2024-09-17T05:13:02.926 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T05:13:02.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T05:13:03.042 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908692 branch: wip-athakkar-testing-2024-09-16-2351 description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}} email: athakkar@redhat.com first_in_suite: false job_id: '7908692' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-athakkar-testing-2024-09-16-2351 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: client mount timeout: 30 debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 820f760e4779dafd30d668ecea7aba6355dfd3d8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 820f760e4779dafd30d668ecea7aba6355dfd3d8 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-athakkar-testing-2024-09-16-2351 sha1: 820f760e4779dafd30d668ecea7aba6355dfd3d8 owner: scheduled_avan@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 448 sha1: 820f760e4779dafd30d668ecea7aba6355dfd3d8 sleep_before_teardown: 0 subset: 1/20 suite: fs:volumes suite_branch: wip-athakkar-testing-2024-09-16-2351 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_820f760e4779dafd30d668ecea7aba6355dfd3d8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 820f760e4779dafd30d668ecea7aba6355dfd3d8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOEtFqiP9toX+ihbeycYKdcQzXI00SFiE4aProN1ZtNrisfn9Ze8qS90+K/X4t3g18CL7SYFt+H+CZ/mfDOFf7Y= smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ5o8pK8GE4c+pmSORYoRYnS5waBRuoWlHEtOUNIJ/vmauIghHkTgk5oqQm9dHaebXK19B2+7MOnpOpwMN9YE1o= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestMisc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_05:02:16 tube: smithi user: avan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T05:13:03.042 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_820f760e4779dafd30d668ecea7aba6355dfd3d8/qa; will attempt to use it 2024-09-17T05:13:03.043 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_820f760e4779dafd30d668ecea7aba6355dfd3d8/qa/tasks 2024-09-17T05:13:03.043 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T05:13:03.044 INFO:teuthology.task.internal:Checking packages... 2024-09-17T05:13:03.066 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '820f760e4779dafd30d668ecea7aba6355dfd3d8' 2024-09-17T05:13:03.066 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T05:13:03.066 INFO:teuthology.packaging:ref: None 2024-09-17T05:13:03.066 INFO:teuthology.packaging:tag: None 2024-09-17T05:13:03.066 INFO:teuthology.packaging:branch: wip-athakkar-testing-2024-09-16-2351 2024-09-17T05:13:03.066 INFO:teuthology.packaging:sha1: 820f760e4779dafd30d668ecea7aba6355dfd3d8 2024-09-17T05:13:03.066 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-athakkar-testing-2024-09-16-2351 2024-09-17T05:13:03.212 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4963-g820f760e-1jammy 2024-09-17T05:13:03.214 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T05:13:03.220 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T05:13:03.220 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T05:13:03.227 INFO:teuthology.task.internal:Saving configuration 2024-09-17T05:13:03.247 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T05:13:03.254 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T05:13:03.280 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908692', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 05:07:08.162838', 'locked_by': 'scheduled_avan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEhXPSOKfIHZflKsJv4MFvHZPzPixz4C6vDSmM4I/mzG'} 2024-09-17T05:13:03.301 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908692', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 05:07:08.164173', 'locked_by': 'scheduled_avan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGfmakQMICpi6oN+r9zlW9NItkmz39UDoKPTV09h7Jiy'} 2024-09-17T05:13:03.302 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T05:13:03.308 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-17T05:13:03.308 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-17T05:13:03.308 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T05:13:03.367 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdaf74a3d90>, signals=[15]) 2024-09-17T05:13:03.367 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T05:13:03.374 INFO:teuthology.task.internal:Opening connections... 2024-09-17T05:13:03.374 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:13:03.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:13:03.457 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:13:03.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:13:03.535 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T05:13:03.542 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2024-09-17T05:13:03.547 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2024-09-17T05:13:03.548 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2024-09-17T05:13:03.595 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T05:13:03.595 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Ubuntu" 2024-09-17T05:13:03.595 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="22.04" 2024-09-17T05:13:03.595 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T05:13:03.595 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_CODENAME=jammy 2024-09-17T05:13:03.596 INFO:teuthology.orchestra.run.smithi031.stdout:ID=ubuntu 2024-09-17T05:13:03.596 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE=debian 2024-09-17T05:13:03.596 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T05:13:03.596 INFO:teuthology.orchestra.run.smithi031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T05:13:03.596 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T05:13:03.596 INFO:teuthology.orchestra.run.smithi031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T05:13:03.596 INFO:teuthology.orchestra.run.smithi031.stdout:UBUNTU_CODENAME=jammy 2024-09-17T05:13:03.597 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2024-09-17T05:13:03.621 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2024-09-17T05:13:03.628 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2024-09-17T05:13:03.628 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2024-09-17T05:13:03.676 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-17T05:13:03.676 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Ubuntu" 2024-09-17T05:13:03.676 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="22.04" 2024-09-17T05:13:03.676 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-17T05:13:03.676 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_CODENAME=jammy 2024-09-17T05:13:03.676 INFO:teuthology.orchestra.run.smithi155.stdout:ID=ubuntu 2024-09-17T05:13:03.676 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE=debian 2024-09-17T05:13:03.676 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-17T05:13:03.677 INFO:teuthology.orchestra.run.smithi155.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-17T05:13:03.677 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-17T05:13:03.677 INFO:teuthology.orchestra.run.smithi155.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-17T05:13:03.677 INFO:teuthology.orchestra.run.smithi155.stdout:UBUNTU_CODENAME=jammy 2024-09-17T05:13:03.677 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2024-09-17T05:13:03.695 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T05:13:03.705 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T05:13:03.711 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T05:13:03.711 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2024-09-17T05:13:03.714 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2024-09-17T05:13:03.723 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T05:13:03.730 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T05:13:03.730 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2024-09-17T05:13:03.761 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2024-09-17T05:13:03.970 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T05:13:04.028 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T05:13:04.045 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-17T05:13:04.045 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-17T05:13:04.045 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-17T05:13:04.045 DEBUG:teuthology.orchestra.run.smithi031:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T05:13:04.046 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T05:13:04.051 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:13:04.051 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:13:04.052 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-09-17T05:13:04.053 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-09-17T05:13:04.214 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T05:13:04.215 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-17T05:13:04.215 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2024-09-17T05:13:04.220 INFO:teuthology.orchestra.run.smithi155.stdout:5.15.0-56-generic 2024-09-17T05:13:04.221 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T05:13:04.221 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-17T05:13:04.221 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-09-17T05:13:04.221 DEBUG:teuthology.orchestra.run.smithi155:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-17T05:13:04.238 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T05:13:04.238 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-17T05:13:04.238 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-09-17T05:13:04.245 INFO:teuthology.orchestra.run.smithi031.stdout:5.15.0-56-generic 2024-09-17T05:13:04.245 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T05:13:04.245 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-17T05:13:04.245 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-09-17T05:13:04.245 DEBUG:teuthology.orchestra.run.smithi031:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-17T05:13:04.284 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-17T05:13:04.306 INFO:teuthology.orchestra.run.smithi031.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-17T05:13:04.413 INFO:teuthology.orchestra.run.smithi155.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-17T05:13:04.413 INFO:teuthology.orchestra.run.smithi155.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-17T05:13:04.414 INFO:teuthology.orchestra.run.smithi155.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-17T05:13:04.414 INFO:teuthology.orchestra.run.smithi155.stderr:hint: 2024-09-17T05:13:04.414 INFO:teuthology.orchestra.run.smithi155.stderr:hint: git config --global init.defaultBranch 2024-09-17T05:13:04.414 INFO:teuthology.orchestra.run.smithi155.stderr:hint: 2024-09-17T05:13:04.414 INFO:teuthology.orchestra.run.smithi155.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-17T05:13:04.414 INFO:teuthology.orchestra.run.smithi155.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-17T05:13:04.414 INFO:teuthology.orchestra.run.smithi155.stderr:hint: 2024-09-17T05:13:04.414 INFO:teuthology.orchestra.run.smithi155.stderr:hint: git branch -m 2024-09-17T05:13:04.415 INFO:teuthology.orchestra.run.smithi155.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-17T05:13:04.416 DEBUG:teuthology.orchestra.run.smithi155:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-17T05:13:04.437 INFO:teuthology.orchestra.run.smithi031.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-17T05:13:04.437 INFO:teuthology.orchestra.run.smithi031.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-17T05:13:04.438 INFO:teuthology.orchestra.run.smithi031.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-17T05:13:04.438 INFO:teuthology.orchestra.run.smithi031.stderr:hint: 2024-09-17T05:13:04.438 INFO:teuthology.orchestra.run.smithi031.stderr:hint: git config --global init.defaultBranch 2024-09-17T05:13:04.438 INFO:teuthology.orchestra.run.smithi031.stderr:hint: 2024-09-17T05:13:04.438 INFO:teuthology.orchestra.run.smithi031.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-17T05:13:04.438 INFO:teuthology.orchestra.run.smithi031.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-17T05:13:04.438 INFO:teuthology.orchestra.run.smithi031.stderr:hint: 2024-09-17T05:13:04.438 INFO:teuthology.orchestra.run.smithi031.stderr:hint: git branch -m 2024-09-17T05:13:04.439 INFO:teuthology.orchestra.run.smithi031.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-17T05:13:04.441 DEBUG:teuthology.orchestra.run.smithi031:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-17T05:13:04.483 DEBUG:teuthology.orchestra.run.smithi155:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-17T05:13:04.515 DEBUG:teuthology.orchestra.run.smithi031:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-17T05:13:04.540 DEBUG:teuthology.orchestra.run.smithi155:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-17T05:13:04.576 DEBUG:teuthology.orchestra.run.smithi031:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-17T05:13:26.714 INFO:teuthology.orchestra.run.smithi155.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-17T05:13:26.714 INFO:teuthology.orchestra.run.smithi155.stderr: * [new branch] main -> origin/main 2024-09-17T05:13:26.751 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20190312 -> 20190312 2024-09-17T05:13:26.752 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20190416 -> 20190416 2024-09-17T05:13:26.752 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20190514 -> 20190514 2024-09-17T05:13:26.752 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20190618 -> 20190618 2024-09-17T05:13:26.752 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20190717 -> 20190717 2024-09-17T05:13:26.752 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20190815 -> 20190815 2024-09-17T05:13:26.752 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20190923 -> 20190923 2024-09-17T05:13:26.752 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20191022 -> 20191022 2024-09-17T05:13:26.752 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20191215 -> 20191215 2024-09-17T05:13:26.752 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20200122 -> 20200122 2024-09-17T05:13:26.755 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20200316 -> 20200316 2024-09-17T05:13:26.755 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20200421 -> 20200421 2024-09-17T05:13:26.755 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20200519 -> 20200519 2024-09-17T05:13:26.755 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20200619 -> 20200619 2024-09-17T05:13:26.755 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20200721 -> 20200721 2024-09-17T05:13:26.755 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20200817 -> 20200817 2024-09-17T05:13:26.755 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20200918 -> 20200918 2024-09-17T05:13:26.755 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20201022 -> 20201022 2024-09-17T05:13:26.755 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20201118 -> 20201118 2024-09-17T05:13:26.755 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20201218 -> 20201218 2024-09-17T05:13:26.755 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20210208 -> 20210208 2024-09-17T05:13:26.756 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20210315 -> 20210315 2024-09-17T05:13:26.756 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20210511 -> 20210511 2024-09-17T05:13:26.756 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20210716 -> 20210716 2024-09-17T05:13:26.756 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20210818 -> 20210818 2024-09-17T05:13:26.756 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20210919 -> 20210919 2024-09-17T05:13:26.756 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20211027 -> 20211027 2024-09-17T05:13:26.756 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20211216 -> 20211216 2024-09-17T05:13:26.756 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20220209 -> 20220209 2024-09-17T05:13:26.756 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20220310 -> 20220310 2024-09-17T05:13:26.756 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20220411 -> 20220411 2024-09-17T05:13:26.756 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20220509 -> 20220509 2024-09-17T05:13:26.759 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20220610 -> 20220610 2024-09-17T05:13:26.759 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20220708 -> 20220708 2024-09-17T05:13:26.759 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20220815 -> 20220815 2024-09-17T05:13:26.759 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20220913 -> 20220913 2024-09-17T05:13:26.759 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20221012 -> 20221012 2024-09-17T05:13:26.759 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20221109 -> 20221109 2024-09-17T05:13:26.760 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20221214 -> 20221214 2024-09-17T05:13:26.760 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20230117 -> 20230117 2024-09-17T05:13:26.760 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20230210 -> 20230210 2024-09-17T05:13:26.760 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20230310 -> 20230310 2024-09-17T05:13:26.760 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20230404 -> 20230404 2024-09-17T05:13:26.760 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20230515 -> 20230515 2024-09-17T05:13:26.760 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20230625 -> 20230625 2024-09-17T05:13:26.760 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20230804 -> 20230804 2024-09-17T05:13:26.760 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20230919 -> 20230919 2024-09-17T05:13:26.760 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20231030 -> 20231030 2024-09-17T05:13:26.760 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20231111 -> 20231111 2024-09-17T05:13:26.760 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20231211 -> 20231211 2024-09-17T05:13:26.761 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20240115 -> 20240115 2024-09-17T05:13:26.761 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20240220 -> 20240220 2024-09-17T05:13:26.761 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20240312 -> 20240312 2024-09-17T05:13:26.761 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20240410 -> 20240410 2024-09-17T05:13:26.761 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20240513 -> 20240513 2024-09-17T05:13:26.761 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20240610 -> 20240610 2024-09-17T05:13:26.761 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20240709 -> 20240709 2024-09-17T05:13:26.761 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20240811 -> 20240811 2024-09-17T05:13:26.761 INFO:teuthology.orchestra.run.smithi155.stderr: * [new tag] 20240909 -> 20240909 2024-09-17T05:13:31.349 INFO:teuthology.orchestra.run.smithi155.stderr:Updating files: 44% (1549/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 59% (2077/3520) Updating files: 59% (2079/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 69% (2429/3520) Updating files: 69% (2435/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 82% (2887/3520) Updating files: 82% (2902/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-17T05:13:31.354 INFO:teuthology.orchestra.run.smithi155.stdout:HEAD is now at 6c88d9b8 Merge branch 'amd-staging' into 'main' 2024-09-17T05:13:31.376 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-17T05:13:31.377 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T05:13:31.522 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-17T05:13:31.522 DEBUG:teuthology.orchestra.run.smithi155:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-17T05:13:31.525 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi155.front.sepia.ceph.com to complete... 2024-09-17T05:13:32.509 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17 05:13:32 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-17T05:13:32.509 INFO:teuthology.orchestra.run.smithi155.stderr:FINISHED --2024-09-17 05:13:32-- 2024-09-17T05:13:32.509 INFO:teuthology.orchestra.run.smithi155.stderr:Total wall clock time: 1.0s 2024-09-17T05:13:32.509 INFO:teuthology.orchestra.run.smithi155.stderr:Downloaded: 1 files, 43M in 0.8s (51.9 MB/s) 2024-09-17T05:13:32.513 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-17T05:13:32.513 DEBUG:teuthology.orchestra.run.smithi155:> sudo dpkg -i /tmp/linux-image.deb 2024-09-17T05:13:32.708 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-17T05:13:34.649 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-17T05:13:34.654 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-17T05:13:34.755 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-17T05:13:35.064 INFO:teuthology.orchestra.run.smithi031.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-17T05:13:35.064 INFO:teuthology.orchestra.run.smithi031.stderr: * [new branch] main -> origin/main 2024-09-17T05:13:35.102 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190312 -> 20190312 2024-09-17T05:13:35.102 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190416 -> 20190416 2024-09-17T05:13:35.102 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190514 -> 20190514 2024-09-17T05:13:35.103 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190618 -> 20190618 2024-09-17T05:13:35.103 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190717 -> 20190717 2024-09-17T05:13:35.103 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190815 -> 20190815 2024-09-17T05:13:35.103 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190923 -> 20190923 2024-09-17T05:13:35.103 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20191022 -> 20191022 2024-09-17T05:13:35.105 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20191215 -> 20191215 2024-09-17T05:13:35.105 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200122 -> 20200122 2024-09-17T05:13:35.105 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200316 -> 20200316 2024-09-17T05:13:35.105 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200421 -> 20200421 2024-09-17T05:13:35.105 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200519 -> 20200519 2024-09-17T05:13:35.106 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200619 -> 20200619 2024-09-17T05:13:35.106 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200721 -> 20200721 2024-09-17T05:13:35.106 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200817 -> 20200817 2024-09-17T05:13:35.106 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200918 -> 20200918 2024-09-17T05:13:35.106 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20201022 -> 20201022 2024-09-17T05:13:35.106 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20201118 -> 20201118 2024-09-17T05:13:35.106 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20201218 -> 20201218 2024-09-17T05:13:35.106 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20210208 -> 20210208 2024-09-17T05:13:35.106 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20210315 -> 20210315 2024-09-17T05:13:35.106 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20210511 -> 20210511 2024-09-17T05:13:35.106 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20210716 -> 20210716 2024-09-17T05:13:35.106 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20210818 -> 20210818 2024-09-17T05:13:35.107 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20210919 -> 20210919 2024-09-17T05:13:35.107 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20211027 -> 20211027 2024-09-17T05:13:35.107 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20211216 -> 20211216 2024-09-17T05:13:35.110 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220209 -> 20220209 2024-09-17T05:13:35.110 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220310 -> 20220310 2024-09-17T05:13:35.110 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220411 -> 20220411 2024-09-17T05:13:35.110 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220509 -> 20220509 2024-09-17T05:13:35.110 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220610 -> 20220610 2024-09-17T05:13:35.110 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220708 -> 20220708 2024-09-17T05:13:35.111 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220815 -> 20220815 2024-09-17T05:13:35.111 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220913 -> 20220913 2024-09-17T05:13:35.111 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20221012 -> 20221012 2024-09-17T05:13:35.111 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20221109 -> 20221109 2024-09-17T05:13:35.111 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20221214 -> 20221214 2024-09-17T05:13:35.111 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230117 -> 20230117 2024-09-17T05:13:35.111 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230210 -> 20230210 2024-09-17T05:13:35.111 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230310 -> 20230310 2024-09-17T05:13:35.111 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230404 -> 20230404 2024-09-17T05:13:35.111 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230515 -> 20230515 2024-09-17T05:13:35.111 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230625 -> 20230625 2024-09-17T05:13:35.111 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230804 -> 20230804 2024-09-17T05:13:35.112 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230919 -> 20230919 2024-09-17T05:13:35.112 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20231030 -> 20231030 2024-09-17T05:13:35.112 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20231111 -> 20231111 2024-09-17T05:13:35.112 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20231211 -> 20231211 2024-09-17T05:13:35.112 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20240115 -> 20240115 2024-09-17T05:13:35.112 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20240220 -> 20240220 2024-09-17T05:13:35.112 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20240312 -> 20240312 2024-09-17T05:13:35.112 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20240410 -> 20240410 2024-09-17T05:13:35.112 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20240513 -> 20240513 2024-09-17T05:13:35.112 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20240610 -> 20240610 2024-09-17T05:13:35.112 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20240709 -> 20240709 2024-09-17T05:13:35.112 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20240811 -> 20240811 2024-09-17T05:13:35.113 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20240909 -> 20240909 2024-09-17T05:13:38.603 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-17T05:13:38.704 INFO:teuthology.orchestra.run.smithi155.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:13:39.974 INFO:teuthology.orchestra.run.smithi031.stderr:Updating files: 28% (998/3520) Updating files: 29% (1021/3520) Updating files: 30% (1056/3520) Updating files: 31% (1092/3520) Updating files: 32% (1127/3520) Updating files: 33% (1162/3520) Updating files: 34% (1197/3520) Updating files: 35% (1232/3520) Updating files: 36% (1268/3520) Updating files: 37% (1303/3520) Updating files: 38% (1338/3520) Updating files: 39% (1373/3520) Updating files: 40% (1408/3520) Updating files: 41% (1444/3520) Updating files: 42% (1479/3520) Updating files: 43% (1514/3520) Updating files: 44% (1549/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 58% (2054/3520) Updating files: 59% (2077/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 68% (2426/3520) Updating files: 69% (2429/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 81% (2884/3520) Updating files: 82% (2887/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-17T05:13:39.979 INFO:teuthology.orchestra.run.smithi031.stdout:HEAD is now at 6c88d9b8 Merge branch 'amd-staging' into 'main' 2024-09-17T05:13:40.003 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-17T05:13:40.004 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-17T05:13:40.150 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-17T05:13:40.150 DEBUG:teuthology.orchestra.run.smithi031:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-17T05:13:40.153 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi031.front.sepia.ceph.com to complete... 2024-09-17T05:13:41.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17 05:13:40 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-17T05:13:41.136 INFO:teuthology.orchestra.run.smithi031.stderr:FINISHED --2024-09-17 05:13:40-- 2024-09-17T05:13:41.136 INFO:teuthology.orchestra.run.smithi031.stderr:Total wall clock time: 1.0s 2024-09-17T05:13:41.136 INFO:teuthology.orchestra.run.smithi031.stderr:Downloaded: 1 files, 43M in 0.8s (52.0 MB/s) 2024-09-17T05:13:41.141 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-17T05:13:41.142 DEBUG:teuthology.orchestra.run.smithi031:> sudo dpkg -i /tmp/linux-image.deb 2024-09-17T05:13:41.348 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-17T05:13:43.327 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-17T05:13:43.331 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-17T05:13:43.497 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-17T05:13:47.514 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-17T05:13:47.612 INFO:teuthology.orchestra.run.smithi031.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:01.360 INFO:teuthology.orchestra.run.smithi155.stderr:Sourcing file `/etc/default/grub' 2024-09-17T05:14:01.381 INFO:teuthology.orchestra.run.smithi155.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T05:14:01.412 INFO:teuthology.orchestra.run.smithi155.stderr:Generating grub configuration file ... 2024-09-17T05:14:01.699 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:01.714 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:01.998 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T05:14:02.008 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T05:14:02.072 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T05:14:02.077 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T05:14:02.237 INFO:teuthology.orchestra.run.smithi155.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T05:14:02.237 INFO:teuthology.orchestra.run.smithi155.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T05:14:02.237 INFO:teuthology.orchestra.run.smithi155.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T05:14:02.283 INFO:teuthology.orchestra.run.smithi155.stderr:done 2024-09-17T05:14:02.439 DEBUG:teuthology.orchestra.run.smithi155:> dpkg-deb -c /tmp/linux-image.deb 2024-09-17T05:14:02.447 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-17T05:14:02.447 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-17T05:14:02.447 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:02.462 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:02.462 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:02.484 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-17T05:14:02.485 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-17T05:14:02.485 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-17T05:14:02.485 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-17T05:14:02.485 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-17T05:14:02.485 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-17T05:14:02.485 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-17T05:14:02.485 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-17T05:14:02.485 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-17T05:14:02.485 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-17T05:14:02.485 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-17T05:14:02.485 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-17T05:14:02.485 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-17T05:14:02.486 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-17T05:14:02.486 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-17T05:14:02.486 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-17T05:14:02.486 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-17T05:14:02.486 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-17T05:14:02.486 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-17T05:14:02.486 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-17T05:14:02.486 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-17T05:14:02.486 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-17T05:14:02.486 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-17T05:14:02.486 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-17T05:14:02.486 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-17T05:14:02.487 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-17T05:14:02.487 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-17T05:14:02.487 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-17T05:14:02.487 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-17T05:14:02.487 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-17T05:14:02.487 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-17T05:14:02.487 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-17T05:14:02.487 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-17T05:14:02.487 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-17T05:14:02.487 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-17T05:14:02.487 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-17T05:14:02.487 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-17T05:14:02.487 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-17T05:14:02.488 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-17T05:14:02.488 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-17T05:14:02.488 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-17T05:14:02.488 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-17T05:14:02.488 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-17T05:14:02.563 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-17T05:14:02.564 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-17T05:14:02.564 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-17T05:14:02.564 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-17T05:14:02.564 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-17T05:14:02.564 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-17T05:14:02.564 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-17T05:14:02.564 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-17T05:14:02.564 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-17T05:14:02.564 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-17T05:14:02.564 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-17T05:14:02.564 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-17T05:14:02.565 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-17T05:14:02.565 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-17T05:14:02.565 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-17T05:14:02.565 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-17T05:14:02.565 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-17T05:14:02.565 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-17T05:14:02.565 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-17T05:14:02.565 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-17T05:14:02.565 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-17T05:14:02.565 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-17T05:14:02.565 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-17T05:14:02.565 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-17T05:14:02.566 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-17T05:14:02.566 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-17T05:14:02.566 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-17T05:14:02.566 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-17T05:14:02.566 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-17T05:14:02.566 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-17T05:14:02.566 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-17T05:14:02.566 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-17T05:14:02.566 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-17T05:14:02.566 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-17T05:14:02.566 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-17T05:14:02.566 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-17T05:14:02.567 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-17T05:14:02.567 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-17T05:14:02.567 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-17T05:14:02.567 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-17T05:14:02.567 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-17T05:14:02.567 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-17T05:14:02.567 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-17T05:14:02.567 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-17T05:14:02.567 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-17T05:14:02.567 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-17T05:14:02.567 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-17T05:14:02.567 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-17T05:14:02.567 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-17T05:14:02.568 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-17T05:14:02.568 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-17T05:14:02.568 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-17T05:14:02.568 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-17T05:14:02.568 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-17T05:14:02.568 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-17T05:14:02.568 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-17T05:14:02.568 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-17T05:14:02.568 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-17T05:14:02.568 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-17T05:14:02.568 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-17T05:14:02.568 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-17T05:14:02.569 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-17T05:14:02.569 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-17T05:14:02.569 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-17T05:14:02.569 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-17T05:14:02.569 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-17T05:14:02.569 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-17T05:14:02.569 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-17T05:14:02.569 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-17T05:14:02.569 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-17T05:14:02.569 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-17T05:14:02.569 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-17T05:14:02.569 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-17T05:14:02.570 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-17T05:14:02.570 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-17T05:14:02.570 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-17T05:14:02.570 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-17T05:14:02.570 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-17T05:14:02.570 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-17T05:14:02.570 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-17T05:14:02.570 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-17T05:14:02.570 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-17T05:14:02.570 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-17T05:14:02.570 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-17T05:14:02.570 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-17T05:14:02.570 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-17T05:14:02.571 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-17T05:14:02.571 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-17T05:14:02.571 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-17T05:14:02.571 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-17T05:14:02.571 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-17T05:14:02.571 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-17T05:14:02.571 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-17T05:14:02.571 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-17T05:14:02.571 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-17T05:14:02.571 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-17T05:14:02.571 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-17T05:14:02.571 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-17T05:14:02.571 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-17T05:14:02.572 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-17T05:14:02.572 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-17T05:14:02.572 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-17T05:14:02.572 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-17T05:14:02.572 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-17T05:14:02.572 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-17T05:14:02.572 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-17T05:14:02.572 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-17T05:14:02.572 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-17T05:14:02.572 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-17T05:14:02.572 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-17T05:14:02.572 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-17T05:14:02.573 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-17T05:14:02.573 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-17T05:14:02.573 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-17T05:14:02.573 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-17T05:14:02.573 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-17T05:14:02.573 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-17T05:14:02.573 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-17T05:14:02.573 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-17T05:14:02.573 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-17T05:14:02.573 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-17T05:14:02.573 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-17T05:14:02.573 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-17T05:14:02.573 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-17T05:14:02.574 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-17T05:14:02.574 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-17T05:14:02.574 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-17T05:14:02.574 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-17T05:14:02.574 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-17T05:14:02.574 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-17T05:14:02.574 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-17T05:14:02.574 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-17T05:14:02.574 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-17T05:14:02.574 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-17T05:14:02.574 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-17T05:14:02.574 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-17T05:14:02.574 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-17T05:14:02.575 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-17T05:14:02.575 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-17T05:14:02.575 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-17T05:14:02.575 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-17T05:14:02.575 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-17T05:14:02.575 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-17T05:14:02.575 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-17T05:14:02.575 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-17T05:14:02.575 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-17T05:14:02.575 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-17T05:14:02.575 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-17T05:14:02.575 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-17T05:14:02.576 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-17T05:14:02.576 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-17T05:14:02.576 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-17T05:14:02.576 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-17T05:14:02.576 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-17T05:14:02.576 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-17T05:14:02.576 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-17T05:14:02.576 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-17T05:14:02.576 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-17T05:14:02.576 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-17T05:14:02.576 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-17T05:14:02.576 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-17T05:14:02.577 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-17T05:14:02.577 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-17T05:14:02.577 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-17T05:14:02.577 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-17T05:14:02.577 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-17T05:14:02.577 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-17T05:14:02.577 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-17T05:14:02.577 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-17T05:14:02.577 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-17T05:14:02.577 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-17T05:14:02.577 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-17T05:14:02.577 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-17T05:14:02.578 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-17T05:14:02.578 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-17T05:14:02.578 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-17T05:14:02.578 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-17T05:14:02.578 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-17T05:14:02.578 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-17T05:14:02.578 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-17T05:14:02.578 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-17T05:14:02.578 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-17T05:14:02.578 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-17T05:14:02.578 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-17T05:14:02.578 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-17T05:14:02.579 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-17T05:14:02.579 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-17T05:14:02.579 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-17T05:14:02.579 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-17T05:14:02.579 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-17T05:14:02.579 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-17T05:14:02.579 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-17T05:14:02.579 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-17T05:14:02.579 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-17T05:14:02.579 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-17T05:14:02.579 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-17T05:14:02.579 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-17T05:14:02.579 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-17T05:14:02.580 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-17T05:14:02.580 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-17T05:14:02.580 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-17T05:14:02.580 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-17T05:14:02.580 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-17T05:14:02.580 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-17T05:14:02.580 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-17T05:14:02.580 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-17T05:14:02.580 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-17T05:14:02.580 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-17T05:14:02.580 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-17T05:14:02.580 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-17T05:14:02.581 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-17T05:14:02.581 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-17T05:14:02.581 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-17T05:14:02.581 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-17T05:14:02.581 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-17T05:14:02.581 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-17T05:14:02.581 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-17T05:14:02.581 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-17T05:14:02.581 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-17T05:14:02.581 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-17T05:14:02.581 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-17T05:14:02.581 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-17T05:14:02.582 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-17T05:14:02.582 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-17T05:14:02.582 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-17T05:14:02.582 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-17T05:14:02.582 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-17T05:14:02.582 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-17T05:14:02.582 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-17T05:14:02.582 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-17T05:14:02.582 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-17T05:14:02.582 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-17T05:14:02.582 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-17T05:14:02.582 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-17T05:14:02.582 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-17T05:14:02.583 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-17T05:14:02.583 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-17T05:14:02.583 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-17T05:14:02.583 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-17T05:14:02.583 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-17T05:14:02.583 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-17T05:14:02.583 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-17T05:14:02.583 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-17T05:14:02.583 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-17T05:14:02.583 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-17T05:14:02.583 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-17T05:14:02.583 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-17T05:14:02.583 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-17T05:14:02.584 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-17T05:14:02.584 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-17T05:14:02.584 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-17T05:14:02.584 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-17T05:14:02.584 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-17T05:14:02.584 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-17T05:14:02.584 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-17T05:14:02.584 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-17T05:14:02.584 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-17T05:14:02.584 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-17T05:14:02.584 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-17T05:14:02.584 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-17T05:14:02.585 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-17T05:14:02.585 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-17T05:14:02.585 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-17T05:14:02.585 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-17T05:14:02.585 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-17T05:14:02.585 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-17T05:14:02.585 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-17T05:14:02.585 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-17T05:14:02.585 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-17T05:14:02.585 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-17T05:14:02.585 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-17T05:14:02.585 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-17T05:14:02.586 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-17T05:14:02.586 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-17T05:14:02.586 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-17T05:14:02.586 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-17T05:14:02.586 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-17T05:14:02.586 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-17T05:14:02.586 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-17T05:14:02.586 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-17T05:14:02.586 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-17T05:14:02.586 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-17T05:14:02.586 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-17T05:14:02.586 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-17T05:14:02.587 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-17T05:14:02.587 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-17T05:14:02.587 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-17T05:14:02.587 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-17T05:14:02.587 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-17T05:14:02.587 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-17T05:14:02.587 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-17T05:14:02.587 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-17T05:14:02.587 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-17T05:14:02.587 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-17T05:14:02.587 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-17T05:14:02.587 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-17T05:14:02.588 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-17T05:14:02.588 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-17T05:14:02.588 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-17T05:14:02.588 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-17T05:14:02.588 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-17T05:14:02.588 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-17T05:14:02.588 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-17T05:14:02.588 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-17T05:14:02.588 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-17T05:14:02.588 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-17T05:14:02.588 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-17T05:14:02.588 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-17T05:14:02.589 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-17T05:14:02.589 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-17T05:14:02.589 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-17T05:14:02.589 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-17T05:14:02.589 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-17T05:14:02.589 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-17T05:14:02.589 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-17T05:14:02.589 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-17T05:14:02.589 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-17T05:14:02.589 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-17T05:14:02.589 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-17T05:14:02.589 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-17T05:14:02.590 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-17T05:14:02.590 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-17T05:14:02.590 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-17T05:14:02.590 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-17T05:14:02.590 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-17T05:14:02.590 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-17T05:14:02.590 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-17T05:14:02.590 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-17T05:14:02.590 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-17T05:14:02.590 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-17T05:14:02.590 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-17T05:14:02.590 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-17T05:14:02.590 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-17T05:14:02.591 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-17T05:14:02.591 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-17T05:14:02.591 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-17T05:14:02.591 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-17T05:14:02.591 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-17T05:14:02.591 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-17T05:14:02.591 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-17T05:14:02.591 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-17T05:14:02.591 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-17T05:14:02.591 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-17T05:14:02.591 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-17T05:14:02.591 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-17T05:14:02.592 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-17T05:14:02.592 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-17T05:14:02.592 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-17T05:14:02.592 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-17T05:14:02.592 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-17T05:14:02.592 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-17T05:14:02.592 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-17T05:14:02.592 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-17T05:14:02.592 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-17T05:14:02.592 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-17T05:14:02.592 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-17T05:14:02.592 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-17T05:14:02.592 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-17T05:14:02.593 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-17T05:14:02.593 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-17T05:14:02.593 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-17T05:14:02.593 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-17T05:14:02.593 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-17T05:14:02.593 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-17T05:14:02.593 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-17T05:14:02.593 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-17T05:14:02.593 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-17T05:14:02.593 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-17T05:14:02.593 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-17T05:14:02.593 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-17T05:14:02.594 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-17T05:14:02.594 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-17T05:14:02.594 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-17T05:14:02.594 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-17T05:14:02.594 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-17T05:14:02.594 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-17T05:14:02.594 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-17T05:14:02.594 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-17T05:14:02.594 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-17T05:14:02.594 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-17T05:14:02.594 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-17T05:14:02.595 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-17T05:14:02.595 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-17T05:14:02.595 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-17T05:14:02.595 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-17T05:14:02.595 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-17T05:14:02.595 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-17T05:14:02.595 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-17T05:14:02.595 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-17T05:14:02.595 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-17T05:14:02.595 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-17T05:14:02.595 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-17T05:14:02.595 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-17T05:14:02.596 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-17T05:14:02.596 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-17T05:14:02.596 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-17T05:14:02.596 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-17T05:14:02.596 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-17T05:14:02.596 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-17T05:14:02.596 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-17T05:14:02.596 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-17T05:14:02.596 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-17T05:14:02.596 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-17T05:14:02.596 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-17T05:14:02.596 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-17T05:14:02.596 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-17T05:14:02.597 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-17T05:14:02.597 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-17T05:14:02.597 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-17T05:14:02.597 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-17T05:14:02.597 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-17T05:14:02.597 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-17T05:14:02.597 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-17T05:14:02.597 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-17T05:14:02.597 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-17T05:14:02.597 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-17T05:14:02.597 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-17T05:14:02.597 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-17T05:14:02.598 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-17T05:14:02.598 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-17T05:14:02.598 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-17T05:14:02.598 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-17T05:14:02.598 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-17T05:14:02.598 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-17T05:14:02.598 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-17T05:14:02.598 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-17T05:14:02.598 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-17T05:14:02.598 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-17T05:14:02.598 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-17T05:14:02.598 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-17T05:14:02.598 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-17T05:14:02.599 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-17T05:14:02.599 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-17T05:14:02.599 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-17T05:14:02.599 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-17T05:14:02.599 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-17T05:14:02.599 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-17T05:14:02.599 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-17T05:14:02.599 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-17T05:14:02.599 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-17T05:14:02.599 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-17T05:14:02.599 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-17T05:14:02.599 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-17T05:14:02.599 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-17T05:14:02.600 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-17T05:14:02.600 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-17T05:14:02.600 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-17T05:14:02.600 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-17T05:14:02.600 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-17T05:14:02.600 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-17T05:14:02.600 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-17T05:14:02.600 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-17T05:14:02.600 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-17T05:14:02.600 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-17T05:14:02.600 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-17T05:14:02.600 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-17T05:14:02.600 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-17T05:14:02.601 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-17T05:14:02.601 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-17T05:14:02.601 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-17T05:14:02.601 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-17T05:14:02.601 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-17T05:14:02.601 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-17T05:14:02.601 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-17T05:14:02.601 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-17T05:14:02.601 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-17T05:14:02.601 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-17T05:14:02.601 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-17T05:14:02.601 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-17T05:14:02.601 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-17T05:14:02.602 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-17T05:14:02.602 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-17T05:14:02.602 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-17T05:14:02.602 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-17T05:14:02.602 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-17T05:14:02.602 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-17T05:14:02.602 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-17T05:14:02.602 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-17T05:14:02.602 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-17T05:14:02.602 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-17T05:14:02.602 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-17T05:14:02.602 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-17T05:14:02.602 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-17T05:14:02.603 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-17T05:14:02.603 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-17T05:14:02.603 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-17T05:14:02.603 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-17T05:14:02.603 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-17T05:14:02.603 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-17T05:14:02.603 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-17T05:14:02.603 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-17T05:14:02.603 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-17T05:14:02.603 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-17T05:14:02.603 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-17T05:14:02.603 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-17T05:14:02.603 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-17T05:14:02.604 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-17T05:14:02.604 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-17T05:14:02.604 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-17T05:14:02.604 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-17T05:14:02.604 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-17T05:14:02.604 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-17T05:14:02.604 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-17T05:14:02.604 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-17T05:14:02.604 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-17T05:14:02.604 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-17T05:14:02.604 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-17T05:14:02.604 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-17T05:14:02.605 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-17T05:14:02.605 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-17T05:14:02.605 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-17T05:14:02.605 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-17T05:14:02.605 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-17T05:14:02.605 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-17T05:14:02.605 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-17T05:14:02.605 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-17T05:14:02.605 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-17T05:14:02.605 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-17T05:14:02.605 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-17T05:14:02.605 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-17T05:14:02.606 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-17T05:14:02.606 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-17T05:14:02.606 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-17T05:14:02.606 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-17T05:14:02.606 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-17T05:14:02.606 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-17T05:14:02.606 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-17T05:14:02.606 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-17T05:14:02.606 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-17T05:14:02.606 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-17T05:14:02.606 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-17T05:14:02.606 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-17T05:14:02.606 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-17T05:14:02.607 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-17T05:14:02.607 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-17T05:14:02.607 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-17T05:14:02.607 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-17T05:14:02.607 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-17T05:14:02.607 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-17T05:14:02.607 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-17T05:14:02.607 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-17T05:14:02.607 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-17T05:14:02.607 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-17T05:14:02.607 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-17T05:14:02.607 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-17T05:14:02.608 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-17T05:14:02.608 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-17T05:14:02.608 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-17T05:14:02.608 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-17T05:14:02.608 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-17T05:14:02.608 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-17T05:14:02.608 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-17T05:14:02.608 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-17T05:14:02.608 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-17T05:14:02.608 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-17T05:14:02.608 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-17T05:14:02.608 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-17T05:14:02.608 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-17T05:14:02.609 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-17T05:14:02.609 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-17T05:14:02.609 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-17T05:14:02.609 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-17T05:14:02.609 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-17T05:14:02.609 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-17T05:14:02.609 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-17T05:14:02.609 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-17T05:14:02.609 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-17T05:14:02.609 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-17T05:14:02.609 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-17T05:14:02.609 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-17T05:14:02.609 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-17T05:14:02.610 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-17T05:14:02.610 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-17T05:14:02.610 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-17T05:14:02.610 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-17T05:14:02.610 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-17T05:14:02.610 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-17T05:14:02.610 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-17T05:14:02.610 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-17T05:14:02.610 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-17T05:14:02.610 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-17T05:14:02.610 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-17T05:14:02.610 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-17T05:14:02.610 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-17T05:14:02.611 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-17T05:14:02.611 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-17T05:14:02.611 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-17T05:14:02.611 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-17T05:14:02.611 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-17T05:14:02.611 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-17T05:14:02.611 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-17T05:14:02.611 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-17T05:14:02.611 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-17T05:14:02.611 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-17T05:14:02.611 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-17T05:14:02.611 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-17T05:14:02.612 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-17T05:14:02.612 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-17T05:14:02.612 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-17T05:14:02.612 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-17T05:14:02.612 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-17T05:14:02.612 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-17T05:14:02.612 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-17T05:14:02.612 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-17T05:14:02.612 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-17T05:14:02.612 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-17T05:14:02.612 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-17T05:14:02.612 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-17T05:14:02.613 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-17T05:14:02.613 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-17T05:14:02.613 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-17T05:14:02.613 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-17T05:14:02.613 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-17T05:14:02.613 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-17T05:14:02.613 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-17T05:14:02.613 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-17T05:14:02.613 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-17T05:14:02.613 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-17T05:14:02.613 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-17T05:14:02.613 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-17T05:14:02.613 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-17T05:14:02.614 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-17T05:14:02.614 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-17T05:14:02.614 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-17T05:14:02.614 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-17T05:14:02.614 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-17T05:14:02.614 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-17T05:14:02.614 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-17T05:14:02.614 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-17T05:14:02.614 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-17T05:14:02.614 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-17T05:14:02.614 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-17T05:14:02.614 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-17T05:14:02.614 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-17T05:14:02.615 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-17T05:14:02.615 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-17T05:14:02.615 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-17T05:14:02.615 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-17T05:14:02.615 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-17T05:14:02.615 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-17T05:14:02.615 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-17T05:14:02.615 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-17T05:14:02.615 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-17T05:14:02.615 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-17T05:14:02.615 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-17T05:14:02.615 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-17T05:14:02.615 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-17T05:14:02.616 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-17T05:14:02.616 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-17T05:14:02.616 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-17T05:14:02.616 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-17T05:14:02.616 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-17T05:14:02.616 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-17T05:14:02.616 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-17T05:14:02.616 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-17T05:14:02.616 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-17T05:14:02.617 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-17T05:14:02.617 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-17T05:14:02.617 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-17T05:14:02.617 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-17T05:14:02.617 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-17T05:14:02.617 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-17T05:14:02.617 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-17T05:14:02.617 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-17T05:14:02.617 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-17T05:14:02.617 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-17T05:14:02.617 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-17T05:14:02.617 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-17T05:14:02.618 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-17T05:14:02.618 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-17T05:14:02.618 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-17T05:14:02.618 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-17T05:14:02.618 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-17T05:14:02.618 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-17T05:14:02.618 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-17T05:14:02.618 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-17T05:14:02.618 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-17T05:14:02.618 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-17T05:14:02.618 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-17T05:14:02.618 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-17T05:14:02.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-17T05:14:02.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-17T05:14:02.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-17T05:14:02.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-17T05:14:02.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-17T05:14:02.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-17T05:14:02.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-17T05:14:02.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-17T05:14:02.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-17T05:14:02.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-17T05:14:02.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-17T05:14:02.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-17T05:14:02.619 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-17T05:14:02.620 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-17T05:14:02.620 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-17T05:14:02.620 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-17T05:14:02.620 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-17T05:14:02.620 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-17T05:14:02.620 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-17T05:14:02.620 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-17T05:14:02.620 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-17T05:14:02.620 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-17T05:14:02.620 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-17T05:14:02.620 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-17T05:14:02.620 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-17T05:14:02.621 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-17T05:14:02.621 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-17T05:14:02.621 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-17T05:14:02.621 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-17T05:14:02.621 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-17T05:14:02.621 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-17T05:14:02.621 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-17T05:14:02.621 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-17T05:14:02.621 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-17T05:14:02.621 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-17T05:14:02.621 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-17T05:14:02.621 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-17T05:14:02.621 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-17T05:14:02.622 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-17T05:14:02.622 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-17T05:14:02.622 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-17T05:14:02.622 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-17T05:14:02.622 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-17T05:14:02.622 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-17T05:14:02.622 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-17T05:14:02.622 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-17T05:14:02.622 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-17T05:14:02.622 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-17T05:14:02.622 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-17T05:14:02.622 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-17T05:14:02.623 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-17T05:14:02.623 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-17T05:14:02.623 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-17T05:14:02.623 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-17T05:14:02.623 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-17T05:14:02.623 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-17T05:14:02.623 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-17T05:14:02.623 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-17T05:14:02.623 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-17T05:14:02.623 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-17T05:14:02.623 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-17T05:14:02.623 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-17T05:14:02.624 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-17T05:14:02.624 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-17T05:14:02.624 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-17T05:14:02.624 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-17T05:14:02.624 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-17T05:14:02.624 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-17T05:14:02.624 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-17T05:14:02.624 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-17T05:14:02.624 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-17T05:14:02.624 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-17T05:14:02.624 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-17T05:14:02.624 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-17T05:14:02.625 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-17T05:14:02.625 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-17T05:14:02.625 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-17T05:14:02.625 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-17T05:14:02.625 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-17T05:14:02.625 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-17T05:14:02.625 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-17T05:14:02.625 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-17T05:14:02.625 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-17T05:14:02.625 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-17T05:14:02.625 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-17T05:14:02.625 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-17T05:14:02.625 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-17T05:14:02.626 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-17T05:14:02.626 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-17T05:14:02.626 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-17T05:14:02.626 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-17T05:14:02.626 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-17T05:14:02.626 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-17T05:14:02.626 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-17T05:14:02.626 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-17T05:14:02.626 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-17T05:14:02.626 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-17T05:14:02.626 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-17T05:14:02.626 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-17T05:14:02.626 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-17T05:14:02.627 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-17T05:14:02.627 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-17T05:14:02.627 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-17T05:14:02.627 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-17T05:14:02.627 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-17T05:14:02.627 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-17T05:14:02.627 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-17T05:14:02.627 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-17T05:14:02.627 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-17T05:14:02.627 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-17T05:14:02.627 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-17T05:14:02.627 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-17T05:14:02.628 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-17T05:14:02.628 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-17T05:14:02.628 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-17T05:14:02.628 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-17T05:14:02.628 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-17T05:14:02.628 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-17T05:14:02.628 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-17T05:14:02.628 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-17T05:14:02.628 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-17T05:14:02.628 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-17T05:14:02.628 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-17T05:14:02.628 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-17T05:14:02.628 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-17T05:14:02.629 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-17T05:14:02.629 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-17T05:14:02.629 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-17T05:14:02.629 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-17T05:14:02.629 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-17T05:14:02.629 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-17T05:14:02.629 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-17T05:14:02.629 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-17T05:14:02.629 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-17T05:14:02.629 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-17T05:14:02.629 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-17T05:14:02.629 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-17T05:14:02.630 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-17T05:14:02.630 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-17T05:14:02.630 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-17T05:14:02.630 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-17T05:14:02.630 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-17T05:14:02.630 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-17T05:14:02.630 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-17T05:14:02.630 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-17T05:14:02.630 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-17T05:14:02.630 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-17T05:14:02.630 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-17T05:14:02.630 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-17T05:14:02.630 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-17T05:14:02.630 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-17T05:14:02.631 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-17T05:14:02.631 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-17T05:14:02.631 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-17T05:14:02.631 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-17T05:14:02.631 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-17T05:14:02.631 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-17T05:14:02.631 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-17T05:14:02.631 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-17T05:14:02.631 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-17T05:14:02.631 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-17T05:14:02.631 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-17T05:14:02.631 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-17T05:14:02.631 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-17T05:14:02.632 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-17T05:14:02.632 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-17T05:14:02.632 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-17T05:14:02.632 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-17T05:14:02.632 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-17T05:14:02.632 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-17T05:14:02.632 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-17T05:14:02.711 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-17T05:14:02.711 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-17T05:14:02.711 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-17T05:14:02.711 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-17T05:14:02.711 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-17T05:14:02.711 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-17T05:14:02.711 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-17T05:14:02.711 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-17T05:14:02.711 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-17T05:14:02.711 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-17T05:14:02.712 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-17T05:14:02.712 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-17T05:14:02.712 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-17T05:14:02.712 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-17T05:14:02.712 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-17T05:14:02.712 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-17T05:14:02.712 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-17T05:14:02.712 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-17T05:14:02.712 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-17T05:14:02.712 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-17T05:14:02.712 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-17T05:14:02.712 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-17T05:14:02.712 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-17T05:14:02.713 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-17T05:14:02.713 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-17T05:14:02.713 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-17T05:14:02.713 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-17T05:14:02.713 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-17T05:14:02.713 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-17T05:14:02.713 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-17T05:14:02.713 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-17T05:14:02.713 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-17T05:14:02.713 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-17T05:14:02.714 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-17T05:14:02.714 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-17T05:14:02.714 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-17T05:14:02.714 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-17T05:14:02.714 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-17T05:14:02.714 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-17T05:14:02.714 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-17T05:14:02.714 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-17T05:14:02.714 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-17T05:14:02.714 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-17T05:14:02.714 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-17T05:14:02.714 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-17T05:14:02.714 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-17T05:14:02.715 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-17T05:14:02.715 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-17T05:14:02.715 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-17T05:14:02.715 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-17T05:14:02.715 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-17T05:14:02.715 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-17T05:14:02.715 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-17T05:14:02.715 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-17T05:14:02.715 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-17T05:14:02.715 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-17T05:14:02.715 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-17T05:14:02.715 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-17T05:14:02.716 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-17T05:14:02.716 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-17T05:14:02.716 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-17T05:14:02.716 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-17T05:14:02.716 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-17T05:14:02.716 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-17T05:14:02.716 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-17T05:14:02.716 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-17T05:14:02.716 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-17T05:14:02.716 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-17T05:14:02.716 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-17T05:14:02.716 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-17T05:14:02.717 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-17T05:14:02.717 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-17T05:14:02.717 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-17T05:14:02.717 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-17T05:14:02.717 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-17T05:14:02.717 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-17T05:14:02.717 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-17T05:14:02.717 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-17T05:14:02.717 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-17T05:14:02.717 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-17T05:14:02.717 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-17T05:14:02.717 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-17T05:14:02.718 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-17T05:14:02.718 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-17T05:14:02.718 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-17T05:14:02.718 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-17T05:14:02.718 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-17T05:14:02.718 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-17T05:14:02.718 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-17T05:14:02.718 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-17T05:14:02.718 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-17T05:14:02.718 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-17T05:14:02.718 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-17T05:14:02.718 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-17T05:14:02.719 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-17T05:14:02.719 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-17T05:14:02.719 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-17T05:14:02.719 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-17T05:14:02.719 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-17T05:14:02.719 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-17T05:14:02.719 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-17T05:14:02.719 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-17T05:14:02.719 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-17T05:14:02.719 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-17T05:14:02.719 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-17T05:14:02.719 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-17T05:14:02.719 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-17T05:14:02.720 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-17T05:14:02.720 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-17T05:14:02.720 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-17T05:14:02.720 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-17T05:14:02.720 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-17T05:14:02.720 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-17T05:14:02.720 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-17T05:14:02.720 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-17T05:14:02.720 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-17T05:14:02.720 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-17T05:14:02.720 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-17T05:14:02.720 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-17T05:14:02.720 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-17T05:14:02.721 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-17T05:14:02.721 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-17T05:14:02.721 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-17T05:14:02.721 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-17T05:14:02.721 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-17T05:14:02.721 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-17T05:14:02.721 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-17T05:14:02.721 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-17T05:14:02.721 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-17T05:14:02.721 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-17T05:14:02.721 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-17T05:14:02.721 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-17T05:14:02.722 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-17T05:14:02.722 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-17T05:14:02.722 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-17T05:14:02.722 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-17T05:14:02.722 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-17T05:14:02.722 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-17T05:14:02.722 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-17T05:14:02.722 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-17T05:14:02.722 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-17T05:14:02.722 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-17T05:14:02.722 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-17T05:14:02.722 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-17T05:14:02.722 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-17T05:14:02.723 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-17T05:14:02.723 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-17T05:14:02.723 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-17T05:14:02.723 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-17T05:14:02.723 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-17T05:14:02.723 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-17T05:14:02.723 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-17T05:14:02.723 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-17T05:14:02.723 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-17T05:14:02.723 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-17T05:14:02.723 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-17T05:14:02.723 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-17T05:14:02.723 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-17T05:14:02.724 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-17T05:14:02.724 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-17T05:14:02.724 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-17T05:14:02.724 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-17T05:14:02.724 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-17T05:14:02.724 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-17T05:14:02.724 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-17T05:14:02.724 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-17T05:14:02.724 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-17T05:14:02.724 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-17T05:14:02.724 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-17T05:14:02.725 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-17T05:14:02.725 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-17T05:14:02.725 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-17T05:14:02.725 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-17T05:14:02.725 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-17T05:14:02.725 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-17T05:14:02.725 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-17T05:14:02.725 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-17T05:14:02.725 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-17T05:14:02.725 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-17T05:14:02.725 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-17T05:14:02.725 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-17T05:14:02.726 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-17T05:14:02.726 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-17T05:14:02.726 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-17T05:14:02.726 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-17T05:14:02.726 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-17T05:14:02.726 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-17T05:14:02.726 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-17T05:14:02.726 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-17T05:14:02.726 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-17T05:14:02.726 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-17T05:14:02.726 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-17T05:14:02.726 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-17T05:14:02.726 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-17T05:14:02.727 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-17T05:14:02.727 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-17T05:14:02.727 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-17T05:14:02.727 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-17T05:14:02.727 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-17T05:14:02.727 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-17T05:14:02.727 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-17T05:14:02.727 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-17T05:14:02.727 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-17T05:14:02.727 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-17T05:14:02.727 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-17T05:14:02.727 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-17T05:14:02.727 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-17T05:14:02.728 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-17T05:14:02.728 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-17T05:14:02.728 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-17T05:14:02.728 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-17T05:14:02.728 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-17T05:14:02.728 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-17T05:14:02.728 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-17T05:14:02.728 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-17T05:14:02.728 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-17T05:14:02.728 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-17T05:14:02.728 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-17T05:14:02.728 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-17T05:14:02.728 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-17T05:14:02.729 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-17T05:14:02.729 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-17T05:14:02.729 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-17T05:14:02.729 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-17T05:14:02.729 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-17T05:14:02.729 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-17T05:14:02.729 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-17T05:14:02.729 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-17T05:14:02.729 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-17T05:14:02.729 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-17T05:14:02.729 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-17T05:14:02.729 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-17T05:14:02.729 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-17T05:14:02.730 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-17T05:14:02.730 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-17T05:14:02.730 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-17T05:14:02.730 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-17T05:14:02.730 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-17T05:14:02.730 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-17T05:14:02.730 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-17T05:14:02.730 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-17T05:14:02.730 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-17T05:14:02.730 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-17T05:14:02.730 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-17T05:14:02.730 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-17T05:14:02.730 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-17T05:14:02.731 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-17T05:14:02.731 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-17T05:14:02.731 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-17T05:14:02.731 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-17T05:14:02.731 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-17T05:14:02.731 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-17T05:14:02.731 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-17T05:14:02.731 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-17T05:14:02.731 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-17T05:14:02.731 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-17T05:14:02.731 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-17T05:14:02.731 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-17T05:14:02.731 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-17T05:14:02.732 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-17T05:14:02.732 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-17T05:14:02.732 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-17T05:14:02.732 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-17T05:14:02.732 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-17T05:14:02.732 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-17T05:14:02.732 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-17T05:14:02.732 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-17T05:14:02.732 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-17T05:14:02.732 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-17T05:14:02.732 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-17T05:14:02.732 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-17T05:14:02.733 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-17T05:14:02.733 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-17T05:14:02.733 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-17T05:14:02.733 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-17T05:14:02.733 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-17T05:14:02.733 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-17T05:14:02.733 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-17T05:14:02.733 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-17T05:14:02.733 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-17T05:14:02.733 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-17T05:14:02.733 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-17T05:14:02.733 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-17T05:14:02.733 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-17T05:14:02.734 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-17T05:14:02.734 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-17T05:14:02.734 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-17T05:14:02.734 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-17T05:14:02.734 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-17T05:14:02.734 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-17T05:14:02.734 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-17T05:14:02.734 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-17T05:14:02.734 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-17T05:14:02.734 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-17T05:14:02.734 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-17T05:14:02.734 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-17T05:14:02.734 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-17T05:14:02.735 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-17T05:14:02.735 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-17T05:14:02.735 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-17T05:14:02.735 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-17T05:14:02.735 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-17T05:14:02.735 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-17T05:14:02.735 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-17T05:14:02.735 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-17T05:14:02.735 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-17T05:14:02.735 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-17T05:14:02.735 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-17T05:14:02.735 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-17T05:14:02.735 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-17T05:14:02.735 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-17T05:14:02.736 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-17T05:14:02.736 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-17T05:14:02.736 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-17T05:14:02.736 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-17T05:14:02.736 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-17T05:14:02.736 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-17T05:14:02.736 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-17T05:14:02.736 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-17T05:14:02.736 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-17T05:14:02.736 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-17T05:14:02.737 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-17T05:14:02.737 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-17T05:14:02.737 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-17T05:14:02.737 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-17T05:14:02.737 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-17T05:14:02.737 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-17T05:14:02.737 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-17T05:14:02.737 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-17T05:14:02.737 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-17T05:14:02.737 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-17T05:14:02.737 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-17T05:14:02.737 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-17T05:14:02.738 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-17T05:14:02.738 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-17T05:14:02.738 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-17T05:14:02.738 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-17T05:14:02.738 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-17T05:14:02.738 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-17T05:14:02.738 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-17T05:14:02.738 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-17T05:14:02.738 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-17T05:14:02.738 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-17T05:14:02.738 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-17T05:14:02.738 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-17T05:14:02.738 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-17T05:14:02.739 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-17T05:14:02.739 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-17T05:14:02.739 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-17T05:14:02.739 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-17T05:14:02.739 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-17T05:14:02.739 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-17T05:14:02.739 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-17T05:14:02.739 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-17T05:14:02.739 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-17T05:14:02.739 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-17T05:14:02.739 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-17T05:14:02.739 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-17T05:14:02.739 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-17T05:14:02.740 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-17T05:14:02.740 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-17T05:14:02.740 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-17T05:14:02.740 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-17T05:14:02.740 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-17T05:14:02.740 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-17T05:14:02.740 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-17T05:14:02.740 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-17T05:14:02.740 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-17T05:14:02.740 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-17T05:14:02.740 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-17T05:14:02.740 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-17T05:14:02.741 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-17T05:14:02.741 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-17T05:14:02.741 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-17T05:14:02.741 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-17T05:14:02.741 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-17T05:14:02.741 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-17T05:14:02.741 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-17T05:14:02.741 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-17T05:14:02.741 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-17T05:14:02.741 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-17T05:14:02.741 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-17T05:14:02.741 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-17T05:14:02.742 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-17T05:14:02.742 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-17T05:14:02.742 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-17T05:14:02.742 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-17T05:14:02.742 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-17T05:14:02.742 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-17T05:14:02.742 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-17T05:14:02.742 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-17T05:14:02.743 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-17T05:14:02.743 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-17T05:14:02.743 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-17T05:14:02.743 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-17T05:14:02.743 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-17T05:14:02.743 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-17T05:14:02.743 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-17T05:14:02.743 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-17T05:14:02.743 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-17T05:14:02.743 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-17T05:14:02.743 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-17T05:14:02.744 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-17T05:14:02.744 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-17T05:14:02.744 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-17T05:14:02.744 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-17T05:14:02.744 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-17T05:14:02.744 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-17T05:14:02.744 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-17T05:14:02.744 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-17T05:14:02.744 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-17T05:14:02.744 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-17T05:14:02.744 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-17T05:14:02.744 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-17T05:14:02.745 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-17T05:14:02.745 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-17T05:14:02.745 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-17T05:14:02.745 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-17T05:14:02.745 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-17T05:14:02.745 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-17T05:14:02.745 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-17T05:14:02.745 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-17T05:14:02.745 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-17T05:14:02.745 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-17T05:14:02.745 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-17T05:14:02.745 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-17T05:14:02.745 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-17T05:14:02.746 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-17T05:14:02.746 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-17T05:14:02.746 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-17T05:14:02.746 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-17T05:14:02.746 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-17T05:14:02.746 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-17T05:14:02.746 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-17T05:14:02.746 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-17T05:14:02.746 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-17T05:14:02.746 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-17T05:14:02.746 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-17T05:14:02.746 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-17T05:14:02.746 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-17T05:14:02.747 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-17T05:14:02.747 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-17T05:14:02.747 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-17T05:14:02.747 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-17T05:14:02.747 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-17T05:14:02.747 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-17T05:14:02.747 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-17T05:14:02.747 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-17T05:14:02.747 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-17T05:14:02.747 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-17T05:14:02.747 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-17T05:14:02.747 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-17T05:14:02.748 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-17T05:14:02.748 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-17T05:14:02.748 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-17T05:14:02.748 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-17T05:14:02.748 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-17T05:14:02.748 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-17T05:14:02.748 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-17T05:14:02.748 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-17T05:14:02.748 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-17T05:14:02.748 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-17T05:14:02.748 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-17T05:14:02.748 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-17T05:14:02.749 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-17T05:14:02.749 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-17T05:14:02.749 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-17T05:14:02.749 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-17T05:14:02.749 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-17T05:14:02.749 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-17T05:14:02.749 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-17T05:14:02.749 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-17T05:14:02.749 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-17T05:14:02.749 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-17T05:14:02.749 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-17T05:14:02.749 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-17T05:14:02.749 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-17T05:14:02.750 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-17T05:14:02.750 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-17T05:14:02.750 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-17T05:14:02.750 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-17T05:14:02.750 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-17T05:14:02.750 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-17T05:14:02.750 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-17T05:14:02.750 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-17T05:14:02.750 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-17T05:14:02.750 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-17T05:14:02.750 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-17T05:14:02.750 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-17T05:14:02.750 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-17T05:14:02.751 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-17T05:14:02.751 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-17T05:14:02.751 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-17T05:14:02.751 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-17T05:14:02.751 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-17T05:14:02.751 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-17T05:14:02.751 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-17T05:14:02.751 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-17T05:14:02.751 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-17T05:14:02.751 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-17T05:14:02.751 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-17T05:14:02.751 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-17T05:14:02.751 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-17T05:14:02.752 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-17T05:14:02.752 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-17T05:14:02.752 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-17T05:14:02.752 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-17T05:14:02.752 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-17T05:14:02.752 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-17T05:14:02.752 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-17T05:14:02.752 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-17T05:14:02.752 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-17T05:14:02.752 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-17T05:14:02.752 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-17T05:14:02.752 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-17T05:14:02.752 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-17T05:14:02.753 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-17T05:14:02.753 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-17T05:14:02.753 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-17T05:14:02.753 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-17T05:14:02.753 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-17T05:14:02.753 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-17T05:14:02.753 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-17T05:14:02.753 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-17T05:14:02.753 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-17T05:14:02.753 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-17T05:14:02.753 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-17T05:14:02.753 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-17T05:14:02.753 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-17T05:14:02.754 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-17T05:14:02.754 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-17T05:14:02.754 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-17T05:14:02.754 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-17T05:14:02.754 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-17T05:14:02.754 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-17T05:14:02.754 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-17T05:14:02.754 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-17T05:14:02.754 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-17T05:14:02.754 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-17T05:14:02.754 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-17T05:14:02.754 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-17T05:14:02.754 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-17T05:14:02.755 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-17T05:14:02.755 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-17T05:14:02.755 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-17T05:14:02.755 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-17T05:14:02.755 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-17T05:14:02.755 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-17T05:14:02.755 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-17T05:14:02.755 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-17T05:14:02.755 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-17T05:14:02.755 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-17T05:14:02.755 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-17T05:14:02.755 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-17T05:14:02.755 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-17T05:14:02.756 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-17T05:14:02.756 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-17T05:14:02.756 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-17T05:14:02.756 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-17T05:14:02.756 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-17T05:14:02.756 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-17T05:14:02.756 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-17T05:14:02.756 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-17T05:14:02.756 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-17T05:14:02.756 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-17T05:14:02.756 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-17T05:14:02.756 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-17T05:14:02.756 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-17T05:14:02.757 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-17T05:14:02.757 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-17T05:14:02.757 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-17T05:14:02.757 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-17T05:14:02.757 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-17T05:14:02.757 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-17T05:14:02.757 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-17T05:14:02.757 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-17T05:14:02.757 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-17T05:14:02.757 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-17T05:14:02.757 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-17T05:14:02.757 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-17T05:14:02.757 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-17T05:14:02.758 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-17T05:14:02.758 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-17T05:14:02.758 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-17T05:14:02.758 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-17T05:14:02.758 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-17T05:14:02.758 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-17T05:14:02.758 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-17T05:14:02.758 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-17T05:14:02.758 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-17T05:14:02.758 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-17T05:14:02.758 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-17T05:14:02.758 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-17T05:14:02.758 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-17T05:14:02.759 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-17T05:14:02.759 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-17T05:14:02.759 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-17T05:14:02.759 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-17T05:14:02.759 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-17T05:14:02.759 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-17T05:14:02.759 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-17T05:14:02.759 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-17T05:14:02.759 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-17T05:14:02.759 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-17T05:14:02.759 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-17T05:14:02.759 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-17T05:14:02.759 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-17T05:14:02.759 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-17T05:14:02.760 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-17T05:14:02.760 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-17T05:14:02.760 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-17T05:14:02.760 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-17T05:14:02.760 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-17T05:14:02.760 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-17T05:14:02.760 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-17T05:14:02.760 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-17T05:14:02.760 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-17T05:14:02.760 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-17T05:14:02.760 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-17T05:14:02.760 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-17T05:14:02.761 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-17T05:14:02.761 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-17T05:14:02.761 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-17T05:14:02.761 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-17T05:14:02.761 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-17T05:14:02.761 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-17T05:14:02.761 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-17T05:14:02.761 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-17T05:14:02.761 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-17T05:14:02.761 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-17T05:14:02.761 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-17T05:14:02.761 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-17T05:14:02.761 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-17T05:14:02.762 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-17T05:14:02.762 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-17T05:14:02.762 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-17T05:14:02.762 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-17T05:14:02.762 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-17T05:14:02.762 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-17T05:14:02.762 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-17T05:14:02.762 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-17T05:14:02.762 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-17T05:14:02.762 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-17T05:14:02.762 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-17T05:14:02.762 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-17T05:14:02.762 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-17T05:14:02.763 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-17T05:14:02.763 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-17T05:14:02.763 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-17T05:14:02.763 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-17T05:14:02.763 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-17T05:14:02.763 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-17T05:14:02.763 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-17T05:14:02.763 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-17T05:14:02.763 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-17T05:14:02.763 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-17T05:14:02.763 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-17T05:14:02.763 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-17T05:14:02.763 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-17T05:14:02.764 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-17T05:14:02.764 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-17T05:14:02.764 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-17T05:14:02.764 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-17T05:14:02.764 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-17T05:14:02.764 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-17T05:14:02.764 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-17T05:14:02.764 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-17T05:14:02.764 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-17T05:14:02.764 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-17T05:14:02.764 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-17T05:14:02.764 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-17T05:14:02.765 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-17T05:14:02.765 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-17T05:14:02.765 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-17T05:14:02.765 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-17T05:14:02.765 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-17T05:14:02.765 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-17T05:14:02.765 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-17T05:14:02.765 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-17T05:14:02.765 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-17T05:14:02.765 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-17T05:14:02.765 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-17T05:14:02.765 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-17T05:14:02.766 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-17T05:14:02.766 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-17T05:14:02.766 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-17T05:14:02.766 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-17T05:14:02.766 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-17T05:14:02.766 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-17T05:14:02.766 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-17T05:14:02.766 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-17T05:14:02.766 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-17T05:14:02.766 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-17T05:14:02.766 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-17T05:14:02.766 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-17T05:14:02.766 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-17T05:14:02.767 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-17T05:14:02.767 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-17T05:14:02.767 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-17T05:14:02.767 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-17T05:14:02.767 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-17T05:14:02.767 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-17T05:14:02.767 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-17T05:14:02.767 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-17T05:14:02.767 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-17T05:14:02.767 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-17T05:14:02.767 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-17T05:14:02.767 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-17T05:14:02.767 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-17T05:14:02.768 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-17T05:14:02.768 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-17T05:14:02.768 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-17T05:14:02.768 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-17T05:14:02.768 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-17T05:14:02.768 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-17T05:14:02.768 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-17T05:14:02.768 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-17T05:14:02.768 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-17T05:14:02.768 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-17T05:14:02.768 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-17T05:14:02.768 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-17T05:14:02.769 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-17T05:14:02.769 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-17T05:14:02.769 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-17T05:14:02.769 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-17T05:14:02.769 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-17T05:14:02.769 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-17T05:14:02.769 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-17T05:14:02.769 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-17T05:14:02.769 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-17T05:14:02.769 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-17T05:14:02.769 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-17T05:14:02.769 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-17T05:14:02.769 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-17T05:14:02.769 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-17T05:14:02.770 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-17T05:14:02.770 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-17T05:14:02.770 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-17T05:14:02.770 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-17T05:14:02.770 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-17T05:14:02.770 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-17T05:14:02.770 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-17T05:14:02.770 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-17T05:14:02.770 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-17T05:14:02.770 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-17T05:14:02.770 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-17T05:14:02.770 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-17T05:14:02.770 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-17T05:14:02.771 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-17T05:14:02.771 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-17T05:14:02.771 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-17T05:14:02.771 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-17T05:14:02.771 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-17T05:14:02.771 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-17T05:14:02.771 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-17T05:14:02.771 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-17T05:14:02.771 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-17T05:14:02.771 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-17T05:14:02.771 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-17T05:14:02.771 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-17T05:14:02.771 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-17T05:14:02.772 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-17T05:14:02.772 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-17T05:14:02.772 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-17T05:14:02.772 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-17T05:14:02.772 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-17T05:14:02.772 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-17T05:14:02.772 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-17T05:14:02.772 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-17T05:14:02.772 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-17T05:14:02.772 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-17T05:14:02.772 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-17T05:14:02.772 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-17T05:14:02.772 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-17T05:14:02.773 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-17T05:14:02.773 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-17T05:14:02.773 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-17T05:14:02.773 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-17T05:14:02.773 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-17T05:14:02.773 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-17T05:14:02.773 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-17T05:14:02.773 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-17T05:14:02.773 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-17T05:14:02.773 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-17T05:14:02.774 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-17T05:14:02.774 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-17T05:14:02.774 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-17T05:14:02.774 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-17T05:14:02.774 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-17T05:14:02.774 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-17T05:14:02.774 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-17T05:14:02.774 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-17T05:14:02.774 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-17T05:14:02.774 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-17T05:14:02.774 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-17T05:14:02.774 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-17T05:14:02.774 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-17T05:14:02.775 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-17T05:14:02.775 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-17T05:14:02.775 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-17T05:14:02.775 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-17T05:14:02.775 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-17T05:14:02.775 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-17T05:14:02.775 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-17T05:14:02.775 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-17T05:14:02.775 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-17T05:14:02.775 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-17T05:14:02.775 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-17T05:14:02.775 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-17T05:14:02.775 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-17T05:14:02.776 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-17T05:14:02.776 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-17T05:14:02.776 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-17T05:14:02.776 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-17T05:14:02.776 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-17T05:14:02.776 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-17T05:14:02.776 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-17T05:14:02.776 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-17T05:14:02.776 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-17T05:14:02.776 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-17T05:14:02.776 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-17T05:14:02.776 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-17T05:14:02.776 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-17T05:14:02.777 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-17T05:14:02.777 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-17T05:14:02.777 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-17T05:14:02.777 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-17T05:14:02.777 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-17T05:14:02.777 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-17T05:14:02.777 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-17T05:14:02.777 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-17T05:14:02.777 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-17T05:14:02.777 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-17T05:14:02.777 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-17T05:14:02.777 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-17T05:14:02.777 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-17T05:14:02.778 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-17T05:14:02.778 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-17T05:14:02.778 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-17T05:14:02.778 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-17T05:14:02.778 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-17T05:14:02.778 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-17T05:14:02.778 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-17T05:14:02.778 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-17T05:14:02.778 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-17T05:14:02.778 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-17T05:14:02.778 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-17T05:14:02.778 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-17T05:14:02.778 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-17T05:14:02.779 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-17T05:14:02.779 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-17T05:14:02.779 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-17T05:14:02.779 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-17T05:14:02.779 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-17T05:14:02.779 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-17T05:14:02.779 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-17T05:14:02.779 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-17T05:14:02.779 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-17T05:14:02.779 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-17T05:14:02.779 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-17T05:14:02.779 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-17T05:14:02.779 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-17T05:14:02.780 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-17T05:14:02.780 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-17T05:14:02.780 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-17T05:14:02.780 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-17T05:14:02.780 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-17T05:14:02.780 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-17T05:14:02.780 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-17T05:14:02.780 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-17T05:14:02.780 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-17T05:14:02.780 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-17T05:14:02.780 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-17T05:14:02.780 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-17T05:14:02.781 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-17T05:14:02.781 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-17T05:14:02.781 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-17T05:14:02.781 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-17T05:14:02.781 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-17T05:14:02.781 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-17T05:14:02.781 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-17T05:14:02.781 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-17T05:14:02.781 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-17T05:14:02.781 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-17T05:14:02.781 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-17T05:14:02.781 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-17T05:14:02.781 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-17T05:14:02.782 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-17T05:14:02.782 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-17T05:14:02.782 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-17T05:14:02.782 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-17T05:14:02.782 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-17T05:14:02.782 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-17T05:14:02.782 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-17T05:14:02.782 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-17T05:14:02.782 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-17T05:14:02.782 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-17T05:14:02.782 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-17T05:14:02.782 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-17T05:14:02.782 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-17T05:14:02.783 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-17T05:14:02.783 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-17T05:14:02.783 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-17T05:14:02.783 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-17T05:14:02.783 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-17T05:14:02.783 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-17T05:14:02.783 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-17T05:14:02.783 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-17T05:14:02.783 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-17T05:14:02.783 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-17T05:14:02.783 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-17T05:14:02.783 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-17T05:14:02.783 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-17T05:14:02.784 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-17T05:14:02.784 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-17T05:14:02.784 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-17T05:14:02.784 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-17T05:14:02.784 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-17T05:14:02.784 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-17T05:14:02.784 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-17T05:14:02.784 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-17T05:14:02.784 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-17T05:14:02.784 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-17T05:14:02.784 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-17T05:14:02.784 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-17T05:14:02.784 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-17T05:14:02.784 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-17T05:14:02.785 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-17T05:14:02.785 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-17T05:14:02.785 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-17T05:14:02.785 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-17T05:14:02.785 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-17T05:14:02.785 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-17T05:14:02.785 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-17T05:14:02.785 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-17T05:14:02.785 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-17T05:14:02.785 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-17T05:14:02.785 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-17T05:14:02.785 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-17T05:14:02.786 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-17T05:14:02.786 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-17T05:14:02.786 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-17T05:14:02.786 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-17T05:14:02.786 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-17T05:14:02.786 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-17T05:14:02.786 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-17T05:14:02.786 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-17T05:14:02.786 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-17T05:14:02.786 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-17T05:14:02.786 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-17T05:14:02.786 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-17T05:14:02.786 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-17T05:14:02.787 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-17T05:14:02.787 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-17T05:14:02.787 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-17T05:14:02.787 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-17T05:14:02.787 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-17T05:14:02.787 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-17T05:14:02.787 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-17T05:14:02.787 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-17T05:14:02.787 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-17T05:14:02.787 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-17T05:14:02.787 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-17T05:14:02.787 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-17T05:14:02.787 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-17T05:14:02.788 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-17T05:14:02.788 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-17T05:14:02.788 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-17T05:14:02.788 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-17T05:14:02.788 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-17T05:14:02.788 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-17T05:14:02.788 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-17T05:14:02.788 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-17T05:14:02.788 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-17T05:14:02.788 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-17T05:14:02.788 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-17T05:14:02.788 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-17T05:14:02.789 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-17T05:14:02.789 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-17T05:14:02.789 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-17T05:14:02.789 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-17T05:14:02.789 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-17T05:14:02.789 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-17T05:14:02.789 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-17T05:14:02.789 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-17T05:14:02.789 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-17T05:14:02.789 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-17T05:14:02.789 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-17T05:14:02.789 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-17T05:14:02.789 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-17T05:14:02.789 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-17T05:14:02.790 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-17T05:14:02.790 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-17T05:14:02.790 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-17T05:14:02.790 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-17T05:14:02.790 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-17T05:14:02.790 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-17T05:14:02.790 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-17T05:14:02.790 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-17T05:14:02.790 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-17T05:14:02.790 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-17T05:14:02.790 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-17T05:14:02.790 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-17T05:14:02.833 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-17T05:14:02.833 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-17T05:14:02.833 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-17T05:14:02.833 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-17T05:14:02.833 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-17T05:14:02.833 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-17T05:14:02.833 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-17T05:14:02.833 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-17T05:14:02.834 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-17T05:14:02.834 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-17T05:14:02.834 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-17T05:14:02.834 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-17T05:14:02.834 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-17T05:14:02.834 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-17T05:14:02.834 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-17T05:14:02.834 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-17T05:14:02.834 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-17T05:14:02.834 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-17T05:14:02.834 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-17T05:14:02.834 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-17T05:14:02.835 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-17T05:14:02.835 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-17T05:14:02.835 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-17T05:14:02.835 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-17T05:14:02.835 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-17T05:14:02.835 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-17T05:14:02.835 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-17T05:14:02.835 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-17T05:14:02.835 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-17T05:14:02.835 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-17T05:14:02.835 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-17T05:14:02.835 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-17T05:14:02.835 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-17T05:14:02.836 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-17T05:14:02.836 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-17T05:14:02.836 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-17T05:14:02.836 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-17T05:14:02.836 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-17T05:14:02.836 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-17T05:14:02.836 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-17T05:14:02.836 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-17T05:14:02.836 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-17T05:14:02.836 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-17T05:14:02.836 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-17T05:14:02.836 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-17T05:14:02.837 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-17T05:14:02.837 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-17T05:14:02.837 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-17T05:14:02.837 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-17T05:14:02.837 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-17T05:14:02.837 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-17T05:14:02.837 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-17T05:14:02.837 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-17T05:14:02.837 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-17T05:14:02.837 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-17T05:14:02.837 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-17T05:14:02.837 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-17T05:14:02.837 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-17T05:14:02.838 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-17T05:14:02.838 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-17T05:14:02.838 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-17T05:14:02.838 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-17T05:14:02.838 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-17T05:14:02.838 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-17T05:14:02.838 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-17T05:14:02.838 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-17T05:14:02.838 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-17T05:14:02.838 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-17T05:14:02.838 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-17T05:14:02.838 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-17T05:14:02.839 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-17T05:14:02.839 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-17T05:14:02.839 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-17T05:14:02.839 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-17T05:14:02.839 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-17T05:14:02.839 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-17T05:14:02.839 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-17T05:14:02.839 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-17T05:14:02.839 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-17T05:14:02.839 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-17T05:14:02.839 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-17T05:14:02.840 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-17T05:14:02.840 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-17T05:14:02.840 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-17T05:14:02.840 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-17T05:14:02.840 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-17T05:14:02.840 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-17T05:14:02.840 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-17T05:14:02.840 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-17T05:14:02.841 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-17T05:14:02.841 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-17T05:14:02.841 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-17T05:14:02.841 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-17T05:14:02.841 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-17T05:14:02.841 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-17T05:14:02.841 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-17T05:14:02.841 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-17T05:14:02.841 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-17T05:14:02.841 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-17T05:14:02.841 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-17T05:14:02.841 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-17T05:14:02.841 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-17T05:14:02.842 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-17T05:14:02.842 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-17T05:14:02.842 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-17T05:14:02.842 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-17T05:14:02.842 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-17T05:14:02.842 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-17T05:14:02.842 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-17T05:14:02.842 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-17T05:14:02.842 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-17T05:14:02.842 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-17T05:14:02.842 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-17T05:14:02.842 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-17T05:14:02.843 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-17T05:14:02.843 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-17T05:14:02.843 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-17T05:14:02.843 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-17T05:14:02.843 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-17T05:14:02.843 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-17T05:14:02.843 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-17T05:14:02.843 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-17T05:14:02.843 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-17T05:14:02.843 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-17T05:14:02.843 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-17T05:14:02.843 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-17T05:14:02.844 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-17T05:14:02.844 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-17T05:14:02.844 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-17T05:14:02.844 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-17T05:14:02.844 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-17T05:14:02.844 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-17T05:14:02.844 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-17T05:14:02.844 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-17T05:14:02.844 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-17T05:14:02.844 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-17T05:14:02.844 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-17T05:14:02.844 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-17T05:14:02.844 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-17T05:14:02.845 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-17T05:14:02.845 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-17T05:14:02.845 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-17T05:14:02.845 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-17T05:14:02.845 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-17T05:14:02.845 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-17T05:14:02.845 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-17T05:14:02.845 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-17T05:14:02.845 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-17T05:14:02.845 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-17T05:14:02.845 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-17T05:14:02.845 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-17T05:14:02.846 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-17T05:14:02.846 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-17T05:14:02.846 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-17T05:14:02.846 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-17T05:14:02.846 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-17T05:14:02.846 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-17T05:14:02.846 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-17T05:14:02.846 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-17T05:14:02.846 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-17T05:14:02.846 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-17T05:14:02.846 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-17T05:14:02.846 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-17T05:14:02.846 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-17T05:14:02.847 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-17T05:14:02.847 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-17T05:14:02.847 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-17T05:14:02.847 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-17T05:14:02.847 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-17T05:14:02.847 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-17T05:14:02.847 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-17T05:14:02.847 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-17T05:14:02.847 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-17T05:14:02.847 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-17T05:14:02.847 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-17T05:14:02.847 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-17T05:14:02.847 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-17T05:14:02.848 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-17T05:14:02.848 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-17T05:14:02.848 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-17T05:14:02.848 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-17T05:14:02.848 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-17T05:14:02.848 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-17T05:14:02.848 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-17T05:14:02.848 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-17T05:14:02.848 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-17T05:14:02.848 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-17T05:14:02.848 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-17T05:14:02.848 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-17T05:14:02.848 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-17T05:14:02.849 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-17T05:14:02.849 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-17T05:14:02.849 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-17T05:14:02.849 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-17T05:14:02.849 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-17T05:14:02.849 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-17T05:14:02.849 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-17T05:14:02.849 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-17T05:14:02.849 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-17T05:14:02.849 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-17T05:14:02.849 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-17T05:14:02.849 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-17T05:14:02.850 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-17T05:14:02.850 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-17T05:14:02.850 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-17T05:14:02.850 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-17T05:14:02.850 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-17T05:14:02.850 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-17T05:14:02.850 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-17T05:14:02.850 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-17T05:14:02.850 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-17T05:14:02.850 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-17T05:14:02.850 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-17T05:14:02.850 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-17T05:14:02.851 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-17T05:14:02.851 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-17T05:14:02.851 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-17T05:14:02.851 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-17T05:14:02.851 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-17T05:14:02.851 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-17T05:14:02.851 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-17T05:14:02.851 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-17T05:14:02.851 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-17T05:14:02.851 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-17T05:14:02.851 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-17T05:14:02.851 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-17T05:14:02.851 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-17T05:14:02.852 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-17T05:14:02.852 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-17T05:14:02.852 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-17T05:14:02.852 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-17T05:14:02.852 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-17T05:14:02.852 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-17T05:14:02.852 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-17T05:14:02.852 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-17T05:14:02.852 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-17T05:14:02.852 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-17T05:14:02.852 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-17T05:14:02.852 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-17T05:14:02.853 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-17T05:14:02.853 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-17T05:14:02.853 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-17T05:14:02.853 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-17T05:14:02.853 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-17T05:14:02.853 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-17T05:14:02.853 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-17T05:14:02.853 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-17T05:14:02.853 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-17T05:14:02.853 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-17T05:14:02.853 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-17T05:14:02.853 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-17T05:14:02.854 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-17T05:14:02.854 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-17T05:14:02.854 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-17T05:14:02.854 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-17T05:14:02.854 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-17T05:14:02.854 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-17T05:14:02.854 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-17T05:14:02.854 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-17T05:14:02.854 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-17T05:14:02.854 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-17T05:14:02.854 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-17T05:14:02.854 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-17T05:14:02.854 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-17T05:14:02.854 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-17T05:14:02.855 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-17T05:14:02.855 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-17T05:14:02.855 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-17T05:14:02.855 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-17T05:14:02.855 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-17T05:14:02.855 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-17T05:14:02.855 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-17T05:14:02.855 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-17T05:14:02.855 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-17T05:14:02.855 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-17T05:14:02.855 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-17T05:14:02.855 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-17T05:14:02.855 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-17T05:14:02.856 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-17T05:14:02.856 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-17T05:14:02.856 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-17T05:14:02.856 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-17T05:14:02.856 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-17T05:14:02.856 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-17T05:14:02.856 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-17T05:14:02.856 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-17T05:14:02.856 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-17T05:14:02.856 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-17T05:14:02.856 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-17T05:14:02.856 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-17T05:14:02.857 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-17T05:14:02.857 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-17T05:14:02.857 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-17T05:14:02.857 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-17T05:14:02.857 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-17T05:14:02.857 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-17T05:14:02.857 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-17T05:14:02.857 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-17T05:14:02.857 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-17T05:14:02.857 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-17T05:14:02.858 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-17T05:14:02.858 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-17T05:14:02.858 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-17T05:14:02.858 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-17T05:14:02.858 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-17T05:14:02.858 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-17T05:14:02.858 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-17T05:14:02.858 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-17T05:14:02.858 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-17T05:14:02.858 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-17T05:14:02.858 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-17T05:14:02.858 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-17T05:14:02.859 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-17T05:14:02.859 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-17T05:14:02.859 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-17T05:14:02.859 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-17T05:14:02.859 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-17T05:14:02.859 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-17T05:14:02.859 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-17T05:14:02.859 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-17T05:14:02.859 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-17T05:14:02.859 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-17T05:14:02.859 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-17T05:14:02.859 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-17T05:14:02.860 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-17T05:14:02.860 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-17T05:14:02.860 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-17T05:14:02.860 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-17T05:14:02.860 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-17T05:14:02.860 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-17T05:14:02.860 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-17T05:14:02.860 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-17T05:14:02.860 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-17T05:14:02.860 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-17T05:14:02.860 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-17T05:14:02.860 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-17T05:14:02.860 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-17T05:14:02.861 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-17T05:14:02.861 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-17T05:14:02.861 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-17T05:14:02.861 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-17T05:14:02.861 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-17T05:14:02.861 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-17T05:14:02.861 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-17T05:14:02.861 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-17T05:14:02.861 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-17T05:14:02.861 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-17T05:14:02.861 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-17T05:14:02.861 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-17T05:14:02.862 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-17T05:14:02.862 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-17T05:14:02.862 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-17T05:14:02.862 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-17T05:14:02.862 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-17T05:14:02.862 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-17T05:14:02.862 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-17T05:14:02.862 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-17T05:14:02.862 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-17T05:14:02.862 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-17T05:14:02.862 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-17T05:14:02.862 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-17T05:14:02.862 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-17T05:14:02.863 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-17T05:14:02.863 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-17T05:14:02.863 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-17T05:14:02.863 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-17T05:14:02.863 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-17T05:14:02.863 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-17T05:14:02.863 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-17T05:14:02.863 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-17T05:14:02.863 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-17T05:14:02.863 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-17T05:14:02.863 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-17T05:14:02.863 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-17T05:14:02.864 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-17T05:14:02.864 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-17T05:14:02.864 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-17T05:14:02.864 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-17T05:14:02.864 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-17T05:14:02.864 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-17T05:14:02.864 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-17T05:14:02.864 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-17T05:14:02.864 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-17T05:14:02.864 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-17T05:14:02.864 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-17T05:14:02.864 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-17T05:14:02.864 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-17T05:14:02.865 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-17T05:14:02.865 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-17T05:14:02.865 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-17T05:14:02.865 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-17T05:14:02.865 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-17T05:14:02.865 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-17T05:14:02.865 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-17T05:14:02.865 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-17T05:14:02.865 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-17T05:14:02.865 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-17T05:14:02.865 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-17T05:14:02.866 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-17T05:14:02.866 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-17T05:14:02.866 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-17T05:14:02.866 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-17T05:14:02.866 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-17T05:14:02.866 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-17T05:14:02.866 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-17T05:14:02.866 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-17T05:14:02.866 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-17T05:14:02.866 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-17T05:14:02.866 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-17T05:14:02.866 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-17T05:14:02.866 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-17T05:14:02.867 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-17T05:14:02.867 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-17T05:14:02.867 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-17T05:14:02.867 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-17T05:14:02.867 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-17T05:14:02.867 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-17T05:14:02.867 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-17T05:14:02.867 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-17T05:14:02.867 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-17T05:14:02.867 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-17T05:14:02.867 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-17T05:14:02.868 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-17T05:14:02.868 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-17T05:14:02.868 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-17T05:14:02.868 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-17T05:14:02.868 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-17T05:14:02.868 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-17T05:14:02.868 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-17T05:14:02.869 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-17T05:14:02.869 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-17T05:14:02.869 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-17T05:14:02.869 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-17T05:14:02.869 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-17T05:14:02.869 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-17T05:14:02.869 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-17T05:14:02.869 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-17T05:14:02.869 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-17T05:14:02.869 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-17T05:14:02.869 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-17T05:14:02.869 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-17T05:14:02.870 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-17T05:14:02.870 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-17T05:14:02.870 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-17T05:14:02.870 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-17T05:14:02.870 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-17T05:14:02.870 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-17T05:14:02.870 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-17T05:14:02.870 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-17T05:14:02.870 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-17T05:14:02.870 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-17T05:14:02.870 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-17T05:14:02.870 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-17T05:14:02.871 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-17T05:14:02.871 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-17T05:14:02.871 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-17T05:14:02.871 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-17T05:14:02.871 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-17T05:14:02.871 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-17T05:14:02.871 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-17T05:14:02.871 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-17T05:14:02.871 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-17T05:14:02.871 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-17T05:14:02.871 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-17T05:14:02.871 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-17T05:14:02.871 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-17T05:14:02.872 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-17T05:14:02.872 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-17T05:14:02.872 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-17T05:14:02.872 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-17T05:14:02.872 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-17T05:14:02.872 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-17T05:14:02.872 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-17T05:14:02.872 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-17T05:14:02.872 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-17T05:14:02.872 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-17T05:14:02.872 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-17T05:14:02.872 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-17T05:14:02.873 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-17T05:14:02.873 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-17T05:14:02.873 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-17T05:14:02.873 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-17T05:14:02.873 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-17T05:14:02.873 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-17T05:14:02.873 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-17T05:14:02.873 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-17T05:14:02.873 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-17T05:14:02.873 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-17T05:14:02.873 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-17T05:14:02.873 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-17T05:14:02.874 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-17T05:14:02.874 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-17T05:14:02.874 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-17T05:14:02.874 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-17T05:14:02.874 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-17T05:14:02.874 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-17T05:14:02.874 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-17T05:14:02.874 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-17T05:14:02.874 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-17T05:14:02.874 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-17T05:14:02.874 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-17T05:14:02.874 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-17T05:14:02.874 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-17T05:14:02.875 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-17T05:14:02.875 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-17T05:14:02.875 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-17T05:14:02.875 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-17T05:14:02.875 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-17T05:14:02.875 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-17T05:14:02.875 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-17T05:14:02.875 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-17T05:14:02.875 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-17T05:14:02.875 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-17T05:14:02.876 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-17T05:14:02.876 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-17T05:14:02.876 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-17T05:14:02.876 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-17T05:14:02.876 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-17T05:14:02.876 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-17T05:14:02.876 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-17T05:14:02.876 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-17T05:14:02.876 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-17T05:14:02.876 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-17T05:14:02.876 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-17T05:14:02.876 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-17T05:14:02.876 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-17T05:14:02.877 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-17T05:14:02.877 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-17T05:14:02.877 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-17T05:14:02.877 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-17T05:14:02.877 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-17T05:14:02.877 INFO:teuthology.orchestra.run.smithi155.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-17T05:14:02.877 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-17T05:14:02.877 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-17T05:14:02.882 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:02.883 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:02.883 DEBUG:teuthology.orchestra.run.smithi155:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-17T05:14:02.889 INFO:teuthology.orchestra.run.smithi155.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-17T05:14:02.889 INFO:teuthology.orchestra.run.smithi155.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-17T05:14:02.889 INFO:teuthology.orchestra.run.smithi155.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-17T05:14:02.890 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-17T05:14:02.890 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:02.890 DEBUG:teuthology.orchestra.run.smithi155:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-17T05:14:02.932 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi155.front.sepia.ceph.com to complete... 2024-09-17T05:14:03.339 INFO:teuthology.orchestra.run.smithi155.stderr:Sourcing file `/etc/default/grub' 2024-09-17T05:14:03.341 INFO:teuthology.orchestra.run.smithi155.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T05:14:03.360 INFO:teuthology.orchestra.run.smithi155.stderr:Generating grub configuration file ... 2024-09-17T05:14:03.533 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:03.539 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:03.749 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T05:14:03.753 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T05:14:03.791 INFO:teuthology.orchestra.run.smithi155.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T05:14:03.795 INFO:teuthology.orchestra.run.smithi155.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T05:14:03.920 INFO:teuthology.orchestra.run.smithi155.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T05:14:03.920 INFO:teuthology.orchestra.run.smithi155.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T05:14:03.920 INFO:teuthology.orchestra.run.smithi155.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T05:14:03.943 INFO:teuthology.orchestra.run.smithi155.stderr:done 2024-09-17T05:14:10.594 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub' 2024-09-17T05:14:10.604 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T05:14:10.625 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2024-09-17T05:14:10.900 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:10.914 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:11.193 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T05:14:11.208 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T05:14:11.271 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T05:14:11.276 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T05:14:11.427 INFO:teuthology.orchestra.run.smithi031.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T05:14:11.427 INFO:teuthology.orchestra.run.smithi031.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T05:14:11.427 INFO:teuthology.orchestra.run.smithi031.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T05:14:11.470 INFO:teuthology.orchestra.run.smithi031.stderr:done 2024-09-17T05:14:11.662 DEBUG:teuthology.orchestra.run.smithi031:> dpkg-deb -c /tmp/linux-image.deb 2024-09-17T05:14:11.670 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-17T05:14:11.670 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-17T05:14:11.670 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:11.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:11.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:11.711 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-17T05:14:11.712 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-17T05:14:11.712 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-17T05:14:11.712 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-17T05:14:11.712 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-17T05:14:11.712 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-17T05:14:11.712 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-17T05:14:11.712 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-17T05:14:11.712 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-17T05:14:11.712 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-17T05:14:11.713 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-17T05:14:11.713 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-17T05:14:11.713 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-17T05:14:11.713 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-17T05:14:11.715 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-17T05:14:11.715 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-17T05:14:11.715 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-17T05:14:11.715 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-17T05:14:11.715 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-17T05:14:11.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-17T05:14:11.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-17T05:14:11.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-17T05:14:11.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-17T05:14:11.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-17T05:14:11.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-17T05:14:11.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-17T05:14:11.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-17T05:14:11.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-17T05:14:11.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-17T05:14:11.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-17T05:14:11.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-17T05:14:11.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-17T05:14:11.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-17T05:14:11.717 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-17T05:14:11.717 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-17T05:14:11.717 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-17T05:14:11.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-17T05:14:11.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-17T05:14:11.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-17T05:14:11.717 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-17T05:14:11.718 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-17T05:14:11.718 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-17T05:14:11.718 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-17T05:14:11.735 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-17T05:14:11.735 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-17T05:14:11.735 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-17T05:14:11.735 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-17T05:14:11.735 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-17T05:14:11.736 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-17T05:14:11.736 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-17T05:14:11.736 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-17T05:14:11.736 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-17T05:14:11.736 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-17T05:14:11.736 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-17T05:14:11.736 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-17T05:14:11.736 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-17T05:14:11.736 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-17T05:14:11.736 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-17T05:14:11.737 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-17T05:14:11.737 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-17T05:14:11.737 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-17T05:14:11.737 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-17T05:14:11.737 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-17T05:14:11.737 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-17T05:14:11.737 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-17T05:14:11.737 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-17T05:14:11.737 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-17T05:14:11.737 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-17T05:14:11.737 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-17T05:14:11.737 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-17T05:14:11.737 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-17T05:14:11.738 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-17T05:14:11.738 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-17T05:14:11.738 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-17T05:14:11.738 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-17T05:14:11.738 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-17T05:14:11.738 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-17T05:14:11.738 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-17T05:14:11.739 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-17T05:14:11.739 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-17T05:14:11.739 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-17T05:14:11.739 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-17T05:14:11.739 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-17T05:14:11.739 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-17T05:14:11.739 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-17T05:14:11.739 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-17T05:14:11.739 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-17T05:14:11.739 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-17T05:14:11.740 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-17T05:14:11.740 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-17T05:14:11.740 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-17T05:14:11.740 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-17T05:14:11.740 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-17T05:14:11.740 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-17T05:14:11.740 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-17T05:14:11.740 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-17T05:14:11.740 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-17T05:14:11.740 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-17T05:14:11.741 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-17T05:14:11.741 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-17T05:14:11.741 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-17T05:14:11.741 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-17T05:14:11.741 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-17T05:14:11.741 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-17T05:14:11.741 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-17T05:14:11.741 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-17T05:14:11.741 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-17T05:14:11.741 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-17T05:14:11.741 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-17T05:14:11.741 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-17T05:14:11.742 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-17T05:14:11.742 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-17T05:14:11.742 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-17T05:14:11.742 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-17T05:14:11.742 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-17T05:14:11.742 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-17T05:14:11.742 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-17T05:14:11.742 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-17T05:14:11.742 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-17T05:14:11.742 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-17T05:14:11.742 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-17T05:14:11.742 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-17T05:14:11.743 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-17T05:14:11.743 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-17T05:14:11.743 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-17T05:14:11.743 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-17T05:14:11.743 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-17T05:14:11.743 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-17T05:14:11.743 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-17T05:14:11.743 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-17T05:14:11.743 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-17T05:14:11.743 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-17T05:14:11.743 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-17T05:14:11.743 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-17T05:14:11.743 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-17T05:14:11.744 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-17T05:14:11.744 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-17T05:14:11.744 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-17T05:14:11.744 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-17T05:14:11.744 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-17T05:14:11.744 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-17T05:14:11.744 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-17T05:14:11.744 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-17T05:14:11.744 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-17T05:14:11.744 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-17T05:14:11.745 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-17T05:14:11.745 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-17T05:14:11.745 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-17T05:14:11.745 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-17T05:14:11.745 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-17T05:14:11.745 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-17T05:14:11.745 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-17T05:14:11.745 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-17T05:14:11.745 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-17T05:14:11.745 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-17T05:14:11.745 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-17T05:14:11.745 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-17T05:14:11.745 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-17T05:14:11.746 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-17T05:14:11.746 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-17T05:14:11.746 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-17T05:14:11.746 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-17T05:14:11.746 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-17T05:14:11.746 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-17T05:14:11.746 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-17T05:14:11.746 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-17T05:14:11.746 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-17T05:14:11.746 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-17T05:14:11.746 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-17T05:14:11.746 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-17T05:14:11.747 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-17T05:14:11.747 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-17T05:14:11.747 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-17T05:14:11.747 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-17T05:14:11.747 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-17T05:14:11.747 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-17T05:14:11.747 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-17T05:14:11.747 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-17T05:14:11.747 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-17T05:14:11.747 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-17T05:14:11.747 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-17T05:14:11.747 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-17T05:14:11.748 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-17T05:14:11.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-17T05:14:11.809 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-17T05:14:11.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-17T05:14:11.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-17T05:14:11.809 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-17T05:14:11.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-17T05:14:11.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-17T05:14:11.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-17T05:14:11.809 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-17T05:14:11.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-17T05:14:11.809 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-17T05:14:11.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-17T05:14:11.810 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-17T05:14:11.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-17T05:14:11.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-17T05:14:11.810 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-17T05:14:11.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-17T05:14:11.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-17T05:14:11.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-17T05:14:11.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-17T05:14:11.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-17T05:14:11.810 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-17T05:14:11.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-17T05:14:11.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-17T05:14:11.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-17T05:14:11.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-17T05:14:11.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-17T05:14:11.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-17T05:14:11.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-17T05:14:11.811 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-17T05:14:11.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-17T05:14:11.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-17T05:14:11.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-17T05:14:11.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-17T05:14:11.811 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-17T05:14:11.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-17T05:14:11.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-17T05:14:11.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-17T05:14:11.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-17T05:14:11.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-17T05:14:11.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-17T05:14:11.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-17T05:14:11.812 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-17T05:14:11.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-17T05:14:11.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-17T05:14:11.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-17T05:14:11.812 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-17T05:14:11.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-17T05:14:11.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-17T05:14:11.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-17T05:14:11.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-17T05:14:11.813 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-17T05:14:11.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-17T05:14:11.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-17T05:14:11.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-17T05:14:11.813 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-17T05:14:11.814 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-17T05:14:11.814 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-17T05:14:11.814 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-17T05:14:11.814 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-17T05:14:11.814 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-17T05:14:11.814 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-17T05:14:11.814 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-17T05:14:11.814 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-17T05:14:11.814 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-17T05:14:11.814 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-17T05:14:11.814 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-17T05:14:11.814 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-17T05:14:11.814 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-17T05:14:11.815 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-17T05:14:11.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-17T05:14:11.815 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-17T05:14:11.815 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-17T05:14:11.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-17T05:14:11.815 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-17T05:14:11.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-17T05:14:11.815 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-17T05:14:11.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-17T05:14:11.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-17T05:14:11.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-17T05:14:11.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-17T05:14:11.815 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-17T05:14:11.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-17T05:14:11.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-17T05:14:11.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-17T05:14:11.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-17T05:14:11.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-17T05:14:11.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-17T05:14:11.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-17T05:14:11.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-17T05:14:11.816 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-17T05:14:11.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-17T05:14:11.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-17T05:14:11.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-17T05:14:11.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-17T05:14:11.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-17T05:14:11.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-17T05:14:11.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-17T05:14:11.817 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-17T05:14:11.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-17T05:14:11.817 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-17T05:14:11.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-17T05:14:11.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-17T05:14:11.817 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-17T05:14:11.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-17T05:14:11.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-17T05:14:11.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-17T05:14:11.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-17T05:14:11.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-17T05:14:11.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-17T05:14:11.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-17T05:14:11.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-17T05:14:11.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-17T05:14:11.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-17T05:14:11.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-17T05:14:11.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-17T05:14:11.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-17T05:14:11.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-17T05:14:11.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-17T05:14:11.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-17T05:14:11.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-17T05:14:11.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-17T05:14:11.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-17T05:14:11.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-17T05:14:11.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-17T05:14:11.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-17T05:14:11.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-17T05:14:11.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-17T05:14:11.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-17T05:14:11.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-17T05:14:11.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-17T05:14:11.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-17T05:14:11.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-17T05:14:11.820 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-17T05:14:11.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-17T05:14:11.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-17T05:14:11.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-17T05:14:11.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-17T05:14:11.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-17T05:14:11.820 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-17T05:14:11.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-17T05:14:11.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-17T05:14:11.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-17T05:14:11.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-17T05:14:11.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-17T05:14:11.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-17T05:14:11.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-17T05:14:11.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-17T05:14:11.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-17T05:14:11.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-17T05:14:11.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-17T05:14:11.821 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-17T05:14:11.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-17T05:14:11.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-17T05:14:11.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-17T05:14:11.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-17T05:14:11.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-17T05:14:11.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-17T05:14:11.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-17T05:14:11.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-17T05:14:11.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-17T05:14:11.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-17T05:14:11.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-17T05:14:11.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-17T05:14:11.822 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-17T05:14:11.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-17T05:14:11.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-17T05:14:11.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-17T05:14:11.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-17T05:14:11.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-17T05:14:11.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-17T05:14:11.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-17T05:14:11.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-17T05:14:11.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-17T05:14:11.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-17T05:14:11.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-17T05:14:11.823 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-17T05:14:11.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-17T05:14:11.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-17T05:14:11.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-17T05:14:11.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-17T05:14:11.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-17T05:14:11.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-17T05:14:11.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-17T05:14:11.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-17T05:14:11.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-17T05:14:11.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-17T05:14:11.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-17T05:14:11.824 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-17T05:14:11.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-17T05:14:11.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-17T05:14:11.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-17T05:14:11.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-17T05:14:11.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-17T05:14:11.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-17T05:14:11.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-17T05:14:11.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-17T05:14:11.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-17T05:14:11.825 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-17T05:14:11.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-17T05:14:11.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-17T05:14:11.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-17T05:14:11.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-17T05:14:11.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-17T05:14:11.826 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-17T05:14:11.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-17T05:14:11.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-17T05:14:11.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-17T05:14:11.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-17T05:14:11.827 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-17T05:14:11.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-17T05:14:11.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-17T05:14:11.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-17T05:14:11.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-17T05:14:11.828 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-17T05:14:11.828 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-17T05:14:11.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-17T05:14:11.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-17T05:14:11.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-17T05:14:11.829 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-17T05:14:11.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-17T05:14:11.829 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-17T05:14:11.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-17T05:14:11.830 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-17T05:14:11.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-17T05:14:11.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-17T05:14:11.830 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-17T05:14:11.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-17T05:14:11.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-17T05:14:11.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-17T05:14:11.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-17T05:14:11.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-17T05:14:11.831 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-17T05:14:11.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-17T05:14:11.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-17T05:14:11.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-17T05:14:11.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-17T05:14:11.832 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-17T05:14:11.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-17T05:14:11.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-17T05:14:11.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-17T05:14:11.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-17T05:14:11.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-17T05:14:11.833 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-17T05:14:11.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-17T05:14:11.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-17T05:14:11.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-17T05:14:11.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-17T05:14:11.834 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-17T05:14:11.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-17T05:14:11.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-17T05:14:11.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-17T05:14:11.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-17T05:14:11.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-17T05:14:11.835 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-17T05:14:11.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-17T05:14:11.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-17T05:14:11.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-17T05:14:11.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-17T05:14:11.836 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-17T05:14:11.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-17T05:14:11.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-17T05:14:11.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-17T05:14:11.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-17T05:14:11.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-17T05:14:11.837 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-17T05:14:11.838 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-17T05:14:11.838 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-17T05:14:11.840 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-17T05:14:11.840 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-17T05:14:11.841 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-17T05:14:11.841 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-17T05:14:11.841 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-17T05:14:11.841 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-17T05:14:11.842 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-17T05:14:11.842 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-17T05:14:11.842 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-17T05:14:11.842 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-17T05:14:11.842 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-17T05:14:11.842 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-17T05:14:11.843 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-17T05:14:11.843 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-17T05:14:11.843 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-17T05:14:11.843 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-17T05:14:11.843 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-17T05:14:11.843 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-17T05:14:11.843 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-17T05:14:11.844 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-17T05:14:11.844 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-17T05:14:11.844 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-17T05:14:11.844 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-17T05:14:11.844 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-17T05:14:11.844 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-17T05:14:11.845 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-17T05:14:11.845 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-17T05:14:11.845 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-17T05:14:11.845 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-17T05:14:11.845 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-17T05:14:11.845 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-17T05:14:11.845 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-17T05:14:11.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-17T05:14:11.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-17T05:14:11.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-17T05:14:11.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-17T05:14:11.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-17T05:14:11.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-17T05:14:11.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-17T05:14:11.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-17T05:14:11.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-17T05:14:11.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-17T05:14:11.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-17T05:14:11.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-17T05:14:11.846 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-17T05:14:11.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-17T05:14:11.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-17T05:14:11.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-17T05:14:11.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-17T05:14:11.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-17T05:14:11.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-17T05:14:11.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-17T05:14:11.847 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-17T05:14:11.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-17T05:14:11.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-17T05:14:11.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-17T05:14:11.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-17T05:14:11.847 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-17T05:14:11.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-17T05:14:11.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-17T05:14:11.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-17T05:14:11.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-17T05:14:11.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-17T05:14:11.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-17T05:14:11.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-17T05:14:11.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-17T05:14:11.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-17T05:14:11.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-17T05:14:11.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-17T05:14:11.848 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-17T05:14:11.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-17T05:14:11.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-17T05:14:11.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-17T05:14:11.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-17T05:14:11.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-17T05:14:11.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-17T05:14:11.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-17T05:14:11.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-17T05:14:11.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-17T05:14:11.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-17T05:14:11.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-17T05:14:11.849 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-17T05:14:11.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-17T05:14:11.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-17T05:14:11.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-17T05:14:11.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-17T05:14:11.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-17T05:14:11.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-17T05:14:11.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-17T05:14:11.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-17T05:14:11.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-17T05:14:11.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-17T05:14:11.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-17T05:14:11.850 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-17T05:14:11.851 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-17T05:14:11.851 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-17T05:14:11.851 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-17T05:14:11.851 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-17T05:14:11.851 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-17T05:14:11.851 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-17T05:14:11.851 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-17T05:14:11.851 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-17T05:14:11.851 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-17T05:14:11.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-17T05:14:11.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-17T05:14:11.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-17T05:14:11.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-17T05:14:11.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-17T05:14:11.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-17T05:14:11.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-17T05:14:11.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-17T05:14:11.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-17T05:14:11.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-17T05:14:11.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-17T05:14:11.852 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-17T05:14:11.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-17T05:14:11.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-17T05:14:11.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-17T05:14:11.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-17T05:14:11.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-17T05:14:11.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-17T05:14:11.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-17T05:14:11.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-17T05:14:11.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-17T05:14:11.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-17T05:14:11.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-17T05:14:11.853 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-17T05:14:11.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-17T05:14:11.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-17T05:14:11.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-17T05:14:11.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-17T05:14:11.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-17T05:14:11.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-17T05:14:11.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-17T05:14:11.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-17T05:14:11.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-17T05:14:11.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-17T05:14:11.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-17T05:14:11.854 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-17T05:14:11.855 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-17T05:14:11.855 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-17T05:14:11.855 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-17T05:14:11.855 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-17T05:14:11.855 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-17T05:14:11.855 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-17T05:14:11.855 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-17T05:14:11.855 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-17T05:14:11.855 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-17T05:14:11.855 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-17T05:14:11.855 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-17T05:14:11.856 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-17T05:14:11.856 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-17T05:14:11.856 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-17T05:14:11.856 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-17T05:14:11.856 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-17T05:14:11.856 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-17T05:14:11.856 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-17T05:14:11.856 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-17T05:14:11.856 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-17T05:14:11.856 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-17T05:14:11.856 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-17T05:14:11.856 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-17T05:14:11.857 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-17T05:14:11.857 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-17T05:14:11.857 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-17T05:14:11.857 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-17T05:14:11.857 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-17T05:14:11.857 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-17T05:14:11.857 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-17T05:14:11.857 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-17T05:14:11.857 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-17T05:14:11.857 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-17T05:14:11.857 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-17T05:14:11.858 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-17T05:14:11.858 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-17T05:14:11.858 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-17T05:14:11.858 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-17T05:14:11.858 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-17T05:14:11.858 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-17T05:14:11.858 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-17T05:14:11.858 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-17T05:14:11.858 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-17T05:14:11.858 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-17T05:14:11.858 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-17T05:14:11.858 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-17T05:14:11.858 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-17T05:14:11.859 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-17T05:14:11.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-17T05:14:11.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-17T05:14:11.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-17T05:14:11.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-17T05:14:11.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-17T05:14:11.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-17T05:14:11.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-17T05:14:11.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-17T05:14:11.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-17T05:14:11.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-17T05:14:11.859 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-17T05:14:11.860 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-17T05:14:11.860 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-17T05:14:11.860 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-17T05:14:11.860 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-17T05:14:11.860 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-17T05:14:11.860 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-17T05:14:11.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-17T05:14:11.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-17T05:14:11.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-17T05:14:11.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-17T05:14:11.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-17T05:14:11.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-17T05:14:11.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-17T05:14:11.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-17T05:14:11.861 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-17T05:14:11.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-17T05:14:11.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-17T05:14:11.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-17T05:14:11.861 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-17T05:14:11.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-17T05:14:11.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-17T05:14:11.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-17T05:14:11.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-17T05:14:11.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-17T05:14:11.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-17T05:14:11.862 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-17T05:14:11.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-17T05:14:11.862 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-17T05:14:11.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-17T05:14:11.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-17T05:14:11.862 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-17T05:14:11.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-17T05:14:11.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-17T05:14:11.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-17T05:14:11.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-17T05:14:11.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-17T05:14:11.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-17T05:14:11.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-17T05:14:11.863 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-17T05:14:11.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-17T05:14:11.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-17T05:14:11.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-17T05:14:11.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-17T05:14:11.863 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-17T05:14:11.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-17T05:14:11.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-17T05:14:11.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-17T05:14:11.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-17T05:14:11.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-17T05:14:11.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-17T05:14:11.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-17T05:14:11.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-17T05:14:11.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-17T05:14:11.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-17T05:14:11.864 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-17T05:14:11.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-17T05:14:11.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-17T05:14:11.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-17T05:14:11.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-17T05:14:11.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-17T05:14:11.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-17T05:14:11.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-17T05:14:11.865 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-17T05:14:11.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-17T05:14:11.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-17T05:14:11.865 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-17T05:14:11.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-17T05:14:11.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-17T05:14:11.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-17T05:14:11.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-17T05:14:11.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-17T05:14:11.866 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-17T05:14:11.866 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-17T05:14:11.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-17T05:14:11.866 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-17T05:14:11.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-17T05:14:11.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-17T05:14:11.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-17T05:14:11.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-17T05:14:11.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-17T05:14:11.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-17T05:14:11.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-17T05:14:11.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-17T05:14:11.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-17T05:14:11.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-17T05:14:11.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-17T05:14:11.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-17T05:14:11.867 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-17T05:14:11.868 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-17T05:14:11.868 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-17T05:14:11.868 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-17T05:14:11.868 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-17T05:14:11.868 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-17T05:14:11.868 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-17T05:14:11.868 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-17T05:14:11.868 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-17T05:14:11.868 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-17T05:14:11.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-17T05:14:11.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-17T05:14:11.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-17T05:14:11.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-17T05:14:11.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-17T05:14:11.869 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-17T05:14:11.869 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-17T05:14:11.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-17T05:14:11.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-17T05:14:11.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-17T05:14:11.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-17T05:14:11.869 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-17T05:14:11.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-17T05:14:11.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-17T05:14:11.870 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-17T05:14:11.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-17T05:14:11.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-17T05:14:11.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-17T05:14:11.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-17T05:14:11.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-17T05:14:11.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-17T05:14:11.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-17T05:14:11.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-17T05:14:11.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-17T05:14:11.870 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-17T05:14:11.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-17T05:14:11.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-17T05:14:11.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-17T05:14:11.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-17T05:14:11.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-17T05:14:11.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-17T05:14:11.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-17T05:14:11.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-17T05:14:11.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-17T05:14:11.871 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-17T05:14:11.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-17T05:14:11.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-17T05:14:11.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-17T05:14:11.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-17T05:14:11.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-17T05:14:11.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-17T05:14:11.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-17T05:14:11.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-17T05:14:11.872 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-17T05:14:11.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-17T05:14:11.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-17T05:14:11.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-17T05:14:11.873 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-17T05:14:11.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-17T05:14:11.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-17T05:14:11.873 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-17T05:14:11.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-17T05:14:11.873 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-17T05:14:11.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-17T05:14:11.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-17T05:14:11.874 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-17T05:14:11.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-17T05:14:11.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-17T05:14:11.874 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-17T05:14:11.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-17T05:14:11.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-17T05:14:11.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-17T05:14:11.874 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-17T05:14:11.874 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-17T05:14:11.874 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-17T05:14:11.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-17T05:14:11.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-17T05:14:11.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-17T05:14:11.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-17T05:14:11.875 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-17T05:14:11.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-17T05:14:11.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-17T05:14:11.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-17T05:14:11.875 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-17T05:14:11.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-17T05:14:11.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-17T05:14:11.875 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-17T05:14:11.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-17T05:14:11.876 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-17T05:14:11.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-17T05:14:11.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-17T05:14:11.876 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-17T05:14:11.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-17T05:14:11.876 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-17T05:14:11.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-17T05:14:11.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-17T05:14:11.877 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-17T05:14:11.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-17T05:14:11.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-17T05:14:11.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-17T05:14:11.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-17T05:14:11.877 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-17T05:14:11.878 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-17T05:14:11.878 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-17T05:14:11.878 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-17T05:14:11.878 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-17T05:14:11.878 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-17T05:14:11.968 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-17T05:14:11.968 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-17T05:14:11.969 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-17T05:14:11.969 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-17T05:14:11.969 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-17T05:14:11.969 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-17T05:14:11.969 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-17T05:14:11.969 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-17T05:14:11.969 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-17T05:14:11.969 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-17T05:14:11.969 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-17T05:14:11.969 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-17T05:14:11.969 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-17T05:14:11.970 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-17T05:14:11.970 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-17T05:14:11.970 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-17T05:14:11.970 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-17T05:14:11.970 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-17T05:14:11.970 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-17T05:14:11.970 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-17T05:14:11.970 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-17T05:14:11.970 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-17T05:14:11.970 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-17T05:14:11.970 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-17T05:14:11.970 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-17T05:14:11.970 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-17T05:14:11.971 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-17T05:14:11.971 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-17T05:14:11.971 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-17T05:14:11.971 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-17T05:14:11.971 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-17T05:14:11.971 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-17T05:14:11.971 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-17T05:14:11.971 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-17T05:14:11.971 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-17T05:14:11.971 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-17T05:14:11.971 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-17T05:14:11.971 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-17T05:14:11.972 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-17T05:14:11.972 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-17T05:14:11.972 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-17T05:14:11.972 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-17T05:14:11.972 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-17T05:14:11.972 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-17T05:14:11.972 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-17T05:14:11.972 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-17T05:14:11.972 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-17T05:14:11.972 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-17T05:14:11.972 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-17T05:14:11.973 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-17T05:14:11.973 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-17T05:14:11.973 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-17T05:14:11.973 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-17T05:14:11.973 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-17T05:14:11.973 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-17T05:14:11.973 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-17T05:14:11.973 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-17T05:14:11.973 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-17T05:14:11.973 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-17T05:14:11.973 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-17T05:14:11.973 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-17T05:14:11.973 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-17T05:14:11.974 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-17T05:14:11.974 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-17T05:14:11.974 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-17T05:14:11.974 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-17T05:14:11.974 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-17T05:14:11.974 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-17T05:14:11.974 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-17T05:14:11.974 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-17T05:14:11.974 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-17T05:14:11.974 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-17T05:14:11.974 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-17T05:14:11.974 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-17T05:14:11.975 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-17T05:14:11.975 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-17T05:14:11.975 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-17T05:14:11.975 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-17T05:14:11.975 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-17T05:14:11.975 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-17T05:14:11.975 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-17T05:14:11.975 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-17T05:14:11.975 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-17T05:14:11.975 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-17T05:14:11.975 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-17T05:14:11.975 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-17T05:14:11.976 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-17T05:14:11.976 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-17T05:14:11.976 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-17T05:14:11.976 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-17T05:14:11.976 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-17T05:14:11.976 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-17T05:14:11.976 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-17T05:14:11.976 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-17T05:14:11.976 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-17T05:14:11.976 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-17T05:14:11.976 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-17T05:14:11.976 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-17T05:14:11.977 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-17T05:14:11.977 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-17T05:14:11.977 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-17T05:14:11.977 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-17T05:14:11.977 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-17T05:14:11.977 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-17T05:14:11.977 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-17T05:14:11.977 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-17T05:14:11.977 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-17T05:14:11.978 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-17T05:14:11.978 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-17T05:14:11.978 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-17T05:14:11.978 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-17T05:14:11.978 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-17T05:14:11.978 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-17T05:14:11.978 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-17T05:14:11.978 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-17T05:14:11.978 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-17T05:14:11.978 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-17T05:14:11.978 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-17T05:14:11.978 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-17T05:14:11.979 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-17T05:14:11.979 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-17T05:14:11.979 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-17T05:14:11.979 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-17T05:14:11.979 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-17T05:14:11.979 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-17T05:14:11.979 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-17T05:14:11.979 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-17T05:14:11.979 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-17T05:14:11.979 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-17T05:14:11.979 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-17T05:14:11.979 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-17T05:14:11.980 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-17T05:14:11.980 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-17T05:14:11.980 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-17T05:14:11.980 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-17T05:14:11.980 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-17T05:14:11.980 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-17T05:14:11.980 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-17T05:14:11.980 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-17T05:14:11.980 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-17T05:14:11.980 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-17T05:14:11.980 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-17T05:14:11.980 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-17T05:14:11.980 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-17T05:14:11.981 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-17T05:14:11.981 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-17T05:14:11.981 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-17T05:14:11.981 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-17T05:14:11.981 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-17T05:14:11.981 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-17T05:14:11.981 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-17T05:14:11.981 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-17T05:14:11.981 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-17T05:14:11.981 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-17T05:14:11.981 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-17T05:14:11.981 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-17T05:14:11.981 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-17T05:14:11.982 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-17T05:14:11.982 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-17T05:14:11.982 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-17T05:14:11.982 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-17T05:14:11.982 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-17T05:14:11.982 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-17T05:14:11.982 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-17T05:14:11.982 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-17T05:14:11.982 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-17T05:14:11.982 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-17T05:14:11.982 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-17T05:14:11.982 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-17T05:14:11.982 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-17T05:14:11.983 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-17T05:14:11.983 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-17T05:14:11.983 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-17T05:14:11.983 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-17T05:14:11.983 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-17T05:14:11.983 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-17T05:14:11.983 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-17T05:14:11.983 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-17T05:14:11.983 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-17T05:14:11.983 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-17T05:14:11.983 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-17T05:14:11.983 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-17T05:14:11.984 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-17T05:14:11.984 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-17T05:14:11.984 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-17T05:14:11.984 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-17T05:14:11.984 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-17T05:14:11.984 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-17T05:14:11.984 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-17T05:14:11.984 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-17T05:14:11.984 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-17T05:14:11.984 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-17T05:14:11.984 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-17T05:14:11.984 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-17T05:14:11.985 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-17T05:14:11.985 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-17T05:14:11.985 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-17T05:14:11.985 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-17T05:14:11.985 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-17T05:14:11.985 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-17T05:14:11.985 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-17T05:14:11.985 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-17T05:14:11.985 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-17T05:14:11.986 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-17T05:14:11.986 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-17T05:14:11.986 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-17T05:14:11.986 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-17T05:14:11.986 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-17T05:14:11.986 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-17T05:14:11.986 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-17T05:14:11.986 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-17T05:14:11.986 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-17T05:14:11.986 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-17T05:14:11.986 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-17T05:14:11.986 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-17T05:14:11.986 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-17T05:14:11.987 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-17T05:14:11.987 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-17T05:14:11.987 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-17T05:14:11.987 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-17T05:14:11.987 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-17T05:14:11.987 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-17T05:14:11.987 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-17T05:14:11.987 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-17T05:14:11.987 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-17T05:14:11.987 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-17T05:14:11.988 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-17T05:14:11.988 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-17T05:14:11.988 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-17T05:14:11.988 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-17T05:14:11.988 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-17T05:14:11.988 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-17T05:14:11.988 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-17T05:14:11.988 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-17T05:14:11.988 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-17T05:14:11.988 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-17T05:14:11.988 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-17T05:14:11.989 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-17T05:14:11.989 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-17T05:14:11.989 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-17T05:14:11.989 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-17T05:14:11.989 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-17T05:14:11.989 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-17T05:14:11.989 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-17T05:14:11.989 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-17T05:14:11.989 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-17T05:14:11.989 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-17T05:14:11.989 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-17T05:14:11.989 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-17T05:14:11.990 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-17T05:14:11.990 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-17T05:14:11.990 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-17T05:14:11.990 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-17T05:14:11.990 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-17T05:14:11.990 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-17T05:14:11.990 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-17T05:14:11.990 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-17T05:14:11.990 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-17T05:14:11.990 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-17T05:14:11.991 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-17T05:14:11.991 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-17T05:14:11.991 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-17T05:14:11.991 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-17T05:14:11.991 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-17T05:14:11.991 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-17T05:14:11.991 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-17T05:14:11.991 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-17T05:14:11.991 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-17T05:14:11.991 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-17T05:14:11.991 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-17T05:14:11.991 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-17T05:14:11.992 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-17T05:14:11.992 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-17T05:14:11.992 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-17T05:14:11.992 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-17T05:14:11.992 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-17T05:14:11.992 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-17T05:14:11.992 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-17T05:14:11.992 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-17T05:14:11.992 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-17T05:14:11.992 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-17T05:14:11.993 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-17T05:14:11.993 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-17T05:14:11.993 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-17T05:14:11.993 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-17T05:14:11.993 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-17T05:14:11.993 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-17T05:14:11.993 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-17T05:14:11.993 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-17T05:14:11.993 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-17T05:14:11.993 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-17T05:14:11.993 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-17T05:14:11.994 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-17T05:14:11.994 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-17T05:14:11.994 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-17T05:14:11.994 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-17T05:14:11.994 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-17T05:14:11.994 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-17T05:14:11.994 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-17T05:14:11.994 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-17T05:14:11.994 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-17T05:14:11.994 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-17T05:14:11.994 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-17T05:14:11.994 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-17T05:14:11.995 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-17T05:14:11.995 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-17T05:14:11.995 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-17T05:14:11.995 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-17T05:14:11.995 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-17T05:14:11.995 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-17T05:14:11.995 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-17T05:14:11.995 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-17T05:14:11.995 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-17T05:14:11.995 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-17T05:14:11.995 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-17T05:14:11.995 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-17T05:14:11.996 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-17T05:14:11.996 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-17T05:14:11.996 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-17T05:14:11.996 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-17T05:14:11.996 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-17T05:14:11.996 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-17T05:14:11.996 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-17T05:14:11.996 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-17T05:14:11.996 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-17T05:14:11.996 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-17T05:14:11.996 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-17T05:14:11.996 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-17T05:14:11.997 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-17T05:14:11.997 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-17T05:14:11.997 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-17T05:14:11.997 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-17T05:14:11.997 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-17T05:14:11.997 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-17T05:14:11.997 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-17T05:14:11.997 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-17T05:14:11.997 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-17T05:14:11.997 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-17T05:14:11.998 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-17T05:14:11.998 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-17T05:14:11.998 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-17T05:14:11.998 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-17T05:14:11.998 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-17T05:14:11.998 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-17T05:14:11.998 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-17T05:14:11.998 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-17T05:14:11.998 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-17T05:14:11.999 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-17T05:14:11.999 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-17T05:14:11.999 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-17T05:14:11.999 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-17T05:14:11.999 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-17T05:14:11.999 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-17T05:14:11.999 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-17T05:14:11.999 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-17T05:14:11.999 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-17T05:14:11.999 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-17T05:14:11.999 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-17T05:14:11.999 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-17T05:14:11.999 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-17T05:14:12.000 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-17T05:14:12.000 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-17T05:14:12.000 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-17T05:14:12.000 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-17T05:14:12.000 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-17T05:14:12.000 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-17T05:14:12.000 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-17T05:14:12.000 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-17T05:14:12.000 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-17T05:14:12.000 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-17T05:14:12.000 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-17T05:14:12.000 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-17T05:14:12.000 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-17T05:14:12.001 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-17T05:14:12.001 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-17T05:14:12.001 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-17T05:14:12.001 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-17T05:14:12.001 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-17T05:14:12.001 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-17T05:14:12.001 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-17T05:14:12.001 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-17T05:14:12.001 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-17T05:14:12.001 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-17T05:14:12.001 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-17T05:14:12.001 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-17T05:14:12.002 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-17T05:14:12.002 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-17T05:14:12.002 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-17T05:14:12.002 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-17T05:14:12.002 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-17T05:14:12.002 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-17T05:14:12.002 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-17T05:14:12.002 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-17T05:14:12.002 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-17T05:14:12.002 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-17T05:14:12.003 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-17T05:14:12.003 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-17T05:14:12.003 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-17T05:14:12.003 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-17T05:14:12.003 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-17T05:14:12.003 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-17T05:14:12.003 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-17T05:14:12.003 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-17T05:14:12.003 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-17T05:14:12.003 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-17T05:14:12.003 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-17T05:14:12.003 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-17T05:14:12.003 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-17T05:14:12.004 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-17T05:14:12.004 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-17T05:14:12.004 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-17T05:14:12.004 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-17T05:14:12.004 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-17T05:14:12.004 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-17T05:14:12.004 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-17T05:14:12.004 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-17T05:14:12.004 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-17T05:14:12.004 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-17T05:14:12.004 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-17T05:14:12.004 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-17T05:14:12.005 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-17T05:14:12.005 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-17T05:14:12.005 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-17T05:14:12.005 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-17T05:14:12.005 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-17T05:14:12.005 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-17T05:14:12.005 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-17T05:14:12.005 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-17T05:14:12.005 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-17T05:14:12.005 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-17T05:14:12.005 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-17T05:14:12.005 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-17T05:14:12.006 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-17T05:14:12.006 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-17T05:14:12.006 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-17T05:14:12.006 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-17T05:14:12.006 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-17T05:14:12.006 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-17T05:14:12.006 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-17T05:14:12.006 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-17T05:14:12.006 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-17T05:14:12.006 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-17T05:14:12.006 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-17T05:14:12.006 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-17T05:14:12.006 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-17T05:14:12.007 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-17T05:14:12.007 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-17T05:14:12.007 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-17T05:14:12.007 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-17T05:14:12.007 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-17T05:14:12.007 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-17T05:14:12.007 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-17T05:14:12.007 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-17T05:14:12.007 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-17T05:14:12.007 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-17T05:14:12.007 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-17T05:14:12.007 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-17T05:14:12.008 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-17T05:14:12.008 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-17T05:14:12.008 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-17T05:14:12.008 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-17T05:14:12.008 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-17T05:14:12.008 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-17T05:14:12.008 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-17T05:14:12.008 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-17T05:14:12.008 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-17T05:14:12.009 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-17T05:14:12.009 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-17T05:14:12.009 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-17T05:14:12.009 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-17T05:14:12.009 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-17T05:14:12.009 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-17T05:14:12.009 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-17T05:14:12.009 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-17T05:14:12.009 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-17T05:14:12.009 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-17T05:14:12.009 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-17T05:14:12.009 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-17T05:14:12.010 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-17T05:14:12.010 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-17T05:14:12.010 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-17T05:14:12.010 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-17T05:14:12.010 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-17T05:14:12.010 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-17T05:14:12.010 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-17T05:14:12.010 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-17T05:14:12.010 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-17T05:14:12.010 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-17T05:14:12.010 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-17T05:14:12.011 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-17T05:14:12.011 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-17T05:14:12.011 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-17T05:14:12.011 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-17T05:14:12.011 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-17T05:14:12.011 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-17T05:14:12.011 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-17T05:14:12.011 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-17T05:14:12.011 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-17T05:14:12.011 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-17T05:14:12.011 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-17T05:14:12.011 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-17T05:14:12.011 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-17T05:14:12.012 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-17T05:14:12.012 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-17T05:14:12.012 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-17T05:14:12.012 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-17T05:14:12.012 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-17T05:14:12.012 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-17T05:14:12.012 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-17T05:14:12.012 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-17T05:14:12.012 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-17T05:14:12.012 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-17T05:14:12.013 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-17T05:14:12.013 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-17T05:14:12.013 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-17T05:14:12.013 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-17T05:14:12.013 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-17T05:14:12.013 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-17T05:14:12.013 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-17T05:14:12.014 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-17T05:14:12.014 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-17T05:14:12.014 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-17T05:14:12.014 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-17T05:14:12.015 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-17T05:14:12.015 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-17T05:14:12.015 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-17T05:14:12.015 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-17T05:14:12.015 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-17T05:14:12.015 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-17T05:14:12.016 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-17T05:14:12.016 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-17T05:14:12.016 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-17T05:14:12.016 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-17T05:14:12.016 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-17T05:14:12.017 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-17T05:14:12.017 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-17T05:14:12.017 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-17T05:14:12.017 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-17T05:14:12.017 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-17T05:14:12.017 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-17T05:14:12.018 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-17T05:14:12.018 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-17T05:14:12.018 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-17T05:14:12.018 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-17T05:14:12.018 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-17T05:14:12.019 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-17T05:14:12.019 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-17T05:14:12.019 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-17T05:14:12.019 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-17T05:14:12.019 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-17T05:14:12.019 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-17T05:14:12.020 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-17T05:14:12.020 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-17T05:14:12.020 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-17T05:14:12.020 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-17T05:14:12.020 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-17T05:14:12.021 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-17T05:14:12.021 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-17T05:14:12.021 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-17T05:14:12.021 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-17T05:14:12.021 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-17T05:14:12.022 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-17T05:14:12.022 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-17T05:14:12.022 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-17T05:14:12.022 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-17T05:14:12.022 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-17T05:14:12.023 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-17T05:14:12.023 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-17T05:14:12.023 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-17T05:14:12.023 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-17T05:14:12.023 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-17T05:14:12.024 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-17T05:14:12.024 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-17T05:14:12.024 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-17T05:14:12.024 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-17T05:14:12.024 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-17T05:14:12.024 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-17T05:14:12.025 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-17T05:14:12.025 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-17T05:14:12.025 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-17T05:14:12.025 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-17T05:14:12.025 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-17T05:14:12.025 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-17T05:14:12.026 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-17T05:14:12.026 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-17T05:14:12.026 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-17T05:14:12.026 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-17T05:14:12.026 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-17T05:14:12.026 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-17T05:14:12.027 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-17T05:14:12.027 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-17T05:14:12.027 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-17T05:14:12.027 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-17T05:14:12.027 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-17T05:14:12.028 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-17T05:14:12.028 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-17T05:14:12.028 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-17T05:14:12.028 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-17T05:14:12.028 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-17T05:14:12.029 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-17T05:14:12.029 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-17T05:14:12.029 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-17T05:14:12.029 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-17T05:14:12.029 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-17T05:14:12.029 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-17T05:14:12.030 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-17T05:14:12.030 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-17T05:14:12.030 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-17T05:14:12.030 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-17T05:14:12.030 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-17T05:14:12.030 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-17T05:14:12.031 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-17T05:14:12.031 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-17T05:14:12.031 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-17T05:14:12.031 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-17T05:14:12.031 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-17T05:14:12.032 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-17T05:14:12.032 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-17T05:14:12.032 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-17T05:14:12.032 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-17T05:14:12.032 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-17T05:14:12.032 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-17T05:14:12.033 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-17T05:14:12.033 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-17T05:14:12.033 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-17T05:14:12.033 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-17T05:14:12.033 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-17T05:14:12.034 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-17T05:14:12.034 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-17T05:14:12.034 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-17T05:14:12.034 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-17T05:14:12.034 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-17T05:14:12.035 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-17T05:14:12.035 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-17T05:14:12.035 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-17T05:14:12.035 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-17T05:14:12.035 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-17T05:14:12.035 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-17T05:14:12.036 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-17T05:14:12.036 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-17T05:14:12.036 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-17T05:14:12.036 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-17T05:14:12.036 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-17T05:14:12.037 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-17T05:14:12.037 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-17T05:14:12.037 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-17T05:14:12.037 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-17T05:14:12.037 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-17T05:14:12.038 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-17T05:14:12.038 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-17T05:14:12.038 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-17T05:14:12.038 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-17T05:14:12.038 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-17T05:14:12.038 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-17T05:14:12.039 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-17T05:14:12.039 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-17T05:14:12.039 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-17T05:14:12.039 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-17T05:14:12.039 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-17T05:14:12.040 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-17T05:14:12.040 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-17T05:14:12.040 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-17T05:14:12.040 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-17T05:14:12.040 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-17T05:14:12.040 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-17T05:14:12.041 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-17T05:14:12.041 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-17T05:14:12.041 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-17T05:14:12.041 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-17T05:14:12.041 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-17T05:14:12.042 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-17T05:14:12.042 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-17T05:14:12.042 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-17T05:14:12.042 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-17T05:14:12.042 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-17T05:14:12.043 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-17T05:14:12.043 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-17T05:14:12.043 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-17T05:14:12.043 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-17T05:14:12.043 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-17T05:14:12.043 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-17T05:14:12.044 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-17T05:14:12.044 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-17T05:14:12.044 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-17T05:14:12.044 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-17T05:14:12.044 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-17T05:14:12.045 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-17T05:14:12.045 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-17T05:14:12.045 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-17T05:14:12.045 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-17T05:14:12.045 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-17T05:14:12.046 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-17T05:14:12.046 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-17T05:14:12.046 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-17T05:14:12.046 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-17T05:14:12.046 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-17T05:14:12.046 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-17T05:14:12.046 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-17T05:14:12.047 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-17T05:14:12.047 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-17T05:14:12.047 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-17T05:14:12.047 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-17T05:14:12.047 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-17T05:14:12.047 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-17T05:14:12.047 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-17T05:14:12.047 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-17T05:14:12.047 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-17T05:14:12.048 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-17T05:14:12.048 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-17T05:14:12.048 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-17T05:14:12.048 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-17T05:14:12.048 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-17T05:14:12.048 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-17T05:14:12.048 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-17T05:14:12.048 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-17T05:14:12.048 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-17T05:14:12.048 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-17T05:14:12.049 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-17T05:14:12.049 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-17T05:14:12.049 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-17T05:14:12.049 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-17T05:14:12.049 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-17T05:14:12.049 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-17T05:14:12.049 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-17T05:14:12.049 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-17T05:14:12.049 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-17T05:14:12.050 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-17T05:14:12.050 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-17T05:14:12.050 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-17T05:14:12.050 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-17T05:14:12.050 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-17T05:14:12.050 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-17T05:14:12.050 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-17T05:14:12.050 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-17T05:14:12.050 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-17T05:14:12.051 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-17T05:14:12.051 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-17T05:14:12.051 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-17T05:14:12.051 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-17T05:14:12.051 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-17T05:14:12.051 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-17T05:14:12.051 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-17T05:14:12.051 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-17T05:14:12.051 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-17T05:14:12.052 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-17T05:14:12.052 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-17T05:14:12.052 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-17T05:14:12.052 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-17T05:14:12.052 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-17T05:14:12.052 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-17T05:14:12.052 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-17T05:14:12.052 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-17T05:14:12.053 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-17T05:14:12.053 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-17T05:14:12.053 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-17T05:14:12.053 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-17T05:14:12.053 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-17T05:14:12.053 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-17T05:14:12.053 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-17T05:14:12.053 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-17T05:14:12.053 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-17T05:14:12.054 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-17T05:14:12.054 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-17T05:14:12.054 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-17T05:14:12.054 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-17T05:14:12.054 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-17T05:14:12.054 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-17T05:14:12.054 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-17T05:14:12.054 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-17T05:14:12.054 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-17T05:14:12.054 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-17T05:14:12.055 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-17T05:14:12.055 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-17T05:14:12.055 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-17T05:14:12.055 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-17T05:14:12.055 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-17T05:14:12.055 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-17T05:14:12.055 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-17T05:14:12.055 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-17T05:14:12.055 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-17T05:14:12.056 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-17T05:14:12.056 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-17T05:14:12.056 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-17T05:14:12.056 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-17T05:14:12.056 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-17T05:14:12.056 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-17T05:14:12.056 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-17T05:14:12.056 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-17T05:14:12.057 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-17T05:14:12.057 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-17T05:14:12.057 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-17T05:14:12.057 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-17T05:14:12.057 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-17T05:14:12.057 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-17T05:14:12.057 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-17T05:14:12.057 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-17T05:14:12.058 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-17T05:14:12.058 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-17T05:14:12.058 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-17T05:14:12.058 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-17T05:14:12.058 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-17T05:14:12.058 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-17T05:14:12.059 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-17T05:14:12.059 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-17T05:14:12.059 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-17T05:14:12.059 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-17T05:14:12.059 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-17T05:14:12.059 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-17T05:14:12.060 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-17T05:14:12.060 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-17T05:14:12.060 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-17T05:14:12.060 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-17T05:14:12.060 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-17T05:14:12.060 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-17T05:14:12.061 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-17T05:14:12.061 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-17T05:14:12.061 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-17T05:14:12.061 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-17T05:14:12.061 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-17T05:14:12.062 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-17T05:14:12.062 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-17T05:14:12.062 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-17T05:14:12.062 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-17T05:14:12.062 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-17T05:14:12.063 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-17T05:14:12.063 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-17T05:14:12.063 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-17T05:14:12.063 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-17T05:14:12.063 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-17T05:14:12.064 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-17T05:14:12.064 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-17T05:14:12.064 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-17T05:14:12.064 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-17T05:14:12.064 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-17T05:14:12.065 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-17T05:14:12.065 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-17T05:14:12.065 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-17T05:14:12.065 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-17T05:14:12.065 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-17T05:14:12.065 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-17T05:14:12.066 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-17T05:14:12.066 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-17T05:14:12.066 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-17T05:14:12.066 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-17T05:14:12.066 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-17T05:14:12.067 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-17T05:14:12.067 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-17T05:14:12.067 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-17T05:14:12.067 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-17T05:14:12.067 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-17T05:14:12.068 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-17T05:14:12.068 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-17T05:14:12.068 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-17T05:14:12.068 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-17T05:14:12.068 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-17T05:14:12.068 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-17T05:14:12.068 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-17T05:14:12.069 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-17T05:14:12.069 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-17T05:14:12.069 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-17T05:14:12.069 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-17T05:14:12.069 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-17T05:14:12.069 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-17T05:14:12.069 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-17T05:14:12.069 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-17T05:14:12.070 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-17T05:14:12.070 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-17T05:14:12.070 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-17T05:14:12.070 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-17T05:14:12.070 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-17T05:14:12.070 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-17T05:14:12.070 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-17T05:14:12.071 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-17T05:14:12.071 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-17T05:14:12.071 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-17T05:14:12.071 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-17T05:14:12.071 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-17T05:14:12.071 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-17T05:14:12.071 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-17T05:14:12.071 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-17T05:14:12.072 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-17T05:14:12.072 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-17T05:14:12.072 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-17T05:14:12.072 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-17T05:14:12.072 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-17T05:14:12.072 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-17T05:14:12.072 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-17T05:14:12.072 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-17T05:14:12.072 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-17T05:14:12.072 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-17T05:14:12.072 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-17T05:14:12.073 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-17T05:14:12.073 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-17T05:14:12.073 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-17T05:14:12.073 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-17T05:14:12.073 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-17T05:14:12.073 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-17T05:14:12.073 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-17T05:14:12.073 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-17T05:14:12.073 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-17T05:14:12.073 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-17T05:14:12.073 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-17T05:14:12.073 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-17T05:14:12.074 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-17T05:14:12.074 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-17T05:14:12.074 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-17T05:14:12.074 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-17T05:14:12.074 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-17T05:14:12.074 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-17T05:14:12.074 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-17T05:14:12.074 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-17T05:14:12.074 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-17T05:14:12.074 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-17T05:14:12.074 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-17T05:14:12.074 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-17T05:14:12.075 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-17T05:14:12.075 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-17T05:14:12.075 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-17T05:14:12.075 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-17T05:14:12.075 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-17T05:14:12.075 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-17T05:14:12.075 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-17T05:14:12.075 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-17T05:14:12.075 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-17T05:14:12.075 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-17T05:14:12.075 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-17T05:14:12.075 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-17T05:14:12.075 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-17T05:14:12.076 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-17T05:14:12.076 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-17T05:14:12.076 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-17T05:14:12.076 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-17T05:14:12.076 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-17T05:14:12.076 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-17T05:14:12.076 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-17T05:14:12.076 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-17T05:14:12.076 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-17T05:14:12.076 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-17T05:14:12.076 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-17T05:14:12.076 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-17T05:14:12.076 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-17T05:14:12.077 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-17T05:14:12.077 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-17T05:14:12.077 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-17T05:14:12.077 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-17T05:14:12.077 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-17T05:14:12.077 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-17T05:14:12.077 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-17T05:14:12.077 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-17T05:14:12.077 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-17T05:14:12.077 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-17T05:14:12.077 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-17T05:14:12.077 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-17T05:14:12.077 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-17T05:14:12.078 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-17T05:14:12.078 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-17T05:14:12.078 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-17T05:14:12.078 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-17T05:14:12.120 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-17T05:14:12.121 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-17T05:14:12.121 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-17T05:14:12.121 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-17T05:14:12.121 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-17T05:14:12.121 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-17T05:14:12.121 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-17T05:14:12.121 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-17T05:14:12.121 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-17T05:14:12.121 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-17T05:14:12.121 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-17T05:14:12.121 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-17T05:14:12.122 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-17T05:14:12.122 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-17T05:14:12.122 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-17T05:14:12.122 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-17T05:14:12.122 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-17T05:14:12.122 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-17T05:14:12.122 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-17T05:14:12.122 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-17T05:14:12.122 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-17T05:14:12.122 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-17T05:14:12.122 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-17T05:14:12.122 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-17T05:14:12.122 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-17T05:14:12.123 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-17T05:14:12.123 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-17T05:14:12.123 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-17T05:14:12.123 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-17T05:14:12.123 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-17T05:14:12.123 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-17T05:14:12.123 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-17T05:14:12.123 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-17T05:14:12.123 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-17T05:14:12.123 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-17T05:14:12.123 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-17T05:14:12.123 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-17T05:14:12.124 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-17T05:14:12.124 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-17T05:14:12.124 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-17T05:14:12.124 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-17T05:14:12.124 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-17T05:14:12.124 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-17T05:14:12.124 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-17T05:14:12.124 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-17T05:14:12.124 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-17T05:14:12.124 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-17T05:14:12.124 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-17T05:14:12.124 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-17T05:14:12.124 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-17T05:14:12.125 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-17T05:14:12.125 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-17T05:14:12.125 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-17T05:14:12.125 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-17T05:14:12.125 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-17T05:14:12.125 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-17T05:14:12.125 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-17T05:14:12.125 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-17T05:14:12.125 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-17T05:14:12.125 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-17T05:14:12.125 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-17T05:14:12.125 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-17T05:14:12.125 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-17T05:14:12.126 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-17T05:14:12.126 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-17T05:14:12.126 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-17T05:14:12.126 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-17T05:14:12.126 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-17T05:14:12.126 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-17T05:14:12.126 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-17T05:14:12.126 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-17T05:14:12.126 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-17T05:14:12.126 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-17T05:14:12.126 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-17T05:14:12.126 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-17T05:14:12.127 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-17T05:14:12.127 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-17T05:14:12.127 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-17T05:14:12.127 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-17T05:14:12.127 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-17T05:14:12.127 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-17T05:14:12.127 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-17T05:14:12.127 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-17T05:14:12.127 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-17T05:14:12.127 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-17T05:14:12.127 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-17T05:14:12.127 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-17T05:14:12.127 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-17T05:14:12.128 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-17T05:14:12.128 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-17T05:14:12.128 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-17T05:14:12.128 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-17T05:14:12.128 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-17T05:14:12.128 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-17T05:14:12.128 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-17T05:14:12.128 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-17T05:14:12.128 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-17T05:14:12.128 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-17T05:14:12.128 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-17T05:14:12.128 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-17T05:14:12.128 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-17T05:14:12.129 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-17T05:14:12.129 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-17T05:14:12.129 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-17T05:14:12.129 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-17T05:14:12.129 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-17T05:14:12.129 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-17T05:14:12.129 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-17T05:14:12.129 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-17T05:14:12.129 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-17T05:14:12.129 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-17T05:14:12.129 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-17T05:14:12.129 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-17T05:14:12.129 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-17T05:14:12.130 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-17T05:14:12.130 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-17T05:14:12.130 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-17T05:14:12.130 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-17T05:14:12.130 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-17T05:14:12.130 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-17T05:14:12.130 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-17T05:14:12.130 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-17T05:14:12.130 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-17T05:14:12.130 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-17T05:14:12.130 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-17T05:14:12.130 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-17T05:14:12.131 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-17T05:14:12.131 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-17T05:14:12.131 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-17T05:14:12.131 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-17T05:14:12.131 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-17T05:14:12.131 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-17T05:14:12.131 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-17T05:14:12.131 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-17T05:14:12.131 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-17T05:14:12.131 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-17T05:14:12.131 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-17T05:14:12.131 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-17T05:14:12.131 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-17T05:14:12.132 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-17T05:14:12.132 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-17T05:14:12.132 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-17T05:14:12.132 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-17T05:14:12.132 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-17T05:14:12.132 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-17T05:14:12.132 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-17T05:14:12.132 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-17T05:14:12.132 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-17T05:14:12.132 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-17T05:14:12.132 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-17T05:14:12.132 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-17T05:14:12.132 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-17T05:14:12.133 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-17T05:14:12.133 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-17T05:14:12.133 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-17T05:14:12.133 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-17T05:14:12.133 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-17T05:14:12.133 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-17T05:14:12.133 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-17T05:14:12.133 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-17T05:14:12.133 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-17T05:14:12.133 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-17T05:14:12.133 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-17T05:14:12.133 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-17T05:14:12.133 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-17T05:14:12.134 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-17T05:14:12.134 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-17T05:14:12.134 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-17T05:14:12.134 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-17T05:14:12.134 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-17T05:14:12.134 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-17T05:14:12.134 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-17T05:14:12.134 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-17T05:14:12.134 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-17T05:14:12.134 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-17T05:14:12.134 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-17T05:14:12.134 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-17T05:14:12.134 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-17T05:14:12.135 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-17T05:14:12.135 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-17T05:14:12.135 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-17T05:14:12.135 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-17T05:14:12.135 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-17T05:14:12.135 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-17T05:14:12.135 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-17T05:14:12.135 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-17T05:14:12.135 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-17T05:14:12.135 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-17T05:14:12.135 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-17T05:14:12.135 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-17T05:14:12.135 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-17T05:14:12.136 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-17T05:14:12.136 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-17T05:14:12.136 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-17T05:14:12.136 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-17T05:14:12.136 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-17T05:14:12.136 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-17T05:14:12.136 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-17T05:14:12.136 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-17T05:14:12.136 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-17T05:14:12.136 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-17T05:14:12.136 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-17T05:14:12.136 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-17T05:14:12.136 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-17T05:14:12.137 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-17T05:14:12.137 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-17T05:14:12.137 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-17T05:14:12.137 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-17T05:14:12.137 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-17T05:14:12.137 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-17T05:14:12.137 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-17T05:14:12.137 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-17T05:14:12.137 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-17T05:14:12.137 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-17T05:14:12.137 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-17T05:14:12.137 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-17T05:14:12.137 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-17T05:14:12.138 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-17T05:14:12.138 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-17T05:14:12.138 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-17T05:14:12.138 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-17T05:14:12.138 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-17T05:14:12.138 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-17T05:14:12.138 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-17T05:14:12.138 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-17T05:14:12.138 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-17T05:14:12.138 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-17T05:14:12.138 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-17T05:14:12.138 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-17T05:14:12.138 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-17T05:14:12.139 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-17T05:14:12.139 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-17T05:14:12.139 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-17T05:14:12.139 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-17T05:14:12.139 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-17T05:14:12.139 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-17T05:14:12.139 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-17T05:14:12.139 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-17T05:14:12.139 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-17T05:14:12.139 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-17T05:14:12.139 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-17T05:14:12.139 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-17T05:14:12.139 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-17T05:14:12.140 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-17T05:14:12.140 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-17T05:14:12.140 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-17T05:14:12.140 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-17T05:14:12.140 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-17T05:14:12.140 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-17T05:14:12.140 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-17T05:14:12.140 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-17T05:14:12.140 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-17T05:14:12.140 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-17T05:14:12.140 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-17T05:14:12.140 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-17T05:14:12.140 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-17T05:14:12.141 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-17T05:14:12.141 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-17T05:14:12.141 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-17T05:14:12.141 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-17T05:14:12.141 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-17T05:14:12.141 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-17T05:14:12.141 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-17T05:14:12.141 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-17T05:14:12.141 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-17T05:14:12.141 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-17T05:14:12.141 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-17T05:14:12.141 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-17T05:14:12.141 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-17T05:14:12.142 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-17T05:14:12.142 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-17T05:14:12.142 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-17T05:14:12.142 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-17T05:14:12.142 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-17T05:14:12.142 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-17T05:14:12.142 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-17T05:14:12.142 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-17T05:14:12.142 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-17T05:14:12.142 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-17T05:14:12.142 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-17T05:14:12.142 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-17T05:14:12.142 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-17T05:14:12.143 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-17T05:14:12.143 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-17T05:14:12.143 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-17T05:14:12.143 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-17T05:14:12.143 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-17T05:14:12.143 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-17T05:14:12.143 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-17T05:14:12.143 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-17T05:14:12.143 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-17T05:14:12.143 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-17T05:14:12.143 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-17T05:14:12.143 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-17T05:14:12.143 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-17T05:14:12.144 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-17T05:14:12.144 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-17T05:14:12.144 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-17T05:14:12.144 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-17T05:14:12.144 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-17T05:14:12.144 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-17T05:14:12.144 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-17T05:14:12.144 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-17T05:14:12.144 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-17T05:14:12.144 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-17T05:14:12.144 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-17T05:14:12.144 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-17T05:14:12.144 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-17T05:14:12.144 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-17T05:14:12.145 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-17T05:14:12.145 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-17T05:14:12.145 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-17T05:14:12.145 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-17T05:14:12.145 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-17T05:14:12.145 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-17T05:14:12.145 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-17T05:14:12.145 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-17T05:14:12.145 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-17T05:14:12.145 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-17T05:14:12.145 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-17T05:14:12.145 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-17T05:14:12.145 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-17T05:14:12.146 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-17T05:14:12.146 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-17T05:14:12.146 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-17T05:14:12.146 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-17T05:14:12.146 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-17T05:14:12.146 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-17T05:14:12.146 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-17T05:14:12.146 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-17T05:14:12.146 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-17T05:14:12.146 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-17T05:14:12.146 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-17T05:14:12.146 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-17T05:14:12.146 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-17T05:14:12.147 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-17T05:14:12.147 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-17T05:14:12.147 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-17T05:14:12.147 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-17T05:14:12.147 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-17T05:14:12.147 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-17T05:14:12.147 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-17T05:14:12.147 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-17T05:14:12.147 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-17T05:14:12.147 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-17T05:14:12.147 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-17T05:14:12.147 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-17T05:14:12.147 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-17T05:14:12.147 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-17T05:14:12.148 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-17T05:14:12.148 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-17T05:14:12.148 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-17T05:14:12.148 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-17T05:14:12.148 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-17T05:14:12.148 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-17T05:14:12.148 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-17T05:14:12.148 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-17T05:14:12.148 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-17T05:14:12.148 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-17T05:14:12.148 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-17T05:14:12.149 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-17T05:14:12.149 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-17T05:14:12.149 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-17T05:14:12.149 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-17T05:14:12.149 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-17T05:14:12.149 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-17T05:14:12.149 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-17T05:14:12.149 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-17T05:14:12.149 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-17T05:14:12.149 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-17T05:14:12.149 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-17T05:14:12.149 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-17T05:14:12.149 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-17T05:14:12.149 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-17T05:14:12.150 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-17T05:14:12.150 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-17T05:14:12.150 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-17T05:14:12.150 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-17T05:14:12.150 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-17T05:14:12.150 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-17T05:14:12.150 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-17T05:14:12.150 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-17T05:14:12.150 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-17T05:14:12.150 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-17T05:14:12.150 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-17T05:14:12.150 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-17T05:14:12.151 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-17T05:14:12.151 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-17T05:14:12.151 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-17T05:14:12.151 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-17T05:14:12.151 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-17T05:14:12.151 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-17T05:14:12.151 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-17T05:14:12.151 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-17T05:14:12.151 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-17T05:14:12.151 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-17T05:14:12.151 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-17T05:14:12.151 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-17T05:14:12.151 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-17T05:14:12.151 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-17T05:14:12.152 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-17T05:14:12.152 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-17T05:14:12.152 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-17T05:14:12.152 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-17T05:14:12.152 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-17T05:14:12.152 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-17T05:14:12.152 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-17T05:14:12.152 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-17T05:14:12.152 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-17T05:14:12.152 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-17T05:14:12.152 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-17T05:14:12.152 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-17T05:14:12.152 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-17T05:14:12.153 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-17T05:14:12.153 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-17T05:14:12.153 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-17T05:14:12.153 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-17T05:14:12.153 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-17T05:14:12.153 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-17T05:14:12.153 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-17T05:14:12.153 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-17T05:14:12.153 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-17T05:14:12.153 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-17T05:14:12.153 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-17T05:14:12.153 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-17T05:14:12.153 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-17T05:14:12.154 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-17T05:14:12.154 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-17T05:14:12.154 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-17T05:14:12.154 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-17T05:14:12.154 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-17T05:14:12.154 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-17T05:14:12.154 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-17T05:14:12.154 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-17T05:14:12.154 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-17T05:14:12.154 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-17T05:14:12.154 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-17T05:14:12.154 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-17T05:14:12.154 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-17T05:14:12.155 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-17T05:14:12.155 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-17T05:14:12.155 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-17T05:14:12.155 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-17T05:14:12.155 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-17T05:14:12.155 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-17T05:14:12.155 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-17T05:14:12.155 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-17T05:14:12.155 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-17T05:14:12.155 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-17T05:14:12.155 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-17T05:14:12.155 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-17T05:14:12.155 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-17T05:14:12.156 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-17T05:14:12.156 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-17T05:14:12.156 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-17T05:14:12.156 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-17T05:14:12.156 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-17T05:14:12.156 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-17T05:14:12.156 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-17T05:14:12.156 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-17T05:14:12.156 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-17T05:14:12.156 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-17T05:14:12.156 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-17T05:14:12.156 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-17T05:14:12.156 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-17T05:14:12.157 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-17T05:14:12.157 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-17T05:14:12.157 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-17T05:14:12.157 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-17T05:14:12.157 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-17T05:14:12.157 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-17T05:14:12.157 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-17T05:14:12.157 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-17T05:14:12.157 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-17T05:14:12.157 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-17T05:14:12.157 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-17T05:14:12.157 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-17T05:14:12.158 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-17T05:14:12.158 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-17T05:14:12.158 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-17T05:14:12.158 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-17T05:14:12.158 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-17T05:14:12.158 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-17T05:14:12.158 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-17T05:14:12.158 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-17T05:14:12.158 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-17T05:14:12.158 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-17T05:14:12.158 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-17T05:14:12.158 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-17T05:14:12.158 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-17T05:14:12.159 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-17T05:14:12.159 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-17T05:14:12.159 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-17T05:14:12.159 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-17T05:14:12.159 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-17T05:14:12.159 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-17T05:14:12.159 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-17T05:14:12.159 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-17T05:14:12.159 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-17T05:14:12.159 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-17T05:14:12.159 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-17T05:14:12.159 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-17T05:14:12.159 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-17T05:14:12.160 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-17T05:14:12.160 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-17T05:14:12.160 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-17T05:14:12.160 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-17T05:14:12.160 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-17T05:14:12.160 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-17T05:14:12.160 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-17T05:14:12.160 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-17T05:14:12.160 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-17T05:14:12.160 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-17T05:14:12.160 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-17T05:14:12.160 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-17T05:14:12.160 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-17T05:14:12.161 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-17T05:14:12.161 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-17T05:14:12.161 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-17T05:14:12.161 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-17T05:14:12.161 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-17T05:14:12.161 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-17T05:14:12.161 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-17T05:14:12.161 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-17T05:14:12.161 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-17T05:14:12.161 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-17T05:14:12.161 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-17T05:14:12.161 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-17T05:14:12.161 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-17T05:14:12.162 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-17T05:14:12.162 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-17T05:14:12.162 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-17T05:14:12.162 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-17T05:14:12.162 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-17T05:14:12.162 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-17T05:14:12.162 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-17T05:14:12.162 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-17T05:14:12.162 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-17T05:14:12.162 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-17T05:14:12.162 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-17T05:14:12.162 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-17T05:14:12.162 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-17T05:14:12.162 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-17T05:14:12.163 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-17T05:14:12.163 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-17T05:14:12.163 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-17T05:14:12.163 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-17T05:14:12.163 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-17T05:14:12.163 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-17T05:14:12.163 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-17T05:14:12.163 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-17T05:14:12.163 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-17T05:14:12.163 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-17T05:14:12.163 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-17T05:14:12.163 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-17T05:14:12.163 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-17T05:14:12.164 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-17T05:14:12.164 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-17T05:14:12.164 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-17T05:14:12.164 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-17T05:14:12.164 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-17T05:14:12.164 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-17T05:14:12.164 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-17T05:14:12.164 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-17T05:14:12.164 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-17T05:14:12.164 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-17T05:14:12.164 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-17T05:14:12.164 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-17T05:14:12.164 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-17T05:14:12.165 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-17T05:14:12.165 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-17T05:14:12.165 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-17T05:14:12.165 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-17T05:14:12.165 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-17T05:14:12.165 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-17T05:14:12.165 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-17T05:14:12.165 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-17T05:14:12.165 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-17T05:14:12.165 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-17T05:14:12.165 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-17T05:14:12.165 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-17T05:14:12.165 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-17T05:14:12.166 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-17T05:14:12.166 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-17T05:14:12.166 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-17T05:14:12.166 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-17T05:14:12.166 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-17T05:14:12.166 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-17T05:14:12.166 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-17T05:14:12.166 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-17T05:14:12.166 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-17T05:14:12.166 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-17T05:14:12.166 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-17T05:14:12.166 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-17T05:14:12.166 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-17T05:14:12.167 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-17T05:14:12.167 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-17T05:14:12.167 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-17T05:14:12.167 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-17T05:14:12.167 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-17T05:14:12.167 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-17T05:14:12.167 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-17T05:14:12.167 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-17T05:14:12.167 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-17T05:14:12.167 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-17T05:14:12.167 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-17T05:14:12.167 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-17T05:14:12.167 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-17T05:14:12.167 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-17T05:14:12.168 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-17T05:14:12.168 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-17T05:14:12.168 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-17T05:14:12.168 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-17T05:14:12.168 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-17T05:14:12.168 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-17T05:14:12.168 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-17T05:14:12.168 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-17T05:14:12.168 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-17T05:14:12.168 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-17T05:14:12.168 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-17T05:14:12.168 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-17T05:14:12.168 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-17T05:14:12.169 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-17T05:14:12.169 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-17T05:14:12.169 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-17T05:14:12.169 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-17T05:14:12.169 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-17T05:14:12.169 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-17T05:14:12.169 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-17T05:14:12.169 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-17T05:14:12.173 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:12.174 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:12.174 DEBUG:teuthology.orchestra.run.smithi031:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-17T05:14:12.181 INFO:teuthology.orchestra.run.smithi031.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-17T05:14:12.181 INFO:teuthology.orchestra.run.smithi031.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-17T05:14:12.181 INFO:teuthology.orchestra.run.smithi031.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-17T05:14:12.181 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-17T05:14:12.182 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:12.182 DEBUG:teuthology.orchestra.run.smithi031:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-17T05:14:12.224 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi031.front.sepia.ceph.com to complete... 2024-09-17T05:14:12.572 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub' 2024-09-17T05:14:12.573 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-17T05:14:12.594 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2024-09-17T05:14:12.765 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:12.771 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:14:13.048 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-17T05:14:13.054 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-17T05:14:13.095 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-17T05:14:13.101 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-17T05:14:13.242 INFO:teuthology.orchestra.run.smithi031.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-17T05:14:13.242 INFO:teuthology.orchestra.run.smithi031.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-17T05:14:13.242 INFO:teuthology.orchestra.run.smithi031.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-17T05:14:13.269 INFO:teuthology.orchestra.run.smithi031.stderr:done 2024-09-17T05:14:35.091 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-17T05:14:35.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-17T05:14:35.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:14:44.389 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-17T05:14:44.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-17T05:14:44.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:14:53.629 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-09-17T05:15:02.636 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-17T05:15:02.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:15:02.845 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-09-17T05:15:05.693 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-09-17T05:15:11.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-17T05:15:11.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:15:17.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-17T05:15:17.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:15:20.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-09-17T05:15:35.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-17T05:15:35.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:16:07.632 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-09-17T05:16:08.305 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-17T05:16:08.305 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-17T05:16:08.306 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2024-09-17T05:16:08.355 INFO:teuthology.orchestra.run.smithi155.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:16:08.356 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:16:08.356 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T05:16:08.356 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T05:16:09.357 DEBUG:teuthology.parallel:result is None 2024-09-17T05:16:11.854 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T05:16:23.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-17T05:16:23.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:16:24.138 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-09-17T05:16:24.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-17T05:16:24.952 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-17T05:16:24.952 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-09-17T05:16:25.000 INFO:teuthology.orchestra.run.smithi031.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:16:25.001 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-17T05:16:25.001 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T05:16:25.001 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-17T05:16:26.004 DEBUG:teuthology.parallel:result is None 2024-09-17T05:16:26.004 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T05:16:26.011 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T05:16:26.012 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T05:16:26.015 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T05:16:26.024 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T05:16:26.031 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T05:16:26.037 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T05:16:26.037 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T05:16:26.068 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T05:16:26.099 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T05:16:26.107 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T05:16:26.107 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T05:16:26.124 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T05:16:26.196 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:16:26.216 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:16:26.250 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:16:26.270 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:16:26.273 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T05:16:26.281 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T05:16:26.281 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T05:16:26.284 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T05:16:26.305 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T05:16:26.315 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T05:16:26.315 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T05:16:26.352 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T05:16:26.361 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T05:16:26.409 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T05:16:26.461 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:16:26.461 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T05:16:26.543 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T05:16:26.552 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T05:16:26.604 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:16:26.604 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T05:16:26.675 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2024-09-17T05:16:26.678 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2024-09-17T05:16:26.807 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T05:16:26.815 INFO:teuthology.task.internal:Starting timer... 2024-09-17T05:16:26.815 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T05:16:26.826 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T05:16:26.836 DEBUG:teuthology.task.selinux:Excluding smithi031: OS 'ubuntu' does not support SELinux 2024-09-17T05:16:26.836 DEBUG:teuthology.task.selinux:Excluding smithi155: OS 'ubuntu' does not support SELinux 2024-09-17T05:16:26.836 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T05:16:26.837 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-17T05:16:26.837 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T05:16:26.837 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T05:16:26.846 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T05:16:26.858 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T05:16:26.859 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi031.front.sepia.ceph.com,smithi155.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T05:24:45.353 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi031.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com')] 2024-09-17T05:24:45.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-17T05:24:45.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:24:45.438 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-09-17T05:24:45.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-17T05:24:45.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-17T05:24:45.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:24:45.642 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-09-17T05:24:45.759 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-17T05:24:45.760 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T05:24:45.770 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T05:24:45.770 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T05:24:45.771 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:24:45.775 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T05:24:45.775 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:24:45.812 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T05:24:45.812 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: Command line: ntpd -gq 2024-09-17T05:24:45.812 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: ---------------------------------------------------- 2024-09-17T05:24:45.812 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T05:24:45.812 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T05:24:45.812 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: corporation. Support and training for ntp-4 are 2024-09-17T05:24:45.812 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: available at https://www.nwtime.org/support 2024-09-17T05:24:45.812 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: ---------------------------------------------------- 2024-09-17T05:24:45.813 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: proto: precision = 0.043 usec (-24) 2024-09-17T05:24:45.813 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: basedate set to 2022-02-04 2024-09-17T05:24:45.813 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: gps base set to 2022-02-06 (week 2196) 2024-09-17T05:24:45.813 INFO:teuthology.orchestra.run.smithi031.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T05:24:45.814 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T05:24:45.814 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T05:24:45.814 INFO:teuthology.orchestra.run.smithi031.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T05:24:45.815 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T05:24:45.815 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T05:24:45.815 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T05:24:45.815 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: Listen normally on 3 ens1f0 172.21.15.31:123 2024-09-17T05:24:45.816 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: Listen normally on 4 lo [::1]:123 2024-09-17T05:24:45.816 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:caba%4]:123 2024-09-17T05:24:45.816 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:45 ntpd[18357]: Listening on routing socket on fd #22 for interface updates 2024-09-17T05:24:45.839 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-17T05:24:45.840 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: Command line: ntpd -gq 2024-09-17T05:24:45.840 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: ---------------------------------------------------- 2024-09-17T05:24:45.840 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: ntp-4 is maintained by Network Time Foundation, 2024-09-17T05:24:45.840 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-17T05:24:45.840 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: corporation. Support and training for ntp-4 are 2024-09-17T05:24:45.840 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: available at https://www.nwtime.org/support 2024-09-17T05:24:45.840 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: ---------------------------------------------------- 2024-09-17T05:24:45.841 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: proto: precision = 0.042 usec (-24) 2024-09-17T05:24:45.841 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: basedate set to 2022-02-04 2024-09-17T05:24:45.841 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: gps base set to 2022-02-06 (week 2196) 2024-09-17T05:24:45.841 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T05:24:45.841 INFO:teuthology.orchestra.run.smithi155.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-17T05:24:45.842 INFO:teuthology.orchestra.run.smithi155.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-17T05:24:45.843 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: restrict ::: KOD does nothing without LIMITED. 2024-09-17T05:24:45.843 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: Listen and drop on 0 v6wildcard [::]:123 2024-09-17T05:24:45.843 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-17T05:24:45.843 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: Listen normally on 2 lo 127.0.0.1:123 2024-09-17T05:24:45.843 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: Listen normally on 3 enp3s0f1 172.21.15.155:123 2024-09-17T05:24:45.843 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: Listen normally on 4 lo [::1]:123 2024-09-17T05:24:45.843 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6ded%5]:123 2024-09-17T05:24:45.843 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:45 ntpd[18461]: Listening on routing socket on fd #22 for interface updates 2024-09-17T05:24:46.812 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:46 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:46.812 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:46 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:46.840 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:46 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:46.840 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:46 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:46.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:46 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:46.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:46 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:46.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:46 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:46.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:46 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:47.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:47 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:47.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:47 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:47.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:47 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:47.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:47 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:47.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:47 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:47.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:47 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:47.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:47 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:47.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:47 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:47.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:47 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:47.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:47 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:47.842 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:47 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:47.842 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:47 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:48.840 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:48 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:48.840 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:48 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:48.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:48 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:48.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:48 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:48.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:48 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:48.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:48 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:49.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:49 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:49.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:49 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:49.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:49 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:49.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:49 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:49.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:49 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:49.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:49 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:49.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:49 ntpd[18357]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:49.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:49 ntpd[18357]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:49.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:49 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:49.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:49 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:49.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:49 ntpd[18357]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:49.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:49 ntpd[18357]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:49.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:49 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:49.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:49 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:49.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:49 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:49.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:49 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:49.842 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:49 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:49.842 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:49 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:49.842 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:49 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:49.842 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:49 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:49.842 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:49 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:49.842 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:49 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:49.842 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:49 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:49.842 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:49 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:49.842 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:49 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:49.842 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:49 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:50.812 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:50 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:50.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:50 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:50.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:50 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:50.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:50 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:50.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:50 ntpd[18357]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:50.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:50 ntpd[18357]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:50.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:50 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:50.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:50 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:50.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:50 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:50.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:50 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:50.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:50 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:50.842 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:50 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:51.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:51 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:51.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:51 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:51.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:51 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:51.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:51 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:51.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:51 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:51.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:51 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:51.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:51 ntpd[18357]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:51.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:51 ntpd[18357]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:51.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:51 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:51.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:51 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:51.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:51 ntpd[18357]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:51.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:51 ntpd[18357]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:51.840 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:51 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:51.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:51 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:51.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:51 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:51.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:51 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:51.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:51 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:51.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:51 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:51.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:51 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:51.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:51 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:51.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:51 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:51.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:51 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:51.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:51 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:51.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:51 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:52.812 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:52 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:52.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:52 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:52.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:52 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:52.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:52 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:52.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:52 ntpd[18357]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:52.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:52 ntpd[18357]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:52.840 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:52 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:52.840 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:52 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:52.840 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:52 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:52.840 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:52 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:52.840 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:52 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:52.840 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:52 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:52.841 INFO:teuthology.orchestra.run.smithi155.stdout:17 Sep 05:24:52 ntpd[18461]: ntpd: time slew -0.001570 s 2024-09-17T05:24:52.841 INFO:teuthology.orchestra.run.smithi155.stdout:ntpd: time slew -0.001570s 2024-09-17T05:24:52.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:52 ntpd[18461]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T05:24:52.841 INFO:teuthology.orchestra.run.smithi155.stderr:17 Sep 05:24:52 ntpd[18461]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T05:24:52.937 INFO:teuthology.orchestra.run.smithi155.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T05:24:52.937 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================== 2024-09-17T05:24:52.937 INFO:teuthology.orchestra.run.smithi155.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T05:24:52.937 INFO:teuthology.orchestra.run.smithi155.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T05:24:52.937 INFO:teuthology.orchestra.run.smithi155.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T05:24:52.937 INFO:teuthology.orchestra.run.smithi155.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T05:24:53.815 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:53 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:53.815 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:53 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:53.815 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:53 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:53.815 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:53 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:53.815 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:53 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:53.816 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:53 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:53.816 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:53 ntpd[18357]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:53.816 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:53 ntpd[18357]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:53.816 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:53 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:53.816 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:53 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:53.816 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:53 ntpd[18357]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:53.816 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:53 ntpd[18357]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:54.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:54 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:54.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:54 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:54.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:54 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:54.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:54 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:54.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:54 ntpd[18357]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:54.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:54 ntpd[18357]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:55.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:55 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:55.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:55 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:55.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:55 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:55.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:55 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:55.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:55 ntpd[18357]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-17T05:24:55.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:55 ntpd[18357]: can't open /var/log/ntpstats/rawstats.20240917: Permission denied 2024-09-17T05:24:55.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:55 ntpd[18357]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-17T05:24:55.813 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:55 ntpd[18357]: can't open /var/log/ntpstats/peerstats.20240917: Permission denied 2024-09-17T05:24:55.814 INFO:teuthology.orchestra.run.smithi031.stdout:17 Sep 05:24:55 ntpd[18357]: ntpd: time slew -0.001739 s 2024-09-17T05:24:55.814 INFO:teuthology.orchestra.run.smithi031.stdout:ntpd: time slew -0.001739s 2024-09-17T05:24:55.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:55 ntpd[18357]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-17T05:24:55.814 INFO:teuthology.orchestra.run.smithi031.stderr:17 Sep 05:24:55 ntpd[18357]: can't open /var/log/ntpstats/loopstats.20240917: Permission denied 2024-09-17T05:24:55.908 INFO:teuthology.orchestra.run.smithi031.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T05:24:55.908 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================== 2024-09-17T05:24:55.908 INFO:teuthology.orchestra.run.smithi031.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T05:24:55.908 INFO:teuthology.orchestra.run.smithi031.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T05:24:55.908 INFO:teuthology.orchestra.run.smithi031.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T05:24:55.908 INFO:teuthology.orchestra.run.smithi031.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-17T05:24:55.909 INFO:teuthology.run_tasks:Running task install... 2024-09-17T05:24:55.918 DEBUG:teuthology.task.install:project ceph 2024-09-17T05:24:55.918 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8'}} 2024-09-17T05:24:55.919 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8'} 2024-09-17T05:24:55.919 INFO:teuthology.task.install:Using flavor: default 2024-09-17T05:24:55.925 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T05:24:55.925 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-17T05:24:55.925 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-key list | grep Ceph 2024-09-17T05:24:55.926 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-key list | grep Ceph 2024-09-17T05:24:56.029 INFO:teuthology.orchestra.run.smithi155.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T05:24:56.057 INFO:teuthology.orchestra.run.smithi031.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-17T05:24:56.081 INFO:teuthology.orchestra.run.smithi155.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T05:24:56.082 INFO:teuthology.orchestra.run.smithi155.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T05:24:56.083 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-17T05:24:56.083 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-17T05:24:56.083 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=820f760e4779dafd30d668ecea7aba6355dfd3d8 2024-09-17T05:24:56.109 INFO:teuthology.orchestra.run.smithi031.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-17T05:24:56.109 INFO:teuthology.orchestra.run.smithi031.stdout:uid [ unknown] Ceph.com (release key) 2024-09-17T05:24:56.119 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-17T05:24:56.119 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-17T05:24:56.119 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=820f760e4779dafd30d668ecea7aba6355dfd3d8 2024-09-17T05:24:56.237 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default/ 2024-09-17T05:24:56.237 INFO:teuthology.task.install.deb:Package version is 19.3.0-4963-g820f760e-1jammy 2024-09-17T05:24:56.257 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default/ 2024-09-17T05:24:56.257 INFO:teuthology.task.install.deb:Package version is 19.3.0-4963-g820f760e-1jammy 2024-09-17T05:24:56.347 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:24:56.347 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T05:24:56.365 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:24:56.365 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-17T05:24:56.367 DEBUG:teuthology.orchestra.run.smithi155:> sudo apt-get update 2024-09-17T05:24:56.386 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get update 2024-09-17T05:24:56.551 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T05:24:56.558 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T05:24:56.560 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-17T05:24:56.572 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-17T05:24:56.575 INFO:teuthology.orchestra.run.smithi155.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T05:24:56.578 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-17T05:24:56.595 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-17T05:24:56.601 INFO:teuthology.orchestra.run.smithi155.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T05:24:56.621 INFO:teuthology.orchestra.run.smithi031.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy InRelease 2024-09-17T05:24:56.622 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-17T05:24:56.642 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-17T05:24:56.643 INFO:teuthology.orchestra.run.smithi155.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T05:24:56.664 INFO:teuthology.orchestra.run.smithi031.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-17T05:24:56.665 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-17T05:24:56.685 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-09-17T05:24:56.696 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-17T05:24:56.697 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-09-17T05:24:56.717 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-17T05:24:57.150 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 29.3 kB in 1s (52.9 kB/s) 2024-09-17T05:24:57.221 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 158 kB in 1s (263 kB/s) 2024-09-17T05:24:58.190 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-09-17T05:24:58.205 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4963-g820f760e-1jammy cephadm=19.3.0-4963-g820f760e-1jammy ceph-mds=19.3.0-4963-g820f760e-1jammy ceph-mgr=19.3.0-4963-g820f760e-1jammy ceph-common=19.3.0-4963-g820f760e-1jammy ceph-fuse=19.3.0-4963-g820f760e-1jammy ceph-test=19.3.0-4963-g820f760e-1jammy ceph-volume=19.3.0-4963-g820f760e-1jammy radosgw=19.3.0-4963-g820f760e-1jammy python3-rados=19.3.0-4963-g820f760e-1jammy python3-rgw=19.3.0-4963-g820f760e-1jammy python3-cephfs=19.3.0-4963-g820f760e-1jammy python3-rbd=19.3.0-4963-g820f760e-1jammy libcephfs2=19.3.0-4963-g820f760e-1jammy libcephfs-dev=19.3.0-4963-g820f760e-1jammy librados2=19.3.0-4963-g820f760e-1jammy librbd1=19.3.0-4963-g820f760e-1jammy rbd-fuse=19.3.0-4963-g820f760e-1jammy python3-cephfs=19.3.0-4963-g820f760e-1jammy cephfs-shell=19.3.0-4963-g820f760e-1jammy cephfs-top=19.3.0-4963-g820f760e-1jammy cephfs-mirror=19.3.0-4963-g820f760e-1jammy 2024-09-17T05:24:58.282 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-09-17T05:24:58.298 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-09-17T05:24:58.313 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4963-g820f760e-1jammy cephadm=19.3.0-4963-g820f760e-1jammy ceph-mds=19.3.0-4963-g820f760e-1jammy ceph-mgr=19.3.0-4963-g820f760e-1jammy ceph-common=19.3.0-4963-g820f760e-1jammy ceph-fuse=19.3.0-4963-g820f760e-1jammy ceph-test=19.3.0-4963-g820f760e-1jammy ceph-volume=19.3.0-4963-g820f760e-1jammy radosgw=19.3.0-4963-g820f760e-1jammy python3-rados=19.3.0-4963-g820f760e-1jammy python3-rgw=19.3.0-4963-g820f760e-1jammy python3-cephfs=19.3.0-4963-g820f760e-1jammy python3-rbd=19.3.0-4963-g820f760e-1jammy libcephfs2=19.3.0-4963-g820f760e-1jammy libcephfs-dev=19.3.0-4963-g820f760e-1jammy librados2=19.3.0-4963-g820f760e-1jammy librbd1=19.3.0-4963-g820f760e-1jammy rbd-fuse=19.3.0-4963-g820f760e-1jammy python3-cephfs=19.3.0-4963-g820f760e-1jammy cephfs-shell=19.3.0-4963-g820f760e-1jammy cephfs-top=19.3.0-4963-g820f760e-1jammy cephfs-mirror=19.3.0-4963-g820f760e-1jammy 2024-09-17T05:24:58.391 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-09-17T05:24:58.467 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2024-09-17T05:24:58.467 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2024-09-17T05:24:58.578 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2024-09-17T05:24:58.578 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2024-09-17T05:24:58.655 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T05:24:58.655 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T05:24:58.655 INFO:teuthology.orchestra.run.smithi155.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T05:24:58.655 INFO:teuthology.orchestra.run.smithi155.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T05:24:58.656 INFO:teuthology.orchestra.run.smithi155.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T05:24:58.656 INFO:teuthology.orchestra.run.smithi155.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T05:24:58.656 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T05:24:58.657 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2024-09-17T05:24:58.657 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T05:24:58.657 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T05:24:58.657 INFO:teuthology.orchestra.run.smithi155.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-17T05:24:58.657 INFO:teuthology.orchestra.run.smithi155.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-17T05:24:58.657 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-17T05:24:58.658 INFO:teuthology.orchestra.run.smithi155.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-17T05:24:58.658 INFO:teuthology.orchestra.run.smithi155.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-17T05:24:58.658 INFO:teuthology.orchestra.run.smithi155.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-17T05:24:58.659 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-17T05:24:58.659 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-17T05:24:58.659 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2024-09-17T05:24:58.659 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-17T05:24:58.659 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-17T05:24:58.659 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-17T05:24:58.659 INFO:teuthology.orchestra.run.smithi155.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-17T05:24:58.659 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-17T05:24:58.659 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-17T05:24:58.659 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-17T05:24:58.659 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-17T05:24:58.659 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-17T05:24:58.659 INFO:teuthology.orchestra.run.smithi155.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-17T05:24:58.660 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-17T05:24:58.660 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-17T05:24:58.660 INFO:teuthology.orchestra.run.smithi155.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-17T05:24:58.660 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2024-09-17T05:24:58.660 INFO:teuthology.orchestra.run.smithi155.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-17T05:24:58.660 INFO:teuthology.orchestra.run.smithi155.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-17T05:24:58.660 INFO:teuthology.orchestra.run.smithi155.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-17T05:24:58.660 INFO:teuthology.orchestra.run.smithi155.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-17T05:24:58.661 INFO:teuthology.orchestra.run.smithi155.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-17T05:24:58.661 INFO:teuthology.orchestra.run.smithi155.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T05:24:58.661 INFO:teuthology.orchestra.run.smithi155.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-17T05:24:58.661 INFO:teuthology.orchestra.run.smithi155.stdout:Recommended packages: 2024-09-17T05:24:58.661 INFO:teuthology.orchestra.run.smithi155.stdout: btrfs-tools 2024-09-17T05:24:58.770 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T05:24:58.770 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T05:24:58.770 INFO:teuthology.orchestra.run.smithi031.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T05:24:58.770 INFO:teuthology.orchestra.run.smithi031.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T05:24:58.771 INFO:teuthology.orchestra.run.smithi031.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T05:24:58.771 INFO:teuthology.orchestra.run.smithi031.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T05:24:58.771 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T05:24:58.772 INFO:teuthology.orchestra.run.smithi031.stdout:The following additional packages will be installed: 2024-09-17T05:24:58.772 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-17T05:24:58.772 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-17T05:24:58.772 INFO:teuthology.orchestra.run.smithi031.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-17T05:24:58.772 INFO:teuthology.orchestra.run.smithi031.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-17T05:24:58.772 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-17T05:24:58.773 INFO:teuthology.orchestra.run.smithi031.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-17T05:24:58.774 INFO:teuthology.orchestra.run.smithi031.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-17T05:24:58.774 INFO:teuthology.orchestra.run.smithi031.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-17T05:24:58.774 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-17T05:24:58.774 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-17T05:24:58.774 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2024-09-17T05:24:58.774 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-17T05:24:58.774 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-17T05:24:58.774 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-17T05:24:58.774 INFO:teuthology.orchestra.run.smithi031.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-17T05:24:58.774 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-17T05:24:58.775 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-17T05:24:58.775 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-17T05:24:58.775 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-17T05:24:58.775 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-17T05:24:58.775 INFO:teuthology.orchestra.run.smithi031.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-17T05:24:58.775 INFO:teuthology.orchestra.run.smithi031.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-17T05:24:58.775 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-17T05:24:58.775 INFO:teuthology.orchestra.run.smithi031.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-17T05:24:58.776 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2024-09-17T05:24:58.776 INFO:teuthology.orchestra.run.smithi031.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-17T05:24:58.776 INFO:teuthology.orchestra.run.smithi031.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-17T05:24:58.776 INFO:teuthology.orchestra.run.smithi031.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-17T05:24:58.776 INFO:teuthology.orchestra.run.smithi031.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-17T05:24:58.776 INFO:teuthology.orchestra.run.smithi031.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-17T05:24:58.776 INFO:teuthology.orchestra.run.smithi031.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-17T05:24:58.776 INFO:teuthology.orchestra.run.smithi031.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-17T05:24:58.776 INFO:teuthology.orchestra.run.smithi031.stdout:Recommended packages: 2024-09-17T05:24:58.776 INFO:teuthology.orchestra.run.smithi031.stdout: btrfs-tools 2024-09-17T05:24:58.814 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2024-09-17T05:24:58.814 INFO:teuthology.orchestra.run.smithi155.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T05:24:58.814 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T05:24:58.814 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-17T05:24:58.815 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-17T05:24:58.815 INFO:teuthology.orchestra.run.smithi155.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-17T05:24:58.815 INFO:teuthology.orchestra.run.smithi155.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-17T05:24:58.815 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-17T05:24:58.816 INFO:teuthology.orchestra.run.smithi155.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-17T05:24:58.816 INFO:teuthology.orchestra.run.smithi155.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-17T05:24:58.816 INFO:teuthology.orchestra.run.smithi155.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-17T05:24:58.817 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-17T05:24:58.817 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-17T05:24:58.817 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-17T05:24:58.817 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T05:24:58.817 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T05:24:58.817 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T05:24:58.817 INFO:teuthology.orchestra.run.smithi155.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T05:24:58.817 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T05:24:58.817 INFO:teuthology.orchestra.run.smithi155.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T05:24:58.817 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-17T05:24:58.817 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-17T05:24:58.818 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-17T05:24:58.818 INFO:teuthology.orchestra.run.smithi155.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T05:24:58.818 INFO:teuthology.orchestra.run.smithi155.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T05:24:58.818 INFO:teuthology.orchestra.run.smithi155.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T05:24:58.818 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T05:24:58.818 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-17T05:24:58.818 INFO:teuthology.orchestra.run.smithi155.stdout: socat unzip xmlstarlet zip 2024-09-17T05:24:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:0 upgraded, 125 newly installed, 0 to remove and 334 not upgraded. 2024-09-17T05:24:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 244 MB of archives. 2024-09-17T05:24:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 910 MB of additional disk space will be used. 2024-09-17T05:24:58.884 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-17T05:24:58.901 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T05:24:58.911 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-17T05:24:58.934 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2024-09-17T05:24:58.934 INFO:teuthology.orchestra.run.smithi031.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-17T05:24:58.934 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-17T05:24:58.934 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-17T05:24:58.935 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-17T05:24:58.935 INFO:teuthology.orchestra.run.smithi031.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-17T05:24:58.935 INFO:teuthology.orchestra.run.smithi031.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-17T05:24:58.935 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-17T05:24:58.936 INFO:teuthology.orchestra.run.smithi031.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-17T05:24:58.936 INFO:teuthology.orchestra.run.smithi031.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-17T05:24:58.936 INFO:teuthology.orchestra.run.smithi031.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-17T05:24:58.936 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-17T05:24:58.936 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-17T05:24:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-17T05:24:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-17T05:24:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-17T05:24:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-17T05:24:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-17T05:24:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-17T05:24:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-17T05:24:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-17T05:24:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-17T05:24:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-17T05:24:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-17T05:24:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-17T05:24:58.938 INFO:teuthology.orchestra.run.smithi031.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-17T05:24:58.938 INFO:teuthology.orchestra.run.smithi031.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-17T05:24:58.938 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-17T05:24:58.938 INFO:teuthology.orchestra.run.smithi031.stdout: socat unzip xmlstarlet zip 2024-09-17T05:24:58.952 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T05:24:58.964 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4963-g820f760e-1jammy [3,634 kB] 2024-09-17T05:24:58.973 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T05:24:58.976 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T05:24:58.987 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T05:24:59.025 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T05:24:59.027 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T05:24:59.034 INFO:teuthology.orchestra.run.smithi155.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T05:24:59.037 INFO:teuthology.orchestra.run.smithi155.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-17T05:24:59.037 INFO:teuthology.orchestra.run.smithi155.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T05:24:59.038 INFO:teuthology.orchestra.run.smithi155.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T05:24:59.044 INFO:teuthology.orchestra.run.smithi155.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-17T05:24:59.046 INFO:teuthology.orchestra.run.smithi155.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-17T05:24:59.048 INFO:teuthology.orchestra.run.smithi155.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-17T05:24:59.049 INFO:teuthology.orchestra.run.smithi155.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-17T05:24:59.061 INFO:teuthology.orchestra.run.smithi155.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-17T05:24:59.063 INFO:teuthology.orchestra.run.smithi155.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-17T05:24:59.065 INFO:teuthology.orchestra.run.smithi155.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-17T05:24:59.066 INFO:teuthology.orchestra.run.smithi155.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T05:24:59.067 INFO:teuthology.orchestra.run.smithi155.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T05:24:59.078 INFO:teuthology.orchestra.run.smithi155.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T05:24:59.079 INFO:teuthology.orchestra.run.smithi155.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T05:24:59.079 INFO:teuthology.orchestra.run.smithi155.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T05:24:59.080 INFO:teuthology.orchestra.run.smithi155.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T05:24:59.080 INFO:teuthology.orchestra.run.smithi155.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T05:24:59.088 INFO:teuthology.orchestra.run.smithi031.stdout:0 upgraded, 125 newly installed, 0 to remove and 334 not upgraded. 2024-09-17T05:24:59.088 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 244 MB of archives. 2024-09-17T05:24:59.088 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 910 MB of additional disk space will be used. 2024-09-17T05:24:59.088 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4963-g820f760e-1jammy [3,634 kB] 2024-09-17T05:24:59.095 INFO:teuthology.orchestra.run.smithi155.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T05:24:59.095 INFO:teuthology.orchestra.run.smithi155.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T05:24:59.096 INFO:teuthology.orchestra.run.smithi155.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T05:24:59.098 INFO:teuthology.orchestra.run.smithi155.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T05:24:59.098 INFO:teuthology.orchestra.run.smithi155.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T05:24:59.112 INFO:teuthology.orchestra.run.smithi155.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T05:24:59.114 INFO:teuthology.orchestra.run.smithi155.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T05:24:59.114 INFO:teuthology.orchestra.run.smithi155.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T05:24:59.114 INFO:teuthology.orchestra.run.smithi155.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T05:24:59.114 INFO:teuthology.orchestra.run.smithi155.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T05:24:59.129 INFO:teuthology.orchestra.run.smithi155.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T05:24:59.130 INFO:teuthology.orchestra.run.smithi155.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T05:24:59.130 INFO:teuthology.orchestra.run.smithi155.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T05:24:59.131 INFO:teuthology.orchestra.run.smithi155.stdout:Get:42 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4963-g820f760e-1jammy [3,334 kB] 2024-09-17T05:24:59.135 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-17T05:24:59.136 INFO:teuthology.orchestra.run.smithi155.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T05:24:59.136 INFO:teuthology.orchestra.run.smithi155.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T05:24:59.146 INFO:teuthology.orchestra.run.smithi155.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T05:24:59.146 INFO:teuthology.orchestra.run.smithi155.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T05:24:59.148 INFO:teuthology.orchestra.run.smithi155.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T05:24:59.150 INFO:teuthology.orchestra.run.smithi155.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T05:24:59.151 INFO:teuthology.orchestra.run.smithi155.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T05:24:59.163 INFO:teuthology.orchestra.run.smithi155.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T05:24:59.164 INFO:teuthology.orchestra.run.smithi155.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T05:24:59.166 INFO:teuthology.orchestra.run.smithi155.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T05:24:59.166 INFO:teuthology.orchestra.run.smithi155.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T05:24:59.167 INFO:teuthology.orchestra.run.smithi155.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T05:24:59.180 INFO:teuthology.orchestra.run.smithi155.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T05:24:59.182 INFO:teuthology.orchestra.run.smithi155.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4963-g820f760e-1jammy [722 kB] 2024-09-17T05:24:59.192 INFO:teuthology.orchestra.run.smithi155.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4963-g820f760e-1jammy [357 kB] 2024-09-17T05:24:59.198 INFO:teuthology.orchestra.run.smithi155.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4963-g820f760e-1jammy [32.8 kB] 2024-09-17T05:24:59.199 INFO:teuthology.orchestra.run.smithi155.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4963-g820f760e-1jammy [180 kB] 2024-09-17T05:24:59.202 INFO:teuthology.orchestra.run.smithi155.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4963-g820f760e-1jammy [72.8 kB] 2024-09-17T05:24:59.203 INFO:teuthology.orchestra.run.smithi155.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4963-g820f760e-1jammy [338 kB] 2024-09-17T05:24:59.213 INFO:teuthology.orchestra.run.smithi155.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4963-g820f760e-1jammy [7,966 kB] 2024-09-17T05:24:59.217 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-17T05:24:59.226 INFO:teuthology.orchestra.run.smithi155.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T05:24:59.227 INFO:teuthology.orchestra.run.smithi155.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T05:24:59.228 INFO:teuthology.orchestra.run.smithi155.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T05:24:59.229 INFO:teuthology.orchestra.run.smithi155.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T05:24:59.230 INFO:teuthology.orchestra.run.smithi155.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T05:24:59.249 INFO:teuthology.orchestra.run.smithi155.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T05:24:59.251 INFO:teuthology.orchestra.run.smithi155.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T05:24:59.251 INFO:teuthology.orchestra.run.smithi155.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T05:24:59.263 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-17T05:24:59.269 INFO:teuthology.orchestra.run.smithi155.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T05:24:59.269 INFO:teuthology.orchestra.run.smithi155.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T05:24:59.270 INFO:teuthology.orchestra.run.smithi155.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T05:24:59.270 INFO:teuthology.orchestra.run.smithi155.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T05:24:59.271 INFO:teuthology.orchestra.run.smithi155.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T05:24:59.271 INFO:teuthology.orchestra.run.smithi155.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T05:24:59.279 INFO:teuthology.orchestra.run.smithi155.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T05:24:59.280 INFO:teuthology.orchestra.run.smithi155.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T05:24:59.283 INFO:teuthology.orchestra.run.smithi155.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T05:24:59.296 INFO:teuthology.orchestra.run.smithi155.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T05:24:59.297 INFO:teuthology.orchestra.run.smithi155.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T05:24:59.298 INFO:teuthology.orchestra.run.smithi155.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T05:24:59.302 INFO:teuthology.orchestra.run.smithi155.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T05:24:59.304 INFO:teuthology.orchestra.run.smithi155.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-17T05:24:59.305 INFO:teuthology.orchestra.run.smithi155.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-17T05:24:59.306 INFO:teuthology.orchestra.run.smithi155.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-17T05:24:59.313 INFO:teuthology.orchestra.run.smithi155.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T05:24:59.317 INFO:teuthology.orchestra.run.smithi155.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-17T05:24:59.318 INFO:teuthology.orchestra.run.smithi155.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T05:24:59.330 INFO:teuthology.orchestra.run.smithi155.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T05:24:59.330 INFO:teuthology.orchestra.run.smithi155.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T05:24:59.331 INFO:teuthology.orchestra.run.smithi155.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T05:24:59.331 INFO:teuthology.orchestra.run.smithi155.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T05:24:59.333 INFO:teuthology.orchestra.run.smithi155.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T05:24:59.334 INFO:teuthology.orchestra.run.smithi155.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T05:24:59.341 INFO:teuthology.orchestra.run.smithi155.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T05:24:59.347 INFO:teuthology.orchestra.run.smithi155.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T05:24:59.348 INFO:teuthology.orchestra.run.smithi155.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T05:24:59.350 INFO:teuthology.orchestra.run.smithi155.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T05:24:59.362 INFO:teuthology.orchestra.run.smithi155.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4963-g820f760e-1jammy [112 kB] 2024-09-17T05:24:59.363 INFO:teuthology.orchestra.run.smithi155.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4963-g820f760e-1jammy [473 kB] 2024-09-17T05:24:59.364 INFO:teuthology.orchestra.run.smithi155.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T05:24:59.368 INFO:teuthology.orchestra.run.smithi155.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4963-g820f760e-1jammy [28.2 MB] 2024-09-17T05:24:59.462 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-17T05:24:59.553 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-17T05:24:59.566 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-17T05:24:59.616 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-17T05:24:59.716 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4963-g820f760e-1jammy [3,334 kB] 2024-09-17T05:24:59.789 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-17T05:24:59.797 INFO:teuthology.orchestra.run.smithi031.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-17T05:24:59.825 INFO:teuthology.orchestra.run.smithi031.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-17T05:24:59.833 INFO:teuthology.orchestra.run.smithi031.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-17T05:24:59.836 INFO:teuthology.orchestra.run.smithi031.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-17T05:24:59.837 INFO:teuthology.orchestra.run.smithi031.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-17T05:24:59.855 INFO:teuthology.orchestra.run.smithi031.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-17T05:24:59.859 INFO:teuthology.orchestra.run.smithi031.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-17T05:24:59.863 INFO:teuthology.orchestra.run.smithi031.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-17T05:24:59.871 INFO:teuthology.orchestra.run.smithi031.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-17T05:24:59.904 INFO:teuthology.orchestra.run.smithi155.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4963-g820f760e-1jammy [5,206 kB] 2024-09-17T05:24:59.947 INFO:teuthology.orchestra.run.smithi031.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-17T05:24:59.949 INFO:teuthology.orchestra.run.smithi031.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-17T05:24:59.951 INFO:teuthology.orchestra.run.smithi031.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-17T05:24:59.952 INFO:teuthology.orchestra.run.smithi031.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-17T05:24:59.953 INFO:teuthology.orchestra.run.smithi031.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-17T05:24:59.953 INFO:teuthology.orchestra.run.smithi031.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-17T05:24:59.954 INFO:teuthology.orchestra.run.smithi031.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-17T05:24:59.955 INFO:teuthology.orchestra.run.smithi031.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-17T05:24:59.955 INFO:teuthology.orchestra.run.smithi031.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-17T05:24:59.999 INFO:teuthology.orchestra.run.smithi155.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4963-g820f760e-1jammy [252 kB] 2024-09-17T05:25:00.003 INFO:teuthology.orchestra.run.smithi155.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4963-g820f760e-1jammy [124 kB] 2024-09-17T05:25:00.005 INFO:teuthology.orchestra.run.smithi155.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4963-g820f760e-1jammy [1,562 kB] 2024-09-17T05:25:00.032 INFO:teuthology.orchestra.run.smithi155.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4963-g820f760e-1jammy [6,309 kB] 2024-09-17T05:25:00.034 INFO:teuthology.orchestra.run.smithi031.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-17T05:25:00.034 INFO:teuthology.orchestra.run.smithi031.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-17T05:25:00.035 INFO:teuthology.orchestra.run.smithi031.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-17T05:25:00.051 INFO:teuthology.orchestra.run.smithi031.stdout:Get:32 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4963-g820f760e-1jammy [722 kB] 2024-09-17T05:25:00.110 INFO:teuthology.orchestra.run.smithi031.stdout:Get:33 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4963-g820f760e-1jammy [357 kB] 2024-09-17T05:25:00.115 INFO:teuthology.orchestra.run.smithi031.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-17T05:25:00.117 INFO:teuthology.orchestra.run.smithi031.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-17T05:25:00.118 INFO:teuthology.orchestra.run.smithi031.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-17T05:25:00.118 INFO:teuthology.orchestra.run.smithi031.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-17T05:25:00.119 INFO:teuthology.orchestra.run.smithi031.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-17T05:25:00.120 INFO:teuthology.orchestra.run.smithi031.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-17T05:25:00.120 INFO:teuthology.orchestra.run.smithi031.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-17T05:25:00.156 INFO:teuthology.orchestra.run.smithi155.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4963-g820f760e-1jammy [23.1 MB] 2024-09-17T05:25:00.161 INFO:teuthology.orchestra.run.smithi031.stdout:Get:41 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4963-g820f760e-1jammy [32.8 kB] 2024-09-17T05:25:00.161 INFO:teuthology.orchestra.run.smithi031.stdout:Get:42 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4963-g820f760e-1jammy [180 kB] 2024-09-17T05:25:00.164 INFO:teuthology.orchestra.run.smithi031.stdout:Get:43 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4963-g820f760e-1jammy [72.8 kB] 2024-09-17T05:25:00.166 INFO:teuthology.orchestra.run.smithi031.stdout:Get:44 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4963-g820f760e-1jammy [338 kB] 2024-09-17T05:25:00.197 INFO:teuthology.orchestra.run.smithi031.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-17T05:25:00.198 INFO:teuthology.orchestra.run.smithi031.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-17T05:25:00.199 INFO:teuthology.orchestra.run.smithi031.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-17T05:25:00.216 INFO:teuthology.orchestra.run.smithi031.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4963-g820f760e-1jammy [7,966 kB] 2024-09-17T05:25:00.278 INFO:teuthology.orchestra.run.smithi031.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-17T05:25:00.283 INFO:teuthology.orchestra.run.smithi031.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-17T05:25:00.284 INFO:teuthology.orchestra.run.smithi031.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-17T05:25:00.284 INFO:teuthology.orchestra.run.smithi031.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-17T05:25:00.285 INFO:teuthology.orchestra.run.smithi031.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-17T05:25:00.286 INFO:teuthology.orchestra.run.smithi031.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-17T05:25:00.288 INFO:teuthology.orchestra.run.smithi031.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-17T05:25:00.360 INFO:teuthology.orchestra.run.smithi031.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-17T05:25:00.361 INFO:teuthology.orchestra.run.smithi031.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-17T05:25:00.361 INFO:teuthology.orchestra.run.smithi031.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-17T05:25:00.442 INFO:teuthology.orchestra.run.smithi031.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-17T05:25:00.442 INFO:teuthology.orchestra.run.smithi031.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-17T05:25:00.442 INFO:teuthology.orchestra.run.smithi031.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-17T05:25:00.445 INFO:teuthology.orchestra.run.smithi031.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-17T05:25:00.553 INFO:teuthology.orchestra.run.smithi031.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-17T05:25:00.553 INFO:teuthology.orchestra.run.smithi031.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-17T05:25:00.555 INFO:teuthology.orchestra.run.smithi031.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-17T05:25:00.555 INFO:teuthology.orchestra.run.smithi031.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-17T05:25:00.556 INFO:teuthology.orchestra.run.smithi031.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-17T05:25:00.628 INFO:teuthology.orchestra.run.smithi031.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-17T05:25:00.630 INFO:teuthology.orchestra.run.smithi031.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-17T05:25:00.630 INFO:teuthology.orchestra.run.smithi031.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-17T05:25:00.658 INFO:teuthology.orchestra.run.smithi155.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4963-g820f760e-1jammy [14.0 kB] 2024-09-17T05:25:00.659 INFO:teuthology.orchestra.run.smithi155.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4963-g820f760e-1jammy [880 kB] 2024-09-17T05:25:00.666 INFO:teuthology.orchestra.run.smithi155.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4963-g820f760e-1jammy [2,454 kB] 2024-09-17T05:25:00.700 INFO:teuthology.orchestra.run.smithi031.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-17T05:25:00.701 INFO:teuthology.orchestra.run.smithi031.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-17T05:25:00.702 INFO:teuthology.orchestra.run.smithi031.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-17T05:25:00.702 INFO:teuthology.orchestra.run.smithi031.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-17T05:25:00.703 INFO:teuthology.orchestra.run.smithi031.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-17T05:25:00.703 INFO:teuthology.orchestra.run.smithi031.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-17T05:25:00.724 INFO:teuthology.orchestra.run.smithi155.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4963-g820f760e-1jammy [813 kB] 2024-09-17T05:25:00.736 INFO:teuthology.orchestra.run.smithi155.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4963-g820f760e-1jammy [160 kB] 2024-09-17T05:25:00.739 INFO:teuthology.orchestra.run.smithi155.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4963-g820f760e-1jammy [61.5 MB] 2024-09-17T05:25:00.768 INFO:teuthology.orchestra.run.smithi031.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-17T05:25:00.768 INFO:teuthology.orchestra.run.smithi031.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-17T05:25:00.769 INFO:teuthology.orchestra.run.smithi031.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4963-g820f760e-1jammy [112 kB] 2024-09-17T05:25:00.770 INFO:teuthology.orchestra.run.smithi031.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4963-g820f760e-1jammy [473 kB] 2024-09-17T05:25:00.772 INFO:teuthology.orchestra.run.smithi031.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-17T05:25:00.823 INFO:teuthology.orchestra.run.smithi031.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4963-g820f760e-1jammy [28.2 MB] 2024-09-17T05:25:00.849 INFO:teuthology.orchestra.run.smithi031.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-17T05:25:00.851 INFO:teuthology.orchestra.run.smithi031.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-17T05:25:00.851 INFO:teuthology.orchestra.run.smithi031.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-17T05:25:00.856 INFO:teuthology.orchestra.run.smithi031.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-17T05:25:00.858 INFO:teuthology.orchestra.run.smithi031.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-17T05:25:00.858 INFO:teuthology.orchestra.run.smithi031.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-17T05:25:00.860 INFO:teuthology.orchestra.run.smithi031.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-17T05:25:00.931 INFO:teuthology.orchestra.run.smithi031.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-17T05:25:00.935 INFO:teuthology.orchestra.run.smithi031.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-17T05:25:00.936 INFO:teuthology.orchestra.run.smithi031.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-17T05:25:01.013 INFO:teuthology.orchestra.run.smithi031.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-17T05:25:01.013 INFO:teuthology.orchestra.run.smithi031.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-17T05:25:01.014 INFO:teuthology.orchestra.run.smithi031.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-17T05:25:01.014 INFO:teuthology.orchestra.run.smithi031.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-17T05:25:01.016 INFO:teuthology.orchestra.run.smithi031.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-17T05:25:01.017 INFO:teuthology.orchestra.run.smithi031.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-17T05:25:01.024 INFO:teuthology.orchestra.run.smithi031.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-17T05:25:01.095 INFO:teuthology.orchestra.run.smithi031.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-17T05:25:01.096 INFO:teuthology.orchestra.run.smithi031.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-17T05:25:01.098 INFO:teuthology.orchestra.run.smithi031.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-17T05:25:01.177 INFO:teuthology.orchestra.run.smithi031.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-17T05:25:02.014 INFO:teuthology.orchestra.run.smithi031.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4963-g820f760e-1jammy [5,206 kB] 2024-09-17T05:25:02.165 INFO:teuthology.orchestra.run.smithi031.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4963-g820f760e-1jammy [252 kB] 2024-09-17T05:25:02.175 INFO:teuthology.orchestra.run.smithi031.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4963-g820f760e-1jammy [124 kB] 2024-09-17T05:25:02.190 INFO:teuthology.orchestra.run.smithi031.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4963-g820f760e-1jammy [1,562 kB] 2024-09-17T05:25:02.240 INFO:teuthology.orchestra.run.smithi031.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4963-g820f760e-1jammy [6,309 kB] 2024-09-17T05:25:02.447 INFO:teuthology.orchestra.run.smithi031.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4963-g820f760e-1jammy [23.1 MB] 2024-09-17T05:25:02.490 INFO:teuthology.orchestra.run.smithi155.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4963-g820f760e-1jammy [8,625 kB] 2024-09-17T05:25:02.746 INFO:teuthology.orchestra.run.smithi155.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4963-g820f760e-1jammy [14.2 kB] 2024-09-17T05:25:02.746 INFO:teuthology.orchestra.run.smithi155.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4963-g820f760e-1jammy [48.5 MB] 2024-09-17T05:25:03.216 INFO:teuthology.orchestra.run.smithi031.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4963-g820f760e-1jammy [14.0 kB] 2024-09-17T05:25:03.216 INFO:teuthology.orchestra.run.smithi031.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4963-g820f760e-1jammy [880 kB] 2024-09-17T05:25:03.249 INFO:teuthology.orchestra.run.smithi031.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4963-g820f760e-1jammy [2,454 kB] 2024-09-17T05:25:03.326 INFO:teuthology.orchestra.run.smithi031.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4963-g820f760e-1jammy [813 kB] 2024-09-17T05:25:03.340 INFO:teuthology.orchestra.run.smithi031.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4963-g820f760e-1jammy [160 kB] 2024-09-17T05:25:03.367 INFO:teuthology.orchestra.run.smithi031.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4963-g820f760e-1jammy [61.5 MB] 2024-09-17T05:25:04.280 INFO:teuthology.orchestra.run.smithi155.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4963-g820f760e-1jammy [130 kB] 2024-09-17T05:25:04.281 INFO:teuthology.orchestra.run.smithi155.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-4963-g820f760e-1jammy [233 kB] 2024-09-17T05:25:04.283 INFO:teuthology.orchestra.run.smithi155.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-4963-g820f760e-1jammy [33.9 kB] 2024-09-17T05:25:04.284 INFO:teuthology.orchestra.run.smithi155.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-4963-g820f760e-1jammy [23.4 kB] 2024-09-17T05:25:04.284 INFO:teuthology.orchestra.run.smithi155.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4963-g820f760e-1jammy [39.0 kB] 2024-09-17T05:25:04.285 INFO:teuthology.orchestra.run.smithi155.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4963-g820f760e-1jammy [15.8 MB] 2024-09-17T05:25:04.778 INFO:teuthology.orchestra.run.smithi155.stdout:Get:125 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4963-g820f760e-1jammy [91.2 kB] 2024-09-17T05:25:05.133 INFO:teuthology.orchestra.run.smithi031.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4963-g820f760e-1jammy [8,625 kB] 2024-09-17T05:25:05.258 INFO:teuthology.orchestra.run.smithi031.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4963-g820f760e-1jammy [14.2 kB] 2024-09-17T05:25:05.259 INFO:teuthology.orchestra.run.smithi031.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4963-g820f760e-1jammy [48.5 MB] 2024-09-17T05:25:05.429 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 244 MB in 6s (41.0 MB/s) 2024-09-17T05:25:05.573 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-17T05:25:05.637 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-17T05:25:05.641 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-17T05:25:05.680 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-17T05:25:05.991 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T05:25:06.004 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T05:25:06.066 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T05:25:06.066 INFO:teuthology.orchestra.run.smithi031.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4963-g820f760e-1jammy [130 kB] 2024-09-17T05:25:06.068 INFO:teuthology.orchestra.run.smithi031.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.3.0-4963-g820f760e-1jammy [233 kB] 2024-09-17T05:25:06.070 INFO:teuthology.orchestra.run.smithi031.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.3.0-4963-g820f760e-1jammy [33.9 kB] 2024-09-17T05:25:06.070 INFO:teuthology.orchestra.run.smithi031.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.3.0-4963-g820f760e-1jammy [23.4 kB] 2024-09-17T05:25:06.071 INFO:teuthology.orchestra.run.smithi031.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4963-g820f760e-1jammy [39.0 kB] 2024-09-17T05:25:06.071 INFO:teuthology.orchestra.run.smithi031.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4963-g820f760e-1jammy [15.8 MB] 2024-09-17T05:25:06.327 INFO:teuthology.orchestra.run.smithi031.stdout:Get:125 https://4.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4963-g820f760e-1jammy [91.2 kB] 2024-09-17T05:25:06.386 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cmd2. 2024-09-17T05:25:06.398 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-17T05:25:06.443 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-17T05:25:06.821 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T05:25:06.835 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T05:25:06.922 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T05:25:07.006 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 244 MB in 7s (33.1 MB/s) 2024-09-17T05:25:07.131 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-17T05:25:07.198 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-17T05:25:07.202 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-17T05:25:07.238 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-17T05:25:07.266 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T05:25:07.280 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T05:25:07.325 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T05:25:07.516 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-17T05:25:07.529 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-17T05:25:07.574 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T05:25:07.636 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T05:25:07.649 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T05:25:07.722 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T05:25:07.927 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cmd2. 2024-09-17T05:25:07.941 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-17T05:25:07.985 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-17T05:25:08.147 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T05:25:08.161 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T05:25:08.213 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:25:08.330 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-17T05:25:08.345 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-17T05:25:08.446 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T05:25:08.642 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T05:25:08.655 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T05:25:08.700 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:25:08.891 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-17T05:25:08.907 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-17T05:25:08.974 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T05:25:09.087 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T05:25:09.100 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T05:25:09.145 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:25:09.236 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-17T05:25:09.252 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-17T05:25:09.286 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T05:25:09.531 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T05:25:09.545 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T05:25:09.589 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T05:25:09.731 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-17T05:25:09.746 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T05:25:09.797 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:25:09.917 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librados2. 2024-09-17T05:25:09.931 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../010-librados2_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:09.975 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librados2 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:10.233 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-17T05:25:10.249 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T05:25:10.292 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:25:10.411 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libnbd0. 2024-09-17T05:25:10.424 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../011-libnbd0_1.10.5-1_amd64.deb ... 2024-09-17T05:25:10.478 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-17T05:25:10.553 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-17T05:25:10.568 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-17T05:25:10.603 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:25:10.764 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librbd1. 2024-09-17T05:25:10.778 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../012-librbd1_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:10.822 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librbd1 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:10.981 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-17T05:25:10.996 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-17T05:25:11.039 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T05:25:11.233 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T05:25:11.246 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../013-libcephfs2_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:11.316 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libcephfs2 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:11.400 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librados2. 2024-09-17T05:25:11.415 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../010-librados2_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:11.458 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librados2 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:11.593 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rados. 2024-09-17T05:25:11.607 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../014-python3-rados_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:11.652 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rados (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:11.919 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libnbd0. 2024-09-17T05:25:11.935 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../011-libnbd0_1.10.5-1_amd64.deb ... 2024-09-17T05:25:11.969 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-17T05:25:11.971 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T05:25:11.984 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../015-python3-ceph-argparse_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:12.029 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-ceph-argparse (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:12.213 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librbd1. 2024-09-17T05:25:12.229 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../012-librbd1_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:12.263 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librbd1 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:12.282 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T05:25:12.297 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../016-python3-cephfs_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:12.331 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cephfs (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:12.642 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T05:25:12.656 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../017-python3-ceph-common_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:12.701 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-ceph-common (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:12.709 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libcephfs2. 2024-09-17T05:25:12.723 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../013-libcephfs2_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:12.765 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libcephfs2 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:13.037 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T05:25:13.043 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rados. 2024-09-17T05:25:13.051 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T05:25:13.058 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../014-python3-rados_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:13.110 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rados (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:13.121 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T05:25:13.387 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-17T05:25:13.403 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../015-python3-ceph-argparse_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:13.431 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T05:25:13.437 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-ceph-argparse (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:13.444 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../019-python3-rbd_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:13.489 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rbd (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:13.729 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cephfs. 2024-09-17T05:25:13.746 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../016-python3-cephfs_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:13.923 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cephfs (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:14.134 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T05:25:14.149 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T05:25:14.201 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T05:25:14.233 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-17T05:25:14.249 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../017-python3-ceph-common_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:14.292 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-ceph-common (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:14.520 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-17T05:25:14.535 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../021-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-17T05:25:14.595 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T05:25:14.612 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-prettytable. 2024-09-17T05:25:14.627 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-17T05:25:14.670 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-17T05:25:14.930 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rbd. 2024-09-17T05:25:14.946 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../019-python3-rbd_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:14.973 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-17T05:25:14.987 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../022-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-17T05:25:14.988 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rbd (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:15.039 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T05:25:15.358 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-17T05:25:15.373 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-17T05:25:15.416 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T05:25:15.417 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package lua5.1. 2024-09-17T05:25:15.432 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../023-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-17T05:25:15.476 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-17T05:25:15.661 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-17T05:25:15.676 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../021-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-17T05:25:15.710 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T05:25:15.845 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package lua-any. 2024-09-17T05:25:15.860 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../024-lua-any_27ubuntu1_all.deb ... 2024-09-17T05:25:15.912 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-17T05:25:16.005 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-17T05:25:16.020 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../022-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-17T05:25:16.063 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T05:25:16.214 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package zip. 2024-09-17T05:25:16.229 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../025-zip_3.0-12build2_amd64.deb ... 2024-09-17T05:25:16.281 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking zip (3.0-12build2) ... 2024-09-17T05:25:16.391 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package lua5.1. 2024-09-17T05:25:16.404 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../023-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-17T05:25:16.466 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-17T05:25:16.659 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package unzip. 2024-09-17T05:25:16.674 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../026-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-17T05:25:16.742 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-17T05:25:16.778 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package lua-any. 2024-09-17T05:25:16.793 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../024-lua-any_27ubuntu1_all.deb ... 2024-09-17T05:25:16.836 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-17T05:25:17.105 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package zip. 2024-09-17T05:25:17.118 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../025-zip_3.0-12build2_amd64.deb ... 2024-09-17T05:25:17.163 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking zip (3.0-12build2) ... 2024-09-17T05:25:17.179 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package luarocks. 2024-09-17T05:25:17.194 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../027-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-17T05:25:17.237 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-17T05:25:17.441 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package unzip. 2024-09-17T05:25:17.454 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../026-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-17T05:25:17.491 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-17T05:25:17.661 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package librgw2. 2024-09-17T05:25:17.673 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../028-librgw2_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:17.711 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking librgw2 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:17.911 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package luarocks. 2024-09-17T05:25:17.925 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../027-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-17T05:25:17.969 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-17T05:25:18.264 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T05:25:18.275 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../029-python3-rgw_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:18.313 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rgw (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:18.368 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librgw2. 2024-09-17T05:25:18.384 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../028-librgw2_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:18.418 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librgw2 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:18.683 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T05:25:18.695 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../030-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T05:25:18.733 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T05:25:18.962 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rgw. 2024-09-17T05:25:18.977 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../029-python3-rgw_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:19.020 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rgw (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:19.052 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T05:25:19.064 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../031-libradosstriper1_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:19.102 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libradosstriper1 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:19.390 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-17T05:25:19.404 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../030-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-17T05:25:19.448 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T05:25:19.574 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-common. 2024-09-17T05:25:19.589 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../032-ceph-common_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:19.632 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-common (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:19.742 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libradosstriper1. 2024-09-17T05:25:19.757 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../031-libradosstriper1_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:19.792 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libradosstriper1 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:20.237 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-common. 2024-09-17T05:25:20.255 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../032-ceph-common_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:20.295 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-common (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:20.845 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-base. 2024-09-17T05:25:20.859 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../033-ceph-base_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:20.913 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-base (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:21.458 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-base. 2024-09-17T05:25:21.474 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../033-ceph-base_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:21.482 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T05:25:21.497 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../034-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T05:25:21.526 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-base (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:21.541 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T05:25:21.801 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T05:25:21.815 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../035-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T05:25:21.860 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T05:25:22.113 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-17T05:25:22.128 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../034-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-17T05:25:22.162 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T05:25:22.170 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-17T05:25:22.177 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../036-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T05:25:22.212 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T05:25:22.432 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cheroot. 2024-09-17T05:25:22.447 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../035-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-17T05:25:22.490 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T05:25:22.490 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T05:25:22.505 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../037-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T05:25:22.548 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T05:25:22.843 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-17T05:25:22.851 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T05:25:22.858 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../036-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-17T05:25:22.866 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../038-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T05:25:22.901 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-17T05:25:22.909 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T05:25:23.171 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-17T05:25:23.186 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../037-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-17T05:25:23.220 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-17T05:25:23.245 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T05:25:23.260 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../039-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T05:25:23.303 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T05:25:23.548 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-17T05:25:23.556 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-portend. 2024-09-17T05:25:23.564 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../038-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-17T05:25:23.571 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../040-python3-portend_3.0.0-1_all.deb ... 2024-09-17T05:25:23.606 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-17T05:25:23.606 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T05:25:23.892 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-tempora. 2024-09-17T05:25:23.908 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../039-python3-tempora_4.1.2-1_all.deb ... 2024-09-17T05:25:23.934 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T05:25:23.949 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../041-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T05:25:23.992 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T05:25:24.150 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-17T05:25:24.422 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-portend. 2024-09-17T05:25:24.438 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../040-python3-portend_3.0.0-1_all.deb ... 2024-09-17T05:25:24.478 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T05:25:24.480 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-17T05:25:24.493 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../042-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T05:25:24.536 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T05:25:24.808 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-17T05:25:24.824 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../041-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-17T05:25:24.866 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-17T05:25:24.898 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T05:25:24.913 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../043-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T05:25:24.956 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T05:25:25.153 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-17T05:25:25.168 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../042-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-17T05:25:25.210 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-17T05:25:25.268 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T05:25:25.283 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../044-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T05:25:25.326 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T05:25:25.573 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-natsort. 2024-09-17T05:25:25.589 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../043-python3-natsort_8.0.2-1_all.deb ... 2024-09-17T05:25:25.628 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T05:25:25.631 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-17T05:25:25.643 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../045-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T05:25:25.712 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T05:25:25.967 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-logutils. 2024-09-17T05:25:25.981 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-mako. 2024-09-17T05:25:25.983 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../044-python3-logutils_0.3.3-8_all.deb ... 2024-09-17T05:25:25.996 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../046-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T05:25:26.025 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-17T05:25:26.031 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T05:25:26.295 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-17T05:25:26.311 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../045-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-17T05:25:26.342 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T05:25:26.344 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-17T05:25:26.357 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../047-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T05:25:26.392 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T05:25:26.673 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-mako. 2024-09-17T05:25:26.682 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../046-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-17T05:25:26.703 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T05:25:26.718 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../048-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T05:25:26.723 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T05:25:26.762 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T05:25:27.064 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-webob. 2024-09-17T05:25:27.079 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../049-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T05:25:27.093 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-17T05:25:27.104 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../047-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-17T05:25:27.131 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T05:25:27.143 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-17T05:25:27.445 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-17T05:25:27.455 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../048-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-17T05:25:27.495 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-17T05:25:27.500 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T05:25:27.515 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../050-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T05:25:27.561 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T05:25:27.807 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-webob. 2024-09-17T05:25:27.817 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../049-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-17T05:25:27.845 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T05:25:27.856 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T05:25:27.857 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../051-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T05:25:27.902 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T05:25:28.189 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-paste. 2024-09-17T05:25:28.202 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../052-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T05:25:28.218 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-waitress. 2024-09-17T05:25:28.228 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../050-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-17T05:25:28.247 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T05:25:28.271 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T05:25:28.579 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-tempita. 2024-09-17T05:25:28.583 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T05:25:28.589 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../051-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-17T05:25:28.596 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../053-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T05:25:28.629 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T05:25:28.633 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T05:25:28.949 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-paste. 2024-09-17T05:25:28.959 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../052-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-17T05:25:28.998 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T05:25:29.320 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T05:25:29.333 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../054-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T05:25:29.352 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-17T05:25:29.365 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../053-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-17T05:25:29.377 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T05:25:29.402 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T05:25:29.647 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T05:25:29.660 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../055-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T05:25:29.688 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-17T05:25:29.696 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T05:25:29.700 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../054-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-17T05:25:29.738 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-17T05:25:30.000 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T05:25:30.013 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../056-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T05:25:30.058 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T05:25:30.066 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-webtest. 2024-09-17T05:25:30.080 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../055-python3-webtest_2.0.35-1_all.deb ... 2024-09-17T05:25:30.124 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-17T05:25:30.446 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T05:25:30.459 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../057-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T05:25:30.460 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pecan. 2024-09-17T05:25:30.473 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../056-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-17T05:25:30.504 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T05:25:30.510 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T05:25:30.840 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-idna. 2024-09-17T05:25:30.853 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../058-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T05:25:30.865 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-certifi. 2024-09-17T05:25:30.877 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../057-python3-certifi_2020.6.20-1_all.deb ... 2024-09-17T05:25:30.898 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T05:25:30.915 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-17T05:25:31.243 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-idna. 2024-09-17T05:25:31.255 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../058-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-17T05:25:31.276 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T05:25:31.285 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T05:25:31.289 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../059-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T05:25:31.334 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T05:25:31.621 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-urllib3. 2024-09-17T05:25:31.635 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../059-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-17T05:25:31.645 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-requests. 2024-09-17T05:25:31.659 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../060-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T05:25:31.679 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T05:25:31.703 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T05:25:32.007 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T05:25:32.023 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../061-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T05:25:32.056 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T05:25:32.360 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T05:25:32.373 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../062-ceph-mgr-modules-core_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:32.417 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:32.733 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-requests. 2024-09-17T05:25:32.746 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../060-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-17T05:25:32.782 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T05:25:32.813 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T05:25:32.827 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../063-libsqlite3-mod-ceph_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:32.897 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:33.110 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-17T05:25:33.123 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../061-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-17T05:25:33.160 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T05:25:33.216 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T05:25:33.230 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../064-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T05:25:33.274 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T05:25:33.430 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-17T05:25:33.443 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../062-ceph-mgr-modules-core_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:33.480 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:33.552 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T05:25:33.565 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../065-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T05:25:33.610 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T05:25:33.885 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-17T05:25:33.898 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../063-libsqlite3-mod-ceph_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:33.934 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:33.946 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T05:25:33.961 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../066-ceph-mgr_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:34.005 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:34.371 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-17T05:25:34.384 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../064-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-17T05:25:34.413 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-17T05:25:34.416 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T05:25:34.430 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../067-ceph-mon_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:34.474 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mon (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:34.715 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-openssl. 2024-09-17T05:25:34.728 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../065-python3-openssl_21.0.0-1_all.deb ... 2024-09-17T05:25:34.765 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-17T05:25:35.078 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T05:25:35.091 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../068-ceph-osd_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:35.135 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr. 2024-09-17T05:25:35.135 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-osd (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:35.148 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../066-ceph-mgr_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:35.185 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:35.554 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mon. 2024-09-17T05:25:35.567 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../067-ceph-mon_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:35.596 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mon (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:35.922 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph. 2024-09-17T05:25:35.937 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../069-ceph_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:35.972 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:36.166 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-osd. 2024-09-17T05:25:36.179 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../068-ceph-osd_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:36.216 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-osd (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:36.283 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T05:25:36.297 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../070-ceph-fuse_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:36.358 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-fuse (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:36.769 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T05:25:36.783 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../071-ceph-mds_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:36.827 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mds (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:36.970 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph. 2024-09-17T05:25:36.982 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../069-ceph_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:37.019 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:37.171 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephadm. 2024-09-17T05:25:37.186 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../072-cephadm_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:37.221 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephadm (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:37.339 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-fuse. 2024-09-17T05:25:37.352 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../070-ceph-fuse_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:37.389 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-fuse (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:37.582 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T05:25:37.596 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../073-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T05:25:37.640 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T05:25:37.758 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mds. 2024-09-17T05:25:37.771 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../071-ceph-mds_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:37.808 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mds (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:37.993 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T05:25:38.007 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../074-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T05:25:38.051 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T05:25:38.186 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephadm. 2024-09-17T05:25:38.199 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../072-cephadm_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:38.236 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephadm (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:38.564 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-17T05:25:38.577 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../073-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-17T05:25:38.614 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-17T05:25:38.950 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-17T05:25:38.963 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../074-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T05:25:38.989 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-babel. 2024-09-17T05:25:39.000 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T05:25:39.001 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../075-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T05:25:39.039 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T05:25:39.375 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T05:25:39.387 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../076-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T05:25:39.425 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T05:25:39.761 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T05:25:39.773 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../077-ceph-mgr-cephadm_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:39.811 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:40.055 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-babel. 2024-09-17T05:25:40.066 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../075-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-17T05:25:40.105 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T05:25:40.147 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T05:25:40.159 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../078-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T05:25:40.188 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T05:25:40.416 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jinja2. 2024-09-17T05:25:40.429 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../076-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-17T05:25:40.466 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T05:25:40.500 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-routes. 2024-09-17T05:25:40.512 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../079-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T05:25:40.550 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T05:25:40.827 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-17T05:25:40.840 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../077-ceph-mgr-cephadm_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:40.877 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:40.886 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T05:25:40.898 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../080-ceph-mgr-dashboard_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:40.958 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:41.239 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-17T05:25:41.252 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../078-python3-repoze.lru_0.7-2_all.deb ... 2024-09-17T05:25:41.297 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-17T05:25:41.575 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-routes. 2024-09-17T05:25:41.588 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../079-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-17T05:25:41.625 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T05:25:41.937 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-17T05:25:41.949 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../080-ceph-mgr-dashboard_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:41.986 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:43.216 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T05:25:43.229 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../081-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T05:25:43.265 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T05:25:43.760 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T05:25:43.772 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../082-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T05:25:43.895 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T05:25:44.232 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T05:25:44.245 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../083-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T05:25:44.282 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T05:25:44.283 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-17T05:25:44.296 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../081-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-17T05:25:44.333 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T05:25:44.593 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T05:25:44.608 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../084-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T05:25:44.651 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T05:25:45.045 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-joblib. 2024-09-17T05:25:45.058 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../082-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-17T05:25:45.181 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T05:25:45.569 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-17T05:25:45.581 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../083-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-17T05:25:45.584 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T05:25:45.598 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../085-ceph-mgr-diskprediction-local_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:45.626 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-17T05:25:45.643 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:45.938 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-sklearn. 2024-09-17T05:25:45.951 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../084-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-17T05:25:45.996 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T05:25:46.663 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-17T05:25:46.675 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../085-ceph-mgr-diskprediction-local_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:46.696 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T05:25:46.711 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../086-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T05:25:46.712 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:46.762 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T05:25:47.132 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T05:25:47.147 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../087-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T05:25:47.207 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T05:25:47.685 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T05:25:47.700 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../088-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T05:25:47.751 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T05:25:47.783 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cachetools. 2024-09-17T05:25:47.796 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../086-python3-cachetools_5.0.0-1_all.deb ... 2024-09-17T05:25:47.841 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-17T05:25:48.129 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T05:25:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-17T05:25:48.144 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../089-python3-rsa_4.8-1_all.deb ... 2024-09-17T05:25:48.157 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../087-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-17T05:25:48.202 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-17T05:25:48.216 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T05:25:48.573 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-17T05:25:48.574 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T05:25:48.586 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../088-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-17T05:25:48.589 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../090-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T05:25:48.631 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T05:25:48.632 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T05:25:48.961 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T05:25:48.975 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rsa. 2024-09-17T05:25:48.976 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../091-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T05:25:48.989 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../089-python3-rsa_4.8-1_all.deb ... 2024-09-17T05:25:49.027 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T05:25:49.033 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-17T05:25:49.304 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-google-auth. 2024-09-17T05:25:49.317 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../090-python3-google-auth_1.5.1-3_all.deb ... 2024-09-17T05:25:49.353 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-17T05:25:49.539 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T05:25:49.554 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../092-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T05:25:49.605 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T05:25:49.682 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-17T05:25:49.696 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../091-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-17T05:25:49.740 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T05:25:49.916 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T05:25:49.932 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../093-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T05:25:49.966 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T05:25:50.093 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-websocket. 2024-09-17T05:25:50.106 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../092-python3-websocket_1.2.3-1_all.deb ... 2024-09-17T05:25:50.143 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-17T05:25:50.455 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-17T05:25:50.468 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../093-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-17T05:25:50.505 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T05:25:50.688 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T05:25:50.702 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../094-ceph-mgr-k8sevents_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:50.746 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:51.099 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T05:25:51.112 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../095-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T05:25:51.157 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T05:25:51.244 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-17T05:25:51.256 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../094-ceph-mgr-k8sevents_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:51.293 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:51.502 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T05:25:51.515 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../096-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T05:25:51.560 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T05:25:51.613 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-17T05:25:51.626 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../095-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-17T05:25:51.671 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T05:25:51.829 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package jq. 2024-09-17T05:25:51.842 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../097-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T05:25:51.879 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T05:25:52.000 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-17T05:25:52.013 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../096-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T05:25:52.049 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T05:25:52.131 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package socat. 2024-09-17T05:25:52.145 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../098-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T05:25:52.189 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T05:25:52.302 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package jq. 2024-09-17T05:25:52.316 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../097-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-17T05:25:52.393 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-17T05:25:52.476 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T05:25:52.490 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../099-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T05:25:52.534 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T05:25:52.646 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package socat. 2024-09-17T05:25:52.660 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../098-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-17T05:25:52.704 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-17T05:25:52.921 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-test. 2024-09-17T05:25:52.935 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../100-ceph-test_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:52.980 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-test (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:53.024 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package xmlstarlet. 2024-09-17T05:25:53.038 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../099-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-17T05:25:53.082 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-17T05:25:53.445 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-test. 2024-09-17T05:25:53.458 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../100-ceph-test_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:53.520 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-test (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:55.001 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T05:25:55.016 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../101-ceph-volume_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:55.050 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ceph-volume (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:55.429 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-17T05:25:55.444 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../102-cephfs-mirror_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:55.479 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-mirror (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:55.666 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-volume. 2024-09-17T05:25:55.680 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../101-ceph-volume_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:55.743 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-volume (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:55.773 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-colorama. 2024-09-17T05:25:55.788 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../103-python3-colorama_0.4.4-1_all.deb ... 2024-09-17T05:25:55.832 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-17T05:25:56.093 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-shell. 2024-09-17T05:25:56.108 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../104-cephfs-shell_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:56.120 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-17T05:25:56.134 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../102-cephfs-mirror_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:56.151 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-shell (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:56.178 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-mirror (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:56.403 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package cephfs-top. 2024-09-17T05:25:56.418 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../105-cephfs-top_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:56.461 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking cephfs-top (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:56.473 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-colorama. 2024-09-17T05:25:56.487 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../103-python3-colorama_0.4.4-1_all.deb ... 2024-09-17T05:25:56.531 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-17T05:25:56.739 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T05:25:56.753 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../106-libcephfs-dev_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:56.792 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-shell. 2024-09-17T05:25:56.796 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libcephfs-dev (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:56.806 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../104-cephfs-shell_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:56.850 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-shell (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:57.108 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-17T05:25:57.123 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../107-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-17T05:25:57.144 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-top. 2024-09-17T05:25:57.158 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T05:25:57.158 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../105-cephfs-top_19.3.0-4963-g820f760e-1jammy_all.deb ... 2024-09-17T05:25:57.203 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-top (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:57.440 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-17T05:25:57.452 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../106-libcephfs-dev_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:25:57.512 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-17T05:25:57.513 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libcephfs-dev (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:25:57.527 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../108-lua-sec_1.0.2-1_amd64.deb ... 2024-09-17T05:25:57.570 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-17T05:25:57.825 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-17T05:25:57.838 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../107-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-17T05:25:57.883 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T05:25:57.941 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T05:25:57.956 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../109-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T05:25:58.007 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T05:25:58.229 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-17T05:25:58.243 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../108-lua-sec_1.0.2-1_amd64.deb ... 2024-09-17T05:25:58.287 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-17T05:25:58.462 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package pkg-config. 2024-09-17T05:25:58.476 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../110-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-17T05:25:58.520 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T05:25:58.599 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package nvme-cli. 2024-09-17T05:25:58.613 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../109-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-17T05:25:58.666 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T05:25:58.781 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T05:25:58.796 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../111-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T05:25:58.831 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T05:25:59.079 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package pkg-config. 2024-09-17T05:25:59.093 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../110-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-17T05:25:59.137 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T05:25:59.244 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T05:25:59.259 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../112-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T05:25:59.303 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T05:25:59.391 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-17T05:25:59.404 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../111-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-17T05:25:59.449 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-17T05:25:59.605 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T05:25:59.620 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../113-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T05:25:59.663 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T05:25:59.893 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-17T05:25:59.911 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../112-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-17T05:25:59.943 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-17T05:25:59.983 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T05:25:59.997 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../114-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T05:26:00.143 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T05:26:00.246 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pastescript. 2024-09-17T05:26:00.261 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../113-python3-pastescript_2.0.2-4_all.deb ... 2024-09-17T05:26:00.312 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-17T05:26:00.620 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T05:26:00.634 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../115-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T05:26:00.658 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pluggy. 2024-09-17T05:26:00.669 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T05:26:00.673 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../114-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-17T05:26:00.716 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-17T05:26:00.972 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-py. 2024-09-17T05:26:00.987 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../116-python3-py_1.10.0-1_all.deb ... 2024-09-17T05:26:01.022 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T05:26:01.044 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-psutil. 2024-09-17T05:26:01.059 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../115-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-17T05:26:01.102 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-17T05:26:01.359 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T05:26:01.373 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../117-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T05:26:01.417 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T05:26:01.430 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-py. 2024-09-17T05:26:01.445 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../116-python3-py_1.10.0-1_all.deb ... 2024-09-17T05:26:01.505 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-17T05:26:01.809 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pygments. 2024-09-17T05:26:01.823 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../117-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-17T05:26:01.854 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T05:26:01.866 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T05:26:01.868 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../118-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T05:26:01.912 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T05:26:02.265 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-toml. 2024-09-17T05:26:02.279 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../119-python3-toml_0.10.2-1_all.deb ... 2024-09-17T05:26:02.323 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T05:26:02.337 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-17T05:26:02.352 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../118-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-17T05:26:02.395 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-17T05:26:02.584 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T05:26:02.598 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../120-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T05:26:02.642 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T05:26:02.732 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-toml. 2024-09-17T05:26:02.747 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../119-python3-toml_0.10.2-1_all.deb ... 2024-09-17T05:26:02.790 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-17T05:26:03.013 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T05:26:03.026 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../121-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T05:26:03.051 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pytest. 2024-09-17T05:26:03.066 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../120-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-17T05:26:03.070 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T05:26:03.101 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T05:26:03.340 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T05:26:03.354 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../122-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T05:26:03.398 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T05:26:03.454 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-simplejson. 2024-09-17T05:26:03.469 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../121-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-17T05:26:03.512 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-17T05:26:03.776 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-17T05:26:03.790 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../122-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-17T05:26:03.853 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-17T05:26:04.136 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package radosgw. 2024-09-17T05:26:04.149 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../123-radosgw_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:26:04.194 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking radosgw (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:04.588 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package radosgw. 2024-09-17T05:26:04.602 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../123-radosgw_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:26:04.637 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking radosgw (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:04.897 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T05:26:04.911 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../124-rbd-fuse_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:26:04.955 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking rbd-fuse (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:05.258 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T05:26:05.341 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package rbd-fuse. 2024-09-17T05:26:05.356 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../124-rbd-fuse_19.3.0-4963-g820f760e-1jammy_amd64.deb ... 2024-09-17T05:26:05.398 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking rbd-fuse (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:05.535 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T05:26:05.689 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T05:26:05.735 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-17T05:26:05.944 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T05:26:05.987 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-17T05:26:06.113 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-17T05:26:06.341 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T05:26:06.420 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-17T05:26:06.860 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-17T05:26:06.973 INFO:teuthology.orchestra.run.smithi155.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T05:26:06.986 INFO:teuthology.orchestra.run.smithi155.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-17T05:26:07.047 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephadm (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:07.549 INFO:teuthology.orchestra.run.smithi031.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-17T05:26:07.605 INFO:teuthology.orchestra.run.smithi031.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-17T05:26:07.615 INFO:teuthology.orchestra.run.smithi155.stdout:Adding system user cephadm....done 2024-09-17T05:26:07.657 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephadm (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:07.769 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T05:26:08.046 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T05:26:08.297 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T05:26:08.423 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T05:26:08.468 INFO:teuthology.orchestra.run.smithi031.stdout:Adding system user cephadm....done 2024-09-17T05:26:08.638 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-17T05:26:08.691 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T05:26:08.931 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-17T05:26:08.958 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T05:26:09.085 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T05:26:09.198 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-17T05:26:09.334 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-17T05:26:09.429 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T05:26:09.601 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-17T05:26:09.797 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T05:26:09.893 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-17T05:26:09.994 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-17T05:26:10.081 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-17T05:26:10.313 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-17T05:26:10.333 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T05:26:10.659 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-17T05:26:10.853 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-17T05:26:10.910 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T05:26:11.133 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-17T05:26:11.203 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T05:26:11.447 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-17T05:26:11.479 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T05:26:11.738 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-ceph-argparse (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:11.793 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-17T05:26:12.039 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T05:26:12.070 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-17T05:26:12.157 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-17T05:26:12.283 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T05:26:12.346 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-17T05:26:12.417 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-17T05:26:12.622 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-17T05:26:12.677 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T05:26:12.828 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T05:26:12.890 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-ceph-argparse (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:13.095 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-17T05:26:13.199 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-17T05:26:13.325 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-17T05:26:13.451 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-17T05:26:13.500 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-17T05:26:13.534 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-17T05:26:13.577 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-17T05:26:13.590 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T05:26:13.749 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T05:26:13.853 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-17T05:26:13.979 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-17T05:26:14.126 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T05:26:14.246 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-17T05:26:14.252 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T05:26:14.553 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T05:26:14.676 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-17T05:26:14.710 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-17T05:26:14.775 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-17T05:26:14.829 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T05:26:14.917 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-17T05:26:15.147 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up zip (3.0-12build2) ... 2024-09-17T05:26:15.248 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T05:26:15.294 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-17T05:26:15.419 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-17T05:26:15.712 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-17T05:26:15.980 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-17T05:26:16.008 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T05:26:16.284 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T05:26:16.323 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up zip (3.0-12build2) ... 2024-09-17T05:26:16.443 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T05:26:16.448 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-17T05:26:16.569 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T05:26:16.887 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T05:26:17.201 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-17T05:26:17.288 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T05:26:17.468 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-17T05:26:17.539 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T05:26:17.569 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-17T05:26:17.695 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-17T05:26:17.916 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T05:26:18.046 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-17T05:26:18.217 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-17T05:26:18.455 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-17T05:26:18.535 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T05:26:18.723 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-17T05:26:18.895 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T05:26:19.125 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-17T05:26:19.162 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T05:26:19.280 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-ceph-common (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:19.434 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-17T05:26:19.573 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T05:26:19.777 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-17T05:26:19.932 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T05:26:20.145 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-17T05:26:20.413 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-17T05:26:20.530 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-ceph-common (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:20.857 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-17T05:26:21.155 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T05:26:21.233 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-17T05:26:21.381 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:26:21.524 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T05:26:21.800 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T05:26:21.926 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T05:26:22.052 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T05:26:22.361 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T05:26:22.521 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-17T05:26:22.638 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T05:26:22.756 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:26:22.891 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-17T05:26:22.897 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:26:23.006 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T05:26:23.200 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-17T05:26:23.316 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T05:26:23.326 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-17T05:26:23.452 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-17T05:26:23.583 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T05:26:23.795 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-17T05:26:23.851 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T05:26:24.071 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-17T05:26:24.119 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T05:26:24.355 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:26:24.412 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T05:26:24.481 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-17T05:26:24.688 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T05:26:24.799 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-17T05:26:24.805 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T05:26:25.073 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T05:26:25.075 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-17T05:26:25.182 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T05:26:25.343 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-17T05:26:25.517 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T05:26:25.594 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-17T05:26:25.835 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T05:26:25.870 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-17T05:26:26.146 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-17T05:26:26.261 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T05:26:26.263 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-17T05:26:26.387 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-17T05:26:26.504 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T05:26:26.556 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-17T05:26:26.585 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T05:26:26.690 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-17T05:26:26.823 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T05:26:26.924 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T05:26:27.017 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-17T05:26:27.325 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T05:26:27.326 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-17T05:26:27.602 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-17T05:26:27.602 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-17T05:26:27.720 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-17T05:26:27.727 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T05:26:27.846 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-17T05:26:27.934 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-17T05:26:28.004 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:26:28.121 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T05:26:28.206 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-17T05:26:28.332 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-17T05:26:28.456 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T05:26:28.748 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T05:26:28.750 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-17T05:26:29.017 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-17T05:26:29.118 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-17T05:26:29.119 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T05:26:29.244 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T05:26:29.386 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-17T05:26:29.504 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-17T05:26:29.521 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T05:26:29.797 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T05:26:29.821 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-17T05:26:30.049 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T05:26:30.164 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-17T05:26:30.433 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T05:26:30.567 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-17T05:26:30.668 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-17T05:26:30.726 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T05:26:30.945 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-17T05:26:31.087 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T05:26:31.213 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librados2 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:31.246 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-17T05:26:31.314 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:31.432 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-17T05:26:31.513 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-17T05:26:31.793 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libcephfs2 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:31.919 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libradosstriper1 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:31.940 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-17T05:26:32.045 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T05:26:32.233 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-17T05:26:32.347 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librbd1 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:32.481 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-modules-core (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:32.577 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-17T05:26:32.590 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-fuse (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:32.703 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librados2 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:32.799 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T05:26:32.799 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T05:26:32.837 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:32.964 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-17T05:26:33.333 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libcephfs2 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:33.450 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libcephfs-dev (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:33.459 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libradosstriper1 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:33.559 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rados (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:33.585 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-17T05:26:33.660 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up librgw2 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:33.786 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-top (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:33.912 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T05:26:33.920 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librbd1 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:34.046 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-modules-core (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:34.172 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-fuse (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:34.392 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T05:26:34.392 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-17T05:26:35.073 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libcephfs-dev (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:35.174 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rbd (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:35.191 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rados (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:35.292 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librgw2 (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:35.300 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up rbd-fuse (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:35.401 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-top (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:35.426 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-rgw (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:35.527 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-17T05:26:35.552 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up python3-cephfs (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:35.678 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-shell (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:35.821 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-common (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:36.357 INFO:teuthology.orchestra.run.smithi155.stdout:Adding group ceph....done 2024-09-17T05:26:36.733 INFO:teuthology.orchestra.run.smithi155.stdout:Adding system user ceph....done 2024-09-17T05:26:36.861 INFO:teuthology.orchestra.run.smithi155.stdout:Setting system user ceph properties....done 2024-09-17T05:26:36.878 INFO:teuthology.orchestra.run.smithi155.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T05:26:36.905 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rbd (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:37.018 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T05:26:37.031 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up rbd-fuse (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:37.157 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rgw (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:37.283 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cephfs (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:37.442 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-shell (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:37.443 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T05:26:37.568 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-common (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:38.121 INFO:teuthology.orchestra.run.smithi031.stdout:Adding group ceph....done 2024-09-17T05:26:38.130 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up cephfs-mirror (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:38.336 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:26:38.337 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:26:38.447 INFO:teuthology.orchestra.run.smithi031.stdout:Adding system user ceph....done 2024-09-17T05:26:38.650 INFO:teuthology.orchestra.run.smithi031.stdout:Setting system user ceph properties....done 2024-09-17T05:26:38.672 INFO:teuthology.orchestra.run.smithi031.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-17T05:26:38.825 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-17T05:26:38.998 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-test (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:39.124 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up radosgw (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:39.239 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-17T05:26:39.654 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:26:39.654 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:26:39.928 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-mirror (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:40.143 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:26:40.143 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:26:40.281 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-base (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:40.828 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-test (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:40.877 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T05:26:40.954 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up radosgw (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:41.515 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:26:41.516 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:26:41.825 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mds (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:42.056 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T05:26:42.056 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T05:26:42.277 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-base (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:42.646 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-17T05:26:42.710 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:42.921 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T05:26:42.921 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T05:26:43.379 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mds (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:43.602 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-osd (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:43.616 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T05:26:43.616 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-17T05:26:43.931 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T05:26:43.931 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T05:26:44.222 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:44.465 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T05:26:44.466 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-17T05:26:44.612 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:44.738 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:44.881 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mon (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:45.107 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-osd (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:45.110 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T05:26:45.111 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T05:26:45.417 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T05:26:45.418 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-17T05:26:45.749 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-cephadm (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:45.925 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:46.058 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:46.059 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-mgr-dashboard (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:46.184 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:46.202 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ceph-volume (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:46.360 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mon (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:46.546 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T05:26:46.578 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T05:26:46.578 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-17T05:26:46.638 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T05:26:46.807 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T05:26:47.211 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-cephadm (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:47.354 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:47.480 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-dashboard (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:47.631 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-volume (19.3.0-4963-g820f760e-1jammy) ... 2024-09-17T05:26:47.715 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T05:26:48.009 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T05:26:48.117 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T05:26:48.270 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T05:26:48.455 INFO:teuthology.orchestra.run.smithi155.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T05:26:48.460 DEBUG:teuthology.orchestra.run.smithi155:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-17T05:26:48.536 INFO:teuthology.orchestra.run.smithi155.stdout:Reading package lists... 2024-09-17T05:26:48.719 INFO:teuthology.orchestra.run.smithi155.stdout:Building dependency tree... 2024-09-17T05:26:48.720 INFO:teuthology.orchestra.run.smithi155.stdout:Reading state information... 2024-09-17T05:26:48.906 INFO:teuthology.orchestra.run.smithi155.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-17T05:26:48.906 INFO:teuthology.orchestra.run.smithi155.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-17T05:26:48.906 INFO:teuthology.orchestra.run.smithi155.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-17T05:26:48.907 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T05:26:48.907 INFO:teuthology.orchestra.run.smithi155.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T05:26:48.907 INFO:teuthology.orchestra.run.smithi155.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T05:26:48.907 INFO:teuthology.orchestra.run.smithi155.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T05:26:48.907 INFO:teuthology.orchestra.run.smithi155.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T05:26:48.907 INFO:teuthology.orchestra.run.smithi155.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T05:26:48.908 INFO:teuthology.orchestra.run.smithi155.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T05:26:48.908 INFO:teuthology.orchestra.run.smithi155.stdout:The following additional packages will be installed: 2024-09-17T05:26:48.908 INFO:teuthology.orchestra.run.smithi155.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-17T05:26:48.908 INFO:teuthology.orchestra.run.smithi155.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-17T05:26:48.909 INFO:teuthology.orchestra.run.smithi155.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-17T05:26:48.909 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-17T05:26:48.909 INFO:teuthology.orchestra.run.smithi155.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-17T05:26:48.910 INFO:teuthology.orchestra.run.smithi155.stdout:Suggested packages: 2024-09-17T05:26:48.910 INFO:teuthology.orchestra.run.smithi155.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-17T05:26:48.910 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-17T05:26:48.910 INFO:teuthology.orchestra.run.smithi155.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-17T05:26:48.965 INFO:teuthology.orchestra.run.smithi155.stdout:The following NEW packages will be installed: 2024-09-17T05:26:48.966 INFO:teuthology.orchestra.run.smithi155.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-17T05:26:48.966 INFO:teuthology.orchestra.run.smithi155.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-17T05:26:48.967 INFO:teuthology.orchestra.run.smithi155.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-17T05:26:48.967 INFO:teuthology.orchestra.run.smithi155.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-17T05:26:48.967 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-17T05:26:48.967 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-17T05:26:48.967 INFO:teuthology.orchestra.run.smithi155.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-17T05:26:48.968 INFO:teuthology.orchestra.run.smithi155.stdout:The following packages will be upgraded: 2024-09-17T05:26:48.969 INFO:teuthology.orchestra.run.smithi155.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-17T05:26:49.026 INFO:teuthology.orchestra.run.smithi155.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-17T05:26:49.026 INFO:teuthology.orchestra.run.smithi155.stdout:Need to get 55.8 MB of archives. 2024-09-17T05:26:49.026 INFO:teuthology.orchestra.run.smithi155.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-17T05:26:49.027 INFO:teuthology.orchestra.run.smithi155.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-17T05:26:49.161 INFO:teuthology.orchestra.run.smithi155.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-17T05:26:49.165 INFO:teuthology.orchestra.run.smithi155.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-17T05:26:49.193 INFO:teuthology.orchestra.run.smithi155.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-17T05:26:49.194 INFO:teuthology.orchestra.run.smithi155.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-17T05:26:49.194 INFO:teuthology.orchestra.run.smithi155.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-17T05:26:49.201 INFO:teuthology.orchestra.run.smithi155.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-17T05:26:49.202 INFO:teuthology.orchestra.run.smithi155.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-17T05:26:49.203 INFO:teuthology.orchestra.run.smithi155.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-17T05:26:49.204 INFO:teuthology.orchestra.run.smithi155.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-17T05:26:49.205 INFO:teuthology.orchestra.run.smithi155.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-17T05:26:49.205 INFO:teuthology.orchestra.run.smithi155.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-17T05:26:49.215 INFO:teuthology.orchestra.run.smithi155.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-17T05:26:49.215 INFO:teuthology.orchestra.run.smithi155.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-17T05:26:49.215 INFO:teuthology.orchestra.run.smithi155.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-17T05:26:49.232 INFO:teuthology.orchestra.run.smithi155.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-17T05:26:49.387 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T05:26:49.440 INFO:teuthology.orchestra.run.smithi155.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-17T05:26:49.442 INFO:teuthology.orchestra.run.smithi155.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-17T05:26:49.443 INFO:teuthology.orchestra.run.smithi155.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-17T05:26:49.445 INFO:teuthology.orchestra.run.smithi155.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-17T05:26:49.446 INFO:teuthology.orchestra.run.smithi155.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-17T05:26:49.450 INFO:teuthology.orchestra.run.smithi155.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-17T05:26:49.452 INFO:teuthology.orchestra.run.smithi155.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-17T05:26:49.459 INFO:teuthology.orchestra.run.smithi155.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-17T05:26:49.459 INFO:teuthology.orchestra.run.smithi155.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-17T05:26:49.480 INFO:teuthology.orchestra.run.smithi155.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-17T05:26:49.480 INFO:teuthology.orchestra.run.smithi155.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-17T05:26:49.490 INFO:teuthology.orchestra.run.smithi155.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-17T05:26:49.510 INFO:teuthology.orchestra.run.smithi155.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-17T05:26:49.513 INFO:teuthology.orchestra.run.smithi155.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-17T05:26:49.514 INFO:teuthology.orchestra.run.smithi155.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-17T05:26:49.515 INFO:teuthology.orchestra.run.smithi155.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-17T05:26:49.515 INFO:teuthology.orchestra.run.smithi155.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-17T05:26:49.526 INFO:teuthology.orchestra.run.smithi155.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-17T05:26:49.528 INFO:teuthology.orchestra.run.smithi155.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-17T05:26:49.674 INFO:teuthology.orchestra.run.smithi155.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-17T05:26:49.674 INFO:teuthology.orchestra.run.smithi155.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-17T05:26:49.674 INFO:teuthology.orchestra.run.smithi155.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-17T05:26:49.674 INFO:teuthology.orchestra.run.smithi155.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-17T05:26:49.674 INFO:teuthology.orchestra.run.smithi155.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-17T05:26:49.674 INFO:teuthology.orchestra.run.smithi155.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-17T05:26:49.687 INFO:teuthology.orchestra.run.smithi155.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-17T05:26:49.687 INFO:teuthology.orchestra.run.smithi155.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-17T05:26:50.072 INFO:teuthology.orchestra.run.smithi155.stdout:Preconfiguring packages ... 2024-09-17T05:26:50.119 INFO:teuthology.orchestra.run.smithi031.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T05:26:50.124 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-17T05:26:50.202 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-09-17T05:26:50.240 INFO:teuthology.orchestra.run.smithi155.stdout:Fetched 55.8 MB in 1s (78.5 MB/s) 2024-09-17T05:26:50.390 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2024-09-17T05:26:50.390 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2024-09-17T05:26:50.561 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143295 files and directories currently installed.) 2024-09-17T05:26:50.565 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T05:26:50.584 INFO:teuthology.orchestra.run.smithi031.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-17T05:26:50.585 INFO:teuthology.orchestra.run.smithi031.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-17T05:26:50.585 INFO:teuthology.orchestra.run.smithi031.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-17T05:26:50.585 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2024-09-17T05:26:50.585 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-17T05:26:50.585 INFO:teuthology.orchestra.run.smithi031.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-17T05:26:50.586 INFO:teuthology.orchestra.run.smithi031.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-17T05:26:50.586 INFO:teuthology.orchestra.run.smithi031.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-17T05:26:50.586 INFO:teuthology.orchestra.run.smithi031.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-17T05:26:50.586 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-17T05:26:50.587 INFO:teuthology.orchestra.run.smithi031.stdout:The following additional packages will be installed: 2024-09-17T05:26:50.587 INFO:teuthology.orchestra.run.smithi031.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-17T05:26:50.587 INFO:teuthology.orchestra.run.smithi031.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-17T05:26:50.588 INFO:teuthology.orchestra.run.smithi031.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-17T05:26:50.588 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-17T05:26:50.588 INFO:teuthology.orchestra.run.smithi031.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-17T05:26:50.589 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2024-09-17T05:26:50.589 INFO:teuthology.orchestra.run.smithi031.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-17T05:26:50.589 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-17T05:26:50.589 INFO:teuthology.orchestra.run.smithi031.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-17T05:26:50.645 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2024-09-17T05:26:50.646 INFO:teuthology.orchestra.run.smithi031.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-17T05:26:50.646 INFO:teuthology.orchestra.run.smithi031.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-17T05:26:50.647 INFO:teuthology.orchestra.run.smithi031.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-17T05:26:50.647 INFO:teuthology.orchestra.run.smithi031.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-17T05:26:50.647 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-17T05:26:50.647 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-17T05:26:50.647 INFO:teuthology.orchestra.run.smithi031.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-17T05:26:50.648 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages will be upgraded: 2024-09-17T05:26:50.649 INFO:teuthology.orchestra.run.smithi031.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-17T05:26:50.730 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T05:26:50.834 INFO:teuthology.orchestra.run.smithi031.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-17T05:26:50.834 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 55.8 MB of archives. 2024-09-17T05:26:50.835 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-17T05:26:50.835 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-17T05:26:51.382 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-17T05:26:51.459 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-17T05:26:51.476 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-17T05:26:51.601 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-17T05:26:51.602 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-17T05:26:51.603 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-17T05:26:51.631 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-17T05:26:51.632 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-17T05:26:51.652 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-17T05:26:51.655 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-17T05:26:51.655 INFO:teuthology.orchestra.run.smithi031.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-17T05:26:51.658 INFO:teuthology.orchestra.run.smithi031.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-17T05:26:51.704 INFO:teuthology.orchestra.run.smithi031.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-17T05:26:51.704 INFO:teuthology.orchestra.run.smithi031.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-17T05:26:51.705 INFO:teuthology.orchestra.run.smithi031.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-17T05:26:51.785 INFO:teuthology.orchestra.run.smithi031.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-17T05:26:52.471 INFO:teuthology.orchestra.run.smithi031.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-17T05:26:52.473 INFO:teuthology.orchestra.run.smithi031.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-17T05:26:52.473 INFO:teuthology.orchestra.run.smithi031.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-17T05:26:52.476 INFO:teuthology.orchestra.run.smithi031.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-17T05:26:52.477 INFO:teuthology.orchestra.run.smithi031.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-17T05:26:52.481 INFO:teuthology.orchestra.run.smithi031.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-17T05:26:52.483 INFO:teuthology.orchestra.run.smithi031.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-17T05:26:52.529 INFO:teuthology.orchestra.run.smithi031.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-17T05:26:52.530 INFO:teuthology.orchestra.run.smithi031.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-17T05:26:52.530 INFO:teuthology.orchestra.run.smithi155.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-17T05:26:52.604 INFO:teuthology.orchestra.run.smithi031.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-17T05:26:52.613 INFO:teuthology.orchestra.run.smithi031.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-17T05:26:52.624 INFO:teuthology.orchestra.run.smithi031.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-17T05:26:52.700 INFO:teuthology.orchestra.run.smithi031.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-17T05:26:52.705 INFO:teuthology.orchestra.run.smithi031.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-17T05:26:52.705 INFO:teuthology.orchestra.run.smithi031.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-17T05:26:52.705 INFO:teuthology.orchestra.run.smithi031.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-17T05:26:52.706 INFO:teuthology.orchestra.run.smithi031.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-17T05:26:52.723 INFO:teuthology.orchestra.run.smithi031.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-17T05:26:52.725 INFO:teuthology.orchestra.run.smithi031.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-17T05:26:52.813 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package flex. 2024-09-17T05:26:52.883 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143295 files and directories currently installed.) 2024-09-17T05:26:52.887 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-17T05:26:52.936 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-17T05:26:53.208 INFO:teuthology.orchestra.run.smithi031.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-17T05:26:53.208 INFO:teuthology.orchestra.run.smithi031.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-17T05:26:53.209 INFO:teuthology.orchestra.run.smithi031.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-17T05:26:53.209 INFO:teuthology.orchestra.run.smithi031.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-17T05:26:53.209 INFO:teuthology.orchestra.run.smithi031.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-17T05:26:53.209 INFO:teuthology.orchestra.run.smithi031.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-17T05:26:53.270 INFO:teuthology.orchestra.run.smithi031.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-17T05:26:53.271 INFO:teuthology.orchestra.run.smithi031.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-17T05:26:53.423 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T05:26:53.651 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-17T05:26:53.674 INFO:teuthology.orchestra.run.smithi031.stdout:Preconfiguring packages ... 2024-09-17T05:26:53.820 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 55.8 MB in 3s (21.3 MB/s) 2024-09-17T05:26:54.091 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T05:26:54.108 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143295 files and directories currently installed.) 2024-09-17T05:26:54.111 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T05:26:54.259 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T05:26:54.631 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143368 files and directories currently installed.) 2024-09-17T05:26:54.635 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T05:26:54.792 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T05:26:54.885 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-17T05:26:55.290 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T05:26:55.449 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T05:26:55.841 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T05:26:56.078 INFO:teuthology.orchestra.run.smithi031.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-17T05:26:56.209 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package bison. 2024-09-17T05:26:56.284 INFO:teuthology.orchestra.run.smithi155.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143368 files and directories currently installed.) 2024-09-17T05:26:56.288 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-17T05:26:56.336 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T05:26:56.347 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package flex. 2024-09-17T05:26:56.419 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143295 files and directories currently installed.) 2024-09-17T05:26:56.423 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-17T05:26:56.470 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-17T05:26:56.779 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-17T05:26:56.796 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-17T05:26:56.837 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-17T05:26:57.166 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package dump. 2024-09-17T05:26:57.175 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T05:26:57.181 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-17T05:26:57.224 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking dump (0.4b47-3) ... 2024-09-17T05:26:57.487 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-17T05:26:57.544 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package indent. 2024-09-17T05:26:57.560 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:26:57.603 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-17T05:26:57.873 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-17T05:26:57.889 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-17T05:26:57.931 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T05:26:58.175 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T05:26:58.235 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-17T05:26:58.251 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-17T05:26:58.293 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-17T05:26:58.588 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-17T05:26:58.604 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-17T05:26:58.646 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T05:26:58.825 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143368 files and directories currently installed.) 2024-09-17T05:26:58.829 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T05:26:58.950 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T05:26:58.983 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-17T05:26:59.000 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-17T05:26:59.042 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T05:26:59.269 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-17T05:26:59.286 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-17T05:26:59.347 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-17T05:26:59.352 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T05:26:59.475 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-17T05:26:59.581 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libjson-perl. 2024-09-17T05:26:59.597 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-17T05:26:59.639 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-17T05:26:59.776 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T05:26:59.959 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-17T05:26:59.975 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-17T05:27:00.017 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-17T05:27:00.201 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package bison. 2024-09-17T05:27:00.280 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143368 files and directories currently installed.) 2024-09-17T05:27:00.285 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-17T05:27:00.328 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T05:27:00.745 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-17T05:27:00.761 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-17T05:27:00.803 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-17T05:27:01.156 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package dump. 2024-09-17T05:27:01.173 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-17T05:27:01.215 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking dump (0.4b47-3) ... 2024-09-17T05:27:01.412 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-17T05:27:01.428 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-17T05:27:01.462 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T05:27:01.496 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package indent. 2024-09-17T05:27:01.510 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:27:01.543 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-17T05:27:01.699 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-17T05:27:01.715 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-17T05:27:01.757 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T05:27:01.804 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-17T05:27:01.821 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-17T05:27:01.862 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T05:27:02.126 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-17T05:27:02.143 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-17T05:27:02.184 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T05:27:02.233 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-17T05:27:02.249 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-17T05:27:02.291 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-17T05:27:02.505 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-17T05:27:02.521 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-17T05:27:02.560 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-17T05:27:02.563 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-17T05:27:02.577 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-17T05:27:02.618 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T05:27:02.857 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-17T05:27:02.873 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-17T05:27:02.941 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-17T05:27:02.955 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-17T05:27:02.972 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-17T05:27:03.013 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T05:27:03.249 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-17T05:27:03.266 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-17T05:27:03.277 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-17T05:27:03.294 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:27:03.324 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T05:27:03.335 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:27:03.577 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libjson-perl. 2024-09-17T05:27:03.594 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-17T05:27:03.635 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-17T05:27:03.697 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-17T05:27:03.714 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:27:03.755 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T05:27:03.963 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-17T05:27:03.980 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-17T05:27:04.013 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-17T05:27:04.075 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-17T05:27:04.092 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:27:04.142 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T05:27:04.436 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-17T05:27:04.452 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T05:27:04.502 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T05:27:05.082 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-17T05:27:05.098 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-17T05:27:05.148 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-17T05:27:05.385 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-17T05:27:05.400 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-17T05:27:05.441 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T05:27:05.560 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package modemmanager. 2024-09-17T05:27:05.576 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-17T05:27:05.643 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T05:27:05.685 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-17T05:27:05.702 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-17T05:27:05.744 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T05:27:06.088 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-17T05:27:06.105 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-17T05:27:06.146 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T05:27:06.226 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package network-manager. 2024-09-17T05:27:06.241 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-17T05:27:06.283 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-17T05:27:06.441 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-17T05:27:06.458 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-17T05:27:06.507 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-17T05:27:06.843 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-17T05:27:06.860 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-17T05:27:06.902 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-17T05:27:06.933 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package ppp. 2024-09-17T05:27:06.949 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-17T05:27:07.280 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-17T05:27:07.296 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:27:07.304 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-17T05:27:07.338 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:27:07.655 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package pptp-linux. 2024-09-17T05:27:07.657 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-17T05:27:07.670 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-17T05:27:07.674 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:27:07.705 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-17T05:27:07.715 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T05:27:07.925 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-17T05:27:07.940 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-17T05:27:07.977 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-17T05:27:07.983 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-17T05:27:07.993 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:27:08.035 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T05:27:08.304 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-17T05:27:08.319 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-17T05:27:08.320 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-17T05:27:08.334 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-17T05:27:08.362 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T05:27:08.378 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-client-common (238) ... 2024-09-17T05:27:08.682 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-17T05:27:08.697 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:27:08.740 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:27:08.874 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-17T05:27:08.890 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-17T05:27:08.932 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-17T05:27:09.294 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package modemmanager. 2024-09-17T05:27:09.310 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-17T05:27:09.320 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-common. 2024-09-17T05:27:09.335 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-17T05:27:09.377 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T05:27:09.396 INFO:teuthology.orchestra.run.smithi155.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-17T05:27:09.428 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-common (238) ... 2024-09-17T05:27:09.836 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-14. 2024-09-17T05:27:09.851 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:27:09.889 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:27:10.017 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package network-manager. 2024-09-17T05:27:10.033 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-17T05:27:10.083 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-17T05:27:10.649 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ppp. 2024-09-17T05:27:10.666 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-17T05:27:11.032 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-17T05:27:11.124 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql. 2024-09-17T05:27:11.139 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-17T05:27:11.174 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql (14+238) ... 2024-09-17T05:27:11.378 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package pptp-linux. 2024-09-17T05:27:11.385 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-client. 2024-09-17T05:27:11.393 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-17T05:27:11.400 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-17T05:27:11.436 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-17T05:27:11.442 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-client (14+238) ... 2024-09-17T05:27:11.687 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-17T05:27:11.702 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-17T05:27:11.739 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-17T05:27:11.745 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-17T05:27:11.754 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-17T05:27:11.789 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-17T05:27:12.083 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-17T05:27:12.100 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-17T05:27:12.106 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package tcl8.6. 2024-09-17T05:27:12.121 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-17T05:27:12.142 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-client-common (238) ... 2024-09-17T05:27:12.165 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-17T05:27:12.479 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-17T05:27:12.496 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:27:12.537 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:27:12.876 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package tcl. 2024-09-17T05:27:12.891 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-17T05:27:12.941 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-17T05:27:13.125 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-common. 2024-09-17T05:27:13.142 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-17T05:27:13.203 INFO:teuthology.orchestra.run.smithi031.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-17T05:27:13.232 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-common (238) ... 2024-09-17T05:27:13.287 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package wpasupplicant. 2024-09-17T05:27:13.302 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-17T05:27:13.345 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-17T05:27:13.707 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-14. 2024-09-17T05:27:13.724 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-17T05:27:13.733 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-17T05:27:13.749 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-17T05:27:13.768 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:27:13.792 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-17T05:27:14.112 INFO:teuthology.orchestra.run.smithi155.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-17T05:27:14.128 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-17T05:27:14.169 INFO:teuthology.orchestra.run.smithi155.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-17T05:27:14.465 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-client-common (238) ... 2024-09-17T05:27:14.693 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-17T05:27:14.819 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-17T05:27:14.842 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql. 2024-09-17T05:27:14.858 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-17T05:27:14.901 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql (14+238) ... 2024-09-17T05:27:14.937 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:27:15.038 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-17T05:27:15.165 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T05:27:15.178 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-client. 2024-09-17T05:27:15.193 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-17T05:27:15.236 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-client (14+238) ... 2024-09-17T05:27:15.291 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:27:15.480 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-17T05:27:15.496 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-17T05:27:15.538 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-17T05:27:15.874 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package tcl8.6. 2024-09-17T05:27:15.891 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-17T05:27:15.924 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-17T05:27:16.193 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package tcl. 2024-09-17T05:27:16.211 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-17T05:27:16.246 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-17T05:27:16.290 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-17T05:27:16.347 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-17T05:27:16.638 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package wpasupplicant. 2024-09-17T05:27:16.655 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-17T05:27:16.696 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-17T05:27:16.751 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-17T05:27:16.751 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-17T05:27:17.058 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-17T05:27:17.075 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-17T05:27:17.116 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-17T05:27:17.458 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T05:27:17.584 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-17T05:27:17.727 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T05:27:17.853 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-17T05:27:17.853 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-17T05:27:17.871 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-17T05:27:17.920 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-17T05:27:17.962 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T05:27:18.072 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T05:27:18.231 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-17T05:27:18.232 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-client-common (238) ... 2024-09-17T05:27:18.357 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-17T05:27:18.441 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-17T05:27:18.576 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-17T05:27:18.735 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:27:18.861 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-17T05:27:18.987 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-17T05:27:19.063 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-17T05:27:19.105 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:27:19.214 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up dump (0.4b47-3) ... 2024-09-17T05:27:19.309 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-17T05:27:19.374 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T05:27:19.500 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-17T05:27:19.626 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-17T05:27:19.752 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-17T05:27:19.878 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T05:27:19.960 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-17T05:27:20.063 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-17T05:27:20.064 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-17T05:27:20.160 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-17T05:27:20.181 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-17T05:27:20.358 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-17T05:27:20.484 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T05:27:20.587 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-17T05:27:20.587 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-17T05:27:20.609 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-17T05:27:20.777 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-client (14+238) ... 2024-09-17T05:27:20.929 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-17T05:27:21.305 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-17T05:27:21.405 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-17T05:27:21.528 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:21.528 INFO:teuthology.orchestra.run.smithi155.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-17T05:27:21.528 INFO:teuthology.orchestra.run.smithi155.stdout:which means they are currently configured by ifupdown: 2024-09-17T05:27:21.528 INFO:teuthology.orchestra.run.smithi155.stdout:- enp3s0f1 2024-09-17T05:27:21.528 INFO:teuthology.orchestra.run.smithi155.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-17T05:27:21.528 INFO:teuthology.orchestra.run.smithi155.stdout:remove their configuration from /etc/network/interfaces. 2024-09-17T05:27:21.528 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:21.556 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-17T05:27:21.659 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-17T05:27:21.682 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-17T05:27:21.808 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-17T05:27:21.942 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-17T05:27:22.068 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-17T05:27:22.094 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-17T05:27:22.219 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-17T05:27:22.494 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-17T05:27:23.243 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-17T05:27:23.385 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up dump (0.4b47-3) ... 2024-09-17T05:27:23.480 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-17T05:27:23.490 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T05:27:23.544 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T05:27:23.658 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T05:27:23.670 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-17T05:27:23.784 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-17T05:27:23.821 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-17T05:27:23.910 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-common (238) ... 2024-09-17T05:27:23.930 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-17T05:27:24.031 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-17T05:27:24.121 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-17T05:27:24.191 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-17T05:27:24.317 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-17T05:27:24.527 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-17T05:27:24.653 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T05:27:24.778 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-17T05:27:24.870 INFO:teuthology.orchestra.run.smithi155.stdout:Adding user postgres to group ssl-cert 2024-09-17T05:27:24.938 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-client (14+238) ... 2024-09-17T05:27:25.064 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-17T05:27:25.094 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:25.094 INFO:teuthology.orchestra.run.smithi155.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-17T05:27:25.348 INFO:teuthology.orchestra.run.smithi155.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-17T05:27:25.348 INFO:teuthology.orchestra.run.smithi155.stdout:Removing obsolete dictionary files: 2024-09-17T05:27:25.669 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:25.669 INFO:teuthology.orchestra.run.smithi031.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-17T05:27:25.669 INFO:teuthology.orchestra.run.smithi031.stdout:which means they are currently configured by ifupdown: 2024-09-17T05:27:25.669 INFO:teuthology.orchestra.run.smithi031.stdout:- ens1f0 2024-09-17T05:27:25.669 INFO:teuthology.orchestra.run.smithi031.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-17T05:27:25.669 INFO:teuthology.orchestra.run.smithi031.stdout:remove their configuration from /etc/network/interfaces. 2024-09-17T05:27:25.670 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:25.808 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-17T05:27:26.083 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-17T05:27:26.225 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-17T05:27:26.545 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:27:26.638 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-17T05:27:26.888 INFO:teuthology.orchestra.run.smithi155.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-17T05:27:26.901 INFO:teuthology.orchestra.run.smithi155.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-17T05:27:26.953 INFO:teuthology.orchestra.run.smithi155.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-17T05:27:26.953 INFO:teuthology.orchestra.run.smithi155.stdout:This user must also own the server process. 2024-09-17T05:27:26.953 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:26.953 INFO:teuthology.orchestra.run.smithi155.stdout:The database cluster will be initialized with locale "en_US". 2024-09-17T05:27:26.953 INFO:teuthology.orchestra.run.smithi155.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-17T05:27:26.953 INFO:teuthology.orchestra.run.smithi155.stdout:The default text search configuration will be set to "english". 2024-09-17T05:27:26.953 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:26.954 INFO:teuthology.orchestra.run.smithi155.stdout:Data page checksums are disabled. 2024-09-17T05:27:26.954 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:26.954 INFO:teuthology.orchestra.run.smithi155.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-17T05:27:26.954 INFO:teuthology.orchestra.run.smithi155.stdout:creating subdirectories ... ok 2024-09-17T05:27:26.954 INFO:teuthology.orchestra.run.smithi155.stdout:selecting dynamic shared memory implementation ... posix 2024-09-17T05:27:26.978 INFO:teuthology.orchestra.run.smithi155.stdout:selecting default max_connections ... 100 2024-09-17T05:27:27.011 INFO:teuthology.orchestra.run.smithi155.stdout:selecting default shared_buffers ... 128MB 2024-09-17T05:27:27.025 INFO:teuthology.orchestra.run.smithi155.stdout:selecting default time zone ... Etc/UTC 2024-09-17T05:27:27.026 INFO:teuthology.orchestra.run.smithi155.stdout:creating configuration files ... ok 2024-09-17T05:27:27.187 INFO:teuthology.orchestra.run.smithi155.stdout:running bootstrap script ... ok 2024-09-17T05:27:27.333 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-17T05:27:27.485 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-17T05:27:27.611 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-17T05:27:27.737 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-common (238) ... 2024-09-17T05:27:27.815 INFO:teuthology.orchestra.run.smithi155.stdout:performing post-bootstrap initialization ... ok 2024-09-17T05:27:28.376 INFO:teuthology.orchestra.run.smithi155.stdout:syncing data to disk ... ok 2024-09-17T05:27:28.705 INFO:teuthology.orchestra.run.smithi031.stdout:Adding user postgres to group ssl-cert 2024-09-17T05:27:28.904 INFO:teuthology.orchestra.run.smithi155.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-17T05:27:28.929 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:28.930 INFO:teuthology.orchestra.run.smithi031.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-17T05:27:29.195 INFO:teuthology.orchestra.run.smithi031.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-17T05:27:29.195 INFO:teuthology.orchestra.run.smithi031.stdout:Removing obsolete dictionary files: 2024-09-17T05:27:29.945 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-17T05:27:30.421 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-17T05:27:30.768 INFO:teuthology.orchestra.run.smithi031.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-17T05:27:30.793 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-17T05:27:30.847 INFO:teuthology.orchestra.run.smithi031.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-17T05:27:30.847 INFO:teuthology.orchestra.run.smithi031.stdout:This user must also own the server process. 2024-09-17T05:27:30.847 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:30.847 INFO:teuthology.orchestra.run.smithi031.stdout:The database cluster will be initialized with locale "en_US". 2024-09-17T05:27:30.847 INFO:teuthology.orchestra.run.smithi031.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-17T05:27:30.847 INFO:teuthology.orchestra.run.smithi031.stdout:The default text search configuration will be set to "english". 2024-09-17T05:27:30.847 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:30.848 INFO:teuthology.orchestra.run.smithi031.stdout:Data page checksums are disabled. 2024-09-17T05:27:30.848 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:30.848 INFO:teuthology.orchestra.run.smithi031.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-17T05:27:30.848 INFO:teuthology.orchestra.run.smithi031.stdout:creating subdirectories ... ok 2024-09-17T05:27:30.848 INFO:teuthology.orchestra.run.smithi031.stdout:selecting dynamic shared memory implementation ... posix 2024-09-17T05:27:30.873 INFO:teuthology.orchestra.run.smithi031.stdout:selecting default max_connections ... 100 2024-09-17T05:27:30.908 INFO:teuthology.orchestra.run.smithi031.stdout:selecting default shared_buffers ... 128MB 2024-09-17T05:27:30.922 INFO:teuthology.orchestra.run.smithi031.stdout:selecting default time zone ... Etc/UTC 2024-09-17T05:27:30.923 INFO:teuthology.orchestra.run.smithi031.stdout:creating configuration files ... ok 2024-09-17T05:27:31.093 INFO:teuthology.orchestra.run.smithi031.stdout:running bootstrap script ... ok 2024-09-17T05:27:31.714 INFO:teuthology.orchestra.run.smithi031.stdout:performing post-bootstrap initialization ... ok 2024-09-17T05:27:31.987 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T05:27:32.113 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-17T05:27:32.240 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up postgresql (14+238) ... 2024-09-17T05:27:32.353 INFO:teuthology.orchestra.run.smithi031.stdout:syncing data to disk ... ok 2024-09-17T05:27:32.366 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T05:27:32.492 INFO:teuthology.orchestra.run.smithi155.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T05:27:32.778 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-17T05:27:32.779 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-17T05:27:32.877 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-17T05:27:33.577 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T05:27:33.670 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-17T05:27:33.991 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T05:27:34.143 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T05:27:35.554 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-17T05:27:35.646 INFO:teuthology.orchestra.run.smithi155.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T05:27:35.861 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T05:27:35.979 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-17T05:27:36.080 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql (14+238) ... 2024-09-17T05:27:36.202 INFO:teuthology.orchestra.run.smithi155.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T05:27:36.210 DEBUG:teuthology.parallel:result is None 2024-09-17T05:27:36.231 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-17T05:27:36.357 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-17T05:27:36.624 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-17T05:27:36.624 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-17T05:27:37.409 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-17T05:27:37.502 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-17T05:27:37.804 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-17T05:27:37.980 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-17T05:27:39.457 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-17T05:27:39.557 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-17T05:27:40.110 INFO:teuthology.orchestra.run.smithi031.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-17T05:27:40.116 DEBUG:teuthology.parallel:result is None 2024-09-17T05:27:40.117 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=820f760e4779dafd30d668ecea7aba6355dfd3d8 2024-09-17T05:27:40.261 DEBUG:teuthology.orchestra.run.smithi031:> dpkg-query -W -f '${Version}' ceph 2024-09-17T05:27:40.284 INFO:teuthology.orchestra.run.smithi031.stdout:19.3.0-4963-g820f760e-1jammy 2024-09-17T05:27:40.285 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4963-g820f760e-1jammy 2024-09-17T05:27:40.285 INFO:teuthology.task.install:The correct ceph version 19.3.0-4963-g820f760e-1jammy is installed. 2024-09-17T05:27:40.286 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=820f760e4779dafd30d668ecea7aba6355dfd3d8 2024-09-17T05:27:40.425 DEBUG:teuthology.orchestra.run.smithi155:> dpkg-query -W -f '${Version}' ceph 2024-09-17T05:27:40.449 INFO:teuthology.orchestra.run.smithi155.stdout:19.3.0-4963-g820f760e-1jammy 2024-09-17T05:27:40.450 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4963-g820f760e-1jammy 2024-09-17T05:27:40.450 INFO:teuthology.task.install:The correct ceph version 19.3.0-4963-g820f760e-1jammy is installed. 2024-09-17T05:27:40.452 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T05:27:40.452 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:27:40.452 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T05:27:40.472 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:27:40.472 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T05:27:40.514 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T05:27:40.515 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:27:40.515 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T05:27:40.536 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T05:27:40.597 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:27:40.597 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T05:27:40.618 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T05:27:40.681 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T05:27:40.681 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:27:40.681 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T05:27:40.701 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T05:27:40.760 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:27:40.761 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T05:27:40.782 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T05:27:40.845 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T05:27:40.846 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:27:40.846 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T05:27:40.866 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T05:27:40.929 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:27:40.929 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T05:27:40.950 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T05:27:41.013 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T05:27:41.097 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T05:27:41.097 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /var/log/ceph 2024-09-17T05:27:41.101 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /var/log/ceph 2024-09-17T05:27:41.122 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T05:27:41.122 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T05:27:41.164 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T05:27:41.185 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T05:27:41.185 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T05:27:41.228 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T05:27:41.256 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-17T05:27:41.256 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-17T05:27:41.256 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-17T05:27:41.256 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:27:41.256 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T05:27:41.298 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T05:27:41.389 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:27:41.389 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T05:27:41.401 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T05:27:41.495 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T05:27:41.495 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T05:27:41.495 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908692', 'branch': 'wip-athakkar-testing-2024-09-16-2351', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}}', 'email': 'athakkar@redhat.com', 'first_in_suite': False, 'job_id': '7908692', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-athakkar-testing-2024-09-16-2351'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-athakkar-testing-2024-09-16-2351', 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8'}}, 'owner': 'scheduled_avan@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 448, 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8', 'sleep_before_teardown': 0, 'subset': '1/20', 'suite': 'fs:volumes', 'suite_branch': 'wip-athakkar-testing-2024-09-16-2351', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_820f760e4779dafd30d668ecea7aba6355dfd3d8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi031.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOEtFqiP9toX+ihbeycYKdcQzXI00SFiE4aProN1ZtNrisfn9Ze8qS90+K/X4t3g18CL7SYFt+H+CZ/mfDOFf7Y=', 'smithi155.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ5o8pK8GE4c+pmSORYoRYnS5waBRuoWlHEtOUNIJ/vmauIghHkTgk5oqQm9dHaebXK19B2+7MOnpOpwMN9YE1o='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestMisc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_05:02:16', 'tube': 'smithi', 'user': 'avan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T05:27:41.496 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T05:27:41.499 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T05:27:41.508 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T05:27:41.548 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T05:27:41.568 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:27:41.568 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T05:27:41.618 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T05:27:41.618 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 2024-09-17T05:27:41.670 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T05:27:41.670 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:27:41.670 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 891 Links: 1 2024-09-17T05:27:41.670 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:27:41.670 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-17 05:20:55.585714018 +0000 2024-09-17T05:27:41.670 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-17 05:20:55.297716591 +0000 2024-09-17T05:27:41.670 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-17 05:20:55.297716591 +0000 2024-09-17T05:27:41.670 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-09-17 05:20:55.297716591 +0000 2024-09-17T05:27:41.671 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T05:27:41.732 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-17T05:27:41.733 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-17T05:27:41.733 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000660855 s, 775 kB/s 2024-09-17T05:27:41.734 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T05:27:41.788 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 2024-09-17T05:27:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T05:27:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:27:41.839 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 906 Links: 1 2024-09-17T05:27:41.839 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:27:41.839 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-17 05:20:56.173708765 +0000 2024-09-17T05:27:41.839 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-17 05:20:55.913711089 +0000 2024-09-17T05:27:41.839 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-17 05:20:55.913711089 +0000 2024-09-17T05:27:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-09-17 05:20:55.913711089 +0000 2024-09-17T05:27:41.840 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T05:27:41.900 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-17T05:27:41.901 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-17T05:27:41.901 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000370165 s, 1.4 MB/s 2024-09-17T05:27:41.902 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T05:27:41.964 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 2024-09-17T05:27:42.014 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T05:27:42.015 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:27:42.015 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 926 Links: 1 2024-09-17T05:27:42.015 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:27:42.015 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-17 05:20:56.457706229 +0000 2024-09-17T05:27:42.015 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-17 05:20:56.453706265 +0000 2024-09-17T05:27:42.015 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-17 05:20:56.453706265 +0000 2024-09-17T05:27:42.015 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-09-17 05:20:56.453706265 +0000 2024-09-17T05:27:42.015 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T05:27:42.077 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-17T05:27:42.077 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-17T05:27:42.077 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000372934 s, 1.4 MB/s 2024-09-17T05:27:42.080 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T05:27:42.132 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 2024-09-17T05:27:42.182 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T05:27:42.182 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:27:42.182 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 942 Links: 1 2024-09-17T05:27:42.182 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:27:42.182 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-17 05:20:57.289698797 +0000 2024-09-17T05:27:42.183 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-17 05:20:57.013701262 +0000 2024-09-17T05:27:42.183 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-17 05:20:57.013701262 +0000 2024-09-17T05:27:42.183 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-09-17 05:20:57.013701262 +0000 2024-09-17T05:27:42.183 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T05:27:42.244 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-17T05:27:42.244 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-17T05:27:42.245 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000385539 s, 1.3 MB/s 2024-09-17T05:27:42.246 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T05:27:42.304 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:27:42.304 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:27:42.305 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T05:27:42.314 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T05:27:42.314 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2024-09-17T05:27:42.365 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T05:27:42.366 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:27:42.366 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 879 Links: 1 2024-09-17T05:27:42.366 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:27:42.366 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-17 05:20:55.577133047 +0000 2024-09-17T05:27:42.366 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-17 05:20:55.317135369 +0000 2024-09-17T05:27:42.366 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-17 05:20:55.317135369 +0000 2024-09-17T05:27:42.366 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-17 05:20:55.317135369 +0000 2024-09-17T05:27:42.366 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T05:27:42.428 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-17T05:27:42.428 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-17T05:27:42.428 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000391625 s, 1.3 MB/s 2024-09-17T05:27:42.430 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T05:27:42.483 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2024-09-17T05:27:42.538 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T05:27:42.538 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:27:42.539 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 897 Links: 1 2024-09-17T05:27:42.539 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:27:42.539 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-17 05:20:56.157127866 +0000 2024-09-17T05:27:42.539 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-17 05:20:55.901130153 +0000 2024-09-17T05:27:42.539 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-17 05:20:55.901130153 +0000 2024-09-17T05:27:42.539 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-17 05:20:55.901130153 +0000 2024-09-17T05:27:42.540 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T05:27:42.600 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-17T05:27:42.600 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-17T05:27:42.600 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000383232 s, 1.3 MB/s 2024-09-17T05:27:42.602 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T05:27:42.655 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2024-09-17T05:27:42.709 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T05:27:42.710 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:27:42.710 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 916 Links: 1 2024-09-17T05:27:42.710 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:27:42.710 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-17 05:20:56.777122328 +0000 2024-09-17T05:27:42.710 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-17 05:20:56.501124793 +0000 2024-09-17T05:27:42.710 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-17 05:20:56.501124793 +0000 2024-09-17T05:27:42.710 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-17 05:20:56.501124793 +0000 2024-09-17T05:27:42.710 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T05:27:42.772 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-17T05:27:42.772 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-17T05:27:42.772 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000400436 s, 1.3 MB/s 2024-09-17T05:27:42.774 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T05:27:42.829 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2024-09-17T05:27:42.881 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T05:27:42.882 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:27:42.882 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 933 Links: 1 2024-09-17T05:27:42.882 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:27:42.882 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-17 05:20:57.349117220 +0000 2024-09-17T05:27:42.882 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-17 05:20:57.093119506 +0000 2024-09-17T05:27:42.882 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-17 05:20:57.093119506 +0000 2024-09-17T05:27:42.882 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-17 05:20:57.093119506 +0000 2024-09-17T05:27:42.882 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T05:27:42.943 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-17T05:27:42.944 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-17T05:27:42.944 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.00039139 s, 1.3 MB/s 2024-09-17T05:27:42.946 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T05:27:43.000 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:27:43.000 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T05:27:43.000 INFO:tasks.ceph:Generating config... 2024-09-17T05:27:43.001 INFO:tasks.ceph:[client] pid file = 2024-09-17T05:27:43.001 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-17T05:27:43.002 INFO:tasks.ceph:[mgr] client mount timeout = 30 2024-09-17T05:27:43.002 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-17T05:27:43.002 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-09-17T05:27:43.002 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T05:27:43.002 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T05:27:43.002 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T05:27:43.002 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T05:27:43.002 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T05:27:43.002 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-17T05:27:43.002 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-17T05:27:43.002 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-17T05:27:43.002 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-17T05:27:43.002 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T05:27:43.003 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T05:27:43.003 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-17T05:27:43.003 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-17T05:27:43.003 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T05:27:43.003 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T05:27:43.003 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-17T05:27:43.003 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T05:27:43.003 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T05:27:43.003 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T05:27:43.003 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T05:27:43.003 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T05:27:43.004 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T05:27:43.004 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T05:27:43.051 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T05:27:43.076 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T05:27:43.126 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T05:27:43.189 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.31'), ('mon.b', '172.21.15.155'), ('mon.c', '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]')] 2024-09-17T05:27:43.190 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.31,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-17T05:27:43.191 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:27:43.191 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T05:27:43.246 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.31 --add b 172.21.15.155 --addv c '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:27:43.338 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:27:43.339 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: generated fsid b668cd1d-3036-4a29-9e5a-69d0df5776a8 2024-09-17T05:27:43.339 INFO:teuthology.orchestra.run.smithi031.stdout:setting min_mon_release = quincy 2024-09-17T05:27:43.339 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 0 2024-09-17T05:27:43.339 INFO:teuthology.orchestra.run.smithi031.stdout:fsid b668cd1d-3036-4a29-9e5a-69d0df5776a8 2024-09-17T05:27:43.339 INFO:teuthology.orchestra.run.smithi031.stdout:last_changed 2024-09-17T05:27:43.340104+0000 2024-09-17T05:27:43.339 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-17T05:27:43.340104+0000 2024-09-17T05:27:43.339 INFO:teuthology.orchestra.run.smithi031.stdout:min_mon_release 17 (quincy) 2024-09-17T05:27:43.339 INFO:teuthology.orchestra.run.smithi031.stdout:election_strategy: 1 2024-09-17T05:27:43.339 INFO:teuthology.orchestra.run.smithi031.stdout:0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-09-17T05:27:43.339 INFO:teuthology.orchestra.run.smithi031.stdout:1: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-17T05:27:43.340 INFO:teuthology.orchestra.run.smithi031.stdout:2: [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] mon.c 2024-09-17T05:27:43.340 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T05:27:43.342 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T05:27:43.350 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b668cd1d-3036-4a29-9e5a-69d0df5776a8... 2024-09-17T05:27:43.351 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T05:27:43.400 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T05:27:43.440 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2024-09-17T05:27:43.441 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2024-09-17T05:27:43.441 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T05:27:43.441 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2024-09-17T05:27:43.441 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.441 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2024-09-17T05:27:43.441 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.441 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2024-09-17T05:27:43.441 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.441 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2024-09-17T05:27:43.441 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2024-09-17T05:27:43.442 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.442 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2024-09-17T05:27:43.442 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2024-09-17T05:27:43.442 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.442 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T05:27:43.442 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2024-09-17T05:27:43.442 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.442 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T05:27:43.442 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T05:27:43.442 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.442 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2024-09-17T05:27:43.442 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.442 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2024-09-17T05:27:43.443 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2024-09-17T05:27:43.443 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2024-09-17T05:27:43.443 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2024-09-17T05:27:43.443 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2024-09-17T05:27:43.443 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2024-09-17T05:27:43.443 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2024-09-17T05:27:43.443 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T05:27:43.443 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T05:27:43.443 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2024-09-17T05:27:43.443 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.443 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T05:27:43.443 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.443 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2024-09-17T05:27:43.444 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.444 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2024-09-17T05:27:43.444 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.444 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2024-09-17T05:27:43.444 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2024-09-17T05:27:43.444 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2024-09-17T05:27:43.444 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.31,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-09-17T05:27:43.444 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on skipped message = False 2024-09-17T05:27:43.444 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = b668cd1d-3036-4a29-9e5a-69d0df5776a8 2024-09-17T05:27:43.444 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.444 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2024-09-17T05:27:43.444 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2024-09-17T05:27:43.445 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.445 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2024-09-17T05:27:43.445 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2024-09-17T05:27:43.445 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2024-09-17T05:27:43.445 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.445 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2024-09-17T05:27:43.445 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2024-09-17T05:27:43.445 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.445 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2024-09-17T05:27:43.445 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2024-09-17T05:27:43.445 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2024-09-17T05:27:43.445 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug trim objects = true 2024-09-17T05:27:43.445 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.446 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2024-09-17T05:27:43.446 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2024-09-17T05:27:43.446 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.446 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2024-09-17T05:27:43.446 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.446 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2024-09-17T05:27:43.446 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.446 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2024-09-17T05:27:43.446 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.446 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2024-09-17T05:27:43.446 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2024-09-17T05:27:43.446 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.446 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2024-09-17T05:27:43.446 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2024-09-17T05:27:43.447 INFO:teuthology.orchestra.run.smithi031.stdout: bdev async discard = True 2024-09-17T05:27:43.447 INFO:teuthology.orchestra.run.smithi031.stdout: bdev enable discard = True 2024-09-17T05:27:43.447 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore allocator = bitmap 2024-09-17T05:27:43.447 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2024-09-17T05:27:43.447 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2024-09-17T05:27:43.447 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 1/20 2024-09-17T05:27:43.447 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 1/20 2024-09-17T05:27:43.447 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-17T05:27:43.447 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2024-09-17T05:27:43.447 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 4/10 2024-09-17T05:27:43.447 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T05:27:43.447 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2024-09-17T05:27:43.448 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2024-09-17T05:27:43.448 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2024-09-17T05:27:43.448 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2024-09-17T05:27:43.448 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.448 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2024-09-17T05:27:43.448 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-17T05:27:43.448 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2024-09-17T05:27:43.448 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-09-17T05:27:43.448 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-09-17T05:27:43.448 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:27:43.448 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:27:43.448 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2024-09-17T05:27:43.448 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 30 2024-09-17T05:27:43.449 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-09-17T05:27:43.449 INFO:teuthology.orchestra.run.smithi031.stdout: debug finisher = 20 2024-09-17T05:27:43.449 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.449 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2024-09-17T05:27:43.449 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-17T05:27:43.449 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-09-17T05:27:43.449 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2024-09-17T05:27:43.449 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-09-17T05:27:43.449 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2024-09-17T05:27:43.449 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2024-09-17T05:27:43.449 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:27:43.449 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2024-09-17T05:27:43.449 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2024-09-17T05:27:43.450 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:27:43.450 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.450 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T05:27:43.450 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T05:27:43.450 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T05:27:43.450 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.450 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T05:27:43.450 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T05:27:43.450 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T05:27:43.450 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.450 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2024-09-17T05:27:43.450 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2024-09-17T05:27:43.450 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.450 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2024-09-17T05:27:43.451 INFO:teuthology.orchestra.run.smithi031.stdout: mon down mkfs grace = 300 2024-09-17T05:27:43.451 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:27:43.451 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2024-09-17T05:27:43.451 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2024-09-17T05:27:43.451 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2024-09-17T05:27:43.451 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2024-09-17T05:27:43.451 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T05:27:43.451 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T05:27:43.451 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = "" 2024-09-17T05:27:43.451 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2024-09-17T05:27:43.451 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2024-09-17T05:27:43.451 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2024-09-17T05:27:43.451 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2024-09-17T05:27:43.452 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2024-09-17T05:27:43.452 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2024-09-17T05:27:43.452 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.d] 2024-09-17T05:27:43.452 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2024-09-17T05:27:43.452 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2024-09-17T05:27:43.452 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T05:27:43.453 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2024-09-17T05:27:43.453 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.453 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2024-09-17T05:27:43.453 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.453 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2024-09-17T05:27:43.453 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.453 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2024-09-17T05:27:43.453 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2024-09-17T05:27:43.453 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.453 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2024-09-17T05:27:43.453 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2024-09-17T05:27:43.453 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.453 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T05:27:43.454 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2024-09-17T05:27:43.454 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.454 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T05:27:43.454 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T05:27:43.454 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.454 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2024-09-17T05:27:43.454 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.454 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2024-09-17T05:27:43.454 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2024-09-17T05:27:43.454 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2024-09-17T05:27:43.454 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2024-09-17T05:27:43.454 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2024-09-17T05:27:43.454 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2024-09-17T05:27:43.455 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2024-09-17T05:27:43.455 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T05:27:43.455 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T05:27:43.455 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2024-09-17T05:27:43.455 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.455 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T05:27:43.455 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.455 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2024-09-17T05:27:43.455 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.455 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2024-09-17T05:27:43.455 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.455 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2024-09-17T05:27:43.455 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2024-09-17T05:27:43.455 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2024-09-17T05:27:43.456 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.31,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-09-17T05:27:43.456 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on skipped message = False 2024-09-17T05:27:43.456 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = b668cd1d-3036-4a29-9e5a-69d0df5776a8 2024-09-17T05:27:43.456 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.456 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2024-09-17T05:27:43.456 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2024-09-17T05:27:43.456 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.456 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2024-09-17T05:27:43.456 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2024-09-17T05:27:43.456 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2024-09-17T05:27:43.456 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.456 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2024-09-17T05:27:43.456 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2024-09-17T05:27:43.457 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.457 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2024-09-17T05:27:43.457 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2024-09-17T05:27:43.457 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2024-09-17T05:27:43.457 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug trim objects = true 2024-09-17T05:27:43.457 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.457 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2024-09-17T05:27:43.457 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2024-09-17T05:27:43.457 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.457 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2024-09-17T05:27:43.457 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.457 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2024-09-17T05:27:43.458 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.458 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2024-09-17T05:27:43.458 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.458 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2024-09-17T05:27:43.458 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2024-09-17T05:27:43.458 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.458 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2024-09-17T05:27:43.458 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2024-09-17T05:27:43.458 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2024-09-17T05:27:43.458 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2024-09-17T05:27:43.458 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2024-09-17T05:27:43.458 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2024-09-17T05:27:43.458 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2024-09-17T05:27:43.459 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 1/20 2024-09-17T05:27:43.459 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 1/20 2024-09-17T05:27:43.459 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-17T05:27:43.459 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2024-09-17T05:27:43.459 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 4/10 2024-09-17T05:27:43.459 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T05:27:43.459 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2024-09-17T05:27:43.459 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2024-09-17T05:27:43.459 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2024-09-17T05:27:43.459 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2024-09-17T05:27:43.459 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.459 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2024-09-17T05:27:43.459 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-17T05:27:43.459 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2024-09-17T05:27:43.460 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-09-17T05:27:43.460 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-09-17T05:27:43.460 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:27:43.460 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:27:43.460 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2024-09-17T05:27:43.460 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 30 2024-09-17T05:27:43.460 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-09-17T05:27:43.460 INFO:teuthology.orchestra.run.smithi155.stdout: debug finisher = 20 2024-09-17T05:27:43.460 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.460 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2024-09-17T05:27:43.460 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-17T05:27:43.460 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-09-17T05:27:43.461 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2024-09-17T05:27:43.461 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-09-17T05:27:43.461 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2024-09-17T05:27:43.461 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2024-09-17T05:27:43.461 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:27:43.461 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2024-09-17T05:27:43.461 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2024-09-17T05:27:43.461 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:27:43.461 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.461 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T05:27:43.461 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T05:27:43.461 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T05:27:43.461 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.462 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T05:27:43.462 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T05:27:43.462 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T05:27:43.462 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.462 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2024-09-17T05:27:43.462 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2024-09-17T05:27:43.462 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.462 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2024-09-17T05:27:43.462 INFO:teuthology.orchestra.run.smithi155.stdout: mon down mkfs grace = 300 2024-09-17T05:27:43.462 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-17T05:27:43.462 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2024-09-17T05:27:43.462 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2024-09-17T05:27:43.463 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2024-09-17T05:27:43.463 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2024-09-17T05:27:43.463 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T05:27:43.463 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T05:27:43.463 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2024-09-17T05:27:43.463 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2024-09-17T05:27:43.463 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2024-09-17T05:27:43.463 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2024-09-17T05:27:43.463 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-09-17T05:27:43.463 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-09-17T05:27:43.463 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-09-17T05:27:43.463 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-09-17T05:27:43.465 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T05:27:43.465 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T05:27:43.563 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T05:27:43.564 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:27:43.564 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T05:27:43.572 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:27:43.573 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T05:27:43.625 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:27:43.625 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:27:43.625 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T05:27:43.625 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T05:27:43.697 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:27:43.697 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:27:43.745 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:27:43.745 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:27:43.745 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T05:27:43.746 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T05:27:43.781 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:27:43.781 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:27:43.829 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T05:27:43.830 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T05:27:43.830 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T05:27:43.885 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T05:27:43.890 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T05:27:43.949 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T05:27:43.960 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T05:27:43.961 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T05:27:44.016 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T05:27:44.020 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-17T05:27:44.041 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T05:27:44.137 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T05:27:44.141 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-17T05:27:44.161 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T05:27:44.222 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T05:27:44.227 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-17T05:27:44.247 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T05:27:44.348 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T05:27:44.352 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-17T05:27:44.372 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T05:27:44.372 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T05:27:44.415 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T05:27:44.432 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-17T05:27:44.516 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-17T05:27:44.533 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T05:27:44.576 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-17T05:27:44.592 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-17T05:27:44.678 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-17T05:27:44.694 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T05:27:44.695 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T05:27:44.695 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T05:27:44.714 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:27:44.714 INFO:tasks.ceph:role: osd.0 2024-09-17T05:27:44.714 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:27:44.714 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T05:27:44.784 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:27:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:27:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:27:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T05:27:44.785 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:27:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:27:44.785 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:27:44.785 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T05:27:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:27:44.785 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:27:45.190 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-09-17T05:27:45.192 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-09-17T05:27:45.193 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T05:27:45.338 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T05:27:45.355 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T05:27:45.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:27:45.356 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T05:27:45.421 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:27:45.421 INFO:tasks.ceph:role: osd.1 2024-09-17T05:27:45.421 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:27:45.421 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T05:27:45.491 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:27:45.491 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:27:45.491 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:27:45.491 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T05:27:45.491 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:27:45.491 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:27:45.492 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:27:45.492 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T05:27:45.492 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:27:45.492 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:27:45.851 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-09-17T05:27:45.853 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-09-17T05:27:45.854 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-17T05:27:45.934 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T05:27:45.994 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T05:27:45.995 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:27:45.995 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T05:27:46.061 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:27:46.062 INFO:tasks.ceph:role: osd.2 2024-09-17T05:27:46.062 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:27:46.062 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T05:27:46.139 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:27:46.139 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:27:46.139 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:27:46.139 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T05:27:46.139 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:27:46.139 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:27:46.139 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:27:46.139 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T05:27:46.139 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:27:46.139 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:27:46.534 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-09-17T05:27:46.537 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-09-17T05:27:46.537 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-17T05:27:46.637 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T05:27:46.655 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T05:27:46.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:27:46.656 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T05:27:46.724 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:27:46.725 INFO:tasks.ceph:role: osd.3 2024-09-17T05:27:46.725 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:27:46.725 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T05:27:46.796 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:27:46.796 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:27:46.796 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:27:46.796 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T05:27:46.796 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:27:46.796 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:27:46.796 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:27:46.796 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T05:27:46.796 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:27:46.797 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:27:47.228 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-09-17T05:27:47.231 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-09-17T05:27:47.231 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-17T05:27:47.377 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T05:27:47.394 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T05:27:47.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:27:47.395 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:27:47.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:27:47.524+0000 7f89f17367c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T05:27:47.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:27:47.528+0000 7f89f17367c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T05:27:47.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:27:47.528+0000 7f89f17367c0 -1 bdev(0x56164dd89800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T05:27:47.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:27:47.528+0000 7f89f17367c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T05:27:50.780 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T05:27:50.802 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:27:50.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:27:50.896+0000 7fb85c19b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T05:27:50.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:27:50.896+0000 7fb85c19b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T05:27:50.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:27:50.896+0000 7fb85c19b7c0 -1 bdev(0x5607fe4fb800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T05:27:50.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:27:50.896+0000 7fb85c19b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T05:27:54.153 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T05:27:54.175 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:27:54.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:27:54.272+0000 7fb3412637c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T05:27:54.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:27:54.272+0000 7fb3412637c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T05:27:54.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:27:54.272+0000 7fb3412637c0 -1 bdev(0x563378231800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T05:27:54.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:27:54.272+0000 7fb3412637c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T05:27:57.496 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T05:27:57.517 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:27:57.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:27:57.608+0000 7fb54ceb27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T05:27:57.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:27:57.612+0000 7fb54ceb27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T05:27:57.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:27:57.612+0000 7fb54ceb27c0 -1 bdev(0x55827a1a3800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-17T05:27:57.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:27:57.612+0000 7fb54ceb27c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-17T05:28:00.843 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T05:28:00.864 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T05:28:00.886 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:28:00.886 INFO:tasks.ceph:role: osd.4 2024-09-17T05:28:00.886 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:28:00.886 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T05:28:00.958 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:28:00.958 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:28:00.958 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:28:00.959 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T05:28:00.959 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:28:00.959 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:28:00.959 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:28:00.959 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T05:28:00.959 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:28:00.959 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:28:01.376 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-09-17T05:28:01.379 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-09-17T05:28:01.380 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-17T05:28:01.512 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T05:28:01.528 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T05:28:01.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:28:01.529 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T05:28:01.596 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:28:01.596 INFO:tasks.ceph:role: osd.5 2024-09-17T05:28:01.596 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:28:01.596 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T05:28:01.664 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:28:01.664 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:28:01.664 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:28:01.664 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T05:28:01.664 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:28:01.664 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:28:01.664 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:28:01.664 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T05:28:01.664 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:28:01.665 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:28:02.027 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-09-17T05:28:02.030 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-09-17T05:28:02.030 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-17T05:28:02.104 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T05:28:02.165 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T05:28:02.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:28:02.166 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-17T05:28:02.232 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:28:02.232 INFO:tasks.ceph:role: osd.6 2024-09-17T05:28:02.232 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:28:02.232 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T05:28:02.300 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:28:02.300 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:28:02.300 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:28:02.300 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T05:28:02.300 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:28:02.300 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:28:02.301 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:28:02.301 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T05:28:02.301 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:28:02.301 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:28:02.692 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-09-17T05:28:02.697 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-09-17T05:28:02.697 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-17T05:28:02.798 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-17T05:28:02.814 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T05:28:02.814 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:28:02.815 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-17T05:28:02.880 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:28:02.880 INFO:tasks.ceph:role: osd.7 2024-09-17T05:28:02.880 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:28:02.881 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T05:28:02.947 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:28:02.947 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:28:02.947 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:28:02.947 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-17T05:28:02.947 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:28:02.947 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:28:02.948 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:28:02.948 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-17T05:28:02.948 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:28:02.948 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:28:03.335 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-09-17T05:28:03.338 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-09-17T05:28:03.338 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-17T05:28:03.476 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-17T05:28:03.491 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: /sbin/restorecon: command not found 2024-09-17T05:28:03.492 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:28:03.492 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:28:03.641 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:03.640+0000 7f1d7a82b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T05:28:03.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:03.640+0000 7f1d7a82b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T05:28:03.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:03.640+0000 7f1d7a82b7c0 -1 bdev(0x55ac08397800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-17T05:28:03.645 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:03.644+0000 7f1d7a82b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-17T05:28:06.867 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T05:28:06.887 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:28:06.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:06.976+0000 7f72797577c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T05:28:06.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:06.976+0000 7f72797577c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T05:28:06.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:06.976+0000 7f72797577c0 -1 bdev(0x5589c53b5800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-17T05:28:06.980 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:06.976+0000 7f72797577c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-17T05:28:10.207 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T05:28:10.226 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:28:10.323 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:10.320+0000 7fa1e9af97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-17T05:28:10.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:10.320+0000 7fa1e9af97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-17T05:28:10.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:10.320+0000 7fa1e9af97c0 -1 bdev(0x55a1c9a51800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-17T05:28:10.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:10.320+0000 7fa1e9af97c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-17T05:28:11.497 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:28:11.502 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:28:13.570 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T05:28:13.590 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:28:13.683 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:13.680+0000 7fa96ef347c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-17T05:28:13.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:13.680+0000 7fa96ef347c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-17T05:28:13.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:13.680+0000 7fa96ef347c0 -1 bdev(0x55f691e4d800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-17T05:28:13.685 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:13.680+0000 7fa96ef347c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-17T05:28:16.887 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T05:28:16.907 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T05:28:16.907 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:28:16.907 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T05:28:16.930 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:28:16.930 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-17T05:28:16.994 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:28:16.995 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-17T05:28:17.063 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:28:17.064 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T05:28:17.130 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:28:17.130 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T05:28:17.198 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:28:17.199 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T05:28:17.262 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:28:17.262 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T05:28:17.330 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:28:17.330 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T05:28:17.351 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:28:17.351 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-17T05:28:17.412 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:28:17.412 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-17T05:28:17.476 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:28:17.476 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T05:28:17.539 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:28:17.539 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T05:28:17.603 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:28:17.603 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-17T05:28:17.669 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:28:17.669 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-17T05:28:17.731 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:28:17.732 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T05:28:17.741 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:28:17.741 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-17T05:28:17.790 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:28:17.790 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-17T05:28:17.798 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:28:17.798 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-17T05:28:17.852 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T05:28:17.853 DEBUG:teuthology.orchestra.run.smithi031:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T05:28:17.859 DEBUG:teuthology.orchestra.run.smithi155:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T05:28:17.905 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.y] 2024-09-17T05:28:17.905 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBPE+lmKILYNBAAojM8RIq92dO2DQyXppReIw== 2024-09-17T05:28:17.905 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2024-09-17T05:28:17.905 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lmoloQARAAbTcR/1F1qz7Crjdu1NPSgw== 2024-09-17T05:28:17.905 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2024-09-17T05:28:17.905 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lmpFRCCBAAZRsuAVwSxuMGDeoYCwWFeg== 2024-09-17T05:28:17.905 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.0] 2024-09-17T05:28:17.905 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBTE+lm0miKHxAA2C1pfwBxJtKQhu4xuPumxg== 2024-09-17T05:28:17.905 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.1] 2024-09-17T05:28:17.905 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBWE+lmdQi7NRAA2v4ETg4jynbPF0K4E73KAA== 2024-09-17T05:28:17.906 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.2] 2024-09-17T05:28:17.906 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBaE+lm18eUEBAA8gAhUx9UNa2Lk4uyFBd7Nw== 2024-09-17T05:28:17.906 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.3] 2024-09-17T05:28:17.906 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBdE+lm00moJBAAizrxOP4rI4fGR91dYzlEkw== 2024-09-17T05:28:17.906 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.x] 2024-09-17T05:28:17.906 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBPE+lmTt2oOBAAmR5ykU4WbEzlKFiwI7sMdg== 2024-09-17T05:28:17.906 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2024-09-17T05:28:17.906 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lmYrdRDRAAkaDz03U3lMZlkLEVFYlTaw== 2024-09-17T05:28:17.906 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.d] 2024-09-17T05:28:17.906 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lm23PSFBAAuO+k0kWY28PN7+pEtlUniQ== 2024-09-17T05:28:17.906 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.4] 2024-09-17T05:28:17.906 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBjE+lmhdtUJhAA7+KM8DwQriFwMbpqXAPTuA== 2024-09-17T05:28:17.906 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.5] 2024-09-17T05:28:17.907 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBmE+lm5cByOhAAiMnQIv2O41am/3E+0dp4sg== 2024-09-17T05:28:17.907 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.6] 2024-09-17T05:28:17.907 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBqE+lm19FhExAAo/Sfj2SX5+Y2/Fxz8mbiNQ== 2024-09-17T05:28:17.907 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.7] 2024-09-17T05:28:17.907 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBtE+lmISDbKBAAapUBS+t+N1vUcCbdJic8Dw== 2024-09-17T05:28:17.907 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-09-17T05:28:17.907 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw== 2024-09-17T05:28:17.907 INFO:teuthology.orchestra.run.smithi031.stdout:[client.2] 2024-09-17T05:28:17.907 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lmAPPaHhAAyz/gKunaNFyrdkAUy50qmQ== 2024-09-17T05:28:17.907 INFO:teuthology.orchestra.run.smithi031.stdout:[client.1] 2024-09-17T05:28:17.907 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lmb2pmIhAA7p+G+WnB7ujZZdSlaossYg== 2024-09-17T05:28:17.907 INFO:teuthology.orchestra.run.smithi031.stdout:[client.3] 2024-09-17T05:28:17.907 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lml72BKBAAgAji5TWedU7azT5oQz3fYg== 2024-09-17T05:28:17.917 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.y] 2024-09-17T05:28:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBPE+lmKILYNBAAojM8RIq92dO2DQyXppReIw== 2024-09-17T05:28:17.917 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-09-17T05:28:17.917 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBQE+lmoloQARAAbTcR/1F1qz7Crjdu1NPSgw== 2024-09-17T05:28:17.917 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-09-17T05:28:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBQE+lmpFRCCBAAZRsuAVwSxuMGDeoYCwWFeg== 2024-09-17T05:28:17.918 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.0] 2024-09-17T05:28:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBTE+lm0miKHxAA2C1pfwBxJtKQhu4xuPumxg== 2024-09-17T05:28:17.918 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.1] 2024-09-17T05:28:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBWE+lmdQi7NRAA2v4ETg4jynbPF0K4E73KAA== 2024-09-17T05:28:17.918 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.2] 2024-09-17T05:28:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBaE+lm18eUEBAA8gAhUx9UNa2Lk4uyFBd7Nw== 2024-09-17T05:28:17.918 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.3] 2024-09-17T05:28:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBdE+lm00moJBAAizrxOP4rI4fGR91dYzlEkw== 2024-09-17T05:28:17.918 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.x] 2024-09-17T05:28:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBPE+lmTt2oOBAAmR5ykU4WbEzlKFiwI7sMdg== 2024-09-17T05:28:17.918 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-09-17T05:28:17.918 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBQE+lmYrdRDRAAkaDz03U3lMZlkLEVFYlTaw== 2024-09-17T05:28:17.918 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-09-17T05:28:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBQE+lm23PSFBAAuO+k0kWY28PN7+pEtlUniQ== 2024-09-17T05:28:17.919 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.4] 2024-09-17T05:28:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBjE+lmhdtUJhAA7+KM8DwQriFwMbpqXAPTuA== 2024-09-17T05:28:17.919 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.5] 2024-09-17T05:28:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBmE+lm5cByOhAAiMnQIv2O41am/3E+0dp4sg== 2024-09-17T05:28:17.919 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.6] 2024-09-17T05:28:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBqE+lm19FhExAAo/Sfj2SX5+Y2/Fxz8mbiNQ== 2024-09-17T05:28:17.919 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.7] 2024-09-17T05:28:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBtE+lmISDbKBAAapUBS+t+N1vUcCbdJic8Dw== 2024-09-17T05:28:17.919 INFO:teuthology.orchestra.run.smithi155.stdout:[client.0] 2024-09-17T05:28:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw== 2024-09-17T05:28:17.919 INFO:teuthology.orchestra.run.smithi155.stdout:[client.2] 2024-09-17T05:28:17.919 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBQE+lmAPPaHhAAyz/gKunaNFyrdkAUy50qmQ== 2024-09-17T05:28:17.919 INFO:teuthology.orchestra.run.smithi155.stdout:[client.1] 2024-09-17T05:28:17.920 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBQE+lmb2pmIhAA7p+G+WnB7ujZZdSlaossYg== 2024-09-17T05:28:17.920 INFO:teuthology.orchestra.run.smithi155.stdout:[client.3] 2024-09-17T05:28:17.920 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBQE+lml72BKBAAgAji5TWedU7azT5oQz3fYg== 2024-09-17T05:28:17.921 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:28:17.953 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:28:18.021 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:28:18.025 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:28:18.082 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:28:18.086 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:28:18.142 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:28:18.145 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:28:18.199 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:28:18.203 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:28:18.256 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:28:18.260 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:28:18.313 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:28:18.316 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:28:18.369 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:28:18.373 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:28:18.425 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:28:18.429 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:28:18.486 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:28:18.489 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:28:18.546 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:28:18.550 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:28:18.603 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:28:18.606 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:28:18.660 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:28:18.663 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:28:18.717 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:28:18.721 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:28:18.774 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:28:18.777 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:28:18.834 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:28:18.837 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:28:18.893 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:28:18.897 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:28:18.954 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:28:18.957 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:28:19.013 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T05:28:19.014 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T05:28:19.033 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T05:28:19.151 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T05:28:19.171 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T05:28:19.190 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T05:28:19.297 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T05:28:19.317 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T05:28:19.383 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T05:28:19.489 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T05:28:19.508 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:28:19.512 DEBUG:teuthology.orchestra.run.smithi155:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:28:19.564 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T05:28:19.564 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T05:28:19.564 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T05:28:19.567 INFO:tasks.ceph.mon.a:Started 2024-09-17T05:28:19.567 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T05:28:19.567 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T05:28:19.607 INFO:tasks.ceph.mon.b:Started 2024-09-17T05:28:19.607 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T05:28:19.607 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T05:28:19.610 INFO:tasks.ceph.mon.c:Started 2024-09-17T05:28:19.610 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T05:28:19.611 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T05:28:19.611 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T05:28:19.614 INFO:tasks.ceph.mgr.y:Started 2024-09-17T05:28:19.614 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T05:28:19.614 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T05:28:19.617 INFO:tasks.ceph.mgr.x:Started 2024-09-17T05:28:19.617 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-17T05:28:19.617 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-17T05:28:19.620 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-17T05:28:19.620 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-17T05:28:19.665 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-17T05:28:19.665 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-17T05:28:19.712 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-17T05:28:19.713 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-17T05:28:19.760 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-17T05:28:19.760 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-17T05:28:19.804 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-17T05:28:19.804 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-17T05:28:19.849 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-17T05:28:19.849 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-17T05:28:19.901 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-17T05:28:19.901 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-17T05:28:19.949 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-17T05:28:19.950 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-17T05:28:20.002 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-17T05:28:20.002 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-17T05:28:20.053 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-17T05:28:20.053 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-17T05:28:20.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.095+0000 7ff2a2000640 1 -- 172.21.15.31:0/3753739413 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2940b2070 con 0x7ff29c036620 2024-09-17T05:28:20.105 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-17T05:28:20.105 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-17T05:28:20.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.099+0000 7ff2a9000640 1 -- 172.21.15.31:0/3753739413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff29c036620 msgr2=0x7ff29c034340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.099+0000 7ff2a9000640 1 --2- 172.21.15.31:0/3753739413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff29c036620 0x7ff29c034340 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0075c0 tx=0x7ff29401c8b0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.099+0000 7ff2a9000640 1 -- 172.21.15.31:0/3753739413 shutdown_connections 2024-09-17T05:28:20.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.099+0000 7ff2a9000640 1 --2- 172.21.15.31:0/3753739413 >> v2:172.21.15.155:3300/0 conn(0x7ff29c052a50 0x7ff29c052e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.099+0000 7ff2a9000640 1 --2- 172.21.15.31:0/3753739413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff29c036620 0x7ff29c034340 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.099+0000 7ff2a9000640 1 -- 172.21.15.31:0/3753739413 >> 172.21.15.31:0/3753739413 conn(0x7ff29c01d780 msgr2=0x7ff29c054570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.099+0000 7ff2a9000640 1 -- 172.21.15.31:0/3753739413 shutdown_connections 2024-09-17T05:28:20.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.099+0000 7ff2a9000640 1 -- 172.21.15.31:0/3753739413 wait complete. 2024-09-17T05:28:20.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.103+0000 7fa254a00640 1 -- 172.21.15.31:0/3717281462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2500ac780 msgr2=0x7fa2500acc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.103+0000 7fa254a00640 1 --2- 172.21.15.31:0/3717281462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2500ac780 0x7fa2500acc00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa23c003960 tx=0x7fa23c003e20 comp rx=0 tx=0).stop 2024-09-17T05:28:20.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.103+0000 7fa254a00640 1 -- 172.21.15.31:0/3717281462 shutdown_connections 2024-09-17T05:28:20.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.103+0000 7fa254a00640 1 --2- 172.21.15.31:0/3717281462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2500cd470 0x7fa2500cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.103+0000 7fa254a00640 1 --2- 172.21.15.31:0/3717281462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2500ac780 0x7fa2500acc00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.103+0000 7fa254a00640 1 --2- 172.21.15.31:0/3717281462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa234004d50 0x7fa2500c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.103+0000 7fa254a00640 1 -- 172.21.15.31:0/3717281462 >> 172.21.15.31:0/3717281462 conn(0x7fa2500b2680 msgr2=0x7fa2500b1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.103+0000 7fa254a00640 1 -- 172.21.15.31:0/3717281462 shutdown_connections 2024-09-17T05:28:20.111 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-17T05:28:20.111 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-17T05:28:20.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.103+0000 7f2f05600640 1 -- 172.21.15.31:0/64334475 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v3)=0 v3) ==== 114+0+0 (secure 0 0 0) 0x7f2f00012e10 con 0x7f2f080c83b0 2024-09-17T05:28:20.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.103+0000 7f2f05600640 1 -- 172.21.15.31:0/64334475 <== mon.0 v2:172.21.15.31:3300/0 9 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7f2f0001c410 con 0x7f2f080c83b0 2024-09-17T05:28:20.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.103+0000 7ff2a9000640 1 Processor -- start 2024-09-17T05:28:20.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.103+0000 7ff2a9000640 1 -- start start 2024-09-17T05:28:20.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.111+0000 7f2f10600640 1 -- 172.21.15.31:0/64334475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f080c83b0 msgr2=0x7f2f080b7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.111+0000 7f2f10600640 1 --2- 172.21.15.31:0/64334475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f080c83b0 0x7f2f080b7340 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f000093c0 tx=0x7f2f00010da0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.111+0000 7f2f10600640 1 -- 172.21.15.31:0/64334475 shutdown_connections 2024-09-17T05:28:20.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.111+0000 7f2f10600640 1 --2- 172.21.15.31:0/64334475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f080c83b0 0x7f2f080b7340 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.111+0000 7f2f10600640 1 --2- 172.21.15.31:0/64334475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f082088a0 0x7f2f080b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.111+0000 7f2f10600640 1 --2- 172.21.15.31:0/64334475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f080b2990 0x7f2f080c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.111+0000 7f2f10600640 1 -- 172.21.15.31:0/64334475 >> 172.21.15.31:0/64334475 conn(0x7f2f080d1e00 msgr2=0x7f2f080b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.103+0000 7fa254a00640 1 -- 172.21.15.31:0/3717281462 wait complete. 2024-09-17T05:28:20.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.111+0000 7f96b2000640 1 -- 172.21.15.31:0/3745974154 <== mon.1 v2:172.21.15.155:3300/0 8 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7f96b40a9bb0 con 0x7f96bc1f7570 2024-09-17T05:28:20.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.115+0000 7f96b2000640 1 -- 172.21.15.31:0/3745974154 <== mon.1 v2:172.21.15.155:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f96b40a9de0 con 0x7f96bc1f7570 2024-09-17T05:28:20.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.115+0000 7f96b2000640 1 -- 172.21.15.31:0/3745974154 <== mon.1 v2:172.21.15.155:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v4)=0 v4) ==== 123+0+0 (secure 0 0 0) 0x7f96b40c7480 con 0x7f96bc1f7570 2024-09-17T05:28:20.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.111+0000 7f0807400640 1 -- 172.21.15.31:0/275761541 <== mon.1 v2:172.21.15.155:3300/0 8 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7f07fc017880 con 0x7f081015eeb0 2024-09-17T05:28:20.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.111+0000 7f0807400640 1 -- 172.21.15.31:0/275761541 <== mon.1 v2:172.21.15.155:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f07fc017ba0 con 0x7f081015eeb0 2024-09-17T05:28:20.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.107+0000 7ff2a9000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff29c052a50 0x7ff29c0398e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.107+0000 7ff2a9000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff29c0e2ee0 0x7ff29c04b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.107+0000 7ff2a3400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff29c052a50 0x7ff29c0398e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.107+0000 7ff2a3400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff29c052a50 0x7ff29c0398e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:53404/0 (socket says 172.21.15.31:53404) 2024-09-17T05:28:20.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.107+0000 7ff2a3400640 1 -- 172.21.15.31:0/3234915130 learned_addr learned my addr 172.21.15.31:0/3234915130 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:20.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.107+0000 7ff2a9000640 1 --2- 172.21.15.31:0/3234915130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff29c0d6590 0x7ff29c04e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.107+0000 7ff2a2a00640 1 --2- 172.21.15.31:0/3234915130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff29c0e2ee0 0x7ff29c04b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.107+0000 7ff2a9000640 1 -- 172.21.15.31:0/3234915130 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff29c01db60 con 0x7ff29c0d6590 2024-09-17T05:28:20.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.107+0000 7ff2a9000640 1 -- 172.21.15.31:0/3234915130 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff29c0e3380 con 0x7ff29c052a50 2024-09-17T05:28:20.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.107+0000 7ff2a9000640 1 -- 172.21.15.31:0/3234915130 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff29c0552e0 con 0x7ff29c0e2ee0 2024-09-17T05:28:20.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.107+0000 7ff2a3e00640 1 --2- 172.21.15.31:0/3234915130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff29c0d6590 0x7ff29c04e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.107+0000 7ff2a2a00640 1 -- 172.21.15.31:0/3234915130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff29c052a50 msgr2=0x7ff29c0398e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.107+0000 7ff2a2a00640 1 --2- 172.21.15.31:0/3234915130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff29c052a50 0x7ff29c0398e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.107+0000 7ff2a2a00640 1 -- 172.21.15.31:0/3234915130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff29c0d6590 msgr2=0x7ff29c04e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.107+0000 7ff2a2a00640 1 --2- 172.21.15.31:0/3234915130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff29c0d6590 0x7ff29c04e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.107+0000 7ff2a2a00640 1 -- 172.21.15.31:0/3234915130 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29c0d6a10 con 0x7ff29c0e2ee0 2024-09-17T05:28:20.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.111+0000 7ff2a2a00640 1 --2- 172.21.15.31:0/3234915130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff29c0e2ee0 0x7ff29c04b5b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff2940ac000 tx=0x7ff294019650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:20.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.111+0000 7ff293400640 1 -- 172.21.15.31:0/3234915130 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2940bd020 con 0x7ff29c0e2ee0 2024-09-17T05:28:20.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.111+0000 7ff293400640 1 -- 172.21.15.31:0/3234915130 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7ff2940b3040 con 0x7ff29c0e2ee0 2024-09-17T05:28:20.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.111+0000 7ff293400640 1 -- 172.21.15.31:0/3234915130 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2940b2050 con 0x7ff29c0e2ee0 2024-09-17T05:28:20.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.111+0000 7ff2a9000640 1 -- 172.21.15.31:0/3234915130 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff29c04d660 con 0x7ff29c0e2ee0 2024-09-17T05:28:20.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.111+0000 7ff293400640 1 -- 172.21.15.31:0/3234915130 <== mon.2 v2:172.21.15.155:3301/0 4 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7ff294005020 con 0x7ff29c0e2ee0 2024-09-17T05:28:20.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.115+0000 7ff293400640 1 -- 172.21.15.31:0/3234915130 <== mon.2 v2:172.21.15.155:3301/0 5 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff2940c0070 con 0x7ff29c0e2ee0 2024-09-17T05:28:20.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.115+0000 7ff2a9000640 1 -- 172.21.15.31:0/3234915130 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff29c04d900 con 0x7ff29c0e2ee0 2024-09-17T05:28:20.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.115+0000 7f2f10600640 1 -- 172.21.15.31:0/64334475 shutdown_connections 2024-09-17T05:28:20.125 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-17T05:28:20.125 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-17T05:28:20.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.115+0000 7f5f3e000640 1 -- 172.21.15.31:0/1362460714 <== mon.2 v2:172.21.15.155:3301/0 8 ==== config(2 keys) ==== 48+0+0 (secure 0 0 0) 0x7f5f400bad80 con 0x7f5f4814b820 2024-09-17T05:28:20.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.115+0000 7f5f3e000640 1 -- 172.21.15.31:0/1362460714 <== mon.2 v2:172.21.15.155:3301/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f5f400ba440 con 0x7f5f4814b820 2024-09-17T05:28:20.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.115+0000 7f2f10600640 1 -- 172.21.15.31:0/64334475 wait complete. 2024-09-17T05:28:20.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.115+0000 7ff2a9000640 1 -- 172.21.15.31:0/3234915130 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff29c0537b0 con 0x7ff29c0e2ee0 2024-09-17T05:28:20.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.119+0000 7ff293400640 1 -- 172.21.15.31:0/3234915130 <== mon.2 v2:172.21.15.155:3301/0 6 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff294003600 con 0x7ff29c0e2ee0 2024-09-17T05:28:20.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.119+0000 7f96c1000640 1 -- 172.21.15.31:0/3745974154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96bc1f7570 msgr2=0x7f96bc1f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.119+0000 7f96c1000640 1 --2- 172.21.15.31:0/3745974154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96bc1f7570 0x7f96bc1f7a20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f96b40ac000 tx=0x7f96a0005840 comp rx=0 tx=0).stop 2024-09-17T05:28:20.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.119+0000 7f5f4ce00640 1 -- 172.21.15.31:0/1362460714 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f5f1c005320 con 0x7f5f4814b820 2024-09-17T05:28:20.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.123+0000 7ff293400640 1 -- 172.21.15.31:0/3234915130 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff2940164d0 con 0x7ff29c0e2ee0 2024-09-17T05:28:20.130 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-17T05:28:20.131 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-17T05:28:20.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.131+0000 7f96c1000640 1 -- 172.21.15.31:0/3745974154 shutdown_connections 2024-09-17T05:28:20.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.131+0000 7f96c1000640 1 --2- 172.21.15.31:0/3745974154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96bc1f7570 0x7f96bc1f7a20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.131+0000 7f96c1000640 1 --2- 172.21.15.31:0/3745974154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96bc15ea50 0x7f96bc0c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.131+0000 7f96c1000640 1 --2- 172.21.15.31:0/3745974154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96a0004d50 0x7f96bc0c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.131+0000 7f96c1000640 1 -- 172.21.15.31:0/3745974154 >> 172.21.15.31:0/3745974154 conn(0x7f96bc0d0c90 msgr2=0x7f96bc0b56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.131+0000 7f96c1000640 1 -- 172.21.15.31:0/3745974154 shutdown_connections 2024-09-17T05:28:20.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.131+0000 7f96c1000640 1 -- 172.21.15.31:0/3745974154 wait complete. 2024-09-17T05:28:20.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.139+0000 7f5f3e000640 1 -- 172.21.15.31:0/1362460714 <== mon.2 v2:172.21.15.155:3301/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f5f400ba5f0 con 0x7f5f4814b820 2024-09-17T05:28:20.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.139+0000 7f5f3e000640 1 -- 172.21.15.31:0/1362460714 <== mon.2 v2:172.21.15.155:3301/0 11 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f5f4814c0a0 con 0x7f5f4814b820 2024-09-17T05:28:20.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.139+0000 7f0807400640 1 -- 172.21.15.31:0/275761541 <== mon.1 v2:172.21.15.155:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f07fc0213f0 con 0x7f081015eeb0 2024-09-17T05:28:20.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.139+0000 7ff293400640 1 -- 172.21.15.31:0/3234915130 <== mon.2 v2:172.21.15.155:3301/0 8 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7ff2940a5910 con 0x7ff29c0e2ee0 2024-09-17T05:28:20.151 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-17T05:28:20.151 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-17T05:28:20.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.151+0000 7f5f4ce00640 1 -- 172.21.15.31:0/1362460714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f4814b820 msgr2=0x7f5f48147fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.151+0000 7f5f4ce00640 1 --2- 172.21.15.31:0/1362460714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f4814b820 0x7f5f48147fc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5f480d0610 tx=0x7f5f2c005840 comp rx=0 tx=0).stop 2024-09-17T05:28:20.157 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-17T05:28:20.157 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-09-17T05:28:20.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.159+0000 7f5f4ce00640 1 -- 172.21.15.31:0/1362460714 shutdown_connections 2024-09-17T05:28:20.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.159+0000 7f5f4ce00640 1 --2- 172.21.15.31:0/1362460714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f4814b820 0x7f5f48147fc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.159+0000 7f5f4ce00640 1 --2- 172.21.15.31:0/1362460714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f48158950 0x7f5f481fb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.159+0000 7f5f4ce00640 1 --2- 172.21.15.31:0/1362460714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f2c005380 0x7f5f481fac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.159+0000 7f5f4ce00640 1 -- 172.21.15.31:0/1362460714 >> 172.21.15.31:0/1362460714 conn(0x7f5f480d0cf0 msgr2=0x7f5f480b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.159+0000 7f5f4ce00640 1 -- 172.21.15.31:0/1362460714 shutdown_connections 2024-09-17T05:28:20.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.159+0000 7f5f4ce00640 1 -- 172.21.15.31:0/1362460714 wait complete. 2024-09-17T05:28:20.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.195+0000 7f080fe00640 1 -- 172.21.15.31:0/275761541 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f07e4005320 con 0x7f081015eeb0 2024-09-17T05:28:20.208 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-17T05:28:20.208 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-17T05:28:20.222 DEBUG:tasks.ceph:set 18 configs 2024-09-17T05:28:20.223 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi031') 2024-09-17T05:28:20.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.215+0000 7f53eea00640 1 -- 172.21.15.31:0/2215569785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53e806ede0 msgr2=0x7f53e80b3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.215+0000 7f53eea00640 1 --2- 172.21.15.31:0/2215569785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53e806ede0 0x7f53e80b3ed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f53e0009bc0 tx=0x7f53e001cba0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.219+0000 7f0807400640 1 -- 172.21.15.31:0/275761541 <== mon.1 v2:172.21.15.155:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07fc021680 con 0x7f081015eeb0 2024-09-17T05:28:20.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.219+0000 7ff293400640 1 -- 172.21.15.31:0/3234915130 <== mon.2 v2:172.21.15.155:3301/0 9 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2940047b0 con 0x7ff29c0e2ee0 2024-09-17T05:28:20.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.219+0000 7f0807400640 1 -- 172.21.15.31:0/275761541 <== mon.1 v2:172.21.15.155:3300/0 12 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f0810073bd0 con 0x7f081015eeb0 2024-09-17T05:28:20.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.219+0000 7f53eea00640 1 -- 172.21.15.31:0/2215569785 shutdown_connections 2024-09-17T05:28:20.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.219+0000 7f53eea00640 1 --2- 172.21.15.31:0/2215569785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53e806ede0 0x7f53e80b3ed0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.219+0000 7f53eea00640 1 --2- 172.21.15.31:0/2215569785 >> v2:172.21.15.31:3300/0 conn(0x7f53e806ea00 0x7f53e80b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.219+0000 7f53eea00640 1 -- 172.21.15.31:0/2215569785 >> 172.21.15.31:0/2215569785 conn(0x7f53e80b18f0 msgr2=0x7f53e80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.231+0000 7f0804c00640 1 -- 172.21.15.31:0/275761541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f081015eeb0 msgr2=0x7f0810147da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.231+0000 7f0804c00640 1 --2- 172.21.15.31:0/275761541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f081015eeb0 0x7f0810147da0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00b560 tx=0x7f07fc00ba20 comp rx=0 tx=0).stop 2024-09-17T05:28:20.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.231+0000 7f53eea00640 1 -- 172.21.15.31:0/2215569785 shutdown_connections 2024-09-17T05:28:20.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.231+0000 7f0804c00640 1 -- 172.21.15.31:0/275761541 shutdown_connections 2024-09-17T05:28:20.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.231+0000 7f0804c00640 1 --2- 172.21.15.31:0/275761541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0810156360 0x7f08101568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.231+0000 7f0804c00640 1 --2- 172.21.15.31:0/275761541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f081015eeb0 0x7f0810147da0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.231+0000 7f0804c00640 1 --2- 172.21.15.31:0/275761541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08100ae4d0 0x7f0810155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.231+0000 7f0804c00640 1 -- 172.21.15.31:0/275761541 >> 172.21.15.31:0/275761541 conn(0x7f08100cfa00 msgr2=0x7f08100b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.231+0000 7f53eea00640 1 -- 172.21.15.31:0/2215569785 wait complete. 2024-09-17T05:28:20.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.231+0000 7f53eea00640 1 Processor -- start 2024-09-17T05:28:20.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.231+0000 7f0804c00640 1 -- 172.21.15.31:0/275761541 shutdown_connections 2024-09-17T05:28:20.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.231+0000 7f0804c00640 1 -- 172.21.15.31:0/275761541 wait complete. 2024-09-17T05:28:20.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53eea00640 1 -- start start 2024-09-17T05:28:20.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53eea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53e806ea00 0x7f53e814e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53eea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53e806ede0 0x7f53e815f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53eea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53e8161b20 0x7f53e80739f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53eea00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f53e80ae310 con 0x7f53e8161b20 2024-09-17T05:28:20.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53eea00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f53e80ae190 con 0x7f53e806ede0 2024-09-17T05:28:20.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53eea00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f53e80ae490 con 0x7f53e806ea00 2024-09-17T05:28:20.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53e7e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53e806ea00 0x7f53e814e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53e7e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53e806ea00 0x7f53e814e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:53820/0 (socket says 172.21.15.31:53820) 2024-09-17T05:28:20.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53e7e00640 1 -- 172.21.15.31:0/1421700722 learned_addr learned my addr 172.21.15.31:0/1421700722 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:20.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53e7400640 1 --2- 172.21.15.31:0/1421700722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53e806ede0 0x7f53e815f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53e7400640 1 -- 172.21.15.31:0/1421700722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53e806ea00 msgr2=0x7f53e814e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53e7400640 1 --2- 172.21.15.31:0/1421700722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53e806ea00 0x7f53e814e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53eca00640 1 --2- 172.21.15.31:0/1421700722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53e8161b20 0x7f53e80739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53e7400640 1 -- 172.21.15.31:0/1421700722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53e8161b20 msgr2=0x7f53e80739f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53e7400640 1 --2- 172.21.15.31:0/1421700722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53e8161b20 0x7f53e80739f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53e7400640 1 -- 172.21.15.31:0/1421700722 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e815a860 con 0x7f53e806ede0 2024-09-17T05:28:20.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53eca00640 1 --2- 172.21.15.31:0/1421700722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53e8161b20 0x7f53e80739f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:28:20.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.243+0000 7f53e7400640 1 --2- 172.21.15.31:0/1421700722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53e806ede0 0x7f53e815f420 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f53e00ac000 tx=0x7f53e00050d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:20.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.247+0000 7f53dfe00640 1 -- 172.21.15.31:0/1421700722 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e00b2040 con 0x7f53e806ede0 2024-09-17T05:28:20.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.247+0000 7f53dfe00640 1 -- 172.21.15.31:0/1421700722 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53e0003b50 con 0x7f53e806ede0 2024-09-17T05:28:20.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.247+0000 7f53dfe00640 1 -- 172.21.15.31:0/1421700722 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e00052c0 con 0x7f53e806ede0 2024-09-17T05:28:20.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.255+0000 7f53eea00640 1 -- 172.21.15.31:0/1421700722 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e815ab40 con 0x7f53e806ede0 2024-09-17T05:28:20.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.255+0000 7f53eea00640 1 -- 172.21.15.31:0/1421700722 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e815b100 con 0x7f53e806ede0 2024-09-17T05:28:20.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.255+0000 7f53dfe00640 1 -- 172.21.15.31:0/1421700722 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f53e00bd030 con 0x7f53e806ede0 2024-09-17T05:28:20.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.255+0000 7f53dfe00640 1 -- 172.21.15.31:0/1421700722 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f53e0002020 con 0x7f53e806ede0 2024-09-17T05:28:20.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.255+0000 7f53eea00640 1 -- 172.21.15.31:0/1421700722 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53e8161fb0 con 0x7f53e806ede0 2024-09-17T05:28:20.265 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi031') 2024-09-17T05:28:20.265 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi031') 2024-09-17T05:28:20.265 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi031') 2024-09-17T05:28:20.265 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi031') 2024-09-17T05:28:20.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.267+0000 7f53dfe00640 1 -- 172.21.15.31:0/1421700722 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f53e00c4060 con 0x7f53e806ede0 2024-09-17T05:28:20.345 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi031') 2024-09-17T05:28:20.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.375+0000 7ff2a9000640 1 -- 172.21.15.31:0/3234915130 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7ff29c0222c0 con 0x7ff29c0e2ee0 2024-09-17T05:28:20.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.383+0000 7f92efe00640 1 -- 172.21.15.31:0/2212503887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92f0162200 msgr2=0x7f92f00d13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.383+0000 7f92efe00640 1 --2- 172.21.15.31:0/2212503887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92f0162200 0x7f92f00d13e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f92e8009bc0 tx=0x7f92e801ca50 comp rx=0 tx=0).stop 2024-09-17T05:28:20.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.387+0000 7f92efe00640 1 -- 172.21.15.31:0/2212503887 shutdown_connections 2024-09-17T05:28:20.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.387+0000 7f92efe00640 1 --2- 172.21.15.31:0/2212503887 >> v2:172.21.15.155:3300/0 conn(0x7f92f00b5880 0x7f92f00b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.387+0000 7f92efe00640 1 --2- 172.21.15.31:0/2212503887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92f0162200 0x7f92f00d13e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.387+0000 7f92efe00640 1 -- 172.21.15.31:0/2212503887 >> 172.21.15.31:0/2212503887 conn(0x7f92f00d0880 msgr2=0x7f92f00d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.387+0000 7f92efe00640 1 -- 172.21.15.31:0/2212503887 shutdown_connections 2024-09-17T05:28:20.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.387+0000 7f92efe00640 1 -- 172.21.15.31:0/2212503887 wait complete. 2024-09-17T05:28:20.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.387+0000 7f92efe00640 1 Processor -- start 2024-09-17T05:28:20.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.391+0000 7f92efe00640 1 -- start start 2024-09-17T05:28:20.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.391+0000 7f92efe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92f00b12c0 0x7f92f015cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.391+0000 7f92efe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92f00b5880 0x7f92f00caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.391+0000 7f92efe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f0162200 0x7f92f00b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.391+0000 7f92eea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92f00b12c0 0x7f92f015cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.391+0000 7f92eea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92f00b12c0 0x7f92f015cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:53842/0 (socket says 172.21.15.31:53842) 2024-09-17T05:28:20.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7f92ee000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92f00b5880 0x7f92f00caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7f92ee000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92f00b5880 0x7f92f00caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:53416/0 (socket says 172.21.15.31:53416) 2024-09-17T05:28:20.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7f92ef400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f0162200 0x7f92f00b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7f92ef400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f0162200 0x7f92f00b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44036/0 (socket says 172.21.15.31:44036) 2024-09-17T05:28:20.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7ff293400640 1 -- 172.21.15.31:0/3234915130 <== mon.2 v2:172.21.15.155:3301/0 10 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7ff2940051d0 con 0x7ff29c0e2ee0 2024-09-17T05:28:20.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7f92eea00640 1 -- 172.21.15.31:0/2819654305 learned_addr learned my addr 172.21.15.31:0/2819654305 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:20.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7f92efe00640 1 -- 172.21.15.31:0/2819654305 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f92f00b2210 con 0x7f92f0162200 2024-09-17T05:28:20.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7f92efe00640 1 -- 172.21.15.31:0/2819654305 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f92f00b2090 con 0x7f92f00b5880 2024-09-17T05:28:20.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7f92efe00640 1 -- 172.21.15.31:0/2819654305 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f92f0162720 con 0x7f92f00b12c0 2024-09-17T05:28:20.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7f92eea00640 1 -- 172.21.15.31:0/2819654305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92f00b5880 msgr2=0x7f92f00caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7f92eea00640 1 --2- 172.21.15.31:0/2819654305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92f00b5880 0x7f92f00caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7f92eea00640 1 -- 172.21.15.31:0/2819654305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f0162200 msgr2=0x7f92f00b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7f92eea00640 1 --2- 172.21.15.31:0/2819654305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f0162200 0x7f92f00b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7f92eea00640 1 -- 172.21.15.31:0/2819654305 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f0157910 con 0x7f92f00b12c0 2024-09-17T05:28:20.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7f92ee000640 1 --2- 172.21.15.31:0/2819654305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92f00b5880 0x7f92f00caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:28:20.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7f92eea00640 1 --2- 172.21.15.31:0/2819654305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92f00b12c0 0x7f92f015cf30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f92e801b100 tx=0x7f92e80a5990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:20.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7f92e7400640 1 -- 172.21.15.31:0/2819654305 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e80cc070 con 0x7f92f00b12c0 2024-09-17T05:28:20.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7f92e7400640 1 -- 172.21.15.31:0/2819654305 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f92e8004460 con 0x7f92f00b12c0 2024-09-17T05:28:20.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.395+0000 7f92e7400640 1 -- 172.21.15.31:0/2819654305 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e80b2040 con 0x7f92f00b12c0 2024-09-17T05:28:20.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.399+0000 7f92efe00640 1 -- 172.21.15.31:0/2819654305 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f0157bf0 con 0x7f92f00b12c0 2024-09-17T05:28:20.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.399+0000 7f92e7400640 1 -- 172.21.15.31:0/2819654305 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f92e8005030 con 0x7f92f00b12c0 2024-09-17T05:28:20.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.399+0000 7f92efe00640 1 -- 172.21.15.31:0/2819654305 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f015cb70 con 0x7f92f00b12c0 2024-09-17T05:28:20.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.403+0000 7f92e4c00640 1 -- 172.21.15.31:0/2819654305 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f006e4c0 con 0x7f92f00b12c0 2024-09-17T05:28:20.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.407+0000 7ff2a9000640 1 -- 172.21.15.31:0/3234915130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff29c0e2ee0 msgr2=0x7ff29c04b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.407+0000 7ff2a9000640 1 --2- 172.21.15.31:0/3234915130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff29c0e2ee0 0x7ff29c04b5b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff2940ac000 tx=0x7ff294019650 comp rx=0 tx=0).stop 2024-09-17T05:28:20.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.407+0000 7f92e7400640 1 -- 172.21.15.31:0/2819654305 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f92e80054b0 con 0x7f92f00b12c0 2024-09-17T05:28:20.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.407+0000 7f92e7400640 1 -- 172.21.15.31:0/2819654305 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f92e80d6070 con 0x7f92f00b12c0 2024-09-17T05:28:20.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.415+0000 7ff2a9000640 1 -- 172.21.15.31:0/3234915130 shutdown_connections 2024-09-17T05:28:20.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.415+0000 7ff2a9000640 1 --2- 172.21.15.31:0/3234915130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff29c0d6590 0x7ff29c04e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.415+0000 7ff2a9000640 1 --2- 172.21.15.31:0/3234915130 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff29c0e2ee0 0x7ff29c04b5b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.415+0000 7ff2a9000640 1 --2- 172.21.15.31:0/3234915130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff29c052a50 0x7ff29c0398e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.415+0000 7ff2a9000640 1 -- 172.21.15.31:0/3234915130 >> 172.21.15.31:0/3234915130 conn(0x7ff29c01d780 msgr2=0x7ff29c005080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.415+0000 7ff2a9000640 1 -- 172.21.15.31:0/3234915130 shutdown_connections 2024-09-17T05:28:20.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.415+0000 7ff2a9000640 1 -- 172.21.15.31:0/3234915130 wait complete. 2024-09-17T05:28:20.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.459+0000 7f9f06a00640 1 -- 172.21.15.31:0/3123067357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f00160380 msgr2=0x7f9f000cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.459+0000 7f9f06a00640 1 --2- 172.21.15.31:0/3123067357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f00160380 0x7f9f000cdae0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009bc0 tx=0x7f9ef801cbc0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.471+0000 7f9f06a00640 1 -- 172.21.15.31:0/3123067357 shutdown_connections 2024-09-17T05:28:20.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.471+0000 7f9f06a00640 1 --2- 172.21.15.31:0/3123067357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f00160380 0x7f9f000cdae0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.471+0000 7f9f06a00640 1 -- 172.21.15.31:0/3123067357 >> 172.21.15.31:0/3123067357 conn(0x7f9f000b18f0 msgr2=0x7f9f000b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.471+0000 7f9f06a00640 1 -- 172.21.15.31:0/3123067357 shutdown_connections 2024-09-17T05:28:20.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.471+0000 7fae19000640 1 -- 172.21.15.31:0/2523196356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae140cac60 msgr2=0x7fae1406e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.471+0000 7fae19000640 1 --2- 172.21.15.31:0/2523196356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae140cac60 0x7fae1406e650 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fae140cbe90 tx=0x7fae0401cb30 comp rx=0 tx=0).stop 2024-09-17T05:28:20.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.471+0000 7f9f06a00640 1 -- 172.21.15.31:0/3123067357 wait complete. 2024-09-17T05:28:20.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.471+0000 7f9f06a00640 1 Processor -- start 2024-09-17T05:28:20.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.471+0000 7f9f06a00640 1 -- start start 2024-09-17T05:28:20.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9f06a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f000cc170 0x7f9f00143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9f06a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f0015f890 0x7f9f0015b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9f06a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f00160380 0x7f9f000b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9f06a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0016a290 con 0x7f9f00160380 2024-09-17T05:28:20.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9f06a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0016a110 con 0x7f9f0015f890 2024-09-17T05:28:20.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9f06a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9f0016a410 con 0x7f9f000cc170 2024-09-17T05:28:20.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9f04a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f00160380 0x7f9f000b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9f04a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f00160380 0x7f9f000b3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44040/0 (socket says 172.21.15.31:44040) 2024-09-17T05:28:20.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9f04a00640 1 -- 172.21.15.31:0/1074503272 learned_addr learned my addr 172.21.15.31:0/1074503272 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:20.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9eff400640 1 --2- 172.21.15.31:0/1074503272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f0015f890 0x7f9f0015b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9effe00640 1 --2- 172.21.15.31:0/1074503272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f000cc170 0x7f9f00143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7fae19000640 1 -- 172.21.15.31:0/2523196356 shutdown_connections 2024-09-17T05:28:20.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7fae19000640 1 --2- 172.21.15.31:0/2523196356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae140cac60 0x7fae1406e650 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7fae19000640 1 -- 172.21.15.31:0/2523196356 >> 172.21.15.31:0/2523196356 conn(0x7fae140cfa00 msgr2=0x7fae140cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7fae19000640 1 -- 172.21.15.31:0/2523196356 shutdown_connections 2024-09-17T05:28:20.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7fae19000640 1 -- 172.21.15.31:0/2523196356 wait complete. 2024-09-17T05:28:20.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9eff400640 1 -- 172.21.15.31:0/1074503272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f000cc170 msgr2=0x7f9f00143530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9eff400640 1 --2- 172.21.15.31:0/1074503272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f000cc170 0x7f9f00143530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9eff400640 1 -- 172.21.15.31:0/1074503272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f00160380 msgr2=0x7f9f000b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9eff400640 1 --2- 172.21.15.31:0/1074503272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f00160380 0x7f9f000b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9eff400640 1 -- 172.21.15.31:0/1074503272 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0015b850 con 0x7f9f0015f890 2024-09-17T05:28:20.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7fae19000640 1 Processor -- start 2024-09-17T05:28:20.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9eff400640 1 --2- 172.21.15.31:0/1074503272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f0015f890 0x7f9f0015b310 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9ef000c360 tx=0x7f9ef000c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:20.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9ef7e00640 1 -- 172.21.15.31:0/1074503272 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0017070 con 0x7f9f0015f890 2024-09-17T05:28:20.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9ef7e00640 1 -- 172.21.15.31:0/1074503272 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ef0003600 con 0x7f9f0015f890 2024-09-17T05:28:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.475+0000 7f9ef7e00640 1 -- 172.21.15.31:0/1074503272 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0003a70 con 0x7f9f0015f890 2024-09-17T05:28:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.479+0000 7f9f06a00640 1 -- 172.21.15.31:0/1074503272 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f00142490 con 0x7f9f0015f890 2024-09-17T05:28:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.479+0000 7f9f06a00640 1 -- 172.21.15.31:0/1074503272 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f00142a50 con 0x7f9f0015f890 2024-09-17T05:28:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.479+0000 7f9ef7e00640 1 -- 172.21.15.31:0/1074503272 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9ef0003c10 con 0x7f9f0015f890 2024-09-17T05:28:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.479+0000 7f9ef7e00640 1 -- 172.21.15.31:0/1074503272 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9ef0006cd0 con 0x7f9f0015f890 2024-09-17T05:28:20.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.483+0000 7fae19000640 1 -- start start 2024-09-17T05:28:20.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.483+0000 7f9f06a00640 1 -- 172.21.15.31:0/1074503272 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f000cdae0 con 0x7f9f0015f890 2024-09-17T05:28:20.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.483+0000 7f9ef7e00640 1 -- 172.21.15.31:0/1074503272 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9ef00067a0 con 0x7f9f0015f890 2024-09-17T05:28:20.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae19000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae14072610 0x7fae1406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae19000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae140aecb0 0x7fae14204f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae19000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae140cac60 0x7fae140a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae19000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fae1415d010 con 0x7fae140cac60 2024-09-17T05:28:20.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae19000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fae1415ce90 con 0x7fae140aecb0 2024-09-17T05:28:20.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae19000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fae1415d190 con 0x7fae14072610 2024-09-17T05:28:20.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae13400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae14072610 0x7fae1406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae13400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae14072610 0x7fae1406f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:53878/0 (socket says 172.21.15.31:53878) 2024-09-17T05:28:20.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae13400640 1 -- 172.21.15.31:0/1008135979 learned_addr learned my addr 172.21.15.31:0/1008135979 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:20.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae13e00640 1 --2- 172.21.15.31:0/1008135979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae140cac60 0x7fae140a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae13400640 1 -- 172.21.15.31:0/1008135979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae140aecb0 msgr2=0x7fae14204f60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:28:20.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae13400640 1 --2- 172.21.15.31:0/1008135979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae140aecb0 0x7fae14204f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae13400640 1 -- 172.21.15.31:0/1008135979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae140cac60 msgr2=0x7fae140a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae13400640 1 --2- 172.21.15.31:0/1008135979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae140cac60 0x7fae140a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae13400640 1 -- 172.21.15.31:0/1008135979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae141684d0 con 0x7fae14072610 2024-09-17T05:28:20.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae13400640 1 --2- 172.21.15.31:0/1008135979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae14072610 0x7fae1406f5e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00c3e0 tx=0x7fadfc00c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:20.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae0b400640 1 -- 172.21.15.31:0/1008135979 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc011790 con 0x7fae14072610 2024-09-17T05:28:20.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae0b400640 1 -- 172.21.15.31:0/1008135979 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadfc017070 con 0x7fae14072610 2024-09-17T05:28:20.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae0b400640 1 -- 172.21.15.31:0/1008135979 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc011d00 con 0x7fae14072610 2024-09-17T05:28:20.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae19000640 1 -- 172.21.15.31:0/1008135979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae141687b0 con 0x7fae14072610 2024-09-17T05:28:20.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.491+0000 7fae19000640 1 -- 172.21.15.31:0/1008135979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fae140a99c0 con 0x7fae14072610 2024-09-17T05:28:20.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.495+0000 7fae0b400640 1 -- 172.21.15.31:0/1008135979 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fadfc01c460 con 0x7fae14072610 2024-09-17T05:28:20.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.495+0000 7fae0b400640 1 -- 172.21.15.31:0/1008135979 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fadfc012a60 con 0x7fae14072610 2024-09-17T05:28:20.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.495+0000 7fae19000640 1 -- 172.21.15.31:0/1008135979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae1406ee30 con 0x7fae14072610 2024-09-17T05:28:20.504 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi031') 2024-09-17T05:28:20.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.503+0000 7fae0b400640 1 -- 172.21.15.31:0/1008135979 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fadfc012420 con 0x7fae14072610 2024-09-17T05:28:20.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.527+0000 7f1b89e00640 1 -- 172.21.15.31:0/1694242621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b8415e230 msgr2=0x7f1b84154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.527+0000 7f1b89e00640 1 --2- 172.21.15.31:0/1694242621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b8415e230 0x7f1b84154c80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1b74009840 tx=0x7f1b7401c780 comp rx=0 tx=0).stop 2024-09-17T05:28:20.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.527+0000 7f1b89e00640 1 -- 172.21.15.31:0/1694242621 shutdown_connections 2024-09-17T05:28:20.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.527+0000 7f1b89e00640 1 --2- 172.21.15.31:0/1694242621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b8415e230 0x7f1b84154c80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.527+0000 7f1b89e00640 1 -- 172.21.15.31:0/1694242621 >> 172.21.15.31:0/1694242621 conn(0x7f1b840b1600 msgr2=0x7f1b840b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.527+0000 7f1b89e00640 1 -- 172.21.15.31:0/1694242621 shutdown_connections 2024-09-17T05:28:20.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.527+0000 7f1b89e00640 1 -- 172.21.15.31:0/1694242621 wait complete. 2024-09-17T05:28:20.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.531+0000 7f1b89e00640 1 Processor -- start 2024-09-17T05:28:20.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.535+0000 7ff601200640 1 -- 172.21.15.31:0/2402667396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f4035ff0 msgr2=0x7ff5f4100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.535+0000 7ff601200640 1 --2- 172.21.15.31:0/2402667396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f4035ff0 0x7ff5f4100c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec00b3e0 tx=0x7ff5ec01d0f0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.535+0000 7ff601200640 1 -- 172.21.15.31:0/2402667396 shutdown_connections 2024-09-17T05:28:20.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.535+0000 7ff601200640 1 --2- 172.21.15.31:0/2402667396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f4035ff0 0x7ff5f4100c40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.535+0000 7ff601200640 1 -- 172.21.15.31:0/2402667396 >> 172.21.15.31:0/2402667396 conn(0x7ff5f401d780 msgr2=0x7ff5f4054570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.535+0000 7f1b89e00640 1 -- start start 2024-09-17T05:28:20.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.535+0000 7f1b89e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b8406e6e0 0x7f1b84151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.535+0000 7f1b89e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b8415e230 0x7f1b8414ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.535+0000 7f1b82a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b8406e6e0 0x7f1b84151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.535+0000 7f1b82a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b8406e6e0 0x7f1b84151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:53466/0 (socket says 172.21.15.31:53466) 2024-09-17T05:28:20.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.539+0000 7f1b82000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b8415e230 0x7f1b8414ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.539+0000 7f1b82000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b8415e230 0x7f1b8414ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44078/0 (socket says 172.21.15.31:44078) 2024-09-17T05:28:20.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.539+0000 7ff601200640 1 -- 172.21.15.31:0/2402667396 shutdown_connections 2024-09-17T05:28:20.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.539+0000 7ff601200640 1 -- 172.21.15.31:0/2402667396 wait complete. 2024-09-17T05:28:20.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.539+0000 7f1b82a00640 1 -- 172.21.15.31:0/3783130141 learned_addr learned my addr 172.21.15.31:0/3783130141 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:20.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.539+0000 7f1b89e00640 1 --2- 172.21.15.31:0/3783130141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b8415ed10 0x7f1b841504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.539+0000 7ff601200640 1 Processor -- start 2024-09-17T05:28:20.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.539+0000 7f1b89e00640 1 -- 172.21.15.31:0/3783130141 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1b841703e0 con 0x7f1b8415e230 2024-09-17T05:28:20.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.539+0000 7f1b89e00640 1 -- 172.21.15.31:0/3783130141 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8415fe10 con 0x7f1b8406e6e0 2024-09-17T05:28:20.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.539+0000 7f1b89e00640 1 -- 172.21.15.31:0/3783130141 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1b84170560 con 0x7f1b8415ed10 2024-09-17T05:28:20.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.539+0000 7f1b83400640 1 --2- 172.21.15.31:0/3783130141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b8415ed10 0x7f1b841504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.539+0000 7f1b82a00640 1 -- 172.21.15.31:0/3783130141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b8415ed10 msgr2=0x7f1b841504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.539+0000 7f1b82a00640 1 --2- 172.21.15.31:0/3783130141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b8415ed10 0x7f1b841504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.539+0000 7f1b82a00640 1 -- 172.21.15.31:0/3783130141 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b8415e230 msgr2=0x7f1b8414ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.539+0000 7f1b82a00640 1 --2- 172.21.15.31:0/3783130141 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b8415e230 0x7f1b8414ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.539+0000 7f1b82a00640 1 -- 172.21.15.31:0/3783130141 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b841540b0 con 0x7f1b8406e6e0 2024-09-17T05:28:20.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.539+0000 7f1b83400640 1 --2- 172.21.15.31:0/3783130141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b8415ed10 0x7f1b841504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:28:20.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.539+0000 7f1b82a00640 1 --2- 172.21.15.31:0/3783130141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b8406e6e0 0x7f1b84151820 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000b4a0 tx=0x7f1b7000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:20.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.543+0000 7f1b7b400640 1 -- 172.21.15.31:0/3783130141 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b70025070 con 0x7f1b8406e6e0 2024-09-17T05:28:20.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.543+0000 7f1b7b400640 1 -- 172.21.15.31:0/3783130141 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b70021720 con 0x7f1b8406e6e0 2024-09-17T05:28:20.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.543+0000 7f1b7b400640 1 -- 172.21.15.31:0/3783130141 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b70021b70 con 0x7f1b8406e6e0 2024-09-17T05:28:20.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.543+0000 7f1b89e00640 1 -- 172.21.15.31:0/3783130141 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b84154e30 con 0x7f1b8406e6e0 2024-09-17T05:28:20.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.543+0000 7f1b89e00640 1 -- 172.21.15.31:0/3783130141 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b84154630 con 0x7f1b8406e6e0 2024-09-17T05:28:20.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.543+0000 7f1b7b400640 1 -- 172.21.15.31:0/3783130141 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1b70028070 con 0x7f1b8406e6e0 2024-09-17T05:28:20.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.543+0000 7f1b7b400640 1 -- 172.21.15.31:0/3783130141 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1b70020700 con 0x7f1b8406e6e0 2024-09-17T05:28:20.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.543+0000 7f9c37200640 1 -- 172.21.15.31:0/3981523642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c30074110 msgr2=0x7f9c3015afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.543+0000 7f9c37200640 1 --2- 172.21.15.31:0/3981523642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c30074110 0x7f9c3015afc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009900 tx=0x7f9c1c01c720 comp rx=0 tx=0).stop 2024-09-17T05:28:20.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.543+0000 7f9c37200640 1 -- 172.21.15.31:0/3981523642 shutdown_connections 2024-09-17T05:28:20.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.543+0000 7f9c37200640 1 --2- 172.21.15.31:0/3981523642 >> v2:172.21.15.31:3300/0 conn(0x7f9c3006ea00 0x7f9c300ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7f9c37200640 1 --2- 172.21.15.31:0/3981523642 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c30074110 0x7f9c3015afc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7f9c37200640 1 -- 172.21.15.31:0/3981523642 >> 172.21.15.31:0/3981523642 conn(0x7f9c300cfa40 msgr2=0x7f9c300cfe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7ff601200640 1 -- start start 2024-09-17T05:28:20.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7ff601200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5f4035ff0 0x7ff5f40f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7ff601200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5f4039cd0 0x7ff5f41afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7ff601200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f4054e90 0x7ff5f4104320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7ff601200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f410f100 con 0x7ff5f4054e90 2024-09-17T05:28:20.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7ff601200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f410ef80 con 0x7ff5f4035ff0 2024-09-17T05:28:20.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7ff601200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f410f280 con 0x7ff5f4039cd0 2024-09-17T05:28:20.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7ff5f9400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5f4039cd0 0x7ff5f41afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7ff5f9400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5f4039cd0 0x7ff5f41afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:53904/0 (socket says 172.21.15.31:53904) 2024-09-17T05:28:20.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7ff5f9400640 1 -- 172.21.15.31:0/651991020 learned_addr learned my addr 172.21.15.31:0/651991020 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:20.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7ff5fa800640 1 --2- 172.21.15.31:0/651991020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f4054e90 0x7ff5f4104320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7ff5f9400640 1 -- 172.21.15.31:0/651991020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5f4035ff0 msgr2=0x7ff5f40f81e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:28:20.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7ff5f9400640 1 --2- 172.21.15.31:0/651991020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5f4035ff0 0x7ff5f40f81e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7ff5f9400640 1 -- 172.21.15.31:0/651991020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f4054e90 msgr2=0x7ff5f4104320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7ff5f9400640 1 --2- 172.21.15.31:0/651991020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f4054e90 0x7ff5f4104320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7ff5f9400640 1 -- 172.21.15.31:0/651991020 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f41abda0 con 0x7ff5f4039cd0 2024-09-17T05:28:20.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.547+0000 7ff5f9400640 1 --2- 172.21.15.31:0/651991020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5f4039cd0 0x7ff5f41afa70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800c430 tx=0x7ff5e800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:20.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.551+0000 7ff5f2000640 1 -- 172.21.15.31:0/651991020 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8017070 con 0x7ff5f4039cd0 2024-09-17T05:28:20.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.551+0000 7ff5f2000640 1 -- 172.21.15.31:0/651991020 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5e8003600 con 0x7ff5f4039cd0 2024-09-17T05:28:20.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.551+0000 7ff5f2000640 1 -- 172.21.15.31:0/651991020 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8003a50 con 0x7ff5f4039cd0 2024-09-17T05:28:20.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.551+0000 7f9c37200640 1 -- 172.21.15.31:0/3981523642 shutdown_connections 2024-09-17T05:28:20.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.551+0000 7f9c37200640 1 -- 172.21.15.31:0/3981523642 wait complete. 2024-09-17T05:28:20.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.551+0000 7ff601200640 1 -- 172.21.15.31:0/651991020 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f41ac080 con 0x7ff5f4039cd0 2024-09-17T05:28:20.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.551+0000 7f1b89e00640 1 -- 172.21.15.31:0/3783130141 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b5c0052a0 con 0x7f1b8406e6e0 2024-09-17T05:28:20.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.551+0000 7ff5f2000640 1 -- 172.21.15.31:0/651991020 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff5e801a070 con 0x7ff5f4039cd0 2024-09-17T05:28:20.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.551+0000 7ff601200640 1 -- 172.21.15.31:0/651991020 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f41ac640 con 0x7ff5f4039cd0 2024-09-17T05:28:20.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.551+0000 7ff5f2000640 1 -- 172.21.15.31:0/651991020 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff5e8012d30 con 0x7ff5f4039cd0 2024-09-17T05:28:20.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.551+0000 7f1b7b400640 1 -- 172.21.15.31:0/3783130141 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1b700209b0 con 0x7f1b8406e6e0 2024-09-17T05:28:20.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.551+0000 7f9c37200640 1 Processor -- start 2024-09-17T05:28:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.559+0000 7f9c37200640 1 -- start start 2024-09-17T05:28:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.559+0000 7f9c37200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c3006ea00 0x7f9c3014a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.559+0000 7f9c37200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c30074110 0x7f9c30200480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.559+0000 7f9c37200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c300ce800 0x7f9c300cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.559+0000 7f9c2f400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c30074110 0x7f9c30200480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.559+0000 7f9c2f400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c30074110 0x7f9c30200480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:53482/0 (socket says 172.21.15.31:53482) 2024-09-17T05:28:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.559+0000 7f9c37200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9c30168010 con 0x7f9c300ce800 2024-09-17T05:28:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.559+0000 7f9c37200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9c30167e90 con 0x7f9c30074110 2024-09-17T05:28:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.559+0000 7f9c37200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9c30168190 con 0x7f9c3006ea00 2024-09-17T05:28:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.559+0000 7f9c2f400640 1 -- 172.21.15.31:0/13899156 learned_addr learned my addr 172.21.15.31:0/13899156 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.559+0000 7f9c35200640 1 --2- 172.21.15.31:0/13899156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c300ce800 0x7f9c300cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.559+0000 7f9c2f400640 1 -- 172.21.15.31:0/13899156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c3006ea00 msgr2=0x7f9c3014a360 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:28:20.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.559+0000 7f9c2f400640 1 --2- 172.21.15.31:0/13899156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c3006ea00 0x7f9c3014a360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.559+0000 7f9c2f400640 1 -- 172.21.15.31:0/13899156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c300ce800 msgr2=0x7f9c300cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.559+0000 7f9c2f400640 1 --2- 172.21.15.31:0/13899156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c300ce800 0x7f9c300cc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.559+0000 7f9c2f400640 1 -- 172.21.15.31:0/13899156 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c301fc980 con 0x7f9c30074110 2024-09-17T05:28:20.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.559+0000 7f9c2f400640 1 --2- 172.21.15.31:0/13899156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c30074110 0x7f9c30200480 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800ba50 tx=0x7f9c2800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:20.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.563+0000 7f9c23e00640 1 -- 172.21.15.31:0/13899156 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28019070 con 0x7f9c30074110 2024-09-17T05:28:20.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.563+0000 7f9c23e00640 1 -- 172.21.15.31:0/13899156 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c2800cd10 con 0x7f9c30074110 2024-09-17T05:28:20.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.563+0000 7f9c23e00640 1 -- 172.21.15.31:0/13899156 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c280146a0 con 0x7f9c30074110 2024-09-17T05:28:20.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.563+0000 7ff601200640 1 -- 172.21.15.31:0/651991020 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d40052a0 con 0x7ff5f4039cd0 2024-09-17T05:28:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.563+0000 7f9c37200640 1 -- 172.21.15.31:0/13899156 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c301fcc60 con 0x7f9c30074110 2024-09-17T05:28:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.563+0000 7f9c37200640 1 -- 172.21.15.31:0/13899156 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c301fd220 con 0x7f9c30074110 2024-09-17T05:28:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.563+0000 7f9c23e00640 1 -- 172.21.15.31:0/13899156 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9c28003a70 con 0x7f9c30074110 2024-09-17T05:28:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.563+0000 7f9c23e00640 1 -- 172.21.15.31:0/13899156 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9c28004420 con 0x7f9c30074110 2024-09-17T05:28:20.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.567+0000 7f9c37200640 1 -- 172.21.15.31:0/13899156 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c3015b0f0 con 0x7f9c30074110 2024-09-17T05:28:20.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.567+0000 7ff5f2000640 1 -- 172.21.15.31:0/651991020 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff5e8022070 con 0x7ff5f4039cd0 2024-09-17T05:28:20.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.567+0000 7f53eea00640 1 -- 172.21.15.31:0/1421700722 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f53e8156cd0 con 0x7f53e806ede0 2024-09-17T05:28:20.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.567+0000 7f9c23e00640 1 -- 172.21.15.31:0/13899156 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9c28022070 con 0x7f9c30074110 2024-09-17T05:28:20.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.575+0000 7fd5c7200640 1 -- 172.21.15.31:0/2543114992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5c00741c0 msgr2=0x7fd5c00cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.575+0000 7fd5c7200640 1 --2- 172.21.15.31:0/2543114992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5c00741c0 0x7fd5c00cf350 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac009840 tx=0x7fd5ac01c820 comp rx=0 tx=0).stop 2024-09-17T05:28:20.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.575+0000 7fd5c7200640 1 -- 172.21.15.31:0/2543114992 shutdown_connections 2024-09-17T05:28:20.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.575+0000 7fd5c7200640 1 --2- 172.21.15.31:0/2543114992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5c00741c0 0x7fd5c00cf350 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.575+0000 7fd5c7200640 1 -- 172.21.15.31:0/2543114992 >> 172.21.15.31:0/2543114992 conn(0x7fd5c00cfde0 msgr2=0x7fd5c00d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.575+0000 7fd5c7200640 1 -- 172.21.15.31:0/2543114992 shutdown_connections 2024-09-17T05:28:20.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.575+0000 7fd5c7200640 1 -- 172.21.15.31:0/2543114992 wait complete. 2024-09-17T05:28:20.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.579+0000 7fd5c7200640 1 Processor -- start 2024-09-17T05:28:20.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.579+0000 7fd5c7200640 1 -- start start 2024-09-17T05:28:20.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.579+0000 7fd5c7200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5c00741c0 0x7fd5c00b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.579+0000 7fd5c7200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c015aa40 0x7fd5c0150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.579+0000 7fd5c7200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5c015ae20 0x7fd5c014ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.579+0000 7fd5c7200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c00ce870 con 0x7fd5c015aa40 2024-09-17T05:28:20.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.579+0000 7fd5c7200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c00ce6f0 con 0x7fd5c00741c0 2024-09-17T05:28:20.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.579+0000 7fd5c7200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd5c00ce9f0 con 0x7fd5c015ae20 2024-09-17T05:28:20.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.583+0000 7fd5bea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c015aa40 0x7fd5c0150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.583+0000 7fd5bfe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5c015ae20 0x7fd5c014ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.583+0000 7fd5bfe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5c015ae20 0x7fd5c014ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:53936/0 (socket says 172.21.15.31:53936) 2024-09-17T05:28:20.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.583+0000 7fd5bfe00640 1 -- 172.21.15.31:0/3002114944 learned_addr learned my addr 172.21.15.31:0/3002114944 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:20.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.583+0000 7fd5bfe00640 1 -- 172.21.15.31:0/3002114944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5c00741c0 msgr2=0x7fd5c00b5080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:28:20.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.583+0000 7fd5bfe00640 1 --2- 172.21.15.31:0/3002114944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5c00741c0 0x7fd5c00b5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.583+0000 7fd5bfe00640 1 -- 172.21.15.31:0/3002114944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c015aa40 msgr2=0x7fd5c0150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.583+0000 7fd5bfe00640 1 --2- 172.21.15.31:0/3002114944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c015aa40 0x7fd5c0150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.583+0000 7fd5bfe00640 1 -- 172.21.15.31:0/3002114944 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c00c9090 con 0x7fd5c015ae20 2024-09-17T05:28:20.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.583+0000 7fd5bfe00640 1 --2- 172.21.15.31:0/3002114944 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5c015ae20 0x7fd5c014ed10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd5b401caa0 tx=0x7fd5b401cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:20.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.583+0000 7f53dfe00640 1 -- 172.21.15.31:0/1421700722 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f53e0016790 con 0x7f53e806ede0 2024-09-17T05:28:20.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.583+0000 7fd5b3e00640 1 -- 172.21.15.31:0/3002114944 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b402a070 con 0x7fd5c015ae20 2024-09-17T05:28:20.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.587+0000 7fd5b3e00640 1 -- 172.21.15.31:0/3002114944 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5b401dca0 con 0x7fd5c015ae20 2024-09-17T05:28:20.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.587+0000 7fd5b3e00640 1 -- 172.21.15.31:0/3002114944 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b40256a0 con 0x7fd5c015ae20 2024-09-17T05:28:20.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.587+0000 7fd5c7200640 1 -- 172.21.15.31:0/3002114944 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c00c9370 con 0x7fd5c015ae20 2024-09-17T05:28:20.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.587+0000 7fd5c7200640 1 -- 172.21.15.31:0/3002114944 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c00b2fe0 con 0x7fd5c015ae20 2024-09-17T05:28:20.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.587+0000 7fd5b3e00640 1 -- 172.21.15.31:0/3002114944 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd5b402d070 con 0x7fd5c015ae20 2024-09-17T05:28:20.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.587+0000 7fd5b3e00640 1 -- 172.21.15.31:0/3002114944 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd5b402fcb0 con 0x7fd5c015ae20 2024-09-17T05:28:20.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.587+0000 7fd5c7200640 1 -- 172.21.15.31:0/3002114944 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5c0073ab0 con 0x7fd5c015ae20 2024-09-17T05:28:20.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.587+0000 7f53eea00640 1 -- 172.21.15.31:0/1421700722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53e806ede0 msgr2=0x7f53e815f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.587+0000 7f53eea00640 1 --2- 172.21.15.31:0/1421700722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53e806ede0 0x7f53e815f420 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f53e00ac000 tx=0x7f53e00050d0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.595+0000 7f53eea00640 1 -- 172.21.15.31:0/1421700722 shutdown_connections 2024-09-17T05:28:20.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.595+0000 7f53eea00640 1 --2- 172.21.15.31:0/1421700722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53e8161b20 0x7f53e80739f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.595+0000 7f53eea00640 1 --2- 172.21.15.31:0/1421700722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53e806ede0 0x7f53e815f420 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.595+0000 7f53eea00640 1 --2- 172.21.15.31:0/1421700722 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53e806ea00 0x7f53e814e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.595+0000 7f53eea00640 1 -- 172.21.15.31:0/1421700722 >> 172.21.15.31:0/1421700722 conn(0x7f53e80b18f0 msgr2=0x7f53e816ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.595+0000 7f53eea00640 1 -- 172.21.15.31:0/1421700722 shutdown_connections 2024-09-17T05:28:20.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.595+0000 7f6451000640 1 -- 172.21.15.31:0/2304552410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f644c0cac60 msgr2=0x7f644c06e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.595+0000 7f6451000640 1 --2- 172.21.15.31:0/2304552410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f644c0cac60 0x7f644c06e650 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6444009bc0 tx=0x7f644401cb30 comp rx=0 tx=0).stop 2024-09-17T05:28:20.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.595+0000 7fd5b3e00640 1 -- 172.21.15.31:0/3002114944 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd5b402f440 con 0x7fd5c015ae20 2024-09-17T05:28:20.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.595+0000 7f53eea00640 1 -- 172.21.15.31:0/1421700722 wait complete. 2024-09-17T05:28:20.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.595+0000 7f6451000640 1 -- 172.21.15.31:0/2304552410 shutdown_connections 2024-09-17T05:28:20.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.595+0000 7f6451000640 1 --2- 172.21.15.31:0/2304552410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f644c0cac60 0x7f644c06e650 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6444009bc0 tx=0x7f644401cb30 comp rx=0 tx=0).stop 2024-09-17T05:28:20.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.595+0000 7f6451000640 1 -- 172.21.15.31:0/2304552410 >> 172.21.15.31:0/2304552410 conn(0x7f644c0cfa00 msgr2=0x7f644c0cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.595+0000 7f6451000640 1 -- 172.21.15.31:0/2304552410 shutdown_connections 2024-09-17T05:28:20.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.595+0000 7f6451000640 1 -- 172.21.15.31:0/2304552410 wait complete. 2024-09-17T05:28:20.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.599+0000 7f6451000640 1 Processor -- start 2024-09-17T05:28:20.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f6451000640 1 -- start start 2024-09-17T05:28:20.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f6451000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f644c072610 0x7f644c14ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f6451000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f644c0aecb0 0x7f644c15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f6451000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f644c0b2890 0x7f644c15da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f6451000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f644c15ce90 con 0x7f644c0aecb0 2024-09-17T05:28:20.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f6451000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f644c0ca970 con 0x7f644c072610 2024-09-17T05:28:20.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f6451000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f644c15d010 con 0x7f644c0b2890 2024-09-17T05:28:20.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f644be00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f644c0b2890 0x7f644c15da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f644b400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f644c072610 0x7f644c14ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f644be00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f644c0b2890 0x7f644c15da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:53944/0 (socket says 172.21.15.31:53944) 2024-09-17T05:28:20.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f644be00640 1 -- 172.21.15.31:0/2161601957 learned_addr learned my addr 172.21.15.31:0/2161601957 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:20.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f644aa00640 1 --2- 172.21.15.31:0/2161601957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f644c0aecb0 0x7f644c15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f644be00640 1 -- 172.21.15.31:0/2161601957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f644c072610 msgr2=0x7f644c14ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f644be00640 1 --2- 172.21.15.31:0/2161601957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f644c072610 0x7f644c14ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f644be00640 1 -- 172.21.15.31:0/2161601957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f644c0aecb0 msgr2=0x7f644c15d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f644be00640 1 --2- 172.21.15.31:0/2161601957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f644c0aecb0 0x7f644c15d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f644be00640 1 -- 172.21.15.31:0/2161601957 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c1522f0 con 0x7f644c0b2890 2024-09-17T05:28:20.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f644aa00640 1 --2- 172.21.15.31:0/2161601957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f644c0aecb0 0x7f644c15d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:28:20.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.603+0000 7f644be00640 1 --2- 172.21.15.31:0/2161601957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f644c0b2890 0x7f644c15da30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f643800c400 tx=0x7f643800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:20.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.607+0000 7f6443400640 1 -- 172.21.15.31:0/2161601957 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438011790 con 0x7f644c0b2890 2024-09-17T05:28:20.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.607+0000 7f6443400640 1 -- 172.21.15.31:0/2161601957 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6438017070 con 0x7f644c0b2890 2024-09-17T05:28:20.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.607+0000 7f6443400640 1 -- 172.21.15.31:0/2161601957 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438011cc0 con 0x7f644c0b2890 2024-09-17T05:28:20.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.611+0000 7f6451000640 1 -- 172.21.15.31:0/2161601957 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644c0b43d0 con 0x7f644c0b2890 2024-09-17T05:28:20.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.611+0000 7f6451000640 1 -- 172.21.15.31:0/2161601957 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f644c15fc80 con 0x7f644c0b2890 2024-09-17T05:28:20.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.615+0000 7f6443400640 1 -- 172.21.15.31:0/2161601957 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f643801c460 con 0x7f644c0b2890 2024-09-17T05:28:20.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.615+0000 7f6443400640 1 -- 172.21.15.31:0/2161601957 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6438012810 con 0x7f644c0b2890 2024-09-17T05:28:20.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.615+0000 7f6451000640 1 -- 172.21.15.31:0/2161601957 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f644c06ed00 con 0x7f644c0b2890 2024-09-17T05:28:20.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.619+0000 7f6443400640 1 -- 172.21.15.31:0/2161601957 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6438011e60 con 0x7f644c0b2890 2024-09-17T05:28:20.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.631+0000 7f92e4c00640 1 -- 172.21.15.31:0/2819654305 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f92f006f1d0 con 0x7f92f00b12c0 2024-09-17T05:28:20.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.651+0000 7fdb55400640 1 -- 172.21.15.31:0/2076633502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb34003a60 msgr2=0x7fdb34003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.651+0000 7fdb55400640 1 --2- 172.21.15.31:0/2076633502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb34003a60 0x7fdb34003e80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009c20 tx=0x7fdb4001d390 comp rx=0 tx=0).stop 2024-09-17T05:28:20.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.651+0000 7fdb55400640 1 -- 172.21.15.31:0/2076633502 shutdown_connections 2024-09-17T05:28:20.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.651+0000 7fdb55400640 1 --2- 172.21.15.31:0/2076633502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb34003a60 0x7fdb34003e80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.651+0000 7fdb55400640 1 -- 172.21.15.31:0/2076633502 >> 172.21.15.31:0/2076633502 conn(0x7fdb500cfa00 msgr2=0x7fdb500cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.651+0000 7fdb55400640 1 -- 172.21.15.31:0/2076633502 shutdown_connections 2024-09-17T05:28:20.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.651+0000 7fdb55400640 1 -- 172.21.15.31:0/2076633502 wait complete. 2024-09-17T05:28:20.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.655+0000 7fdb55400640 1 Processor -- start 2024-09-17T05:28:20.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.659+0000 7f92e7400640 1 -- 172.21.15.31:0/2819654305 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7f92e80166d0 con 0x7f92f00b12c0 2024-09-17T05:28:20.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.663+0000 7f92e4c00640 1 -- 172.21.15.31:0/2819654305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92f00b12c0 msgr2=0x7f92f015cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.663+0000 7f92e4c00640 1 --2- 172.21.15.31:0/2819654305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92f00b12c0 0x7f92f015cf30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f92e801b100 tx=0x7f92e80a5990 comp rx=0 tx=0).stop 2024-09-17T05:28:20.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.663+0000 7f92e4c00640 1 -- 172.21.15.31:0/2819654305 shutdown_connections 2024-09-17T05:28:20.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.663+0000 7f92e4c00640 1 --2- 172.21.15.31:0/2819654305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92f0162200 0x7f92f00b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.663+0000 7f92e4c00640 1 --2- 172.21.15.31:0/2819654305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f92f00b5880 0x7f92f00caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.663+0000 7f92e4c00640 1 --2- 172.21.15.31:0/2819654305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92f00b12c0 0x7f92f015cf30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.663+0000 7f92e4c00640 1 -- 172.21.15.31:0/2819654305 >> 172.21.15.31:0/2819654305 conn(0x7f92f00d0880 msgr2=0x7f92f00b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.659+0000 7fdb55400640 1 -- start start 2024-09-17T05:28:20.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.659+0000 7fdb55400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb34003a60 0x7fdb501f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.659+0000 7fdb55400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb500c5cd0 0x7fdb501efdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.659+0000 7fdb55400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb500ce340 0x7fdb500ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.659+0000 7fdb55400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdb500cf430 con 0x7fdb500ce340 2024-09-17T05:28:20.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.659+0000 7fdb55400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdb500cdc80 con 0x7fdb500c5cd0 2024-09-17T05:28:20.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.659+0000 7fdb55400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdb500cf5b0 con 0x7fdb34003a60 2024-09-17T05:28:20.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.659+0000 7fdb54a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb500ce340 0x7fdb500ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.659+0000 7fdb54a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb500ce340 0x7fdb500ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44166/0 (socket says 172.21.15.31:44166) 2024-09-17T05:28:20.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.659+0000 7fdb54a00640 1 -- 172.21.15.31:0/3969622525 learned_addr learned my addr 172.21.15.31:0/3969622525 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:20.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.659+0000 7fdb54a00640 1 -- 172.21.15.31:0/3969622525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb34003a60 msgr2=0x7fdb501f4560 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:28:20.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.659+0000 7fdb54a00640 1 --2- 172.21.15.31:0/3969622525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb34003a60 0x7fdb501f4560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.659+0000 7fdb54a00640 1 -- 172.21.15.31:0/3969622525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb500c5cd0 msgr2=0x7fdb501efdb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:28:20.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.659+0000 7fdb54a00640 1 --2- 172.21.15.31:0/3969622525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb500c5cd0 0x7fdb501efdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.659+0000 7fdb54a00640 1 -- 172.21.15.31:0/3969622525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb501f1480 con 0x7fdb500ce340 2024-09-17T05:28:20.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.663+0000 7fdb54a00640 1 --2- 172.21.15.31:0/3969622525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb500ce340 0x7fdb500ce7f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdb50072250 tx=0x7fdb4800fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:20.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.663+0000 7fdb47e00640 1 -- 172.21.15.31:0/3969622525 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48003d90 con 0x7fdb500ce340 2024-09-17T05:28:20.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.663+0000 7fdb47e00640 1 -- 172.21.15.31:0/3969622525 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb48018070 con 0x7fdb500ce340 2024-09-17T05:28:20.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.663+0000 7fdb47e00640 1 -- 172.21.15.31:0/3969622525 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48014a20 con 0x7fdb500ce340 2024-09-17T05:28:20.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.663+0000 7fdb55400640 1 -- 172.21.15.31:0/3969622525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb501f06c0 con 0x7fdb500ce340 2024-09-17T05:28:20.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.663+0000 7fdb55400640 1 -- 172.21.15.31:0/3969622525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb501f0c80 con 0x7fdb500ce340 2024-09-17T05:28:20.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.663+0000 7fdb47e00640 1 -- 172.21.15.31:0/3969622525 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdb4800c070 con 0x7fdb500ce340 2024-09-17T05:28:20.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.663+0000 7fdb47e00640 1 -- 172.21.15.31:0/3969622525 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdb48004570 con 0x7fdb500ce340 2024-09-17T05:28:20.672 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi031') 2024-09-17T05:28:20.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.667+0000 7f92e4c00640 1 -- 172.21.15.31:0/2819654305 shutdown_connections 2024-09-17T05:28:20.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.667+0000 7f92e4c00640 1 -- 172.21.15.31:0/2819654305 wait complete. 2024-09-17T05:28:20.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.667+0000 7fdb45600640 1 -- 172.21.15.31:0/3969622525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb50073e80 con 0x7fdb500ce340 2024-09-17T05:28:20.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.671+0000 7fdb47e00640 1 -- 172.21.15.31:0/3969622525 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fdb48023020 con 0x7fdb500ce340 2024-09-17T05:28:20.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.679+0000 7f3fa7200640 1 -- 172.21.15.31:0/558355307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa8074540 msgr2=0x7f3fa80ca050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.679+0000 7f3fa7200640 1 --2- 172.21.15.31:0/558355307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa8074540 0x7f3fa80ca050 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009c80 tx=0x7f3fa001cd90 comp rx=0 tx=0).stop 2024-09-17T05:28:20.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.679+0000 7f3fa7200640 1 -- 172.21.15.31:0/558355307 shutdown_connections 2024-09-17T05:28:20.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.679+0000 7f3fa7200640 1 --2- 172.21.15.31:0/558355307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa8074540 0x7f3fa80ca050 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.679+0000 7f3fa7200640 1 --2- 172.21.15.31:0/558355307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa815e300 0x7f3fa80cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.679+0000 7f3fa7200640 1 -- 172.21.15.31:0/558355307 >> 172.21.15.31:0/558355307 conn(0x7f3fa80cfa00 msgr2=0x7f3fa80cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.679+0000 7f3fa7200640 1 -- 172.21.15.31:0/558355307 shutdown_connections 2024-09-17T05:28:20.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.679+0000 7f3fa7200640 1 -- 172.21.15.31:0/558355307 wait complete. 2024-09-17T05:28:20.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.683+0000 7f3fa7200640 1 Processor -- start 2024-09-17T05:28:20.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.683+0000 7f3fa7200640 1 -- start start 2024-09-17T05:28:20.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.683+0000 7f3fa7200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa8074540 0x7f3fa80c2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.683+0000 7f3fa7200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa80cd5d0 0x7f3fa80c19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.683+0000 7f3fa5e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa8074540 0x7f3fa80c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.683+0000 7f3fa7200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa815e300 0x7f3fa80c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.683+0000 7f3fa5e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa8074540 0x7f3fa80c2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:53968/0 (socket says 172.21.15.31:53968) 2024-09-17T05:28:20.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.683+0000 7f3fa5e00640 1 -- 172.21.15.31:0/287399987 learned_addr learned my addr 172.21.15.31:0/287399987 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:20.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.683+0000 7f3fa7200640 1 -- 172.21.15.31:0/287399987 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa81662a0 con 0x7f3fa80cd5d0 2024-09-17T05:28:20.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.683+0000 7f3fa7200640 1 -- 172.21.15.31:0/287399987 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa8166120 con 0x7f3fa815e300 2024-09-17T05:28:20.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.683+0000 7f3fa7200640 1 -- 172.21.15.31:0/287399987 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa8166420 con 0x7f3fa8074540 2024-09-17T05:28:20.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.683+0000 7f3fa6800640 1 --2- 172.21.15.31:0/287399987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa815e300 0x7f3fa80c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.683+0000 7f3fa5e00640 1 -- 172.21.15.31:0/287399987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa815e300 msgr2=0x7f3fa80c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.683+0000 7f3fa5e00640 1 --2- 172.21.15.31:0/287399987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa815e300 0x7f3fa80c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.683+0000 7f3fa5e00640 1 -- 172.21.15.31:0/287399987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa80cd5d0 msgr2=0x7f3fa80c19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.683+0000 7f3fa5e00640 1 --2- 172.21.15.31:0/287399987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa80cd5d0 0x7f3fa80c19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.683+0000 7f9f06a00640 1 -- 172.21.15.31:0/1074503272 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f9f000cbcd0 con 0x7f9f0015f890 2024-09-17T05:28:20.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.683+0000 7f3fa5e00640 1 -- 172.21.15.31:0/287399987 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa806e700 con 0x7f3fa8074540 2024-09-17T05:28:20.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.687+0000 7f3fa5e00640 1 --2- 172.21.15.31:0/287399987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa8074540 0x7f3fa80c2530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3f980058d0 tx=0x7f3f9800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:20.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.687+0000 7f3f9e000640 1 -- 172.21.15.31:0/287399987 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98017070 con 0x7f3fa8074540 2024-09-17T05:28:20.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.687+0000 7f3f9e000640 1 -- 172.21.15.31:0/287399987 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f98009d20 con 0x7f3fa8074540 2024-09-17T05:28:20.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.687+0000 7f3f9e000640 1 -- 172.21.15.31:0/287399987 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f980106c0 con 0x7f3fa8074540 2024-09-17T05:28:20.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.687+0000 7f3fa7200640 1 -- 172.21.15.31:0/287399987 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa80cef70 con 0x7f3fa8074540 2024-09-17T05:28:20.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.687+0000 7f3fa7200640 1 -- 172.21.15.31:0/287399987 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa80afcc0 con 0x7f3fa8074540 2024-09-17T05:28:20.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.691+0000 7fae19000640 1 -- 172.21.15.31:0/1008135979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fae140b3b60 con 0x7fae14072610 2024-09-17T05:28:20.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.687+0000 7f3f9e000640 1 -- 172.21.15.31:0/287399987 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3f9801a070 con 0x7f3fa8074540 2024-09-17T05:28:20.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.687+0000 7f3f9e000640 1 -- 172.21.15.31:0/287399987 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3f9801cb40 con 0x7f3fa8074540 2024-09-17T05:28:20.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.691+0000 7f3fa7200640 1 -- 172.21.15.31:0/287399987 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa80ca050 con 0x7f3fa8074540 2024-09-17T05:28:20.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.691+0000 7f3f9e000640 1 -- 172.21.15.31:0/287399987 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3f98010860 con 0x7f3fa8074540 2024-09-17T05:28:20.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.699+0000 7f9ef7e00640 1 -- 172.21.15.31:0/1074503272 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f9ef0006fe0 con 0x7f9f0015f890 2024-09-17T05:28:20.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.703+0000 7f5a23e00640 1 -- 172.21.15.31:0/3912952039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a240cd5d0 msgr2=0x7f5a240ca050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.703+0000 7f5a23e00640 1 --2- 172.21.15.31:0/3912952039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a240cd5d0 0x7f5a240ca050 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009900 tx=0x7f5a1401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.703+0000 7f9f06a00640 1 -- 172.21.15.31:0/1074503272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f0015f890 msgr2=0x7f9f0015b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.703+0000 7f9f06a00640 1 --2- 172.21.15.31:0/1074503272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f0015f890 0x7f9f0015b310 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9ef000c360 tx=0x7f9ef000c820 comp rx=0 tx=0).stop 2024-09-17T05:28:20.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.703+0000 7f5a23e00640 1 -- 172.21.15.31:0/3912952039 shutdown_connections 2024-09-17T05:28:20.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.707+0000 7f9f06a00640 1 -- 172.21.15.31:0/1074503272 shutdown_connections 2024-09-17T05:28:20.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.707+0000 7f9f06a00640 1 --2- 172.21.15.31:0/1074503272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f00160380 0x7f9f000b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.707+0000 7f9f06a00640 1 --2- 172.21.15.31:0/1074503272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f0015f890 0x7f9f0015b310 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.707+0000 7f9f06a00640 1 --2- 172.21.15.31:0/1074503272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f000cc170 0x7f9f00143530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.707+0000 7f9f06a00640 1 -- 172.21.15.31:0/1074503272 >> 172.21.15.31:0/1074503272 conn(0x7f9f000b18f0 msgr2=0x7f9f000af8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.707+0000 7f5a23e00640 1 --2- 172.21.15.31:0/3912952039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a240cd5d0 0x7f5a240ca050 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.707+0000 7f5a23e00640 1 -- 172.21.15.31:0/3912952039 >> 172.21.15.31:0/3912952039 conn(0x7f5a240cfa00 msgr2=0x7f5a240cfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.707+0000 7f9f06a00640 1 -- 172.21.15.31:0/1074503272 shutdown_connections 2024-09-17T05:28:20.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.707+0000 7f9f06a00640 1 -- 172.21.15.31:0/1074503272 wait complete. 2024-09-17T05:28:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.707+0000 7f5a23e00640 1 -- 172.21.15.31:0/3912952039 shutdown_connections 2024-09-17T05:28:20.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.707+0000 7f5a23e00640 1 -- 172.21.15.31:0/3912952039 wait complete. 2024-09-17T05:28:20.717 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi031') 2024-09-17T05:28:20.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.711+0000 7f5a23e00640 1 Processor -- start 2024-09-17T05:28:20.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.715+0000 7fae0b400640 1 -- 172.21.15.31:0/1008135979 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v11)=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7fadfc012c60 con 0x7fae14072610 2024-09-17T05:28:20.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7fae19000640 1 -- 172.21.15.31:0/1008135979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae14072610 msgr2=0x7fae1406f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7fae19000640 1 --2- 172.21.15.31:0/1008135979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae14072610 0x7fae1406f5e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00c3e0 tx=0x7fadfc00c8a0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7fae19000640 1 -- 172.21.15.31:0/1008135979 shutdown_connections 2024-09-17T05:28:20.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7fae19000640 1 --2- 172.21.15.31:0/1008135979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae140cac60 0x7fae140a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7fae19000640 1 --2- 172.21.15.31:0/1008135979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae140aecb0 0x7fae14204f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7fae19000640 1 --2- 172.21.15.31:0/1008135979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae14072610 0x7fae1406f5e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7fae19000640 1 -- 172.21.15.31:0/1008135979 >> 172.21.15.31:0/1008135979 conn(0x7fae140cfa00 msgr2=0x7fae140b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7fae19000640 1 -- 172.21.15.31:0/1008135979 shutdown_connections 2024-09-17T05:28:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7fae19000640 1 -- 172.21.15.31:0/1008135979 wait complete. 2024-09-17T05:28:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.711+0000 7f5a23e00640 1 -- start start 2024-09-17T05:28:20.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7f5a23e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a240ae4d0 0x7f5a240b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7f5a23e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a240cd5d0 0x7f5a2414be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7f5a23e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2415eeb0 0x7f5a2416b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:20.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7f5a23e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5a241705c0 con 0x7f5a240cd5d0 2024-09-17T05:28:20.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7f5a23e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5a24170440 con 0x7f5a240ae4d0 2024-09-17T05:28:20.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7f5a23e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5a24170740 con 0x7f5a2415eeb0 2024-09-17T05:28:20.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7f5a22000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a240cd5d0 0x7f5a2414be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7f5a22000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a240cd5d0 0x7f5a2414be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44192/0 (socket says 172.21.15.31:44192) 2024-09-17T05:28:20.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7f5a22000640 1 -- 172.21.15.31:0/743121528 learned_addr learned my addr 172.21.15.31:0/743121528 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:20.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7f5a23400640 1 --2- 172.21.15.31:0/743121528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2415eeb0 0x7f5a2416b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7f5a22a00640 1 --2- 172.21.15.31:0/743121528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a240ae4d0 0x7f5a240b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:20.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7f5a22a00640 1 -- 172.21.15.31:0/743121528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2415eeb0 msgr2=0x7f5a2416b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7f5a22a00640 1 --2- 172.21.15.31:0/743121528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2415eeb0 0x7f5a2416b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7f5a22a00640 1 -- 172.21.15.31:0/743121528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a240cd5d0 msgr2=0x7f5a2414be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7f5a22a00640 1 --2- 172.21.15.31:0/743121528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a240cd5d0 0x7f5a2414be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7f5a22a00640 1 -- 172.21.15.31:0/743121528 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a240b3df0 con 0x7f5a240ae4d0 2024-09-17T05:28:20.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.719+0000 7f5a22a00640 1 --2- 172.21.15.31:0/743121528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a240ae4d0 0x7f5a240b32c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a140ac000 tx=0x7f5a14004220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:20.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.723+0000 7f5a1aa00640 1 -- 172.21.15.31:0/743121528 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a140b2070 con 0x7f5a240ae4d0 2024-09-17T05:28:20.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.723+0000 7f5a1aa00640 1 -- 172.21.15.31:0/743121528 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a14005110 con 0x7f5a240ae4d0 2024-09-17T05:28:20.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.723+0000 7f5a1aa00640 1 -- 172.21.15.31:0/743121528 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a14005360 con 0x7f5a240ae4d0 2024-09-17T05:28:20.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.723+0000 7f5a23e00640 1 -- 172.21.15.31:0/743121528 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a2414fc20 con 0x7f5a240ae4d0 2024-09-17T05:28:20.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.723+0000 7f5a23e00640 1 -- 172.21.15.31:0/743121528 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a24153fc0 con 0x7f5a240ae4d0 2024-09-17T05:28:20.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.723+0000 7f5a1aa00640 1 -- 172.21.15.31:0/743121528 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5a140c0030 con 0x7f5a240ae4d0 2024-09-17T05:28:20.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.723+0000 7f5a1aa00640 1 -- 172.21.15.31:0/743121528 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5a14003940 con 0x7f5a240ae4d0 2024-09-17T05:28:20.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.731+0000 7f5a23e00640 1 -- 172.21.15.31:0/743121528 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a240cba00 con 0x7f5a240ae4d0 2024-09-17T05:28:20.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.735+0000 7f5a1aa00640 1 -- 172.21.15.31:0/743121528 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5a140c7020 con 0x7f5a240ae4d0 2024-09-17T05:28:20.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.739+0000 7f9c37200640 1 -- 172.21.15.31:0/13899156 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f9c300d0710 con 0x7f9c30074110 2024-09-17T05:28:20.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.747+0000 7f9c23e00640 1 -- 172.21.15.31:0/13899156 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v12)=0 v12) ==== 121+0+0 (secure 0 0 0) 0x7f9c28004670 con 0x7f9c30074110 2024-09-17T05:28:20.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.751+0000 7f9c37200640 1 -- 172.21.15.31:0/13899156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c30074110 msgr2=0x7f9c30200480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.751+0000 7f9c37200640 1 --2- 172.21.15.31:0/13899156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c30074110 0x7f9c30200480 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800ba50 tx=0x7f9c2800bf10 comp rx=0 tx=0).stop 2024-09-17T05:28:20.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.751+0000 7f9c37200640 1 -- 172.21.15.31:0/13899156 shutdown_connections 2024-09-17T05:28:20.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.751+0000 7f9c37200640 1 --2- 172.21.15.31:0/13899156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c300ce800 0x7f9c300cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.751+0000 7f9c37200640 1 --2- 172.21.15.31:0/13899156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c30074110 0x7f9c30200480 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.751+0000 7f9c37200640 1 --2- 172.21.15.31:0/13899156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c3006ea00 0x7f9c3014a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.751+0000 7f9c37200640 1 -- 172.21.15.31:0/13899156 >> 172.21.15.31:0/13899156 conn(0x7f9c300cfa40 msgr2=0x7f9c3006f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.751+0000 7f9c37200640 1 -- 172.21.15.31:0/13899156 shutdown_connections 2024-09-17T05:28:20.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.751+0000 7f9c37200640 1 -- 172.21.15.31:0/13899156 wait complete. 2024-09-17T05:28:20.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.747+0000 7f1b89e00640 1 -- 172.21.15.31:0/3783130141 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f1b5c005590 con 0x7f1b8406e6e0 2024-09-17T05:28:20.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.759+0000 7f1b7b400640 1 -- 172.21.15.31:0/3783130141 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v13)=0 v13) ==== 125+0+0 (secure 0 0 0) 0x7f1b70020bf0 con 0x7f1b8406e6e0 2024-09-17T05:28:20.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.763+0000 7fd5c7200640 1 -- 172.21.15.31:0/3002114944 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fd5c015a820 con 0x7fd5c015ae20 2024-09-17T05:28:20.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.763+0000 7f6451000640 1 -- 172.21.15.31:0/2161601957 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f644c1557b0 con 0x7f644c0b2890 2024-09-17T05:28:20.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.767+0000 7f1b89e00640 1 -- 172.21.15.31:0/3783130141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b8406e6e0 msgr2=0x7f1b84151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.767+0000 7f1b89e00640 1 --2- 172.21.15.31:0/3783130141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b8406e6e0 0x7f1b84151820 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000b4a0 tx=0x7f1b7000b960 comp rx=0 tx=0).stop 2024-09-17T05:28:20.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.767+0000 7f1b89e00640 1 -- 172.21.15.31:0/3783130141 shutdown_connections 2024-09-17T05:28:20.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.767+0000 7f1b89e00640 1 --2- 172.21.15.31:0/3783130141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1b8415ed10 0x7f1b841504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.767+0000 7f1b89e00640 1 --2- 172.21.15.31:0/3783130141 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b8415e230 0x7f1b8414ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.767+0000 7f1b89e00640 1 --2- 172.21.15.31:0/3783130141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b8406e6e0 0x7f1b84151820 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.767+0000 7f1b89e00640 1 -- 172.21.15.31:0/3783130141 >> 172.21.15.31:0/3783130141 conn(0x7f1b840b1600 msgr2=0x7f1b840b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.767+0000 7f1b89e00640 1 -- 172.21.15.31:0/3783130141 shutdown_connections 2024-09-17T05:28:20.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.767+0000 7f1b89e00640 1 -- 172.21.15.31:0/3783130141 wait complete. 2024-09-17T05:28:20.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.775+0000 7fd5b3e00640 1 -- 172.21.15.31:0/3002114944 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v14)=0 v14) ==== 121+0+0 (secure 0 0 0) 0x7fd5b4025840 con 0x7fd5c015ae20 2024-09-17T05:28:20.782 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi031') 2024-09-17T05:28:20.782 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi031') 2024-09-17T05:28:20.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.779+0000 7fd5c7200640 1 -- 172.21.15.31:0/3002114944 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5c015ae20 msgr2=0x7fd5c014ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.779+0000 7fd5c7200640 1 --2- 172.21.15.31:0/3002114944 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5c015ae20 0x7fd5c014ed10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd5b401caa0 tx=0x7fd5b401cf60 comp rx=0 tx=0).stop 2024-09-17T05:28:20.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.779+0000 7fd5c7200640 1 -- 172.21.15.31:0/3002114944 shutdown_connections 2024-09-17T05:28:20.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.779+0000 7fd5c7200640 1 --2- 172.21.15.31:0/3002114944 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5c015ae20 0x7fd5c014ed10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.779+0000 7fd5c7200640 1 --2- 172.21.15.31:0/3002114944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c015aa40 0x7fd5c0150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.779+0000 7fd5c7200640 1 --2- 172.21.15.31:0/3002114944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5c00741c0 0x7fd5c00b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.779+0000 7fd5c7200640 1 -- 172.21.15.31:0/3002114944 >> 172.21.15.31:0/3002114944 conn(0x7fd5c00cfde0 msgr2=0x7fd5c00ca000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.779+0000 7fd5c7200640 1 -- 172.21.15.31:0/3002114944 shutdown_connections 2024-09-17T05:28:20.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.779+0000 7fd5c7200640 1 -- 172.21.15.31:0/3002114944 wait complete. 2024-09-17T05:28:20.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.779+0000 7f6443400640 1 -- 172.21.15.31:0/2161601957 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7f6438012a60 con 0x7f644c0b2890 2024-09-17T05:28:20.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.791+0000 7f6451000640 1 -- 172.21.15.31:0/2161601957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f644c0b2890 msgr2=0x7f644c15da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.791+0000 7f6451000640 1 --2- 172.21.15.31:0/2161601957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f644c0b2890 0x7f644c15da30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f643800c400 tx=0x7f643800c8c0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.791+0000 7f6451000640 1 -- 172.21.15.31:0/2161601957 shutdown_connections 2024-09-17T05:28:20.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.791+0000 7f6451000640 1 --2- 172.21.15.31:0/2161601957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f644c0b2890 0x7f644c15da30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.791+0000 7f6451000640 1 --2- 172.21.15.31:0/2161601957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f644c0aecb0 0x7f644c15d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.791+0000 7f6451000640 1 --2- 172.21.15.31:0/2161601957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f644c072610 0x7f644c14ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.791+0000 7f6451000640 1 -- 172.21.15.31:0/2161601957 >> 172.21.15.31:0/2161601957 conn(0x7f644c0cfa00 msgr2=0x7f644c06f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.791+0000 7f6451000640 1 -- 172.21.15.31:0/2161601957 shutdown_connections 2024-09-17T05:28:20.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.791+0000 7f6451000640 1 -- 172.21.15.31:0/2161601957 wait complete. 2024-09-17T05:28:20.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.799+0000 7ff601200640 1 -- 172.21.15.31:0/651991020 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7ff5d4005860 con 0x7ff5f4039cd0 2024-09-17T05:28:20.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.803+0000 7ff5f2000640 1 -- 172.21.15.31:0/651991020 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7ff5e80124e0 con 0x7ff5f4039cd0 2024-09-17T05:28:20.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.807+0000 7ff601200640 1 -- 172.21.15.31:0/651991020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5f4039cd0 msgr2=0x7ff5f41afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.807+0000 7ff601200640 1 --2- 172.21.15.31:0/651991020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5f4039cd0 0x7ff5f41afa70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800c430 tx=0x7ff5e800c8f0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.807+0000 7ff601200640 1 -- 172.21.15.31:0/651991020 shutdown_connections 2024-09-17T05:28:20.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.807+0000 7ff601200640 1 --2- 172.21.15.31:0/651991020 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5f4054e90 0x7ff5f4104320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.807+0000 7ff601200640 1 --2- 172.21.15.31:0/651991020 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5f4039cd0 0x7ff5f41afa70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.807+0000 7ff601200640 1 --2- 172.21.15.31:0/651991020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5f4035ff0 0x7ff5f40f81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.807+0000 7ff601200640 1 -- 172.21.15.31:0/651991020 >> 172.21.15.31:0/651991020 conn(0x7ff5f401d780 msgr2=0x7ff5f400a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.807+0000 7ff601200640 1 -- 172.21.15.31:0/651991020 shutdown_connections 2024-09-17T05:28:20.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.807+0000 7ff601200640 1 -- 172.21.15.31:0/651991020 wait complete. 2024-09-17T05:28:20.815 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi031') 2024-09-17T05:28:20.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.827+0000 7fdb45600640 1 -- 172.21.15.31:0/3969622525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fdb500d06a0 con 0x7fdb500ce340 2024-09-17T05:28:20.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.827+0000 7f3fa7200640 1 -- 172.21.15.31:0/287399987 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f3fa80d06a0 con 0x7f3fa8074540 2024-09-17T05:28:20.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.827+0000 7fdb47e00640 1 -- 172.21.15.31:0/3969622525 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v17)=0 v17) ==== 119+0+0 (secure 0 0 0) 0x7fdb48014c10 con 0x7fdb500ce340 2024-09-17T05:28:20.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.831+0000 7fdb45600640 1 -- 172.21.15.31:0/3969622525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb500ce340 msgr2=0x7fdb500ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.831+0000 7fdb45600640 1 --2- 172.21.15.31:0/3969622525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb500ce340 0x7fdb500ce7f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdb50072250 tx=0x7fdb4800fcd0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.831+0000 7fdb45600640 1 -- 172.21.15.31:0/3969622525 shutdown_connections 2024-09-17T05:28:20.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.831+0000 7fdb45600640 1 --2- 172.21.15.31:0/3969622525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb500ce340 0x7fdb500ce7f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.831+0000 7fdb45600640 1 --2- 172.21.15.31:0/3969622525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb500c5cd0 0x7fdb501efdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.831+0000 7fdb45600640 1 --2- 172.21.15.31:0/3969622525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb34003a60 0x7fdb501f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.831+0000 7fdb45600640 1 -- 172.21.15.31:0/3969622525 >> 172.21.15.31:0/3969622525 conn(0x7fdb500cfa00 msgr2=0x7fdb500cc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.831+0000 7fdb45600640 1 -- 172.21.15.31:0/3969622525 shutdown_connections 2024-09-17T05:28:20.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.831+0000 7fdb45600640 1 -- 172.21.15.31:0/3969622525 wait complete. 2024-09-17T05:28:20.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.835+0000 7f3f9e000640 1 -- 172.21.15.31:0/287399987 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v18)=0 v18) ==== 120+0+0 (secure 0 0 0) 0x7f3f98010860 con 0x7f3fa8074540 2024-09-17T05:28:20.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.835+0000 7f3fa7200640 1 -- 172.21.15.31:0/287399987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa8074540 msgr2=0x7f3fa80c2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.835+0000 7f3fa7200640 1 --2- 172.21.15.31:0/287399987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa8074540 0x7f3fa80c2530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3f980058d0 tx=0x7f3f9800dde0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.835+0000 7f3fa7200640 1 -- 172.21.15.31:0/287399987 shutdown_connections 2024-09-17T05:28:20.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.835+0000 7f3fa7200640 1 --2- 172.21.15.31:0/287399987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa815e300 0x7f3fa80c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.835+0000 7f3fa7200640 1 --2- 172.21.15.31:0/287399987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa80cd5d0 0x7f3fa80c19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.835+0000 7f3fa7200640 1 --2- 172.21.15.31:0/287399987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa8074540 0x7f3fa80c2530 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.835+0000 7f3fa7200640 1 -- 172.21.15.31:0/287399987 >> 172.21.15.31:0/287399987 conn(0x7f3fa80cfa00 msgr2=0x7f3fa80ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.835+0000 7f3fa7200640 1 -- 172.21.15.31:0/287399987 shutdown_connections 2024-09-17T05:28:20.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.835+0000 7f3fa7200640 1 -- 172.21.15.31:0/287399987 wait complete. 2024-09-17T05:28:20.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.851+0000 7f5a23e00640 1 -- 172.21.15.31:0/743121528 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f5a240d0630 con 0x7f5a240ae4d0 2024-09-17T05:28:20.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.855+0000 7f5a1aa00640 1 -- 172.21.15.31:0/743121528 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v19)=0 v19) ==== 120+0+0 (secure 0 0 0) 0x7f5a140c7020 con 0x7f5a240ae4d0 2024-09-17T05:28:20.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.855+0000 7f5a23e00640 1 -- 172.21.15.31:0/743121528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a240ae4d0 msgr2=0x7f5a240b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:20.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.855+0000 7f5a23e00640 1 --2- 172.21.15.31:0/743121528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a240ae4d0 0x7f5a240b32c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a140ac000 tx=0x7f5a14004220 comp rx=0 tx=0).stop 2024-09-17T05:28:20.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.855+0000 7f5a23e00640 1 -- 172.21.15.31:0/743121528 shutdown_connections 2024-09-17T05:28:20.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.855+0000 7f5a23e00640 1 --2- 172.21.15.31:0/743121528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a2415eeb0 0x7f5a2416b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.855+0000 7f5a23e00640 1 --2- 172.21.15.31:0/743121528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a240cd5d0 0x7f5a2414be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.855+0000 7f5a23e00640 1 --2- 172.21.15.31:0/743121528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a240ae4d0 0x7f5a240b32c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:20.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.855+0000 7f5a23e00640 1 -- 172.21.15.31:0/743121528 >> 172.21.15.31:0/743121528 conn(0x7f5a240cfa00 msgr2=0x7f5a241581f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:20.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.855+0000 7f5a23e00640 1 -- 172.21.15.31:0/743121528 shutdown_connections 2024-09-17T05:28:20.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:20.859+0000 7f5a23e00640 1 -- 172.21.15.31:0/743121528 wait complete. 2024-09-17T05:28:20.869 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi031') 2024-09-17T05:28:20.869 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi031') 2024-09-17T05:28:20.869 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi031') 2024-09-17T05:28:20.881 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi031') 2024-09-17T05:28:20.882 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi031') 2024-09-17T05:28:20.882 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi031') 2024-09-17T05:28:20.882 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T05:28:20.882 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T05:28:21.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.063+0000 7f3963400640 1 -- 172.21.15.31:0/34310574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f395c0d1990 msgr2=0x7f395c161340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:21.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.063+0000 7f3963400640 1 --2- 172.21.15.31:0/34310574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f395c0d1990 0x7f395c161340 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3944009900 tx=0x7f394401c790 comp rx=0 tx=0).stop 2024-09-17T05:28:21.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.063+0000 7f3963400640 1 -- 172.21.15.31:0/34310574 shutdown_connections 2024-09-17T05:28:21.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.063+0000 7f3963400640 1 --2- 172.21.15.31:0/34310574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f395c0d1990 0x7f395c161340 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:21.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.063+0000 7f3963400640 1 -- 172.21.15.31:0/34310574 >> 172.21.15.31:0/34310574 conn(0x7f395c0d1e90 msgr2=0x7f395c0d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:21.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3963400640 1 -- 172.21.15.31:0/34310574 shutdown_connections 2024-09-17T05:28:21.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3963400640 1 -- 172.21.15.31:0/34310574 wait complete. 2024-09-17T05:28:21.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3963400640 1 Processor -- start 2024-09-17T05:28:21.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3963400640 1 -- start start 2024-09-17T05:28:21.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3963400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f395c0ce970 0x7f395c159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:21.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3963400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f395c0ced50 0x7f395c15a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:21.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3963400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0d1990 0x7f395c14fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:21.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3963400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f395c16c7a0 con 0x7f395c0ce970 2024-09-17T05:28:21.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3963400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f395c16c920 con 0x7f395c0d1990 2024-09-17T05:28:21.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3963400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f395c16caa0 con 0x7f395c0ced50 2024-09-17T05:28:21.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3960a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f395c0ce970 0x7f395c159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:21.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3960a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f395c0ce970 0x7f395c159e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44206/0 (socket says 172.21.15.31:44206) 2024-09-17T05:28:21.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3960a00640 1 -- 172.21.15.31:0/1596636960 learned_addr learned my addr 172.21.15.31:0/1596636960 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:21.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3953e00640 1 --2- 172.21.15.31:0/1596636960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f395c0ced50 0x7f395c15a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3961400640 1 --2- 172.21.15.31:0/1596636960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0d1990 0x7f395c14fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3960a00640 1 -- 172.21.15.31:0/1596636960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f395c0ced50 msgr2=0x7f395c15a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3960a00640 1 --2- 172.21.15.31:0/1596636960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f395c0ced50 0x7f395c15a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3960a00640 1 -- 172.21.15.31:0/1596636960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0d1990 msgr2=0x7f395c14fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3960a00640 1 --2- 172.21.15.31:0/1596636960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0d1990 0x7f395c14fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.067+0000 7f3960a00640 1 -- 172.21.15.31:0/1596636960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395c15b100 con 0x7f395c0ce970 2024-09-17T05:28:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.071+0000 7f3960a00640 1 --2- 172.21.15.31:0/1596636960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f395c0ce970 0x7f395c159e60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f394c00c4b0 tx=0x7f394c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.071+0000 7f3959600640 1 -- 172.21.15.31:0/1596636960 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c0052d0 con 0x7f395c0ce970 2024-09-17T05:28:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.071+0000 7f3959600640 1 -- 172.21.15.31:0/1596636960 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f394c005470 con 0x7f395c0ce970 2024-09-17T05:28:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.071+0000 7f3959600640 1 -- 172.21.15.31:0/1596636960 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c012870 con 0x7f395c0ce970 2024-09-17T05:28:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.071+0000 7f3963400640 1 -- 172.21.15.31:0/1596636960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f395c159380 con 0x7f395c0ce970 2024-09-17T05:28:21.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.071+0000 7f3963400640 1 -- 172.21.15.31:0/1596636960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f395c15b3e0 con 0x7f395c0ce970 2024-09-17T05:28:21.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.071+0000 7f3959600640 1 -- 172.21.15.31:0/1596636960 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f394c012a10 con 0x7f395c0ce970 2024-09-17T05:28:21.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.071+0000 7f3959600640 1 -- 172.21.15.31:0/1596636960 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f394c01b900 con 0x7f395c0ce970 2024-09-17T05:28:21.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.071+0000 7f3963400640 1 -- 172.21.15.31:0/1596636960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f395c159770 con 0x7f395c0ce970 2024-09-17T05:28:21.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.071+0000 7f3959600640 1 -- 172.21.15.31:0/1596636960 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f394c01bb50 con 0x7f395c0ce970 2024-09-17T05:28:21.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.139+0000 7f3963400640 1 -- 172.21.15.31:0/1596636960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f395c159550 con 0x7f395c0ce970 2024-09-17T05:28:21.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.139+0000 7f3959600640 1 -- 172.21.15.31:0/1596636960 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f394c01bd30 con 0x7f395c0ce970 2024-09-17T05:28:21.145 INFO:teuthology.orchestra.run.smithi031.stderr:adjusted tunables profile to default 2024-09-17T05:28:21.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.143+0000 7f3963400640 1 -- 172.21.15.31:0/1596636960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f395c0ce970 msgr2=0x7f395c159e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:21.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.143+0000 7f3963400640 1 --2- 172.21.15.31:0/1596636960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f395c0ce970 0x7f395c159e60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f394c00c4b0 tx=0x7f394c00c970 comp rx=0 tx=0).stop 2024-09-17T05:28:21.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.143+0000 7f3963400640 1 -- 172.21.15.31:0/1596636960 shutdown_connections 2024-09-17T05:28:21.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.143+0000 7f3963400640 1 --2- 172.21.15.31:0/1596636960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f395c0d1990 0x7f395c14fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:21.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.143+0000 7f3963400640 1 --2- 172.21.15.31:0/1596636960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f395c0ced50 0x7f395c15a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:21.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.143+0000 7f3963400640 1 --2- 172.21.15.31:0/1596636960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f395c0ce970 0x7f395c159e60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:21.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.143+0000 7f3963400640 1 -- 172.21.15.31:0/1596636960 >> 172.21.15.31:0/1596636960 conn(0x7f395c0d1e90 msgr2=0x7f395c0b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:21.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.143+0000 7f3963400640 1 -- 172.21.15.31:0/1596636960 shutdown_connections 2024-09-17T05:28:21.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:21.143+0000 7f3963400640 1 -- 172.21.15.31:0/1596636960 wait complete. 2024-09-17T05:28:21.166 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T05:28:21.166 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T05:28:21.166 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:28:21.166 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T05:28:21.186 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:28:21.186 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T05:28:21.249 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:28:21.250 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T05:28:21.309 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:28:21.309 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T05:28:21.369 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:28:21.369 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T05:28:21.389 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:28:21.390 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T05:28:21.453 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:28:21.453 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-17T05:28:21.516 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:28:21.516 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-17T05:28:21.576 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new dd9b9452-0347-4305-a82b-47f49f7f4046 0 2024-09-17T05:28:21.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.756+0000 7ff321c00640 1 -- 172.21.15.155:0/882900616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff31c06eb10 msgr2=0x7ff31c0b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:21.759 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.756+0000 7ff321c00640 1 --2- 172.21.15.155:0/882900616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff31c06eb10 0x7ff31c0b3a40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff308009840 tx=0x7ff30801c5b0 comp rx=0 tx=0).stop 2024-09-17T05:28:21.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.756+0000 7ff321c00640 1 -- 172.21.15.155:0/882900616 shutdown_connections 2024-09-17T05:28:21.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.756+0000 7ff321c00640 1 --2- 172.21.15.155:0/882900616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff31c06eb10 0x7ff31c0b3a40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:21.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.756+0000 7ff321c00640 1 -- 172.21.15.155:0/882900616 >> 172.21.15.155:0/882900616 conn(0x7ff31c0b1ce0 msgr2=0x7ff31c0b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:21.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.756+0000 7ff321c00640 1 -- 172.21.15.155:0/882900616 shutdown_connections 2024-09-17T05:28:21.760 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.756+0000 7ff321c00640 1 -- 172.21.15.155:0/882900616 wait complete. 2024-09-17T05:28:21.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.756+0000 7ff321c00640 1 Processor -- start 2024-09-17T05:28:21.761 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.756+0000 7ff321c00640 1 -- start start 2024-09-17T05:28:21.762 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff321c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff31c06eb10 0x7ff31c1fc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:21.762 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff321c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff31c06ef30 0x7ff31c0af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:21.762 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff321c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff31c073d60 0x7ff31c14d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:21.762 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff321c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff31c169490 con 0x7ff31c06eb10 2024-09-17T05:28:21.762 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff321c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff31c169310 con 0x7ff31c06ef30 2024-09-17T05:28:21.762 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff321c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff31c169610 con 0x7ff31c073d60 2024-09-17T05:28:21.762 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff31a000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff31c06ef30 0x7ff31c0af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:21.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff31a000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff31c06ef30 0x7ff31c0af310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33236/0 (socket says 172.21.15.155:33236) 2024-09-17T05:28:21.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff31a000640 1 -- 172.21.15.155:0/1852892040 learned_addr learned my addr 172.21.15.155:0/1852892040 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-17T05:28:21.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff31b400640 1 --2- 172.21.15.155:0/1852892040 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff31c073d60 0x7ff31c14d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:21.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff31aa00640 1 --2- 172.21.15.155:0/1852892040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff31c06eb10 0x7ff31c1fc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:21.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff31a000640 1 -- 172.21.15.155:0/1852892040 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff31c073d60 msgr2=0x7ff31c14d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:21.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff31a000640 1 --2- 172.21.15.155:0/1852892040 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff31c073d60 0x7ff31c14d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:21.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff31a000640 1 -- 172.21.15.155:0/1852892040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff31c06eb10 msgr2=0x7ff31c1fc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:21.764 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff31a000640 1 --2- 172.21.15.155:0/1852892040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff31c06eb10 0x7ff31c1fc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:21.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff31a000640 1 -- 172.21.15.155:0/1852892040 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff31c1f85a0 con 0x7ff31c06ef30 2024-09-17T05:28:21.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff31aa00640 1 --2- 172.21.15.155:0/1852892040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff31c06eb10 0x7ff31c1fc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:28:21.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff31a000640 1 --2- 172.21.15.155:0/1852892040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff31c06ef30 0x7ff31c0af310 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff30801ac60 tx=0x7ff3080040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:21.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff312a00640 1 -- 172.21.15.155:0/1852892040 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3080aaab0 con 0x7ff31c06ef30 2024-09-17T05:28:21.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff312a00640 1 -- 172.21.15.155:0/1852892040 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3080b9070 con 0x7ff31c06ef30 2024-09-17T05:28:21.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff312a00640 1 -- 172.21.15.155:0/1852892040 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff308005050 con 0x7ff31c06ef30 2024-09-17T05:28:21.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff321c00640 1 -- 172.21.15.155:0/1852892040 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff31c1f8880 con 0x7ff31c06ef30 2024-09-17T05:28:21.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff321c00640 1 -- 172.21.15.155:0/1852892040 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff31c1f8e40 con 0x7ff31c06ef30 2024-09-17T05:28:21.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff312a00640 1 -- 172.21.15.155:0/1852892040 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff3080046d0 con 0x7ff31c06ef30 2024-09-17T05:28:21.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff312a00640 1 -- 172.21.15.155:0/1852892040 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7ff308003780 con 0x7ff31c06ef30 2024-09-17T05:28:21.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.760+0000 7ff321c00640 1 -- 172.21.15.155:0/1852892040 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff31c0b3a40 con 0x7ff31c06ef30 2024-09-17T05:28:21.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.764+0000 7ff312a00640 1 -- 172.21.15.155:0/1852892040 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff31c0b4390 con 0x7ff31c06ef30 2024-09-17T05:28:21.835 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.832+0000 7ff321c00640 1 -- 172.21.15.155:0/1852892040 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dd9b9452-0347-4305-a82b-47f49f7f4046", "id": 0} v 0) -- 0x7ff31c0b34d0 con 0x7ff31c06ef30 2024-09-17T05:28:21.839 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.836+0000 7ff312a00640 1 -- 172.21.15.155:0/1852892040 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dd9b9452-0347-4305-a82b-47f49f7f4046", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7ff308004b00 con 0x7ff31c06ef30 2024-09-17T05:28:21.839 INFO:teuthology.orchestra.run.smithi155.stdout:0 2024-09-17T05:28:21.840 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.836+0000 7ff321c00640 1 -- 172.21.15.155:0/1852892040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff31c06ef30 msgr2=0x7ff31c0af310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:21.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.836+0000 7ff321c00640 1 --2- 172.21.15.155:0/1852892040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff31c06ef30 0x7ff31c0af310 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff30801ac60 tx=0x7ff3080040c0 comp rx=0 tx=0).stop 2024-09-17T05:28:21.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.836+0000 7ff321c00640 1 -- 172.21.15.155:0/1852892040 shutdown_connections 2024-09-17T05:28:21.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.836+0000 7ff321c00640 1 --2- 172.21.15.155:0/1852892040 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff31c073d60 0x7ff31c14d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:21.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.836+0000 7ff321c00640 1 --2- 172.21.15.155:0/1852892040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff31c06ef30 0x7ff31c0af310 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:21.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.836+0000 7ff321c00640 1 --2- 172.21.15.155:0/1852892040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff31c06eb10 0x7ff31c1fc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:21.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.836+0000 7ff321c00640 1 -- 172.21.15.155:0/1852892040 >> 172.21.15.155:0/1852892040 conn(0x7ff31c0b1ce0 msgr2=0x7ff31c074140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:21.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.836+0000 7ff321c00640 1 -- 172.21.15.155:0/1852892040 shutdown_connections 2024-09-17T05:28:21.841 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:21.836+0000 7ff321c00640 1 -- 172.21.15.155:0/1852892040 wait complete. 2024-09-17T05:28:21.859 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new f364151a-36bb-43b4-b111-e20b1bae8aa1 1 2024-09-17T05:28:22.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.000+0000 7f47cb400640 1 -- 172.21.15.155:0/3074040547 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c406d330 msgr2=0x7f47c4151310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:22.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.000+0000 7f47cb400640 1 --2- 172.21.15.155:0/3074040547 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c406d330 0x7f47c4151310 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009bf0 tx=0x7f47bc01cb50 comp rx=0 tx=0).stop 2024-09-17T05:28:22.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.000+0000 7f47cb400640 1 -- 172.21.15.155:0/3074040547 shutdown_connections 2024-09-17T05:28:22.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.000+0000 7f47cb400640 1 --2- 172.21.15.155:0/3074040547 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c406d330 0x7f47c4151310 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.000+0000 7f47cb400640 1 -- 172.21.15.155:0/3074040547 >> 172.21.15.155:0/3074040547 conn(0x7f47c40d04f0 msgr2=0x7f47c40d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:22.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.000+0000 7f47cb400640 1 -- 172.21.15.155:0/3074040547 shutdown_connections 2024-09-17T05:28:22.004 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.000+0000 7f47cb400640 1 -- 172.21.15.155:0/3074040547 wait complete. 2024-09-17T05:28:22.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47cb400640 1 Processor -- start 2024-09-17T05:28:22.005 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47cb400640 1 -- start start 2024-09-17T05:28:22.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47cb400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47c406d330 0x7f47c40c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:22.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47cb400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47c40cc8c0 0x7f47c40c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:22.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47cb400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c415a960 0x7f47c40c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:22.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47cb400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f47c4074190 con 0x7f47c40cc8c0 2024-09-17T05:28:22.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47cb400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f47c4074010 con 0x7f47c406d330 2024-09-17T05:28:22.007 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47cb400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f47c4169310 con 0x7f47c415a960 2024-09-17T05:28:22.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47c8a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47c406d330 0x7f47c40c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:22.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47c9400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c415a960 0x7f47c40c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:22.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47c8a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47c406d330 0x7f47c40c4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33252/0 (socket says 172.21.15.155:33252) 2024-09-17T05:28:22.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47c8a00640 1 -- 172.21.15.155:0/1384853459 learned_addr learned my addr 172.21.15.155:0/1384853459 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-17T05:28:22.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47c3e00640 1 --2- 172.21.15.155:0/1384853459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47c40cc8c0 0x7f47c40c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:22.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47c8a00640 1 -- 172.21.15.155:0/1384853459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c415a960 msgr2=0x7f47c40c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:22.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47c8a00640 1 --2- 172.21.15.155:0/1384853459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c415a960 0x7f47c40c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47c8a00640 1 -- 172.21.15.155:0/1384853459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47c40cc8c0 msgr2=0x7f47c40c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:22.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47c8a00640 1 --2- 172.21.15.155:0/1384853459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47c40cc8c0 0x7f47c40c34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.008 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47c8a00640 1 -- 172.21.15.155:0/1384853459 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c40c4ff0 con 0x7f47c406d330 2024-09-17T05:28:22.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47c8a00640 1 --2- 172.21.15.155:0/1384853459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47c406d330 0x7f47c40c4a10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f47b800c400 tx=0x7f47b800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:22.009 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47c0c00640 1 -- 172.21.15.155:0/1384853459 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b8011790 con 0x7f47c406d330 2024-09-17T05:28:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47c0c00640 1 -- 172.21.15.155:0/1384853459 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47b8017070 con 0x7f47c406d330 2024-09-17T05:28:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47c0c00640 1 -- 172.21.15.155:0/1384853459 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b8011ce0 con 0x7f47c406d330 2024-09-17T05:28:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47cb400640 1 -- 172.21.15.155:0/1384853459 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c40c52d0 con 0x7f47c406d330 2024-09-17T05:28:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47cb400640 1 -- 172.21.15.155:0/1384853459 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c40c5890 con 0x7f47c406d330 2024-09-17T05:28:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47c0c00640 1 -- 172.21.15.155:0/1384853459 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f47b801c460 con 0x7f47c406d330 2024-09-17T05:28:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47c0c00640 1 -- 172.21.15.155:0/1384853459 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f47b8012830 con 0x7f47c406d330 2024-09-17T05:28:22.010 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.004+0000 7f47cb400640 1 -- 172.21.15.155:0/1384853459 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c4151310 con 0x7f47c406d330 2024-09-17T05:28:22.011 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.008+0000 7f47c0c00640 1 -- 172.21.15.155:0/1384853459 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f47b8011e80 con 0x7f47c406d330 2024-09-17T05:28:22.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.076+0000 7f47cb400640 1 -- 172.21.15.155:0/1384853459 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f364151a-36bb-43b4-b111-e20b1bae8aa1", "id": 1} v 0) -- 0x7f47c40afc60 con 0x7f47c406d330 2024-09-17T05:28:22.086 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.084+0000 7f47c0c00640 1 -- 172.21.15.155:0/1384853459 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f364151a-36bb-43b4-b111-e20b1bae8aa1", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f47b8012a30 con 0x7f47c406d330 2024-09-17T05:28:22.087 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-17T05:28:22.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.084+0000 7f47cb400640 1 -- 172.21.15.155:0/1384853459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47c406d330 msgr2=0x7f47c40c4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:22.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.084+0000 7f47cb400640 1 --2- 172.21.15.155:0/1384853459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47c406d330 0x7f47c40c4a10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f47b800c400 tx=0x7f47b800c8c0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.084+0000 7f47cb400640 1 -- 172.21.15.155:0/1384853459 shutdown_connections 2024-09-17T05:28:22.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.084+0000 7f47cb400640 1 --2- 172.21.15.155:0/1384853459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47c415a960 0x7f47c40c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.084+0000 7f47cb400640 1 --2- 172.21.15.155:0/1384853459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f47c40cc8c0 0x7f47c40c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.088 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.084+0000 7f47cb400640 1 --2- 172.21.15.155:0/1384853459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47c406d330 0x7f47c40c4a10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.084+0000 7f47cb400640 1 -- 172.21.15.155:0/1384853459 >> 172.21.15.155:0/1384853459 conn(0x7f47c40d04f0 msgr2=0x7f47c4068960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:22.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.084+0000 7f47cb400640 1 -- 172.21.15.155:0/1384853459 shutdown_connections 2024-09-17T05:28:22.089 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.084+0000 7f47cb400640 1 -- 172.21.15.155:0/1384853459 wait complete. 2024-09-17T05:28:22.106 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 3267113f-0f31-4343-aea9-685074951354 2 2024-09-17T05:28:22.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.244+0000 7f57dcc00640 1 -- 172.21.15.155:0/266939865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57d8151310 msgr2=0x7f57d80cc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:22.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.244+0000 7f57dcc00640 1 --2- 172.21.15.155:0/266939865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57d8151310 0x7f57d80cc8c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f57c8009900 tx=0x7f57c801c8e0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.244+0000 7f57dcc00640 1 -- 172.21.15.155:0/266939865 shutdown_connections 2024-09-17T05:28:22.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.244+0000 7f57dcc00640 1 --2- 172.21.15.155:0/266939865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57d8151310 0x7f57d80cc8c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.244+0000 7f57dcc00640 1 -- 172.21.15.155:0/266939865 >> 172.21.15.155:0/266939865 conn(0x7f57d80d04f0 msgr2=0x7f57d80d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:22.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.244+0000 7f57dcc00640 1 -- 172.21.15.155:0/266939865 shutdown_connections 2024-09-17T05:28:22.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.244+0000 7f57dcc00640 1 -- 172.21.15.155:0/266939865 wait complete. 2024-09-17T05:28:22.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57dcc00640 1 Processor -- start 2024-09-17T05:28:22.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57dcc00640 1 -- start start 2024-09-17T05:28:22.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57dcc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57d806d330 0x7f57d80b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:22.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57dcc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d8151310 0x7f57d80c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:22.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57dcc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57d815a960 0x7f57d80c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:22.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57dcc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f57d8169000 con 0x7f57d8151310 2024-09-17T05:28:22.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57dcc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f57d8168e80 con 0x7f57d815a960 2024-09-17T05:28:22.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57dcc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f57d8169180 con 0x7f57d806d330 2024-09-17T05:28:22.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57d6800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57d815a960 0x7f57d80c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:22.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57d6800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57d815a960 0x7f57d80c58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33272/0 (socket says 172.21.15.155:33272) 2024-09-17T05:28:22.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57d6800640 1 -- 172.21.15.155:0/357323551 learned_addr learned my addr 172.21.15.155:0/357323551 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-17T05:28:22.251 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57cfe00640 1 --2- 172.21.15.155:0/357323551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d8151310 0x7f57d80c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:22.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57d5e00640 1 --2- 172.21.15.155:0/357323551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57d806d330 0x7f57d80b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:22.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57d6800640 1 -- 172.21.15.155:0/357323551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57d806d330 msgr2=0x7f57d80b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:22.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57d6800640 1 --2- 172.21.15.155:0/357323551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57d806d330 0x7f57d80b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57d6800640 1 -- 172.21.15.155:0/357323551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d8151310 msgr2=0x7f57d80c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:22.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57d6800640 1 --2- 172.21.15.155:0/357323551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d8151310 0x7f57d80c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57d6800640 1 -- 172.21.15.155:0/357323551 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d80c4fa0 con 0x7f57d815a960 2024-09-17T05:28:22.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57d6800640 1 --2- 172.21.15.155:0/357323551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57d815a960 0x7f57d80c58e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f57d000c7c0 tx=0x7f57d000cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:22.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57ce000640 1 -- 172.21.15.155:0/357323551 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d0003b80 con 0x7f57d815a960 2024-09-17T05:28:22.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57ce000640 1 -- 172.21.15.155:0/357323551 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57d0003d20 con 0x7f57d815a960 2024-09-17T05:28:22.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57dcc00640 1 -- 172.21.15.155:0/357323551 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57d80c5f10 con 0x7f57d815a960 2024-09-17T05:28:22.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57ce000640 1 -- 172.21.15.155:0/357323551 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d000aab0 con 0x7f57d815a960 2024-09-17T05:28:22.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57dcc00640 1 -- 172.21.15.155:0/357323551 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57d80c64d0 con 0x7f57d815a960 2024-09-17T05:28:22.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57ce000640 1 -- 172.21.15.155:0/357323551 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f57d000ac50 con 0x7f57d815a960 2024-09-17T05:28:22.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57ce000640 1 -- 172.21.15.155:0/357323551 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f57d0012a20 con 0x7f57d815a960 2024-09-17T05:28:22.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.248+0000 7f57dcc00640 1 -- 172.21.15.155:0/357323551 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57d80cc8c0 con 0x7f57d815a960 2024-09-17T05:28:22.254 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.252+0000 7f57ce000640 1 -- 172.21.15.155:0/357323551 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f57d0012600 con 0x7f57d815a960 2024-09-17T05:28:22.324 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.320+0000 7f57dcc00640 1 -- 172.21.15.155:0/357323551 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3267113f-0f31-4343-aea9-685074951354", "id": 2} v 0) -- 0x7f57d806d770 con 0x7f57d815a960 2024-09-17T05:28:22.333 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.332+0000 7f57ce000640 1 -- 172.21.15.155:0/357323551 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3267113f-0f31-4343-aea9-685074951354", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f57d00050d0 con 0x7f57d815a960 2024-09-17T05:28:22.333 INFO:teuthology.orchestra.run.smithi155.stdout:2 2024-09-17T05:28:22.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.332+0000 7f57dcc00640 1 -- 172.21.15.155:0/357323551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57d815a960 msgr2=0x7f57d80c58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:22.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.332+0000 7f57dcc00640 1 --2- 172.21.15.155:0/357323551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57d815a960 0x7f57d80c58e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f57d000c7c0 tx=0x7f57d000cc80 comp rx=0 tx=0).stop 2024-09-17T05:28:22.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.332+0000 7f57dcc00640 1 -- 172.21.15.155:0/357323551 shutdown_connections 2024-09-17T05:28:22.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.332+0000 7f57dcc00640 1 --2- 172.21.15.155:0/357323551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57d815a960 0x7f57d80c58e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.332+0000 7f57dcc00640 1 --2- 172.21.15.155:0/357323551 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d8151310 0x7f57d80c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.332+0000 7f57dcc00640 1 --2- 172.21.15.155:0/357323551 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57d806d330 0x7f57d80b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.332+0000 7f57dcc00640 1 -- 172.21.15.155:0/357323551 >> 172.21.15.155:0/357323551 conn(0x7f57d80d04f0 msgr2=0x7f57d80708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:22.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.332+0000 7f57dcc00640 1 -- 172.21.15.155:0/357323551 shutdown_connections 2024-09-17T05:28:22.335 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.332+0000 7f57dcc00640 1 -- 172.21.15.155:0/357323551 wait complete. 2024-09-17T05:28:22.354 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e 3 2024-09-17T05:28:22.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.496+0000 7fce3f600640 1 -- 172.21.15.155:0/2519252128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce380b63e0 msgr2=0x7fce3806cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:22.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.496+0000 7fce3f600640 1 --2- 172.21.15.155:0/2519252128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce380b63e0 0x7fce3806cc20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fce2c009900 tx=0x7fce2c01c8e0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.496+0000 7fce3f600640 1 -- 172.21.15.155:0/2519252128 shutdown_connections 2024-09-17T05:28:22.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.496+0000 7fce3f600640 1 --2- 172.21.15.155:0/2519252128 >> v2:172.21.15.155:3300/0 conn(0x7fce3806d160 0x7fce3806f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.496+0000 7fce3f600640 1 --2- 172.21.15.155:0/2519252128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce380b63e0 0x7fce3806cc20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.496+0000 7fce3f600640 1 -- 172.21.15.155:0/2519252128 >> 172.21.15.155:0/2519252128 conn(0x7fce380d0da0 msgr2=0x7fce380d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:22.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.496+0000 7fce3f600640 1 -- 172.21.15.155:0/2519252128 shutdown_connections 2024-09-17T05:28:22.499 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.496+0000 7fce3f600640 1 -- 172.21.15.155:0/2519252128 wait complete. 2024-09-17T05:28:22.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.496+0000 7fce3f600640 1 Processor -- start 2024-09-17T05:28:22.500 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.496+0000 7fce3f600640 1 -- start start 2024-09-17T05:28:22.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.496+0000 7fce3f600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce3806d160 0x7fce3814e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:22.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce3f600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce3806fe20 0x7fce381f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:22.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce3f600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce380b63e0 0x7fce38158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:22.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce3f600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fce38168e50 con 0x7fce380b63e0 2024-09-17T05:28:22.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce3f600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce38168cd0 con 0x7fce3806fe20 2024-09-17T05:28:22.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce3f600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fce38168fd0 con 0x7fce3806d160 2024-09-17T05:28:22.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce3cc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce3806d160 0x7fce3814e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:22.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce37e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce3806fe20 0x7fce381f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:22.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce3cc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce3806d160 0x7fce3814e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:41266/0 (socket says 172.21.15.155:41266) 2024-09-17T05:28:22.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce3cc00640 1 -- 172.21.15.155:0/1242804264 learned_addr learned my addr 172.21.15.155:0/1242804264 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-17T05:28:22.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce3d600640 1 --2- 172.21.15.155:0/1242804264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce380b63e0 0x7fce38158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:22.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce3cc00640 1 -- 172.21.15.155:0/1242804264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce3806fe20 msgr2=0x7fce381f74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:22.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce3cc00640 1 --2- 172.21.15.155:0/1242804264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce3806fe20 0x7fce381f74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce3cc00640 1 -- 172.21.15.155:0/1242804264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce380b63e0 msgr2=0x7fce38158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:22.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce3cc00640 1 --2- 172.21.15.155:0/1242804264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce380b63e0 0x7fce38158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce3cc00640 1 -- 172.21.15.155:0/1242804264 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce38155b00 con 0x7fce3806d160 2024-09-17T05:28:22.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce37e00640 1 --2- 172.21.15.155:0/1242804264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce3806fe20 0x7fce381f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:28:22.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce3cc00640 1 --2- 172.21.15.155:0/1242804264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce3806d160 0x7fce3814e930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0b0040 tx=0x7fce2c0a6690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:22.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce34c00640 1 -- 172.21.15.155:0/1242804264 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c004380 con 0x7fce3806d160 2024-09-17T05:28:22.504 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce34c00640 1 -- 172.21.15.155:0/1242804264 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce2c005020 con 0x7fce3806d160 2024-09-17T05:28:22.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce34c00640 1 -- 172.21.15.155:0/1242804264 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c005470 con 0x7fce3806d160 2024-09-17T05:28:22.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce3f600640 1 -- 172.21.15.155:0/1242804264 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce38155de0 con 0x7fce3806d160 2024-09-17T05:28:22.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce3f600640 1 -- 172.21.15.155:0/1242804264 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fce381587c0 con 0x7fce3806d160 2024-09-17T05:28:22.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce34c00640 1 -- 172.21.15.155:0/1242804264 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fce2c0be060 con 0x7fce3806d160 2024-09-17T05:28:22.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce34c00640 1 -- 172.21.15.155:0/1242804264 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fce2c003650 con 0x7fce3806d160 2024-09-17T05:28:22.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.500+0000 7fce3f600640 1 -- 172.21.15.155:0/1242804264 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce38157440 con 0x7fce3806d160 2024-09-17T05:28:22.505 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.504+0000 7fce34c00640 1 -- 172.21.15.155:0/1242804264 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fce2c0164d0 con 0x7fce3806d160 2024-09-17T05:28:22.574 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.572+0000 7fce3f600640 1 -- 172.21.15.155:0/1242804264 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e", "id": 3} v 0) -- 0x7fce3806f860 con 0x7fce3806d160 2024-09-17T05:28:22.581 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.580+0000 7fce34c00640 1 -- 172.21.15.155:0/1242804264 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fce2c004a60 con 0x7fce3806d160 2024-09-17T05:28:22.581 INFO:teuthology.orchestra.run.smithi155.stdout:3 2024-09-17T05:28:22.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.580+0000 7fce3f600640 1 -- 172.21.15.155:0/1242804264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce3806d160 msgr2=0x7fce3814e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:22.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.580+0000 7fce3f600640 1 --2- 172.21.15.155:0/1242804264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce3806d160 0x7fce3814e930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0b0040 tx=0x7fce2c0a6690 comp rx=0 tx=0).stop 2024-09-17T05:28:22.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.580+0000 7fce3f600640 1 -- 172.21.15.155:0/1242804264 shutdown_connections 2024-09-17T05:28:22.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.580+0000 7fce3f600640 1 --2- 172.21.15.155:0/1242804264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce380b63e0 0x7fce38158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.580+0000 7fce3f600640 1 --2- 172.21.15.155:0/1242804264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce3806fe20 0x7fce381f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.580+0000 7fce3f600640 1 --2- 172.21.15.155:0/1242804264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce3806d160 0x7fce3814e930 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.580+0000 7fce3f600640 1 -- 172.21.15.155:0/1242804264 >> 172.21.15.155:0/1242804264 conn(0x7fce380d0da0 msgr2=0x7fce380d1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:22.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.580+0000 7fce3f600640 1 -- 172.21.15.155:0/1242804264 shutdown_connections 2024-09-17T05:28:22.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.580+0000 7fce3f600640 1 -- 172.21.15.155:0/1242804264 wait complete. 2024-09-17T05:28:22.600 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 5a32fddf-47a9-4ccc-b8f0-fe312468709a 4 2024-09-17T05:28:22.762 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.760+0000 7f1ca7e00640 1 -- 172.21.15.155:0/1457257418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c8c003ab0 msgr2=0x7f1c8c003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:22.762 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.760+0000 7f1ca7e00640 1 --2- 172.21.15.155:0/1457257418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c8c003ab0 0x7f1c8c003ed0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1c980016f0 tx=0x7f1c9801c790 comp rx=0 tx=0).stop 2024-09-17T05:28:22.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.760+0000 7f1ca7e00640 1 -- 172.21.15.155:0/1457257418 shutdown_connections 2024-09-17T05:28:22.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.760+0000 7f1ca7e00640 1 --2- 172.21.15.155:0/1457257418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c8c003ab0 0x7f1c8c003ed0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.760+0000 7f1ca7e00640 1 -- 172.21.15.155:0/1457257418 >> 172.21.15.155:0/1457257418 conn(0x7f1ca806dd30 msgr2=0x7f1ca806e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:22.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.764+0000 7f1ca7e00640 1 -- 172.21.15.155:0/1457257418 shutdown_connections 2024-09-17T05:28:22.765 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.764+0000 7f1ca7e00640 1 -- 172.21.15.155:0/1457257418 wait complete. 2024-09-17T05:28:22.769 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.764+0000 7f1ca7e00640 1 Processor -- start 2024-09-17T05:28:22.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.768+0000 7f1ca7e00640 1 -- start start 2024-09-17T05:28:22.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.768+0000 7f1ca7e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c8c003ab0 0x7f1ca80ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:22.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.768+0000 7f1ca7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ca8073e50 0x7f1ca80b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:22.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.772+0000 7f1ca6a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c8c003ab0 0x7f1ca80ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:22.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.772+0000 7f1ca6a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c8c003ab0 0x7f1ca80ca3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33322/0 (socket says 172.21.15.155:33322) 2024-09-17T05:28:22.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.772+0000 7f1ca6a00640 1 -- 172.21.15.155:0/2850804731 learned_addr learned my addr 172.21.15.155:0/2850804731 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-17T05:28:22.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.772+0000 7f1ca7e00640 1 --2- 172.21.15.155:0/2850804731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ca80b4a60 0x7f1ca80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:22.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.772+0000 7f1ca6000640 1 --2- 172.21.15.155:0/2850804731 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ca8073e50 0x7f1ca80b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:22.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.772+0000 7f1ca7e00640 1 -- 172.21.15.155:0/2850804731 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca80cd630 con 0x7f1ca8073e50 2024-09-17T05:28:22.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.772+0000 7f1ca7e00640 1 -- 172.21.15.155:0/2850804731 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca80cd4b0 con 0x7f1c8c003ab0 2024-09-17T05:28:22.775 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.772+0000 7f1ca7e00640 1 -- 172.21.15.155:0/2850804731 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca80cd7b0 con 0x7f1ca80b4a60 2024-09-17T05:28:22.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.772+0000 7f1ca7400640 1 --2- 172.21.15.155:0/2850804731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ca80b4a60 0x7f1ca80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:22.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.772+0000 7f1ca6a00640 1 -- 172.21.15.155:0/2850804731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ca80b4a60 msgr2=0x7f1ca80b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:22.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.772+0000 7f1ca6a00640 1 --2- 172.21.15.155:0/2850804731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ca80b4a60 0x7f1ca80b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.772+0000 7f1ca6a00640 1 -- 172.21.15.155:0/2850804731 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ca8073e50 msgr2=0x7f1ca80b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:22.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.772+0000 7f1ca6a00640 1 --2- 172.21.15.155:0/2850804731 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ca8073e50 0x7f1ca80b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.776 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.772+0000 7f1ca6a00640 1 -- 172.21.15.155:0/2850804731 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca81fcdd0 con 0x7f1c8c003ab0 2024-09-17T05:28:22.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.772+0000 7f1ca6a00640 1 --2- 172.21.15.155:0/2850804731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c8c003ab0 0x7f1ca80ca3d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1c980016f0 tx=0x7f1c98003c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:22.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.776+0000 7f1c9ea00640 1 -- 172.21.15.155:0/2850804731 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c980ba070 con 0x7f1c8c003ab0 2024-09-17T05:28:22.777 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.776+0000 7f1c9ea00640 1 -- 172.21.15.155:0/2850804731 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c980af040 con 0x7f1c8c003ab0 2024-09-17T05:28:22.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.776+0000 7f1c9ea00640 1 -- 172.21.15.155:0/2850804731 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c980ae070 con 0x7f1c8c003ab0 2024-09-17T05:28:22.778 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.776+0000 7f1ca7e00640 1 -- 172.21.15.155:0/2850804731 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca80b3d30 con 0x7f1c8c003ab0 2024-09-17T05:28:22.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.776+0000 7f1ca7e00640 1 -- 172.21.15.155:0/2850804731 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca80c5680 con 0x7f1c8c003ab0 2024-09-17T05:28:22.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.776+0000 7f1c9ea00640 1 -- 172.21.15.155:0/2850804731 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1c980a8430 con 0x7f1c8c003ab0 2024-09-17T05:28:22.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.776+0000 7f1c9ea00640 1 -- 172.21.15.155:0/2850804731 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f1c980a8c30 con 0x7f1c8c003ab0 2024-09-17T05:28:22.779 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.776+0000 7f1ca7e00640 1 -- 172.21.15.155:0/2850804731 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca80b4340 con 0x7f1c8c003ab0 2024-09-17T05:28:22.783 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.780+0000 7f1c9ea00640 1 -- 172.21.15.155:0/2850804731 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1ca80b4340 con 0x7f1c8c003ab0 2024-09-17T05:28:22.863 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.860+0000 7f1ca7e00640 1 -- 172.21.15.155:0/2850804731 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5a32fddf-47a9-4ccc-b8f0-fe312468709a", "id": 4} v 0) -- 0x7f1ca80cdd10 con 0x7f1c8c003ab0 2024-09-17T05:28:22.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.868+0000 7f1c9ea00640 1 -- 172.21.15.155:0/2850804731 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5a32fddf-47a9-4ccc-b8f0-fe312468709a", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f1c980c3020 con 0x7f1c8c003ab0 2024-09-17T05:28:22.870 INFO:teuthology.orchestra.run.smithi155.stdout:4 2024-09-17T05:28:22.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.868+0000 7f1ca7e00640 1 -- 172.21.15.155:0/2850804731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c8c003ab0 msgr2=0x7f1ca80ca3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:22.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.868+0000 7f1ca7e00640 1 --2- 172.21.15.155:0/2850804731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c8c003ab0 0x7f1ca80ca3d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1c980016f0 tx=0x7f1c98003c60 comp rx=0 tx=0).stop 2024-09-17T05:28:22.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.868+0000 7f1ca7e00640 1 -- 172.21.15.155:0/2850804731 shutdown_connections 2024-09-17T05:28:22.871 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.868+0000 7f1ca7e00640 1 --2- 172.21.15.155:0/2850804731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ca80b4a60 0x7f1ca80b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.868+0000 7f1ca7e00640 1 --2- 172.21.15.155:0/2850804731 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ca8073e50 0x7f1ca80b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.868+0000 7f1ca7e00640 1 --2- 172.21.15.155:0/2850804731 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c8c003ab0 0x7f1ca80ca3d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:22.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.868+0000 7f1ca7e00640 1 -- 172.21.15.155:0/2850804731 >> 172.21.15.155:0/2850804731 conn(0x7f1ca806dd30 msgr2=0x7f1ca815d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:22.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.868+0000 7f1ca7e00640 1 -- 172.21.15.155:0/2850804731 shutdown_connections 2024-09-17T05:28:22.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:22.868+0000 7f1ca7e00640 1 -- 172.21.15.155:0/2850804731 wait complete. 2024-09-17T05:28:22.889 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 0a6791a2-7e16-4ed2-b3c3-42675a9658e8 5 2024-09-17T05:28:23.033 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.028+0000 7fad2ca00640 1 -- 172.21.15.155:0/1058211545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad280cf0d0 msgr2=0x7fad28068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:23.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.028+0000 7fad2ca00640 1 --2- 172.21.15.155:0/1058211545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad280cf0d0 0x7fad28068960 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fad18009900 tx=0x7fad1801c8e0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.028+0000 7fad2ca00640 1 -- 172.21.15.155:0/1058211545 shutdown_connections 2024-09-17T05:28:23.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.028+0000 7fad2ca00640 1 --2- 172.21.15.155:0/1058211545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad280cf0d0 0x7fad28068960 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.028+0000 7fad2ca00640 1 -- 172.21.15.155:0/1058211545 >> 172.21.15.155:0/1058211545 conn(0x7fad280cced0 msgr2=0x7fad280cd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:23.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.028+0000 7fad2ca00640 1 -- 172.21.15.155:0/1058211545 shutdown_connections 2024-09-17T05:28:23.034 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.028+0000 7fad2ca00640 1 -- 172.21.15.155:0/1058211545 wait complete. 2024-09-17T05:28:23.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad2ca00640 1 Processor -- start 2024-09-17T05:28:23.039 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad2ca00640 1 -- start start 2024-09-17T05:28:23.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad2ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad280cf0d0 0x7fad280c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:23.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad2ca00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad2815f000 0x7fad28140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:23.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad2ca00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad2806f120 0x7fad280730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:23.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad2ca00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fad28168e40 con 0x7fad280cf0d0 2024-09-17T05:28:23.040 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad2ca00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fad28168cc0 con 0x7fad2815f000 2024-09-17T05:28:23.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad2ca00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fad28168fc0 con 0x7fad2806f120 2024-09-17T05:28:23.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad25e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad2815f000 0x7fad28140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:23.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad26800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad280cf0d0 0x7fad280c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:23.041 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad27200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad2806f120 0x7fad280730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:23.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad25e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad2815f000 0x7fad28140fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33330/0 (socket says 172.21.15.155:33330) 2024-09-17T05:28:23.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad25e00640 1 -- 172.21.15.155:0/2642929533 learned_addr learned my addr 172.21.15.155:0/2642929533 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-17T05:28:23.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad27200640 1 -- 172.21.15.155:0/2642929533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad2815f000 msgr2=0x7fad28140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:23.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad27200640 1 --2- 172.21.15.155:0/2642929533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad2815f000 0x7fad28140fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad27200640 1 -- 172.21.15.155:0/2642929533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad280cf0d0 msgr2=0x7fad280c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:23.042 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad27200640 1 --2- 172.21.15.155:0/2642929533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad280cf0d0 0x7fad280c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad27200640 1 -- 172.21.15.155:0/2642929533 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad28158cc0 con 0x7fad2806f120 2024-09-17T05:28:23.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad26800640 1 --2- 172.21.15.155:0/2642929533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad280cf0d0 0x7fad280c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:28:23.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad25e00640 1 --2- 172.21.15.155:0/2642929533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad2815f000 0x7fad28140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:28:23.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad27200640 1 --2- 172.21.15.155:0/2642929533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad2806f120 0x7fad280730e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fad2000c650 tx=0x7fad2000cb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:23.043 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad1ea00640 1 -- 172.21.15.155:0/2642929533 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20003b80 con 0x7fad2806f120 2024-09-17T05:28:23.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad1ea00640 1 -- 172.21.15.155:0/2642929533 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad20003d20 con 0x7fad2806f120 2024-09-17T05:28:23.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad2ca00640 1 -- 172.21.15.155:0/2642929533 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad28158fa0 con 0x7fad2806f120 2024-09-17T05:28:23.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad1ea00640 1 -- 172.21.15.155:0/2642929533 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20005330 con 0x7fad2806f120 2024-09-17T05:28:23.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad2ca00640 1 -- 172.21.15.155:0/2642929533 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fad28159560 con 0x7fad2806f120 2024-09-17T05:28:23.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.032+0000 7fad1ea00640 1 -- 172.21.15.155:0/2642929533 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fad200054d0 con 0x7fad2806f120 2024-09-17T05:28:23.044 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.036+0000 7fad1ea00640 1 -- 172.21.15.155:0/2642929533 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fad2000abc0 con 0x7fad2806f120 2024-09-17T05:28:23.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.036+0000 7fad2ca00640 1 -- 172.21.15.155:0/2642929533 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad28068960 con 0x7fad2806f120 2024-09-17T05:28:23.045 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.036+0000 7fad1ea00640 1 -- 172.21.15.155:0/2642929533 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fad200057c0 con 0x7fad2806f120 2024-09-17T05:28:23.046 INFO:tasks.ceph.mgr.x.smithi155.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-17T05:28:23.046 INFO:tasks.ceph.mgr.x.smithi155.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-17T05:28:23.046 INFO:tasks.ceph.mgr.x.smithi155.stderr: from numpy import show_config as show_numpy_config 2024-09-17T05:28:23.109 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.104+0000 7fad2ca00640 1 -- 172.21.15.155:0/2642929533 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0a6791a2-7e16-4ed2-b3c3-42675a9658e8", "id": 5} v 0) -- 0x7fad28068fd0 con 0x7fad2806f120 2024-09-17T05:28:23.114 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.112+0000 7fad1ea00640 1 -- 172.21.15.155:0/2642929533 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0a6791a2-7e16-4ed2-b3c3-42675a9658e8", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fad20006b60 con 0x7fad2806f120 2024-09-17T05:28:23.114 INFO:teuthology.orchestra.run.smithi155.stdout:5 2024-09-17T05:28:23.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.112+0000 7fad2ca00640 1 -- 172.21.15.155:0/2642929533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad2806f120 msgr2=0x7fad280730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:23.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.112+0000 7fad2ca00640 1 --2- 172.21.15.155:0/2642929533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad2806f120 0x7fad280730e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fad2000c650 tx=0x7fad2000cb10 comp rx=0 tx=0).stop 2024-09-17T05:28:23.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.112+0000 7fad2ca00640 1 -- 172.21.15.155:0/2642929533 shutdown_connections 2024-09-17T05:28:23.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.112+0000 7fad2ca00640 1 --2- 172.21.15.155:0/2642929533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad2806f120 0x7fad280730e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.112+0000 7fad2ca00640 1 --2- 172.21.15.155:0/2642929533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad2815f000 0x7fad28140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.112+0000 7fad2ca00640 1 --2- 172.21.15.155:0/2642929533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad280cf0d0 0x7fad280c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.112+0000 7fad2ca00640 1 -- 172.21.15.155:0/2642929533 >> 172.21.15.155:0/2642929533 conn(0x7fad280cced0 msgr2=0x7fad280afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:23.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.112+0000 7fad2ca00640 1 -- 172.21.15.155:0/2642929533 shutdown_connections 2024-09-17T05:28:23.117 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.112+0000 7fad2ca00640 1 -- 172.21.15.155:0/2642929533 wait complete. 2024-09-17T05:28:23.134 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 6c0198a4-03d8-4180-821e-b15c8b5eed87 6 2024-09-17T05:28:23.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.272+0000 7f9c7ac00640 1 -- 172.21.15.155:0/3926351831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c740d00a0 msgr2=0x7f9c740d0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:23.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.272+0000 7f9c7ac00640 1 --2- 172.21.15.155:0/3926351831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c740d00a0 0x7f9c740d0530 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009c80 tx=0x7f9c6c01cda0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.272+0000 7f9c7ac00640 1 -- 172.21.15.155:0/3926351831 shutdown_connections 2024-09-17T05:28:23.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.272+0000 7f9c7ac00640 1 --2- 172.21.15.155:0/3926351831 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c740d00a0 0x7f9c740d0530 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.272+0000 7f9c7ac00640 1 --2- 172.21.15.155:0/3926351831 >> v2:172.21.15.31:3300/0 conn(0x7f9c74151960 0x7f9c74151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.272+0000 7f9c7ac00640 1 -- 172.21.15.155:0/3926351831 >> 172.21.15.155:0/3926351831 conn(0x7f9c740d0da0 msgr2=0x7f9c740d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:23.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.272+0000 7f9c7ac00640 1 -- 172.21.15.155:0/3926351831 shutdown_connections 2024-09-17T05:28:23.277 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.272+0000 7f9c7ac00640 1 -- 172.21.15.155:0/3926351831 wait complete. 2024-09-17T05:28:23.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c7ac00640 1 Processor -- start 2024-09-17T05:28:23.278 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c7ac00640 1 -- start start 2024-09-17T05:28:23.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c7ac00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c74070720 0x7f9c740cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:23.280 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c7ac00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c740d00a0 0x7f9c74150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:23.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c7ac00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c74151960 0x7f9c74151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:23.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c7ac00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9c740cc690 con 0x7f9c740d00a0 2024-09-17T05:28:23.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c7ac00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9c740cc510 con 0x7f9c74070720 2024-09-17T05:28:23.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c7ac00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9c740cc810 con 0x7f9c74151960 2024-09-17T05:28:23.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c73e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c74070720 0x7f9c740cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:23.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c78c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c74151960 0x7f9c74151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:23.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c73e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c74070720 0x7f9c740cadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33332/0 (socket says 172.21.15.155:33332) 2024-09-17T05:28:23.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c73e00640 1 -- 172.21.15.155:0/481312285 learned_addr learned my addr 172.21.15.155:0/481312285 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-17T05:28:23.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c78c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c74151960 0x7f9c74151050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:41300/0 (socket says 172.21.15.155:41300) 2024-09-17T05:28:23.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c73400640 1 --2- 172.21.15.155:0/481312285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c740d00a0 0x7f9c74150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:23.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c78c00640 1 -- 172.21.15.155:0/481312285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c74070720 msgr2=0x7f9c740cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:23.281 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c78c00640 1 --2- 172.21.15.155:0/481312285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c74070720 0x7f9c740cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c78c00640 1 -- 172.21.15.155:0/481312285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c740d00a0 msgr2=0x7f9c74150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:23.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c78c00640 1 --2- 172.21.15.155:0/481312285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c740d00a0 0x7f9c74150640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c78c00640 1 -- 172.21.15.155:0/481312285 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c740ca030 con 0x7f9c74151960 2024-09-17T05:28:23.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c73e00640 1 --2- 172.21.15.155:0/481312285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c74070720 0x7f9c740cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:28:23.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c78c00640 1 --2- 172.21.15.155:0/481312285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c74151960 0x7f9c74151050 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0ac000 tx=0x7f9c6c009330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:23.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c6be00640 1 -- 172.21.15.155:0/481312285 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c0bb070 con 0x7f9c74151960 2024-09-17T05:28:23.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c6be00640 1 -- 172.21.15.155:0/481312285 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c6c004c50 con 0x7f9c74151960 2024-09-17T05:28:23.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c7ac00640 1 -- 172.21.15.155:0/481312285 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c740ca310 con 0x7f9c74151960 2024-09-17T05:28:23.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c6be00640 1 -- 172.21.15.155:0/481312285 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c0b2040 con 0x7f9c74151960 2024-09-17T05:28:23.282 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.276+0000 7f9c7ac00640 1 -- 172.21.15.155:0/481312285 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c740ca8d0 con 0x7f9c74151960 2024-09-17T05:28:23.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.280+0000 7f9c6be00640 1 -- 172.21.15.155:0/481312285 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9c6c0be070 con 0x7f9c74151960 2024-09-17T05:28:23.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.280+0000 7f9c6be00640 1 -- 172.21.15.155:0/481312285 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f9c6c0047f0 con 0x7f9c74151960 2024-09-17T05:28:23.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.280+0000 7f9c7ac00640 1 -- 172.21.15.155:0/481312285 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c740d0530 con 0x7f9c74151960 2024-09-17T05:28:23.283 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.280+0000 7f9c6be00640 1 -- 172.21.15.155:0/481312285 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9c6c0d8860 con 0x7f9c74151960 2024-09-17T05:28:23.353 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.352+0000 7f9c7ac00640 1 -- 172.21.15.155:0/481312285 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6c0198a4-03d8-4180-821e-b15c8b5eed87", "id": 6} v 0) -- 0x7f9c740b6d20 con 0x7f9c74151960 2024-09-17T05:28:23.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.356+0000 7f9c6be00640 1 -- 172.21.15.155:0/481312285 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6c0198a4-03d8-4180-821e-b15c8b5eed87", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f9c6c0c6030 con 0x7f9c74151960 2024-09-17T05:28:23.360 INFO:teuthology.orchestra.run.smithi155.stdout:6 2024-09-17T05:28:23.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.356+0000 7f9c7ac00640 1 -- 172.21.15.155:0/481312285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c74151960 msgr2=0x7f9c74151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:23.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.356+0000 7f9c7ac00640 1 --2- 172.21.15.155:0/481312285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c74151960 0x7f9c74151050 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0ac000 tx=0x7f9c6c009330 comp rx=0 tx=0).stop 2024-09-17T05:28:23.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.356+0000 7f9c7ac00640 1 -- 172.21.15.155:0/481312285 shutdown_connections 2024-09-17T05:28:23.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.356+0000 7f9c7ac00640 1 --2- 172.21.15.155:0/481312285 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c74151960 0x7f9c74151050 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.356+0000 7f9c7ac00640 1 --2- 172.21.15.155:0/481312285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c740d00a0 0x7f9c74150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.356+0000 7f9c7ac00640 1 --2- 172.21.15.155:0/481312285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c74070720 0x7f9c740cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.361 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.356+0000 7f9c7ac00640 1 -- 172.21.15.155:0/481312285 >> 172.21.15.155:0/481312285 conn(0x7f9c740d0da0 msgr2=0x7f9c7415da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:23.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.360+0000 7f9c7ac00640 1 -- 172.21.15.155:0/481312285 shutdown_connections 2024-09-17T05:28:23.362 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.360+0000 7f9c7ac00640 1 -- 172.21.15.155:0/481312285 wait complete. 2024-09-17T05:28:23.379 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c 7 2024-09-17T05:28:23.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9e000640 1 -- 172.21.15.155:0/3947148477 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a98152dc0 msgr2=0x7f0a980caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:23.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9e000640 1 --2- 172.21.15.155:0/3947148477 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a98152dc0 0x7f0a980caaa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0a980cc5d0 tx=0x7f0a9001ccf0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9e000640 1 -- 172.21.15.155:0/3947148477 shutdown_connections 2024-09-17T05:28:23.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9e000640 1 --2- 172.21.15.155:0/3947148477 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a98152dc0 0x7f0a980caaa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9e000640 1 --2- 172.21.15.155:0/3947148477 >> v2:172.21.15.31:3300/0 conn(0x7f0a98073340 0x7f0a98068960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9e000640 1 -- 172.21.15.155:0/3947148477 >> 172.21.15.155:0/3947148477 conn(0x7f0a980cced0 msgr2=0x7f0a980cd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:23.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9e000640 1 -- 172.21.15.155:0/3947148477 shutdown_connections 2024-09-17T05:28:23.522 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9e000640 1 -- 172.21.15.155:0/3947148477 wait complete. 2024-09-17T05:28:23.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9e000640 1 Processor -- start 2024-09-17T05:28:23.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9e000640 1 -- start start 2024-09-17T05:28:23.526 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9e000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a98073340 0x7f0a980b4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:23.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9e000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a98152dc0 0x7f0a980b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:23.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a9815c1a0 0x7f0a9814cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:23.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9e000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0a980cef10 con 0x7f0a9815c1a0 2024-09-17T05:28:23.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9e000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0a980ced90 con 0x7f0a98073340 2024-09-17T05:28:23.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9e000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0a980cf090 con 0x7f0a98152dc0 2024-09-17T05:28:23.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9cc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a98073340 0x7f0a980b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:23.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9cc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a98073340 0x7f0a980b4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:33346/0 (socket says 172.21.15.155:33346) 2024-09-17T05:28:23.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9cc00640 1 -- 172.21.15.155:0/866640984 learned_addr learned my addr 172.21.15.155:0/866640984 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-17T05:28:23.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a97e00640 1 --2- 172.21.15.155:0/866640984 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a98152dc0 0x7f0a980b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:23.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.520+0000 7f0a9d600640 1 --2- 172.21.15.155:0/866640984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a9815c1a0 0x7f0a9814cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:23.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.524+0000 7f0a9cc00640 1 -- 172.21.15.155:0/866640984 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a98152dc0 msgr2=0x7f0a980b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:23.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.524+0000 7f0a9cc00640 1 --2- 172.21.15.155:0/866640984 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a98152dc0 0x7f0a980b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.524+0000 7f0a9cc00640 1 -- 172.21.15.155:0/866640984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a9815c1a0 msgr2=0x7f0a9814cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:23.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.524+0000 7f0a9cc00640 1 --2- 172.21.15.155:0/866640984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a9815c1a0 0x7f0a9814cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.524+0000 7f0a9cc00640 1 -- 172.21.15.155:0/866640984 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a980c9a40 con 0x7f0a98073340 2024-09-17T05:28:23.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.524+0000 7f0a9cc00640 1 --2- 172.21.15.155:0/866640984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a98073340 0x7f0a980b4550 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00ea20 tx=0x7f0a8c00eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:23.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.524+0000 7f0a94c00640 1 -- 172.21.15.155:0/866640984 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c00cd80 con 0x7f0a98073340 2024-09-17T05:28:23.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.524+0000 7f0a94c00640 1 -- 172.21.15.155:0/866640984 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a8c010430 con 0x7f0a98073340 2024-09-17T05:28:23.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.524+0000 7f0a94c00640 1 -- 172.21.15.155:0/866640984 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c010860 con 0x7f0a98073340 2024-09-17T05:28:23.528 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.524+0000 7f0a9e000640 1 -- 172.21.15.155:0/866640984 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a980c9d20 con 0x7f0a98073340 2024-09-17T05:28:23.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.524+0000 7f0a9e000640 1 -- 172.21.15.155:0/866640984 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a980c76a0 con 0x7f0a98073340 2024-09-17T05:28:23.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.524+0000 7f0a94c00640 1 -- 172.21.15.155:0/866640984 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0a8c010a00 con 0x7f0a98073340 2024-09-17T05:28:23.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.524+0000 7f0a94c00640 1 -- 172.21.15.155:0/866640984 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f0a8c010cf0 con 0x7f0a98073340 2024-09-17T05:28:23.529 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.524+0000 7f0a9e000640 1 -- 172.21.15.155:0/866640984 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a980cf540 con 0x7f0a98073340 2024-09-17T05:28:23.530 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.524+0000 7f0a94c00640 1 -- 172.21.15.155:0/866640984 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0a8c018e20 con 0x7f0a98073340 2024-09-17T05:28:23.598 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.596+0000 7f0a9e000640 1 -- 172.21.15.155:0/866640984 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c", "id": 7} v 0) -- 0x7f0a980cdc10 con 0x7f0a98073340 2024-09-17T05:28:23.602 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.600+0000 7f0a94c00640 1 -- 172.21.15.155:0/866640984 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f0a8c018420 con 0x7f0a98073340 2024-09-17T05:28:23.602 INFO:teuthology.orchestra.run.smithi155.stdout:7 2024-09-17T05:28:23.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.600+0000 7f0a9e000640 1 -- 172.21.15.155:0/866640984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a98073340 msgr2=0x7f0a980b4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:23.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.600+0000 7f0a9e000640 1 --2- 172.21.15.155:0/866640984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a98073340 0x7f0a980b4550 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00ea20 tx=0x7f0a8c00eee0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.603 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.600+0000 7f0a9e000640 1 -- 172.21.15.155:0/866640984 shutdown_connections 2024-09-17T05:28:23.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.600+0000 7f0a9e000640 1 --2- 172.21.15.155:0/866640984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a9815c1a0 0x7f0a9814cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.600+0000 7f0a9e000640 1 --2- 172.21.15.155:0/866640984 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a98152dc0 0x7f0a980b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.600+0000 7f0a9e000640 1 --2- 172.21.15.155:0/866640984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a98073340 0x7f0a980b4550 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.600+0000 7f0a9e000640 1 -- 172.21.15.155:0/866640984 >> 172.21.15.155:0/866640984 conn(0x7f0a980cced0 msgr2=0x7f0a98073da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:23.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.600+0000 7f0a9e000640 1 -- 172.21.15.155:0/866640984 shutdown_connections 2024-09-17T05:28:23.604 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:28:23.600+0000 7f0a9e000640 1 -- 172.21.15.155:0/866640984 wait complete. 2024-09-17T05:28:23.621 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T05:28:23.621 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T05:28:23.621 INFO:tasks.ceph.mgr.y.smithi031.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-17T05:28:23.622 INFO:tasks.ceph.mgr.y.smithi031.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-17T05:28:23.622 INFO:tasks.ceph.mgr.y.smithi031.stderr: from numpy import show_config as show_numpy_config 2024-09-17T05:28:23.625 INFO:tasks.ceph.osd.0:Started 2024-09-17T05:28:23.625 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T05:28:23.625 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T05:28:23.627 INFO:tasks.ceph.osd.1:Started 2024-09-17T05:28:23.628 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T05:28:23.628 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T05:28:23.631 INFO:tasks.ceph.osd.2:Started 2024-09-17T05:28:23.631 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T05:28:23.631 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T05:28:23.635 INFO:tasks.ceph.osd.3:Started 2024-09-17T05:28:23.635 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T05:28:23.635 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T05:28:23.638 INFO:tasks.ceph.osd.4:Started 2024-09-17T05:28:23.638 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T05:28:23.638 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T05:28:23.641 INFO:tasks.ceph.osd.5:Started 2024-09-17T05:28:23.642 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-17T05:28:23.642 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-17T05:28:23.645 INFO:tasks.ceph.osd.6:Started 2024-09-17T05:28:23.645 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T05:28:23.645 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T05:28:23.649 INFO:tasks.ceph.osd.7:Started 2024-09-17T05:28:23.650 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:28:23.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.823+0000 7f690a600640 1 -- 172.21.15.31:0/2668819335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690415df50 msgr2=0x7f690406e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:23.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.823+0000 7f690a600640 1 --2- 172.21.15.31:0/2668819335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690415df50 0x7f690406e740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6904161c00 tx=0x7f68f401c770 comp rx=0 tx=0).stop 2024-09-17T05:28:23.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.823+0000 7f690a600640 1 -- 172.21.15.31:0/2668819335 shutdown_connections 2024-09-17T05:28:23.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.823+0000 7f690a600640 1 --2- 172.21.15.31:0/2668819335 >> v2:172.21.15.155:3300/0 conn(0x7f690415e330 0x7f690406ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.823+0000 7f690a600640 1 --2- 172.21.15.31:0/2668819335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690415df50 0x7f690406e740 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.823+0000 7f690a600640 1 -- 172.21.15.31:0/2668819335 >> 172.21.15.31:0/2668819335 conn(0x7f69040d1dc0 msgr2=0x7f69040d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:23.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.823+0000 7f690a600640 1 -- 172.21.15.31:0/2668819335 shutdown_connections 2024-09-17T05:28:23.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.823+0000 7f690a600640 1 -- 172.21.15.31:0/2668819335 wait complete. 2024-09-17T05:28:23.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.823+0000 7f690a600640 1 Processor -- start 2024-09-17T05:28:23.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.823+0000 7f690a600640 1 -- start start 2024-09-17T05:28:23.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.823+0000 7f690a600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69040b11d0 0x7f69040b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:23.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.823+0000 7f690a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690415df50 0x7f69040b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:23.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.823+0000 7f690a600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f690415e330 0x7f69041552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:23.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.823+0000 7f690a600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f69040d0820 con 0x7f690415df50 2024-09-17T05:28:23.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.823+0000 7f690a600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f69040d06a0 con 0x7f690415e330 2024-09-17T05:28:23.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.823+0000 7f690a600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f69040d09a0 con 0x7f69040b11d0 2024-09-17T05:28:23.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f6902a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690415df50 0x7f69040b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:23.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f6902a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690415df50 0x7f69040b7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44250/0 (socket says 172.21.15.31:44250) 2024-09-17T05:28:23.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f6902a00640 1 -- 172.21.15.31:0/2510256955 learned_addr learned my addr 172.21.15.31:0/2510256955 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:23.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f6903400640 1 --2- 172.21.15.31:0/2510256955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69040b11d0 0x7f69040b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:23.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f6903e00640 1 --2- 172.21.15.31:0/2510256955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f690415e330 0x7f69041552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:23.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f6902a00640 1 -- 172.21.15.31:0/2510256955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69040b11d0 msgr2=0x7f69040b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:23.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f6902a00640 1 --2- 172.21.15.31:0/2510256955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69040b11d0 0x7f69040b6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f6902a00640 1 -- 172.21.15.31:0/2510256955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f690415e330 msgr2=0x7f69041552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:23.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f6902a00640 1 --2- 172.21.15.31:0/2510256955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f690415e330 0x7f69041552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f6902a00640 1 -- 172.21.15.31:0/2510256955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69041560d0 con 0x7f690415df50 2024-09-17T05:28:23.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f6902a00640 1 --2- 172.21.15.31:0/2510256955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690415df50 0x7f69040b7300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f68f000e7a0 tx=0x7f68f000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:23.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f68fb400640 1 -- 172.21.15.31:0/2510256955 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f000ccc0 con 0x7f690415df50 2024-09-17T05:28:23.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f68fb400640 1 -- 172.21.15.31:0/2510256955 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68f0010430 con 0x7f690415df50 2024-09-17T05:28:23.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f690a600640 1 -- 172.21.15.31:0/2510256955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f690415fc10 con 0x7f690415df50 2024-09-17T05:28:23.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f68fb400640 1 -- 172.21.15.31:0/2510256955 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f0010860 con 0x7f690415df50 2024-09-17T05:28:23.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f690a600640 1 -- 172.21.15.31:0/2510256955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69041601d0 con 0x7f690415df50 2024-09-17T05:28:23.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f68fb400640 1 -- 172.21.15.31:0/2510256955 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f68f0010a00 con 0x7f690415df50 2024-09-17T05:28:23.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f68fb400640 1 -- 172.21.15.31:0/2510256955 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f68f0010cf0 con 0x7f690415df50 2024-09-17T05:28:23.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.827+0000 7f690a600640 1 -- 172.21.15.31:0/2510256955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6904159a00 con 0x7f690415df50 2024-09-17T05:28:23.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.831+0000 7f68fb400640 1 -- 172.21.15.31:0/2510256955 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f69041560d0 con 0x7f690415df50 2024-09-17T05:28:23.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.891+0000 7f690a600640 1 -- 172.21.15.31:0/2510256955 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69040afcd0 con 0x7f690415df50 2024-09-17T05:28:23.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.891+0000 7f68fb400640 1 -- 172.21.15.31:0/2510256955 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f68f0018c40 con 0x7f690415df50 2024-09-17T05:28:23.893 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:23.893 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:28:23.600114+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:28:23.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.891+0000 7f690a600640 1 -- 172.21.15.31:0/2510256955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690415df50 msgr2=0x7f69040b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:23.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.891+0000 7f690a600640 1 --2- 172.21.15.31:0/2510256955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690415df50 0x7f69040b7300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f68f000e7a0 tx=0x7f68f000ec60 comp rx=0 tx=0).stop 2024-09-17T05:28:23.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.891+0000 7f690a600640 1 -- 172.21.15.31:0/2510256955 shutdown_connections 2024-09-17T05:28:23.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.891+0000 7f690a600640 1 --2- 172.21.15.31:0/2510256955 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f690415e330 0x7f69041552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.891+0000 7f690a600640 1 --2- 172.21.15.31:0/2510256955 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f690415df50 0x7f69040b7300 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.891+0000 7f690a600640 1 --2- 172.21.15.31:0/2510256955 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f69040b11d0 0x7f69040b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:23.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.891+0000 7f690a600640 1 -- 172.21.15.31:0/2510256955 >> 172.21.15.31:0/2510256955 conn(0x7f69040d1dc0 msgr2=0x7f69040ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:23.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.891+0000 7f690a600640 1 -- 172.21.15.31:0/2510256955 shutdown_connections 2024-09-17T05:28:23.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:23.891+0000 7f690a600640 1 -- 172.21.15.31:0/2510256955 wait complete. 2024-09-17T05:28:23.912 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T05:28:23.912 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T05:28:24.719 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T05:28:24.860 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.859+0000 7f79da600640 1 -- 172.21.15.31:0/3293074054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79d41616a0 msgr2=0x7f79d4070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:24.860 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.859+0000 7f79da600640 1 --2- 172.21.15.31:0/3293074054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79d41616a0 0x7f79d4070890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f79c4009840 tx=0x7f79c401c790 comp rx=0 tx=0).stop 2024-09-17T05:28:24.860 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.859+0000 7f79da600640 1 -- 172.21.15.31:0/3293074054 shutdown_connections 2024-09-17T05:28:24.860 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.859+0000 7f79da600640 1 --2- 172.21.15.31:0/3293074054 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79d40ce800 0x7f79d406cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:24.860 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.859+0000 7f79da600640 1 --2- 172.21.15.31:0/3293074054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79d41616a0 0x7f79d4070890 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:24.861 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.859+0000 7f79da600640 1 -- 172.21.15.31:0/3293074054 >> 172.21.15.31:0/3293074054 conn(0x7f79d40d0c30 msgr2=0x7f79d40d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:24.861 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.859+0000 7f79da600640 1 -- 172.21.15.31:0/3293074054 shutdown_connections 2024-09-17T05:28:24.861 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.859+0000 7f79da600640 1 -- 172.21.15.31:0/3293074054 wait complete. 2024-09-17T05:28:24.861 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.859+0000 7f79da600640 1 Processor -- start 2024-09-17T05:28:24.861 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.859+0000 7f79da600640 1 -- start start 2024-09-17T05:28:24.863 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79da600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79d406d160 0x7f79d41502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:24.864 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79da600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79d40ce800 0x7f79d40b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:24.864 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79da600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d41616a0 0x7f79d40b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:24.864 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79da600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f79d416b7e0 con 0x7f79d41616a0 2024-09-17T05:28:24.864 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79da600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f79d40cedf0 con 0x7f79d40ce800 2024-09-17T05:28:24.864 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79da600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f79d416b960 con 0x7f79d406d160 2024-09-17T05:28:24.864 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79d3400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79d406d160 0x7f79d41502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:24.864 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79d3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d41616a0 0x7f79d40b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:24.864 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79d3400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79d406d160 0x7f79d41502d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:54020/0 (socket says 172.21.15.31:54020) 2024-09-17T05:28:24.864 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79d3400640 1 -- 172.21.15.31:0/3258828744 learned_addr learned my addr 172.21.15.31:0/3258828744 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:24.865 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79cbe00640 1 --2- 172.21.15.31:0/3258828744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79d40ce800 0x7f79d40b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:24.865 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79d3400640 1 -- 172.21.15.31:0/3258828744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79d40ce800 msgr2=0x7f79d40b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:24.865 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79d3400640 1 --2- 172.21.15.31:0/3258828744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79d40ce800 0x7f79d40b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:24.865 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79d3400640 1 -- 172.21.15.31:0/3258828744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d41616a0 msgr2=0x7f79d40b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:24.865 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79d3400640 1 --2- 172.21.15.31:0/3258828744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d41616a0 0x7f79d40b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:24.865 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79d3400640 1 -- 172.21.15.31:0/3258828744 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d4150810 con 0x7f79d406d160 2024-09-17T05:28:24.865 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79cbe00640 1 --2- 172.21.15.31:0/3258828744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79d40ce800 0x7f79d40b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:28:24.865 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79d3e00640 1 --2- 172.21.15.31:0/3258828744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d41616a0 0x7f79d40b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:28:24.865 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79d3400640 1 --2- 172.21.15.31:0/3258828744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79d406d160 0x7f79d41502d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f79c4000c10 tx=0x7f79c40a6460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:24.866 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79cb400640 1 -- 172.21.15.31:0/3258828744 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c40ac030 con 0x7f79d406d160 2024-09-17T05:28:24.866 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79cb400640 1 -- 172.21.15.31:0/3258828744 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79c40053b0 con 0x7f79d406d160 2024-09-17T05:28:24.866 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79cb400640 1 -- 172.21.15.31:0/3258828744 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c40046d0 con 0x7f79d406d160 2024-09-17T05:28:24.866 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79da600640 1 -- 172.21.15.31:0/3258828744 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d40aeed0 con 0x7f79d406d160 2024-09-17T05:28:24.867 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79da600640 1 -- 172.21.15.31:0/3258828744 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d40b48d0 con 0x7f79d406d160 2024-09-17T05:28:24.867 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79cb400640 1 -- 172.21.15.31:0/3258828744 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f79c40af070 con 0x7f79d406d160 2024-09-17T05:28:24.867 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79cb400640 1 -- 172.21.15.31:0/3258828744 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f79c40a6660 con 0x7f79d406d160 2024-09-17T05:28:24.867 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.863+0000 7f79da600640 1 -- 172.21.15.31:0/3258828744 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d406cc20 con 0x7f79d406d160 2024-09-17T05:28:24.867 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.867+0000 7f79cb400640 1 -- 172.21.15.31:0/3258828744 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f79c4016410 con 0x7f79d406d160 2024-09-17T05:28:24.929 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.927+0000 7f79da600640 1 -- 172.21.15.31:0/3258828744 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f79d4073af0 con 0x7f79d406d160 2024-09-17T05:28:24.930 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.927+0000 7f79cb400640 1 -- 172.21.15.31:0/3258828744 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f79c4004870 con 0x7f79d406d160 2024-09-17T05:28:24.930 INFO:teuthology.misc.health.smithi031.stdout: 2024-09-17T05:28:24.930 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":10,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:28:23.600114+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:28:24.931 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.931+0000 7f79da600640 1 -- 172.21.15.31:0/3258828744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79d406d160 msgr2=0x7f79d41502d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:24.931 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.931+0000 7f79da600640 1 --2- 172.21.15.31:0/3258828744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79d406d160 0x7f79d41502d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f79c4000c10 tx=0x7f79c40a6460 comp rx=0 tx=0).stop 2024-09-17T05:28:24.931 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.931+0000 7f79da600640 1 -- 172.21.15.31:0/3258828744 shutdown_connections 2024-09-17T05:28:24.931 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.931+0000 7f79da600640 1 --2- 172.21.15.31:0/3258828744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79d41616a0 0x7f79d40b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:24.931 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.931+0000 7f79da600640 1 --2- 172.21.15.31:0/3258828744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79d40ce800 0x7f79d40b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:24.932 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.931+0000 7f79da600640 1 --2- 172.21.15.31:0/3258828744 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79d406d160 0x7f79d41502d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:24.932 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.931+0000 7f79da600640 1 -- 172.21.15.31:0/3258828744 >> 172.21.15.31:0/3258828744 conn(0x7f79d40d0c30 msgr2=0x7f79d40b22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:24.932 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.931+0000 7f79da600640 1 -- 172.21.15.31:0/3258828744 shutdown_connections 2024-09-17T05:28:24.932 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:24.931+0000 7f79da600640 1 -- 172.21.15.31:0/3258828744 wait complete. 2024-09-17T05:28:24.948 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T05:28:25.066 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-09-17T05:28:25.064+0000 7f912e21e7c0 -1 Falling back to public interface 2024-09-17T05:28:25.115 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-09-17T05:28:25.115+0000 7f1183a2b7c0 -1 Falling back to public interface 2024-09-17T05:28:25.310 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-09-17T05:28:25.308+0000 7fd7878547c0 -1 Falling back to public interface 2024-09-17T05:28:25.326 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-09-17T05:28:25.324+0000 7f7a6170b7c0 -1 Falling back to public interface 2024-09-17T05:28:25.343 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-09-17T05:28:25.343+0000 7f3dbba5b7c0 -1 Falling back to public interface 2024-09-17T05:28:25.344 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-09-17T05:28:25.343+0000 7f2d836d27c0 -1 Falling back to public interface 2024-09-17T05:28:25.355 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-09-17T05:28:25.355+0000 7fbc46c727c0 -1 Falling back to public interface 2024-09-17T05:28:25.578 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-09-17T05:28:25.576+0000 7f5eb65b67c0 -1 Falling back to public interface 2024-09-17T05:28:26.188 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:28:26.184+0000 7fab24800640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T05:28:26.189 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:28:26.188+0000 7fab24800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T05:28:29.366 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-09-17T05:28:29.363+0000 7f1183a2b7c0 -1 osd.0 0 log_to_monitors true 2024-09-17T05:28:29.408 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-09-17T05:28:29.404+0000 7f912e21e7c0 -1 osd.5 0 log_to_monitors true 2024-09-17T05:28:29.663 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-09-17T05:28:29.660+0000 7fd7878547c0 -1 osd.4 0 log_to_monitors true 2024-09-17T05:28:29.952 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-09-17T05:28:29.948+0000 7f7a6170b7c0 -1 osd.6 0 log_to_monitors true 2024-09-17T05:28:29.953 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-09-17T05:28:29.950+0000 7fbc46c727c0 -1 osd.2 0 log_to_monitors true 2024-09-17T05:28:29.985 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-09-17T05:28:29.982+0000 7f2d836d27c0 -1 osd.3 0 log_to_monitors true 2024-09-17T05:28:30.037 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-09-17T05:28:30.036+0000 7f5eb65b67c0 -1 osd.7 0 log_to_monitors true 2024-09-17T05:28:30.060 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-09-17T05:28:30.058+0000 7f3dbba5b7c0 -1 osd.1 0 log_to_monitors true 2024-09-17T05:28:31.492 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-09-17T05:28:31.488+0000 7f9129a00640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T05:28:31.522 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-09-17T05:28:31.518+0000 7f117e800640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T05:28:31.576 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-09-17T05:28:31.570+0000 7f1173e00640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:28:31.581 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-09-17T05:28:31.576+0000 7f911f000640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:28:31.754 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T05:28:31.924 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.922+0000 7f4a4fe00640 1 -- 172.21.15.31:0/785869522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a4815c5b0 msgr2=0x7f4a4806d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:31.925 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.922+0000 7f4a4fe00640 1 --2- 172.21.15.31:0/785869522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a4815c5b0 0x7f4a4806d000 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4a48076600 tx=0x7f4a3401c8c0 comp rx=0 tx=0).stop 2024-09-17T05:28:31.925 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.922+0000 7f4a4fe00640 1 -- 172.21.15.31:0/785869522 shutdown_connections 2024-09-17T05:28:31.925 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.922+0000 7f4a4fe00640 1 --2- 172.21.15.31:0/785869522 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a4815c5b0 0x7f4a4806d000 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:31.925 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.922+0000 7f4a4fe00640 1 --2- 172.21.15.31:0/785869522 >> v2:172.21.15.155:3300/0 conn(0x7f4a4806cc20 0x7f4a480ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:31.925 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.922+0000 7f4a4fe00640 1 -- 172.21.15.31:0/785869522 >> 172.21.15.31:0/785869522 conn(0x7f4a480d0c20 msgr2=0x7f4a480d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:31.925 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.922+0000 7f4a4fe00640 1 -- 172.21.15.31:0/785869522 shutdown_connections 2024-09-17T05:28:31.925 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.922+0000 7f4a4fe00640 1 -- 172.21.15.31:0/785869522 wait complete. 2024-09-17T05:28:31.926 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.922+0000 7f4a4fe00640 1 Processor -- start 2024-09-17T05:28:31.926 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4fe00640 1 -- start start 2024-09-17T05:28:31.929 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a4806cc20 0x7f4a48152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:31.929 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4fe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4815c5b0 0x7f4a48156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:31.929 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a4815fad0 0x7f4a480b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:31.929 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4fe00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4a48169800 con 0x7f4a4815fad0 2024-09-17T05:28:31.929 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4fe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a48169680 con 0x7f4a4815c5b0 2024-09-17T05:28:31.929 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4fe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4a48169980 con 0x7f4a4806cc20 2024-09-17T05:28:31.929 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a4815fad0 0x7f4a480b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:31.929 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a4815fad0 0x7f4a480b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40322/0 (socket says 172.21.15.31:40322) 2024-09-17T05:28:31.929 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4de00640 1 -- 172.21.15.31:0/1328135819 learned_addr learned my addr 172.21.15.31:0/1328135819 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:31.929 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4ca00640 1 --2- 172.21.15.31:0/1328135819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4815c5b0 0x7f4a48156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:31.929 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4d400640 1 --2- 172.21.15.31:0/1328135819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a4806cc20 0x7f4a48152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:31.930 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4ca00640 1 -- 172.21.15.31:0/1328135819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a4806cc20 msgr2=0x7f4a48152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:31.931 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4ca00640 1 --2- 172.21.15.31:0/1328135819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a4806cc20 0x7f4a48152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:31.931 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4ca00640 1 -- 172.21.15.31:0/1328135819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a4815fad0 msgr2=0x7f4a480b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:31.931 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4ca00640 1 --2- 172.21.15.31:0/1328135819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a4815fad0 0x7f4a480b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:31.931 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4ca00640 1 -- 172.21.15.31:0/1328135819 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a480746a0 con 0x7f4a4815c5b0 2024-09-17T05:28:31.931 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4de00640 1 --2- 172.21.15.31:0/1328135819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a4815fad0 0x7f4a480b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:28:31.931 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4ca00640 1 --2- 172.21.15.31:0/1328135819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4815c5b0 0x7f4a48156dd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4a340ac000 tx=0x7f4a340a5600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:31.931 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a45600640 1 -- 172.21.15.31:0/1328135819 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a340bb070 con 0x7f4a4815c5b0 2024-09-17T05:28:31.931 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a45600640 1 -- 172.21.15.31:0/1328135819 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a340043d0 con 0x7f4a4815c5b0 2024-09-17T05:28:31.931 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a45600640 1 -- 172.21.15.31:0/1328135819 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a340b2040 con 0x7f4a4815c5b0 2024-09-17T05:28:31.931 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4fe00640 1 -- 172.21.15.31:0/1328135819 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a48157310 con 0x7f4a4815c5b0 2024-09-17T05:28:31.931 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.926+0000 7f4a4fe00640 1 -- 172.21.15.31:0/1328135819 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a480b5ac0 con 0x7f4a4815c5b0 2024-09-17T05:28:31.932 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.930+0000 7f4a4fe00640 1 -- 172.21.15.31:0/1328135819 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a480ccf50 con 0x7f4a4815c5b0 2024-09-17T05:28:31.932 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.930+0000 7f4a45600640 1 -- 172.21.15.31:0/1328135819 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) ==== 97178+0+0 (secure 0 0 0) 0x7f4a34005290 con 0x7f4a4815c5b0 2024-09-17T05:28:31.933 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.930+0000 7f4a45600640 1 --2- 172.21.15.31:0/1328135819 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4a28073170 0x7f4a28075630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:31.934 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.930+0000 7f4a45600640 1 -- 172.21.15.31:0/1328135819 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2231+0+0 (secure 0 0 0) 0x7f4a3412c920 con 0x7f4a4815c5b0 2024-09-17T05:28:31.934 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.930+0000 7f4a4d400640 1 --2- 172.21.15.31:0/1328135819 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4a28073170 0x7f4a28075630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:31.935 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.934+0000 7f4a4d400640 1 --2- 172.21.15.31:0/1328135819 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4a28073170 0x7f4a28075630 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4a480cec30 tx=0x7f4a3c0091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:31.938 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:31.934+0000 7f4a45600640 1 -- 172.21.15.31:0/1328135819 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4a340164b0 con 0x7f4a4815c5b0 2024-09-17T05:28:32.187 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:32.186+0000 7f4a4fe00640 1 -- 172.21.15.31:0/1328135819 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a480ca1e0 con 0x7f4a4815c5b0 2024-09-17T05:28:32.187 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:32.186+0000 7f4a45600640 1 -- 172.21.15.31:0/1328135819 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7058 (secure 0 0 0) 0x7f4a340f8160 con 0x7f4a4815c5b0 2024-09-17T05:28:32.188 INFO:teuthology.misc.health.smithi031.stdout: 2024-09-17T05:28:32.188 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":13,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:28:31.425941+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:28:32.190 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:32.186+0000 7f4a4fe00640 1 -- 172.21.15.31:0/1328135819 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4a28073170 msgr2=0x7f4a28075630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:32.190 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:32.186+0000 7f4a4fe00640 1 --2- 172.21.15.31:0/1328135819 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4a28073170 0x7f4a28075630 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4a480cec30 tx=0x7f4a3c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:28:32.190 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:32.186+0000 7f4a4fe00640 1 -- 172.21.15.31:0/1328135819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4815c5b0 msgr2=0x7f4a48156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:32.190 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:32.186+0000 7f4a4fe00640 1 --2- 172.21.15.31:0/1328135819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4815c5b0 0x7f4a48156dd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4a340ac000 tx=0x7f4a340a5600 comp rx=0 tx=0).stop 2024-09-17T05:28:32.191 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:32.186+0000 7f4a4fe00640 1 -- 172.21.15.31:0/1328135819 shutdown_connections 2024-09-17T05:28:32.191 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:32.186+0000 7f4a4fe00640 1 --2- 172.21.15.31:0/1328135819 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4a28073170 0x7f4a28075630 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:32.191 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:32.186+0000 7f4a4fe00640 1 --2- 172.21.15.31:0/1328135819 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a4815fad0 0x7f4a480b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:32.191 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:32.186+0000 7f4a4fe00640 1 --2- 172.21.15.31:0/1328135819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4815c5b0 0x7f4a48156dd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:32.191 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:32.186+0000 7f4a4fe00640 1 --2- 172.21.15.31:0/1328135819 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a4806cc20 0x7f4a48152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:32.191 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:32.186+0000 7f4a4fe00640 1 -- 172.21.15.31:0/1328135819 >> 172.21.15.31:0/1328135819 conn(0x7f4a480d0c20 msgr2=0x7f4a48155ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:32.191 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:32.186+0000 7f4a4fe00640 1 -- 172.21.15.31:0/1328135819 shutdown_connections 2024-09-17T05:28:32.191 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:32.186+0000 7f4a4fe00640 1 -- 172.21.15.31:0/1328135819 wait complete. 2024-09-17T05:28:32.214 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T05:28:33.208 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-09-17T05:28:33.206+0000 7f2d7e600640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T05:28:33.221 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-09-17T05:28:33.220+0000 7f7a5c600640 -1 osd.6 0 waiting for initial osdmap 2024-09-17T05:28:33.233 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-09-17T05:28:33.232+0000 7f5eb1400640 -1 osd.7 0 waiting for initial osdmap 2024-09-17T05:28:33.246 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-09-17T05:28:33.244+0000 7f7a52600640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:28:33.252 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-09-17T05:28:33.250+0000 7f2d74600640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:28:33.259 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-09-17T05:28:33.256+0000 7fd782800640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T05:28:33.262 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-09-17T05:28:33.260+0000 7f5ea7400640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:28:33.281 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-09-17T05:28:33.278+0000 7f3db6a00640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T05:28:33.294 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-09-17T05:28:33.292+0000 7fd778800640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:28:33.302 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-09-17T05:28:33.298+0000 7fbc41c00640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T05:28:33.304 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-09-17T05:28:33.302+0000 7f3daca00640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:28:33.339 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-09-17T05:28:33.338+0000 7fbc37c00640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:28:39.022 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T05:28:39.170 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.166+0000 7f1315400640 1 -- 172.21.15.31:0/2674947117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13100cfe40 msgr2=0x7f13100cd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:39.170 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.166+0000 7f1315400640 1 --2- 172.21.15.31:0/2674947117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13100cfe40 0x7f13100cd830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f12fc009840 tx=0x7f12fc01c820 comp rx=0 tx=0).stop 2024-09-17T05:28:39.170 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.166+0000 7f1315400640 1 -- 172.21.15.31:0/2674947117 shutdown_connections 2024-09-17T05:28:39.170 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.166+0000 7f1315400640 1 --2- 172.21.15.31:0/2674947117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100c5f90 0x7f13100ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:39.170 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.166+0000 7f1315400640 1 --2- 172.21.15.31:0/2674947117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13100cfe40 0x7f13100cd830 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:39.171 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.166+0000 7f1315400640 1 -- 172.21.15.31:0/2674947117 >> 172.21.15.31:0/2674947117 conn(0x7f13100d1d30 msgr2=0x7f13100d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:39.171 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.166+0000 7f1315400640 1 -- 172.21.15.31:0/2674947117 shutdown_connections 2024-09-17T05:28:39.171 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.166+0000 7f1315400640 1 -- 172.21.15.31:0/2674947117 wait complete. 2024-09-17T05:28:39.171 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f1315400640 1 Processor -- start 2024-09-17T05:28:39.171 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f1315400640 1 -- start start 2024-09-17T05:28:39.175 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f1315400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13100c5f90 0x7f1310165f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:39.175 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f1315400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100cfe40 0x7f13100ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:39.175 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f1315400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13100aede0 0x7f1310158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:39.175 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f1315400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f13101695a0 con 0x7f13100aede0 2024-09-17T05:28:39.175 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f1315400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1310169420 con 0x7f13100c5f90 2024-09-17T05:28:39.175 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f1315400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1310169720 con 0x7f13100cfe40 2024-09-17T05:28:39.175 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f130f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13100aede0 0x7f1310158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:39.175 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f130de00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100cfe40 0x7f13100ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:39.175 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f130de00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100cfe40 0x7f13100ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:50670/0 (socket says 172.21.15.31:50670) 2024-09-17T05:28:39.175 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f130de00640 1 -- 172.21.15.31:0/4093582701 learned_addr learned my addr 172.21.15.31:0/4093582701 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:39.176 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f130e800640 1 --2- 172.21.15.31:0/4093582701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13100c5f90 0x7f1310165f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:39.176 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f130de00640 1 -- 172.21.15.31:0/4093582701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13100c5f90 msgr2=0x7f1310165f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:39.176 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f130de00640 1 --2- 172.21.15.31:0/4093582701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13100c5f90 0x7f1310165f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:39.176 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f130de00640 1 -- 172.21.15.31:0/4093582701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13100aede0 msgr2=0x7f1310158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:39.176 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f130de00640 1 --2- 172.21.15.31:0/4093582701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13100aede0 0x7f1310158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:39.176 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f130de00640 1 -- 172.21.15.31:0/4093582701 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13101fbaa0 con 0x7f13100cfe40 2024-09-17T05:28:39.176 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f130f200640 1 --2- 172.21.15.31:0/4093582701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13100aede0 0x7f1310158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:28:39.176 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f130de00640 1 --2- 172.21.15.31:0/4093582701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100cfe40 0x7f13100ae8a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f12fc009790 tx=0x7f12fc0a5700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:39.176 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f1306a00640 1 -- 172.21.15.31:0/4093582701 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0b2040 con 0x7f13100cfe40 2024-09-17T05:28:39.176 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f1306a00640 1 -- 172.21.15.31:0/4093582701 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12fc004430 con 0x7f13100cfe40 2024-09-17T05:28:39.176 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.170+0000 7f1315400640 1 -- 172.21.15.31:0/4093582701 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13101fbd80 con 0x7f13100cfe40 2024-09-17T05:28:39.176 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.174+0000 7f1306a00640 1 -- 172.21.15.31:0/4093582701 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12fc005280 con 0x7f13100cfe40 2024-09-17T05:28:39.176 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.174+0000 7f1315400640 1 -- 172.21.15.31:0/4093582701 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f13101fc340 con 0x7f13100cfe40 2024-09-17T05:28:39.177 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.174+0000 7f1315400640 1 -- 172.21.15.31:0/4093582701 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13100ce0d0 con 0x7f13100cfe40 2024-09-17T05:28:39.177 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.174+0000 7f1306a00640 1 -- 172.21.15.31:0/4093582701 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f12fc0be060 con 0x7f13100cfe40 2024-09-17T05:28:39.178 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.174+0000 7f1306a00640 1 --2- 172.21.15.31:0/4093582701 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f12f0073200 0x7f12f00756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:39.178 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.174+0000 7f1306a00640 1 -- 172.21.15.31:0/4093582701 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f12fc12d9a0 con 0x7f13100cfe40 2024-09-17T05:28:39.178 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.174+0000 7f130e800640 1 --2- 172.21.15.31:0/4093582701 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f12f0073200 0x7f12f00756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:39.179 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.178+0000 7f130e800640 1 --2- 172.21.15.31:0/4093582701 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f12f0073200 0x7f12f00756c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1310070370 tx=0x7f1300009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:39.182 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.178+0000 7f1306a00640 1 -- 172.21.15.31:0/4093582701 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f12fc016410 con 0x7f13100cfe40 2024-09-17T05:28:39.358 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.354+0000 7f1315400640 1 -- 172.21.15.31:0/4093582701 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13100d0660 con 0x7f13100cfe40 2024-09-17T05:28:39.359 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.358+0000 7f1306a00640 1 -- 172.21.15.31:0/4093582701 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12920 (secure 0 0 0) 0x7f12fc0f87c0 con 0x7f13100cfe40 2024-09-17T05:28:39.360 INFO:teuthology.misc.health.smithi031.stdout: 2024-09-17T05:28:39.360 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":17,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:28:35.580766+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:28:39.362 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.358+0000 7f1315400640 1 -- 172.21.15.31:0/4093582701 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f12f0073200 msgr2=0x7f12f00756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:39.362 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.358+0000 7f1315400640 1 --2- 172.21.15.31:0/4093582701 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f12f0073200 0x7f12f00756c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1310070370 tx=0x7f1300009040 comp rx=0 tx=0).stop 2024-09-17T05:28:39.362 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.358+0000 7f1315400640 1 -- 172.21.15.31:0/4093582701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100cfe40 msgr2=0x7f13100ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:39.362 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.358+0000 7f1315400640 1 --2- 172.21.15.31:0/4093582701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100cfe40 0x7f13100ae8a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f12fc009790 tx=0x7f12fc0a5700 comp rx=0 tx=0).stop 2024-09-17T05:28:39.362 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.358+0000 7f1315400640 1 -- 172.21.15.31:0/4093582701 shutdown_connections 2024-09-17T05:28:39.362 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.358+0000 7f1315400640 1 --2- 172.21.15.31:0/4093582701 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f12f0073200 0x7f12f00756c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:39.362 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.358+0000 7f1315400640 1 --2- 172.21.15.31:0/4093582701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13100aede0 0x7f1310158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:39.362 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.358+0000 7f1315400640 1 --2- 172.21.15.31:0/4093582701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13100cfe40 0x7f13100ae8a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:39.362 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.358+0000 7f1315400640 1 --2- 172.21.15.31:0/4093582701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13100c5f90 0x7f1310165f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:39.362 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.358+0000 7f1315400640 1 -- 172.21.15.31:0/4093582701 >> 172.21.15.31:0/4093582701 conn(0x7f13100d1d30 msgr2=0x7f1310071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:39.362 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.358+0000 7f1315400640 1 -- 172.21.15.31:0/4093582701 shutdown_connections 2024-09-17T05:28:39.363 INFO:teuthology.misc.health.smithi031.stderr:2024-09-17T05:28:39.358+0000 7f1315400640 1 -- 172.21.15.31:0/4093582701 wait complete. 2024-09-17T05:28:39.378 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-17T05:28:39.379 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T05:28:39.379 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:28:39.379 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:28:39.382 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:28:39.382 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:28:39.383 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:28:39.385 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:28:39.386 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:28:39.386 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:28:39.389 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:28:39.389 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:28:39.390 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:28:39.393 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:28:39.393 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-17T05:28:39.393 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:28:39.499 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-17T05:28:39.500 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-17T05:28:39.501 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-17T05:28:39.501 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-17T05:28:39.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.542+0000 7f25f2a00640 1 -- 172.21.15.31:0/2611386226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25ec0cdb30 msgr2=0x7f25ec0cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:39.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.542+0000 7f25f2a00640 1 --2- 172.21.15.31:0/2611386226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25ec0cdb30 0x7f25ec0cebb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009840 tx=0x7f25d401c820 comp rx=0 tx=0).stop 2024-09-17T05:28:39.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f2a00640 1 -- 172.21.15.31:0/2611386226 shutdown_connections 2024-09-17T05:28:39.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f2a00640 1 --2- 172.21.15.31:0/2611386226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25ec0cdb30 0x7f25ec0cebb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:39.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f2a00640 1 --2- 172.21.15.31:0/2611386226 >> v2:172.21.15.155:3300/0 conn(0x7f25ec15bea0 0x7f25ec0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:39.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f2a00640 1 -- 172.21.15.31:0/2611386226 >> 172.21.15.31:0/2611386226 conn(0x7f25ec0d1dc0 msgr2=0x7f25ec0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:39.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f2a00640 1 -- 172.21.15.31:0/2611386226 shutdown_connections 2024-09-17T05:28:39.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f2a00640 1 -- 172.21.15.31:0/2611386226 wait complete. 2024-09-17T05:28:39.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f2a00640 1 Processor -- start 2024-09-17T05:28:39.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f2a00640 1 -- start start 2024-09-17T05:28:39.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f2a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25ec0cdb30 0x7f25ec1fb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:39.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f2a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25ec0d28e0 0x7f25ec0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:39.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f2a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25ec15bea0 0x7f25ec157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:39.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f2a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec168fc0 con 0x7f25ec15bea0 2024-09-17T05:28:39.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f2a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec168e40 con 0x7f25ec0d28e0 2024-09-17T05:28:39.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f2a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f25ec169140 con 0x7f25ec0cdb30 2024-09-17T05:28:39.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f0a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25ec15bea0 0x7f25ec157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:39.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f0a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25ec15bea0 0x7f25ec157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60560/0 (socket says 172.21.15.31:60560) 2024-09-17T05:28:39.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f0a00640 1 -- 172.21.15.31:0/822839721 learned_addr learned my addr 172.21.15.31:0/822839721 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:39.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25e3e00640 1 --2- 172.21.15.31:0/822839721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25ec0d28e0 0x7f25ec0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:39.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25ebe00640 1 --2- 172.21.15.31:0/822839721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25ec0cdb30 0x7f25ec1fb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:39.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f0a00640 1 -- 172.21.15.31:0/822839721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25ec0cdb30 msgr2=0x7f25ec1fb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:39.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f0a00640 1 --2- 172.21.15.31:0/822839721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25ec0cdb30 0x7f25ec1fb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:39.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f0a00640 1 -- 172.21.15.31:0/822839721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25ec0d28e0 msgr2=0x7f25ec0b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:39.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f0a00640 1 --2- 172.21.15.31:0/822839721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25ec0d28e0 0x7f25ec0b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:39.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f0a00640 1 -- 172.21.15.31:0/822839721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ec0b1610 con 0x7f25ec15bea0 2024-09-17T05:28:39.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.546+0000 7f25f0a00640 1 --2- 172.21.15.31:0/822839721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25ec15bea0 0x7f25ec157530 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f25e400cbc0 tx=0x7f25e400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:39.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.550+0000 7f25e8c00640 1 -- 172.21.15.31:0/822839721 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e4016020 con 0x7f25ec15bea0 2024-09-17T05:28:39.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.550+0000 7f25e8c00640 1 -- 172.21.15.31:0/822839721 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25e400ab00 con 0x7f25ec15bea0 2024-09-17T05:28:39.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.550+0000 7f25e8c00640 1 -- 172.21.15.31:0/822839721 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e4012420 con 0x7f25ec15bea0 2024-09-17T05:28:39.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.550+0000 7f25f2a00640 1 -- 172.21.15.31:0/822839721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25ec0b1880 con 0x7f25ec15bea0 2024-09-17T05:28:39.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.550+0000 7f25f2a00640 1 -- 172.21.15.31:0/822839721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25ec157a70 con 0x7f25ec15bea0 2024-09-17T05:28:39.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.550+0000 7f25f2a00640 1 -- 172.21.15.31:0/822839721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25ec0cc9d0 con 0x7f25ec15bea0 2024-09-17T05:28:39.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.550+0000 7f25e8c00640 1 -- 172.21.15.31:0/822839721 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f25e4019020 con 0x7f25ec15bea0 2024-09-17T05:28:39.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.550+0000 7f25e8c00640 1 --2- 172.21.15.31:0/822839721 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f25c8073230 0x7f25c80756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:39.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.550+0000 7f25e8c00640 1 -- 172.21.15.31:0/822839721 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f25e4094110 con 0x7f25ec15bea0 2024-09-17T05:28:39.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.554+0000 7f25ebe00640 1 --2- 172.21.15.31:0/822839721 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f25c8073230 0x7f25c80756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:39.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.554+0000 7f25ebe00640 1 --2- 172.21.15.31:0/822839721 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f25c8073230 0x7f25c80756f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00bb50 tx=0x7f25dc00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:39.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.558+0000 7f25e8c00640 1 -- 172.21.15.31:0/822839721 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f25e4020020 con 0x7f25ec15bea0 2024-09-17T05:28:39.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.770+0000 7f25f2a00640 1 -- 172.21.15.31:0/822839721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25ec071af0 con 0x7f25ec15bea0 2024-09-17T05:28:39.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.770+0000 7f25e8c00640 1 -- 172.21.15.31:0/822839721 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1431 (secure 0 0 0) 0x7f25e405ed10 con 0x7f25ec15bea0 2024-09-17T05:28:39.773 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:39.774 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":2,"btime":"2024-09-17T05:28:39:515793+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/851893415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":851893415},{"type":"v1","addr":"172.21.15.31:6834","nonce":851893415}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-17T05:28:39.774 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 2 2024-09-17T05:28:39.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.774+0000 7f25f2a00640 1 -- 172.21.15.31:0/822839721 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f25c8073230 msgr2=0x7f25c80756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:39.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.774+0000 7f25f2a00640 1 --2- 172.21.15.31:0/822839721 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f25c8073230 0x7f25c80756f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00bb50 tx=0x7f25dc00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:28:39.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.774+0000 7f25f2a00640 1 -- 172.21.15.31:0/822839721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25ec15bea0 msgr2=0x7f25ec157530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:39.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.774+0000 7f25f2a00640 1 --2- 172.21.15.31:0/822839721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25ec15bea0 0x7f25ec157530 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f25e400cbc0 tx=0x7f25e400ccb0 comp rx=0 tx=0).stop 2024-09-17T05:28:39.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.774+0000 7f25f2a00640 1 -- 172.21.15.31:0/822839721 shutdown_connections 2024-09-17T05:28:39.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.774+0000 7f25f2a00640 1 --2- 172.21.15.31:0/822839721 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f25c8073230 0x7f25c80756f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:39.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.774+0000 7f25f2a00640 1 --2- 172.21.15.31:0/822839721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25ec15bea0 0x7f25ec157530 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:39.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.774+0000 7f25f2a00640 1 --2- 172.21.15.31:0/822839721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25ec0d28e0 0x7f25ec0b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:39.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.774+0000 7f25f2a00640 1 --2- 172.21.15.31:0/822839721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f25ec0cdb30 0x7f25ec1fb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:39.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.774+0000 7f25f2a00640 1 -- 172.21.15.31:0/822839721 >> 172.21.15.31:0/822839721 conn(0x7f25ec0d1dc0 msgr2=0x7f25ec070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:39.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.774+0000 7f25f2a00640 1 -- 172.21.15.31:0/822839721 shutdown_connections 2024-09-17T05:28:39.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:39.774+0000 7f25f2a00640 1 -- 172.21.15.31:0/822839721 wait complete. 2024-09-17T05:28:41.576 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:28:41.580 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:28:41.795 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:28:41.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.950+0000 7f5fd2a00640 1 -- 172.21.15.31:0/3573407665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fb00051d0 msgr2=0x7f5fb000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:41.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.950+0000 7f5fd2a00640 1 --2- 172.21.15.31:0/3573407665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fb00051d0 0x7f5fb000b9d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4009ee0 tx=0x7f5fc401d630 comp rx=0 tx=0).stop 2024-09-17T05:28:41.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.950+0000 7f5fd2a00640 1 -- 172.21.15.31:0/3573407665 shutdown_connections 2024-09-17T05:28:41.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.950+0000 7f5fd2a00640 1 --2- 172.21.15.31:0/3573407665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fb00051d0 0x7f5fb000b9d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:41.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.950+0000 7f5fd2a00640 1 -- 172.21.15.31:0/3573407665 >> 172.21.15.31:0/3573407665 conn(0x7f5fcc0d1dc0 msgr2=0x7f5fcc0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:41.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.950+0000 7f5fd2a00640 1 -- 172.21.15.31:0/3573407665 shutdown_connections 2024-09-17T05:28:41.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.950+0000 7f5fd2a00640 1 -- 172.21.15.31:0/3573407665 wait complete. 2024-09-17T05:28:41.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fd2a00640 1 Processor -- start 2024-09-17T05:28:41.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fd2a00640 1 -- start start 2024-09-17T05:28:41.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fd2a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fb00051d0 0x7f5fcc0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:41.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fd2a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fcc0b3d90 0x7f5fcc1f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:41.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fd2a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fcc154da0 0x7f5fcc156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:41.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fd2a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5fcc0d2a60 con 0x7f5fb00051d0 2024-09-17T05:28:41.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fd2a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5fcc0d28e0 con 0x7f5fcc0b3d90 2024-09-17T05:28:41.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fd2a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5fcc0d2be0 con 0x7f5fcc154da0 2024-09-17T05:28:41.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fcbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fb00051d0 0x7f5fcc0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:41.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fcbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fb00051d0 0x7f5fcc0b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60584/0 (socket says 172.21.15.31:60584) 2024-09-17T05:28:41.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fcbe00640 1 -- 172.21.15.31:0/2199248905 learned_addr learned my addr 172.21.15.31:0/2199248905 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:41.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fc3e00640 1 --2- 172.21.15.31:0/2199248905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fcc0b3d90 0x7f5fcc1f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:41.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fd0a00640 1 --2- 172.21.15.31:0/2199248905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fcc154da0 0x7f5fcc156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:41.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fcbe00640 1 -- 172.21.15.31:0/2199248905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fcc154da0 msgr2=0x7f5fcc156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:41.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fcbe00640 1 --2- 172.21.15.31:0/2199248905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fcc154da0 0x7f5fcc156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:41.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fcbe00640 1 -- 172.21.15.31:0/2199248905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fcc0b3d90 msgr2=0x7f5fcc1f4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:41.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fcbe00640 1 --2- 172.21.15.31:0/2199248905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fcc0b3d90 0x7f5fcc1f4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:41.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fcbe00640 1 -- 172.21.15.31:0/2199248905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fcc0b4450 con 0x7f5fb00051d0 2024-09-17T05:28:41.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fc3e00640 1 --2- 172.21.15.31:0/2199248905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fcc0b3d90 0x7f5fcc1f4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:28:41.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fd0a00640 1 --2- 172.21.15.31:0/2199248905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fcc154da0 0x7f5fcc156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:28:41.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fcbe00640 1 --2- 172.21.15.31:0/2199248905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fb00051d0 0x7f5fcc0b25a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc004dd0 tx=0x7f5fbc001740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:41.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fc8c00640 1 -- 172.21.15.31:0/2199248905 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc0107d0 con 0x7f5fb00051d0 2024-09-17T05:28:41.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fc8c00640 1 -- 172.21.15.31:0/2199248905 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fbc016070 con 0x7f5fb00051d0 2024-09-17T05:28:41.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fc8c00640 1 -- 172.21.15.31:0/2199248905 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc010d20 con 0x7f5fb00051d0 2024-09-17T05:28:41.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fd2a00640 1 -- 172.21.15.31:0/2199248905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fcc1f5510 con 0x7f5fb00051d0 2024-09-17T05:28:41.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fd2a00640 1 -- 172.21.15.31:0/2199248905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fcc0b1ac0 con 0x7f5fb00051d0 2024-09-17T05:28:41.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.954+0000 7f5fd2a00640 1 -- 172.21.15.31:0/2199248905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fcc0ce910 con 0x7f5fb00051d0 2024-09-17T05:28:41.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.958+0000 7f5fc8c00640 1 -- 172.21.15.31:0/2199248905 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5fbc01b460 con 0x7f5fb00051d0 2024-09-17T05:28:41.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.958+0000 7f5fc8c00640 1 --2- 172.21.15.31:0/2199248905 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5fa8073200 0x7f5fa80756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:41.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.958+0000 7f5fc8c00640 1 -- 172.21.15.31:0/2199248905 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f5fbc0952b0 con 0x7f5fb00051d0 2024-09-17T05:28:41.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.958+0000 7f5fc3e00640 1 --2- 172.21.15.31:0/2199248905 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5fa8073200 0x7f5fa80756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:41.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.958+0000 7f5fc3e00640 1 --2- 172.21.15.31:0/2199248905 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5fa8073200 0x7f5fa80756c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0b46a0 tx=0x7f5fb4006730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:41.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:41.962+0000 7f5fc8c00640 1 -- 172.21.15.31:0/2199248905 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5fbc060720 con 0x7f5fb00051d0 2024-09-17T05:28:42.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.170+0000 7f5fd2a00640 1 -- 172.21.15.31:0/2199248905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5fcc0ce3a0 con 0x7f5fb00051d0 2024-09-17T05:28:42.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.174+0000 7f5fc8c00640 1 -- 172.21.15.31:0/2199248905 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3909 (secure 0 0 0) 0x7f5fbc060020 con 0x7f5fb00051d0 2024-09-17T05:28:42.175 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:42.176 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":3,"btime":"2024-09-17T05:28:40:517503+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/3491154284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3491154284},{"type":"v1","addr":"172.21.15.155:6836","nonce":3491154284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4301,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3619522478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3619522478},{"type":"v1","addr":"172.21.15.155:6837","nonce":3619522478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/851893415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":851893415},{"type":"v1","addr":"172.21.15.31:6834","nonce":851893415}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4380,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3393035146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3393035146},{"type":"v1","addr":"172.21.15.31:6835","nonce":3393035146}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-17T05:28:42.176 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 3 2024-09-17T05:28:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.174+0000 7f5fd2a00640 1 -- 172.21.15.31:0/2199248905 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5fa8073200 msgr2=0x7f5fa80756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.174+0000 7f5fd2a00640 1 --2- 172.21.15.31:0/2199248905 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5fa8073200 0x7f5fa80756c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0b46a0 tx=0x7f5fb4006730 comp rx=0 tx=0).stop 2024-09-17T05:28:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.174+0000 7f5fd2a00640 1 -- 172.21.15.31:0/2199248905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fb00051d0 msgr2=0x7f5fcc0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.174+0000 7f5fd2a00640 1 --2- 172.21.15.31:0/2199248905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fb00051d0 0x7f5fcc0b25a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc004dd0 tx=0x7f5fbc001740 comp rx=0 tx=0).stop 2024-09-17T05:28:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.174+0000 7f5fd2a00640 1 -- 172.21.15.31:0/2199248905 shutdown_connections 2024-09-17T05:28:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.174+0000 7f5fd2a00640 1 --2- 172.21.15.31:0/2199248905 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5fa8073200 0x7f5fa80756c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.174+0000 7f5fd2a00640 1 --2- 172.21.15.31:0/2199248905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fcc154da0 0x7f5fcc156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.174+0000 7f5fd2a00640 1 --2- 172.21.15.31:0/2199248905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fcc0b3d90 0x7f5fcc1f4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.174+0000 7f5fd2a00640 1 --2- 172.21.15.31:0/2199248905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fb00051d0 0x7f5fcc0b25a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.174+0000 7f5fd2a00640 1 -- 172.21.15.31:0/2199248905 >> 172.21.15.31:0/2199248905 conn(0x7f5fcc0d1dc0 msgr2=0x7f5fcc0aedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:42.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.174+0000 7f5fd2a00640 1 -- 172.21.15.31:0/2199248905 shutdown_connections 2024-09-17T05:28:42.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.174+0000 7f5fd2a00640 1 -- 172.21.15.31:0/2199248905 wait complete. 2024-09-17T05:28:42.198 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:28:42.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.342+0000 7f284b200640 1 -- 172.21.15.31:0/2012396066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f284c15dd70 msgr2=0x7f284c0ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:42.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.342+0000 7f284b200640 1 --2- 172.21.15.31:0/2012396066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f284c15dd70 0x7f284c0ccd60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f284c0d0ad0 tx=0x7f283c01c7d0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.342+0000 7f284b200640 1 -- 172.21.15.31:0/2012396066 shutdown_connections 2024-09-17T05:28:42.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.342+0000 7f284b200640 1 --2- 172.21.15.31:0/2012396066 >> v2:172.21.15.155:3300/0 conn(0x7f284c0cc650 0x7f284c06cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.342+0000 7f284b200640 1 --2- 172.21.15.31:0/2012396066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f284c15dd70 0x7f284c0ccd60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.342+0000 7f284b200640 1 -- 172.21.15.31:0/2012396066 >> 172.21.15.31:0/2012396066 conn(0x7f284c06dd30 msgr2=0x7f284c06e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:42.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.342+0000 7f284b200640 1 -- 172.21.15.31:0/2012396066 shutdown_connections 2024-09-17T05:28:42.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.342+0000 7f284b200640 1 -- 172.21.15.31:0/2012396066 wait complete. 2024-09-17T05:28:42.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.342+0000 7f284b200640 1 Processor -- start 2024-09-17T05:28:42.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.342+0000 7f284b200640 1 -- start start 2024-09-17T05:28:42.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f284b200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f284c0cc650 0x7f284c155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:42.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f284b200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f284c15dd70 0x7f284c09ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:42.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f284b200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f284c15f440 0x7f284c09f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:42.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f284b200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f284c16b000 con 0x7f284c15dd70 2024-09-17T05:28:42.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f284b200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f284c16ae80 con 0x7f284c0cc650 2024-09-17T05:28:42.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f284b200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f284c16b180 con 0x7f284c15f440 2024-09-17T05:28:42.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f2849400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f284c15dd70 0x7f284c09ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:42.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f2849400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f284c15dd70 0x7f284c09ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60598/0 (socket says 172.21.15.31:60598) 2024-09-17T05:28:42.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f2849400640 1 -- 172.21.15.31:0/2696107410 learned_addr learned my addr 172.21.15.31:0/2696107410 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:42.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f2849e00640 1 --2- 172.21.15.31:0/2696107410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f284c0cc650 0x7f284c155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:42.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f284a800640 1 --2- 172.21.15.31:0/2696107410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f284c15f440 0x7f284c09f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:42.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f2849400640 1 -- 172.21.15.31:0/2696107410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f284c15f440 msgr2=0x7f284c09f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:42.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f2849400640 1 --2- 172.21.15.31:0/2696107410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f284c15f440 0x7f284c09f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f2849400640 1 -- 172.21.15.31:0/2696107410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f284c0cc650 msgr2=0x7f284c155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:42.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f2849400640 1 --2- 172.21.15.31:0/2696107410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f284c0cc650 0x7f284c155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f2849400640 1 -- 172.21.15.31:0/2696107410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284c156cd0 con 0x7f284c15dd70 2024-09-17T05:28:42.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f2849400640 1 --2- 172.21.15.31:0/2696107410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f284c15dd70 0x7f284c09ee20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f283800d950 tx=0x7f283800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:42.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f2842000640 1 -- 172.21.15.31:0/2696107410 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2838017070 con 0x7f284c15dd70 2024-09-17T05:28:42.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f2842000640 1 -- 172.21.15.31:0/2696107410 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2838009d20 con 0x7f284c15dd70 2024-09-17T05:28:42.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f2842000640 1 -- 172.21.15.31:0/2696107410 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28380106c0 con 0x7f284c15dd70 2024-09-17T05:28:42.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f284b200640 1 -- 172.21.15.31:0/2696107410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f284c156fb0 con 0x7f284c15dd70 2024-09-17T05:28:42.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f284b200640 1 -- 172.21.15.31:0/2696107410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f284c157570 con 0x7f284c15dd70 2024-09-17T05:28:42.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.346+0000 7f284b200640 1 -- 172.21.15.31:0/2696107410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f284c0caf30 con 0x7f284c15dd70 2024-09-17T05:28:42.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.350+0000 7f2842000640 1 -- 172.21.15.31:0/2696107410 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f283801a070 con 0x7f284c15dd70 2024-09-17T05:28:42.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.350+0000 7f2842000640 1 --2- 172.21.15.31:0/2696107410 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f282c073200 0x7f282c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:42.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.350+0000 7f2842000640 1 -- 172.21.15.31:0/2696107410 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2838094090 con 0x7f284c15dd70 2024-09-17T05:28:42.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.350+0000 7f2849e00640 1 --2- 172.21.15.31:0/2696107410 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f282c073200 0x7f282c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:42.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.350+0000 7f2849e00640 1 --2- 172.21.15.31:0/2696107410 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f282c073200 0x7f282c0756c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f283c0af000 tx=0x7f283c01b010 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:42.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.354+0000 7f2842000640 1 -- 172.21.15.31:0/2696107410 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f283805eda0 con 0x7f284c15dd70 2024-09-17T05:28:42.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.530+0000 7f284b200640 1 -- 172.21.15.31:0/2696107410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f284c0d0b10 con 0x7f284c15dd70 2024-09-17T05:28:42.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.530+0000 7f2842000640 1 -- 172.21.15.31:0/2696107410 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f28380637d0 con 0x7f284c15dd70 2024-09-17T05:28:42.534 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:42.534 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:28:42.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:28:42.535 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-09-17T05:28:42.535 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-09-17T05:28:42.535 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:28:42.535 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:28:42.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.534+0000 7f284b200640 1 -- 172.21.15.31:0/2696107410 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f282c073200 msgr2=0x7f282c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:42.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.534+0000 7f284b200640 1 --2- 172.21.15.31:0/2696107410 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f282c073200 0x7f282c0756c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f283c0af000 tx=0x7f283c01b010 comp rx=0 tx=0).stop 2024-09-17T05:28:42.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.534+0000 7f284b200640 1 -- 172.21.15.31:0/2696107410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f284c15dd70 msgr2=0x7f284c09ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:42.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.534+0000 7f284b200640 1 --2- 172.21.15.31:0/2696107410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f284c15dd70 0x7f284c09ee20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f283800d950 tx=0x7f283800de10 comp rx=0 tx=0).stop 2024-09-17T05:28:42.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.534+0000 7f284b200640 1 -- 172.21.15.31:0/2696107410 shutdown_connections 2024-09-17T05:28:42.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.534+0000 7f284b200640 1 --2- 172.21.15.31:0/2696107410 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f282c073200 0x7f282c0756c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.534+0000 7f284b200640 1 --2- 172.21.15.31:0/2696107410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f284c15f440 0x7f284c09f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.534+0000 7f284b200640 1 --2- 172.21.15.31:0/2696107410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f284c15dd70 0x7f284c09ee20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.534+0000 7f284b200640 1 --2- 172.21.15.31:0/2696107410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f284c0cc650 0x7f284c155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.534+0000 7f284b200640 1 -- 172.21.15.31:0/2696107410 >> 172.21.15.31:0/2696107410 conn(0x7f284c06dd30 msgr2=0x7f284c0d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.534+0000 7f284b200640 1 -- 172.21.15.31:0/2696107410 shutdown_connections 2024-09-17T05:28:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.534+0000 7f284b200640 1 -- 172.21.15.31:0/2696107410 wait complete. 2024-09-17T05:28:42.555 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:28:42.556 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:28:42.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.706+0000 7f9c11200640 1 -- 172.21.15.31:0/880791635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c0c15c1f0 msgr2=0x7f9c0c0cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:42.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.706+0000 7f9c11200640 1 --2- 172.21.15.31:0/880791635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c0c15c1f0 0x7f9c0c0cec40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c074e00 tx=0x7f9bf401f0b0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.706+0000 7f9c11200640 1 -- 172.21.15.31:0/880791635 shutdown_connections 2024-09-17T05:28:42.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.706+0000 7f9c11200640 1 --2- 172.21.15.31:0/880791635 >> v2:172.21.15.155:3300/0 conn(0x7f9c0c0b0b60 0x7f9c0c0cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.706+0000 7f9c11200640 1 --2- 172.21.15.31:0/880791635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c0c15c1f0 0x7f9c0c0cec40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.706+0000 7f9c11200640 1 --2- 172.21.15.31:0/880791635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c0c15be10 0x7f9c0c0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.706+0000 7f9c11200640 1 -- 172.21.15.31:0/880791635 >> 172.21.15.31:0/880791635 conn(0x7f9c0c0d1da0 msgr2=0x7f9c0c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:42.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.706+0000 7f9c11200640 1 -- 172.21.15.31:0/880791635 shutdown_connections 2024-09-17T05:28:42.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.706+0000 7f9c11200640 1 -- 172.21.15.31:0/880791635 wait complete. 2024-09-17T05:28:42.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.706+0000 7f9c11200640 1 Processor -- start 2024-09-17T05:28:42.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.706+0000 7f9c11200640 1 -- start start 2024-09-17T05:28:42.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c11200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c0c0b0b60 0x7f9c0c0c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:42.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c11200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c0c15be10 0x7f9c0c1f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:42.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c11200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c0c15c1f0 0x7f9c0c1f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:42.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c11200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c1600a0 con 0x7f9c0c0b0b60 2024-09-17T05:28:42.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c11200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c15ff20 con 0x7f9c0c15be10 2024-09-17T05:28:42.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c11200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9c0c160220 con 0x7f9c0c15c1f0 2024-09-17T05:28:42.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c09e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c0c0b0b60 0x7f9c0c0c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:42.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c09e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c0c0b0b60 0x7f9c0c0c7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60616/0 (socket says 172.21.15.31:60616) 2024-09-17T05:28:42.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c09e00640 1 -- 172.21.15.31:0/2996297583 learned_addr learned my addr 172.21.15.31:0/2996297583 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:42.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c03e00640 1 --2- 172.21.15.31:0/2996297583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c0c15be10 0x7f9c0c1f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:42.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c0a800640 1 --2- 172.21.15.31:0/2996297583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c0c15c1f0 0x7f9c0c1f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:42.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c09e00640 1 -- 172.21.15.31:0/2996297583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c0c15c1f0 msgr2=0x7f9c0c1f5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:42.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c09e00640 1 --2- 172.21.15.31:0/2996297583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c0c15c1f0 0x7f9c0c1f5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c09e00640 1 -- 172.21.15.31:0/2996297583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c0c15be10 msgr2=0x7f9c0c1f50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:42.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c09e00640 1 --2- 172.21.15.31:0/2996297583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c0c15be10 0x7f9c0c1f50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:42.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c09e00640 1 -- 172.21.15.31:0/2996297583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0c0b7410 con 0x7f9c0c0b0b60 2024-09-17T05:28:42.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c09e00640 1 --2- 172.21.15.31:0/2996297583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c0c0b0b60 0x7f9c0c0c7070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00d980 tx=0x7f9bfc00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:42.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c02000640 1 -- 172.21.15.31:0/2996297583 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc017070 con 0x7f9c0c0b0b60 2024-09-17T05:28:42.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c02000640 1 -- 172.21.15.31:0/2996297583 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bfc009d60 con 0x7f9c0c0b0b60 2024-09-17T05:28:42.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c02000640 1 -- 172.21.15.31:0/2996297583 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc005280 con 0x7f9c0c0b0b60 2024-09-17T05:28:42.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c11200640 1 -- 172.21.15.31:0/2996297583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0c0b7690 con 0x7f9c0c0b0b60 2024-09-17T05:28:42.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c11200640 1 -- 172.21.15.31:0/2996297583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c0c0cb3c0 con 0x7f9c0c0b0b60 2024-09-17T05:28:42.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c11200640 1 -- 172.21.15.31:0/2996297583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c0c1606d0 con 0x7f9c0c0b0b60 2024-09-17T05:28:42.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.710+0000 7f9c02000640 1 -- 172.21.15.31:0/2996297583 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9bfc005420 con 0x7f9c0c0b0b60 2024-09-17T05:28:42.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.714+0000 7f9c02000640 1 --2- 172.21.15.31:0/2996297583 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9be8073200 0x7f9be80756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:42.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.714+0000 7f9c02000640 1 -- 172.21.15.31:0/2996297583 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f9bfc094080 con 0x7f9c0c0b0b60 2024-09-17T05:28:42.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.714+0000 7f9c03e00640 1 --2- 172.21.15.31:0/2996297583 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9be8073200 0x7f9be80756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:42.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.714+0000 7f9c03e00640 1 --2- 172.21.15.31:0/2996297583 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9be8073200 0x7f9be80756c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40b2000 tx=0x7f9bf401d8f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:42.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.718+0000 7f9c02000640 1 -- 172.21.15.31:0/2996297583 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9c0c0b7410 con 0x7f9c0c0b0b60 2024-09-17T05:28:42.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:42.894+0000 7f9c11200640 1 -- 172.21.15.31:0/2996297583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9c0c070350 con 0x7f9c0c0b0b60 2024-09-17T05:28:43.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.630+0000 7f9c02000640 1 -- 172.21.15.31:0/2996297583 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f9bfc05eda0 con 0x7f9c0c0b0b60 2024-09-17T05:28:43.631 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-09-17T05:28:43.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.630+0000 7f9c11200640 1 -- 172.21.15.31:0/2996297583 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9be8073200 msgr2=0x7f9be80756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:43.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.630+0000 7f9c11200640 1 --2- 172.21.15.31:0/2996297583 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9be8073200 0x7f9be80756c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40b2000 tx=0x7f9bf401d8f0 comp rx=0 tx=0).stop 2024-09-17T05:28:43.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.630+0000 7f9c11200640 1 -- 172.21.15.31:0/2996297583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c0c0b0b60 msgr2=0x7f9c0c0c7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:43.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.630+0000 7f9c11200640 1 --2- 172.21.15.31:0/2996297583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c0c0b0b60 0x7f9c0c0c7070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc00d980 tx=0x7f9bfc00de40 comp rx=0 tx=0).stop 2024-09-17T05:28:43.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.634+0000 7f9c11200640 1 -- 172.21.15.31:0/2996297583 shutdown_connections 2024-09-17T05:28:43.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.634+0000 7f9c11200640 1 --2- 172.21.15.31:0/2996297583 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9be8073200 0x7f9be80756c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:43.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.634+0000 7f9c11200640 1 --2- 172.21.15.31:0/2996297583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c0c15c1f0 0x7f9c0c1f5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:43.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.634+0000 7f9c11200640 1 --2- 172.21.15.31:0/2996297583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c0c15be10 0x7f9c0c1f50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:43.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.634+0000 7f9c11200640 1 --2- 172.21.15.31:0/2996297583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c0c0b0b60 0x7f9c0c0c7070 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:43.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.634+0000 7f9c11200640 1 -- 172.21.15.31:0/2996297583 >> 172.21.15.31:0/2996297583 conn(0x7f9c0c0d1da0 msgr2=0x7f9c0c0aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:43.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.634+0000 7f9c11200640 1 -- 172.21.15.31:0/2996297583 shutdown_connections 2024-09-17T05:28:43.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.634+0000 7f9c11200640 1 -- 172.21.15.31:0/2996297583 wait complete. 2024-09-17T05:28:43.665 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:28:43.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377fe00640 1 -- 172.21.15.31:0/2506354299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37800b25e0 msgr2=0x7f37800af540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:43.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377fe00640 1 --2- 172.21.15.31:0/2506354299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37800b25e0 0x7f37800af540 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3778009c80 tx=0x7f377801cd70 comp rx=0 tx=0).stop 2024-09-17T05:28:43.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377fe00640 1 -- 172.21.15.31:0/2506354299 shutdown_connections 2024-09-17T05:28:43.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377fe00640 1 --2- 172.21.15.31:0/2506354299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37800b25e0 0x7f37800af540 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:43.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377fe00640 1 --2- 172.21.15.31:0/2506354299 >> v2:172.21.15.155:3300/0 conn(0x7f37800d2810 0x7f3780160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:43.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377fe00640 1 -- 172.21.15.31:0/2506354299 >> 172.21.15.31:0/2506354299 conn(0x7f37800d1cf0 msgr2=0x7f37800d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:43.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377fe00640 1 -- 172.21.15.31:0/2506354299 shutdown_connections 2024-09-17T05:28:43.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377fe00640 1 -- 172.21.15.31:0/2506354299 wait complete. 2024-09-17T05:28:43.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377fe00640 1 Processor -- start 2024-09-17T05:28:43.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377fe00640 1 -- start start 2024-09-17T05:28:43.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37800b25e0 0x7f378006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:43.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377fe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37800cfd30 0x7f3780154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:43.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37800d2810 0x7f3780166220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:43.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377fe00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3780168f10 con 0x7f37800d2810 2024-09-17T05:28:43.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377fe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f37800b07b0 con 0x7f37800cfd30 2024-09-17T05:28:43.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377fe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3780169090 con 0x7f37800b25e0 2024-09-17T05:28:43.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37800d2810 0x7f3780166220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:43.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37800d2810 0x7f3780166220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60620/0 (socket says 172.21.15.31:60620) 2024-09-17T05:28:43.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.822+0000 7f377f400640 1 -- 172.21.15.31:0/2308004675 learned_addr learned my addr 172.21.15.31:0/2308004675 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:43.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.826+0000 7f3777e00640 1 --2- 172.21.15.31:0/2308004675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37800cfd30 0x7f3780154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:43.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.826+0000 7f377ea00640 1 --2- 172.21.15.31:0/2308004675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37800b25e0 0x7f378006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:43.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.826+0000 7f377f400640 1 -- 172.21.15.31:0/2308004675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37800b25e0 msgr2=0x7f378006f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:43.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.826+0000 7f377f400640 1 --2- 172.21.15.31:0/2308004675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37800b25e0 0x7f378006f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:43.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.826+0000 7f377f400640 1 -- 172.21.15.31:0/2308004675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37800cfd30 msgr2=0x7f3780154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:43.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.826+0000 7f377f400640 1 --2- 172.21.15.31:0/2308004675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37800cfd30 0x7f3780154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:43.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.826+0000 7f377f400640 1 -- 172.21.15.31:0/2308004675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37801f7710 con 0x7f37800d2810 2024-09-17T05:28:43.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.826+0000 7f377f400640 1 --2- 172.21.15.31:0/2308004675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37800d2810 0x7f3780166220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3778009bd0 tx=0x7f3778003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:43.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.826+0000 7f3776a00640 1 -- 172.21.15.31:0/2308004675 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37780bb070 con 0x7f37800d2810 2024-09-17T05:28:43.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.826+0000 7f3776a00640 1 -- 172.21.15.31:0/2308004675 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3778004d40 con 0x7f37800d2810 2024-09-17T05:28:43.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.826+0000 7f3776a00640 1 -- 172.21.15.31:0/2308004675 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37780b2040 con 0x7f37800d2810 2024-09-17T05:28:43.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.826+0000 7f377fe00640 1 -- 172.21.15.31:0/2308004675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37801fb600 con 0x7f37800d2810 2024-09-17T05:28:43.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.826+0000 7f377fe00640 1 -- 172.21.15.31:0/2308004675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3780165710 con 0x7f37800d2810 2024-09-17T05:28:43.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.826+0000 7f377fe00640 1 -- 172.21.15.31:0/2308004675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3780165500 con 0x7f37800d2810 2024-09-17T05:28:43.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.826+0000 7f3776a00640 1 -- 172.21.15.31:0/2308004675 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f37780ad850 con 0x7f37800d2810 2024-09-17T05:28:43.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.830+0000 7f3776a00640 1 --2- 172.21.15.31:0/2308004675 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f375c073200 0x7f375c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:43.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.830+0000 7f3776a00640 1 -- 172.21.15.31:0/2308004675 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f377812e530 con 0x7f37800d2810 2024-09-17T05:28:43.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.830+0000 7f377ea00640 1 --2- 172.21.15.31:0/2308004675 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f375c073200 0x7f375c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:43.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.830+0000 7f377ea00640 1 --2- 172.21.15.31:0/2308004675 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f375c073200 0x7f375c0756c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3770000f70 tx=0x7f3770009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:43.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:43.830+0000 7f3776a00640 1 -- 172.21.15.31:0/2308004675 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f37780c4070 con 0x7f37800d2810 2024-09-17T05:28:44.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.010+0000 7f377fe00640 1 -- 172.21.15.31:0/2308004675 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f37800af540 con 0x7f37800d2810 2024-09-17T05:28:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.630+0000 7f3776a00640 1 -- 172.21.15.31:0/2308004675 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f3778016990 con 0x7f37800d2810 2024-09-17T05:28:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-09-17T05:28:44.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.634+0000 7f377fe00640 1 -- 172.21.15.31:0/2308004675 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f375c073200 msgr2=0x7f375c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:44.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.634+0000 7f377fe00640 1 --2- 172.21.15.31:0/2308004675 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f375c073200 0x7f375c0756c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3770000f70 tx=0x7f3770009040 comp rx=0 tx=0).stop 2024-09-17T05:28:44.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.634+0000 7f377fe00640 1 -- 172.21.15.31:0/2308004675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37800d2810 msgr2=0x7f3780166220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:44.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.634+0000 7f377fe00640 1 --2- 172.21.15.31:0/2308004675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37800d2810 0x7f3780166220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3778009bd0 tx=0x7f3778003f40 comp rx=0 tx=0).stop 2024-09-17T05:28:44.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.634+0000 7f377fe00640 1 -- 172.21.15.31:0/2308004675 shutdown_connections 2024-09-17T05:28:44.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.634+0000 7f377fe00640 1 --2- 172.21.15.31:0/2308004675 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f375c073200 0x7f375c0756c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:44.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.634+0000 7f377fe00640 1 --2- 172.21.15.31:0/2308004675 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37800d2810 0x7f3780166220 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:44.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.634+0000 7f377fe00640 1 --2- 172.21.15.31:0/2308004675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37800cfd30 0x7f3780154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:44.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.634+0000 7f377fe00640 1 --2- 172.21.15.31:0/2308004675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37800b25e0 0x7f378006f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:44.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.634+0000 7f377fe00640 1 -- 172.21.15.31:0/2308004675 >> 172.21.15.31:0/2308004675 conn(0x7f37800d1cf0 msgr2=0x7f37800b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:44.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.634+0000 7f377fe00640 1 -- 172.21.15.31:0/2308004675 shutdown_connections 2024-09-17T05:28:44.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.634+0000 7f377fe00640 1 -- 172.21.15.31:0/2308004675 wait complete. 2024-09-17T05:28:44.681 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:28:44.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.830+0000 7f5bfa600640 1 -- 172.21.15.31:0/2084783099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bf415f640 msgr2=0x7f5bf40cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:44.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.830+0000 7f5bfa600640 1 --2- 172.21.15.31:0/2084783099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bf415f640 0x7f5bf40cd510 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5be40098f0 tx=0x7f5be401c7c0 comp rx=0 tx=0).stop 2024-09-17T05:28:44.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.830+0000 7f5bfa600640 1 -- 172.21.15.31:0/2084783099 shutdown_connections 2024-09-17T05:28:44.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.830+0000 7f5bfa600640 1 --2- 172.21.15.31:0/2084783099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bf415f640 0x7f5bf40cd510 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:44.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.830+0000 7f5bfa600640 1 -- 172.21.15.31:0/2084783099 >> 172.21.15.31:0/2084783099 conn(0x7f5bf40d1e30 msgr2=0x7f5bf40d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:44.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.830+0000 7f5bfa600640 1 -- 172.21.15.31:0/2084783099 shutdown_connections 2024-09-17T05:28:44.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.830+0000 7f5bfa600640 1 -- 172.21.15.31:0/2084783099 wait complete. 2024-09-17T05:28:44.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.830+0000 7f5bfa600640 1 Processor -- start 2024-09-17T05:28:44.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.830+0000 7f5bfa600640 1 -- start start 2024-09-17T05:28:44.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bfa600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bf40ce7f0 0x7f5bf4154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:44.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bfa600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bf415f640 0x7f5bf406f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:44.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bfa600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bf406dd30 0x7f5bf40afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:44.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bfa600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf416a840 con 0x7f5bf406dd30 2024-09-17T05:28:44.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bfa600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf416a6c0 con 0x7f5bf40ce7f0 2024-09-17T05:28:44.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bfa600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5bf416a9c0 con 0x7f5bf415f640 2024-09-17T05:28:44.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bf3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bf406dd30 0x7f5bf40afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:44.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bf3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bf406dd30 0x7f5bf40afce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60640/0 (socket says 172.21.15.31:60640) 2024-09-17T05:28:44.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bf3400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bf40ce7f0 0x7f5bf4154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:44.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bf3e00640 1 -- 172.21.15.31:0/1964939614 learned_addr learned my addr 172.21.15.31:0/1964939614 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:44.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bf2a00640 1 --2- 172.21.15.31:0/1964939614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bf415f640 0x7f5bf406f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bf3e00640 1 -- 172.21.15.31:0/1964939614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bf415f640 msgr2=0x7f5bf406f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bf3e00640 1 --2- 172.21.15.31:0/1964939614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bf415f640 0x7f5bf406f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bf3e00640 1 -- 172.21.15.31:0/1964939614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bf40ce7f0 msgr2=0x7f5bf4154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bf3e00640 1 --2- 172.21.15.31:0/1964939614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bf40ce7f0 0x7f5bf4154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bf3e00640 1 -- 172.21.15.31:0/1964939614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf4156cd0 con 0x7f5bf406dd30 2024-09-17T05:28:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bf3e00640 1 --2- 172.21.15.31:0/1964939614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bf406dd30 0x7f5bf40afce0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00c7c0 tx=0x7f5bec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5beb400640 1 -- 172.21.15.31:0/1964939614 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec003b80 con 0x7f5bf406dd30 2024-09-17T05:28:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5beb400640 1 -- 172.21.15.31:0/1964939614 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bec003d20 con 0x7f5bf406dd30 2024-09-17T05:28:44.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bfa600640 1 -- 172.21.15.31:0/1964939614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf4156fb0 con 0x7f5bf406dd30 2024-09-17T05:28:44.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5beb400640 1 -- 172.21.15.31:0/1964939614 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec00aab0 con 0x7f5bf406dd30 2024-09-17T05:28:44.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bfa600640 1 -- 172.21.15.31:0/1964939614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf406f1b0 con 0x7f5bf406dd30 2024-09-17T05:28:44.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.834+0000 7f5bfa600640 1 -- 172.21.15.31:0/1964939614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf406ed00 con 0x7f5bf406dd30 2024-09-17T05:28:44.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.838+0000 7f5beb400640 1 -- 172.21.15.31:0/1964939614 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5bec00ac50 con 0x7f5bf406dd30 2024-09-17T05:28:44.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.838+0000 7f5beb400640 1 --2- 172.21.15.31:0/1964939614 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5bd4073230 0x7f5bd40756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:44.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.838+0000 7f5beb400640 1 -- 172.21.15.31:0/1964939614 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f5bec0949d0 con 0x7f5bf406dd30 2024-09-17T05:28:44.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.838+0000 7f5bf3400640 1 --2- 172.21.15.31:0/1964939614 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5bd4073230 0x7f5bd40756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:44.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.838+0000 7f5bf3400640 1 --2- 172.21.15.31:0/1964939614 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5bd4073230 0x7f5bd40756f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5be40af000 tx=0x7f5be401b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:44.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:44.842+0000 7f5beb400640 1 -- 172.21.15.31:0/1964939614 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5bec05f470 con 0x7f5bf406dd30 2024-09-17T05:28:45.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.054+0000 7f5bfa600640 1 -- 172.21.15.31:0/1964939614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f5bf406f3b0 con 0x7f5bf406dd30 2024-09-17T05:28:45.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.662+0000 7f5beb400640 1 -- 172.21.15.31:0/1964939614 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f5bf406f3b0 con 0x7f5bf406dd30 2024-09-17T05:28:45.664 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 2 and data pool 3 2024-09-17T05:28:45.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.670+0000 7f5bfa600640 1 -- 172.21.15.31:0/1964939614 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5bd4073230 msgr2=0x7f5bd40756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:45.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.670+0000 7f5bfa600640 1 --2- 172.21.15.31:0/1964939614 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5bd4073230 0x7f5bd40756f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5be40af000 tx=0x7f5be401b000 comp rx=0 tx=0).stop 2024-09-17T05:28:45.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.670+0000 7f5bfa600640 1 -- 172.21.15.31:0/1964939614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bf406dd30 msgr2=0x7f5bf40afce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:45.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.670+0000 7f5bfa600640 1 --2- 172.21.15.31:0/1964939614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bf406dd30 0x7f5bf40afce0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00c7c0 tx=0x7f5bec00cc80 comp rx=0 tx=0).stop 2024-09-17T05:28:45.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.670+0000 7f5bfa600640 1 -- 172.21.15.31:0/1964939614 shutdown_connections 2024-09-17T05:28:45.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.670+0000 7f5bfa600640 1 --2- 172.21.15.31:0/1964939614 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5bd4073230 0x7f5bd40756f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:45.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.670+0000 7f5bfa600640 1 --2- 172.21.15.31:0/1964939614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bf406dd30 0x7f5bf40afce0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:45.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.670+0000 7f5bfa600640 1 --2- 172.21.15.31:0/1964939614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bf415f640 0x7f5bf406f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:45.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.670+0000 7f5bfa600640 1 --2- 172.21.15.31:0/1964939614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bf40ce7f0 0x7f5bf4154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:45.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.670+0000 7f5bfa600640 1 -- 172.21.15.31:0/1964939614 >> 172.21.15.31:0/1964939614 conn(0x7f5bf40d1e30 msgr2=0x7f5bf40cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:45.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.678+0000 7f5bfa600640 1 -- 172.21.15.31:0/1964939614 shutdown_connections 2024-09-17T05:28:45.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.678+0000 7f5bfa600640 1 -- 172.21.15.31:0/1964939614 wait complete. 2024-09-17T05:28:45.714 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:28:45.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.862+0000 7f5285200640 1 -- 172.21.15.31:0/1001124014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5264003a40 msgr2=0x7f5264003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:45.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.862+0000 7f5285200640 1 --2- 172.21.15.31:0/1001124014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5264003a40 0x7f5264003e60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f52700016f0 tx=0x7f527001c780 comp rx=0 tx=0).stop 2024-09-17T05:28:45.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.862+0000 7f527e800640 1 -- 172.21.15.31:0/1001124014 reap_dead start 2024-09-17T05:28:45.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.862+0000 7f5285200640 1 -- 172.21.15.31:0/1001124014 shutdown_connections 2024-09-17T05:28:45.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.862+0000 7f5285200640 1 -- 172.21.15.31:0/1001124014 >> 172.21.15.31:0/1001124014 conn(0x7f52800d1e30 msgr2=0x7f52800d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:45.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.862+0000 7f5285200640 1 -- 172.21.15.31:0/1001124014 shutdown_connections 2024-09-17T05:28:45.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.862+0000 7f5285200640 1 -- 172.21.15.31:0/1001124014 wait complete. 2024-09-17T05:28:45.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.862+0000 7f5285200640 1 Processor -- start 2024-09-17T05:28:45.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.862+0000 7f5285200640 1 -- start start 2024-09-17T05:28:45.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f5285200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5264003a40 0x7f5280150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f5285200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52801fc230 0x7f52801657a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f5285200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5280167260 0x7f52801676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f5285200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5280167e00 con 0x7f5280167260 2024-09-17T05:28:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f5285200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5280167c80 con 0x7f5264003a40 2024-09-17T05:28:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f5285200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5280167f80 con 0x7f52801fc230 2024-09-17T05:28:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f527e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5280167260 0x7f52801676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f527e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5280167260 0x7f52801676e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60664/0 (socket says 172.21.15.31:60664) 2024-09-17T05:28:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f527e800640 1 -- 172.21.15.31:0/3386969224 learned_addr learned my addr 172.21.15.31:0/3386969224 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f527de00640 1 --2- 172.21.15.31:0/3386969224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5264003a40 0x7f5280150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f5277e00640 1 --2- 172.21.15.31:0/3386969224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52801fc230 0x7f52801657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:45.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f527e800640 1 -- 172.21.15.31:0/3386969224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52801fc230 msgr2=0x7f52801657a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:45.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f527e800640 1 --2- 172.21.15.31:0/3386969224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52801fc230 0x7f52801657a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:45.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f527e800640 1 -- 172.21.15.31:0/3386969224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5264003a40 msgr2=0x7f5280150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:45.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f527e800640 1 --2- 172.21.15.31:0/3386969224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5264003a40 0x7f5280150310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:45.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f527e800640 1 -- 172.21.15.31:0/3386969224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5280150850 con 0x7f5280167260 2024-09-17T05:28:45.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f5277e00640 1 --2- 172.21.15.31:0/3386969224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52801fc230 0x7f52801657a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:28:45.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f527e800640 1 --2- 172.21.15.31:0/3386969224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5280167260 0x7f52801676e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5280069e60 tx=0x7f527800eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:45.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f5276000640 1 -- 172.21.15.31:0/3386969224 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278015020 con 0x7f5280167260 2024-09-17T05:28:45.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f5276000640 1 -- 172.21.15.31:0/3386969224 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f527800ca60 con 0x7f5280167260 2024-09-17T05:28:45.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f5285200640 1 -- 172.21.15.31:0/3386969224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52801661c0 con 0x7f5280167260 2024-09-17T05:28:45.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f5276000640 1 -- 172.21.15.31:0/3386969224 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527800ce90 con 0x7f5280167260 2024-09-17T05:28:45.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f5285200640 1 -- 172.21.15.31:0/3386969224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5280166780 con 0x7f5280167260 2024-09-17T05:28:45.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f5285200640 1 -- 172.21.15.31:0/3386969224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52800b0130 con 0x7f5280167260 2024-09-17T05:28:45.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.866+0000 7f5276000640 1 -- 172.21.15.31:0/3386969224 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5278018020 con 0x7f5280167260 2024-09-17T05:28:45.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.870+0000 7f5276000640 1 --2- 172.21.15.31:0/3386969224 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f525c0733d0 0x7f525c075890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:45.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.870+0000 7f5276000640 1 -- 172.21.15.31:0/3386969224 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5278094760 con 0x7f5280167260 2024-09-17T05:28:45.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.870+0000 7f527de00640 1 --2- 172.21.15.31:0/3386969224 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f525c0733d0 0x7f525c075890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:45.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.870+0000 7f527de00640 1 --2- 172.21.15.31:0/3386969224 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f525c0733d0 0x7f525c075890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52700016c0 tx=0x7f52700b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:45.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:45.874+0000 7f5276000640 1 -- 172.21.15.31:0/3386969224 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f527801f020 con 0x7f5280167260 2024-09-17T05:28:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.050+0000 7f5285200640 1 -- 172.21.15.31:0/3386969224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52800d0600 con 0x7f5280167260 2024-09-17T05:28:46.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.050+0000 7f5276000640 1 -- 172.21.15.31:0/3386969224 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16702 (secure 0 0 0) 0x7f527805f800 con 0x7f5280167260 2024-09-17T05:28:46.055 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:46.055 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:28:45.059448+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:28:42.906739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:28:44.023489+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:28:46.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.054+0000 7f5285200640 1 -- 172.21.15.31:0/3386969224 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f525c0733d0 msgr2=0x7f525c075890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.054+0000 7f5285200640 1 --2- 172.21.15.31:0/3386969224 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f525c0733d0 0x7f525c075890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52700016c0 tx=0x7f52700b1040 comp rx=0 tx=0).stop 2024-09-17T05:28:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.054+0000 7f5285200640 1 -- 172.21.15.31:0/3386969224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5280167260 msgr2=0x7f52801676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.054+0000 7f5285200640 1 --2- 172.21.15.31:0/3386969224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5280167260 0x7f52801676e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5280069e60 tx=0x7f527800eac0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.054+0000 7f5285200640 1 -- 172.21.15.31:0/3386969224 shutdown_connections 2024-09-17T05:28:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.054+0000 7f5285200640 1 --2- 172.21.15.31:0/3386969224 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f525c0733d0 0x7f525c075890 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.054+0000 7f5285200640 1 --2- 172.21.15.31:0/3386969224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5280167260 0x7f52801676e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.054+0000 7f5285200640 1 --2- 172.21.15.31:0/3386969224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52801fc230 0x7f52801657a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.054+0000 7f5285200640 1 --2- 172.21.15.31:0/3386969224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5264003a40 0x7f5280150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.054+0000 7f5285200640 1 -- 172.21.15.31:0/3386969224 >> 172.21.15.31:0/3386969224 conn(0x7f52800d1e30 msgr2=0x7f52800c49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.054+0000 7f5285200640 1 -- 172.21.15.31:0/3386969224 shutdown_connections 2024-09-17T05:28:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.054+0000 7f5285200640 1 -- 172.21.15.31:0/3386969224 wait complete. 2024-09-17T05:28:46.077 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:28:46.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.218+0000 7f23bb800640 1 -- 172.21.15.31:0/813188970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23b415af60 msgr2=0x7f23b40cffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:46.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.218+0000 7f23bb800640 1 --2- 172.21.15.31:0/813188970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23b415af60 0x7f23b40cffc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f23b40d1b50 tx=0x7f23a801c5b0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.218+0000 7f23bb800640 1 -- 172.21.15.31:0/813188970 shutdown_connections 2024-09-17T05:28:46.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.218+0000 7f23bb800640 1 --2- 172.21.15.31:0/813188970 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23b4074160 0x7f23b40ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.218+0000 7f23bb800640 1 --2- 172.21.15.31:0/813188970 >> v2:172.21.15.155:3300/0 conn(0x7f23b40737c0 0x7f23b4073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.218+0000 7f23bb800640 1 --2- 172.21.15.31:0/813188970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23b415af60 0x7f23b40cffc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.218+0000 7f23bb800640 1 -- 172.21.15.31:0/813188970 >> 172.21.15.31:0/813188970 conn(0x7f23b40d0c90 msgr2=0x7f23b40d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:46.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.218+0000 7f23bb800640 1 -- 172.21.15.31:0/813188970 shutdown_connections 2024-09-17T05:28:46.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.218+0000 7f23bb800640 1 -- 172.21.15.31:0/813188970 wait complete. 2024-09-17T05:28:46.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23bb800640 1 Processor -- start 2024-09-17T05:28:46.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23bb800640 1 -- start start 2024-09-17T05:28:46.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23bb800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23b40737c0 0x7f23b40ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:46.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23bb800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23b4074160 0x7f23b41f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:46.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23bb800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23b415af60 0x7f23b40c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:46.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23bb800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f23b406cfb0 con 0x7f23b4074160 2024-09-17T05:28:46.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23bb800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f23b406ce30 con 0x7f23b415af60 2024-09-17T05:28:46.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23bb800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f23b406d130 con 0x7f23b40737c0 2024-09-17T05:28:46.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23b3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23b4074160 0x7f23b41f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:46.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23b3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23b4074160 0x7f23b41f6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60694/0 (socket says 172.21.15.31:60694) 2024-09-17T05:28:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23b3e00640 1 -- 172.21.15.31:0/2418590552 learned_addr learned my addr 172.21.15.31:0/2418590552 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23b8e00640 1 --2- 172.21.15.31:0/2418590552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23b40737c0 0x7f23b40ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23b9800640 1 --2- 172.21.15.31:0/2418590552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23b415af60 0x7f23b40c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23b3e00640 1 -- 172.21.15.31:0/2418590552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23b40737c0 msgr2=0x7f23b40ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23b3e00640 1 --2- 172.21.15.31:0/2418590552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23b40737c0 0x7f23b40ca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23b3e00640 1 -- 172.21.15.31:0/2418590552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23b415af60 msgr2=0x7f23b40c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23b3e00640 1 --2- 172.21.15.31:0/2418590552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23b415af60 0x7f23b40c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23b3e00640 1 -- 172.21.15.31:0/2418590552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b41f72a0 con 0x7f23b4074160 2024-09-17T05:28:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23b3e00640 1 --2- 172.21.15.31:0/2418590552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23b4074160 0x7f23b41f6d60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f23a000d770 tx=0x7f23a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23b0c00640 1 -- 172.21.15.31:0/2418590552 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0017070 con 0x7f23b4074160 2024-09-17T05:28:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23b0c00640 1 -- 172.21.15.31:0/2418590552 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23a0009d20 con 0x7f23b4074160 2024-09-17T05:28:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23b0c00640 1 -- 172.21.15.31:0/2418590552 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a00106c0 con 0x7f23b4074160 2024-09-17T05:28:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23bb800640 1 -- 172.21.15.31:0/2418590552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b40b60e0 con 0x7f23b4074160 2024-09-17T05:28:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.222+0000 7f23bb800640 1 -- 172.21.15.31:0/2418590552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b40b66a0 con 0x7f23b4074160 2024-09-17T05:28:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.226+0000 7f23bb800640 1 -- 172.21.15.31:0/2418590552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23b4073c20 con 0x7f23b4074160 2024-09-17T05:28:46.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.226+0000 7f23b0c00640 1 -- 172.21.15.31:0/2418590552 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f23a001a070 con 0x7f23b4074160 2024-09-17T05:28:46.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.226+0000 7f23b0c00640 1 --2- 172.21.15.31:0/2418590552 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2394073200 0x7f23940756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:46.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.226+0000 7f23b0c00640 1 -- 172.21.15.31:0/2418590552 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f23a0094300 con 0x7f23b4074160 2024-09-17T05:28:46.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.226+0000 7f23b8e00640 1 --2- 172.21.15.31:0/2418590552 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2394073200 0x7f23940756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:46.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.230+0000 7f23b8e00640 1 --2- 172.21.15.31:0/2418590552 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2394073200 0x7f23940756c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f23a80ae000 tx=0x7f23a801adf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:46.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.230+0000 7f23b0c00640 1 -- 172.21.15.31:0/2418590552 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f23a005ecc0 con 0x7f23b4074160 2024-09-17T05:28:46.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.410+0000 7f23bb800640 1 -- 172.21.15.31:0/2418590552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23b40c4080 con 0x7f23b4074160 2024-09-17T05:28:46.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.410+0000 7f23b0c00640 1 -- 172.21.15.31:0/2418590552 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16702 (secure 0 0 0) 0x7f23a00636f0 con 0x7f23b4074160 2024-09-17T05:28:46.413 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:46.413 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:28:45.059448+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:28:42.906739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:28:44.023489+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:28:46.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.410+0000 7f23bb800640 1 -- 172.21.15.31:0/2418590552 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2394073200 msgr2=0x7f23940756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:46.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.410+0000 7f23bb800640 1 --2- 172.21.15.31:0/2418590552 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2394073200 0x7f23940756c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f23a80ae000 tx=0x7f23a801adf0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.410+0000 7f23bb800640 1 -- 172.21.15.31:0/2418590552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23b4074160 msgr2=0x7f23b41f6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:46.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.410+0000 7f23bb800640 1 --2- 172.21.15.31:0/2418590552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23b4074160 0x7f23b41f6d60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f23a000d770 tx=0x7f23a000dc30 comp rx=0 tx=0).stop 2024-09-17T05:28:46.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.414+0000 7f23bb800640 1 -- 172.21.15.31:0/2418590552 shutdown_connections 2024-09-17T05:28:46.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.414+0000 7f23bb800640 1 --2- 172.21.15.31:0/2418590552 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2394073200 0x7f23940756c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.414+0000 7f23bb800640 1 --2- 172.21.15.31:0/2418590552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23b415af60 0x7f23b40c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.414+0000 7f23bb800640 1 --2- 172.21.15.31:0/2418590552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23b4074160 0x7f23b41f6d60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.414+0000 7f23bb800640 1 --2- 172.21.15.31:0/2418590552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23b40737c0 0x7f23b40ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.414+0000 7f23bb800640 1 -- 172.21.15.31:0/2418590552 >> 172.21.15.31:0/2418590552 conn(0x7f23b40d0c90 msgr2=0x7f23b4070c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:46.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.414+0000 7f23bb800640 1 -- 172.21.15.31:0/2418590552 shutdown_connections 2024-09-17T05:28:46.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.414+0000 7f23bb800640 1 -- 172.21.15.31:0/2418590552 wait complete. 2024-09-17T05:28:46.434 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:28:46.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.582+0000 7fa06e600640 1 -- 172.21.15.31:0/1127589163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0680b1650 msgr2=0x7fa0680b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:46.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.582+0000 7fa06e600640 1 --2- 172.21.15.31:0/1127589163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0680b1650 0x7fa0680b1a30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa050009900 tx=0x7fa05001c8e0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.582+0000 7fa06e600640 1 -- 172.21.15.31:0/1127589163 shutdown_connections 2024-09-17T05:28:46.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.582+0000 7fa06e600640 1 --2- 172.21.15.31:0/1127589163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0680b1650 0x7fa0680b1a30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.582+0000 7fa06e600640 1 --2- 172.21.15.31:0/1127589163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0681605d0 0x7fa0680d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.582+0000 7fa06e600640 1 -- 172.21.15.31:0/1127589163 >> 172.21.15.31:0/1127589163 conn(0x7fa0680d1dd0 msgr2=0x7fa0680d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:46.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.582+0000 7fa06e600640 1 -- 172.21.15.31:0/1127589163 shutdown_connections 2024-09-17T05:28:46.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.582+0000 7fa06e600640 1 -- 172.21.15.31:0/1127589163 wait complete. 2024-09-17T05:28:46.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.582+0000 7fa06e600640 1 Processor -- start 2024-09-17T05:28:46.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.582+0000 7fa06e600640 1 -- start start 2024-09-17T05:28:46.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa06e600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0680aeb00 0x7fa0680cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:46.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa06e600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0680b1650 0x7fa0681f84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:46.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa06e600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0681605d0 0x7fa06806dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa06e600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa0680b0e50 con 0x7fa0681605d0 2024-09-17T05:28:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa06e600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa0680b0cd0 con 0x7fa0680aeb00 2024-09-17T05:28:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa06e600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa0680b1220 con 0x7fa0680b1650 2024-09-17T05:28:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa067e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0681605d0 0x7fa06806dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa067e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0681605d0 0x7fa06806dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60704/0 (socket says 172.21.15.31:60704) 2024-09-17T05:28:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa067e00640 1 -- 172.21.15.31:0/196787520 learned_addr learned my addr 172.21.15.31:0/196787520 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa067400640 1 --2- 172.21.15.31:0/196787520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0680aeb00 0x7fa0680cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:46.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa05fe00640 1 --2- 172.21.15.31:0/196787520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0680b1650 0x7fa0681f84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa067e00640 1 -- 172.21.15.31:0/196787520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0680b1650 msgr2=0x7fa0681f84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa067e00640 1 --2- 172.21.15.31:0/196787520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0680b1650 0x7fa0681f84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa067e00640 1 -- 172.21.15.31:0/196787520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0680aeb00 msgr2=0x7fa0680cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:46.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa067e00640 1 --2- 172.21.15.31:0/196787520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0680aeb00 0x7fa0680cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:46.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa067e00640 1 -- 172.21.15.31:0/196787520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06806f110 con 0x7fa0681605d0 2024-09-17T05:28:46.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa05fe00640 1 --2- 172.21.15.31:0/196787520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0680b1650 0x7fa0681f84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:28:46.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa067400640 1 --2- 172.21.15.31:0/196787520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0680aeb00 0x7fa0680cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:28:46.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa067e00640 1 --2- 172.21.15.31:0/196787520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0681605d0 0x7fa06806dd30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa06000c7c0 tx=0x7fa06000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:46.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa05f400640 1 -- 172.21.15.31:0/196787520 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060003b80 con 0x7fa0681605d0 2024-09-17T05:28:46.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa05f400640 1 -- 172.21.15.31:0/196787520 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa060003d20 con 0x7fa0681605d0 2024-09-17T05:28:46.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa05f400640 1 -- 172.21.15.31:0/196787520 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06000aab0 con 0x7fa0681605d0 2024-09-17T05:28:46.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa06e600640 1 -- 172.21.15.31:0/196787520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0680cb710 con 0x7fa0681605d0 2024-09-17T05:28:46.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa06e600640 1 -- 172.21.15.31:0/196787520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0680cbcd0 con 0x7fa0681605d0 2024-09-17T05:28:46.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa06e600640 1 -- 172.21.15.31:0/196787520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0680b1a30 con 0x7fa0681605d0 2024-09-17T05:28:46.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.586+0000 7fa05f400640 1 -- 172.21.15.31:0/196787520 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa06000ac50 con 0x7fa0681605d0 2024-09-17T05:28:46.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.590+0000 7fa05f400640 1 --2- 172.21.15.31:0/196787520 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa044073200 0x7fa0440756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:46.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.590+0000 7fa05f400640 1 -- 172.21.15.31:0/196787520 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa060093ec0 con 0x7fa0681605d0 2024-09-17T05:28:46.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.590+0000 7fa067400640 1 --2- 172.21.15.31:0/196787520 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa044073200 0x7fa0440756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:46.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.590+0000 7fa067400640 1 --2- 172.21.15.31:0/196787520 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa044073200 0x7fa0440756c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa058009b90 tx=0x7fa0580091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.594+0000 7fa05f400640 1 -- 172.21.15.31:0/196787520 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa06005eed0 con 0x7fa0681605d0 2024-09-17T05:28:46.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:46.810+0000 7fa06e600640 1 -- 172.21.15.31:0/196787520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa0680d1080 con 0x7fa0681605d0 2024-09-17T05:28:47.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.674+0000 7fa05f400640 1 -- 172.21.15.31:0/196787520 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fa06005e7d0 con 0x7fa0681605d0 2024-09-17T05:28:47.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.674+0000 7fa06e600640 1 -- 172.21.15.31:0/196787520 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa044073200 msgr2=0x7fa0440756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:47.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.674+0000 7fa06e600640 1 --2- 172.21.15.31:0/196787520 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa044073200 0x7fa0440756c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa058009b90 tx=0x7fa0580091e0 comp rx=0 tx=0).stop 2024-09-17T05:28:47.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.678+0000 7fa06e600640 1 -- 172.21.15.31:0/196787520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0681605d0 msgr2=0x7fa06806dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:47.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.678+0000 7fa06e600640 1 --2- 172.21.15.31:0/196787520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0681605d0 0x7fa06806dd30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa06000c7c0 tx=0x7fa06000cc80 comp rx=0 tx=0).stop 2024-09-17T05:28:47.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.678+0000 7fa06e600640 1 -- 172.21.15.31:0/196787520 shutdown_connections 2024-09-17T05:28:47.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.678+0000 7fa06e600640 1 --2- 172.21.15.31:0/196787520 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa044073200 0x7fa0440756c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:47.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.678+0000 7fa06e600640 1 --2- 172.21.15.31:0/196787520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0681605d0 0x7fa06806dd30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:47.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.678+0000 7fa06e600640 1 --2- 172.21.15.31:0/196787520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0680b1650 0x7fa0681f84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:47.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.678+0000 7fa06e600640 1 --2- 172.21.15.31:0/196787520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0680aeb00 0x7fa0680cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:47.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.678+0000 7fa06e600640 1 -- 172.21.15.31:0/196787520 >> 172.21.15.31:0/196787520 conn(0x7fa0680d1dd0 msgr2=0x7fa0680cc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:47.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.678+0000 7fa06e600640 1 -- 172.21.15.31:0/196787520 shutdown_connections 2024-09-17T05:28:47.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.678+0000 7fa06e600640 1 -- 172.21.15.31:0/196787520 wait complete. 2024-09-17T05:28:47.702 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:28:47.703 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:28:47.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.854+0000 7fe625a00640 1 -- 172.21.15.31:0/2984934607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6201605d0 msgr2=0x7fe6200d0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:47.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.854+0000 7fe625a00640 1 --2- 172.21.15.31:0/2984934607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6201605d0 0x7fe6200d0690 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe610009900 tx=0x7fe61001c8e0 comp rx=0 tx=0).stop 2024-09-17T05:28:47.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.854+0000 7fe625a00640 1 -- 172.21.15.31:0/2984934607 shutdown_connections 2024-09-17T05:28:47.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.854+0000 7fe625a00640 1 --2- 172.21.15.31:0/2984934607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6200b1650 0x7fe6200b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:47.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.854+0000 7fe625a00640 1 --2- 172.21.15.31:0/2984934607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6201605d0 0x7fe6200d0690 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:47.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.854+0000 7fe625a00640 1 -- 172.21.15.31:0/2984934607 >> 172.21.15.31:0/2984934607 conn(0x7fe6200d1dd0 msgr2=0x7fe6200d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:47.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.854+0000 7fe625a00640 1 -- 172.21.15.31:0/2984934607 shutdown_connections 2024-09-17T05:28:47.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.854+0000 7fe625a00640 1 -- 172.21.15.31:0/2984934607 wait complete. 2024-09-17T05:28:47.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.854+0000 7fe625a00640 1 Processor -- start 2024-09-17T05:28:47.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.854+0000 7fe625a00640 1 -- start start 2024-09-17T05:28:47.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe625a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6200aeb00 0x7fe620166560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:47.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe625a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6200b1650 0x7fe6200ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:47.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe625a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6201605d0 0x7fe620164ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:47.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe625a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe6200b1220 con 0x7fe6200b1650 2024-09-17T05:28:47.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe625a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe6200b0ee0 con 0x7fe6200aeb00 2024-09-17T05:28:47.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe625a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe6200b13a0 con 0x7fe6201605d0 2024-09-17T05:28:47.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe61e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6200b1650 0x7fe6200ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:47.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe61e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6200b1650 0x7fe6200ca680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60724/0 (socket says 172.21.15.31:60724) 2024-09-17T05:28:47.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe61e000640 1 -- 172.21.15.31:0/877241290 learned_addr learned my addr 172.21.15.31:0/877241290 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:47.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe61ea00640 1 --2- 172.21.15.31:0/877241290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6200aeb00 0x7fe620166560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:47.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe61f400640 1 --2- 172.21.15.31:0/877241290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6201605d0 0x7fe620164ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:47.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe61e000640 1 -- 172.21.15.31:0/877241290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6201605d0 msgr2=0x7fe620164ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:47.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe61e000640 1 --2- 172.21.15.31:0/877241290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6201605d0 0x7fe620164ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:47.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe61e000640 1 -- 172.21.15.31:0/877241290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6200aeb00 msgr2=0x7fe620166560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:47.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe61e000640 1 --2- 172.21.15.31:0/877241290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6200aeb00 0x7fe620166560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:47.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe61e000640 1 -- 172.21.15.31:0/877241290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe620153f00 con 0x7fe6200b1650 2024-09-17T05:28:47.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe61e000640 1 --2- 172.21.15.31:0/877241290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6200b1650 0x7fe6200ca680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00c970 tx=0x7fe60c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:47.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe616a00640 1 -- 172.21.15.31:0/877241290 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c007c70 con 0x7fe6200b1650 2024-09-17T05:28:47.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe616a00640 1 -- 172.21.15.31:0/877241290 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe60c00f450 con 0x7fe6200b1650 2024-09-17T05:28:47.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe625a00640 1 -- 172.21.15.31:0/877241290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe620166aa0 con 0x7fe6200b1650 2024-09-17T05:28:47.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe616a00640 1 -- 172.21.15.31:0/877241290 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c00f8a0 con 0x7fe6200b1650 2024-09-17T05:28:47.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe625a00640 1 -- 172.21.15.31:0/877241290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6201f8380 con 0x7fe6200b1650 2024-09-17T05:28:47.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.858+0000 7fe625a00640 1 -- 172.21.15.31:0/877241290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6200b1a30 con 0x7fe6200b1650 2024-09-17T05:28:47.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.862+0000 7fe616a00640 1 -- 172.21.15.31:0/877241290 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe60c00fa40 con 0x7fe6200b1650 2024-09-17T05:28:47.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.862+0000 7fe616a00640 1 --2- 172.21.15.31:0/877241290 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe600073200 0x7fe6000756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:47.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.862+0000 7fe616a00640 1 -- 172.21.15.31:0/877241290 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe60c094a00 con 0x7fe6200b1650 2024-09-17T05:28:47.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.862+0000 7fe61ea00640 1 --2- 172.21.15.31:0/877241290 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe600073200 0x7fe6000756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:47.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.862+0000 7fe61ea00640 1 --2- 172.21.15.31:0/877241290 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe600073200 0x7fe6000756c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe6100af000 tx=0x7fe61001b120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:47.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:47.866+0000 7fe616a00640 1 -- 172.21.15.31:0/877241290 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe620166aa0 con 0x7fe6200b1650 2024-09-17T05:28:48.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.078+0000 7fe625a00640 1 -- 172.21.15.31:0/877241290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe6200ce9c0 con 0x7fe6200b1650 2024-09-17T05:28:48.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.674+0000 7fe616a00640 1 -- 172.21.15.31:0/877241290 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fe620153f00 con 0x7fe6200b1650 2024-09-17T05:28:48.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.678+0000 7fe625a00640 1 -- 172.21.15.31:0/877241290 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe600073200 msgr2=0x7fe6000756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:48.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.678+0000 7fe625a00640 1 --2- 172.21.15.31:0/877241290 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe600073200 0x7fe6000756c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe6100af000 tx=0x7fe61001b120 comp rx=0 tx=0).stop 2024-09-17T05:28:48.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.678+0000 7fe625a00640 1 -- 172.21.15.31:0/877241290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6200b1650 msgr2=0x7fe6200ca680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:48.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.678+0000 7fe625a00640 1 --2- 172.21.15.31:0/877241290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6200b1650 0x7fe6200ca680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00c970 tx=0x7fe60c00ce30 comp rx=0 tx=0).stop 2024-09-17T05:28:48.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.678+0000 7fe625a00640 1 -- 172.21.15.31:0/877241290 shutdown_connections 2024-09-17T05:28:48.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.678+0000 7fe625a00640 1 --2- 172.21.15.31:0/877241290 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe600073200 0x7fe6000756c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:48.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.678+0000 7fe625a00640 1 --2- 172.21.15.31:0/877241290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6201605d0 0x7fe620164ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:48.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.678+0000 7fe625a00640 1 --2- 172.21.15.31:0/877241290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6200b1650 0x7fe6200ca680 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:48.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.678+0000 7fe625a00640 1 --2- 172.21.15.31:0/877241290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6200aeb00 0x7fe620166560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:48.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.678+0000 7fe625a00640 1 -- 172.21.15.31:0/877241290 >> 172.21.15.31:0/877241290 conn(0x7fe6200d1dd0 msgr2=0x7fe620071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:48.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.678+0000 7fe625a00640 1 -- 172.21.15.31:0/877241290 shutdown_connections 2024-09-17T05:28:48.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.678+0000 7fe625a00640 1 -- 172.21.15.31:0/877241290 wait complete. 2024-09-17T05:28:48.707 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:28:48.707 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:28:48.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.854+0000 7fc9b4200640 1 -- 172.21.15.31:0/1469276752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac15bea0 msgr2=0x7fc9ac0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:48.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.854+0000 7fc9b4200640 1 --2- 172.21.15.31:0/1469276752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac15bea0 0x7fc9ac0ce670 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009840 tx=0x7fc9a001c820 comp rx=0 tx=0).stop 2024-09-17T05:28:48.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.854+0000 7fc9b4200640 1 -- 172.21.15.31:0/1469276752 shutdown_connections 2024-09-17T05:28:48.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.854+0000 7fc9b4200640 1 --2- 172.21.15.31:0/1469276752 >> v2:172.21.15.155:3300/0 conn(0x7fc9ac0d28e0 0x7fc9ac0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:48.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.854+0000 7fc9b4200640 1 --2- 172.21.15.31:0/1469276752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac15bea0 0x7fc9ac0ce670 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:48.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.854+0000 7fc9b4200640 1 -- 172.21.15.31:0/1469276752 >> 172.21.15.31:0/1469276752 conn(0x7fc9ac0d1dc0 msgr2=0x7fc9ac0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:48.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.854+0000 7fc9b4200640 1 -- 172.21.15.31:0/1469276752 shutdown_connections 2024-09-17T05:28:48.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.854+0000 7fc9b4200640 1 -- 172.21.15.31:0/1469276752 wait complete. 2024-09-17T05:28:48.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b4200640 1 Processor -- start 2024-09-17T05:28:48.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b4200640 1 -- start start 2024-09-17T05:28:48.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b4200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9ac0cdb30 0x7fc9ac0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:48.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b4200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac0d28e0 0x7fc9ac09c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:48.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b4200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9ac15bea0 0x7fc9ac071a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:48.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b4200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac168fc0 con 0x7fc9ac0cdb30 2024-09-17T05:28:48.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b4200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac168e40 con 0x7fc9ac15bea0 2024-09-17T05:28:48.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b4200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc9ac169140 con 0x7fc9ac0d28e0 2024-09-17T05:28:48.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b1800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9ac0cdb30 0x7fc9ac0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:48.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b1800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9ac0cdb30 0x7fc9ac0c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41882/0 (socket says 172.21.15.31:41882) 2024-09-17T05:28:48.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b1800640 1 -- 172.21.15.31:0/594795828 learned_addr learned my addr 172.21.15.31:0/594795828 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:48.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b2200640 1 --2- 172.21.15.31:0/594795828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9ac15bea0 0x7fc9ac071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:48.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b0e00640 1 --2- 172.21.15.31:0/594795828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac0d28e0 0x7fc9ac09c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:48.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b1800640 1 -- 172.21.15.31:0/594795828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac0d28e0 msgr2=0x7fc9ac09c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:48.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b1800640 1 --2- 172.21.15.31:0/594795828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac0d28e0 0x7fc9ac09c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:48.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b1800640 1 -- 172.21.15.31:0/594795828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9ac15bea0 msgr2=0x7fc9ac071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:48.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b1800640 1 --2- 172.21.15.31:0/594795828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9ac15bea0 0x7fc9ac071a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:48.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b1800640 1 -- 172.21.15.31:0/594795828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ac156a00 con 0x7fc9ac0cdb30 2024-09-17T05:28:48.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b1800640 1 --2- 172.21.15.31:0/594795828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9ac0cdb30 0x7fc9ac0c8220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0019430 tx=0x7fc9a00a55f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:48.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9a9600640 1 -- 172.21.15.31:0/594795828 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00b2040 con 0x7fc9ac0cdb30 2024-09-17T05:28:48.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9a9600640 1 -- 172.21.15.31:0/594795828 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9a00041e0 con 0x7fc9ac0cdb30 2024-09-17T05:28:48.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9a9600640 1 -- 172.21.15.31:0/594795828 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a00050c0 con 0x7fc9ac0cdb30 2024-09-17T05:28:48.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b4200640 1 -- 172.21.15.31:0/594795828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ac156ce0 con 0x7fc9ac0cdb30 2024-09-17T05:28:48.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.858+0000 7fc9b4200640 1 -- 172.21.15.31:0/594795828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ac1572a0 con 0x7fc9ac0cdb30 2024-09-17T05:28:48.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.862+0000 7fc9b4200640 1 -- 172.21.15.31:0/594795828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9ac0cc9d0 con 0x7fc9ac0cdb30 2024-09-17T05:28:48.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.862+0000 7fc9a9600640 1 -- 172.21.15.31:0/594795828 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc9a00bd030 con 0x7fc9ac0cdb30 2024-09-17T05:28:48.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.862+0000 7fc9a9600640 1 --2- 172.21.15.31:0/594795828 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc98c073200 0x7fc98c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:48.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.862+0000 7fc9a9600640 1 -- 172.21.15.31:0/594795828 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc9a012dd30 con 0x7fc9ac0cdb30 2024-09-17T05:28:48.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.862+0000 7fc9b0e00640 1 --2- 172.21.15.31:0/594795828 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc98c073200 0x7fc98c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:48.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.862+0000 7fc9b0e00640 1 --2- 172.21.15.31:0/594795828 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc98c073200 0x7fc98c0756c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0cc270 tx=0x7fc998009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:48.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:48.866+0000 7fc9a9600640 1 -- 172.21.15.31:0/594795828 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc9a00c4060 con 0x7fc9ac0cdb30 2024-09-17T05:28:49.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.074+0000 7fc9b4200640 1 -- 172.21.15.31:0/594795828 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9ac0b01c0 con 0x7fc9ac0cdb30 2024-09-17T05:28:49.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.078+0000 7fc9a9600640 1 -- 172.21.15.31:0/594795828 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7fc9a0016410 con 0x7fc9ac0cdb30 2024-09-17T05:28:49.080 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:49.080 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"btime":"2024-09-17T05:28:48:676550+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/3491154284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3491154284},{"type":"v1","addr":"172.21.15.155:6836","nonce":3491154284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4301,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3619522478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3619522478},{"type":"v1","addr":"172.21.15.155:6837","nonce":3619522478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/851893415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":851893415},{"type":"v1","addr":"172.21.15.31:6834","nonce":851893415}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:28:45.059391+0000","modified":"2024-09-17T05:28:48.082624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4380":{"gid":4380,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3393035146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3393035146},{"type":"v1","addr":"172.21.15.31:6835","nonce":3393035146}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4380,"qdb_cluster":[4380]},"id":1}]} 2024-09-17T05:28:49.080 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-09-17T05:28:49.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.078+0000 7fc9b4200640 1 -- 172.21.15.31:0/594795828 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc98c073200 msgr2=0x7fc98c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:49.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.078+0000 7fc9b4200640 1 --2- 172.21.15.31:0/594795828 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc98c073200 0x7fc98c0756c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0cc270 tx=0x7fc998009040 comp rx=0 tx=0).stop 2024-09-17T05:28:49.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.078+0000 7fc9b4200640 1 -- 172.21.15.31:0/594795828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9ac0cdb30 msgr2=0x7fc9ac0c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:49.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.078+0000 7fc9b4200640 1 --2- 172.21.15.31:0/594795828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9ac0cdb30 0x7fc9ac0c8220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0019430 tx=0x7fc9a00a55f0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.078+0000 7fc9b4200640 1 -- 172.21.15.31:0/594795828 shutdown_connections 2024-09-17T05:28:49.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.078+0000 7fc9b4200640 1 --2- 172.21.15.31:0/594795828 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc98c073200 0x7fc98c0756c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.078+0000 7fc9b4200640 1 --2- 172.21.15.31:0/594795828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9ac15bea0 0x7fc9ac071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.078+0000 7fc9b4200640 1 --2- 172.21.15.31:0/594795828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9ac0d28e0 0x7fc9ac09c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.078+0000 7fc9b4200640 1 --2- 172.21.15.31:0/594795828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9ac0cdb30 0x7fc9ac0c8220 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.078+0000 7fc9b4200640 1 -- 172.21.15.31:0/594795828 >> 172.21.15.31:0/594795828 conn(0x7fc9ac0d1dc0 msgr2=0x7fc9ac158f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:49.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.078+0000 7fc9b4200640 1 -- 172.21.15.31:0/594795828 shutdown_connections 2024-09-17T05:28:49.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.078+0000 7fc9b4200640 1 -- 172.21.15.31:0/594795828 wait complete. 2024-09-17T05:28:49.101 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:28:49.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.242+0000 7f8b1c800640 1 -- 172.21.15.31:0/1357980950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b1415f7b0 msgr2=0x7f8b1415fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:49.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.242+0000 7f8b1c800640 1 --2- 172.21.15.31:0/1357980950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b1415f7b0 0x7f8b1415fc40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8b1406ec30 tx=0x7f8b1001cd50 comp rx=0 tx=0).stop 2024-09-17T05:28:49.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.242+0000 7f8b1c800640 1 -- 172.21.15.31:0/1357980950 shutdown_connections 2024-09-17T05:28:49.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.242+0000 7f8b1c800640 1 --2- 172.21.15.31:0/1357980950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b1415f7b0 0x7f8b1415fc40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.242+0000 7f8b1c800640 1 --2- 172.21.15.31:0/1357980950 >> v2:172.21.15.155:3300/0 conn(0x7f8b1415c1c0 0x7f8b1406d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.242+0000 7f8b1c800640 1 --2- 172.21.15.31:0/1357980950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b1406cc20 0x7f8b140737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.242+0000 7f8b1c800640 1 -- 172.21.15.31:0/1357980950 >> 172.21.15.31:0/1357980950 conn(0x7f8b140d0c90 msgr2=0x7f8b140d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:49.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.242+0000 7f8b1c800640 1 -- 172.21.15.31:0/1357980950 shutdown_connections 2024-09-17T05:28:49.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.242+0000 7f8b1c800640 1 -- 172.21.15.31:0/1357980950 wait complete. 2024-09-17T05:28:49.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b1c800640 1 Processor -- start 2024-09-17T05:28:49.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b1c800640 1 -- start start 2024-09-17T05:28:49.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b1c800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b1406cc20 0x7f8b1415de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:49.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b1c800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b1415c1c0 0x7f8b141ffe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:49.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b1c800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b1415f7b0 0x7f8b14200390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:49.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b1c800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8b140719c0 con 0x7f8b1415c1c0 2024-09-17T05:28:49.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b1c800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8b14071840 con 0x7f8b1415f7b0 2024-09-17T05:28:49.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b1c800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8b14071b40 con 0x7f8b1406cc20 2024-09-17T05:28:49.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b19400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b1415c1c0 0x7f8b141ffe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:49.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b19e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b1406cc20 0x7f8b1415de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:49.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b19400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b1415c1c0 0x7f8b141ffe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41910/0 (socket says 172.21.15.31:41910) 2024-09-17T05:28:49.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b19400640 1 -- 172.21.15.31:0/2610568106 learned_addr learned my addr 172.21.15.31:0/2610568106 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:49.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b1a800640 1 --2- 172.21.15.31:0/2610568106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b1415f7b0 0x7f8b14200390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:49.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b19400640 1 -- 172.21.15.31:0/2610568106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b1406cc20 msgr2=0x7f8b1415de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:49.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b19400640 1 --2- 172.21.15.31:0/2610568106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b1406cc20 0x7f8b1415de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b19400640 1 -- 172.21.15.31:0/2610568106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b1415f7b0 msgr2=0x7f8b14200390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:49.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b19400640 1 --2- 172.21.15.31:0/2610568106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b1415f7b0 0x7f8b14200390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b19400640 1 -- 172.21.15.31:0/2610568106 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b140cf430 con 0x7f8b1415c1c0 2024-09-17T05:28:49.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b19400640 1 --2- 172.21.15.31:0/2610568106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b1415c1c0 0x7f8b141ffe50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400c970 tx=0x7f8b0400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:49.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b0e000640 1 -- 172.21.15.31:0/2610568106 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b04007c70 con 0x7f8b1415c1c0 2024-09-17T05:28:49.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b0e000640 1 -- 172.21.15.31:0/2610568106 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b0400f450 con 0x7f8b1415c1c0 2024-09-17T05:28:49.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b0e000640 1 -- 172.21.15.31:0/2610568106 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0400f8a0 con 0x7f8b1415c1c0 2024-09-17T05:28:49.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b1c800640 1 -- 172.21.15.31:0/2610568106 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b140cf710 con 0x7f8b1415c1c0 2024-09-17T05:28:49.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.246+0000 7f8b1c800640 1 -- 172.21.15.31:0/2610568106 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b140cfcd0 con 0x7f8b1415c1c0 2024-09-17T05:28:49.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.250+0000 7f8b1c800640 1 -- 172.21.15.31:0/2610568106 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b1406d000 con 0x7f8b1415c1c0 2024-09-17T05:28:49.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.250+0000 7f8b0e000640 1 -- 172.21.15.31:0/2610568106 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8b0400fa40 con 0x7f8b1415c1c0 2024-09-17T05:28:49.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.250+0000 7f8b0e000640 1 --2- 172.21.15.31:0/2610568106 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8af8073200 0x7f8af80756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:49.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.250+0000 7f8b0e000640 1 -- 172.21.15.31:0/2610568106 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8b040948d0 con 0x7f8b1415c1c0 2024-09-17T05:28:49.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.250+0000 7f8b19e00640 1 --2- 172.21.15.31:0/2610568106 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8af8073200 0x7f8af80756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:49.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.250+0000 7f8b19e00640 1 --2- 172.21.15.31:0/2610568106 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8af8073200 0x7f8af80756c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8b14164ca0 tx=0x7f8b08005f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:49.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.254+0000 7f8b0e000640 1 -- 172.21.15.31:0/2610568106 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8b04014030 con 0x7f8b1415c1c0 2024-09-17T05:28:49.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.430+0000 7f8b1c800640 1 -- 172.21.15.31:0/2610568106 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b140d0650 con 0x7f8b1415c1c0 2024-09-17T05:28:49.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.430+0000 7f8b0e000640 1 -- 172.21.15.31:0/2610568106 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16689 (secure 0 0 0) 0x7f8b0405f320 con 0x7f8b1415c1c0 2024-09-17T05:28:49.433 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:49.433 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":21,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:28:46.650201+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:28:42.906739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:28:44.023489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:28:49.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.434+0000 7f8b1c800640 1 -- 172.21.15.31:0/2610568106 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8af8073200 msgr2=0x7f8af80756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:49.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.434+0000 7f8b1c800640 1 --2- 172.21.15.31:0/2610568106 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8af8073200 0x7f8af80756c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8b14164ca0 tx=0x7f8b08005f90 comp rx=0 tx=0).stop 2024-09-17T05:28:49.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.434+0000 7f8b1c800640 1 -- 172.21.15.31:0/2610568106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b1415c1c0 msgr2=0x7f8b141ffe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:49.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.434+0000 7f8b1c800640 1 --2- 172.21.15.31:0/2610568106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b1415c1c0 0x7f8b141ffe50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400c970 tx=0x7f8b0400ce30 comp rx=0 tx=0).stop 2024-09-17T05:28:49.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.434+0000 7f8b1c800640 1 -- 172.21.15.31:0/2610568106 shutdown_connections 2024-09-17T05:28:49.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.434+0000 7f8b1c800640 1 --2- 172.21.15.31:0/2610568106 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8af8073200 0x7f8af80756c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.434+0000 7f8b1c800640 1 --2- 172.21.15.31:0/2610568106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b1415f7b0 0x7f8b14200390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.434+0000 7f8b1c800640 1 --2- 172.21.15.31:0/2610568106 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b1415c1c0 0x7f8b141ffe50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.434+0000 7f8b1c800640 1 --2- 172.21.15.31:0/2610568106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b1406cc20 0x7f8b1415de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.434+0000 7f8b1c800640 1 -- 172.21.15.31:0/2610568106 >> 172.21.15.31:0/2610568106 conn(0x7f8b140d0c90 msgr2=0x7f8b140b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:49.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.434+0000 7f8b1c800640 1 -- 172.21.15.31:0/2610568106 shutdown_connections 2024-09-17T05:28:49.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.434+0000 7f8b1c800640 1 -- 172.21.15.31:0/2610568106 wait complete. 2024-09-17T05:28:49.456 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:28:49.456 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:28:49.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.598+0000 7f5d9a800640 1 -- 172.21.15.31:0/3318796218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d9415dae0 msgr2=0x7f5d940acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:49.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.598+0000 7f5d9a800640 1 --2- 172.21.15.31:0/3318796218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d9415dae0 0x7f5d940acd40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5d94070d30 tx=0x7f5d8401c7a0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.598+0000 7f5d9a800640 1 -- 172.21.15.31:0/3318796218 shutdown_connections 2024-09-17T05:28:49.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.598+0000 7f5d9a800640 1 --2- 172.21.15.31:0/3318796218 >> v2:172.21.15.155:3300/0 conn(0x7f5d940b49e0 0x7f5d9406f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.598+0000 7f5d9a800640 1 --2- 172.21.15.31:0/3318796218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d9415dae0 0x7f5d940acd40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.598+0000 7f5d9a800640 1 -- 172.21.15.31:0/3318796218 >> 172.21.15.31:0/3318796218 conn(0x7f5d940b18f0 msgr2=0x7f5d940b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:49.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.598+0000 7f5d9a800640 1 -- 172.21.15.31:0/3318796218 shutdown_connections 2024-09-17T05:28:49.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.598+0000 7f5d9a800640 1 -- 172.21.15.31:0/3318796218 wait complete. 2024-09-17T05:28:49.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d9a800640 1 Processor -- start 2024-09-17T05:28:49.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d9a800640 1 -- start start 2024-09-17T05:28:49.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d9a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d940b49e0 0x7f5d94157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:49.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d9a800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d940cd100 0x7f5d9415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:49.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d9a800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9415dae0 0x7f5d9415c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:49.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d9a800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5d940cc9d0 con 0x7f5d940b49e0 2024-09-17T05:28:49.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d9a800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5d940cc850 con 0x7f5d940cd100 2024-09-17T05:28:49.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d9a800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5d940ccb50 con 0x7f5d9415dae0 2024-09-17T05:28:49.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d93400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d940b49e0 0x7f5d94157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:49.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d93400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d940b49e0 0x7f5d94157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41932/0 (socket says 172.21.15.31:41932) 2024-09-17T05:28:49.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d93400640 1 -- 172.21.15.31:0/622532299 learned_addr learned my addr 172.21.15.31:0/622532299 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:49.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d93e00640 1 --2- 172.21.15.31:0/622532299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9415dae0 0x7f5d9415c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:49.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d8be00640 1 --2- 172.21.15.31:0/622532299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d940cd100 0x7f5d9415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:49.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d93400640 1 -- 172.21.15.31:0/622532299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9415dae0 msgr2=0x7f5d9415c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:49.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d93400640 1 --2- 172.21.15.31:0/622532299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9415dae0 0x7f5d9415c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d93400640 1 -- 172.21.15.31:0/622532299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d940cd100 msgr2=0x7f5d9415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:49.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d93400640 1 --2- 172.21.15.31:0/622532299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d940cd100 0x7f5d9415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d93400640 1 -- 172.21.15.31:0/622532299 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d941fb1b0 con 0x7f5d940b49e0 2024-09-17T05:28:49.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d8be00640 1 --2- 172.21.15.31:0/622532299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d940cd100 0x7f5d9415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:28:49.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d93400640 1 --2- 172.21.15.31:0/622532299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d940b49e0 0x7f5d94157af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009850 tx=0x7f5d840a6540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:49.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d8b400640 1 -- 172.21.15.31:0/622532299 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d840ac070 con 0x7f5d940b49e0 2024-09-17T05:28:49.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d8b400640 1 -- 172.21.15.31:0/622532299 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d84004340 con 0x7f5d940b49e0 2024-09-17T05:28:49.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d8b400640 1 -- 172.21.15.31:0/622532299 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d840053a0 con 0x7f5d940b49e0 2024-09-17T05:28:49.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d9a800640 1 -- 172.21.15.31:0/622532299 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d941fb450 con 0x7f5d940b49e0 2024-09-17T05:28:49.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.602+0000 7f5d9a800640 1 -- 172.21.15.31:0/622532299 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d941fba10 con 0x7f5d940b49e0 2024-09-17T05:28:49.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.606+0000 7f5d9a800640 1 -- 172.21.15.31:0/622532299 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d94069410 con 0x7f5d940b49e0 2024-09-17T05:28:49.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.606+0000 7f5d8b400640 1 -- 172.21.15.31:0/622532299 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5d840af070 con 0x7f5d940b49e0 2024-09-17T05:28:49.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.606+0000 7f5d8b400640 1 --2- 172.21.15.31:0/622532299 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5d70073200 0x7f5d700756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:49.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.606+0000 7f5d8b400640 1 -- 172.21.15.31:0/622532299 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5d8412e310 con 0x7f5d940b49e0 2024-09-17T05:28:49.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.606+0000 7f5d8be00640 1 --2- 172.21.15.31:0/622532299 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5d70073200 0x7f5d700756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:49.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.606+0000 7f5d8be00640 1 --2- 172.21.15.31:0/622532299 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5d70073200 0x7f5d700756c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5d941582b0 tx=0x7f5d7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:49.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.610+0000 7f5d8b400640 1 -- 172.21.15.31:0/622532299 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5d840164b0 con 0x7f5d940b49e0 2024-09-17T05:28:49.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.782+0000 7f5d9a800640 1 -- 172.21.15.31:0/622532299 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5d940acd40 con 0x7f5d70073200 2024-09-17T05:28:49.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.790+0000 7f5d8b400640 1 -- 172.21.15.31:0/622532299 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243644 (secure 0 0 0) 0x7f5d7c0547d0 con 0x7f5d70073200 2024-09-17T05:28:49.794 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:49.800 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:28:49.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.794+0000 7f5d9a800640 1 -- 172.21.15.31:0/622532299 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5d70073200 msgr2=0x7f5d700756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:49.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.794+0000 7f5d9a800640 1 --2- 172.21.15.31:0/622532299 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5d70073200 0x7f5d700756c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5d941582b0 tx=0x7f5d7c009040 comp rx=0 tx=0).stop 2024-09-17T05:28:49.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.794+0000 7f5d9a800640 1 -- 172.21.15.31:0/622532299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d940b49e0 msgr2=0x7f5d94157af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:49.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.794+0000 7f5d9a800640 1 --2- 172.21.15.31:0/622532299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d940b49e0 0x7f5d94157af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009850 tx=0x7f5d840a6540 comp rx=0 tx=0).stop 2024-09-17T05:28:49.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.794+0000 7f5d9a800640 1 -- 172.21.15.31:0/622532299 shutdown_connections 2024-09-17T05:28:49.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.794+0000 7f5d9a800640 1 --2- 172.21.15.31:0/622532299 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5d70073200 0x7f5d700756c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.794+0000 7f5d9a800640 1 --2- 172.21.15.31:0/622532299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9415dae0 0x7f5d9415c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.794+0000 7f5d9a800640 1 --2- 172.21.15.31:0/622532299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d940cd100 0x7f5d9415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.794+0000 7f5d9a800640 1 --2- 172.21.15.31:0/622532299 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d940b49e0 0x7f5d94157af0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:49.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.794+0000 7f5d9a800640 1 -- 172.21.15.31:0/622532299 >> 172.21.15.31:0/622532299 conn(0x7f5d940b18f0 msgr2=0x7f5d94158640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:49.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.794+0000 7f5d9a800640 1 -- 172.21.15.31:0/622532299 shutdown_connections 2024-09-17T05:28:49.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:49.794+0000 7f5d9a800640 1 -- 172.21.15.31:0/622532299 wait complete. 2024-09-17T05:28:49.817 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-17T05:28:49.181956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":110,"acting":110,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218816,"kb_used_data":2580,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755904,"statfs":{"total":773094113280,"available":772870045696,"internally_reserved":0,"allocated":2641920,"data_stored":1637043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.547394"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862447+0000","last_change":"2024-09-17T05:28:45.671569+0000","last_active":"2024-09-17T05:28:46.862447+0000","last_peered":"2024-09-17T05:28:46.862447+0000","last_clean":"2024-09-17T05:28:46.862447+0000","last_became_active":"2024-09-17T05:28:45.671278+0000","last_became_peered":"2024-09-17T05:28:45.671278+0000","last_unstale":"2024-09-17T05:28:46.862447+0000","last_undegraded":"2024-09-17T05:28:46.862447+0000","last_fullsized":"2024-09-17T05:28:46.862447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:58:21.650063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660082+0000","last_change":"2024-09-17T05:28:45.689085+0000","last_active":"2024-09-17T05:28:46.660082+0000","last_peered":"2024-09-17T05:28:46.660082+0000","last_clean":"2024-09-17T05:28:46.660082+0000","last_became_active":"2024-09-17T05:28:45.688806+0000","last_became_peered":"2024-09-17T05:28:45.688806+0000","last_unstale":"2024-09-17T05:28:46.660082+0000","last_undegraded":"2024-09-17T05:28:46.660082+0000","last_fullsized":"2024-09-17T05:28:46.660082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:51.791266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660986+0000","last_change":"2024-09-17T05:28:45.674052+0000","last_active":"2024-09-17T05:28:46.660986+0000","last_peered":"2024-09-17T05:28:46.660986+0000","last_clean":"2024-09-17T05:28:46.660986+0000","last_became_active":"2024-09-17T05:28:45.673577+0000","last_became_peered":"2024-09-17T05:28:45.673577+0000","last_unstale":"2024-09-17T05:28:46.660986+0000","last_undegraded":"2024-09-17T05:28:46.660986+0000","last_fullsized":"2024-09-17T05:28:46.660986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:51.624046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861769+0000","last_change":"2024-09-17T05:28:45.664352+0000","last_active":"2024-09-17T05:28:46.861769+0000","last_peered":"2024-09-17T05:28:46.861769+0000","last_clean":"2024-09-17T05:28:46.861769+0000","last_became_active":"2024-09-17T05:28:45.663507+0000","last_became_peered":"2024-09-17T05:28:45.663507+0000","last_unstale":"2024-09-17T05:28:46.861769+0000","last_undegraded":"2024-09-17T05:28:46.861769+0000","last_fullsized":"2024-09-17T05:28:46.861769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:17.848561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659618+0000","last_change":"2024-09-17T05:28:45.670649+0000","last_active":"2024-09-17T05:28:46.659618+0000","last_peered":"2024-09-17T05:28:46.659618+0000","last_clean":"2024-09-17T05:28:46.659618+0000","last_became_active":"2024-09-17T05:28:45.670351+0000","last_became_peered":"2024-09-17T05:28:45.670351+0000","last_unstale":"2024-09-17T05:28:46.659618+0000","last_undegraded":"2024-09-17T05:28:46.659618+0000","last_fullsized":"2024-09-17T05:28:46.659618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:29.130107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660571+0000","last_change":"2024-09-17T05:28:45.679957+0000","last_active":"2024-09-17T05:28:46.660571+0000","last_peered":"2024-09-17T05:28:46.660571+0000","last_clean":"2024-09-17T05:28:46.660571+0000","last_became_active":"2024-09-17T05:28:45.679602+0000","last_became_peered":"2024-09-17T05:28:45.679602+0000","last_unstale":"2024-09-17T05:28:46.660571+0000","last_undegraded":"2024-09-17T05:28:46.660571+0000","last_fullsized":"2024-09-17T05:28:46.660571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:39.462655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861974+0000","last_change":"2024-09-17T05:28:45.679307+0000","last_active":"2024-09-17T05:28:46.861974+0000","last_peered":"2024-09-17T05:28:46.861974+0000","last_clean":"2024-09-17T05:28:46.861974+0000","last_became_active":"2024-09-17T05:28:45.677900+0000","last_became_peered":"2024-09-17T05:28:45.677900+0000","last_unstale":"2024-09-17T05:28:46.861974+0000","last_undegraded":"2024-09-17T05:28:46.861974+0000","last_fullsized":"2024-09-17T05:28:46.861974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:16.537395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661054+0000","last_change":"2024-09-17T05:28:45.675903+0000","last_active":"2024-09-17T05:28:46.661054+0000","last_peered":"2024-09-17T05:28:46.661054+0000","last_clean":"2024-09-17T05:28:46.661054+0000","last_became_active":"2024-09-17T05:28:45.675619+0000","last_became_peered":"2024-09-17T05:28:45.675619+0000","last_unstale":"2024-09-17T05:28:46.661054+0000","last_undegraded":"2024-09-17T05:28:46.661054+0000","last_fullsized":"2024-09-17T05:28:46.661054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:25.383911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660820+0000","last_change":"2024-09-17T05:28:45.670609+0000","last_active":"2024-09-17T05:28:46.660820+0000","last_peered":"2024-09-17T05:28:46.660820+0000","last_clean":"2024-09-17T05:28:46.660820+0000","last_became_active":"2024-09-17T05:28:45.670294+0000","last_became_peered":"2024-09-17T05:28:45.670294+0000","last_unstale":"2024-09-17T05:28:46.660820+0000","last_undegraded":"2024-09-17T05:28:46.660820+0000","last_fullsized":"2024-09-17T05:28:46.660820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:47.532792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862091+0000","last_change":"2024-09-17T05:28:45.686073+0000","last_active":"2024-09-17T05:28:46.862091+0000","last_peered":"2024-09-17T05:28:46.862091+0000","last_clean":"2024-09-17T05:28:46.862091+0000","last_became_active":"2024-09-17T05:28:45.685807+0000","last_became_peered":"2024-09-17T05:28:45.685807+0000","last_unstale":"2024-09-17T05:28:46.862091+0000","last_undegraded":"2024-09-17T05:28:46.862091+0000","last_fullsized":"2024-09-17T05:28:46.862091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:16.599698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661110+0000","last_change":"2024-09-17T05:28:45.671925+0000","last_active":"2024-09-17T05:28:46.661110+0000","last_peered":"2024-09-17T05:28:46.661110+0000","last_clean":"2024-09-17T05:28:46.661110+0000","last_became_active":"2024-09-17T05:28:45.671678+0000","last_became_peered":"2024-09-17T05:28:45.671678+0000","last_unstale":"2024-09-17T05:28:46.661110+0000","last_undegraded":"2024-09-17T05:28:46.661110+0000","last_fullsized":"2024-09-17T05:28:46.661110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:42.029278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.638855+0000","last_change":"2024-09-17T05:28:43.638855+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.638855+0000","last_undegraded":"2024-09-17T05:28:43.638855+0000","last_fullsized":"2024-09-17T05:28:43.638855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862171+0000","last_change":"2024-09-17T05:28:45.661811+0000","last_active":"2024-09-17T05:28:46.862171+0000","last_peered":"2024-09-17T05:28:46.862171+0000","last_clean":"2024-09-17T05:28:46.862171+0000","last_became_active":"2024-09-17T05:28:45.659242+0000","last_became_peered":"2024-09-17T05:28:45.659242+0000","last_unstale":"2024-09-17T05:28:46.862171+0000","last_undegraded":"2024-09-17T05:28:46.862171+0000","last_fullsized":"2024-09-17T05:28:46.862171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:47.085346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.641587+0000","last_change":"2024-09-17T05:28:43.641587+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.641587+0000","last_undegraded":"2024-09-17T05:28:43.641587+0000","last_fullsized":"2024-09-17T05:28:43.641587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.637090+0000","last_change":"2024-09-17T05:28:43.637090+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.637090+0000","last_undegraded":"2024-09-17T05:28:43.637090+0000","last_fullsized":"2024-09-17T05:28:43.637090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660320+0000","last_change":"2024-09-17T05:28:44.659788+0000","last_active":"2024-09-17T05:28:46.660320+0000","last_peered":"2024-09-17T05:28:46.660320+0000","last_clean":"2024-09-17T05:28:46.660320+0000","last_became_active":"2024-09-17T05:28:44.657841+0000","last_became_peered":"2024-09-17T05:28:44.657841+0000","last_unstale":"2024-09-17T05:28:46.660320+0000","last_undegraded":"2024-09-17T05:28:46.660320+0000","last_fullsized":"2024-09-17T05:28:46.660320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:31.718118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.643827+0000","last_change":"2024-09-17T05:28:43.643827+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.643827+0000","last_undegraded":"2024-09-17T05:28:43.643827+0000","last_fullsized":"2024-09-17T05:28:43.643827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660354+0000","last_change":"2024-09-17T05:28:45.682482+0000","last_active":"2024-09-17T05:28:46.660354+0000","last_peered":"2024-09-17T05:28:46.660354+0000","last_clean":"2024-09-17T05:28:46.660354+0000","last_became_active":"2024-09-17T05:28:45.682173+0000","last_became_peered":"2024-09-17T05:28:45.682173+0000","last_unstale":"2024-09-17T05:28:46.660354+0000","last_undegraded":"2024-09-17T05:28:46.660354+0000","last_fullsized":"2024-09-17T05:28:46.660354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:49.488039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660472+0000","last_change":"2024-09-17T05:28:44.660933+0000","last_active":"2024-09-17T05:28:46.660472+0000","last_peered":"2024-09-17T05:28:46.660472+0000","last_clean":"2024-09-17T05:28:46.660472+0000","last_became_active":"2024-09-17T05:28:44.660651+0000","last_became_peered":"2024-09-17T05:28:44.660651+0000","last_unstale":"2024-09-17T05:28:46.660472+0000","last_undegraded":"2024-09-17T05:28:46.660472+0000","last_fullsized":"2024-09-17T05:28:46.660472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:07.374786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862562+0000","last_change":"2024-09-17T05:28:45.680416+0000","last_active":"2024-09-17T05:28:46.862562+0000","last_peered":"2024-09-17T05:28:46.862562+0000","last_clean":"2024-09-17T05:28:46.862562+0000","last_became_active":"2024-09-17T05:28:45.676745+0000","last_became_peered":"2024-09-17T05:28:45.676745+0000","last_unstale":"2024-09-17T05:28:46.862562+0000","last_undegraded":"2024-09-17T05:28:46.862562+0000","last_fullsized":"2024-09-17T05:28:46.862562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:26.799851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.638098+0000","last_change":"2024-09-17T05:28:43.638098+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.638098+0000","last_undegraded":"2024-09-17T05:28:43.638098+0000","last_fullsized":"2024-09-17T05:28:43.638098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.642108+0000","last_change":"2024-09-17T05:28:43.642108+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.642108+0000","last_undegraded":"2024-09-17T05:28:43.642108+0000","last_fullsized":"2024-09-17T05:28:43.642108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862160+0000","last_change":"2024-09-17T05:28:44.656355+0000","last_active":"2024-09-17T05:28:46.862160+0000","last_peered":"2024-09-17T05:28:46.862160+0000","last_clean":"2024-09-17T05:28:46.862160+0000","last_became_active":"2024-09-17T05:28:44.656064+0000","last_became_peered":"2024-09-17T05:28:44.656064+0000","last_unstale":"2024-09-17T05:28:46.862160+0000","last_undegraded":"2024-09-17T05:28:46.862160+0000","last_fullsized":"2024-09-17T05:28:46.862160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:00:37.731866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861989+0000","last_change":"2024-09-17T05:28:45.683802+0000","last_active":"2024-09-17T05:28:46.861989+0000","last_peered":"2024-09-17T05:28:46.861989+0000","last_clean":"2024-09-17T05:28:46.861989+0000","last_became_active":"2024-09-17T05:28:45.681514+0000","last_became_peered":"2024-09-17T05:28:45.681514+0000","last_unstale":"2024-09-17T05:28:46.861989+0000","last_undegraded":"2024-09-17T05:28:46.861989+0000","last_fullsized":"2024-09-17T05:28:46.861989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:03.269669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661166+0000","last_change":"2024-09-17T05:28:44.666923+0000","last_active":"2024-09-17T05:28:46.661166+0000","last_peered":"2024-09-17T05:28:46.661166+0000","last_clean":"2024-09-17T05:28:46.661166+0000","last_became_active":"2024-09-17T05:28:44.663304+0000","last_became_peered":"2024-09-17T05:28:44.663304+0000","last_unstale":"2024-09-17T05:28:46.661166+0000","last_undegraded":"2024-09-17T05:28:46.661166+0000","last_fullsized":"2024-09-17T05:28:46.661166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:39.859160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.642261+0000","last_change":"2024-09-17T05:28:43.642261+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.642261+0000","last_undegraded":"2024-09-17T05:28:43.642261+0000","last_fullsized":"2024-09-17T05:28:43.642261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.645337+0000","last_change":"2024-09-17T05:28:43.645337+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.645337+0000","last_undegraded":"2024-09-17T05:28:43.645337+0000","last_fullsized":"2024-09-17T05:28:43.645337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.646287+0000","last_change":"2024-09-17T05:28:43.646287+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.646287+0000","last_undegraded":"2024-09-17T05:28:43.646287+0000","last_fullsized":"2024-09-17T05:28:43.646287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.645600+0000","last_change":"2024-09-17T05:28:43.645600+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.645600+0000","last_undegraded":"2024-09-17T05:28:43.645600+0000","last_fullsized":"2024-09-17T05:28:43.645600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.636993+0000","last_change":"2024-09-17T05:28:43.636993+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.636993+0000","last_undegraded":"2024-09-17T05:28:43.636993+0000","last_fullsized":"2024-09-17T05:28:43.636993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660529+0000","last_change":"2024-09-17T05:28:45.689026+0000","last_active":"2024-09-17T05:28:46.660529+0000","last_peered":"2024-09-17T05:28:46.660529+0000","last_clean":"2024-09-17T05:28:46.660529+0000","last_became_active":"2024-09-17T05:28:45.688756+0000","last_became_peered":"2024-09-17T05:28:45.688756+0000","last_unstale":"2024-09-17T05:28:46.660529+0000","last_undegraded":"2024-09-17T05:28:46.660529+0000","last_fullsized":"2024-09-17T05:28:46.660529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:51.339078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.645565+0000","last_change":"2024-09-17T05:28:43.645565+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.645565+0000","last_undegraded":"2024-09-17T05:28:43.645565+0000","last_fullsized":"2024-09-17T05:28:43.645565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":105,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T05:28:43.639746+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:28:43.639746+0000","last_peered":"2024-09-17T05:28:43.639746+0000","last_clean":"2024-09-17T05:28:43.639746+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:28:43.639746+0000","last_undegraded":"2024-09-17T05:28:43.639746+0000","last_fullsized":"2024-09-17T05:28:43.639746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659979+0000","last_change":"2024-09-17T05:28:44.655816+0000","last_active":"2024-09-17T05:28:46.659979+0000","last_peered":"2024-09-17T05:28:46.659979+0000","last_clean":"2024-09-17T05:28:46.659979+0000","last_became_active":"2024-09-17T05:28:44.655528+0000","last_became_peered":"2024-09-17T05:28:44.655528+0000","last_unstale":"2024-09-17T05:28:46.659979+0000","last_undegraded":"2024-09-17T05:28:46.659979+0000","last_fullsized":"2024-09-17T05:28:46.659979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:53.370296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.637927+0000","last_change":"2024-09-17T05:28:43.637927+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.637927+0000","last_undegraded":"2024-09-17T05:28:43.637927+0000","last_fullsized":"2024-09-17T05:28:43.637927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861309+0000","last_change":"2024-09-17T05:28:45.670679+0000","last_active":"2024-09-17T05:28:46.861309+0000","last_peered":"2024-09-17T05:28:46.861309+0000","last_clean":"2024-09-17T05:28:46.861309+0000","last_became_active":"2024-09-17T05:28:45.670385+0000","last_became_peered":"2024-09-17T05:28:45.670385+0000","last_unstale":"2024-09-17T05:28:46.861309+0000","last_undegraded":"2024-09-17T05:28:46.861309+0000","last_fullsized":"2024-09-17T05:28:46.861309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:56.353907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.645346+0000","last_change":"2024-09-17T05:28:43.645346+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.645346+0000","last_undegraded":"2024-09-17T05:28:43.645346+0000","last_fullsized":"2024-09-17T05:28:43.645346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661173+0000","last_change":"2024-09-17T05:28:44.659616+0000","last_active":"2024-09-17T05:28:46.661173+0000","last_peered":"2024-09-17T05:28:46.661173+0000","last_clean":"2024-09-17T05:28:46.661173+0000","last_became_active":"2024-09-17T05:28:44.659315+0000","last_became_peered":"2024-09-17T05:28:44.659315+0000","last_unstale":"2024-09-17T05:28:46.661173+0000","last_undegraded":"2024-09-17T05:28:46.661173+0000","last_fullsized":"2024-09-17T05:28:46.661173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:01.383128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.635910+0000","last_change":"2024-09-17T05:28:43.635910+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.635910+0000","last_undegraded":"2024-09-17T05:28:43.635910+0000","last_fullsized":"2024-09-17T05:28:43.635910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660901+0000","last_change":"2024-09-17T05:28:45.673340+0000","last_active":"2024-09-17T05:28:46.660901+0000","last_peered":"2024-09-17T05:28:46.660901+0000","last_clean":"2024-09-17T05:28:46.660901+0000","last_became_active":"2024-09-17T05:28:45.673047+0000","last_became_peered":"2024-09-17T05:28:45.673047+0000","last_unstale":"2024-09-17T05:28:46.660901+0000","last_undegraded":"2024-09-17T05:28:46.660901+0000","last_fullsized":"2024-09-17T05:28:46.660901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:21.863500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.637925+0000","last_change":"2024-09-17T05:28:43.637925+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.637925+0000","last_undegraded":"2024-09-17T05:28:43.637925+0000","last_fullsized":"2024-09-17T05:28:43.637925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.635944+0000","last_change":"2024-09-17T05:28:43.635944+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.635944+0000","last_undegraded":"2024-09-17T05:28:43.635944+0000","last_fullsized":"2024-09-17T05:28:43.635944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.643283+0000","last_change":"2024-09-17T05:28:43.643283+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.643283+0000","last_undegraded":"2024-09-17T05:28:43.643283+0000","last_fullsized":"2024-09-17T05:28:43.643283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862563+0000","last_change":"2024-09-17T05:28:45.669543+0000","last_active":"2024-09-17T05:28:46.862563+0000","last_peered":"2024-09-17T05:28:46.862563+0000","last_clean":"2024-09-17T05:28:46.862563+0000","last_became_active":"2024-09-17T05:28:45.669258+0000","last_became_peered":"2024-09-17T05:28:45.669258+0000","last_unstale":"2024-09-17T05:28:46.862563+0000","last_undegraded":"2024-09-17T05:28:46.862563+0000","last_fullsized":"2024-09-17T05:28:46.862563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:29.130107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.638903+0000","last_change":"2024-09-17T05:28:43.638903+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.638903+0000","last_undegraded":"2024-09-17T05:28:43.638903+0000","last_fullsized":"2024-09-17T05:28:43.638903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.635921+0000","last_change":"2024-09-17T05:28:43.635921+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.635921+0000","last_undegraded":"2024-09-17T05:28:43.635921+0000","last_fullsized":"2024-09-17T05:28:43.635921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.636042+0000","last_change":"2024-09-17T05:28:43.636042+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.636042+0000","last_undegraded":"2024-09-17T05:28:43.636042+0000","last_fullsized":"2024-09-17T05:28:43.636042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.638338+0000","last_change":"2024-09-17T05:28:43.638338+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.638338+0000","last_undegraded":"2024-09-17T05:28:43.638338+0000","last_fullsized":"2024-09-17T05:28:43.638338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660675+0000","last_change":"2024-09-17T05:28:45.674640+0000","last_active":"2024-09-17T05:28:46.660675+0000","last_peered":"2024-09-17T05:28:46.660675+0000","last_clean":"2024-09-17T05:28:46.660675+0000","last_became_active":"2024-09-17T05:28:45.674375+0000","last_became_peered":"2024-09-17T05:28:45.674375+0000","last_unstale":"2024-09-17T05:28:46.660675+0000","last_undegraded":"2024-09-17T05:28:46.660675+0000","last_fullsized":"2024-09-17T05:28:46.660675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:48.986140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.637981+0000","last_change":"2024-09-17T05:28:43.637981+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.637981+0000","last_undegraded":"2024-09-17T05:28:43.637981+0000","last_fullsized":"2024-09-17T05:28:43.637981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660309+0000","last_change":"2024-09-17T05:28:45.675119+0000","last_active":"2024-09-17T05:28:46.660309+0000","last_peered":"2024-09-17T05:28:46.660309+0000","last_clean":"2024-09-17T05:28:46.660309+0000","last_became_active":"2024-09-17T05:28:45.674840+0000","last_became_peered":"2024-09-17T05:28:45.674840+0000","last_unstale":"2024-09-17T05:28:46.660309+0000","last_undegraded":"2024-09-17T05:28:46.660309+0000","last_fullsized":"2024-09-17T05:28:46.660309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:26.709674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.639137+0000","last_change":"2024-09-17T05:28:43.639137+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.639137+0000","last_undegraded":"2024-09-17T05:28:43.639137+0000","last_fullsized":"2024-09-17T05:28:43.639137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862459+0000","last_change":"2024-09-17T05:28:45.677087+0000","last_active":"2024-09-17T05:28:46.862459+0000","last_peered":"2024-09-17T05:28:46.862459+0000","last_clean":"2024-09-17T05:28:46.862459+0000","last_became_active":"2024-09-17T05:28:45.676750+0000","last_became_peered":"2024-09-17T05:28:45.676750+0000","last_unstale":"2024-09-17T05:28:46.862459+0000","last_undegraded":"2024-09-17T05:28:46.862459+0000","last_fullsized":"2024-09-17T05:28:46.862459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:14.581812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.637899+0000","last_change":"2024-09-17T05:28:43.637899+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.637899+0000","last_undegraded":"2024-09-17T05:28:43.637899+0000","last_fullsized":"2024-09-17T05:28:43.637899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862559+0000","last_change":"2024-09-17T05:28:44.666526+0000","last_active":"2024-09-17T05:28:46.862559+0000","last_peered":"2024-09-17T05:28:46.862559+0000","last_clean":"2024-09-17T05:28:46.862559+0000","last_became_active":"2024-09-17T05:28:44.666209+0000","last_became_peered":"2024-09-17T05:28:44.666209+0000","last_unstale":"2024-09-17T05:28:46.862559+0000","last_undegraded":"2024-09-17T05:28:46.862559+0000","last_fullsized":"2024-09-17T05:28:46.862559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:50.431079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":44,"acting":44,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":643205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":159744,"data_stored":47020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509443,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":663193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:28:49.821 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:28:50.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.002+0000 7fb185a00640 1 -- 172.21.15.31:0/2496569588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb18015bb90 msgr2=0x7fb18015f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:50.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.002+0000 7fb185a00640 1 --2- 172.21.15.31:0/2496569588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb18015bb90 0x7fb18015f960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb1800c5640 tx=0x7fb17001c8c0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.002+0000 7fb185a00640 1 -- 172.21.15.31:0/2496569588 shutdown_connections 2024-09-17T05:28:50.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.002+0000 7fb185a00640 1 --2- 172.21.15.31:0/2496569588 >> v2:172.21.15.155:3300/0 conn(0x7fb1800d2940 0x7fb18015fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.002+0000 7fb185a00640 1 --2- 172.21.15.31:0/2496569588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb18015bb90 0x7fb18015f960 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.002+0000 7fb185a00640 1 -- 172.21.15.31:0/2496569588 >> 172.21.15.31:0/2496569588 conn(0x7fb1800d1d90 msgr2=0x7fb1800d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:50.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.002+0000 7fb185a00640 1 -- 172.21.15.31:0/2496569588 shutdown_connections 2024-09-17T05:28:50.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.002+0000 7fb185a00640 1 -- 172.21.15.31:0/2496569588 wait complete. 2024-09-17T05:28:50.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb185a00640 1 Processor -- start 2024-09-17T05:28:50.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb185a00640 1 -- start start 2024-09-17T05:28:50.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb185a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1800d2940 0x7fb18014e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:50.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb185a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb18015bb90 0x7fb18014ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:50.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb185a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb18015bf70 0x7fb180156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:50.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb185a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb1801693f0 con 0x7fb18015bf70 2024-09-17T05:28:50.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb185a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb180169270 con 0x7fb18015bb90 2024-09-17T05:28:50.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb185a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb180169570 con 0x7fb1800d2940 2024-09-17T05:28:50.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb17f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb18015bf70 0x7fb180156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:50.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb17f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb18015bf70 0x7fb180156520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41952/0 (socket says 172.21.15.31:41952) 2024-09-17T05:28:50.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb17f400640 1 -- 172.21.15.31:0/3031926333 learned_addr learned my addr 172.21.15.31:0/3031926333 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:50.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb176000640 1 --2- 172.21.15.31:0/3031926333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb18015bb90 0x7fb18014ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:50.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb17ea00640 1 --2- 172.21.15.31:0/3031926333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1800d2940 0x7fb18014e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:50.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb17f400640 1 -- 172.21.15.31:0/3031926333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1800d2940 msgr2=0x7fb18014e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:50.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb17f400640 1 --2- 172.21.15.31:0/3031926333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1800d2940 0x7fb18014e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb17f400640 1 -- 172.21.15.31:0/3031926333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb18015bb90 msgr2=0x7fb18014ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:50.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb17f400640 1 --2- 172.21.15.31:0/3031926333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb18015bb90 0x7fb18014ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb17f400640 1 -- 172.21.15.31:0/3031926333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1800c5890 con 0x7fb18015bf70 2024-09-17T05:28:50.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb176000640 1 --2- 172.21.15.31:0/3031926333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb18015bb90 0x7fb18014ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:28:50.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb17f400640 1 --2- 172.21.15.31:0/3031926333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb18015bf70 0x7fb180156520 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb17800b970 tx=0x7fb17800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:50.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb177400640 1 -- 172.21.15.31:0/3031926333 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178019070 con 0x7fb18015bf70 2024-09-17T05:28:50.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb177400640 1 -- 172.21.15.31:0/3031926333 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb17800cc30 con 0x7fb18015bf70 2024-09-17T05:28:50.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb177400640 1 -- 172.21.15.31:0/3031926333 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17800ce60 con 0x7fb18015bf70 2024-09-17T05:28:50.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb185a00640 1 -- 172.21.15.31:0/3031926333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1800c7c50 con 0x7fb18015bf70 2024-09-17T05:28:50.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.006+0000 7fb185a00640 1 -- 172.21.15.31:0/3031926333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1800c8210 con 0x7fb18015bf70 2024-09-17T05:28:50.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.010+0000 7fb185a00640 1 -- 172.21.15.31:0/3031926333 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1800cc8a0 con 0x7fb18015bf70 2024-09-17T05:28:50.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.010+0000 7fb177400640 1 -- 172.21.15.31:0/3031926333 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb17801c070 con 0x7fb18015bf70 2024-09-17T05:28:50.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.010+0000 7fb177400640 1 --2- 172.21.15.31:0/3031926333 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb15c073230 0x7fb15c0756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:50.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.010+0000 7fb177400640 1 -- 172.21.15.31:0/3031926333 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb178093d20 con 0x7fb18015bf70 2024-09-17T05:28:50.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.010+0000 7fb17ea00640 1 --2- 172.21.15.31:0/3031926333 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb15c073230 0x7fb15c0756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:50.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.014+0000 7fb17ea00640 1 --2- 172.21.15.31:0/3031926333 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb15c073230 0x7fb15c0756f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb1700af000 tx=0x7fb17001b100 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:50.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.014+0000 7fb177400640 1 -- 172.21.15.31:0/3031926333 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb17805e770 con 0x7fb18015bf70 2024-09-17T05:28:50.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.190+0000 7fb185a00640 1 -- 172.21.15.31:0/3031926333 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb1800c83e0 con 0x7fb15c073230 2024-09-17T05:28:50.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.194+0000 7fb177400640 1 -- 172.21.15.31:0/3031926333 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243644 (secure 0 0 0) 0x7fb1800c83e0 con 0x7fb15c073230 2024-09-17T05:28:50.200 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:50.201 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:28:50.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.198+0000 7fb185a00640 1 -- 172.21.15.31:0/3031926333 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb15c073230 msgr2=0x7fb15c0756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:50.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.198+0000 7fb185a00640 1 --2- 172.21.15.31:0/3031926333 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb15c073230 0x7fb15c0756f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb1700af000 tx=0x7fb17001b100 comp rx=0 tx=0).stop 2024-09-17T05:28:50.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.198+0000 7fb185a00640 1 -- 172.21.15.31:0/3031926333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb18015bf70 msgr2=0x7fb180156520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:50.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.198+0000 7fb185a00640 1 --2- 172.21.15.31:0/3031926333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb18015bf70 0x7fb180156520 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb17800b970 tx=0x7fb17800be30 comp rx=0 tx=0).stop 2024-09-17T05:28:50.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.198+0000 7fb185a00640 1 -- 172.21.15.31:0/3031926333 shutdown_connections 2024-09-17T05:28:50.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.198+0000 7fb185a00640 1 --2- 172.21.15.31:0/3031926333 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb15c073230 0x7fb15c0756f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.198+0000 7fb185a00640 1 --2- 172.21.15.31:0/3031926333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb18015bf70 0x7fb180156520 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.198+0000 7fb185a00640 1 --2- 172.21.15.31:0/3031926333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb18015bb90 0x7fb18014ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.198+0000 7fb185a00640 1 --2- 172.21.15.31:0/3031926333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1800d2940 0x7fb18014e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.198+0000 7fb185a00640 1 -- 172.21.15.31:0/3031926333 >> 172.21.15.31:0/3031926333 conn(0x7fb1800d1d90 msgr2=0x7fb180157550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:50.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.198+0000 7fb185a00640 1 -- 172.21.15.31:0/3031926333 shutdown_connections 2024-09-17T05:28:50.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.198+0000 7fb185a00640 1 -- 172.21.15.31:0/3031926333 wait complete. 2024-09-17T05:28:50.221 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-17T05:28:49.181956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":110,"acting":110,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218816,"kb_used_data":2580,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755904,"statfs":{"total":773094113280,"available":772870045696,"internally_reserved":0,"allocated":2641920,"data_stored":1637043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.547394"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862447+0000","last_change":"2024-09-17T05:28:45.671569+0000","last_active":"2024-09-17T05:28:46.862447+0000","last_peered":"2024-09-17T05:28:46.862447+0000","last_clean":"2024-09-17T05:28:46.862447+0000","last_became_active":"2024-09-17T05:28:45.671278+0000","last_became_peered":"2024-09-17T05:28:45.671278+0000","last_unstale":"2024-09-17T05:28:46.862447+0000","last_undegraded":"2024-09-17T05:28:46.862447+0000","last_fullsized":"2024-09-17T05:28:46.862447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:58:21.650063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660082+0000","last_change":"2024-09-17T05:28:45.689085+0000","last_active":"2024-09-17T05:28:46.660082+0000","last_peered":"2024-09-17T05:28:46.660082+0000","last_clean":"2024-09-17T05:28:46.660082+0000","last_became_active":"2024-09-17T05:28:45.688806+0000","last_became_peered":"2024-09-17T05:28:45.688806+0000","last_unstale":"2024-09-17T05:28:46.660082+0000","last_undegraded":"2024-09-17T05:28:46.660082+0000","last_fullsized":"2024-09-17T05:28:46.660082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:51.791266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660986+0000","last_change":"2024-09-17T05:28:45.674052+0000","last_active":"2024-09-17T05:28:46.660986+0000","last_peered":"2024-09-17T05:28:46.660986+0000","last_clean":"2024-09-17T05:28:46.660986+0000","last_became_active":"2024-09-17T05:28:45.673577+0000","last_became_peered":"2024-09-17T05:28:45.673577+0000","last_unstale":"2024-09-17T05:28:46.660986+0000","last_undegraded":"2024-09-17T05:28:46.660986+0000","last_fullsized":"2024-09-17T05:28:46.660986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:51.624046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861769+0000","last_change":"2024-09-17T05:28:45.664352+0000","last_active":"2024-09-17T05:28:46.861769+0000","last_peered":"2024-09-17T05:28:46.861769+0000","last_clean":"2024-09-17T05:28:46.861769+0000","last_became_active":"2024-09-17T05:28:45.663507+0000","last_became_peered":"2024-09-17T05:28:45.663507+0000","last_unstale":"2024-09-17T05:28:46.861769+0000","last_undegraded":"2024-09-17T05:28:46.861769+0000","last_fullsized":"2024-09-17T05:28:46.861769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:17.848561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659618+0000","last_change":"2024-09-17T05:28:45.670649+0000","last_active":"2024-09-17T05:28:46.659618+0000","last_peered":"2024-09-17T05:28:46.659618+0000","last_clean":"2024-09-17T05:28:46.659618+0000","last_became_active":"2024-09-17T05:28:45.670351+0000","last_became_peered":"2024-09-17T05:28:45.670351+0000","last_unstale":"2024-09-17T05:28:46.659618+0000","last_undegraded":"2024-09-17T05:28:46.659618+0000","last_fullsized":"2024-09-17T05:28:46.659618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:29.130107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660571+0000","last_change":"2024-09-17T05:28:45.679957+0000","last_active":"2024-09-17T05:28:46.660571+0000","last_peered":"2024-09-17T05:28:46.660571+0000","last_clean":"2024-09-17T05:28:46.660571+0000","last_became_active":"2024-09-17T05:28:45.679602+0000","last_became_peered":"2024-09-17T05:28:45.679602+0000","last_unstale":"2024-09-17T05:28:46.660571+0000","last_undegraded":"2024-09-17T05:28:46.660571+0000","last_fullsized":"2024-09-17T05:28:46.660571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:39.462655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861974+0000","last_change":"2024-09-17T05:28:45.679307+0000","last_active":"2024-09-17T05:28:46.861974+0000","last_peered":"2024-09-17T05:28:46.861974+0000","last_clean":"2024-09-17T05:28:46.861974+0000","last_became_active":"2024-09-17T05:28:45.677900+0000","last_became_peered":"2024-09-17T05:28:45.677900+0000","last_unstale":"2024-09-17T05:28:46.861974+0000","last_undegraded":"2024-09-17T05:28:46.861974+0000","last_fullsized":"2024-09-17T05:28:46.861974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:16.537395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661054+0000","last_change":"2024-09-17T05:28:45.675903+0000","last_active":"2024-09-17T05:28:46.661054+0000","last_peered":"2024-09-17T05:28:46.661054+0000","last_clean":"2024-09-17T05:28:46.661054+0000","last_became_active":"2024-09-17T05:28:45.675619+0000","last_became_peered":"2024-09-17T05:28:45.675619+0000","last_unstale":"2024-09-17T05:28:46.661054+0000","last_undegraded":"2024-09-17T05:28:46.661054+0000","last_fullsized":"2024-09-17T05:28:46.661054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:25.383911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660820+0000","last_change":"2024-09-17T05:28:45.670609+0000","last_active":"2024-09-17T05:28:46.660820+0000","last_peered":"2024-09-17T05:28:46.660820+0000","last_clean":"2024-09-17T05:28:46.660820+0000","last_became_active":"2024-09-17T05:28:45.670294+0000","last_became_peered":"2024-09-17T05:28:45.670294+0000","last_unstale":"2024-09-17T05:28:46.660820+0000","last_undegraded":"2024-09-17T05:28:46.660820+0000","last_fullsized":"2024-09-17T05:28:46.660820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:47.532792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862091+0000","last_change":"2024-09-17T05:28:45.686073+0000","last_active":"2024-09-17T05:28:46.862091+0000","last_peered":"2024-09-17T05:28:46.862091+0000","last_clean":"2024-09-17T05:28:46.862091+0000","last_became_active":"2024-09-17T05:28:45.685807+0000","last_became_peered":"2024-09-17T05:28:45.685807+0000","last_unstale":"2024-09-17T05:28:46.862091+0000","last_undegraded":"2024-09-17T05:28:46.862091+0000","last_fullsized":"2024-09-17T05:28:46.862091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:16.599698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661110+0000","last_change":"2024-09-17T05:28:45.671925+0000","last_active":"2024-09-17T05:28:46.661110+0000","last_peered":"2024-09-17T05:28:46.661110+0000","last_clean":"2024-09-17T05:28:46.661110+0000","last_became_active":"2024-09-17T05:28:45.671678+0000","last_became_peered":"2024-09-17T05:28:45.671678+0000","last_unstale":"2024-09-17T05:28:46.661110+0000","last_undegraded":"2024-09-17T05:28:46.661110+0000","last_fullsized":"2024-09-17T05:28:46.661110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:42.029278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.638855+0000","last_change":"2024-09-17T05:28:43.638855+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.638855+0000","last_undegraded":"2024-09-17T05:28:43.638855+0000","last_fullsized":"2024-09-17T05:28:43.638855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862171+0000","last_change":"2024-09-17T05:28:45.661811+0000","last_active":"2024-09-17T05:28:46.862171+0000","last_peered":"2024-09-17T05:28:46.862171+0000","last_clean":"2024-09-17T05:28:46.862171+0000","last_became_active":"2024-09-17T05:28:45.659242+0000","last_became_peered":"2024-09-17T05:28:45.659242+0000","last_unstale":"2024-09-17T05:28:46.862171+0000","last_undegraded":"2024-09-17T05:28:46.862171+0000","last_fullsized":"2024-09-17T05:28:46.862171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:47.085346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.641587+0000","last_change":"2024-09-17T05:28:43.641587+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.641587+0000","last_undegraded":"2024-09-17T05:28:43.641587+0000","last_fullsized":"2024-09-17T05:28:43.641587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.637090+0000","last_change":"2024-09-17T05:28:43.637090+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.637090+0000","last_undegraded":"2024-09-17T05:28:43.637090+0000","last_fullsized":"2024-09-17T05:28:43.637090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660320+0000","last_change":"2024-09-17T05:28:44.659788+0000","last_active":"2024-09-17T05:28:46.660320+0000","last_peered":"2024-09-17T05:28:46.660320+0000","last_clean":"2024-09-17T05:28:46.660320+0000","last_became_active":"2024-09-17T05:28:44.657841+0000","last_became_peered":"2024-09-17T05:28:44.657841+0000","last_unstale":"2024-09-17T05:28:46.660320+0000","last_undegraded":"2024-09-17T05:28:46.660320+0000","last_fullsized":"2024-09-17T05:28:46.660320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:31.718118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.643827+0000","last_change":"2024-09-17T05:28:43.643827+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.643827+0000","last_undegraded":"2024-09-17T05:28:43.643827+0000","last_fullsized":"2024-09-17T05:28:43.643827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660354+0000","last_change":"2024-09-17T05:28:45.682482+0000","last_active":"2024-09-17T05:28:46.660354+0000","last_peered":"2024-09-17T05:28:46.660354+0000","last_clean":"2024-09-17T05:28:46.660354+0000","last_became_active":"2024-09-17T05:28:45.682173+0000","last_became_peered":"2024-09-17T05:28:45.682173+0000","last_unstale":"2024-09-17T05:28:46.660354+0000","last_undegraded":"2024-09-17T05:28:46.660354+0000","last_fullsized":"2024-09-17T05:28:46.660354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:49.488039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660472+0000","last_change":"2024-09-17T05:28:44.660933+0000","last_active":"2024-09-17T05:28:46.660472+0000","last_peered":"2024-09-17T05:28:46.660472+0000","last_clean":"2024-09-17T05:28:46.660472+0000","last_became_active":"2024-09-17T05:28:44.660651+0000","last_became_peered":"2024-09-17T05:28:44.660651+0000","last_unstale":"2024-09-17T05:28:46.660472+0000","last_undegraded":"2024-09-17T05:28:46.660472+0000","last_fullsized":"2024-09-17T05:28:46.660472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:07.374786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862562+0000","last_change":"2024-09-17T05:28:45.680416+0000","last_active":"2024-09-17T05:28:46.862562+0000","last_peered":"2024-09-17T05:28:46.862562+0000","last_clean":"2024-09-17T05:28:46.862562+0000","last_became_active":"2024-09-17T05:28:45.676745+0000","last_became_peered":"2024-09-17T05:28:45.676745+0000","last_unstale":"2024-09-17T05:28:46.862562+0000","last_undegraded":"2024-09-17T05:28:46.862562+0000","last_fullsized":"2024-09-17T05:28:46.862562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:26.799851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.638098+0000","last_change":"2024-09-17T05:28:43.638098+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.638098+0000","last_undegraded":"2024-09-17T05:28:43.638098+0000","last_fullsized":"2024-09-17T05:28:43.638098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.642108+0000","last_change":"2024-09-17T05:28:43.642108+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.642108+0000","last_undegraded":"2024-09-17T05:28:43.642108+0000","last_fullsized":"2024-09-17T05:28:43.642108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862160+0000","last_change":"2024-09-17T05:28:44.656355+0000","last_active":"2024-09-17T05:28:46.862160+0000","last_peered":"2024-09-17T05:28:46.862160+0000","last_clean":"2024-09-17T05:28:46.862160+0000","last_became_active":"2024-09-17T05:28:44.656064+0000","last_became_peered":"2024-09-17T05:28:44.656064+0000","last_unstale":"2024-09-17T05:28:46.862160+0000","last_undegraded":"2024-09-17T05:28:46.862160+0000","last_fullsized":"2024-09-17T05:28:46.862160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:00:37.731866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861989+0000","last_change":"2024-09-17T05:28:45.683802+0000","last_active":"2024-09-17T05:28:46.861989+0000","last_peered":"2024-09-17T05:28:46.861989+0000","last_clean":"2024-09-17T05:28:46.861989+0000","last_became_active":"2024-09-17T05:28:45.681514+0000","last_became_peered":"2024-09-17T05:28:45.681514+0000","last_unstale":"2024-09-17T05:28:46.861989+0000","last_undegraded":"2024-09-17T05:28:46.861989+0000","last_fullsized":"2024-09-17T05:28:46.861989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:03.269669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661166+0000","last_change":"2024-09-17T05:28:44.666923+0000","last_active":"2024-09-17T05:28:46.661166+0000","last_peered":"2024-09-17T05:28:46.661166+0000","last_clean":"2024-09-17T05:28:46.661166+0000","last_became_active":"2024-09-17T05:28:44.663304+0000","last_became_peered":"2024-09-17T05:28:44.663304+0000","last_unstale":"2024-09-17T05:28:46.661166+0000","last_undegraded":"2024-09-17T05:28:46.661166+0000","last_fullsized":"2024-09-17T05:28:46.661166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:39.859160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.642261+0000","last_change":"2024-09-17T05:28:43.642261+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.642261+0000","last_undegraded":"2024-09-17T05:28:43.642261+0000","last_fullsized":"2024-09-17T05:28:43.642261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.645337+0000","last_change":"2024-09-17T05:28:43.645337+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.645337+0000","last_undegraded":"2024-09-17T05:28:43.645337+0000","last_fullsized":"2024-09-17T05:28:43.645337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.646287+0000","last_change":"2024-09-17T05:28:43.646287+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.646287+0000","last_undegraded":"2024-09-17T05:28:43.646287+0000","last_fullsized":"2024-09-17T05:28:43.646287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.645600+0000","last_change":"2024-09-17T05:28:43.645600+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.645600+0000","last_undegraded":"2024-09-17T05:28:43.645600+0000","last_fullsized":"2024-09-17T05:28:43.645600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.636993+0000","last_change":"2024-09-17T05:28:43.636993+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.636993+0000","last_undegraded":"2024-09-17T05:28:43.636993+0000","last_fullsized":"2024-09-17T05:28:43.636993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660529+0000","last_change":"2024-09-17T05:28:45.689026+0000","last_active":"2024-09-17T05:28:46.660529+0000","last_peered":"2024-09-17T05:28:46.660529+0000","last_clean":"2024-09-17T05:28:46.660529+0000","last_became_active":"2024-09-17T05:28:45.688756+0000","last_became_peered":"2024-09-17T05:28:45.688756+0000","last_unstale":"2024-09-17T05:28:46.660529+0000","last_undegraded":"2024-09-17T05:28:46.660529+0000","last_fullsized":"2024-09-17T05:28:46.660529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:51.339078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.645565+0000","last_change":"2024-09-17T05:28:43.645565+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.645565+0000","last_undegraded":"2024-09-17T05:28:43.645565+0000","last_fullsized":"2024-09-17T05:28:43.645565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":105,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T05:28:43.639746+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:28:43.639746+0000","last_peered":"2024-09-17T05:28:43.639746+0000","last_clean":"2024-09-17T05:28:43.639746+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:28:43.639746+0000","last_undegraded":"2024-09-17T05:28:43.639746+0000","last_fullsized":"2024-09-17T05:28:43.639746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659979+0000","last_change":"2024-09-17T05:28:44.655816+0000","last_active":"2024-09-17T05:28:46.659979+0000","last_peered":"2024-09-17T05:28:46.659979+0000","last_clean":"2024-09-17T05:28:46.659979+0000","last_became_active":"2024-09-17T05:28:44.655528+0000","last_became_peered":"2024-09-17T05:28:44.655528+0000","last_unstale":"2024-09-17T05:28:46.659979+0000","last_undegraded":"2024-09-17T05:28:46.659979+0000","last_fullsized":"2024-09-17T05:28:46.659979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:53.370296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.637927+0000","last_change":"2024-09-17T05:28:43.637927+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.637927+0000","last_undegraded":"2024-09-17T05:28:43.637927+0000","last_fullsized":"2024-09-17T05:28:43.637927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861309+0000","last_change":"2024-09-17T05:28:45.670679+0000","last_active":"2024-09-17T05:28:46.861309+0000","last_peered":"2024-09-17T05:28:46.861309+0000","last_clean":"2024-09-17T05:28:46.861309+0000","last_became_active":"2024-09-17T05:28:45.670385+0000","last_became_peered":"2024-09-17T05:28:45.670385+0000","last_unstale":"2024-09-17T05:28:46.861309+0000","last_undegraded":"2024-09-17T05:28:46.861309+0000","last_fullsized":"2024-09-17T05:28:46.861309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:56.353907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.645346+0000","last_change":"2024-09-17T05:28:43.645346+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.645346+0000","last_undegraded":"2024-09-17T05:28:43.645346+0000","last_fullsized":"2024-09-17T05:28:43.645346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661173+0000","last_change":"2024-09-17T05:28:44.659616+0000","last_active":"2024-09-17T05:28:46.661173+0000","last_peered":"2024-09-17T05:28:46.661173+0000","last_clean":"2024-09-17T05:28:46.661173+0000","last_became_active":"2024-09-17T05:28:44.659315+0000","last_became_peered":"2024-09-17T05:28:44.659315+0000","last_unstale":"2024-09-17T05:28:46.661173+0000","last_undegraded":"2024-09-17T05:28:46.661173+0000","last_fullsized":"2024-09-17T05:28:46.661173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:01.383128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.635910+0000","last_change":"2024-09-17T05:28:43.635910+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.635910+0000","last_undegraded":"2024-09-17T05:28:43.635910+0000","last_fullsized":"2024-09-17T05:28:43.635910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660901+0000","last_change":"2024-09-17T05:28:45.673340+0000","last_active":"2024-09-17T05:28:46.660901+0000","last_peered":"2024-09-17T05:28:46.660901+0000","last_clean":"2024-09-17T05:28:46.660901+0000","last_became_active":"2024-09-17T05:28:45.673047+0000","last_became_peered":"2024-09-17T05:28:45.673047+0000","last_unstale":"2024-09-17T05:28:46.660901+0000","last_undegraded":"2024-09-17T05:28:46.660901+0000","last_fullsized":"2024-09-17T05:28:46.660901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:21.863500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.637925+0000","last_change":"2024-09-17T05:28:43.637925+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.637925+0000","last_undegraded":"2024-09-17T05:28:43.637925+0000","last_fullsized":"2024-09-17T05:28:43.637925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.635944+0000","last_change":"2024-09-17T05:28:43.635944+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.635944+0000","last_undegraded":"2024-09-17T05:28:43.635944+0000","last_fullsized":"2024-09-17T05:28:43.635944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.643283+0000","last_change":"2024-09-17T05:28:43.643283+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.643283+0000","last_undegraded":"2024-09-17T05:28:43.643283+0000","last_fullsized":"2024-09-17T05:28:43.643283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862563+0000","last_change":"2024-09-17T05:28:45.669543+0000","last_active":"2024-09-17T05:28:46.862563+0000","last_peered":"2024-09-17T05:28:46.862563+0000","last_clean":"2024-09-17T05:28:46.862563+0000","last_became_active":"2024-09-17T05:28:45.669258+0000","last_became_peered":"2024-09-17T05:28:45.669258+0000","last_unstale":"2024-09-17T05:28:46.862563+0000","last_undegraded":"2024-09-17T05:28:46.862563+0000","last_fullsized":"2024-09-17T05:28:46.862563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:29.130107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.638903+0000","last_change":"2024-09-17T05:28:43.638903+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.638903+0000","last_undegraded":"2024-09-17T05:28:43.638903+0000","last_fullsized":"2024-09-17T05:28:43.638903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.635921+0000","last_change":"2024-09-17T05:28:43.635921+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.635921+0000","last_undegraded":"2024-09-17T05:28:43.635921+0000","last_fullsized":"2024-09-17T05:28:43.635921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.636042+0000","last_change":"2024-09-17T05:28:43.636042+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.636042+0000","last_undegraded":"2024-09-17T05:28:43.636042+0000","last_fullsized":"2024-09-17T05:28:43.636042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.638338+0000","last_change":"2024-09-17T05:28:43.638338+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.638338+0000","last_undegraded":"2024-09-17T05:28:43.638338+0000","last_fullsized":"2024-09-17T05:28:43.638338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660675+0000","last_change":"2024-09-17T05:28:45.674640+0000","last_active":"2024-09-17T05:28:46.660675+0000","last_peered":"2024-09-17T05:28:46.660675+0000","last_clean":"2024-09-17T05:28:46.660675+0000","last_became_active":"2024-09-17T05:28:45.674375+0000","last_became_peered":"2024-09-17T05:28:45.674375+0000","last_unstale":"2024-09-17T05:28:46.660675+0000","last_undegraded":"2024-09-17T05:28:46.660675+0000","last_fullsized":"2024-09-17T05:28:46.660675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:48.986140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.637981+0000","last_change":"2024-09-17T05:28:43.637981+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.637981+0000","last_undegraded":"2024-09-17T05:28:43.637981+0000","last_fullsized":"2024-09-17T05:28:43.637981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660309+0000","last_change":"2024-09-17T05:28:45.675119+0000","last_active":"2024-09-17T05:28:46.660309+0000","last_peered":"2024-09-17T05:28:46.660309+0000","last_clean":"2024-09-17T05:28:46.660309+0000","last_became_active":"2024-09-17T05:28:45.674840+0000","last_became_peered":"2024-09-17T05:28:45.674840+0000","last_unstale":"2024-09-17T05:28:46.660309+0000","last_undegraded":"2024-09-17T05:28:46.660309+0000","last_fullsized":"2024-09-17T05:28:46.660309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:26.709674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.639137+0000","last_change":"2024-09-17T05:28:43.639137+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.639137+0000","last_undegraded":"2024-09-17T05:28:43.639137+0000","last_fullsized":"2024-09-17T05:28:43.639137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862459+0000","last_change":"2024-09-17T05:28:45.677087+0000","last_active":"2024-09-17T05:28:46.862459+0000","last_peered":"2024-09-17T05:28:46.862459+0000","last_clean":"2024-09-17T05:28:46.862459+0000","last_became_active":"2024-09-17T05:28:45.676750+0000","last_became_peered":"2024-09-17T05:28:45.676750+0000","last_unstale":"2024-09-17T05:28:46.862459+0000","last_undegraded":"2024-09-17T05:28:46.862459+0000","last_fullsized":"2024-09-17T05:28:46.862459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:14.581812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.637899+0000","last_change":"2024-09-17T05:28:43.637899+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.637899+0000","last_undegraded":"2024-09-17T05:28:43.637899+0000","last_fullsized":"2024-09-17T05:28:43.637899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862559+0000","last_change":"2024-09-17T05:28:44.666526+0000","last_active":"2024-09-17T05:28:46.862559+0000","last_peered":"2024-09-17T05:28:46.862559+0000","last_clean":"2024-09-17T05:28:46.862559+0000","last_became_active":"2024-09-17T05:28:44.666209+0000","last_became_peered":"2024-09-17T05:28:44.666209+0000","last_unstale":"2024-09-17T05:28:46.862559+0000","last_undegraded":"2024-09-17T05:28:46.862559+0000","last_fullsized":"2024-09-17T05:28:46.862559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:50.431079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":44,"acting":44,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":643205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":159744,"data_stored":47020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509443,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":663193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:28:50.225 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:28:50.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.406+0000 7fb94e000640 1 -- 172.21.15.31:0/4279143996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb94815bea0 msgr2=0x7fb9480ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:50.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.406+0000 7fb94e000640 1 --2- 172.21.15.31:0/4279143996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb94815bea0 0x7fb9480ce670 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb938009840 tx=0x7fb93801c790 comp rx=0 tx=0).stop 2024-09-17T05:28:50.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.406+0000 7fb94e000640 1 -- 172.21.15.31:0/4279143996 shutdown_connections 2024-09-17T05:28:50.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.406+0000 7fb94e000640 1 --2- 172.21.15.31:0/4279143996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb94815bea0 0x7fb9480ce670 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.406+0000 7fb94e000640 1 -- 172.21.15.31:0/4279143996 >> 172.21.15.31:0/4279143996 conn(0x7fb9480d1dc0 msgr2=0x7fb9480d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:50.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.406+0000 7fb94e000640 1 -- 172.21.15.31:0/4279143996 shutdown_connections 2024-09-17T05:28:50.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.406+0000 7fb94e000640 1 -- 172.21.15.31:0/4279143996 wait complete. 2024-09-17T05:28:50.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.406+0000 7fb94e000640 1 Processor -- start 2024-09-17T05:28:50.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.406+0000 7fb94e000640 1 -- start start 2024-09-17T05:28:50.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.406+0000 7fb94e000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9480cdb30 0x7fb9480b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:50.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.406+0000 7fb94e000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9480d28e0 0x7fb9480b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:50.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.406+0000 7fb94e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb94815bea0 0x7fb94814d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:50.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.406+0000 7fb94e000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb94816a930 con 0x7fb94815bea0 2024-09-17T05:28:50.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.406+0000 7fb94e000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb94816a7b0 con 0x7fb9480cdb30 2024-09-17T05:28:50.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.406+0000 7fb94e000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb94816aab0 con 0x7fb9480d28e0 2024-09-17T05:28:50.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.410+0000 7fb947e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb94815bea0 0x7fb94814d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:50.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.410+0000 7fb947400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9480cdb30 0x7fb9480b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:50.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.410+0000 7fb947e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb94815bea0 0x7fb94814d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41958/0 (socket says 172.21.15.31:41958) 2024-09-17T05:28:50.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.410+0000 7fb947e00640 1 -- 172.21.15.31:0/3183520268 learned_addr learned my addr 172.21.15.31:0/3183520268 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:50.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.410+0000 7fb93fe00640 1 --2- 172.21.15.31:0/3183520268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9480d28e0 0x7fb9480b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:50.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.410+0000 7fb947400640 1 -- 172.21.15.31:0/3183520268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9480d28e0 msgr2=0x7fb9480b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:50.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.410+0000 7fb947400640 1 --2- 172.21.15.31:0/3183520268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9480d28e0 0x7fb9480b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.410+0000 7fb947400640 1 -- 172.21.15.31:0/3183520268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb94815bea0 msgr2=0x7fb94814d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:50.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.410+0000 7fb947400640 1 --2- 172.21.15.31:0/3183520268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb94815bea0 0x7fb94814d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.410+0000 7fb947400640 1 -- 172.21.15.31:0/3183520268 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9480b16a0 con 0x7fb9480cdb30 2024-09-17T05:28:50.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.410+0000 7fb947400640 1 --2- 172.21.15.31:0/3183520268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9480cdb30 0x7fb9480b2700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb9380ac000 tx=0x7fb9380a64f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:50.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.410+0000 7fb93f400640 1 -- 172.21.15.31:0/3183520268 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb938004030 con 0x7fb9480cdb30 2024-09-17T05:28:50.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.410+0000 7fb93f400640 1 -- 172.21.15.31:0/3183520268 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9380041f0 con 0x7fb9480cdb30 2024-09-17T05:28:50.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.410+0000 7fb93f400640 1 -- 172.21.15.31:0/3183520268 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb938005070 con 0x7fb9480cdb30 2024-09-17T05:28:50.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.410+0000 7fb94e000640 1 -- 172.21.15.31:0/3183520268 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9480b3400 con 0x7fb9480cdb30 2024-09-17T05:28:50.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.410+0000 7fb94e000640 1 -- 172.21.15.31:0/3183520268 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9480b1c20 con 0x7fb9480cdb30 2024-09-17T05:28:50.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.410+0000 7fb94e000640 1 -- 172.21.15.31:0/3183520268 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9480ce670 con 0x7fb9480cdb30 2024-09-17T05:28:50.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.410+0000 7fb93f400640 1 -- 172.21.15.31:0/3183520268 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb9380a67a0 con 0x7fb9480cdb30 2024-09-17T05:28:50.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.414+0000 7fb93f400640 1 --2- 172.21.15.31:0/3183520268 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb924073200 0x7fb9240756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:50.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.414+0000 7fb93f400640 1 -- 172.21.15.31:0/3183520268 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb93812df50 con 0x7fb9480cdb30 2024-09-17T05:28:50.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.414+0000 7fb93fe00640 1 --2- 172.21.15.31:0/3183520268 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb924073200 0x7fb9240756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:50.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.414+0000 7fb93fe00640 1 --2- 172.21.15.31:0/3183520268 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb924073200 0x7fb9240756c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb9481536b0 tx=0x7fb930009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:50.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.418+0000 7fb93f400640 1 -- 172.21.15.31:0/3183520268 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb9380bf030 con 0x7fb9480cdb30 2024-09-17T05:28:50.527 INFO:tasks.ceph.mds.c.smithi031.stderr:2024-09-17T05:28:50.526+0000 7fbd17000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:28:50.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.590+0000 7fb94e000640 1 -- 172.21.15.31:0/3183520268 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb9481541f0 con 0x7fb924073200 2024-09-17T05:28:50.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.594+0000 7fb93f400640 1 -- 172.21.15.31:0/3183520268 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243644 (secure 0 0 0) 0x7fb9481541f0 con 0x7fb924073200 2024-09-17T05:28:50.599 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:50.601 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:28:50.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.598+0000 7fb94e000640 1 -- 172.21.15.31:0/3183520268 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb924073200 msgr2=0x7fb9240756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:50.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.598+0000 7fb94e000640 1 --2- 172.21.15.31:0/3183520268 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb924073200 0x7fb9240756c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb9481536b0 tx=0x7fb930009040 comp rx=0 tx=0).stop 2024-09-17T05:28:50.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.598+0000 7fb94e000640 1 -- 172.21.15.31:0/3183520268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9480cdb30 msgr2=0x7fb9480b2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:50.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.598+0000 7fb94e000640 1 --2- 172.21.15.31:0/3183520268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9480cdb30 0x7fb9480b2700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb9380ac000 tx=0x7fb9380a64f0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.598+0000 7fb94e000640 1 -- 172.21.15.31:0/3183520268 shutdown_connections 2024-09-17T05:28:50.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.598+0000 7fb94e000640 1 --2- 172.21.15.31:0/3183520268 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb924073200 0x7fb9240756c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.598+0000 7fb94e000640 1 --2- 172.21.15.31:0/3183520268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb94815bea0 0x7fb94814d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.598+0000 7fb94e000640 1 --2- 172.21.15.31:0/3183520268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb9480d28e0 0x7fb9480b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.598+0000 7fb94e000640 1 --2- 172.21.15.31:0/3183520268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9480cdb30 0x7fb9480b2700 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.598+0000 7fb94e000640 1 -- 172.21.15.31:0/3183520268 >> 172.21.15.31:0/3183520268 conn(0x7fb9480d1dc0 msgr2=0x7fb9480cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:50.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.598+0000 7fb94e000640 1 -- 172.21.15.31:0/3183520268 shutdown_connections 2024-09-17T05:28:50.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.598+0000 7fb94e000640 1 -- 172.21.15.31:0/3183520268 wait complete. 2024-09-17T05:28:50.619 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-17T05:28:49.181956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":110,"acting":110,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218816,"kb_used_data":2580,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755904,"statfs":{"total":773094113280,"available":772870045696,"internally_reserved":0,"allocated":2641920,"data_stored":1637043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.547394"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862447+0000","last_change":"2024-09-17T05:28:45.671569+0000","last_active":"2024-09-17T05:28:46.862447+0000","last_peered":"2024-09-17T05:28:46.862447+0000","last_clean":"2024-09-17T05:28:46.862447+0000","last_became_active":"2024-09-17T05:28:45.671278+0000","last_became_peered":"2024-09-17T05:28:45.671278+0000","last_unstale":"2024-09-17T05:28:46.862447+0000","last_undegraded":"2024-09-17T05:28:46.862447+0000","last_fullsized":"2024-09-17T05:28:46.862447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:58:21.650063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660082+0000","last_change":"2024-09-17T05:28:45.689085+0000","last_active":"2024-09-17T05:28:46.660082+0000","last_peered":"2024-09-17T05:28:46.660082+0000","last_clean":"2024-09-17T05:28:46.660082+0000","last_became_active":"2024-09-17T05:28:45.688806+0000","last_became_peered":"2024-09-17T05:28:45.688806+0000","last_unstale":"2024-09-17T05:28:46.660082+0000","last_undegraded":"2024-09-17T05:28:46.660082+0000","last_fullsized":"2024-09-17T05:28:46.660082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:51.791266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660986+0000","last_change":"2024-09-17T05:28:45.674052+0000","last_active":"2024-09-17T05:28:46.660986+0000","last_peered":"2024-09-17T05:28:46.660986+0000","last_clean":"2024-09-17T05:28:46.660986+0000","last_became_active":"2024-09-17T05:28:45.673577+0000","last_became_peered":"2024-09-17T05:28:45.673577+0000","last_unstale":"2024-09-17T05:28:46.660986+0000","last_undegraded":"2024-09-17T05:28:46.660986+0000","last_fullsized":"2024-09-17T05:28:46.660986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:51.624046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861769+0000","last_change":"2024-09-17T05:28:45.664352+0000","last_active":"2024-09-17T05:28:46.861769+0000","last_peered":"2024-09-17T05:28:46.861769+0000","last_clean":"2024-09-17T05:28:46.861769+0000","last_became_active":"2024-09-17T05:28:45.663507+0000","last_became_peered":"2024-09-17T05:28:45.663507+0000","last_unstale":"2024-09-17T05:28:46.861769+0000","last_undegraded":"2024-09-17T05:28:46.861769+0000","last_fullsized":"2024-09-17T05:28:46.861769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:17.848561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659618+0000","last_change":"2024-09-17T05:28:45.670649+0000","last_active":"2024-09-17T05:28:46.659618+0000","last_peered":"2024-09-17T05:28:46.659618+0000","last_clean":"2024-09-17T05:28:46.659618+0000","last_became_active":"2024-09-17T05:28:45.670351+0000","last_became_peered":"2024-09-17T05:28:45.670351+0000","last_unstale":"2024-09-17T05:28:46.659618+0000","last_undegraded":"2024-09-17T05:28:46.659618+0000","last_fullsized":"2024-09-17T05:28:46.659618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:29.130107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660571+0000","last_change":"2024-09-17T05:28:45.679957+0000","last_active":"2024-09-17T05:28:46.660571+0000","last_peered":"2024-09-17T05:28:46.660571+0000","last_clean":"2024-09-17T05:28:46.660571+0000","last_became_active":"2024-09-17T05:28:45.679602+0000","last_became_peered":"2024-09-17T05:28:45.679602+0000","last_unstale":"2024-09-17T05:28:46.660571+0000","last_undegraded":"2024-09-17T05:28:46.660571+0000","last_fullsized":"2024-09-17T05:28:46.660571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:39.462655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861974+0000","last_change":"2024-09-17T05:28:45.679307+0000","last_active":"2024-09-17T05:28:46.861974+0000","last_peered":"2024-09-17T05:28:46.861974+0000","last_clean":"2024-09-17T05:28:46.861974+0000","last_became_active":"2024-09-17T05:28:45.677900+0000","last_became_peered":"2024-09-17T05:28:45.677900+0000","last_unstale":"2024-09-17T05:28:46.861974+0000","last_undegraded":"2024-09-17T05:28:46.861974+0000","last_fullsized":"2024-09-17T05:28:46.861974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:16.537395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661054+0000","last_change":"2024-09-17T05:28:45.675903+0000","last_active":"2024-09-17T05:28:46.661054+0000","last_peered":"2024-09-17T05:28:46.661054+0000","last_clean":"2024-09-17T05:28:46.661054+0000","last_became_active":"2024-09-17T05:28:45.675619+0000","last_became_peered":"2024-09-17T05:28:45.675619+0000","last_unstale":"2024-09-17T05:28:46.661054+0000","last_undegraded":"2024-09-17T05:28:46.661054+0000","last_fullsized":"2024-09-17T05:28:46.661054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:25.383911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660820+0000","last_change":"2024-09-17T05:28:45.670609+0000","last_active":"2024-09-17T05:28:46.660820+0000","last_peered":"2024-09-17T05:28:46.660820+0000","last_clean":"2024-09-17T05:28:46.660820+0000","last_became_active":"2024-09-17T05:28:45.670294+0000","last_became_peered":"2024-09-17T05:28:45.670294+0000","last_unstale":"2024-09-17T05:28:46.660820+0000","last_undegraded":"2024-09-17T05:28:46.660820+0000","last_fullsized":"2024-09-17T05:28:46.660820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:47.532792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862091+0000","last_change":"2024-09-17T05:28:45.686073+0000","last_active":"2024-09-17T05:28:46.862091+0000","last_peered":"2024-09-17T05:28:46.862091+0000","last_clean":"2024-09-17T05:28:46.862091+0000","last_became_active":"2024-09-17T05:28:45.685807+0000","last_became_peered":"2024-09-17T05:28:45.685807+0000","last_unstale":"2024-09-17T05:28:46.862091+0000","last_undegraded":"2024-09-17T05:28:46.862091+0000","last_fullsized":"2024-09-17T05:28:46.862091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:16.599698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661110+0000","last_change":"2024-09-17T05:28:45.671925+0000","last_active":"2024-09-17T05:28:46.661110+0000","last_peered":"2024-09-17T05:28:46.661110+0000","last_clean":"2024-09-17T05:28:46.661110+0000","last_became_active":"2024-09-17T05:28:45.671678+0000","last_became_peered":"2024-09-17T05:28:45.671678+0000","last_unstale":"2024-09-17T05:28:46.661110+0000","last_undegraded":"2024-09-17T05:28:46.661110+0000","last_fullsized":"2024-09-17T05:28:46.661110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:42.029278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.638855+0000","last_change":"2024-09-17T05:28:43.638855+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.638855+0000","last_undegraded":"2024-09-17T05:28:43.638855+0000","last_fullsized":"2024-09-17T05:28:43.638855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862171+0000","last_change":"2024-09-17T05:28:45.661811+0000","last_active":"2024-09-17T05:28:46.862171+0000","last_peered":"2024-09-17T05:28:46.862171+0000","last_clean":"2024-09-17T05:28:46.862171+0000","last_became_active":"2024-09-17T05:28:45.659242+0000","last_became_peered":"2024-09-17T05:28:45.659242+0000","last_unstale":"2024-09-17T05:28:46.862171+0000","last_undegraded":"2024-09-17T05:28:46.862171+0000","last_fullsized":"2024-09-17T05:28:46.862171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:47.085346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.641587+0000","last_change":"2024-09-17T05:28:43.641587+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.641587+0000","last_undegraded":"2024-09-17T05:28:43.641587+0000","last_fullsized":"2024-09-17T05:28:43.641587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.637090+0000","last_change":"2024-09-17T05:28:43.637090+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.637090+0000","last_undegraded":"2024-09-17T05:28:43.637090+0000","last_fullsized":"2024-09-17T05:28:43.637090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660320+0000","last_change":"2024-09-17T05:28:44.659788+0000","last_active":"2024-09-17T05:28:46.660320+0000","last_peered":"2024-09-17T05:28:46.660320+0000","last_clean":"2024-09-17T05:28:46.660320+0000","last_became_active":"2024-09-17T05:28:44.657841+0000","last_became_peered":"2024-09-17T05:28:44.657841+0000","last_unstale":"2024-09-17T05:28:46.660320+0000","last_undegraded":"2024-09-17T05:28:46.660320+0000","last_fullsized":"2024-09-17T05:28:46.660320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:31.718118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.643827+0000","last_change":"2024-09-17T05:28:43.643827+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.643827+0000","last_undegraded":"2024-09-17T05:28:43.643827+0000","last_fullsized":"2024-09-17T05:28:43.643827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660354+0000","last_change":"2024-09-17T05:28:45.682482+0000","last_active":"2024-09-17T05:28:46.660354+0000","last_peered":"2024-09-17T05:28:46.660354+0000","last_clean":"2024-09-17T05:28:46.660354+0000","last_became_active":"2024-09-17T05:28:45.682173+0000","last_became_peered":"2024-09-17T05:28:45.682173+0000","last_unstale":"2024-09-17T05:28:46.660354+0000","last_undegraded":"2024-09-17T05:28:46.660354+0000","last_fullsized":"2024-09-17T05:28:46.660354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:49.488039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660472+0000","last_change":"2024-09-17T05:28:44.660933+0000","last_active":"2024-09-17T05:28:46.660472+0000","last_peered":"2024-09-17T05:28:46.660472+0000","last_clean":"2024-09-17T05:28:46.660472+0000","last_became_active":"2024-09-17T05:28:44.660651+0000","last_became_peered":"2024-09-17T05:28:44.660651+0000","last_unstale":"2024-09-17T05:28:46.660472+0000","last_undegraded":"2024-09-17T05:28:46.660472+0000","last_fullsized":"2024-09-17T05:28:46.660472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:07.374786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862562+0000","last_change":"2024-09-17T05:28:45.680416+0000","last_active":"2024-09-17T05:28:46.862562+0000","last_peered":"2024-09-17T05:28:46.862562+0000","last_clean":"2024-09-17T05:28:46.862562+0000","last_became_active":"2024-09-17T05:28:45.676745+0000","last_became_peered":"2024-09-17T05:28:45.676745+0000","last_unstale":"2024-09-17T05:28:46.862562+0000","last_undegraded":"2024-09-17T05:28:46.862562+0000","last_fullsized":"2024-09-17T05:28:46.862562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:26.799851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.638098+0000","last_change":"2024-09-17T05:28:43.638098+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.638098+0000","last_undegraded":"2024-09-17T05:28:43.638098+0000","last_fullsized":"2024-09-17T05:28:43.638098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.642108+0000","last_change":"2024-09-17T05:28:43.642108+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.642108+0000","last_undegraded":"2024-09-17T05:28:43.642108+0000","last_fullsized":"2024-09-17T05:28:43.642108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862160+0000","last_change":"2024-09-17T05:28:44.656355+0000","last_active":"2024-09-17T05:28:46.862160+0000","last_peered":"2024-09-17T05:28:46.862160+0000","last_clean":"2024-09-17T05:28:46.862160+0000","last_became_active":"2024-09-17T05:28:44.656064+0000","last_became_peered":"2024-09-17T05:28:44.656064+0000","last_unstale":"2024-09-17T05:28:46.862160+0000","last_undegraded":"2024-09-17T05:28:46.862160+0000","last_fullsized":"2024-09-17T05:28:46.862160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:00:37.731866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861989+0000","last_change":"2024-09-17T05:28:45.683802+0000","last_active":"2024-09-17T05:28:46.861989+0000","last_peered":"2024-09-17T05:28:46.861989+0000","last_clean":"2024-09-17T05:28:46.861989+0000","last_became_active":"2024-09-17T05:28:45.681514+0000","last_became_peered":"2024-09-17T05:28:45.681514+0000","last_unstale":"2024-09-17T05:28:46.861989+0000","last_undegraded":"2024-09-17T05:28:46.861989+0000","last_fullsized":"2024-09-17T05:28:46.861989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:03.269669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661166+0000","last_change":"2024-09-17T05:28:44.666923+0000","last_active":"2024-09-17T05:28:46.661166+0000","last_peered":"2024-09-17T05:28:46.661166+0000","last_clean":"2024-09-17T05:28:46.661166+0000","last_became_active":"2024-09-17T05:28:44.663304+0000","last_became_peered":"2024-09-17T05:28:44.663304+0000","last_unstale":"2024-09-17T05:28:46.661166+0000","last_undegraded":"2024-09-17T05:28:46.661166+0000","last_fullsized":"2024-09-17T05:28:46.661166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:39.859160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.642261+0000","last_change":"2024-09-17T05:28:43.642261+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.642261+0000","last_undegraded":"2024-09-17T05:28:43.642261+0000","last_fullsized":"2024-09-17T05:28:43.642261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.645337+0000","last_change":"2024-09-17T05:28:43.645337+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.645337+0000","last_undegraded":"2024-09-17T05:28:43.645337+0000","last_fullsized":"2024-09-17T05:28:43.645337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.646287+0000","last_change":"2024-09-17T05:28:43.646287+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.646287+0000","last_undegraded":"2024-09-17T05:28:43.646287+0000","last_fullsized":"2024-09-17T05:28:43.646287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.645600+0000","last_change":"2024-09-17T05:28:43.645600+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.645600+0000","last_undegraded":"2024-09-17T05:28:43.645600+0000","last_fullsized":"2024-09-17T05:28:43.645600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.636993+0000","last_change":"2024-09-17T05:28:43.636993+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.636993+0000","last_undegraded":"2024-09-17T05:28:43.636993+0000","last_fullsized":"2024-09-17T05:28:43.636993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660529+0000","last_change":"2024-09-17T05:28:45.689026+0000","last_active":"2024-09-17T05:28:46.660529+0000","last_peered":"2024-09-17T05:28:46.660529+0000","last_clean":"2024-09-17T05:28:46.660529+0000","last_became_active":"2024-09-17T05:28:45.688756+0000","last_became_peered":"2024-09-17T05:28:45.688756+0000","last_unstale":"2024-09-17T05:28:46.660529+0000","last_undegraded":"2024-09-17T05:28:46.660529+0000","last_fullsized":"2024-09-17T05:28:46.660529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:51.339078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.645565+0000","last_change":"2024-09-17T05:28:43.645565+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.645565+0000","last_undegraded":"2024-09-17T05:28:43.645565+0000","last_fullsized":"2024-09-17T05:28:43.645565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":105,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-17T05:28:43.639746+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:28:43.639746+0000","last_peered":"2024-09-17T05:28:43.639746+0000","last_clean":"2024-09-17T05:28:43.639746+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:28:43.639746+0000","last_undegraded":"2024-09-17T05:28:43.639746+0000","last_fullsized":"2024-09-17T05:28:43.639746+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659979+0000","last_change":"2024-09-17T05:28:44.655816+0000","last_active":"2024-09-17T05:28:46.659979+0000","last_peered":"2024-09-17T05:28:46.659979+0000","last_clean":"2024-09-17T05:28:46.659979+0000","last_became_active":"2024-09-17T05:28:44.655528+0000","last_became_peered":"2024-09-17T05:28:44.655528+0000","last_unstale":"2024-09-17T05:28:46.659979+0000","last_undegraded":"2024-09-17T05:28:46.659979+0000","last_fullsized":"2024-09-17T05:28:46.659979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:53.370296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.637927+0000","last_change":"2024-09-17T05:28:43.637927+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.637927+0000","last_undegraded":"2024-09-17T05:28:43.637927+0000","last_fullsized":"2024-09-17T05:28:43.637927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861309+0000","last_change":"2024-09-17T05:28:45.670679+0000","last_active":"2024-09-17T05:28:46.861309+0000","last_peered":"2024-09-17T05:28:46.861309+0000","last_clean":"2024-09-17T05:28:46.861309+0000","last_became_active":"2024-09-17T05:28:45.670385+0000","last_became_peered":"2024-09-17T05:28:45.670385+0000","last_unstale":"2024-09-17T05:28:46.861309+0000","last_undegraded":"2024-09-17T05:28:46.861309+0000","last_fullsized":"2024-09-17T05:28:46.861309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:56.353907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.645346+0000","last_change":"2024-09-17T05:28:43.645346+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.645346+0000","last_undegraded":"2024-09-17T05:28:43.645346+0000","last_fullsized":"2024-09-17T05:28:43.645346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661173+0000","last_change":"2024-09-17T05:28:44.659616+0000","last_active":"2024-09-17T05:28:46.661173+0000","last_peered":"2024-09-17T05:28:46.661173+0000","last_clean":"2024-09-17T05:28:46.661173+0000","last_became_active":"2024-09-17T05:28:44.659315+0000","last_became_peered":"2024-09-17T05:28:44.659315+0000","last_unstale":"2024-09-17T05:28:46.661173+0000","last_undegraded":"2024-09-17T05:28:46.661173+0000","last_fullsized":"2024-09-17T05:28:46.661173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:01.383128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.635910+0000","last_change":"2024-09-17T05:28:43.635910+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.635910+0000","last_undegraded":"2024-09-17T05:28:43.635910+0000","last_fullsized":"2024-09-17T05:28:43.635910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660901+0000","last_change":"2024-09-17T05:28:45.673340+0000","last_active":"2024-09-17T05:28:46.660901+0000","last_peered":"2024-09-17T05:28:46.660901+0000","last_clean":"2024-09-17T05:28:46.660901+0000","last_became_active":"2024-09-17T05:28:45.673047+0000","last_became_peered":"2024-09-17T05:28:45.673047+0000","last_unstale":"2024-09-17T05:28:46.660901+0000","last_undegraded":"2024-09-17T05:28:46.660901+0000","last_fullsized":"2024-09-17T05:28:46.660901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:21.863500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.637925+0000","last_change":"2024-09-17T05:28:43.637925+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.637925+0000","last_undegraded":"2024-09-17T05:28:43.637925+0000","last_fullsized":"2024-09-17T05:28:43.637925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.635944+0000","last_change":"2024-09-17T05:28:43.635944+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.635944+0000","last_undegraded":"2024-09-17T05:28:43.635944+0000","last_fullsized":"2024-09-17T05:28:43.635944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.643283+0000","last_change":"2024-09-17T05:28:43.643283+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.643283+0000","last_undegraded":"2024-09-17T05:28:43.643283+0000","last_fullsized":"2024-09-17T05:28:43.643283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862563+0000","last_change":"2024-09-17T05:28:45.669543+0000","last_active":"2024-09-17T05:28:46.862563+0000","last_peered":"2024-09-17T05:28:46.862563+0000","last_clean":"2024-09-17T05:28:46.862563+0000","last_became_active":"2024-09-17T05:28:45.669258+0000","last_became_peered":"2024-09-17T05:28:45.669258+0000","last_unstale":"2024-09-17T05:28:46.862563+0000","last_undegraded":"2024-09-17T05:28:46.862563+0000","last_fullsized":"2024-09-17T05:28:46.862563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:29.130107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.638903+0000","last_change":"2024-09-17T05:28:43.638903+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.638903+0000","last_undegraded":"2024-09-17T05:28:43.638903+0000","last_fullsized":"2024-09-17T05:28:43.638903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.635921+0000","last_change":"2024-09-17T05:28:43.635921+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.635921+0000","last_undegraded":"2024-09-17T05:28:43.635921+0000","last_fullsized":"2024-09-17T05:28:43.635921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.636042+0000","last_change":"2024-09-17T05:28:43.636042+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.636042+0000","last_undegraded":"2024-09-17T05:28:43.636042+0000","last_fullsized":"2024-09-17T05:28:43.636042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.638338+0000","last_change":"2024-09-17T05:28:43.638338+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.638338+0000","last_undegraded":"2024-09-17T05:28:43.638338+0000","last_fullsized":"2024-09-17T05:28:43.638338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660675+0000","last_change":"2024-09-17T05:28:45.674640+0000","last_active":"2024-09-17T05:28:46.660675+0000","last_peered":"2024-09-17T05:28:46.660675+0000","last_clean":"2024-09-17T05:28:46.660675+0000","last_became_active":"2024-09-17T05:28:45.674375+0000","last_became_peered":"2024-09-17T05:28:45.674375+0000","last_unstale":"2024-09-17T05:28:46.660675+0000","last_undegraded":"2024-09-17T05:28:46.660675+0000","last_fullsized":"2024-09-17T05:28:46.660675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:48.986140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.637981+0000","last_change":"2024-09-17T05:28:43.637981+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.637981+0000","last_undegraded":"2024-09-17T05:28:43.637981+0000","last_fullsized":"2024-09-17T05:28:43.637981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660309+0000","last_change":"2024-09-17T05:28:45.675119+0000","last_active":"2024-09-17T05:28:46.660309+0000","last_peered":"2024-09-17T05:28:46.660309+0000","last_clean":"2024-09-17T05:28:46.660309+0000","last_became_active":"2024-09-17T05:28:45.674840+0000","last_became_peered":"2024-09-17T05:28:45.674840+0000","last_unstale":"2024-09-17T05:28:46.660309+0000","last_undegraded":"2024-09-17T05:28:46.660309+0000","last_fullsized":"2024-09-17T05:28:46.660309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:26.709674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.639137+0000","last_change":"2024-09-17T05:28:43.639137+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.639137+0000","last_undegraded":"2024-09-17T05:28:43.639137+0000","last_fullsized":"2024-09-17T05:28:43.639137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862459+0000","last_change":"2024-09-17T05:28:45.677087+0000","last_active":"2024-09-17T05:28:46.862459+0000","last_peered":"2024-09-17T05:28:46.862459+0000","last_clean":"2024-09-17T05:28:46.862459+0000","last_became_active":"2024-09-17T05:28:45.676750+0000","last_became_peered":"2024-09-17T05:28:45.676750+0000","last_unstale":"2024-09-17T05:28:46.862459+0000","last_undegraded":"2024-09-17T05:28:46.862459+0000","last_fullsized":"2024-09-17T05:28:46.862459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:14.581812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-17T05:28:43.637899+0000","last_change":"2024-09-17T05:28:43.637899+0000","last_active":"2024-09-17T05:28:43.621484+0000","last_peered":"2024-09-17T05:28:43.621484+0000","last_clean":"2024-09-17T05:28:43.621484+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:43.637899+0000","last_undegraded":"2024-09-17T05:28:43.637899+0000","last_fullsized":"2024-09-17T05:28:43.637899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:28:44.631618+0000","last_change":"2024-09-17T05:28:44.631618+0000","last_active":"2024-09-17T05:28:44.631618+0000","last_peered":"2024-09-17T05:28:44.631618+0000","last_clean":"2024-09-17T05:28:44.631618+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:28:44.631618+0000","last_undegraded":"2024-09-17T05:28:44.631618+0000","last_fullsized":"2024-09-17T05:28:44.631618+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862559+0000","last_change":"2024-09-17T05:28:44.666526+0000","last_active":"2024-09-17T05:28:46.862559+0000","last_peered":"2024-09-17T05:28:46.862559+0000","last_clean":"2024-09-17T05:28:46.862559+0000","last_became_active":"2024-09-17T05:28:44.666209+0000","last_became_peered":"2024-09-17T05:28:44.666209+0000","last_unstale":"2024-09-17T05:28:46.862559+0000","last_undegraded":"2024-09-17T05:28:46.862559+0000","last_fullsized":"2024-09-17T05:28:46.862559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:50.431079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":44,"acting":44,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":643205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":159744,"data_stored":47020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509443,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":52837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":663193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:28:50.623 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-17T05:28:50.624 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.624 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-17T05:28:50.624 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.624 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-17T05:28:50.624 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.624 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-17T05:28:50.624 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.624 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-17T05:28:50.624 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.625 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-17T05:28:50.625 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.625 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-17T05:28:50.625 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.625 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-17T05:28:50.625 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.625 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-17T05:28:50.625 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.625 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-17T05:28:50.626 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.626 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-17T05:28:50.626 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.626 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-17T05:28:50.626 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.627 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-17T05:28:50.627 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.627 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-17T05:28:50.627 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.627 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-17T05:28:50.627 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.627 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-17T05:28:50.627 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.628 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-17T05:28:50.628 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.628 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-17T05:28:50.628 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.628 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-17T05:28:50.628 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.628 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-17T05:28:50.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.629 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-17T05:28:50.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.629 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-17T05:28:50.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.629 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1b is not active+clean 2024-09-17T05:28:50.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.638855+0000', 'last_change': '2024-09-17T05:28:43.638855+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.638855+0000', 'last_undegraded': '2024-09-17T05:28:43.638855+0000', 'last_fullsized': '2024-09-17T05:28:43.638855+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:28:50.629 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1a is not active+clean 2024-09-17T05:28:50.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.641587+0000', 'last_change': '2024-09-17T05:28:43.641587+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.641587+0000', 'last_undegraded': '2024-09-17T05:28:43.641587+0000', 'last_fullsized': '2024-09-17T05:28:43.641587+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:28:50.630 INFO:tasks.ceph.ceph_manager.ceph:PG 2.19 is not active+clean 2024-09-17T05:28:50.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.637090+0000', 'last_change': '2024-09-17T05:28:43.637090+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.637090+0000', 'last_undegraded': '2024-09-17T05:28:43.637090+0000', 'last_fullsized': '2024-09-17T05:28:43.637090+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:28:50.630 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-17T05:28:50.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.630 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-17T05:28:50.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.630 INFO:tasks.ceph.ceph_manager.ceph:PG 2.17 is not active+clean 2024-09-17T05:28:50.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.643827+0000', 'last_change': '2024-09-17T05:28:43.643827+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.643827+0000', 'last_undegraded': '2024-09-17T05:28:43.643827+0000', 'last_fullsized': '2024-09-17T05:28:43.643827+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:28:50.630 INFO:tasks.ceph.ceph_manager.ceph:PG 2.15 is not active+clean 2024-09-17T05:28:50.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.638098+0000', 'last_change': '2024-09-17T05:28:43.638098+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.638098+0000', 'last_undegraded': '2024-09-17T05:28:43.638098+0000', 'last_fullsized': '2024-09-17T05:28:43.638098+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:28:50.630 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-17T05:28:50.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.631 INFO:tasks.ceph.ceph_manager.ceph:PG 2.14 is not active+clean 2024-09-17T05:28:50.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.642108+0000', 'last_change': '2024-09-17T05:28:43.642108+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.642108+0000', 'last_undegraded': '2024-09-17T05:28:43.642108+0000', 'last_fullsized': '2024-09-17T05:28:43.642108+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:28:50.631 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-17T05:28:50.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.631 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-17T05:28:50.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.631 INFO:tasks.ceph.ceph_manager.ceph:PG 2.11 is not active+clean 2024-09-17T05:28:50.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.642261+0000', 'last_change': '2024-09-17T05:28:43.642261+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.642261+0000', 'last_undegraded': '2024-09-17T05:28:43.642261+0000', 'last_fullsized': '2024-09-17T05:28:43.642261+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:28:50.631 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-17T05:28:50.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.632 INFO:tasks.ceph.ceph_manager.ceph:PG 2.10 is not active+clean 2024-09-17T05:28:50.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.645337+0000', 'last_change': '2024-09-17T05:28:43.645337+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.645337+0000', 'last_undegraded': '2024-09-17T05:28:43.645337+0000', 'last_fullsized': '2024-09-17T05:28:43.645337+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:28:50.632 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-17T05:28:50.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.632 INFO:tasks.ceph.ceph_manager.ceph:PG 2.f is not active+clean 2024-09-17T05:28:50.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.646287+0000', 'last_change': '2024-09-17T05:28:43.646287+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.646287+0000', 'last_undegraded': '2024-09-17T05:28:43.646287+0000', 'last_fullsized': '2024-09-17T05:28:43.646287+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:28:50.632 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-17T05:28:50.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.633 INFO:tasks.ceph.ceph_manager.ceph:PG 2.e is not active+clean 2024-09-17T05:28:50.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.645600+0000', 'last_change': '2024-09-17T05:28:43.645600+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.645600+0000', 'last_undegraded': '2024-09-17T05:28:43.645600+0000', 'last_fullsized': '2024-09-17T05:28:43.645600+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:28:50.633 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-17T05:28:50.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.633 INFO:tasks.ceph.ceph_manager.ceph:PG 2.d is not active+clean 2024-09-17T05:28:50.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.636993+0000', 'last_change': '2024-09-17T05:28:43.636993+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.636993+0000', 'last_undegraded': '2024-09-17T05:28:43.636993+0000', 'last_fullsized': '2024-09-17T05:28:43.636993+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:28:50.633 INFO:tasks.ceph.ceph_manager.ceph:PG 2.c is not active+clean 2024-09-17T05:28:50.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.645565+0000', 'last_change': '2024-09-17T05:28:43.645565+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.645565+0000', 'last_undegraded': '2024-09-17T05:28:43.645565+0000', 'last_fullsized': '2024-09-17T05:28:43.645565+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:28:50.634 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-17T05:28:50.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.634 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-17T05:28:50.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.634 INFO:tasks.ceph.ceph_manager.ceph:PG 2.0 is not active+clean 2024-09-17T05:28:50.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.637927+0000', 'last_change': '2024-09-17T05:28:43.637927+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.637927+0000', 'last_undegraded': '2024-09-17T05:28:43.637927+0000', 'last_fullsized': '2024-09-17T05:28:43.637927+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:28:50.635 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1 is not active+clean 2024-09-17T05:28:50.635 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.645346+0000', 'last_change': '2024-09-17T05:28:43.645346+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.645346+0000', 'last_undegraded': '2024-09-17T05:28:43.645346+0000', 'last_fullsized': '2024-09-17T05:28:43.645346+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:28:50.635 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-17T05:28:50.635 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.635 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-17T05:28:50.635 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.635 INFO:tasks.ceph.ceph_manager.ceph:PG 2.4 is not active+clean 2024-09-17T05:28:50.635 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.635910+0000', 'last_change': '2024-09-17T05:28:43.635910+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.635910+0000', 'last_undegraded': '2024-09-17T05:28:43.635910+0000', 'last_fullsized': '2024-09-17T05:28:43.635910+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:28:50.635 INFO:tasks.ceph.ceph_manager.ceph:PG 2.5 is not active+clean 2024-09-17T05:28:50.636 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.637925+0000', 'last_change': '2024-09-17T05:28:43.637925+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.637925+0000', 'last_undegraded': '2024-09-17T05:28:43.637925+0000', 'last_fullsized': '2024-09-17T05:28:43.637925+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:28:50.636 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-17T05:28:50.636 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.636 INFO:tasks.ceph.ceph_manager.ceph:PG 2.6 is not active+clean 2024-09-17T05:28:50.636 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.635944+0000', 'last_change': '2024-09-17T05:28:43.635944+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.635944+0000', 'last_undegraded': '2024-09-17T05:28:43.635944+0000', 'last_fullsized': '2024-09-17T05:28:43.635944+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:28:50.636 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-17T05:28:50.636 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.636 INFO:tasks.ceph.ceph_manager.ceph:PG 2.7 is not active+clean 2024-09-17T05:28:50.637 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.643283+0000', 'last_change': '2024-09-17T05:28:43.643283+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.643283+0000', 'last_undegraded': '2024-09-17T05:28:43.643283+0000', 'last_fullsized': '2024-09-17T05:28:43.643283+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:28:50.637 INFO:tasks.ceph.ceph_manager.ceph:PG 2.8 is not active+clean 2024-09-17T05:28:50.637 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.638903+0000', 'last_change': '2024-09-17T05:28:43.638903+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.638903+0000', 'last_undegraded': '2024-09-17T05:28:43.638903+0000', 'last_fullsized': '2024-09-17T05:28:43.638903+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:28:50.637 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-17T05:28:50.637 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.637 INFO:tasks.ceph.ceph_manager.ceph:PG 2.9 is not active+clean 2024-09-17T05:28:50.637 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.635921+0000', 'last_change': '2024-09-17T05:28:43.635921+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.635921+0000', 'last_undegraded': '2024-09-17T05:28:43.635921+0000', 'last_fullsized': '2024-09-17T05:28:43.635921+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:28:50.637 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-17T05:28:50.637 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.638 INFO:tasks.ceph.ceph_manager.ceph:PG 2.a is not active+clean 2024-09-17T05:28:50.638 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.636042+0000', 'last_change': '2024-09-17T05:28:43.636042+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.636042+0000', 'last_undegraded': '2024-09-17T05:28:43.636042+0000', 'last_fullsized': '2024-09-17T05:28:43.636042+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:28:50.638 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-17T05:28:50.638 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.638 INFO:tasks.ceph.ceph_manager.ceph:PG 2.b is not active+clean 2024-09-17T05:28:50.638 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.638338+0000', 'last_change': '2024-09-17T05:28:43.638338+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.638338+0000', 'last_undegraded': '2024-09-17T05:28:43.638338+0000', 'last_fullsized': '2024-09-17T05:28:43.638338+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:28:50.638 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-17T05:28:50.639 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.639 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1c is not active+clean 2024-09-17T05:28:50.639 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.637981+0000', 'last_change': '2024-09-17T05:28:43.637981+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.637981+0000', 'last_undegraded': '2024-09-17T05:28:43.637981+0000', 'last_fullsized': '2024-09-17T05:28:43.637981+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:28:50.639 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1d is not active+clean 2024-09-17T05:28:50.639 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.639137+0000', 'last_change': '2024-09-17T05:28:43.639137+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.639137+0000', 'last_undegraded': '2024-09-17T05:28:43.639137+0000', 'last_fullsized': '2024-09-17T05:28:43.639137+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:28:50.639 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1e is not active+clean 2024-09-17T05:28:50.639 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:28:43.637899+0000', 'last_change': '2024-09-17T05:28:43.637899+0000', 'last_active': '2024-09-17T05:28:43.621484+0000', 'last_peered': '2024-09-17T05:28:43.621484+0000', 'last_clean': '2024-09-17T05:28:43.621484+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:43.637899+0000', 'last_undegraded': '2024-09-17T05:28:43.637899+0000', 'last_fullsized': '2024-09-17T05:28:43.637899+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:43.621484+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:28:50.639 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-17T05:28:50.639 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:28:44.631618+0000', 'last_change': '2024-09-17T05:28:44.631618+0000', 'last_active': '2024-09-17T05:28:44.631618+0000', 'last_peered': '2024-09-17T05:28:44.631618+0000', 'last_clean': '2024-09-17T05:28:44.631618+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:28:44.631618+0000', 'last_undegraded': '2024-09-17T05:28:44.631618+0000', 'last_fullsized': '2024-09-17T05:28:44.631618+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'last_clean_scrub_stamp': '2024-09-17T05:28:44.631618+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:28:50.640 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:28:50.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.810+0000 7f7983c00640 1 -- 172.21.15.31:0/1967752698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f797c0b2760 msgr2=0x7f797c0d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:50.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.810+0000 7f7983c00640 1 --2- 172.21.15.31:0/1967752698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f797c0b2760 0x7f797c0d0260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f797c0cf810 tx=0x7f796801c650 comp rx=0 tx=0).stop 2024-09-17T05:28:50.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.810+0000 7f7983c00640 1 -- 172.21.15.31:0/1967752698 shutdown_connections 2024-09-17T05:28:50.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.810+0000 7f7983c00640 1 --2- 172.21.15.31:0/1967752698 >> v2:172.21.15.155:3300/0 conn(0x7f797c0b2d00 0x7f797c1605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.810+0000 7f7983c00640 1 --2- 172.21.15.31:0/1967752698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f797c0b2760 0x7f797c0d0260 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.810+0000 7f7983c00640 1 -- 172.21.15.31:0/1967752698 >> 172.21.15.31:0/1967752698 conn(0x7f797c0d1e40 msgr2=0x7f797c0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:50.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.810+0000 7f7983c00640 1 -- 172.21.15.31:0/1967752698 shutdown_connections 2024-09-17T05:28:50.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.810+0000 7f7983c00640 1 -- 172.21.15.31:0/1967752698 wait complete. 2024-09-17T05:28:50.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.810+0000 7f7983c00640 1 Processor -- start 2024-09-17T05:28:50.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.810+0000 7f7983c00640 1 -- start start 2024-09-17T05:28:50.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7983c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f797c0b2760 0x7f797c151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:50.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7983c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f797c0b2d00 0x7f797c1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:50.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7983c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f797c0cfe80 0x7f797c1589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7983c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f797c0b0940 con 0x7f797c0b2760 2024-09-17T05:28:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7983c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f797c0b07c0 con 0x7f797c0b2d00 2024-09-17T05:28:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7983c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f797c0b0ac0 con 0x7f797c0cfe80 2024-09-17T05:28:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7981200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f797c0b2760 0x7f797c151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7981200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f797c0b2760 0x7f797c151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41980/0 (socket says 172.21.15.31:41980) 2024-09-17T05:28:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7981200640 1 -- 172.21.15.31:0/1705019138 learned_addr learned my addr 172.21.15.31:0/1705019138 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f797be00640 1 --2- 172.21.15.31:0/1705019138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f797c0b2d00 0x7f797c1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7981c00640 1 --2- 172.21.15.31:0/1705019138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f797c0cfe80 0x7f797c1589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7981200640 1 -- 172.21.15.31:0/1705019138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f797c0cfe80 msgr2=0x7f797c1589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7981200640 1 --2- 172.21.15.31:0/1705019138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f797c0cfe80 0x7f797c1589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7981200640 1 -- 172.21.15.31:0/1705019138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f797c0b2d00 msgr2=0x7f797c1584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7981200640 1 --2- 172.21.15.31:0/1705019138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f797c0b2d00 0x7f797c1584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7981200640 1 -- 172.21.15.31:0/1705019138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797c1f8d10 con 0x7f797c0b2760 2024-09-17T05:28:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7981200640 1 --2- 172.21.15.31:0/1705019138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f797c0b2760 0x7f797c151a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f797000b440 tx=0x7f797000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7978c00640 1 -- 172.21.15.31:0/1705019138 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7970015020 con 0x7f797c0b2760 2024-09-17T05:28:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7978c00640 1 -- 172.21.15.31:0/1705019138 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7970011980 con 0x7f797c0b2760 2024-09-17T05:28:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7978c00640 1 -- 172.21.15.31:0/1705019138 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7970011dd0 con 0x7f797c0b2760 2024-09-17T05:28:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7983c00640 1 -- 172.21.15.31:0/1705019138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797c1f8ff0 con 0x7f797c0b2760 2024-09-17T05:28:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7983c00640 1 -- 172.21.15.31:0/1705019138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f797c151f70 con 0x7f797c0b2760 2024-09-17T05:28:50.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.814+0000 7f7983c00640 1 -- 172.21.15.31:0/1705019138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f797c0d0260 con 0x7f797c0b2760 2024-09-17T05:28:50.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.818+0000 7f7978c00640 1 -- 172.21.15.31:0/1705019138 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7970018020 con 0x7f797c0b2760 2024-09-17T05:28:50.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.818+0000 7f7978c00640 1 --2- 172.21.15.31:0/1705019138 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f795c073230 0x7f795c0756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:50.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.818+0000 7f7978c00640 1 -- 172.21.15.31:0/1705019138 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7970093fc0 con 0x7f797c0b2760 2024-09-17T05:28:50.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.818+0000 7f797be00640 1 --2- 172.21.15.31:0/1705019138 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f795c073230 0x7f795c0756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:50.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.818+0000 7f797be00640 1 --2- 172.21.15.31:0/1705019138 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f795c073230 0x7f795c0756f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f79680ae000 tx=0x7f796801ae90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:50.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:50.822+0000 7f7978c00640 1 -- 172.21.15.31:0/1705019138 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f797001f030 con 0x7f797c0b2760 2024-09-17T05:28:51.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.066+0000 7f7983c00640 1 -- 172.21.15.31:0/1705019138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f797c0cd990 con 0x7f797c0b2760 2024-09-17T05:28:51.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.070+0000 7f7978c00640 1 -- 172.21.15.31:0/1705019138 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1213 (secure 0 0 0) 0x7f797000d040 con 0x7f797c0b2760 2024-09-17T05:28:51.071 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:51.072 INFO:teuthology.orchestra.run.smithi031.stdout:{"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":31,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1726550913,"num_in_osds":8,"osd_in_since":1726550903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":42},{"state_name":"active+clean","count":30},{"state_name":"creating+peering","count":25}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":590984,"bytes_used":224067584,"bytes_avail":772870045696,"bytes_total":773094113280,"unknown_pgs_ratio":0.4329896867275238,"inactive_pgs_ratio":0.25773194432258606,"write_bytes_sec":1476,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":8,"btime":"2024-09-17T05:28:48:676550+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4380}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-17T05:28:19.899251+0000","services":{}},"progress_events":{}} 2024-09-17T05:28:51.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.070+0000 7f7983c00640 1 -- 172.21.15.31:0/1705019138 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f795c073230 msgr2=0x7f795c0756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:51.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.070+0000 7f7983c00640 1 --2- 172.21.15.31:0/1705019138 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f795c073230 0x7f795c0756f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f79680ae000 tx=0x7f796801ae90 comp rx=0 tx=0).stop 2024-09-17T05:28:51.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.070+0000 7f7983c00640 1 -- 172.21.15.31:0/1705019138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f797c0b2760 msgr2=0x7f797c151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:51.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.070+0000 7f7983c00640 1 --2- 172.21.15.31:0/1705019138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f797c0b2760 0x7f797c151a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f797000b440 tx=0x7f797000b900 comp rx=0 tx=0).stop 2024-09-17T05:28:51.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.070+0000 7f7983c00640 1 -- 172.21.15.31:0/1705019138 shutdown_connections 2024-09-17T05:28:51.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.070+0000 7f7983c00640 1 --2- 172.21.15.31:0/1705019138 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f795c073230 0x7f795c0756f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:51.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.070+0000 7f7983c00640 1 --2- 172.21.15.31:0/1705019138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f797c0cfe80 0x7f797c1589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:51.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.070+0000 7f7983c00640 1 --2- 172.21.15.31:0/1705019138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f797c0b2d00 0x7f797c1584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:51.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.070+0000 7f7983c00640 1 --2- 172.21.15.31:0/1705019138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f797c0b2760 0x7f797c151a30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:51.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.070+0000 7f7983c00640 1 -- 172.21.15.31:0/1705019138 >> 172.21.15.31:0/1705019138 conn(0x7f797c0d1e40 msgr2=0x7f797c15d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:51.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.070+0000 7f7983c00640 1 -- 172.21.15.31:0/1705019138 shutdown_connections 2024-09-17T05:28:51.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.070+0000 7f7983c00640 1 -- 172.21.15.31:0/1705019138 wait complete. 2024-09-17T05:28:51.092 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:28:51.092 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:28:51.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.234+0000 7f3eee800640 1 -- 172.21.15.31:0/4149792265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ee8071030 msgr2=0x7f3ee80714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:51.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.234+0000 7f3eee800640 1 --2- 172.21.15.31:0/4149792265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ee8071030 0x7f3ee80714c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009bc0 tx=0x7f3ee001cb70 comp rx=0 tx=0).stop 2024-09-17T05:28:51.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.234+0000 7f3eee800640 1 -- 172.21.15.31:0/4149792265 shutdown_connections 2024-09-17T05:28:51.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.234+0000 7f3eee800640 1 --2- 172.21.15.31:0/4149792265 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ee8071030 0x7f3ee80714c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:51.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.234+0000 7f3eee800640 1 --2- 172.21.15.31:0/4149792265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee80737c0 0x7f3ee815c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:51.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.234+0000 7f3eee800640 1 -- 172.21.15.31:0/4149792265 >> 172.21.15.31:0/4149792265 conn(0x7f3ee80d0c90 msgr2=0x7f3ee80d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:51.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.234+0000 7f3eee800640 1 -- 172.21.15.31:0/4149792265 shutdown_connections 2024-09-17T05:28:51.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.234+0000 7f3eee800640 1 -- 172.21.15.31:0/4149792265 wait complete. 2024-09-17T05:28:51.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3eee800640 1 Processor -- start 2024-09-17T05:28:51.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3eee800640 1 -- start start 2024-09-17T05:28:51.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3eee800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ee806cc20 0x7f3ee80af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3eee800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee8071030 0x7f3ee8164cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3eee800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ee80737c0 0x7f3ee80cf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3eee800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee8169020 con 0x7f3ee80737c0 2024-09-17T05:28:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3eee800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee8168ea0 con 0x7f3ee806cc20 2024-09-17T05:28:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3eee800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3ee81691a0 con 0x7f3ee8071030 2024-09-17T05:28:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3ee7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ee80737c0 0x7f3ee80cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3ee7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ee80737c0 0x7f3ee80cf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41998/0 (socket says 172.21.15.31:41998) 2024-09-17T05:28:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3ee7e00640 1 -- 172.21.15.31:0/2514629796 learned_addr learned my addr 172.21.15.31:0/2514629796 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3edfe00640 1 --2- 172.21.15.31:0/2514629796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee8071030 0x7f3ee8164cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3ee7400640 1 --2- 172.21.15.31:0/2514629796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ee806cc20 0x7f3ee80af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3ee7e00640 1 -- 172.21.15.31:0/2514629796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee8071030 msgr2=0x7f3ee8164cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:51.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3ee7e00640 1 --2- 172.21.15.31:0/2514629796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee8071030 0x7f3ee8164cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:51.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3ee7e00640 1 -- 172.21.15.31:0/2514629796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ee806cc20 msgr2=0x7f3ee80af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:51.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3ee7e00640 1 --2- 172.21.15.31:0/2514629796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ee806cc20 0x7f3ee80af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:51.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3ee7e00640 1 -- 172.21.15.31:0/2514629796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee80d05b0 con 0x7f3ee80737c0 2024-09-17T05:28:51.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3edfe00640 1 --2- 172.21.15.31:0/2514629796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee8071030 0x7f3ee8164cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:28:51.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3ee7e00640 1 --2- 172.21.15.31:0/2514629796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ee80737c0 0x7f3ee80cf410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3ee001a7a0 tx=0x7f3ee00a5970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:51.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3edf400640 1 -- 172.21.15.31:0/2514629796 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee00b2040 con 0x7f3ee80737c0 2024-09-17T05:28:51.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3edf400640 1 -- 172.21.15.31:0/2514629796 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ee0004d40 con 0x7f3ee80737c0 2024-09-17T05:28:51.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3eee800640 1 -- 172.21.15.31:0/2514629796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee81fba60 con 0x7f3ee80737c0 2024-09-17T05:28:51.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3edf400640 1 -- 172.21.15.31:0/2514629796 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0004300 con 0x7f3ee80737c0 2024-09-17T05:28:51.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.238+0000 7f3eee800640 1 -- 172.21.15.31:0/2514629796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee8155f30 con 0x7f3ee80737c0 2024-09-17T05:28:51.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.242+0000 7f3eee800640 1 -- 172.21.15.31:0/2514629796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee81fbca0 con 0x7f3ee80737c0 2024-09-17T05:28:51.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.242+0000 7f3edf400640 1 -- 172.21.15.31:0/2514629796 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3ee00be060 con 0x7f3ee80737c0 2024-09-17T05:28:51.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.242+0000 7f3edf400640 1 --2- 172.21.15.31:0/2514629796 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3ec4073200 0x7f3ec40756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:51.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.242+0000 7f3edf400640 1 -- 172.21.15.31:0/2514629796 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3ee012e0b0 con 0x7f3ee80737c0 2024-09-17T05:28:51.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.242+0000 7f3ee7400640 1 --2- 172.21.15.31:0/2514629796 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3ec4073200 0x7f3ec40756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:51.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.242+0000 7f3ee7400640 1 --2- 172.21.15.31:0/2514629796 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3ec4073200 0x7f3ec40756c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8000f70 tx=0x7f3ed8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:51.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.246+0000 7f3edf400640 1 -- 172.21.15.31:0/2514629796 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f3ee0016790 con 0x7f3ee80737c0 2024-09-17T05:28:51.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.422+0000 7f3eee800640 1 -- 172.21.15.31:0/2514629796 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ee80714c0 con 0x7f3ec4073200 2024-09-17T05:28:51.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.426+0000 7f3edf400640 1 -- 172.21.15.31:0/2514629796 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251937 (secure 0 0 0) 0x7f3ee80714c0 con 0x7f3ec4073200 2024-09-17T05:28:51.432 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:51.436 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:28:51.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.430+0000 7f3eee800640 1 -- 172.21.15.31:0/2514629796 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3ec4073200 msgr2=0x7f3ec40756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:51.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.430+0000 7f3eee800640 1 --2- 172.21.15.31:0/2514629796 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3ec4073200 0x7f3ec40756c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8000f70 tx=0x7f3ed8009040 comp rx=0 tx=0).stop 2024-09-17T05:28:51.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.430+0000 7f3eee800640 1 -- 172.21.15.31:0/2514629796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ee80737c0 msgr2=0x7f3ee80cf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.430+0000 7f3eee800640 1 --2- 172.21.15.31:0/2514629796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ee80737c0 0x7f3ee80cf410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3ee001a7a0 tx=0x7f3ee00a5970 comp rx=0 tx=0).stop 2024-09-17T05:28:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.430+0000 7f3eee800640 1 -- 172.21.15.31:0/2514629796 shutdown_connections 2024-09-17T05:28:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.430+0000 7f3eee800640 1 --2- 172.21.15.31:0/2514629796 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3ec4073200 0x7f3ec40756c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.430+0000 7f3eee800640 1 --2- 172.21.15.31:0/2514629796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ee80737c0 0x7f3ee80cf410 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.430+0000 7f3eee800640 1 --2- 172.21.15.31:0/2514629796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ee8071030 0x7f3ee8164cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.430+0000 7f3eee800640 1 --2- 172.21.15.31:0/2514629796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ee806cc20 0x7f3ee80af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.430+0000 7f3eee800640 1 -- 172.21.15.31:0/2514629796 >> 172.21.15.31:0/2514629796 conn(0x7f3ee80d0c90 msgr2=0x7f3ee80b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.430+0000 7f3eee800640 1 -- 172.21.15.31:0/2514629796 shutdown_connections 2024-09-17T05:28:51.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:51.430+0000 7f3eee800640 1 -- 172.21.15.31:0/2514629796 wait complete. 2024-09-17T05:28:51.452 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-17T05:28:51.182395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219120,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755600,"statfs":{"total":773094113280,"available":772869734400,"internally_reserved":0,"allocated":2924544,"data_stored":1763052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.544734"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863232+0000","last_change":"2024-09-17T05:28:45.697872+0000","last_active":"2024-09-17T05:28:46.863232+0000","last_peered":"2024-09-17T05:28:46.863232+0000","last_clean":"2024-09-17T05:28:46.863232+0000","last_became_active":"2024-09-17T05:28:45.695565+0000","last_became_peered":"2024-09-17T05:28:45.695565+0000","last_unstale":"2024-09-17T05:28:46.863232+0000","last_undegraded":"2024-09-17T05:28:46.863232+0000","last_fullsized":"2024-09-17T05:28:46.863232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:45:19.586402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688506+0000","last_change":"2024-09-17T05:28:45.678580+0000","last_active":"2024-09-17T05:28:46.688506+0000","last_peered":"2024-09-17T05:28:46.688506+0000","last_clean":"2024-09-17T05:28:46.688506+0000","last_became_active":"2024-09-17T05:28:45.678219+0000","last_became_peered":"2024-09-17T05:28:45.678219+0000","last_unstale":"2024-09-17T05:28:46.688506+0000","last_undegraded":"2024-09-17T05:28:46.688506+0000","last_fullsized":"2024-09-17T05:28:46.688506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:21.659738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862447+0000","last_change":"2024-09-17T05:28:45.671569+0000","last_active":"2024-09-17T05:28:46.862447+0000","last_peered":"2024-09-17T05:28:46.862447+0000","last_clean":"2024-09-17T05:28:46.862447+0000","last_became_active":"2024-09-17T05:28:45.671278+0000","last_became_peered":"2024-09-17T05:28:45.671278+0000","last_unstale":"2024-09-17T05:28:46.862447+0000","last_undegraded":"2024-09-17T05:28:46.862447+0000","last_fullsized":"2024-09-17T05:28:46.862447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:58:21.650063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660082+0000","last_change":"2024-09-17T05:28:45.689085+0000","last_active":"2024-09-17T05:28:46.660082+0000","last_peered":"2024-09-17T05:28:46.660082+0000","last_clean":"2024-09-17T05:28:46.660082+0000","last_became_active":"2024-09-17T05:28:45.688806+0000","last_became_peered":"2024-09-17T05:28:45.688806+0000","last_unstale":"2024-09-17T05:28:46.660082+0000","last_undegraded":"2024-09-17T05:28:46.660082+0000","last_fullsized":"2024-09-17T05:28:46.660082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:51.791266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862886+0000","last_change":"2024-09-17T05:28:45.682352+0000","last_active":"2024-09-17T05:28:46.862886+0000","last_peered":"2024-09-17T05:28:46.862886+0000","last_clean":"2024-09-17T05:28:46.862886+0000","last_became_active":"2024-09-17T05:28:45.682032+0000","last_became_peered":"2024-09-17T05:28:45.682032+0000","last_unstale":"2024-09-17T05:28:46.862886+0000","last_undegraded":"2024-09-17T05:28:46.862886+0000","last_fullsized":"2024-09-17T05:28:46.862886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:46.948368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660986+0000","last_change":"2024-09-17T05:28:45.674052+0000","last_active":"2024-09-17T05:28:46.660986+0000","last_peered":"2024-09-17T05:28:46.660986+0000","last_clean":"2024-09-17T05:28:46.660986+0000","last_became_active":"2024-09-17T05:28:45.673577+0000","last_became_peered":"2024-09-17T05:28:45.673577+0000","last_unstale":"2024-09-17T05:28:46.660986+0000","last_undegraded":"2024-09-17T05:28:46.660986+0000","last_fullsized":"2024-09-17T05:28:46.660986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:51.624046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863066+0000","last_change":"2024-09-17T05:28:45.681779+0000","last_active":"2024-09-17T05:28:46.863066+0000","last_peered":"2024-09-17T05:28:46.863066+0000","last_clean":"2024-09-17T05:28:46.863066+0000","last_became_active":"2024-09-17T05:28:45.681439+0000","last_became_peered":"2024-09-17T05:28:45.681439+0000","last_unstale":"2024-09-17T05:28:46.863066+0000","last_undegraded":"2024-09-17T05:28:46.863066+0000","last_fullsized":"2024-09-17T05:28:46.863066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:17.571913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861260+0000","last_change":"2024-09-17T05:28:45.675817+0000","last_active":"2024-09-17T05:28:46.861260+0000","last_peered":"2024-09-17T05:28:46.861260+0000","last_clean":"2024-09-17T05:28:46.861260+0000","last_became_active":"2024-09-17T05:28:45.675261+0000","last_became_peered":"2024-09-17T05:28:45.675261+0000","last_unstale":"2024-09-17T05:28:46.861260+0000","last_undegraded":"2024-09-17T05:28:46.861260+0000","last_fullsized":"2024-09-17T05:28:46.861260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.192825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863307+0000","last_change":"2024-09-17T05:28:45.678585+0000","last_active":"2024-09-17T05:28:46.863307+0000","last_peered":"2024-09-17T05:28:46.863307+0000","last_clean":"2024-09-17T05:28:46.863307+0000","last_became_active":"2024-09-17T05:28:45.678193+0000","last_became_peered":"2024-09-17T05:28:45.678193+0000","last_unstale":"2024-09-17T05:28:46.863307+0000","last_undegraded":"2024-09-17T05:28:46.863307+0000","last_fullsized":"2024-09-17T05:28:46.863307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:09.412687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692863+0000","last_change":"2024-09-17T05:28:45.694856+0000","last_active":"2024-09-17T05:28:46.692863+0000","last_peered":"2024-09-17T05:28:46.692863+0000","last_clean":"2024-09-17T05:28:46.692863+0000","last_became_active":"2024-09-17T05:28:45.694301+0000","last_became_peered":"2024-09-17T05:28:45.694301+0000","last_unstale":"2024-09-17T05:28:46.692863+0000","last_undegraded":"2024-09-17T05:28:46.692863+0000","last_fullsized":"2024-09-17T05:28:46.692863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:51.540943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692949+0000","last_change":"2024-09-17T05:28:45.686541+0000","last_active":"2024-09-17T05:28:46.692949+0000","last_peered":"2024-09-17T05:28:46.692949+0000","last_clean":"2024-09-17T05:28:46.692949+0000","last_became_active":"2024-09-17T05:28:45.686257+0000","last_became_peered":"2024-09-17T05:28:45.686257+0000","last_unstale":"2024-09-17T05:28:46.692949+0000","last_undegraded":"2024-09-17T05:28:46.692949+0000","last_fullsized":"2024-09-17T05:28:46.692949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:43.813385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660297+0000","last_change":"2024-09-17T05:28:45.686106+0000","last_active":"2024-09-17T05:28:46.660297+0000","last_peered":"2024-09-17T05:28:46.660297+0000","last_clean":"2024-09-17T05:28:46.660297+0000","last_became_active":"2024-09-17T05:28:45.685801+0000","last_became_peered":"2024-09-17T05:28:45.685801+0000","last_unstale":"2024-09-17T05:28:46.660297+0000","last_undegraded":"2024-09-17T05:28:46.660297+0000","last_fullsized":"2024-09-17T05:28:46.660297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:49.061509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861763+0000","last_change":"2024-09-17T05:28:45.681737+0000","last_active":"2024-09-17T05:28:46.861763+0000","last_peered":"2024-09-17T05:28:46.861763+0000","last_clean":"2024-09-17T05:28:46.861763+0000","last_became_active":"2024-09-17T05:28:45.681463+0000","last_became_peered":"2024-09-17T05:28:45.681463+0000","last_unstale":"2024-09-17T05:28:46.861763+0000","last_undegraded":"2024-09-17T05:28:46.861763+0000","last_fullsized":"2024-09-17T05:28:46.861763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.524996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861769+0000","last_change":"2024-09-17T05:28:45.664352+0000","last_active":"2024-09-17T05:28:46.861769+0000","last_peered":"2024-09-17T05:28:46.861769+0000","last_clean":"2024-09-17T05:28:46.861769+0000","last_became_active":"2024-09-17T05:28:45.663507+0000","last_became_peered":"2024-09-17T05:28:45.663507+0000","last_unstale":"2024-09-17T05:28:46.861769+0000","last_undegraded":"2024-09-17T05:28:46.861769+0000","last_fullsized":"2024-09-17T05:28:46.861769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:17.848561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688160+0000","last_change":"2024-09-17T05:28:45.661764+0000","last_active":"2024-09-17T05:28:46.688160+0000","last_peered":"2024-09-17T05:28:46.688160+0000","last_clean":"2024-09-17T05:28:46.688160+0000","last_became_active":"2024-09-17T05:28:45.661449+0000","last_became_peered":"2024-09-17T05:28:45.661449+0000","last_unstale":"2024-09-17T05:28:46.688160+0000","last_undegraded":"2024-09-17T05:28:46.688160+0000","last_fullsized":"2024-09-17T05:28:46.688160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:06.446649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659618+0000","last_change":"2024-09-17T05:28:45.670649+0000","last_active":"2024-09-17T05:28:46.659618+0000","last_peered":"2024-09-17T05:28:46.659618+0000","last_clean":"2024-09-17T05:28:46.659618+0000","last_became_active":"2024-09-17T05:28:45.670351+0000","last_became_peered":"2024-09-17T05:28:45.670351+0000","last_unstale":"2024-09-17T05:28:46.659618+0000","last_undegraded":"2024-09-17T05:28:46.659618+0000","last_fullsized":"2024-09-17T05:28:46.659618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:29.130107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660571+0000","last_change":"2024-09-17T05:28:45.679957+0000","last_active":"2024-09-17T05:28:46.660571+0000","last_peered":"2024-09-17T05:28:46.660571+0000","last_clean":"2024-09-17T05:28:46.660571+0000","last_became_active":"2024-09-17T05:28:45.679602+0000","last_became_peered":"2024-09-17T05:28:45.679602+0000","last_unstale":"2024-09-17T05:28:46.660571+0000","last_undegraded":"2024-09-17T05:28:46.660571+0000","last_fullsized":"2024-09-17T05:28:46.660571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:39.462655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654439+0000","last_change":"2024-09-17T05:28:45.696611+0000","last_active":"2024-09-17T05:28:46.654439+0000","last_peered":"2024-09-17T05:28:46.654439+0000","last_clean":"2024-09-17T05:28:46.654439+0000","last_became_active":"2024-09-17T05:28:45.696317+0000","last_became_peered":"2024-09-17T05:28:45.696317+0000","last_unstale":"2024-09-17T05:28:46.654439+0000","last_undegraded":"2024-09-17T05:28:46.654439+0000","last_fullsized":"2024-09-17T05:28:46.654439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:02.631947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863417+0000","last_change":"2024-09-17T05:28:45.682233+0000","last_active":"2024-09-17T05:28:46.863417+0000","last_peered":"2024-09-17T05:28:46.863417+0000","last_clean":"2024-09-17T05:28:46.863417+0000","last_became_active":"2024-09-17T05:28:45.681921+0000","last_became_peered":"2024-09-17T05:28:45.681921+0000","last_unstale":"2024-09-17T05:28:46.863417+0000","last_undegraded":"2024-09-17T05:28:46.863417+0000","last_fullsized":"2024-09-17T05:28:46.863417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:48.570504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692784+0000","last_change":"2024-09-17T05:28:45.689764+0000","last_active":"2024-09-17T05:28:46.692784+0000","last_peered":"2024-09-17T05:28:46.692784+0000","last_clean":"2024-09-17T05:28:46.692784+0000","last_became_active":"2024-09-17T05:28:45.686962+0000","last_became_peered":"2024-09-17T05:28:45.686962+0000","last_unstale":"2024-09-17T05:28:46.692784+0000","last_undegraded":"2024-09-17T05:28:46.692784+0000","last_fullsized":"2024-09-17T05:28:46.692784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:02:08.175874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861974+0000","last_change":"2024-09-17T05:28:45.679307+0000","last_active":"2024-09-17T05:28:46.861974+0000","last_peered":"2024-09-17T05:28:46.861974+0000","last_clean":"2024-09-17T05:28:46.861974+0000","last_became_active":"2024-09-17T05:28:45.677900+0000","last_became_peered":"2024-09-17T05:28:45.677900+0000","last_unstale":"2024-09-17T05:28:46.861974+0000","last_undegraded":"2024-09-17T05:28:46.861974+0000","last_fullsized":"2024-09-17T05:28:46.861974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:16.537395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661054+0000","last_change":"2024-09-17T05:28:45.675903+0000","last_active":"2024-09-17T05:28:46.661054+0000","last_peered":"2024-09-17T05:28:46.661054+0000","last_clean":"2024-09-17T05:28:46.661054+0000","last_became_active":"2024-09-17T05:28:45.675619+0000","last_became_peered":"2024-09-17T05:28:45.675619+0000","last_unstale":"2024-09-17T05:28:46.661054+0000","last_undegraded":"2024-09-17T05:28:46.661054+0000","last_fullsized":"2024-09-17T05:28:46.661054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:25.383911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861418+0000","last_change":"2024-09-17T05:28:45.685230+0000","last_active":"2024-09-17T05:28:46.861418+0000","last_peered":"2024-09-17T05:28:46.861418+0000","last_clean":"2024-09-17T05:28:46.861418+0000","last_became_active":"2024-09-17T05:28:45.684920+0000","last_became_peered":"2024-09-17T05:28:45.684920+0000","last_unstale":"2024-09-17T05:28:46.861418+0000","last_undegraded":"2024-09-17T05:28:46.861418+0000","last_fullsized":"2024-09-17T05:28:46.861418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:37.130400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660820+0000","last_change":"2024-09-17T05:28:45.670609+0000","last_active":"2024-09-17T05:28:46.660820+0000","last_peered":"2024-09-17T05:28:46.660820+0000","last_clean":"2024-09-17T05:28:46.660820+0000","last_became_active":"2024-09-17T05:28:45.670294+0000","last_became_peered":"2024-09-17T05:28:45.670294+0000","last_unstale":"2024-09-17T05:28:46.660820+0000","last_undegraded":"2024-09-17T05:28:46.660820+0000","last_fullsized":"2024-09-17T05:28:46.660820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:47.532792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862177+0000","last_change":"2024-09-17T05:28:45.686654+0000","last_active":"2024-09-17T05:28:46.862177+0000","last_peered":"2024-09-17T05:28:46.862177+0000","last_clean":"2024-09-17T05:28:46.862177+0000","last_became_active":"2024-09-17T05:28:45.686315+0000","last_became_peered":"2024-09-17T05:28:45.686315+0000","last_unstale":"2024-09-17T05:28:46.862177+0000","last_undegraded":"2024-09-17T05:28:46.862177+0000","last_fullsized":"2024-09-17T05:28:46.862177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.777428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.693162+0000","last_change":"2024-09-17T05:28:45.696244+0000","last_active":"2024-09-17T05:28:46.693162+0000","last_peered":"2024-09-17T05:28:46.693162+0000","last_clean":"2024-09-17T05:28:46.693162+0000","last_became_active":"2024-09-17T05:28:45.695996+0000","last_became_peered":"2024-09-17T05:28:45.695996+0000","last_unstale":"2024-09-17T05:28:46.693162+0000","last_undegraded":"2024-09-17T05:28:46.693162+0000","last_fullsized":"2024-09-17T05:28:46.693162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:21.659738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688428+0000","last_change":"2024-09-17T05:28:45.672165+0000","last_active":"2024-09-17T05:28:46.688428+0000","last_peered":"2024-09-17T05:28:46.688428+0000","last_clean":"2024-09-17T05:28:46.688428+0000","last_became_active":"2024-09-17T05:28:45.671847+0000","last_became_peered":"2024-09-17T05:28:45.671847+0000","last_unstale":"2024-09-17T05:28:46.688428+0000","last_undegraded":"2024-09-17T05:28:46.688428+0000","last_fullsized":"2024-09-17T05:28:46.688428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:33.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861906+0000","last_change":"2024-09-17T05:28:45.685316+0000","last_active":"2024-09-17T05:28:46.861906+0000","last_peered":"2024-09-17T05:28:46.861906+0000","last_clean":"2024-09-17T05:28:46.861906+0000","last_became_active":"2024-09-17T05:28:45.684897+0000","last_became_peered":"2024-09-17T05:28:45.684897+0000","last_unstale":"2024-09-17T05:28:46.861906+0000","last_undegraded":"2024-09-17T05:28:46.861906+0000","last_fullsized":"2024-09-17T05:28:46.861906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:09.347060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862091+0000","last_change":"2024-09-17T05:28:45.686073+0000","last_active":"2024-09-17T05:28:46.862091+0000","last_peered":"2024-09-17T05:28:46.862091+0000","last_clean":"2024-09-17T05:28:46.862091+0000","last_became_active":"2024-09-17T05:28:45.685807+0000","last_became_peered":"2024-09-17T05:28:45.685807+0000","last_unstale":"2024-09-17T05:28:46.862091+0000","last_undegraded":"2024-09-17T05:28:46.862091+0000","last_fullsized":"2024-09-17T05:28:46.862091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:16.599698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661110+0000","last_change":"2024-09-17T05:28:45.671925+0000","last_active":"2024-09-17T05:28:46.661110+0000","last_peered":"2024-09-17T05:28:46.661110+0000","last_clean":"2024-09-17T05:28:46.661110+0000","last_became_active":"2024-09-17T05:28:45.671678+0000","last_became_peered":"2024-09-17T05:28:45.671678+0000","last_unstale":"2024-09-17T05:28:46.661110+0000","last_undegraded":"2024-09-17T05:28:46.661110+0000","last_fullsized":"2024-09-17T05:28:46.661110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:42.029278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654148+0000","last_change":"2024-09-17T05:28:45.671512+0000","last_active":"2024-09-17T05:28:46.654148+0000","last_peered":"2024-09-17T05:28:46.654148+0000","last_clean":"2024-09-17T05:28:46.654148+0000","last_became_active":"2024-09-17T05:28:45.671206+0000","last_became_peered":"2024-09-17T05:28:45.671206+0000","last_unstale":"2024-09-17T05:28:46.654148+0000","last_undegraded":"2024-09-17T05:28:46.654148+0000","last_fullsized":"2024-09-17T05:28:46.654148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:49.061509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692663+0000","last_change":"2024-09-17T05:28:45.691716+0000","last_active":"2024-09-17T05:28:46.692663+0000","last_peered":"2024-09-17T05:28:46.692663+0000","last_clean":"2024-09-17T05:28:46.692663+0000","last_became_active":"2024-09-17T05:28:45.691437+0000","last_became_peered":"2024-09-17T05:28:45.691437+0000","last_unstale":"2024-09-17T05:28:46.692663+0000","last_undegraded":"2024-09-17T05:28:46.692663+0000","last_fullsized":"2024-09-17T05:28:46.692663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:36.011098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659719+0000","last_change":"2024-09-17T05:28:45.668556+0000","last_active":"2024-09-17T05:28:46.659719+0000","last_peered":"2024-09-17T05:28:46.659719+0000","last_clean":"2024-09-17T05:28:46.659719+0000","last_became_active":"2024-09-17T05:28:45.667772+0000","last_became_peered":"2024-09-17T05:28:45.667772+0000","last_unstale":"2024-09-17T05:28:46.659719+0000","last_undegraded":"2024-09-17T05:28:46.659719+0000","last_fullsized":"2024-09-17T05:28:46.659719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:01.766360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861829+0000","last_change":"2024-09-17T05:28:44.657244+0000","last_active":"2024-09-17T05:28:46.861829+0000","last_peered":"2024-09-17T05:28:46.861829+0000","last_clean":"2024-09-17T05:28:46.861829+0000","last_became_active":"2024-09-17T05:28:44.656558+0000","last_became_peered":"2024-09-17T05:28:44.656558+0000","last_unstale":"2024-09-17T05:28:46.861829+0000","last_undegraded":"2024-09-17T05:28:46.861829+0000","last_fullsized":"2024-09-17T05:28:46.861829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:54.204227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862171+0000","last_change":"2024-09-17T05:28:45.661811+0000","last_active":"2024-09-17T05:28:46.862171+0000","last_peered":"2024-09-17T05:28:46.862171+0000","last_clean":"2024-09-17T05:28:46.862171+0000","last_became_active":"2024-09-17T05:28:45.659242+0000","last_became_peered":"2024-09-17T05:28:45.659242+0000","last_unstale":"2024-09-17T05:28:46.862171+0000","last_undegraded":"2024-09-17T05:28:46.862171+0000","last_fullsized":"2024-09-17T05:28:46.862171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:47.085346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692619+0000","last_change":"2024-09-17T05:28:44.660153+0000","last_active":"2024-09-17T05:28:46.692619+0000","last_peered":"2024-09-17T05:28:46.692619+0000","last_clean":"2024-09-17T05:28:46.692619+0000","last_became_active":"2024-09-17T05:28:44.658470+0000","last_became_peered":"2024-09-17T05:28:44.658470+0000","last_unstale":"2024-09-17T05:28:46.692619+0000","last_undegraded":"2024-09-17T05:28:46.692619+0000","last_fullsized":"2024-09-17T05:28:46.692619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:44.416180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861467+0000","last_change":"2024-09-17T05:28:44.665256+0000","last_active":"2024-09-17T05:28:46.861467+0000","last_peered":"2024-09-17T05:28:46.861467+0000","last_clean":"2024-09-17T05:28:46.861467+0000","last_became_active":"2024-09-17T05:28:44.664960+0000","last_became_peered":"2024-09-17T05:28:44.664960+0000","last_unstale":"2024-09-17T05:28:46.861467+0000","last_undegraded":"2024-09-17T05:28:46.861467+0000","last_fullsized":"2024-09-17T05:28:46.861467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:14.057015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861329+0000","last_change":"2024-09-17T05:28:45.673448+0000","last_active":"2024-09-17T05:28:46.861329+0000","last_peered":"2024-09-17T05:28:46.861329+0000","last_clean":"2024-09-17T05:28:46.861329+0000","last_became_active":"2024-09-17T05:28:45.670646+0000","last_became_peered":"2024-09-17T05:28:45.670646+0000","last_unstale":"2024-09-17T05:28:46.861329+0000","last_undegraded":"2024-09-17T05:28:46.861329+0000","last_fullsized":"2024-09-17T05:28:46.861329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:06.446649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660320+0000","last_change":"2024-09-17T05:28:44.659788+0000","last_active":"2024-09-17T05:28:46.660320+0000","last_peered":"2024-09-17T05:28:46.660320+0000","last_clean":"2024-09-17T05:28:46.660320+0000","last_became_active":"2024-09-17T05:28:44.657841+0000","last_became_peered":"2024-09-17T05:28:44.657841+0000","last_unstale":"2024-09-17T05:28:46.660320+0000","last_undegraded":"2024-09-17T05:28:46.660320+0000","last_fullsized":"2024-09-17T05:28:46.660320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:31.718118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688161+0000","last_change":"2024-09-17T05:28:45.673740+0000","last_active":"2024-09-17T05:28:46.688161+0000","last_peered":"2024-09-17T05:28:46.688161+0000","last_clean":"2024-09-17T05:28:46.688161+0000","last_became_active":"2024-09-17T05:28:45.671723+0000","last_became_peered":"2024-09-17T05:28:45.671723+0000","last_unstale":"2024-09-17T05:28:46.688161+0000","last_undegraded":"2024-09-17T05:28:46.688161+0000","last_fullsized":"2024-09-17T05:28:46.688161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:02:08.175874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692691+0000","last_change":"2024-09-17T05:28:44.659120+0000","last_active":"2024-09-17T05:28:46.692691+0000","last_peered":"2024-09-17T05:28:46.692691+0000","last_clean":"2024-09-17T05:28:46.692691+0000","last_became_active":"2024-09-17T05:28:44.658305+0000","last_became_peered":"2024-09-17T05:28:44.658305+0000","last_unstale":"2024-09-17T05:28:46.692691+0000","last_undegraded":"2024-09-17T05:28:46.692691+0000","last_fullsized":"2024-09-17T05:28:46.692691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:54.204227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660354+0000","last_change":"2024-09-17T05:28:45.682482+0000","last_active":"2024-09-17T05:28:46.660354+0000","last_peered":"2024-09-17T05:28:46.660354+0000","last_clean":"2024-09-17T05:28:46.660354+0000","last_became_active":"2024-09-17T05:28:45.682173+0000","last_became_peered":"2024-09-17T05:28:45.682173+0000","last_unstale":"2024-09-17T05:28:46.660354+0000","last_undegraded":"2024-09-17T05:28:46.660354+0000","last_fullsized":"2024-09-17T05:28:46.660354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:49.488039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660472+0000","last_change":"2024-09-17T05:28:44.660933+0000","last_active":"2024-09-17T05:28:46.660472+0000","last_peered":"2024-09-17T05:28:46.660472+0000","last_clean":"2024-09-17T05:28:46.660472+0000","last_became_active":"2024-09-17T05:28:44.660651+0000","last_became_peered":"2024-09-17T05:28:44.660651+0000","last_unstale":"2024-09-17T05:28:46.660472+0000","last_undegraded":"2024-09-17T05:28:46.660472+0000","last_fullsized":"2024-09-17T05:28:46.660472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:07.374786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862562+0000","last_change":"2024-09-17T05:28:45.680416+0000","last_active":"2024-09-17T05:28:46.862562+0000","last_peered":"2024-09-17T05:28:46.862562+0000","last_clean":"2024-09-17T05:28:46.862562+0000","last_became_active":"2024-09-17T05:28:45.676745+0000","last_became_peered":"2024-09-17T05:28:45.676745+0000","last_unstale":"2024-09-17T05:28:46.862562+0000","last_undegraded":"2024-09-17T05:28:46.862562+0000","last_fullsized":"2024-09-17T05:28:46.862562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:26.799851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688387+0000","last_change":"2024-09-17T05:28:44.658749+0000","last_active":"2024-09-17T05:28:46.688387+0000","last_peered":"2024-09-17T05:28:46.688387+0000","last_clean":"2024-09-17T05:28:46.688387+0000","last_became_active":"2024-09-17T05:28:44.658422+0000","last_became_peered":"2024-09-17T05:28:44.658422+0000","last_unstale":"2024-09-17T05:28:46.688387+0000","last_undegraded":"2024-09-17T05:28:46.688387+0000","last_fullsized":"2024-09-17T05:28:46.688387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:44.416180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660498+0000","last_change":"2024-09-17T05:28:45.679934+0000","last_active":"2024-09-17T05:28:46.660498+0000","last_peered":"2024-09-17T05:28:46.660498+0000","last_clean":"2024-09-17T05:28:46.660498+0000","last_became_active":"2024-09-17T05:28:45.679532+0000","last_became_peered":"2024-09-17T05:28:45.679532+0000","last_unstale":"2024-09-17T05:28:46.660498+0000","last_undegraded":"2024-09-17T05:28:46.660498+0000","last_fullsized":"2024-09-17T05:28:46.660498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:02.631947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692603+0000","last_change":"2024-09-17T05:28:44.670793+0000","last_active":"2024-09-17T05:28:46.692603+0000","last_peered":"2024-09-17T05:28:46.692603+0000","last_clean":"2024-09-17T05:28:46.692603+0000","last_became_active":"2024-09-17T05:28:44.670483+0000","last_became_peered":"2024-09-17T05:28:44.670483+0000","last_unstale":"2024-09-17T05:28:46.692603+0000","last_undegraded":"2024-09-17T05:28:46.692603+0000","last_fullsized":"2024-09-17T05:28:46.692603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:56.605556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863123+0000","last_change":"2024-09-17T05:28:45.676170+0000","last_active":"2024-09-17T05:28:46.863123+0000","last_peered":"2024-09-17T05:28:46.863123+0000","last_clean":"2024-09-17T05:28:46.863123+0000","last_became_active":"2024-09-17T05:28:45.675349+0000","last_became_peered":"2024-09-17T05:28:45.675349+0000","last_unstale":"2024-09-17T05:28:46.863123+0000","last_undegraded":"2024-09-17T05:28:46.863123+0000","last_fullsized":"2024-09-17T05:28:46.863123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:25.988668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862160+0000","last_change":"2024-09-17T05:28:44.656355+0000","last_active":"2024-09-17T05:28:46.862160+0000","last_peered":"2024-09-17T05:28:46.862160+0000","last_clean":"2024-09-17T05:28:46.862160+0000","last_became_active":"2024-09-17T05:28:44.656064+0000","last_became_peered":"2024-09-17T05:28:44.656064+0000","last_unstale":"2024-09-17T05:28:46.862160+0000","last_undegraded":"2024-09-17T05:28:46.862160+0000","last_fullsized":"2024-09-17T05:28:46.862160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:00:37.731866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861989+0000","last_change":"2024-09-17T05:28:45.683802+0000","last_active":"2024-09-17T05:28:46.861989+0000","last_peered":"2024-09-17T05:28:46.861989+0000","last_clean":"2024-09-17T05:28:46.861989+0000","last_became_active":"2024-09-17T05:28:45.681514+0000","last_became_peered":"2024-09-17T05:28:45.681514+0000","last_unstale":"2024-09-17T05:28:46.861989+0000","last_undegraded":"2024-09-17T05:28:46.861989+0000","last_fullsized":"2024-09-17T05:28:46.861989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:03.269669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661166+0000","last_change":"2024-09-17T05:28:44.666923+0000","last_active":"2024-09-17T05:28:46.661166+0000","last_peered":"2024-09-17T05:28:46.661166+0000","last_clean":"2024-09-17T05:28:46.661166+0000","last_became_active":"2024-09-17T05:28:44.663304+0000","last_became_peered":"2024-09-17T05:28:44.663304+0000","last_unstale":"2024-09-17T05:28:46.661166+0000","last_undegraded":"2024-09-17T05:28:46.661166+0000","last_fullsized":"2024-09-17T05:28:46.661166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:39.859160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863074+0000","last_change":"2024-09-17T05:28:45.690781+0000","last_active":"2024-09-17T05:28:46.863074+0000","last_peered":"2024-09-17T05:28:46.863074+0000","last_clean":"2024-09-17T05:28:46.863074+0000","last_became_active":"2024-09-17T05:28:45.690510+0000","last_became_peered":"2024-09-17T05:28:45.690510+0000","last_unstale":"2024-09-17T05:28:46.863074+0000","last_undegraded":"2024-09-17T05:28:46.863074+0000","last_fullsized":"2024-09-17T05:28:46.863074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:23.217463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692449+0000","last_change":"2024-09-17T05:28:44.659293+0000","last_active":"2024-09-17T05:28:46.692449+0000","last_peered":"2024-09-17T05:28:46.692449+0000","last_clean":"2024-09-17T05:28:46.692449+0000","last_became_active":"2024-09-17T05:28:44.658946+0000","last_became_peered":"2024-09-17T05:28:44.658946+0000","last_unstale":"2024-09-17T05:28:46.692449+0000","last_undegraded":"2024-09-17T05:28:46.692449+0000","last_fullsized":"2024-09-17T05:28:46.692449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:17.828856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692995+0000","last_change":"2024-09-17T05:28:45.686933+0000","last_active":"2024-09-17T05:28:46.692995+0000","last_peered":"2024-09-17T05:28:46.692995+0000","last_clean":"2024-09-17T05:28:46.692995+0000","last_became_active":"2024-09-17T05:28:45.686604+0000","last_became_peered":"2024-09-17T05:28:45.686604+0000","last_unstale":"2024-09-17T05:28:46.692995+0000","last_undegraded":"2024-09-17T05:28:46.692995+0000","last_fullsized":"2024-09-17T05:28:46.692995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:33.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.653948+0000","last_change":"2024-09-17T05:28:44.659167+0000","last_active":"2024-09-17T05:28:46.653948+0000","last_peered":"2024-09-17T05:28:46.653948+0000","last_clean":"2024-09-17T05:28:46.653948+0000","last_became_active":"2024-09-17T05:28:44.658804+0000","last_became_peered":"2024-09-17T05:28:44.658804+0000","last_unstale":"2024-09-17T05:28:46.653948+0000","last_undegraded":"2024-09-17T05:28:46.653948+0000","last_fullsized":"2024-09-17T05:28:46.653948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:50.304488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862798+0000","last_change":"2024-09-17T05:28:45.688426+0000","last_active":"2024-09-17T05:28:46.862798+0000","last_peered":"2024-09-17T05:28:46.862798+0000","last_clean":"2024-09-17T05:28:46.862798+0000","last_became_active":"2024-09-17T05:28:45.688100+0000","last_became_peered":"2024-09-17T05:28:45.688100+0000","last_unstale":"2024-09-17T05:28:46.862798+0000","last_undegraded":"2024-09-17T05:28:46.862798+0000","last_fullsized":"2024-09-17T05:28:46.862798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:11.277486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660737+0000","last_change":"2024-09-17T05:28:44.662254+0000","last_active":"2024-09-17T05:28:46.660737+0000","last_peered":"2024-09-17T05:28:46.660737+0000","last_clean":"2024-09-17T05:28:46.660737+0000","last_became_active":"2024-09-17T05:28:44.659880+0000","last_became_peered":"2024-09-17T05:28:44.659880+0000","last_unstale":"2024-09-17T05:28:46.660737+0000","last_undegraded":"2024-09-17T05:28:46.660737+0000","last_fullsized":"2024-09-17T05:28:46.660737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:54.102764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863300+0000","last_change":"2024-09-17T05:28:45.693962+0000","last_active":"2024-09-17T05:28:46.863300+0000","last_peered":"2024-09-17T05:28:46.863300+0000","last_clean":"2024-09-17T05:28:46.863300+0000","last_became_active":"2024-09-17T05:28:45.693641+0000","last_became_peered":"2024-09-17T05:28:45.693641+0000","last_unstale":"2024-09-17T05:28:46.863300+0000","last_undegraded":"2024-09-17T05:28:46.863300+0000","last_fullsized":"2024-09-17T05:28:46.863300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:12.085165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654313+0000","last_change":"2024-09-17T05:28:44.657506+0000","last_active":"2024-09-17T05:28:46.654313+0000","last_peered":"2024-09-17T05:28:46.654313+0000","last_clean":"2024-09-17T05:28:46.654313+0000","last_became_active":"2024-09-17T05:28:44.653791+0000","last_became_peered":"2024-09-17T05:28:44.653791+0000","last_unstale":"2024-09-17T05:28:46.654313+0000","last_undegraded":"2024-09-17T05:28:46.654313+0000","last_fullsized":"2024-09-17T05:28:46.654313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:24.655736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863392+0000","last_change":"2024-09-17T05:28:45.684936+0000","last_active":"2024-09-17T05:28:46.863392+0000","last_peered":"2024-09-17T05:28:46.863392+0000","last_clean":"2024-09-17T05:28:46.863392+0000","last_became_active":"2024-09-17T05:28:45.684661+0000","last_became_peered":"2024-09-17T05:28:45.684661+0000","last_unstale":"2024-09-17T05:28:46.863392+0000","last_undegraded":"2024-09-17T05:28:46.863392+0000","last_fullsized":"2024-09-17T05:28:46.863392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:11.266932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688447+0000","last_change":"2024-09-17T05:28:44.659661+0000","last_active":"2024-09-17T05:28:46.688447+0000","last_peered":"2024-09-17T05:28:46.688447+0000","last_clean":"2024-09-17T05:28:46.688447+0000","last_became_active":"2024-09-17T05:28:44.659296+0000","last_became_peered":"2024-09-17T05:28:44.659296+0000","last_unstale":"2024-09-17T05:28:46.688447+0000","last_undegraded":"2024-09-17T05:28:46.688447+0000","last_fullsized":"2024-09-17T05:28:46.688447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:54.204227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660529+0000","last_change":"2024-09-17T05:28:45.689026+0000","last_active":"2024-09-17T05:28:46.660529+0000","last_peered":"2024-09-17T05:28:46.660529+0000","last_clean":"2024-09-17T05:28:46.660529+0000","last_became_active":"2024-09-17T05:28:45.688756+0000","last_became_peered":"2024-09-17T05:28:45.688756+0000","last_unstale":"2024-09-17T05:28:46.660529+0000","last_undegraded":"2024-09-17T05:28:46.660529+0000","last_fullsized":"2024-09-17T05:28:46.660529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:51.339078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654198+0000","last_change":"2024-09-17T05:28:44.657464+0000","last_active":"2024-09-17T05:28:46.654198+0000","last_peered":"2024-09-17T05:28:46.654198+0000","last_clean":"2024-09-17T05:28:46.654198+0000","last_became_active":"2024-09-17T05:28:44.654450+0000","last_became_peered":"2024-09-17T05:28:44.654450+0000","last_unstale":"2024-09-17T05:28:46.654198+0000","last_undegraded":"2024-09-17T05:28:46.654198+0000","last_fullsized":"2024-09-17T05:28:46.654198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:42.638974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863210+0000","last_change":"2024-09-17T05:28:45.676934+0000","last_active":"2024-09-17T05:28:46.863210+0000","last_peered":"2024-09-17T05:28:46.863210+0000","last_clean":"2024-09-17T05:28:46.863210+0000","last_became_active":"2024-09-17T05:28:45.676633+0000","last_became_peered":"2024-09-17T05:28:45.676633+0000","last_unstale":"2024-09-17T05:28:46.863210+0000","last_undegraded":"2024-09-17T05:28:46.863210+0000","last_fullsized":"2024-09-17T05:28:46.863210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:24.636305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862638+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:28:46.862638+0000","last_peered":"2024-09-17T05:28:46.862638+0000","last_clean":"2024-09-17T05:28:46.862638+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:28:46.862638+0000","last_undegraded":"2024-09-17T05:28:46.862638+0000","last_fullsized":"2024-09-17T05:28:46.862638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659979+0000","last_change":"2024-09-17T05:28:44.655816+0000","last_active":"2024-09-17T05:28:46.659979+0000","last_peered":"2024-09-17T05:28:46.659979+0000","last_clean":"2024-09-17T05:28:46.659979+0000","last_became_active":"2024-09-17T05:28:44.655528+0000","last_became_peered":"2024-09-17T05:28:44.655528+0000","last_unstale":"2024-09-17T05:28:46.659979+0000","last_undegraded":"2024-09-17T05:28:46.659979+0000","last_fullsized":"2024-09-17T05:28:46.659979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:53.370296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861881+0000","last_change":"2024-09-17T05:28:45.678111+0000","last_active":"2024-09-17T05:28:46.861881+0000","last_peered":"2024-09-17T05:28:46.861881+0000","last_clean":"2024-09-17T05:28:46.861881+0000","last_became_active":"2024-09-17T05:28:45.677828+0000","last_became_peered":"2024-09-17T05:28:45.677828+0000","last_unstale":"2024-09-17T05:28:46.861881+0000","last_undegraded":"2024-09-17T05:28:46.861881+0000","last_fullsized":"2024-09-17T05:28:46.861881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:35.611079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862512+0000","last_change":"2024-09-17T05:28:44.665338+0000","last_active":"2024-09-17T05:28:46.862512+0000","last_peered":"2024-09-17T05:28:46.862512+0000","last_clean":"2024-09-17T05:28:46.862512+0000","last_became_active":"2024-09-17T05:28:44.665066+0000","last_became_peered":"2024-09-17T05:28:44.665066+0000","last_unstale":"2024-09-17T05:28:46.862512+0000","last_undegraded":"2024-09-17T05:28:46.862512+0000","last_fullsized":"2024-09-17T05:28:46.862512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:57.978737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861309+0000","last_change":"2024-09-17T05:28:45.670679+0000","last_active":"2024-09-17T05:28:46.861309+0000","last_peered":"2024-09-17T05:28:46.861309+0000","last_clean":"2024-09-17T05:28:46.861309+0000","last_became_active":"2024-09-17T05:28:45.670385+0000","last_became_peered":"2024-09-17T05:28:45.670385+0000","last_unstale":"2024-09-17T05:28:46.861309+0000","last_undegraded":"2024-09-17T05:28:46.861309+0000","last_fullsized":"2024-09-17T05:28:46.861309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:56.353907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654167+0000","last_change":"2024-09-17T05:28:44.656799+0000","last_active":"2024-09-17T05:28:46.654167+0000","last_peered":"2024-09-17T05:28:46.654167+0000","last_clean":"2024-09-17T05:28:46.654167+0000","last_became_active":"2024-09-17T05:28:44.653919+0000","last_became_peered":"2024-09-17T05:28:44.653919+0000","last_unstale":"2024-09-17T05:28:46.654167+0000","last_undegraded":"2024-09-17T05:28:46.654167+0000","last_fullsized":"2024-09-17T05:28:46.654167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:00.756226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688170+0000","last_change":"2024-09-17T05:28:45.680508+0000","last_active":"2024-09-17T05:28:46.688170+0000","last_peered":"2024-09-17T05:28:46.688170+0000","last_clean":"2024-09-17T05:28:46.688170+0000","last_became_active":"2024-09-17T05:28:45.680228+0000","last_became_peered":"2024-09-17T05:28:45.680228+0000","last_unstale":"2024-09-17T05:28:46.688170+0000","last_undegraded":"2024-09-17T05:28:46.688170+0000","last_fullsized":"2024-09-17T05:28:46.688170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:00.494429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661173+0000","last_change":"2024-09-17T05:28:44.659616+0000","last_active":"2024-09-17T05:28:46.661173+0000","last_peered":"2024-09-17T05:28:46.661173+0000","last_clean":"2024-09-17T05:28:46.661173+0000","last_became_active":"2024-09-17T05:28:44.659315+0000","last_became_peered":"2024-09-17T05:28:44.659315+0000","last_unstale":"2024-09-17T05:28:46.661173+0000","last_undegraded":"2024-09-17T05:28:46.661173+0000","last_fullsized":"2024-09-17T05:28:46.661173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:01.383128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659953+0000","last_change":"2024-09-17T05:28:45.667308+0000","last_active":"2024-09-17T05:28:46.659953+0000","last_peered":"2024-09-17T05:28:46.659953+0000","last_clean":"2024-09-17T05:28:46.659953+0000","last_became_active":"2024-09-17T05:28:45.665085+0000","last_became_peered":"2024-09-17T05:28:45.665085+0000","last_unstale":"2024-09-17T05:28:46.659953+0000","last_undegraded":"2024-09-17T05:28:46.659953+0000","last_fullsized":"2024-09-17T05:28:46.659953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:35.749778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688240+0000","last_change":"2024-09-17T05:28:44.664461+0000","last_active":"2024-09-17T05:28:46.688240+0000","last_peered":"2024-09-17T05:28:46.688240+0000","last_clean":"2024-09-17T05:28:46.688240+0000","last_became_active":"2024-09-17T05:28:44.663124+0000","last_became_peered":"2024-09-17T05:28:44.663124+0000","last_unstale":"2024-09-17T05:28:46.688240+0000","last_undegraded":"2024-09-17T05:28:46.688240+0000","last_fullsized":"2024-09-17T05:28:46.688240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:56.605556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660901+0000","last_change":"2024-09-17T05:28:45.673340+0000","last_active":"2024-09-17T05:28:46.660901+0000","last_peered":"2024-09-17T05:28:46.660901+0000","last_clean":"2024-09-17T05:28:46.660901+0000","last_became_active":"2024-09-17T05:28:45.673047+0000","last_became_peered":"2024-09-17T05:28:45.673047+0000","last_unstale":"2024-09-17T05:28:46.660901+0000","last_undegraded":"2024-09-17T05:28:46.660901+0000","last_fullsized":"2024-09-17T05:28:46.660901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:21.863500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863309+0000","last_change":"2024-09-17T05:28:44.668483+0000","last_active":"2024-09-17T05:28:46.863309+0000","last_peered":"2024-09-17T05:28:46.863309+0000","last_clean":"2024-09-17T05:28:46.863309+0000","last_became_active":"2024-09-17T05:28:44.668063+0000","last_became_peered":"2024-09-17T05:28:44.668063+0000","last_unstale":"2024-09-17T05:28:46.863309+0000","last_undegraded":"2024-09-17T05:28:46.863309+0000","last_fullsized":"2024-09-17T05:28:46.863309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:03.222463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688247+0000","last_change":"2024-09-17T05:28:45.666361+0000","last_active":"2024-09-17T05:28:46.688247+0000","last_peered":"2024-09-17T05:28:46.688247+0000","last_clean":"2024-09-17T05:28:46.688247+0000","last_became_active":"2024-09-17T05:28:45.666003+0000","last_became_peered":"2024-09-17T05:28:45.666003+0000","last_unstale":"2024-09-17T05:28:46.688247+0000","last_undegraded":"2024-09-17T05:28:46.688247+0000","last_fullsized":"2024-09-17T05:28:46.688247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:43.813385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688447+0000","last_change":"2024-09-17T05:28:44.663175+0000","last_active":"2024-09-17T05:28:46.688447+0000","last_peered":"2024-09-17T05:28:46.688447+0000","last_clean":"2024-09-17T05:28:46.688447+0000","last_became_active":"2024-09-17T05:28:44.662839+0000","last_became_peered":"2024-09-17T05:28:44.662839+0000","last_unstale":"2024-09-17T05:28:46.688447+0000","last_undegraded":"2024-09-17T05:28:46.688447+0000","last_fullsized":"2024-09-17T05:28:46.688447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:14.858019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862188+0000","last_change":"2024-09-17T05:28:45.683844+0000","last_active":"2024-09-17T05:28:46.862188+0000","last_peered":"2024-09-17T05:28:46.862188+0000","last_clean":"2024-09-17T05:28:46.862188+0000","last_became_active":"2024-09-17T05:28:45.683527+0000","last_became_peered":"2024-09-17T05:28:45.683527+0000","last_unstale":"2024-09-17T05:28:46.862188+0000","last_undegraded":"2024-09-17T05:28:46.862188+0000","last_fullsized":"2024-09-17T05:28:46.862188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:11.277486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692809+0000","last_change":"2024-09-17T05:28:44.671021+0000","last_active":"2024-09-17T05:28:46.692809+0000","last_peered":"2024-09-17T05:28:46.692809+0000","last_clean":"2024-09-17T05:28:46.692809+0000","last_became_active":"2024-09-17T05:28:44.666107+0000","last_became_peered":"2024-09-17T05:28:44.666107+0000","last_unstale":"2024-09-17T05:28:46.692809+0000","last_undegraded":"2024-09-17T05:28:46.692809+0000","last_fullsized":"2024-09-17T05:28:46.692809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:57.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862563+0000","last_change":"2024-09-17T05:28:45.669543+0000","last_active":"2024-09-17T05:28:46.862563+0000","last_peered":"2024-09-17T05:28:46.862563+0000","last_clean":"2024-09-17T05:28:46.862563+0000","last_became_active":"2024-09-17T05:28:45.669258+0000","last_became_peered":"2024-09-17T05:28:45.669258+0000","last_unstale":"2024-09-17T05:28:46.862563+0000","last_undegraded":"2024-09-17T05:28:46.862563+0000","last_fullsized":"2024-09-17T05:28:46.862563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:29.130107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862503+0000","last_change":"2024-09-17T05:28:44.669157+0000","last_active":"2024-09-17T05:28:46.862503+0000","last_peered":"2024-09-17T05:28:46.862503+0000","last_clean":"2024-09-17T05:28:46.862503+0000","last_became_active":"2024-09-17T05:28:44.668464+0000","last_became_peered":"2024-09-17T05:28:44.668464+0000","last_unstale":"2024-09-17T05:28:46.862503+0000","last_undegraded":"2024-09-17T05:28:46.862503+0000","last_fullsized":"2024-09-17T05:28:46.862503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:27.326210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659841+0000","last_change":"2024-09-17T05:28:45.667885+0000","last_active":"2024-09-17T05:28:46.659841+0000","last_peered":"2024-09-17T05:28:46.659841+0000","last_clean":"2024-09-17T05:28:46.659841+0000","last_became_active":"2024-09-17T05:28:45.666920+0000","last_became_peered":"2024-09-17T05:28:45.666920+0000","last_unstale":"2024-09-17T05:28:46.659841+0000","last_undegraded":"2024-09-17T05:28:46.659841+0000","last_fullsized":"2024-09-17T05:28:46.659841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:25.665870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688240+0000","last_change":"2024-09-17T05:28:44.665516+0000","last_active":"2024-09-17T05:28:46.688240+0000","last_peered":"2024-09-17T05:28:46.688240+0000","last_clean":"2024-09-17T05:28:46.688240+0000","last_became_active":"2024-09-17T05:28:44.665205+0000","last_became_peered":"2024-09-17T05:28:44.665205+0000","last_unstale":"2024-09-17T05:28:46.688240+0000","last_undegraded":"2024-09-17T05:28:46.688240+0000","last_fullsized":"2024-09-17T05:28:46.688240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:57.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861431+0000","last_change":"2024-09-17T05:28:45.674698+0000","last_active":"2024-09-17T05:28:46.861431+0000","last_peered":"2024-09-17T05:28:46.861431+0000","last_clean":"2024-09-17T05:28:46.861431+0000","last_became_active":"2024-09-17T05:28:45.671117+0000","last_became_peered":"2024-09-17T05:28:45.671117+0000","last_unstale":"2024-09-17T05:28:46.861431+0000","last_undegraded":"2024-09-17T05:28:46.861431+0000","last_fullsized":"2024-09-17T05:28:46.861431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:34.701781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688163+0000","last_change":"2024-09-17T05:28:44.662000+0000","last_active":"2024-09-17T05:28:46.688163+0000","last_peered":"2024-09-17T05:28:46.688163+0000","last_clean":"2024-09-17T05:28:46.688163+0000","last_became_active":"2024-09-17T05:28:44.661699+0000","last_became_peered":"2024-09-17T05:28:44.661699+0000","last_unstale":"2024-09-17T05:28:46.688163+0000","last_undegraded":"2024-09-17T05:28:46.688163+0000","last_fullsized":"2024-09-17T05:28:46.688163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:57.978737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861824+0000","last_change":"2024-09-17T05:28:45.682448+0000","last_active":"2024-09-17T05:28:46.861824+0000","last_peered":"2024-09-17T05:28:46.861824+0000","last_clean":"2024-09-17T05:28:46.861824+0000","last_became_active":"2024-09-17T05:28:45.682109+0000","last_became_peered":"2024-09-17T05:28:45.682109+0000","last_unstale":"2024-09-17T05:28:46.861824+0000","last_undegraded":"2024-09-17T05:28:46.861824+0000","last_fullsized":"2024-09-17T05:28:46.861824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:44.301995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863028+0000","last_change":"2024-09-17T05:28:44.668065+0000","last_active":"2024-09-17T05:28:46.863028+0000","last_peered":"2024-09-17T05:28:46.863028+0000","last_clean":"2024-09-17T05:28:46.863028+0000","last_became_active":"2024-09-17T05:28:44.667735+0000","last_became_peered":"2024-09-17T05:28:44.667735+0000","last_unstale":"2024-09-17T05:28:46.863028+0000","last_undegraded":"2024-09-17T05:28:46.863028+0000","last_fullsized":"2024-09-17T05:28:46.863028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:28.072242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692822+0000","last_change":"2024-09-17T05:28:45.688653+0000","last_active":"2024-09-17T05:28:46.692822+0000","last_peered":"2024-09-17T05:28:46.692822+0000","last_clean":"2024-09-17T05:28:46.692822+0000","last_became_active":"2024-09-17T05:28:45.687995+0000","last_became_peered":"2024-09-17T05:28:45.687995+0000","last_unstale":"2024-09-17T05:28:46.692822+0000","last_undegraded":"2024-09-17T05:28:46.692822+0000","last_fullsized":"2024-09-17T05:28:46.692822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:00.494429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660675+0000","last_change":"2024-09-17T05:28:45.674640+0000","last_active":"2024-09-17T05:28:46.660675+0000","last_peered":"2024-09-17T05:28:46.660675+0000","last_clean":"2024-09-17T05:28:46.660675+0000","last_became_active":"2024-09-17T05:28:45.674375+0000","last_became_peered":"2024-09-17T05:28:45.674375+0000","last_unstale":"2024-09-17T05:28:46.660675+0000","last_undegraded":"2024-09-17T05:28:46.660675+0000","last_fullsized":"2024-09-17T05:28:46.660675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:48.986140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862772+0000","last_change":"2024-09-17T05:28:44.668500+0000","last_active":"2024-09-17T05:28:46.862772+0000","last_peered":"2024-09-17T05:28:46.862772+0000","last_clean":"2024-09-17T05:28:46.862772+0000","last_became_active":"2024-09-17T05:28:44.668171+0000","last_became_peered":"2024-09-17T05:28:44.668171+0000","last_unstale":"2024-09-17T05:28:46.862772+0000","last_undegraded":"2024-09-17T05:28:46.862772+0000","last_fullsized":"2024-09-17T05:28:46.862772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:05.964906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660309+0000","last_change":"2024-09-17T05:28:45.675119+0000","last_active":"2024-09-17T05:28:46.660309+0000","last_peered":"2024-09-17T05:28:46.660309+0000","last_clean":"2024-09-17T05:28:46.660309+0000","last_became_active":"2024-09-17T05:28:45.674840+0000","last_became_peered":"2024-09-17T05:28:45.674840+0000","last_unstale":"2024-09-17T05:28:46.660309+0000","last_undegraded":"2024-09-17T05:28:46.660309+0000","last_fullsized":"2024-09-17T05:28:46.660309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:26.709674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863195+0000","last_change":"2024-09-17T05:28:44.671103+0000","last_active":"2024-09-17T05:28:46.863195+0000","last_peered":"2024-09-17T05:28:46.863195+0000","last_clean":"2024-09-17T05:28:46.863195+0000","last_became_active":"2024-09-17T05:28:44.670755+0000","last_became_peered":"2024-09-17T05:28:44.670755+0000","last_unstale":"2024-09-17T05:28:46.863195+0000","last_undegraded":"2024-09-17T05:28:46.863195+0000","last_fullsized":"2024-09-17T05:28:46.863195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:14.858019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862459+0000","last_change":"2024-09-17T05:28:45.677087+0000","last_active":"2024-09-17T05:28:46.862459+0000","last_peered":"2024-09-17T05:28:46.862459+0000","last_clean":"2024-09-17T05:28:46.862459+0000","last_became_active":"2024-09-17T05:28:45.676750+0000","last_became_peered":"2024-09-17T05:28:45.676750+0000","last_unstale":"2024-09-17T05:28:46.862459+0000","last_undegraded":"2024-09-17T05:28:46.862459+0000","last_fullsized":"2024-09-17T05:28:46.862459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:14.581812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862014+0000","last_change":"2024-09-17T05:28:44.654538+0000","last_active":"2024-09-17T05:28:46.862014+0000","last_peered":"2024-09-17T05:28:46.862014+0000","last_clean":"2024-09-17T05:28:46.862014+0000","last_became_active":"2024-09-17T05:28:44.654264+0000","last_became_peered":"2024-09-17T05:28:44.654264+0000","last_unstale":"2024-09-17T05:28:46.862014+0000","last_undegraded":"2024-09-17T05:28:46.862014+0000","last_fullsized":"2024-09-17T05:28:46.862014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:57.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861779+0000","last_change":"2024-09-17T05:28:45.697637+0000","last_active":"2024-09-17T05:28:46.861779+0000","last_peered":"2024-09-17T05:28:46.861779+0000","last_clean":"2024-09-17T05:28:46.861779+0000","last_became_active":"2024-09-17T05:28:45.697328+0000","last_became_peered":"2024-09-17T05:28:45.697328+0000","last_unstale":"2024-09-17T05:28:46.861779+0000","last_undegraded":"2024-09-17T05:28:46.861779+0000","last_fullsized":"2024-09-17T05:28:46.861779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:44.608081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862559+0000","last_change":"2024-09-17T05:28:44.666526+0000","last_active":"2024-09-17T05:28:46.862559+0000","last_peered":"2024-09-17T05:28:46.862559+0000","last_clean":"2024-09-17T05:28:46.862559+0000","last_became_active":"2024-09-17T05:28:44.666209+0000","last_became_peered":"2024-09-17T05:28:44.666209+0000","last_unstale":"2024-09-17T05:28:46.862559+0000","last_undegraded":"2024-09-17T05:28:46.862559+0000","last_fullsized":"2024-09-17T05:28:46.862559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:50.431079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":663137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":72313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":72187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":663193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:28:54.457 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:28:54.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.609+0000 7f3040600640 1 -- 172.21.15.31:0/2346496043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3020003c40 msgr2=0x7f3020004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:54.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.609+0000 7f3040600640 1 --2- 172.21.15.31:0/2346496043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3020003c40 0x7f3020004060 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f302c001830 tx=0x7f302c01c840 comp rx=0 tx=0).stop 2024-09-17T05:28:54.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.609+0000 7f3040600640 1 -- 172.21.15.31:0/2346496043 shutdown_connections 2024-09-17T05:28:54.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.609+0000 7f3040600640 1 --2- 172.21.15.31:0/2346496043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3020003c40 0x7f3020004060 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:54.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.609+0000 7f3040600640 1 -- 172.21.15.31:0/2346496043 >> 172.21.15.31:0/2346496043 conn(0x7f30380b18f0 msgr2=0x7f30380b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:54.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.609+0000 7f3040600640 1 -- 172.21.15.31:0/2346496043 shutdown_connections 2024-09-17T05:28:54.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.609+0000 7f3040600640 1 -- 172.21.15.31:0/2346496043 wait complete. 2024-09-17T05:28:54.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.609+0000 7f3040600640 1 Processor -- start 2024-09-17T05:28:54.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f3040600640 1 -- start start 2024-09-17T05:28:54.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f3040600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3020003c40 0x7f30381f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:54.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f3040600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30381566e0 0x7f30381e72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:54.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f3040600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f303814b280 0x7f303814b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:54.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f3040600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f303815f290 con 0x7f3020003c40 2024-09-17T05:28:54.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f3040600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f303815f110 con 0x7f303814b280 2024-09-17T05:28:54.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f3040600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f303815f410 con 0x7f30381566e0 2024-09-17T05:28:54.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f303dc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3020003c40 0x7f30381f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:54.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f303dc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3020003c40 0x7f30381f6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42006/0 (socket says 172.21.15.31:42006) 2024-09-17T05:28:54.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f303dc00640 1 -- 172.21.15.31:0/1193019445 learned_addr learned my addr 172.21.15.31:0/1193019445 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:54.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f303d200640 1 --2- 172.21.15.31:0/1193019445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30381566e0 0x7f30381e72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:54.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f303e600640 1 --2- 172.21.15.31:0/1193019445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f303814b280 0x7f303814b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:54.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f303dc00640 1 -- 172.21.15.31:0/1193019445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30381566e0 msgr2=0x7f30381e72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:54.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f303dc00640 1 --2- 172.21.15.31:0/1193019445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30381566e0 0x7f30381e72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:54.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f303dc00640 1 -- 172.21.15.31:0/1193019445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f303814b280 msgr2=0x7f303814b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:54.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f303dc00640 1 --2- 172.21.15.31:0/1193019445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f303814b280 0x7f303814b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:54.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f303dc00640 1 -- 172.21.15.31:0/1193019445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f303809d5a0 con 0x7f3020003c40 2024-09-17T05:28:54.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f303dc00640 1 --2- 172.21.15.31:0/1193019445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3020003c40 0x7f30381f6910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f302c01cd20 tx=0x7f302c003be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:54.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f3035600640 1 -- 172.21.15.31:0/1193019445 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c001480 con 0x7f3020003c40 2024-09-17T05:28:54.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f3035600640 1 -- 172.21.15.31:0/1193019445 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f302c006090 con 0x7f3020003c40 2024-09-17T05:28:54.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f3035600640 1 -- 172.21.15.31:0/1193019445 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302c0a64d0 con 0x7f3020003c40 2024-09-17T05:28:54.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f3040600640 1 -- 172.21.15.31:0/1193019445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30381f3cc0 con 0x7f3020003c40 2024-09-17T05:28:54.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f3040600640 1 -- 172.21.15.31:0/1193019445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30381f4280 con 0x7f3020003c40 2024-09-17T05:28:54.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.613+0000 7f3040600640 1 -- 172.21.15.31:0/1193019445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3038069410 con 0x7f3020003c40 2024-09-17T05:28:54.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.617+0000 7f3035600640 1 -- 172.21.15.31:0/1193019445 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f302c0a6690 con 0x7f3020003c40 2024-09-17T05:28:54.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.617+0000 7f3035600640 1 --2- 172.21.15.31:0/1193019445 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3018073200 0x7f30180756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:54.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.617+0000 7f3035600640 1 -- 172.21.15.31:0/1193019445 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f302c0b5020 con 0x7f3020003c40 2024-09-17T05:28:54.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.617+0000 7f303d200640 1 --2- 172.21.15.31:0/1193019445 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3018073200 0x7f30180756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:54.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.617+0000 7f303d200640 1 --2- 172.21.15.31:0/1193019445 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3018073200 0x7f30180756c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3038156ec0 tx=0x7f3024006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:54.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.621+0000 7f3035600640 1 -- 172.21.15.31:0/1193019445 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f302c0aa070 con 0x7f3020003c40 2024-09-17T05:28:54.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.797+0000 7f3040600640 1 -- 172.21.15.31:0/1193019445 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f303809d350 con 0x7f3018073200 2024-09-17T05:28:54.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.801+0000 7f3035600640 1 -- 172.21.15.31:0/1193019445 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251937 (secure 0 0 0) 0x7f303809d350 con 0x7f3018073200 2024-09-17T05:28:54.808 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:54.809 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:28:54.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.805+0000 7f3040600640 1 -- 172.21.15.31:0/1193019445 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3018073200 msgr2=0x7f30180756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:54.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.805+0000 7f3040600640 1 --2- 172.21.15.31:0/1193019445 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3018073200 0x7f30180756c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3038156ec0 tx=0x7f3024006040 comp rx=0 tx=0).stop 2024-09-17T05:28:54.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.805+0000 7f3040600640 1 -- 172.21.15.31:0/1193019445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3020003c40 msgr2=0x7f30381f6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:54.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.805+0000 7f3040600640 1 --2- 172.21.15.31:0/1193019445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3020003c40 0x7f30381f6910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f302c01cd20 tx=0x7f302c003be0 comp rx=0 tx=0).stop 2024-09-17T05:28:54.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.805+0000 7f3040600640 1 -- 172.21.15.31:0/1193019445 shutdown_connections 2024-09-17T05:28:54.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.805+0000 7f3040600640 1 --2- 172.21.15.31:0/1193019445 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3018073200 0x7f30180756c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:54.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.805+0000 7f3040600640 1 --2- 172.21.15.31:0/1193019445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f303814b280 0x7f303814b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:54.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.805+0000 7f3040600640 1 --2- 172.21.15.31:0/1193019445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30381566e0 0x7f30381e72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:54.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.805+0000 7f3040600640 1 --2- 172.21.15.31:0/1193019445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3020003c40 0x7f30381f6910 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:54.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.805+0000 7f3040600640 1 -- 172.21.15.31:0/1193019445 >> 172.21.15.31:0/1193019445 conn(0x7f30380b18f0 msgr2=0x7f3038074370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:54.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.805+0000 7f3040600640 1 -- 172.21.15.31:0/1193019445 shutdown_connections 2024-09-17T05:28:54.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:54.805+0000 7f3040600640 1 -- 172.21.15.31:0/1193019445 wait complete. 2024-09-17T05:28:54.828 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-17T05:28:53.182784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219120,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755600,"statfs":{"total":773094113280,"available":772869734400,"internally_reserved":0,"allocated":2924544,"data_stored":1763052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001843"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863232+0000","last_change":"2024-09-17T05:28:45.697872+0000","last_active":"2024-09-17T05:28:46.863232+0000","last_peered":"2024-09-17T05:28:46.863232+0000","last_clean":"2024-09-17T05:28:46.863232+0000","last_became_active":"2024-09-17T05:28:45.695565+0000","last_became_peered":"2024-09-17T05:28:45.695565+0000","last_unstale":"2024-09-17T05:28:46.863232+0000","last_undegraded":"2024-09-17T05:28:46.863232+0000","last_fullsized":"2024-09-17T05:28:46.863232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:45:19.586402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688506+0000","last_change":"2024-09-17T05:28:45.678580+0000","last_active":"2024-09-17T05:28:46.688506+0000","last_peered":"2024-09-17T05:28:46.688506+0000","last_clean":"2024-09-17T05:28:46.688506+0000","last_became_active":"2024-09-17T05:28:45.678219+0000","last_became_peered":"2024-09-17T05:28:45.678219+0000","last_unstale":"2024-09-17T05:28:46.688506+0000","last_undegraded":"2024-09-17T05:28:46.688506+0000","last_fullsized":"2024-09-17T05:28:46.688506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:21.659738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862447+0000","last_change":"2024-09-17T05:28:45.671569+0000","last_active":"2024-09-17T05:28:46.862447+0000","last_peered":"2024-09-17T05:28:46.862447+0000","last_clean":"2024-09-17T05:28:46.862447+0000","last_became_active":"2024-09-17T05:28:45.671278+0000","last_became_peered":"2024-09-17T05:28:45.671278+0000","last_unstale":"2024-09-17T05:28:46.862447+0000","last_undegraded":"2024-09-17T05:28:46.862447+0000","last_fullsized":"2024-09-17T05:28:46.862447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:58:21.650063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660082+0000","last_change":"2024-09-17T05:28:45.689085+0000","last_active":"2024-09-17T05:28:46.660082+0000","last_peered":"2024-09-17T05:28:46.660082+0000","last_clean":"2024-09-17T05:28:46.660082+0000","last_became_active":"2024-09-17T05:28:45.688806+0000","last_became_peered":"2024-09-17T05:28:45.688806+0000","last_unstale":"2024-09-17T05:28:46.660082+0000","last_undegraded":"2024-09-17T05:28:46.660082+0000","last_fullsized":"2024-09-17T05:28:46.660082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:51.791266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862886+0000","last_change":"2024-09-17T05:28:45.682352+0000","last_active":"2024-09-17T05:28:46.862886+0000","last_peered":"2024-09-17T05:28:46.862886+0000","last_clean":"2024-09-17T05:28:46.862886+0000","last_became_active":"2024-09-17T05:28:45.682032+0000","last_became_peered":"2024-09-17T05:28:45.682032+0000","last_unstale":"2024-09-17T05:28:46.862886+0000","last_undegraded":"2024-09-17T05:28:46.862886+0000","last_fullsized":"2024-09-17T05:28:46.862886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:46.948368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660986+0000","last_change":"2024-09-17T05:28:45.674052+0000","last_active":"2024-09-17T05:28:46.660986+0000","last_peered":"2024-09-17T05:28:46.660986+0000","last_clean":"2024-09-17T05:28:46.660986+0000","last_became_active":"2024-09-17T05:28:45.673577+0000","last_became_peered":"2024-09-17T05:28:45.673577+0000","last_unstale":"2024-09-17T05:28:46.660986+0000","last_undegraded":"2024-09-17T05:28:46.660986+0000","last_fullsized":"2024-09-17T05:28:46.660986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:51.624046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863066+0000","last_change":"2024-09-17T05:28:45.681779+0000","last_active":"2024-09-17T05:28:46.863066+0000","last_peered":"2024-09-17T05:28:46.863066+0000","last_clean":"2024-09-17T05:28:46.863066+0000","last_became_active":"2024-09-17T05:28:45.681439+0000","last_became_peered":"2024-09-17T05:28:45.681439+0000","last_unstale":"2024-09-17T05:28:46.863066+0000","last_undegraded":"2024-09-17T05:28:46.863066+0000","last_fullsized":"2024-09-17T05:28:46.863066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:17.571913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861260+0000","last_change":"2024-09-17T05:28:45.675817+0000","last_active":"2024-09-17T05:28:46.861260+0000","last_peered":"2024-09-17T05:28:46.861260+0000","last_clean":"2024-09-17T05:28:46.861260+0000","last_became_active":"2024-09-17T05:28:45.675261+0000","last_became_peered":"2024-09-17T05:28:45.675261+0000","last_unstale":"2024-09-17T05:28:46.861260+0000","last_undegraded":"2024-09-17T05:28:46.861260+0000","last_fullsized":"2024-09-17T05:28:46.861260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.192825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863307+0000","last_change":"2024-09-17T05:28:45.678585+0000","last_active":"2024-09-17T05:28:46.863307+0000","last_peered":"2024-09-17T05:28:46.863307+0000","last_clean":"2024-09-17T05:28:46.863307+0000","last_became_active":"2024-09-17T05:28:45.678193+0000","last_became_peered":"2024-09-17T05:28:45.678193+0000","last_unstale":"2024-09-17T05:28:46.863307+0000","last_undegraded":"2024-09-17T05:28:46.863307+0000","last_fullsized":"2024-09-17T05:28:46.863307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:09.412687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692863+0000","last_change":"2024-09-17T05:28:45.694856+0000","last_active":"2024-09-17T05:28:46.692863+0000","last_peered":"2024-09-17T05:28:46.692863+0000","last_clean":"2024-09-17T05:28:46.692863+0000","last_became_active":"2024-09-17T05:28:45.694301+0000","last_became_peered":"2024-09-17T05:28:45.694301+0000","last_unstale":"2024-09-17T05:28:46.692863+0000","last_undegraded":"2024-09-17T05:28:46.692863+0000","last_fullsized":"2024-09-17T05:28:46.692863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:51.540943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692949+0000","last_change":"2024-09-17T05:28:45.686541+0000","last_active":"2024-09-17T05:28:46.692949+0000","last_peered":"2024-09-17T05:28:46.692949+0000","last_clean":"2024-09-17T05:28:46.692949+0000","last_became_active":"2024-09-17T05:28:45.686257+0000","last_became_peered":"2024-09-17T05:28:45.686257+0000","last_unstale":"2024-09-17T05:28:46.692949+0000","last_undegraded":"2024-09-17T05:28:46.692949+0000","last_fullsized":"2024-09-17T05:28:46.692949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:43.813385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660297+0000","last_change":"2024-09-17T05:28:45.686106+0000","last_active":"2024-09-17T05:28:46.660297+0000","last_peered":"2024-09-17T05:28:46.660297+0000","last_clean":"2024-09-17T05:28:46.660297+0000","last_became_active":"2024-09-17T05:28:45.685801+0000","last_became_peered":"2024-09-17T05:28:45.685801+0000","last_unstale":"2024-09-17T05:28:46.660297+0000","last_undegraded":"2024-09-17T05:28:46.660297+0000","last_fullsized":"2024-09-17T05:28:46.660297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:49.061509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861763+0000","last_change":"2024-09-17T05:28:45.681737+0000","last_active":"2024-09-17T05:28:46.861763+0000","last_peered":"2024-09-17T05:28:46.861763+0000","last_clean":"2024-09-17T05:28:46.861763+0000","last_became_active":"2024-09-17T05:28:45.681463+0000","last_became_peered":"2024-09-17T05:28:45.681463+0000","last_unstale":"2024-09-17T05:28:46.861763+0000","last_undegraded":"2024-09-17T05:28:46.861763+0000","last_fullsized":"2024-09-17T05:28:46.861763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.524996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861769+0000","last_change":"2024-09-17T05:28:45.664352+0000","last_active":"2024-09-17T05:28:46.861769+0000","last_peered":"2024-09-17T05:28:46.861769+0000","last_clean":"2024-09-17T05:28:46.861769+0000","last_became_active":"2024-09-17T05:28:45.663507+0000","last_became_peered":"2024-09-17T05:28:45.663507+0000","last_unstale":"2024-09-17T05:28:46.861769+0000","last_undegraded":"2024-09-17T05:28:46.861769+0000","last_fullsized":"2024-09-17T05:28:46.861769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:17.848561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688160+0000","last_change":"2024-09-17T05:28:45.661764+0000","last_active":"2024-09-17T05:28:46.688160+0000","last_peered":"2024-09-17T05:28:46.688160+0000","last_clean":"2024-09-17T05:28:46.688160+0000","last_became_active":"2024-09-17T05:28:45.661449+0000","last_became_peered":"2024-09-17T05:28:45.661449+0000","last_unstale":"2024-09-17T05:28:46.688160+0000","last_undegraded":"2024-09-17T05:28:46.688160+0000","last_fullsized":"2024-09-17T05:28:46.688160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:06.446649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659618+0000","last_change":"2024-09-17T05:28:45.670649+0000","last_active":"2024-09-17T05:28:46.659618+0000","last_peered":"2024-09-17T05:28:46.659618+0000","last_clean":"2024-09-17T05:28:46.659618+0000","last_became_active":"2024-09-17T05:28:45.670351+0000","last_became_peered":"2024-09-17T05:28:45.670351+0000","last_unstale":"2024-09-17T05:28:46.659618+0000","last_undegraded":"2024-09-17T05:28:46.659618+0000","last_fullsized":"2024-09-17T05:28:46.659618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:29.130107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660571+0000","last_change":"2024-09-17T05:28:45.679957+0000","last_active":"2024-09-17T05:28:46.660571+0000","last_peered":"2024-09-17T05:28:46.660571+0000","last_clean":"2024-09-17T05:28:46.660571+0000","last_became_active":"2024-09-17T05:28:45.679602+0000","last_became_peered":"2024-09-17T05:28:45.679602+0000","last_unstale":"2024-09-17T05:28:46.660571+0000","last_undegraded":"2024-09-17T05:28:46.660571+0000","last_fullsized":"2024-09-17T05:28:46.660571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:39.462655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654439+0000","last_change":"2024-09-17T05:28:45.696611+0000","last_active":"2024-09-17T05:28:46.654439+0000","last_peered":"2024-09-17T05:28:46.654439+0000","last_clean":"2024-09-17T05:28:46.654439+0000","last_became_active":"2024-09-17T05:28:45.696317+0000","last_became_peered":"2024-09-17T05:28:45.696317+0000","last_unstale":"2024-09-17T05:28:46.654439+0000","last_undegraded":"2024-09-17T05:28:46.654439+0000","last_fullsized":"2024-09-17T05:28:46.654439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:02.631947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863417+0000","last_change":"2024-09-17T05:28:45.682233+0000","last_active":"2024-09-17T05:28:46.863417+0000","last_peered":"2024-09-17T05:28:46.863417+0000","last_clean":"2024-09-17T05:28:46.863417+0000","last_became_active":"2024-09-17T05:28:45.681921+0000","last_became_peered":"2024-09-17T05:28:45.681921+0000","last_unstale":"2024-09-17T05:28:46.863417+0000","last_undegraded":"2024-09-17T05:28:46.863417+0000","last_fullsized":"2024-09-17T05:28:46.863417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:48.570504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692784+0000","last_change":"2024-09-17T05:28:45.689764+0000","last_active":"2024-09-17T05:28:46.692784+0000","last_peered":"2024-09-17T05:28:46.692784+0000","last_clean":"2024-09-17T05:28:46.692784+0000","last_became_active":"2024-09-17T05:28:45.686962+0000","last_became_peered":"2024-09-17T05:28:45.686962+0000","last_unstale":"2024-09-17T05:28:46.692784+0000","last_undegraded":"2024-09-17T05:28:46.692784+0000","last_fullsized":"2024-09-17T05:28:46.692784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:02:08.175874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861974+0000","last_change":"2024-09-17T05:28:45.679307+0000","last_active":"2024-09-17T05:28:46.861974+0000","last_peered":"2024-09-17T05:28:46.861974+0000","last_clean":"2024-09-17T05:28:46.861974+0000","last_became_active":"2024-09-17T05:28:45.677900+0000","last_became_peered":"2024-09-17T05:28:45.677900+0000","last_unstale":"2024-09-17T05:28:46.861974+0000","last_undegraded":"2024-09-17T05:28:46.861974+0000","last_fullsized":"2024-09-17T05:28:46.861974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:16.537395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661054+0000","last_change":"2024-09-17T05:28:45.675903+0000","last_active":"2024-09-17T05:28:46.661054+0000","last_peered":"2024-09-17T05:28:46.661054+0000","last_clean":"2024-09-17T05:28:46.661054+0000","last_became_active":"2024-09-17T05:28:45.675619+0000","last_became_peered":"2024-09-17T05:28:45.675619+0000","last_unstale":"2024-09-17T05:28:46.661054+0000","last_undegraded":"2024-09-17T05:28:46.661054+0000","last_fullsized":"2024-09-17T05:28:46.661054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:25.383911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861418+0000","last_change":"2024-09-17T05:28:45.685230+0000","last_active":"2024-09-17T05:28:46.861418+0000","last_peered":"2024-09-17T05:28:46.861418+0000","last_clean":"2024-09-17T05:28:46.861418+0000","last_became_active":"2024-09-17T05:28:45.684920+0000","last_became_peered":"2024-09-17T05:28:45.684920+0000","last_unstale":"2024-09-17T05:28:46.861418+0000","last_undegraded":"2024-09-17T05:28:46.861418+0000","last_fullsized":"2024-09-17T05:28:46.861418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:37.130400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660820+0000","last_change":"2024-09-17T05:28:45.670609+0000","last_active":"2024-09-17T05:28:46.660820+0000","last_peered":"2024-09-17T05:28:46.660820+0000","last_clean":"2024-09-17T05:28:46.660820+0000","last_became_active":"2024-09-17T05:28:45.670294+0000","last_became_peered":"2024-09-17T05:28:45.670294+0000","last_unstale":"2024-09-17T05:28:46.660820+0000","last_undegraded":"2024-09-17T05:28:46.660820+0000","last_fullsized":"2024-09-17T05:28:46.660820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:47.532792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862177+0000","last_change":"2024-09-17T05:28:45.686654+0000","last_active":"2024-09-17T05:28:46.862177+0000","last_peered":"2024-09-17T05:28:46.862177+0000","last_clean":"2024-09-17T05:28:46.862177+0000","last_became_active":"2024-09-17T05:28:45.686315+0000","last_became_peered":"2024-09-17T05:28:45.686315+0000","last_unstale":"2024-09-17T05:28:46.862177+0000","last_undegraded":"2024-09-17T05:28:46.862177+0000","last_fullsized":"2024-09-17T05:28:46.862177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.777428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.693162+0000","last_change":"2024-09-17T05:28:45.696244+0000","last_active":"2024-09-17T05:28:46.693162+0000","last_peered":"2024-09-17T05:28:46.693162+0000","last_clean":"2024-09-17T05:28:46.693162+0000","last_became_active":"2024-09-17T05:28:45.695996+0000","last_became_peered":"2024-09-17T05:28:45.695996+0000","last_unstale":"2024-09-17T05:28:46.693162+0000","last_undegraded":"2024-09-17T05:28:46.693162+0000","last_fullsized":"2024-09-17T05:28:46.693162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:21.659738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688428+0000","last_change":"2024-09-17T05:28:45.672165+0000","last_active":"2024-09-17T05:28:46.688428+0000","last_peered":"2024-09-17T05:28:46.688428+0000","last_clean":"2024-09-17T05:28:46.688428+0000","last_became_active":"2024-09-17T05:28:45.671847+0000","last_became_peered":"2024-09-17T05:28:45.671847+0000","last_unstale":"2024-09-17T05:28:46.688428+0000","last_undegraded":"2024-09-17T05:28:46.688428+0000","last_fullsized":"2024-09-17T05:28:46.688428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:33.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861906+0000","last_change":"2024-09-17T05:28:45.685316+0000","last_active":"2024-09-17T05:28:46.861906+0000","last_peered":"2024-09-17T05:28:46.861906+0000","last_clean":"2024-09-17T05:28:46.861906+0000","last_became_active":"2024-09-17T05:28:45.684897+0000","last_became_peered":"2024-09-17T05:28:45.684897+0000","last_unstale":"2024-09-17T05:28:46.861906+0000","last_undegraded":"2024-09-17T05:28:46.861906+0000","last_fullsized":"2024-09-17T05:28:46.861906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:09.347060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862091+0000","last_change":"2024-09-17T05:28:45.686073+0000","last_active":"2024-09-17T05:28:46.862091+0000","last_peered":"2024-09-17T05:28:46.862091+0000","last_clean":"2024-09-17T05:28:46.862091+0000","last_became_active":"2024-09-17T05:28:45.685807+0000","last_became_peered":"2024-09-17T05:28:45.685807+0000","last_unstale":"2024-09-17T05:28:46.862091+0000","last_undegraded":"2024-09-17T05:28:46.862091+0000","last_fullsized":"2024-09-17T05:28:46.862091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:16.599698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661110+0000","last_change":"2024-09-17T05:28:45.671925+0000","last_active":"2024-09-17T05:28:46.661110+0000","last_peered":"2024-09-17T05:28:46.661110+0000","last_clean":"2024-09-17T05:28:46.661110+0000","last_became_active":"2024-09-17T05:28:45.671678+0000","last_became_peered":"2024-09-17T05:28:45.671678+0000","last_unstale":"2024-09-17T05:28:46.661110+0000","last_undegraded":"2024-09-17T05:28:46.661110+0000","last_fullsized":"2024-09-17T05:28:46.661110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:42.029278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654148+0000","last_change":"2024-09-17T05:28:45.671512+0000","last_active":"2024-09-17T05:28:46.654148+0000","last_peered":"2024-09-17T05:28:46.654148+0000","last_clean":"2024-09-17T05:28:46.654148+0000","last_became_active":"2024-09-17T05:28:45.671206+0000","last_became_peered":"2024-09-17T05:28:45.671206+0000","last_unstale":"2024-09-17T05:28:46.654148+0000","last_undegraded":"2024-09-17T05:28:46.654148+0000","last_fullsized":"2024-09-17T05:28:46.654148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:49.061509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692663+0000","last_change":"2024-09-17T05:28:45.691716+0000","last_active":"2024-09-17T05:28:46.692663+0000","last_peered":"2024-09-17T05:28:46.692663+0000","last_clean":"2024-09-17T05:28:46.692663+0000","last_became_active":"2024-09-17T05:28:45.691437+0000","last_became_peered":"2024-09-17T05:28:45.691437+0000","last_unstale":"2024-09-17T05:28:46.692663+0000","last_undegraded":"2024-09-17T05:28:46.692663+0000","last_fullsized":"2024-09-17T05:28:46.692663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:36.011098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659719+0000","last_change":"2024-09-17T05:28:45.668556+0000","last_active":"2024-09-17T05:28:46.659719+0000","last_peered":"2024-09-17T05:28:46.659719+0000","last_clean":"2024-09-17T05:28:46.659719+0000","last_became_active":"2024-09-17T05:28:45.667772+0000","last_became_peered":"2024-09-17T05:28:45.667772+0000","last_unstale":"2024-09-17T05:28:46.659719+0000","last_undegraded":"2024-09-17T05:28:46.659719+0000","last_fullsized":"2024-09-17T05:28:46.659719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:01.766360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861829+0000","last_change":"2024-09-17T05:28:44.657244+0000","last_active":"2024-09-17T05:28:46.861829+0000","last_peered":"2024-09-17T05:28:46.861829+0000","last_clean":"2024-09-17T05:28:46.861829+0000","last_became_active":"2024-09-17T05:28:44.656558+0000","last_became_peered":"2024-09-17T05:28:44.656558+0000","last_unstale":"2024-09-17T05:28:46.861829+0000","last_undegraded":"2024-09-17T05:28:46.861829+0000","last_fullsized":"2024-09-17T05:28:46.861829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:54.204227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862171+0000","last_change":"2024-09-17T05:28:45.661811+0000","last_active":"2024-09-17T05:28:46.862171+0000","last_peered":"2024-09-17T05:28:46.862171+0000","last_clean":"2024-09-17T05:28:46.862171+0000","last_became_active":"2024-09-17T05:28:45.659242+0000","last_became_peered":"2024-09-17T05:28:45.659242+0000","last_unstale":"2024-09-17T05:28:46.862171+0000","last_undegraded":"2024-09-17T05:28:46.862171+0000","last_fullsized":"2024-09-17T05:28:46.862171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:47.085346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692619+0000","last_change":"2024-09-17T05:28:44.660153+0000","last_active":"2024-09-17T05:28:46.692619+0000","last_peered":"2024-09-17T05:28:46.692619+0000","last_clean":"2024-09-17T05:28:46.692619+0000","last_became_active":"2024-09-17T05:28:44.658470+0000","last_became_peered":"2024-09-17T05:28:44.658470+0000","last_unstale":"2024-09-17T05:28:46.692619+0000","last_undegraded":"2024-09-17T05:28:46.692619+0000","last_fullsized":"2024-09-17T05:28:46.692619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:44.416180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861467+0000","last_change":"2024-09-17T05:28:44.665256+0000","last_active":"2024-09-17T05:28:46.861467+0000","last_peered":"2024-09-17T05:28:46.861467+0000","last_clean":"2024-09-17T05:28:46.861467+0000","last_became_active":"2024-09-17T05:28:44.664960+0000","last_became_peered":"2024-09-17T05:28:44.664960+0000","last_unstale":"2024-09-17T05:28:46.861467+0000","last_undegraded":"2024-09-17T05:28:46.861467+0000","last_fullsized":"2024-09-17T05:28:46.861467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:14.057015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861329+0000","last_change":"2024-09-17T05:28:45.673448+0000","last_active":"2024-09-17T05:28:46.861329+0000","last_peered":"2024-09-17T05:28:46.861329+0000","last_clean":"2024-09-17T05:28:46.861329+0000","last_became_active":"2024-09-17T05:28:45.670646+0000","last_became_peered":"2024-09-17T05:28:45.670646+0000","last_unstale":"2024-09-17T05:28:46.861329+0000","last_undegraded":"2024-09-17T05:28:46.861329+0000","last_fullsized":"2024-09-17T05:28:46.861329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:06.446649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660320+0000","last_change":"2024-09-17T05:28:44.659788+0000","last_active":"2024-09-17T05:28:46.660320+0000","last_peered":"2024-09-17T05:28:46.660320+0000","last_clean":"2024-09-17T05:28:46.660320+0000","last_became_active":"2024-09-17T05:28:44.657841+0000","last_became_peered":"2024-09-17T05:28:44.657841+0000","last_unstale":"2024-09-17T05:28:46.660320+0000","last_undegraded":"2024-09-17T05:28:46.660320+0000","last_fullsized":"2024-09-17T05:28:46.660320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:31.718118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688161+0000","last_change":"2024-09-17T05:28:45.673740+0000","last_active":"2024-09-17T05:28:46.688161+0000","last_peered":"2024-09-17T05:28:46.688161+0000","last_clean":"2024-09-17T05:28:46.688161+0000","last_became_active":"2024-09-17T05:28:45.671723+0000","last_became_peered":"2024-09-17T05:28:45.671723+0000","last_unstale":"2024-09-17T05:28:46.688161+0000","last_undegraded":"2024-09-17T05:28:46.688161+0000","last_fullsized":"2024-09-17T05:28:46.688161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:02:08.175874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692691+0000","last_change":"2024-09-17T05:28:44.659120+0000","last_active":"2024-09-17T05:28:46.692691+0000","last_peered":"2024-09-17T05:28:46.692691+0000","last_clean":"2024-09-17T05:28:46.692691+0000","last_became_active":"2024-09-17T05:28:44.658305+0000","last_became_peered":"2024-09-17T05:28:44.658305+0000","last_unstale":"2024-09-17T05:28:46.692691+0000","last_undegraded":"2024-09-17T05:28:46.692691+0000","last_fullsized":"2024-09-17T05:28:46.692691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:54.204227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660354+0000","last_change":"2024-09-17T05:28:45.682482+0000","last_active":"2024-09-17T05:28:46.660354+0000","last_peered":"2024-09-17T05:28:46.660354+0000","last_clean":"2024-09-17T05:28:46.660354+0000","last_became_active":"2024-09-17T05:28:45.682173+0000","last_became_peered":"2024-09-17T05:28:45.682173+0000","last_unstale":"2024-09-17T05:28:46.660354+0000","last_undegraded":"2024-09-17T05:28:46.660354+0000","last_fullsized":"2024-09-17T05:28:46.660354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:49.488039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660472+0000","last_change":"2024-09-17T05:28:44.660933+0000","last_active":"2024-09-17T05:28:46.660472+0000","last_peered":"2024-09-17T05:28:46.660472+0000","last_clean":"2024-09-17T05:28:46.660472+0000","last_became_active":"2024-09-17T05:28:44.660651+0000","last_became_peered":"2024-09-17T05:28:44.660651+0000","last_unstale":"2024-09-17T05:28:46.660472+0000","last_undegraded":"2024-09-17T05:28:46.660472+0000","last_fullsized":"2024-09-17T05:28:46.660472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:07.374786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862562+0000","last_change":"2024-09-17T05:28:45.680416+0000","last_active":"2024-09-17T05:28:46.862562+0000","last_peered":"2024-09-17T05:28:46.862562+0000","last_clean":"2024-09-17T05:28:46.862562+0000","last_became_active":"2024-09-17T05:28:45.676745+0000","last_became_peered":"2024-09-17T05:28:45.676745+0000","last_unstale":"2024-09-17T05:28:46.862562+0000","last_undegraded":"2024-09-17T05:28:46.862562+0000","last_fullsized":"2024-09-17T05:28:46.862562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:26.799851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688387+0000","last_change":"2024-09-17T05:28:44.658749+0000","last_active":"2024-09-17T05:28:46.688387+0000","last_peered":"2024-09-17T05:28:46.688387+0000","last_clean":"2024-09-17T05:28:46.688387+0000","last_became_active":"2024-09-17T05:28:44.658422+0000","last_became_peered":"2024-09-17T05:28:44.658422+0000","last_unstale":"2024-09-17T05:28:46.688387+0000","last_undegraded":"2024-09-17T05:28:46.688387+0000","last_fullsized":"2024-09-17T05:28:46.688387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:44.416180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660498+0000","last_change":"2024-09-17T05:28:45.679934+0000","last_active":"2024-09-17T05:28:46.660498+0000","last_peered":"2024-09-17T05:28:46.660498+0000","last_clean":"2024-09-17T05:28:46.660498+0000","last_became_active":"2024-09-17T05:28:45.679532+0000","last_became_peered":"2024-09-17T05:28:45.679532+0000","last_unstale":"2024-09-17T05:28:46.660498+0000","last_undegraded":"2024-09-17T05:28:46.660498+0000","last_fullsized":"2024-09-17T05:28:46.660498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:02.631947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692603+0000","last_change":"2024-09-17T05:28:44.670793+0000","last_active":"2024-09-17T05:28:46.692603+0000","last_peered":"2024-09-17T05:28:46.692603+0000","last_clean":"2024-09-17T05:28:46.692603+0000","last_became_active":"2024-09-17T05:28:44.670483+0000","last_became_peered":"2024-09-17T05:28:44.670483+0000","last_unstale":"2024-09-17T05:28:46.692603+0000","last_undegraded":"2024-09-17T05:28:46.692603+0000","last_fullsized":"2024-09-17T05:28:46.692603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:56.605556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863123+0000","last_change":"2024-09-17T05:28:45.676170+0000","last_active":"2024-09-17T05:28:46.863123+0000","last_peered":"2024-09-17T05:28:46.863123+0000","last_clean":"2024-09-17T05:28:46.863123+0000","last_became_active":"2024-09-17T05:28:45.675349+0000","last_became_peered":"2024-09-17T05:28:45.675349+0000","last_unstale":"2024-09-17T05:28:46.863123+0000","last_undegraded":"2024-09-17T05:28:46.863123+0000","last_fullsized":"2024-09-17T05:28:46.863123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:25.988668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862160+0000","last_change":"2024-09-17T05:28:44.656355+0000","last_active":"2024-09-17T05:28:46.862160+0000","last_peered":"2024-09-17T05:28:46.862160+0000","last_clean":"2024-09-17T05:28:46.862160+0000","last_became_active":"2024-09-17T05:28:44.656064+0000","last_became_peered":"2024-09-17T05:28:44.656064+0000","last_unstale":"2024-09-17T05:28:46.862160+0000","last_undegraded":"2024-09-17T05:28:46.862160+0000","last_fullsized":"2024-09-17T05:28:46.862160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:00:37.731866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861989+0000","last_change":"2024-09-17T05:28:45.683802+0000","last_active":"2024-09-17T05:28:46.861989+0000","last_peered":"2024-09-17T05:28:46.861989+0000","last_clean":"2024-09-17T05:28:46.861989+0000","last_became_active":"2024-09-17T05:28:45.681514+0000","last_became_peered":"2024-09-17T05:28:45.681514+0000","last_unstale":"2024-09-17T05:28:46.861989+0000","last_undegraded":"2024-09-17T05:28:46.861989+0000","last_fullsized":"2024-09-17T05:28:46.861989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:03.269669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661166+0000","last_change":"2024-09-17T05:28:44.666923+0000","last_active":"2024-09-17T05:28:46.661166+0000","last_peered":"2024-09-17T05:28:46.661166+0000","last_clean":"2024-09-17T05:28:46.661166+0000","last_became_active":"2024-09-17T05:28:44.663304+0000","last_became_peered":"2024-09-17T05:28:44.663304+0000","last_unstale":"2024-09-17T05:28:46.661166+0000","last_undegraded":"2024-09-17T05:28:46.661166+0000","last_fullsized":"2024-09-17T05:28:46.661166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:39.859160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863074+0000","last_change":"2024-09-17T05:28:45.690781+0000","last_active":"2024-09-17T05:28:46.863074+0000","last_peered":"2024-09-17T05:28:46.863074+0000","last_clean":"2024-09-17T05:28:46.863074+0000","last_became_active":"2024-09-17T05:28:45.690510+0000","last_became_peered":"2024-09-17T05:28:45.690510+0000","last_unstale":"2024-09-17T05:28:46.863074+0000","last_undegraded":"2024-09-17T05:28:46.863074+0000","last_fullsized":"2024-09-17T05:28:46.863074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:23.217463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692449+0000","last_change":"2024-09-17T05:28:44.659293+0000","last_active":"2024-09-17T05:28:46.692449+0000","last_peered":"2024-09-17T05:28:46.692449+0000","last_clean":"2024-09-17T05:28:46.692449+0000","last_became_active":"2024-09-17T05:28:44.658946+0000","last_became_peered":"2024-09-17T05:28:44.658946+0000","last_unstale":"2024-09-17T05:28:46.692449+0000","last_undegraded":"2024-09-17T05:28:46.692449+0000","last_fullsized":"2024-09-17T05:28:46.692449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:17.828856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692995+0000","last_change":"2024-09-17T05:28:45.686933+0000","last_active":"2024-09-17T05:28:46.692995+0000","last_peered":"2024-09-17T05:28:46.692995+0000","last_clean":"2024-09-17T05:28:46.692995+0000","last_became_active":"2024-09-17T05:28:45.686604+0000","last_became_peered":"2024-09-17T05:28:45.686604+0000","last_unstale":"2024-09-17T05:28:46.692995+0000","last_undegraded":"2024-09-17T05:28:46.692995+0000","last_fullsized":"2024-09-17T05:28:46.692995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:33.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.653948+0000","last_change":"2024-09-17T05:28:44.659167+0000","last_active":"2024-09-17T05:28:46.653948+0000","last_peered":"2024-09-17T05:28:46.653948+0000","last_clean":"2024-09-17T05:28:46.653948+0000","last_became_active":"2024-09-17T05:28:44.658804+0000","last_became_peered":"2024-09-17T05:28:44.658804+0000","last_unstale":"2024-09-17T05:28:46.653948+0000","last_undegraded":"2024-09-17T05:28:46.653948+0000","last_fullsized":"2024-09-17T05:28:46.653948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:50.304488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862798+0000","last_change":"2024-09-17T05:28:45.688426+0000","last_active":"2024-09-17T05:28:46.862798+0000","last_peered":"2024-09-17T05:28:46.862798+0000","last_clean":"2024-09-17T05:28:46.862798+0000","last_became_active":"2024-09-17T05:28:45.688100+0000","last_became_peered":"2024-09-17T05:28:45.688100+0000","last_unstale":"2024-09-17T05:28:46.862798+0000","last_undegraded":"2024-09-17T05:28:46.862798+0000","last_fullsized":"2024-09-17T05:28:46.862798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:11.277486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660737+0000","last_change":"2024-09-17T05:28:44.662254+0000","last_active":"2024-09-17T05:28:46.660737+0000","last_peered":"2024-09-17T05:28:46.660737+0000","last_clean":"2024-09-17T05:28:46.660737+0000","last_became_active":"2024-09-17T05:28:44.659880+0000","last_became_peered":"2024-09-17T05:28:44.659880+0000","last_unstale":"2024-09-17T05:28:46.660737+0000","last_undegraded":"2024-09-17T05:28:46.660737+0000","last_fullsized":"2024-09-17T05:28:46.660737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:54.102764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863300+0000","last_change":"2024-09-17T05:28:45.693962+0000","last_active":"2024-09-17T05:28:46.863300+0000","last_peered":"2024-09-17T05:28:46.863300+0000","last_clean":"2024-09-17T05:28:46.863300+0000","last_became_active":"2024-09-17T05:28:45.693641+0000","last_became_peered":"2024-09-17T05:28:45.693641+0000","last_unstale":"2024-09-17T05:28:46.863300+0000","last_undegraded":"2024-09-17T05:28:46.863300+0000","last_fullsized":"2024-09-17T05:28:46.863300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:12.085165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654313+0000","last_change":"2024-09-17T05:28:44.657506+0000","last_active":"2024-09-17T05:28:46.654313+0000","last_peered":"2024-09-17T05:28:46.654313+0000","last_clean":"2024-09-17T05:28:46.654313+0000","last_became_active":"2024-09-17T05:28:44.653791+0000","last_became_peered":"2024-09-17T05:28:44.653791+0000","last_unstale":"2024-09-17T05:28:46.654313+0000","last_undegraded":"2024-09-17T05:28:46.654313+0000","last_fullsized":"2024-09-17T05:28:46.654313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:24.655736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863392+0000","last_change":"2024-09-17T05:28:45.684936+0000","last_active":"2024-09-17T05:28:46.863392+0000","last_peered":"2024-09-17T05:28:46.863392+0000","last_clean":"2024-09-17T05:28:46.863392+0000","last_became_active":"2024-09-17T05:28:45.684661+0000","last_became_peered":"2024-09-17T05:28:45.684661+0000","last_unstale":"2024-09-17T05:28:46.863392+0000","last_undegraded":"2024-09-17T05:28:46.863392+0000","last_fullsized":"2024-09-17T05:28:46.863392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:11.266932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688447+0000","last_change":"2024-09-17T05:28:44.659661+0000","last_active":"2024-09-17T05:28:46.688447+0000","last_peered":"2024-09-17T05:28:46.688447+0000","last_clean":"2024-09-17T05:28:46.688447+0000","last_became_active":"2024-09-17T05:28:44.659296+0000","last_became_peered":"2024-09-17T05:28:44.659296+0000","last_unstale":"2024-09-17T05:28:46.688447+0000","last_undegraded":"2024-09-17T05:28:46.688447+0000","last_fullsized":"2024-09-17T05:28:46.688447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:54.204227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660529+0000","last_change":"2024-09-17T05:28:45.689026+0000","last_active":"2024-09-17T05:28:46.660529+0000","last_peered":"2024-09-17T05:28:46.660529+0000","last_clean":"2024-09-17T05:28:46.660529+0000","last_became_active":"2024-09-17T05:28:45.688756+0000","last_became_peered":"2024-09-17T05:28:45.688756+0000","last_unstale":"2024-09-17T05:28:46.660529+0000","last_undegraded":"2024-09-17T05:28:46.660529+0000","last_fullsized":"2024-09-17T05:28:46.660529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:51.339078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654198+0000","last_change":"2024-09-17T05:28:44.657464+0000","last_active":"2024-09-17T05:28:46.654198+0000","last_peered":"2024-09-17T05:28:46.654198+0000","last_clean":"2024-09-17T05:28:46.654198+0000","last_became_active":"2024-09-17T05:28:44.654450+0000","last_became_peered":"2024-09-17T05:28:44.654450+0000","last_unstale":"2024-09-17T05:28:46.654198+0000","last_undegraded":"2024-09-17T05:28:46.654198+0000","last_fullsized":"2024-09-17T05:28:46.654198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:42.638974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863210+0000","last_change":"2024-09-17T05:28:45.676934+0000","last_active":"2024-09-17T05:28:46.863210+0000","last_peered":"2024-09-17T05:28:46.863210+0000","last_clean":"2024-09-17T05:28:46.863210+0000","last_became_active":"2024-09-17T05:28:45.676633+0000","last_became_peered":"2024-09-17T05:28:45.676633+0000","last_unstale":"2024-09-17T05:28:46.863210+0000","last_undegraded":"2024-09-17T05:28:46.863210+0000","last_fullsized":"2024-09-17T05:28:46.863210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:24.636305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862638+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:28:46.862638+0000","last_peered":"2024-09-17T05:28:46.862638+0000","last_clean":"2024-09-17T05:28:46.862638+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:28:46.862638+0000","last_undegraded":"2024-09-17T05:28:46.862638+0000","last_fullsized":"2024-09-17T05:28:46.862638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659979+0000","last_change":"2024-09-17T05:28:44.655816+0000","last_active":"2024-09-17T05:28:46.659979+0000","last_peered":"2024-09-17T05:28:46.659979+0000","last_clean":"2024-09-17T05:28:46.659979+0000","last_became_active":"2024-09-17T05:28:44.655528+0000","last_became_peered":"2024-09-17T05:28:44.655528+0000","last_unstale":"2024-09-17T05:28:46.659979+0000","last_undegraded":"2024-09-17T05:28:46.659979+0000","last_fullsized":"2024-09-17T05:28:46.659979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:53.370296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861881+0000","last_change":"2024-09-17T05:28:45.678111+0000","last_active":"2024-09-17T05:28:46.861881+0000","last_peered":"2024-09-17T05:28:46.861881+0000","last_clean":"2024-09-17T05:28:46.861881+0000","last_became_active":"2024-09-17T05:28:45.677828+0000","last_became_peered":"2024-09-17T05:28:45.677828+0000","last_unstale":"2024-09-17T05:28:46.861881+0000","last_undegraded":"2024-09-17T05:28:46.861881+0000","last_fullsized":"2024-09-17T05:28:46.861881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:35.611079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862512+0000","last_change":"2024-09-17T05:28:44.665338+0000","last_active":"2024-09-17T05:28:46.862512+0000","last_peered":"2024-09-17T05:28:46.862512+0000","last_clean":"2024-09-17T05:28:46.862512+0000","last_became_active":"2024-09-17T05:28:44.665066+0000","last_became_peered":"2024-09-17T05:28:44.665066+0000","last_unstale":"2024-09-17T05:28:46.862512+0000","last_undegraded":"2024-09-17T05:28:46.862512+0000","last_fullsized":"2024-09-17T05:28:46.862512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:57.978737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861309+0000","last_change":"2024-09-17T05:28:45.670679+0000","last_active":"2024-09-17T05:28:46.861309+0000","last_peered":"2024-09-17T05:28:46.861309+0000","last_clean":"2024-09-17T05:28:46.861309+0000","last_became_active":"2024-09-17T05:28:45.670385+0000","last_became_peered":"2024-09-17T05:28:45.670385+0000","last_unstale":"2024-09-17T05:28:46.861309+0000","last_undegraded":"2024-09-17T05:28:46.861309+0000","last_fullsized":"2024-09-17T05:28:46.861309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:56.353907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654167+0000","last_change":"2024-09-17T05:28:44.656799+0000","last_active":"2024-09-17T05:28:46.654167+0000","last_peered":"2024-09-17T05:28:46.654167+0000","last_clean":"2024-09-17T05:28:46.654167+0000","last_became_active":"2024-09-17T05:28:44.653919+0000","last_became_peered":"2024-09-17T05:28:44.653919+0000","last_unstale":"2024-09-17T05:28:46.654167+0000","last_undegraded":"2024-09-17T05:28:46.654167+0000","last_fullsized":"2024-09-17T05:28:46.654167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:00.756226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688170+0000","last_change":"2024-09-17T05:28:45.680508+0000","last_active":"2024-09-17T05:28:46.688170+0000","last_peered":"2024-09-17T05:28:46.688170+0000","last_clean":"2024-09-17T05:28:46.688170+0000","last_became_active":"2024-09-17T05:28:45.680228+0000","last_became_peered":"2024-09-17T05:28:45.680228+0000","last_unstale":"2024-09-17T05:28:46.688170+0000","last_undegraded":"2024-09-17T05:28:46.688170+0000","last_fullsized":"2024-09-17T05:28:46.688170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:00.494429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661173+0000","last_change":"2024-09-17T05:28:44.659616+0000","last_active":"2024-09-17T05:28:46.661173+0000","last_peered":"2024-09-17T05:28:46.661173+0000","last_clean":"2024-09-17T05:28:46.661173+0000","last_became_active":"2024-09-17T05:28:44.659315+0000","last_became_peered":"2024-09-17T05:28:44.659315+0000","last_unstale":"2024-09-17T05:28:46.661173+0000","last_undegraded":"2024-09-17T05:28:46.661173+0000","last_fullsized":"2024-09-17T05:28:46.661173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:01.383128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659953+0000","last_change":"2024-09-17T05:28:45.667308+0000","last_active":"2024-09-17T05:28:46.659953+0000","last_peered":"2024-09-17T05:28:46.659953+0000","last_clean":"2024-09-17T05:28:46.659953+0000","last_became_active":"2024-09-17T05:28:45.665085+0000","last_became_peered":"2024-09-17T05:28:45.665085+0000","last_unstale":"2024-09-17T05:28:46.659953+0000","last_undegraded":"2024-09-17T05:28:46.659953+0000","last_fullsized":"2024-09-17T05:28:46.659953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:35.749778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688240+0000","last_change":"2024-09-17T05:28:44.664461+0000","last_active":"2024-09-17T05:28:46.688240+0000","last_peered":"2024-09-17T05:28:46.688240+0000","last_clean":"2024-09-17T05:28:46.688240+0000","last_became_active":"2024-09-17T05:28:44.663124+0000","last_became_peered":"2024-09-17T05:28:44.663124+0000","last_unstale":"2024-09-17T05:28:46.688240+0000","last_undegraded":"2024-09-17T05:28:46.688240+0000","last_fullsized":"2024-09-17T05:28:46.688240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:56.605556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660901+0000","last_change":"2024-09-17T05:28:45.673340+0000","last_active":"2024-09-17T05:28:46.660901+0000","last_peered":"2024-09-17T05:28:46.660901+0000","last_clean":"2024-09-17T05:28:46.660901+0000","last_became_active":"2024-09-17T05:28:45.673047+0000","last_became_peered":"2024-09-17T05:28:45.673047+0000","last_unstale":"2024-09-17T05:28:46.660901+0000","last_undegraded":"2024-09-17T05:28:46.660901+0000","last_fullsized":"2024-09-17T05:28:46.660901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:21.863500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863309+0000","last_change":"2024-09-17T05:28:44.668483+0000","last_active":"2024-09-17T05:28:46.863309+0000","last_peered":"2024-09-17T05:28:46.863309+0000","last_clean":"2024-09-17T05:28:46.863309+0000","last_became_active":"2024-09-17T05:28:44.668063+0000","last_became_peered":"2024-09-17T05:28:44.668063+0000","last_unstale":"2024-09-17T05:28:46.863309+0000","last_undegraded":"2024-09-17T05:28:46.863309+0000","last_fullsized":"2024-09-17T05:28:46.863309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:03.222463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688247+0000","last_change":"2024-09-17T05:28:45.666361+0000","last_active":"2024-09-17T05:28:46.688247+0000","last_peered":"2024-09-17T05:28:46.688247+0000","last_clean":"2024-09-17T05:28:46.688247+0000","last_became_active":"2024-09-17T05:28:45.666003+0000","last_became_peered":"2024-09-17T05:28:45.666003+0000","last_unstale":"2024-09-17T05:28:46.688247+0000","last_undegraded":"2024-09-17T05:28:46.688247+0000","last_fullsized":"2024-09-17T05:28:46.688247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:43.813385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688447+0000","last_change":"2024-09-17T05:28:44.663175+0000","last_active":"2024-09-17T05:28:46.688447+0000","last_peered":"2024-09-17T05:28:46.688447+0000","last_clean":"2024-09-17T05:28:46.688447+0000","last_became_active":"2024-09-17T05:28:44.662839+0000","last_became_peered":"2024-09-17T05:28:44.662839+0000","last_unstale":"2024-09-17T05:28:46.688447+0000","last_undegraded":"2024-09-17T05:28:46.688447+0000","last_fullsized":"2024-09-17T05:28:46.688447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:14.858019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862188+0000","last_change":"2024-09-17T05:28:45.683844+0000","last_active":"2024-09-17T05:28:46.862188+0000","last_peered":"2024-09-17T05:28:46.862188+0000","last_clean":"2024-09-17T05:28:46.862188+0000","last_became_active":"2024-09-17T05:28:45.683527+0000","last_became_peered":"2024-09-17T05:28:45.683527+0000","last_unstale":"2024-09-17T05:28:46.862188+0000","last_undegraded":"2024-09-17T05:28:46.862188+0000","last_fullsized":"2024-09-17T05:28:46.862188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:11.277486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692809+0000","last_change":"2024-09-17T05:28:44.671021+0000","last_active":"2024-09-17T05:28:46.692809+0000","last_peered":"2024-09-17T05:28:46.692809+0000","last_clean":"2024-09-17T05:28:46.692809+0000","last_became_active":"2024-09-17T05:28:44.666107+0000","last_became_peered":"2024-09-17T05:28:44.666107+0000","last_unstale":"2024-09-17T05:28:46.692809+0000","last_undegraded":"2024-09-17T05:28:46.692809+0000","last_fullsized":"2024-09-17T05:28:46.692809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:57.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862563+0000","last_change":"2024-09-17T05:28:45.669543+0000","last_active":"2024-09-17T05:28:46.862563+0000","last_peered":"2024-09-17T05:28:46.862563+0000","last_clean":"2024-09-17T05:28:46.862563+0000","last_became_active":"2024-09-17T05:28:45.669258+0000","last_became_peered":"2024-09-17T05:28:45.669258+0000","last_unstale":"2024-09-17T05:28:46.862563+0000","last_undegraded":"2024-09-17T05:28:46.862563+0000","last_fullsized":"2024-09-17T05:28:46.862563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:29.130107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862503+0000","last_change":"2024-09-17T05:28:44.669157+0000","last_active":"2024-09-17T05:28:46.862503+0000","last_peered":"2024-09-17T05:28:46.862503+0000","last_clean":"2024-09-17T05:28:46.862503+0000","last_became_active":"2024-09-17T05:28:44.668464+0000","last_became_peered":"2024-09-17T05:28:44.668464+0000","last_unstale":"2024-09-17T05:28:46.862503+0000","last_undegraded":"2024-09-17T05:28:46.862503+0000","last_fullsized":"2024-09-17T05:28:46.862503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:27.326210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659841+0000","last_change":"2024-09-17T05:28:45.667885+0000","last_active":"2024-09-17T05:28:46.659841+0000","last_peered":"2024-09-17T05:28:46.659841+0000","last_clean":"2024-09-17T05:28:46.659841+0000","last_became_active":"2024-09-17T05:28:45.666920+0000","last_became_peered":"2024-09-17T05:28:45.666920+0000","last_unstale":"2024-09-17T05:28:46.659841+0000","last_undegraded":"2024-09-17T05:28:46.659841+0000","last_fullsized":"2024-09-17T05:28:46.659841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:25.665870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688240+0000","last_change":"2024-09-17T05:28:44.665516+0000","last_active":"2024-09-17T05:28:46.688240+0000","last_peered":"2024-09-17T05:28:46.688240+0000","last_clean":"2024-09-17T05:28:46.688240+0000","last_became_active":"2024-09-17T05:28:44.665205+0000","last_became_peered":"2024-09-17T05:28:44.665205+0000","last_unstale":"2024-09-17T05:28:46.688240+0000","last_undegraded":"2024-09-17T05:28:46.688240+0000","last_fullsized":"2024-09-17T05:28:46.688240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:57.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861431+0000","last_change":"2024-09-17T05:28:45.674698+0000","last_active":"2024-09-17T05:28:46.861431+0000","last_peered":"2024-09-17T05:28:46.861431+0000","last_clean":"2024-09-17T05:28:46.861431+0000","last_became_active":"2024-09-17T05:28:45.671117+0000","last_became_peered":"2024-09-17T05:28:45.671117+0000","last_unstale":"2024-09-17T05:28:46.861431+0000","last_undegraded":"2024-09-17T05:28:46.861431+0000","last_fullsized":"2024-09-17T05:28:46.861431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:34.701781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688163+0000","last_change":"2024-09-17T05:28:44.662000+0000","last_active":"2024-09-17T05:28:46.688163+0000","last_peered":"2024-09-17T05:28:46.688163+0000","last_clean":"2024-09-17T05:28:46.688163+0000","last_became_active":"2024-09-17T05:28:44.661699+0000","last_became_peered":"2024-09-17T05:28:44.661699+0000","last_unstale":"2024-09-17T05:28:46.688163+0000","last_undegraded":"2024-09-17T05:28:46.688163+0000","last_fullsized":"2024-09-17T05:28:46.688163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:57.978737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861824+0000","last_change":"2024-09-17T05:28:45.682448+0000","last_active":"2024-09-17T05:28:46.861824+0000","last_peered":"2024-09-17T05:28:46.861824+0000","last_clean":"2024-09-17T05:28:46.861824+0000","last_became_active":"2024-09-17T05:28:45.682109+0000","last_became_peered":"2024-09-17T05:28:45.682109+0000","last_unstale":"2024-09-17T05:28:46.861824+0000","last_undegraded":"2024-09-17T05:28:46.861824+0000","last_fullsized":"2024-09-17T05:28:46.861824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:44.301995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863028+0000","last_change":"2024-09-17T05:28:44.668065+0000","last_active":"2024-09-17T05:28:46.863028+0000","last_peered":"2024-09-17T05:28:46.863028+0000","last_clean":"2024-09-17T05:28:46.863028+0000","last_became_active":"2024-09-17T05:28:44.667735+0000","last_became_peered":"2024-09-17T05:28:44.667735+0000","last_unstale":"2024-09-17T05:28:46.863028+0000","last_undegraded":"2024-09-17T05:28:46.863028+0000","last_fullsized":"2024-09-17T05:28:46.863028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:28.072242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692822+0000","last_change":"2024-09-17T05:28:45.688653+0000","last_active":"2024-09-17T05:28:46.692822+0000","last_peered":"2024-09-17T05:28:46.692822+0000","last_clean":"2024-09-17T05:28:46.692822+0000","last_became_active":"2024-09-17T05:28:45.687995+0000","last_became_peered":"2024-09-17T05:28:45.687995+0000","last_unstale":"2024-09-17T05:28:46.692822+0000","last_undegraded":"2024-09-17T05:28:46.692822+0000","last_fullsized":"2024-09-17T05:28:46.692822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:00.494429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660675+0000","last_change":"2024-09-17T05:28:45.674640+0000","last_active":"2024-09-17T05:28:46.660675+0000","last_peered":"2024-09-17T05:28:46.660675+0000","last_clean":"2024-09-17T05:28:46.660675+0000","last_became_active":"2024-09-17T05:28:45.674375+0000","last_became_peered":"2024-09-17T05:28:45.674375+0000","last_unstale":"2024-09-17T05:28:46.660675+0000","last_undegraded":"2024-09-17T05:28:46.660675+0000","last_fullsized":"2024-09-17T05:28:46.660675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:48.986140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862772+0000","last_change":"2024-09-17T05:28:44.668500+0000","last_active":"2024-09-17T05:28:46.862772+0000","last_peered":"2024-09-17T05:28:46.862772+0000","last_clean":"2024-09-17T05:28:46.862772+0000","last_became_active":"2024-09-17T05:28:44.668171+0000","last_became_peered":"2024-09-17T05:28:44.668171+0000","last_unstale":"2024-09-17T05:28:46.862772+0000","last_undegraded":"2024-09-17T05:28:46.862772+0000","last_fullsized":"2024-09-17T05:28:46.862772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:05.964906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660309+0000","last_change":"2024-09-17T05:28:45.675119+0000","last_active":"2024-09-17T05:28:46.660309+0000","last_peered":"2024-09-17T05:28:46.660309+0000","last_clean":"2024-09-17T05:28:46.660309+0000","last_became_active":"2024-09-17T05:28:45.674840+0000","last_became_peered":"2024-09-17T05:28:45.674840+0000","last_unstale":"2024-09-17T05:28:46.660309+0000","last_undegraded":"2024-09-17T05:28:46.660309+0000","last_fullsized":"2024-09-17T05:28:46.660309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:26.709674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863195+0000","last_change":"2024-09-17T05:28:44.671103+0000","last_active":"2024-09-17T05:28:46.863195+0000","last_peered":"2024-09-17T05:28:46.863195+0000","last_clean":"2024-09-17T05:28:46.863195+0000","last_became_active":"2024-09-17T05:28:44.670755+0000","last_became_peered":"2024-09-17T05:28:44.670755+0000","last_unstale":"2024-09-17T05:28:46.863195+0000","last_undegraded":"2024-09-17T05:28:46.863195+0000","last_fullsized":"2024-09-17T05:28:46.863195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:14.858019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862459+0000","last_change":"2024-09-17T05:28:45.677087+0000","last_active":"2024-09-17T05:28:46.862459+0000","last_peered":"2024-09-17T05:28:46.862459+0000","last_clean":"2024-09-17T05:28:46.862459+0000","last_became_active":"2024-09-17T05:28:45.676750+0000","last_became_peered":"2024-09-17T05:28:45.676750+0000","last_unstale":"2024-09-17T05:28:46.862459+0000","last_undegraded":"2024-09-17T05:28:46.862459+0000","last_fullsized":"2024-09-17T05:28:46.862459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:14.581812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862014+0000","last_change":"2024-09-17T05:28:44.654538+0000","last_active":"2024-09-17T05:28:46.862014+0000","last_peered":"2024-09-17T05:28:46.862014+0000","last_clean":"2024-09-17T05:28:46.862014+0000","last_became_active":"2024-09-17T05:28:44.654264+0000","last_became_peered":"2024-09-17T05:28:44.654264+0000","last_unstale":"2024-09-17T05:28:46.862014+0000","last_undegraded":"2024-09-17T05:28:46.862014+0000","last_fullsized":"2024-09-17T05:28:46.862014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:57.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861779+0000","last_change":"2024-09-17T05:28:45.697637+0000","last_active":"2024-09-17T05:28:46.861779+0000","last_peered":"2024-09-17T05:28:46.861779+0000","last_clean":"2024-09-17T05:28:46.861779+0000","last_became_active":"2024-09-17T05:28:45.697328+0000","last_became_peered":"2024-09-17T05:28:45.697328+0000","last_unstale":"2024-09-17T05:28:46.861779+0000","last_undegraded":"2024-09-17T05:28:46.861779+0000","last_fullsized":"2024-09-17T05:28:46.861779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:44.608081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862559+0000","last_change":"2024-09-17T05:28:44.666526+0000","last_active":"2024-09-17T05:28:46.862559+0000","last_peered":"2024-09-17T05:28:46.862559+0000","last_clean":"2024-09-17T05:28:46.862559+0000","last_became_active":"2024-09-17T05:28:44.666209+0000","last_became_peered":"2024-09-17T05:28:44.666209+0000","last_unstale":"2024-09-17T05:28:46.862559+0000","last_undegraded":"2024-09-17T05:28:46.862559+0000","last_fullsized":"2024-09-17T05:28:46.862559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:50.431079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":663137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":72313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":72187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":663193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:28:54.834 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:28:54.834 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-17T05:28:54.835 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T05:28:55.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.017+0000 7fa008600640 1 -- 172.21.15.31:0/3480170883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0000cdb30 msgr2=0x7fa0000cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:55.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.017+0000 7fa008600640 1 --2- 172.21.15.31:0/3480170883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0000cdb30 0x7fa0000cebb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009900 tx=0x7f9fec01c8e0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.017+0000 7fa008600640 1 -- 172.21.15.31:0/3480170883 shutdown_connections 2024-09-17T05:28:55.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.017+0000 7fa008600640 1 --2- 172.21.15.31:0/3480170883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0000cdb30 0x7fa0000cebb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.017+0000 7fa008600640 1 --2- 172.21.15.31:0/3480170883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa00015bea0 0x7fa0000ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.017+0000 7fa008600640 1 -- 172.21.15.31:0/3480170883 >> 172.21.15.31:0/3480170883 conn(0x7fa0000d1dc0 msgr2=0x7fa0000d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:55.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.017+0000 7fa008600640 1 -- 172.21.15.31:0/3480170883 shutdown_connections 2024-09-17T05:28:55.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.017+0000 7fa008600640 1 -- 172.21.15.31:0/3480170883 wait complete. 2024-09-17T05:28:55.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa008600640 1 Processor -- start 2024-09-17T05:28:55.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa008600640 1 -- start start 2024-09-17T05:28:55.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa008600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0000cdb30 0x7fa000157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:55.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa008600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0000d28e0 0x7fa0000b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:55.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa008600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa00015bea0 0x7fa0000caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa008600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa000168fc0 con 0x7fa0000cdb30 2024-09-17T05:28:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa008600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa000168e40 con 0x7fa00015bea0 2024-09-17T05:28:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa008600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa000169140 con 0x7fa0000d28e0 2024-09-17T05:28:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa005c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0000cdb30 0x7fa000157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa005c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0000cdb30 0x7fa000157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42038/0 (socket says 172.21.15.31:42038) 2024-09-17T05:28:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa005c00640 1 -- 172.21.15.31:0/2835896042 learned_addr learned my addr 172.21.15.31:0/2835896042 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa005200640 1 --2- 172.21.15.31:0/2835896042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0000d28e0 0x7fa0000b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa006600640 1 --2- 172.21.15.31:0/2835896042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa00015bea0 0x7fa0000caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa005c00640 1 -- 172.21.15.31:0/2835896042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0000d28e0 msgr2=0x7fa0000b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa005c00640 1 --2- 172.21.15.31:0/2835896042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0000d28e0 0x7fa0000b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa005c00640 1 -- 172.21.15.31:0/2835896042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa00015bea0 msgr2=0x7fa0000caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:55.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa005c00640 1 --2- 172.21.15.31:0/2835896042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa00015bea0 0x7fa0000caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa005c00640 1 -- 172.21.15.31:0/2835896042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0000b39a0 con 0x7fa0000cdb30 2024-09-17T05:28:55.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa005200640 1 --2- 172.21.15.31:0/2835896042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0000d28e0 0x7fa0000b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:28:55.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa005c00640 1 --2- 172.21.15.31:0/2835896042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0000cdb30 0x7fa000157e60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400d750 tx=0x7f9ff400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:55.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7f9ffd600640 1 -- 172.21.15.31:0/2835896042 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4017070 con 0x7fa0000cdb30 2024-09-17T05:28:55.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7f9ffd600640 1 -- 172.21.15.31:0/2835896042 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ff4009d20 con 0x7fa0000cdb30 2024-09-17T05:28:55.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7f9ffd600640 1 -- 172.21.15.31:0/2835896042 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff400de60 con 0x7fa0000cdb30 2024-09-17T05:28:55.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa008600640 1 -- 172.21.15.31:0/2835896042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0000b3c80 con 0x7fa0000cdb30 2024-09-17T05:28:55.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa008600640 1 -- 172.21.15.31:0/2835896042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0001583a0 con 0x7fa0000cdb30 2024-09-17T05:28:55.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.021+0000 7fa008600640 1 -- 172.21.15.31:0/2835896042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0000cc9d0 con 0x7fa0000cdb30 2024-09-17T05:28:55.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.025+0000 7f9ffd600640 1 -- 172.21.15.31:0/2835896042 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9ff4004280 con 0x7fa0000cdb30 2024-09-17T05:28:55.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.025+0000 7f9ffd600640 1 --2- 172.21.15.31:0/2835896042 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9fe0073200 0x7f9fe00756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:55.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.025+0000 7f9ffd600640 1 -- 172.21.15.31:0/2835896042 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9ff4094650 con 0x7fa0000cdb30 2024-09-17T05:28:55.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.025+0000 7fa005200640 1 --2- 172.21.15.31:0/2835896042 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9fe0073200 0x7f9fe00756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:55.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.025+0000 7fa005200640 1 --2- 172.21.15.31:0/2835896042 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9fe0073200 0x7f9fe00756c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0af000 tx=0x7f9fec01b120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:55.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.029+0000 7f9ffd600640 1 -- 172.21.15.31:0/2835896042 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9ff4020020 con 0x7fa0000cdb30 2024-09-17T05:28:55.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.209+0000 7fa008600640 1 -- 172.21.15.31:0/2835896042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fa00006d0b0 con 0x7fa0000cdb30 2024-09-17T05:28:55.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.209+0000 7f9ffd600640 1 -- 172.21.15.31:0/2835896042 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v27) ==== 86+0+160 (secure 0 0 0) 0x7f9ff405f6f0 con 0x7fa0000cdb30 2024-09-17T05:28:55.212 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:55.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.209+0000 7fa008600640 1 -- 172.21.15.31:0/2835896042 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9fe0073200 msgr2=0x7f9fe00756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:55.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.209+0000 7fa008600640 1 --2- 172.21.15.31:0/2835896042 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9fe0073200 0x7f9fe00756c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0af000 tx=0x7f9fec01b120 comp rx=0 tx=0).stop 2024-09-17T05:28:55.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.209+0000 7fa008600640 1 -- 172.21.15.31:0/2835896042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0000cdb30 msgr2=0x7fa000157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:55.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.209+0000 7fa008600640 1 --2- 172.21.15.31:0/2835896042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0000cdb30 0x7fa000157e60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400d750 tx=0x7f9ff400dc10 comp rx=0 tx=0).stop 2024-09-17T05:28:55.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.209+0000 7fa008600640 1 -- 172.21.15.31:0/2835896042 shutdown_connections 2024-09-17T05:28:55.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.209+0000 7fa008600640 1 --2- 172.21.15.31:0/2835896042 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9fe0073200 0x7f9fe00756c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.209+0000 7fa008600640 1 --2- 172.21.15.31:0/2835896042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa00015bea0 0x7fa0000caea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.209+0000 7fa008600640 1 --2- 172.21.15.31:0/2835896042 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0000d28e0 0x7fa0000b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.209+0000 7fa008600640 1 --2- 172.21.15.31:0/2835896042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0000cdb30 0x7fa000157e60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.209+0000 7fa008600640 1 -- 172.21.15.31:0/2835896042 >> 172.21.15.31:0/2835896042 conn(0x7fa0000d1dc0 msgr2=0x7fa0000b7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:55.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.209+0000 7fa008600640 1 -- 172.21.15.31:0/2835896042 shutdown_connections 2024-09-17T05:28:55.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.209+0000 7fa008600640 1 -- 172.21.15.31:0/2835896042 wait complete. 2024-09-17T05:28:55.233 INFO:teuthology.orchestra.run.smithi031.stdout:[{"version":27,"timestamp":"2024-09-17T05:28:33.303867+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"4575.968427"}]}] 2024-09-17T05:28:55.234 INFO:tasks.ceph_manager:config epoch is 27 2024-09-17T05:28:55.234 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T05:28:55.234 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T05:28:55.234 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T05:28:55.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff63e00640 1 -- 172.21.15.31:0/4247074544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff6415f000 msgr2=0x7eff640d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:55.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff63e00640 1 --2- 172.21.15.31:0/4247074544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff6415f000 0x7eff640d01b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7eff64073000 tx=0x7eff5401c6e0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff63e00640 1 -- 172.21.15.31:0/4247074544 shutdown_connections 2024-09-17T05:28:55.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff63e00640 1 --2- 172.21.15.31:0/4247074544 >> v2:172.21.15.155:3300/0 conn(0x7eff640b2590 0x7eff640b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff63e00640 1 --2- 172.21.15.31:0/4247074544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff6415f000 0x7eff640d01b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff63e00640 1 -- 172.21.15.31:0/4247074544 >> 172.21.15.31:0/4247074544 conn(0x7eff6409aa10 msgr2=0x7eff6409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:55.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff63e00640 1 -- 172.21.15.31:0/4247074544 shutdown_connections 2024-09-17T05:28:55.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff63e00640 1 -- 172.21.15.31:0/4247074544 wait complete. 2024-09-17T05:28:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff63e00640 1 Processor -- start 2024-09-17T05:28:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff63e00640 1 -- start start 2024-09-17T05:28:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff63e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff640b2590 0x7eff64151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff63e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff640cefb0 0x7eff64151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff63e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff6415f000 0x7eff640c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff63e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7eff64168ea0 con 0x7eff640b2590 2024-09-17T05:28:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff63e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7eff64168d20 con 0x7eff6415f000 2024-09-17T05:28:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff63e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7eff64169020 con 0x7eff640cefb0 2024-09-17T05:28:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff62a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff640b2590 0x7eff64151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff62a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff640b2590 0x7eff64151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42042/0 (socket says 172.21.15.31:42042) 2024-09-17T05:28:55.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.377+0000 7eff62a00640 1 -- 172.21.15.31:0/4018723572 learned_addr learned my addr 172.21.15.31:0/4018723572 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:55.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.381+0000 7eff63400640 1 --2- 172.21.15.31:0/4018723572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff6415f000 0x7eff640c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:55.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.381+0000 7eff5be00640 1 --2- 172.21.15.31:0/4018723572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff640cefb0 0x7eff64151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:55.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.381+0000 7eff62a00640 1 -- 172.21.15.31:0/4018723572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff640cefb0 msgr2=0x7eff64151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:55.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.381+0000 7eff62a00640 1 --2- 172.21.15.31:0/4018723572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff640cefb0 0x7eff64151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.381+0000 7eff62a00640 1 -- 172.21.15.31:0/4018723572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff6415f000 msgr2=0x7eff640c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:55.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.381+0000 7eff62a00640 1 --2- 172.21.15.31:0/4018723572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff6415f000 0x7eff640c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.381+0000 7eff62a00640 1 -- 172.21.15.31:0/4018723572 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff640cb770 con 0x7eff640b2590 2024-09-17T05:28:55.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.381+0000 7eff5be00640 1 --2- 172.21.15.31:0/4018723572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff640cefb0 0x7eff64151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:28:55.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.381+0000 7eff63400640 1 --2- 172.21.15.31:0/4018723572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff6415f000 0x7eff640c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:28:55.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.381+0000 7eff62a00640 1 --2- 172.21.15.31:0/4018723572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff640b2590 0x7eff64151730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff54000c10 tx=0x7eff540a8570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:55.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.381+0000 7eff5aa00640 1 -- 172.21.15.31:0/4018723572 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff540a8a50 con 0x7eff640b2590 2024-09-17T05:28:55.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.381+0000 7eff5aa00640 1 -- 172.21.15.31:0/4018723572 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff540a8bf0 con 0x7eff640b2590 2024-09-17T05:28:55.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.381+0000 7eff63e00640 1 -- 172.21.15.31:0/4018723572 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff640cba10 con 0x7eff640b2590 2024-09-17T05:28:55.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.381+0000 7eff5aa00640 1 -- 172.21.15.31:0/4018723572 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff54004030 con 0x7eff640b2590 2024-09-17T05:28:55.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.381+0000 7eff63e00640 1 -- 172.21.15.31:0/4018723572 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff6415e050 con 0x7eff640b2590 2024-09-17T05:28:55.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.381+0000 7eff63e00640 1 -- 172.21.15.31:0/4018723572 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff640b29e0 con 0x7eff640b2590 2024-09-17T05:28:55.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.381+0000 7eff5aa00640 1 -- 172.21.15.31:0/4018723572 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7eff540041d0 con 0x7eff640b2590 2024-09-17T05:28:55.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.381+0000 7eff5aa00640 1 --2- 172.21.15.31:0/4018723572 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7eff40073200 0x7eff400756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:55.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.385+0000 7eff5aa00640 1 -- 172.21.15.31:0/4018723572 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7eff5412e260 con 0x7eff640b2590 2024-09-17T05:28:55.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.385+0000 7eff5be00640 1 --2- 172.21.15.31:0/4018723572 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7eff40073200 0x7eff400756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:55.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.385+0000 7eff5be00640 1 --2- 172.21.15.31:0/4018723572 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7eff40073200 0x7eff400756c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7eff4c001400 tx=0x7eff4c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:55.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.385+0000 7eff5aa00640 1 -- 172.21.15.31:0/4018723572 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7eff540ac030 con 0x7eff640b2590 2024-09-17T05:28:55.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.605+0000 7eff63e00640 1 -- 172.21.15.31:0/4018723572 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7eff6415db20 con 0x7eff640b2590 2024-09-17T05:28:55.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.609+0000 7eff5aa00640 1 -- 172.21.15.31:0/4018723572 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+186462 (secure 0 0 0) 0x7eff540163f0 con 0x7eff640b2590 2024-09-17T05:28:55.615 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:55.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.613+0000 7eff63e00640 1 -- 172.21.15.31:0/4018723572 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7eff40073200 msgr2=0x7eff400756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.613+0000 7eff63e00640 1 --2- 172.21.15.31:0/4018723572 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7eff40073200 0x7eff400756c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7eff4c001400 tx=0x7eff4c009040 comp rx=0 tx=0).stop 2024-09-17T05:28:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.613+0000 7eff63e00640 1 -- 172.21.15.31:0/4018723572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff640b2590 msgr2=0x7eff64151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.613+0000 7eff63e00640 1 --2- 172.21.15.31:0/4018723572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff640b2590 0x7eff64151730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff54000c10 tx=0x7eff540a8570 comp rx=0 tx=0).stop 2024-09-17T05:28:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.613+0000 7eff63e00640 1 -- 172.21.15.31:0/4018723572 shutdown_connections 2024-09-17T05:28:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.613+0000 7eff63e00640 1 --2- 172.21.15.31:0/4018723572 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7eff40073200 0x7eff400756c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.613+0000 7eff63e00640 1 --2- 172.21.15.31:0/4018723572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff6415f000 0x7eff640c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.613+0000 7eff63e00640 1 --2- 172.21.15.31:0/4018723572 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff640cefb0 0x7eff64151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.613+0000 7eff63e00640 1 --2- 172.21.15.31:0/4018723572 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff640b2590 0x7eff64151730 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.613+0000 7eff63e00640 1 -- 172.21.15.31:0/4018723572 >> 172.21.15.31:0/4018723572 conn(0x7eff6409aa10 msgr2=0x7eff640aec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:55.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.613+0000 7eff63e00640 1 -- 172.21.15.31:0/4018723572 shutdown_connections 2024-09-17T05:28:55.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.613+0000 7eff63e00640 1 -- 172.21.15.31:0/4018723572 wait complete. 2024-09-17T05:28:55.635 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1222054038},{"type":"v1","addr":"172.21.15.155:6809","nonce":1222054038}]},"active_addr":"172.21.15.155:6809/1222054038","active_change":"2024-09-17T05:28:25.169123+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":3294325931}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":3008380108}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":376613225}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":987689145}]}]} 2024-09-17T05:28:55.644 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T05:28:55.644 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T05:28:55.644 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:28:55.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a61200640 1 -- 172.21.15.31:0/2298880514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a5c15bea0 msgr2=0x7f4a5c0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:55.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a61200640 1 --2- 172.21.15.31:0/2298880514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a5c15bea0 0x7f4a5c0ce670 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009840 tx=0x7f4a4c01c820 comp rx=0 tx=0).stop 2024-09-17T05:28:55.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a61200640 1 -- 172.21.15.31:0/2298880514 shutdown_connections 2024-09-17T05:28:55.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a61200640 1 --2- 172.21.15.31:0/2298880514 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a5c0d28e0 0x7f4a5c0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a61200640 1 --2- 172.21.15.31:0/2298880514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a5c15bea0 0x7f4a5c0ce670 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a61200640 1 -- 172.21.15.31:0/2298880514 >> 172.21.15.31:0/2298880514 conn(0x7f4a5c0d1dc0 msgr2=0x7f4a5c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:55.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a61200640 1 -- 172.21.15.31:0/2298880514 shutdown_connections 2024-09-17T05:28:55.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a61200640 1 -- 172.21.15.31:0/2298880514 wait complete. 2024-09-17T05:28:55.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a61200640 1 Processor -- start 2024-09-17T05:28:55.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a61200640 1 -- start start 2024-09-17T05:28:55.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a61200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a5c0cdb30 0x7f4a5c157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:55.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a61200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a5c0d28e0 0x7f4a5c155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:55.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a61200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a5c15bea0 0x7f4a5c0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:55.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a61200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5c168fc0 con 0x7f4a5c0cdb30 2024-09-17T05:28:55.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a61200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5c168e40 con 0x7f4a5c15bea0 2024-09-17T05:28:55.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a61200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4a5c169140 con 0x7f4a5c0d28e0 2024-09-17T05:28:55.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a59e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a5c0cdb30 0x7f4a5c157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:55.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a59e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a5c0cdb30 0x7f4a5c157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42068/0 (socket says 172.21.15.31:42068) 2024-09-17T05:28:55.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a59e00640 1 -- 172.21.15.31:0/4107707525 learned_addr learned my addr 172.21.15.31:0/4107707525 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:55.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a51400640 1 --2- 172.21.15.31:0/4107707525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a5c0d28e0 0x7f4a5c155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:55.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.789+0000 7f4a5a800640 1 --2- 172.21.15.31:0/4107707525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a5c15bea0 0x7f4a5c0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:55.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.793+0000 7f4a59e00640 1 -- 172.21.15.31:0/4107707525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a5c0d28e0 msgr2=0x7f4a5c155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:55.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.793+0000 7f4a59e00640 1 --2- 172.21.15.31:0/4107707525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a5c0d28e0 0x7f4a5c155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.793+0000 7f4a59e00640 1 -- 172.21.15.31:0/4107707525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a5c15bea0 msgr2=0x7f4a5c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:55.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.793+0000 7f4a59e00640 1 --2- 172.21.15.31:0/4107707525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a5c15bea0 0x7f4a5c0b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.793+0000 7f4a59e00640 1 -- 172.21.15.31:0/4107707525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5c0c59a0 con 0x7f4a5c0cdb30 2024-09-17T05:28:55.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.793+0000 7f4a5a800640 1 --2- 172.21.15.31:0/4107707525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a5c15bea0 0x7f4a5c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:28:55.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.793+0000 7f4a59e00640 1 --2- 172.21.15.31:0/4107707525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a5c0cdb30 0x7f4a5c157040 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009790 tx=0x7f4a4c0a5700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:55.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.793+0000 7f4a52a00640 1 -- 172.21.15.31:0/4107707525 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c0bb070 con 0x7f4a5c0cdb30 2024-09-17T05:28:55.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.793+0000 7f4a52a00640 1 -- 172.21.15.31:0/4107707525 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a4c005030 con 0x7f4a5c0cdb30 2024-09-17T05:28:55.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.793+0000 7f4a52a00640 1 -- 172.21.15.31:0/4107707525 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c0b2040 con 0x7f4a5c0cdb30 2024-09-17T05:28:55.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.793+0000 7f4a61200640 1 -- 172.21.15.31:0/4107707525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a5c0c89b0 con 0x7f4a5c0cdb30 2024-09-17T05:28:55.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.793+0000 7f4a61200640 1 -- 172.21.15.31:0/4107707525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a5c0c8100 con 0x7f4a5c0cdb30 2024-09-17T05:28:55.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.793+0000 7f4a61200640 1 -- 172.21.15.31:0/4107707525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a5c0cc9d0 con 0x7f4a5c0cdb30 2024-09-17T05:28:55.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.793+0000 7f4a52a00640 1 -- 172.21.15.31:0/4107707525 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4a4c005460 con 0x7f4a5c0cdb30 2024-09-17T05:28:55.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.793+0000 7f4a52a00640 1 --2- 172.21.15.31:0/4107707525 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4a38073200 0x7f4a380756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:55.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.793+0000 7f4a52a00640 1 -- 172.21.15.31:0/4107707525 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4a4c12daf0 con 0x7f4a5c0cdb30 2024-09-17T05:28:55.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.797+0000 7f4a51400640 1 --2- 172.21.15.31:0/4107707525 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4a38073200 0x7f4a380756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:55.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.797+0000 7f4a51400640 1 --2- 172.21.15.31:0/4107707525 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4a38073200 0x7f4a380756c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c157580 tx=0x7f4a44007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:55.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.797+0000 7f4a52a00640 1 -- 172.21.15.31:0/4107707525 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4a4c016410 con 0x7f4a5c0cdb30 2024-09-17T05:28:55.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.981+0000 7f4a61200640 1 -- 172.21.15.31:0/4107707525 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a5c0cb750 con 0x7f4a5c0cdb30 2024-09-17T05:28:55.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.981+0000 7f4a52a00640 1 -- 172.21.15.31:0/4107707525 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16689 (secure 0 0 0) 0x7f4a4c0f8540 con 0x7f4a5c0cdb30 2024-09-17T05:28:55.985 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:55.985 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":21,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:28:46.650201+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:28:42.906739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:28:44.023489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:28:55.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.981+0000 7f4a61200640 1 -- 172.21.15.31:0/4107707525 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4a38073200 msgr2=0x7f4a380756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:55.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.981+0000 7f4a61200640 1 --2- 172.21.15.31:0/4107707525 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4a38073200 0x7f4a380756c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c157580 tx=0x7f4a44007d50 comp rx=0 tx=0).stop 2024-09-17T05:28:55.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.981+0000 7f4a61200640 1 -- 172.21.15.31:0/4107707525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a5c0cdb30 msgr2=0x7f4a5c157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:55.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.981+0000 7f4a61200640 1 --2- 172.21.15.31:0/4107707525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a5c0cdb30 0x7f4a5c157040 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009790 tx=0x7f4a4c0a5700 comp rx=0 tx=0).stop 2024-09-17T05:28:55.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.981+0000 7f4a61200640 1 -- 172.21.15.31:0/4107707525 shutdown_connections 2024-09-17T05:28:55.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.981+0000 7f4a61200640 1 --2- 172.21.15.31:0/4107707525 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4a38073200 0x7f4a380756c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.981+0000 7f4a61200640 1 --2- 172.21.15.31:0/4107707525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a5c15bea0 0x7f4a5c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.981+0000 7f4a61200640 1 --2- 172.21.15.31:0/4107707525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a5c0d28e0 0x7f4a5c155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.981+0000 7f4a61200640 1 --2- 172.21.15.31:0/4107707525 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a5c0cdb30 0x7f4a5c157040 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:55.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.981+0000 7f4a61200640 1 -- 172.21.15.31:0/4107707525 >> 172.21.15.31:0/4107707525 conn(0x7f4a5c0d1dc0 msgr2=0x7f4a5c0b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:55.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.981+0000 7f4a61200640 1 -- 172.21.15.31:0/4107707525 shutdown_connections 2024-09-17T05:28:55.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:55.981+0000 7f4a61200640 1 -- 172.21.15.31:0/4107707525 wait complete. 2024-09-17T05:28:56.008 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T05:28:56.008 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:28:56.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.149+0000 7ff5c1800640 1 -- 172.21.15.31:0/2464456005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5a0004d50 msgr2=0x7ff5a00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.149+0000 7ff5c1800640 1 --2- 172.21.15.31:0/2464456005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5a0004d50 0x7ff5a00051d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009ee0 tx=0x7ff5b401d5f0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.149+0000 7ff5bb400640 1 -- 172.21.15.31:0/2464456005 reap_dead start 2024-09-17T05:28:56.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.149+0000 7ff5c1800640 1 -- 172.21.15.31:0/2464456005 shutdown_connections 2024-09-17T05:28:56.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.149+0000 7ff5c1800640 1 -- 172.21.15.31:0/2464456005 >> 172.21.15.31:0/2464456005 conn(0x7ff5bc0b2060 msgr2=0x7ff5bc0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5c1800640 1 -- 172.21.15.31:0/2464456005 shutdown_connections 2024-09-17T05:28:56.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5c1800640 1 -- 172.21.15.31:0/2464456005 wait complete. 2024-09-17T05:28:56.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5c1800640 1 Processor -- start 2024-09-17T05:28:56.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5c1800640 1 -- start start 2024-09-17T05:28:56.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5c1800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5a0004d50 0x7ff5bc0af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5c1800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5bc152420 0x7ff5bc0ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5c1800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5bc0ae930 0x7ff5bc1f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5c1800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc0cd460 con 0x7ff5a0004d50 2024-09-17T05:28:56.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5c1800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc0cd2e0 con 0x7ff5bc152420 2024-09-17T05:28:56.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5c1800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff5bc0cd5e0 con 0x7ff5bc0ae930 2024-09-17T05:28:56.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5baa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5a0004d50 0x7ff5bc0af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5baa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5a0004d50 0x7ff5bc0af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42080/0 (socket says 172.21.15.31:42080) 2024-09-17T05:28:56.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5baa00640 1 -- 172.21.15.31:0/3063800859 learned_addr learned my addr 172.21.15.31:0/3063800859 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:56.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5b3e00640 1 --2- 172.21.15.31:0/3063800859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5bc152420 0x7ff5bc0ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5bb400640 1 --2- 172.21.15.31:0/3063800859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5bc0ae930 0x7ff5bc1f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5baa00640 1 -- 172.21.15.31:0/3063800859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5bc0ae930 msgr2=0x7ff5bc1f7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5baa00640 1 --2- 172.21.15.31:0/3063800859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5bc0ae930 0x7ff5bc1f7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5baa00640 1 -- 172.21.15.31:0/3063800859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5bc152420 msgr2=0x7ff5bc0ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5baa00640 1 --2- 172.21.15.31:0/3063800859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5bc152420 0x7ff5bc0ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5baa00640 1 -- 172.21.15.31:0/3063800859 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5bc15a410 con 0x7ff5a0004d50 2024-09-17T05:28:56.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5b3e00640 1 --2- 172.21.15.31:0/3063800859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5bc152420 0x7ff5bc0ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:28:56.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5bb400640 1 --2- 172.21.15.31:0/3063800859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5bc0ae930 0x7ff5bc1f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:28:56.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.153+0000 7ff5baa00640 1 --2- 172.21.15.31:0/3063800859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5a0004d50 0x7ff5bc0af1f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac011b10 tx=0x7ff5ac009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.157+0000 7ff5b2a00640 1 -- 172.21.15.31:0/3063800859 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac00fd00 con 0x7ff5a0004d50 2024-09-17T05:28:56.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.157+0000 7ff5b2a00640 1 -- 172.21.15.31:0/3063800859 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff5ac004020 con 0x7ff5a0004d50 2024-09-17T05:28:56.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.157+0000 7ff5c1800640 1 -- 172.21.15.31:0/3063800859 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5bc15a6f0 con 0x7ff5a0004d50 2024-09-17T05:28:56.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.157+0000 7ff5b2a00640 1 -- 172.21.15.31:0/3063800859 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac00fea0 con 0x7ff5a0004d50 2024-09-17T05:28:56.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.157+0000 7ff5c1800640 1 -- 172.21.15.31:0/3063800859 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5bc15acb0 con 0x7ff5a0004d50 2024-09-17T05:28:56.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.157+0000 7ff5c1800640 1 -- 172.21.15.31:0/3063800859 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5bc0aed10 con 0x7ff5a0004d50 2024-09-17T05:28:56.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.157+0000 7ff5b2a00640 1 -- 172.21.15.31:0/3063800859 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff5ac003600 con 0x7ff5a0004d50 2024-09-17T05:28:56.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.157+0000 7ff5b2a00640 1 --2- 172.21.15.31:0/3063800859 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff598073230 0x7ff5980756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.157+0000 7ff5b2a00640 1 -- 172.21.15.31:0/3063800859 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff5ac094d80 con 0x7ff5a0004d50 2024-09-17T05:28:56.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.157+0000 7ff5b3e00640 1 --2- 172.21.15.31:0/3063800859 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff598073230 0x7ff5980756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.161+0000 7ff5b3e00640 1 --2- 172.21.15.31:0/3063800859 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff598073230 0x7ff5980756f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4001c10 tx=0x7ff5a4001ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.161+0000 7ff5b2a00640 1 -- 172.21.15.31:0/3063800859 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff5ac004470 con 0x7ff5a0004d50 2024-09-17T05:28:56.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.341+0000 7ff5c1800640 1 -- 172.21.15.31:0/3063800859 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5bc0c8530 con 0x7ff5a0004d50 2024-09-17T05:28:56.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.341+0000 7ff5b2a00640 1 -- 172.21.15.31:0/3063800859 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16689 (secure 0 0 0) 0x7ff5ac05fd10 con 0x7ff5a0004d50 2024-09-17T05:28:56.344 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:56.345 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":21,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:28:46.650201+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:28:42.906739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:28:44.023489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:28:56.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.341+0000 7ff5c1800640 1 -- 172.21.15.31:0/3063800859 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff598073230 msgr2=0x7ff5980756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.341+0000 7ff5c1800640 1 --2- 172.21.15.31:0/3063800859 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff598073230 0x7ff5980756f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4001c10 tx=0x7ff5a4001ba0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.341+0000 7ff5c1800640 1 -- 172.21.15.31:0/3063800859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5a0004d50 msgr2=0x7ff5bc0af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.341+0000 7ff5c1800640 1 --2- 172.21.15.31:0/3063800859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5a0004d50 0x7ff5bc0af1f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac011b10 tx=0x7ff5ac009f20 comp rx=0 tx=0).stop 2024-09-17T05:28:56.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.341+0000 7ff5c1800640 1 -- 172.21.15.31:0/3063800859 shutdown_connections 2024-09-17T05:28:56.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.341+0000 7ff5c1800640 1 --2- 172.21.15.31:0/3063800859 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff598073230 0x7ff5980756f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.341+0000 7ff5c1800640 1 --2- 172.21.15.31:0/3063800859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5bc0ae930 0x7ff5bc1f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.341+0000 7ff5c1800640 1 --2- 172.21.15.31:0/3063800859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5bc152420 0x7ff5bc0ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.341+0000 7ff5c1800640 1 --2- 172.21.15.31:0/3063800859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5a0004d50 0x7ff5bc0af1f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.341+0000 7ff5c1800640 1 -- 172.21.15.31:0/3063800859 >> 172.21.15.31:0/3063800859 conn(0x7ff5bc0b2060 msgr2=0x7ff5bc0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.341+0000 7ff5c1800640 1 -- 172.21.15.31:0/3063800859 shutdown_connections 2024-09-17T05:28:56.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.341+0000 7ff5c1800640 1 -- 172.21.15.31:0/3063800859 wait complete. 2024-09-17T05:28:56.367 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T05:28:56.368 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T05:28:56.368 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T05:28:56.368 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T05:28:56.369 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T05:28:56.369 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T05:28:56.369 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T05:28:56.370 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T05:28:56.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.621+0000 7ffa6d800640 1 -- 172.21.15.31:0/3247692539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa600584b0 msgr2=0x7ffa60006d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.621+0000 7ffa6d800640 1 --2- 172.21.15.31:0/3247692539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa600584b0 0x7ffa60006d30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffa6806b080 tx=0x7ffa680985d0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.621+0000 7ffa6d800640 1 -- 172.21.15.31:0/3247692539 shutdown_connections 2024-09-17T05:28:56.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.621+0000 7ffa6d800640 1 --2- 172.21.15.31:0/3247692539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa600584b0 0x7ffa60006d30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.621+0000 7ffa6d800640 1 --2- 172.21.15.31:0/3247692539 >> v2:172.21.15.155:3300/0 conn(0x7ffa60037e20 0x7ffa60057f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.621+0000 7ffa6d800640 1 -- 172.21.15.31:0/3247692539 >> 172.21.15.31:0/3247692539 conn(0x7ffa6003a3e0 msgr2=0x7ffa6003a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.621+0000 7ffa6d800640 1 -- 172.21.15.31:0/3247692539 shutdown_connections 2024-09-17T05:28:56.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.621+0000 7ffa6d800640 1 -- 172.21.15.31:0/3247692539 wait complete. 2024-09-17T05:28:56.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.625+0000 7ffa6d800640 1 Processor -- start 2024-09-17T05:28:56.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.625+0000 7ffa6d800640 1 -- start start 2024-09-17T05:28:56.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.625+0000 7ffa6d800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa60037e20 0x7ffa601806a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.625+0000 7ffa6d800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa600e6e60 0x7ffa600df490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.625+0000 7ffa6d800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa600e0f70 0x7ffa600e1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.625+0000 7ffa6d800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ffa600f3e80 con 0x7ffa60037e20 2024-09-17T05:28:56.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.625+0000 7ffa6d800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffa600f3d00 con 0x7ffa600e0f70 2024-09-17T05:28:56.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.625+0000 7ffa6d800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffa600f4000 con 0x7ffa600e6e60 2024-09-17T05:28:56.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ffa66000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa600e6e60 0x7ffa600df490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ffa67400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa600e0f70 0x7ffa600e1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ffa67400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa600e0f70 0x7ffa600e1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:58296/0 (socket says 172.21.15.31:58296) 2024-09-17T05:28:56.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ffa67400640 1 -- 172.21.15.31:0/2168619124 learned_addr learned my addr 172.21.15.31:0/2168619124 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:56.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ffa66000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa600e6e60 0x7ffa600df490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:49812/0 (socket says 172.21.15.31:49812) 2024-09-17T05:28:56.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ffa66a00640 1 --2- 172.21.15.31:0/2168619124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa60037e20 0x7ffa601806a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ffa66000640 1 -- 172.21.15.31:0/2168619124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa600e0f70 msgr2=0x7ffa600e1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ffa66000640 1 --2- 172.21.15.31:0/2168619124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa600e0f70 0x7ffa600e1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ffa66000640 1 -- 172.21.15.31:0/2168619124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa60037e20 msgr2=0x7ffa601806a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ffa66000640 1 --2- 172.21.15.31:0/2168619124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa60037e20 0x7ffa601806a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ffa66000640 1 -- 172.21.15.31:0/2168619124 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa60180e10 con 0x7ffa600e6e60 2024-09-17T05:28:56.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ffa66000640 1 --2- 172.21.15.31:0/2168619124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa600e6e60 0x7ffa600df490 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400d750 tx=0x7ffa5400dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7f0f35e00640 1 -- 172.21.15.31:0/2168671043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3015e090 msgr2=0x7f0f300d1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7f0ffa800640 1 -- 172.21.15.31:0/1977821700 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fec007780 msgr2=0x7f0fec0373c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7f0ffa800640 1 --2- 172.21.15.31:0/1977821700 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fec007780 0x7f0fec0373c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009840 tx=0x7f0fe801c810 comp rx=0 tx=0).stop 2024-09-17T05:28:56.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7f0f35e00640 1 --2- 172.21.15.31:0/2168671043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3015e090 0x7f0f300d1b80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0f3008c500 tx=0x7f0f2001c740 comp rx=0 tx=0).stop 2024-09-17T05:28:56.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7f0f35e00640 1 -- 172.21.15.31:0/2168671043 shutdown_connections 2024-09-17T05:28:56.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7f0f35e00640 1 --2- 172.21.15.31:0/2168671043 >> v2:172.21.15.31:3300/0 conn(0x7f0f300cfc50 0x7f0f30161c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7f0f35e00640 1 --2- 172.21.15.31:0/2168671043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f3015e090 0x7f0f300d1b80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7f0f35e00640 1 -- 172.21.15.31:0/2168671043 >> 172.21.15.31:0/2168671043 conn(0x7f0f300d3fb0 msgr2=0x7f0f300d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7f0f35e00640 1 -- 172.21.15.31:0/2168671043 shutdown_connections 2024-09-17T05:28:56.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7f0f35e00640 1 -- 172.21.15.31:0/2168671043 wait complete. 2024-09-17T05:28:56.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ffa5ea00640 1 -- 172.21.15.31:0/2168619124 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54017070 con 0x7ffa600e6e60 2024-09-17T05:28:56.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ffa5ea00640 1 -- 172.21.15.31:0/2168619124 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa54009cc0 con 0x7ffa600e6e60 2024-09-17T05:28:56.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ffa5ea00640 1 -- 172.21.15.31:0/2168619124 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5400de60 con 0x7ffa600e6e60 2024-09-17T05:28:56.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ffa6d800640 1 -- 172.21.15.31:0/2168619124 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa601810f0 con 0x7ffa600e6e60 2024-09-17T05:28:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7f0ffa800640 1 -- 172.21.15.31:0/1977821700 shutdown_connections 2024-09-17T05:28:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7f0ffa800640 1 --2- 172.21.15.31:0/1977821700 >> v2:172.21.15.31:3300/0 conn(0x7f0fec008270 0x7f0fec033590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7f0ffa800640 1 --2- 172.21.15.31:0/1977821700 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fec007780 0x7f0fec0373c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7f0ffa800640 1 -- 172.21.15.31:0/1977821700 >> 172.21.15.31:0/1977821700 conn(0x7f0fec056720 msgr2=0x7f0fec056b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7f0ffa800640 1 -- 172.21.15.31:0/1977821700 shutdown_connections 2024-09-17T05:28:56.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7f0ffa800640 1 -- 172.21.15.31:0/1977821700 wait complete. 2024-09-17T05:28:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ff15e800640 1 -- 172.21.15.31:0/1789897045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1580cf870 msgr2=0x7ff15806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7ff15e800640 1 --2- 172.21.15.31:0/1789897045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1580cf870 0x7ff15806eb80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff15000afd0 tx=0x7ff15001d8f0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ffa6d800640 1 -- 172.21.15.31:0/2168619124 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa600df9d0 con 0x7ffa600e6e60 2024-09-17T05:28:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.629+0000 7ffa6d800640 1 -- 172.21.15.31:0/2168619124 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffa60052150 con 0x7ffa600e6e60 2024-09-17T05:28:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f686f800640 1 -- 172.21.15.31:0/3948856198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f684c004810 msgr2=0x7f684c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f686f800640 1 --2- 172.21.15.31:0/3948856198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f684c004810 0x7f684c004c90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6854006fb0 tx=0x7f685401cfc0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f686d800640 1 -- 172.21.15.31:0/3948856198 reap_dead start 2024-09-17T05:28:56.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0ffa800640 1 Processor -- start 2024-09-17T05:28:56.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f35e00640 1 Processor -- start 2024-09-17T05:28:56.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f35e00640 1 -- start start 2024-09-17T05:28:56.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7ff15e800640 1 -- 172.21.15.31:0/1789897045 shutdown_connections 2024-09-17T05:28:56.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7ff15e800640 1 --2- 172.21.15.31:0/1789897045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1580cf870 0x7ff15806eb80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7ffa5ea00640 1 -- 172.21.15.31:0/2168619124 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ffa54005280 con 0x7ffa600e6e60 2024-09-17T05:28:56.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7ff15e800640 1 --2- 172.21.15.31:0/1789897045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff15815e1a0 0x7ff15815e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7ff15e800640 1 -- 172.21.15.31:0/1789897045 >> 172.21.15.31:0/1789897045 conn(0x7ff1580cfff0 msgr2=0x7ff1580d0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f35e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f300cfc50 0x7f0f30204560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f35e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f300d20c0 0x7f0f300c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f35e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f3015e090 0x7f0f30156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f35e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3016b4a0 con 0x7f0f3015e090 2024-09-17T05:28:56.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f686f800640 1 -- 172.21.15.31:0/3948856198 shutdown_connections 2024-09-17T05:28:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f686f800640 1 -- 172.21.15.31:0/3948856198 >> 172.21.15.31:0/3948856198 conn(0x7f68680b18f0 msgr2=0x7f68680b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f35e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3016b320 con 0x7f0f300cfc50 2024-09-17T05:28:56.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f35e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3016b620 con 0x7f0f300d20c0 2024-09-17T05:28:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f686f800640 1 -- 172.21.15.31:0/3948856198 shutdown_connections 2024-09-17T05:28:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f686f800640 1 -- 172.21.15.31:0/3948856198 wait complete. 2024-09-17T05:28:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7ffa5ea00640 1 --2- 172.21.15.31:0/2168619124 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffa48073300 0x7ffa480757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7ffa5ea00640 1 -- 172.21.15.31:0/2168619124 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ffa540943e0 con 0x7ffa600e6e60 2024-09-17T05:28:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7ffa5ea00640 1 --2- 172.21.15.31:0/2168619124 >> [v2:172.21.15.31:6800/2294581293,v1:172.21.15.31:6801/2294581293] conn(0x7ffa4807b520 0x7ffa4807d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0ffa800640 1 -- start start 2024-09-17T05:28:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0ffa800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fec007780 0x7f0fec0d2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f23400640 1 -- 172.21.15.31:0/477537683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f1c15b870 msgr2=0x7f0f1c1619a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f23400640 1 --2- 172.21.15.31:0/477537683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f1c15b870 0x7f0f1c1619a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c06ecf0 tx=0x7f0f0c01c8c0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f2ea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f300cfc50 0x7f0f30204560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f2ea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f300cfc50 0x7f0f30204560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:58320/0 (socket says 172.21.15.31:58320) 2024-09-17T05:28:56.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f2ea00640 1 -- 172.21.15.31:0/1818862669 learned_addr learned my addr 172.21.15.31:0/1818862669 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:56.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f2e000640 1 --2- 172.21.15.31:0/1818862669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f300d20c0 0x7f0f300c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f2f400640 1 --2- 172.21.15.31:0/1818862669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f3015e090 0x7f0f30156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f2ea00640 1 -- 172.21.15.31:0/1818862669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f300d20c0 msgr2=0x7f0f300c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f2ea00640 1 --2- 172.21.15.31:0/1818862669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f300d20c0 0x7f0f300c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f2ea00640 1 -- 172.21.15.31:0/1818862669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f3015e090 msgr2=0x7f0f30156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f2ea00640 1 --2- 172.21.15.31:0/1818862669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f3015e090 0x7f0f30156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f2ea00640 1 -- 172.21.15.31:0/1818862669 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f300c8030 con 0x7f0f300cfc50 2024-09-17T05:28:56.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f2ea00640 1 --2- 172.21.15.31:0/1818862669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f300cfc50 0x7f0f30204560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0f20019350 tx=0x7f0f20005db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f27400640 1 -- 172.21.15.31:0/1818862669 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f200bb070 con 0x7f0f300cfc50 2024-09-17T05:28:56.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f27400640 1 -- 172.21.15.31:0/1818862669 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f200a5c70 con 0x7f0f300cfc50 2024-09-17T05:28:56.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f35e00640 1 -- 172.21.15.31:0/1818862669 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f300c85a0 con 0x7f0f300cfc50 2024-09-17T05:28:56.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7f0f35e00640 1 -- 172.21.15.31:0/1818862669 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f300c8b60 con 0x7f0f300cfc50 2024-09-17T05:28:56.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0f27400640 1 -- 172.21.15.31:0/1818862669 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f200b2040 con 0x7f0f300cfc50 2024-09-17T05:28:56.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7ff15e800640 1 -- 172.21.15.31:0/1789897045 shutdown_connections 2024-09-17T05:28:56.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.633+0000 7ff15e800640 1 -- 172.21.15.31:0/1789897045 wait complete. 2024-09-17T05:28:56.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7ffa5ea00640 1 -- 172.21.15.31:0/2168619124 --> [v2:172.21.15.31:6800/2294581293,v1:172.21.15.31:6801/2294581293] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffa4807dff0 con 0x7ffa4807b520 2024-09-17T05:28:56.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7ffa5ea00640 1 -- 172.21.15.31:0/2168619124 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ffa540947d0 con 0x7ffa600e6e60 2024-09-17T05:28:56.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f686f800640 1 Processor -- start 2024-09-17T05:28:56.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0ffa800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fec008270 0x7f0fec0df7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0ffa800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0fec055b90 0x7f0fec0dfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f686f800640 1 -- start start 2024-09-17T05:28:56.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0ff3400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fec007780 0x7f0fec0d2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0ff3400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fec007780 0x7f0fec0d2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:49838/0 (socket says 172.21.15.31:49838) 2024-09-17T05:28:56.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0ff3400640 1 -- 172.21.15.31:0/1253252336 learned_addr learned my addr 172.21.15.31:0/1253252336 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:56.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0ffa800640 1 -- 172.21.15.31:0/1253252336 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0fec0efb30 con 0x7f0fec055b90 2024-09-17T05:28:56.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0ffa800640 1 -- 172.21.15.31:0/1253252336 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0fec0ef9b0 con 0x7f0fec008270 2024-09-17T05:28:56.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0ffa800640 1 -- 172.21.15.31:0/1253252336 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0fec0efcb0 con 0x7f0fec007780 2024-09-17T05:28:56.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0ff2a00640 1 --2- 172.21.15.31:0/1253252336 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fec008270 0x7f0fec0df7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0ff3400640 1 -- 172.21.15.31:0/1253252336 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fec008270 msgr2=0x7f0fec0df7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0ff3400640 1 --2- 172.21.15.31:0/1253252336 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0fec008270 0x7f0fec0df7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0ff3400640 1 -- 172.21.15.31:0/1253252336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0fec055b90 msgr2=0x7f0fec0dfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0ff3400640 1 --2- 172.21.15.31:0/1253252336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0fec055b90 0x7f0fec0dfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0ff3400640 1 -- 172.21.15.31:0/1253252336 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fec04c5c0 con 0x7f0fec007780 2024-09-17T05:28:56.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0f23400640 1 -- 172.21.15.31:0/477537683 shutdown_connections 2024-09-17T05:28:56.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0f23400640 1 --2- 172.21.15.31:0/477537683 >> v2:172.21.15.31:3300/0 conn(0x7f0f1c0cb3a0 0x7f0f1c0cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0f23400640 1 --2- 172.21.15.31:0/477537683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f1c15b870 0x7f0f1c1619a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0f23400640 1 -- 172.21.15.31:0/477537683 >> 172.21.15.31:0/477537683 conn(0x7f0f1c0d0d50 msgr2=0x7f0f1c0d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0f35e00640 1 -- 172.21.15.31:0/1818862669 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0f08001040 con 0x7f0f300cfc50 2024-09-17T05:28:56.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7ffa66a00640 1 --2- 172.21.15.31:0/2168619124 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffa48073300 0x7ffa480757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f686f800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f684c004810 0x7f68680742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0ff3400640 1 --2- 172.21.15.31:0/1253252336 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fec007780 0x7f0fec0d2ae0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8019420 tx=0x7f0fe8005130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0fe7400640 1 -- 172.21.15.31:0/1253252336 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe80ba020 con 0x7f0fec007780 2024-09-17T05:28:56.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0ffa800640 1 -- 172.21.15.31:0/1253252336 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fec04c8a0 con 0x7f0fec007780 2024-09-17T05:28:56.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0ffa800640 1 -- 172.21.15.31:0/1253252336 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fec0de360 con 0x7f0fec007780 2024-09-17T05:28:56.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0f23400640 1 -- 172.21.15.31:0/477537683 shutdown_connections 2024-09-17T05:28:56.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7f0f23400640 1 -- 172.21.15.31:0/477537683 wait complete. 2024-09-17T05:28:56.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7ff15e800640 1 Processor -- start 2024-09-17T05:28:56.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f686f800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6868072870 0x7f6868147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7ffa66a00640 1 --2- 172.21.15.31:0/2168619124 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffa48073300 0x7ffa480757c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffa58001650 tx=0x7ffa58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7ffa67400640 1 --2- 172.21.15.31:0/2168619124 >> [v2:172.21.15.31:6800/2294581293,v1:172.21.15.31:6801/2294581293] conn(0x7ffa4807b520 0x7ffa4807d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f686ce00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f684c004810 0x7f68680742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f686ce00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f684c004810 0x7f68680742b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:49842/0 (socket says 172.21.15.31:49842) 2024-09-17T05:28:56.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f686f800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68680b09c0 0x7f68680b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f0ffa800640 1 -- 172.21.15.31:0/1253252336 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0fec0e1090 con 0x7f0fec007780 2024-09-17T05:28:56.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f686ce00640 1 -- 172.21.15.31:0/3703077979 learned_addr learned my addr 172.21.15.31:0/3703077979 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:56.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f686f800640 1 -- 172.21.15.31:0/3703077979 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6868166360 con 0x7f6868072870 2024-09-17T05:28:56.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f686f800640 1 -- 172.21.15.31:0/3703077979 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f68681661e0 con 0x7f68680b09c0 2024-09-17T05:28:56.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f686f800640 1 -- 172.21.15.31:0/3703077979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f68681664e0 con 0x7f684c004810 2024-09-17T05:28:56.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f686d800640 1 --2- 172.21.15.31:0/3703077979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68680b09c0 0x7f68680b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f6867e00640 1 --2- 172.21.15.31:0/3703077979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6868072870 0x7f6868147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f686ce00640 1 -- 172.21.15.31:0/3703077979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68680b09c0 msgr2=0x7f68680b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f686ce00640 1 --2- 172.21.15.31:0/3703077979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68680b09c0 0x7f68680b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f686ce00640 1 -- 172.21.15.31:0/3703077979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6868072870 msgr2=0x7f6868147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f686ce00640 1 --2- 172.21.15.31:0/3703077979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6868072870 0x7f6868147d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f686ce00640 1 -- 172.21.15.31:0/3703077979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6868074970 con 0x7f684c004810 2024-09-17T05:28:56.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f0fe7400640 1 -- 172.21.15.31:0/1253252336 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fe8004030 con 0x7f0fec007780 2024-09-17T05:28:56.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f0fe7400640 1 -- 172.21.15.31:0/1253252336 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe80ba020 con 0x7f0fec007780 2024-09-17T05:28:56.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f0f27400640 1 -- 172.21.15.31:0/1818862669 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0f20005270 con 0x7f0f300cfc50 2024-09-17T05:28:56.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f0f27400640 1 --2- 172.21.15.31:0/1818862669 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0f10073200 0x7f0f100756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f0f27400640 1 -- 172.21.15.31:0/1818862669 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0f2012d910 con 0x7f0f300cfc50 2024-09-17T05:28:56.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f0f27400640 1 --2- 172.21.15.31:0/1818862669 >> [v2:172.21.15.155:6810/3398816604,v1:172.21.15.155:6811/3398816604] conn(0x7f0f1007b3a0 0x7f0f1007d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f0f27400640 1 -- 172.21.15.31:0/1818862669 --> [v2:172.21.15.155:6810/3398816604,v1:172.21.15.155:6811/3398816604] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f200c0e50 con 0x7f0f1007b3a0 2024-09-17T05:28:56.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f0f27400640 1 -- 172.21.15.31:0/1818862669 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0f200f4870 con 0x7f0f300cfc50 2024-09-17T05:28:56.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.637+0000 7ff15e800640 1 -- start start 2024-09-17T05:28:56.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7ff15e800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1580cf870 0x7ff1581504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7ff15e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff15815a0d0 0x7ff1581f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7ff15e800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff15815e1a0 0x7ff15809d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f0f2e000640 1 --2- 172.21.15.31:0/1818862669 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0f10073200 0x7f0f100756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f686ce00640 1 --2- 172.21.15.31:0/3703077979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f684c004810 0x7f68680742b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f685800c520 tx=0x7f685800c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7ffa67400640 1 --2- 172.21.15.31:0/2168619124 >> [v2:172.21.15.31:6800/2294581293,v1:172.21.15.31:6801/2294581293] conn(0x7ffa4807b520 0x7ffa4807d940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7ffa5ea00640 1 -- 172.21.15.31:0/2168619124 <== osd.0 v2:172.21.15.31:6800/2294581293 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffa4807dff0 con 0x7ffa4807b520 2024-09-17T05:28:56.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f6864c00640 1 -- 172.21.15.31:0/3703077979 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6858017070 con 0x7f684c004810 2024-09-17T05:28:56.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f686f800640 1 -- 172.21.15.31:0/3703077979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68681f3ee0 con 0x7f684c004810 2024-09-17T05:28:56.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f686f800640 1 -- 172.21.15.31:0/3703077979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f68681f44a0 con 0x7f684c004810 2024-09-17T05:28:56.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f6864c00640 1 -- 172.21.15.31:0/3703077979 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68580053c0 con 0x7f684c004810 2024-09-17T05:28:56.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f6864c00640 1 -- 172.21.15.31:0/3703077979 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6858012870 con 0x7f684c004810 2024-09-17T05:28:56.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f0f23400640 1 Processor -- start 2024-09-17T05:28:56.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f0f23400640 1 -- start start 2024-09-17T05:28:56.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f0f2f400640 1 --2- 172.21.15.31:0/1818862669 >> [v2:172.21.15.155:6810/3398816604,v1:172.21.15.155:6811/3398816604] conn(0x7f0f1007b3a0 0x7f0f1007d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7f0f2e000640 1 --2- 172.21.15.31:0/1818862669 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0f10073200 0x7f0f100756c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c006fd0 tx=0x7f0f1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f2f400640 1 --2- 172.21.15.31:0/1818862669 >> [v2:172.21.15.155:6810/3398816604,v1:172.21.15.155:6811/3398816604] conn(0x7f0f1007b3a0 0x7f0f1007d7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7ff157400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1580cf870 0x7ff1581504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7ff157400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1580cf870 0x7ff1581504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:58358/0 (socket says 172.21.15.31:58358) 2024-09-17T05:28:56.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7ff157400640 1 -- 172.21.15.31:0/201703772 learned_addr learned my addr 172.21.15.31:0/201703772 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:56.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7ff157e00640 1 --2- 172.21.15.31:0/201703772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff15815e1a0 0x7ff15809d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7ff15e800640 1 -- 172.21.15.31:0/201703772 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff1581671c0 con 0x7ff15815a0d0 2024-09-17T05:28:56.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.641+0000 7ff15e800640 1 -- 172.21.15.31:0/201703772 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff158167040 con 0x7ff1580cf870 2024-09-17T05:28:56.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7ff15e800640 1 -- 172.21.15.31:0/201703772 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff158167340 con 0x7ff15815e1a0 2024-09-17T05:28:56.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7fc9b7200640 1 -- 172.21.15.31:0/1339272911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9b8072a50 msgr2=0x7fc9b815ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7fc9b7200640 1 --2- 172.21.15.31:0/1339272911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9b8072a50 0x7fc9b815ac30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8072ee0 tx=0x7fc9a401d470 comp rx=0 tx=0).stop 2024-09-17T05:28:56.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7ff156a00640 1 --2- 172.21.15.31:0/201703772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff15815a0d0 0x7ff1581f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7ff157e00640 1 -- 172.21.15.31:0/201703772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1580cf870 msgr2=0x7ff1581504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7ff157e00640 1 --2- 172.21.15.31:0/201703772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1580cf870 0x7ff1581504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7ff157e00640 1 -- 172.21.15.31:0/201703772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff15815a0d0 msgr2=0x7ff1581f4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7ff157e00640 1 --2- 172.21.15.31:0/201703772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff15815a0d0 0x7ff1581f4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7ff157e00640 1 -- 172.21.15.31:0/201703772 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff15809d760 con 0x7ff15815e1a0 2024-09-17T05:28:56.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7ff157400640 1 --2- 172.21.15.31:0/201703772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1580cf870 0x7ff1581504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:28:56.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f23400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f1c0cb3a0 0x7f0f1c1550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f23400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f1c0d1920 0x7f0f1c157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f23400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f1c15b870 0x7f0f1c157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0fe7400640 1 -- 172.21.15.31:0/1253252336 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0fe80041e0 con 0x7f0fec007780 2024-09-17T05:28:56.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f686f800640 1 -- 172.21.15.31:0/3703077979 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6840001040 con 0x7f684c004810 2024-09-17T05:28:56.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f23400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c16aec0 con 0x7f0f1c15b870 2024-09-17T05:28:56.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f23400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c16ad40 con 0x7f0f1c0cb3a0 2024-09-17T05:28:56.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f23400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0f1c16b040 con 0x7f0f1c0d1920 2024-09-17T05:28:56.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f21400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f1c15b870 0x7f0f1c157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f27400640 1 -- 172.21.15.31:0/1818862669 <== osd.4 v2:172.21.15.155:6810/3398816604 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0f200c0e50 con 0x7f0f1007b3a0 2024-09-17T05:28:56.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7ff157e00640 1 --2- 172.21.15.31:0/201703772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff15815e1a0 0x7ff15809d220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff1500ac000 tx=0x7ff150004a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f20a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f1c0cb3a0 0x7f0f1c1550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f20a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f1c0cb3a0 0x7f0f1c1550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:58366/0 (socket says 172.21.15.31:58366) 2024-09-17T05:28:56.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7fc9b7200640 1 -- 172.21.15.31:0/1339272911 shutdown_connections 2024-09-17T05:28:56.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7fc9b7200640 1 --2- 172.21.15.31:0/1339272911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9b8072a50 0x7fc9b815ac30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7fc9b7200640 1 --2- 172.21.15.31:0/1339272911 >> v2:172.21.15.31:3300/0 conn(0x7fc9b815df30 0x7fc9b815e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f20a00640 1 -- 172.21.15.31:0/49471036 learned_addr learned my addr 172.21.15.31:0/49471036 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:56.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7fc9b7200640 1 -- 172.21.15.31:0/1339272911 >> 172.21.15.31:0/1339272911 conn(0x7fc9b806cc20 msgr2=0x7fc9b806d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f1be00640 1 --2- 172.21.15.31:0/49471036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f1c0d1920 0x7f0f1c157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0fe7400640 1 --2- 172.21.15.31:0/1253252336 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0fd4073430 0x7f0fd40758f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f20a00640 1 -- 172.21.15.31:0/49471036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f1c0d1920 msgr2=0x7f0f1c157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f20a00640 1 --2- 172.21.15.31:0/49471036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f1c0d1920 0x7f0f1c157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f20a00640 1 -- 172.21.15.31:0/49471036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f1c15b870 msgr2=0x7f0f1c157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f20a00640 1 --2- 172.21.15.31:0/49471036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f1c15b870 0x7f0f1c157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f20a00640 1 -- 172.21.15.31:0/49471036 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1c157bd0 con 0x7f0f1c0cb3a0 2024-09-17T05:28:56.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7ff14f400640 1 -- 172.21.15.31:0/201703772 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1500be020 con 0x7ff15815e1a0 2024-09-17T05:28:56.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7fc9b7200640 1 -- 172.21.15.31:0/1339272911 shutdown_connections 2024-09-17T05:28:56.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7fc9b7200640 1 -- 172.21.15.31:0/1339272911 wait complete. 2024-09-17T05:28:56.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0fe7400640 1 -- 172.21.15.31:0/1253252336 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0fe812dfd0 con 0x7f0fec007780 2024-09-17T05:28:56.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0fe7400640 1 --2- 172.21.15.31:0/1253252336 >> [v2:172.21.15.31:6824/1172069379,v1:172.21.15.31:6825/1172069379] conn(0x7f0fd407b650 0x7f0fd407da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0fe7400640 1 -- 172.21.15.31:0/1253252336 --> [v2:172.21.15.31:6824/1172069379,v1:172.21.15.31:6825/1172069379] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0fe80a6910 con 0x7f0fd407b650 2024-09-17T05:28:56.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0fe7400640 1 -- 172.21.15.31:0/1253252336 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0fe812e3c0 con 0x7f0fec007780 2024-09-17T05:28:56.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7f0f20a00640 1 --2- 172.21.15.31:0/49471036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f1c0cb3a0 0x7f0f1c1550e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c0194d0 tx=0x7f0f0c0a57d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7ff14f400640 1 -- 172.21.15.31:0/201703772 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1500a8410 con 0x7ff15815e1a0 2024-09-17T05:28:56.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7ff15e800640 1 -- 172.21.15.31:0/201703772 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1581f6c70 con 0x7ff15815e1a0 2024-09-17T05:28:56.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7ff15e800640 1 -- 172.21.15.31:0/201703772 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1581f7230 con 0x7ff15815e1a0 2024-09-17T05:28:56.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.645+0000 7ff14f400640 1 -- 172.21.15.31:0/201703772 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1500b3040 con 0x7ff15815e1a0 2024-09-17T05:28:56.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.649+0000 7f0ff2a00640 1 --2- 172.21.15.31:0/1253252336 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0fd4073430 0x7f0fd40758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.649+0000 7f0f18c00640 1 -- 172.21.15.31:0/49471036 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c0bc070 con 0x7f0f1c0cb3a0 2024-09-17T05:28:56.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.649+0000 7f0f23400640 1 -- 172.21.15.31:0/49471036 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1c15afc0 con 0x7f0f1c0cb3a0 2024-09-17T05:28:56.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.649+0000 7f0f23400640 1 -- 172.21.15.31:0/49471036 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f1c15a4e0 con 0x7f0f1c0cb3a0 2024-09-17T05:28:56.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.649+0000 7ff15e800640 1 -- 172.21.15.31:0/201703772 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1580d0b10 con 0x7ff15815e1a0 2024-09-17T05:28:56.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.649+0000 7f0f18c00640 1 -- 172.21.15.31:0/49471036 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f0c003600 con 0x7f0f1c0cb3a0 2024-09-17T05:28:56.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.649+0000 7f0f18c00640 1 -- 172.21.15.31:0/49471036 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c0b2040 con 0x7f0f1c0cb3a0 2024-09-17T05:28:56.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.649+0000 7f0f12000640 1 -- 172.21.15.31:0/49471036 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ef0001040 con 0x7f0f1c0cb3a0 2024-09-17T05:28:56.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.649+0000 7fc9b7200640 1 Processor -- start 2024-09-17T05:28:56.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.649+0000 7f6864c00640 1 -- 172.21.15.31:0/3703077979 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f685801a070 con 0x7f684c004810 2024-09-17T05:28:56.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.649+0000 7f0ff2a00640 1 --2- 172.21.15.31:0/1253252336 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0fd4073430 0x7f0fd40758f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0fec053a00 tx=0x7f0fe0007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.649+0000 7ff14f400640 1 -- 172.21.15.31:0/201703772 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff1500c1070 con 0x7ff15815e1a0 2024-09-17T05:28:56.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.649+0000 7fc9b7200640 1 -- start start 2024-09-17T05:28:56.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.649+0000 7f6864c00640 1 --2- 172.21.15.31:0/3703077979 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6848073200 0x7f68480756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f6864c00640 1 -- 172.21.15.31:0/3703077979 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f68580934b0 con 0x7f684c004810 2024-09-17T05:28:56.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f6864c00640 1 --2- 172.21.15.31:0/3703077979 >> [v2:172.21.15.31:6808/2661812175,v1:172.21.15.31:6810/2661812175] conn(0x7f684807b3a0 0x7f684807d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f6864c00640 1 -- 172.21.15.31:0/3703077979 --> [v2:172.21.15.31:6808/2661812175,v1:172.21.15.31:6810/2661812175] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f684807de70 con 0x7f684807b3a0 2024-09-17T05:28:56.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f6864c00640 1 -- 172.21.15.31:0/3703077979 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f685809a050 con 0x7f684c004810 2024-09-17T05:28:56.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f6867e00640 1 --2- 172.21.15.31:0/3703077979 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6848073200 0x7f68480756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f0ff3e00640 1 --2- 172.21.15.31:0/1253252336 >> [v2:172.21.15.31:6824/1172069379,v1:172.21.15.31:6825/1172069379] conn(0x7f0fd407b650 0x7f0fd407da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f0ff3e00640 1 --2- 172.21.15.31:0/1253252336 >> [v2:172.21.15.31:6824/1172069379,v1:172.21.15.31:6825/1172069379] conn(0x7f0fd407b650 0x7f0fd407da70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.649+0000 7fc9b7200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b8072a50 0x7fc9b8153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b7200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b80cfe50 0x7fc9b814eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b8072a50 0x7fc9b8153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b7200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9b81594a0 0x7fc9b814f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b5400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b80cfe50 0x7fc9b814eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b5400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b80cfe50 0x7fc9b814eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:49860/0 (socket says 172.21.15.31:49860) 2024-09-17T05:28:56.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b8072a50 0x7fc9b8153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42206/0 (socket says 172.21.15.31:42206) 2024-09-17T05:28:56.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b5400640 1 -- 172.21.15.31:0/2483391107 learned_addr learned my addr 172.21.15.31:0/2483391107 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:56.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b7200640 1 -- 172.21.15.31:0/2483391107 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b8167430 con 0x7fc9b8072a50 2024-09-17T05:28:56.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b6800640 1 --2- 172.21.15.31:0/2483391107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9b81594a0 0x7fc9b814f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b7200640 1 -- 172.21.15.31:0/2483391107 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b81672b0 con 0x7fc9b81594a0 2024-09-17T05:28:56.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.649+0000 7f3e35600640 1 -- 172.21.15.31:0/4263217292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e3006d260 msgr2=0x7f3e30159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.649+0000 7f3e35600640 1 --2- 172.21.15.31:0/4263217292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e3006d260 0x7f3e30159870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3e300c4530 tx=0x7f3e2801cd50 comp rx=0 tx=0).stop 2024-09-17T05:28:56.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f3e35600640 1 -- 172.21.15.31:0/4263217292 shutdown_connections 2024-09-17T05:28:56.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f3e35600640 1 --2- 172.21.15.31:0/4263217292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e3006d260 0x7f3e30159870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f3e35600640 1 --2- 172.21.15.31:0/4263217292 >> v2:172.21.15.31:3300/0 conn(0x7f3e300cc600 0x7f3e30159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f3e35600640 1 -- 172.21.15.31:0/4263217292 >> 172.21.15.31:0/4263217292 conn(0x7f3e3006dd30 msgr2=0x7f3e3006e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b7200640 1 -- 172.21.15.31:0/2483391107 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc9b81675b0 con 0x7fc9b80cfe50 2024-09-17T05:28:56.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f686d800640 1 --2- 172.21.15.31:0/3703077979 >> [v2:172.21.15.31:6808/2661812175,v1:172.21.15.31:6810/2661812175] conn(0x7f684807b3a0 0x7f684807d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f0fe7400640 1 -- 172.21.15.31:0/1253252336 <== osd.2 v2:172.21.15.31:6824/1172069379 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0fe80a6910 con 0x7f0fd407b650 2024-09-17T05:28:56.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.649+0000 7f0f18c00640 1 -- 172.21.15.31:0/49471036 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0f0c003a50 con 0x7f0f1c0cb3a0 2024-09-17T05:28:56.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f0f18c00640 1 --2- 172.21.15.31:0/49471036 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0efc073200 0x7f0efc0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f0f18c00640 1 -- 172.21.15.31:0/49471036 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0f0c003d40 con 0x7f0f1c0cb3a0 2024-09-17T05:28:56.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f0f1be00640 1 --2- 172.21.15.31:0/49471036 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0efc073200 0x7f0efc0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f0f18c00640 1 --2- 172.21.15.31:0/49471036 >> [v2:172.21.15.31:6809/2225281127,v1:172.21.15.31:6811/2225281127] conn(0x7f0efc07c070 0x7f0efc07e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f0f18c00640 1 -- 172.21.15.31:0/49471036 --> [v2:172.21.15.31:6809/2225281127,v1:172.21.15.31:6811/2225281127] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0efc07ebe0 con 0x7f0efc07c070 2024-09-17T05:28:56.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f0f18c00640 1 -- 172.21.15.31:0/49471036 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0f0c0f5000 con 0x7f0f1c0cb3a0 2024-09-17T05:28:56.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f0f1be00640 1 --2- 172.21.15.31:0/49471036 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0efc073200 0x7f0efc0756c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c15b210 tx=0x7f0f08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f0f21400640 1 --2- 172.21.15.31:0/49471036 >> [v2:172.21.15.31:6809/2225281127,v1:172.21.15.31:6811/2225281127] conn(0x7f0efc07c070 0x7f0efc07e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7ff14f400640 1 --2- 172.21.15.31:0/201703772 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff138073230 0x7ff1380756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7ff14f400640 1 -- 172.21.15.31:0/201703772 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff1501314e0 con 0x7ff15815e1a0 2024-09-17T05:28:56.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7ff14f400640 1 --2- 172.21.15.31:0/201703772 >> [v2:172.21.15.155:6800/4024510825,v1:172.21.15.155:6801/4024510825] conn(0x7ff13807b3d0 0x7ff13807d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7ff14f400640 1 -- 172.21.15.31:0/201703772 --> [v2:172.21.15.155:6800/4024510825,v1:172.21.15.155:6801/4024510825] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff13807dea0 con 0x7ff13807b3d0 2024-09-17T05:28:56.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7ff14f400640 1 -- 172.21.15.31:0/201703772 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff150131890 con 0x7ff15815e1a0 2024-09-17T05:28:56.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7ff157400640 1 --2- 172.21.15.31:0/201703772 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff138073230 0x7ff1380756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7ff156a00640 1 --2- 172.21.15.31:0/201703772 >> [v2:172.21.15.155:6800/4024510825,v1:172.21.15.155:6801/4024510825] conn(0x7ff13807b3d0 0x7ff13807d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7ff156a00640 1 --2- 172.21.15.31:0/201703772 >> [v2:172.21.15.155:6800/4024510825,v1:172.21.15.155:6801/4024510825] conn(0x7ff13807b3d0 0x7ff13807d7f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7ff157400640 1 --2- 172.21.15.31:0/201703772 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff138073230 0x7ff1380756f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff148000f70 tx=0x7ff148009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b6800640 1 -- 172.21.15.31:0/2483391107 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b80cfe50 msgr2=0x7fc9b814eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b6800640 1 --2- 172.21.15.31:0/2483391107 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc9b80cfe50 0x7fc9b814eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b6800640 1 -- 172.21.15.31:0/2483391107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b8072a50 msgr2=0x7fc9b8153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b6800640 1 --2- 172.21.15.31:0/2483391107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc9b8072a50 0x7fc9b8153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b6800640 1 -- 172.21.15.31:0/2483391107 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b81fc420 con 0x7fc9b81594a0 2024-09-17T05:28:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b6800640 1 --2- 172.21.15.31:0/2483391107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9b81594a0 0x7fc9b814f070 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000cb10 tx=0x7fc9b000cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9ae000640 1 -- 172.21.15.31:0/2483391107 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0016020 con 0x7fc9b81594a0 2024-09-17T05:28:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9ae000640 1 -- 172.21.15.31:0/2483391107 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9b000ce50 con 0x7fc9b81594a0 2024-09-17T05:28:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9ae000640 1 -- 172.21.15.31:0/2483391107 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b000ae00 con 0x7fc9b81594a0 2024-09-17T05:28:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b7200640 1 -- 172.21.15.31:0/2483391107 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b8159960 con 0x7fc9b81594a0 2024-09-17T05:28:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7fc9b7200640 1 -- 172.21.15.31:0/2483391107 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b81fc9a0 con 0x7fc9b81594a0 2024-09-17T05:28:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f3e35600640 1 -- 172.21.15.31:0/4263217292 shutdown_connections 2024-09-17T05:28:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f3e35600640 1 -- 172.21.15.31:0/4263217292 wait complete. 2024-09-17T05:28:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e35600640 1 Processor -- start 2024-09-17T05:28:56.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.653+0000 7f6867e00640 1 --2- 172.21.15.31:0/3703077979 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6848073200 0x7f68480756c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6854001060 tx=0x7f68540a7040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f686d800640 1 --2- 172.21.15.31:0/3703077979 >> [v2:172.21.15.31:6808/2661812175,v1:172.21.15.31:6810/2661812175] conn(0x7f684807b3a0 0x7f684807d7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f0f21400640 1 --2- 172.21.15.31:0/49471036 >> [v2:172.21.15.31:6809/2225281127,v1:172.21.15.31:6811/2225281127] conn(0x7f0efc07c070 0x7f0efc07e510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7ff14f400640 1 -- 172.21.15.31:0/201703772 <== osd.5 v2:172.21.15.155:6800/4024510825 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff13807dea0 con 0x7ff13807b3d0 2024-09-17T05:28:56.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e35600640 1 -- start start 2024-09-17T05:28:56.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7fc9b7200640 1 -- 172.21.15.31:0/2483391107 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9b815ac30 con 0x7fc9b81594a0 2024-09-17T05:28:56.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f0f18c00640 1 -- 172.21.15.31:0/49471036 <== osd.3 v2:172.21.15.31:6809/2225281127 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0efc07ebe0 con 0x7f0efc07c070 2024-09-17T05:28:56.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e35600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e3006ce80 0x7f3e300c3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e35600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3006d260 0x7f3e30154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e35600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e300cc600 0x7f3e30153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e35600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3015c9a0 con 0x7f3e3006d260 2024-09-17T05:28:56.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e35600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3015c820 con 0x7f3e300cc600 2024-09-17T05:28:56.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e35600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3e3015cb20 con 0x7f3e3006ce80 2024-09-17T05:28:56.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e2fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e3006ce80 0x7f3e300c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e34c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e300cc600 0x7f3e30153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e34c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e300cc600 0x7f3e30153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:58384/0 (socket says 172.21.15.31:58384) 2024-09-17T05:28:56.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e34c00640 1 -- 172.21.15.31:0/3048163841 learned_addr learned my addr 172.21.15.31:0/3048163841 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:56.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f6864c00640 1 -- 172.21.15.31:0/3703077979 <== osd.1 v2:172.21.15.31:6808/2661812175 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f684807de70 con 0x7f684807b3a0 2024-09-17T05:28:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e2f400640 1 --2- 172.21.15.31:0/3048163841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3006d260 0x7f3e30154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e34c00640 1 -- 172.21.15.31:0/3048163841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e3006ce80 msgr2=0x7f3e300c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e34c00640 1 --2- 172.21.15.31:0/3048163841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e3006ce80 0x7f3e300c3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e34c00640 1 -- 172.21.15.31:0/3048163841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3006d260 msgr2=0x7f3e30154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e34c00640 1 --2- 172.21.15.31:0/3048163841 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3e3006d260 0x7f3e30154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e34c00640 1 -- 172.21.15.31:0/3048163841 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e30071810 con 0x7f3e300cc600 2024-09-17T05:28:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7fc9ae000640 1 -- 172.21.15.31:0/2483391107 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc9b0019020 con 0x7fc9b81594a0 2024-09-17T05:28:56.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.661+0000 7fc9ae000640 1 --2- 172.21.15.31:0/2483391107 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc998073300 0x7fc9980757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.661+0000 7fc9ae000640 1 -- 172.21.15.31:0/2483391107 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc9b0094020 con 0x7fc9b81594a0 2024-09-17T05:28:56.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.661+0000 7fc9ae000640 1 --2- 172.21.15.31:0/2483391107 >> [v2:172.21.15.155:6818/1112531135,v1:172.21.15.155:6819/1112531135] conn(0x7fc99807b580 0x7fc99807d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.661+0000 7fc9b5e00640 1 --2- 172.21.15.31:0/2483391107 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc998073300 0x7fc9980757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.661+0000 7fc9b5400640 1 --2- 172.21.15.31:0/2483391107 >> [v2:172.21.15.155:6818/1112531135,v1:172.21.15.155:6819/1112531135] conn(0x7fc99807b580 0x7fc99807d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.661+0000 7fc9ae000640 1 -- 172.21.15.31:0/2483391107 --> [v2:172.21.15.155:6818/1112531135,v1:172.21.15.155:6819/1112531135] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9b0004800 con 0x7fc99807b580 2024-09-17T05:28:56.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.661+0000 7fc9ae000640 1 -- 172.21.15.31:0/2483391107 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc9b009b050 con 0x7fc9b81594a0 2024-09-17T05:28:56.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.665+0000 7fc9b5e00640 1 --2- 172.21.15.31:0/2483391107 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc998073300 0x7fc9980757c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80058d0 tx=0x7fc9a800a2d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e34c00640 1 --2- 172.21.15.31:0/3048163841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e300cc600 0x7f3e30153a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3e28009bd0 tx=0x7f3e280a5af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.657+0000 7f3e27e00640 1 -- 172.21.15.31:0/3048163841 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e280bb070 con 0x7f3e300cc600 2024-09-17T05:28:56.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.661+0000 7f3e27e00640 1 -- 172.21.15.31:0/3048163841 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e28004d40 con 0x7f3e300cc600 2024-09-17T05:28:56.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.661+0000 7f3e27e00640 1 -- 172.21.15.31:0/3048163841 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e280b2040 con 0x7f3e300cc600 2024-09-17T05:28:56.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.661+0000 7f3e35600640 1 -- 172.21.15.31:0/3048163841 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e300b3a90 con 0x7f3e300cc600 2024-09-17T05:28:56.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.661+0000 7f3e35600640 1 -- 172.21.15.31:0/3048163841 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e30153f50 con 0x7f3e300cc600 2024-09-17T05:28:56.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.665+0000 7f3e27e00640 1 -- 172.21.15.31:0/3048163841 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f3e280be070 con 0x7f3e300cc600 2024-09-17T05:28:56.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.665+0000 7f3e27e00640 1 --2- 172.21.15.31:0/3048163841 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3e10073250 0x7f3e10075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.665+0000 7f3e27e00640 1 -- 172.21.15.31:0/3048163841 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3e280a5cf0 con 0x7f3e300cc600 2024-09-17T05:28:56.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.665+0000 7f3e2fe00640 1 --2- 172.21.15.31:0/3048163841 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3e10073250 0x7f3e10075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.669+0000 7f3e35600640 1 --2- 172.21.15.31:0/3048163841 >> [v2:172.21.15.155:6826/4001062257,v1:172.21.15.155:6827/4001062257] conn(0x7f3e08001660 0x7f3e08003b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.669+0000 7f3e35600640 1 -- 172.21.15.31:0/3048163841 --> [v2:172.21.15.155:6826/4001062257,v1:172.21.15.155:6827/4001062257] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e08006bc0 con 0x7f3e08001660 2024-09-17T05:28:56.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.669+0000 7fc9b5400640 1 --2- 172.21.15.31:0/2483391107 >> [v2:172.21.15.155:6818/1112531135,v1:172.21.15.155:6819/1112531135] conn(0x7fc99807b580 0x7fc99807d9a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.669+0000 7f3e2fe00640 1 --2- 172.21.15.31:0/3048163841 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3e10073250 0x7f3e10075710 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3e20004e30 tx=0x7f3e20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.669+0000 7f3e2f400640 1 --2- 172.21.15.31:0/3048163841 >> [v2:172.21.15.155:6826/4001062257,v1:172.21.15.155:6827/4001062257] conn(0x7f3e08001660 0x7f3e08003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.669+0000 7f3e2f400640 1 --2- 172.21.15.31:0/3048163841 >> [v2:172.21.15.155:6826/4001062257,v1:172.21.15.155:6827/4001062257] conn(0x7f3e08001660 0x7f3e08003b20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.669+0000 7fc9ae000640 1 -- 172.21.15.31:0/2483391107 <== osd.6 v2:172.21.15.155:6818/1112531135 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9b0004800 con 0x7fc99807b580 2024-09-17T05:28:56.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.669+0000 7f3e27e00640 1 -- 172.21.15.31:0/3048163841 <== osd.7 v2:172.21.15.155:6826/4001062257 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3e08006bc0 con 0x7f3e08001660 2024-09-17T05:28:56.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7ffa6d800640 1 -- 172.21.15.31:0/2168619124 --> [v2:172.21.15.31:6800/2294581293,v1:172.21.15.31:6801/2294581293] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffa6004f930 con 0x7ffa4807b520 2024-09-17T05:28:56.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7f0f35e00640 1 -- 172.21.15.31:0/1818862669 --> [v2:172.21.15.155:6810/3398816604,v1:172.21.15.155:6811/3398816604] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0f08002de0 con 0x7f0f1007b3a0 2024-09-17T05:28:56.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7ffa5ea00640 1 -- 172.21.15.31:0/2168619124 <== osd.0 v2:172.21.15.31:6800/2294581293 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ffa6004f930 con 0x7ffa4807b520 2024-09-17T05:28:56.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7f0f27400640 1 -- 172.21.15.31:0/1818862669 <== osd.4 v2:172.21.15.155:6810/3398816604 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0f08002de0 con 0x7f0f1007b3a0 2024-09-17T05:28:56.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7ffa6d800640 1 -- 172.21.15.31:0/2168619124 >> [v2:172.21.15.31:6800/2294581293,v1:172.21.15.31:6801/2294581293] conn(0x7ffa4807b520 msgr2=0x7ffa4807d940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7ffa6d800640 1 --2- 172.21.15.31:0/2168619124 >> [v2:172.21.15.31:6800/2294581293,v1:172.21.15.31:6801/2294581293] conn(0x7ffa4807b520 0x7ffa4807d940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7ffa6d800640 1 -- 172.21.15.31:0/2168619124 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffa48073300 msgr2=0x7ffa480757c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7ffa6d800640 1 --2- 172.21.15.31:0/2168619124 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffa48073300 0x7ffa480757c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffa58001650 tx=0x7ffa58009040 comp rx=0 tx=0).stop 2024-09-17T05:28:56.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7ffa6d800640 1 -- 172.21.15.31:0/2168619124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa600e6e60 msgr2=0x7ffa600df490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7ffa6d800640 1 --2- 172.21.15.31:0/2168619124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa600e6e60 0x7ffa600df490 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400d750 tx=0x7ffa5400dc10 comp rx=0 tx=0).stop 2024-09-17T05:28:56.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7ffa67400640 1 -- 172.21.15.31:0/2168619124 reap_dead start 2024-09-17T05:28:56.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7ffa6d800640 1 -- 172.21.15.31:0/2168619124 shutdown_connections 2024-09-17T05:28:56.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7ffa6d800640 1 -- 172.21.15.31:0/2168619124 >> 172.21.15.31:0/2168619124 conn(0x7ffa6003a3e0 msgr2=0x7ffa6003c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7f0f35e00640 1 -- 172.21.15.31:0/1818862669 >> [v2:172.21.15.155:6810/3398816604,v1:172.21.15.155:6811/3398816604] conn(0x7f0f1007b3a0 msgr2=0x7f0f1007d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7f0f35e00640 1 --2- 172.21.15.31:0/1818862669 >> [v2:172.21.15.155:6810/3398816604,v1:172.21.15.155:6811/3398816604] conn(0x7f0f1007b3a0 0x7f0f1007d7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7f0f35e00640 1 -- 172.21.15.31:0/1818862669 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0f10073200 msgr2=0x7f0f100756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7f0f35e00640 1 --2- 172.21.15.31:0/1818862669 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0f10073200 0x7f0f100756c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c006fd0 tx=0x7f0f1c008040 comp rx=0 tx=0).stop 2024-09-17T05:28:56.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7f0f35e00640 1 -- 172.21.15.31:0/1818862669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f300cfc50 msgr2=0x7f0f30204560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7f0f35e00640 1 --2- 172.21.15.31:0/1818862669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f300cfc50 0x7f0f30204560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0f20019350 tx=0x7f0f20005db0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7ffa6d800640 1 -- 172.21.15.31:0/2168619124 shutdown_connections 2024-09-17T05:28:56.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7ffa6d800640 1 -- 172.21.15.31:0/2168619124 wait complete. 2024-09-17T05:28:56.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7f0f2f400640 1 -- 172.21.15.31:0/1818862669 reap_dead start 2024-09-17T05:28:56.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7f0f35e00640 1 -- 172.21.15.31:0/1818862669 shutdown_connections 2024-09-17T05:28:56.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7f0f35e00640 1 -- 172.21.15.31:0/1818862669 >> 172.21.15.31:0/1818862669 conn(0x7f0f300d3fb0 msgr2=0x7f0f300b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7f0f35e00640 1 -- 172.21.15.31:0/1818862669 shutdown_connections 2024-09-17T05:28:56.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.681+0000 7f0f35e00640 1 -- 172.21.15.31:0/1818862669 wait complete. 2024-09-17T05:28:56.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.685+0000 7f0ffa800640 1 -- 172.21.15.31:0/1253252336 --> [v2:172.21.15.31:6824/1172069379,v1:172.21.15.31:6825/1172069379] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0fec0373c0 con 0x7f0fd407b650 2024-09-17T05:28:56.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.685+0000 7fc9b7200640 1 -- 172.21.15.31:0/2483391107 --> [v2:172.21.15.155:6818/1112531135,v1:172.21.15.155:6819/1112531135] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc9b80cc5c0 con 0x7fc99807b580 2024-09-17T05:28:56.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7f0fe7400640 1 -- 172.21.15.31:0/1253252336 <== osd.2 v2:172.21.15.31:6824/1172069379 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0fec0373c0 con 0x7f0fd407b650 2024-09-17T05:28:56.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7fc9ae000640 1 -- 172.21.15.31:0/2483391107 <== osd.6 v2:172.21.15.155:6818/1112531135 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc9b80cc5c0 con 0x7fc99807b580 2024-09-17T05:28:56.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7f0ffa800640 1 -- 172.21.15.31:0/1253252336 >> [v2:172.21.15.31:6824/1172069379,v1:172.21.15.31:6825/1172069379] conn(0x7f0fd407b650 msgr2=0x7f0fd407da70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7f0ffa800640 1 --2- 172.21.15.31:0/1253252336 >> [v2:172.21.15.31:6824/1172069379,v1:172.21.15.31:6825/1172069379] conn(0x7f0fd407b650 0x7f0fd407da70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7f0ffa800640 1 -- 172.21.15.31:0/1253252336 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0fd4073430 msgr2=0x7f0fd40758f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7f0ffa800640 1 --2- 172.21.15.31:0/1253252336 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0fd4073430 0x7f0fd40758f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0fec053a00 tx=0x7f0fe0007ea0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7f0ffa800640 1 -- 172.21.15.31:0/1253252336 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fec007780 msgr2=0x7f0fec0d2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7f0ffa800640 1 --2- 172.21.15.31:0/1253252336 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fec007780 0x7f0fec0d2ae0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8019420 tx=0x7f0fe8005130 comp rx=0 tx=0).stop 2024-09-17T05:28:56.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7f0ff3e00640 1 -- 172.21.15.31:0/1253252336 reap_dead start 2024-09-17T05:28:56.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7f0ffa800640 1 -- 172.21.15.31:0/1253252336 shutdown_connections 2024-09-17T05:28:56.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7ff15e800640 1 -- 172.21.15.31:0/201703772 --> [v2:172.21.15.155:6800/4024510825,v1:172.21.15.155:6801/4024510825] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff1580b5f70 con 0x7ff13807b3d0 2024-09-17T05:28:56.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7fc9b7200640 1 -- 172.21.15.31:0/2483391107 >> [v2:172.21.15.155:6818/1112531135,v1:172.21.15.155:6819/1112531135] conn(0x7fc99807b580 msgr2=0x7fc99807d9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7fc9b7200640 1 --2- 172.21.15.31:0/2483391107 >> [v2:172.21.15.155:6818/1112531135,v1:172.21.15.155:6819/1112531135] conn(0x7fc99807b580 0x7fc99807d9a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7fc9b7200640 1 -- 172.21.15.31:0/2483391107 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc998073300 msgr2=0x7fc9980757c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7fc9b7200640 1 --2- 172.21.15.31:0/2483391107 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc998073300 0x7fc9980757c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80058d0 tx=0x7fc9a800a2d0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7fc9b7200640 1 -- 172.21.15.31:0/2483391107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9b81594a0 msgr2=0x7fc9b814f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7fc9b7200640 1 --2- 172.21.15.31:0/2483391107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9b81594a0 0x7fc9b814f070 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000cb10 tx=0x7fc9b000cc00 comp rx=0 tx=0).stop 2024-09-17T05:28:56.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7fc9b6800640 1 -- 172.21.15.31:0/2483391107 reap_dead start 2024-09-17T05:28:56.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7fc9b7200640 1 -- 172.21.15.31:0/2483391107 shutdown_connections 2024-09-17T05:28:56.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7fc9b7200640 1 -- 172.21.15.31:0/2483391107 >> 172.21.15.31:0/2483391107 conn(0x7fc9b806cc20 msgr2=0x7fc9b80b3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7fc9b7200640 1 -- 172.21.15.31:0/2483391107 shutdown_connections 2024-09-17T05:28:56.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7f0ffa800640 1 -- 172.21.15.31:0/1253252336 >> 172.21.15.31:0/1253252336 conn(0x7f0fec056720 msgr2=0x7f0fec00d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7fc9b7200640 1 -- 172.21.15.31:0/2483391107 wait complete. 2024-09-17T05:28:56.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7f0f12000640 1 -- 172.21.15.31:0/49471036 --> [v2:172.21.15.31:6809/2225281127,v1:172.21.15.31:6811/2225281127] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0ef0002de0 con 0x7f0efc07c070 2024-09-17T05:28:56.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7f0ffa800640 1 -- 172.21.15.31:0/1253252336 shutdown_connections 2024-09-17T05:28:56.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7f0ffa800640 1 -- 172.21.15.31:0/1253252336 wait complete. 2024-09-17T05:28:56.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7ff14f400640 1 -- 172.21.15.31:0/201703772 <== osd.5 v2:172.21.15.155:6800/4024510825 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff1580b5f70 con 0x7ff13807b3d0 2024-09-17T05:28:56.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7f686f800640 1 -- 172.21.15.31:0/3703077979 --> [v2:172.21.15.31:6808/2661812175,v1:172.21.15.31:6810/2661812175] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6840002de0 con 0x7f684807b3a0 2024-09-17T05:28:56.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7f0f18c00640 1 -- 172.21.15.31:0/49471036 <== osd.3 v2:172.21.15.31:6809/2225281127 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0ef0002de0 con 0x7f0efc07c070 2024-09-17T05:28:56.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.689+0000 7ff15e800640 1 -- 172.21.15.31:0/201703772 >> [v2:172.21.15.155:6800/4024510825,v1:172.21.15.155:6801/4024510825] conn(0x7ff13807b3d0 msgr2=0x7ff13807d7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7ff15e800640 1 --2- 172.21.15.31:0/201703772 >> [v2:172.21.15.155:6800/4024510825,v1:172.21.15.155:6801/4024510825] conn(0x7ff13807b3d0 0x7ff13807d7f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7f6864c00640 1 -- 172.21.15.31:0/3703077979 <== osd.1 v2:172.21.15.31:6808/2661812175 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6840002de0 con 0x7f684807b3a0 2024-09-17T05:28:56.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7f0f12000640 1 -- 172.21.15.31:0/49471036 >> [v2:172.21.15.31:6809/2225281127,v1:172.21.15.31:6811/2225281127] conn(0x7f0efc07c070 msgr2=0x7f0efc07e510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7f0f12000640 1 --2- 172.21.15.31:0/49471036 >> [v2:172.21.15.31:6809/2225281127,v1:172.21.15.31:6811/2225281127] conn(0x7f0efc07c070 0x7f0efc07e510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7ff15e800640 1 -- 172.21.15.31:0/201703772 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff138073230 msgr2=0x7ff1380756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7ff15e800640 1 --2- 172.21.15.31:0/201703772 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff138073230 0x7ff1380756f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff148000f70 tx=0x7ff148009040 comp rx=0 tx=0).stop 2024-09-17T05:28:56.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7ff15e800640 1 -- 172.21.15.31:0/201703772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff15815e1a0 msgr2=0x7ff15809d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7ff15e800640 1 --2- 172.21.15.31:0/201703772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff15815e1a0 0x7ff15809d220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff1500ac000 tx=0x7ff150004a50 comp rx=0 tx=0).stop 2024-09-17T05:28:56.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7f0f12000640 1 -- 172.21.15.31:0/49471036 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0efc073200 msgr2=0x7f0efc0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7f0f12000640 1 --2- 172.21.15.31:0/49471036 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0efc073200 0x7f0efc0756c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c15b210 tx=0x7f0f08009040 comp rx=0 tx=0).stop 2024-09-17T05:28:56.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7f0f12000640 1 -- 172.21.15.31:0/49471036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f1c0cb3a0 msgr2=0x7f0f1c1550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7f0f12000640 1 --2- 172.21.15.31:0/49471036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f1c0cb3a0 0x7f0f1c1550e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c0194d0 tx=0x7f0f0c0a57d0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7f0f21400640 1 -- 172.21.15.31:0/49471036 reap_dead start 2024-09-17T05:28:56.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7f0f12000640 1 -- 172.21.15.31:0/49471036 shutdown_connections 2024-09-17T05:28:56.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7f0f12000640 1 -- 172.21.15.31:0/49471036 >> 172.21.15.31:0/49471036 conn(0x7f0f1c0d0d50 msgr2=0x7f0f1c06fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7ff157e00640 1 -- 172.21.15.31:0/201703772 reap_dead start 2024-09-17T05:28:56.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7ff15e800640 1 -- 172.21.15.31:0/201703772 shutdown_connections 2024-09-17T05:28:56.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7ff15e800640 1 -- 172.21.15.31:0/201703772 >> 172.21.15.31:0/201703772 conn(0x7ff1580cfff0 msgr2=0x7ff1580ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7f0f12000640 1 -- 172.21.15.31:0/49471036 shutdown_connections 2024-09-17T05:28:56.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7f0f12000640 1 -- 172.21.15.31:0/49471036 wait complete. 2024-09-17T05:28:56.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7f686f800640 1 -- 172.21.15.31:0/3703077979 >> [v2:172.21.15.31:6808/2661812175,v1:172.21.15.31:6810/2661812175] conn(0x7f684807b3a0 msgr2=0x7f684807d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.693+0000 7f686f800640 1 --2- 172.21.15.31:0/3703077979 >> [v2:172.21.15.31:6808/2661812175,v1:172.21.15.31:6810/2661812175] conn(0x7f684807b3a0 0x7f684807d7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.697+0000 7ff15e800640 1 -- 172.21.15.31:0/201703772 shutdown_connections 2024-09-17T05:28:56.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.697+0000 7ff15e800640 1 -- 172.21.15.31:0/201703772 wait complete. 2024-09-17T05:28:56.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f686f800640 1 -- 172.21.15.31:0/3703077979 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6848073200 msgr2=0x7f68480756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f686f800640 1 --2- 172.21.15.31:0/3703077979 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6848073200 0x7f68480756c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6854001060 tx=0x7f68540a7040 comp rx=0 tx=0).stop 2024-09-17T05:28:56.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f686f800640 1 -- 172.21.15.31:0/3703077979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f684c004810 msgr2=0x7f68680742b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f686f800640 1 --2- 172.21.15.31:0/3703077979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f684c004810 0x7f68680742b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f685800c520 tx=0x7f685800c9e0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f686d800640 1 -- 172.21.15.31:0/3703077979 reap_dead start 2024-09-17T05:28:56.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f686f800640 1 -- 172.21.15.31:0/3703077979 shutdown_connections 2024-09-17T05:28:56.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f686f800640 1 -- 172.21.15.31:0/3703077979 >> 172.21.15.31:0/3703077979 conn(0x7f68680b18f0 msgr2=0x7f686815c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f686f800640 1 -- 172.21.15.31:0/3703077979 shutdown_connections 2024-09-17T05:28:56.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f686f800640 1 -- 172.21.15.31:0/3703077979 wait complete. 2024-09-17T05:28:56.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f3e35600640 1 -- 172.21.15.31:0/3048163841 --> [v2:172.21.15.155:6826/4001062257,v1:172.21.15.155:6827/4001062257] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3e08005ca0 con 0x7f3e08001660 2024-09-17T05:28:56.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f3e27e00640 1 -- 172.21.15.31:0/3048163841 <== osd.7 v2:172.21.15.155:6826/4001062257 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3e08005ca0 con 0x7f3e08001660 2024-09-17T05:28:56.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f3e35600640 1 -- 172.21.15.31:0/3048163841 >> [v2:172.21.15.155:6826/4001062257,v1:172.21.15.155:6827/4001062257] conn(0x7f3e08001660 msgr2=0x7f3e08003b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f3e35600640 1 --2- 172.21.15.31:0/3048163841 >> [v2:172.21.15.155:6826/4001062257,v1:172.21.15.155:6827/4001062257] conn(0x7f3e08001660 0x7f3e08003b20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f3e35600640 1 -- 172.21.15.31:0/3048163841 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3e10073250 msgr2=0x7f3e10075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f3e35600640 1 --2- 172.21.15.31:0/3048163841 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3e10073250 0x7f3e10075710 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3e20004e30 tx=0x7f3e20009040 comp rx=0 tx=0).stop 2024-09-17T05:28:56.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f3e35600640 1 -- 172.21.15.31:0/3048163841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e300cc600 msgr2=0x7f3e30153a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f3e35600640 1 --2- 172.21.15.31:0/3048163841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e300cc600 0x7f3e30153a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3e28009bd0 tx=0x7f3e280a5af0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f3e34c00640 1 -- 172.21.15.31:0/3048163841 reap_dead start 2024-09-17T05:28:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f3e35600640 1 -- 172.21.15.31:0/3048163841 shutdown_connections 2024-09-17T05:28:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f3e35600640 1 -- 172.21.15.31:0/3048163841 >> 172.21.15.31:0/3048163841 conn(0x7f3e3006dd30 msgr2=0x7f3e300b0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f3e35600640 1 -- 172.21.15.31:0/3048163841 shutdown_connections 2024-09-17T05:28:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.701+0000 7f3e35600640 1 -- 172.21.15.31:0/3048163841 wait complete. 2024-09-17T05:28:56.725 INFO:teuthology.orchestra.run.smithi031.stdout:60129542150 2024-09-17T05:28:56.725 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T05:28:56.735 INFO:teuthology.orchestra.run.smithi031.stdout:64424509448 2024-09-17T05:28:56.736 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T05:28:56.737 INFO:teuthology.orchestra.run.smithi031.stdout:64424509448 2024-09-17T05:28:56.738 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T05:28:56.740 INFO:teuthology.orchestra.run.smithi031.stdout:60129542151 2024-09-17T05:28:56.740 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T05:28:56.745 INFO:teuthology.orchestra.run.smithi031.stdout:64424509448 2024-09-17T05:28:56.746 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T05:28:56.749 INFO:teuthology.orchestra.run.smithi031.stdout:64424509446 2024-09-17T05:28:56.750 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T05:28:56.752 INFO:teuthology.orchestra.run.smithi031.stdout:64424509448 2024-09-17T05:28:56.752 INFO:teuthology.orchestra.run.smithi031.stdout:64424509447 2024-09-17T05:28:56.753 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T05:28:56.753 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T05:28:56.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.969+0000 7fb963200640 1 -- 172.21.15.31:0/3734432961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9640ae5d0 msgr2=0x7fb9640cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.969+0000 7fb963200640 1 --2- 172.21.15.31:0/3734432961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9640ae5d0 0x7fb9640cbeb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb9640741a0 tx=0x7fb95001dea0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.969+0000 7fb963200640 1 -- 172.21.15.31:0/3734432961 shutdown_connections 2024-09-17T05:28:56.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.969+0000 7fb963200640 1 --2- 172.21.15.31:0/3734432961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9640ae5d0 0x7fb9640cbeb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.969+0000 7fb963200640 1 --2- 172.21.15.31:0/3734432961 >> v2:172.21.15.31:3300/0 conn(0x7fb9640cd600 0x7fb9640cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.969+0000 7fb963200640 1 -- 172.21.15.31:0/3734432961 >> 172.21.15.31:0/3734432961 conn(0x7fb9640b1600 msgr2=0x7fb9640b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.969+0000 7fb963200640 1 -- 172.21.15.31:0/3734432961 shutdown_connections 2024-09-17T05:28:56.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.969+0000 7fb963200640 1 -- 172.21.15.31:0/3734432961 wait complete. 2024-09-17T05:28:56.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.973+0000 7fb963200640 1 Processor -- start 2024-09-17T05:28:56.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.977+0000 7fb963200640 1 -- start start 2024-09-17T05:28:56.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.977+0000 7fb963200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb96406e6e0 0x7fb9640c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.977+0000 7fb963200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9640ae5d0 0x7fb964172880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.977+0000 7fb963200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9640cd600 0x7fb9640ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.977+0000 7fb963200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb964177e00 con 0x7fb9640cd600 2024-09-17T05:28:56.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.977+0000 7fb963200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb964177c80 con 0x7fb9640ae5d0 2024-09-17T05:28:56.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.977+0000 7fb963200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb964177f80 con 0x7fb96406e6e0 2024-09-17T05:28:56.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.977+0000 7fb961400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9640ae5d0 0x7fb964172880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.977+0000 7fb961400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9640ae5d0 0x7fb964172880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:58402/0 (socket says 172.21.15.31:58402) 2024-09-17T05:28:56.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.977+0000 7fb961400640 1 -- 172.21.15.31:0/908213138 learned_addr learned my addr 172.21.15.31:0/908213138 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:56.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.977+0000 7fb961e00640 1 --2- 172.21.15.31:0/908213138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb96406e6e0 0x7fb9640c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.977+0000 7fb962800640 1 --2- 172.21.15.31:0/908213138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9640cd600 0x7fb9640ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.977+0000 7fb961400640 1 -- 172.21.15.31:0/908213138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb96406e6e0 msgr2=0x7fb9640c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.977+0000 7fb961400640 1 --2- 172.21.15.31:0/908213138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb96406e6e0 0x7fb9640c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.977+0000 7fb961400640 1 -- 172.21.15.31:0/908213138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9640cd600 msgr2=0x7fb9640ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.977+0000 7fb961400640 1 --2- 172.21.15.31:0/908213138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9640cd600 0x7fb9640ac670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.977+0000 7fb961400640 1 -- 172.21.15.31:0/908213138 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9640aa050 con 0x7fb9640ae5d0 2024-09-17T05:28:56.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.977+0000 7fb961400640 1 --2- 172.21.15.31:0/908213138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9640ae5d0 0x7fb964172880 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00ee20 tx=0x7fb95c00c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.981+0000 7fb95a000640 1 -- 172.21.15.31:0/908213138 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c01b070 con 0x7fb9640ae5d0 2024-09-17T05:28:56.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.981+0000 7fb95a000640 1 -- 172.21.15.31:0/908213138 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb95c00b860 con 0x7fb9640ae5d0 2024-09-17T05:28:56.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.981+0000 7fb95a000640 1 -- 172.21.15.31:0/908213138 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c00bc70 con 0x7fb9640ae5d0 2024-09-17T05:28:56.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.981+0000 7fb963200640 1 -- 172.21.15.31:0/908213138 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9640aa330 con 0x7fb9640ae5d0 2024-09-17T05:28:56.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.981+0000 7fb963200640 1 -- 172.21.15.31:0/908213138 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9640aa8f0 con 0x7fb9640ae5d0 2024-09-17T05:28:56.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.981+0000 7fb963200640 1 -- 172.21.15.31:0/908213138 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb96406eac0 con 0x7fb9640ae5d0 2024-09-17T05:28:56.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.981+0000 7f2255400640 1 -- 172.21.15.31:0/1735745434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f225006eeb0 msgr2=0x7f22500b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.981+0000 7f2255400640 1 --2- 172.21.15.31:0/1735745434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f225006eeb0 0x7f22500b3990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f223c009900 tx=0x7f223c01c8b0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.981+0000 7f2255400640 1 -- 172.21.15.31:0/1735745434 shutdown_connections 2024-09-17T05:28:56.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.981+0000 7f2255400640 1 --2- 172.21.15.31:0/1735745434 >> v2:172.21.15.31:3300/0 conn(0x7f22500b3ed0 0x7f22500ad300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.981+0000 7f2255400640 1 --2- 172.21.15.31:0/1735745434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f225006eeb0 0x7f22500b3990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.981+0000 7f2255400640 1 -- 172.21.15.31:0/1735745434 >> 172.21.15.31:0/1735745434 conn(0x7f22500b18f0 msgr2=0x7f22500b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.981+0000 7f2255400640 1 -- 172.21.15.31:0/1735745434 shutdown_connections 2024-09-17T05:28:56.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.981+0000 7f2255400640 1 -- 172.21.15.31:0/1735745434 wait complete. 2024-09-17T05:28:56.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.985+0000 7f2255400640 1 Processor -- start 2024-09-17T05:28:56.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.985+0000 7fb222c00640 1 -- 172.21.15.31:0/3561116687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c0cf570 msgr2=0x7fb21c072680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.985+0000 7fb222c00640 1 --2- 172.21.15.31:0/3561116687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c0cf570 0x7fb21c072680 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0cee80 tx=0x7fb20801d460 comp rx=0 tx=0).stop 2024-09-17T05:28:56.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.985+0000 7fb222c00640 1 -- 172.21.15.31:0/3561116687 shutdown_connections 2024-09-17T05:28:56.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.985+0000 7fb222c00640 1 --2- 172.21.15.31:0/3561116687 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c0cf570 0x7fb21c072680 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.985+0000 7fb222c00640 1 -- 172.21.15.31:0/3561116687 >> 172.21.15.31:0/3561116687 conn(0x7fb21c0cfa30 msgr2=0x7fb21c0cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.985+0000 7fb222c00640 1 -- 172.21.15.31:0/3561116687 shutdown_connections 2024-09-17T05:28:56.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.985+0000 7fb222c00640 1 -- 172.21.15.31:0/3561116687 wait complete. 2024-09-17T05:28:56.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.985+0000 7fb95a000640 1 -- 172.21.15.31:0/908213138 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb95c01e070 con 0x7fb9640ae5d0 2024-09-17T05:28:56.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.985+0000 7fb95a000640 1 --2- 172.21.15.31:0/908213138 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb944073230 0x7fb9440756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.985+0000 7fb95a000640 1 -- 172.21.15.31:0/908213138 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb95c0952d0 con 0x7fb9640ae5d0 2024-09-17T05:28:56.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.985+0000 7fb961e00640 1 --2- 172.21.15.31:0/908213138 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb944073230 0x7fb9440756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.985+0000 7f2255400640 1 -- start start 2024-09-17T05:28:56.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.989+0000 7fb95a000640 1 -- 172.21.15.31:0/908213138 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb95c05fd10 con 0x7fb9640ae5d0 2024-09-17T05:28:56.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.989+0000 7fb222c00640 1 Processor -- start 2024-09-17T05:28:56.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.989+0000 7fb961e00640 1 --2- 172.21.15.31:0/908213138 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb944073230 0x7fb9440756f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb954000f70 tx=0x7fb954009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:56.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.989+0000 7f2255400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f225006eeb0 0x7f225014a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.989+0000 7fccdf200640 1 -- 172.21.15.31:0/964870682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccd8033740 msgr2=0x7fccd80e70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.989+0000 7fccdf200640 1 --2- 172.21.15.31:0/964870682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccd8033740 0x7fccd80e70c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fccd0005fd0 tx=0x7fccd001c4b0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.989+0000 7fb222c00640 1 -- start start 2024-09-17T05:28:56.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.989+0000 7f2255400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22500b3ed0 0x7f225015fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.989+0000 7f2255400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2250161520 0x7f22501600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.989+0000 7fb222c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c0cd600 0x7fb21c0adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f224f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2250161520 0x7f22501600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f224f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2250161520 0x7f22501600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:58422/0 (socket says 172.21.15.31:58422) 2024-09-17T05:28:56.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f224e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f225006eeb0 0x7f225014a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f224e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f225006eeb0 0x7f225014a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42252/0 (socket says 172.21.15.31:42252) 2024-09-17T05:28:56.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f224e800640 1 -- 172.21.15.31:0/3520395330 learned_addr learned my addr 172.21.15.31:0/3520395330 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:56.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f2255400640 1 -- 172.21.15.31:0/3520395330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f225016b040 con 0x7f225006eeb0 2024-09-17T05:28:56.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f2255400640 1 -- 172.21.15.31:0/3520395330 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f225016aec0 con 0x7f2250161520 2024-09-17T05:28:56.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f2255400640 1 -- 172.21.15.31:0/3520395330 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f225016b1c0 con 0x7f22500b3ed0 2024-09-17T05:28:56.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f224de00640 1 --2- 172.21.15.31:0/3520395330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22500b3ed0 0x7f225015fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.989+0000 7fb222c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb21c0cf570 0x7fb21c1fb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.989+0000 7fb222c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb21c159cc0 0x7fb21c0c2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:56.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.989+0000 7fb222c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c06fa20 con 0x7fb21c0cd600 2024-09-17T05:28:56.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.989+0000 7fb222c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb21c06f8a0 con 0x7fb21c159cc0 2024-09-17T05:28:56.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.989+0000 7fb222c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb21c06fba0 con 0x7fb21c0cf570 2024-09-17T05:28:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7fb220e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb21c0cf570 0x7fb21c1fb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7fb220e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb21c0cf570 0x7fb21c1fb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:49906/0 (socket says 172.21.15.31:49906) 2024-09-17T05:28:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7fb220e00640 1 -- 172.21.15.31:0/2800957689 learned_addr learned my addr 172.21.15.31:0/2800957689 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7fb221800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c0cd600 0x7fb21c0adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7fb222200640 1 --2- 172.21.15.31:0/2800957689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb21c159cc0 0x7fb21c0c2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7fb220e00640 1 -- 172.21.15.31:0/2800957689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb21c159cc0 msgr2=0x7fb21c0c2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7fb220e00640 1 --2- 172.21.15.31:0/2800957689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb21c159cc0 0x7fb21c0c2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7fb220e00640 1 -- 172.21.15.31:0/2800957689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c0cd600 msgr2=0x7fb21c0adaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7fb220e00640 1 --2- 172.21.15.31:0/2800957689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c0cd600 0x7fb21c0adaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7fb220e00640 1 -- 172.21.15.31:0/2800957689 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21c0c48d0 con 0x7fb21c0cf570 2024-09-17T05:28:56.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7fb221800640 1 --2- 172.21.15.31:0/2800957689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c0cd600 0x7fb21c0adaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:28:56.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7fccdf200640 1 -- 172.21.15.31:0/964870682 shutdown_connections 2024-09-17T05:28:56.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7fccdf200640 1 --2- 172.21.15.31:0/964870682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccd8033740 0x7fccd80e70c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:56.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7fccdf200640 1 -- 172.21.15.31:0/964870682 >> 172.21.15.31:0/964870682 conn(0x7fccd801d780 msgr2=0x7fccd8054570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:56.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f224f200640 1 -- 172.21.15.31:0/3520395330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22500b3ed0 msgr2=0x7f225015fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f224f200640 1 --2- 172.21.15.31:0/3520395330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22500b3ed0 0x7f225015fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f224f200640 1 -- 172.21.15.31:0/3520395330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f225006eeb0 msgr2=0x7f225014a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f224f200640 1 --2- 172.21.15.31:0/3520395330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f225006eeb0 0x7f225014a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f224f200640 1 -- 172.21.15.31:0/3520395330 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2250160ae0 con 0x7f2250161520 2024-09-17T05:28:57.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f224f200640 1 --2- 172.21.15.31:0/3520395330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2250161520 0x7f22501600a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f224800ea60 tx=0x7f224800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:57.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f2246a00640 1 -- 172.21.15.31:0/3520395330 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224800ce40 con 0x7f2250161520 2024-09-17T05:28:57.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f2246a00640 1 -- 172.21.15.31:0/3520395330 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2248004c20 con 0x7f2250161520 2024-09-17T05:28:57.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f2246a00640 1 -- 172.21.15.31:0/3520395330 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248005020 con 0x7f2250161520 2024-09-17T05:28:57.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f2255400640 1 -- 172.21.15.31:0/3520395330 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2250150670 con 0x7f2250161520 2024-09-17T05:28:57.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7fccdf200640 1 -- 172.21.15.31:0/964870682 shutdown_connections 2024-09-17T05:28:57.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7fccdf200640 1 -- 172.21.15.31:0/964870682 wait complete. 2024-09-17T05:28:57.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7f2255400640 1 -- 172.21.15.31:0/3520395330 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f225014a7f0 con 0x7f2250161520 2024-09-17T05:28:57.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.993+0000 7fb220e00640 1 --2- 172.21.15.31:0/2800957689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb21c0cf570 0x7fb21c1fb710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb20801b090 tx=0x7fb208008c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:57.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.997+0000 7f2255400640 1 -- 172.21.15.31:0/3520395330 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22280052a0 con 0x7f2250161520 2024-09-17T05:28:57.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.997+0000 7fccdf200640 1 Processor -- start 2024-09-17T05:28:57.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.997+0000 7fccdf200640 1 -- start start 2024-09-17T05:28:57.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.997+0000 7f2246a00640 1 -- 172.21.15.31:0/3520395330 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f22480051c0 con 0x7f2250161520 2024-09-17T05:28:57.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:56.997+0000 7fccdf200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccd8033740 0x7fccd8032550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fb219600640 1 -- 172.21.15.31:0/2800957689 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb208005030 con 0x7fb21c0cf570 2024-09-17T05:28:57.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fb219600640 1 -- 172.21.15.31:0/2800957689 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2080052c0 con 0x7fb21c0cf570 2024-09-17T05:28:57.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fb219600640 1 -- 172.21.15.31:0/2800957689 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2080046d0 con 0x7fb21c0cf570 2024-09-17T05:28:57.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fb222c00640 1 -- 172.21.15.31:0/2800957689 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21c1fc0f0 con 0x7fb21c0cf570 2024-09-17T05:28:57.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fb222c00640 1 -- 172.21.15.31:0/2800957689 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb21c0c4b70 con 0x7fb21c0cf570 2024-09-17T05:28:57.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccdde00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccd8033740 0x7fccd8032550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccdde00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccd8033740 0x7fccd8032550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:58456/0 (socket says 172.21.15.31:58456) 2024-09-17T05:28:57.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccdf200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccd8036700 0x7fccd80e4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7f2246a00640 1 --2- 172.21.15.31:0/3520395330 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f22300732d0 0x7f2230075790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7f2246a00640 1 -- 172.21.15.31:0/3520395330 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2248094cf0 con 0x7f2250161520 2024-09-17T05:28:57.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccdde00640 1 -- 172.21.15.31:0/33327907 learned_addr learned my addr 172.21.15.31:0/33327907 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:57.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccdf200640 1 --2- 172.21.15.31:0/33327907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccd8055070 0x7fccd80e52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccdd400640 1 --2- 172.21.15.31:0/33327907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccd8036700 0x7fccd80e4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7f224e800640 1 --2- 172.21.15.31:0/3520395330 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f22300732d0 0x7f2230075790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccdf200640 1 -- 172.21.15.31:0/33327907 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fccd80f0dc0 con 0x7fccd8036700 2024-09-17T05:28:57.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccdf200640 1 -- 172.21.15.31:0/33327907 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fccd80f0c40 con 0x7fccd8033740 2024-09-17T05:28:57.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fb222c00640 1 -- 172.21.15.31:0/2800957689 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb21c072680 con 0x7fb21c0cf570 2024-09-17T05:28:57.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccde800640 1 --2- 172.21.15.31:0/33327907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccd8055070 0x7fccd80e52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccdf200640 1 -- 172.21.15.31:0/33327907 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fccd80f0f40 con 0x7fccd8055070 2024-09-17T05:28:57.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7f224e800640 1 --2- 172.21.15.31:0/3520395330 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f22300732d0 0x7f2230075790 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2240001870 tx=0x7f2240009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:57.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccde800640 1 -- 172.21.15.31:0/33327907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccd8033740 msgr2=0x7fccd8032550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccde800640 1 --2- 172.21.15.31:0/33327907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccd8033740 0x7fccd8032550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccde800640 1 -- 172.21.15.31:0/33327907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccd8036700 msgr2=0x7fccd80e4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccde800640 1 --2- 172.21.15.31:0/33327907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccd8036700 0x7fccd80e4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccde800640 1 -- 172.21.15.31:0/33327907 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd8032a90 con 0x7fccd8055070 2024-09-17T05:28:57.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccdd400640 1 --2- 172.21.15.31:0/33327907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccd8036700 0x7fccd80e4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:28:57.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccde800640 1 --2- 172.21.15.31:0/33327907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccd8055070 0x7fccd80e52b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcce0069ff0 tx=0x7fcce006a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:57.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccd6000640 1 -- 172.21.15.31:0/33327907 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0090070 con 0x7fccd8055070 2024-09-17T05:28:57.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccd6000640 1 -- 172.21.15.31:0/33327907 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcce0074720 con 0x7fccd8055070 2024-09-17T05:28:57.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccd6000640 1 -- 172.21.15.31:0/33327907 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0074bf0 con 0x7fccd8055070 2024-09-17T05:28:57.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fccdf200640 1 -- 172.21.15.31:0/33327907 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd80494e0 con 0x7fccd8055070 2024-09-17T05:28:57.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.005+0000 7fccdf200640 1 -- 172.21.15.31:0/33327907 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd8049aa0 con 0x7fccd8055070 2024-09-17T05:28:57.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.001+0000 7fb219600640 1 -- 172.21.15.31:0/2800957689 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb208004870 con 0x7fb21c0cf570 2024-09-17T05:28:57.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.005+0000 7fb219600640 1 --2- 172.21.15.31:0/2800957689 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb1fc073250 0x7fb1fc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.005+0000 7fb219600640 1 -- 172.21.15.31:0/2800957689 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb20812e310 con 0x7fb21c0cf570 2024-09-17T05:28:57.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.005+0000 7fb221800640 1 --2- 172.21.15.31:0/2800957689 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb1fc073250 0x7fb1fc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.005+0000 7f2246a00640 1 -- 172.21.15.31:0/3520395330 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f224805f7c0 con 0x7f2250161520 2024-09-17T05:28:57.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.005+0000 7fb6cb200640 1 -- 172.21.15.31:0/747745828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c40b3610 msgr2=0x7fb6c41433c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.005+0000 7fb6cb200640 1 --2- 172.21.15.31:0/747745828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c40b3610 0x7fb6c41433c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009870 tx=0x7fb6b401c7f0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.005+0000 7fb221800640 1 --2- 172.21.15.31:0/2800957689 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb1fc073250 0x7fb1fc075710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb2100046c0 tx=0x7fb210007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:57.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.005+0000 7fccdf200640 1 -- 172.21.15.31:0/33327907 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb80052a0 con 0x7fccd8055070 2024-09-17T05:28:57.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.005+0000 7fb6cb200640 1 -- 172.21.15.31:0/747745828 shutdown_connections 2024-09-17T05:28:57.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.005+0000 7fb6cb200640 1 --2- 172.21.15.31:0/747745828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c40b3610 0x7fb6c41433c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.005+0000 7fb6cb200640 1 -- 172.21.15.31:0/747745828 >> 172.21.15.31:0/747745828 conn(0x7fb6c406cc20 msgr2=0x7fb6c406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:57.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.005+0000 7fb6cb200640 1 -- 172.21.15.31:0/747745828 shutdown_connections 2024-09-17T05:28:57.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.005+0000 7fb6cb200640 1 -- 172.21.15.31:0/747745828 wait complete. 2024-09-17T05:28:57.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.009+0000 7fb6cb200640 1 Processor -- start 2024-09-17T05:28:57.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.009+0000 7fb6cb200640 1 -- start start 2024-09-17T05:28:57.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.009+0000 7fb219600640 1 -- 172.21.15.31:0/2800957689 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb2080c2020 con 0x7fb21c0cf570 2024-09-17T05:28:57.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.009+0000 7fb6cb200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6c40b3610 0x7fb6c413e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fb6cb200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c4142fe0 0x7fb6c40b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fb6cb200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6c4143900 0x7fb6c4157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fb6cb200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c416c5e0 con 0x7fb6c4143900 2024-09-17T05:28:57.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fb6cb200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c416c460 con 0x7fb6c4142fe0 2024-09-17T05:28:57.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fb6cb200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c416c760 con 0x7fb6c40b3610 2024-09-17T05:28:57.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fb6c9400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c4142fe0 0x7fb6c40b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fb6c9400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c4142fe0 0x7fb6c40b0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:58466/0 (socket says 172.21.15.31:58466) 2024-09-17T05:28:57.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fb6c9400640 1 -- 172.21.15.31:0/3811184882 learned_addr learned my addr 172.21.15.31:0/3811184882 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:57.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fb6ca800640 1 --2- 172.21.15.31:0/3811184882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6c4143900 0x7fb6c4157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fb6c9400640 1 -- 172.21.15.31:0/3811184882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6c40b3610 msgr2=0x7fb6c413e960 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:28:57.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fb6c9400640 1 --2- 172.21.15.31:0/3811184882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6c40b3610 0x7fb6c413e960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fb6c9400640 1 -- 172.21.15.31:0/3811184882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6c4143900 msgr2=0x7fb6c4157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fb6c9400640 1 --2- 172.21.15.31:0/3811184882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6c4143900 0x7fb6c4157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fb6c9400640 1 -- 172.21.15.31:0/3811184882 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c413eea0 con 0x7fb6c4142fe0 2024-09-17T05:28:57.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fccd6000640 1 -- 172.21.15.31:0/33327907 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fcce0093070 con 0x7fccd8055070 2024-09-17T05:28:57.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fccd6000640 1 --2- 172.21.15.31:0/33327907 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fccc00732d0 0x7fccc0075790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fccd6000640 1 -- 172.21.15.31:0/33327907 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcce010f240 con 0x7fccd8055070 2024-09-17T05:28:57.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fccdde00640 1 --2- 172.21.15.31:0/33327907 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fccc00732d0 0x7fccc0075790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.017+0000 7fccd6000640 1 -- 172.21.15.31:0/33327907 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fccd8032a90 con 0x7fccd8055070 2024-09-17T05:28:57.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.017+0000 7fccdde00640 1 --2- 172.21.15.31:0/33327907 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fccc00732d0 0x7fccc0075790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009790 tx=0x7fccd001acf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:57.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.013+0000 7fb6ca800640 1 --2- 172.21.15.31:0/3811184882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6c4143900 0x7fb6c4157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:28:57.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.017+0000 7f73e8c00640 1 -- 172.21.15.31:0/21094013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73e40cf6c0 msgr2=0x7f73e40cce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.017+0000 7f73e8c00640 1 --2- 172.21.15.31:0/21094013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73e40cf6c0 0x7f73e40cce50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009b70 tx=0x7f73dc01ca40 comp rx=0 tx=0).stop 2024-09-17T05:28:57.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.017+0000 7fb6c9400640 1 --2- 172.21.15.31:0/3811184882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c4142fe0 0x7fb6c40b0980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4000c10 tx=0x7fb6b40a5810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:57.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.017+0000 7fb6be000640 1 -- 172.21.15.31:0/3811184882 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b40b2070 con 0x7fb6c4142fe0 2024-09-17T05:28:57.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.017+0000 7fb6be000640 1 -- 172.21.15.31:0/3811184882 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6b40b3040 con 0x7fb6c4142fe0 2024-09-17T05:28:57.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.017+0000 7fb6be000640 1 -- 172.21.15.31:0/3811184882 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4004030 con 0x7fb6c4142fe0 2024-09-17T05:28:57.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.025+0000 7fb6cb200640 1 -- 172.21.15.31:0/3811184882 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c4140e70 con 0x7fb6c4142fe0 2024-09-17T05:28:57.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.025+0000 7f73e8c00640 1 -- 172.21.15.31:0/21094013 shutdown_connections 2024-09-17T05:28:57.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.025+0000 7f73e8c00640 1 --2- 172.21.15.31:0/21094013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73e40cf6c0 0x7f73e40cce50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.025+0000 7f73e8c00640 1 -- 172.21.15.31:0/21094013 >> 172.21.15.31:0/21094013 conn(0x7f73e40b18f0 msgr2=0x7f73e40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:57.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.025+0000 7fb6cb200640 1 -- 172.21.15.31:0/3811184882 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c4140390 con 0x7fb6c4142fe0 2024-09-17T05:28:57.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.025+0000 7f73e8c00640 1 -- 172.21.15.31:0/21094013 shutdown_connections 2024-09-17T05:28:57.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.025+0000 7f73e8c00640 1 -- 172.21.15.31:0/21094013 wait complete. 2024-09-17T05:28:57.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.025+0000 7fb6cb200640 1 -- 172.21.15.31:0/3811184882 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c41433c0 con 0x7fb6c4142fe0 2024-09-17T05:28:57.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.025+0000 7f73e8c00640 1 Processor -- start 2024-09-17T05:28:57.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.025+0000 7f73e8c00640 1 -- start start 2024-09-17T05:28:57.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7fb6be000640 1 -- 172.21.15.31:0/3811184882 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb6b40041d0 con 0x7fb6c4142fe0 2024-09-17T05:28:57.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7f73e8c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73e406ffd0 0x7f73e4157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7f73e8c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73e4070960 0x7f73e4150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7f73e8c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e40cf6c0 0x7f73e414c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7fb6be000640 1 --2- 172.21.15.31:0/3811184882 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb6a8073200 0x7fb6a80756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7f73e8c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f73e415f6f0 con 0x7f73e40cf6c0 2024-09-17T05:28:57.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7f73e8c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f73e415f570 con 0x7f73e4070960 2024-09-17T05:28:57.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7f73e8c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f73e415f870 con 0x7f73e406ffd0 2024-09-17T05:28:57.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7fb6be000640 1 -- 172.21.15.31:0/3811184882 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb6b412df30 con 0x7fb6c4142fe0 2024-09-17T05:28:57.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7f73e1e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73e406ffd0 0x7f73e4157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7f73e1400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73e4070960 0x7f73e4150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7fb6c9e00640 1 --2- 172.21.15.31:0/3811184882 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb6a8073200 0x7fb6a80756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7f73e1e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73e406ffd0 0x7f73e4157a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:49944/0 (socket says 172.21.15.31:49944) 2024-09-17T05:28:57.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7f73e1e00640 1 -- 172.21.15.31:0/1575492573 learned_addr learned my addr 172.21.15.31:0/1575492573 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:57.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7f73e2800640 1 --2- 172.21.15.31:0/1575492573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e40cf6c0 0x7f73e414c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7f73e1400640 1 -- 172.21.15.31:0/1575492573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73e406ffd0 msgr2=0x7f73e4157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.033+0000 7fb6be000640 1 -- 172.21.15.31:0/3811184882 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb6c413eea0 con 0x7fb6c4142fe0 2024-09-17T05:28:57.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7f73e1400640 1 --2- 172.21.15.31:0/1575492573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73e406ffd0 0x7f73e4157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7f73e1400640 1 -- 172.21.15.31:0/1575492573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e40cf6c0 msgr2=0x7f73e414c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7f73e1400640 1 --2- 172.21.15.31:0/1575492573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e40cf6c0 0x7f73e414c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.029+0000 7f73e1400640 1 -- 172.21.15.31:0/1575492573 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e4156280 con 0x7f73e4070960 2024-09-17T05:28:57.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.033+0000 7f73e1400640 1 --2- 172.21.15.31:0/1575492573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73e4070960 0x7f73e4150eb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f73d000c870 tx=0x7f73d000cd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:57.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.033+0000 7f73da000640 1 -- 172.21.15.31:0/1575492573 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d0018070 con 0x7f73e4070960 2024-09-17T05:28:57.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.037+0000 7fb6c9e00640 1 --2- 172.21.15.31:0/3811184882 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb6a8073200 0x7fb6a80756c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8001550 tx=0x7fb6b8007a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:57.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.037+0000 7f73da000640 1 -- 172.21.15.31:0/1575492573 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73d0007030 con 0x7f73e4070960 2024-09-17T05:28:57.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.037+0000 7f73da000640 1 -- 172.21.15.31:0/1575492573 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d0007460 con 0x7f73e4070960 2024-09-17T05:28:57.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.037+0000 7f73e8c00640 1 -- 172.21.15.31:0/1575492573 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73e40730e0 con 0x7f73e4070960 2024-09-17T05:28:57.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.037+0000 7f73e8c00640 1 -- 172.21.15.31:0/1575492573 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73e41513f0 con 0x7f73e4070960 2024-09-17T05:28:57.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.041+0000 7f73e8c00640 1 -- 172.21.15.31:0/1575492573 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73e4069410 con 0x7f73e4070960 2024-09-17T05:28:57.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.041+0000 7f73da000640 1 -- 172.21.15.31:0/1575492573 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f73d00067a0 con 0x7f73e4070960 2024-09-17T05:28:57.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.041+0000 7f73da000640 1 --2- 172.21.15.31:0/1575492573 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f73c4073200 0x7f73c40756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.041+0000 7f73da000640 1 -- 172.21.15.31:0/1575492573 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f73d00937b0 con 0x7f73e4070960 2024-09-17T05:28:57.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.041+0000 7f73e1e00640 1 --2- 172.21.15.31:0/1575492573 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f73c4073200 0x7f73c40756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.045+0000 7f73e1e00640 1 --2- 172.21.15.31:0/1575492573 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f73c4073200 0x7f73c40756c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f73d4001130 tx=0x7f73d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:57.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.049+0000 7f73da000640 1 -- 172.21.15.31:0/1575492573 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f73d005e200 con 0x7f73e4070960 2024-09-17T05:28:57.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.061+0000 7f8718c00640 1 -- 172.21.15.31:0/2110416131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86f80043a0 msgr2=0x7f86f8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.061+0000 7f8718c00640 1 --2- 172.21.15.31:0/2110416131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86f80043a0 0x7f86f8004850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f870000c2e0 tx=0x7f870001cfd0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.061+0000 7f8718c00640 1 -- 172.21.15.31:0/2110416131 shutdown_connections 2024-09-17T05:28:57.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.061+0000 7f8718c00640 1 --2- 172.21.15.31:0/2110416131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86f80043a0 0x7f86f8004850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.061+0000 7f8718c00640 1 -- 172.21.15.31:0/2110416131 >> 172.21.15.31:0/2110416131 conn(0x7f87140ccf10 msgr2=0x7f87140cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:57.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.061+0000 7f8718c00640 1 -- 172.21.15.31:0/2110416131 shutdown_connections 2024-09-17T05:28:57.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.061+0000 7f8718c00640 1 -- 172.21.15.31:0/2110416131 wait complete. 2024-09-17T05:28:57.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.065+0000 7f8718c00640 1 Processor -- start 2024-09-17T05:28:57.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.065+0000 7f8718c00640 1 -- start start 2024-09-17T05:28:57.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.065+0000 7f8718c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86f80043a0 0x7f8714158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.065+0000 7fe599800640 1 -- 172.21.15.31:0/2526880767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe59415f890 msgr2=0x7fe5940cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.065+0000 7fe599800640 1 --2- 172.21.15.31:0/2526880767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe59415f890 0x7fe5940cdae0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009840 tx=0x7fe57c01c840 comp rx=0 tx=0).stop 2024-09-17T05:28:57.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8718c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8714158b70 0x7f87142044f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8718c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8714204a30 0x7f87141563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8718c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f87140afde0 con 0x7f86f80043a0 2024-09-17T05:28:57.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8718c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f87140afc60 con 0x7f8714158b70 2024-09-17T05:28:57.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8718c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f871406f9c0 con 0x7f8714204a30 2024-09-17T05:28:57.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8711e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86f80043a0 0x7f8714158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8711e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86f80043a0 0x7f8714158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42300/0 (socket says 172.21.15.31:42300) 2024-09-17T05:28:57.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8712800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8714204a30 0x7f87141563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8712800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8714204a30 0x7f87141563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:49970/0 (socket says 172.21.15.31:49970) 2024-09-17T05:28:57.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8712800640 1 -- 172.21.15.31:0/110329002 learned_addr learned my addr 172.21.15.31:0/110329002 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:57.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8711400640 1 --2- 172.21.15.31:0/110329002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8714158b70 0x7f87142044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8712800640 1 -- 172.21.15.31:0/110329002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8714158b70 msgr2=0x7f87142044f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8712800640 1 --2- 172.21.15.31:0/110329002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8714158b70 0x7f87142044f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8712800640 1 -- 172.21.15.31:0/110329002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86f80043a0 msgr2=0x7f8714158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8712800640 1 --2- 172.21.15.31:0/110329002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86f80043a0 0x7f8714158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8712800640 1 -- 172.21.15.31:0/110329002 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8714159130 con 0x7f8714204a30 2024-09-17T05:28:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8711400640 1 --2- 172.21.15.31:0/110329002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8714158b70 0x7f87142044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:28:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8711e00640 1 --2- 172.21.15.31:0/110329002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86f80043a0 0x7f8714158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:28:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8712800640 1 --2- 172.21.15.31:0/110329002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8714204a30 0x7f87141563c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f871406dc30 tx=0x7f870c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f870a000640 1 -- 172.21.15.31:0/110329002 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c017070 con 0x7f8714204a30 2024-09-17T05:28:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f870a000640 1 -- 172.21.15.31:0/110329002 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f870c003db0 con 0x7f8714204a30 2024-09-17T05:28:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f870a000640 1 -- 172.21.15.31:0/110329002 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c005330 con 0x7f8714204a30 2024-09-17T05:28:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8718c00640 1 -- 172.21.15.31:0/110329002 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87140c4140 con 0x7f8714204a30 2024-09-17T05:28:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8718c00640 1 -- 172.21.15.31:0/110329002 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8714158890 con 0x7f8714204a30 2024-09-17T05:28:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7fe599800640 1 -- 172.21.15.31:0/2526880767 shutdown_connections 2024-09-17T05:28:57.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7fe599800640 1 --2- 172.21.15.31:0/2526880767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe594160380 0x7fe594073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7fe599800640 1 --2- 172.21.15.31:0/2526880767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe59415f890 0x7fe5940cdae0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7fe599800640 1 -- 172.21.15.31:0/2526880767 >> 172.21.15.31:0/2526880767 conn(0x7fe5940b18f0 msgr2=0x7fe5940b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:57.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.069+0000 7f8718c00640 1 -- 172.21.15.31:0/110329002 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f871415e4d0 con 0x7f8714204a30 2024-09-17T05:28:57.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.073+0000 7fe599800640 1 -- 172.21.15.31:0/2526880767 shutdown_connections 2024-09-17T05:28:57.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.073+0000 7fe599800640 1 -- 172.21.15.31:0/2526880767 wait complete. 2024-09-17T05:28:57.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.073+0000 7f870a000640 1 -- 172.21.15.31:0/110329002 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f870c01a070 con 0x7f8714204a30 2024-09-17T05:28:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.073+0000 7fe599800640 1 Processor -- start 2024-09-17T05:28:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7fe599800640 1 -- start start 2024-09-17T05:28:57.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7f870a000640 1 --2- 172.21.15.31:0/110329002 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f86f4073200 0x7f86f40756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7f870a000640 1 -- 172.21.15.31:0/110329002 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f870c093380 con 0x7f8714204a30 2024-09-17T05:28:57.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7f8711e00640 1 --2- 172.21.15.31:0/110329002 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f86f4073200 0x7f86f40756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7fe599800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5940cc170 0x7fe59414c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7fe599800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe59415f890 0x7fe594149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7fe599800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe594160380 0x7fe5941f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7fe599800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe5941691d0 con 0x7fe59415f890 2024-09-17T05:28:57.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7fe599800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe594169050 con 0x7fe5940cc170 2024-09-17T05:28:57.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7fe599800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe594169350 con 0x7fe594160380 2024-09-17T05:28:57.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7fe592a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5940cc170 0x7fe59414c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7fe593400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe594160380 0x7fe5941f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7fe592a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5940cc170 0x7fe59414c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:58512/0 (socket says 172.21.15.31:58512) 2024-09-17T05:28:57.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7fe592a00640 1 -- 172.21.15.31:0/1735661636 learned_addr learned my addr 172.21.15.31:0/1735661636 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:57.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7fe592a00640 1 -- 172.21.15.31:0/1735661636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe594160380 msgr2=0x7fe5941f6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7fe592a00640 1 --2- 172.21.15.31:0/1735661636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe594160380 0x7fe5941f6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7fe58a000640 1 --2- 172.21.15.31:0/1735661636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe59415f890 0x7fe594149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7fe592a00640 1 -- 172.21.15.31:0/1735661636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe59415f890 msgr2=0x7fe594149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7fe592a00640 1 --2- 172.21.15.31:0/1735661636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe59415f890 0x7fe594149db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7fe592a00640 1 -- 172.21.15.31:0/1735661636 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe59414f280 con 0x7fe5940cc170 2024-09-17T05:28:57.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7f8711e00640 1 --2- 172.21.15.31:0/110329002 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f86f4073200 0x7f86f40756c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8714052940 tx=0x7f870400a2f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:57.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.077+0000 7fe593400640 1 --2- 172.21.15.31:0/1735661636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe594160380 0x7fe5941f6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:28:57.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.081+0000 7fe592a00640 1 --2- 172.21.15.31:0/1735661636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5940cc170 0x7fe59414c220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe57c01aef0 tx=0x7fe57c0a7960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.085+0000 7fe58b400640 1 -- 172.21.15.31:0/1735661636 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0bf020 con 0x7fe5940cc170 2024-09-17T05:28:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.085+0000 7fe58b400640 1 -- 172.21.15.31:0/1735661636 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe57c005020 con 0x7fe5940cc170 2024-09-17T05:28:57.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.085+0000 7fe58b400640 1 -- 172.21.15.31:0/1735661636 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c005430 con 0x7fe5940cc170 2024-09-17T05:28:57.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.085+0000 7fe599800640 1 -- 172.21.15.31:0/1735661636 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5941f5d90 con 0x7fe5940cc170 2024-09-17T05:28:57.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.085+0000 7fe599800640 1 -- 172.21.15.31:0/1735661636 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe59414cb90 con 0x7fe5940cc170 2024-09-17T05:28:57.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.085+0000 7f870a000640 1 -- 172.21.15.31:0/110329002 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f870c05e4a0 con 0x7f8714204a30 2024-09-17T05:28:57.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.085+0000 7fe599800640 1 -- 172.21.15.31:0/1735661636 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5940cdae0 con 0x7fe5940cc170 2024-09-17T05:28:57.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.089+0000 7fe58b400640 1 -- 172.21.15.31:0/1735661636 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe57c0a7030 con 0x7fe5940cc170 2024-09-17T05:28:57.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.089+0000 7fe58b400640 1 --2- 172.21.15.31:0/1735661636 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe570073250 0x7fe570075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:57.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.089+0000 7fe58b400640 1 -- 172.21.15.31:0/1735661636 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe57c12f000 con 0x7fe5940cc170 2024-09-17T05:28:57.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.089+0000 7fe58b400640 1 -- 172.21.15.31:0/1735661636 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe57c016430 con 0x7fe5940cc170 2024-09-17T05:28:57.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.093+0000 7fe58a000640 1 --2- 172.21.15.31:0/1735661636 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe570073250 0x7fe570075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:57.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.097+0000 7fe58a000640 1 --2- 172.21.15.31:0/1735661636 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe570073250 0x7fe570075710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe584007fd0 tx=0x7fe584009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:57.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.349+0000 7fb963200640 1 -- 172.21.15.31:0/908213138 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb96408b8e0 con 0x7fb9640ae5d0 2024-09-17T05:28:57.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.349+0000 7fb95a000640 1 -- 172.21.15.31:0/908213138 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb96408b8e0 con 0x7fb9640ae5d0 2024-09-17T05:28:57.354 INFO:teuthology.orchestra.run.smithi031.stdout:60129542150 2024-09-17T05:28:57.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.357+0000 7fb94f400640 1 -- 172.21.15.31:0/908213138 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb944073230 msgr2=0x7fb9440756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.357+0000 7fb94f400640 1 --2- 172.21.15.31:0/908213138 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb944073230 0x7fb9440756f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb954000f70 tx=0x7fb954009040 comp rx=0 tx=0).stop 2024-09-17T05:28:57.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.357+0000 7fb94f400640 1 -- 172.21.15.31:0/908213138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9640ae5d0 msgr2=0x7fb964172880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.357+0000 7fb94f400640 1 --2- 172.21.15.31:0/908213138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9640ae5d0 0x7fb964172880 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00ee20 tx=0x7fb95c00c740 comp rx=0 tx=0).stop 2024-09-17T05:28:57.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.357+0000 7fb94f400640 1 -- 172.21.15.31:0/908213138 shutdown_connections 2024-09-17T05:28:57.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.357+0000 7fb94f400640 1 --2- 172.21.15.31:0/908213138 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb944073230 0x7fb9440756f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.357+0000 7fb94f400640 1 --2- 172.21.15.31:0/908213138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9640cd600 0x7fb9640ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.357+0000 7fb94f400640 1 --2- 172.21.15.31:0/908213138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb9640ae5d0 0x7fb964172880 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.357+0000 7fb94f400640 1 --2- 172.21.15.31:0/908213138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb96406e6e0 0x7fb9640c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.357+0000 7fb94f400640 1 -- 172.21.15.31:0/908213138 >> 172.21.15.31:0/908213138 conn(0x7fb9640b1600 msgr2=0x7fb9640b0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:57.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.357+0000 7fb94f400640 1 -- 172.21.15.31:0/908213138 shutdown_connections 2024-09-17T05:28:57.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.357+0000 7fb94f400640 1 -- 172.21.15.31:0/908213138 wait complete. 2024-09-17T05:28:57.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.377+0000 7f2255400640 1 -- 172.21.15.31:0/3520395330 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2228005590 con 0x7f2250161520 2024-09-17T05:28:57.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.377+0000 7f2246a00640 1 -- 172.21.15.31:0/3520395330 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f22480641f0 con 0x7f2250161520 2024-09-17T05:28:57.383 INFO:teuthology.orchestra.run.smithi031.stdout:60129542149 2024-09-17T05:28:57.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.381+0000 7f2255400640 1 -- 172.21.15.31:0/3520395330 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f22300732d0 msgr2=0x7f2230075790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.381+0000 7f2255400640 1 --2- 172.21.15.31:0/3520395330 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f22300732d0 0x7f2230075790 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2240001870 tx=0x7f2240009040 comp rx=0 tx=0).stop 2024-09-17T05:28:57.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.381+0000 7f2255400640 1 -- 172.21.15.31:0/3520395330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2250161520 msgr2=0x7f22501600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.381+0000 7f2255400640 1 --2- 172.21.15.31:0/3520395330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2250161520 0x7f22501600a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f224800ea60 tx=0x7f224800ef20 comp rx=0 tx=0).stop 2024-09-17T05:28:57.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.381+0000 7f2255400640 1 -- 172.21.15.31:0/3520395330 shutdown_connections 2024-09-17T05:28:57.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.381+0000 7f2255400640 1 --2- 172.21.15.31:0/3520395330 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f22300732d0 0x7f2230075790 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.381+0000 7f2255400640 1 --2- 172.21.15.31:0/3520395330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2250161520 0x7f22501600a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.381+0000 7f2255400640 1 --2- 172.21.15.31:0/3520395330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22500b3ed0 0x7f225015fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.381+0000 7f2255400640 1 --2- 172.21.15.31:0/3520395330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f225006eeb0 0x7f225014a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.381+0000 7f2255400640 1 -- 172.21.15.31:0/3520395330 >> 172.21.15.31:0/3520395330 conn(0x7f22500b18f0 msgr2=0x7f22500cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:57.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.385+0000 7f2255400640 1 -- 172.21.15.31:0/3520395330 shutdown_connections 2024-09-17T05:28:57.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.385+0000 7f2255400640 1 -- 172.21.15.31:0/3520395330 wait complete. 2024-09-17T05:28:57.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.5 2024-09-17T05:28:57.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.397+0000 7fccdf200640 1 -- 172.21.15.31:0/33327907 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fccb8005860 con 0x7fccd8055070 2024-09-17T05:28:57.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.397+0000 7fccd6000640 1 -- 172.21.15.31:0/33327907 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcce00d9d10 con 0x7fccd8055070 2024-09-17T05:28:57.402 INFO:teuthology.orchestra.run.smithi031.stdout:64424509447 2024-09-17T05:28:57.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.397+0000 7fb222c00640 1 -- 172.21.15.31:0/2800957689 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb21c1545d0 con 0x7fb21c0cf570 2024-09-17T05:28:57.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.401+0000 7fb219600640 1 -- 172.21.15.31:0/2800957689 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb208017080 con 0x7fb21c0cf570 2024-09-17T05:28:57.404 INFO:teuthology.orchestra.run.smithi031.stdout:64424509447 2024-09-17T05:28:57.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.401+0000 7fccdf200640 1 -- 172.21.15.31:0/33327907 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fccc00732d0 msgr2=0x7fccc0075790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.401+0000 7fccdf200640 1 --2- 172.21.15.31:0/33327907 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fccc00732d0 0x7fccc0075790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009790 tx=0x7fccd001acf0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.401+0000 7fccdf200640 1 -- 172.21.15.31:0/33327907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccd8055070 msgr2=0x7fccd80e52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.401+0000 7fccdf200640 1 --2- 172.21.15.31:0/33327907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccd8055070 0x7fccd80e52b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcce0069ff0 tx=0x7fcce006a110 comp rx=0 tx=0).stop 2024-09-17T05:28:57.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.401+0000 7fccdf200640 1 -- 172.21.15.31:0/33327907 shutdown_connections 2024-09-17T05:28:57.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.401+0000 7fccdf200640 1 --2- 172.21.15.31:0/33327907 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fccc00732d0 0x7fccc0075790 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.401+0000 7fccdf200640 1 --2- 172.21.15.31:0/33327907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccd8055070 0x7fccd80e52b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.401+0000 7fccdf200640 1 --2- 172.21.15.31:0/33327907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccd8036700 0x7fccd80e4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.401+0000 7fccdf200640 1 --2- 172.21.15.31:0/33327907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccd8033740 0x7fccd8032550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.401+0000 7fccdf200640 1 -- 172.21.15.31:0/33327907 >> 172.21.15.31:0/33327907 conn(0x7fccd801d780 msgr2=0x7fccd80522f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:57.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.401+0000 7fccdf200640 1 -- 172.21.15.31:0/33327907 shutdown_connections 2024-09-17T05:28:57.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.401+0000 7fccdf200640 1 -- 172.21.15.31:0/33327907 wait complete. 2024-09-17T05:28:57.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.405+0000 7fb222c00640 1 -- 172.21.15.31:0/2800957689 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb1fc073250 msgr2=0x7fb1fc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.405+0000 7fb222c00640 1 --2- 172.21.15.31:0/2800957689 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb1fc073250 0x7fb1fc075710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb2100046c0 tx=0x7fb210007ea0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.405+0000 7fb222c00640 1 -- 172.21.15.31:0/2800957689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb21c0cf570 msgr2=0x7fb21c1fb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.405+0000 7fb222c00640 1 --2- 172.21.15.31:0/2800957689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb21c0cf570 0x7fb21c1fb710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb20801b090 tx=0x7fb208008c50 comp rx=0 tx=0).stop 2024-09-17T05:28:57.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.405+0000 7fb6cb200640 1 -- 172.21.15.31:0/3811184882 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb6c413b690 con 0x7fb6c4142fe0 2024-09-17T05:28:57.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.405+0000 7fb222c00640 1 -- 172.21.15.31:0/2800957689 shutdown_connections 2024-09-17T05:28:57.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.405+0000 7fb222c00640 1 --2- 172.21.15.31:0/2800957689 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb1fc073250 0x7fb1fc075710 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.405+0000 7fb222c00640 1 --2- 172.21.15.31:0/2800957689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb21c159cc0 0x7fb21c0c2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.405+0000 7fb222c00640 1 --2- 172.21.15.31:0/2800957689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb21c0cf570 0x7fb21c1fb710 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.405+0000 7fb222c00640 1 --2- 172.21.15.31:0/2800957689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb21c0cd600 0x7fb21c0adaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.405+0000 7fb222c00640 1 -- 172.21.15.31:0/2800957689 >> 172.21.15.31:0/2800957689 conn(0x7fb21c0cfa30 msgr2=0x7fb21c0b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:57.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.405+0000 7fb222c00640 1 -- 172.21.15.31:0/2800957689 shutdown_connections 2024-09-17T05:28:57.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.405+0000 7fb222c00640 1 -- 172.21.15.31:0/2800957689 wait complete. 2024-09-17T05:28:57.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.405+0000 7fb6be000640 1 -- 172.21.15.31:0/3811184882 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb6b4016410 con 0x7fb6c4142fe0 2024-09-17T05:28:57.411 INFO:teuthology.orchestra.run.smithi031.stdout:64424509447 2024-09-17T05:28:57.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.409+0000 7fb6cb200640 1 -- 172.21.15.31:0/3811184882 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb6a8073200 msgr2=0x7fb6a80756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.409+0000 7fb6cb200640 1 --2- 172.21.15.31:0/3811184882 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb6a8073200 0x7fb6a80756c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8001550 tx=0x7fb6b8007a20 comp rx=0 tx=0).stop 2024-09-17T05:28:57.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.409+0000 7fb6cb200640 1 -- 172.21.15.31:0/3811184882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c4142fe0 msgr2=0x7fb6c40b0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.409+0000 7fb6cb200640 1 --2- 172.21.15.31:0/3811184882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c4142fe0 0x7fb6c40b0980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4000c10 tx=0x7fb6b40a5810 comp rx=0 tx=0).stop 2024-09-17T05:28:57.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.409+0000 7fb6cb200640 1 -- 172.21.15.31:0/3811184882 shutdown_connections 2024-09-17T05:28:57.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.409+0000 7fb6cb200640 1 --2- 172.21.15.31:0/3811184882 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb6a8073200 0x7fb6a80756c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.409+0000 7fb6cb200640 1 --2- 172.21.15.31:0/3811184882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6c4143900 0x7fb6c4157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.409+0000 7fb6cb200640 1 --2- 172.21.15.31:0/3811184882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c4142fe0 0x7fb6c40b0980 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4000c10 tx=0x7fb6b40a5810 comp rx=0 tx=0).stop 2024-09-17T05:28:57.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.409+0000 7fb6cb200640 1 --2- 172.21.15.31:0/3811184882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6c40b3610 0x7fb6c413e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.409+0000 7fb6cb200640 1 -- 172.21.15.31:0/3811184882 >> 172.21.15.31:0/3811184882 conn(0x7fb6c406cc20 msgr2=0x7fb6c40b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:57.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.413+0000 7fb6cb200640 1 -- 172.21.15.31:0/3811184882 shutdown_connections 2024-09-17T05:28:57.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.413+0000 7fb6cb200640 1 -- 172.21.15.31:0/3811184882 wait complete. 2024-09-17T05:28:57.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.0 2024-09-17T05:28:57.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.417+0000 7f73e8c00640 1 -- 172.21.15.31:0/1575492573 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f73e40cd3d0 con 0x7f73e4070960 2024-09-17T05:28:57.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.417+0000 7f73da000640 1 -- 172.21.15.31:0/1575492573 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f73d0062c30 con 0x7f73e4070960 2024-09-17T05:28:57.420 INFO:teuthology.orchestra.run.smithi031.stdout:64424509445 2024-09-17T05:28:57.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.421+0000 7f73e8c00640 1 -- 172.21.15.31:0/1575492573 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f73c4073200 msgr2=0x7f73c40756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.421+0000 7f73e8c00640 1 --2- 172.21.15.31:0/1575492573 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f73c4073200 0x7f73c40756c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f73d4001130 tx=0x7f73d4009040 comp rx=0 tx=0).stop 2024-09-17T05:28:57.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.421+0000 7f73e8c00640 1 -- 172.21.15.31:0/1575492573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73e4070960 msgr2=0x7f73e4150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.421+0000 7f73e8c00640 1 --2- 172.21.15.31:0/1575492573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73e4070960 0x7f73e4150eb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f73d000c870 tx=0x7f73d000cd30 comp rx=0 tx=0).stop 2024-09-17T05:28:57.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.421+0000 7f73e8c00640 1 -- 172.21.15.31:0/1575492573 shutdown_connections 2024-09-17T05:28:57.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.421+0000 7f73e8c00640 1 --2- 172.21.15.31:0/1575492573 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f73c4073200 0x7f73c40756c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.421+0000 7f73e8c00640 1 --2- 172.21.15.31:0/1575492573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73e40cf6c0 0x7f73e414c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.421+0000 7f73e8c00640 1 --2- 172.21.15.31:0/1575492573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73e4070960 0x7f73e4150eb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.421+0000 7f73e8c00640 1 --2- 172.21.15.31:0/1575492573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73e406ffd0 0x7f73e4157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.421+0000 7f73e8c00640 1 -- 172.21.15.31:0/1575492573 >> 172.21.15.31:0/1575492573 conn(0x7f73e40b18f0 msgr2=0x7f73e415dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:57.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.421+0000 7f73e8c00640 1 -- 172.21.15.31:0/1575492573 shutdown_connections 2024-09-17T05:28:57.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.421+0000 7f73e8c00640 1 -- 172.21.15.31:0/1575492573 wait complete. 2024-09-17T05:28:57.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.4 2024-09-17T05:28:57.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.441+0000 7f8718c00640 1 -- 172.21.15.31:0/110329002 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8714073c70 con 0x7f8714204a30 2024-09-17T05:28:57.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.441+0000 7f870a000640 1 -- 172.21.15.31:0/110329002 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f870c05dda0 con 0x7f8714204a30 2024-09-17T05:28:57.447 INFO:teuthology.orchestra.run.smithi031.stdout:64424509447 2024-09-17T05:28:57.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.2 2024-09-17T05:28:57.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.445+0000 7f8718c00640 1 -- 172.21.15.31:0/110329002 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f86f4073200 msgr2=0x7f86f40756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.445+0000 7f8718c00640 1 --2- 172.21.15.31:0/110329002 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f86f4073200 0x7f86f40756c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8714052940 tx=0x7f870400a2f0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.445+0000 7f8718c00640 1 -- 172.21.15.31:0/110329002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8714204a30 msgr2=0x7f87141563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.445+0000 7f8718c00640 1 --2- 172.21.15.31:0/110329002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8714204a30 0x7f87141563c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f871406dc30 tx=0x7f870c00c8f0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.445+0000 7f8718c00640 1 -- 172.21.15.31:0/110329002 shutdown_connections 2024-09-17T05:28:57.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.445+0000 7f8718c00640 1 --2- 172.21.15.31:0/110329002 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f86f4073200 0x7f86f40756c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.445+0000 7f8718c00640 1 --2- 172.21.15.31:0/110329002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8714204a30 0x7f87141563c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.445+0000 7f8718c00640 1 --2- 172.21.15.31:0/110329002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8714158b70 0x7f87142044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.445+0000 7f8718c00640 1 --2- 172.21.15.31:0/110329002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86f80043a0 0x7f8714158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.445+0000 7f8718c00640 1 -- 172.21.15.31:0/110329002 >> 172.21.15.31:0/110329002 conn(0x7f87140ccf10 msgr2=0x7f87140b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.445+0000 7f8718c00640 1 -- 172.21.15.31:0/110329002 shutdown_connections 2024-09-17T05:28:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.445+0000 7f8718c00640 1 -- 172.21.15.31:0/110329002 wait complete. 2024-09-17T05:28:57.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.6 2024-09-17T05:28:57.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.1 2024-09-17T05:28:57.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.449+0000 7fe599800640 1 -- 172.21.15.31:0/1735661636 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe5940cbcd0 con 0x7fe5940cc170 2024-09-17T05:28:57.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.449+0000 7fe58b400640 1 -- 172.21.15.31:0/1735661636 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe57c0fa220 con 0x7fe5940cc170 2024-09-17T05:28:57.454 INFO:teuthology.orchestra.run.smithi031.stdout:64424509446 2024-09-17T05:28:57.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.453+0000 7fe599800640 1 -- 172.21.15.31:0/1735661636 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe570073250 msgr2=0x7fe570075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.453+0000 7fe599800640 1 --2- 172.21.15.31:0/1735661636 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe570073250 0x7fe570075710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe584007fd0 tx=0x7fe584009040 comp rx=0 tx=0).stop 2024-09-17T05:28:57.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.453+0000 7fe599800640 1 -- 172.21.15.31:0/1735661636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5940cc170 msgr2=0x7fe59414c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:57.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.453+0000 7fe599800640 1 --2- 172.21.15.31:0/1735661636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5940cc170 0x7fe59414c220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe57c01aef0 tx=0x7fe57c0a7960 comp rx=0 tx=0).stop 2024-09-17T05:28:57.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.453+0000 7fe599800640 1 -- 172.21.15.31:0/1735661636 shutdown_connections 2024-09-17T05:28:57.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.453+0000 7fe599800640 1 --2- 172.21.15.31:0/1735661636 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe570073250 0x7fe570075710 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.453+0000 7fe599800640 1 --2- 172.21.15.31:0/1735661636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe594160380 0x7fe5941f6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.453+0000 7fe599800640 1 --2- 172.21.15.31:0/1735661636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe59415f890 0x7fe594149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.453+0000 7fe599800640 1 --2- 172.21.15.31:0/1735661636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5940cc170 0x7fe59414c220 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:57.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.453+0000 7fe599800640 1 -- 172.21.15.31:0/1735661636 >> 172.21.15.31:0/1735661636 conn(0x7fe5940b18f0 msgr2=0x7fe59415fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:57.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.453+0000 7fe599800640 1 -- 172.21.15.31:0/1735661636 shutdown_connections 2024-09-17T05:28:57.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:57.453+0000 7fe599800640 1 -- 172.21.15.31:0/1735661636 wait complete. 2024-09-17T05:28:57.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.3 2024-09-17T05:28:57.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.7 2024-09-17T05:28:58.393 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T05:28:58.419 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T05:28:58.442 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T05:28:58.449 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T05:28:58.452 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T05:28:58.454 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T05:28:58.472 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T05:28:58.478 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T05:28:58.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.601+0000 7fdc86200640 1 -- 172.21.15.31:0/2459566833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7800a480 msgr2=0x7fdc7800a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.601+0000 7fdc86200640 1 --2- 172.21.15.31:0/2459566833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7800a480 0x7fdc7800a860 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800d330 tx=0x7fdc7401c600 comp rx=0 tx=0).stop 2024-09-17T05:28:58.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.601+0000 7fdc86200640 1 -- 172.21.15.31:0/2459566833 shutdown_connections 2024-09-17T05:28:58.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.601+0000 7fdc86200640 1 --2- 172.21.15.31:0/2459566833 >> v2:172.21.15.31:3300/0 conn(0x7fdc7801c370 0x7fdc78035ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.601+0000 7fdc86200640 1 --2- 172.21.15.31:0/2459566833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7800a480 0x7fdc7800a860 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.601+0000 7fdc86200640 1 -- 172.21.15.31:0/2459566833 >> 172.21.15.31:0/2459566833 conn(0x7fdc78054570 msgr2=0x7fdc78054980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:58.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.601+0000 7fdc86200640 1 -- 172.21.15.31:0/2459566833 shutdown_connections 2024-09-17T05:28:58.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.601+0000 7fdc86200640 1 -- 172.21.15.31:0/2459566833 wait complete. 2024-09-17T05:28:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.605+0000 7fdc86200640 1 Processor -- start 2024-09-17T05:28:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.605+0000 7fdc86200640 1 -- start start 2024-09-17T05:28:58.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.609+0000 7fdc86200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7800a480 0x7fdc7817c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.609+0000 7fdc86200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc7800ba10 0x7fdc78020f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.609+0000 7fdc86200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc7801c370 0x7fdc78021480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.609+0000 7fdc86200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdc78006450 con 0x7fdc7801c370 2024-09-17T05:28:58.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.609+0000 7fdc86200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdc780062d0 con 0x7fdc7800a480 2024-09-17T05:28:58.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.609+0000 7fdc86200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdc780065d0 con 0x7fdc7800ba10 2024-09-17T05:28:58.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.613+0000 7fdc7fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc7800ba10 0x7fdc78020f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.613+0000 7fdc7fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc7800ba10 0x7fdc78020f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:58482/0 (socket says 172.21.15.31:58482) 2024-09-17T05:28:58.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.613+0000 7fdc7fe00640 1 -- 172.21.15.31:0/3716667076 learned_addr learned my addr 172.21.15.31:0/3716667076 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:58.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.613+0000 7fdc84e00640 1 --2- 172.21.15.31:0/3716667076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7800a480 0x7fdc7817c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.613+0000 7fdc85800640 1 --2- 172.21.15.31:0/3716667076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc7801c370 0x7fdc78021480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.613+0000 7fdc84e00640 1 -- 172.21.15.31:0/3716667076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc7800ba10 msgr2=0x7fdc78020f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.613+0000 7fdc84e00640 1 --2- 172.21.15.31:0/3716667076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc7800ba10 0x7fdc78020f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.613+0000 7fdc84e00640 1 -- 172.21.15.31:0/3716667076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc7801c370 msgr2=0x7fdc78021480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.613+0000 7fdc84e00640 1 --2- 172.21.15.31:0/3716667076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc7801c370 0x7fdc78021480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.613+0000 7fdc84e00640 1 -- 172.21.15.31:0/3716667076 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7801e710 con 0x7fdc7800a480 2024-09-17T05:28:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.613+0000 7fdc85800640 1 --2- 172.21.15.31:0/3716667076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc7801c370 0x7fdc78021480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:28:58.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.613+0000 7fdc7fe00640 1 --2- 172.21.15.31:0/3716667076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc7800ba10 0x7fdc78020f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:28:58.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.613+0000 7fdc84e00640 1 --2- 172.21.15.31:0/3716667076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7800a480 0x7fdc7817c090 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdc740ac000 tx=0x7fdc740a9510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:58.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.613+0000 7fdc7cc00640 1 -- 172.21.15.31:0/3716667076 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc740ad070 con 0x7fdc7800a480 2024-09-17T05:28:58.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.613+0000 7fdc7cc00640 1 -- 172.21.15.31:0/3716667076 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc74004030 con 0x7fdc7800a480 2024-09-17T05:28:58.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.613+0000 7fdc7cc00640 1 -- 172.21.15.31:0/3716667076 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc740044a0 con 0x7fdc7800a480 2024-09-17T05:28:58.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.613+0000 7fdc86200640 1 -- 172.21.15.31:0/3716667076 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc78021ae0 con 0x7fdc7800a480 2024-09-17T05:28:58.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.617+0000 7fdc86200640 1 -- 172.21.15.31:0/3716667076 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc7801ec90 con 0x7fdc7800a480 2024-09-17T05:28:58.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.617+0000 7fdc86200640 1 -- 172.21.15.31:0/3716667076 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc78006b10 con 0x7fdc7800a480 2024-09-17T05:28:58.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.621+0000 7fdc7cc00640 1 -- 172.21.15.31:0/3716667076 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdc740b0070 con 0x7fdc7800a480 2024-09-17T05:28:58.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.621+0000 7fdc7cc00640 1 --2- 172.21.15.31:0/3716667076 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdc60073200 0x7fdc600756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.621+0000 7fdc7cc00640 1 -- 172.21.15.31:0/3716667076 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdc7412ef20 con 0x7fdc7800a480 2024-09-17T05:28:58.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.625+0000 7fdc7fe00640 1 --2- 172.21.15.31:0/3716667076 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdc60073200 0x7fdc600756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.625+0000 7fdc7cc00640 1 -- 172.21.15.31:0/3716667076 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fdc7800ada0 con 0x7fdc7800a480 2024-09-17T05:28:58.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.625+0000 7fdc7fe00640 1 --2- 172.21.15.31:0/3716667076 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdc60073200 0x7fdc600756c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdc780ddeb0 tx=0x7fdc6c00b410 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:58.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.673+0000 7f0531600640 1 -- 172.21.15.31:0/2087782803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f052c0726b0 msgr2=0x7f052c150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.673+0000 7f0531600640 1 --2- 172.21.15.31:0/2087782803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f052c0726b0 0x7f052c150d50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0524009bc0 tx=0x7f052401f3d0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.673+0000 7f0531600640 1 -- 172.21.15.31:0/2087782803 shutdown_connections 2024-09-17T05:28:58.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.673+0000 7f0531600640 1 --2- 172.21.15.31:0/2087782803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f052c0726b0 0x7f052c150d50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.673+0000 7f0531600640 1 --2- 172.21.15.31:0/2087782803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f052c161ef0 0x7f052c0730c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.673+0000 7f0531600640 1 -- 172.21.15.31:0/2087782803 >> 172.21.15.31:0/2087782803 conn(0x7f052c06cc20 msgr2=0x7f052c06d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:58.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.673+0000 7f0531600640 1 -- 172.21.15.31:0/2087782803 shutdown_connections 2024-09-17T05:28:58.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.673+0000 7f0531600640 1 -- 172.21.15.31:0/2087782803 wait complete. 2024-09-17T05:28:58.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.677+0000 7f0531600640 1 Processor -- start 2024-09-17T05:28:58.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.677+0000 7f0531600640 1 -- start start 2024-09-17T05:28:58.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7f0531600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f052c0726b0 0x7f052c1f9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7f0531600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f052c161b10 0x7f052c1473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7fed3b200640 1 -- 172.21.15.31:0/1929335676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed3406ede0 msgr2=0x7fed340b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7fed32a00640 1 -- 172.21.15.31:0/1929335676 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20005cc0 con 0x7fed3406ede0 2024-09-17T05:28:58.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7fed3b200640 1 --2- 172.21.15.31:0/1929335676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed3406ede0 0x7fed340b4790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fed20009ca0 tx=0x7fed2001ce00 comp rx=0 tx=0).stop 2024-09-17T05:28:58.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7f052aa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f052c0726b0 0x7f052c1f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7f052aa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f052c0726b0 0x7f052c1f9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:58800/0 (socket says 172.21.15.31:58800) 2024-09-17T05:28:58.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7f052aa00640 1 -- 172.21.15.31:0/929119 learned_addr learned my addr 172.21.15.31:0/929119 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:58.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7f0531600640 1 --2- 172.21.15.31:0/929119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f052c161ef0 0x7f052c14f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7fed3b200640 1 -- 172.21.15.31:0/1929335676 shutdown_connections 2024-09-17T05:28:58.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7f052a000640 1 --2- 172.21.15.31:0/929119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f052c161b10 0x7f052c1473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7f052b400640 1 --2- 172.21.15.31:0/929119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f052c161ef0 0x7f052c14f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7fed3b200640 1 --2- 172.21.15.31:0/1929335676 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed3406ede0 0x7fed340b4790 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7fed3b200640 1 -- 172.21.15.31:0/1929335676 >> 172.21.15.31:0/1929335676 conn(0x7fed3406cc20 msgr2=0x7fed3406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:58.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7f0531600640 1 -- 172.21.15.31:0/929119 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f052c151410 con 0x7f052c161ef0 2024-09-17T05:28:58.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7fed3b200640 1 -- 172.21.15.31:0/1929335676 shutdown_connections 2024-09-17T05:28:58.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7f0531600640 1 -- 172.21.15.31:0/929119 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f052c151290 con 0x7f052c0726b0 2024-09-17T05:28:58.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7f0531600640 1 -- 172.21.15.31:0/929119 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f052c15f480 con 0x7f052c161b10 2024-09-17T05:28:58.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.681+0000 7fed3b200640 1 -- 172.21.15.31:0/1929335676 wait complete. 2024-09-17T05:28:58.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.685+0000 7f052a000640 1 -- 172.21.15.31:0/929119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f052c0726b0 msgr2=0x7f052c1f9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.685+0000 7f052a000640 1 --2- 172.21.15.31:0/929119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f052c0726b0 0x7f052c1f9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.685+0000 7f052a000640 1 -- 172.21.15.31:0/929119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f052c161ef0 msgr2=0x7f052c14f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.685+0000 7f052a000640 1 --2- 172.21.15.31:0/929119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f052c161ef0 0x7f052c14f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.685+0000 7f052a000640 1 -- 172.21.15.31:0/929119 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052c1f9d40 con 0x7f052c161b10 2024-09-17T05:28:58.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.685+0000 7f052a000640 1 --2- 172.21.15.31:0/929119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f052c161b10 0x7f052c1473c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f052c0b5060 tx=0x7f051800eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:58.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.685+0000 7fed3b200640 1 Processor -- start 2024-09-17T05:28:58.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.685+0000 7f0522a00640 1 -- 172.21.15.31:0/929119 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518004220 con 0x7f052c161b10 2024-09-17T05:28:58.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.685+0000 7f0522a00640 1 -- 172.21.15.31:0/929119 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05180043c0 con 0x7f052c161b10 2024-09-17T05:28:58.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.685+0000 7fed3b200640 1 -- start start 2024-09-17T05:28:58.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7f0522a00640 1 -- 172.21.15.31:0/929119 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051800cb10 con 0x7f052c161b10 2024-09-17T05:28:58.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed3b200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed3406ede0 0x7fed34159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7f0531600640 1 -- 172.21.15.31:0/929119 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f052c15c240 con 0x7f052c161b10 2024-09-17T05:28:58.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7f0531600640 1 -- 172.21.15.31:0/929119 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f052c15cae0 con 0x7f052c161b10 2024-09-17T05:28:58.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed3b200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed3406fdf0 0x7fed34163bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed3b200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed3408ba70 0x7fed34164110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed3b200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fed34178d90 con 0x7fed3408ba70 2024-09-17T05:28:58.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed3b200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fed34178c10 con 0x7fed3406fdf0 2024-09-17T05:28:58.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed3b200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fed34178f90 con 0x7fed3406ede0 2024-09-17T05:28:58.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed33e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed3406ede0 0x7fed34159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed33e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed3406ede0 0x7fed34159040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:58512/0 (socket says 172.21.15.31:58512) 2024-09-17T05:28:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed33e00640 1 -- 172.21.15.31:0/1138808468 learned_addr learned my addr 172.21.15.31:0/1138808468 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed33400640 1 --2- 172.21.15.31:0/1138808468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed3406fdf0 0x7fed34163bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed39200640 1 --2- 172.21.15.31:0/1138808468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed3408ba70 0x7fed34164110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed33400640 1 -- 172.21.15.31:0/1138808468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed3406ede0 msgr2=0x7fed34159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed33400640 1 --2- 172.21.15.31:0/1138808468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed3406ede0 0x7fed34159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed33400640 1 -- 172.21.15.31:0/1138808468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed3408ba70 msgr2=0x7fed34164110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7f0531600640 1 -- 172.21.15.31:0/929119 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f052c06e980 con 0x7f052c161b10 2024-09-17T05:28:58.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed33400640 1 --2- 172.21.15.31:0/1138808468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed3408ba70 0x7fed34164110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed33400640 1 -- 172.21.15.31:0/1138808468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed34167b20 con 0x7fed3406fdf0 2024-09-17T05:28:58.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed33e00640 1 --2- 172.21.15.31:0/1138808468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed3406ede0 0x7fed34159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:28:58.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed39200640 1 --2- 172.21.15.31:0/1138808468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed3408ba70 0x7fed34164110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:28:58.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed33400640 1 --2- 172.21.15.31:0/1138808468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed3406fdf0 0x7fed34163bd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fed200ac000 tx=0x7fed200042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:58.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed2be00640 1 -- 172.21.15.31:0/1138808468 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed200b2040 con 0x7fed3406fdf0 2024-09-17T05:28:58.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed2be00640 1 -- 172.21.15.31:0/1138808468 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed20003600 con 0x7fed3406fdf0 2024-09-17T05:28:58.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.689+0000 7fed2be00640 1 -- 172.21.15.31:0/1138808468 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20003a50 con 0x7fed3406fdf0 2024-09-17T05:28:58.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.693+0000 7fed3b200640 1 -- 172.21.15.31:0/1138808468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3415b260 con 0x7fed3406fdf0 2024-09-17T05:28:58.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.693+0000 7fed3b200640 1 -- 172.21.15.31:0/1138808468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed341680a0 con 0x7fed3406fdf0 2024-09-17T05:28:58.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.693+0000 7f0522a00640 1 -- 172.21.15.31:0/929119 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f051800ccb0 con 0x7f052c161b10 2024-09-17T05:28:58.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.697+0000 7f0522a00640 1 --2- 172.21.15.31:0/929119 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f050c073200 0x7f050c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.697+0000 7f0522a00640 1 -- 172.21.15.31:0/929119 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0518094990 con 0x7f052c161b10 2024-09-17T05:28:58.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.697+0000 7f052aa00640 1 --2- 172.21.15.31:0/929119 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f050c073200 0x7f050c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.697+0000 7fed3b200640 1 -- 172.21.15.31:0/1138808468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed0c0052a0 con 0x7fed3406fdf0 2024-09-17T05:28:58.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.697+0000 7fed2be00640 1 -- 172.21.15.31:0/1138808468 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fed200bd060 con 0x7fed3406fdf0 2024-09-17T05:28:58.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.697+0000 7fed2be00640 1 --2- 172.21.15.31:0/1138808468 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fed140732d0 0x7fed14075790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.697+0000 7fed2be00640 1 -- 172.21.15.31:0/1138808468 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fed2012d180 con 0x7fed3406fdf0 2024-09-17T05:28:58.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.697+0000 7f0522a00640 1 -- 172.21.15.31:0/929119 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f052c1f9d40 con 0x7f052c161b10 2024-09-17T05:28:58.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.697+0000 7f052aa00640 1 --2- 172.21.15.31:0/929119 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f050c073200 0x7f050c0756c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f051c001950 tx=0x7f051c007bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:58.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.697+0000 7fed33e00640 1 --2- 172.21.15.31:0/1138808468 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fed140732d0 0x7fed14075790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.701+0000 7fed33e00640 1 --2- 172.21.15.31:0/1138808468 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fed140732d0 0x7fed14075790 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fed341651e0 tx=0x7fed24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:58.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.701+0000 7fed2be00640 1 -- 172.21.15.31:0/1138808468 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fed200169f0 con 0x7fed3406fdf0 2024-09-17T05:28:58.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.753+0000 7ff045e00640 1 -- 172.21.15.31:0/1964541504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0400b4d80 msgr2=0x7ff0400b11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.753+0000 7ff045e00640 1 --2- 172.21.15.31:0/1964541504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0400b4d80 0x7ff0400b11a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff034009840 tx=0x7ff03401c6b0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7ff045e00640 1 -- 172.21.15.31:0/1964541504 shutdown_connections 2024-09-17T05:28:58.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7ff045e00640 1 --2- 172.21.15.31:0/1964541504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0400b4d80 0x7ff0400b11a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7ff045e00640 1 -- 172.21.15.31:0/1964541504 >> 172.21.15.31:0/1964541504 conn(0x7ff04009aa10 msgr2=0x7ff04009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:58.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7ff045e00640 1 -- 172.21.15.31:0/1964541504 shutdown_connections 2024-09-17T05:28:58.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7efe50800640 1 -- 172.21.15.31:0/1675978918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe30004810 msgr2=0x7efe30004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7efe50800640 1 --2- 172.21.15.31:0/1675978918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe30004810 0x7efe30004c90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efe3c006fd0 tx=0x7efe3c01d050 comp rx=0 tx=0).stop 2024-09-17T05:28:58.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7efe50800640 1 -- 172.21.15.31:0/1675978918 shutdown_connections 2024-09-17T05:28:58.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7efe50800640 1 --2- 172.21.15.31:0/1675978918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe30004810 0x7efe30004c90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7efe50800640 1 -- 172.21.15.31:0/1675978918 >> 172.21.15.31:0/1675978918 conn(0x7efe480d3fb0 msgr2=0x7efe480d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:58.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7efe50800640 1 -- 172.21.15.31:0/1675978918 shutdown_connections 2024-09-17T05:28:58.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7efe50800640 1 -- 172.21.15.31:0/1675978918 wait complete. 2024-09-17T05:28:58.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7ff045e00640 1 -- 172.21.15.31:0/1964541504 wait complete. 2024-09-17T05:28:58.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7ff045e00640 1 Processor -- start 2024-09-17T05:28:58.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7f7672000640 1 -- 172.21.15.31:0/2624192070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76540053d0 msgr2=0x7f765400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7f7672000640 1 --2- 172.21.15.31:0/2624192070 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76540053d0 0x7f765400b9d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f766400c640 tx=0x7f766c158920 comp rx=0 tx=0).stop 2024-09-17T05:28:58.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7f7671600640 1 -- 172.21.15.31:0/2624192070 reap_dead start 2024-09-17T05:28:58.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7f7672000640 1 -- 172.21.15.31:0/2624192070 shutdown_connections 2024-09-17T05:28:58.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7f7672000640 1 -- 172.21.15.31:0/2624192070 >> 172.21.15.31:0/2624192070 conn(0x7f766c074310 msgr2=0x7f766c0746f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:58.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7f7672000640 1 -- 172.21.15.31:0/2624192070 shutdown_connections 2024-09-17T05:28:58.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.761+0000 7f7672000640 1 -- 172.21.15.31:0/2624192070 wait complete. 2024-09-17T05:28:58.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7ff045e00640 1 -- start start 2024-09-17T05:28:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7efe50800640 1 Processor -- start 2024-09-17T05:28:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7efe50800640 1 -- start start 2024-09-17T05:28:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7f7672000640 1 Processor -- start 2024-09-17T05:28:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7efe50800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe30004810 0x7efe481f9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7efe50800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe4815bd60 0x7efe481fc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7efe50800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe481fcd60 0x7efe48157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7efe50800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efe48162380 con 0x7efe4815bd60 2024-09-17T05:28:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7efe50800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efe48162200 con 0x7efe481fcd60 2024-09-17T05:28:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7efe50800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efe4815e030 con 0x7efe30004810 2024-09-17T05:28:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7efe4de00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe30004810 0x7efe481f9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7efe4de00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe30004810 0x7efe481f9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:58564/0 (socket says 172.21.15.31:58564) 2024-09-17T05:28:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7efe4de00640 1 -- 172.21.15.31:0/1656611732 learned_addr learned my addr 172.21.15.31:0/1656611732 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:58.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7ff045e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0400b0ce0 0x7ff0401496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7ff045e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0400b4d80 0x7ff040151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7ff045e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0400b5870 0x7ff040152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7efe4e800640 1 --2- 172.21.15.31:0/1656611732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe481fcd60 0x7efe48157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7ff03fe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0400b4d80 0x7ff040151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7ff03fe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0400b4d80 0x7ff040151df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:58852/0 (socket says 172.21.15.31:58852) 2024-09-17T05:28:58.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7efe4de00640 1 -- 172.21.15.31:0/1656611732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe481fcd60 msgr2=0x7efe48157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7efe4de00640 1 --2- 172.21.15.31:0/1656611732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe481fcd60 0x7efe48157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7efe4de00640 1 -- 172.21.15.31:0/1656611732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe4815bd60 msgr2=0x7efe481fc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7efe4de00640 1 --2- 172.21.15.31:0/1656611732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe4815bd60 0x7efe481fc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7efe4de00640 1 -- 172.21.15.31:0/1656611732 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe481f9420 con 0x7efe30004810 2024-09-17T05:28:58.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7ff045e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff040166f10 con 0x7ff0400b0ce0 2024-09-17T05:28:58.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7ff045e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff040166d90 con 0x7ff0400b4d80 2024-09-17T05:28:58.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7ff045e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff040167090 con 0x7ff0400b5870 2024-09-17T05:28:58.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7ff03fe00640 1 -- 172.21.15.31:0/296905353 learned_addr learned my addr 172.21.15.31:0/296905353 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:58.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7ff045400640 1 --2- 172.21.15.31:0/296905353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0400b5870 0x7ff040152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.765+0000 7efe4de00640 1 --2- 172.21.15.31:0/1656611732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe30004810 0x7efe481f9c00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efe3800d7a0 tx=0x7efe3800dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:58.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.769+0000 7ff03fe00640 1 -- 172.21.15.31:0/296905353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0400b5870 msgr2=0x7ff040152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.769+0000 7ff03fe00640 1 --2- 172.21.15.31:0/296905353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0400b5870 0x7ff040152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.769+0000 7ff03fe00640 1 -- 172.21.15.31:0/296905353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0400b0ce0 msgr2=0x7ff0401496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.769+0000 7ff03fe00640 1 --2- 172.21.15.31:0/296905353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0400b0ce0 0x7ff0401496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.769+0000 7ff03fe00640 1 -- 172.21.15.31:0/296905353 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0400b2060 con 0x7ff0400b4d80 2024-09-17T05:28:58.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.769+0000 7efe42000640 1 -- 172.21.15.31:0/1656611732 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe38017070 con 0x7efe30004810 2024-09-17T05:28:58.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.769+0000 7efe42000640 1 -- 172.21.15.31:0/1656611732 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe38009d40 con 0x7efe30004810 2024-09-17T05:28:58.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.769+0000 7efe42000640 1 -- 172.21.15.31:0/1656611732 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe380106c0 con 0x7efe30004810 2024-09-17T05:28:58.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.769+0000 7efe50800640 1 -- 172.21.15.31:0/1656611732 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe481fd270 con 0x7efe30004810 2024-09-17T05:28:58.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.769+0000 7efe50800640 1 -- 172.21.15.31:0/1656611732 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efe481f96e0 con 0x7efe30004810 2024-09-17T05:28:58.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.769+0000 7ff03fe00640 1 --2- 172.21.15.31:0/296905353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0400b4d80 0x7ff040151df0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff02c00c4b0 tx=0x7ff02c00c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:58.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.769+0000 7f7672000640 1 -- start start 2024-09-17T05:28:58.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.769+0000 7efe50800640 1 -- 172.21.15.31:0/1656611732 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe48162500 con 0x7efe30004810 2024-09-17T05:28:58.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.769+0000 7fb0c5400640 1 -- 172.21.15.31:0/1423212812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0c00ca950 msgr2=0x7fb0c006e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.769+0000 7fb0c5400640 1 --2- 172.21.15.31:0/1423212812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0c00ca950 0x7fb0c006e960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8013fd0 tx=0x7fb0b8027aa0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.769+0000 7f7672000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76540053d0 0x7f766c156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.769+0000 7f7672000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f766c0b3090 0x7f766c162920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7f7670c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76540053d0 0x7f766c156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7f7670c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76540053d0 0x7f766c156c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:58574/0 (socket says 172.21.15.31:58574) 2024-09-17T05:28:58.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7ff03cc00640 1 -- 172.21.15.31:0/296905353 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02c016020 con 0x7ff0400b4d80 2024-09-17T05:28:58.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7ff03cc00640 1 -- 172.21.15.31:0/296905353 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff02c012920 con 0x7ff0400b4d80 2024-09-17T05:28:58.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7ff03cc00640 1 -- 172.21.15.31:0/296905353 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02c012d90 con 0x7ff0400b4d80 2024-09-17T05:28:58.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7ff045e00640 1 -- 172.21.15.31:0/296905353 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff040152960 con 0x7ff0400b4d80 2024-09-17T05:28:58.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7ff045e00640 1 -- 172.21.15.31:0/296905353 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff040202270 con 0x7ff0400b4d80 2024-09-17T05:28:58.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7fb0c5400640 1 -- 172.21.15.31:0/1423212812 shutdown_connections 2024-09-17T05:28:58.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7fb0c5400640 1 --2- 172.21.15.31:0/1423212812 >> v2:172.21.15.31:3300/0 conn(0x7fb0c00707b0 0x7fb0c0072d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7fb0c5400640 1 --2- 172.21.15.31:0/1423212812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0c00ca950 0x7fb0c006e960 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7fb0c5400640 1 -- 172.21.15.31:0/1423212812 >> 172.21.15.31:0/1423212812 conn(0x7fb0c00cfa30 msgr2=0x7fb0c00cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:58.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7fb0c5400640 1 -- 172.21.15.31:0/1423212812 shutdown_connections 2024-09-17T05:28:58.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7fb0c5400640 1 -- 172.21.15.31:0/1423212812 wait complete. 2024-09-17T05:28:58.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7f7670c00640 1 -- 172.21.15.31:0/1141559147 learned_addr learned my addr 172.21.15.31:0/1141559147 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:58.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7f766be00640 1 --2- 172.21.15.31:0/1141559147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f766c0b3090 0x7f766c162920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7f7672000640 1 --2- 172.21.15.31:0/1141559147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f766c0b3510 0x7f766c162e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7f7671600640 1 --2- 172.21.15.31:0/1141559147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f766c0b3510 0x7f766c162e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7f7672000640 1 -- 172.21.15.31:0/1141559147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f766c0ad980 con 0x7f766c0b3510 2024-09-17T05:28:58.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7f7672000640 1 -- 172.21.15.31:0/1141559147 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f766c0ad800 con 0x7f766c0b3090 2024-09-17T05:28:58.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7f7672000640 1 -- 172.21.15.31:0/1141559147 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f766c0adb00 con 0x7f76540053d0 2024-09-17T05:28:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7efe42000640 1 -- 172.21.15.31:0/1656611732 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efe3801a070 con 0x7efe30004810 2024-09-17T05:28:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7efe42000640 1 --2- 172.21.15.31:0/1656611732 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe2c073200 0x7efe2c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7efe42000640 1 -- 172.21.15.31:0/1656611732 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efe38094830 con 0x7efe30004810 2024-09-17T05:28:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7ff045e00640 1 -- 172.21.15.31:0/296905353 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff01c0052a0 con 0x7ff0400b4d80 2024-09-17T05:28:58.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7efe42000640 1 -- 172.21.15.31:0/1656611732 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7efe3805f270 con 0x7efe30004810 2024-09-17T05:28:58.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7f7671600640 1 -- 172.21.15.31:0/1141559147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76540053d0 msgr2=0x7f766c156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7f7671600640 1 --2- 172.21.15.31:0/1141559147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76540053d0 0x7f766c156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7f7671600640 1 -- 172.21.15.31:0/1141559147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f766c0b3090 msgr2=0x7f766c162920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7f7671600640 1 --2- 172.21.15.31:0/1141559147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f766c0b3090 0x7f766c162920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.773+0000 7f7671600640 1 -- 172.21.15.31:0/1141559147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766c050f90 con 0x7f766c0b3510 2024-09-17T05:28:58.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7efe4d400640 1 --2- 172.21.15.31:0/1656611732 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe2c073200 0x7efe2c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7f7434200640 1 -- 172.21.15.31:0/122448867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7414003ab0 msgr2=0x7f7414003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7f7434200640 1 --2- 172.21.15.31:0/122448867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7414003ab0 0x7f7414003e90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f741c009b30 tx=0x7f741c01d230 comp rx=0 tx=0).stop 2024-09-17T05:28:58.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7f7671600640 1 --2- 172.21.15.31:0/1141559147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f766c0b3510 0x7f766c162e60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f765400c470 tx=0x7f766401bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:58.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7f7670c00640 1 --2- 172.21.15.31:0/1141559147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76540053d0 0x7f766c156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:28:58.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7ff03cc00640 1 -- 172.21.15.31:0/296905353 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff02c019020 con 0x7ff0400b4d80 2024-09-17T05:28:58.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7ff03cc00640 1 --2- 172.21.15.31:0/296905353 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff0200732d0 0x7ff020075790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7ff03cc00640 1 -- 172.21.15.31:0/296905353 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff02c094060 con 0x7ff0400b4d80 2024-09-17T05:28:58.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7fb0c5400640 1 Processor -- start 2024-09-17T05:28:58.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7fb0c5400640 1 -- start start 2024-09-17T05:28:58.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7f7668c00640 1 -- 172.21.15.31:0/1141559147 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7664004e40 con 0x7f766c0b3510 2024-09-17T05:28:58.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7f7434200640 1 -- 172.21.15.31:0/122448867 shutdown_connections 2024-09-17T05:28:58.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7f7434200640 1 --2- 172.21.15.31:0/122448867 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7414003ab0 0x7f7414003e90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7f7434200640 1 -- 172.21.15.31:0/122448867 >> 172.21.15.31:0/122448867 conn(0x7f742c0d0a30 msgr2=0x7f742c0d0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:58.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7efe4d400640 1 --2- 172.21.15.31:0/1656611732 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe2c073200 0x7efe2c0756c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efe3c001ec0 tx=0x7efe30005840 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:58.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7f7434200640 1 -- 172.21.15.31:0/122448867 shutdown_connections 2024-09-17T05:28:58.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7f7672000640 1 -- 172.21.15.31:0/1141559147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f766c0c6bc0 con 0x7f766c0b3510 2024-09-17T05:28:58.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7f7672000640 1 -- 172.21.15.31:0/1141559147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f766c0b5430 con 0x7f766c0b3510 2024-09-17T05:28:58.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7f7668c00640 1 -- 172.21.15.31:0/1141559147 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76640c0020 con 0x7f766c0b3510 2024-09-17T05:28:58.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7f7668c00640 1 -- 172.21.15.31:0/1141559147 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76640bc9e0 con 0x7f766c0b3510 2024-09-17T05:28:58.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7ff044a00640 1 --2- 172.21.15.31:0/296905353 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff0200732d0 0x7ff020075790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7f7434200640 1 -- 172.21.15.31:0/122448867 wait complete. 2024-09-17T05:28:58.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7fb0c5400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0c00707b0 0x7fb0c01f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.777+0000 7fb0c5400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0c00af120 0x7fb0c014dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.781+0000 7fb0c5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0c00ca950 0x7fb0c0153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.781+0000 7fb0c5400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c015eb30 con 0x7fb0c00ca950 2024-09-17T05:28:58.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.781+0000 7fb0c5400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c0073980 con 0x7fb0c00af120 2024-09-17T05:28:58.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.781+0000 7fb0c5400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c015ecb0 con 0x7fb0c00707b0 2024-09-17T05:28:58.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.781+0000 7fb0bf400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0c00af120 0x7fb0c014dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.781+0000 7fb0bf400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0c00af120 0x7fb0c014dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:58870/0 (socket says 172.21.15.31:58870) 2024-09-17T05:28:58.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.781+0000 7fb0bf400640 1 -- 172.21.15.31:0/1685527153 learned_addr learned my addr 172.21.15.31:0/1685527153 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:58.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.781+0000 7f7672000640 1 -- 172.21.15.31:0/1141559147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76480052a0 con 0x7f766c0b3510 2024-09-17T05:28:58.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.781+0000 7f7434200640 1 Processor -- start 2024-09-17T05:28:58.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.781+0000 7f7434200640 1 -- start start 2024-09-17T05:28:58.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.781+0000 7fb0bfe00640 1 --2- 172.21.15.31:0/1685527153 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0c00707b0 0x7fb0c01f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.781+0000 7fb0c4a00640 1 --2- 172.21.15.31:0/1685527153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0c00ca950 0x7fb0c0153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7ff03cc00640 1 -- 172.21.15.31:0/296905353 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff02c020020 con 0x7ff0400b4d80 2024-09-17T05:28:58.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7ff044a00640 1 --2- 172.21.15.31:0/296905353 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff0200732d0 0x7ff020075790 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff0340af000 tx=0x7ff034019450 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:58.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7f7434200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7414003ab0 0x7f742c0c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7f7434200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f742c157be0 0x7f742c162a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7f7431800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7414003ab0 0x7f742c0c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7f7431800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7414003ab0 0x7f742c0c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:58876/0 (socket says 172.21.15.31:58876) 2024-09-17T05:28:58.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7f7434200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f742c162f70 0x7f742c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7fb0bfe00640 1 -- 172.21.15.31:0/1685527153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0c00af120 msgr2=0x7fb0c014dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7fb0bfe00640 1 --2- 172.21.15.31:0/1685527153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0c00af120 0x7fb0c014dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7fb0bfe00640 1 -- 172.21.15.31:0/1685527153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0c00ca950 msgr2=0x7fb0c0153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7fb0bfe00640 1 --2- 172.21.15.31:0/1685527153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0c00ca950 0x7fb0c0153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7fb0bfe00640 1 -- 172.21.15.31:0/1685527153 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c01f05d0 con 0x7fb0c00707b0 2024-09-17T05:28:58.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7f7668c00640 1 -- 172.21.15.31:0/1141559147 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f76640bcb80 con 0x7f766c0b3510 2024-09-17T05:28:58.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7f7430e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f742c157be0 0x7f742c162a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7f7430e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f742c157be0 0x7f742c162a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:58588/0 (socket says 172.21.15.31:58588) 2024-09-17T05:28:58.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7f7434200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f742c0b3130 con 0x7f742c162f70 2024-09-17T05:28:58.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7f7434200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f742c09cb50 con 0x7f7414003ab0 2024-09-17T05:28:58.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7f7434200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f742c0b32b0 con 0x7f742c157be0 2024-09-17T05:28:58.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7f7431800640 1 -- 172.21.15.31:0/2294199390 learned_addr learned my addr 172.21.15.31:0/2294199390 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:58.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7fb0bfe00640 1 --2- 172.21.15.31:0/1685527153 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0c00707b0 0x7fb0c01f45d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00706a0 tx=0x7fb0b80092e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:58.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7f7432200640 1 --2- 172.21.15.31:0/2294199390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f742c162f70 0x7f742c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7fb0b7e00640 1 -- 172.21.15.31:0/1685527153 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b80be040 con 0x7fb0c00707b0 2024-09-17T05:28:58.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7fb0b7e00640 1 -- 172.21.15.31:0/1685527153 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0b8003b50 con 0x7fb0c00707b0 2024-09-17T05:28:58.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7f7430e00640 1 -- 172.21.15.31:0/2294199390 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7414003ab0 msgr2=0x7f742c0c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7f7430e00640 1 --2- 172.21.15.31:0/2294199390 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7414003ab0 0x7f742c0c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.785+0000 7f7430e00640 1 -- 172.21.15.31:0/2294199390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f742c162f70 msgr2=0x7f742c15b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:58.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.789+0000 7f7430e00640 1 --2- 172.21.15.31:0/2294199390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f742c162f70 0x7f742c15b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:58.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.789+0000 7fb0b7e00640 1 -- 172.21.15.31:0/1685527153 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8004030 con 0x7fb0c00707b0 2024-09-17T05:28:58.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.789+0000 7f7668c00640 1 --2- 172.21.15.31:0/1141559147 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f764c073200 0x7f764c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.789+0000 7f7668c00640 1 -- 172.21.15.31:0/1141559147 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7664136af0 con 0x7f766c0b3510 2024-09-17T05:28:58.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.789+0000 7f7430e00640 1 -- 172.21.15.31:0/2294199390 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742c1ffec0 con 0x7f742c157be0 2024-09-17T05:28:58.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.789+0000 7f7432200640 1 --2- 172.21.15.31:0/2294199390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f742c162f70 0x7f742c15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:28:58.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.789+0000 7f7430e00640 1 --2- 172.21.15.31:0/2294199390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f742c157be0 0x7f742c162a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f742000d580 tx=0x7f742000da40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:58.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.789+0000 7f7429600640 1 -- 172.21.15.31:0/2294199390 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420003620 con 0x7f742c157be0 2024-09-17T05:28:58.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.789+0000 7f7429600640 1 -- 172.21.15.31:0/2294199390 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74200038b0 con 0x7f742c157be0 2024-09-17T05:28:58.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.789+0000 7f7429600640 1 -- 172.21.15.31:0/2294199390 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420003d00 con 0x7f742c157be0 2024-09-17T05:28:58.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.789+0000 7fb0c5400640 1 -- 172.21.15.31:0/1685527153 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c014e590 con 0x7fb0c00707b0 2024-09-17T05:28:58.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.789+0000 7fb0c5400640 1 -- 172.21.15.31:0/1685527153 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c01f0b30 con 0x7fb0c00707b0 2024-09-17T05:28:58.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.789+0000 7f7434200640 1 -- 172.21.15.31:0/2294199390 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742c2001a0 con 0x7f742c157be0 2024-09-17T05:28:58.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.789+0000 7f7434200640 1 -- 172.21.15.31:0/2294199390 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f742c200760 con 0x7f742c157be0 2024-09-17T05:28:58.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.793+0000 7f7670c00640 1 --2- 172.21.15.31:0/1141559147 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f764c073200 0x7f764c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.793+0000 7fb0c5400640 1 -- 172.21.15.31:0/1685527153 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0c0072d20 con 0x7fb0c00707b0 2024-09-17T05:28:58.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.793+0000 7f7670c00640 1 --2- 172.21.15.31:0/1141559147 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f764c073200 0x7f764c0756c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f766000bac0 tx=0x7f7660005d20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:58.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.793+0000 7fb0b7e00640 1 -- 172.21.15.31:0/1685527153 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb0b80c9070 con 0x7fb0c00707b0 2024-09-17T05:28:58.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.793+0000 7f7429600640 1 -- 172.21.15.31:0/2294199390 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f742000b4d0 con 0x7f742c157be0 2024-09-17T05:28:58.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.793+0000 7fb0b7e00640 1 --2- 172.21.15.31:0/1685527153 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb0a0073250 0x7fb0a0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.797+0000 7f7434200640 1 -- 172.21.15.31:0/2294199390 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742c163380 con 0x7f742c157be0 2024-09-17T05:28:58.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.797+0000 7fb0b7e00640 1 -- 172.21.15.31:0/1685527153 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb0b8002020 con 0x7fb0c00707b0 2024-09-17T05:28:58.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.797+0000 7fb0bf400640 1 --2- 172.21.15.31:0/1685527153 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb0a0073250 0x7fb0a0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.797+0000 7f7429600640 1 --2- 172.21.15.31:0/2294199390 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7410073300 0x7f74100757c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:58.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.797+0000 7f7429600640 1 -- 172.21.15.31:0/2294199390 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7420093fa0 con 0x7f742c157be0 2024-09-17T05:28:58.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.797+0000 7fb0bf400640 1 --2- 172.21.15.31:0/1685527153 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb0a0073250 0x7fb0a0075710 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0155e30 tx=0x7fb0ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:58.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.797+0000 7f7431800640 1 --2- 172.21.15.31:0/2294199390 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7410073300 0x7f74100757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:58.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.797+0000 7f7668c00640 1 -- 172.21.15.31:0/1141559147 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f76640ca030 con 0x7f766c0b3510 2024-09-17T05:28:58.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.797+0000 7f7431800640 1 --2- 172.21.15.31:0/2294199390 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7410073300 0x7f74100757c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f741c01bb10 tx=0x7f741c01a030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:58.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.801+0000 7fb0b7e00640 1 -- 172.21.15.31:0/1685527153 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb0c01f05d0 con 0x7fb0c00707b0 2024-09-17T05:28:58.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.805+0000 7f7429600640 1 -- 172.21.15.31:0/2294199390 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f742c163380 con 0x7f742c157be0 2024-09-17T05:28:58.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:58.997+0000 7fdc86200640 1 -- 172.21.15.31:0/3716667076 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fdc780329c0 con 0x7fdc7800a480 2024-09-17T05:28:59.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.001+0000 7fdc7cc00640 1 -- 172.21.15.31:0/3716667076 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdc740fa040 con 0x7fdc7800a480 2024-09-17T05:28:59.003 INFO:teuthology.orchestra.run.smithi031.stdout:60129542151 2024-09-17T05:28:59.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.005+0000 7fdc86200640 1 -- 172.21.15.31:0/3716667076 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdc60073200 msgr2=0x7fdc600756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.005+0000 7fdc86200640 1 --2- 172.21.15.31:0/3716667076 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdc60073200 0x7fdc600756c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdc780ddeb0 tx=0x7fdc6c00b410 comp rx=0 tx=0).stop 2024-09-17T05:28:59.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.005+0000 7fdc86200640 1 -- 172.21.15.31:0/3716667076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7800a480 msgr2=0x7fdc7817c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.005+0000 7fdc86200640 1 --2- 172.21.15.31:0/3716667076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7800a480 0x7fdc7817c090 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdc740ac000 tx=0x7fdc740a9510 comp rx=0 tx=0).stop 2024-09-17T05:28:59.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.005+0000 7fdc86200640 1 -- 172.21.15.31:0/3716667076 shutdown_connections 2024-09-17T05:28:59.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.005+0000 7fdc86200640 1 --2- 172.21.15.31:0/3716667076 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdc60073200 0x7fdc600756c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.005+0000 7fdc86200640 1 --2- 172.21.15.31:0/3716667076 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc7801c370 0x7fdc78021480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.005+0000 7fdc86200640 1 --2- 172.21.15.31:0/3716667076 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc7800ba10 0x7fdc78020f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.005+0000 7fdc86200640 1 --2- 172.21.15.31:0/3716667076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7800a480 0x7fdc7817c090 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.005+0000 7fdc86200640 1 -- 172.21.15.31:0/3716667076 >> 172.21.15.31:0/3716667076 conn(0x7fdc78054570 msgr2=0x7fdc78035d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:59.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.005+0000 7fdc86200640 1 -- 172.21.15.31:0/3716667076 shutdown_connections 2024-09-17T05:28:59.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.005+0000 7fdc86200640 1 -- 172.21.15.31:0/3716667076 wait complete. 2024-09-17T05:28:59.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.5 2024-09-17T05:28:59.042 DEBUG:teuthology.parallel:result is None 2024-09-17T05:28:59.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.049+0000 7fed3b200640 1 -- 172.21.15.31:0/1138808468 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fed0c005590 con 0x7fed3406fdf0 2024-09-17T05:28:59.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.049+0000 7fed2be00640 1 -- 172.21.15.31:0/1138808468 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fed200f8360 con 0x7fed3406fdf0 2024-09-17T05:28:59.054 INFO:teuthology.orchestra.run.smithi031.stdout:64424509448 2024-09-17T05:28:59.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.053+0000 7fed3b200640 1 -- 172.21.15.31:0/1138808468 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fed140732d0 msgr2=0x7fed14075790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.053+0000 7fed3b200640 1 --2- 172.21.15.31:0/1138808468 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fed140732d0 0x7fed14075790 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fed341651e0 tx=0x7fed24009040 comp rx=0 tx=0).stop 2024-09-17T05:28:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.053+0000 7fed3b200640 1 -- 172.21.15.31:0/1138808468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed3406fdf0 msgr2=0x7fed34163bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.053+0000 7fed3b200640 1 --2- 172.21.15.31:0/1138808468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed3406fdf0 0x7fed34163bd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fed200ac000 tx=0x7fed200042f0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.053+0000 7fed3b200640 1 -- 172.21.15.31:0/1138808468 shutdown_connections 2024-09-17T05:28:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.053+0000 7fed3b200640 1 --2- 172.21.15.31:0/1138808468 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fed140732d0 0x7fed14075790 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.053+0000 7fed3b200640 1 --2- 172.21.15.31:0/1138808468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed3408ba70 0x7fed34164110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.053+0000 7fed3b200640 1 --2- 172.21.15.31:0/1138808468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed3406fdf0 0x7fed34163bd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.053+0000 7fed3b200640 1 --2- 172.21.15.31:0/1138808468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fed3406ede0 0x7fed34159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.053+0000 7fed3b200640 1 -- 172.21.15.31:0/1138808468 >> 172.21.15.31:0/1138808468 conn(0x7fed3406cc20 msgr2=0x7fed3406e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:59.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.053+0000 7fed3b200640 1 -- 172.21.15.31:0/1138808468 shutdown_connections 2024-09-17T05:28:59.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.053+0000 7fed3b200640 1 -- 172.21.15.31:0/1138808468 wait complete. 2024-09-17T05:28:59.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.065+0000 7f0531600640 1 -- 172.21.15.31:0/929119 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f052c148060 con 0x7f052c161b10 2024-09-17T05:28:59.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.065+0000 7f0522a00640 1 -- 172.21.15.31:0/929119 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f051805f350 con 0x7f052c161b10 2024-09-17T05:28:59.069 INFO:teuthology.orchestra.run.smithi031.stdout:60129542150 2024-09-17T05:28:59.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.065+0000 7f0531600640 1 -- 172.21.15.31:0/929119 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f050c073200 msgr2=0x7f050c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.065+0000 7f0531600640 1 --2- 172.21.15.31:0/929119 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f050c073200 0x7f050c0756c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f051c001950 tx=0x7f051c007bf0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.069+0000 7f0531600640 1 -- 172.21.15.31:0/929119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f052c161b10 msgr2=0x7f052c1473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.069+0000 7f0531600640 1 --2- 172.21.15.31:0/929119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f052c161b10 0x7f052c1473c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f052c0b5060 tx=0x7f051800eb50 comp rx=0 tx=0).stop 2024-09-17T05:28:59.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.069+0000 7f0531600640 1 -- 172.21.15.31:0/929119 shutdown_connections 2024-09-17T05:28:59.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.069+0000 7f0531600640 1 --2- 172.21.15.31:0/929119 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f050c073200 0x7f050c0756c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.069+0000 7f0531600640 1 --2- 172.21.15.31:0/929119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f052c161ef0 0x7f052c14f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.069+0000 7f0531600640 1 --2- 172.21.15.31:0/929119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f052c161b10 0x7f052c1473c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.069+0000 7f0531600640 1 --2- 172.21.15.31:0/929119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f052c0726b0 0x7f052c1f9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.069+0000 7f0531600640 1 -- 172.21.15.31:0/929119 >> 172.21.15.31:0/929119 conn(0x7f052c06cc20 msgr2=0x7f052c0b3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:59.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.069+0000 7f0531600640 1 -- 172.21.15.31:0/929119 shutdown_connections 2024-09-17T05:28:59.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.069+0000 7f0531600640 1 -- 172.21.15.31:0/929119 wait complete. 2024-09-17T05:28:59.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2024-09-17T05:28:59.094 DEBUG:teuthology.parallel:result is None 2024-09-17T05:28:59.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2024-09-17T05:28:59.095 DEBUG:teuthology.parallel:result is None 2024-09-17T05:28:59.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.125+0000 7f7434200640 1 -- 172.21.15.31:0/2294199390 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f742c09bf90 con 0x7f742c157be0 2024-09-17T05:28:59.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.125+0000 7f7429600640 1 -- 172.21.15.31:0/2294199390 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f742c163380 con 0x7f742c157be0 2024-09-17T05:28:59.131 INFO:teuthology.orchestra.run.smithi031.stdout:64424509448 2024-09-17T05:28:59.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.129+0000 7f7434200640 1 -- 172.21.15.31:0/2294199390 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7410073300 msgr2=0x7f74100757c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.129+0000 7f7434200640 1 --2- 172.21.15.31:0/2294199390 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7410073300 0x7f74100757c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f741c01bb10 tx=0x7f741c01a030 comp rx=0 tx=0).stop 2024-09-17T05:28:59.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.129+0000 7f7434200640 1 -- 172.21.15.31:0/2294199390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f742c157be0 msgr2=0x7f742c162a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.129+0000 7f7434200640 1 --2- 172.21.15.31:0/2294199390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f742c157be0 0x7f742c162a30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f742000d580 tx=0x7f742000da40 comp rx=0 tx=0).stop 2024-09-17T05:28:59.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.129+0000 7f7434200640 1 -- 172.21.15.31:0/2294199390 shutdown_connections 2024-09-17T05:28:59.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.129+0000 7f7434200640 1 --2- 172.21.15.31:0/2294199390 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7410073300 0x7f74100757c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.129+0000 7f7434200640 1 --2- 172.21.15.31:0/2294199390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f742c162f70 0x7f742c15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.129+0000 7f7434200640 1 --2- 172.21.15.31:0/2294199390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f742c157be0 0x7f742c162a30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.129+0000 7f7434200640 1 --2- 172.21.15.31:0/2294199390 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7414003ab0 0x7f742c0c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.129+0000 7f7434200640 1 -- 172.21.15.31:0/2294199390 >> 172.21.15.31:0/2294199390 conn(0x7f742c0d0a30 msgr2=0x7f742c0b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:59.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.129+0000 7f7434200640 1 -- 172.21.15.31:0/2294199390 shutdown_connections 2024-09-17T05:28:59.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.129+0000 7f7434200640 1 -- 172.21.15.31:0/2294199390 wait complete. 2024-09-17T05:28:59.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.3 2024-09-17T05:28:59.153 DEBUG:teuthology.parallel:result is None 2024-09-17T05:28:59.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.153+0000 7efe50800640 1 -- 172.21.15.31:0/1656611732 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7efe4808d600 con 0x7efe30004810 2024-09-17T05:28:59.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.153+0000 7efe42000640 1 -- 172.21.15.31:0/1656611732 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efe38063ca0 con 0x7efe30004810 2024-09-17T05:28:59.156 INFO:teuthology.orchestra.run.smithi031.stdout:64424509446 2024-09-17T05:28:59.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.157+0000 7efe50800640 1 -- 172.21.15.31:0/1656611732 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe2c073200 msgr2=0x7efe2c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.157+0000 7efe50800640 1 --2- 172.21.15.31:0/1656611732 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe2c073200 0x7efe2c0756c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efe3c001ec0 tx=0x7efe30005840 comp rx=0 tx=0).stop 2024-09-17T05:28:59.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.157+0000 7efe50800640 1 -- 172.21.15.31:0/1656611732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe30004810 msgr2=0x7efe481f9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.157+0000 7efe50800640 1 --2- 172.21.15.31:0/1656611732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe30004810 0x7efe481f9c00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efe3800d7a0 tx=0x7efe3800dc60 comp rx=0 tx=0).stop 2024-09-17T05:28:59.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.157+0000 7efe50800640 1 -- 172.21.15.31:0/1656611732 shutdown_connections 2024-09-17T05:28:59.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.157+0000 7efe50800640 1 --2- 172.21.15.31:0/1656611732 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe2c073200 0x7efe2c0756c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.157+0000 7efe50800640 1 --2- 172.21.15.31:0/1656611732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe481fcd60 0x7efe48157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.157+0000 7efe50800640 1 --2- 172.21.15.31:0/1656611732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe4815bd60 0x7efe481fc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.157+0000 7efe50800640 1 --2- 172.21.15.31:0/1656611732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe30004810 0x7efe481f9c00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.157+0000 7efe50800640 1 -- 172.21.15.31:0/1656611732 >> 172.21.15.31:0/1656611732 conn(0x7efe480d3fb0 msgr2=0x7efe480b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:59.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.157+0000 7efe50800640 1 -- 172.21.15.31:0/1656611732 shutdown_connections 2024-09-17T05:28:59.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.157+0000 7efe50800640 1 -- 172.21.15.31:0/1656611732 wait complete. 2024-09-17T05:28:59.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.157+0000 7ff045e00640 1 -- 172.21.15.31:0/296905353 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff01c005590 con 0x7ff0400b4d80 2024-09-17T05:28:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.157+0000 7ff03cc00640 1 -- 172.21.15.31:0/296905353 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff02c05f0f0 con 0x7ff0400b4d80 2024-09-17T05:28:59.163 INFO:teuthology.orchestra.run.smithi031.stdout:64424509448 2024-09-17T05:28:59.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.161+0000 7ff045e00640 1 -- 172.21.15.31:0/296905353 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff0200732d0 msgr2=0x7ff020075790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.161+0000 7ff045e00640 1 --2- 172.21.15.31:0/296905353 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff0200732d0 0x7ff020075790 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff0340af000 tx=0x7ff034019450 comp rx=0 tx=0).stop 2024-09-17T05:28:59.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.161+0000 7ff045e00640 1 -- 172.21.15.31:0/296905353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0400b4d80 msgr2=0x7ff040151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.161+0000 7ff045e00640 1 --2- 172.21.15.31:0/296905353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0400b4d80 0x7ff040151df0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff02c00c4b0 tx=0x7ff02c00c970 comp rx=0 tx=0).stop 2024-09-17T05:28:59.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.161+0000 7ff045e00640 1 -- 172.21.15.31:0/296905353 shutdown_connections 2024-09-17T05:28:59.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.161+0000 7ff045e00640 1 --2- 172.21.15.31:0/296905353 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff0200732d0 0x7ff020075790 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.161+0000 7ff045e00640 1 --2- 172.21.15.31:0/296905353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0400b5870 0x7ff040152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.161+0000 7ff045e00640 1 --2- 172.21.15.31:0/296905353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0400b4d80 0x7ff040151df0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.161+0000 7ff045e00640 1 --2- 172.21.15.31:0/296905353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0400b0ce0 0x7ff0401496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.161+0000 7ff045e00640 1 -- 172.21.15.31:0/296905353 >> 172.21.15.31:0/296905353 conn(0x7ff04009aa10 msgr2=0x7ff0400b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:59.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.161+0000 7ff045e00640 1 -- 172.21.15.31:0/296905353 shutdown_connections 2024-09-17T05:28:59.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.161+0000 7ff045e00640 1 -- 172.21.15.31:0/296905353 wait complete. 2024-09-17T05:28:59.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.169+0000 7fb0c5400640 1 -- 172.21.15.31:0/1685527153 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb0c00afc80 con 0x7fb0c00707b0 2024-09-17T05:28:59.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.169+0000 7fb0b7e00640 1 -- 172.21.15.31:0/1685527153 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb0b8021600 con 0x7fb0c00707b0 2024-09-17T05:28:59.173 INFO:teuthology.orchestra.run.smithi031.stdout:64424509447 2024-09-17T05:28:59.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.169+0000 7fb0c5400640 1 -- 172.21.15.31:0/1685527153 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb0a0073250 msgr2=0x7fb0a0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.169+0000 7fb0c5400640 1 --2- 172.21.15.31:0/1685527153 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb0a0073250 0x7fb0a0075710 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0155e30 tx=0x7fb0ac009040 comp rx=0 tx=0).stop 2024-09-17T05:28:59.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.169+0000 7fb0c5400640 1 -- 172.21.15.31:0/1685527153 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0c00707b0 msgr2=0x7fb0c01f45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.169+0000 7fb0c5400640 1 --2- 172.21.15.31:0/1685527153 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0c00707b0 0x7fb0c01f45d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00706a0 tx=0x7fb0b80092e0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.173+0000 7fb0c5400640 1 -- 172.21.15.31:0/1685527153 shutdown_connections 2024-09-17T05:28:59.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.173+0000 7fb0c5400640 1 --2- 172.21.15.31:0/1685527153 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb0a0073250 0x7fb0a0075710 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.173+0000 7fb0c5400640 1 --2- 172.21.15.31:0/1685527153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0c00ca950 0x7fb0c0153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.173+0000 7fb0c5400640 1 --2- 172.21.15.31:0/1685527153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0c00af120 0x7fb0c014dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.173+0000 7fb0c5400640 1 --2- 172.21.15.31:0/1685527153 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0c00707b0 0x7fb0c01f45d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.173+0000 7fb0c5400640 1 -- 172.21.15.31:0/1685527153 >> 172.21.15.31:0/1685527153 conn(0x7fb0c00cfa30 msgr2=0x7fb0c015dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:59.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.173+0000 7fb0c5400640 1 -- 172.21.15.31:0/1685527153 shutdown_connections 2024-09-17T05:28:59.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.173+0000 7fb0c5400640 1 -- 172.21.15.31:0/1685527153 wait complete. 2024-09-17T05:28:59.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.173+0000 7f7672000640 1 -- 172.21.15.31:0/1141559147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7648005590 con 0x7f766c0b3510 2024-09-17T05:28:59.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.173+0000 7f7668c00640 1 -- 172.21.15.31:0/1141559147 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7664017070 con 0x7f766c0b3510 2024-09-17T05:28:59.177 INFO:teuthology.orchestra.run.smithi031.stdout:64424509448 2024-09-17T05:28:59.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.177+0000 7f7672000640 1 -- 172.21.15.31:0/1141559147 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f764c073200 msgr2=0x7f764c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.177+0000 7f7672000640 1 --2- 172.21.15.31:0/1141559147 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f764c073200 0x7f764c0756c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f766000bac0 tx=0x7f7660005d20 comp rx=0 tx=0).stop 2024-09-17T05:28:59.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.177+0000 7f7672000640 1 -- 172.21.15.31:0/1141559147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f766c0b3510 msgr2=0x7f766c162e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.177+0000 7f7672000640 1 --2- 172.21.15.31:0/1141559147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f766c0b3510 0x7f766c162e60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f765400c470 tx=0x7f766401bb50 comp rx=0 tx=0).stop 2024-09-17T05:28:59.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.177+0000 7f7672000640 1 -- 172.21.15.31:0/1141559147 shutdown_connections 2024-09-17T05:28:59.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.177+0000 7f7672000640 1 --2- 172.21.15.31:0/1141559147 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f764c073200 0x7f764c0756c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.177+0000 7f7672000640 1 --2- 172.21.15.31:0/1141559147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f766c0b3510 0x7f766c162e60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.177+0000 7f7672000640 1 --2- 172.21.15.31:0/1141559147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f766c0b3090 0x7f766c162920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.177+0000 7f7672000640 1 --2- 172.21.15.31:0/1141559147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76540053d0 0x7f766c156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.177+0000 7f7672000640 1 -- 172.21.15.31:0/1141559147 >> 172.21.15.31:0/1141559147 conn(0x7f766c074310 msgr2=0x7f766c06ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:59.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.177+0000 7f7672000640 1 -- 172.21.15.31:0/1141559147 shutdown_connections 2024-09-17T05:28:59.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.177+0000 7f7672000640 1 -- 172.21.15.31:0/1141559147 wait complete. 2024-09-17T05:28:59.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-09-17T05:28:59.186 DEBUG:teuthology.parallel:result is None 2024-09-17T05:28:59.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.6 2024-09-17T05:28:59.191 DEBUG:teuthology.parallel:result is None 2024-09-17T05:28:59.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.7 2024-09-17T05:28:59.209 DEBUG:teuthology.parallel:result is None 2024-09-17T05:28:59.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.2 2024-09-17T05:28:59.210 DEBUG:teuthology.parallel:result is None 2024-09-17T05:28:59.210 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:28:59.210 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:28:59.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.393+0000 7f4275a00640 1 -- 172.21.15.31:0/225063890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42700b0cb0 msgr2=0x7f42700c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.393+0000 7f4275a00640 1 --2- 172.21.15.31:0/225063890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42700b0cb0 0x7f42700c74f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f427015dfb0 tx=0x7f426001f0b0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.393+0000 7f4275a00640 1 -- 172.21.15.31:0/225063890 shutdown_connections 2024-09-17T05:28:59.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.393+0000 7f4275a00640 1 --2- 172.21.15.31:0/225063890 >> v2:172.21.15.155:3300/0 conn(0x7f42700b1650 0x7f4270074380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.393+0000 7f4275a00640 1 --2- 172.21.15.31:0/225063890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42700b0cb0 0x7f42700c74f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.393+0000 7f4275a00640 1 -- 172.21.15.31:0/225063890 >> 172.21.15.31:0/225063890 conn(0x7f42700b1f10 msgr2=0x7f42700b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:59.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.393+0000 7f4275a00640 1 -- 172.21.15.31:0/225063890 shutdown_connections 2024-09-17T05:28:59.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.393+0000 7f4275a00640 1 -- 172.21.15.31:0/225063890 wait complete. 2024-09-17T05:28:59.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.393+0000 7f4275a00640 1 Processor -- start 2024-09-17T05:28:59.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.393+0000 7f4275a00640 1 -- start start 2024-09-17T05:28:59.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.393+0000 7f4275a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42700b0cb0 0x7f42700af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:59.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.393+0000 7f4275a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42700b1120 0x7f42700af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:59.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.393+0000 7f4275a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42700b1650 0x7f42700c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:59.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.393+0000 7f4275a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4270074a40 con 0x7f42700b1650 2024-09-17T05:28:59.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.393+0000 7f4275a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f42700748c0 con 0x7f42700b0cb0 2024-09-17T05:28:59.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.393+0000 7f4275a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4270074bc0 con 0x7f42700b1120 2024-09-17T05:28:59.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.397+0000 7f426f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42700b1650 0x7f42700c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:59.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.397+0000 7f426ea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42700b0cb0 0x7f42700af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:59.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.397+0000 7f426f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42700b1650 0x7f42700c62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59636/0 (socket says 172.21.15.31:59636) 2024-09-17T05:28:59.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.397+0000 7f426f400640 1 -- 172.21.15.31:0/3450376736 learned_addr learned my addr 172.21.15.31:0/3450376736 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:59.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.397+0000 7f4266000640 1 --2- 172.21.15.31:0/3450376736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42700b1120 0x7f42700af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:59.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.397+0000 7f426f400640 1 -- 172.21.15.31:0/3450376736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42700b1120 msgr2=0x7f42700af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.397+0000 7f426f400640 1 --2- 172.21.15.31:0/3450376736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42700b1120 0x7f42700af820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.397+0000 7f426f400640 1 -- 172.21.15.31:0/3450376736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42700b0cb0 msgr2=0x7f42700af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.397+0000 7f426f400640 1 --2- 172.21.15.31:0/3450376736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42700b0cb0 0x7f42700af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.397+0000 7f426f400640 1 -- 172.21.15.31:0/3450376736 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427014e150 con 0x7f42700b1650 2024-09-17T05:28:59.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.397+0000 7f426f400640 1 --2- 172.21.15.31:0/3450376736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42700b1650 0x7f42700c62b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f426800b9a0 tx=0x7f426800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:59.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.397+0000 7f4267400640 1 -- 172.21.15.31:0/3450376736 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4268019070 con 0x7f42700b1650 2024-09-17T05:28:59.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.397+0000 7f4267400640 1 -- 172.21.15.31:0/3450376736 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f426800ccb0 con 0x7f42700b1650 2024-09-17T05:28:59.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.397+0000 7f4267400640 1 -- 172.21.15.31:0/3450376736 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42680146a0 con 0x7f42700b1650 2024-09-17T05:28:59.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.397+0000 7f4275a00640 1 -- 172.21.15.31:0/3450376736 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427014e430 con 0x7f42700b1650 2024-09-17T05:28:59.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.397+0000 7f4275a00640 1 -- 172.21.15.31:0/3450376736 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f427014e9f0 con 0x7f42700b1650 2024-09-17T05:28:59.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.397+0000 7f4275a00640 1 -- 172.21.15.31:0/3450376736 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42700c74f0 con 0x7f42700b1650 2024-09-17T05:28:59.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.397+0000 7f4267400640 1 -- 172.21.15.31:0/3450376736 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f426801c070 con 0x7f42700b1650 2024-09-17T05:28:59.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.401+0000 7f4267400640 1 --2- 172.21.15.31:0/3450376736 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f424c073200 0x7f424c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:59.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.401+0000 7f4267400640 1 -- 172.21.15.31:0/3450376736 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4268093ef0 con 0x7f42700b1650 2024-09-17T05:28:59.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.401+0000 7f426ea00640 1 --2- 172.21.15.31:0/3450376736 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f424c073200 0x7f424c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:59.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.401+0000 7f426ea00640 1 --2- 172.21.15.31:0/3450376736 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f424c073200 0x7f424c0756c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f42600b2000 tx=0x7f426001d8f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:59.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.405+0000 7f4267400640 1 -- 172.21.15.31:0/3450376736 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f426805e8b0 con 0x7f42700b1650 2024-09-17T05:28:59.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.577+0000 7f4275a00640 1 -- 172.21.15.31:0/3450376736 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f427015f950 con 0x7f424c073200 2024-09-17T05:28:59.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.581+0000 7f4267400640 1 -- 172.21.15.31:0/3450376736 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f427015f950 con 0x7f424c073200 2024-09-17T05:28:59.588 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:59.590 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:28:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.585+0000 7f4275a00640 1 -- 172.21.15.31:0/3450376736 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f424c073200 msgr2=0x7f424c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.585+0000 7f4275a00640 1 --2- 172.21.15.31:0/3450376736 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f424c073200 0x7f424c0756c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f42600b2000 tx=0x7f426001d8f0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.585+0000 7f4275a00640 1 -- 172.21.15.31:0/3450376736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42700b1650 msgr2=0x7f42700c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.585+0000 7f4275a00640 1 --2- 172.21.15.31:0/3450376736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42700b1650 0x7f42700c62b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f426800b9a0 tx=0x7f426800be60 comp rx=0 tx=0).stop 2024-09-17T05:28:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.585+0000 7f4275a00640 1 -- 172.21.15.31:0/3450376736 shutdown_connections 2024-09-17T05:28:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.585+0000 7f4275a00640 1 --2- 172.21.15.31:0/3450376736 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f424c073200 0x7f424c0756c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.585+0000 7f4275a00640 1 --2- 172.21.15.31:0/3450376736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42700b1650 0x7f42700c62b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.585+0000 7f4275a00640 1 --2- 172.21.15.31:0/3450376736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42700b1120 0x7f42700af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.585+0000 7f4275a00640 1 --2- 172.21.15.31:0/3450376736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42700b0cb0 0x7f42700af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.585+0000 7f4275a00640 1 -- 172.21.15.31:0/3450376736 >> 172.21.15.31:0/3450376736 conn(0x7f42700b1f10 msgr2=0x7f42700cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:59.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.585+0000 7f4275a00640 1 -- 172.21.15.31:0/3450376736 shutdown_connections 2024-09-17T05:28:59.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.585+0000 7f4275a00640 1 -- 172.21.15.31:0/3450376736 wait complete. 2024-09-17T05:28:59.609 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-17T05:28:59.184175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219120,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755600,"statfs":{"total":773094113280,"available":772869734400,"internally_reserved":0,"allocated":2924544,"data_stored":1763052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002774"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863232+0000","last_change":"2024-09-17T05:28:45.697872+0000","last_active":"2024-09-17T05:28:46.863232+0000","last_peered":"2024-09-17T05:28:46.863232+0000","last_clean":"2024-09-17T05:28:46.863232+0000","last_became_active":"2024-09-17T05:28:45.695565+0000","last_became_peered":"2024-09-17T05:28:45.695565+0000","last_unstale":"2024-09-17T05:28:46.863232+0000","last_undegraded":"2024-09-17T05:28:46.863232+0000","last_fullsized":"2024-09-17T05:28:46.863232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:45:19.586402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688506+0000","last_change":"2024-09-17T05:28:45.678580+0000","last_active":"2024-09-17T05:28:46.688506+0000","last_peered":"2024-09-17T05:28:46.688506+0000","last_clean":"2024-09-17T05:28:46.688506+0000","last_became_active":"2024-09-17T05:28:45.678219+0000","last_became_peered":"2024-09-17T05:28:45.678219+0000","last_unstale":"2024-09-17T05:28:46.688506+0000","last_undegraded":"2024-09-17T05:28:46.688506+0000","last_fullsized":"2024-09-17T05:28:46.688506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:21.659738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862447+0000","last_change":"2024-09-17T05:28:45.671569+0000","last_active":"2024-09-17T05:28:46.862447+0000","last_peered":"2024-09-17T05:28:46.862447+0000","last_clean":"2024-09-17T05:28:46.862447+0000","last_became_active":"2024-09-17T05:28:45.671278+0000","last_became_peered":"2024-09-17T05:28:45.671278+0000","last_unstale":"2024-09-17T05:28:46.862447+0000","last_undegraded":"2024-09-17T05:28:46.862447+0000","last_fullsized":"2024-09-17T05:28:46.862447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:58:21.650063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660082+0000","last_change":"2024-09-17T05:28:45.689085+0000","last_active":"2024-09-17T05:28:46.660082+0000","last_peered":"2024-09-17T05:28:46.660082+0000","last_clean":"2024-09-17T05:28:46.660082+0000","last_became_active":"2024-09-17T05:28:45.688806+0000","last_became_peered":"2024-09-17T05:28:45.688806+0000","last_unstale":"2024-09-17T05:28:46.660082+0000","last_undegraded":"2024-09-17T05:28:46.660082+0000","last_fullsized":"2024-09-17T05:28:46.660082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:51.791266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862886+0000","last_change":"2024-09-17T05:28:45.682352+0000","last_active":"2024-09-17T05:28:46.862886+0000","last_peered":"2024-09-17T05:28:46.862886+0000","last_clean":"2024-09-17T05:28:46.862886+0000","last_became_active":"2024-09-17T05:28:45.682032+0000","last_became_peered":"2024-09-17T05:28:45.682032+0000","last_unstale":"2024-09-17T05:28:46.862886+0000","last_undegraded":"2024-09-17T05:28:46.862886+0000","last_fullsized":"2024-09-17T05:28:46.862886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:46.948368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660986+0000","last_change":"2024-09-17T05:28:45.674052+0000","last_active":"2024-09-17T05:28:46.660986+0000","last_peered":"2024-09-17T05:28:46.660986+0000","last_clean":"2024-09-17T05:28:46.660986+0000","last_became_active":"2024-09-17T05:28:45.673577+0000","last_became_peered":"2024-09-17T05:28:45.673577+0000","last_unstale":"2024-09-17T05:28:46.660986+0000","last_undegraded":"2024-09-17T05:28:46.660986+0000","last_fullsized":"2024-09-17T05:28:46.660986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:51.624046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863066+0000","last_change":"2024-09-17T05:28:45.681779+0000","last_active":"2024-09-17T05:28:46.863066+0000","last_peered":"2024-09-17T05:28:46.863066+0000","last_clean":"2024-09-17T05:28:46.863066+0000","last_became_active":"2024-09-17T05:28:45.681439+0000","last_became_peered":"2024-09-17T05:28:45.681439+0000","last_unstale":"2024-09-17T05:28:46.863066+0000","last_undegraded":"2024-09-17T05:28:46.863066+0000","last_fullsized":"2024-09-17T05:28:46.863066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:17.571913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861260+0000","last_change":"2024-09-17T05:28:45.675817+0000","last_active":"2024-09-17T05:28:46.861260+0000","last_peered":"2024-09-17T05:28:46.861260+0000","last_clean":"2024-09-17T05:28:46.861260+0000","last_became_active":"2024-09-17T05:28:45.675261+0000","last_became_peered":"2024-09-17T05:28:45.675261+0000","last_unstale":"2024-09-17T05:28:46.861260+0000","last_undegraded":"2024-09-17T05:28:46.861260+0000","last_fullsized":"2024-09-17T05:28:46.861260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.192825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863307+0000","last_change":"2024-09-17T05:28:45.678585+0000","last_active":"2024-09-17T05:28:46.863307+0000","last_peered":"2024-09-17T05:28:46.863307+0000","last_clean":"2024-09-17T05:28:46.863307+0000","last_became_active":"2024-09-17T05:28:45.678193+0000","last_became_peered":"2024-09-17T05:28:45.678193+0000","last_unstale":"2024-09-17T05:28:46.863307+0000","last_undegraded":"2024-09-17T05:28:46.863307+0000","last_fullsized":"2024-09-17T05:28:46.863307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:09.412687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692863+0000","last_change":"2024-09-17T05:28:45.694856+0000","last_active":"2024-09-17T05:28:46.692863+0000","last_peered":"2024-09-17T05:28:46.692863+0000","last_clean":"2024-09-17T05:28:46.692863+0000","last_became_active":"2024-09-17T05:28:45.694301+0000","last_became_peered":"2024-09-17T05:28:45.694301+0000","last_unstale":"2024-09-17T05:28:46.692863+0000","last_undegraded":"2024-09-17T05:28:46.692863+0000","last_fullsized":"2024-09-17T05:28:46.692863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:51.540943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692949+0000","last_change":"2024-09-17T05:28:45.686541+0000","last_active":"2024-09-17T05:28:46.692949+0000","last_peered":"2024-09-17T05:28:46.692949+0000","last_clean":"2024-09-17T05:28:46.692949+0000","last_became_active":"2024-09-17T05:28:45.686257+0000","last_became_peered":"2024-09-17T05:28:45.686257+0000","last_unstale":"2024-09-17T05:28:46.692949+0000","last_undegraded":"2024-09-17T05:28:46.692949+0000","last_fullsized":"2024-09-17T05:28:46.692949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:43.813385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660297+0000","last_change":"2024-09-17T05:28:45.686106+0000","last_active":"2024-09-17T05:28:46.660297+0000","last_peered":"2024-09-17T05:28:46.660297+0000","last_clean":"2024-09-17T05:28:46.660297+0000","last_became_active":"2024-09-17T05:28:45.685801+0000","last_became_peered":"2024-09-17T05:28:45.685801+0000","last_unstale":"2024-09-17T05:28:46.660297+0000","last_undegraded":"2024-09-17T05:28:46.660297+0000","last_fullsized":"2024-09-17T05:28:46.660297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:49.061509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861763+0000","last_change":"2024-09-17T05:28:45.681737+0000","last_active":"2024-09-17T05:28:46.861763+0000","last_peered":"2024-09-17T05:28:46.861763+0000","last_clean":"2024-09-17T05:28:46.861763+0000","last_became_active":"2024-09-17T05:28:45.681463+0000","last_became_peered":"2024-09-17T05:28:45.681463+0000","last_unstale":"2024-09-17T05:28:46.861763+0000","last_undegraded":"2024-09-17T05:28:46.861763+0000","last_fullsized":"2024-09-17T05:28:46.861763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.524996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861769+0000","last_change":"2024-09-17T05:28:45.664352+0000","last_active":"2024-09-17T05:28:46.861769+0000","last_peered":"2024-09-17T05:28:46.861769+0000","last_clean":"2024-09-17T05:28:46.861769+0000","last_became_active":"2024-09-17T05:28:45.663507+0000","last_became_peered":"2024-09-17T05:28:45.663507+0000","last_unstale":"2024-09-17T05:28:46.861769+0000","last_undegraded":"2024-09-17T05:28:46.861769+0000","last_fullsized":"2024-09-17T05:28:46.861769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:17.848561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688160+0000","last_change":"2024-09-17T05:28:45.661764+0000","last_active":"2024-09-17T05:28:46.688160+0000","last_peered":"2024-09-17T05:28:46.688160+0000","last_clean":"2024-09-17T05:28:46.688160+0000","last_became_active":"2024-09-17T05:28:45.661449+0000","last_became_peered":"2024-09-17T05:28:45.661449+0000","last_unstale":"2024-09-17T05:28:46.688160+0000","last_undegraded":"2024-09-17T05:28:46.688160+0000","last_fullsized":"2024-09-17T05:28:46.688160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:06.446649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659618+0000","last_change":"2024-09-17T05:28:45.670649+0000","last_active":"2024-09-17T05:28:46.659618+0000","last_peered":"2024-09-17T05:28:46.659618+0000","last_clean":"2024-09-17T05:28:46.659618+0000","last_became_active":"2024-09-17T05:28:45.670351+0000","last_became_peered":"2024-09-17T05:28:45.670351+0000","last_unstale":"2024-09-17T05:28:46.659618+0000","last_undegraded":"2024-09-17T05:28:46.659618+0000","last_fullsized":"2024-09-17T05:28:46.659618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:29.130107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660571+0000","last_change":"2024-09-17T05:28:45.679957+0000","last_active":"2024-09-17T05:28:46.660571+0000","last_peered":"2024-09-17T05:28:46.660571+0000","last_clean":"2024-09-17T05:28:46.660571+0000","last_became_active":"2024-09-17T05:28:45.679602+0000","last_became_peered":"2024-09-17T05:28:45.679602+0000","last_unstale":"2024-09-17T05:28:46.660571+0000","last_undegraded":"2024-09-17T05:28:46.660571+0000","last_fullsized":"2024-09-17T05:28:46.660571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:39.462655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654439+0000","last_change":"2024-09-17T05:28:45.696611+0000","last_active":"2024-09-17T05:28:46.654439+0000","last_peered":"2024-09-17T05:28:46.654439+0000","last_clean":"2024-09-17T05:28:46.654439+0000","last_became_active":"2024-09-17T05:28:45.696317+0000","last_became_peered":"2024-09-17T05:28:45.696317+0000","last_unstale":"2024-09-17T05:28:46.654439+0000","last_undegraded":"2024-09-17T05:28:46.654439+0000","last_fullsized":"2024-09-17T05:28:46.654439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:02.631947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863417+0000","last_change":"2024-09-17T05:28:45.682233+0000","last_active":"2024-09-17T05:28:46.863417+0000","last_peered":"2024-09-17T05:28:46.863417+0000","last_clean":"2024-09-17T05:28:46.863417+0000","last_became_active":"2024-09-17T05:28:45.681921+0000","last_became_peered":"2024-09-17T05:28:45.681921+0000","last_unstale":"2024-09-17T05:28:46.863417+0000","last_undegraded":"2024-09-17T05:28:46.863417+0000","last_fullsized":"2024-09-17T05:28:46.863417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:48.570504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692784+0000","last_change":"2024-09-17T05:28:45.689764+0000","last_active":"2024-09-17T05:28:46.692784+0000","last_peered":"2024-09-17T05:28:46.692784+0000","last_clean":"2024-09-17T05:28:46.692784+0000","last_became_active":"2024-09-17T05:28:45.686962+0000","last_became_peered":"2024-09-17T05:28:45.686962+0000","last_unstale":"2024-09-17T05:28:46.692784+0000","last_undegraded":"2024-09-17T05:28:46.692784+0000","last_fullsized":"2024-09-17T05:28:46.692784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:02:08.175874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861974+0000","last_change":"2024-09-17T05:28:45.679307+0000","last_active":"2024-09-17T05:28:46.861974+0000","last_peered":"2024-09-17T05:28:46.861974+0000","last_clean":"2024-09-17T05:28:46.861974+0000","last_became_active":"2024-09-17T05:28:45.677900+0000","last_became_peered":"2024-09-17T05:28:45.677900+0000","last_unstale":"2024-09-17T05:28:46.861974+0000","last_undegraded":"2024-09-17T05:28:46.861974+0000","last_fullsized":"2024-09-17T05:28:46.861974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:16.537395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661054+0000","last_change":"2024-09-17T05:28:45.675903+0000","last_active":"2024-09-17T05:28:46.661054+0000","last_peered":"2024-09-17T05:28:46.661054+0000","last_clean":"2024-09-17T05:28:46.661054+0000","last_became_active":"2024-09-17T05:28:45.675619+0000","last_became_peered":"2024-09-17T05:28:45.675619+0000","last_unstale":"2024-09-17T05:28:46.661054+0000","last_undegraded":"2024-09-17T05:28:46.661054+0000","last_fullsized":"2024-09-17T05:28:46.661054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:25.383911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861418+0000","last_change":"2024-09-17T05:28:45.685230+0000","last_active":"2024-09-17T05:28:46.861418+0000","last_peered":"2024-09-17T05:28:46.861418+0000","last_clean":"2024-09-17T05:28:46.861418+0000","last_became_active":"2024-09-17T05:28:45.684920+0000","last_became_peered":"2024-09-17T05:28:45.684920+0000","last_unstale":"2024-09-17T05:28:46.861418+0000","last_undegraded":"2024-09-17T05:28:46.861418+0000","last_fullsized":"2024-09-17T05:28:46.861418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:37.130400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660820+0000","last_change":"2024-09-17T05:28:45.670609+0000","last_active":"2024-09-17T05:28:46.660820+0000","last_peered":"2024-09-17T05:28:46.660820+0000","last_clean":"2024-09-17T05:28:46.660820+0000","last_became_active":"2024-09-17T05:28:45.670294+0000","last_became_peered":"2024-09-17T05:28:45.670294+0000","last_unstale":"2024-09-17T05:28:46.660820+0000","last_undegraded":"2024-09-17T05:28:46.660820+0000","last_fullsized":"2024-09-17T05:28:46.660820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:47.532792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862177+0000","last_change":"2024-09-17T05:28:45.686654+0000","last_active":"2024-09-17T05:28:46.862177+0000","last_peered":"2024-09-17T05:28:46.862177+0000","last_clean":"2024-09-17T05:28:46.862177+0000","last_became_active":"2024-09-17T05:28:45.686315+0000","last_became_peered":"2024-09-17T05:28:45.686315+0000","last_unstale":"2024-09-17T05:28:46.862177+0000","last_undegraded":"2024-09-17T05:28:46.862177+0000","last_fullsized":"2024-09-17T05:28:46.862177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.777428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.693162+0000","last_change":"2024-09-17T05:28:45.696244+0000","last_active":"2024-09-17T05:28:46.693162+0000","last_peered":"2024-09-17T05:28:46.693162+0000","last_clean":"2024-09-17T05:28:46.693162+0000","last_became_active":"2024-09-17T05:28:45.695996+0000","last_became_peered":"2024-09-17T05:28:45.695996+0000","last_unstale":"2024-09-17T05:28:46.693162+0000","last_undegraded":"2024-09-17T05:28:46.693162+0000","last_fullsized":"2024-09-17T05:28:46.693162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:21.659738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688428+0000","last_change":"2024-09-17T05:28:45.672165+0000","last_active":"2024-09-17T05:28:46.688428+0000","last_peered":"2024-09-17T05:28:46.688428+0000","last_clean":"2024-09-17T05:28:46.688428+0000","last_became_active":"2024-09-17T05:28:45.671847+0000","last_became_peered":"2024-09-17T05:28:45.671847+0000","last_unstale":"2024-09-17T05:28:46.688428+0000","last_undegraded":"2024-09-17T05:28:46.688428+0000","last_fullsized":"2024-09-17T05:28:46.688428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:33.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861906+0000","last_change":"2024-09-17T05:28:45.685316+0000","last_active":"2024-09-17T05:28:46.861906+0000","last_peered":"2024-09-17T05:28:46.861906+0000","last_clean":"2024-09-17T05:28:46.861906+0000","last_became_active":"2024-09-17T05:28:45.684897+0000","last_became_peered":"2024-09-17T05:28:45.684897+0000","last_unstale":"2024-09-17T05:28:46.861906+0000","last_undegraded":"2024-09-17T05:28:46.861906+0000","last_fullsized":"2024-09-17T05:28:46.861906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:09.347060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862091+0000","last_change":"2024-09-17T05:28:45.686073+0000","last_active":"2024-09-17T05:28:46.862091+0000","last_peered":"2024-09-17T05:28:46.862091+0000","last_clean":"2024-09-17T05:28:46.862091+0000","last_became_active":"2024-09-17T05:28:45.685807+0000","last_became_peered":"2024-09-17T05:28:45.685807+0000","last_unstale":"2024-09-17T05:28:46.862091+0000","last_undegraded":"2024-09-17T05:28:46.862091+0000","last_fullsized":"2024-09-17T05:28:46.862091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:16.599698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661110+0000","last_change":"2024-09-17T05:28:45.671925+0000","last_active":"2024-09-17T05:28:46.661110+0000","last_peered":"2024-09-17T05:28:46.661110+0000","last_clean":"2024-09-17T05:28:46.661110+0000","last_became_active":"2024-09-17T05:28:45.671678+0000","last_became_peered":"2024-09-17T05:28:45.671678+0000","last_unstale":"2024-09-17T05:28:46.661110+0000","last_undegraded":"2024-09-17T05:28:46.661110+0000","last_fullsized":"2024-09-17T05:28:46.661110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:42.029278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654148+0000","last_change":"2024-09-17T05:28:45.671512+0000","last_active":"2024-09-17T05:28:46.654148+0000","last_peered":"2024-09-17T05:28:46.654148+0000","last_clean":"2024-09-17T05:28:46.654148+0000","last_became_active":"2024-09-17T05:28:45.671206+0000","last_became_peered":"2024-09-17T05:28:45.671206+0000","last_unstale":"2024-09-17T05:28:46.654148+0000","last_undegraded":"2024-09-17T05:28:46.654148+0000","last_fullsized":"2024-09-17T05:28:46.654148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:49.061509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692663+0000","last_change":"2024-09-17T05:28:45.691716+0000","last_active":"2024-09-17T05:28:46.692663+0000","last_peered":"2024-09-17T05:28:46.692663+0000","last_clean":"2024-09-17T05:28:46.692663+0000","last_became_active":"2024-09-17T05:28:45.691437+0000","last_became_peered":"2024-09-17T05:28:45.691437+0000","last_unstale":"2024-09-17T05:28:46.692663+0000","last_undegraded":"2024-09-17T05:28:46.692663+0000","last_fullsized":"2024-09-17T05:28:46.692663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:36.011098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659719+0000","last_change":"2024-09-17T05:28:45.668556+0000","last_active":"2024-09-17T05:28:46.659719+0000","last_peered":"2024-09-17T05:28:46.659719+0000","last_clean":"2024-09-17T05:28:46.659719+0000","last_became_active":"2024-09-17T05:28:45.667772+0000","last_became_peered":"2024-09-17T05:28:45.667772+0000","last_unstale":"2024-09-17T05:28:46.659719+0000","last_undegraded":"2024-09-17T05:28:46.659719+0000","last_fullsized":"2024-09-17T05:28:46.659719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:01.766360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861829+0000","last_change":"2024-09-17T05:28:44.657244+0000","last_active":"2024-09-17T05:28:46.861829+0000","last_peered":"2024-09-17T05:28:46.861829+0000","last_clean":"2024-09-17T05:28:46.861829+0000","last_became_active":"2024-09-17T05:28:44.656558+0000","last_became_peered":"2024-09-17T05:28:44.656558+0000","last_unstale":"2024-09-17T05:28:46.861829+0000","last_undegraded":"2024-09-17T05:28:46.861829+0000","last_fullsized":"2024-09-17T05:28:46.861829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:54.204227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862171+0000","last_change":"2024-09-17T05:28:45.661811+0000","last_active":"2024-09-17T05:28:46.862171+0000","last_peered":"2024-09-17T05:28:46.862171+0000","last_clean":"2024-09-17T05:28:46.862171+0000","last_became_active":"2024-09-17T05:28:45.659242+0000","last_became_peered":"2024-09-17T05:28:45.659242+0000","last_unstale":"2024-09-17T05:28:46.862171+0000","last_undegraded":"2024-09-17T05:28:46.862171+0000","last_fullsized":"2024-09-17T05:28:46.862171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:47.085346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692619+0000","last_change":"2024-09-17T05:28:44.660153+0000","last_active":"2024-09-17T05:28:46.692619+0000","last_peered":"2024-09-17T05:28:46.692619+0000","last_clean":"2024-09-17T05:28:46.692619+0000","last_became_active":"2024-09-17T05:28:44.658470+0000","last_became_peered":"2024-09-17T05:28:44.658470+0000","last_unstale":"2024-09-17T05:28:46.692619+0000","last_undegraded":"2024-09-17T05:28:46.692619+0000","last_fullsized":"2024-09-17T05:28:46.692619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:44.416180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861467+0000","last_change":"2024-09-17T05:28:44.665256+0000","last_active":"2024-09-17T05:28:46.861467+0000","last_peered":"2024-09-17T05:28:46.861467+0000","last_clean":"2024-09-17T05:28:46.861467+0000","last_became_active":"2024-09-17T05:28:44.664960+0000","last_became_peered":"2024-09-17T05:28:44.664960+0000","last_unstale":"2024-09-17T05:28:46.861467+0000","last_undegraded":"2024-09-17T05:28:46.861467+0000","last_fullsized":"2024-09-17T05:28:46.861467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:14.057015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861329+0000","last_change":"2024-09-17T05:28:45.673448+0000","last_active":"2024-09-17T05:28:46.861329+0000","last_peered":"2024-09-17T05:28:46.861329+0000","last_clean":"2024-09-17T05:28:46.861329+0000","last_became_active":"2024-09-17T05:28:45.670646+0000","last_became_peered":"2024-09-17T05:28:45.670646+0000","last_unstale":"2024-09-17T05:28:46.861329+0000","last_undegraded":"2024-09-17T05:28:46.861329+0000","last_fullsized":"2024-09-17T05:28:46.861329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:06.446649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660320+0000","last_change":"2024-09-17T05:28:44.659788+0000","last_active":"2024-09-17T05:28:46.660320+0000","last_peered":"2024-09-17T05:28:46.660320+0000","last_clean":"2024-09-17T05:28:46.660320+0000","last_became_active":"2024-09-17T05:28:44.657841+0000","last_became_peered":"2024-09-17T05:28:44.657841+0000","last_unstale":"2024-09-17T05:28:46.660320+0000","last_undegraded":"2024-09-17T05:28:46.660320+0000","last_fullsized":"2024-09-17T05:28:46.660320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:31.718118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688161+0000","last_change":"2024-09-17T05:28:45.673740+0000","last_active":"2024-09-17T05:28:46.688161+0000","last_peered":"2024-09-17T05:28:46.688161+0000","last_clean":"2024-09-17T05:28:46.688161+0000","last_became_active":"2024-09-17T05:28:45.671723+0000","last_became_peered":"2024-09-17T05:28:45.671723+0000","last_unstale":"2024-09-17T05:28:46.688161+0000","last_undegraded":"2024-09-17T05:28:46.688161+0000","last_fullsized":"2024-09-17T05:28:46.688161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:02:08.175874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692691+0000","last_change":"2024-09-17T05:28:44.659120+0000","last_active":"2024-09-17T05:28:46.692691+0000","last_peered":"2024-09-17T05:28:46.692691+0000","last_clean":"2024-09-17T05:28:46.692691+0000","last_became_active":"2024-09-17T05:28:44.658305+0000","last_became_peered":"2024-09-17T05:28:44.658305+0000","last_unstale":"2024-09-17T05:28:46.692691+0000","last_undegraded":"2024-09-17T05:28:46.692691+0000","last_fullsized":"2024-09-17T05:28:46.692691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:54.204227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660354+0000","last_change":"2024-09-17T05:28:45.682482+0000","last_active":"2024-09-17T05:28:46.660354+0000","last_peered":"2024-09-17T05:28:46.660354+0000","last_clean":"2024-09-17T05:28:46.660354+0000","last_became_active":"2024-09-17T05:28:45.682173+0000","last_became_peered":"2024-09-17T05:28:45.682173+0000","last_unstale":"2024-09-17T05:28:46.660354+0000","last_undegraded":"2024-09-17T05:28:46.660354+0000","last_fullsized":"2024-09-17T05:28:46.660354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:49.488039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660472+0000","last_change":"2024-09-17T05:28:44.660933+0000","last_active":"2024-09-17T05:28:46.660472+0000","last_peered":"2024-09-17T05:28:46.660472+0000","last_clean":"2024-09-17T05:28:46.660472+0000","last_became_active":"2024-09-17T05:28:44.660651+0000","last_became_peered":"2024-09-17T05:28:44.660651+0000","last_unstale":"2024-09-17T05:28:46.660472+0000","last_undegraded":"2024-09-17T05:28:46.660472+0000","last_fullsized":"2024-09-17T05:28:46.660472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:07.374786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862562+0000","last_change":"2024-09-17T05:28:45.680416+0000","last_active":"2024-09-17T05:28:46.862562+0000","last_peered":"2024-09-17T05:28:46.862562+0000","last_clean":"2024-09-17T05:28:46.862562+0000","last_became_active":"2024-09-17T05:28:45.676745+0000","last_became_peered":"2024-09-17T05:28:45.676745+0000","last_unstale":"2024-09-17T05:28:46.862562+0000","last_undegraded":"2024-09-17T05:28:46.862562+0000","last_fullsized":"2024-09-17T05:28:46.862562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:26.799851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688387+0000","last_change":"2024-09-17T05:28:44.658749+0000","last_active":"2024-09-17T05:28:46.688387+0000","last_peered":"2024-09-17T05:28:46.688387+0000","last_clean":"2024-09-17T05:28:46.688387+0000","last_became_active":"2024-09-17T05:28:44.658422+0000","last_became_peered":"2024-09-17T05:28:44.658422+0000","last_unstale":"2024-09-17T05:28:46.688387+0000","last_undegraded":"2024-09-17T05:28:46.688387+0000","last_fullsized":"2024-09-17T05:28:46.688387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:44.416180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660498+0000","last_change":"2024-09-17T05:28:45.679934+0000","last_active":"2024-09-17T05:28:46.660498+0000","last_peered":"2024-09-17T05:28:46.660498+0000","last_clean":"2024-09-17T05:28:46.660498+0000","last_became_active":"2024-09-17T05:28:45.679532+0000","last_became_peered":"2024-09-17T05:28:45.679532+0000","last_unstale":"2024-09-17T05:28:46.660498+0000","last_undegraded":"2024-09-17T05:28:46.660498+0000","last_fullsized":"2024-09-17T05:28:46.660498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:02.631947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692603+0000","last_change":"2024-09-17T05:28:44.670793+0000","last_active":"2024-09-17T05:28:46.692603+0000","last_peered":"2024-09-17T05:28:46.692603+0000","last_clean":"2024-09-17T05:28:46.692603+0000","last_became_active":"2024-09-17T05:28:44.670483+0000","last_became_peered":"2024-09-17T05:28:44.670483+0000","last_unstale":"2024-09-17T05:28:46.692603+0000","last_undegraded":"2024-09-17T05:28:46.692603+0000","last_fullsized":"2024-09-17T05:28:46.692603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:56.605556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863123+0000","last_change":"2024-09-17T05:28:45.676170+0000","last_active":"2024-09-17T05:28:46.863123+0000","last_peered":"2024-09-17T05:28:46.863123+0000","last_clean":"2024-09-17T05:28:46.863123+0000","last_became_active":"2024-09-17T05:28:45.675349+0000","last_became_peered":"2024-09-17T05:28:45.675349+0000","last_unstale":"2024-09-17T05:28:46.863123+0000","last_undegraded":"2024-09-17T05:28:46.863123+0000","last_fullsized":"2024-09-17T05:28:46.863123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:25.988668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862160+0000","last_change":"2024-09-17T05:28:44.656355+0000","last_active":"2024-09-17T05:28:46.862160+0000","last_peered":"2024-09-17T05:28:46.862160+0000","last_clean":"2024-09-17T05:28:46.862160+0000","last_became_active":"2024-09-17T05:28:44.656064+0000","last_became_peered":"2024-09-17T05:28:44.656064+0000","last_unstale":"2024-09-17T05:28:46.862160+0000","last_undegraded":"2024-09-17T05:28:46.862160+0000","last_fullsized":"2024-09-17T05:28:46.862160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:00:37.731866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861989+0000","last_change":"2024-09-17T05:28:45.683802+0000","last_active":"2024-09-17T05:28:46.861989+0000","last_peered":"2024-09-17T05:28:46.861989+0000","last_clean":"2024-09-17T05:28:46.861989+0000","last_became_active":"2024-09-17T05:28:45.681514+0000","last_became_peered":"2024-09-17T05:28:45.681514+0000","last_unstale":"2024-09-17T05:28:46.861989+0000","last_undegraded":"2024-09-17T05:28:46.861989+0000","last_fullsized":"2024-09-17T05:28:46.861989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:03.269669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661166+0000","last_change":"2024-09-17T05:28:44.666923+0000","last_active":"2024-09-17T05:28:46.661166+0000","last_peered":"2024-09-17T05:28:46.661166+0000","last_clean":"2024-09-17T05:28:46.661166+0000","last_became_active":"2024-09-17T05:28:44.663304+0000","last_became_peered":"2024-09-17T05:28:44.663304+0000","last_unstale":"2024-09-17T05:28:46.661166+0000","last_undegraded":"2024-09-17T05:28:46.661166+0000","last_fullsized":"2024-09-17T05:28:46.661166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:39.859160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863074+0000","last_change":"2024-09-17T05:28:45.690781+0000","last_active":"2024-09-17T05:28:46.863074+0000","last_peered":"2024-09-17T05:28:46.863074+0000","last_clean":"2024-09-17T05:28:46.863074+0000","last_became_active":"2024-09-17T05:28:45.690510+0000","last_became_peered":"2024-09-17T05:28:45.690510+0000","last_unstale":"2024-09-17T05:28:46.863074+0000","last_undegraded":"2024-09-17T05:28:46.863074+0000","last_fullsized":"2024-09-17T05:28:46.863074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:23.217463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692449+0000","last_change":"2024-09-17T05:28:44.659293+0000","last_active":"2024-09-17T05:28:46.692449+0000","last_peered":"2024-09-17T05:28:46.692449+0000","last_clean":"2024-09-17T05:28:46.692449+0000","last_became_active":"2024-09-17T05:28:44.658946+0000","last_became_peered":"2024-09-17T05:28:44.658946+0000","last_unstale":"2024-09-17T05:28:46.692449+0000","last_undegraded":"2024-09-17T05:28:46.692449+0000","last_fullsized":"2024-09-17T05:28:46.692449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:17.828856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692995+0000","last_change":"2024-09-17T05:28:45.686933+0000","last_active":"2024-09-17T05:28:46.692995+0000","last_peered":"2024-09-17T05:28:46.692995+0000","last_clean":"2024-09-17T05:28:46.692995+0000","last_became_active":"2024-09-17T05:28:45.686604+0000","last_became_peered":"2024-09-17T05:28:45.686604+0000","last_unstale":"2024-09-17T05:28:46.692995+0000","last_undegraded":"2024-09-17T05:28:46.692995+0000","last_fullsized":"2024-09-17T05:28:46.692995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:33.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.653948+0000","last_change":"2024-09-17T05:28:44.659167+0000","last_active":"2024-09-17T05:28:46.653948+0000","last_peered":"2024-09-17T05:28:46.653948+0000","last_clean":"2024-09-17T05:28:46.653948+0000","last_became_active":"2024-09-17T05:28:44.658804+0000","last_became_peered":"2024-09-17T05:28:44.658804+0000","last_unstale":"2024-09-17T05:28:46.653948+0000","last_undegraded":"2024-09-17T05:28:46.653948+0000","last_fullsized":"2024-09-17T05:28:46.653948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:50.304488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862798+0000","last_change":"2024-09-17T05:28:45.688426+0000","last_active":"2024-09-17T05:28:46.862798+0000","last_peered":"2024-09-17T05:28:46.862798+0000","last_clean":"2024-09-17T05:28:46.862798+0000","last_became_active":"2024-09-17T05:28:45.688100+0000","last_became_peered":"2024-09-17T05:28:45.688100+0000","last_unstale":"2024-09-17T05:28:46.862798+0000","last_undegraded":"2024-09-17T05:28:46.862798+0000","last_fullsized":"2024-09-17T05:28:46.862798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:11.277486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660737+0000","last_change":"2024-09-17T05:28:44.662254+0000","last_active":"2024-09-17T05:28:46.660737+0000","last_peered":"2024-09-17T05:28:46.660737+0000","last_clean":"2024-09-17T05:28:46.660737+0000","last_became_active":"2024-09-17T05:28:44.659880+0000","last_became_peered":"2024-09-17T05:28:44.659880+0000","last_unstale":"2024-09-17T05:28:46.660737+0000","last_undegraded":"2024-09-17T05:28:46.660737+0000","last_fullsized":"2024-09-17T05:28:46.660737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:54.102764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863300+0000","last_change":"2024-09-17T05:28:45.693962+0000","last_active":"2024-09-17T05:28:46.863300+0000","last_peered":"2024-09-17T05:28:46.863300+0000","last_clean":"2024-09-17T05:28:46.863300+0000","last_became_active":"2024-09-17T05:28:45.693641+0000","last_became_peered":"2024-09-17T05:28:45.693641+0000","last_unstale":"2024-09-17T05:28:46.863300+0000","last_undegraded":"2024-09-17T05:28:46.863300+0000","last_fullsized":"2024-09-17T05:28:46.863300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:12.085165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654313+0000","last_change":"2024-09-17T05:28:44.657506+0000","last_active":"2024-09-17T05:28:46.654313+0000","last_peered":"2024-09-17T05:28:46.654313+0000","last_clean":"2024-09-17T05:28:46.654313+0000","last_became_active":"2024-09-17T05:28:44.653791+0000","last_became_peered":"2024-09-17T05:28:44.653791+0000","last_unstale":"2024-09-17T05:28:46.654313+0000","last_undegraded":"2024-09-17T05:28:46.654313+0000","last_fullsized":"2024-09-17T05:28:46.654313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:24.655736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863392+0000","last_change":"2024-09-17T05:28:45.684936+0000","last_active":"2024-09-17T05:28:46.863392+0000","last_peered":"2024-09-17T05:28:46.863392+0000","last_clean":"2024-09-17T05:28:46.863392+0000","last_became_active":"2024-09-17T05:28:45.684661+0000","last_became_peered":"2024-09-17T05:28:45.684661+0000","last_unstale":"2024-09-17T05:28:46.863392+0000","last_undegraded":"2024-09-17T05:28:46.863392+0000","last_fullsized":"2024-09-17T05:28:46.863392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:11.266932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688447+0000","last_change":"2024-09-17T05:28:44.659661+0000","last_active":"2024-09-17T05:28:46.688447+0000","last_peered":"2024-09-17T05:28:46.688447+0000","last_clean":"2024-09-17T05:28:46.688447+0000","last_became_active":"2024-09-17T05:28:44.659296+0000","last_became_peered":"2024-09-17T05:28:44.659296+0000","last_unstale":"2024-09-17T05:28:46.688447+0000","last_undegraded":"2024-09-17T05:28:46.688447+0000","last_fullsized":"2024-09-17T05:28:46.688447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:54.204227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660529+0000","last_change":"2024-09-17T05:28:45.689026+0000","last_active":"2024-09-17T05:28:46.660529+0000","last_peered":"2024-09-17T05:28:46.660529+0000","last_clean":"2024-09-17T05:28:46.660529+0000","last_became_active":"2024-09-17T05:28:45.688756+0000","last_became_peered":"2024-09-17T05:28:45.688756+0000","last_unstale":"2024-09-17T05:28:46.660529+0000","last_undegraded":"2024-09-17T05:28:46.660529+0000","last_fullsized":"2024-09-17T05:28:46.660529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:51.339078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654198+0000","last_change":"2024-09-17T05:28:44.657464+0000","last_active":"2024-09-17T05:28:46.654198+0000","last_peered":"2024-09-17T05:28:46.654198+0000","last_clean":"2024-09-17T05:28:46.654198+0000","last_became_active":"2024-09-17T05:28:44.654450+0000","last_became_peered":"2024-09-17T05:28:44.654450+0000","last_unstale":"2024-09-17T05:28:46.654198+0000","last_undegraded":"2024-09-17T05:28:46.654198+0000","last_fullsized":"2024-09-17T05:28:46.654198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:42.638974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863210+0000","last_change":"2024-09-17T05:28:45.676934+0000","last_active":"2024-09-17T05:28:46.863210+0000","last_peered":"2024-09-17T05:28:46.863210+0000","last_clean":"2024-09-17T05:28:46.863210+0000","last_became_active":"2024-09-17T05:28:45.676633+0000","last_became_peered":"2024-09-17T05:28:45.676633+0000","last_unstale":"2024-09-17T05:28:46.863210+0000","last_undegraded":"2024-09-17T05:28:46.863210+0000","last_fullsized":"2024-09-17T05:28:46.863210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:24.636305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862638+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:28:46.862638+0000","last_peered":"2024-09-17T05:28:46.862638+0000","last_clean":"2024-09-17T05:28:46.862638+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:28:46.862638+0000","last_undegraded":"2024-09-17T05:28:46.862638+0000","last_fullsized":"2024-09-17T05:28:46.862638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659979+0000","last_change":"2024-09-17T05:28:44.655816+0000","last_active":"2024-09-17T05:28:46.659979+0000","last_peered":"2024-09-17T05:28:46.659979+0000","last_clean":"2024-09-17T05:28:46.659979+0000","last_became_active":"2024-09-17T05:28:44.655528+0000","last_became_peered":"2024-09-17T05:28:44.655528+0000","last_unstale":"2024-09-17T05:28:46.659979+0000","last_undegraded":"2024-09-17T05:28:46.659979+0000","last_fullsized":"2024-09-17T05:28:46.659979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:53.370296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861881+0000","last_change":"2024-09-17T05:28:45.678111+0000","last_active":"2024-09-17T05:28:46.861881+0000","last_peered":"2024-09-17T05:28:46.861881+0000","last_clean":"2024-09-17T05:28:46.861881+0000","last_became_active":"2024-09-17T05:28:45.677828+0000","last_became_peered":"2024-09-17T05:28:45.677828+0000","last_unstale":"2024-09-17T05:28:46.861881+0000","last_undegraded":"2024-09-17T05:28:46.861881+0000","last_fullsized":"2024-09-17T05:28:46.861881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:35.611079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862512+0000","last_change":"2024-09-17T05:28:44.665338+0000","last_active":"2024-09-17T05:28:46.862512+0000","last_peered":"2024-09-17T05:28:46.862512+0000","last_clean":"2024-09-17T05:28:46.862512+0000","last_became_active":"2024-09-17T05:28:44.665066+0000","last_became_peered":"2024-09-17T05:28:44.665066+0000","last_unstale":"2024-09-17T05:28:46.862512+0000","last_undegraded":"2024-09-17T05:28:46.862512+0000","last_fullsized":"2024-09-17T05:28:46.862512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:57.978737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861309+0000","last_change":"2024-09-17T05:28:45.670679+0000","last_active":"2024-09-17T05:28:46.861309+0000","last_peered":"2024-09-17T05:28:46.861309+0000","last_clean":"2024-09-17T05:28:46.861309+0000","last_became_active":"2024-09-17T05:28:45.670385+0000","last_became_peered":"2024-09-17T05:28:45.670385+0000","last_unstale":"2024-09-17T05:28:46.861309+0000","last_undegraded":"2024-09-17T05:28:46.861309+0000","last_fullsized":"2024-09-17T05:28:46.861309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:56.353907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654167+0000","last_change":"2024-09-17T05:28:44.656799+0000","last_active":"2024-09-17T05:28:46.654167+0000","last_peered":"2024-09-17T05:28:46.654167+0000","last_clean":"2024-09-17T05:28:46.654167+0000","last_became_active":"2024-09-17T05:28:44.653919+0000","last_became_peered":"2024-09-17T05:28:44.653919+0000","last_unstale":"2024-09-17T05:28:46.654167+0000","last_undegraded":"2024-09-17T05:28:46.654167+0000","last_fullsized":"2024-09-17T05:28:46.654167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:00.756226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688170+0000","last_change":"2024-09-17T05:28:45.680508+0000","last_active":"2024-09-17T05:28:46.688170+0000","last_peered":"2024-09-17T05:28:46.688170+0000","last_clean":"2024-09-17T05:28:46.688170+0000","last_became_active":"2024-09-17T05:28:45.680228+0000","last_became_peered":"2024-09-17T05:28:45.680228+0000","last_unstale":"2024-09-17T05:28:46.688170+0000","last_undegraded":"2024-09-17T05:28:46.688170+0000","last_fullsized":"2024-09-17T05:28:46.688170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:00.494429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661173+0000","last_change":"2024-09-17T05:28:44.659616+0000","last_active":"2024-09-17T05:28:46.661173+0000","last_peered":"2024-09-17T05:28:46.661173+0000","last_clean":"2024-09-17T05:28:46.661173+0000","last_became_active":"2024-09-17T05:28:44.659315+0000","last_became_peered":"2024-09-17T05:28:44.659315+0000","last_unstale":"2024-09-17T05:28:46.661173+0000","last_undegraded":"2024-09-17T05:28:46.661173+0000","last_fullsized":"2024-09-17T05:28:46.661173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:01.383128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659953+0000","last_change":"2024-09-17T05:28:45.667308+0000","last_active":"2024-09-17T05:28:46.659953+0000","last_peered":"2024-09-17T05:28:46.659953+0000","last_clean":"2024-09-17T05:28:46.659953+0000","last_became_active":"2024-09-17T05:28:45.665085+0000","last_became_peered":"2024-09-17T05:28:45.665085+0000","last_unstale":"2024-09-17T05:28:46.659953+0000","last_undegraded":"2024-09-17T05:28:46.659953+0000","last_fullsized":"2024-09-17T05:28:46.659953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:35.749778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688240+0000","last_change":"2024-09-17T05:28:44.664461+0000","last_active":"2024-09-17T05:28:46.688240+0000","last_peered":"2024-09-17T05:28:46.688240+0000","last_clean":"2024-09-17T05:28:46.688240+0000","last_became_active":"2024-09-17T05:28:44.663124+0000","last_became_peered":"2024-09-17T05:28:44.663124+0000","last_unstale":"2024-09-17T05:28:46.688240+0000","last_undegraded":"2024-09-17T05:28:46.688240+0000","last_fullsized":"2024-09-17T05:28:46.688240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:56.605556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660901+0000","last_change":"2024-09-17T05:28:45.673340+0000","last_active":"2024-09-17T05:28:46.660901+0000","last_peered":"2024-09-17T05:28:46.660901+0000","last_clean":"2024-09-17T05:28:46.660901+0000","last_became_active":"2024-09-17T05:28:45.673047+0000","last_became_peered":"2024-09-17T05:28:45.673047+0000","last_unstale":"2024-09-17T05:28:46.660901+0000","last_undegraded":"2024-09-17T05:28:46.660901+0000","last_fullsized":"2024-09-17T05:28:46.660901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:21.863500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863309+0000","last_change":"2024-09-17T05:28:44.668483+0000","last_active":"2024-09-17T05:28:46.863309+0000","last_peered":"2024-09-17T05:28:46.863309+0000","last_clean":"2024-09-17T05:28:46.863309+0000","last_became_active":"2024-09-17T05:28:44.668063+0000","last_became_peered":"2024-09-17T05:28:44.668063+0000","last_unstale":"2024-09-17T05:28:46.863309+0000","last_undegraded":"2024-09-17T05:28:46.863309+0000","last_fullsized":"2024-09-17T05:28:46.863309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:03.222463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688247+0000","last_change":"2024-09-17T05:28:45.666361+0000","last_active":"2024-09-17T05:28:46.688247+0000","last_peered":"2024-09-17T05:28:46.688247+0000","last_clean":"2024-09-17T05:28:46.688247+0000","last_became_active":"2024-09-17T05:28:45.666003+0000","last_became_peered":"2024-09-17T05:28:45.666003+0000","last_unstale":"2024-09-17T05:28:46.688247+0000","last_undegraded":"2024-09-17T05:28:46.688247+0000","last_fullsized":"2024-09-17T05:28:46.688247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:43.813385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688447+0000","last_change":"2024-09-17T05:28:44.663175+0000","last_active":"2024-09-17T05:28:46.688447+0000","last_peered":"2024-09-17T05:28:46.688447+0000","last_clean":"2024-09-17T05:28:46.688447+0000","last_became_active":"2024-09-17T05:28:44.662839+0000","last_became_peered":"2024-09-17T05:28:44.662839+0000","last_unstale":"2024-09-17T05:28:46.688447+0000","last_undegraded":"2024-09-17T05:28:46.688447+0000","last_fullsized":"2024-09-17T05:28:46.688447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:14.858019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862188+0000","last_change":"2024-09-17T05:28:45.683844+0000","last_active":"2024-09-17T05:28:46.862188+0000","last_peered":"2024-09-17T05:28:46.862188+0000","last_clean":"2024-09-17T05:28:46.862188+0000","last_became_active":"2024-09-17T05:28:45.683527+0000","last_became_peered":"2024-09-17T05:28:45.683527+0000","last_unstale":"2024-09-17T05:28:46.862188+0000","last_undegraded":"2024-09-17T05:28:46.862188+0000","last_fullsized":"2024-09-17T05:28:46.862188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:11.277486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692809+0000","last_change":"2024-09-17T05:28:44.671021+0000","last_active":"2024-09-17T05:28:46.692809+0000","last_peered":"2024-09-17T05:28:46.692809+0000","last_clean":"2024-09-17T05:28:46.692809+0000","last_became_active":"2024-09-17T05:28:44.666107+0000","last_became_peered":"2024-09-17T05:28:44.666107+0000","last_unstale":"2024-09-17T05:28:46.692809+0000","last_undegraded":"2024-09-17T05:28:46.692809+0000","last_fullsized":"2024-09-17T05:28:46.692809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:57.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862563+0000","last_change":"2024-09-17T05:28:45.669543+0000","last_active":"2024-09-17T05:28:46.862563+0000","last_peered":"2024-09-17T05:28:46.862563+0000","last_clean":"2024-09-17T05:28:46.862563+0000","last_became_active":"2024-09-17T05:28:45.669258+0000","last_became_peered":"2024-09-17T05:28:45.669258+0000","last_unstale":"2024-09-17T05:28:46.862563+0000","last_undegraded":"2024-09-17T05:28:46.862563+0000","last_fullsized":"2024-09-17T05:28:46.862563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:29.130107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862503+0000","last_change":"2024-09-17T05:28:44.669157+0000","last_active":"2024-09-17T05:28:46.862503+0000","last_peered":"2024-09-17T05:28:46.862503+0000","last_clean":"2024-09-17T05:28:46.862503+0000","last_became_active":"2024-09-17T05:28:44.668464+0000","last_became_peered":"2024-09-17T05:28:44.668464+0000","last_unstale":"2024-09-17T05:28:46.862503+0000","last_undegraded":"2024-09-17T05:28:46.862503+0000","last_fullsized":"2024-09-17T05:28:46.862503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:27.326210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659841+0000","last_change":"2024-09-17T05:28:45.667885+0000","last_active":"2024-09-17T05:28:46.659841+0000","last_peered":"2024-09-17T05:28:46.659841+0000","last_clean":"2024-09-17T05:28:46.659841+0000","last_became_active":"2024-09-17T05:28:45.666920+0000","last_became_peered":"2024-09-17T05:28:45.666920+0000","last_unstale":"2024-09-17T05:28:46.659841+0000","last_undegraded":"2024-09-17T05:28:46.659841+0000","last_fullsized":"2024-09-17T05:28:46.659841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:25.665870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688240+0000","last_change":"2024-09-17T05:28:44.665516+0000","last_active":"2024-09-17T05:28:46.688240+0000","last_peered":"2024-09-17T05:28:46.688240+0000","last_clean":"2024-09-17T05:28:46.688240+0000","last_became_active":"2024-09-17T05:28:44.665205+0000","last_became_peered":"2024-09-17T05:28:44.665205+0000","last_unstale":"2024-09-17T05:28:46.688240+0000","last_undegraded":"2024-09-17T05:28:46.688240+0000","last_fullsized":"2024-09-17T05:28:46.688240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:57.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861431+0000","last_change":"2024-09-17T05:28:45.674698+0000","last_active":"2024-09-17T05:28:46.861431+0000","last_peered":"2024-09-17T05:28:46.861431+0000","last_clean":"2024-09-17T05:28:46.861431+0000","last_became_active":"2024-09-17T05:28:45.671117+0000","last_became_peered":"2024-09-17T05:28:45.671117+0000","last_unstale":"2024-09-17T05:28:46.861431+0000","last_undegraded":"2024-09-17T05:28:46.861431+0000","last_fullsized":"2024-09-17T05:28:46.861431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:34.701781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688163+0000","last_change":"2024-09-17T05:28:44.662000+0000","last_active":"2024-09-17T05:28:46.688163+0000","last_peered":"2024-09-17T05:28:46.688163+0000","last_clean":"2024-09-17T05:28:46.688163+0000","last_became_active":"2024-09-17T05:28:44.661699+0000","last_became_peered":"2024-09-17T05:28:44.661699+0000","last_unstale":"2024-09-17T05:28:46.688163+0000","last_undegraded":"2024-09-17T05:28:46.688163+0000","last_fullsized":"2024-09-17T05:28:46.688163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:57.978737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861824+0000","last_change":"2024-09-17T05:28:45.682448+0000","last_active":"2024-09-17T05:28:46.861824+0000","last_peered":"2024-09-17T05:28:46.861824+0000","last_clean":"2024-09-17T05:28:46.861824+0000","last_became_active":"2024-09-17T05:28:45.682109+0000","last_became_peered":"2024-09-17T05:28:45.682109+0000","last_unstale":"2024-09-17T05:28:46.861824+0000","last_undegraded":"2024-09-17T05:28:46.861824+0000","last_fullsized":"2024-09-17T05:28:46.861824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:44.301995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863028+0000","last_change":"2024-09-17T05:28:44.668065+0000","last_active":"2024-09-17T05:28:46.863028+0000","last_peered":"2024-09-17T05:28:46.863028+0000","last_clean":"2024-09-17T05:28:46.863028+0000","last_became_active":"2024-09-17T05:28:44.667735+0000","last_became_peered":"2024-09-17T05:28:44.667735+0000","last_unstale":"2024-09-17T05:28:46.863028+0000","last_undegraded":"2024-09-17T05:28:46.863028+0000","last_fullsized":"2024-09-17T05:28:46.863028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:28.072242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692822+0000","last_change":"2024-09-17T05:28:45.688653+0000","last_active":"2024-09-17T05:28:46.692822+0000","last_peered":"2024-09-17T05:28:46.692822+0000","last_clean":"2024-09-17T05:28:46.692822+0000","last_became_active":"2024-09-17T05:28:45.687995+0000","last_became_peered":"2024-09-17T05:28:45.687995+0000","last_unstale":"2024-09-17T05:28:46.692822+0000","last_undegraded":"2024-09-17T05:28:46.692822+0000","last_fullsized":"2024-09-17T05:28:46.692822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:00.494429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660675+0000","last_change":"2024-09-17T05:28:45.674640+0000","last_active":"2024-09-17T05:28:46.660675+0000","last_peered":"2024-09-17T05:28:46.660675+0000","last_clean":"2024-09-17T05:28:46.660675+0000","last_became_active":"2024-09-17T05:28:45.674375+0000","last_became_peered":"2024-09-17T05:28:45.674375+0000","last_unstale":"2024-09-17T05:28:46.660675+0000","last_undegraded":"2024-09-17T05:28:46.660675+0000","last_fullsized":"2024-09-17T05:28:46.660675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:48.986140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862772+0000","last_change":"2024-09-17T05:28:44.668500+0000","last_active":"2024-09-17T05:28:46.862772+0000","last_peered":"2024-09-17T05:28:46.862772+0000","last_clean":"2024-09-17T05:28:46.862772+0000","last_became_active":"2024-09-17T05:28:44.668171+0000","last_became_peered":"2024-09-17T05:28:44.668171+0000","last_unstale":"2024-09-17T05:28:46.862772+0000","last_undegraded":"2024-09-17T05:28:46.862772+0000","last_fullsized":"2024-09-17T05:28:46.862772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:05.964906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660309+0000","last_change":"2024-09-17T05:28:45.675119+0000","last_active":"2024-09-17T05:28:46.660309+0000","last_peered":"2024-09-17T05:28:46.660309+0000","last_clean":"2024-09-17T05:28:46.660309+0000","last_became_active":"2024-09-17T05:28:45.674840+0000","last_became_peered":"2024-09-17T05:28:45.674840+0000","last_unstale":"2024-09-17T05:28:46.660309+0000","last_undegraded":"2024-09-17T05:28:46.660309+0000","last_fullsized":"2024-09-17T05:28:46.660309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:26.709674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863195+0000","last_change":"2024-09-17T05:28:44.671103+0000","last_active":"2024-09-17T05:28:46.863195+0000","last_peered":"2024-09-17T05:28:46.863195+0000","last_clean":"2024-09-17T05:28:46.863195+0000","last_became_active":"2024-09-17T05:28:44.670755+0000","last_became_peered":"2024-09-17T05:28:44.670755+0000","last_unstale":"2024-09-17T05:28:46.863195+0000","last_undegraded":"2024-09-17T05:28:46.863195+0000","last_fullsized":"2024-09-17T05:28:46.863195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:14.858019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862459+0000","last_change":"2024-09-17T05:28:45.677087+0000","last_active":"2024-09-17T05:28:46.862459+0000","last_peered":"2024-09-17T05:28:46.862459+0000","last_clean":"2024-09-17T05:28:46.862459+0000","last_became_active":"2024-09-17T05:28:45.676750+0000","last_became_peered":"2024-09-17T05:28:45.676750+0000","last_unstale":"2024-09-17T05:28:46.862459+0000","last_undegraded":"2024-09-17T05:28:46.862459+0000","last_fullsized":"2024-09-17T05:28:46.862459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:14.581812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862014+0000","last_change":"2024-09-17T05:28:44.654538+0000","last_active":"2024-09-17T05:28:46.862014+0000","last_peered":"2024-09-17T05:28:46.862014+0000","last_clean":"2024-09-17T05:28:46.862014+0000","last_became_active":"2024-09-17T05:28:44.654264+0000","last_became_peered":"2024-09-17T05:28:44.654264+0000","last_unstale":"2024-09-17T05:28:46.862014+0000","last_undegraded":"2024-09-17T05:28:46.862014+0000","last_fullsized":"2024-09-17T05:28:46.862014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:57.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861779+0000","last_change":"2024-09-17T05:28:45.697637+0000","last_active":"2024-09-17T05:28:46.861779+0000","last_peered":"2024-09-17T05:28:46.861779+0000","last_clean":"2024-09-17T05:28:46.861779+0000","last_became_active":"2024-09-17T05:28:45.697328+0000","last_became_peered":"2024-09-17T05:28:45.697328+0000","last_unstale":"2024-09-17T05:28:46.861779+0000","last_undegraded":"2024-09-17T05:28:46.861779+0000","last_fullsized":"2024-09-17T05:28:46.861779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:44.608081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862559+0000","last_change":"2024-09-17T05:28:44.666526+0000","last_active":"2024-09-17T05:28:46.862559+0000","last_peered":"2024-09-17T05:28:46.862559+0000","last_clean":"2024-09-17T05:28:46.862559+0000","last_became_active":"2024-09-17T05:28:44.666209+0000","last_became_peered":"2024-09-17T05:28:44.666209+0000","last_unstale":"2024-09-17T05:28:46.862559+0000","last_undegraded":"2024-09-17T05:28:46.862559+0000","last_fullsized":"2024-09-17T05:28:46.862559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:50.431079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":663137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":72313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":72187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":663193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:28:59.613 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:28:59.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.793+0000 7fa378000640 1 -- 172.21.15.31:0/2159918163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa370071030 msgr2=0x7fa3700714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.793+0000 7fa378000640 1 --2- 172.21.15.31:0/2159918163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa370071030 0x7fa3700714c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa368009c80 tx=0x7fa36801cd70 comp rx=0 tx=0).stop 2024-09-17T05:28:59.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.793+0000 7fa378000640 1 -- 172.21.15.31:0/2159918163 shutdown_connections 2024-09-17T05:28:59.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.793+0000 7fa378000640 1 --2- 172.21.15.31:0/2159918163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa370071030 0x7fa3700714c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.793+0000 7fa378000640 1 --2- 172.21.15.31:0/2159918163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa37006cc20 0x7fa3700737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.793+0000 7fa378000640 1 -- 172.21.15.31:0/2159918163 >> 172.21.15.31:0/2159918163 conn(0x7fa3700d0c90 msgr2=0x7fa3700d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:59.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.793+0000 7fa378000640 1 -- 172.21.15.31:0/2159918163 shutdown_connections 2024-09-17T05:28:59.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.793+0000 7fa378000640 1 -- 172.21.15.31:0/2159918163 wait complete. 2024-09-17T05:28:59.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.793+0000 7fa378000640 1 Processor -- start 2024-09-17T05:28:59.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa378000640 1 -- start start 2024-09-17T05:28:59.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa378000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa37006cc20 0x7fa3700c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:59.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa378000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa370071030 0x7fa3700b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:59.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa378000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa37015c1c0 0x7fa3700b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:59.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa378000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa370168f60 con 0x7fa370071030 2024-09-17T05:28:59.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa378000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa370168de0 con 0x7fa37006cc20 2024-09-17T05:28:59.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa378000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa3701690e0 con 0x7fa37015c1c0 2024-09-17T05:28:59.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa374c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa370071030 0x7fa3700b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:59.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa374c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa370071030 0x7fa3700b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59648/0 (socket says 172.21.15.31:59648) 2024-09-17T05:28:59.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa374c00640 1 -- 172.21.15.31:0/1959505975 learned_addr learned my addr 172.21.15.31:0/1959505975 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:28:59.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa375600640 1 --2- 172.21.15.31:0/1959505975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa37006cc20 0x7fa3700c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:59.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa376000640 1 --2- 172.21.15.31:0/1959505975 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa37015c1c0 0x7fa3700b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:59.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa374c00640 1 -- 172.21.15.31:0/1959505975 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa37015c1c0 msgr2=0x7fa3700b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa374c00640 1 --2- 172.21.15.31:0/1959505975 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa37015c1c0 0x7fa3700b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa374c00640 1 -- 172.21.15.31:0/1959505975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa37006cc20 msgr2=0x7fa3700c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa374c00640 1 --2- 172.21.15.31:0/1959505975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa37006cc20 0x7fa3700c3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa374c00640 1 -- 172.21.15.31:0/1959505975 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3700c4210 con 0x7fa370071030 2024-09-17T05:28:59.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa374c00640 1 --2- 172.21.15.31:0/1959505975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa370071030 0x7fa3700b3ac0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00b410 tx=0x7fa35c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:59.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa36d600640 1 -- 172.21.15.31:0/1959505975 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c015030 con 0x7fa370071030 2024-09-17T05:28:59.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa36d600640 1 -- 172.21.15.31:0/1959505975 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa35c004020 con 0x7fa370071030 2024-09-17T05:28:59.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa378000640 1 -- 172.21.15.31:0/1959505975 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3700c44f0 con 0x7fa370071030 2024-09-17T05:28:59.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa36d600640 1 -- 172.21.15.31:0/1959505975 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c004470 con 0x7fa370071030 2024-09-17T05:28:59.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa378000640 1 -- 172.21.15.31:0/1959505975 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3700c4ab0 con 0x7fa370071030 2024-09-17T05:28:59.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.797+0000 7fa378000640 1 -- 172.21.15.31:0/1959505975 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3700737c0 con 0x7fa370071030 2024-09-17T05:28:59.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.801+0000 7fa36d600640 1 -- 172.21.15.31:0/1959505975 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa35c018070 con 0x7fa370071030 2024-09-17T05:28:59.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.801+0000 7fa36d600640 1 --2- 172.21.15.31:0/1959505975 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa350073200 0x7fa3500756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:28:59.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.801+0000 7fa36d600640 1 -- 172.21.15.31:0/1959505975 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa35c093e10 con 0x7fa370071030 2024-09-17T05:28:59.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.801+0000 7fa375600640 1 --2- 172.21.15.31:0/1959505975 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa350073200 0x7fa3500756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:28:59.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.801+0000 7fa375600640 1 --2- 172.21.15.31:0/1959505975 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa350073200 0x7fa3500756c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa36400abe0 tx=0x7fa36400a2d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:28:59.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.805+0000 7fa36d600640 1 -- 172.21.15.31:0/1959505975 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa35c097030 con 0x7fa370071030 2024-09-17T05:28:59.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.977+0000 7fa378000640 1 -- 172.21.15.31:0/1959505975 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa3700715e0 con 0x7fa350073200 2024-09-17T05:28:59.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.981+0000 7fa36d600640 1 -- 172.21.15.31:0/1959505975 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7fa3700715e0 con 0x7fa350073200 2024-09-17T05:28:59.989 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:28:59.990 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:28:59.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.985+0000 7fa378000640 1 -- 172.21.15.31:0/1959505975 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa350073200 msgr2=0x7fa3500756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.985+0000 7fa378000640 1 --2- 172.21.15.31:0/1959505975 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa350073200 0x7fa3500756c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa36400abe0 tx=0x7fa36400a2d0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.985+0000 7fa378000640 1 -- 172.21.15.31:0/1959505975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa370071030 msgr2=0x7fa3700b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:28:59.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.985+0000 7fa378000640 1 --2- 172.21.15.31:0/1959505975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa370071030 0x7fa3700b3ac0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00b410 tx=0x7fa35c00b8d0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.985+0000 7fa378000640 1 -- 172.21.15.31:0/1959505975 shutdown_connections 2024-09-17T05:28:59.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.985+0000 7fa378000640 1 --2- 172.21.15.31:0/1959505975 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa350073200 0x7fa3500756c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.985+0000 7fa378000640 1 --2- 172.21.15.31:0/1959505975 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa37015c1c0 0x7fa3700b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.985+0000 7fa378000640 1 --2- 172.21.15.31:0/1959505975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa370071030 0x7fa3700b3ac0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.985+0000 7fa378000640 1 --2- 172.21.15.31:0/1959505975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa37006cc20 0x7fa3700c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:28:59.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.985+0000 7fa378000640 1 -- 172.21.15.31:0/1959505975 >> 172.21.15.31:0/1959505975 conn(0x7fa3700d0c90 msgr2=0x7fa3700c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:28:59.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.985+0000 7fa378000640 1 -- 172.21.15.31:0/1959505975 shutdown_connections 2024-09-17T05:28:59.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:28:59.985+0000 7fa378000640 1 -- 172.21.15.31:0/1959505975 wait complete. 2024-09-17T05:29:00.012 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-17T05:28:59.184175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219120,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755600,"statfs":{"total":773094113280,"available":772869734400,"internally_reserved":0,"allocated":2924544,"data_stored":1763052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002774"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863232+0000","last_change":"2024-09-17T05:28:45.697872+0000","last_active":"2024-09-17T05:28:46.863232+0000","last_peered":"2024-09-17T05:28:46.863232+0000","last_clean":"2024-09-17T05:28:46.863232+0000","last_became_active":"2024-09-17T05:28:45.695565+0000","last_became_peered":"2024-09-17T05:28:45.695565+0000","last_unstale":"2024-09-17T05:28:46.863232+0000","last_undegraded":"2024-09-17T05:28:46.863232+0000","last_fullsized":"2024-09-17T05:28:46.863232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:45:19.586402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688506+0000","last_change":"2024-09-17T05:28:45.678580+0000","last_active":"2024-09-17T05:28:46.688506+0000","last_peered":"2024-09-17T05:28:46.688506+0000","last_clean":"2024-09-17T05:28:46.688506+0000","last_became_active":"2024-09-17T05:28:45.678219+0000","last_became_peered":"2024-09-17T05:28:45.678219+0000","last_unstale":"2024-09-17T05:28:46.688506+0000","last_undegraded":"2024-09-17T05:28:46.688506+0000","last_fullsized":"2024-09-17T05:28:46.688506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:21.659738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862447+0000","last_change":"2024-09-17T05:28:45.671569+0000","last_active":"2024-09-17T05:28:46.862447+0000","last_peered":"2024-09-17T05:28:46.862447+0000","last_clean":"2024-09-17T05:28:46.862447+0000","last_became_active":"2024-09-17T05:28:45.671278+0000","last_became_peered":"2024-09-17T05:28:45.671278+0000","last_unstale":"2024-09-17T05:28:46.862447+0000","last_undegraded":"2024-09-17T05:28:46.862447+0000","last_fullsized":"2024-09-17T05:28:46.862447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:58:21.650063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660082+0000","last_change":"2024-09-17T05:28:45.689085+0000","last_active":"2024-09-17T05:28:46.660082+0000","last_peered":"2024-09-17T05:28:46.660082+0000","last_clean":"2024-09-17T05:28:46.660082+0000","last_became_active":"2024-09-17T05:28:45.688806+0000","last_became_peered":"2024-09-17T05:28:45.688806+0000","last_unstale":"2024-09-17T05:28:46.660082+0000","last_undegraded":"2024-09-17T05:28:46.660082+0000","last_fullsized":"2024-09-17T05:28:46.660082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:51.791266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862886+0000","last_change":"2024-09-17T05:28:45.682352+0000","last_active":"2024-09-17T05:28:46.862886+0000","last_peered":"2024-09-17T05:28:46.862886+0000","last_clean":"2024-09-17T05:28:46.862886+0000","last_became_active":"2024-09-17T05:28:45.682032+0000","last_became_peered":"2024-09-17T05:28:45.682032+0000","last_unstale":"2024-09-17T05:28:46.862886+0000","last_undegraded":"2024-09-17T05:28:46.862886+0000","last_fullsized":"2024-09-17T05:28:46.862886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:46.948368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660986+0000","last_change":"2024-09-17T05:28:45.674052+0000","last_active":"2024-09-17T05:28:46.660986+0000","last_peered":"2024-09-17T05:28:46.660986+0000","last_clean":"2024-09-17T05:28:46.660986+0000","last_became_active":"2024-09-17T05:28:45.673577+0000","last_became_peered":"2024-09-17T05:28:45.673577+0000","last_unstale":"2024-09-17T05:28:46.660986+0000","last_undegraded":"2024-09-17T05:28:46.660986+0000","last_fullsized":"2024-09-17T05:28:46.660986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:51.624046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863066+0000","last_change":"2024-09-17T05:28:45.681779+0000","last_active":"2024-09-17T05:28:46.863066+0000","last_peered":"2024-09-17T05:28:46.863066+0000","last_clean":"2024-09-17T05:28:46.863066+0000","last_became_active":"2024-09-17T05:28:45.681439+0000","last_became_peered":"2024-09-17T05:28:45.681439+0000","last_unstale":"2024-09-17T05:28:46.863066+0000","last_undegraded":"2024-09-17T05:28:46.863066+0000","last_fullsized":"2024-09-17T05:28:46.863066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:17.571913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861260+0000","last_change":"2024-09-17T05:28:45.675817+0000","last_active":"2024-09-17T05:28:46.861260+0000","last_peered":"2024-09-17T05:28:46.861260+0000","last_clean":"2024-09-17T05:28:46.861260+0000","last_became_active":"2024-09-17T05:28:45.675261+0000","last_became_peered":"2024-09-17T05:28:45.675261+0000","last_unstale":"2024-09-17T05:28:46.861260+0000","last_undegraded":"2024-09-17T05:28:46.861260+0000","last_fullsized":"2024-09-17T05:28:46.861260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:12.192825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863307+0000","last_change":"2024-09-17T05:28:45.678585+0000","last_active":"2024-09-17T05:28:46.863307+0000","last_peered":"2024-09-17T05:28:46.863307+0000","last_clean":"2024-09-17T05:28:46.863307+0000","last_became_active":"2024-09-17T05:28:45.678193+0000","last_became_peered":"2024-09-17T05:28:45.678193+0000","last_unstale":"2024-09-17T05:28:46.863307+0000","last_undegraded":"2024-09-17T05:28:46.863307+0000","last_fullsized":"2024-09-17T05:28:46.863307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:09.412687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692863+0000","last_change":"2024-09-17T05:28:45.694856+0000","last_active":"2024-09-17T05:28:46.692863+0000","last_peered":"2024-09-17T05:28:46.692863+0000","last_clean":"2024-09-17T05:28:46.692863+0000","last_became_active":"2024-09-17T05:28:45.694301+0000","last_became_peered":"2024-09-17T05:28:45.694301+0000","last_unstale":"2024-09-17T05:28:46.692863+0000","last_undegraded":"2024-09-17T05:28:46.692863+0000","last_fullsized":"2024-09-17T05:28:46.692863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:51.540943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692949+0000","last_change":"2024-09-17T05:28:45.686541+0000","last_active":"2024-09-17T05:28:46.692949+0000","last_peered":"2024-09-17T05:28:46.692949+0000","last_clean":"2024-09-17T05:28:46.692949+0000","last_became_active":"2024-09-17T05:28:45.686257+0000","last_became_peered":"2024-09-17T05:28:45.686257+0000","last_unstale":"2024-09-17T05:28:46.692949+0000","last_undegraded":"2024-09-17T05:28:46.692949+0000","last_fullsized":"2024-09-17T05:28:46.692949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:43.813385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660297+0000","last_change":"2024-09-17T05:28:45.686106+0000","last_active":"2024-09-17T05:28:46.660297+0000","last_peered":"2024-09-17T05:28:46.660297+0000","last_clean":"2024-09-17T05:28:46.660297+0000","last_became_active":"2024-09-17T05:28:45.685801+0000","last_became_peered":"2024-09-17T05:28:45.685801+0000","last_unstale":"2024-09-17T05:28:46.660297+0000","last_undegraded":"2024-09-17T05:28:46.660297+0000","last_fullsized":"2024-09-17T05:28:46.660297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:49.061509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861763+0000","last_change":"2024-09-17T05:28:45.681737+0000","last_active":"2024-09-17T05:28:46.861763+0000","last_peered":"2024-09-17T05:28:46.861763+0000","last_clean":"2024-09-17T05:28:46.861763+0000","last_became_active":"2024-09-17T05:28:45.681463+0000","last_became_peered":"2024-09-17T05:28:45.681463+0000","last_unstale":"2024-09-17T05:28:46.861763+0000","last_undegraded":"2024-09-17T05:28:46.861763+0000","last_fullsized":"2024-09-17T05:28:46.861763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:04.524996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861769+0000","last_change":"2024-09-17T05:28:45.664352+0000","last_active":"2024-09-17T05:28:46.861769+0000","last_peered":"2024-09-17T05:28:46.861769+0000","last_clean":"2024-09-17T05:28:46.861769+0000","last_became_active":"2024-09-17T05:28:45.663507+0000","last_became_peered":"2024-09-17T05:28:45.663507+0000","last_unstale":"2024-09-17T05:28:46.861769+0000","last_undegraded":"2024-09-17T05:28:46.861769+0000","last_fullsized":"2024-09-17T05:28:46.861769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:17.848561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688160+0000","last_change":"2024-09-17T05:28:45.661764+0000","last_active":"2024-09-17T05:28:46.688160+0000","last_peered":"2024-09-17T05:28:46.688160+0000","last_clean":"2024-09-17T05:28:46.688160+0000","last_became_active":"2024-09-17T05:28:45.661449+0000","last_became_peered":"2024-09-17T05:28:45.661449+0000","last_unstale":"2024-09-17T05:28:46.688160+0000","last_undegraded":"2024-09-17T05:28:46.688160+0000","last_fullsized":"2024-09-17T05:28:46.688160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:06.446649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659618+0000","last_change":"2024-09-17T05:28:45.670649+0000","last_active":"2024-09-17T05:28:46.659618+0000","last_peered":"2024-09-17T05:28:46.659618+0000","last_clean":"2024-09-17T05:28:46.659618+0000","last_became_active":"2024-09-17T05:28:45.670351+0000","last_became_peered":"2024-09-17T05:28:45.670351+0000","last_unstale":"2024-09-17T05:28:46.659618+0000","last_undegraded":"2024-09-17T05:28:46.659618+0000","last_fullsized":"2024-09-17T05:28:46.659618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:29.130107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660571+0000","last_change":"2024-09-17T05:28:45.679957+0000","last_active":"2024-09-17T05:28:46.660571+0000","last_peered":"2024-09-17T05:28:46.660571+0000","last_clean":"2024-09-17T05:28:46.660571+0000","last_became_active":"2024-09-17T05:28:45.679602+0000","last_became_peered":"2024-09-17T05:28:45.679602+0000","last_unstale":"2024-09-17T05:28:46.660571+0000","last_undegraded":"2024-09-17T05:28:46.660571+0000","last_fullsized":"2024-09-17T05:28:46.660571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:39.462655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654439+0000","last_change":"2024-09-17T05:28:45.696611+0000","last_active":"2024-09-17T05:28:46.654439+0000","last_peered":"2024-09-17T05:28:46.654439+0000","last_clean":"2024-09-17T05:28:46.654439+0000","last_became_active":"2024-09-17T05:28:45.696317+0000","last_became_peered":"2024-09-17T05:28:45.696317+0000","last_unstale":"2024-09-17T05:28:46.654439+0000","last_undegraded":"2024-09-17T05:28:46.654439+0000","last_fullsized":"2024-09-17T05:28:46.654439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:02.631947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863417+0000","last_change":"2024-09-17T05:28:45.682233+0000","last_active":"2024-09-17T05:28:46.863417+0000","last_peered":"2024-09-17T05:28:46.863417+0000","last_clean":"2024-09-17T05:28:46.863417+0000","last_became_active":"2024-09-17T05:28:45.681921+0000","last_became_peered":"2024-09-17T05:28:45.681921+0000","last_unstale":"2024-09-17T05:28:46.863417+0000","last_undegraded":"2024-09-17T05:28:46.863417+0000","last_fullsized":"2024-09-17T05:28:46.863417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:48.570504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692784+0000","last_change":"2024-09-17T05:28:45.689764+0000","last_active":"2024-09-17T05:28:46.692784+0000","last_peered":"2024-09-17T05:28:46.692784+0000","last_clean":"2024-09-17T05:28:46.692784+0000","last_became_active":"2024-09-17T05:28:45.686962+0000","last_became_peered":"2024-09-17T05:28:45.686962+0000","last_unstale":"2024-09-17T05:28:46.692784+0000","last_undegraded":"2024-09-17T05:28:46.692784+0000","last_fullsized":"2024-09-17T05:28:46.692784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:02:08.175874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861974+0000","last_change":"2024-09-17T05:28:45.679307+0000","last_active":"2024-09-17T05:28:46.861974+0000","last_peered":"2024-09-17T05:28:46.861974+0000","last_clean":"2024-09-17T05:28:46.861974+0000","last_became_active":"2024-09-17T05:28:45.677900+0000","last_became_peered":"2024-09-17T05:28:45.677900+0000","last_unstale":"2024-09-17T05:28:46.861974+0000","last_undegraded":"2024-09-17T05:28:46.861974+0000","last_fullsized":"2024-09-17T05:28:46.861974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:16.537395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661054+0000","last_change":"2024-09-17T05:28:45.675903+0000","last_active":"2024-09-17T05:28:46.661054+0000","last_peered":"2024-09-17T05:28:46.661054+0000","last_clean":"2024-09-17T05:28:46.661054+0000","last_became_active":"2024-09-17T05:28:45.675619+0000","last_became_peered":"2024-09-17T05:28:45.675619+0000","last_unstale":"2024-09-17T05:28:46.661054+0000","last_undegraded":"2024-09-17T05:28:46.661054+0000","last_fullsized":"2024-09-17T05:28:46.661054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:25.383911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861418+0000","last_change":"2024-09-17T05:28:45.685230+0000","last_active":"2024-09-17T05:28:46.861418+0000","last_peered":"2024-09-17T05:28:46.861418+0000","last_clean":"2024-09-17T05:28:46.861418+0000","last_became_active":"2024-09-17T05:28:45.684920+0000","last_became_peered":"2024-09-17T05:28:45.684920+0000","last_unstale":"2024-09-17T05:28:46.861418+0000","last_undegraded":"2024-09-17T05:28:46.861418+0000","last_fullsized":"2024-09-17T05:28:46.861418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:37.130400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660820+0000","last_change":"2024-09-17T05:28:45.670609+0000","last_active":"2024-09-17T05:28:46.660820+0000","last_peered":"2024-09-17T05:28:46.660820+0000","last_clean":"2024-09-17T05:28:46.660820+0000","last_became_active":"2024-09-17T05:28:45.670294+0000","last_became_peered":"2024-09-17T05:28:45.670294+0000","last_unstale":"2024-09-17T05:28:46.660820+0000","last_undegraded":"2024-09-17T05:28:46.660820+0000","last_fullsized":"2024-09-17T05:28:46.660820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:47.532792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862177+0000","last_change":"2024-09-17T05:28:45.686654+0000","last_active":"2024-09-17T05:28:46.862177+0000","last_peered":"2024-09-17T05:28:46.862177+0000","last_clean":"2024-09-17T05:28:46.862177+0000","last_became_active":"2024-09-17T05:28:45.686315+0000","last_became_peered":"2024-09-17T05:28:45.686315+0000","last_unstale":"2024-09-17T05:28:46.862177+0000","last_undegraded":"2024-09-17T05:28:46.862177+0000","last_fullsized":"2024-09-17T05:28:46.862177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:49.777428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.693162+0000","last_change":"2024-09-17T05:28:45.696244+0000","last_active":"2024-09-17T05:28:46.693162+0000","last_peered":"2024-09-17T05:28:46.693162+0000","last_clean":"2024-09-17T05:28:46.693162+0000","last_became_active":"2024-09-17T05:28:45.695996+0000","last_became_peered":"2024-09-17T05:28:45.695996+0000","last_unstale":"2024-09-17T05:28:46.693162+0000","last_undegraded":"2024-09-17T05:28:46.693162+0000","last_fullsized":"2024-09-17T05:28:46.693162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:21.659738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688428+0000","last_change":"2024-09-17T05:28:45.672165+0000","last_active":"2024-09-17T05:28:46.688428+0000","last_peered":"2024-09-17T05:28:46.688428+0000","last_clean":"2024-09-17T05:28:46.688428+0000","last_became_active":"2024-09-17T05:28:45.671847+0000","last_became_peered":"2024-09-17T05:28:45.671847+0000","last_unstale":"2024-09-17T05:28:46.688428+0000","last_undegraded":"2024-09-17T05:28:46.688428+0000","last_fullsized":"2024-09-17T05:28:46.688428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:33.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861906+0000","last_change":"2024-09-17T05:28:45.685316+0000","last_active":"2024-09-17T05:28:46.861906+0000","last_peered":"2024-09-17T05:28:46.861906+0000","last_clean":"2024-09-17T05:28:46.861906+0000","last_became_active":"2024-09-17T05:28:45.684897+0000","last_became_peered":"2024-09-17T05:28:45.684897+0000","last_unstale":"2024-09-17T05:28:46.861906+0000","last_undegraded":"2024-09-17T05:28:46.861906+0000","last_fullsized":"2024-09-17T05:28:46.861906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:09.347060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862091+0000","last_change":"2024-09-17T05:28:45.686073+0000","last_active":"2024-09-17T05:28:46.862091+0000","last_peered":"2024-09-17T05:28:46.862091+0000","last_clean":"2024-09-17T05:28:46.862091+0000","last_became_active":"2024-09-17T05:28:45.685807+0000","last_became_peered":"2024-09-17T05:28:45.685807+0000","last_unstale":"2024-09-17T05:28:46.862091+0000","last_undegraded":"2024-09-17T05:28:46.862091+0000","last_fullsized":"2024-09-17T05:28:46.862091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:16.599698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661110+0000","last_change":"2024-09-17T05:28:45.671925+0000","last_active":"2024-09-17T05:28:46.661110+0000","last_peered":"2024-09-17T05:28:46.661110+0000","last_clean":"2024-09-17T05:28:46.661110+0000","last_became_active":"2024-09-17T05:28:45.671678+0000","last_became_peered":"2024-09-17T05:28:45.671678+0000","last_unstale":"2024-09-17T05:28:46.661110+0000","last_undegraded":"2024-09-17T05:28:46.661110+0000","last_fullsized":"2024-09-17T05:28:46.661110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:42.029278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654148+0000","last_change":"2024-09-17T05:28:45.671512+0000","last_active":"2024-09-17T05:28:46.654148+0000","last_peered":"2024-09-17T05:28:46.654148+0000","last_clean":"2024-09-17T05:28:46.654148+0000","last_became_active":"2024-09-17T05:28:45.671206+0000","last_became_peered":"2024-09-17T05:28:45.671206+0000","last_unstale":"2024-09-17T05:28:46.654148+0000","last_undegraded":"2024-09-17T05:28:46.654148+0000","last_fullsized":"2024-09-17T05:28:46.654148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:49.061509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692663+0000","last_change":"2024-09-17T05:28:45.691716+0000","last_active":"2024-09-17T05:28:46.692663+0000","last_peered":"2024-09-17T05:28:46.692663+0000","last_clean":"2024-09-17T05:28:46.692663+0000","last_became_active":"2024-09-17T05:28:45.691437+0000","last_became_peered":"2024-09-17T05:28:45.691437+0000","last_unstale":"2024-09-17T05:28:46.692663+0000","last_undegraded":"2024-09-17T05:28:46.692663+0000","last_fullsized":"2024-09-17T05:28:46.692663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:36.011098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659719+0000","last_change":"2024-09-17T05:28:45.668556+0000","last_active":"2024-09-17T05:28:46.659719+0000","last_peered":"2024-09-17T05:28:46.659719+0000","last_clean":"2024-09-17T05:28:46.659719+0000","last_became_active":"2024-09-17T05:28:45.667772+0000","last_became_peered":"2024-09-17T05:28:45.667772+0000","last_unstale":"2024-09-17T05:28:46.659719+0000","last_undegraded":"2024-09-17T05:28:46.659719+0000","last_fullsized":"2024-09-17T05:28:46.659719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:01.766360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861829+0000","last_change":"2024-09-17T05:28:44.657244+0000","last_active":"2024-09-17T05:28:46.861829+0000","last_peered":"2024-09-17T05:28:46.861829+0000","last_clean":"2024-09-17T05:28:46.861829+0000","last_became_active":"2024-09-17T05:28:44.656558+0000","last_became_peered":"2024-09-17T05:28:44.656558+0000","last_unstale":"2024-09-17T05:28:46.861829+0000","last_undegraded":"2024-09-17T05:28:46.861829+0000","last_fullsized":"2024-09-17T05:28:46.861829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:54.204227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862171+0000","last_change":"2024-09-17T05:28:45.661811+0000","last_active":"2024-09-17T05:28:46.862171+0000","last_peered":"2024-09-17T05:28:46.862171+0000","last_clean":"2024-09-17T05:28:46.862171+0000","last_became_active":"2024-09-17T05:28:45.659242+0000","last_became_peered":"2024-09-17T05:28:45.659242+0000","last_unstale":"2024-09-17T05:28:46.862171+0000","last_undegraded":"2024-09-17T05:28:46.862171+0000","last_fullsized":"2024-09-17T05:28:46.862171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:47.085346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692619+0000","last_change":"2024-09-17T05:28:44.660153+0000","last_active":"2024-09-17T05:28:46.692619+0000","last_peered":"2024-09-17T05:28:46.692619+0000","last_clean":"2024-09-17T05:28:46.692619+0000","last_became_active":"2024-09-17T05:28:44.658470+0000","last_became_peered":"2024-09-17T05:28:44.658470+0000","last_unstale":"2024-09-17T05:28:46.692619+0000","last_undegraded":"2024-09-17T05:28:46.692619+0000","last_fullsized":"2024-09-17T05:28:46.692619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:44.416180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861467+0000","last_change":"2024-09-17T05:28:44.665256+0000","last_active":"2024-09-17T05:28:46.861467+0000","last_peered":"2024-09-17T05:28:46.861467+0000","last_clean":"2024-09-17T05:28:46.861467+0000","last_became_active":"2024-09-17T05:28:44.664960+0000","last_became_peered":"2024-09-17T05:28:44.664960+0000","last_unstale":"2024-09-17T05:28:46.861467+0000","last_undegraded":"2024-09-17T05:28:46.861467+0000","last_fullsized":"2024-09-17T05:28:46.861467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:14.057015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861329+0000","last_change":"2024-09-17T05:28:45.673448+0000","last_active":"2024-09-17T05:28:46.861329+0000","last_peered":"2024-09-17T05:28:46.861329+0000","last_clean":"2024-09-17T05:28:46.861329+0000","last_became_active":"2024-09-17T05:28:45.670646+0000","last_became_peered":"2024-09-17T05:28:45.670646+0000","last_unstale":"2024-09-17T05:28:46.861329+0000","last_undegraded":"2024-09-17T05:28:46.861329+0000","last_fullsized":"2024-09-17T05:28:46.861329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:06.446649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660320+0000","last_change":"2024-09-17T05:28:44.659788+0000","last_active":"2024-09-17T05:28:46.660320+0000","last_peered":"2024-09-17T05:28:46.660320+0000","last_clean":"2024-09-17T05:28:46.660320+0000","last_became_active":"2024-09-17T05:28:44.657841+0000","last_became_peered":"2024-09-17T05:28:44.657841+0000","last_unstale":"2024-09-17T05:28:46.660320+0000","last_undegraded":"2024-09-17T05:28:46.660320+0000","last_fullsized":"2024-09-17T05:28:46.660320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:31.718118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688161+0000","last_change":"2024-09-17T05:28:45.673740+0000","last_active":"2024-09-17T05:28:46.688161+0000","last_peered":"2024-09-17T05:28:46.688161+0000","last_clean":"2024-09-17T05:28:46.688161+0000","last_became_active":"2024-09-17T05:28:45.671723+0000","last_became_peered":"2024-09-17T05:28:45.671723+0000","last_unstale":"2024-09-17T05:28:46.688161+0000","last_undegraded":"2024-09-17T05:28:46.688161+0000","last_fullsized":"2024-09-17T05:28:46.688161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:02:08.175874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692691+0000","last_change":"2024-09-17T05:28:44.659120+0000","last_active":"2024-09-17T05:28:46.692691+0000","last_peered":"2024-09-17T05:28:46.692691+0000","last_clean":"2024-09-17T05:28:46.692691+0000","last_became_active":"2024-09-17T05:28:44.658305+0000","last_became_peered":"2024-09-17T05:28:44.658305+0000","last_unstale":"2024-09-17T05:28:46.692691+0000","last_undegraded":"2024-09-17T05:28:46.692691+0000","last_fullsized":"2024-09-17T05:28:46.692691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:54.204227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660354+0000","last_change":"2024-09-17T05:28:45.682482+0000","last_active":"2024-09-17T05:28:46.660354+0000","last_peered":"2024-09-17T05:28:46.660354+0000","last_clean":"2024-09-17T05:28:46.660354+0000","last_became_active":"2024-09-17T05:28:45.682173+0000","last_became_peered":"2024-09-17T05:28:45.682173+0000","last_unstale":"2024-09-17T05:28:46.660354+0000","last_undegraded":"2024-09-17T05:28:46.660354+0000","last_fullsized":"2024-09-17T05:28:46.660354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:49.488039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660472+0000","last_change":"2024-09-17T05:28:44.660933+0000","last_active":"2024-09-17T05:28:46.660472+0000","last_peered":"2024-09-17T05:28:46.660472+0000","last_clean":"2024-09-17T05:28:46.660472+0000","last_became_active":"2024-09-17T05:28:44.660651+0000","last_became_peered":"2024-09-17T05:28:44.660651+0000","last_unstale":"2024-09-17T05:28:46.660472+0000","last_undegraded":"2024-09-17T05:28:46.660472+0000","last_fullsized":"2024-09-17T05:28:46.660472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:07.374786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862562+0000","last_change":"2024-09-17T05:28:45.680416+0000","last_active":"2024-09-17T05:28:46.862562+0000","last_peered":"2024-09-17T05:28:46.862562+0000","last_clean":"2024-09-17T05:28:46.862562+0000","last_became_active":"2024-09-17T05:28:45.676745+0000","last_became_peered":"2024-09-17T05:28:45.676745+0000","last_unstale":"2024-09-17T05:28:46.862562+0000","last_undegraded":"2024-09-17T05:28:46.862562+0000","last_fullsized":"2024-09-17T05:28:46.862562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:26.799851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688387+0000","last_change":"2024-09-17T05:28:44.658749+0000","last_active":"2024-09-17T05:28:46.688387+0000","last_peered":"2024-09-17T05:28:46.688387+0000","last_clean":"2024-09-17T05:28:46.688387+0000","last_became_active":"2024-09-17T05:28:44.658422+0000","last_became_peered":"2024-09-17T05:28:44.658422+0000","last_unstale":"2024-09-17T05:28:46.688387+0000","last_undegraded":"2024-09-17T05:28:46.688387+0000","last_fullsized":"2024-09-17T05:28:46.688387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:44.416180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660498+0000","last_change":"2024-09-17T05:28:45.679934+0000","last_active":"2024-09-17T05:28:46.660498+0000","last_peered":"2024-09-17T05:28:46.660498+0000","last_clean":"2024-09-17T05:28:46.660498+0000","last_became_active":"2024-09-17T05:28:45.679532+0000","last_became_peered":"2024-09-17T05:28:45.679532+0000","last_unstale":"2024-09-17T05:28:46.660498+0000","last_undegraded":"2024-09-17T05:28:46.660498+0000","last_fullsized":"2024-09-17T05:28:46.660498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:02.631947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692603+0000","last_change":"2024-09-17T05:28:44.670793+0000","last_active":"2024-09-17T05:28:46.692603+0000","last_peered":"2024-09-17T05:28:46.692603+0000","last_clean":"2024-09-17T05:28:46.692603+0000","last_became_active":"2024-09-17T05:28:44.670483+0000","last_became_peered":"2024-09-17T05:28:44.670483+0000","last_unstale":"2024-09-17T05:28:46.692603+0000","last_undegraded":"2024-09-17T05:28:46.692603+0000","last_fullsized":"2024-09-17T05:28:46.692603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:56.605556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863123+0000","last_change":"2024-09-17T05:28:45.676170+0000","last_active":"2024-09-17T05:28:46.863123+0000","last_peered":"2024-09-17T05:28:46.863123+0000","last_clean":"2024-09-17T05:28:46.863123+0000","last_became_active":"2024-09-17T05:28:45.675349+0000","last_became_peered":"2024-09-17T05:28:45.675349+0000","last_unstale":"2024-09-17T05:28:46.863123+0000","last_undegraded":"2024-09-17T05:28:46.863123+0000","last_fullsized":"2024-09-17T05:28:46.863123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:25.988668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862160+0000","last_change":"2024-09-17T05:28:44.656355+0000","last_active":"2024-09-17T05:28:46.862160+0000","last_peered":"2024-09-17T05:28:46.862160+0000","last_clean":"2024-09-17T05:28:46.862160+0000","last_became_active":"2024-09-17T05:28:44.656064+0000","last_became_peered":"2024-09-17T05:28:44.656064+0000","last_unstale":"2024-09-17T05:28:46.862160+0000","last_undegraded":"2024-09-17T05:28:46.862160+0000","last_fullsized":"2024-09-17T05:28:46.862160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:00:37.731866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861989+0000","last_change":"2024-09-17T05:28:45.683802+0000","last_active":"2024-09-17T05:28:46.861989+0000","last_peered":"2024-09-17T05:28:46.861989+0000","last_clean":"2024-09-17T05:28:46.861989+0000","last_became_active":"2024-09-17T05:28:45.681514+0000","last_became_peered":"2024-09-17T05:28:45.681514+0000","last_unstale":"2024-09-17T05:28:46.861989+0000","last_undegraded":"2024-09-17T05:28:46.861989+0000","last_fullsized":"2024-09-17T05:28:46.861989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:03.269669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661166+0000","last_change":"2024-09-17T05:28:44.666923+0000","last_active":"2024-09-17T05:28:46.661166+0000","last_peered":"2024-09-17T05:28:46.661166+0000","last_clean":"2024-09-17T05:28:46.661166+0000","last_became_active":"2024-09-17T05:28:44.663304+0000","last_became_peered":"2024-09-17T05:28:44.663304+0000","last_unstale":"2024-09-17T05:28:46.661166+0000","last_undegraded":"2024-09-17T05:28:46.661166+0000","last_fullsized":"2024-09-17T05:28:46.661166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:39.859160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863074+0000","last_change":"2024-09-17T05:28:45.690781+0000","last_active":"2024-09-17T05:28:46.863074+0000","last_peered":"2024-09-17T05:28:46.863074+0000","last_clean":"2024-09-17T05:28:46.863074+0000","last_became_active":"2024-09-17T05:28:45.690510+0000","last_became_peered":"2024-09-17T05:28:45.690510+0000","last_unstale":"2024-09-17T05:28:46.863074+0000","last_undegraded":"2024-09-17T05:28:46.863074+0000","last_fullsized":"2024-09-17T05:28:46.863074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:23.217463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692449+0000","last_change":"2024-09-17T05:28:44.659293+0000","last_active":"2024-09-17T05:28:46.692449+0000","last_peered":"2024-09-17T05:28:46.692449+0000","last_clean":"2024-09-17T05:28:46.692449+0000","last_became_active":"2024-09-17T05:28:44.658946+0000","last_became_peered":"2024-09-17T05:28:44.658946+0000","last_unstale":"2024-09-17T05:28:46.692449+0000","last_undegraded":"2024-09-17T05:28:46.692449+0000","last_fullsized":"2024-09-17T05:28:46.692449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:17.828856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692995+0000","last_change":"2024-09-17T05:28:45.686933+0000","last_active":"2024-09-17T05:28:46.692995+0000","last_peered":"2024-09-17T05:28:46.692995+0000","last_clean":"2024-09-17T05:28:46.692995+0000","last_became_active":"2024-09-17T05:28:45.686604+0000","last_became_peered":"2024-09-17T05:28:45.686604+0000","last_unstale":"2024-09-17T05:28:46.692995+0000","last_undegraded":"2024-09-17T05:28:46.692995+0000","last_fullsized":"2024-09-17T05:28:46.692995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:33.719271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.653948+0000","last_change":"2024-09-17T05:28:44.659167+0000","last_active":"2024-09-17T05:28:46.653948+0000","last_peered":"2024-09-17T05:28:46.653948+0000","last_clean":"2024-09-17T05:28:46.653948+0000","last_became_active":"2024-09-17T05:28:44.658804+0000","last_became_peered":"2024-09-17T05:28:44.658804+0000","last_unstale":"2024-09-17T05:28:46.653948+0000","last_undegraded":"2024-09-17T05:28:46.653948+0000","last_fullsized":"2024-09-17T05:28:46.653948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:50.304488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862798+0000","last_change":"2024-09-17T05:28:45.688426+0000","last_active":"2024-09-17T05:28:46.862798+0000","last_peered":"2024-09-17T05:28:46.862798+0000","last_clean":"2024-09-17T05:28:46.862798+0000","last_became_active":"2024-09-17T05:28:45.688100+0000","last_became_peered":"2024-09-17T05:28:45.688100+0000","last_unstale":"2024-09-17T05:28:46.862798+0000","last_undegraded":"2024-09-17T05:28:46.862798+0000","last_fullsized":"2024-09-17T05:28:46.862798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:11.277486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660737+0000","last_change":"2024-09-17T05:28:44.662254+0000","last_active":"2024-09-17T05:28:46.660737+0000","last_peered":"2024-09-17T05:28:46.660737+0000","last_clean":"2024-09-17T05:28:46.660737+0000","last_became_active":"2024-09-17T05:28:44.659880+0000","last_became_peered":"2024-09-17T05:28:44.659880+0000","last_unstale":"2024-09-17T05:28:46.660737+0000","last_undegraded":"2024-09-17T05:28:46.660737+0000","last_fullsized":"2024-09-17T05:28:46.660737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:54.102764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863300+0000","last_change":"2024-09-17T05:28:45.693962+0000","last_active":"2024-09-17T05:28:46.863300+0000","last_peered":"2024-09-17T05:28:46.863300+0000","last_clean":"2024-09-17T05:28:46.863300+0000","last_became_active":"2024-09-17T05:28:45.693641+0000","last_became_peered":"2024-09-17T05:28:45.693641+0000","last_unstale":"2024-09-17T05:28:46.863300+0000","last_undegraded":"2024-09-17T05:28:46.863300+0000","last_fullsized":"2024-09-17T05:28:46.863300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:12.085165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654313+0000","last_change":"2024-09-17T05:28:44.657506+0000","last_active":"2024-09-17T05:28:46.654313+0000","last_peered":"2024-09-17T05:28:46.654313+0000","last_clean":"2024-09-17T05:28:46.654313+0000","last_became_active":"2024-09-17T05:28:44.653791+0000","last_became_peered":"2024-09-17T05:28:44.653791+0000","last_unstale":"2024-09-17T05:28:46.654313+0000","last_undegraded":"2024-09-17T05:28:46.654313+0000","last_fullsized":"2024-09-17T05:28:46.654313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:24.655736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863392+0000","last_change":"2024-09-17T05:28:45.684936+0000","last_active":"2024-09-17T05:28:46.863392+0000","last_peered":"2024-09-17T05:28:46.863392+0000","last_clean":"2024-09-17T05:28:46.863392+0000","last_became_active":"2024-09-17T05:28:45.684661+0000","last_became_peered":"2024-09-17T05:28:45.684661+0000","last_unstale":"2024-09-17T05:28:46.863392+0000","last_undegraded":"2024-09-17T05:28:46.863392+0000","last_fullsized":"2024-09-17T05:28:46.863392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:11.266932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688447+0000","last_change":"2024-09-17T05:28:44.659661+0000","last_active":"2024-09-17T05:28:46.688447+0000","last_peered":"2024-09-17T05:28:46.688447+0000","last_clean":"2024-09-17T05:28:46.688447+0000","last_became_active":"2024-09-17T05:28:44.659296+0000","last_became_peered":"2024-09-17T05:28:44.659296+0000","last_unstale":"2024-09-17T05:28:46.688447+0000","last_undegraded":"2024-09-17T05:28:46.688447+0000","last_fullsized":"2024-09-17T05:28:46.688447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:54.204227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660529+0000","last_change":"2024-09-17T05:28:45.689026+0000","last_active":"2024-09-17T05:28:46.660529+0000","last_peered":"2024-09-17T05:28:46.660529+0000","last_clean":"2024-09-17T05:28:46.660529+0000","last_became_active":"2024-09-17T05:28:45.688756+0000","last_became_peered":"2024-09-17T05:28:45.688756+0000","last_unstale":"2024-09-17T05:28:46.660529+0000","last_undegraded":"2024-09-17T05:28:46.660529+0000","last_fullsized":"2024-09-17T05:28:46.660529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:51.339078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654198+0000","last_change":"2024-09-17T05:28:44.657464+0000","last_active":"2024-09-17T05:28:46.654198+0000","last_peered":"2024-09-17T05:28:46.654198+0000","last_clean":"2024-09-17T05:28:46.654198+0000","last_became_active":"2024-09-17T05:28:44.654450+0000","last_became_peered":"2024-09-17T05:28:44.654450+0000","last_unstale":"2024-09-17T05:28:46.654198+0000","last_undegraded":"2024-09-17T05:28:46.654198+0000","last_fullsized":"2024-09-17T05:28:46.654198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:42.638974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863210+0000","last_change":"2024-09-17T05:28:45.676934+0000","last_active":"2024-09-17T05:28:46.863210+0000","last_peered":"2024-09-17T05:28:46.863210+0000","last_clean":"2024-09-17T05:28:46.863210+0000","last_became_active":"2024-09-17T05:28:45.676633+0000","last_became_peered":"2024-09-17T05:28:45.676633+0000","last_unstale":"2024-09-17T05:28:46.863210+0000","last_undegraded":"2024-09-17T05:28:46.863210+0000","last_fullsized":"2024-09-17T05:28:46.863210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:24.636305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862638+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:28:46.862638+0000","last_peered":"2024-09-17T05:28:46.862638+0000","last_clean":"2024-09-17T05:28:46.862638+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:28:46.862638+0000","last_undegraded":"2024-09-17T05:28:46.862638+0000","last_fullsized":"2024-09-17T05:28:46.862638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659979+0000","last_change":"2024-09-17T05:28:44.655816+0000","last_active":"2024-09-17T05:28:46.659979+0000","last_peered":"2024-09-17T05:28:46.659979+0000","last_clean":"2024-09-17T05:28:46.659979+0000","last_became_active":"2024-09-17T05:28:44.655528+0000","last_became_peered":"2024-09-17T05:28:44.655528+0000","last_unstale":"2024-09-17T05:28:46.659979+0000","last_undegraded":"2024-09-17T05:28:46.659979+0000","last_fullsized":"2024-09-17T05:28:46.659979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:53.370296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861881+0000","last_change":"2024-09-17T05:28:45.678111+0000","last_active":"2024-09-17T05:28:46.861881+0000","last_peered":"2024-09-17T05:28:46.861881+0000","last_clean":"2024-09-17T05:28:46.861881+0000","last_became_active":"2024-09-17T05:28:45.677828+0000","last_became_peered":"2024-09-17T05:28:45.677828+0000","last_unstale":"2024-09-17T05:28:46.861881+0000","last_undegraded":"2024-09-17T05:28:46.861881+0000","last_fullsized":"2024-09-17T05:28:46.861881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:35.611079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862512+0000","last_change":"2024-09-17T05:28:44.665338+0000","last_active":"2024-09-17T05:28:46.862512+0000","last_peered":"2024-09-17T05:28:46.862512+0000","last_clean":"2024-09-17T05:28:46.862512+0000","last_became_active":"2024-09-17T05:28:44.665066+0000","last_became_peered":"2024-09-17T05:28:44.665066+0000","last_unstale":"2024-09-17T05:28:46.862512+0000","last_undegraded":"2024-09-17T05:28:46.862512+0000","last_fullsized":"2024-09-17T05:28:46.862512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:57.978737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861309+0000","last_change":"2024-09-17T05:28:45.670679+0000","last_active":"2024-09-17T05:28:46.861309+0000","last_peered":"2024-09-17T05:28:46.861309+0000","last_clean":"2024-09-17T05:28:46.861309+0000","last_became_active":"2024-09-17T05:28:45.670385+0000","last_became_peered":"2024-09-17T05:28:45.670385+0000","last_unstale":"2024-09-17T05:28:46.861309+0000","last_undegraded":"2024-09-17T05:28:46.861309+0000","last_fullsized":"2024-09-17T05:28:46.861309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:56.353907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.654167+0000","last_change":"2024-09-17T05:28:44.656799+0000","last_active":"2024-09-17T05:28:46.654167+0000","last_peered":"2024-09-17T05:28:46.654167+0000","last_clean":"2024-09-17T05:28:46.654167+0000","last_became_active":"2024-09-17T05:28:44.653919+0000","last_became_peered":"2024-09-17T05:28:44.653919+0000","last_unstale":"2024-09-17T05:28:46.654167+0000","last_undegraded":"2024-09-17T05:28:46.654167+0000","last_fullsized":"2024-09-17T05:28:46.654167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:00.756226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688170+0000","last_change":"2024-09-17T05:28:45.680508+0000","last_active":"2024-09-17T05:28:46.688170+0000","last_peered":"2024-09-17T05:28:46.688170+0000","last_clean":"2024-09-17T05:28:46.688170+0000","last_became_active":"2024-09-17T05:28:45.680228+0000","last_became_peered":"2024-09-17T05:28:45.680228+0000","last_unstale":"2024-09-17T05:28:46.688170+0000","last_undegraded":"2024-09-17T05:28:46.688170+0000","last_fullsized":"2024-09-17T05:28:46.688170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:00.494429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.661173+0000","last_change":"2024-09-17T05:28:44.659616+0000","last_active":"2024-09-17T05:28:46.661173+0000","last_peered":"2024-09-17T05:28:46.661173+0000","last_clean":"2024-09-17T05:28:46.661173+0000","last_became_active":"2024-09-17T05:28:44.659315+0000","last_became_peered":"2024-09-17T05:28:44.659315+0000","last_unstale":"2024-09-17T05:28:46.661173+0000","last_undegraded":"2024-09-17T05:28:46.661173+0000","last_fullsized":"2024-09-17T05:28:46.661173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:01.383128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659953+0000","last_change":"2024-09-17T05:28:45.667308+0000","last_active":"2024-09-17T05:28:46.659953+0000","last_peered":"2024-09-17T05:28:46.659953+0000","last_clean":"2024-09-17T05:28:46.659953+0000","last_became_active":"2024-09-17T05:28:45.665085+0000","last_became_peered":"2024-09-17T05:28:45.665085+0000","last_unstale":"2024-09-17T05:28:46.659953+0000","last_undegraded":"2024-09-17T05:28:46.659953+0000","last_fullsized":"2024-09-17T05:28:46.659953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:35.749778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688240+0000","last_change":"2024-09-17T05:28:44.664461+0000","last_active":"2024-09-17T05:28:46.688240+0000","last_peered":"2024-09-17T05:28:46.688240+0000","last_clean":"2024-09-17T05:28:46.688240+0000","last_became_active":"2024-09-17T05:28:44.663124+0000","last_became_peered":"2024-09-17T05:28:44.663124+0000","last_unstale":"2024-09-17T05:28:46.688240+0000","last_undegraded":"2024-09-17T05:28:46.688240+0000","last_fullsized":"2024-09-17T05:28:46.688240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:56.605556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660901+0000","last_change":"2024-09-17T05:28:45.673340+0000","last_active":"2024-09-17T05:28:46.660901+0000","last_peered":"2024-09-17T05:28:46.660901+0000","last_clean":"2024-09-17T05:28:46.660901+0000","last_became_active":"2024-09-17T05:28:45.673047+0000","last_became_peered":"2024-09-17T05:28:45.673047+0000","last_unstale":"2024-09-17T05:28:46.660901+0000","last_undegraded":"2024-09-17T05:28:46.660901+0000","last_fullsized":"2024-09-17T05:28:46.660901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:21.863500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863309+0000","last_change":"2024-09-17T05:28:44.668483+0000","last_active":"2024-09-17T05:28:46.863309+0000","last_peered":"2024-09-17T05:28:46.863309+0000","last_clean":"2024-09-17T05:28:46.863309+0000","last_became_active":"2024-09-17T05:28:44.668063+0000","last_became_peered":"2024-09-17T05:28:44.668063+0000","last_unstale":"2024-09-17T05:28:46.863309+0000","last_undegraded":"2024-09-17T05:28:46.863309+0000","last_fullsized":"2024-09-17T05:28:46.863309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:03.222463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688247+0000","last_change":"2024-09-17T05:28:45.666361+0000","last_active":"2024-09-17T05:28:46.688247+0000","last_peered":"2024-09-17T05:28:46.688247+0000","last_clean":"2024-09-17T05:28:46.688247+0000","last_became_active":"2024-09-17T05:28:45.666003+0000","last_became_peered":"2024-09-17T05:28:45.666003+0000","last_unstale":"2024-09-17T05:28:46.688247+0000","last_undegraded":"2024-09-17T05:28:46.688247+0000","last_fullsized":"2024-09-17T05:28:46.688247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:43.813385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688447+0000","last_change":"2024-09-17T05:28:44.663175+0000","last_active":"2024-09-17T05:28:46.688447+0000","last_peered":"2024-09-17T05:28:46.688447+0000","last_clean":"2024-09-17T05:28:46.688447+0000","last_became_active":"2024-09-17T05:28:44.662839+0000","last_became_peered":"2024-09-17T05:28:44.662839+0000","last_unstale":"2024-09-17T05:28:46.688447+0000","last_undegraded":"2024-09-17T05:28:46.688447+0000","last_fullsized":"2024-09-17T05:28:46.688447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:14.858019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862188+0000","last_change":"2024-09-17T05:28:45.683844+0000","last_active":"2024-09-17T05:28:46.862188+0000","last_peered":"2024-09-17T05:28:46.862188+0000","last_clean":"2024-09-17T05:28:46.862188+0000","last_became_active":"2024-09-17T05:28:45.683527+0000","last_became_peered":"2024-09-17T05:28:45.683527+0000","last_unstale":"2024-09-17T05:28:46.862188+0000","last_undegraded":"2024-09-17T05:28:46.862188+0000","last_fullsized":"2024-09-17T05:28:46.862188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:11.277486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692809+0000","last_change":"2024-09-17T05:28:44.671021+0000","last_active":"2024-09-17T05:28:46.692809+0000","last_peered":"2024-09-17T05:28:46.692809+0000","last_clean":"2024-09-17T05:28:46.692809+0000","last_became_active":"2024-09-17T05:28:44.666107+0000","last_became_peered":"2024-09-17T05:28:44.666107+0000","last_unstale":"2024-09-17T05:28:46.692809+0000","last_undegraded":"2024-09-17T05:28:46.692809+0000","last_fullsized":"2024-09-17T05:28:46.692809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:57.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862563+0000","last_change":"2024-09-17T05:28:45.669543+0000","last_active":"2024-09-17T05:28:46.862563+0000","last_peered":"2024-09-17T05:28:46.862563+0000","last_clean":"2024-09-17T05:28:46.862563+0000","last_became_active":"2024-09-17T05:28:45.669258+0000","last_became_peered":"2024-09-17T05:28:45.669258+0000","last_unstale":"2024-09-17T05:28:46.862563+0000","last_undegraded":"2024-09-17T05:28:46.862563+0000","last_fullsized":"2024-09-17T05:28:46.862563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:29.130107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862503+0000","last_change":"2024-09-17T05:28:44.669157+0000","last_active":"2024-09-17T05:28:46.862503+0000","last_peered":"2024-09-17T05:28:46.862503+0000","last_clean":"2024-09-17T05:28:46.862503+0000","last_became_active":"2024-09-17T05:28:44.668464+0000","last_became_peered":"2024-09-17T05:28:44.668464+0000","last_unstale":"2024-09-17T05:28:46.862503+0000","last_undegraded":"2024-09-17T05:28:46.862503+0000","last_fullsized":"2024-09-17T05:28:46.862503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:27.326210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.659841+0000","last_change":"2024-09-17T05:28:45.667885+0000","last_active":"2024-09-17T05:28:46.659841+0000","last_peered":"2024-09-17T05:28:46.659841+0000","last_clean":"2024-09-17T05:28:46.659841+0000","last_became_active":"2024-09-17T05:28:45.666920+0000","last_became_peered":"2024-09-17T05:28:45.666920+0000","last_unstale":"2024-09-17T05:28:46.659841+0000","last_undegraded":"2024-09-17T05:28:46.659841+0000","last_fullsized":"2024-09-17T05:28:46.659841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:25.665870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688240+0000","last_change":"2024-09-17T05:28:44.665516+0000","last_active":"2024-09-17T05:28:46.688240+0000","last_peered":"2024-09-17T05:28:46.688240+0000","last_clean":"2024-09-17T05:28:46.688240+0000","last_became_active":"2024-09-17T05:28:44.665205+0000","last_became_peered":"2024-09-17T05:28:44.665205+0000","last_unstale":"2024-09-17T05:28:46.688240+0000","last_undegraded":"2024-09-17T05:28:46.688240+0000","last_fullsized":"2024-09-17T05:28:46.688240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:57.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861431+0000","last_change":"2024-09-17T05:28:45.674698+0000","last_active":"2024-09-17T05:28:46.861431+0000","last_peered":"2024-09-17T05:28:46.861431+0000","last_clean":"2024-09-17T05:28:46.861431+0000","last_became_active":"2024-09-17T05:28:45.671117+0000","last_became_peered":"2024-09-17T05:28:45.671117+0000","last_unstale":"2024-09-17T05:28:46.861431+0000","last_undegraded":"2024-09-17T05:28:46.861431+0000","last_fullsized":"2024-09-17T05:28:46.861431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:34.701781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.688163+0000","last_change":"2024-09-17T05:28:44.662000+0000","last_active":"2024-09-17T05:28:46.688163+0000","last_peered":"2024-09-17T05:28:46.688163+0000","last_clean":"2024-09-17T05:28:46.688163+0000","last_became_active":"2024-09-17T05:28:44.661699+0000","last_became_peered":"2024-09-17T05:28:44.661699+0000","last_unstale":"2024-09-17T05:28:46.688163+0000","last_undegraded":"2024-09-17T05:28:46.688163+0000","last_fullsized":"2024-09-17T05:28:46.688163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:57.978737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861824+0000","last_change":"2024-09-17T05:28:45.682448+0000","last_active":"2024-09-17T05:28:46.861824+0000","last_peered":"2024-09-17T05:28:46.861824+0000","last_clean":"2024-09-17T05:28:46.861824+0000","last_became_active":"2024-09-17T05:28:45.682109+0000","last_became_peered":"2024-09-17T05:28:45.682109+0000","last_unstale":"2024-09-17T05:28:46.861824+0000","last_undegraded":"2024-09-17T05:28:46.861824+0000","last_fullsized":"2024-09-17T05:28:46.861824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:44.301995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863028+0000","last_change":"2024-09-17T05:28:44.668065+0000","last_active":"2024-09-17T05:28:46.863028+0000","last_peered":"2024-09-17T05:28:46.863028+0000","last_clean":"2024-09-17T05:28:46.863028+0000","last_became_active":"2024-09-17T05:28:44.667735+0000","last_became_peered":"2024-09-17T05:28:44.667735+0000","last_unstale":"2024-09-17T05:28:46.863028+0000","last_undegraded":"2024-09-17T05:28:46.863028+0000","last_fullsized":"2024-09-17T05:28:46.863028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:28.072242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.692822+0000","last_change":"2024-09-17T05:28:45.688653+0000","last_active":"2024-09-17T05:28:46.692822+0000","last_peered":"2024-09-17T05:28:46.692822+0000","last_clean":"2024-09-17T05:28:46.692822+0000","last_became_active":"2024-09-17T05:28:45.687995+0000","last_became_peered":"2024-09-17T05:28:45.687995+0000","last_unstale":"2024-09-17T05:28:46.692822+0000","last_undegraded":"2024-09-17T05:28:46.692822+0000","last_fullsized":"2024-09-17T05:28:46.692822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:00.494429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660675+0000","last_change":"2024-09-17T05:28:45.674640+0000","last_active":"2024-09-17T05:28:46.660675+0000","last_peered":"2024-09-17T05:28:46.660675+0000","last_clean":"2024-09-17T05:28:46.660675+0000","last_became_active":"2024-09-17T05:28:45.674375+0000","last_became_peered":"2024-09-17T05:28:45.674375+0000","last_unstale":"2024-09-17T05:28:46.660675+0000","last_undegraded":"2024-09-17T05:28:46.660675+0000","last_fullsized":"2024-09-17T05:28:46.660675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:48.986140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862772+0000","last_change":"2024-09-17T05:28:44.668500+0000","last_active":"2024-09-17T05:28:46.862772+0000","last_peered":"2024-09-17T05:28:46.862772+0000","last_clean":"2024-09-17T05:28:46.862772+0000","last_became_active":"2024-09-17T05:28:44.668171+0000","last_became_peered":"2024-09-17T05:28:44.668171+0000","last_unstale":"2024-09-17T05:28:46.862772+0000","last_undegraded":"2024-09-17T05:28:46.862772+0000","last_fullsized":"2024-09-17T05:28:46.862772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:05.964906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.660309+0000","last_change":"2024-09-17T05:28:45.675119+0000","last_active":"2024-09-17T05:28:46.660309+0000","last_peered":"2024-09-17T05:28:46.660309+0000","last_clean":"2024-09-17T05:28:46.660309+0000","last_became_active":"2024-09-17T05:28:45.674840+0000","last_became_peered":"2024-09-17T05:28:45.674840+0000","last_unstale":"2024-09-17T05:28:46.660309+0000","last_undegraded":"2024-09-17T05:28:46.660309+0000","last_fullsized":"2024-09-17T05:28:46.660309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:26.709674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.863195+0000","last_change":"2024-09-17T05:28:44.671103+0000","last_active":"2024-09-17T05:28:46.863195+0000","last_peered":"2024-09-17T05:28:46.863195+0000","last_clean":"2024-09-17T05:28:46.863195+0000","last_became_active":"2024-09-17T05:28:44.670755+0000","last_became_peered":"2024-09-17T05:28:44.670755+0000","last_unstale":"2024-09-17T05:28:46.863195+0000","last_undegraded":"2024-09-17T05:28:46.863195+0000","last_fullsized":"2024-09-17T05:28:46.863195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:14.858019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862459+0000","last_change":"2024-09-17T05:28:45.677087+0000","last_active":"2024-09-17T05:28:46.862459+0000","last_peered":"2024-09-17T05:28:46.862459+0000","last_clean":"2024-09-17T05:28:46.862459+0000","last_became_active":"2024-09-17T05:28:45.676750+0000","last_became_peered":"2024-09-17T05:28:45.676750+0000","last_unstale":"2024-09-17T05:28:46.862459+0000","last_undegraded":"2024-09-17T05:28:46.862459+0000","last_fullsized":"2024-09-17T05:28:46.862459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:14.581812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862014+0000","last_change":"2024-09-17T05:28:44.654538+0000","last_active":"2024-09-17T05:28:46.862014+0000","last_peered":"2024-09-17T05:28:46.862014+0000","last_clean":"2024-09-17T05:28:46.862014+0000","last_became_active":"2024-09-17T05:28:44.654264+0000","last_became_peered":"2024-09-17T05:28:44.654264+0000","last_unstale":"2024-09-17T05:28:46.862014+0000","last_undegraded":"2024-09-17T05:28:46.862014+0000","last_fullsized":"2024-09-17T05:28:46.862014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:57.572825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.861779+0000","last_change":"2024-09-17T05:28:45.697637+0000","last_active":"2024-09-17T05:28:46.861779+0000","last_peered":"2024-09-17T05:28:46.861779+0000","last_clean":"2024-09-17T05:28:46.861779+0000","last_became_active":"2024-09-17T05:28:45.697328+0000","last_became_peered":"2024-09-17T05:28:45.697328+0000","last_unstale":"2024-09-17T05:28:46.861779+0000","last_undegraded":"2024-09-17T05:28:46.861779+0000","last_fullsized":"2024-09-17T05:28:46.861779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:44.631618+0000","last_clean_scrub_stamp":"2024-09-17T05:28:44.631618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:44.608081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:28:46.862559+0000","last_change":"2024-09-17T05:28:44.666526+0000","last_active":"2024-09-17T05:28:46.862559+0000","last_peered":"2024-09-17T05:28:46.862559+0000","last_clean":"2024-09-17T05:28:46.862559+0000","last_became_active":"2024-09-17T05:28:44.666209+0000","last_became_peered":"2024-09-17T05:28:44.666209+0000","last_unstale":"2024-09-17T05:28:46.862559+0000","last_undegraded":"2024-09-17T05:28:46.862559+0000","last_fullsized":"2024-09-17T05:28:46.862559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:43.621484+0000","last_clean_scrub_stamp":"2024-09-17T05:28:43.621484+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:50.431079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":663137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":72313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":72187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":72347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":815104,"data_stored":663193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:29:00.016 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:29:00.016 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T05:29:00.017 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T05:29:00.017 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T05:29:00.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.197+0000 7f7265800640 1 -- 172.21.15.31:0/2410459716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f726015e220 msgr2=0x7f72600cfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:00.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.197+0000 7f7265800640 1 --2- 172.21.15.31:0/2410459716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f726015e220 0x7f72600cfcb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7250005fd0 tx=0x7f725001c790 comp rx=0 tx=0).stop 2024-09-17T05:29:00.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.197+0000 7f7265800640 1 -- 172.21.15.31:0/2410459716 shutdown_connections 2024-09-17T05:29:00.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.197+0000 7f7265800640 1 --2- 172.21.15.31:0/2410459716 >> v2:172.21.15.155:3300/0 conn(0x7f72600d11d0 0x7f72600b6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.197+0000 7f7265800640 1 --2- 172.21.15.31:0/2410459716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f726015e220 0x7f72600cfcb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.197+0000 7f7265800640 1 -- 172.21.15.31:0/2410459716 >> 172.21.15.31:0/2410459716 conn(0x7f72600d40b0 msgr2=0x7f72600d44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:00.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.197+0000 7f7265800640 1 -- 172.21.15.31:0/2410459716 shutdown_connections 2024-09-17T05:29:00.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.197+0000 7f7265800640 1 -- 172.21.15.31:0/2410459716 wait complete. 2024-09-17T05:29:00.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.197+0000 7f7265800640 1 Processor -- start 2024-09-17T05:29:00.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.197+0000 7f7265800640 1 -- start start 2024-09-17T05:29:00.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.197+0000 7f7265800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72600d11d0 0x7f726014fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:00.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.197+0000 7f7265800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72600d4bd0 0x7f7260159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:00.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.197+0000 7f7265800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f726015e220 0x7f7260159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:00.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.197+0000 7f7265800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f726016b880 con 0x7f726015e220 2024-09-17T05:29:00.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.197+0000 7f7265800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f726016b700 con 0x7f72600d11d0 2024-09-17T05:29:00.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.197+0000 7f7265800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f726016ba00 con 0x7f72600d4bd0 2024-09-17T05:29:00.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.201+0000 7f725f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f726015e220 0x7f7260159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:00.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.201+0000 7f725f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f726015e220 0x7f7260159d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59658/0 (socket says 172.21.15.31:59658) 2024-09-17T05:29:00.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.201+0000 7f725f400640 1 -- 172.21.15.31:0/312695075 learned_addr learned my addr 172.21.15.31:0/312695075 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:00.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.201+0000 7f7257e00640 1 --2- 172.21.15.31:0/312695075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72600d4bd0 0x7f7260159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:00.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.201+0000 7f725ea00640 1 --2- 172.21.15.31:0/312695075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72600d11d0 0x7f726014fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:00.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.201+0000 7f725f400640 1 -- 172.21.15.31:0/312695075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72600d4bd0 msgr2=0x7f7260159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:00.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.201+0000 7f725f400640 1 --2- 172.21.15.31:0/312695075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72600d4bd0 0x7f7260159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.201+0000 7f725f400640 1 -- 172.21.15.31:0/312695075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72600d11d0 msgr2=0x7f726014fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:00.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.201+0000 7f725f400640 1 --2- 172.21.15.31:0/312695075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72600d11d0 0x7f726014fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.201+0000 7f725f400640 1 -- 172.21.15.31:0/312695075 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726015e7b0 con 0x7f726015e220 2024-09-17T05:29:00.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.201+0000 7f725f400640 1 --2- 172.21.15.31:0/312695075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f726015e220 0x7f7260159d60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f725800efd0 tx=0x7f725800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:00.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.201+0000 7f7256a00640 1 -- 172.21.15.31:0/312695075 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7258003b80 con 0x7f726015e220 2024-09-17T05:29:00.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.201+0000 7f7256a00640 1 -- 172.21.15.31:0/312695075 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7258003e10 con 0x7f726015e220 2024-09-17T05:29:00.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.201+0000 7f7265800640 1 -- 172.21.15.31:0/312695075 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726015ea90 con 0x7f726015e220 2024-09-17T05:29:00.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.201+0000 7f7256a00640 1 -- 172.21.15.31:0/312695075 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7258004280 con 0x7f726015e220 2024-09-17T05:29:00.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.201+0000 7f7265800640 1 -- 172.21.15.31:0/312695075 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726015f050 con 0x7f726015e220 2024-09-17T05:29:00.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.201+0000 7f7265800640 1 -- 172.21.15.31:0/312695075 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72600b6f00 con 0x7f726015e220 2024-09-17T05:29:00.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.201+0000 7f7256a00640 1 -- 172.21.15.31:0/312695075 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7258004420 con 0x7f726015e220 2024-09-17T05:29:00.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.205+0000 7f7256a00640 1 --2- 172.21.15.31:0/312695075 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f723c073200 0x7f723c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:00.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.205+0000 7f7256a00640 1 -- 172.21.15.31:0/312695075 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7258094fe0 con 0x7f726015e220 2024-09-17T05:29:00.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.205+0000 7f725ea00640 1 --2- 172.21.15.31:0/312695075 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f723c073200 0x7f723c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:00.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.205+0000 7f725ea00640 1 --2- 172.21.15.31:0/312695075 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f723c073200 0x7f723c0756c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f72500ae000 tx=0x7f725001afd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:00.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.209+0000 7f7256a00640 1 -- 172.21.15.31:0/312695075 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f725805f9a0 con 0x7f726015e220 2024-09-17T05:29:00.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.417+0000 7f7265800640 1 -- 172.21.15.31:0/312695075 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f72600d08a0 con 0x7f726015e220 2024-09-17T05:29:00.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.421+0000 7f7256a00640 1 -- 172.21.15.31:0/312695075 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f72580643d0 con 0x7f726015e220 2024-09-17T05:29:00.424 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:00.425 INFO:teuthology.orchestra.run.smithi031.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T05:29:00.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.421+0000 7f7265800640 1 -- 172.21.15.31:0/312695075 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f723c073200 msgr2=0x7f723c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:00.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.421+0000 7f7265800640 1 --2- 172.21.15.31:0/312695075 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f723c073200 0x7f723c0756c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f72500ae000 tx=0x7f725001afd0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.421+0000 7f7265800640 1 -- 172.21.15.31:0/312695075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f726015e220 msgr2=0x7f7260159d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:00.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.421+0000 7f7265800640 1 --2- 172.21.15.31:0/312695075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f726015e220 0x7f7260159d60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f725800efd0 tx=0x7f725800c6a0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.421+0000 7f7265800640 1 -- 172.21.15.31:0/312695075 shutdown_connections 2024-09-17T05:29:00.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.421+0000 7f7265800640 1 --2- 172.21.15.31:0/312695075 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f723c073200 0x7f723c0756c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.421+0000 7f7265800640 1 --2- 172.21.15.31:0/312695075 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f726015e220 0x7f7260159d60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.421+0000 7f7265800640 1 --2- 172.21.15.31:0/312695075 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72600d4bd0 0x7f7260159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.421+0000 7f7265800640 1 --2- 172.21.15.31:0/312695075 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72600d11d0 0x7f726014fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.421+0000 7f7265800640 1 -- 172.21.15.31:0/312695075 >> 172.21.15.31:0/312695075 conn(0x7f72600d40b0 msgr2=0x7f72600b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:00.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.421+0000 7f7265800640 1 -- 172.21.15.31:0/312695075 shutdown_connections 2024-09-17T05:29:00.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.421+0000 7f7265800640 1 -- 172.21.15.31:0/312695075 wait complete. 2024-09-17T05:29:00.445 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T05:29:00.446 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:29:00.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938ec00640 1 -- 172.21.15.31:0/2292490696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93880cdb30 msgr2=0x7f93880cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:00.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938ec00640 1 --2- 172.21.15.31:0/2292490696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93880cdb30 0x7f93880cebb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9370009840 tx=0x7f937001c820 comp rx=0 tx=0).stop 2024-09-17T05:29:00.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938ec00640 1 -- 172.21.15.31:0/2292490696 shutdown_connections 2024-09-17T05:29:00.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938ec00640 1 --2- 172.21.15.31:0/2292490696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93880cdb30 0x7f93880cebb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938ec00640 1 --2- 172.21.15.31:0/2292490696 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f938815bea0 0x7f93880ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938ec00640 1 -- 172.21.15.31:0/2292490696 >> 172.21.15.31:0/2292490696 conn(0x7f93880d1dc0 msgr2=0x7f93880d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:00.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938ec00640 1 -- 172.21.15.31:0/2292490696 shutdown_connections 2024-09-17T05:29:00.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938ec00640 1 -- 172.21.15.31:0/2292490696 wait complete. 2024-09-17T05:29:00.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938ec00640 1 Processor -- start 2024-09-17T05:29:00.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938ec00640 1 -- start start 2024-09-17T05:29:00.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938ec00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93880cdb30 0x7f93880b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:00.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938ec00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93880d28e0 0x7f938814a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:00.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938ec00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f938815bea0 0x7f9388071d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:00.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938ec00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9388168f10 con 0x7f938815bea0 2024-09-17T05:29:00.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938ec00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9388168d90 con 0x7f93880d28e0 2024-09-17T05:29:00.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938ec00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9388169090 con 0x7f93880cdb30 2024-09-17T05:29:00.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f938815bea0 0x7f9388071d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:00.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f938815bea0 0x7f9388071d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59690/0 (socket says 172.21.15.31:59690) 2024-09-17T05:29:00.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f938cc00640 1 -- 172.21.15.31:0/1231256920 learned_addr learned my addr 172.21.15.31:0/1231256920 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:00.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f937fe00640 1 --2- 172.21.15.31:0/1231256920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93880d28e0 0x7f938814a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:00.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.589+0000 7f9387e00640 1 --2- 172.21.15.31:0/1231256920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93880cdb30 0x7f93880b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:00.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.593+0000 7f938cc00640 1 -- 172.21.15.31:0/1231256920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93880cdb30 msgr2=0x7f93880b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:00.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.593+0000 7f938cc00640 1 --2- 172.21.15.31:0/1231256920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93880cdb30 0x7f93880b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.593+0000 7f938cc00640 1 -- 172.21.15.31:0/1231256920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93880d28e0 msgr2=0x7f938814a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:00.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.593+0000 7f938cc00640 1 --2- 172.21.15.31:0/1231256920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93880d28e0 0x7f938814a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.593+0000 7f938cc00640 1 -- 172.21.15.31:0/1231256920 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93881fbe10 con 0x7f938815bea0 2024-09-17T05:29:00.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.593+0000 7f938cc00640 1 --2- 172.21.15.31:0/1231256920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f938815bea0 0x7f9388071d10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f938000cbf0 tx=0x7f938000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:00.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.593+0000 7f9384c00640 1 -- 172.21.15.31:0/1231256920 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9380016020 con 0x7f938815bea0 2024-09-17T05:29:00.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.593+0000 7f9384c00640 1 -- 172.21.15.31:0/1231256920 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f938000ab00 con 0x7f938815bea0 2024-09-17T05:29:00.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.593+0000 7f9384c00640 1 -- 172.21.15.31:0/1231256920 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9380012420 con 0x7f938815bea0 2024-09-17T05:29:00.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.593+0000 7f938ec00640 1 -- 172.21.15.31:0/1231256920 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93880b45e0 con 0x7f938815bea0 2024-09-17T05:29:00.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.593+0000 7f938ec00640 1 -- 172.21.15.31:0/1231256920 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93881fb330 con 0x7f938815bea0 2024-09-17T05:29:00.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.593+0000 7f938ec00640 1 -- 172.21.15.31:0/1231256920 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93880cc9d0 con 0x7f938815bea0 2024-09-17T05:29:00.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.593+0000 7f9384c00640 1 -- 172.21.15.31:0/1231256920 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9380019020 con 0x7f938815bea0 2024-09-17T05:29:00.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.597+0000 7f9384c00640 1 --2- 172.21.15.31:0/1231256920 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9364073200 0x7f93640756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:00.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.597+0000 7f9384c00640 1 -- 172.21.15.31:0/1231256920 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9380094410 con 0x7f938815bea0 2024-09-17T05:29:00.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.597+0000 7f9387e00640 1 --2- 172.21.15.31:0/1231256920 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9364073200 0x7f93640756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:00.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.597+0000 7f9387e00640 1 --2- 172.21.15.31:0/1231256920 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9364073200 0x7f93640756c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f937800bb50 tx=0x7f937800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:00.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.597+0000 7f9384c00640 1 -- 172.21.15.31:0/1231256920 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9380020020 con 0x7f938815bea0 2024-09-17T05:29:00.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.813+0000 7f938ec00640 1 -- 172.21.15.31:0/1231256920 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93880b0570 con 0x7f938815bea0 2024-09-17T05:29:00.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.813+0000 7f9384c00640 1 -- 172.21.15.31:0/1231256920 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7f938005edd0 con 0x7f938815bea0 2024-09-17T05:29:00.819 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:00.819 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"btime":"2024-09-17T05:28:48:676550+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/3491154284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3491154284},{"type":"v1","addr":"172.21.15.155:6836","nonce":3491154284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4301,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3619522478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3619522478},{"type":"v1","addr":"172.21.15.155:6837","nonce":3619522478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/851893415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":851893415},{"type":"v1","addr":"172.21.15.31:6834","nonce":851893415}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:28:45.059391+0000","modified":"2024-09-17T05:28:48.082624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4380":{"gid":4380,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3393035146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3393035146},{"type":"v1","addr":"172.21.15.31:6835","nonce":3393035146}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4380,"qdb_cluster":[4380]},"id":1}]} 2024-09-17T05:29:00.821 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-09-17T05:29:00.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.817+0000 7f938ec00640 1 -- 172.21.15.31:0/1231256920 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9364073200 msgr2=0x7f93640756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:00.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.817+0000 7f938ec00640 1 --2- 172.21.15.31:0/1231256920 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9364073200 0x7f93640756c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f937800bb50 tx=0x7f937800b2e0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.817+0000 7f938ec00640 1 -- 172.21.15.31:0/1231256920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f938815bea0 msgr2=0x7f9388071d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:00.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.817+0000 7f938ec00640 1 --2- 172.21.15.31:0/1231256920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f938815bea0 0x7f9388071d10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f938000cbf0 tx=0x7f938000cce0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.817+0000 7f938ec00640 1 -- 172.21.15.31:0/1231256920 shutdown_connections 2024-09-17T05:29:00.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.817+0000 7f938ec00640 1 --2- 172.21.15.31:0/1231256920 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9364073200 0x7f93640756c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.817+0000 7f938ec00640 1 --2- 172.21.15.31:0/1231256920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f938815bea0 0x7f9388071d10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.817+0000 7f938ec00640 1 --2- 172.21.15.31:0/1231256920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93880d28e0 0x7f938814a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.817+0000 7f938ec00640 1 --2- 172.21.15.31:0/1231256920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93880cdb30 0x7f93880b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.817+0000 7f938ec00640 1 -- 172.21.15.31:0/1231256920 >> 172.21.15.31:0/1231256920 conn(0x7f93880d1dc0 msgr2=0x7f93880b6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:00.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.817+0000 7f938ec00640 1 -- 172.21.15.31:0/1231256920 shutdown_connections 2024-09-17T05:29:00.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.817+0000 7f938ec00640 1 -- 172.21.15.31:0/1231256920 wait complete. 2024-09-17T05:29:00.840 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:29:00.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.981+0000 7f6169000640 1 -- 172.21.15.31:0/2797621568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6164163910 msgr2=0x7f6164165d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:00.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.981+0000 7f6169000640 1 --2- 172.21.15.31:0/2797621568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6164163910 0x7f6164165d00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f615c009c80 tx=0x7f615c01cda0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.981+0000 7f6169000640 1 -- 172.21.15.31:0/2797621568 shutdown_connections 2024-09-17T05:29:00.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.981+0000 7f6169000640 1 --2- 172.21.15.31:0/2797621568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6164163910 0x7f6164165d00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.981+0000 7f6169000640 1 -- 172.21.15.31:0/2797621568 >> 172.21.15.31:0/2797621568 conn(0x7f61640d0c90 msgr2=0x7f61640d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:00.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.981+0000 7f6169000640 1 -- 172.21.15.31:0/2797621568 shutdown_connections 2024-09-17T05:29:00.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.981+0000 7f6169000640 1 -- 172.21.15.31:0/2797621568 wait complete. 2024-09-17T05:29:00.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6169000640 1 Processor -- start 2024-09-17T05:29:00.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6169000640 1 -- start start 2024-09-17T05:29:00.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6169000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61640cffc0 0x7f61641560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:00.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6169000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f616415af60 0x7f61641f71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:00.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6169000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6164163910 0x7f61641f7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:00.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6169000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6164168df0 con 0x7f61640cffc0 2024-09-17T05:29:00.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6169000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6164168c70 con 0x7f6164163910 2024-09-17T05:29:00.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6169000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6164168f70 con 0x7f616415af60 2024-09-17T05:29:00.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6161e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61640cffc0 0x7f61641560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:00.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6161e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61640cffc0 0x7f61641560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59702/0 (socket says 172.21.15.31:59702) 2024-09-17T05:29:00.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6161e00640 1 -- 172.21.15.31:0/3677266897 learned_addr learned my addr 172.21.15.31:0/3677266897 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:00.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6162800640 1 --2- 172.21.15.31:0/3677266897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6164163910 0x7f61641f7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:00.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6161e00640 1 -- 172.21.15.31:0/3677266897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f616415af60 msgr2=0x7f61641f71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:00.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6161e00640 1 --2- 172.21.15.31:0/3677266897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f616415af60 0x7f61641f71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6161e00640 1 -- 172.21.15.31:0/3677266897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6164163910 msgr2=0x7f61641f7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:00.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6161e00640 1 --2- 172.21.15.31:0/3677266897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6164163910 0x7f61641f7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:00.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6161e00640 1 -- 172.21.15.31:0/3677266897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61640cf850 con 0x7f61640cffc0 2024-09-17T05:29:00.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6162800640 1 --2- 172.21.15.31:0/3677266897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6164163910 0x7f61641f7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:29:00.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6161e00640 1 --2- 172.21.15.31:0/3677266897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61640cffc0 0x7f61641560d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f615400c420 tx=0x7f615400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:00.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f615a000640 1 -- 172.21.15.31:0/3677266897 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6154017070 con 0x7f61640cffc0 2024-09-17T05:29:00.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f615a000640 1 -- 172.21.15.31:0/3677266897 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6154003600 con 0x7f61640cffc0 2024-09-17T05:29:00.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f615a000640 1 -- 172.21.15.31:0/3677266897 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6154003a90 con 0x7f61640cffc0 2024-09-17T05:29:00.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6169000640 1 -- 172.21.15.31:0/3677266897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6164165c80 con 0x7f61640cffc0 2024-09-17T05:29:00.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.985+0000 7f6169000640 1 -- 172.21.15.31:0/3677266897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f616409f230 con 0x7f61640cffc0 2024-09-17T05:29:00.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.989+0000 7f6169000640 1 -- 172.21.15.31:0/3677266897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61640737c0 con 0x7f61640cffc0 2024-09-17T05:29:00.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.989+0000 7f615a000640 1 -- 172.21.15.31:0/3677266897 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f615401a070 con 0x7f61640cffc0 2024-09-17T05:29:00.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.989+0000 7f615a000640 1 --2- 172.21.15.31:0/3677266897 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6140073230 0x7f61400756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:00.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.989+0000 7f615a000640 1 -- 172.21.15.31:0/3677266897 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f61540934f0 con 0x7f61640cffc0 2024-09-17T05:29:00.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.989+0000 7f615be00640 1 --2- 172.21.15.31:0/3677266897 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6140073230 0x7f61400756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:00.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.989+0000 7f615be00640 1 --2- 172.21.15.31:0/3677266897 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6140073230 0x7f61400756f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f614c007fd0 tx=0x7f614c007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:00.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:00.993+0000 7f615a000640 1 -- 172.21.15.31:0/3677266897 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f615405e590 con 0x7f61640cffc0 2024-09-17T05:29:01.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.201+0000 7f6169000640 1 -- 172.21.15.31:0/3677266897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6164164700 con 0x7f61640cffc0 2024-09-17T05:29:01.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.201+0000 7f615a000640 1 -- 172.21.15.31:0/3677266897 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7f615405de90 con 0x7f61640cffc0 2024-09-17T05:29:01.207 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:01.207 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"btime":"2024-09-17T05:28:48:676550+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/3491154284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3491154284},{"type":"v1","addr":"172.21.15.155:6836","nonce":3491154284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4301,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3619522478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3619522478},{"type":"v1","addr":"172.21.15.155:6837","nonce":3619522478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/851893415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":851893415},{"type":"v1","addr":"172.21.15.31:6834","nonce":851893415}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:28:45.059391+0000","modified":"2024-09-17T05:28:48.082624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4380":{"gid":4380,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3393035146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3393035146},{"type":"v1","addr":"172.21.15.31:6835","nonce":3393035146}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4380,"qdb_cluster":[4380]},"id":1}]} 2024-09-17T05:29:01.208 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-09-17T05:29:01.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.205+0000 7f6169000640 1 -- 172.21.15.31:0/3677266897 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6140073230 msgr2=0x7f61400756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:01.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.205+0000 7f6169000640 1 --2- 172.21.15.31:0/3677266897 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6140073230 0x7f61400756f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f614c007fd0 tx=0x7f614c007980 comp rx=0 tx=0).stop 2024-09-17T05:29:01.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.205+0000 7f6169000640 1 -- 172.21.15.31:0/3677266897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61640cffc0 msgr2=0x7f61641560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:01.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.205+0000 7f6169000640 1 --2- 172.21.15.31:0/3677266897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61640cffc0 0x7f61641560d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f615400c420 tx=0x7f615400c8e0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.205+0000 7f6169000640 1 -- 172.21.15.31:0/3677266897 shutdown_connections 2024-09-17T05:29:01.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.205+0000 7f6169000640 1 --2- 172.21.15.31:0/3677266897 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6140073230 0x7f61400756f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.205+0000 7f6169000640 1 --2- 172.21.15.31:0/3677266897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6164163910 0x7f61641f7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.205+0000 7f6169000640 1 --2- 172.21.15.31:0/3677266897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f616415af60 0x7f61641f71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.205+0000 7f6169000640 1 --2- 172.21.15.31:0/3677266897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61640cffc0 0x7f61641560d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.205+0000 7f6169000640 1 -- 172.21.15.31:0/3677266897 >> 172.21.15.31:0/3677266897 conn(0x7f61640d0c90 msgr2=0x7f6164158440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:01.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.205+0000 7f6169000640 1 -- 172.21.15.31:0/3677266897 shutdown_connections 2024-09-17T05:29:01.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.205+0000 7f6169000640 1 -- 172.21.15.31:0/3677266897 wait complete. 2024-09-17T05:29:01.229 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:29:01.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f72c00640 1 -- 172.21.15.31:0/3037722094 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f6c15bea0 msgr2=0x7f8f6c0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:01.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f72c00640 1 --2- 172.21.15.31:0/3037722094 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f6c15bea0 0x7f8f6c0ce670 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009870 tx=0x7f8f5c01c780 comp rx=0 tx=0).stop 2024-09-17T05:29:01.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f72c00640 1 -- 172.21.15.31:0/3037722094 shutdown_connections 2024-09-17T05:29:01.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f72c00640 1 --2- 172.21.15.31:0/3037722094 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f6c15bea0 0x7f8f6c0ce670 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f72c00640 1 -- 172.21.15.31:0/3037722094 >> 172.21.15.31:0/3037722094 conn(0x7f8f6c0d1dc0 msgr2=0x7f8f6c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:01.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f72c00640 1 -- 172.21.15.31:0/3037722094 shutdown_connections 2024-09-17T05:29:01.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f72c00640 1 -- 172.21.15.31:0/3037722094 wait complete. 2024-09-17T05:29:01.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f72c00640 1 Processor -- start 2024-09-17T05:29:01.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f72c00640 1 -- start start 2024-09-17T05:29:01.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f72c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f6c0cdb30 0x7f8f6c0b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:01.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f72c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f6c0d28e0 0x7f8f6c0c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:01.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f72c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f6c15bea0 0x7f8f6c1fb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:01.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f72c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6c16a930 con 0x7f8f6c0cdb30 2024-09-17T05:29:01.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f72c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6c16a7b0 con 0x7f8f6c15bea0 2024-09-17T05:29:01.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f72c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8f6c16aab0 con 0x7f8f6c0d28e0 2024-09-17T05:29:01.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f6be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f6c0cdb30 0x7f8f6c0b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:01.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f6be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f6c0cdb30 0x7f8f6c0b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59714/0 (socket says 172.21.15.31:59714) 2024-09-17T05:29:01.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f6be00640 1 -- 172.21.15.31:0/962047161 learned_addr learned my addr 172.21.15.31:0/962047161 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:01.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f63400640 1 --2- 172.21.15.31:0/962047161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f6c0d28e0 0x7f8f6c0c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:01.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f70c00640 1 --2- 172.21.15.31:0/962047161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f6c15bea0 0x7f8f6c1fb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:01.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f6be00640 1 -- 172.21.15.31:0/962047161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f6c0d28e0 msgr2=0x7f8f6c0c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:01.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f6be00640 1 --2- 172.21.15.31:0/962047161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f6c0d28e0 0x7f8f6c0c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f6be00640 1 -- 172.21.15.31:0/962047161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f6c15bea0 msgr2=0x7f8f6c1fb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:01.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f6be00640 1 --2- 172.21.15.31:0/962047161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f6c15bea0 0x7f8f6c1fb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.373+0000 7f8f6be00640 1 -- 172.21.15.31:0/962047161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f6c156e50 con 0x7f8f6c0cdb30 2024-09-17T05:29:01.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.377+0000 7f8f6be00640 1 --2- 172.21.15.31:0/962047161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f6c0cdb30 0x7f8f6c0b0d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c01cc60 tx=0x7f8f5c0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:01.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.377+0000 7f8f68c00640 1 -- 172.21.15.31:0/962047161 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c0be070 con 0x7f8f6c0cdb30 2024-09-17T05:29:01.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.377+0000 7f8f68c00640 1 -- 172.21.15.31:0/962047161 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f5c0a86d0 con 0x7f8f6c0cdb30 2024-09-17T05:29:01.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.377+0000 7f8f72c00640 1 -- 172.21.15.31:0/962047161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f6c158720 con 0x7f8f6c0cdb30 2024-09-17T05:29:01.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.377+0000 7f8f68c00640 1 -- 172.21.15.31:0/962047161 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c0a8ae0 con 0x7f8f6c0cdb30 2024-09-17T05:29:01.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.377+0000 7f8f72c00640 1 -- 172.21.15.31:0/962047161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f6c0b45f0 con 0x7f8f6c0cdb30 2024-09-17T05:29:01.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.377+0000 7f8f72c00640 1 -- 172.21.15.31:0/962047161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f6c0d24e0 con 0x7f8f6c0cdb30 2024-09-17T05:29:01.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.377+0000 7f8f68c00640 1 -- 172.21.15.31:0/962047161 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8f5c0c1070 con 0x7f8f6c0cdb30 2024-09-17T05:29:01.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.377+0000 7f8f68c00640 1 --2- 172.21.15.31:0/962047161 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8f48073200 0x7f8f480756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:01.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.377+0000 7f8f68c00640 1 -- 172.21.15.31:0/962047161 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8f5c12dff0 con 0x7f8f6c0cdb30 2024-09-17T05:29:01.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.377+0000 7f8f63400640 1 --2- 172.21.15.31:0/962047161 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8f48073200 0x7f8f480756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:01.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.381+0000 7f8f63400640 1 --2- 172.21.15.31:0/962047161 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8f48073200 0x7f8f480756c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0b12c0 tx=0x7f8f54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:01.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.381+0000 7f8f68c00640 1 -- 172.21.15.31:0/962047161 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8f6c156e50 con 0x7f8f6c0cdb30 2024-09-17T05:29:01.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.569+0000 7f8f72c00640 1 -- 172.21.15.31:0/962047161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f6c158970 con 0x7f8f6c0cdb30 2024-09-17T05:29:01.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.569+0000 7f8f68c00640 1 -- 172.21.15.31:0/962047161 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16689 (secure 0 0 0) 0x7f8f5c0ac030 con 0x7f8f6c0cdb30 2024-09-17T05:29:01.573 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:01.574 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":21,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:28:46.650201+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:28:42.906739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:28:44.023489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:29:01.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.573+0000 7f8f72c00640 1 -- 172.21.15.31:0/962047161 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8f48073200 msgr2=0x7f8f480756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:01.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.573+0000 7f8f72c00640 1 --2- 172.21.15.31:0/962047161 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8f48073200 0x7f8f480756c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0b12c0 tx=0x7f8f54009040 comp rx=0 tx=0).stop 2024-09-17T05:29:01.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.573+0000 7f8f72c00640 1 -- 172.21.15.31:0/962047161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f6c0cdb30 msgr2=0x7f8f6c0b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:01.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.573+0000 7f8f72c00640 1 --2- 172.21.15.31:0/962047161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f6c0cdb30 0x7f8f6c0b0d80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c01cc60 tx=0x7f8f5c0056d0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.573+0000 7f8f72c00640 1 -- 172.21.15.31:0/962047161 shutdown_connections 2024-09-17T05:29:01.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.573+0000 7f8f72c00640 1 --2- 172.21.15.31:0/962047161 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8f48073200 0x7f8f480756c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.573+0000 7f8f72c00640 1 --2- 172.21.15.31:0/962047161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f6c15bea0 0x7f8f6c1fb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.573+0000 7f8f72c00640 1 --2- 172.21.15.31:0/962047161 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f6c0d28e0 0x7f8f6c0c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.573+0000 7f8f72c00640 1 --2- 172.21.15.31:0/962047161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f6c0cdb30 0x7f8f6c0b0d80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.573+0000 7f8f72c00640 1 -- 172.21.15.31:0/962047161 >> 172.21.15.31:0/962047161 conn(0x7f8f6c0d1dc0 msgr2=0x7f8f6c0b7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:01.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.573+0000 7f8f72c00640 1 -- 172.21.15.31:0/962047161 shutdown_connections 2024-09-17T05:29:01.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.573+0000 7f8f72c00640 1 -- 172.21.15.31:0/962047161 wait complete. 2024-09-17T05:29:01.594 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:29:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.737+0000 7ff250400640 1 -- 172.21.15.31:0/890001902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff230004810 msgr2=0x7ff230004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.737+0000 7ff250400640 1 --2- 172.21.15.31:0/890001902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff230004810 0x7ff230004c90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff23400c2e0 tx=0x7ff23401f6e0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.737+0000 7ff250400640 1 -- 172.21.15.31:0/890001902 shutdown_connections 2024-09-17T05:29:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.737+0000 7ff250400640 1 --2- 172.21.15.31:0/890001902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff230004810 0x7ff230004c90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.737+0000 7ff250400640 1 -- 172.21.15.31:0/890001902 >> 172.21.15.31:0/890001902 conn(0x7ff2480b1f10 msgr2=0x7ff2480b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.737+0000 7ff250400640 1 -- 172.21.15.31:0/890001902 shutdown_connections 2024-09-17T05:29:01.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.737+0000 7ff250400640 1 -- 172.21.15.31:0/890001902 wait complete. 2024-09-17T05:29:01.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff250400640 1 Processor -- start 2024-09-17T05:29:01.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff250400640 1 -- start start 2024-09-17T05:29:01.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff250400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff230004810 0x7ff2480c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:01.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff250400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff248157080 0x7ff2480cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:01.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff250400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff24808c8d0 0x7ff248157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:01.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff250400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff248074710 con 0x7ff230004810 2024-09-17T05:29:01.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff250400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff248074590 con 0x7ff24808c8d0 2024-09-17T05:29:01.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff250400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff248074890 con 0x7ff248157080 2024-09-17T05:29:01.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff24da00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff230004810 0x7ff2480c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:01.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff24da00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff230004810 0x7ff2480c9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59724/0 (socket says 172.21.15.31:59724) 2024-09-17T05:29:01.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff24da00640 1 -- 172.21.15.31:0/2966255723 learned_addr learned my addr 172.21.15.31:0/2966255723 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:01.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff24d000640 1 --2- 172.21.15.31:0/2966255723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff248157080 0x7ff2480cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:01.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff24e400640 1 --2- 172.21.15.31:0/2966255723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff24808c8d0 0x7ff248157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:01.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff24da00640 1 -- 172.21.15.31:0/2966255723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff248157080 msgr2=0x7ff2480cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:01.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff24da00640 1 --2- 172.21.15.31:0/2966255723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff248157080 0x7ff2480cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff24da00640 1 -- 172.21.15.31:0/2966255723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff24808c8d0 msgr2=0x7ff248157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:01.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff24da00640 1 --2- 172.21.15.31:0/2966255723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff24808c8d0 0x7ff248157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff24da00640 1 -- 172.21.15.31:0/2966255723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2480c9b40 con 0x7ff230004810 2024-09-17T05:29:01.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.741+0000 7ff24da00640 1 --2- 172.21.15.31:0/2966255723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff230004810 0x7ff2480c9600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff23c011a10 tx=0x7ff23c011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:01.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.745+0000 7ff245600640 1 -- 172.21.15.31:0/2966255723 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c01e070 con 0x7ff230004810 2024-09-17T05:29:01.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.745+0000 7ff245600640 1 -- 172.21.15.31:0/2966255723 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff23c004460 con 0x7ff230004810 2024-09-17T05:29:01.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.745+0000 7ff245600640 1 -- 172.21.15.31:0/2966255723 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c00fc00 con 0x7ff230004810 2024-09-17T05:29:01.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.745+0000 7ff250400640 1 -- 172.21.15.31:0/2966255723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2480c9e10 con 0x7ff230004810 2024-09-17T05:29:01.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.745+0000 7ff250400640 1 -- 172.21.15.31:0/2966255723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff24808c0d0 con 0x7ff230004810 2024-09-17T05:29:01.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.745+0000 7ff250400640 1 -- 172.21.15.31:0/2966255723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff248068ce0 con 0x7ff230004810 2024-09-17T05:29:01.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.745+0000 7ff245600640 1 -- 172.21.15.31:0/2966255723 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff23c021070 con 0x7ff230004810 2024-09-17T05:29:01.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.749+0000 7ff245600640 1 --2- 172.21.15.31:0/2966255723 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff228073230 0x7ff2280756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:01.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.749+0000 7ff245600640 1 -- 172.21.15.31:0/2966255723 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff23c094b50 con 0x7ff230004810 2024-09-17T05:29:01.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.749+0000 7ff24d000640 1 --2- 172.21.15.31:0/2966255723 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff228073230 0x7ff2280756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:01.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.749+0000 7ff24d000640 1 --2- 172.21.15.31:0/2966255723 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff228073230 0x7ff2280756f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff2340b0000 tx=0x7ff23401c520 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:01.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.753+0000 7ff245600640 1 -- 172.21.15.31:0/2966255723 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff23c05f5a0 con 0x7ff230004810 2024-09-17T05:29:01.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.965+0000 7ff250400640 1 -- 172.21.15.31:0/2966255723 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2480ca330 con 0x7ff230004810 2024-09-17T05:29:01.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.965+0000 7ff245600640 1 -- 172.21.15.31:0/2966255723 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7ff23c063fd0 con 0x7ff230004810 2024-09-17T05:29:01.970 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:01.970 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"btime":"2024-09-17T05:28:48:676550+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/3491154284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3491154284},{"type":"v1","addr":"172.21.15.155:6836","nonce":3491154284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4301,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3619522478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3619522478},{"type":"v1","addr":"172.21.15.155:6837","nonce":3619522478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/851893415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":851893415},{"type":"v1","addr":"172.21.15.31:6834","nonce":851893415}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:28:45.059391+0000","modified":"2024-09-17T05:28:48.082624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4380":{"gid":4380,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3393035146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3393035146},{"type":"v1","addr":"172.21.15.31:6835","nonce":3393035146}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4380,"qdb_cluster":[4380]},"id":1}]} 2024-09-17T05:29:01.970 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-09-17T05:29:01.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.969+0000 7ff250400640 1 -- 172.21.15.31:0/2966255723 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff228073230 msgr2=0x7ff2280756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:01.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.969+0000 7ff250400640 1 --2- 172.21.15.31:0/2966255723 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff228073230 0x7ff2280756f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff2340b0000 tx=0x7ff23401c520 comp rx=0 tx=0).stop 2024-09-17T05:29:01.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.969+0000 7ff250400640 1 -- 172.21.15.31:0/2966255723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff230004810 msgr2=0x7ff2480c9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:01.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.969+0000 7ff250400640 1 --2- 172.21.15.31:0/2966255723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff230004810 0x7ff2480c9600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff23c011a10 tx=0x7ff23c011ed0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.969+0000 7ff250400640 1 -- 172.21.15.31:0/2966255723 shutdown_connections 2024-09-17T05:29:01.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.969+0000 7ff250400640 1 --2- 172.21.15.31:0/2966255723 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff228073230 0x7ff2280756f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.969+0000 7ff250400640 1 --2- 172.21.15.31:0/2966255723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff24808c8d0 0x7ff248157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.969+0000 7ff250400640 1 --2- 172.21.15.31:0/2966255723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff248157080 0x7ff2480cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.969+0000 7ff250400640 1 --2- 172.21.15.31:0/2966255723 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff230004810 0x7ff2480c9600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:01.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.969+0000 7ff250400640 1 -- 172.21.15.31:0/2966255723 >> 172.21.15.31:0/2966255723 conn(0x7ff2480b1f10 msgr2=0x7ff24815b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:01.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.969+0000 7ff250400640 1 -- 172.21.15.31:0/2966255723 shutdown_connections 2024-09-17T05:29:01.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:01.969+0000 7ff250400640 1 -- 172.21.15.31:0/2966255723 wait complete. 2024-09-17T05:29:02.397 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:28:45.059391+0000', 'modified': '2024-09-17T05:28:48.082624+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4380}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4380': {'gid': 4380, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/3393035146', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6833', 'nonce': 3393035146}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 3393035146}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4380, 'qdb_cluster': [4380]} 2024-09-17T05:29:02.397 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:29:02.397 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:29:02.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.541+0000 7fce0f600640 1 -- 172.21.15.31:0/3119338793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce0815bf70 msgr2=0x7fce080b53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:02.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.541+0000 7fce0f600640 1 --2- 172.21.15.31:0/3119338793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce0815bf70 0x7fce080b53e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fce00009bc0 tx=0x7fce0001cb10 comp rx=0 tx=0).stop 2024-09-17T05:29:02.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.541+0000 7fce0f600640 1 -- 172.21.15.31:0/3119338793 shutdown_connections 2024-09-17T05:29:02.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.541+0000 7fce0f600640 1 --2- 172.21.15.31:0/3119338793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce0815bf70 0x7fce080b53e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.541+0000 7fce0f600640 1 --2- 172.21.15.31:0/3119338793 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce0815bb90 0x7fce0815f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.541+0000 7fce0f600640 1 -- 172.21.15.31:0/3119338793 >> 172.21.15.31:0/3119338793 conn(0x7fce080d1d90 msgr2=0x7fce080d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:02.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.541+0000 7fce0f600640 1 -- 172.21.15.31:0/3119338793 shutdown_connections 2024-09-17T05:29:02.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.541+0000 7fce0f600640 1 -- 172.21.15.31:0/3119338793 wait complete. 2024-09-17T05:29:02.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0f600640 1 Processor -- start 2024-09-17T05:29:02.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0f600640 1 -- start start 2024-09-17T05:29:02.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0f600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce080d2940 0x7fce08151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:02.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0f600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce0815bb90 0x7fce08148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:02.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0f600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce0815bf70 0x7fce08157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:02.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0f600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fce08168ca0 con 0x7fce0815bf70 2024-09-17T05:29:02.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0f600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce080b6640 con 0x7fce0815bb90 2024-09-17T05:29:02.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0f600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fce08168e20 con 0x7fce080d2940 2024-09-17T05:29:02.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0d600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce0815bf70 0x7fce08157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:02.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0d600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce0815bf70 0x7fce08157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59734/0 (socket says 172.21.15.31:59734) 2024-09-17T05:29:02.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0d600640 1 -- 172.21.15.31:0/973701494 learned_addr learned my addr 172.21.15.31:0/973701494 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:02.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0cc00640 1 --2- 172.21.15.31:0/973701494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce080d2940 0x7fce08151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:02.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce07e00640 1 --2- 172.21.15.31:0/973701494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce0815bb90 0x7fce08148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:02.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0d600640 1 -- 172.21.15.31:0/973701494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce080d2940 msgr2=0x7fce08151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:02.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0d600640 1 --2- 172.21.15.31:0/973701494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce080d2940 0x7fce08151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0d600640 1 -- 172.21.15.31:0/973701494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce0815bb90 msgr2=0x7fce08148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:02.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0d600640 1 --2- 172.21.15.31:0/973701494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce0815bb90 0x7fce08148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0d600640 1 -- 172.21.15.31:0/973701494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce080719b0 con 0x7fce0815bf70 2024-09-17T05:29:02.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0cc00640 1 --2- 172.21.15.31:0/973701494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce080d2940 0x7fce08151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:02.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0d600640 1 --2- 172.21.15.31:0/973701494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce0815bf70 0x7fce08157100 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fce000b0040 tx=0x7fce000a5a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:02.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce04c00640 1 -- 172.21.15.31:0/973701494 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce000bb070 con 0x7fce0815bf70 2024-09-17T05:29:02.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce04c00640 1 -- 172.21.15.31:0/973701494 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce00004d40 con 0x7fce0815bf70 2024-09-17T05:29:02.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0f600640 1 -- 172.21.15.31:0/973701494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce080716d0 con 0x7fce0815bf70 2024-09-17T05:29:02.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce04c00640 1 -- 172.21.15.31:0/973701494 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce000b2040 con 0x7fce0815bf70 2024-09-17T05:29:02.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.545+0000 7fce0f600640 1 -- 172.21.15.31:0/973701494 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce080b38f0 con 0x7fce0815bf70 2024-09-17T05:29:02.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.549+0000 7fce04c00640 1 -- 172.21.15.31:0/973701494 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fce000be070 con 0x7fce0815bf70 2024-09-17T05:29:02.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.549+0000 7fce04c00640 1 --2- 172.21.15.31:0/973701494 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fcde8073230 0x7fcde80756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:02.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.549+0000 7fce04c00640 1 -- 172.21.15.31:0/973701494 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fce0012e1c0 con 0x7fce0815bf70 2024-09-17T05:29:02.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.549+0000 7fce129c8000 1 Processor -- start 2024-09-17T05:29:02.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.549+0000 7fce129c8000 1 -- start start 2024-09-17T05:29:02.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.549+0000 7fce0cc00640 1 --2- 172.21.15.31:0/973701494 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fcde8073230 0x7fcde80756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:02.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce129c8000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1b9d0 0x56026ef1bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:02.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce129c8000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026ef1c2f0 0x56026eecf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:02.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce0cc00640 1 --2- 172.21.15.31:0/973701494 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fcde8073230 0x7fcde80756f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc005fd0 tx=0x7fcdfc00a5e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:02.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce129c8000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026eecfe10 0x56026eed01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:02.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce129c8000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56026edf03f0 con 0x56026ef1b9d0 2024-09-17T05:29:02.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce129c8000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56026ed2db20 con 0x56026ef1c2f0 2024-09-17T05:29:02.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce129c8000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x56026ed1cf50 con 0x56026eecfe10 2024-09-17T05:29:02.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce0cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1b9d0 0x56026ef1bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:02.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce0cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1b9d0 0x56026ef1bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59748/0 (socket says 172.21.15.31:59748) 2024-09-17T05:29:02.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce0cc00640 1 -- 172.21.15.31:0/1737785887 learned_addr learned my addr 172.21.15.31:0/1737785887 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:02.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce07e00640 1 --2- 172.21.15.31:0/1737785887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026ef1c2f0 0x56026eecf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:02.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce0d600640 1 --2- 172.21.15.31:0/1737785887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026eecfe10 0x56026eed01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:02.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce0cc00640 1 -- 172.21.15.31:0/1737785887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026eecfe10 msgr2=0x56026eed01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:29:02.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce0cc00640 1 --2- 172.21.15.31:0/1737785887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026eecfe10 0x56026eed01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce0cc00640 1 -- 172.21.15.31:0/1737785887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026ef1c2f0 msgr2=0x56026eecf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:29:02.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce0cc00640 1 --2- 172.21.15.31:0/1737785887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026ef1c2f0 0x56026eecf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce0cc00640 1 -- 172.21.15.31:0/1737785887 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56026ece4590 con 0x56026ef1b9d0 2024-09-17T05:29:02.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce0cc00640 1 --2- 172.21.15.31:0/1737785887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1b9d0 0x56026ef1bdb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00ef30 tx=0x7fcdfc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e53de0f6f0cfdc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:02.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fcdf9600640 1 -- 172.21.15.31:0/1737785887 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc021070 con 0x56026ef1b9d0 2024-09-17T05:29:02.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fcdf9600640 1 -- 172.21.15.31:0/1737785887 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdfc01d950 con 0x56026ef1b9d0 2024-09-17T05:29:02.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fcdf9600640 1 -- 172.21.15.31:0/1737785887 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc01dd60 con 0x56026ef1b9d0 2024-09-17T05:29:02.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce129c8000 1 -- 172.21.15.31:0/1737785887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1b9d0 msgr2=0x56026ef1bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:02.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce129c8000 1 --2- 172.21.15.31:0/1737785887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1b9d0 0x56026ef1bdb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00ef30 tx=0x7fcdfc011000 comp rx=0 tx=0).stop 2024-09-17T05:29:02.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce129c8000 1 -- 172.21.15.31:0/1737785887 shutdown_connections 2024-09-17T05:29:02.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce129c8000 1 --2- 172.21.15.31:0/1737785887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026eecfe10 0x56026eed01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce129c8000 1 --2- 172.21.15.31:0/1737785887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026ef1c2f0 0x56026eecf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce129c8000 1 --2- 172.21.15.31:0/1737785887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1b9d0 0x56026ef1bdb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce129c8000 1 -- 172.21.15.31:0/1737785887 >> 172.21.15.31:0/1737785887 conn(0x56026edb9130 msgr2=0x56026eefee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:02.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce129c8000 1 -- 172.21.15.31:0/1737785887 shutdown_connections 2024-09-17T05:29:02.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce129c8000 1 -- 172.21.15.31:0/1737785887 wait complete. 2024-09-17T05:29:02.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce129c8000 1 -- start start 2024-09-17T05:29:02.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.553+0000 7fce129c8000 1 Processor -- start 2024-09-17T05:29:02.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce129c8000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026eecfe10 0x56026eefc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:02.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce129c8000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026ef1b9d0 0x56026eefce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:02.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce129c8000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026ef1c2f0 0x56026eefd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:02.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce129c8000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56026ecb75d0 con 0x56026eecfe10 2024-09-17T05:29:02.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce129c8000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56026ed20d60 con 0x56026ef1b9d0 2024-09-17T05:29:02.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce129c8000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x56026ecc3500 con 0x56026ef1c2f0 2024-09-17T05:29:02.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce129c8000 10 client.0 _ll_register_callbacks cb 0x56026ecc7810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:29:02.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce0cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026eecfe10 0x56026eefc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:02.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce0cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026eecfe10 0x56026eefc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59758/0 (socket says 172.21.15.31:59758) 2024-09-17T05:29:02.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce0cc00640 1 -- 172.21.15.31:0/1018212405 learned_addr learned my addr 172.21.15.31:0/1018212405 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:02.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce07e00640 1 --2- 172.21.15.31:0/1018212405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026ef1b9d0 0x56026eefce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:02.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce0d600640 1 --2- 172.21.15.31:0/1018212405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026ef1c2f0 0x56026eefd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:02.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce0cc00640 1 -- 172.21.15.31:0/1018212405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026ef1c2f0 msgr2=0x56026eefd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:29:02.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce0cc00640 1 --2- 172.21.15.31:0/1018212405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026ef1c2f0 0x56026eefd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce0cc00640 1 -- 172.21.15.31:0/1018212405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026ef1b9d0 msgr2=0x56026eefce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:29:02.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce0cc00640 1 --2- 172.21.15.31:0/1018212405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026ef1b9d0 0x56026eefce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce0cc00640 1 -- 172.21.15.31:0/1018212405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56026ecbb170 con 0x56026eecfe10 2024-09-17T05:29:02.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce0cc00640 1 --2- 172.21.15.31:0/1018212405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026eecfe10 0x56026eefc6a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00a810 tx=0x7fcdfc01fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd508a42100b202b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:02.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fcdee000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:29:02.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fcdee000640 1 -- 172.21.15.31:0/1018212405 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc021040 con 0x56026eecfe10 2024-09-17T05:29:02.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce129c8000 1 -- 172.21.15.31:0/1018212405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56026ecb50f0 con 0x56026eecfe10 2024-09-17T05:29:02.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fcdee000640 1 -- 172.21.15.31:0/1018212405 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcdfc01f320 con 0x56026eecfe10 2024-09-17T05:29:02.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fcdee000640 1 -- 172.21.15.31:0/1018212405 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fcdfc038050 con 0x56026eecfe10 2024-09-17T05:29:02.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce129c8000 10 client.4698 fetch_fsmap learned FSMap version 8 2024-09-17T05:29:02.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce129c8000 1 -- 172.21.15.31:0/1018212405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x56026eda1ef0 con 0x56026eecfe10 2024-09-17T05:29:02.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fcdee000640 1 -- 172.21.15.31:0/1018212405 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56026ecb50f0 con 0x56026eecfe10 2024-09-17T05:29:02.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fcdee000640 1 -- 172.21.15.31:0/1018212405 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fcdfc01d660 con 0x56026eecfe10 2024-09-17T05:29:02.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce129c8000 10 client.4698 fetch_fsmap finished waiting for FSMap version 8 2024-09-17T05:29:02.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce129c8000 10 client.4698 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:29:02.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce129c8000 20 client.4698 populate_metadata read hostname 'smithi031' 2024-09-17T05:29:02.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce129c8000 1 --2- 172.21.15.31:0/1018212405 >> [v2:172.21.15.31:6833/3393035146,v1:172.21.15.31:6835/3393035146] conn(0x56026eefe0f0 0x56026ef2dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:02.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce129c8000 4 client.4698 mds_command: new command op to 4380 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:29:02.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce129c8000 1 -- 172.21.15.31:0/1018212405 --> [v2:172.21.15.31:6833/3393035146,v1:172.21.15.31:6835/3393035146] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56026ed2fa70 con 0x56026eefe0f0 2024-09-17T05:29:02.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce07e00640 1 --2- 172.21.15.31:0/1018212405 >> [v2:172.21.15.31:6833/3393035146,v1:172.21.15.31:6835/3393035146] conn(0x56026eefe0f0 0x56026ef2dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:02.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce07e00640 1 --2- 172.21.15.31:0/1018212405 >> [v2:172.21.15.31:6833/3393035146,v1:172.21.15.31:6835/3393035146] conn(0x56026eefe0f0 0x56026ef2dc90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b95e56eadbc7d09 server_cookie=bdc3a363f72c36bf in_seq=0 out_seq=0 2024-09-17T05:29:02.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fcdee000640 10 client.4698 ms_handle_connect on v2:172.21.15.31:6833/3393035146 2024-09-17T05:29:02.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fcdee000640 1 -- 172.21.15.31:0/1018212405 <== mds.0 v2:172.21.15.31:6833/3393035146 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56026ed2fa70 con 0x56026eefe0f0 2024-09-17T05:29:02.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fcdee000640 10 client.4698 handle_command_reply: tid=0 2024-09-17T05:29:02.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.557+0000 7fce129c8000 1 client.4698 shutdown 2024-09-17T05:29:02.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.561+0000 7fce129c8000 1 -- 172.21.15.31:0/1018212405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026eecfe10 msgr2=0x56026eefc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:02.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.561+0000 7fce129c8000 1 --2- 172.21.15.31:0/1018212405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026eecfe10 0x56026eefc6a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00a810 tx=0x7fcdfc01fc70 comp rx=0 tx=0).stop 2024-09-17T05:29:02.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.561+0000 7fce129c8000 1 -- 172.21.15.31:0/1018212405 shutdown_connections 2024-09-17T05:29:02.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.561+0000 7fce129c8000 1 --2- 172.21.15.31:0/1018212405 >> [v2:172.21.15.31:6833/3393035146,v1:172.21.15.31:6835/3393035146] conn(0x56026eefe0f0 0x56026ef2dc90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.561+0000 7fce129c8000 1 --2- 172.21.15.31:0/1018212405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026ef1c2f0 0x56026eefd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.561+0000 7fce129c8000 1 --2- 172.21.15.31:0/1018212405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026ef1b9d0 0x56026eefce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.561+0000 7fce129c8000 1 --2- 172.21.15.31:0/1018212405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026eecfe10 0x56026eefc6a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.561+0000 7fce129c8000 1 -- 172.21.15.31:0/1018212405 >> 172.21.15.31:0/1018212405 conn(0x56026edb9130 msgr2=0x56026eecefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:02.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.561+0000 7fcdee000640 0 client.4698 ms_handle_reset on v2:172.21.15.31:6833/3393035146 2024-09-17T05:29:02.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.561+0000 7fce129c8000 1 -- 172.21.15.31:0/1018212405 shutdown_connections 2024-09-17T05:29:02.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.561+0000 7fce129c8000 1 -- 172.21.15.31:0/1018212405 wait complete. 2024-09-17T05:29:02.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.561+0000 7fce129c8000 20 client.4698 trim_cache size 0 max 16384 2024-09-17T05:29:02.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.577+0000 7fce129c8000 1 Processor -- start 2024-09-17T05:29:02.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.577+0000 7fce129c8000 1 -- start start 2024-09-17T05:29:02.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.577+0000 7fce129c8000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026eecfe10 0x56026ef8dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:02.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.577+0000 7fce129c8000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026ef1b9d0 0x56026ef8e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:02.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.577+0000 7fce129c8000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1c2f0 0x56026ef8ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:02.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.577+0000 7fce129c8000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fce08203d30 con 0x56026ef1c2f0 2024-09-17T05:29:02.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.577+0000 7fce129c8000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce08202da0 con 0x56026ef1b9d0 2024-09-17T05:29:02.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.577+0000 7fce129c8000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fce08202200 con 0x56026eecfe10 2024-09-17T05:29:02.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce0d600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1c2f0 0x56026ef8ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:02.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce0d600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1c2f0 0x56026ef8ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59770/0 (socket says 172.21.15.31:59770) 2024-09-17T05:29:02.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce0d600640 1 -- 172.21.15.31:0/3547448599 learned_addr learned my addr 172.21.15.31:0/3547448599 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:02.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce0cc00640 1 --2- 172.21.15.31:0/3547448599 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026eecfe10 0x56026ef8dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:02.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce07e00640 1 --2- 172.21.15.31:0/3547448599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026ef1b9d0 0x56026ef8e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:02.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce0d600640 1 -- 172.21.15.31:0/3547448599 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026eecfe10 msgr2=0x56026ef8dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:29:02.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce0d600640 1 --2- 172.21.15.31:0/3547448599 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026eecfe10 0x56026ef8dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce0d600640 1 -- 172.21.15.31:0/3547448599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026ef1b9d0 msgr2=0x56026ef8e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:29:02.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce0d600640 1 --2- 172.21.15.31:0/3547448599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026ef1b9d0 0x56026ef8e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce0d600640 1 -- 172.21.15.31:0/3547448599 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56026ed78d90 con 0x56026ef1c2f0 2024-09-17T05:29:02.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce0cc00640 1 --2- 172.21.15.31:0/3547448599 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026eecfe10 0x56026ef8dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:02.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce07e00640 1 --2- 172.21.15.31:0/3547448599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026ef1b9d0 0x56026ef8e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:02.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce0d600640 1 --2- 172.21.15.31:0/3547448599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1c2f0 0x56026ef8ea60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fce000985f0 tx=0x7fce00009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221893646e88f72 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:02.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fcdf8c00640 1 -- 172.21.15.31:0/3547448599 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce000f8560 con 0x56026ef1c2f0 2024-09-17T05:29:02.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fcdf8c00640 1 -- 172.21.15.31:0/3547448599 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce000f8720 con 0x56026ef1c2f0 2024-09-17T05:29:02.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fcdf8c00640 1 -- 172.21.15.31:0/3547448599 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce000f8380 con 0x56026ef1c2f0 2024-09-17T05:29:02.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce129c8000 1 -- 172.21.15.31:0/3547448599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1c2f0 msgr2=0x56026ef8ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:02.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce129c8000 1 --2- 172.21.15.31:0/3547448599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1c2f0 0x56026ef8ea60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fce000985f0 tx=0x7fce00009500 comp rx=0 tx=0).stop 2024-09-17T05:29:02.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce129c8000 1 -- 172.21.15.31:0/3547448599 shutdown_connections 2024-09-17T05:29:02.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce129c8000 1 --2- 172.21.15.31:0/3547448599 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1c2f0 0x56026ef8ea60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce129c8000 1 --2- 172.21.15.31:0/3547448599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026ef1b9d0 0x56026ef8e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce129c8000 1 --2- 172.21.15.31:0/3547448599 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026eecfe10 0x56026ef8dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce129c8000 1 -- 172.21.15.31:0/3547448599 >> 172.21.15.31:0/3547448599 conn(0x56026edb9130 msgr2=0x56026eed7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:02.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce129c8000 1 -- 172.21.15.31:0/3547448599 shutdown_connections 2024-09-17T05:29:02.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce129c8000 1 -- 172.21.15.31:0/3547448599 wait complete. 2024-09-17T05:29:02.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce129c8000 1 -- start start 2024-09-17T05:29:02.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce129c8000 1 Processor -- start 2024-09-17T05:29:02.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce129c8000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026eecfe10 0x56026ef2f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:02.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce129c8000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026ef1b9d0 0x56026ef2fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:02.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce129c8000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1c2f0 0x56026ef30210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:02.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce129c8000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56026ed20070 con 0x56026ef1c2f0 2024-09-17T05:29:02.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce129c8000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56026eddc730 con 0x56026eecfe10 2024-09-17T05:29:02.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce129c8000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x56026eda1a60 con 0x56026ef1b9d0 2024-09-17T05:29:02.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce129c8000 10 client.0 _ll_register_callbacks cb 0x7fcdf4001300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:29:02.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce0d600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1c2f0 0x56026ef30210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:02.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce0d600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1c2f0 0x56026ef30210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59776/0 (socket says 172.21.15.31:59776) 2024-09-17T05:29:02.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce0d600640 1 -- 172.21.15.31:0/1133933810 learned_addr learned my addr 172.21.15.31:0/1133933810 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:02.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce07e00640 1 --2- 172.21.15.31:0/1133933810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026ef1b9d0 0x56026ef2fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:02.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.581+0000 7fce0cc00640 1 --2- 172.21.15.31:0/1133933810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026eecfe10 0x56026ef2f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:02.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0d600640 1 -- 172.21.15.31:0/1133933810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026ef1b9d0 msgr2=0x56026ef2fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:29:02.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0d600640 1 --2- 172.21.15.31:0/1133933810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026ef1b9d0 0x56026ef2fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0d600640 1 -- 172.21.15.31:0/1133933810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026eecfe10 msgr2=0x56026ef2f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:29:02.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0d600640 1 --2- 172.21.15.31:0/1133933810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026eecfe10 0x56026ef2f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0d600640 1 -- 172.21.15.31:0/1133933810 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56026ece3a90 con 0x56026ef1c2f0 2024-09-17T05:29:02.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0cc00640 1 --2- 172.21.15.31:0/1133933810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026eecfe10 0x56026ef2f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:02.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0d600640 1 --2- 172.21.15.31:0/1133933810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1c2f0 0x56026ef30210 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fce000f5e80 tx=0x7fce000f8380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994be6e8a71c6324 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:02.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fcdee000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:29:02.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fcdee000640 1 -- 172.21.15.31:0/1133933810 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce000f8c10 con 0x56026ef1c2f0 2024-09-17T05:29:02.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fcdee000640 1 -- 172.21.15.31:0/1133933810 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fce00102060 con 0x56026ef1c2f0 2024-09-17T05:29:02.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 1 -- 172.21.15.31:0/1133933810 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce000f8720 con 0x56026ef1c2f0 2024-09-17T05:29:02.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fcdee000640 1 -- 172.21.15.31:0/1133933810 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fce000fd640 con 0x56026ef1c2f0 2024-09-17T05:29:02.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 10 client.4704 fetch_fsmap learned FSMap version 8 2024-09-17T05:29:02.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 1 -- 172.21.15.31:0/1133933810 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x56026ecc2050 con 0x56026ef1c2f0 2024-09-17T05:29:02.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fcdee000640 1 -- 172.21.15.31:0/1133933810 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce000f8720 con 0x56026ef1c2f0 2024-09-17T05:29:02.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fcdee000640 1 -- 172.21.15.31:0/1133933810 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7fce000b5030 con 0x56026ef1c2f0 2024-09-17T05:29:02.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 10 client.4704 fetch_fsmap finished waiting for FSMap version 8 2024-09-17T05:29:02.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 10 client.4704 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:29:02.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 20 client.4704 populate_metadata read hostname 'smithi031' 2024-09-17T05:29:02.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 1 --2- 172.21.15.31:0/1133933810 >> [v2:172.21.15.31:6833/3393035146,v1:172.21.15.31:6835/3393035146] conn(0x56026ef30750 0x56026ef30b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:02.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 4 client.4704 mds_command: new command op to 4380 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:29:02.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 1 -- 172.21.15.31:0/1133933810 --> [v2:172.21.15.31:6833/3393035146,v1:172.21.15.31:6835/3393035146] -- command(tid 0: {"prefix": "status"}) -- 0x56026ed2b520 con 0x56026ef30750 2024-09-17T05:29:02.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0cc00640 1 --2- 172.21.15.31:0/1133933810 >> [v2:172.21.15.31:6833/3393035146,v1:172.21.15.31:6835/3393035146] conn(0x56026ef30750 0x56026ef30b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:02.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0cc00640 1 --2- 172.21.15.31:0/1133933810 >> [v2:172.21.15.31:6833/3393035146,v1:172.21.15.31:6835/3393035146] conn(0x56026ef30750 0x56026ef30b30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa10f043f3dc124c server_cookie=eb5a6ba44d3bccf4 in_seq=0 out_seq=0 2024-09-17T05:29:02.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fcdee000640 10 client.4704 ms_handle_connect on v2:172.21.15.31:6833/3393035146 2024-09-17T05:29:02.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fcdee000640 1 -- 172.21.15.31:0/1133933810 <== mds.0 v2:172.21.15.31:6833/3393035146 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x56026ed2b520 con 0x56026ef30750 2024-09-17T05:29:02.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fcdee000640 10 client.4704 handle_command_reply: tid=0 2024-09-17T05:29:02.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 1 client.4704 shutdown 2024-09-17T05:29:02.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 1 -- 172.21.15.31:0/1133933810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1c2f0 msgr2=0x56026ef30210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:02.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 1 --2- 172.21.15.31:0/1133933810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1c2f0 0x56026ef30210 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fce000f5e80 tx=0x7fce000f8380 comp rx=0 tx=0).stop 2024-09-17T05:29:02.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 1 -- 172.21.15.31:0/1133933810 shutdown_connections 2024-09-17T05:29:02.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 1 --2- 172.21.15.31:0/1133933810 >> [v2:172.21.15.31:6833/3393035146,v1:172.21.15.31:6835/3393035146] conn(0x56026ef30750 0x56026ef30b30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 1 --2- 172.21.15.31:0/1133933810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56026ef1c2f0 0x56026ef30210 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 1 --2- 172.21.15.31:0/1133933810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56026ef1b9d0 0x56026ef2fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 1 --2- 172.21.15.31:0/1133933810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56026eecfe10 0x56026ef2f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fcdee000640 0 client.4704 ms_handle_reset on v2:172.21.15.31:6833/3393035146 2024-09-17T05:29:02.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 1 -- 172.21.15.31:0/1133933810 >> 172.21.15.31:0/1133933810 conn(0x56026edb9130 msgr2=0x56026ef1add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:02.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 1 -- 172.21.15.31:0/1133933810 shutdown_connections 2024-09-17T05:29:02.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 1 -- 172.21.15.31:0/1133933810 wait complete. 2024-09-17T05:29:02.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce129c8000 20 client.4704 trim_cache size 0 max 16384 2024-09-17T05:29:02.596 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:29:02.596 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "b668cd1d-3036-4a29-9e5a-69d0df5776a8", 2024-09-17T05:29:02.596 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-17T05:29:02.596 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4380, 2024-09-17T05:29:02.596 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-09-17T05:29:02.596 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-09-17T05:29:02.597 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-17T05:29:02.597 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 16.920551567, 2024-09-17T05:29:02.597 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 8, 2024-09-17T05:29:02.597 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 21, 2024-09-17T05:29:02.597 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 21, 2024-09-17T05:29:02.597 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 23.083834553999999 2024-09-17T05:29:02.597 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:29:02.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0f600640 1 -- 172.21.15.31:0/973701494 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fcde8073230 msgr2=0x7fcde80756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:02.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0f600640 1 --2- 172.21.15.31:0/973701494 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fcde8073230 0x7fcde80756f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc005fd0 tx=0x7fcdfc00a5e0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0f600640 1 -- 172.21.15.31:0/973701494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce0815bf70 msgr2=0x7fce08157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:02.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0f600640 1 --2- 172.21.15.31:0/973701494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce0815bf70 0x7fce08157100 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fce000b0040 tx=0x7fce000a5a30 comp rx=0 tx=0).stop 2024-09-17T05:29:02.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0f600640 1 -- 172.21.15.31:0/973701494 shutdown_connections 2024-09-17T05:29:02.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0f600640 1 --2- 172.21.15.31:0/973701494 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fcde8073230 0x7fcde80756f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0f600640 1 --2- 172.21.15.31:0/973701494 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce0815bf70 0x7fce08157100 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0f600640 1 --2- 172.21.15.31:0/973701494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce0815bb90 0x7fce08148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0f600640 1 --2- 172.21.15.31:0/973701494 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce080d2940 0x7fce08151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:02.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0f600640 1 -- 172.21.15.31:0/973701494 >> 172.21.15.31:0/973701494 conn(0x7fce080d1d90 msgr2=0x7fce081554a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:02.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0f600640 1 -- 172.21.15.31:0/973701494 shutdown_connections 2024-09-17T05:29:02.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:02.585+0000 7fce0f600640 1 -- 172.21.15.31:0/973701494 wait complete. 2024-09-17T05:29:02.611 INFO:teuthology.run_tasks:Running task kclient... 2024-09-17T05:29:02.652 INFO:tasks.kclient:Mounting kernel clients... 2024-09-17T05:29:02.652 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-17T05:29:02.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:02.653 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T05:29:02.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:02.663 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2024-09-17T05:29:02.730 INFO:teuthology.orchestra.run.smithi031.stderr:Cannot find device "ceph-brx" 2024-09-17T05:29:02.731 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:29:02.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:02.732 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T05:29:02.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:02.788 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2024-09-17T05:29:02.858 INFO:teuthology.orchestra.run.smithi031.stderr:Cannot find device "ceph-brx" 2024-09-17T05:29:02.859 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:29:02.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:02.860 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-17T05:29:02.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:02.871 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-09-17T05:29:02.937 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2024-09-17T05:29:02.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:29:02.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:02.940 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-17T05:29:02.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:02.990 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-09-17T05:29:03.056 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2024-09-17T05:29:03.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:29:03.059 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-17T05:29:03.059 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:29:03.059 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:29:03.059 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:29:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.201+0000 7f784ea00640 1 -- 172.21.15.31:0/730078653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7848072c90 msgr2=0x7f7848073120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.201+0000 7f784ea00640 1 --2- 172.21.15.31:0/730078653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7848072c90 0x7f7848073120 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f784806e790 tx=0x7f784001f580 comp rx=0 tx=0).stop 2024-09-17T05:29:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.201+0000 7f784ea00640 1 -- 172.21.15.31:0/730078653 shutdown_connections 2024-09-17T05:29:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.201+0000 7f784ea00640 1 --2- 172.21.15.31:0/730078653 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7848072c90 0x7f7848073120 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.201+0000 7f784ea00640 1 --2- 172.21.15.31:0/730078653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78480af150 0x7f78480b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.201+0000 7f784ea00640 1 --2- 172.21.15.31:0/730078653 >> v2:172.21.15.155:3300/0 conn(0x7f784815e1b0 0x7f78480705f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.201+0000 7f784ea00640 1 -- 172.21.15.31:0/730078653 >> 172.21.15.31:0/730078653 conn(0x7f78480b1c20 msgr2=0x7f78480b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.201+0000 7f784ea00640 1 -- 172.21.15.31:0/730078653 shutdown_connections 2024-09-17T05:29:03.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.201+0000 7f784ea00640 1 -- 172.21.15.31:0/730078653 wait complete. 2024-09-17T05:29:03.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ea00640 1 Processor -- start 2024-09-17T05:29:03.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ea00640 1 -- start start 2024-09-17T05:29:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7848072c90 0x7f784809ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78480af150 0x7f78480cf190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f784815e1b0 0x7f78481f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ea00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f78480ae510 con 0x7f784815e1b0 2024-09-17T05:29:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ea00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f78480ae390 con 0x7f78480af150 2024-09-17T05:29:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ea00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f78480ae690 con 0x7f7848072c90 2024-09-17T05:29:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f784815e1b0 0x7f78481f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f784815e1b0 0x7f78481f5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59796/0 (socket says 172.21.15.31:59796) 2024-09-17T05:29:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ca00640 1 -- 172.21.15.31:0/2682864974 learned_addr learned my addr 172.21.15.31:0/2682864974 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f783f400640 1 --2- 172.21.15.31:0/2682864974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78480af150 0x7f78480cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f7847e00640 1 --2- 172.21.15.31:0/2682864974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7848072c90 0x7f784809ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ca00640 1 -- 172.21.15.31:0/2682864974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7848072c90 msgr2=0x7f784809ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ca00640 1 --2- 172.21.15.31:0/2682864974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7848072c90 0x7f784809ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ca00640 1 -- 172.21.15.31:0/2682864974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78480af150 msgr2=0x7f78480cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ca00640 1 --2- 172.21.15.31:0/2682864974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78480af150 0x7f78480cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ca00640 1 -- 172.21.15.31:0/2682864974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78480ce3f0 con 0x7f784815e1b0 2024-09-17T05:29:03.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ca00640 1 --2- 172.21.15.31:0/2682864974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f784815e1b0 0x7f78481f5f90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f784001dc30 tx=0x7f78400093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:03.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f7844c00640 1 -- 172.21.15.31:0/2682864974 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78400bf070 con 0x7f784815e1b0 2024-09-17T05:29:03.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f7844c00640 1 -- 172.21.15.31:0/2682864974 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7840004b40 con 0x7f784815e1b0 2024-09-17T05:29:03.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ea00640 1 -- 172.21.15.31:0/2682864974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78480ce6d0 con 0x7f784815e1b0 2024-09-17T05:29:03.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f7844c00640 1 -- 172.21.15.31:0/2682864974 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78400b5040 con 0x7f784815e1b0 2024-09-17T05:29:03.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.205+0000 7f784ea00640 1 -- 172.21.15.31:0/2682864974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78480cec90 con 0x7f784815e1b0 2024-09-17T05:29:03.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.209+0000 7f784ea00640 1 -- 172.21.15.31:0/2682864974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78480aeb40 con 0x7f784815e1b0 2024-09-17T05:29:03.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.209+0000 7f7844c00640 1 -- 172.21.15.31:0/2682864974 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f78400c2070 con 0x7f784815e1b0 2024-09-17T05:29:03.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.209+0000 7f7844c00640 1 --2- 172.21.15.31:0/2682864974 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7824073200 0x7f78240756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:03.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.209+0000 7f7844c00640 1 -- 172.21.15.31:0/2682864974 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f78401312c0 con 0x7f784815e1b0 2024-09-17T05:29:03.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.209+0000 7f7847e00640 1 --2- 172.21.15.31:0/2682864974 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7824073200 0x7f78240756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:03.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.209+0000 7f7847e00640 1 --2- 172.21.15.31:0/2682864974 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7824073200 0x7f78240756c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f783800bb50 tx=0x7f783800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:03.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.213+0000 7f7844c00640 1 -- 172.21.15.31:0/2682864974 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f78400190e0 con 0x7f784815e1b0 2024-09-17T05:29:03.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.425+0000 7f784ea00640 1 -- 172.21.15.31:0/2682864974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f78480b5200 con 0x7f784815e1b0 2024-09-17T05:29:03.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.429+0000 7f7844c00640 1 -- 172.21.15.31:0/2682864974 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f78400fbc80 con 0x7f784815e1b0 2024-09-17T05:29:03.432 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:29:03.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.429+0000 7f784ea00640 1 -- 172.21.15.31:0/2682864974 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7824073200 msgr2=0x7f78240756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:03.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.429+0000 7f784ea00640 1 --2- 172.21.15.31:0/2682864974 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7824073200 0x7f78240756c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f783800bb50 tx=0x7f783800b2e0 comp rx=0 tx=0).stop 2024-09-17T05:29:03.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.429+0000 7f784ea00640 1 -- 172.21.15.31:0/2682864974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f784815e1b0 msgr2=0x7f78481f5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:03.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.429+0000 7f784ea00640 1 --2- 172.21.15.31:0/2682864974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f784815e1b0 0x7f78481f5f90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f784001dc30 tx=0x7f78400093b0 comp rx=0 tx=0).stop 2024-09-17T05:29:03.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.429+0000 7f784ea00640 1 -- 172.21.15.31:0/2682864974 shutdown_connections 2024-09-17T05:29:03.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.429+0000 7f784ea00640 1 --2- 172.21.15.31:0/2682864974 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7824073200 0x7f78240756c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:03.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.429+0000 7f784ea00640 1 --2- 172.21.15.31:0/2682864974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f784815e1b0 0x7f78481f5f90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:03.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.429+0000 7f784ea00640 1 --2- 172.21.15.31:0/2682864974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78480af150 0x7f78480cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:03.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.429+0000 7f784ea00640 1 --2- 172.21.15.31:0/2682864974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7848072c90 0x7f784809ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:03.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.429+0000 7f784ea00640 1 -- 172.21.15.31:0/2682864974 >> 172.21.15.31:0/2682864974 conn(0x7f78480b1c20 msgr2=0x7f78481585e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:03.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.429+0000 7f784ea00640 1 -- 172.21.15.31:0/2682864974 shutdown_connections 2024-09-17T05:29:03.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03.429+0000 7f784ea00640 1 -- 172.21.15.31:0/2682864974 wait complete. 2024-09-17T05:29:03.452 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:29:03.453 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:29:03.453 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-17T05:29:03.453 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:29:03.453 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:29:03.453 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:29:03.453 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:29:03.453 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:29:03.453 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:29:03.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:03.453 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-17T05:29:03.462 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:29:03.462 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:29:03.462 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:29:03.463 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:03.463 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-17T05:29:03.463 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:03.463 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:29:03.463 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:03.463 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-17T05:29:03.463 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:29:03.463 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:03.463 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-17T05:29:03.463 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:29:03.463 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:03.463 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-17T05:29:03.464 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:29:03.464 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42409sec preferred_lft 42409sec 2024-09-17T05:29:03.464 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-17T05:29:03.464 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:03.464 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:29:03.464 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:03.464 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-17T05:29:03.464 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:29:03.464 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:fe:f3:3e:aa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:03.464 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:29:03.464 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:03.465 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T05:29:03.466 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:03.466 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:29:03.466 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add name ceph-brx type bridge 2024-09-17T05:29:03.466 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr flush dev ceph-brx 2024-09-17T05:29:03.466 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set ceph-brx up 2024-09-17T05:29:03.466 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T05:29:03.466 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:29:03.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:03.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:03.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:03.622 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:29:03.641 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-17T05:29:03.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:03.643 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-17T05:29:03.717 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-17T05:29:03.717 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:29:03.718 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:29:03.718 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:29:03.718 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:29:03.718 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:29:03.718 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:03.719 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:29:03.719 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:29:03.719 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:29:03.719 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:29:03.719 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:29:03.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:03.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:03.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:03.860 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T05:29:03.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:03.870 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list-id 2024-09-17T05:29:03.920 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:03.920 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:29:03.920 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:29:03.920 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T05:29:03.920 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:29:04.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:04.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:04.049 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T05:29:04.049 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:04.049 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:29:04.049 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T05:29:04.049 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T05:29:04.049 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T05:29:04.049 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T05:29:04.049 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T05:29:04.049 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:29:04.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:04.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:04.219 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:04.220 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:29:04.220 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-09-17T05:29:04.220 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T05:29:04.220 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:29:04.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:04.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:04.348 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:29:04.348 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:29:04.403 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:29:04.403 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:29:04.403 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:29:04.458 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-17T05:29:04.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:04.459 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:29:04.548 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:29:04.548 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:29:05.221 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:29:05.221 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:29:05.221 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:29:05.221 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:29:05.221 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:29:05.224 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:29:05.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:05.225 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:29:05.246 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:29:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:29:05.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:05.361 INFO:teuthology.orchestra.run.smithi031.stdout:client4532 2024-09-17T05:29:05.361 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:29:05.362 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:05.370 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:29:05.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:29:05.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:05.479 INFO:teuthology.orchestra.run.smithi031.stdout:client4532 2024-09-17T05:29:05.480 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:29:05.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:29:05.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:05.545 INFO:teuthology.orchestra.run.smithi031.stdout:client4532 2024-09-17T05:29:05.545 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/b668cd1d-3036-4a29-9e5a-69d0df5776a8.client4532/status') 2024-09-17T05:29:05.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:05.611 INFO:teuthology.orchestra.run.smithi031.stdout:instance: client.4532 (3)172.21.15.31:0/2896047947 2024-09-17T05:29:05.611 INFO:teuthology.orchestra.run.smithi031.stdout:blocklisted: false 2024-09-17T05:29:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records in 2024-09-17T05:29:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records out 2024-09-17T05:29:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:70 bytes copied, 5.3007e-05 s, 1.3 MB/s 2024-09-17T05:29:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:05.619 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-17T05:29:05.619 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:29:05.619 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T05:29:05.620 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:29:05.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.761+0000 7fae54600640 1 -- 172.21.15.31:0/879692787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae4c15a150 msgr2=0x7fae4c15b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:05.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.761+0000 7fae54600640 1 --2- 172.21.15.31:0/879692787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae4c15a150 0x7fae4c15b730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fae4000aa10 tx=0x7fae4001dc30 comp rx=0 tx=0).stop 2024-09-17T05:29:05.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.761+0000 7fae54600640 1 -- 172.21.15.31:0/879692787 shutdown_connections 2024-09-17T05:29:05.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.761+0000 7fae54600640 1 --2- 172.21.15.31:0/879692787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae4c0ce9b0 0x7fae4c0cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:05.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.761+0000 7fae54600640 1 --2- 172.21.15.31:0/879692787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae4c15a150 0x7fae4c15b730 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:05.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.761+0000 7fae54600640 1 -- 172.21.15.31:0/879692787 >> 172.21.15.31:0/879692787 conn(0x7fae4c0b2060 msgr2=0x7fae4c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:05.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.761+0000 7fae54600640 1 -- 172.21.15.31:0/879692787 shutdown_connections 2024-09-17T05:29:05.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.761+0000 7fae54600640 1 -- 172.21.15.31:0/879692787 wait complete. 2024-09-17T05:29:05.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae54600640 1 Processor -- start 2024-09-17T05:29:05.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae54600640 1 -- start start 2024-09-17T05:29:05.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae54600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae4c0ce9b0 0x7fae4c163370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:05.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae54600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae4c15a150 0x7fae4c1fbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:05.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae54600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae4c15e8d0 0x7fae4c14be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:05.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae54600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fae4c0c6dc0 con 0x7fae4c15a150 2024-09-17T05:29:05.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae54600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fae4c0c6c40 con 0x7fae4c0ce9b0 2024-09-17T05:29:05.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae54600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fae4c0c6f40 con 0x7fae4c15e8d0 2024-09-17T05:29:05.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae51200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae4c15a150 0x7fae4c1fbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:05.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae51200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae4c15a150 0x7fae4c1fbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59826/0 (socket says 172.21.15.31:59826) 2024-09-17T05:29:05.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae51200640 1 -- 172.21.15.31:0/650902512 learned_addr learned my addr 172.21.15.31:0/650902512 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:05.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae51c00640 1 --2- 172.21.15.31:0/650902512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae4c0ce9b0 0x7fae4c163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:05.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae52600640 1 --2- 172.21.15.31:0/650902512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae4c15e8d0 0x7fae4c14be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:05.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae51200640 1 -- 172.21.15.31:0/650902512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae4c15e8d0 msgr2=0x7fae4c14be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:05.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae51200640 1 --2- 172.21.15.31:0/650902512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae4c15e8d0 0x7fae4c14be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:05.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae51200640 1 -- 172.21.15.31:0/650902512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae4c0ce9b0 msgr2=0x7fae4c163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:05.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae51200640 1 --2- 172.21.15.31:0/650902512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae4c0ce9b0 0x7fae4c163370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:05.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae51200640 1 -- 172.21.15.31:0/650902512 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4c1638b0 con 0x7fae4c15a150 2024-09-17T05:29:05.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae51c00640 1 --2- 172.21.15.31:0/650902512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae4c0ce9b0 0x7fae4c163370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:05.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae51200640 1 --2- 172.21.15.31:0/650902512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae4c15a150 0x7fae4c1fbb50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fae3800c420 tx=0x7fae3800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:05.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae49600640 1 -- 172.21.15.31:0/650902512 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38017070 con 0x7fae4c15a150 2024-09-17T05:29:05.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae49600640 1 -- 172.21.15.31:0/650902512 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae380053c0 con 0x7fae4c15a150 2024-09-17T05:29:05.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae49600640 1 -- 172.21.15.31:0/650902512 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38003860 con 0x7fae4c15a150 2024-09-17T05:29:05.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae54600640 1 -- 172.21.15.31:0/650902512 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae4c15d590 con 0x7fae4c15a150 2024-09-17T05:29:05.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.765+0000 7fae54600640 1 -- 172.21.15.31:0/650902512 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae4c154f50 con 0x7fae4c15a150 2024-09-17T05:29:05.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.769+0000 7fae54600640 1 -- 172.21.15.31:0/650902512 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae4c0cee00 con 0x7fae4c15a150 2024-09-17T05:29:05.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.769+0000 7fae49600640 1 -- 172.21.15.31:0/650902512 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fae3801a070 con 0x7fae4c15a150 2024-09-17T05:29:05.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.769+0000 7fae49600640 1 --2- 172.21.15.31:0/650902512 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fae2c073200 0x7fae2c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:05.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.769+0000 7fae49600640 1 -- 172.21.15.31:0/650902512 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fae38093610 con 0x7fae4c15a150 2024-09-17T05:29:05.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.769+0000 7fae51c00640 1 --2- 172.21.15.31:0/650902512 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fae2c073200 0x7fae2c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:05.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.769+0000 7fae51c00640 1 --2- 172.21.15.31:0/650902512 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fae2c073200 0x7fae2c0756c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fae400b0000 tx=0x7fae4001c470 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:05.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.773+0000 7fae49600640 1 -- 172.21.15.31:0/650902512 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fae3805e6b0 con 0x7fae4c15a150 2024-09-17T05:29:05.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.985+0000 7fae54600640 1 -- 172.21.15.31:0/650902512 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fae4c15d2b0 con 0x7fae4c15a150 2024-09-17T05:29:05.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.985+0000 7fae49600640 1 -- 172.21.15.31:0/650902512 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fae3805dfb0 con 0x7fae4c15a150 2024-09-17T05:29:05.991 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:29:05.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.989+0000 7fae54600640 1 -- 172.21.15.31:0/650902512 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fae2c073200 msgr2=0x7fae2c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:05.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.989+0000 7fae54600640 1 --2- 172.21.15.31:0/650902512 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fae2c073200 0x7fae2c0756c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fae400b0000 tx=0x7fae4001c470 comp rx=0 tx=0).stop 2024-09-17T05:29:05.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.989+0000 7fae54600640 1 -- 172.21.15.31:0/650902512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae4c15a150 msgr2=0x7fae4c1fbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:05.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.989+0000 7fae54600640 1 --2- 172.21.15.31:0/650902512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae4c15a150 0x7fae4c1fbb50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fae3800c420 tx=0x7fae3800c8e0 comp rx=0 tx=0).stop 2024-09-17T05:29:05.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.989+0000 7fae54600640 1 -- 172.21.15.31:0/650902512 shutdown_connections 2024-09-17T05:29:05.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.989+0000 7fae54600640 1 --2- 172.21.15.31:0/650902512 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fae2c073200 0x7fae2c0756c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:05.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.989+0000 7fae54600640 1 --2- 172.21.15.31:0/650902512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae4c15e8d0 0x7fae4c14be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:05.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.989+0000 7fae54600640 1 --2- 172.21.15.31:0/650902512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae4c15a150 0x7fae4c1fbb50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:05.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.989+0000 7fae54600640 1 --2- 172.21.15.31:0/650902512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae4c0ce9b0 0x7fae4c163370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:05.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.989+0000 7fae54600640 1 -- 172.21.15.31:0/650902512 >> 172.21.15.31:0/650902512 conn(0x7fae4c0b2060 msgr2=0x7fae4c06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:05.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.989+0000 7fae54600640 1 -- 172.21.15.31:0/650902512 shutdown_connections 2024-09-17T05:29:05.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:05.989+0000 7fae54600640 1 -- 172.21.15.31:0/650902512 wait complete. 2024-09-17T05:29:06.012 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:29:06.012 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:29:06.012 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-17T05:29:06.013 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-17T05:29:06.013 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T05:29:06.013 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:29:06.013 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:29:06.013 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:29:06.013 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-17T05:29:06.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:06.014 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-17T05:29:06.022 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:29:06.022 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:29:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:29:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-17T05:29:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:06.023 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:29:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-17T05:29:06.023 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:29:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-17T05:29:06.023 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:29:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-17T05:29:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:29:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42407sec preferred_lft 42407sec 2024-09-17T05:29:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-17T05:29:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:06.024 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:29:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-17T05:29:06.024 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:29:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:fe:f3:3e:aa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:29:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:06.025 INFO:teuthology.orchestra.run.smithi031.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:29:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:29:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:29:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:06.025 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:29:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:29:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:29:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:06.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:06.026 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:29:06.088 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-17T05:29:06.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:06.091 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-17T05:29:06.140 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-17T05:29:06.141 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:29:06.144 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:29:06.145 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:29:06.145 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:29:06.145 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:29:06.145 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:06.145 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:29:06.145 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:29:06.146 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:29:06.146 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:29:06.146 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:29:06.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:06.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:06.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:06.280 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T05:29:06.290 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:29:06.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:06.291 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list-id 2024-09-17T05:29:06.338 INFO:teuthology.orchestra.run.smithi031.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-17T05:29:06.339 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:06.340 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:29:06.340 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:29:06.340 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-17T05:29:06.340 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:29:06.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:06.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:06.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:06.472 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T05:29:06.493 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:29:06.494 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:29:06.494 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:29:06.494 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:06.494 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-17T05:29:06.495 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:06.495 INFO:teuthology.orchestra.run.smithi031.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:29:06.495 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 76:ca:1f:86:13:57 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:29:06.495 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:29:06.495 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:06.496 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::74ca:1fff:fe86:1357/64 scope link 2024-09-17T05:29:06.496 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:06.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:06.498 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T05:29:06.559 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:29:06.559 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:29:06.559 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:29:06.559 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:06.559 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-17T05:29:06.559 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:06.559 INFO:teuthology.orchestra.run.smithi031.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:29:06.560 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 76:ca:1f:86:13:57 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:29:06.560 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:29:06.560 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:06.560 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::74ca:1fff:fe86:1357/64 scope link 2024-09-17T05:29:06.560 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:06.561 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-17T05:29:06.561 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:06.561 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:29:06.561 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-17T05:29:06.561 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T05:29:06.561 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-17T05:29:06.562 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-17T05:29:06.562 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-17T05:29:06.562 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:29:06.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:06.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:06.742 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:06.742 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:29:06.742 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.1 up 2024-09-17T05:29:06.742 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T05:29:06.742 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:29:06.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:06.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:06.828 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:29:06.828 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-17T05:29:06.879 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-17T05:29:06.880 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:29:06.880 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-17T05:29:06.935 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-17T05:29:06.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:06.936 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:29:07.029 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:29:07.029 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:29:07.043 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:29:07.043 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:29:07.043 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:29:07.043 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 2@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:29:07.043 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:29:07.047 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:29:07.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:07.047 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-17T05:29:07.066 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:29:07.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:29:07.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:07.168 INFO:teuthology.orchestra.run.smithi031.stdout:client4708 2024-09-17T05:29:07.169 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:29:07.169 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:07.178 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:29:07.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:29:07.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:07.275 INFO:teuthology.orchestra.run.smithi031.stdout:client4708 2024-09-17T05:29:07.276 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:29:07.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:29:07.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:07.333 INFO:teuthology.orchestra.run.smithi031.stdout:client4708 2024-09-17T05:29:07.333 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/b668cd1d-3036-4a29-9e5a-69d0df5776a8.client4708/status') 2024-09-17T05:29:07.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:07.395 INFO:teuthology.orchestra.run.smithi031.stdout:instance: client.4708 (3)172.21.15.31:0/3302871322 2024-09-17T05:29:07.395 INFO:teuthology.orchestra.run.smithi031.stdout:blocklisted: false 2024-09-17T05:29:07.395 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records in 2024-09-17T05:29:07.395 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records out 2024-09-17T05:29:07.395 INFO:teuthology.orchestra.run.smithi031.stderr:70 bytes copied, 5.2138e-05 s, 1.3 MB/s 2024-09-17T05:29:07.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:07.403 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-17T05:29:07.403 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:29:07.403 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:29:07.403 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:29:07.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.545+0000 7f5562000640 1 -- 172.21.15.31:0/3424008919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5544003fe0 msgr2=0x7f5544004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:07.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.545+0000 7f5562000640 1 --2- 172.21.15.31:0/3424008919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5544003fe0 0x7f5544004810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f554800c2e0 tx=0x7f554801f6c0 comp rx=0 tx=0).stop 2024-09-17T05:29:07.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.545+0000 7f5561600640 1 -- 172.21.15.31:0/3424008919 reap_dead start 2024-09-17T05:29:07.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.545+0000 7f5562000640 1 -- 172.21.15.31:0/3424008919 shutdown_connections 2024-09-17T05:29:07.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.545+0000 7f5562000640 1 -- 172.21.15.31:0/3424008919 >> 172.21.15.31:0/3424008919 conn(0x7f555c073490 msgr2=0x7f555c0d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:07.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.545+0000 7f5562000640 1 -- 172.21.15.31:0/3424008919 shutdown_connections 2024-09-17T05:29:07.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.545+0000 7f5562000640 1 -- 172.21.15.31:0/3424008919 wait complete. 2024-09-17T05:29:07.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5562000640 1 Processor -- start 2024-09-17T05:29:07.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5562000640 1 -- start start 2024-09-17T05:29:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5562000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5544003fe0 0x7f555c09aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5562000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f555c1f60b0 0x7f555c0c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5562000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c0c9270 0x7f555c0b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5562000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f555c0cd290 con 0x7f555c0c9270 2024-09-17T05:29:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5562000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f555c0cd110 con 0x7f5544003fe0 2024-09-17T05:29:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5562000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f555c0cd410 con 0x7f555c1f60b0 2024-09-17T05:29:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5561600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c0c9270 0x7f555c0b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5561600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c0c9270 0x7f555c0b0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59838/0 (socket says 172.21.15.31:59838) 2024-09-17T05:29:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5561600640 1 -- 172.21.15.31:0/896018531 learned_addr learned my addr 172.21.15.31:0/896018531 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5560c00640 1 --2- 172.21.15.31:0/896018531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5544003fe0 0x7f555c09aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:07.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f555be00640 1 --2- 172.21.15.31:0/896018531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f555c1f60b0 0x7f555c0c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5561600640 1 -- 172.21.15.31:0/896018531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f555c1f60b0 msgr2=0x7f555c0c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5561600640 1 --2- 172.21.15.31:0/896018531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f555c1f60b0 0x7f555c0c6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5561600640 1 -- 172.21.15.31:0/896018531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5544003fe0 msgr2=0x7f555c09aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5561600640 1 --2- 172.21.15.31:0/896018531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5544003fe0 0x7f555c09aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5561600640 1 -- 172.21.15.31:0/896018531 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555c09afe0 con 0x7f555c0c9270 2024-09-17T05:29:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5561600640 1 --2- 172.21.15.31:0/896018531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c0c9270 0x7f555c0b0f10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f555c072ee0 tx=0x7f5554009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5558c00640 1 -- 172.21.15.31:0/896018531 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555400fce0 con 0x7f555c0c9270 2024-09-17T05:29:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5558c00640 1 -- 172.21.15.31:0/896018531 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f555400fe80 con 0x7f555c0c9270 2024-09-17T05:29:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5558c00640 1 -- 172.21.15.31:0/896018531 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554004d70 con 0x7f555c0c9270 2024-09-17T05:29:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5562000640 1 -- 172.21.15.31:0/896018531 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555c09c740 con 0x7f555c0c9270 2024-09-17T05:29:07.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.549+0000 7f5562000640 1 -- 172.21.15.31:0/896018531 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f555c09cd00 con 0x7f555c0c9270 2024-09-17T05:29:07.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.553+0000 7f5562000640 1 -- 172.21.15.31:0/896018531 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f555c068ce0 con 0x7f555c0c9270 2024-09-17T05:29:07.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.553+0000 7f5558c00640 1 -- 172.21.15.31:0/896018531 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f5554020020 con 0x7f555c0c9270 2024-09-17T05:29:07.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.553+0000 7f5558c00640 1 --2- 172.21.15.31:0/896018531 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f553c073230 0x7f553c0756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:07.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.553+0000 7f5558c00640 1 -- 172.21.15.31:0/896018531 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f55540948e0 con 0x7f555c0c9270 2024-09-17T05:29:07.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.553+0000 7f5560c00640 1 --2- 172.21.15.31:0/896018531 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f553c073230 0x7f553c0756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:07.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.553+0000 7f5560c00640 1 --2- 172.21.15.31:0/896018531 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f553c073230 0x7f553c0756f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5550009cc0 tx=0x7f55500091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:07.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.557+0000 7f5558c00640 1 -- 172.21.15.31:0/896018531 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f555405f8f0 con 0x7f555c0c9270 2024-09-17T05:29:07.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.773+0000 7f5562000640 1 -- 172.21.15.31:0/896018531 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f555c0b22e0 con 0x7f555c0c9270 2024-09-17T05:29:07.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.773+0000 7f5558c00640 1 -- 172.21.15.31:0/896018531 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f555405f1f0 con 0x7f555c0c9270 2024-09-17T05:29:07.777 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:29:07.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.773+0000 7f5562000640 1 -- 172.21.15.31:0/896018531 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f553c073230 msgr2=0x7f553c0756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:07.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.773+0000 7f5562000640 1 --2- 172.21.15.31:0/896018531 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f553c073230 0x7f553c0756f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5550009cc0 tx=0x7f55500091e0 comp rx=0 tx=0).stop 2024-09-17T05:29:07.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.773+0000 7f5562000640 1 -- 172.21.15.31:0/896018531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c0c9270 msgr2=0x7f555c0b0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:07.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.773+0000 7f5562000640 1 --2- 172.21.15.31:0/896018531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c0c9270 0x7f555c0b0f10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f555c072ee0 tx=0x7f5554009200 comp rx=0 tx=0).stop 2024-09-17T05:29:07.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.773+0000 7f5562000640 1 -- 172.21.15.31:0/896018531 shutdown_connections 2024-09-17T05:29:07.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.773+0000 7f5562000640 1 --2- 172.21.15.31:0/896018531 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f553c073230 0x7f553c0756f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:07.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.773+0000 7f5562000640 1 --2- 172.21.15.31:0/896018531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555c0c9270 0x7f555c0b0f10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:07.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.773+0000 7f5562000640 1 --2- 172.21.15.31:0/896018531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f555c1f60b0 0x7f555c0c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:07.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.773+0000 7f5562000640 1 --2- 172.21.15.31:0/896018531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5544003fe0 0x7f555c09aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:07.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.773+0000 7f5562000640 1 -- 172.21.15.31:0/896018531 >> 172.21.15.31:0/896018531 conn(0x7f555c073490 msgr2=0x7f555c0b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:07.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.773+0000 7f5562000640 1 -- 172.21.15.31:0/896018531 shutdown_connections 2024-09-17T05:29:07.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:07.773+0000 7f5562000640 1 -- 172.21.15.31:0/896018531 wait complete. 2024-09-17T05:29:07.797 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:29:07.798 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:29:07.798 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-09-17T05:29:07.798 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:29:07.798 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:29:07.798 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:29:07.798 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:29:07.798 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:29:07.798 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:29:07.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:07.798 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-09-17T05:29:07.809 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:29:07.809 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:29:07.809 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:29:07.809 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:07.809 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-17T05:29:07.809 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:07.809 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:29:07.809 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:07.810 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-09-17T05:29:07.810 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:29:07.810 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:07.810 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-09-17T05:29:07.810 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:29:07.810 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:07.810 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:29:07.810 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:07.810 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-17T05:29:07.810 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42408sec preferred_lft 42408sec 2024-09-17T05:29:07.810 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-09-17T05:29:07.810 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:07.811 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:29:07.811 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:84:cd:fc:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:07.811 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:29:07.811 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:07.811 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T05:29:07.811 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:07.811 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:29:07.811 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add name ceph-brx type bridge 2024-09-17T05:29:07.811 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr flush dev ceph-brx 2024-09-17T05:29:07.812 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set ceph-brx up 2024-09-17T05:29:07.812 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T05:29:07.812 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:29:07.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:07.967 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:07.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:07.974 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:29:07.993 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-17T05:29:07.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:07.995 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-09-17T05:29:08.072 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-09-17T05:29:08.072 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:29:08.072 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-17T05:29:08.072 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:29:08.073 INFO:teuthology.orchestra.run.smithi155.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-17T05:29:08.073 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:29:08.073 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:29:08.073 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:29:08.073 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:29:08.073 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:29:08.073 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:29:08.073 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:08.073 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:29:08.074 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:29:08.074 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:29:08.074 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:29:08.074 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:29:08.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:08.203 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:08.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:08.210 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-17T05:29:08.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:08.219 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2024-09-17T05:29:08.268 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:08.268 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:29:08.268 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:29:08.269 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T05:29:08.269 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:29:08.357 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:08.389 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:08.396 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T05:29:08.396 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:08.396 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:29:08.397 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T05:29:08.397 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T05:29:08.397 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T05:29:08.397 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T05:29:08.397 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T05:29:08.397 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:29:08.443 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:08.583 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:08.593 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:08.594 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:29:08.594 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-09-17T05:29:08.594 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T05:29:08.594 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:29:08.684 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:08.714 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:08.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:29:08.721 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:29:08.729 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:29:08.729 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:29:08.730 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:29:08.779 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-17T05:29:08.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:08.780 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:29:08.872 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:29:08.872 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:29:09.555 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:29:09.556 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:29:09.556 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:29:09.556 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:29:09.556 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:29:09.560 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:29:09.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:09.560 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:29:09.581 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:29:09.675 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:29:09.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:09.699 INFO:teuthology.orchestra.run.smithi155.stdout:client4547 2024-09-17T05:29:09.699 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:29:09.699 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:09.708 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:29:09.796 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:29:09.799 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:09.805 INFO:teuthology.orchestra.run.smithi155.stdout:client4547 2024-09-17T05:29:09.806 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:29:09.852 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:29:09.855 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:09.861 INFO:teuthology.orchestra.run.smithi155.stdout:client4547 2024-09-17T05:29:09.862 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/b668cd1d-3036-4a29-9e5a-69d0df5776a8.client4547/status') 2024-09-17T05:29:09.953 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:09.965 INFO:teuthology.orchestra.run.smithi155.stdout:instance: client.4547 (3)192.168.0.1:0/3008463335 2024-09-17T05:29:09.965 INFO:teuthology.orchestra.run.smithi155.stdout:blocklisted: false 2024-09-17T05:29:09.965 INFO:teuthology.orchestra.run.smithi155.stderr:0+1 records in 2024-09-17T05:29:09.965 INFO:teuthology.orchestra.run.smithi155.stderr:0+1 records out 2024-09-17T05:29:09.966 INFO:teuthology.orchestra.run.smithi155.stderr:69 bytes copied, 5.2261e-05 s, 1.3 MB/s 2024-09-17T05:29:09.966 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:09.974 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-17T05:29:09.974 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:29:09.974 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T05:29:09.974 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:29:10.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.133+0000 7fb266200640 1 -- 172.21.15.31:0/2647129111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2600cefb0 msgr2=0x7fb2600cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:10.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.133+0000 7fb266200640 1 --2- 172.21.15.31:0/2647129111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2600cefb0 0x7fb2600cc5b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb2600b1640 tx=0x7fb24c01c830 comp rx=0 tx=0).stop 2024-09-17T05:29:10.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.133+0000 7fb266200640 1 -- 172.21.15.31:0/2647129111 shutdown_connections 2024-09-17T05:29:10.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.133+0000 7fb266200640 1 --2- 172.21.15.31:0/2647129111 >> v2:172.21.15.155:3300/0 conn(0x7fb2600ccaf0 0x7fb2600b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:10.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.133+0000 7fb266200640 1 --2- 172.21.15.31:0/2647129111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2600cefb0 0x7fb2600cc5b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:10.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.133+0000 7fb266200640 1 --2- 172.21.15.31:0/2647129111 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb26015f000 0x7fb2600d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:10.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.133+0000 7fb266200640 1 -- 172.21.15.31:0/2647129111 >> 172.21.15.31:0/2647129111 conn(0x7fb26009aa10 msgr2=0x7fb26009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:10.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.133+0000 7fb266200640 1 -- 172.21.15.31:0/2647129111 shutdown_connections 2024-09-17T05:29:10.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.133+0000 7fb266200640 1 -- 172.21.15.31:0/2647129111 wait complete. 2024-09-17T05:29:10.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.133+0000 7fb266200640 1 Processor -- start 2024-09-17T05:29:10.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.133+0000 7fb266200640 1 -- start start 2024-09-17T05:29:10.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.133+0000 7fb266200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2600ccaf0 0x7fb2600afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:10.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.133+0000 7fb266200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2600cefb0 0x7fb260154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:10.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.133+0000 7fb266200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb26015f000 0x7fb26015c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:10.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.133+0000 7fb266200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb26015ff80 con 0x7fb26015f000 2024-09-17T05:29:10.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.133+0000 7fb266200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb26015fe00 con 0x7fb2600ccaf0 2024-09-17T05:29:10.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.133+0000 7fb266200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb260160100 con 0x7fb2600cefb0 2024-09-17T05:29:10.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.133+0000 7fb265800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb26015f000 0x7fb26015c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:10.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.137+0000 7fb265800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb26015f000 0x7fb26015c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48492/0 (socket says 172.21.15.31:48492) 2024-09-17T05:29:10.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.137+0000 7fb25fe00640 1 --2- 172.21.15.31:0/2745909072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2600cefb0 0x7fb260154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:10.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.137+0000 7fb264e00640 1 --2- 172.21.15.31:0/2745909072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2600ccaf0 0x7fb2600afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:10.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.137+0000 7fb265800640 1 -- 172.21.15.31:0/2745909072 learned_addr learned my addr 172.21.15.31:0/2745909072 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:10.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.137+0000 7fb25fe00640 1 -- 172.21.15.31:0/2745909072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2600ccaf0 msgr2=0x7fb2600afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:10.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.137+0000 7fb25fe00640 1 --2- 172.21.15.31:0/2745909072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2600ccaf0 0x7fb2600afec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:10.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.137+0000 7fb25fe00640 1 -- 172.21.15.31:0/2745909072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb26015f000 msgr2=0x7fb26015c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:10.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.137+0000 7fb25fe00640 1 --2- 172.21.15.31:0/2745909072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb26015f000 0x7fb26015c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:10.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.137+0000 7fb25fe00640 1 -- 172.21.15.31:0/2745909072 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2600ce8b0 con 0x7fb2600cefb0 2024-09-17T05:29:10.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.137+0000 7fb265800640 1 --2- 172.21.15.31:0/2745909072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb26015f000 0x7fb26015c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:29:10.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.137+0000 7fb25fe00640 1 --2- 172.21.15.31:0/2745909072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2600cefb0 0x7fb260154a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0ac000 tx=0x7fb24c0a66a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:10.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.137+0000 7fb25cc00640 1 -- 172.21.15.31:0/2745909072 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c0042c0 con 0x7fb2600cefb0 2024-09-17T05:29:10.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.137+0000 7fb25cc00640 1 -- 172.21.15.31:0/2745909072 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb24c005030 con 0x7fb2600cefb0 2024-09-17T05:29:10.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.137+0000 7fb266200640 1 -- 172.21.15.31:0/2745909072 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb260071850 con 0x7fb2600cefb0 2024-09-17T05:29:10.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.137+0000 7fb25cc00640 1 -- 172.21.15.31:0/2745909072 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c005480 con 0x7fb2600cefb0 2024-09-17T05:29:10.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.137+0000 7fb266200640 1 -- 172.21.15.31:0/2745909072 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2600b75a0 con 0x7fb2600cefb0 2024-09-17T05:29:10.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.137+0000 7fb266200640 1 -- 172.21.15.31:0/2745909072 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2600cc5b0 con 0x7fb2600cefb0 2024-09-17T05:29:10.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.137+0000 7fb25cc00640 1 -- 172.21.15.31:0/2745909072 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb24c0a6810 con 0x7fb2600cefb0 2024-09-17T05:29:10.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.141+0000 7fb25cc00640 1 --2- 172.21.15.31:0/2745909072 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb240073200 0x7fb2400756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:10.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.141+0000 7fb25cc00640 1 -- 172.21.15.31:0/2745909072 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb24c12e0c0 con 0x7fb2600cefb0 2024-09-17T05:29:10.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.141+0000 7fb264e00640 1 --2- 172.21.15.31:0/2745909072 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb240073200 0x7fb2400756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:10.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.141+0000 7fb264e00640 1 --2- 172.21.15.31:0/2745909072 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb240073200 0x7fb2400756c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb25000bb50 tx=0x7fb25000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:10.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.141+0000 7fb25cc00640 1 -- 172.21.15.31:0/2745909072 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb24c0bf060 con 0x7fb2600cefb0 2024-09-17T05:29:10.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.361+0000 7fb266200640 1 -- 172.21.15.31:0/2745909072 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb2600b0400 con 0x7fb2600cefb0 2024-09-17T05:29:10.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.361+0000 7fb25cc00640 1 -- 172.21.15.31:0/2745909072 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fb24c0164b0 con 0x7fb2600cefb0 2024-09-17T05:29:10.366 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:29:10.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.365+0000 7fb266200640 1 -- 172.21.15.31:0/2745909072 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb240073200 msgr2=0x7fb2400756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:10.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.365+0000 7fb266200640 1 --2- 172.21.15.31:0/2745909072 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb240073200 0x7fb2400756c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb25000bb50 tx=0x7fb25000b2e0 comp rx=0 tx=0).stop 2024-09-17T05:29:10.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.365+0000 7fb266200640 1 -- 172.21.15.31:0/2745909072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2600cefb0 msgr2=0x7fb260154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:10.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.365+0000 7fb266200640 1 --2- 172.21.15.31:0/2745909072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2600cefb0 0x7fb260154a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0ac000 tx=0x7fb24c0a66a0 comp rx=0 tx=0).stop 2024-09-17T05:29:10.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.365+0000 7fb266200640 1 -- 172.21.15.31:0/2745909072 shutdown_connections 2024-09-17T05:29:10.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.365+0000 7fb266200640 1 --2- 172.21.15.31:0/2745909072 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb240073200 0x7fb2400756c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:10.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.365+0000 7fb266200640 1 --2- 172.21.15.31:0/2745909072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb26015f000 0x7fb26015c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:10.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.365+0000 7fb266200640 1 --2- 172.21.15.31:0/2745909072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2600cefb0 0x7fb260154a10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:10.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.365+0000 7fb266200640 1 --2- 172.21.15.31:0/2745909072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2600ccaf0 0x7fb2600afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:10.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.365+0000 7fb266200640 1 -- 172.21.15.31:0/2745909072 >> 172.21.15.31:0/2745909072 conn(0x7fb26009aa10 msgr2=0x7fb2600ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:10.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.365+0000 7fb266200640 1 -- 172.21.15.31:0/2745909072 shutdown_connections 2024-09-17T05:29:10.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:10.365+0000 7fb266200640 1 -- 172.21.15.31:0/2745909072 wait complete. 2024-09-17T05:29:10.387 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:29:10.387 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:29:10.387 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-09-17T05:29:10.387 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-17T05:29:10.387 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T05:29:10.387 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:29:10.387 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:29:10.387 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:29:10.387 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-17T05:29:10.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:10.388 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-09-17T05:29:10.396 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:29:10.396 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:29:10.397 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:29:10.397 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:10.397 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-17T05:29:10.397 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:10.397 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:29:10.397 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:10.397 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-09-17T05:29:10.397 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:29:10.397 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:10.397 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-09-17T05:29:10.397 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:29:10.398 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:10.398 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:29:10.398 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:10.398 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-17T05:29:10.398 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42405sec preferred_lft 42405sec 2024-09-17T05:29:10.398 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-09-17T05:29:10.398 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:10.398 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:29:10.398 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:84:cd:fc:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:10.398 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:29:10.398 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:10.398 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:29:10.399 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:10.399 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:29:10.399 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:10.399 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-09-17T05:29:10.399 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:10.399 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:29:10.399 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:29:10.399 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-09-17T05:29:10.399 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:10.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:10.400 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:29:10.461 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-17T05:29:10.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:10.464 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-09-17T05:29:10.516 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-09-17T05:29:10.516 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:29:10.516 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-17T05:29:10.516 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:29:10.516 INFO:teuthology.orchestra.run.smithi155.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-17T05:29:10.516 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:29:10.516 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:29:10.516 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:29:10.516 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:29:10.516 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:29:10.516 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:29:10.517 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:10.517 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:29:10.517 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:29:10.517 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:29:10.517 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:29:10.517 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:29:10.606 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:10.647 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:10.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:10.654 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-17T05:29:10.704 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:29:10.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:10.705 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2024-09-17T05:29:10.756 INFO:teuthology.orchestra.run.smithi155.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-17T05:29:10.757 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:10.757 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:29:10.757 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:29:10.757 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-17T05:29:10.757 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:29:10.847 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:10.877 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:10.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:10.884 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T05:29:10.905 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:29:10.905 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:29:10.905 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:29:10.906 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:10.906 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-17T05:29:10.906 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:10.906 INFO:teuthology.orchestra.run.smithi155.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:29:10.906 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether a6:a3:52:75:f0:00 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:29:10.906 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:29:10.906 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:10.906 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::a4a3:52ff:fe75:f000/64 scope link 2024-09-17T05:29:10.906 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:10.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:10.907 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T05:29:10.971 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:29:10.972 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:29:10.972 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:29:10.972 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:10.972 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-17T05:29:10.972 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:10.972 INFO:teuthology.orchestra.run.smithi155.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:29:10.972 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether a6:a3:52:75:f0:00 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:29:10.972 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:29:10.972 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:10.972 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::a4a3:52ff:fe75:f000/64 scope link 2024-09-17T05:29:10.973 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:10.977 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-17T05:29:10.977 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:10.977 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:29:10.977 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-17T05:29:10.977 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T05:29:10.978 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-17T05:29:10.978 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-17T05:29:10.978 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-17T05:29:10.978 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:29:11.066 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:11.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:11.154 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:11.154 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:29:11.155 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.1 up 2024-09-17T05:29:11.155 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T05:29:11.155 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:29:11.202 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:11.233 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:11.240 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:29:11.240 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-17T05:29:11.248 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-17T05:29:11.249 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:29:11.249 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-17T05:29:11.303 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-17T05:29:11.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:11.304 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:29:11.391 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:29:11.392 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:29:11.406 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:29:11.406 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:29:11.406 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:29:11.406 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 3@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:29:11.406 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:29:11.409 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:29:11.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:11.410 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-17T05:29:11.428 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:29:11.523 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:29:11.527 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:11.533 INFO:teuthology.orchestra.run.smithi155.stdout:client4723 2024-09-17T05:29:11.534 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:29:11.534 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:11.542 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:29:11.633 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:29:11.636 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:11.642 INFO:teuthology.orchestra.run.smithi155.stdout:client4723 2024-09-17T05:29:11.642 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:29:11.661 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:29:11.664 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:29:11.688 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:29:11.692 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:11.699 INFO:teuthology.orchestra.run.smithi155.stdout:client4723 2024-09-17T05:29:11.699 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/b668cd1d-3036-4a29-9e5a-69d0df5776a8.client4723/status') 2024-09-17T05:29:11.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:11.841 INFO:teuthology.orchestra.run.smithi155.stdout:instance: client.4723 (3)192.168.0.2:0/697268414 2024-09-17T05:29:11.841 INFO:teuthology.orchestra.run.smithi155.stdout:blocklisted: false 2024-09-17T05:29:11.841 INFO:teuthology.orchestra.run.smithi155.stderr:0+1 records in 2024-09-17T05:29:11.842 INFO:teuthology.orchestra.run.smithi155.stderr:0+1 records out 2024-09-17T05:29:11.842 INFO:teuthology.orchestra.run.smithi155.stderr:68 bytes copied, 6.3301e-05 s, 1.1 MB/s 2024-09-17T05:29:11.842 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:11.849 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-17T05:29:12.013 INFO:tasks.cephfs_test_runner:Starting test: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate binary .meta file on legacy subvol root doesn't break the system 2024-09-17T05:29:12.013 INFO:tasks.cephfs_test_runner:test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:29:12.014 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:29:12.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.169+0000 7f5785a00640 1 -- 172.21.15.31:0/1157136022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f578015dae0 msgr2=0x7f57800acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:12.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.169+0000 7f5785a00640 1 --2- 172.21.15.31:0/1157136022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f578015dae0 0x7f57800acd40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f57800af800 tx=0x7f577001c830 comp rx=0 tx=0).stop 2024-09-17T05:29:12.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.169+0000 7f5785a00640 1 -- 172.21.15.31:0/1157136022 shutdown_connections 2024-09-17T05:29:12.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.169+0000 7f5785a00640 1 --2- 172.21.15.31:0/1157136022 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57800b4810 0x7f57800ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.169+0000 7f5785a00640 1 --2- 172.21.15.31:0/1157136022 >> v2:172.21.15.155:3300/0 conn(0x7f57800cd100 0x7f57800b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.169+0000 7f5785a00640 1 --2- 172.21.15.31:0/1157136022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f578015dae0 0x7f57800acd40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.169+0000 7f5785a00640 1 -- 172.21.15.31:0/1157136022 >> 172.21.15.31:0/1157136022 conn(0x7f57800b18f0 msgr2=0x7f57800b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:12.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.169+0000 7f5785a00640 1 -- 172.21.15.31:0/1157136022 shutdown_connections 2024-09-17T05:29:12.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.169+0000 7f5785a00640 1 -- 172.21.15.31:0/1157136022 wait complete. 2024-09-17T05:29:12.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.169+0000 7f5785a00640 1 Processor -- start 2024-09-17T05:29:12.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.169+0000 7f5785a00640 1 -- start start 2024-09-17T05:29:12.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.169+0000 7f5785a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57800b4810 0x7f57800cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:12.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.169+0000 7f5785a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57800cd100 0x7f5780149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:12.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.169+0000 7f5785a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f578015dae0 0x7f578015b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:12.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.169+0000 7f5785a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f57800cf3c0 con 0x7f57800cd100 2024-09-17T05:29:12.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.169+0000 7f5785a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f57800cf240 con 0x7f578015dae0 2024-09-17T05:29:12.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.169+0000 7f5785a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f57800cf540 con 0x7f57800b4810 2024-09-17T05:29:12.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f5777e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57800cd100 0x7f5780149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:12.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f5777e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57800cd100 0x7f5780149d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48510/0 (socket says 172.21.15.31:48510) 2024-09-17T05:29:12.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f5777e00640 1 -- 172.21.15.31:0/2562285413 learned_addr learned my addr 172.21.15.31:0/2562285413 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:12.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f577f400640 1 --2- 172.21.15.31:0/2562285413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f578015dae0 0x7f578015b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:12.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f577ea00640 1 --2- 172.21.15.31:0/2562285413 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57800b4810 0x7f57800cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:12.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f5777e00640 1 -- 172.21.15.31:0/2562285413 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57800b4810 msgr2=0x7f57800cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:12.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f5777e00640 1 --2- 172.21.15.31:0/2562285413 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57800b4810 0x7f57800cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f5777e00640 1 -- 172.21.15.31:0/2562285413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f578015dae0 msgr2=0x7f578015b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:12.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f5777e00640 1 --2- 172.21.15.31:0/2562285413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f578015dae0 0x7f578015b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f5777e00640 1 -- 172.21.15.31:0/2562285413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578015bb80 con 0x7f57800cd100 2024-09-17T05:29:12.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f577f400640 1 --2- 172.21.15.31:0/2562285413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f578015dae0 0x7f578015b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:12.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f577ea00640 1 --2- 172.21.15.31:0/2562285413 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57800b4810 0x7f57800cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:29:12.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f5777e00640 1 --2- 172.21.15.31:0/2562285413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57800cd100 0x7f5780149d70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f576800c970 tx=0x7f576800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:12.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f5776a00640 1 -- 172.21.15.31:0/2562285413 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5768007c70 con 0x7f57800cd100 2024-09-17T05:29:12.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f5776a00640 1 -- 172.21.15.31:0/2562285413 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f576800f450 con 0x7f57800cd100 2024-09-17T05:29:12.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f5776a00640 1 -- 172.21.15.31:0/2562285413 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576800f8a0 con 0x7f57800cd100 2024-09-17T05:29:12.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f5785a00640 1 -- 172.21.15.31:0/2562285413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578015be60 con 0x7f57800cd100 2024-09-17T05:29:12.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f5785a00640 1 -- 172.21.15.31:0/2562285413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5780149850 con 0x7f57800cd100 2024-09-17T05:29:12.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f5785a00640 1 -- 172.21.15.31:0/2562285413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5780069410 con 0x7f57800cd100 2024-09-17T05:29:12.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.173+0000 7f5776a00640 1 -- 172.21.15.31:0/2562285413 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f576800fa40 con 0x7f57800cd100 2024-09-17T05:29:12.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.177+0000 7f5776a00640 1 --2- 172.21.15.31:0/2562285413 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f575c073200 0x7f575c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:12.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.177+0000 7f5776a00640 1 -- 172.21.15.31:0/2562285413 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5768094aa0 con 0x7f57800cd100 2024-09-17T05:29:12.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.177+0000 7f577ea00640 1 --2- 172.21.15.31:0/2562285413 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f575c073200 0x7f575c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:12.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.177+0000 7f577ea00640 1 --2- 172.21.15.31:0/2562285413 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f575c073200 0x7f575c0756c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f57700af000 tx=0x7f577001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:12.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.181+0000 7f5776a00640 1 -- 172.21.15.31:0/2562285413 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5768014030 con 0x7f57800cd100 2024-09-17T05:29:12.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.357+0000 7f5785a00640 1 -- 172.21.15.31:0/2562285413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5780074570 con 0x7f57800cd100 2024-09-17T05:29:12.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.357+0000 7f5776a00640 1 -- 172.21.15.31:0/2562285413 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16689 (secure 0 0 0) 0x7f576805fab0 con 0x7f57800cd100 2024-09-17T05:29:12.363 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:12.363 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":21,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:28:46.650201+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:28:42.906739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:28:44.023489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:29:12.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.361+0000 7f5785a00640 1 -- 172.21.15.31:0/2562285413 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f575c073200 msgr2=0x7f575c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:12.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.361+0000 7f5785a00640 1 --2- 172.21.15.31:0/2562285413 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f575c073200 0x7f575c0756c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f57700af000 tx=0x7f577001b070 comp rx=0 tx=0).stop 2024-09-17T05:29:12.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.361+0000 7f5785a00640 1 -- 172.21.15.31:0/2562285413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57800cd100 msgr2=0x7f5780149d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:12.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.361+0000 7f5785a00640 1 --2- 172.21.15.31:0/2562285413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57800cd100 0x7f5780149d70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f576800c970 tx=0x7f576800ce30 comp rx=0 tx=0).stop 2024-09-17T05:29:12.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.361+0000 7f5785a00640 1 -- 172.21.15.31:0/2562285413 shutdown_connections 2024-09-17T05:29:12.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.361+0000 7f5785a00640 1 --2- 172.21.15.31:0/2562285413 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f575c073200 0x7f575c0756c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.361+0000 7f5785a00640 1 --2- 172.21.15.31:0/2562285413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f578015dae0 0x7f578015b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.361+0000 7f5785a00640 1 --2- 172.21.15.31:0/2562285413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57800cd100 0x7f5780149d70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.361+0000 7f5785a00640 1 --2- 172.21.15.31:0/2562285413 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57800b4810 0x7f57800cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.361+0000 7f5785a00640 1 -- 172.21.15.31:0/2562285413 >> 172.21.15.31:0/2562285413 conn(0x7f57800b18f0 msgr2=0x7f5780073b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:12.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.361+0000 7f5785a00640 1 -- 172.21.15.31:0/2562285413 shutdown_connections 2024-09-17T05:29:12.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.361+0000 7f5785a00640 1 -- 172.21.15.31:0/2562285413 wait complete. 2024-09-17T05:29:12.385 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:28:33.209612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T05:28:42.906739+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T05:28:44.023489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:29:12.385 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:29:12.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.529+0000 7fce26e00640 1 -- 172.21.15.31:0/1274674330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce200b2e50 msgr2=0x7fce201657b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:12.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.529+0000 7fce26e00640 1 --2- 172.21.15.31:0/1274674330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce200b2e50 0x7fce201657b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fce18009840 tx=0x7fce1801c710 comp rx=0 tx=0).stop 2024-09-17T05:29:12.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.529+0000 7fce26e00640 1 -- 172.21.15.31:0/1274674330 shutdown_connections 2024-09-17T05:29:12.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.529+0000 7fce26e00640 1 --2- 172.21.15.31:0/1274674330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce200b2e50 0x7fce201657b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.529+0000 7fce26e00640 1 -- 172.21.15.31:0/1274674330 >> 172.21.15.31:0/1274674330 conn(0x7fce200cd740 msgr2=0x7fce200cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:12.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.529+0000 7fce26e00640 1 -- 172.21.15.31:0/1274674330 shutdown_connections 2024-09-17T05:29:12.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.529+0000 7fce26e00640 1 -- 172.21.15.31:0/1274674330 wait complete. 2024-09-17T05:29:12.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce26e00640 1 Processor -- start 2024-09-17T05:29:12.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce26e00640 1 -- start start 2024-09-17T05:29:12.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce26e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce200b2e50 0x7fce20153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:12.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce26e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce200cf2a0 0x7fce201528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:12.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce26e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce2015ac70 0x7fce200c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:12.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce26e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fce20168b70 con 0x7fce2015ac70 2024-09-17T05:29:12.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce26e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce201689f0 con 0x7fce200cf2a0 2024-09-17T05:29:12.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce26e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fce20168cf0 con 0x7fce200b2e50 2024-09-17T05:29:12.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce24e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce2015ac70 0x7fce200c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:12.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce24e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce2015ac70 0x7fce200c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48512/0 (socket says 172.21.15.31:48512) 2024-09-17T05:29:12.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce24e00640 1 -- 172.21.15.31:0/648921165 learned_addr learned my addr 172.21.15.31:0/648921165 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:12.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce1fe00640 1 --2- 172.21.15.31:0/648921165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce200b2e50 0x7fce20153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:12.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce17400640 1 --2- 172.21.15.31:0/648921165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce200cf2a0 0x7fce201528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:12.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce24e00640 1 -- 172.21.15.31:0/648921165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce200b2e50 msgr2=0x7fce20153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:12.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce24e00640 1 --2- 172.21.15.31:0/648921165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce200b2e50 0x7fce20153600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce24e00640 1 -- 172.21.15.31:0/648921165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce200cf2a0 msgr2=0x7fce201528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:12.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce24e00640 1 --2- 172.21.15.31:0/648921165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce200cf2a0 0x7fce201528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce24e00640 1 -- 172.21.15.31:0/648921165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce20153cc0 con 0x7fce2015ac70 2024-09-17T05:29:12.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce24e00640 1 --2- 172.21.15.31:0/648921165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce2015ac70 0x7fce200c7d90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fce18019320 tx=0x7fce18004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:12.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce1cc00640 1 -- 172.21.15.31:0/648921165 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce180bb070 con 0x7fce2015ac70 2024-09-17T05:29:12.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce26e00640 1 -- 172.21.15.31:0/648921165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce20153fa0 con 0x7fce2015ac70 2024-09-17T05:29:12.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce1cc00640 1 -- 172.21.15.31:0/648921165 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce180a5c20 con 0x7fce2015ac70 2024-09-17T05:29:12.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce1cc00640 1 -- 172.21.15.31:0/648921165 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce180b2040 con 0x7fce2015ac70 2024-09-17T05:29:12.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.533+0000 7fce26e00640 1 -- 172.21.15.31:0/648921165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce20154560 con 0x7fce2015ac70 2024-09-17T05:29:12.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.537+0000 7fce26e00640 1 -- 172.21.15.31:0/648921165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce200b2740 con 0x7fce2015ac70 2024-09-17T05:29:12.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.537+0000 7fce1cc00640 1 -- 172.21.15.31:0/648921165 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fce18005030 con 0x7fce2015ac70 2024-09-17T05:29:12.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.537+0000 7fce1cc00640 1 --2- 172.21.15.31:0/648921165 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fcdfc073200 0x7fcdfc0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:12.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.537+0000 7fce1cc00640 1 -- 172.21.15.31:0/648921165 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fce1812d9c0 con 0x7fce2015ac70 2024-09-17T05:29:12.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.537+0000 7fce1fe00640 1 --2- 172.21.15.31:0/648921165 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fcdfc073200 0x7fcdfc0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:12.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.537+0000 7fce1fe00640 1 --2- 172.21.15.31:0/648921165 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fcdfc073200 0x7fcdfc0756c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fce10001470 tx=0x7fce10001d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:12.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.541+0000 7fce1cc00640 1 -- 172.21.15.31:0/648921165 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fce18016330 con 0x7fce2015ac70 2024-09-17T05:29:12.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.717+0000 7fce26e00640 1 -- 172.21.15.31:0/648921165 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fce200c4590 con 0x7fce2015ac70 2024-09-17T05:29:12.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.717+0000 7fce1cc00640 1 -- 172.21.15.31:0/648921165 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fce180f8390 con 0x7fce2015ac70 2024-09-17T05:29:12.722 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-09-17T05:29:12.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.721+0000 7fce26e00640 1 -- 172.21.15.31:0/648921165 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fcdfc073200 msgr2=0x7fcdfc0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:12.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.721+0000 7fce26e00640 1 --2- 172.21.15.31:0/648921165 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fcdfc073200 0x7fcdfc0756c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fce10001470 tx=0x7fce10001d30 comp rx=0 tx=0).stop 2024-09-17T05:29:12.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.721+0000 7fce26e00640 1 -- 172.21.15.31:0/648921165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce2015ac70 msgr2=0x7fce200c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:12.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.721+0000 7fce26e00640 1 --2- 172.21.15.31:0/648921165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce2015ac70 0x7fce200c7d90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fce18019320 tx=0x7fce18004620 comp rx=0 tx=0).stop 2024-09-17T05:29:12.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.721+0000 7fce26e00640 1 -- 172.21.15.31:0/648921165 shutdown_connections 2024-09-17T05:29:12.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.721+0000 7fce26e00640 1 --2- 172.21.15.31:0/648921165 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fcdfc073200 0x7fcdfc0756c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.721+0000 7fce26e00640 1 --2- 172.21.15.31:0/648921165 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce2015ac70 0x7fce200c7d90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.721+0000 7fce26e00640 1 --2- 172.21.15.31:0/648921165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce200cf2a0 0x7fce201528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.721+0000 7fce26e00640 1 --2- 172.21.15.31:0/648921165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce200b2e50 0x7fce20153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.721+0000 7fce26e00640 1 -- 172.21.15.31:0/648921165 >> 172.21.15.31:0/648921165 conn(0x7fce200cd740 msgr2=0x7fce20071650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:12.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.721+0000 7fce26e00640 1 -- 172.21.15.31:0/648921165 shutdown_connections 2024-09-17T05:29:12.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.721+0000 7fce26e00640 1 -- 172.21.15.31:0/648921165 wait complete. 2024-09-17T05:29:12.744 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-17T05:29:12.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe0a2800640 1 -- 172.21.15.31:0/3900448111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe080005220 msgr2=0x7fe08000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:12.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe0a2800640 1 --2- 172.21.15.31:0/3900448111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe080005220 0x7fe08000b9d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe094001dc0 tx=0x7fe09401cb30 comp rx=0 tx=0).stop 2024-09-17T05:29:12.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe0a2800640 1 -- 172.21.15.31:0/3900448111 shutdown_connections 2024-09-17T05:29:12.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe0a2800640 1 --2- 172.21.15.31:0/3900448111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe080005220 0x7fe08000b9d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe0a2800640 1 -- 172.21.15.31:0/3900448111 >> 172.21.15.31:0/3900448111 conn(0x7fe09c0d1e00 msgr2=0x7fe09c0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:12.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe0a2800640 1 -- 172.21.15.31:0/3900448111 shutdown_connections 2024-09-17T05:29:12.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe0a2800640 1 -- 172.21.15.31:0/3900448111 wait complete. 2024-09-17T05:29:12.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe0a2800640 1 Processor -- start 2024-09-17T05:29:12.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe0a2800640 1 -- start start 2024-09-17T05:29:12.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe0a2800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe080005220 0x7fe09c06dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe0a2800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe09c0c4bd0 0x7fe09c06f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe0a2800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe09c0c5050 0x7fe09c0cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe0a2800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c0b3620 con 0x7fe080005220 2024-09-17T05:29:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe0a2800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c0b34a0 con 0x7fe09c0c5050 2024-09-17T05:29:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe0a2800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe09c0b37a0 con 0x7fe09c0c4bd0 2024-09-17T05:29:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe09b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe080005220 0x7fe09c06dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe09b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe080005220 0x7fe09c06dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48532/0 (socket says 172.21.15.31:48532) 2024-09-17T05:29:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe09b400640 1 -- 172.21.15.31:0/656067385 learned_addr learned my addr 172.21.15.31:0/656067385 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe09be00640 1 --2- 172.21.15.31:0/656067385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe09c0c5050 0x7fe09c0cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.893+0000 7fe093e00640 1 --2- 172.21.15.31:0/656067385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe09c0c4bd0 0x7fe09c06f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.897+0000 7fe09b400640 1 -- 172.21.15.31:0/656067385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe09c0c4bd0 msgr2=0x7fe09c06f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.897+0000 7fe09b400640 1 --2- 172.21.15.31:0/656067385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe09c0c4bd0 0x7fe09c06f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.897+0000 7fe09b400640 1 -- 172.21.15.31:0/656067385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe09c0c5050 msgr2=0x7fe09c0cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:12.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.897+0000 7fe09b400640 1 --2- 172.21.15.31:0/656067385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe09c0c5050 0x7fe09c0cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:12.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.897+0000 7fe09b400640 1 -- 172.21.15.31:0/656067385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09c1f7fb0 con 0x7fe080005220 2024-09-17T05:29:12.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.897+0000 7fe09b400640 1 --2- 172.21.15.31:0/656067385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe080005220 0x7fe09c06dd30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe08c011ab0 tx=0x7fe08c011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:12.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.897+0000 7fe093400640 1 -- 172.21.15.31:0/656067385 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c01e070 con 0x7fe080005220 2024-09-17T05:29:12.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.897+0000 7fe093400640 1 -- 172.21.15.31:0/656067385 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe08c004460 con 0x7fe080005220 2024-09-17T05:29:12.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.897+0000 7fe0a2800640 1 -- 172.21.15.31:0/656067385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe09c1f8290 con 0x7fe080005220 2024-09-17T05:29:12.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.897+0000 7fe093400640 1 -- 172.21.15.31:0/656067385 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c00fc60 con 0x7fe080005220 2024-09-17T05:29:12.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.897+0000 7fe0a2800640 1 -- 172.21.15.31:0/656067385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe09c1f8850 con 0x7fe080005220 2024-09-17T05:29:12.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.897+0000 7fe0a2800640 1 -- 172.21.15.31:0/656067385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe09c0cd200 con 0x7fe080005220 2024-09-17T05:29:12.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.897+0000 7fe093400640 1 -- 172.21.15.31:0/656067385 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe08c021070 con 0x7fe080005220 2024-09-17T05:29:12.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.897+0000 7fe093400640 1 --2- 172.21.15.31:0/656067385 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe078073200 0x7fe0780756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:12.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.901+0000 7fe093400640 1 -- 172.21.15.31:0/656067385 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe08c094c20 con 0x7fe080005220 2024-09-17T05:29:12.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.901+0000 7fe093e00640 1 --2- 172.21.15.31:0/656067385 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe078073200 0x7fe0780756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:12.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.901+0000 7fe093e00640 1 --2- 172.21.15.31:0/656067385 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe078073200 0x7fe0780756c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe084001a40 tx=0x7fe084006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:12.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:12.901+0000 7fe093400640 1 -- 172.21.15.31:0/656067385 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe08c05f5e0 con 0x7fe080005220 2024-09-17T05:29:13.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.077+0000 7fe0a2800640 1 -- 172.21.15.31:0/656067385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe09c0cc350 con 0x7fe080005220 2024-09-17T05:29:13.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.081+0000 7fe093400640 1 -- 172.21.15.31:0/656067385 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fe08c064010 con 0x7fe080005220 2024-09-17T05:29:13.084 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-09-17T05:29:13.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.081+0000 7fe0a2800640 1 -- 172.21.15.31:0/656067385 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe078073200 msgr2=0x7fe0780756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:13.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.081+0000 7fe0a2800640 1 --2- 172.21.15.31:0/656067385 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe078073200 0x7fe0780756c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe084001a40 tx=0x7fe084006040 comp rx=0 tx=0).stop 2024-09-17T05:29:13.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.081+0000 7fe0a2800640 1 -- 172.21.15.31:0/656067385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe080005220 msgr2=0x7fe09c06dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:13.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.081+0000 7fe0a2800640 1 --2- 172.21.15.31:0/656067385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe080005220 0x7fe09c06dd30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe08c011ab0 tx=0x7fe08c011f70 comp rx=0 tx=0).stop 2024-09-17T05:29:13.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.081+0000 7fe0a2800640 1 -- 172.21.15.31:0/656067385 shutdown_connections 2024-09-17T05:29:13.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.081+0000 7fe0a2800640 1 --2- 172.21.15.31:0/656067385 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe078073200 0x7fe0780756c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:13.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.081+0000 7fe0a2800640 1 --2- 172.21.15.31:0/656067385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe09c0c5050 0x7fe09c0cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:13.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.081+0000 7fe0a2800640 1 --2- 172.21.15.31:0/656067385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe09c0c4bd0 0x7fe09c06f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:13.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.081+0000 7fe0a2800640 1 --2- 172.21.15.31:0/656067385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe080005220 0x7fe09c06dd30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:13.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.081+0000 7fe0a2800640 1 -- 172.21.15.31:0/656067385 >> 172.21.15.31:0/656067385 conn(0x7fe09c0d1e00 msgr2=0x7fe09c0b6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:13.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.081+0000 7fe0a2800640 1 -- 172.21.15.31:0/656067385 shutdown_connections 2024-09-17T05:29:13.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.081+0000 7fe0a2800640 1 -- 172.21.15.31:0/656067385 wait complete. 2024-09-17T05:29:13.105 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-17T05:29:13.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.253+0000 7f25ade00640 1 -- 172.21.15.31:0/3483180574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c004d50 msgr2=0x7f258c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:13.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.253+0000 7f25ade00640 1 --2- 172.21.15.31:0/3483180574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c004d50 0x7f258c005150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2598006f80 tx=0x7f259801cf00 comp rx=0 tx=0).stop 2024-09-17T05:29:13.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.253+0000 7f25ade00640 1 -- 172.21.15.31:0/3483180574 shutdown_connections 2024-09-17T05:29:13.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.253+0000 7f25ade00640 1 --2- 172.21.15.31:0/3483180574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c004d50 0x7f258c005150 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:13.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.253+0000 7f25ade00640 1 -- 172.21.15.31:0/3483180574 >> 172.21.15.31:0/3483180574 conn(0x7f25a80b2060 msgr2=0x7f25a80b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:13.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.253+0000 7f25ade00640 1 -- 172.21.15.31:0/3483180574 shutdown_connections 2024-09-17T05:29:13.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.253+0000 7f25ade00640 1 -- 172.21.15.31:0/3483180574 wait complete. 2024-09-17T05:29:13.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.253+0000 7f25ade00640 1 Processor -- start 2024-09-17T05:29:13.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.253+0000 7f25ade00640 1 -- start start 2024-09-17T05:29:13.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.253+0000 7f25ade00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f258c004d50 0x7f25a80c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:13.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.253+0000 7f25ade00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25a81451d0 0x7f25a81f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:13.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f25ade00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25a80c96f0 0x7f25a80c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:13.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f25ade00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f25a8073400 con 0x7f25a81451d0 2024-09-17T05:29:13.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f25ade00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f25a8073280 con 0x7f25a80c96f0 2024-09-17T05:29:13.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f25ade00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f25a8073580 con 0x7f258c004d50 2024-09-17T05:29:13.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f259e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25a81451d0 0x7f25a81f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:13.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f25a6a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f258c004d50 0x7f25a80c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:13.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f259e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25a81451d0 0x7f25a81f5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48540/0 (socket says 172.21.15.31:48540) 2024-09-17T05:29:13.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f259e000640 1 -- 172.21.15.31:0/3369599924 learned_addr learned my addr 172.21.15.31:0/3369599924 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:13.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f25a7400640 1 --2- 172.21.15.31:0/3369599924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25a80c96f0 0x7f25a80c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:13.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f259e000640 1 -- 172.21.15.31:0/3369599924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f258c004d50 msgr2=0x7f25a80c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:13.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f259e000640 1 --2- 172.21.15.31:0/3369599924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f258c004d50 0x7f25a80c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:13.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f259e000640 1 -- 172.21.15.31:0/3369599924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25a80c96f0 msgr2=0x7f25a80c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:13.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f259e000640 1 --2- 172.21.15.31:0/3369599924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25a80c96f0 0x7f25a80c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:13.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f259e000640 1 -- 172.21.15.31:0/3369599924 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a80c8650 con 0x7f25a81451d0 2024-09-17T05:29:13.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f259e000640 1 --2- 172.21.15.31:0/3369599924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25a81451d0 0x7f25a81f5a10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2590003e20 tx=0x7f2590001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:13.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f259fe00640 1 -- 172.21.15.31:0/3369599924 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590011700 con 0x7f25a81451d0 2024-09-17T05:29:13.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f259fe00640 1 -- 172.21.15.31:0/3369599924 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2590016020 con 0x7f25a81451d0 2024-09-17T05:29:13.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f259fe00640 1 -- 172.21.15.31:0/3369599924 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590011b60 con 0x7f25a81451d0 2024-09-17T05:29:13.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f25ade00640 1 -- 172.21.15.31:0/3369599924 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a80c8930 con 0x7f25a81451d0 2024-09-17T05:29:13.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f25ade00640 1 -- 172.21.15.31:0/3369599924 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a80c8ef0 con 0x7f25a81451d0 2024-09-17T05:29:13.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f25ade00640 1 -- 172.21.15.31:0/3369599924 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a8073ae0 con 0x7f25a81451d0 2024-09-17T05:29:13.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.257+0000 7f259fe00640 1 -- 172.21.15.31:0/3369599924 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2590011d00 con 0x7f25a81451d0 2024-09-17T05:29:13.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.261+0000 7f259fe00640 1 --2- 172.21.15.31:0/3369599924 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2584073230 0x7f25840756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:13.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.261+0000 7f259fe00640 1 -- 172.21.15.31:0/3369599924 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2590094d10 con 0x7f25a81451d0 2024-09-17T05:29:13.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.261+0000 7f25a6a00640 1 --2- 172.21.15.31:0/3369599924 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2584073230 0x7f25840756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:13.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.261+0000 7f25a6a00640 1 --2- 172.21.15.31:0/3369599924 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2584073230 0x7f25840756f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f25980ab000 tx=0x7f2598019d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:13.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.265+0000 7f259fe00640 1 -- 172.21.15.31:0/3369599924 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f259009a020 con 0x7f25a81451d0 2024-09-17T05:29:13.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.437+0000 7f25ade00640 1 -- 172.21.15.31:0/3369599924 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f25a80d13c0 con 0x7f25a81451d0 2024-09-17T05:29:13.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.437+0000 7f259fe00640 1 -- 172.21.15.31:0/3369599924 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f2590020020 con 0x7f25a81451d0 2024-09-17T05:29:13.441 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-09-17T05:29:13.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.437+0000 7f25ade00640 1 -- 172.21.15.31:0/3369599924 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2584073230 msgr2=0x7f25840756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:13.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.437+0000 7f25ade00640 1 --2- 172.21.15.31:0/3369599924 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2584073230 0x7f25840756f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f25980ab000 tx=0x7f2598019d40 comp rx=0 tx=0).stop 2024-09-17T05:29:13.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.437+0000 7f25ade00640 1 -- 172.21.15.31:0/3369599924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25a81451d0 msgr2=0x7f25a81f5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:13.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.437+0000 7f25ade00640 1 --2- 172.21.15.31:0/3369599924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25a81451d0 0x7f25a81f5a10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2590003e20 tx=0x7f2590001810 comp rx=0 tx=0).stop 2024-09-17T05:29:13.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.437+0000 7f25ade00640 1 -- 172.21.15.31:0/3369599924 shutdown_connections 2024-09-17T05:29:13.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.437+0000 7f25ade00640 1 --2- 172.21.15.31:0/3369599924 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2584073230 0x7f25840756f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:13.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.437+0000 7f25ade00640 1 --2- 172.21.15.31:0/3369599924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f25a80c96f0 0x7f25a80c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:13.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.437+0000 7f25ade00640 1 --2- 172.21.15.31:0/3369599924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25a81451d0 0x7f25a81f5a10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:13.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.437+0000 7f25ade00640 1 --2- 172.21.15.31:0/3369599924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f258c004d50 0x7f25a80c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:13.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.437+0000 7f25ade00640 1 -- 172.21.15.31:0/3369599924 >> 172.21.15.31:0/3369599924 conn(0x7f25a80b2060 msgr2=0x7f25a81592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:13.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.441+0000 7f25ade00640 1 -- 172.21.15.31:0/3369599924 shutdown_connections 2024-09-17T05:29:13.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.441+0000 7f25ade00640 1 -- 172.21.15.31:0/3369599924 wait complete. 2024-09-17T05:29:13.463 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2024-09-17T05:29:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.605+0000 7f124f200640 1 -- 172.21.15.31:0/1914820762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f125015f000 msgr2=0x7f12500d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.605+0000 7f124f200640 1 --2- 172.21.15.31:0/1914820762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f125015f000 0x7f12500d01b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1250073000 tx=0x7f124001c7a0 comp rx=0 tx=0).stop 2024-09-17T05:29:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.605+0000 7f124f200640 1 -- 172.21.15.31:0/1914820762 shutdown_connections 2024-09-17T05:29:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.605+0000 7f124f200640 1 --2- 172.21.15.31:0/1914820762 >> v2:172.21.15.155:3300/0 conn(0x7f12500b2590 0x7f12500b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:13.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.605+0000 7f124f200640 1 --2- 172.21.15.31:0/1914820762 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f125015f000 0x7f12500d01b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.605+0000 7f124f200640 1 -- 172.21.15.31:0/1914820762 >> 172.21.15.31:0/1914820762 conn(0x7f125009aa10 msgr2=0x7f125009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.605+0000 7f124f200640 1 -- 172.21.15.31:0/1914820762 shutdown_connections 2024-09-17T05:29:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.605+0000 7f124f200640 1 -- 172.21.15.31:0/1914820762 wait complete. 2024-09-17T05:29:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.605+0000 7f124f200640 1 Processor -- start 2024-09-17T05:29:13.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124f200640 1 -- start start 2024-09-17T05:29:13.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12500b2590 0x7f1250155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:13.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12500cefb0 0x7f1250150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:13.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f125015f000 0x7f12500b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:13.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1250168ea0 con 0x7f12500b2590 2024-09-17T05:29:13.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124f200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1250168d20 con 0x7f12500cefb0 2024-09-17T05:29:13.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1250169020 con 0x7f125015f000 2024-09-17T05:29:13.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12500b2590 0x7f1250155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:13.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12500b2590 0x7f1250155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48566/0 (socket says 172.21.15.31:48566) 2024-09-17T05:29:13.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124de00640 1 -- 172.21.15.31:0/1180972290 learned_addr learned my addr 172.21.15.31:0/1180972290 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:13.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f1247e00640 1 --2- 172.21.15.31:0/1180972290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12500cefb0 0x7f1250150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:13.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124e800640 1 --2- 172.21.15.31:0/1180972290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f125015f000 0x7f12500b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:13.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124de00640 1 -- 172.21.15.31:0/1180972290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f125015f000 msgr2=0x7f12500b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:13.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124de00640 1 --2- 172.21.15.31:0/1180972290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f125015f000 0x7f12500b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:13.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124de00640 1 -- 172.21.15.31:0/1180972290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12500cefb0 msgr2=0x7f1250150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:13.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124de00640 1 --2- 172.21.15.31:0/1180972290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12500cefb0 0x7f1250150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:13.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124de00640 1 -- 172.21.15.31:0/1180972290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1250151ad0 con 0x7f12500b2590 2024-09-17T05:29:13.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124e800640 1 --2- 172.21.15.31:0/1180972290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f125015f000 0x7f12500b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:13.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124de00640 1 --2- 172.21.15.31:0/1180972290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12500b2590 0x7f1250155a30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f12400193b0 tx=0x7f12400a64f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:13.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f1246000640 1 -- 172.21.15.31:0/1180972290 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1240004240 con 0x7f12500b2590 2024-09-17T05:29:13.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f1246000640 1 -- 172.21.15.31:0/1180972290 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12400044d0 con 0x7f12500b2590 2024-09-17T05:29:13.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f1246000640 1 -- 172.21.15.31:0/1180972290 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1240005290 con 0x7f12500b2590 2024-09-17T05:29:13.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124f200640 1 -- 172.21.15.31:0/1180972290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1250154f50 con 0x7f12500b2590 2024-09-17T05:29:13.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124f200640 1 -- 172.21.15.31:0/1180972290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1250155510 con 0x7f12500b2590 2024-09-17T05:29:13.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.609+0000 7f124f200640 1 -- 172.21.15.31:0/1180972290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1250154d60 con 0x7f12500b2590 2024-09-17T05:29:13.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.613+0000 7f1246000640 1 -- 172.21.15.31:0/1180972290 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f1240005430 con 0x7f12500b2590 2024-09-17T05:29:13.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.613+0000 7f1246000640 1 --2- 172.21.15.31:0/1180972290 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f122c073200 0x7f122c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:13.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.613+0000 7f1246000640 1 -- 172.21.15.31:0/1180972290 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f124012e060 con 0x7f12500b2590 2024-09-17T05:29:13.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.613+0000 7f1247e00640 1 --2- 172.21.15.31:0/1180972290 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f122c073200 0x7f122c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:13.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.613+0000 7f1247e00640 1 --2- 172.21.15.31:0/1180972290 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f122c073200 0x7f122c0756c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f12500b7c20 tx=0x7f1238009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:13.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.617+0000 7f1246000640 1 -- 172.21.15.31:0/1180972290 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f12400bf070 con 0x7f12500b2590 2024-09-17T05:29:13.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:13.853+0000 7f124f200640 1 -- 172.21.15.31:0/1180972290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f12500b29e0 con 0x7f12500b2590 2024-09-17T05:29:14.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.781+0000 7f1246000640 1 -- 172.21.15.31:0/1180972290 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v49) ==== 161+0+0 (secure 0 0 0) 0x7f12400b6070 con 0x7f12500b2590 2024-09-17T05:29:14.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.785+0000 7f124f200640 1 -- 172.21.15.31:0/1180972290 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f122c073200 msgr2=0x7f122c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:14.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.785+0000 7f124f200640 1 --2- 172.21.15.31:0/1180972290 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f122c073200 0x7f122c0756c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f12500b7c20 tx=0x7f1238009040 comp rx=0 tx=0).stop 2024-09-17T05:29:14.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.785+0000 7f124f200640 1 -- 172.21.15.31:0/1180972290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12500b2590 msgr2=0x7f1250155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.785+0000 7f124f200640 1 --2- 172.21.15.31:0/1180972290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12500b2590 0x7f1250155a30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f12400193b0 tx=0x7f12400a64f0 comp rx=0 tx=0).stop 2024-09-17T05:29:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.785+0000 7f124f200640 1 -- 172.21.15.31:0/1180972290 shutdown_connections 2024-09-17T05:29:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.785+0000 7f124f200640 1 --2- 172.21.15.31:0/1180972290 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f122c073200 0x7f122c0756c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.785+0000 7f124f200640 1 --2- 172.21.15.31:0/1180972290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f125015f000 0x7f12500b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.785+0000 7f124f200640 1 --2- 172.21.15.31:0/1180972290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12500cefb0 0x7f1250150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.785+0000 7f124f200640 1 --2- 172.21.15.31:0/1180972290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12500b2590 0x7f1250155a30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.785+0000 7f124f200640 1 -- 172.21.15.31:0/1180972290 >> 172.21.15.31:0/1180972290 conn(0x7f125009aa10 msgr2=0x7f1250157750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.785+0000 7f124f200640 1 -- 172.21.15.31:0/1180972290 shutdown_connections 2024-09-17T05:29:14.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.785+0000 7f124f200640 1 -- 172.21.15.31:0/1180972290 wait complete. 2024-09-17T05:29:14.814 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:29:14.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.961+0000 7fe01f400640 1 -- 172.21.15.31:0/3529053133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0180cdb30 msgr2=0x7fe0180cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:14.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.961+0000 7fe01f400640 1 --2- 172.21.15.31:0/3529053133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0180cdb30 0x7fe0180cebb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe004009840 tx=0x7fe00401c820 comp rx=0 tx=0).stop 2024-09-17T05:29:14.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.961+0000 7fe01f400640 1 -- 172.21.15.31:0/3529053133 shutdown_connections 2024-09-17T05:29:14.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.961+0000 7fe01f400640 1 --2- 172.21.15.31:0/3529053133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0180cdb30 0x7fe0180cebb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:14.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.961+0000 7fe01f400640 1 --2- 172.21.15.31:0/3529053133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe01815bea0 0x7fe0180ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:14.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.961+0000 7fe01f400640 1 -- 172.21.15.31:0/3529053133 >> 172.21.15.31:0/3529053133 conn(0x7fe0180d1dc0 msgr2=0x7fe0180d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:14.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.961+0000 7fe01f400640 1 -- 172.21.15.31:0/3529053133 shutdown_connections 2024-09-17T05:29:14.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.961+0000 7fe01f400640 1 -- 172.21.15.31:0/3529053133 wait complete. 2024-09-17T05:29:14.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.961+0000 7fe01f400640 1 Processor -- start 2024-09-17T05:29:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.961+0000 7fe01f400640 1 -- start start 2024-09-17T05:29:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.961+0000 7fe01f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0180cdb30 0x7fe01809f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.961+0000 7fe01f400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0180d28e0 0x7fe018156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.961+0000 7fe01f400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe01815bea0 0x7fe018158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.961+0000 7fe01f400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe018168fc0 con 0x7fe0180cdb30 2024-09-17T05:29:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.961+0000 7fe01f400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe018168e40 con 0x7fe0180d28e0 2024-09-17T05:29:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.961+0000 7fe01f400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe018169140 con 0x7fe01815bea0 2024-09-17T05:29:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.965+0000 7fe01ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0180cdb30 0x7fe01809f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.965+0000 7fe01ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0180cdb30 0x7fe01809f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48590/0 (socket says 172.21.15.31:48590) 2024-09-17T05:29:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.965+0000 7fe01ca00640 1 -- 172.21.15.31:0/2823123225 learned_addr learned my addr 172.21.15.31:0/2823123225 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.965+0000 7fe017e00640 1 --2- 172.21.15.31:0/2823123225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0180d28e0 0x7fe018156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.965+0000 7fe01d400640 1 --2- 172.21.15.31:0/2823123225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe01815bea0 0x7fe018158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.965+0000 7fe01ca00640 1 -- 172.21.15.31:0/2823123225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe01815bea0 msgr2=0x7fe018158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.965+0000 7fe01ca00640 1 --2- 172.21.15.31:0/2823123225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe01815bea0 0x7fe018158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.965+0000 7fe01ca00640 1 -- 172.21.15.31:0/2823123225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0180d28e0 msgr2=0x7fe018156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.965+0000 7fe01ca00640 1 --2- 172.21.15.31:0/2823123225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0180d28e0 0x7fe018156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.965+0000 7fe01ca00640 1 -- 172.21.15.31:0/2823123225 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01809fac0 con 0x7fe0180cdb30 2024-09-17T05:29:14.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.965+0000 7fe01ca00640 1 --2- 172.21.15.31:0/2823123225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0180cdb30 0x7fe01809f580 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00d750 tx=0x7fe00c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:14.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.965+0000 7fe014c00640 1 -- 172.21.15.31:0/2823123225 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c017070 con 0x7fe0180cdb30 2024-09-17T05:29:14.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.965+0000 7fe014c00640 1 -- 172.21.15.31:0/2823123225 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe00c009d20 con 0x7fe0180cdb30 2024-09-17T05:29:14.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.965+0000 7fe014c00640 1 -- 172.21.15.31:0/2823123225 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c00de60 con 0x7fe0180cdb30 2024-09-17T05:29:14.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.965+0000 7fe01f400640 1 -- 172.21.15.31:0/2823123225 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe018144b60 con 0x7fe0180cdb30 2024-09-17T05:29:14.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.965+0000 7fe01f400640 1 -- 172.21.15.31:0/2823123225 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe018156350 con 0x7fe0180cdb30 2024-09-17T05:29:14.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.965+0000 7fe01f400640 1 -- 172.21.15.31:0/2823123225 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0180cc9d0 con 0x7fe0180cdb30 2024-09-17T05:29:14.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.965+0000 7fe014c00640 1 -- 172.21.15.31:0/2823123225 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe00c004280 con 0x7fe0180cdb30 2024-09-17T05:29:14.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.969+0000 7fe014c00640 1 --2- 172.21.15.31:0/2823123225 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdff8073200 0x7fdff80756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:14.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.969+0000 7fe014c00640 1 -- 172.21.15.31:0/2823123225 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe00c094550 con 0x7fe0180cdb30 2024-09-17T05:29:14.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.969+0000 7fe017e00640 1 --2- 172.21.15.31:0/2823123225 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdff8073200 0x7fdff80756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:14.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.969+0000 7fe017e00640 1 --2- 172.21.15.31:0/2823123225 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdff8073200 0x7fdff80756c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe0040af000 tx=0x7fe00401b060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:14.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:14.973+0000 7fe014c00640 1 -- 172.21.15.31:0/2823123225 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe00c020020 con 0x7fe0180cdb30 2024-09-17T05:29:15.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.149+0000 7fe01f400640 1 -- 172.21.15.31:0/2823123225 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fe0180b58c0 con 0x7fe0180cdb30 2024-09-17T05:29:15.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.149+0000 7fe014c00640 1 -- 172.21.15.31:0/2823123225 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v27) ==== 59+0+1998 (secure 0 0 0) 0x7fe00c05f5f0 con 0x7fe0180cdb30 2024-09-17T05:29:15.152 INFO:teuthology.orchestra.run.smithi031.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:29:15.153 INFO:teuthology.orchestra.run.smithi031.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:29:15.153 INFO:teuthology.orchestra.run.smithi031.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:29:15.153 INFO:teuthology.orchestra.run.smithi031.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:29:15.153 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6159.333103 2024-09-17T05:29:15.153 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4566.558105 2024-09-17T05:29:15.153 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4575.968427 2024-09-17T05:29:15.153 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4702.806393 2024-09-17T05:29:15.153 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4956.728274 2024-09-17T05:29:15.153 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 6604.257199 2024-09-17T05:29:15.153 INFO:teuthology.orchestra.run.smithi031.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4779.165073 2024-09-17T05:29:15.154 INFO:teuthology.orchestra.run.smithi031.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4673.795919 2024-09-17T05:29:15.154 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds 20/20 2024-09-17T05:29:15.154 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:29:15.154 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_ms 2/2 2024-09-17T05:29:15.154 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_frag true 2024-09-17T05:29:15.154 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:29:15.154 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:29:15.154 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_verify_scatter true 2024-09-17T05:29:15.154 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:29:15.154 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:29:15.154 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:29:15.154 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced client_mount_timeout 600 2024-09-17T05:29:15.155 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_client 20/20 2024-09-17T05:29:15.155 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_ms 1/1 2024-09-17T05:29:15.155 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:29:15.155 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:29:15.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.149+0000 7fe01f400640 1 -- 172.21.15.31:0/2823123225 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdff8073200 msgr2=0x7fdff80756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:15.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.149+0000 7fe01f400640 1 --2- 172.21.15.31:0/2823123225 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdff8073200 0x7fdff80756c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe0040af000 tx=0x7fe00401b060 comp rx=0 tx=0).stop 2024-09-17T05:29:15.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.149+0000 7fe01f400640 1 -- 172.21.15.31:0/2823123225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0180cdb30 msgr2=0x7fe01809f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:15.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.149+0000 7fe01f400640 1 --2- 172.21.15.31:0/2823123225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0180cdb30 0x7fe01809f580 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00d750 tx=0x7fe00c00dc10 comp rx=0 tx=0).stop 2024-09-17T05:29:15.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.149+0000 7fe01f400640 1 -- 172.21.15.31:0/2823123225 shutdown_connections 2024-09-17T05:29:15.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.149+0000 7fe01f400640 1 --2- 172.21.15.31:0/2823123225 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdff8073200 0x7fdff80756c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:15.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.149+0000 7fe01f400640 1 --2- 172.21.15.31:0/2823123225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe01815bea0 0x7fe018158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:15.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.149+0000 7fe01f400640 1 --2- 172.21.15.31:0/2823123225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0180d28e0 0x7fe018156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:15.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.149+0000 7fe01f400640 1 --2- 172.21.15.31:0/2823123225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0180cdb30 0x7fe01809f580 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:15.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.149+0000 7fe01f400640 1 -- 172.21.15.31:0/2823123225 >> 172.21.15.31:0/2823123225 conn(0x7fe0180d1dc0 msgr2=0x7fe0180b6020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:15.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.149+0000 7fe01f400640 1 -- 172.21.15.31:0/2823123225 shutdown_connections 2024-09-17T05:29:15.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.149+0000 7fe01f400640 1 -- 172.21.15.31:0/2823123225 wait complete. 2024-09-17T05:29:15.174 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:29:15.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9fe00640 1 -- 172.21.15.31:0/3322023220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe98073780 msgr2=0x7efe9815e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:15.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9fe00640 1 --2- 172.21.15.31:0/3322023220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe98073780 0x7efe9815e8d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efe980ce280 tx=0x7efe9001ccf0 comp rx=0 tx=0).stop 2024-09-17T05:29:15.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9fe00640 1 -- 172.21.15.31:0/3322023220 shutdown_connections 2024-09-17T05:29:15.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9fe00640 1 --2- 172.21.15.31:0/3322023220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe98073780 0x7efe9815e8d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:15.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9fe00640 1 --2- 172.21.15.31:0/3322023220 >> v2:172.21.15.155:3300/0 conn(0x7efe980cc570 0x7efe980cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:15.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9fe00640 1 -- 172.21.15.31:0/3322023220 >> 172.21.15.31:0/3322023220 conn(0x7efe980b2060 msgr2=0x7efe980b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:15.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9fe00640 1 -- 172.21.15.31:0/3322023220 shutdown_connections 2024-09-17T05:29:15.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9fe00640 1 -- 172.21.15.31:0/3322023220 wait complete. 2024-09-17T05:29:15.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9fe00640 1 Processor -- start 2024-09-17T05:29:15.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9fe00640 1 -- start start 2024-09-17T05:29:15.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe98073780 0x7efe98146920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:15.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe980cc570 0x7efe98154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:15.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9fe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe980cfb60 0x7efe98152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:15.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9fe00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efe98168110 con 0x7efe980cc570 2024-09-17T05:29:15.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9fe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efe98167f90 con 0x7efe980cfb60 2024-09-17T05:29:15.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9fe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efe98168290 con 0x7efe98073780 2024-09-17T05:29:15.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe980cc570 0x7efe98154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:15.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe980cc570 0x7efe98154770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48598/0 (socket says 172.21.15.31:48598) 2024-09-17T05:29:15.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9ca00640 1 -- 172.21.15.31:0/2000227541 learned_addr learned my addr 172.21.15.31:0/2000227541 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:15.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9de00640 1 --2- 172.21.15.31:0/2000227541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe980cfb60 0x7efe98152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:15.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.321+0000 7efe9d400640 1 --2- 172.21.15.31:0/2000227541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe98073780 0x7efe98146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:15.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.325+0000 7efe9ca00640 1 -- 172.21.15.31:0/2000227541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe98073780 msgr2=0x7efe98146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:15.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.325+0000 7efe9ca00640 1 --2- 172.21.15.31:0/2000227541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe98073780 0x7efe98146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:15.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.325+0000 7efe9ca00640 1 -- 172.21.15.31:0/2000227541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe980cfb60 msgr2=0x7efe98152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:15.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.325+0000 7efe9ca00640 1 --2- 172.21.15.31:0/2000227541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe980cfb60 0x7efe98152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:15.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.325+0000 7efe9ca00640 1 -- 172.21.15.31:0/2000227541 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe98155210 con 0x7efe980cc570 2024-09-17T05:29:15.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.325+0000 7efe9de00640 1 --2- 172.21.15.31:0/2000227541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe980cfb60 0x7efe98152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:29:15.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.325+0000 7efe9ca00640 1 --2- 172.21.15.31:0/2000227541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe980cc570 0x7efe98154770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efe8400c3c0 tx=0x7efe8400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:15.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.325+0000 7efe95600640 1 -- 172.21.15.31:0/2000227541 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe84017070 con 0x7efe980cc570 2024-09-17T05:29:15.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.325+0000 7efe95600640 1 -- 172.21.15.31:0/2000227541 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe840053c0 con 0x7efe980cc570 2024-09-17T05:29:15.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.325+0000 7efe95600640 1 -- 172.21.15.31:0/2000227541 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe84003860 con 0x7efe980cc570 2024-09-17T05:29:15.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.325+0000 7efe9fe00640 1 -- 172.21.15.31:0/2000227541 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe981554f0 con 0x7efe980cc570 2024-09-17T05:29:15.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.325+0000 7efe9fe00640 1 -- 172.21.15.31:0/2000227541 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe980b5ce0 con 0x7efe980cc570 2024-09-17T05:29:15.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.325+0000 7efe9fe00640 1 -- 172.21.15.31:0/2000227541 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe98155730 con 0x7efe980cc570 2024-09-17T05:29:15.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.325+0000 7efe95600640 1 -- 172.21.15.31:0/2000227541 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efe8401a070 con 0x7efe980cc570 2024-09-17T05:29:15.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.329+0000 7efe95600640 1 --2- 172.21.15.31:0/2000227541 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe78073230 0x7efe780756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:15.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.329+0000 7efe95600640 1 -- 172.21.15.31:0/2000227541 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efe84093490 con 0x7efe980cc570 2024-09-17T05:29:15.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.329+0000 7efe9d400640 1 --2- 172.21.15.31:0/2000227541 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe78073230 0x7efe780756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:15.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.329+0000 7efe9d400640 1 --2- 172.21.15.31:0/2000227541 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe78073230 0x7efe780756f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009be0 tx=0x7efe8c0091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:15.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.329+0000 7efe95600640 1 -- 172.21.15.31:0/2000227541 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7efe98155730 con 0x7efe980cc570 2024-09-17T05:29:15.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.505+0000 7efe9fe00640 1 -- 172.21.15.31:0/2000227541 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7efe9815e8d0 con 0x7efe980cc570 2024-09-17T05:29:15.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.509+0000 7efe95600640 1 -- 172.21.15.31:0/2000227541 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7efe8405dee0 con 0x7efe980cc570 2024-09-17T05:29:15.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.513+0000 7efe9fe00640 1 -- 172.21.15.31:0/2000227541 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe78073230 msgr2=0x7efe780756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:15.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.513+0000 7efe9fe00640 1 --2- 172.21.15.31:0/2000227541 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe78073230 0x7efe780756f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009be0 tx=0x7efe8c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:29:15.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.513+0000 7efe9fe00640 1 -- 172.21.15.31:0/2000227541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe980cc570 msgr2=0x7efe98154770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:15.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.513+0000 7efe9fe00640 1 --2- 172.21.15.31:0/2000227541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe980cc570 0x7efe98154770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efe8400c3c0 tx=0x7efe8400c880 comp rx=0 tx=0).stop 2024-09-17T05:29:15.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.513+0000 7efe9fe00640 1 -- 172.21.15.31:0/2000227541 shutdown_connections 2024-09-17T05:29:15.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.513+0000 7efe9fe00640 1 --2- 172.21.15.31:0/2000227541 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe78073230 0x7efe780756f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:15.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.513+0000 7efe9fe00640 1 --2- 172.21.15.31:0/2000227541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe980cfb60 0x7efe98152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:15.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.513+0000 7efe9fe00640 1 --2- 172.21.15.31:0/2000227541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe980cc570 0x7efe98154770 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:15.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.513+0000 7efe9fe00640 1 --2- 172.21.15.31:0/2000227541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe98073780 0x7efe98146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:15.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.513+0000 7efe9fe00640 1 -- 172.21.15.31:0/2000227541 >> 172.21.15.31:0/2000227541 conn(0x7efe980b2060 msgr2=0x7efe98151500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:15.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.513+0000 7efe9fe00640 1 -- 172.21.15.31:0/2000227541 shutdown_connections 2024-09-17T05:29:15.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:15.513+0000 7efe9fe00640 1 -- 172.21.15.31:0/2000227541 wait complete. 2024-09-17T05:29:15.537 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:29:15.538 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:29:15.626 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:29:15.723 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:29:15.723 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:29:15.723 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:15.733 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:29:15.733 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:15.783 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:29:15.783 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:15.836 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:29:16.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.025+0000 7fe452a00640 1 -- 172.21.15.31:0/2929569390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe434004090 msgr2=0x7fe434004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:16.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.025+0000 7fe452a00640 1 --2- 172.21.15.31:0/2929569390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe434004090 0x7fe434004810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe43800bbb0 tx=0x7fe43801cda0 comp rx=0 tx=0).stop 2024-09-17T05:29:16.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.025+0000 7fe452000640 1 -- 172.21.15.31:0/2929569390 reap_dead start 2024-09-17T05:29:16.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.025+0000 7fe452a00640 1 -- 172.21.15.31:0/2929569390 shutdown_connections 2024-09-17T05:29:16.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.025+0000 7fe452a00640 1 -- 172.21.15.31:0/2929569390 >> 172.21.15.31:0/2929569390 conn(0x7fe44c06dd30 msgr2=0x7fe44c06e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:16.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.025+0000 7fe452a00640 1 -- 172.21.15.31:0/2929569390 shutdown_connections 2024-09-17T05:29:16.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.025+0000 7fe452a00640 1 -- 172.21.15.31:0/2929569390 wait complete. 2024-09-17T05:29:16.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe452a00640 1 Processor -- start 2024-09-17T05:29:16.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe452a00640 1 -- start start 2024-09-17T05:29:16.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe452a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe434004090 0x7fe44c1f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:16.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe452a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe44c0af3d0 0x7fe44c0adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:16.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe452a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe44c1404a0 0x7fe44c1e52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:16.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe452a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c15fe80 con 0x7fe434004090 2024-09-17T05:29:16.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe452a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c15fd00 con 0x7fe44c0af3d0 2024-09-17T05:29:16.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe452a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe44c0b3af0 con 0x7fe44c1404a0 2024-09-17T05:29:16.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe451600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe434004090 0x7fe44c1f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe451600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe434004090 0x7fe44c1f4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48616/0 (socket says 172.21.15.31:48616) 2024-09-17T05:29:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe451600640 1 -- 172.21.15.31:0/3246991859 learned_addr learned my addr 172.21.15.31:0/3246991859 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe450c00640 1 --2- 172.21.15.31:0/3246991859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe44c0af3d0 0x7fe44c0adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe452000640 1 --2- 172.21.15.31:0/3246991859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe44c1404a0 0x7fe44c1e52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:16.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe451600640 1 -- 172.21.15.31:0/3246991859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe44c1404a0 msgr2=0x7fe44c1e52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:16.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe451600640 1 --2- 172.21.15.31:0/3246991859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe44c1404a0 0x7fe44c1e52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:16.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe451600640 1 -- 172.21.15.31:0/3246991859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe44c0af3d0 msgr2=0x7fe44c0adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:16.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe451600640 1 --2- 172.21.15.31:0/3246991859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe44c0af3d0 0x7fe44c0adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:16.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe451600640 1 -- 172.21.15.31:0/3246991859 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44c0ae330 con 0x7fe434004090 2024-09-17T05:29:16.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe450c00640 1 --2- 172.21.15.31:0/3246991859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe44c0af3d0 0x7fe44c0adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:16.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe451600640 1 --2- 172.21.15.31:0/3246991859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe434004090 0x7fe44c1f4560 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe440012640 tx=0x7fe440012b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:16.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe449600640 1 -- 172.21.15.31:0/3246991859 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440010a80 con 0x7fe434004090 2024-09-17T05:29:16.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe449600640 1 -- 172.21.15.31:0/3246991859 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe440017030 con 0x7fe434004090 2024-09-17T05:29:16.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe449600640 1 -- 172.21.15.31:0/3246991859 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440013450 con 0x7fe434004090 2024-09-17T05:29:16.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe452a00640 1 -- 172.21.15.31:0/3246991859 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe44c0ae610 con 0x7fe434004090 2024-09-17T05:29:16.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.029+0000 7fe452a00640 1 -- 172.21.15.31:0/3246991859 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe44c0aebd0 con 0x7fe434004090 2024-09-17T05:29:16.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.033+0000 7fe452a00640 1 -- 172.21.15.31:0/3246991859 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe44c15ccb0 con 0x7fe434004090 2024-09-17T05:29:16.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.033+0000 7fe449600640 1 -- 172.21.15.31:0/3246991859 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe4400135f0 con 0x7fe434004090 2024-09-17T05:29:16.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.033+0000 7fe449600640 1 --2- 172.21.15.31:0/3246991859 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe42c073230 0x7fe42c0756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:16.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.033+0000 7fe449600640 1 -- 172.21.15.31:0/3246991859 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe440097e80 con 0x7fe434004090 2024-09-17T05:29:16.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.033+0000 7fe450c00640 1 --2- 172.21.15.31:0/3246991859 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe42c073230 0x7fe42c0756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:16.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.033+0000 7fe450c00640 1 --2- 172.21.15.31:0/3246991859 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe42c073230 0x7fe42c0756f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe4380b0000 tx=0x7fe438019b40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:16.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.037+0000 7fe449600640 1 -- 172.21.15.31:0/3246991859 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe440062f20 con 0x7fe434004090 2024-09-17T05:29:16.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.225+0000 7fe452a00640 1 -- 172.21.15.31:0/3246991859 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe44c0b4bc0 con 0x7fe434004090 2024-09-17T05:29:16.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.225+0000 7fe449600640 1 -- 172.21.15.31:0/3246991859 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fe440062820 con 0x7fe434004090 2024-09-17T05:29:16.229 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:29:16.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.229+0000 7fe452a00640 1 -- 172.21.15.31:0/3246991859 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe42c073230 msgr2=0x7fe42c0756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:16.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.229+0000 7fe452a00640 1 --2- 172.21.15.31:0/3246991859 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe42c073230 0x7fe42c0756f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe4380b0000 tx=0x7fe438019b40 comp rx=0 tx=0).stop 2024-09-17T05:29:16.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.229+0000 7fe452a00640 1 -- 172.21.15.31:0/3246991859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe434004090 msgr2=0x7fe44c1f4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:16.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.229+0000 7fe452a00640 1 --2- 172.21.15.31:0/3246991859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe434004090 0x7fe44c1f4560 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe440012640 tx=0x7fe440012b00 comp rx=0 tx=0).stop 2024-09-17T05:29:16.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.229+0000 7fe452a00640 1 -- 172.21.15.31:0/3246991859 shutdown_connections 2024-09-17T05:29:16.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.229+0000 7fe452a00640 1 --2- 172.21.15.31:0/3246991859 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe42c073230 0x7fe42c0756f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:16.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.229+0000 7fe452a00640 1 --2- 172.21.15.31:0/3246991859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe44c1404a0 0x7fe44c1e52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:16.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.229+0000 7fe452a00640 1 --2- 172.21.15.31:0/3246991859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe44c0af3d0 0x7fe44c0adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:16.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.229+0000 7fe452a00640 1 --2- 172.21.15.31:0/3246991859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe434004090 0x7fe44c1f4560 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:16.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.229+0000 7fe452a00640 1 -- 172.21.15.31:0/3246991859 >> 172.21.15.31:0/3246991859 conn(0x7fe44c06dd30 msgr2=0x7fe44c15b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:16.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.229+0000 7fe452a00640 1 -- 172.21.15.31:0/3246991859 shutdown_connections 2024-09-17T05:29:16.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.229+0000 7fe452a00640 1 -- 172.21.15.31:0/3246991859 wait complete. 2024-09-17T05:29:16.252 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:29:16.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:16.252 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-17T05:29:16.283 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:29:16.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:16.284 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:29:16.344 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:29:16.344 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:16.354 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:29:16.354 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:16.404 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:29:16.404 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:16.456 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:29:16.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.597+0000 7f2307a00640 1 -- 172.21.15.31:0/318889877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2300158240 msgr2=0x7f230015ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:16.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.597+0000 7f2307a00640 1 --2- 172.21.15.31:0/318889877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2300158240 0x7f230015ede0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009900 tx=0x7f22f401c8b0 comp rx=0 tx=0).stop 2024-09-17T05:29:16.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f2307a00640 1 -- 172.21.15.31:0/318889877 shutdown_connections 2024-09-17T05:29:16.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f2307a00640 1 --2- 172.21.15.31:0/318889877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2300158620 0x7f2300161a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:16.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f2307a00640 1 --2- 172.21.15.31:0/318889877 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2300158240 0x7f230015ede0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:16.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f2307a00640 1 -- 172.21.15.31:0/318889877 >> 172.21.15.31:0/318889877 conn(0x7f23000d0c90 msgr2=0x7f23000d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:16.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f2307a00640 1 -- 172.21.15.31:0/318889877 shutdown_connections 2024-09-17T05:29:16.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f2307a00640 1 -- 172.21.15.31:0/318889877 wait complete. 2024-09-17T05:29:16.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f2307a00640 1 Processor -- start 2024-09-17T05:29:16.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f2307a00640 1 -- start start 2024-09-17T05:29:16.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f2307a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2300158240 0x7f23000afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:16.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f2307a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2300158620 0x7f23000adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:16.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f2307a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2300161f70 0x7f23000b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:16.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f2307a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f23000cebf0 con 0x7f2300158620 2024-09-17T05:29:16.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f2307a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f23000cea70 con 0x7f2300158240 2024-09-17T05:29:16.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f2307a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f23000ced70 con 0x7f2300161f70 2024-09-17T05:29:16.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f22ffe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2300158620 0x7f23000adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:16.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f22ffe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2300158620 0x7f23000adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48640/0 (socket says 172.21.15.31:48640) 2024-09-17T05:29:16.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f22ffe00640 1 -- 172.21.15.31:0/3851790364 learned_addr learned my addr 172.21.15.31:0/3851790364 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:16.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f2305000640 1 --2- 172.21.15.31:0/3851790364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2300158240 0x7f23000afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:16.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f2305a00640 1 --2- 172.21.15.31:0/3851790364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2300161f70 0x7f23000b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:16.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f22ffe00640 1 -- 172.21.15.31:0/3851790364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2300161f70 msgr2=0x7f23000b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:16.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f22ffe00640 1 --2- 172.21.15.31:0/3851790364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2300161f70 0x7f23000b5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:16.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f22ffe00640 1 -- 172.21.15.31:0/3851790364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2300158240 msgr2=0x7f23000afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:16.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f22ffe00640 1 --2- 172.21.15.31:0/3851790364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2300158240 0x7f23000afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:16.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f22ffe00640 1 -- 172.21.15.31:0/3851790364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23000ae2e0 con 0x7f2300158620 2024-09-17T05:29:16.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f22ffe00640 1 --2- 172.21.15.31:0/3851790364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2300158620 0x7f23000adda0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00e9f0 tx=0x7f22ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:16.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.601+0000 7f22fcc00640 1 -- 172.21.15.31:0/3851790364 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00cd80 con 0x7f2300158620 2024-09-17T05:29:16.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.605+0000 7f22fcc00640 1 -- 172.21.15.31:0/3851790364 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22ec010430 con 0x7f2300158620 2024-09-17T05:29:16.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.605+0000 7f2307a00640 1 -- 172.21.15.31:0/3851790364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23000ae890 con 0x7f2300158620 2024-09-17T05:29:16.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.605+0000 7f22fcc00640 1 -- 172.21.15.31:0/3851790364 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec010860 con 0x7f2300158620 2024-09-17T05:29:16.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.605+0000 7f2307a00640 1 -- 172.21.15.31:0/3851790364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23000aee50 con 0x7f2300158620 2024-09-17T05:29:16.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.605+0000 7f2307a00640 1 -- 172.21.15.31:0/3851790364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23000af610 con 0x7f2300158620 2024-09-17T05:29:16.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.605+0000 7f22fcc00640 1 -- 172.21.15.31:0/3851790364 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f22ec010a00 con 0x7f2300158620 2024-09-17T05:29:16.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.605+0000 7f22fcc00640 1 --2- 172.21.15.31:0/3851790364 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f22e0073200 0x7f22e00756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:16.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.605+0000 7f22fcc00640 1 -- 172.21.15.31:0/3851790364 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f22ec094e10 con 0x7f2300158620 2024-09-17T05:29:16.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.605+0000 7f2305000640 1 --2- 172.21.15.31:0/3851790364 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f22e0073200 0x7f22e00756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:16.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.609+0000 7f2305000640 1 --2- 172.21.15.31:0/3851790364 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f22e0073200 0x7f22e00756c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f22f40af000 tx=0x7f22f401b0f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:16.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.609+0000 7f22fcc00640 1 -- 172.21.15.31:0/3851790364 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f23000af610 con 0x7f2300158620 2024-09-17T05:29:16.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.801+0000 7f2307a00640 1 -- 172.21.15.31:0/3851790364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2300070200 con 0x7f2300158620 2024-09-17T05:29:16.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.801+0000 7f22fcc00640 1 -- 172.21.15.31:0/3851790364 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f22ec098030 con 0x7f2300158620 2024-09-17T05:29:16.805 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:29:16.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.801+0000 7f2307a00640 1 -- 172.21.15.31:0/3851790364 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f22e0073200 msgr2=0x7f22e00756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:16.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.801+0000 7f2307a00640 1 --2- 172.21.15.31:0/3851790364 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f22e0073200 0x7f22e00756c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f22f40af000 tx=0x7f22f401b0f0 comp rx=0 tx=0).stop 2024-09-17T05:29:16.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.801+0000 7f2307a00640 1 -- 172.21.15.31:0/3851790364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2300158620 msgr2=0x7f23000adda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:16.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.801+0000 7f2307a00640 1 --2- 172.21.15.31:0/3851790364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2300158620 0x7f23000adda0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00e9f0 tx=0x7f22ec00eeb0 comp rx=0 tx=0).stop 2024-09-17T05:29:16.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.801+0000 7f2307a00640 1 -- 172.21.15.31:0/3851790364 shutdown_connections 2024-09-17T05:29:16.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.801+0000 7f2307a00640 1 --2- 172.21.15.31:0/3851790364 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f22e0073200 0x7f22e00756c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:16.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.801+0000 7f2307a00640 1 --2- 172.21.15.31:0/3851790364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2300161f70 0x7f23000b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:16.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.801+0000 7f2307a00640 1 --2- 172.21.15.31:0/3851790364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2300158620 0x7f23000adda0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:16.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.801+0000 7f2307a00640 1 --2- 172.21.15.31:0/3851790364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2300158240 0x7f23000afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:16.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.801+0000 7f2307a00640 1 -- 172.21.15.31:0/3851790364 >> 172.21.15.31:0/3851790364 conn(0x7f23000d0c90 msgr2=0x7f23000d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:16.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.801+0000 7f2307a00640 1 -- 172.21.15.31:0/3851790364 shutdown_connections 2024-09-17T05:29:16.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:16.801+0000 7f2307a00640 1 -- 172.21.15.31:0/3851790364 wait complete. 2024-09-17T05:29:16.826 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T05:29:16.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:16.827 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-17T05:29:16.859 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:29:16.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:16.859 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:29:16.916 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:29:16.916 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:16.925 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:29:16.925 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:16.979 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:29:16.979 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:17.033 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:29:17.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca8200640 1 -- 172.21.15.31:0/405910847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ca00cf1d0 msgr2=0x7f2ca015fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:17.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca8200640 1 --2- 172.21.15.31:0/405910847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ca00cf1d0 0x7f2ca015fd80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00b26f0 tx=0x7f2c8c01c7d0 comp rx=0 tx=0).stop 2024-09-17T05:29:17.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca8200640 1 -- 172.21.15.31:0/405910847 shutdown_connections 2024-09-17T05:29:17.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca8200640 1 --2- 172.21.15.31:0/405910847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ca00cf1d0 0x7f2ca015fd80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:17.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca8200640 1 --2- 172.21.15.31:0/405910847 >> v2:172.21.15.155:3300/0 conn(0x7f2ca015f9a0 0x7f2ca006e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:17.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca8200640 1 -- 172.21.15.31:0/405910847 >> 172.21.15.31:0/405910847 conn(0x7f2ca00b18f0 msgr2=0x7f2ca00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:17.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca8200640 1 -- 172.21.15.31:0/405910847 shutdown_connections 2024-09-17T05:29:17.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca8200640 1 -- 172.21.15.31:0/405910847 wait complete. 2024-09-17T05:29:17.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca8200640 1 Processor -- start 2024-09-17T05:29:17.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca8200640 1 -- start start 2024-09-17T05:29:17.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca8200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ca00cf1d0 0x7f2ca01664c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:17.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca8200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ca015f9a0 0x7f2ca0150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:17.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca8200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ca01602c0 0x7f2ca0150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:17.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca8200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca01695a0 con 0x7f2ca00cf1d0 2024-09-17T05:29:17.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca8200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca01608e0 con 0x7f2ca01602c0 2024-09-17T05:29:17.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca8200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca0169720 con 0x7f2ca015f9a0 2024-09-17T05:29:17.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca5800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ca00cf1d0 0x7f2ca01664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:17.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca5800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ca00cf1d0 0x7f2ca01664c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48654/0 (socket says 172.21.15.31:48654) 2024-09-17T05:29:17.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca5800640 1 -- 172.21.15.31:0/1709959423 learned_addr learned my addr 172.21.15.31:0/1709959423 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:17.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca4e00640 1 --2- 172.21.15.31:0/1709959423 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ca015f9a0 0x7f2ca0150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:17.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca6200640 1 --2- 172.21.15.31:0/1709959423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ca01602c0 0x7f2ca0150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:17.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca5800640 1 -- 172.21.15.31:0/1709959423 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ca015f9a0 msgr2=0x7f2ca0150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:17.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca5800640 1 --2- 172.21.15.31:0/1709959423 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ca015f9a0 0x7f2ca0150020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:17.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca5800640 1 -- 172.21.15.31:0/1709959423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ca01602c0 msgr2=0x7f2ca0150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:17.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca5800640 1 --2- 172.21.15.31:0/1709959423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ca01602c0 0x7f2ca0150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:17.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca5800640 1 -- 172.21.15.31:0/1709959423 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca009ab90 con 0x7f2ca00cf1d0 2024-09-17T05:29:17.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.221+0000 7f2ca5800640 1 --2- 172.21.15.31:0/1709959423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ca00cf1d0 0x7f2ca01664c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400d950 tx=0x7f2c9400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:17.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.225+0000 7f2c9d600640 1 -- 172.21.15.31:0/1709959423 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94017070 con 0x7f2ca00cf1d0 2024-09-17T05:29:17.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.225+0000 7f2c9d600640 1 -- 172.21.15.31:0/1709959423 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c94009d20 con 0x7f2ca00cf1d0 2024-09-17T05:29:17.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.225+0000 7f2c9d600640 1 -- 172.21.15.31:0/1709959423 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c940106c0 con 0x7f2ca00cf1d0 2024-09-17T05:29:17.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.225+0000 7f2ca8200640 1 -- 172.21.15.31:0/1709959423 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca009ae70 con 0x7f2ca00cf1d0 2024-09-17T05:29:17.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.225+0000 7f2ca8200640 1 -- 172.21.15.31:0/1709959423 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca00b1100 con 0x7f2ca00cf1d0 2024-09-17T05:29:17.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.225+0000 7f2ca8200640 1 -- 172.21.15.31:0/1709959423 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca0069410 con 0x7f2ca00cf1d0 2024-09-17T05:29:17.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.225+0000 7f2c9d600640 1 -- 172.21.15.31:0/1709959423 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f2c94010860 con 0x7f2ca00cf1d0 2024-09-17T05:29:17.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.225+0000 7f2c9d600640 1 --2- 172.21.15.31:0/1709959423 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2c80073200 0x7f2c800756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:17.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.225+0000 7f2c9d600640 1 -- 172.21.15.31:0/1709959423 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2c940945c0 con 0x7f2ca00cf1d0 2024-09-17T05:29:17.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.225+0000 7f2ca4e00640 1 --2- 172.21.15.31:0/1709959423 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2c80073200 0x7f2c800756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:17.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.229+0000 7f2ca4e00640 1 --2- 172.21.15.31:0/1709959423 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2c80073200 0x7f2c800756c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c0af000 tx=0x7f2c8c01b010 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:17.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.229+0000 7f2c9d600640 1 -- 172.21.15.31:0/1709959423 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2c9405ef80 con 0x7f2ca00cf1d0 2024-09-17T05:29:17.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.417+0000 7f2ca8200640 1 -- 172.21.15.31:0/1709959423 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2ca009b040 con 0x7f2ca00cf1d0 2024-09-17T05:29:17.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.417+0000 7f2c9d600640 1 -- 172.21.15.31:0/1709959423 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f2c940639b0 con 0x7f2ca00cf1d0 2024-09-17T05:29:17.420 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:29:17.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.417+0000 7f2ca8200640 1 -- 172.21.15.31:0/1709959423 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2c80073200 msgr2=0x7f2c800756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:17.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.417+0000 7f2ca8200640 1 --2- 172.21.15.31:0/1709959423 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2c80073200 0x7f2c800756c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c0af000 tx=0x7f2c8c01b010 comp rx=0 tx=0).stop 2024-09-17T05:29:17.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.417+0000 7f2ca8200640 1 -- 172.21.15.31:0/1709959423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ca00cf1d0 msgr2=0x7f2ca01664c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:17.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.417+0000 7f2ca8200640 1 --2- 172.21.15.31:0/1709959423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ca00cf1d0 0x7f2ca01664c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400d950 tx=0x7f2c9400de10 comp rx=0 tx=0).stop 2024-09-17T05:29:17.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.417+0000 7f2ca8200640 1 -- 172.21.15.31:0/1709959423 shutdown_connections 2024-09-17T05:29:17.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.417+0000 7f2ca8200640 1 --2- 172.21.15.31:0/1709959423 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2c80073200 0x7f2c800756c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:17.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.417+0000 7f2ca8200640 1 --2- 172.21.15.31:0/1709959423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ca01602c0 0x7f2ca0150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:17.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.417+0000 7f2ca8200640 1 --2- 172.21.15.31:0/1709959423 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ca015f9a0 0x7f2ca0150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:17.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.417+0000 7f2ca8200640 1 --2- 172.21.15.31:0/1709959423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ca00cf1d0 0x7f2ca01664c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:17.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.417+0000 7f2ca8200640 1 -- 172.21.15.31:0/1709959423 >> 172.21.15.31:0/1709959423 conn(0x7f2ca00b18f0 msgr2=0x7f2ca015b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:17.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.417+0000 7f2ca8200640 1 -- 172.21.15.31:0/1709959423 shutdown_connections 2024-09-17T05:29:17.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.417+0000 7f2ca8200640 1 -- 172.21.15.31:0/1709959423 wait complete. 2024-09-17T05:29:17.442 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-17T05:29:17.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:17.443 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-17T05:29:17.466 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:29:17.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:17.466 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-17T05:29:17.520 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:29:17.520 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:17.530 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:29:17.530 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:17.580 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:29:17.580 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:17.633 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:29:17.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.781+0000 7f7c84800640 1 -- 172.21.15.31:0/3940760187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c64003c90 msgr2=0x7f7c64004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:17.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.781+0000 7f7c84800640 1 --2- 172.21.15.31:0/3940760187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c64003c90 0x7f7c64004090 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7c70001860 tx=0x7f7c7001c8c0 comp rx=0 tx=0).stop 2024-09-17T05:29:17.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.781+0000 7f7c84800640 1 -- 172.21.15.31:0/3940760187 shutdown_connections 2024-09-17T05:29:17.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.781+0000 7f7c84800640 1 --2- 172.21.15.31:0/3940760187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c64003c90 0x7f7c64004090 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:17.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.781+0000 7f7c84800640 1 -- 172.21.15.31:0/3940760187 >> 172.21.15.31:0/3940760187 conn(0x7f7c7c0d1dc0 msgr2=0x7f7c7c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:17.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.781+0000 7f7c84800640 1 -- 172.21.15.31:0/3940760187 shutdown_connections 2024-09-17T05:29:17.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.781+0000 7f7c84800640 1 -- 172.21.15.31:0/3940760187 wait complete. 2024-09-17T05:29:17.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.781+0000 7f7c84800640 1 Processor -- start 2024-09-17T05:29:17.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.781+0000 7f7c84800640 1 -- start start 2024-09-17T05:29:17.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c84800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c64003c90 0x7f7c7c0b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:17.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c84800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c7c0cbdc0 0x7f7c7c1583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:17.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c84800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c7c158930 0x7f7c7c157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:17.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c84800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7c0cea80 con 0x7f7c7c158930 2024-09-17T05:29:17.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c84800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7c0ce900 con 0x7f7c7c0cbdc0 2024-09-17T05:29:17.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c84800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7c7c0cec00 con 0x7f7c64003c90 2024-09-17T05:29:17.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c82800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c7c158930 0x7f7c7c157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:17.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c82800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c7c158930 0x7f7c7c157250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48680/0 (socket says 172.21.15.31:48680) 2024-09-17T05:29:17.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c82800640 1 -- 172.21.15.31:0/1126738338 learned_addr learned my addr 172.21.15.31:0/1126738338 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:17.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c81e00640 1 --2- 172.21.15.31:0/1126738338 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c64003c90 0x7f7c7c0b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:17.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c81400640 1 --2- 172.21.15.31:0/1126738338 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c7c0cbdc0 0x7f7c7c1583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:17.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c82800640 1 -- 172.21.15.31:0/1126738338 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c64003c90 msgr2=0x7f7c7c0b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:17.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c82800640 1 --2- 172.21.15.31:0/1126738338 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c64003c90 0x7f7c7c0b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:17.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c82800640 1 -- 172.21.15.31:0/1126738338 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c7c0cbdc0 msgr2=0x7f7c7c1583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:17.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c82800640 1 --2- 172.21.15.31:0/1126738338 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c7c0cbdc0 0x7f7c7c1583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:17.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c82800640 1 -- 172.21.15.31:0/1126738338 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7c14c240 con 0x7f7c7c158930 2024-09-17T05:29:17.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c82800640 1 --2- 172.21.15.31:0/1126738338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c7c158930 0x7f7c7c157250 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0d0910 tx=0x7f7c7800eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:17.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c76000640 1 -- 172.21.15.31:0/1126738338 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7800c920 con 0x7f7c7c158930 2024-09-17T05:29:17.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c76000640 1 -- 172.21.15.31:0/1126738338 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c78017070 con 0x7f7c7c158930 2024-09-17T05:29:17.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c84800640 1 -- 172.21.15.31:0/1126738338 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c7c0c8f30 con 0x7f7c7c158930 2024-09-17T05:29:17.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c76000640 1 -- 172.21.15.31:0/1126738338 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7800ce30 con 0x7f7c7c158930 2024-09-17T05:29:17.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c84800640 1 -- 172.21.15.31:0/1126738338 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c7c0cb5c0 con 0x7f7c7c158930 2024-09-17T05:29:17.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c84800640 1 -- 172.21.15.31:0/1126738338 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c7c0cd4f0 con 0x7f7c7c158930 2024-09-17T05:29:17.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.785+0000 7f7c76000640 1 -- 172.21.15.31:0/1126738338 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7c7801c460 con 0x7f7c7c158930 2024-09-17T05:29:17.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.789+0000 7f7c76000640 1 --2- 172.21.15.31:0/1126738338 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7c60073230 0x7f7c600756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:17.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.789+0000 7f7c76000640 1 -- 172.21.15.31:0/1126738338 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7c78094540 con 0x7f7c7c158930 2024-09-17T05:29:17.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.789+0000 7f7c81e00640 1 --2- 172.21.15.31:0/1126738338 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7c60073230 0x7f7c600756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:17.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.789+0000 7f7c81e00640 1 --2- 172.21.15.31:0/1126738338 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7c60073230 0x7f7c600756f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7c70001830 tx=0x7f7c70019700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:17.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.793+0000 7f7c76000640 1 -- 172.21.15.31:0/1126738338 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7c7c14c240 con 0x7f7c7c158930 2024-09-17T05:29:17.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.985+0000 7f7c84800640 1 -- 172.21.15.31:0/1126738338 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7c7c0b5000 con 0x7f7c7c158930 2024-09-17T05:29:17.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.985+0000 7f7c76000640 1 -- 172.21.15.31:0/1126738338 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f7c7805f5e0 con 0x7f7c7c158930 2024-09-17T05:29:17.988 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:29:17.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.985+0000 7f7c84800640 1 -- 172.21.15.31:0/1126738338 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7c60073230 msgr2=0x7f7c600756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:17.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.985+0000 7f7c84800640 1 --2- 172.21.15.31:0/1126738338 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7c60073230 0x7f7c600756f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7c70001830 tx=0x7f7c70019700 comp rx=0 tx=0).stop 2024-09-17T05:29:17.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.985+0000 7f7c84800640 1 -- 172.21.15.31:0/1126738338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c7c158930 msgr2=0x7f7c7c157250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:17.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.985+0000 7f7c84800640 1 --2- 172.21.15.31:0/1126738338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c7c158930 0x7f7c7c157250 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c0d0910 tx=0x7f7c7800eac0 comp rx=0 tx=0).stop 2024-09-17T05:29:17.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.985+0000 7f7c84800640 1 -- 172.21.15.31:0/1126738338 shutdown_connections 2024-09-17T05:29:17.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.985+0000 7f7c84800640 1 --2- 172.21.15.31:0/1126738338 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7c60073230 0x7f7c600756f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:17.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.985+0000 7f7c84800640 1 --2- 172.21.15.31:0/1126738338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c7c158930 0x7f7c7c157250 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:17.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.985+0000 7f7c84800640 1 --2- 172.21.15.31:0/1126738338 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c7c0cbdc0 0x7f7c7c1583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:17.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.985+0000 7f7c84800640 1 --2- 172.21.15.31:0/1126738338 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c64003c90 0x7f7c7c0b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:17.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.985+0000 7f7c84800640 1 -- 172.21.15.31:0/1126738338 >> 172.21.15.31:0/1126738338 conn(0x7f7c7c0d1dc0 msgr2=0x7f7c7c159920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:17.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.985+0000 7f7c84800640 1 -- 172.21.15.31:0/1126738338 shutdown_connections 2024-09-17T05:29:17.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:17.985+0000 7f7c84800640 1 -- 172.21.15.31:0/1126738338 wait complete. 2024-09-17T05:29:18.010 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-17T05:29:18.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:18.011 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-17T05:29:18.038 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:29:18.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:18.038 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-17T05:29:18.093 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:29:18.094 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:29:18.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.237+0000 7fe1a2200640 1 -- 172.21.15.31:0/2705807094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe19c0d28e0 msgr2=0x7fe19c0cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:18.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.237+0000 7fe1a2200640 1 --2- 172.21.15.31:0/2705807094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe19c0d28e0 0x7fe19c0cc9d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0745d0 tx=0x7fe19401cd80 comp rx=0 tx=0).stop 2024-09-17T05:29:18.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.237+0000 7fe1a2200640 1 -- 172.21.15.31:0/2705807094 shutdown_connections 2024-09-17T05:29:18.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.237+0000 7fe1a2200640 1 --2- 172.21.15.31:0/2705807094 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe19c0d28e0 0x7fe19c0cc9d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:18.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.237+0000 7fe1a2200640 1 --2- 172.21.15.31:0/2705807094 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe19c0cdb30 0x7fe19c0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:18.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.237+0000 7fe1a2200640 1 --2- 172.21.15.31:0/2705807094 >> v2:172.21.15.155:3300/0 conn(0x7fe19c15bea0 0x7fe19c0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:18.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.237+0000 7fe1a2200640 1 -- 172.21.15.31:0/2705807094 >> 172.21.15.31:0/2705807094 conn(0x7fe19c0d1dc0 msgr2=0x7fe19c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:18.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.237+0000 7fe1a2200640 1 -- 172.21.15.31:0/2705807094 shutdown_connections 2024-09-17T05:29:18.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.237+0000 7fe1a2200640 1 -- 172.21.15.31:0/2705807094 wait complete. 2024-09-17T05:29:18.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.237+0000 7fe1a2200640 1 Processor -- start 2024-09-17T05:29:18.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.237+0000 7fe1a2200640 1 -- start start 2024-09-17T05:29:18.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.237+0000 7fe1a2200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe19c0cdb30 0x7fe19c1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:18.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.237+0000 7fe1a2200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe19c0d28e0 0x7fe19c0ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:18.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.237+0000 7fe1a2200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe19c15bea0 0x7fe19c157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:18.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.237+0000 7fe1a2200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c0af120 con 0x7fe19c15bea0 2024-09-17T05:29:18.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.237+0000 7fe1a2200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c0aefa0 con 0x7fe19c0cdb30 2024-09-17T05:29:18.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.237+0000 7fe1a2200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe19c0af2a0 con 0x7fe19c0d28e0 2024-09-17T05:29:18.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.241+0000 7fe19be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe19c15bea0 0x7fe19c157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:18.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.241+0000 7fe19be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe19c15bea0 0x7fe19c157f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48704/0 (socket says 172.21.15.31:48704) 2024-09-17T05:29:18.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.241+0000 7fe19be00640 1 -- 172.21.15.31:0/3801559961 learned_addr learned my addr 172.21.15.31:0/3801559961 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:18.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.241+0000 7fe19b400640 1 --2- 172.21.15.31:0/3801559961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe19c0cdb30 0x7fe19c1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:18.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.241+0000 7fe19be00640 1 -- 172.21.15.31:0/3801559961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe19c0d28e0 msgr2=0x7fe19c0ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:18.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.241+0000 7fe19be00640 1 --2- 172.21.15.31:0/3801559961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe19c0d28e0 0x7fe19c0ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:18.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.241+0000 7fe19be00640 1 -- 172.21.15.31:0/3801559961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe19c0cdb30 msgr2=0x7fe19c1524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:18.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.241+0000 7fe19be00640 1 --2- 172.21.15.31:0/3801559961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe19c0cdb30 0x7fe19c1524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:18.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.241+0000 7fe19be00640 1 -- 172.21.15.31:0/3801559961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c0cac20 con 0x7fe19c15bea0 2024-09-17T05:29:18.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.241+0000 7fe19b400640 1 --2- 172.21.15.31:0/3801559961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe19c0cdb30 0x7fe19c1524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:29:18.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.241+0000 7fe19be00640 1 --2- 172.21.15.31:0/3801559961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe19c15bea0 0x7fe19c157f80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe19401b430 tx=0x7fe194003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:18.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.241+0000 7fe193400640 1 -- 172.21.15.31:0/3801559961 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1940bb070 con 0x7fe19c15bea0 2024-09-17T05:29:18.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.241+0000 7fe193400640 1 -- 172.21.15.31:0/3801559961 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe194004d40 con 0x7fe19c15bea0 2024-09-17T05:29:18.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.241+0000 7fe193400640 1 -- 172.21.15.31:0/3801559961 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1940b2040 con 0x7fe19c15bea0 2024-09-17T05:29:18.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.241+0000 7fe1a2200640 1 -- 172.21.15.31:0/3801559961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19c1558c0 con 0x7fe19c15bea0 2024-09-17T05:29:18.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.241+0000 7fe1a2200640 1 -- 172.21.15.31:0/3801559961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe19c155020 con 0x7fe19c15bea0 2024-09-17T05:29:18.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.241+0000 7fe1a2200640 1 -- 172.21.15.31:0/3801559961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe19c0af830 con 0x7fe19c15bea0 2024-09-17T05:29:18.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.241+0000 7fe193400640 1 -- 172.21.15.31:0/3801559961 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe1940a5be0 con 0x7fe19c15bea0 2024-09-17T05:29:18.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.245+0000 7fe193400640 1 --2- 172.21.15.31:0/3801559961 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe178073200 0x7fe1780756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:18.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.245+0000 7fe193400640 1 -- 172.21.15.31:0/3801559961 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe19412e460 con 0x7fe19c15bea0 2024-09-17T05:29:18.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.245+0000 7fe19b400640 1 --2- 172.21.15.31:0/3801559961 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe178073200 0x7fe1780756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:18.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.245+0000 7fe19b400640 1 --2- 172.21.15.31:0/3801559961 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe178073200 0x7fe1780756c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe19c1f8de0 tx=0x7fe18c0091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:18.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.245+0000 7fe193400640 1 -- 172.21.15.31:0/3801559961 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe1940c4020 con 0x7fe19c15bea0 2024-09-17T05:29:18.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.457+0000 7fe1a2200640 1 -- 172.21.15.31:0/3801559961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe19c156980 con 0x7fe19c15bea0 2024-09-17T05:29:18.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.457+0000 7fe193400640 1 -- 172.21.15.31:0/3801559961 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7fe194016970 con 0x7fe19c15bea0 2024-09-17T05:29:18.463 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:18.463 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"btime":"2024-09-17T05:28:48:676550+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/3491154284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3491154284},{"type":"v1","addr":"172.21.15.155:6836","nonce":3491154284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4301,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3619522478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3619522478},{"type":"v1","addr":"172.21.15.155:6837","nonce":3619522478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/851893415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":851893415},{"type":"v1","addr":"172.21.15.31:6834","nonce":851893415}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:28:45.059391+0000","modified":"2024-09-17T05:28:48.082624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4380":{"gid":4380,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3393035146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3393035146},{"type":"v1","addr":"172.21.15.31:6835","nonce":3393035146}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4380,"qdb_cluster":[4380]},"id":1}]} 2024-09-17T05:29:18.464 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-09-17T05:29:18.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.461+0000 7fe1a2200640 1 -- 172.21.15.31:0/3801559961 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe178073200 msgr2=0x7fe1780756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:18.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.461+0000 7fe1a2200640 1 --2- 172.21.15.31:0/3801559961 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe178073200 0x7fe1780756c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe19c1f8de0 tx=0x7fe18c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:29:18.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.461+0000 7fe1a2200640 1 -- 172.21.15.31:0/3801559961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe19c15bea0 msgr2=0x7fe19c157f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:18.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.461+0000 7fe1a2200640 1 --2- 172.21.15.31:0/3801559961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe19c15bea0 0x7fe19c157f80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe19401b430 tx=0x7fe194003f60 comp rx=0 tx=0).stop 2024-09-17T05:29:18.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.461+0000 7fe1a2200640 1 -- 172.21.15.31:0/3801559961 shutdown_connections 2024-09-17T05:29:18.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.461+0000 7fe1a2200640 1 --2- 172.21.15.31:0/3801559961 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe178073200 0x7fe1780756c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:18.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.461+0000 7fe1a2200640 1 --2- 172.21.15.31:0/3801559961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe19c15bea0 0x7fe19c157f80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:18.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.461+0000 7fe1a2200640 1 --2- 172.21.15.31:0/3801559961 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe19c0d28e0 0x7fe19c0ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:18.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.461+0000 7fe1a2200640 1 --2- 172.21.15.31:0/3801559961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe19c0cdb30 0x7fe19c1524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:18.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.461+0000 7fe1a2200640 1 -- 172.21.15.31:0/3801559961 >> 172.21.15.31:0/3801559961 conn(0x7fe19c0d1dc0 msgr2=0x7fe19c159d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:18.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.461+0000 7fe1a2200640 1 -- 172.21.15.31:0/3801559961 shutdown_connections 2024-09-17T05:29:18.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.461+0000 7fe1a2200640 1 -- 172.21.15.31:0/3801559961 wait complete. 2024-09-17T05:29:18.485 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:29:18.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72ed600640 1 -- 172.21.15.31:0/3053996982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72cc005240 msgr2=0x7f72cc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:18.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72ed600640 1 --2- 172.21.15.31:0/3053996982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72cc005240 0x7f72cc00b9d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f72e000e400 tx=0x7f72e001d7d0 comp rx=0 tx=0).stop 2024-09-17T05:29:18.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72ed600640 1 -- 172.21.15.31:0/3053996982 shutdown_connections 2024-09-17T05:29:18.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72ed600640 1 --2- 172.21.15.31:0/3053996982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72cc005240 0x7f72cc00b9d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:18.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72ed600640 1 -- 172.21.15.31:0/3053996982 >> 172.21.15.31:0/3053996982 conn(0x7f72e80d1d90 msgr2=0x7f72e80d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:18.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72ed600640 1 -- 172.21.15.31:0/3053996982 shutdown_connections 2024-09-17T05:29:18.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72ed600640 1 -- 172.21.15.31:0/3053996982 wait complete. 2024-09-17T05:29:18.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72ed600640 1 Processor -- start 2024-09-17T05:29:18.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72ed600640 1 -- start start 2024-09-17T05:29:18.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72ed600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72cc005240 0x7f72e815cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:18.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72ed600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72e814b460 0x7f72e80ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:18.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72ed600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72e80cad50 0x7f72e80c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:18.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72ed600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f72e815f960 con 0x7f72e814b460 2024-09-17T05:29:18.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72ed600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f72e815c180 con 0x7f72e80cad50 2024-09-17T05:29:18.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72ed600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f72e815fae0 con 0x7f72cc005240 2024-09-17T05:29:18.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72dfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72e814b460 0x7f72e80ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:18.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72dfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72e814b460 0x7f72e80ca810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39914/0 (socket says 172.21.15.31:39914) 2024-09-17T05:29:18.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72dfe00640 1 -- 172.21.15.31:0/1120828654 learned_addr learned my addr 172.21.15.31:0/1120828654 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:18.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72e6a00640 1 --2- 172.21.15.31:0/1120828654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72cc005240 0x7f72e815cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:18.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.629+0000 7f72e7400640 1 --2- 172.21.15.31:0/1120828654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72e80cad50 0x7f72e80c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:18.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.633+0000 7f72dfe00640 1 -- 172.21.15.31:0/1120828654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72cc005240 msgr2=0x7f72e815cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:18.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.633+0000 7f72dfe00640 1 --2- 172.21.15.31:0/1120828654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72cc005240 0x7f72e815cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:18.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.633+0000 7f72dfe00640 1 -- 172.21.15.31:0/1120828654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72e80cad50 msgr2=0x7f72e80c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:18.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.633+0000 7f72dfe00640 1 --2- 172.21.15.31:0/1120828654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72e80cad50 0x7f72e80c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:18.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.633+0000 7f72dfe00640 1 -- 172.21.15.31:0/1120828654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e80b7c30 con 0x7f72e814b460 2024-09-17T05:29:18.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.633+0000 7f72e6a00640 1 --2- 172.21.15.31:0/1120828654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72cc005240 0x7f72e815cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:18.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.633+0000 7f72dfe00640 1 --2- 172.21.15.31:0/1120828654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72e814b460 0x7f72e80ca810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f72d0003ea0 tx=0x7f72d0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:18.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.633+0000 7f72dea00640 1 -- 172.21.15.31:0/1120828654 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d0015070 con 0x7f72e814b460 2024-09-17T05:29:18.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.633+0000 7f72dea00640 1 -- 172.21.15.31:0/1120828654 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72d0011900 con 0x7f72e814b460 2024-09-17T05:29:18.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.633+0000 7f72dea00640 1 -- 172.21.15.31:0/1120828654 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d0011d50 con 0x7f72e814b460 2024-09-17T05:29:18.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.633+0000 7f72ed600640 1 -- 172.21.15.31:0/1120828654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e80c9d00 con 0x7f72e814b460 2024-09-17T05:29:18.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.633+0000 7f72ed600640 1 -- 172.21.15.31:0/1120828654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e8158100 con 0x7f72e814b460 2024-09-17T05:29:18.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.633+0000 7f72ed600640 1 -- 172.21.15.31:0/1120828654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72e80cb160 con 0x7f72e814b460 2024-09-17T05:29:18.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.633+0000 7f72dea00640 1 -- 172.21.15.31:0/1120828654 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f72d0018070 con 0x7f72e814b460 2024-09-17T05:29:18.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.633+0000 7f72dea00640 1 --2- 172.21.15.31:0/1120828654 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f72c4073230 0x7f72c40756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:18.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.633+0000 7f72dea00640 1 -- 172.21.15.31:0/1120828654 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f72d0094ef0 con 0x7f72e814b460 2024-09-17T05:29:18.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.637+0000 7f72e6a00640 1 --2- 172.21.15.31:0/1120828654 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f72c4073230 0x7f72c40756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:18.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.637+0000 7f72e6a00640 1 --2- 172.21.15.31:0/1120828654 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f72c4073230 0x7f72c40756f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f72d8006b20 tx=0x7f72d8006a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:18.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.637+0000 7f72dea00640 1 -- 172.21.15.31:0/1120828654 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f72e80cb160 con 0x7f72e814b460 2024-09-17T05:29:18.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.853+0000 7f72ed600640 1 -- 172.21.15.31:0/1120828654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72e80d0500 con 0x7f72e814b460 2024-09-17T05:29:18.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.853+0000 7f72dea00640 1 -- 172.21.15.31:0/1120828654 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7f72d005ff90 con 0x7f72e814b460 2024-09-17T05:29:18.857 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:18.857 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"btime":"2024-09-17T05:28:48:676550+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/3491154284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3491154284},{"type":"v1","addr":"172.21.15.155:6836","nonce":3491154284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4301,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3619522478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3619522478},{"type":"v1","addr":"172.21.15.155:6837","nonce":3619522478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/851893415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":851893415},{"type":"v1","addr":"172.21.15.31:6834","nonce":851893415}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:28:45.059391+0000","modified":"2024-09-17T05:28:48.082624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4380":{"gid":4380,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3393035146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3393035146},{"type":"v1","addr":"172.21.15.31:6835","nonce":3393035146}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4380,"qdb_cluster":[4380]},"id":1}]} 2024-09-17T05:29:18.857 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-09-17T05:29:18.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.853+0000 7f72ed600640 1 -- 172.21.15.31:0/1120828654 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f72c4073230 msgr2=0x7f72c40756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:18.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.853+0000 7f72ed600640 1 --2- 172.21.15.31:0/1120828654 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f72c4073230 0x7f72c40756f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f72d8006b20 tx=0x7f72d8006a30 comp rx=0 tx=0).stop 2024-09-17T05:29:18.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.853+0000 7f72ed600640 1 -- 172.21.15.31:0/1120828654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72e814b460 msgr2=0x7f72e80ca810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:18.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.853+0000 7f72ed600640 1 --2- 172.21.15.31:0/1120828654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72e814b460 0x7f72e80ca810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f72d0003ea0 tx=0x7f72d0003f90 comp rx=0 tx=0).stop 2024-09-17T05:29:18.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.853+0000 7f72ed600640 1 -- 172.21.15.31:0/1120828654 shutdown_connections 2024-09-17T05:29:18.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.853+0000 7f72ed600640 1 --2- 172.21.15.31:0/1120828654 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f72c4073230 0x7f72c40756f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:18.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.853+0000 7f72ed600640 1 --2- 172.21.15.31:0/1120828654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72e80cad50 0x7f72e80c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:18.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.853+0000 7f72ed600640 1 --2- 172.21.15.31:0/1120828654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72e814b460 0x7f72e80ca810 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:18.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.853+0000 7f72ed600640 1 --2- 172.21.15.31:0/1120828654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72cc005240 0x7f72e815cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:18.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.853+0000 7f72ed600640 1 -- 172.21.15.31:0/1120828654 >> 172.21.15.31:0/1120828654 conn(0x7f72e80d1d90 msgr2=0x7f72e80c7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:18.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.853+0000 7f72ed600640 1 -- 172.21.15.31:0/1120828654 shutdown_connections 2024-09-17T05:29:18.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:18.853+0000 7f72ed600640 1 -- 172.21.15.31:0/1120828654 wait complete. 2024-09-17T05:29:18.879 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:29:19.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.021+0000 7f4985a00640 1 -- 172.21.15.31:0/1013961425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49800ced80 msgr2=0x7f49800ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:19.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.021+0000 7f4985a00640 1 --2- 172.21.15.31:0/1013961425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49800ced80 0x7f49800ae9b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f496c009840 tx=0x7f496c01c820 comp rx=0 tx=0).stop 2024-09-17T05:29:19.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.021+0000 7f4985a00640 1 -- 172.21.15.31:0/1013961425 shutdown_connections 2024-09-17T05:29:19.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.021+0000 7f4985a00640 1 --2- 172.21.15.31:0/1013961425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49800cdb30 0x7f49800aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.021+0000 7f4985a00640 1 --2- 172.21.15.31:0/1013961425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49800ced80 0x7f49800ae9b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.021+0000 7f4985a00640 1 -- 172.21.15.31:0/1013961425 >> 172.21.15.31:0/1013961425 conn(0x7f49800d1dc0 msgr2=0x7f49800d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:19.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.021+0000 7f4985a00640 1 -- 172.21.15.31:0/1013961425 shutdown_connections 2024-09-17T05:29:19.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.021+0000 7f4985a00640 1 -- 172.21.15.31:0/1013961425 wait complete. 2024-09-17T05:29:19.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.021+0000 7f4985a00640 1 Processor -- start 2024-09-17T05:29:19.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.021+0000 7f4985a00640 1 -- start start 2024-09-17T05:29:19.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f4985a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49800cdb30 0x7f498014ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:19.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f4985a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49800ced80 0x7f498015ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:19.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f4985a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f498015bea0 0x7f498015b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:19.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f4985a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4980169340 con 0x7f498015bea0 2024-09-17T05:29:19.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f4985a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f49801691c0 con 0x7f49800ced80 2024-09-17T05:29:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f4985a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f49801694c0 con 0x7f49800cdb30 2024-09-17T05:29:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f497f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f498015bea0 0x7f498015b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f497f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f498015bea0 0x7f498015b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39924/0 (socket says 172.21.15.31:39924) 2024-09-17T05:29:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f497f400640 1 -- 172.21.15.31:0/4216893498 learned_addr learned my addr 172.21.15.31:0/4216893498 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f497ea00640 1 --2- 172.21.15.31:0/4216893498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49800cdb30 0x7f498014ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f497e000640 1 --2- 172.21.15.31:0/4216893498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49800ced80 0x7f498015ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f497f400640 1 -- 172.21.15.31:0/4216893498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49800cdb30 msgr2=0x7f498014ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f497f400640 1 --2- 172.21.15.31:0/4216893498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49800cdb30 0x7f498014ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f497f400640 1 -- 172.21.15.31:0/4216893498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49800ced80 msgr2=0x7f498015ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f497f400640 1 --2- 172.21.15.31:0/4216893498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49800ced80 0x7f498015ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f497f400640 1 -- 172.21.15.31:0/4216893498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49801f9af0 con 0x7f498015bea0 2024-09-17T05:29:19.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f497e000640 1 --2- 172.21.15.31:0/4216893498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49800ced80 0x7f498015ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:29:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f497f400640 1 --2- 172.21.15.31:0/4216893498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f498015bea0 0x7f498015b190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f497800ea20 tx=0x7f497800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f4976a00640 1 -- 172.21.15.31:0/4216893498 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497800cde0 con 0x7f498015bea0 2024-09-17T05:29:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f4976a00640 1 -- 172.21.15.31:0/4216893498 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4978004c40 con 0x7f498015bea0 2024-09-17T05:29:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f4976a00640 1 -- 172.21.15.31:0/4216893498 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978005280 con 0x7f498015bea0 2024-09-17T05:29:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f4985a00640 1 -- 172.21.15.31:0/4216893498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f498009fab0 con 0x7f498015bea0 2024-09-17T05:29:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f4985a00640 1 -- 172.21.15.31:0/4216893498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49801f9150 con 0x7f498015bea0 2024-09-17T05:29:19.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.025+0000 7f4985a00640 1 -- 172.21.15.31:0/4216893498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49800ce670 con 0x7f498015bea0 2024-09-17T05:29:19.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.029+0000 7f4976a00640 1 -- 172.21.15.31:0/4216893498 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f4978005420 con 0x7f498015bea0 2024-09-17T05:29:19.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.029+0000 7f4976a00640 1 --2- 172.21.15.31:0/4216893498 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4960073200 0x7f49600756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:19.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.029+0000 7f4976a00640 1 -- 172.21.15.31:0/4216893498 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4978094b30 con 0x7f498015bea0 2024-09-17T05:29:19.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.029+0000 7f497ea00640 1 --2- 172.21.15.31:0/4216893498 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4960073200 0x7f49600756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:19.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.029+0000 7f497ea00640 1 --2- 172.21.15.31:0/4216893498 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4960073200 0x7f49600756c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4970000f70 tx=0x7f4970009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:19.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.033+0000 7f4976a00640 1 -- 172.21.15.31:0/4216893498 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4978016030 con 0x7f498015bea0 2024-09-17T05:29:19.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.209+0000 7f4985a00640 1 -- 172.21.15.31:0/4216893498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49800d2400 con 0x7f498015bea0 2024-09-17T05:29:19.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.209+0000 7f4976a00640 1 -- 172.21.15.31:0/4216893498 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16689 (secure 0 0 0) 0x7f497805fc70 con 0x7f498015bea0 2024-09-17T05:29:19.213 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:19.213 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":21,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:28:46.650201+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:28:42.906739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:28:44.023489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:29:19.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.209+0000 7f4985a00640 1 -- 172.21.15.31:0/4216893498 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4960073200 msgr2=0x7f49600756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:19.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.209+0000 7f4985a00640 1 --2- 172.21.15.31:0/4216893498 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4960073200 0x7f49600756c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4970000f70 tx=0x7f4970009040 comp rx=0 tx=0).stop 2024-09-17T05:29:19.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.209+0000 7f4985a00640 1 -- 172.21.15.31:0/4216893498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f498015bea0 msgr2=0x7f498015b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:19.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.209+0000 7f4985a00640 1 --2- 172.21.15.31:0/4216893498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f498015bea0 0x7f498015b190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f497800ea20 tx=0x7f497800eee0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.209+0000 7f4985a00640 1 -- 172.21.15.31:0/4216893498 shutdown_connections 2024-09-17T05:29:19.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.209+0000 7f4985a00640 1 --2- 172.21.15.31:0/4216893498 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4960073200 0x7f49600756c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.209+0000 7f4985a00640 1 --2- 172.21.15.31:0/4216893498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f498015bea0 0x7f498015b190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.209+0000 7f4985a00640 1 --2- 172.21.15.31:0/4216893498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49800ced80 0x7f498015ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.209+0000 7f4985a00640 1 --2- 172.21.15.31:0/4216893498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49800cdb30 0x7f498014ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.209+0000 7f4985a00640 1 -- 172.21.15.31:0/4216893498 >> 172.21.15.31:0/4216893498 conn(0x7f49800d1dc0 msgr2=0x7f49800b7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:19.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.209+0000 7f4985a00640 1 -- 172.21.15.31:0/4216893498 shutdown_connections 2024-09-17T05:29:19.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.209+0000 7f4985a00640 1 -- 172.21.15.31:0/4216893498 wait complete. 2024-09-17T05:29:19.234 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:29:19.235 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:29:19.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.377+0000 7faa51e00640 1 -- 172.21.15.31:0/711714501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa34003a40 msgr2=0x7faa34003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:19.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.377+0000 7faa51e00640 1 --2- 172.21.15.31:0/711714501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa34003a40 0x7faa34003e60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faa40009b60 tx=0x7faa4001d270 comp rx=0 tx=0).stop 2024-09-17T05:29:19.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.377+0000 7faa51400640 1 -- 172.21.15.31:0/711714501 reap_dead start 2024-09-17T05:29:19.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.377+0000 7faa51e00640 1 -- 172.21.15.31:0/711714501 shutdown_connections 2024-09-17T05:29:19.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.377+0000 7faa51e00640 1 -- 172.21.15.31:0/711714501 >> 172.21.15.31:0/711714501 conn(0x7faa4c0b1960 msgr2=0x7faa4c0b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:19.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.377+0000 7faa51e00640 1 -- 172.21.15.31:0/711714501 shutdown_connections 2024-09-17T05:29:19.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.377+0000 7faa51e00640 1 -- 172.21.15.31:0/711714501 wait complete. 2024-09-17T05:29:19.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa51e00640 1 Processor -- start 2024-09-17T05:29:19.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa51e00640 1 -- start start 2024-09-17T05:29:19.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa51e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa34003a40 0x7faa4c150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:19.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa51e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa4c0b4af0 0x7faa4c0b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:19.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa51e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa4c06e9e0 0x7faa4c06ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:19.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa51e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c168430 con 0x7faa4c0b4af0 2024-09-17T05:29:19.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa51e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faa4c0cfa70 con 0x7faa4c06e9e0 2024-09-17T05:29:19.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa51e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7faa4c1685b0 con 0x7faa34003a40 2024-09-17T05:29:19.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa4be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa4c0b4af0 0x7faa4c0b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:19.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa4be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa4c0b4af0 0x7faa4c0b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39942/0 (socket says 172.21.15.31:39942) 2024-09-17T05:29:19.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa4be00640 1 -- 172.21.15.31:0/559436218 learned_addr learned my addr 172.21.15.31:0/559436218 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:19.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa50a00640 1 --2- 172.21.15.31:0/559436218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa34003a40 0x7faa4c150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:19.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa51400640 1 --2- 172.21.15.31:0/559436218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa4c06e9e0 0x7faa4c06ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:19.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa4be00640 1 -- 172.21.15.31:0/559436218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa34003a40 msgr2=0x7faa4c150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:19.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa4be00640 1 --2- 172.21.15.31:0/559436218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa34003a40 0x7faa4c150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa4be00640 1 -- 172.21.15.31:0/559436218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa4c06e9e0 msgr2=0x7faa4c06ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:19.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa4be00640 1 --2- 172.21.15.31:0/559436218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa4c06e9e0 0x7faa4c06ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa4be00640 1 -- 172.21.15.31:0/559436218 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa4c0b4030 con 0x7faa4c0b4af0 2024-09-17T05:29:19.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa51400640 1 --2- 172.21.15.31:0/559436218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa4c06e9e0 0x7faa4c06ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:19.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa4be00640 1 --2- 172.21.15.31:0/559436218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa4c0b4af0 0x7faa4c0b4f50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faa38006480 tx=0x7faa380039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:19.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa48c00640 1 -- 172.21.15.31:0/559436218 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38015070 con 0x7faa4c0b4af0 2024-09-17T05:29:19.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa48c00640 1 -- 172.21.15.31:0/559436218 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa38011840 con 0x7faa4c0b4af0 2024-09-17T05:29:19.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa48c00640 1 -- 172.21.15.31:0/559436218 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38011c70 con 0x7faa4c0b4af0 2024-09-17T05:29:19.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa51e00640 1 -- 172.21.15.31:0/559436218 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa4c15df00 con 0x7faa4c0b4af0 2024-09-17T05:29:19.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa51e00640 1 -- 172.21.15.31:0/559436218 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa4c0b42f0 con 0x7faa4c0b4af0 2024-09-17T05:29:19.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.381+0000 7faa51e00640 1 -- 172.21.15.31:0/559436218 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa4c0ced10 con 0x7faa4c0b4af0 2024-09-17T05:29:19.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.385+0000 7faa48c00640 1 -- 172.21.15.31:0/559436218 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7faa38018070 con 0x7faa4c0b4af0 2024-09-17T05:29:19.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.385+0000 7faa48c00640 1 --2- 172.21.15.31:0/559436218 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7faa2c073200 0x7faa2c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:19.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.385+0000 7faa48c00640 1 -- 172.21.15.31:0/559436218 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faa38094e70 con 0x7faa4c0b4af0 2024-09-17T05:29:19.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.385+0000 7faa50a00640 1 --2- 172.21.15.31:0/559436218 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7faa2c073200 0x7faa2c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:19.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.385+0000 7faa50a00640 1 --2- 172.21.15.31:0/559436218 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7faa2c073200 0x7faa2c0756c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faa400ae000 tx=0x7faa4001a010 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:19.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.389+0000 7faa48c00640 1 -- 172.21.15.31:0/559436218 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7faa3805f8c0 con 0x7faa4c0b4af0 2024-09-17T05:29:19.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.601+0000 7faa51e00640 1 -- 172.21.15.31:0/559436218 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa4c0b5df0 con 0x7faa4c0b4af0 2024-09-17T05:29:19.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.601+0000 7faa48c00640 1 -- 172.21.15.31:0/559436218 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7faa380642f0 con 0x7faa4c0b4af0 2024-09-17T05:29:19.606 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:19.606 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"btime":"2024-09-17T05:28:48:676550+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/3491154284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3491154284},{"type":"v1","addr":"172.21.15.155:6836","nonce":3491154284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4301,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3619522478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3619522478},{"type":"v1","addr":"172.21.15.155:6837","nonce":3619522478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/851893415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":851893415},{"type":"v1","addr":"172.21.15.31:6834","nonce":851893415}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:28:45.059391+0000","modified":"2024-09-17T05:28:48.082624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4380":{"gid":4380,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3393035146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3393035146},{"type":"v1","addr":"172.21.15.31:6835","nonce":3393035146}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4380,"qdb_cluster":[4380]},"id":1}]} 2024-09-17T05:29:19.606 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-09-17T05:29:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.605+0000 7faa51e00640 1 -- 172.21.15.31:0/559436218 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7faa2c073200 msgr2=0x7faa2c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.605+0000 7faa51e00640 1 --2- 172.21.15.31:0/559436218 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7faa2c073200 0x7faa2c0756c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faa400ae000 tx=0x7faa4001a010 comp rx=0 tx=0).stop 2024-09-17T05:29:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.605+0000 7faa51e00640 1 -- 172.21.15.31:0/559436218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa4c0b4af0 msgr2=0x7faa4c0b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.605+0000 7faa51e00640 1 --2- 172.21.15.31:0/559436218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa4c0b4af0 0x7faa4c0b4f50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faa38006480 tx=0x7faa380039d0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.605+0000 7faa51e00640 1 -- 172.21.15.31:0/559436218 shutdown_connections 2024-09-17T05:29:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.605+0000 7faa51e00640 1 --2- 172.21.15.31:0/559436218 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7faa2c073200 0x7faa2c0756c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.605+0000 7faa51e00640 1 --2- 172.21.15.31:0/559436218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa4c06e9e0 0x7faa4c06ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.605+0000 7faa51e00640 1 --2- 172.21.15.31:0/559436218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faa4c0b4af0 0x7faa4c0b4f50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.605+0000 7faa51e00640 1 --2- 172.21.15.31:0/559436218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa34003a40 0x7faa4c150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.605+0000 7faa51e00640 1 -- 172.21.15.31:0/559436218 >> 172.21.15.31:0/559436218 conn(0x7faa4c0b1960 msgr2=0x7faa4c153130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:19.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.605+0000 7faa51e00640 1 -- 172.21.15.31:0/559436218 shutdown_connections 2024-09-17T05:29:19.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.605+0000 7faa51e00640 1 -- 172.21.15.31:0/559436218 wait complete. 2024-09-17T05:29:19.630 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:29:19.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.773+0000 7f9e4e800640 1 -- 172.21.15.31:0/2508830756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e2c003a40 msgr2=0x7f9e2c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:19.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.773+0000 7f9e4e800640 1 --2- 172.21.15.31:0/2508830756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e2c003a40 0x7f9e2c003e60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9e38001690 tx=0x7f9e3801c7a0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.773+0000 7f9e47e00640 1 -- 172.21.15.31:0/2508830756 reap_dead start 2024-09-17T05:29:19.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.773+0000 7f9e4e800640 1 -- 172.21.15.31:0/2508830756 shutdown_connections 2024-09-17T05:29:19.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.773+0000 7f9e4e800640 1 -- 172.21.15.31:0/2508830756 >> 172.21.15.31:0/2508830756 conn(0x7f9e480b1c20 msgr2=0x7f9e480b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:19.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.773+0000 7f9e4e800640 1 -- 172.21.15.31:0/2508830756 shutdown_connections 2024-09-17T05:29:19.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.773+0000 7f9e4e800640 1 -- 172.21.15.31:0/2508830756 wait complete. 2024-09-17T05:29:19.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e4e800640 1 Processor -- start 2024-09-17T05:29:19.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e4e800640 1 -- start start 2024-09-17T05:29:19.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e4e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e2c003a40 0x7f9e48154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:19.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e4e800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e48155270 0x7f9e4815f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:19.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e4e800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e48160a90 0x7f9e48160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:19.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e4e800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4816a400 con 0x7f9e2c003a40 2024-09-17T05:29:19.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e4e800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9e480b5270 con 0x7f9e48160a90 2024-09-17T05:29:19.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e4e800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9e4816a580 con 0x7f9e48155270 2024-09-17T05:29:19.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e47400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e2c003a40 0x7f9e48154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:19.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e47400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e2c003a40 0x7f9e48154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39964/0 (socket says 172.21.15.31:39964) 2024-09-17T05:29:19.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e47400640 1 -- 172.21.15.31:0/2596260814 learned_addr learned my addr 172.21.15.31:0/2596260814 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:19.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e47e00640 1 --2- 172.21.15.31:0/2596260814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e48160a90 0x7f9e48160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:19.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e3fe00640 1 --2- 172.21.15.31:0/2596260814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e48155270 0x7f9e4815f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:19.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e47400640 1 -- 172.21.15.31:0/2596260814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e48155270 msgr2=0x7f9e4815f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:19.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e47400640 1 --2- 172.21.15.31:0/2596260814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e48155270 0x7f9e4815f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e47400640 1 -- 172.21.15.31:0/2596260814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e48160a90 msgr2=0x7f9e48160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:19.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e47400640 1 --2- 172.21.15.31:0/2596260814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e48160a90 0x7f9e48160ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:19.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e47400640 1 -- 172.21.15.31:0/2596260814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4815fe80 con 0x7f9e2c003a40 2024-09-17T05:29:19.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e47400640 1 --2- 172.21.15.31:0/2596260814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e2c003a40 0x7f9e48154a10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9e3801c5d0 tx=0x7f9e38003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:19.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e3f400640 1 -- 172.21.15.31:0/2596260814 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e380ae070 con 0x7f9e2c003a40 2024-09-17T05:29:19.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e3f400640 1 -- 172.21.15.31:0/2596260814 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e38006500 con 0x7f9e2c003a40 2024-09-17T05:29:19.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e3f400640 1 -- 172.21.15.31:0/2596260814 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e380012b0 con 0x7f9e2c003a40 2024-09-17T05:29:19.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e4e800640 1 -- 172.21.15.31:0/2596260814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e48160160 con 0x7f9e2c003a40 2024-09-17T05:29:19.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e4e800640 1 -- 172.21.15.31:0/2596260814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e48154f50 con 0x7f9e2c003a40 2024-09-17T05:29:19.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.777+0000 7f9e4e800640 1 -- 172.21.15.31:0/2596260814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e481603a0 con 0x7f9e2c003a40 2024-09-17T05:29:19.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.781+0000 7f9e3f400640 1 -- 172.21.15.31:0/2596260814 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9e380a8650 con 0x7f9e2c003a40 2024-09-17T05:29:19.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.781+0000 7f9e3f400640 1 --2- 172.21.15.31:0/2596260814 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9e24073200 0x7f9e240756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:19.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.781+0000 7f9e3f400640 1 -- 172.21.15.31:0/2596260814 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9e3812e160 con 0x7f9e2c003a40 2024-09-17T05:29:19.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.781+0000 7f9e3fe00640 1 --2- 172.21.15.31:0/2596260814 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9e24073200 0x7f9e240756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:19.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.781+0000 7f9e3fe00640 1 --2- 172.21.15.31:0/2596260814 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9e24073200 0x7f9e240756c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9e481605d0 tx=0x7f9e300091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:19.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.785+0000 7f9e3f400640 1 -- 172.21.15.31:0/2596260814 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9e481603a0 con 0x7f9e2c003a40 2024-09-17T05:29:20.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.997+0000 7f9e4e800640 1 -- 172.21.15.31:0/2596260814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e480b4540 con 0x7f9e2c003a40 2024-09-17T05:29:20.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:19.997+0000 7f9e3f400640 1 -- 172.21.15.31:0/2596260814 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5220 (secure 0 0 0) 0x7f9e380164b0 con 0x7f9e2c003a40 2024-09-17T05:29:20.002 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:20.002 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"btime":"2024-09-17T05:28:48:676550+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4295,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/3491154284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3491154284},{"type":"v1","addr":"172.21.15.155:6836","nonce":3491154284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4301,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3619522478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3619522478},{"type":"v1","addr":"172.21.15.155:6837","nonce":3619522478}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4374,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/851893415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":851893415},{"type":"v1","addr":"172.21.15.31:6834","nonce":851893415}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:28:45.059391+0000","modified":"2024-09-17T05:28:48.082624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4380},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4380":{"gid":4380,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3393035146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3393035146},{"type":"v1","addr":"172.21.15.31:6835","nonce":3393035146}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4380,"qdb_cluster":[4380]},"id":1}]} 2024-09-17T05:29:20.002 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-09-17T05:29:20.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.001+0000 7f9e4e800640 1 -- 172.21.15.31:0/2596260814 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9e24073200 msgr2=0x7f9e240756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:20.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.001+0000 7f9e4e800640 1 --2- 172.21.15.31:0/2596260814 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9e24073200 0x7f9e240756c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9e481605d0 tx=0x7f9e300091e0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.001+0000 7f9e4e800640 1 -- 172.21.15.31:0/2596260814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e2c003a40 msgr2=0x7f9e48154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:20.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.001+0000 7f9e4e800640 1 --2- 172.21.15.31:0/2596260814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e2c003a40 0x7f9e48154a10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9e3801c5d0 tx=0x7f9e38003c80 comp rx=0 tx=0).stop 2024-09-17T05:29:20.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.001+0000 7f9e4e800640 1 -- 172.21.15.31:0/2596260814 shutdown_connections 2024-09-17T05:29:20.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.001+0000 7f9e4e800640 1 --2- 172.21.15.31:0/2596260814 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9e24073200 0x7f9e240756c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.001+0000 7f9e4e800640 1 --2- 172.21.15.31:0/2596260814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e48160a90 0x7f9e48160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.001+0000 7f9e4e800640 1 --2- 172.21.15.31:0/2596260814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e48155270 0x7f9e4815f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.001+0000 7f9e4e800640 1 --2- 172.21.15.31:0/2596260814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e2c003a40 0x7f9e48154a10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.001+0000 7f9e4e800640 1 -- 172.21.15.31:0/2596260814 >> 172.21.15.31:0/2596260814 conn(0x7f9e480b1c20 msgr2=0x7f9e481680a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:20.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.001+0000 7f9e4e800640 1 -- 172.21.15.31:0/2596260814 shutdown_connections 2024-09-17T05:29:20.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.001+0000 7f9e4e800640 1 -- 172.21.15.31:0/2596260814 wait complete. 2024-09-17T05:29:20.025 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:29:20.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4f200640 1 -- 172.21.15.31:0/210698334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb480748c0 msgr2=0x7ffb480cbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:20.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4f200640 1 --2- 172.21.15.31:0/210698334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb480748c0 0x7ffb480cbe30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffb40009bc0 tx=0x7ffb4001cba0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4f200640 1 -- 172.21.15.31:0/210698334 shutdown_connections 2024-09-17T05:29:20.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4f200640 1 --2- 172.21.15.31:0/210698334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb480748c0 0x7ffb480cbe30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4f200640 1 --2- 172.21.15.31:0/210698334 >> v2:172.21.15.155:3300/0 conn(0x7ffb480b10a0 0x7ffb48074380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4f200640 1 -- 172.21.15.31:0/210698334 >> 172.21.15.31:0/210698334 conn(0x7ffb480b1f10 msgr2=0x7ffb480b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:20.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4f200640 1 -- 172.21.15.31:0/210698334 shutdown_connections 2024-09-17T05:29:20.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4f200640 1 -- 172.21.15.31:0/210698334 wait complete. 2024-09-17T05:29:20.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4f200640 1 Processor -- start 2024-09-17T05:29:20.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4f200640 1 -- start start 2024-09-17T05:29:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb480748c0 0x7ffb480b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb480b10a0 0x7ffb480b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb4815bea0 0x7ffb480b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ffb48169020 con 0x7ffb4815bea0 2024-09-17T05:29:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4f200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffb48168ea0 con 0x7ffb480748c0 2024-09-17T05:29:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffb481691a0 con 0x7ffb480b10a0 2024-09-17T05:29:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4d200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb4815bea0 0x7ffb480b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4d200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb4815bea0 0x7ffb480b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39978/0 (socket says 172.21.15.31:39978) 2024-09-17T05:29:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb4d200640 1 -- 172.21.15.31:0/30912591 learned_addr learned my addr 172.21.15.31:0/30912591 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:20.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb3fe00640 1 --2- 172.21.15.31:0/30912591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb480b10a0 0x7ffb480b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:20.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.169+0000 7ffb47e00640 1 --2- 172.21.15.31:0/30912591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb480748c0 0x7ffb480b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:20.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.173+0000 7ffb4d200640 1 -- 172.21.15.31:0/30912591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb480b10a0 msgr2=0x7ffb480b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:20.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.173+0000 7ffb4d200640 1 --2- 172.21.15.31:0/30912591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb480b10a0 0x7ffb480b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.173+0000 7ffb4d200640 1 -- 172.21.15.31:0/30912591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb480748c0 msgr2=0x7ffb480b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:20.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.173+0000 7ffb4d200640 1 --2- 172.21.15.31:0/30912591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb480748c0 0x7ffb480b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.173+0000 7ffb4d200640 1 -- 172.21.15.31:0/30912591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb480b2e40 con 0x7ffb4815bea0 2024-09-17T05:29:20.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.173+0000 7ffb4d200640 1 --2- 172.21.15.31:0/30912591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb4815bea0 0x7ffb480b45f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffb4001a7d0 tx=0x7ffb40003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:20.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.173+0000 7ffb44c00640 1 -- 172.21.15.31:0/30912591 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb400b2070 con 0x7ffb4815bea0 2024-09-17T05:29:20.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.173+0000 7ffb44c00640 1 -- 172.21.15.31:0/30912591 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb400bc070 con 0x7ffb4815bea0 2024-09-17T05:29:20.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.173+0000 7ffb4f200640 1 -- 172.21.15.31:0/30912591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb480ce9b0 con 0x7ffb4815bea0 2024-09-17T05:29:20.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.173+0000 7ffb44c00640 1 -- 172.21.15.31:0/30912591 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40004040 con 0x7ffb4815bea0 2024-09-17T05:29:20.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.173+0000 7ffb4f200640 1 -- 172.21.15.31:0/30912591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb480cef30 con 0x7ffb4815bea0 2024-09-17T05:29:20.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.173+0000 7ffb4f200640 1 -- 172.21.15.31:0/30912591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb480cbe30 con 0x7ffb4815bea0 2024-09-17T05:29:20.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.173+0000 7ffb44c00640 1 -- 172.21.15.31:0/30912591 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ffb400041e0 con 0x7ffb4815bea0 2024-09-17T05:29:20.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.177+0000 7ffb44c00640 1 --2- 172.21.15.31:0/30912591 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffb24073200 0x7ffb240756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:20.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.177+0000 7ffb44c00640 1 -- 172.21.15.31:0/30912591 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ffb4012e950 con 0x7ffb4815bea0 2024-09-17T05:29:20.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.177+0000 7ffb47e00640 1 --2- 172.21.15.31:0/30912591 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffb24073200 0x7ffb240756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:20.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.177+0000 7ffb47e00640 1 --2- 172.21.15.31:0/30912591 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffb24073200 0x7ffb240756c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb38001870 tx=0x7ffb38001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:20.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.181+0000 7ffb44c00640 1 -- 172.21.15.31:0/30912591 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ffb40016790 con 0x7ffb4815bea0 2024-09-17T05:29:20.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.353+0000 7ffb4f200640 1 -- 172.21.15.31:0/30912591 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb480b62a0 con 0x7ffb4815bea0 2024-09-17T05:29:20.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.353+0000 7ffb44c00640 1 -- 172.21.15.31:0/30912591 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16689 (secure 0 0 0) 0x7ffb400f9310 con 0x7ffb4815bea0 2024-09-17T05:29:20.359 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:20.359 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":21,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:28:46.650201+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:28:42.906739+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:28:44.023489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:29:20.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.357+0000 7ffb4f200640 1 -- 172.21.15.31:0/30912591 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffb24073200 msgr2=0x7ffb240756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:20.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.357+0000 7ffb4f200640 1 --2- 172.21.15.31:0/30912591 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffb24073200 0x7ffb240756c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb38001870 tx=0x7ffb38001380 comp rx=0 tx=0).stop 2024-09-17T05:29:20.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.357+0000 7ffb4f200640 1 -- 172.21.15.31:0/30912591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb4815bea0 msgr2=0x7ffb480b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:20.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.357+0000 7ffb4f200640 1 --2- 172.21.15.31:0/30912591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb4815bea0 0x7ffb480b45f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffb4001a7d0 tx=0x7ffb40003f70 comp rx=0 tx=0).stop 2024-09-17T05:29:20.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.357+0000 7ffb4f200640 1 -- 172.21.15.31:0/30912591 shutdown_connections 2024-09-17T05:29:20.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.357+0000 7ffb4f200640 1 --2- 172.21.15.31:0/30912591 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffb24073200 0x7ffb240756c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.357+0000 7ffb4f200640 1 --2- 172.21.15.31:0/30912591 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb4815bea0 0x7ffb480b45f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.357+0000 7ffb4f200640 1 --2- 172.21.15.31:0/30912591 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb480b10a0 0x7ffb480b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.357+0000 7ffb4f200640 1 --2- 172.21.15.31:0/30912591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb480748c0 0x7ffb480b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.357+0000 7ffb4f200640 1 -- 172.21.15.31:0/30912591 >> 172.21.15.31:0/30912591 conn(0x7ffb480b1f10 msgr2=0x7ffb48159d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:20.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.357+0000 7ffb4f200640 1 -- 172.21.15.31:0/30912591 shutdown_connections 2024-09-17T05:29:20.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.357+0000 7ffb4f200640 1 -- 172.21.15.31:0/30912591 wait complete. 2024-09-17T05:29:20.380 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:29:20.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.521+0000 7f9af5c00640 1 -- 172.21.15.31:0/1984803521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9af006cc20 msgr2=0x7f9af00737c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:20.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.521+0000 7f9af5c00640 1 --2- 172.21.15.31:0/1984803521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9af006cc20 0x7f9af00737c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0009c80 tx=0x7f9ae001cd70 comp rx=0 tx=0).stop 2024-09-17T05:29:20.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.521+0000 7f9af5c00640 1 -- 172.21.15.31:0/1984803521 shutdown_connections 2024-09-17T05:29:20.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.521+0000 7f9af5c00640 1 --2- 172.21.15.31:0/1984803521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9af015c1c0 0x7f9af006d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.521+0000 7f9af5c00640 1 --2- 172.21.15.31:0/1984803521 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9af006cc20 0x7f9af00737c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.521+0000 7f9af5c00640 1 -- 172.21.15.31:0/1984803521 >> 172.21.15.31:0/1984803521 conn(0x7f9af00d0c90 msgr2=0x7f9af00d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:20.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.521+0000 7f9af5c00640 1 -- 172.21.15.31:0/1984803521 shutdown_connections 2024-09-17T05:29:20.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.521+0000 7f9af5c00640 1 -- 172.21.15.31:0/1984803521 wait complete. 2024-09-17T05:29:20.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9af5c00640 1 Processor -- start 2024-09-17T05:29:20.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9af5c00640 1 -- start start 2024-09-17T05:29:20.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9af5c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9af006cc20 0x7f9af01557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:20.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9af5c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9af015c1c0 0x7f9af00d0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:20.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9af5c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9af015f7b0 0x7f9af00c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:20.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9af5c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9af01694e0 con 0x7f9af015f7b0 2024-09-17T05:29:20.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9af5c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9af0169360 con 0x7f9af006cc20 2024-09-17T05:29:20.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9af5c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9af0169660 con 0x7f9af015c1c0 2024-09-17T05:29:20.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9aef400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9af015f7b0 0x7f9af00c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:20.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9aef400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9af015f7b0 0x7f9af00c4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40006/0 (socket says 172.21.15.31:40006) 2024-09-17T05:29:20.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9aef400640 1 -- 172.21.15.31:0/3645585082 learned_addr learned my addr 172.21.15.31:0/3645585082 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:20.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9ae6000640 1 --2- 172.21.15.31:0/3645585082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9af015c1c0 0x7f9af00d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:20.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9aeea00640 1 --2- 172.21.15.31:0/3645585082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9af006cc20 0x7f9af01557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:20.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9aef400640 1 -- 172.21.15.31:0/3645585082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9af015c1c0 msgr2=0x7f9af00d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:20.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9aef400640 1 --2- 172.21.15.31:0/3645585082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9af015c1c0 0x7f9af00d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9aef400640 1 -- 172.21.15.31:0/3645585082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9af006cc20 msgr2=0x7f9af01557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:20.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9aef400640 1 --2- 172.21.15.31:0/3645585082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9af006cc20 0x7f9af01557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9aef400640 1 -- 172.21.15.31:0/3645585082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af00c4530 con 0x7f9af015f7b0 2024-09-17T05:29:20.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9ae6000640 1 --2- 172.21.15.31:0/3645585082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9af015c1c0 0x7f9af00d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:20.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9aef400640 1 --2- 172.21.15.31:0/3645585082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9af015f7b0 0x7f9af00c4a70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9ae800c390 tx=0x7f9ae800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:20.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9ae7400640 1 -- 172.21.15.31:0/3645585082 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8017070 con 0x7f9af015f7b0 2024-09-17T05:29:20.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9ae7400640 1 -- 172.21.15.31:0/3645585082 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ae80053c0 con 0x7f9af015f7b0 2024-09-17T05:29:20.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9ae7400640 1 -- 172.21.15.31:0/3645585082 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8003860 con 0x7f9af015f7b0 2024-09-17T05:29:20.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9af5c00640 1 -- 172.21.15.31:0/3645585082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af00c6b00 con 0x7f9af015f7b0 2024-09-17T05:29:20.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.525+0000 7f9af5c00640 1 -- 172.21.15.31:0/3645585082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af00d06c0 con 0x7f9af015f7b0 2024-09-17T05:29:20.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.529+0000 7f9af5c00640 1 -- 172.21.15.31:0/3645585082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af00737c0 con 0x7f9af015f7b0 2024-09-17T05:29:20.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.529+0000 7f9ae7400640 1 -- 172.21.15.31:0/3645585082 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9ae801a070 con 0x7f9af015f7b0 2024-09-17T05:29:20.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.529+0000 7f9ae7400640 1 --2- 172.21.15.31:0/3645585082 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9acc073200 0x7f9acc0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:20.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.529+0000 7f9ae7400640 1 -- 172.21.15.31:0/3645585082 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9ae80934d0 con 0x7f9af015f7b0 2024-09-17T05:29:20.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.529+0000 7f9aeea00640 1 --2- 172.21.15.31:0/3645585082 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9acc073200 0x7f9acc0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:20.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.533+0000 7f9aeea00640 1 --2- 172.21.15.31:0/3645585082 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9acc073200 0x7f9acc0756c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00af000 tx=0x7f9ae001b5b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:20.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.533+0000 7f9ae7400640 1 -- 172.21.15.31:0/3645585082 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9ae805df20 con 0x7f9af015f7b0 2024-09-17T05:29:20.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.745+0000 7f9af5c00640 1 -- 172.21.15.31:0/3645585082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9af00b6c10 con 0x7f9af015f7b0 2024-09-17T05:29:20.749 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-09-17T05:29:20.745+0000 7f21d0200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:29:20.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.745+0000 7f9ae7400640 1 -- 172.21.15.31:0/3645585082 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f9ae8062950 con 0x7f9af015f7b0 2024-09-17T05:29:20.751 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:29:20.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.749+0000 7f9af5c00640 1 -- 172.21.15.31:0/3645585082 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9acc073200 msgr2=0x7f9acc0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:20.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.749+0000 7f9af5c00640 1 --2- 172.21.15.31:0/3645585082 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9acc073200 0x7f9acc0756c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00af000 tx=0x7f9ae001b5b0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.749+0000 7f9af5c00640 1 -- 172.21.15.31:0/3645585082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9af015f7b0 msgr2=0x7f9af00c4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:20.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.749+0000 7f9af5c00640 1 --2- 172.21.15.31:0/3645585082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9af015f7b0 0x7f9af00c4a70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9ae800c390 tx=0x7f9ae800c850 comp rx=0 tx=0).stop 2024-09-17T05:29:20.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.749+0000 7f9af5c00640 1 -- 172.21.15.31:0/3645585082 shutdown_connections 2024-09-17T05:29:20.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.749+0000 7f9af5c00640 1 --2- 172.21.15.31:0/3645585082 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9acc073200 0x7f9acc0756c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.749+0000 7f9af5c00640 1 --2- 172.21.15.31:0/3645585082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9af015f7b0 0x7f9af00c4a70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.749+0000 7f9af5c00640 1 --2- 172.21.15.31:0/3645585082 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9af015c1c0 0x7f9af00d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.749+0000 7f9af5c00640 1 --2- 172.21.15.31:0/3645585082 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9af006cc20 0x7f9af01557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.749+0000 7f9af5c00640 1 -- 172.21.15.31:0/3645585082 >> 172.21.15.31:0/3645585082 conn(0x7f9af00d0c90 msgr2=0x7f9af00c7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:20.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.749+0000 7f9af5c00640 1 -- 172.21.15.31:0/3645585082 shutdown_connections 2024-09-17T05:29:20.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.749+0000 7f9af5c00640 1 -- 172.21.15.31:0/3645585082 wait complete. 2024-09-17T05:29:20.766 INFO:tasks.ceph.mds.c.smithi031.stderr: -7041> 2024-09-17T05:28:50.526+0000 7fbd17000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:29:20.775 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:29:20.819 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-17T05:29:20.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.925+0000 7f9fb0c00640 1 -- 172.21.15.31:0/3821984074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f90004810 msgr2=0x7f9f90004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:20.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.925+0000 7f9fb0c00640 1 --2- 172.21.15.31:0/3821984074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f90004810 0x7f9f90004c90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9f94006f80 tx=0x7f9f9401cee0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.925+0000 7f9faa800640 1 -- 172.21.15.31:0/3821984074 reap_dead start 2024-09-17T05:29:20.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.925+0000 7f9fb0c00640 1 -- 172.21.15.31:0/3821984074 shutdown_connections 2024-09-17T05:29:20.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.925+0000 7f9fb0c00640 1 -- 172.21.15.31:0/3821984074 >> 172.21.15.31:0/3821984074 conn(0x7f9fac0d0da0 msgr2=0x7f9fac0d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:20.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.925+0000 7f9fb0c00640 1 -- 172.21.15.31:0/3821984074 shutdown_connections 2024-09-17T05:29:20.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.925+0000 7f9fb0c00640 1 -- 172.21.15.31:0/3821984074 wait complete. 2024-09-17T05:29:20.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9fb0c00640 1 Processor -- start 2024-09-17T05:29:20.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9fb0c00640 1 -- start start 2024-09-17T05:29:20.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9fb0c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f90004810 0x7f9fac0b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:20.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9fb0c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fac157d80 0x7f9fac157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:20.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9fb0c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fac1582d0 0x7f9fac15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:20.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9fb0c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9fac167080 con 0x7f9fac1582d0 2024-09-17T05:29:20.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9fb0c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9fac166f00 con 0x7f9f90004810 2024-09-17T05:29:20.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9fb0c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9fac167200 con 0x7f9fac157d80 2024-09-17T05:29:20.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9faa800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fac1582d0 0x7f9fac15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:20.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9faa800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fac1582d0 0x7f9fac15cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40044/0 (socket says 172.21.15.31:40044) 2024-09-17T05:29:20.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9faa800640 1 -- 172.21.15.31:0/1270863323 learned_addr learned my addr 172.21.15.31:0/1270863323 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:20.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9fa1400640 1 --2- 172.21.15.31:0/1270863323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fac157d80 0x7f9fac157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:20.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9fa9e00640 1 --2- 172.21.15.31:0/1270863323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f90004810 0x7f9fac0b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:20.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9faa800640 1 -- 172.21.15.31:0/1270863323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fac157d80 msgr2=0x7f9fac157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:20.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9faa800640 1 --2- 172.21.15.31:0/1270863323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fac157d80 0x7f9fac157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9faa800640 1 -- 172.21.15.31:0/1270863323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f90004810 msgr2=0x7f9fac0b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:20.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9faa800640 1 --2- 172.21.15.31:0/1270863323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f90004810 0x7f9fac0b4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:20.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9faa800640 1 -- 172.21.15.31:0/1270863323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fac15ade0 con 0x7f9fac1582d0 2024-09-17T05:29:20.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9faa800640 1 --2- 172.21.15.31:0/1270863323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fac1582d0 0x7f9fac15cf60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0d1e20 tx=0x7f9fa4010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:20.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9fa2a00640 1 -- 172.21.15.31:0/1270863323 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4003980 con 0x7f9fac1582d0 2024-09-17T05:29:20.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9fa2a00640 1 -- 172.21.15.31:0/1270863323 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9fa4015070 con 0x7f9fac1582d0 2024-09-17T05:29:20.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9fb0c00640 1 -- 172.21.15.31:0/1270863323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fac15b0c0 con 0x7f9fac1582d0 2024-09-17T05:29:20.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9fa2a00640 1 -- 172.21.15.31:0/1270863323 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4004030 con 0x7f9fac1582d0 2024-09-17T05:29:20.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.929+0000 7f9fb0c00640 1 -- 172.21.15.31:0/1270863323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fac15b680 con 0x7f9fac1582d0 2024-09-17T05:29:20.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.933+0000 7f9fb0c00640 1 -- 172.21.15.31:0/1270863323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fac0cb5b0 con 0x7f9fac1582d0 2024-09-17T05:29:20.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.933+0000 7f9fa2a00640 1 -- 172.21.15.31:0/1270863323 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9fa40041d0 con 0x7f9fac1582d0 2024-09-17T05:29:20.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.933+0000 7f9fa2a00640 1 --2- 172.21.15.31:0/1270863323 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9f88073200 0x7f9f880756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:20.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.933+0000 7f9fa2a00640 1 -- 172.21.15.31:0/1270863323 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f9fa4095090 con 0x7f9fac1582d0 2024-09-17T05:29:20.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.933+0000 7f9fa9e00640 1 --2- 172.21.15.31:0/1270863323 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9f88073200 0x7f9f880756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:20.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.937+0000 7f9fa9e00640 1 --2- 172.21.15.31:0/1270863323 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9f88073200 0x7f9f880756c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c000c10 tx=0x7f9f9c006b20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:20.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:20.937+0000 7f9fa2a00640 1 -- 172.21.15.31:0/1270863323 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9fa4060150 con 0x7f9fac1582d0 2024-09-17T05:29:21.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:21.153+0000 7f9fb0c00640 1 -- 172.21.15.31:0/1270863323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9fac0b6d20 con 0x7f9fac1582d0 2024-09-17T05:29:21.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:21.813+0000 7f9fa2a00640 1 -- 172.21.15.31:0/1270863323 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f9fa405fa50 con 0x7f9fac1582d0 2024-09-17T05:29:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:21.817+0000 7f9fb0c00640 1 -- 172.21.15.31:0/1270863323 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9f88073200 msgr2=0x7f9f880756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:21.817+0000 7f9fb0c00640 1 --2- 172.21.15.31:0/1270863323 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9f88073200 0x7f9f880756c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c000c10 tx=0x7f9f9c006b20 comp rx=0 tx=0).stop 2024-09-17T05:29:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:21.817+0000 7f9fb0c00640 1 -- 172.21.15.31:0/1270863323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fac1582d0 msgr2=0x7f9fac15cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:21.817+0000 7f9fb0c00640 1 --2- 172.21.15.31:0/1270863323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fac1582d0 0x7f9fac15cf60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9fac0d1e20 tx=0x7f9fa4010f40 comp rx=0 tx=0).stop 2024-09-17T05:29:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:21.817+0000 7f9fb0c00640 1 -- 172.21.15.31:0/1270863323 shutdown_connections 2024-09-17T05:29:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:21.817+0000 7f9fb0c00640 1 --2- 172.21.15.31:0/1270863323 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9f88073200 0x7f9f880756c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:21.817+0000 7f9fb0c00640 1 --2- 172.21.15.31:0/1270863323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fac1582d0 0x7f9fac15cf60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:21.817+0000 7f9fb0c00640 1 --2- 172.21.15.31:0/1270863323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9fac157d80 0x7f9fac157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:21.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:21.817+0000 7f9fb0c00640 1 --2- 172.21.15.31:0/1270863323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f90004810 0x7f9fac0b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:21.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:21.817+0000 7f9fb0c00640 1 -- 172.21.15.31:0/1270863323 >> 172.21.15.31:0/1270863323 conn(0x7f9fac0d0da0 msgr2=0x7f9fac0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:21.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:21.817+0000 7f9fb0c00640 1 -- 172.21.15.31:0/1270863323 shutdown_connections 2024-09-17T05:29:21.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:21.817+0000 7f9fb0c00640 1 -- 172.21.15.31:0/1270863323 wait complete. 2024-09-17T05:29:21.845 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:29:22.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.041+0000 7f9615800640 1 -- 172.21.15.31:0/3350482669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961015f700 msgr2=0x7f96100d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:22.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.041+0000 7f9615800640 1 --2- 172.21.15.31:0/3350482669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961015f700 0x7f96100d0720 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9608009c80 tx=0x7f960801cd70 comp rx=0 tx=0).stop 2024-09-17T05:29:22.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.041+0000 7f9615800640 1 -- 172.21.15.31:0/3350482669 shutdown_connections 2024-09-17T05:29:22.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.041+0000 7f9615800640 1 --2- 172.21.15.31:0/3350482669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f961015f700 0x7f96100d0720 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:22.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.041+0000 7f9615800640 1 --2- 172.21.15.31:0/3350482669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96100cff00 0x7f96100d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:22.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.041+0000 7f9615800640 1 -- 172.21.15.31:0/3350482669 >> 172.21.15.31:0/3350482669 conn(0x7f96100d1da0 msgr2=0x7f96100d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:22.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.041+0000 7f9615800640 1 -- 172.21.15.31:0/3350482669 shutdown_connections 2024-09-17T05:29:22.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.041+0000 7f9615800640 1 -- 172.21.15.31:0/3350482669 wait complete. 2024-09-17T05:29:22.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.041+0000 7f9615800640 1 Processor -- start 2024-09-17T05:29:22.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.041+0000 7f9615800640 1 -- start start 2024-09-17T05:29:22.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f9615800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96100cff00 0x7f9610149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:22.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f9615800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96100d02e0 0x7f961006e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:22.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f9615800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f961015f700 0x7f961006eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:22.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f9615800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f96100b0c50 con 0x7f96100cff00 2024-09-17T05:29:22.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f9615800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f96100b0ad0 con 0x7f96100d02e0 2024-09-17T05:29:22.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f9615800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9610168bf0 con 0x7f961015f700 2024-09-17T05:29:22.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f960fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96100cff00 0x7f9610149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:22.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f960fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96100cff00 0x7f9610149210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40054/0 (socket says 172.21.15.31:40054) 2024-09-17T05:29:22.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f960fe00640 1 -- 172.21.15.31:0/2233695155 learned_addr learned my addr 172.21.15.31:0/2233695155 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:22.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f9614e00640 1 --2- 172.21.15.31:0/2233695155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f961015f700 0x7f961006eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:22.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f960f400640 1 --2- 172.21.15.31:0/2233695155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96100d02e0 0x7f961006e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:22.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f960fe00640 1 -- 172.21.15.31:0/2233695155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f961015f700 msgr2=0x7f961006eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:22.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f960fe00640 1 --2- 172.21.15.31:0/2233695155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f961015f700 0x7f961006eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:22.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f960fe00640 1 -- 172.21.15.31:0/2233695155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96100d02e0 msgr2=0x7f961006e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:22.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f960fe00640 1 --2- 172.21.15.31:0/2233695155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96100d02e0 0x7f961006e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:22.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f960fe00640 1 -- 172.21.15.31:0/2233695155 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96100c7ed0 con 0x7f96100cff00 2024-09-17T05:29:22.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f960fe00640 1 --2- 172.21.15.31:0/2233695155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96100cff00 0x7f9610149210 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f960000d9b0 tx=0x7f960000de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:22.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f9607e00640 1 -- 172.21.15.31:0/2233695155 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9600017070 con 0x7f96100cff00 2024-09-17T05:29:22.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f9607e00640 1 -- 172.21.15.31:0/2233695155 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9600009cc0 con 0x7f96100cff00 2024-09-17T05:29:22.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f9607e00640 1 -- 172.21.15.31:0/2233695155 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9600005280 con 0x7f96100cff00 2024-09-17T05:29:22.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f9615800640 1 -- 172.21.15.31:0/2233695155 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96100c81b0 con 0x7f96100cff00 2024-09-17T05:29:22.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f9615800640 1 -- 172.21.15.31:0/2233695155 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96100c8770 con 0x7f96100cff00 2024-09-17T05:29:22.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.045+0000 7f9615800640 1 -- 172.21.15.31:0/2233695155 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96100d28c0 con 0x7f96100cff00 2024-09-17T05:29:22.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.049+0000 7f9607e00640 1 -- 172.21.15.31:0/2233695155 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9600005420 con 0x7f96100cff00 2024-09-17T05:29:22.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.049+0000 7f9607e00640 1 --2- 172.21.15.31:0/2233695155 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f95f0073200 0x7f95f00756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:22.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.049+0000 7f9607e00640 1 -- 172.21.15.31:0/2233695155 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f9600094410 con 0x7f96100cff00 2024-09-17T05:29:22.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.049+0000 7f960f400640 1 --2- 172.21.15.31:0/2233695155 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f95f0073200 0x7f95f00756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:22.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.049+0000 7f960f400640 1 --2- 172.21.15.31:0/2233695155 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f95f0073200 0x7f95f00756c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9610152760 tx=0x7f95fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:22.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.053+0000 7f9607e00640 1 -- 172.21.15.31:0/2233695155 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f960005ece0 con 0x7f96100cff00 2024-09-17T05:29:22.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.229+0000 7f9615800640 1 -- 172.21.15.31:0/2233695155 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f961015e720 con 0x7f96100cff00 2024-09-17T05:29:22.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.817+0000 7f9607e00640 1 -- 172.21.15.31:0/2233695155 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7f9600063710 con 0x7f96100cff00 2024-09-17T05:29:22.820 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:29:22.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.817+0000 7f9615800640 1 -- 172.21.15.31:0/2233695155 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f95f0073200 msgr2=0x7f95f00756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:22.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.817+0000 7f9615800640 1 --2- 172.21.15.31:0/2233695155 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f95f0073200 0x7f95f00756c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9610152760 tx=0x7f95fc009040 comp rx=0 tx=0).stop 2024-09-17T05:29:22.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.821+0000 7f9615800640 1 -- 172.21.15.31:0/2233695155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96100cff00 msgr2=0x7f9610149210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:22.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.821+0000 7f9615800640 1 --2- 172.21.15.31:0/2233695155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96100cff00 0x7f9610149210 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f960000d9b0 tx=0x7f960000de70 comp rx=0 tx=0).stop 2024-09-17T05:29:22.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.821+0000 7f9615800640 1 -- 172.21.15.31:0/2233695155 shutdown_connections 2024-09-17T05:29:22.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.821+0000 7f9615800640 1 --2- 172.21.15.31:0/2233695155 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f95f0073200 0x7f95f00756c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:22.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.821+0000 7f9615800640 1 --2- 172.21.15.31:0/2233695155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f961015f700 0x7f961006eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:22.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.821+0000 7f9615800640 1 --2- 172.21.15.31:0/2233695155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96100d02e0 0x7f961006e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:22.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.821+0000 7f9615800640 1 --2- 172.21.15.31:0/2233695155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96100cff00 0x7f9610149210 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:22.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.821+0000 7f9615800640 1 -- 172.21.15.31:0/2233695155 >> 172.21.15.31:0/2233695155 conn(0x7f96100d1da0 msgr2=0x7f961015d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:22.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.821+0000 7f9615800640 1 -- 172.21.15.31:0/2233695155 shutdown_connections 2024-09-17T05:29:22.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:22.821+0000 7f9615800640 1 -- 172.21.15.31:0/2233695155 wait complete. 2024-09-17T05:29:22.850 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:29:23.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efebec00640 1 -- 172.21.15.31:0/3692125534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe9c0051d0 msgr2=0x7efe9c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:23.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efebec00640 1 --2- 172.21.15.31:0/3692125534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe9c0051d0 0x7efe9c00b9d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efeb0009ee0 tx=0x7efeb001d630 comp rx=0 tx=0).stop 2024-09-17T05:29:23.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efebec00640 1 -- 172.21.15.31:0/3692125534 shutdown_connections 2024-09-17T05:29:23.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efebec00640 1 --2- 172.21.15.31:0/3692125534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe9c0051d0 0x7efe9c00b9d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:23.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efebec00640 1 -- 172.21.15.31:0/3692125534 >> 172.21.15.31:0/3692125534 conn(0x7efeb80d1da0 msgr2=0x7efeb80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:23.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efebec00640 1 -- 172.21.15.31:0/3692125534 shutdown_connections 2024-09-17T05:29:23.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efebec00640 1 -- 172.21.15.31:0/3692125534 wait complete. 2024-09-17T05:29:23.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efebec00640 1 Processor -- start 2024-09-17T05:29:23.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efebec00640 1 -- start start 2024-09-17T05:29:23.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efebec00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe9c0051d0 0x7efeb80cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:23.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efebec00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efeb8151240 0x7efeb80c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:23.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efebec00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efeb80b2760 0x7efeb80b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:23.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efebec00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efeb80cea90 con 0x7efe9c0051d0 2024-09-17T05:29:23.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efebec00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efeb80ce910 con 0x7efeb80b2760 2024-09-17T05:29:23.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efebec00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efeb80cec10 con 0x7efeb8151240 2024-09-17T05:29:23.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efeb7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe9c0051d0 0x7efeb80cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:23.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efeb7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe9c0051d0 0x7efeb80cad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40086/0 (socket says 172.21.15.31:40086) 2024-09-17T05:29:23.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efeb7e00640 1 -- 172.21.15.31:0/839495520 learned_addr learned my addr 172.21.15.31:0/839495520 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:23.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efebcc00640 1 --2- 172.21.15.31:0/839495520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efeb80b2760 0x7efeb80b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:23.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efeafe00640 1 --2- 172.21.15.31:0/839495520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efeb8151240 0x7efeb80c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:23.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efeb7e00640 1 -- 172.21.15.31:0/839495520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efeb8151240 msgr2=0x7efeb80c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:23.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efeb7e00640 1 --2- 172.21.15.31:0/839495520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efeb8151240 0x7efeb80c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:23.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efeb7e00640 1 -- 172.21.15.31:0/839495520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efeb80b2760 msgr2=0x7efeb80b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:23.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efeb7e00640 1 --2- 172.21.15.31:0/839495520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efeb80b2760 0x7efeb80b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:23.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efeb7e00640 1 -- 172.21.15.31:0/839495520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb80cb5b0 con 0x7efe9c0051d0 2024-09-17T05:29:23.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.005+0000 7efeafe00640 1 --2- 172.21.15.31:0/839495520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efeb8151240 0x7efeb80c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:29:23.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.009+0000 7efeb7e00640 1 --2- 172.21.15.31:0/839495520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe9c0051d0 0x7efeb80cad80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efea8003eb0 tx=0x7efea8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:23.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.009+0000 7efeb4c00640 1 -- 172.21.15.31:0/839495520 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8015070 con 0x7efe9c0051d0 2024-09-17T05:29:23.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.009+0000 7efeb4c00640 1 -- 172.21.15.31:0/839495520 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efea8011840 con 0x7efe9c0051d0 2024-09-17T05:29:23.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.009+0000 7efeb4c00640 1 -- 172.21.15.31:0/839495520 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8011c70 con 0x7efe9c0051d0 2024-09-17T05:29:23.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.009+0000 7efebec00640 1 -- 172.21.15.31:0/839495520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb80cb890 con 0x7efe9c0051d0 2024-09-17T05:29:23.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.009+0000 7efebec00640 1 -- 172.21.15.31:0/839495520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb80cb2c0 con 0x7efe9c0051d0 2024-09-17T05:29:23.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.009+0000 7efebec00640 1 -- 172.21.15.31:0/839495520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb80b3120 con 0x7efe9c0051d0 2024-09-17T05:29:23.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.009+0000 7efeb4c00640 1 -- 172.21.15.31:0/839495520 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7efea8018070 con 0x7efe9c0051d0 2024-09-17T05:29:23.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.009+0000 7efeb4c00640 1 --2- 172.21.15.31:0/839495520 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe94073230 0x7efe940756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:23.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.009+0000 7efeb4c00640 1 -- 172.21.15.31:0/839495520 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5357+0+0 (secure 0 0 0) 0x7efea8094c80 con 0x7efe9c0051d0 2024-09-17T05:29:23.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.009+0000 7efeafe00640 1 --2- 172.21.15.31:0/839495520 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe94073230 0x7efe940756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:23.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.013+0000 7efeafe00640 1 --2- 172.21.15.31:0/839495520 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe94073230 0x7efe940756f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efeb81573a0 tx=0x7efea00067b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:23.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.013+0000 7efeb4c00640 1 -- 172.21.15.31:0/839495520 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7efea805fdf0 con 0x7efe9c0051d0 2024-09-17T05:29:23.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.193+0000 7efebec00640 1 -- 172.21.15.31:0/839495520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7efeb80c61c0 con 0x7efe9c0051d0 2024-09-17T05:29:23.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.829+0000 7efeb4c00640 1 -- 172.21.15.31:0/839495520 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7efea805f6f0 con 0x7efe9c0051d0 2024-09-17T05:29:23.834 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-09-17T05:29:23.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.837+0000 7efebec00640 1 -- 172.21.15.31:0/839495520 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe94073230 msgr2=0x7efe940756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:23.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.837+0000 7efebec00640 1 --2- 172.21.15.31:0/839495520 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe94073230 0x7efe940756f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efeb81573a0 tx=0x7efea00067b0 comp rx=0 tx=0).stop 2024-09-17T05:29:23.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.837+0000 7efebec00640 1 -- 172.21.15.31:0/839495520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe9c0051d0 msgr2=0x7efeb80cad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:23.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.837+0000 7efebec00640 1 --2- 172.21.15.31:0/839495520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe9c0051d0 0x7efeb80cad80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efea8003eb0 tx=0x7efea8001640 comp rx=0 tx=0).stop 2024-09-17T05:29:23.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.841+0000 7efebec00640 1 -- 172.21.15.31:0/839495520 shutdown_connections 2024-09-17T05:29:23.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.841+0000 7efebec00640 1 --2- 172.21.15.31:0/839495520 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe94073230 0x7efe940756f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:23.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.841+0000 7efebec00640 1 --2- 172.21.15.31:0/839495520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efeb80b2760 0x7efeb80b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:23.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.841+0000 7efebec00640 1 --2- 172.21.15.31:0/839495520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efeb8151240 0x7efeb80c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:23.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.841+0000 7efebec00640 1 --2- 172.21.15.31:0/839495520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe9c0051d0 0x7efeb80cad80 secure :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efea8003eb0 tx=0x7efea8001640 comp rx=0 tx=0).stop 2024-09-17T05:29:23.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.841+0000 7efebec00640 1 -- 172.21.15.31:0/839495520 >> 172.21.15.31:0/839495520 conn(0x7efeb80d1da0 msgr2=0x7efeb8071760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:23.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.841+0000 7efebec00640 1 -- 172.21.15.31:0/839495520 shutdown_connections 2024-09-17T05:29:23.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:23.841+0000 7efebec00640 1 -- 172.21.15.31:0/839495520 wait complete. 2024-09-17T05:29:23.873 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:29:23.873 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:29:23.873 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:29:23.874 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:29:23.874 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:29:23.874 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:29:23.874 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:29:23.874 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:29:23.874 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:29:23.874 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:29:23.875 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:29:23.875 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:29:23.875 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:29:23.875 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:29:23.875 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:29:23.875 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:29:23.888 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:29:23.889 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:29:23.890 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:29:23.891 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:29:23.891 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:29:23.892 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:29:23.893 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:29:23.893 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:29:23.933 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:29:23.934 DEBUG:teuthology.parallel:result is None 2024-09-17T05:29:23.935 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:29:23.935 DEBUG:teuthology.parallel:result is None 2024-09-17T05:29:23.935 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:29:23.936 DEBUG:teuthology.parallel:result is None 2024-09-17T05:29:23.936 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:29:23.936 DEBUG:teuthology.parallel:result is None 2024-09-17T05:29:23.937 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:29:24.023 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-17T05:29:24.024 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-17T05:29:24.025 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-17T05:29:24.025 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-17T05:29:24.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.089+0000 7f79bb400640 1 -- 172.21.15.31:0/268683845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b40b3130 msgr2=0x7f79b40cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:24.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.089+0000 7f79bb400640 1 --2- 172.21.15.31:0/268683845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b40b3130 0x7f79b40cc550 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009bc0 tx=0x7f79ac01cba0 comp rx=0 tx=0).stop 2024-09-17T05:29:24.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.089+0000 7f79bb400640 1 -- 172.21.15.31:0/268683845 shutdown_connections 2024-09-17T05:29:24.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.089+0000 7f79bb400640 1 --2- 172.21.15.31:0/268683845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b40b3130 0x7f79b40cc550 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:24.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.089+0000 7f79bb400640 1 --2- 172.21.15.31:0/268683845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79b40b4bd0 0x7f79b40b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:24.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.089+0000 7f79bb400640 1 -- 172.21.15.31:0/268683845 >> 172.21.15.31:0/268683845 conn(0x7f79b40b18f0 msgr2=0x7f79b40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:24.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.089+0000 7f79bb400640 1 -- 172.21.15.31:0/268683845 shutdown_connections 2024-09-17T05:29:24.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.089+0000 7f79bb400640 1 -- 172.21.15.31:0/268683845 wait complete. 2024-09-17T05:29:24.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.089+0000 7f79bb400640 1 Processor -- start 2024-09-17T05:29:24.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.089+0000 7f79bb400640 1 -- start start 2024-09-17T05:29:24.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79bb400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79b40b3130 0x7f79b41f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:24.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79bb400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b40b4bd0 0x7f79b409c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:24.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79bb400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79b415b580 0x7f79b40b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:24.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79bb400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f79b4167b70 con 0x7f79b415b580 2024-09-17T05:29:24.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79bb400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f79b40cd570 con 0x7f79b40b4bd0 2024-09-17T05:29:24.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79bb400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f79b4167cf0 con 0x7f79b40b3130 2024-09-17T05:29:24.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79b9400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79b415b580 0x7f79b40b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:24.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79b8a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79b40b3130 0x7f79b41f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:24.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79b9400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79b415b580 0x7f79b40b0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40118/0 (socket says 172.21.15.31:40118) 2024-09-17T05:29:24.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79b9400640 1 -- 172.21.15.31:0/1532814012 learned_addr learned my addr 172.21.15.31:0/1532814012 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:24.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79b3e00640 1 --2- 172.21.15.31:0/1532814012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b40b4bd0 0x7f79b409c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:24.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79b9400640 1 -- 172.21.15.31:0/1532814012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79b40b3130 msgr2=0x7f79b41f5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:24.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79b9400640 1 --2- 172.21.15.31:0/1532814012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79b40b3130 0x7f79b41f5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:24.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79b9400640 1 -- 172.21.15.31:0/1532814012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b40b4bd0 msgr2=0x7f79b409c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:24.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79b9400640 1 --2- 172.21.15.31:0/1532814012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b40b4bd0 0x7f79b409c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:24.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79b9400640 1 -- 172.21.15.31:0/1532814012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b409d850 con 0x7f79b415b580 2024-09-17T05:29:24.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79b9400640 1 --2- 172.21.15.31:0/1532814012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79b415b580 0x7f79b40b0430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f79ac01a7d0 tx=0x7f79ac009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:24.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79b0c00640 1 -- 172.21.15.31:0/1532814012 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ac0b2040 con 0x7f79b415b580 2024-09-17T05:29:24.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79b0c00640 1 -- 172.21.15.31:0/1532814012 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79ac004d40 con 0x7f79b415b580 2024-09-17T05:29:24.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79b0c00640 1 -- 172.21.15.31:0/1532814012 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ac004240 con 0x7f79b415b580 2024-09-17T05:29:24.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79bb400640 1 -- 172.21.15.31:0/1532814012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79b41f5550 con 0x7f79b415b580 2024-09-17T05:29:24.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79bb400640 1 -- 172.21.15.31:0/1532814012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79b409d570 con 0x7f79b415b580 2024-09-17T05:29:24.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.093+0000 7f79bb400640 1 -- 172.21.15.31:0/1532814012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79b4069410 con 0x7f79b415b580 2024-09-17T05:29:24.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.097+0000 7f79b0c00640 1 -- 172.21.15.31:0/1532814012 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f79ac0be060 con 0x7f79b415b580 2024-09-17T05:29:24.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.097+0000 7f79b0c00640 1 --2- 172.21.15.31:0/1532814012 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7994073230 0x7f79940756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:24.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.097+0000 7f79b0c00640 1 -- 172.21.15.31:0/1532814012 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7f79ac12db90 con 0x7f79b415b580 2024-09-17T05:29:24.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.097+0000 7f79b8a00640 1 --2- 172.21.15.31:0/1532814012 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7994073230 0x7f79940756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:24.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.097+0000 7f79b8a00640 1 --2- 172.21.15.31:0/1532814012 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7994073230 0x7f79940756f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f79a8007fd0 tx=0x7f79a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:24.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.101+0000 7f79b0c00640 1 -- 172.21.15.31:0/1532814012 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f79b409d850 con 0x7f79b415b580 2024-09-17T05:29:24.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.297+0000 7f79bb400640 1 -- 172.21.15.31:0/1532814012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f79b406fe70 con 0x7f79b415b580 2024-09-17T05:29:24.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.845+0000 7f79b0c00640 1 -- 172.21.15.31:0/1532814012 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7f79ac016790 con 0x7f79b415b580 2024-09-17T05:29:24.850 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2024-09-17T05:29:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.849+0000 7f79bb400640 1 -- 172.21.15.31:0/1532814012 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7994073230 msgr2=0x7f79940756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.849+0000 7f79bb400640 1 --2- 172.21.15.31:0/1532814012 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7994073230 0x7f79940756f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f79a8007fd0 tx=0x7f79a8009040 comp rx=0 tx=0).stop 2024-09-17T05:29:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.849+0000 7f79bb400640 1 -- 172.21.15.31:0/1532814012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79b415b580 msgr2=0x7f79b40b0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.849+0000 7f79bb400640 1 --2- 172.21.15.31:0/1532814012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79b415b580 0x7f79b40b0430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f79ac01a7d0 tx=0x7f79ac009300 comp rx=0 tx=0).stop 2024-09-17T05:29:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.849+0000 7f79bb400640 1 -- 172.21.15.31:0/1532814012 shutdown_connections 2024-09-17T05:29:24.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.849+0000 7f79bb400640 1 --2- 172.21.15.31:0/1532814012 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7994073230 0x7f79940756f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:24.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.849+0000 7f79bb400640 1 --2- 172.21.15.31:0/1532814012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79b415b580 0x7f79b40b0430 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:24.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.849+0000 7f79bb400640 1 --2- 172.21.15.31:0/1532814012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f79b40b4bd0 0x7f79b409c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:24.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.849+0000 7f79bb400640 1 --2- 172.21.15.31:0/1532814012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79b40b3130 0x7f79b41f5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:24.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.849+0000 7f79bb400640 1 -- 172.21.15.31:0/1532814012 >> 172.21.15.31:0/1532814012 conn(0x7f79b40b18f0 msgr2=0x7f79b4073360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:24.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.849+0000 7f79bb400640 1 -- 172.21.15.31:0/1532814012 shutdown_connections 2024-09-17T05:29:24.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:24.849+0000 7f79bb400640 1 -- 172.21.15.31:0/1532814012 wait complete. 2024-09-17T05:29:24.881 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:29:25.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f9311a00640 1 -- 172.21.15.31:0/169889284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f930c06e810 msgr2=0x7f930c06f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:25.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f9311a00640 1 --2- 172.21.15.31:0/169889284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f930c06e810 0x7f930c06f3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f930c0cc770 tx=0x7f930401cda0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f9311a00640 1 -- 172.21.15.31:0/169889284 shutdown_connections 2024-09-17T05:29:25.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f9311a00640 1 --2- 172.21.15.31:0/169889284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f930c06e810 0x7f930c06f3c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f9311a00640 1 -- 172.21.15.31:0/169889284 >> 172.21.15.31:0/169889284 conn(0x7f930c0b18f0 msgr2=0x7f930c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:25.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f9311a00640 1 -- 172.21.15.31:0/169889284 shutdown_connections 2024-09-17T05:29:25.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f9311a00640 1 -- 172.21.15.31:0/169889284 wait complete. 2024-09-17T05:29:25.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f9311a00640 1 Processor -- start 2024-09-17T05:29:25.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f9311a00640 1 -- start start 2024-09-17T05:29:25.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f9311a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f930c06e810 0x7f930c09c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:25.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f9311a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f930c0cf300 0x7f930c1fc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:25.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f9311a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f930c15ade0 0x7f930c140d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:25.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f9311a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f930c169b20 con 0x7f930c15ade0 2024-09-17T05:29:25.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f9311a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f930c1699a0 con 0x7f930c0cf300 2024-09-17T05:29:25.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f9311a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f930c169ca0 con 0x7f930c06e810 2024-09-17T05:29:25.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f930b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f930c15ade0 0x7f930c140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:25.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f930b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f930c15ade0 0x7f930c140d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40132/0 (socket says 172.21.15.31:40132) 2024-09-17T05:29:25.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f930b400640 1 -- 172.21.15.31:0/802848797 learned_addr learned my addr 172.21.15.31:0/802848797 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:25.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f930aa00640 1 --2- 172.21.15.31:0/802848797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f930c06e810 0x7f930c09c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:25.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f9302000640 1 --2- 172.21.15.31:0/802848797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f930c0cf300 0x7f930c1fc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:25.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f930b400640 1 -- 172.21.15.31:0/802848797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f930c06e810 msgr2=0x7f930c09c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:25.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f930b400640 1 --2- 172.21.15.31:0/802848797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f930c06e810 0x7f930c09c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f930b400640 1 -- 172.21.15.31:0/802848797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f930c0cf300 msgr2=0x7f930c1fc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:25.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f930b400640 1 --2- 172.21.15.31:0/802848797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f930c0cf300 0x7f930c1fc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.029+0000 7f930b400640 1 -- 172.21.15.31:0/802848797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930c1fc730 con 0x7f930c15ade0 2024-09-17T05:29:25.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.033+0000 7f930b400640 1 --2- 172.21.15.31:0/802848797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f930c15ade0 0x7f930c140d20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9304009bd0 tx=0x7f93040a5ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:25.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.033+0000 7f9303400640 1 -- 172.21.15.31:0/802848797 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93040bb070 con 0x7f930c15ade0 2024-09-17T05:29:25.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.033+0000 7f9303400640 1 -- 172.21.15.31:0/802848797 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9304004d40 con 0x7f930c15ade0 2024-09-17T05:29:25.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.033+0000 7f9311a00640 1 -- 172.21.15.31:0/802848797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f930c09cf00 con 0x7f930c15ade0 2024-09-17T05:29:25.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.033+0000 7f9303400640 1 -- 172.21.15.31:0/802848797 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93040b2040 con 0x7f930c15ade0 2024-09-17T05:29:25.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.033+0000 7f9311a00640 1 -- 172.21.15.31:0/802848797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f930c09d7a0 con 0x7f930c15ade0 2024-09-17T05:29:25.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.033+0000 7f9311a00640 1 -- 172.21.15.31:0/802848797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f930c069410 con 0x7f930c15ade0 2024-09-17T05:29:25.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.033+0000 7f9303400640 1 -- 172.21.15.31:0/802848797 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f93040be070 con 0x7f930c15ade0 2024-09-17T05:29:25.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.037+0000 7f9303400640 1 --2- 172.21.15.31:0/802848797 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f92e8073200 0x7f92e80756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:25.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.037+0000 7f9303400640 1 -- 172.21.15.31:0/802848797 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f930412dd20 con 0x7f930c15ade0 2024-09-17T05:29:25.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.037+0000 7f930aa00640 1 --2- 172.21.15.31:0/802848797 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f92e8073200 0x7f92e80756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:25.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.037+0000 7f930aa00640 1 --2- 172.21.15.31:0/802848797 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f92e8073200 0x7f92e80756c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f92fc007fd0 tx=0x7f92fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:25.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.041+0000 7f9303400640 1 -- 172.21.15.31:0/802848797 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f930c1fc730 con 0x7f930c15ade0 2024-09-17T05:29:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.277+0000 7f9311a00640 1 -- 172.21.15.31:0/802848797 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f930c0cebf0 con 0x7f930c15ade0 2024-09-17T05:29:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.277+0000 7f9303400640 1 -- 172.21.15.31:0/802848797 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) ==== 80+0+6645 (secure 0 0 0) 0x7f9304016990 con 0x7f930c15ade0 2024-09-17T05:29:25.281 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:25.282 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:29:25.282 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2024-09-17T05:29:25.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.282 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2024-09-17T05:29:25.282 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmoloQARAAbTcR/1F1qz7Crjdu1NPSgw==", 2024-09-17T05:29:25.282 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.282 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:29:25.282 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:29:25.282 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:29:25.282 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:29:25.282 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.283 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2024-09-17T05:29:25.283 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmYrdRDRAAkaDz03U3lMZlkLEVFYlTaw==", 2024-09-17T05:29:25.283 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.283 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:29:25.283 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:29:25.283 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:29:25.283 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:29:25.283 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.283 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2024-09-17T05:29:25.283 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmpFRCCBAAZRsuAVwSxuMGDeoYCwWFeg==", 2024-09-17T05:29:25.283 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.284 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:29:25.284 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:29:25.284 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:29:25.284 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:29:25.284 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.284 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2024-09-17T05:29:25.284 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lm23PSFBAAuO+k0kWY28PN7+pEtlUniQ==", 2024-09-17T05:29:25.284 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.284 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:29:25.285 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:29:25.285 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:29:25.285 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:29:25.285 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.285 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2024-09-17T05:29:25.285 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBTE+lm0miKHxAA2C1pfwBxJtKQhu4xuPumxg==", 2024-09-17T05:29:25.285 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.285 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:29:25.285 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:29:25.285 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:29:25.286 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.286 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2024-09-17T05:29:25.286 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBWE+lmdQi7NRAA2v4ETg4jynbPF0K4E73KAA==", 2024-09-17T05:29:25.286 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.286 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:29:25.286 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:29:25.286 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:29:25.286 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.286 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2024-09-17T05:29:25.286 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBaE+lm18eUEBAA8gAhUx9UNa2Lk4uyFBd7Nw==", 2024-09-17T05:29:25.287 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.287 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:29:25.287 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:29:25.287 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:29:25.287 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.287 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2024-09-17T05:29:25.287 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBdE+lm00moJBAAizrxOP4rI4fGR91dYzlEkw==", 2024-09-17T05:29:25.287 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.287 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:29:25.287 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:29:25.288 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:29:25.288 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.288 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2024-09-17T05:29:25.288 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBjE+lmhdtUJhAA7+KM8DwQriFwMbpqXAPTuA==", 2024-09-17T05:29:25.288 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.288 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:29:25.288 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:29:25.288 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:29:25.288 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.289 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2024-09-17T05:29:25.289 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBmE+lm5cByOhAAiMnQIv2O41am/3E+0dp4sg==", 2024-09-17T05:29:25.289 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.289 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:29:25.289 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:29:25.289 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:29:25.289 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.289 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2024-09-17T05:29:25.289 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBqE+lm19FhExAAo/Sfj2SX5+Y2/Fxz8mbiNQ==", 2024-09-17T05:29:25.289 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.290 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:29:25.290 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:29:25.290 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:29:25.290 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.290 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2024-09-17T05:29:25.290 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBtE+lmISDbKBAAapUBS+t+N1vUcCbdJic8Dw==", 2024-09-17T05:29:25.290 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.290 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:29:25.290 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:29:25.290 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:29:25.291 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.291 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2024-09-17T05:29:25.291 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw==", 2024-09-17T05:29:25.291 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.291 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:29:25.291 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:29:25.291 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:29:25.291 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:29:25.291 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.291 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2024-09-17T05:29:25.292 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmb2pmIhAA7p+G+WnB7ujZZdSlaossYg==", 2024-09-17T05:29:25.292 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.292 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:29:25.292 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:29:25.292 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:29:25.292 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:29:25.292 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.292 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2024-09-17T05:29:25.292 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmAPPaHhAAyz/gKunaNFyrdkAUy50qmQ==", 2024-09-17T05:29:25.292 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.293 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:29:25.293 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:29:25.293 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:29:25.293 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:29:25.293 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.293 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2024-09-17T05:29:25.293 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lml72BKBAAgAji5TWedU7azT5oQz3fYg==", 2024-09-17T05:29:25.293 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.293 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:29:25.293 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:29:25.293 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:29:25.294 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:29:25.294 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.294 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2024-09-17T05:29:25.294 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmtgltIRAAeTv/U/vZ9ZIuGN4JXTHD0A==", 2024-09-17T05:29:25.294 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.294 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:29:25.294 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:29:25.294 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:29:25.294 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:29:25.294 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.295 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-mds", 2024-09-17T05:29:25.295 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBzE+lmbBGKNRAA7mVhNg0tbjbSSIjUqmIWCQ==", 2024-09-17T05:29:25.295 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.295 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-mds" 2024-09-17T05:29:25.295 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.295 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-mgr", 2024-09-17T05:29:25.295 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBzE+lm/yGKNRAAiWdkIKxMQV8az0DrFOg0rg==", 2024-09-17T05:29:25.295 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.296 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-17T05:29:25.296 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.296 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.296 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.296 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-osd", 2024-09-17T05:29:25.296 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBzE+lmSyuKNRAA+cWGgRYBmwWseFC3MFWLUA==", 2024-09-17T05:29:25.296 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.296 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-osd" 2024-09-17T05:29:25.297 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.297 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-rbd", 2024-09-17T05:29:25.297 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBzE+lmyzOKNRAAN5Ig2JYVLN10k+KhPmWs9A==", 2024-09-17T05:29:25.297 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.297 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-17T05:29:25.297 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.297 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-17T05:29:25.297 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBzE+lmlTyKNRAArAgZ+X3WXcKew6M4NaJ1lQ==", 2024-09-17T05:29:25.298 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.298 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-17T05:29:25.298 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.298 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.298 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-rgw", 2024-09-17T05:29:25.298 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBzE+lmbUWKNRAAeduUQpu7OuCB6A6RaPzkmQ==", 2024-09-17T05:29:25.298 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.298 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-17T05:29:25.298 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.299 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2024-09-17T05:29:25.300 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmTt2oOBAAmR5ykU4WbEzlKFiwI7sMdg==", 2024-09-17T05:29:25.300 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.300 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:29:25.300 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:29:25.300 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:29:25.300 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:29:25.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:25.300 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2024-09-17T05:29:25.300 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmKILYNBAAojM8RIq92dO2DQyXppReIw==", 2024-09-17T05:29:25.300 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:29:25.301 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:29:25.301 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:29:25.301 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:29:25.301 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.301 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:25.301 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:29:25.301 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:29:25.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.277+0000 7f9311a00640 1 -- 172.21.15.31:0/802848797 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f92e8073200 msgr2=0x7f92e80756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:25.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.277+0000 7f9311a00640 1 --2- 172.21.15.31:0/802848797 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f92e8073200 0x7f92e80756c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f92fc007fd0 tx=0x7f92fc009040 comp rx=0 tx=0).stop 2024-09-17T05:29:25.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.277+0000 7f9311a00640 1 -- 172.21.15.31:0/802848797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f930c15ade0 msgr2=0x7f930c140d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:25.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.277+0000 7f9311a00640 1 --2- 172.21.15.31:0/802848797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f930c15ade0 0x7f930c140d20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9304009bd0 tx=0x7f93040a5ce0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.281+0000 7f9311a00640 1 -- 172.21.15.31:0/802848797 shutdown_connections 2024-09-17T05:29:25.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.281+0000 7f9311a00640 1 --2- 172.21.15.31:0/802848797 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f92e8073200 0x7f92e80756c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.281+0000 7f9311a00640 1 --2- 172.21.15.31:0/802848797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f930c15ade0 0x7f930c140d20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.281+0000 7f9311a00640 1 --2- 172.21.15.31:0/802848797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f930c0cf300 0x7f930c1fc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.281+0000 7f9311a00640 1 --2- 172.21.15.31:0/802848797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f930c06e810 0x7f930c09c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.281+0000 7f9311a00640 1 -- 172.21.15.31:0/802848797 >> 172.21.15.31:0/802848797 conn(0x7f930c0b18f0 msgr2=0x7f930c158680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:25.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.281+0000 7f9311a00640 1 -- 172.21.15.31:0/802848797 shutdown_connections 2024-09-17T05:29:25.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.281+0000 7f9311a00640 1 -- 172.21.15.31:0/802848797 wait complete. 2024-09-17T05:29:25.304 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-17T05:29:25.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.445+0000 7fb8b5600640 1 -- 172.21.15.31:0/3498486630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8b015af60 msgr2=0x7fb8b00cffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:25.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.445+0000 7fb8b5600640 1 --2- 172.21.15.31:0/3498486630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8b015af60 0x7fb8b00cffc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00d1b50 tx=0x7fb8a001c8c0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.445+0000 7fb8b5600640 1 -- 172.21.15.31:0/3498486630 shutdown_connections 2024-09-17T05:29:25.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.445+0000 7fb8b5600640 1 --2- 172.21.15.31:0/3498486630 >> v2:172.21.15.155:3300/0 conn(0x7fb8b00737c0 0x7fb8b0073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.445+0000 7fb8b5600640 1 --2- 172.21.15.31:0/3498486630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8b015af60 0x7fb8b00cffc0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.445+0000 7fb8b5600640 1 -- 172.21.15.31:0/3498486630 >> 172.21.15.31:0/3498486630 conn(0x7fb8b00d0c90 msgr2=0x7fb8b00d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:25.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.445+0000 7fb8b5600640 1 -- 172.21.15.31:0/3498486630 shutdown_connections 2024-09-17T05:29:25.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.445+0000 7fb8b5600640 1 -- 172.21.15.31:0/3498486630 wait complete. 2024-09-17T05:29:25.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8b5600640 1 Processor -- start 2024-09-17T05:29:25.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8b5600640 1 -- start start 2024-09-17T05:29:25.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8b5600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8b00737c0 0x7fb8b00c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:25.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8b5600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8b0074160 0x7fb8b0154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:25.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8b5600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8b015af60 0x7fb8b0155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:25.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8b5600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b0167b40 con 0x7fb8b015af60 2024-09-17T05:29:25.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8b5600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b0070b70 con 0x7fb8b00737c0 2024-09-17T05:29:25.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8b5600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb8b0167cc0 con 0x7fb8b0074160 2024-09-17T05:29:25.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8af400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8b015af60 0x7fb8b0155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:25.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8aea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8b00737c0 0x7fb8b00c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:25.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8af400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8b015af60 0x7fb8b0155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40144/0 (socket says 172.21.15.31:40144) 2024-09-17T05:29:25.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8af400640 1 -- 172.21.15.31:0/357514901 learned_addr learned my addr 172.21.15.31:0/357514901 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:25.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8a7e00640 1 --2- 172.21.15.31:0/357514901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8b0074160 0x7fb8b0154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:25.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8af400640 1 -- 172.21.15.31:0/357514901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8b0074160 msgr2=0x7fb8b0154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:25.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8af400640 1 --2- 172.21.15.31:0/357514901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8b0074160 0x7fb8b0154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8af400640 1 -- 172.21.15.31:0/357514901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8b00737c0 msgr2=0x7fb8b00c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:25.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8af400640 1 --2- 172.21.15.31:0/357514901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8b00737c0 0x7fb8b00c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8af400640 1 -- 172.21.15.31:0/357514901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b0154cd0 con 0x7fb8b015af60 2024-09-17T05:29:25.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8af400640 1 --2- 172.21.15.31:0/357514901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8b015af60 0x7fb8b0155910 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800c7c0 tx=0x7fb8a800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:25.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8a6a00640 1 -- 172.21.15.31:0/357514901 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8003b80 con 0x7fb8b015af60 2024-09-17T05:29:25.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8a6a00640 1 -- 172.21.15.31:0/357514901 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8a8003d20 con 0x7fb8b015af60 2024-09-17T05:29:25.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8a6a00640 1 -- 172.21.15.31:0/357514901 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a800aab0 con 0x7fb8b015af60 2024-09-17T05:29:25.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8b5600640 1 -- 172.21.15.31:0/357514901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8b01f6670 con 0x7fb8b015af60 2024-09-17T05:29:25.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.449+0000 7fb8b5600640 1 -- 172.21.15.31:0/357514901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8b0153cb0 con 0x7fb8b015af60 2024-09-17T05:29:25.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.453+0000 7fb8b5600640 1 -- 172.21.15.31:0/357514901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8b0073c20 con 0x7fb8b015af60 2024-09-17T05:29:25.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.453+0000 7fb8a6a00640 1 -- 172.21.15.31:0/357514901 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb8a800ac50 con 0x7fb8b015af60 2024-09-17T05:29:25.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.453+0000 7fb8a6a00640 1 --2- 172.21.15.31:0/357514901 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb88c073200 0x7fb88c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:25.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.453+0000 7fb8a6a00640 1 -- 172.21.15.31:0/357514901 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fb8a8093bd0 con 0x7fb8b015af60 2024-09-17T05:29:25.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.453+0000 7fb8aea00640 1 --2- 172.21.15.31:0/357514901 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb88c073200 0x7fb88c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:25.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.453+0000 7fb8aea00640 1 --2- 172.21.15.31:0/357514901 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb88c073200 0x7fb88c0756c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00af000 tx=0x7fb8a00a7040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:25.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.457+0000 7fb8a6a00640 1 -- 172.21.15.31:0/357514901 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb8a805e970 con 0x7fb8b015af60 2024-09-17T05:29:25.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.693+0000 7fb8b5600640 1 -- 172.21.15.31:0/357514901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fb8b00d1110 con 0x7fb8b015af60 2024-09-17T05:29:25.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.697+0000 7fb8a6a00640 1 -- 172.21.15.31:0/357514901 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fb8a80633a0 con 0x7fb8b015af60 2024-09-17T05:29:25.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.701+0000 7fb8b5600640 1 -- 172.21.15.31:0/357514901 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb88c073200 msgr2=0x7fb88c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:25.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.701+0000 7fb8b5600640 1 --2- 172.21.15.31:0/357514901 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb88c073200 0x7fb88c0756c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00af000 tx=0x7fb8a00a7040 comp rx=0 tx=0).stop 2024-09-17T05:29:25.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.701+0000 7fb8b5600640 1 -- 172.21.15.31:0/357514901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8b015af60 msgr2=0x7fb8b0155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:25.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.701+0000 7fb8b5600640 1 --2- 172.21.15.31:0/357514901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8b015af60 0x7fb8b0155910 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800c7c0 tx=0x7fb8a800cc80 comp rx=0 tx=0).stop 2024-09-17T05:29:25.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.701+0000 7fb8b5600640 1 -- 172.21.15.31:0/357514901 shutdown_connections 2024-09-17T05:29:25.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.701+0000 7fb8b5600640 1 --2- 172.21.15.31:0/357514901 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb88c073200 0x7fb88c0756c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.701+0000 7fb8b5600640 1 --2- 172.21.15.31:0/357514901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb8b015af60 0x7fb8b0155910 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.701+0000 7fb8b5600640 1 --2- 172.21.15.31:0/357514901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb8b0074160 0x7fb8b0154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.701+0000 7fb8b5600640 1 --2- 172.21.15.31:0/357514901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8b00737c0 0x7fb8b00c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.701+0000 7fb8b5600640 1 -- 172.21.15.31:0/357514901 >> 172.21.15.31:0/357514901 conn(0x7fb8b00d0c90 msgr2=0x7fb8b00b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:25.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.701+0000 7fb8b5600640 1 -- 172.21.15.31:0/357514901 shutdown_connections 2024-09-17T05:29:25.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.701+0000 7fb8b5600640 1 -- 172.21.15.31:0/357514901 wait complete. 2024-09-17T05:29:25.723 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-17T05:29:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.873+0000 7f986ec00640 1 -- 172.21.15.31:0/2353409272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98680b0ce0 msgr2=0x7f98680b5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.873+0000 7f986ec00640 1 --2- 172.21.15.31:0/2353409272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98680b0ce0 0x7f98680b5160 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f98680b16e0 tx=0x7f985401c8c0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.873+0000 7f986ec00640 1 -- 172.21.15.31:0/2353409272 shutdown_connections 2024-09-17T05:29:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.873+0000 7f986ec00640 1 --2- 172.21.15.31:0/2353409272 >> v2:172.21.15.155:3300/0 conn(0x7f98680b56a0 0x7f9868070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.873+0000 7f986ec00640 1 --2- 172.21.15.31:0/2353409272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98680b0ce0 0x7f98680b5160 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.873+0000 7f986ec00640 1 --2- 172.21.15.31:0/2353409272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98680b4d80 0x7f98680b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.873+0000 7f986ec00640 1 -- 172.21.15.31:0/2353409272 >> 172.21.15.31:0/2353409272 conn(0x7f986809aa10 msgr2=0x7f986809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:25.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.873+0000 7f986ec00640 1 -- 172.21.15.31:0/2353409272 shutdown_connections 2024-09-17T05:29:25.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.873+0000 7f986ec00640 1 -- 172.21.15.31:0/2353409272 wait complete. 2024-09-17T05:29:25.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.873+0000 7f986ec00640 1 Processor -- start 2024-09-17T05:29:25.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.873+0000 7f986ec00640 1 -- start start 2024-09-17T05:29:25.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.873+0000 7f986ec00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98680b0ce0 0x7f98680cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:25.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986ec00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98680b4d80 0x7f986806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:25.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986ec00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98680b56a0 0x7f986815b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:25.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986ec00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9868167800 con 0x7f98680b56a0 2024-09-17T05:29:25.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986ec00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9868167680 con 0x7f98680b4d80 2024-09-17T05:29:25.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986ec00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9868167980 con 0x7f98680b0ce0 2024-09-17T05:29:25.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986e200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98680b56a0 0x7f986815b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:25.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986e200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98680b56a0 0x7f986815b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40160/0 (socket says 172.21.15.31:40160) 2024-09-17T05:29:25.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986e200640 1 -- 172.21.15.31:0/1391277529 learned_addr learned my addr 172.21.15.31:0/1391277529 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:25.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986ce00640 1 --2- 172.21.15.31:0/1391277529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98680b4d80 0x7f986806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:25.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986d800640 1 --2- 172.21.15.31:0/1391277529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98680b0ce0 0x7f98680cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:25.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986e200640 1 -- 172.21.15.31:0/1391277529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98680b0ce0 msgr2=0x7f98680cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:25.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986e200640 1 --2- 172.21.15.31:0/1391277529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98680b0ce0 0x7f98680cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986e200640 1 -- 172.21.15.31:0/1391277529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98680b4d80 msgr2=0x7f986806e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:25.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986e200640 1 --2- 172.21.15.31:0/1391277529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98680b4d80 0x7f986806e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:25.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986e200640 1 -- 172.21.15.31:0/1391277529 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98680b53d0 con 0x7f98680b56a0 2024-09-17T05:29:25.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986d800640 1 --2- 172.21.15.31:0/1391277529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98680b0ce0 0x7f98680cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:29:25.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986e200640 1 --2- 172.21.15.31:0/1391277529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98680b56a0 0x7f986815b020 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f986000eab0 tx=0x7f986000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:25.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f9865600640 1 -- 172.21.15.31:0/1391277529 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986000cea0 con 0x7f98680b56a0 2024-09-17T05:29:25.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f9865600640 1 -- 172.21.15.31:0/1391277529 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9860004b30 con 0x7f98680b56a0 2024-09-17T05:29:25.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f9865600640 1 -- 172.21.15.31:0/1391277529 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9860005020 con 0x7f98680b56a0 2024-09-17T05:29:25.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986ec00640 1 -- 172.21.15.31:0/1391277529 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f986806ddd0 con 0x7f98680b56a0 2024-09-17T05:29:25.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986ec00640 1 -- 172.21.15.31:0/1391277529 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f986806e040 con 0x7f98680b56a0 2024-09-17T05:29:25.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f986ec00640 1 -- 172.21.15.31:0/1391277529 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98680b11a0 con 0x7f98680b56a0 2024-09-17T05:29:25.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.877+0000 7f9865600640 1 -- 172.21.15.31:0/1391277529 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f98600051c0 con 0x7f98680b56a0 2024-09-17T05:29:25.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.881+0000 7f9865600640 1 --2- 172.21.15.31:0/1391277529 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9848073200 0x7f98480756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:25.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.881+0000 7f9865600640 1 -- 172.21.15.31:0/1391277529 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f9860094c10 con 0x7f98680b56a0 2024-09-17T05:29:25.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.881+0000 7f986d800640 1 --2- 172.21.15.31:0/1391277529 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9848073200 0x7f98480756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:25.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.881+0000 7f986d800640 1 --2- 172.21.15.31:0/1391277529 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9848073200 0x7f98480756c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f985c009b60 tx=0x7f985c0091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:25.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:25.885+0000 7f9865600640 1 -- 172.21.15.31:0/1391277529 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f986005ff70 con 0x7f98680b56a0 2024-09-17T05:29:26.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.133+0000 7f986ec00640 1 -- 172.21.15.31:0/1391277529 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f9868157910 con 0x7f98680b56a0 2024-09-17T05:29:26.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.133+0000 7f9865600640 1 -- 172.21.15.31:0/1391277529 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f986005f870 con 0x7f98680b56a0 2024-09-17T05:29:26.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.137+0000 7f986ec00640 1 -- 172.21.15.31:0/1391277529 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9848073200 msgr2=0x7f98480756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:26.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.137+0000 7f986ec00640 1 --2- 172.21.15.31:0/1391277529 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9848073200 0x7f98480756c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f985c009b60 tx=0x7f985c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.137+0000 7f986ec00640 1 -- 172.21.15.31:0/1391277529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98680b56a0 msgr2=0x7f986815b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:26.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.137+0000 7f986ec00640 1 --2- 172.21.15.31:0/1391277529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98680b56a0 0x7f986815b020 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f986000eab0 tx=0x7f986000ef70 comp rx=0 tx=0).stop 2024-09-17T05:29:26.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.137+0000 7f986ec00640 1 -- 172.21.15.31:0/1391277529 shutdown_connections 2024-09-17T05:29:26.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.137+0000 7f986ec00640 1 --2- 172.21.15.31:0/1391277529 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9848073200 0x7f98480756c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.137+0000 7f986ec00640 1 --2- 172.21.15.31:0/1391277529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98680b56a0 0x7f986815b020 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.137+0000 7f986ec00640 1 --2- 172.21.15.31:0/1391277529 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98680b4d80 0x7f986806e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.137+0000 7f986ec00640 1 --2- 172.21.15.31:0/1391277529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98680b0ce0 0x7f98680cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.137+0000 7f986ec00640 1 -- 172.21.15.31:0/1391277529 >> 172.21.15.31:0/1391277529 conn(0x7f986809aa10 msgr2=0x7f98681555c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:26.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.137+0000 7f986ec00640 1 -- 172.21.15.31:0/1391277529 shutdown_connections 2024-09-17T05:29:26.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.137+0000 7f986ec00640 1 -- 172.21.15.31:0/1391277529 wait complete. 2024-09-17T05:29:26.162 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-17T05:29:26.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.305+0000 7f9c08600640 1 -- 172.21.15.31:0/2672936279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c00146b50 msgr2=0x7f9c000d16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:26.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.305+0000 7f9c08600640 1 --2- 172.21.15.31:0/2672936279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c00146b50 0x7f9c000d16e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009900 tx=0x7f9bf401c880 comp rx=0 tx=0).stop 2024-09-17T05:29:26.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.305+0000 7f9c08600640 1 -- 172.21.15.31:0/2672936279 shutdown_connections 2024-09-17T05:29:26.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.305+0000 7f9c08600640 1 --2- 172.21.15.31:0/2672936279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c000b5b80 0x7f9c0006f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.305+0000 7f9c08600640 1 --2- 172.21.15.31:0/2672936279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c00146b50 0x7f9c000d16e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.305+0000 7f9c08600640 1 -- 172.21.15.31:0/2672936279 >> 172.21.15.31:0/2672936279 conn(0x7f9c0006dd30 msgr2=0x7f9c0006e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:26.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.305+0000 7f9c08600640 1 -- 172.21.15.31:0/2672936279 shutdown_connections 2024-09-17T05:29:26.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.305+0000 7f9c08600640 1 -- 172.21.15.31:0/2672936279 wait complete. 2024-09-17T05:29:26.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.305+0000 7f9c08600640 1 Processor -- start 2024-09-17T05:29:26.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.305+0000 7f9c08600640 1 -- start start 2024-09-17T05:29:26.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9c08600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c000746e0 0x7f9c00161230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:26.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9c08600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c000b5b80 0x7f9c0015f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:26.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9c08600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c00146b50 0x7f9c0015d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9c08600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0016ae50 con 0x7f9c000746e0 2024-09-17T05:29:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9c08600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0016acd0 con 0x7f9c000b5b80 2024-09-17T05:29:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9c08600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9c0016afd0 con 0x7f9c00146b50 2024-09-17T05:29:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9c05c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c000746e0 0x7f9c00161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9c05c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c000746e0 0x7f9c00161230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40182/0 (socket says 172.21.15.31:40182) 2024-09-17T05:29:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9c05c00640 1 -- 172.21.15.31:0/2648543905 learned_addr learned my addr 172.21.15.31:0/2648543905 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9c05c00640 1 -- 172.21.15.31:0/2648543905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c00146b50 msgr2=0x7f9c0015d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9c05c00640 1 --2- 172.21.15.31:0/2648543905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c00146b50 0x7f9c0015d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9c05c00640 1 -- 172.21.15.31:0/2648543905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c000b5b80 msgr2=0x7f9c0015f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9c05c00640 1 --2- 172.21.15.31:0/2648543905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c000b5b80 0x7f9c0015f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9c05c00640 1 -- 172.21.15.31:0/2648543905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0015f5a0 con 0x7f9c000746e0 2024-09-17T05:29:26.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9c05c00640 1 --2- 172.21.15.31:0/2648543905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c000746e0 0x7f9c00161230 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009850 tx=0x7f9bf4005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:26.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9bfd600640 1 -- 172.21.15.31:0/2648543905 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf40b2040 con 0x7f9c000746e0 2024-09-17T05:29:26.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9bfd600640 1 -- 172.21.15.31:0/2648543905 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bf4005320 con 0x7f9c000746e0 2024-09-17T05:29:26.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9bfd600640 1 -- 172.21.15.31:0/2648543905 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf40046d0 con 0x7f9c000746e0 2024-09-17T05:29:26.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9c08600640 1 -- 172.21.15.31:0/2648543905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0013b8e0 con 0x7f9c000746e0 2024-09-17T05:29:26.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9c08600640 1 -- 172.21.15.31:0/2648543905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c0013bea0 con 0x7f9c000746e0 2024-09-17T05:29:26.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9c08600640 1 -- 172.21.15.31:0/2648543905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c0006f6b0 con 0x7f9c000746e0 2024-09-17T05:29:26.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.309+0000 7f9bfd600640 1 -- 172.21.15.31:0/2648543905 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9bf40bd060 con 0x7f9c000746e0 2024-09-17T05:29:26.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.313+0000 7f9bfd600640 1 --2- 172.21.15.31:0/2648543905 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9be0073200 0x7f9be00756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:26.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.313+0000 7f9bfd600640 1 -- 172.21.15.31:0/2648543905 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f9bf412dc60 con 0x7f9c000746e0 2024-09-17T05:29:26.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.313+0000 7f9c05200640 1 --2- 172.21.15.31:0/2648543905 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9be0073200 0x7f9be00756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:26.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.313+0000 7f9c05200640 1 --2- 172.21.15.31:0/2648543905 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9be0073200 0x7f9be00756c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9bec007fd0 tx=0x7f9bec0078e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:26.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.317+0000 7f9bfd600640 1 -- 172.21.15.31:0/2648543905 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9c0015f5a0 con 0x7f9c000746e0 2024-09-17T05:29:26.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.557+0000 7f9c08600640 1 -- 172.21.15.31:0/2648543905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f9c000adef0 con 0x7f9c000746e0 2024-09-17T05:29:26.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.561+0000 7f9bfd600640 1 -- 172.21.15.31:0/2648543905 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f9bf40164d0 con 0x7f9c000746e0 2024-09-17T05:29:26.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.561+0000 7f9c08600640 1 -- 172.21.15.31:0/2648543905 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9be0073200 msgr2=0x7f9be00756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:26.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.561+0000 7f9c08600640 1 --2- 172.21.15.31:0/2648543905 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9be0073200 0x7f9be00756c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9bec007fd0 tx=0x7f9bec0078e0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.561+0000 7f9c08600640 1 -- 172.21.15.31:0/2648543905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c000746e0 msgr2=0x7f9c00161230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:26.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.561+0000 7f9c08600640 1 --2- 172.21.15.31:0/2648543905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c000746e0 0x7f9c00161230 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009850 tx=0x7f9bf4005de0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.561+0000 7f9c08600640 1 -- 172.21.15.31:0/2648543905 shutdown_connections 2024-09-17T05:29:26.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.561+0000 7f9c08600640 1 --2- 172.21.15.31:0/2648543905 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9be0073200 0x7f9be00756c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.561+0000 7f9c08600640 1 --2- 172.21.15.31:0/2648543905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c00146b50 0x7f9c0015d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.561+0000 7f9c08600640 1 --2- 172.21.15.31:0/2648543905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c000b5b80 0x7f9c0015f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.561+0000 7f9c08600640 1 --2- 172.21.15.31:0/2648543905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c000746e0 0x7f9c00161230 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.561+0000 7f9c08600640 1 -- 172.21.15.31:0/2648543905 >> 172.21.15.31:0/2648543905 conn(0x7f9c0006dd30 msgr2=0x7f9c000ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:26.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.561+0000 7f9c08600640 1 -- 172.21.15.31:0/2648543905 shutdown_connections 2024-09-17T05:29:26.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.561+0000 7f9c08600640 1 -- 172.21.15.31:0/2648543905 wait complete. 2024-09-17T05:29:26.586 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-17T05:29:26.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.729+0000 7fc37c400640 1 -- 172.21.15.31:0/2972732655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3740d28c0 msgr2=0x7fc3740cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:26.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.729+0000 7fc37c400640 1 --2- 172.21.15.31:0/2972732655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3740d28c0 0x7fc3740cea20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc360009840 tx=0x7fc36001c820 comp rx=0 tx=0).stop 2024-09-17T05:29:26.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.729+0000 7fc37c400640 1 -- 172.21.15.31:0/2972732655 shutdown_connections 2024-09-17T05:29:26.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.729+0000 7fc37c400640 1 --2- 172.21.15.31:0/2972732655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3740d28c0 0x7fc3740cea20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.729+0000 7fc37c400640 1 --2- 172.21.15.31:0/2972732655 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc37415be80 0x7fc3740ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.729+0000 7fc37c400640 1 -- 172.21.15.31:0/2972732655 >> 172.21.15.31:0/2972732655 conn(0x7fc3740d1da0 msgr2=0x7fc3740d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:26.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.729+0000 7fc37c400640 1 -- 172.21.15.31:0/2972732655 shutdown_connections 2024-09-17T05:29:26.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.729+0000 7fc37c400640 1 -- 172.21.15.31:0/2972732655 wait complete. 2024-09-17T05:29:26.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.729+0000 7fc37c400640 1 Processor -- start 2024-09-17T05:29:26.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.729+0000 7fc37c400640 1 -- start start 2024-09-17T05:29:26.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc37c400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3740b53f0 0x7fc3741574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:26.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc37c400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3740d28c0 0x7fc374156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:26.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc37c400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc37415be80 0x7fc3740c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:26.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc37c400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc3741691c0 con 0x7fc3740b53f0 2024-09-17T05:29:26.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc37c400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc374169040 con 0x7fc3740d28c0 2024-09-17T05:29:26.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc37c400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc374169340 con 0x7fc37415be80 2024-09-17T05:29:26.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc379a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3740b53f0 0x7fc3741574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:26.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc379a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3740b53f0 0x7fc3741574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40208/0 (socket says 172.21.15.31:40208) 2024-09-17T05:29:26.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc379a00640 1 -- 172.21.15.31:0/101661062 learned_addr learned my addr 172.21.15.31:0/101661062 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:26.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc37a400640 1 --2- 172.21.15.31:0/101661062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc37415be80 0x7fc3740c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:26.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc379000640 1 --2- 172.21.15.31:0/101661062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3740d28c0 0x7fc374156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:26.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc379a00640 1 -- 172.21.15.31:0/101661062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc37415be80 msgr2=0x7fc3740c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:26.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc379a00640 1 --2- 172.21.15.31:0/101661062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc37415be80 0x7fc3740c5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc379a00640 1 -- 172.21.15.31:0/101661062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3740d28c0 msgr2=0x7fc374156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:26.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc379a00640 1 --2- 172.21.15.31:0/101661062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3740d28c0 0x7fc374156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc379a00640 1 -- 172.21.15.31:0/101661062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3741f8de0 con 0x7fc3740b53f0 2024-09-17T05:29:26.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc379a00640 1 --2- 172.21.15.31:0/101661062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3740b53f0 0x7fc3741574e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc36800e7a0 tx=0x7fc36800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:26.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc371600640 1 -- 172.21.15.31:0/101661062 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36800ccc0 con 0x7fc3740b53f0 2024-09-17T05:29:26.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc371600640 1 -- 172.21.15.31:0/101661062 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc368010430 con 0x7fc3740b53f0 2024-09-17T05:29:26.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc371600640 1 -- 172.21.15.31:0/101661062 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368010860 con 0x7fc3740b53f0 2024-09-17T05:29:26.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc37c400640 1 -- 172.21.15.31:0/101661062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc374166850 con 0x7fc3740b53f0 2024-09-17T05:29:26.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc37c400640 1 -- 172.21.15.31:0/101661062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc374166570 con 0x7fc3740b53f0 2024-09-17T05:29:26.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc37c400640 1 -- 172.21.15.31:0/101661062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3740b5880 con 0x7fc3740b53f0 2024-09-17T05:29:26.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.733+0000 7fc371600640 1 -- 172.21.15.31:0/101661062 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc368010a00 con 0x7fc3740b53f0 2024-09-17T05:29:26.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.737+0000 7fc371600640 1 --2- 172.21.15.31:0/101661062 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc354073200 0x7fc3540756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:26.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.737+0000 7fc371600640 1 -- 172.21.15.31:0/101661062 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fc368094970 con 0x7fc3740b53f0 2024-09-17T05:29:26.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.737+0000 7fc379000640 1 --2- 172.21.15.31:0/101661062 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc354073200 0x7fc3540756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:26.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.737+0000 7fc379000640 1 --2- 172.21.15.31:0/101661062 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc354073200 0x7fc3540756c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc3600af000 tx=0x7fc36001b060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:26.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.741+0000 7fc371600640 1 -- 172.21.15.31:0/101661062 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc36805fd60 con 0x7fc3740b53f0 2024-09-17T05:29:26.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.981+0000 7fc37c400640 1 -- 172.21.15.31:0/101661062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fc37406adb0 con 0x7fc3740b53f0 2024-09-17T05:29:26.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.981+0000 7fc371600640 1 -- 172.21.15.31:0/101661062 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v13) ==== 90+0+0 (secure 0 0 0) 0x7fc36805f660 con 0x7fc3740b53f0 2024-09-17T05:29:26.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.985+0000 7fc37c400640 1 -- 172.21.15.31:0/101661062 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc354073200 msgr2=0x7fc3540756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:26.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.985+0000 7fc37c400640 1 --2- 172.21.15.31:0/101661062 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc354073200 0x7fc3540756c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc3600af000 tx=0x7fc36001b060 comp rx=0 tx=0).stop 2024-09-17T05:29:26.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.985+0000 7fc37c400640 1 -- 172.21.15.31:0/101661062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3740b53f0 msgr2=0x7fc3741574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:26.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.985+0000 7fc37c400640 1 --2- 172.21.15.31:0/101661062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3740b53f0 0x7fc3741574e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc36800e7a0 tx=0x7fc36800ec60 comp rx=0 tx=0).stop 2024-09-17T05:29:26.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.985+0000 7fc37c400640 1 -- 172.21.15.31:0/101661062 shutdown_connections 2024-09-17T05:29:26.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.985+0000 7fc37c400640 1 --2- 172.21.15.31:0/101661062 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc354073200 0x7fc3540756c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.985+0000 7fc37c400640 1 --2- 172.21.15.31:0/101661062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc37415be80 0x7fc3740c5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.985+0000 7fc37c400640 1 --2- 172.21.15.31:0/101661062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3740d28c0 0x7fc374156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.985+0000 7fc37c400640 1 --2- 172.21.15.31:0/101661062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3740b53f0 0x7fc3741574e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:26.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.985+0000 7fc37c400640 1 -- 172.21.15.31:0/101661062 >> 172.21.15.31:0/101661062 conn(0x7fc3740d1da0 msgr2=0x7fc3740b7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:26.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.985+0000 7fc37c400640 1 -- 172.21.15.31:0/101661062 shutdown_connections 2024-09-17T05:29:26.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:26.985+0000 7fc37c400640 1 -- 172.21.15.31:0/101661062 wait complete. 2024-09-17T05:29:27.009 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-17T05:29:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.153+0000 7fd783c00640 1 -- 172.21.15.31:0/1569274904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd77c0cd3c0 msgr2=0x7fd77c0b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.153+0000 7fd783c00640 1 --2- 172.21.15.31:0/1569274904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd77c0cd3c0 0x7fd77c0b42d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd77c069800 tx=0x7fd76801dbf0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.153+0000 7fd783c00640 1 -- 172.21.15.31:0/1569274904 shutdown_connections 2024-09-17T05:29:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.153+0000 7fd783c00640 1 --2- 172.21.15.31:0/1569274904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd77c0cd3c0 0x7fd77c0b42d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.153+0000 7fd783c00640 1 --2- 172.21.15.31:0/1569274904 >> v2:172.21.15.155:3300/0 conn(0x7fd77c15a720 0x7fd77c06e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.153+0000 7fd783c00640 1 -- 172.21.15.31:0/1569274904 >> 172.21.15.31:0/1569274904 conn(0x7fd77c0b18f0 msgr2=0x7fd77c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.153+0000 7fd783c00640 1 -- 172.21.15.31:0/1569274904 shutdown_connections 2024-09-17T05:29:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.153+0000 7fd783c00640 1 -- 172.21.15.31:0/1569274904 wait complete. 2024-09-17T05:29:27.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.153+0000 7fd783c00640 1 Processor -- start 2024-09-17T05:29:27.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.153+0000 7fd783c00640 1 -- start start 2024-09-17T05:29:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd783c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd77c0b4810 0x7fd77c14f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd783c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd77c0cd3c0 0x7fd77c1fbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd783c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd77c15a720 0x7fd77c0ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd783c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c167220 con 0x7fd77c15a720 2024-09-17T05:29:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd783c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c15ee00 con 0x7fd77c0b4810 2024-09-17T05:29:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd783c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd77c1673a0 con 0x7fd77c0cd3c0 2024-09-17T05:29:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd781c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd77c15a720 0x7fd77c0ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd781c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd77c15a720 0x7fd77c0ae330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40226/0 (socket says 172.21.15.31:40226) 2024-09-17T05:29:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd781c00640 1 -- 172.21.15.31:0/2014960703 learned_addr learned my addr 172.21.15.31:0/2014960703 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:27.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd781200640 1 --2- 172.21.15.31:0/2014960703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd77c0b4810 0x7fd77c14f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:27.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd77be00640 1 --2- 172.21.15.31:0/2014960703 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd77c0cd3c0 0x7fd77c1fbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:27.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd781c00640 1 -- 172.21.15.31:0/2014960703 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd77c0cd3c0 msgr2=0x7fd77c1fbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:27.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd781c00640 1 --2- 172.21.15.31:0/2014960703 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd77c0cd3c0 0x7fd77c1fbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd781c00640 1 -- 172.21.15.31:0/2014960703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd77c0b4810 msgr2=0x7fd77c14f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:27.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd781c00640 1 --2- 172.21.15.31:0/2014960703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd77c0b4810 0x7fd77c14f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd781c00640 1 -- 172.21.15.31:0/2014960703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77c09bd00 con 0x7fd77c15a720 2024-09-17T05:29:27.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd781c00640 1 --2- 172.21.15.31:0/2014960703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd77c15a720 0x7fd77c0ae330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd77400c780 tx=0x7fd77400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:27.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd778c00640 1 -- 172.21.15.31:0/2014960703 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd774017070 con 0x7fd77c15a720 2024-09-17T05:29:27.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd778c00640 1 -- 172.21.15.31:0/2014960703 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd774005070 con 0x7fd77c15a720 2024-09-17T05:29:27.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd778c00640 1 -- 172.21.15.31:0/2014960703 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd774005500 con 0x7fd77c15a720 2024-09-17T05:29:27.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd783c00640 1 -- 172.21.15.31:0/2014960703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd77c09ac60 con 0x7fd77c15a720 2024-09-17T05:29:27.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd783c00640 1 -- 172.21.15.31:0/2014960703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd77c09b220 con 0x7fd77c15a720 2024-09-17T05:29:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.157+0000 7fd783c00640 1 -- 172.21.15.31:0/2014960703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd77c069410 con 0x7fd77c15a720 2024-09-17T05:29:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.161+0000 7fd778c00640 1 -- 172.21.15.31:0/2014960703 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd7740056a0 con 0x7fd77c15a720 2024-09-17T05:29:27.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.161+0000 7fd778c00640 1 --2- 172.21.15.31:0/2014960703 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd75c073200 0x7fd75c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:27.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.161+0000 7fd778c00640 1 -- 172.21.15.31:0/2014960703 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fd7740932f0 con 0x7fd77c15a720 2024-09-17T05:29:27.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.161+0000 7fd781200640 1 --2- 172.21.15.31:0/2014960703 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd75c073200 0x7fd75c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:27.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.161+0000 7fd781200640 1 --2- 172.21.15.31:0/2014960703 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd75c073200 0x7fd75c0756c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd77c1638b0 tx=0x7fd77000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:27.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.165+0000 7fd778c00640 1 -- 172.21.15.31:0/2014960703 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd77405e090 con 0x7fd77c15a720 2024-09-17T05:29:27.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.405+0000 7fd783c00640 1 -- 172.21.15.31:0/2014960703 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fd77c0b42d0 con 0x7fd77c15a720 2024-09-17T05:29:27.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.409+0000 7fd778c00640 1 -- 172.21.15.31:0/2014960703 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v14) ==== 97+0+0 (secure 0 0 0) 0x7fd7740930d0 con 0x7fd77c15a720 2024-09-17T05:29:27.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.413+0000 7fd783c00640 1 -- 172.21.15.31:0/2014960703 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd75c073200 msgr2=0x7fd75c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:27.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.413+0000 7fd783c00640 1 --2- 172.21.15.31:0/2014960703 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd75c073200 0x7fd75c0756c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd77c1638b0 tx=0x7fd77000b2e0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.413+0000 7fd783c00640 1 -- 172.21.15.31:0/2014960703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd77c15a720 msgr2=0x7fd77c0ae330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:27.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.413+0000 7fd783c00640 1 --2- 172.21.15.31:0/2014960703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd77c15a720 0x7fd77c0ae330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd77400c780 tx=0x7fd77400cc40 comp rx=0 tx=0).stop 2024-09-17T05:29:27.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.413+0000 7fd783c00640 1 -- 172.21.15.31:0/2014960703 shutdown_connections 2024-09-17T05:29:27.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.413+0000 7fd783c00640 1 --2- 172.21.15.31:0/2014960703 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd75c073200 0x7fd75c0756c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.413+0000 7fd783c00640 1 --2- 172.21.15.31:0/2014960703 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd77c15a720 0x7fd77c0ae330 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.413+0000 7fd783c00640 1 --2- 172.21.15.31:0/2014960703 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd77c0cd3c0 0x7fd77c1fbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.413+0000 7fd783c00640 1 --2- 172.21.15.31:0/2014960703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd77c0b4810 0x7fd77c14f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.413+0000 7fd783c00640 1 -- 172.21.15.31:0/2014960703 >> 172.21.15.31:0/2014960703 conn(0x7fd77c0b18f0 msgr2=0x7fd77c15dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:27.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.413+0000 7fd783c00640 1 -- 172.21.15.31:0/2014960703 shutdown_connections 2024-09-17T05:29:27.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.413+0000 7fd783c00640 1 -- 172.21.15.31:0/2014960703 wait complete. 2024-09-17T05:29:27.435 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-17T05:29:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.577+0000 7ffaeb000640 1 -- 172.21.15.31:0/2032868078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae415bd50 msgr2=0x7ffae40ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.577+0000 7ffaeb000640 1 --2- 172.21.15.31:0/2032868078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae415bd50 0x7ffae40ce5e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffad4009900 tx=0x7ffad401c7c0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.577+0000 7ffaeb000640 1 -- 172.21.15.31:0/2032868078 shutdown_connections 2024-09-17T05:29:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.577+0000 7ffaeb000640 1 --2- 172.21.15.31:0/2032868078 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffae415c130 0x7ffae40ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.577+0000 7ffaeb000640 1 --2- 172.21.15.31:0/2032868078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae415bd50 0x7ffae40ce5e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.577+0000 7ffaeb000640 1 -- 172.21.15.31:0/2032868078 >> 172.21.15.31:0/2032868078 conn(0x7ffae40d1ea0 msgr2=0x7ffae40d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.577+0000 7ffaeb000640 1 -- 172.21.15.31:0/2032868078 shutdown_connections 2024-09-17T05:29:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.577+0000 7ffaeb000640 1 -- 172.21.15.31:0/2032868078 wait complete. 2024-09-17T05:29:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffaeb000640 1 Processor -- start 2024-09-17T05:29:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffaeb000640 1 -- start start 2024-09-17T05:29:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffaeb000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae40cf4e0 0x7ffae40b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffaeb000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffae415bd50 0x7ffae409efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffaeb000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae415c130 0x7ffae409f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffaeb000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ffae4168e50 con 0x7ffae40cf4e0 2024-09-17T05:29:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffaeb000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffae4168cd0 con 0x7ffae415c130 2024-09-17T05:29:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffaeb000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffae4168fd0 con 0x7ffae415bd50 2024-09-17T05:29:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffae3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae40cf4e0 0x7ffae40b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffae3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae40cf4e0 0x7ffae40b66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40242/0 (socket says 172.21.15.31:40242) 2024-09-17T05:29:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffae3e00640 1 -- 172.21.15.31:0/3700346489 learned_addr learned my addr 172.21.15.31:0/3700346489 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffadbe00640 1 --2- 172.21.15.31:0/3700346489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffae415bd50 0x7ffae409efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffae9000640 1 --2- 172.21.15.31:0/3700346489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae415c130 0x7ffae409f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffae3e00640 1 -- 172.21.15.31:0/3700346489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffae415bd50 msgr2=0x7ffae409efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffae3e00640 1 --2- 172.21.15.31:0/3700346489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffae415bd50 0x7ffae409efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffae3e00640 1 -- 172.21.15.31:0/3700346489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae415c130 msgr2=0x7ffae409f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffae3e00640 1 --2- 172.21.15.31:0/3700346489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae415c130 0x7ffae409f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffae3e00640 1 -- 172.21.15.31:0/3700346489 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae40c57b0 con 0x7ffae40cf4e0 2024-09-17T05:29:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffadbe00640 1 --2- 172.21.15.31:0/3700346489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffae415bd50 0x7ffae409efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffae3e00640 1 --2- 172.21.15.31:0/3700346489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae40cf4e0 0x7ffae40b66e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffad4009850 tx=0x7ffad40a5590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffae0c00640 1 -- 172.21.15.31:0/3700346489 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad40b2040 con 0x7ffae40cf4e0 2024-09-17T05:29:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffae0c00640 1 -- 172.21.15.31:0/3700346489 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffad4004380 con 0x7ffae40cf4e0 2024-09-17T05:29:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffae0c00640 1 -- 172.21.15.31:0/3700346489 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad4005290 con 0x7ffae40cf4e0 2024-09-17T05:29:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffaeb000640 1 -- 172.21.15.31:0/3700346489 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffae40b7640 con 0x7ffae40cf4e0 2024-09-17T05:29:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.581+0000 7ffaeb000640 1 -- 172.21.15.31:0/3700346489 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffae40c9010 con 0x7ffae40cf4e0 2024-09-17T05:29:27.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.585+0000 7ffaeb000640 1 -- 172.21.15.31:0/3700346489 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffae40c5dd0 con 0x7ffae40cf4e0 2024-09-17T05:29:27.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.585+0000 7ffae0c00640 1 -- 172.21.15.31:0/3700346489 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ffad4005430 con 0x7ffae40cf4e0 2024-09-17T05:29:27.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.585+0000 7ffae0c00640 1 --2- 172.21.15.31:0/3700346489 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffac0073200 0x7ffac00756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:27.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.585+0000 7ffae0c00640 1 -- 172.21.15.31:0/3700346489 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7ffad412d9c0 con 0x7ffae40cf4e0 2024-09-17T05:29:27.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.585+0000 7ffadbe00640 1 --2- 172.21.15.31:0/3700346489 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffac0073200 0x7ffac00756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:27.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.585+0000 7ffadbe00640 1 --2- 172.21.15.31:0/3700346489 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffac0073200 0x7ffac00756c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffae415b3e0 tx=0x7ffacc0091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:27.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.589+0000 7ffae0c00640 1 -- 172.21.15.31:0/3700346489 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ffae40c57b0 con 0x7ffae40cf4e0 2024-09-17T05:29:27.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.829+0000 7ffaeb000640 1 -- 172.21.15.31:0/3700346489 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7ffae406fd20 con 0x7ffae40cf4e0 2024-09-17T05:29:27.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.829+0000 7ffae0c00640 1 -- 172.21.15.31:0/3700346489 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v15) ==== 90+0+0 (secure 0 0 0) 0x7ffad40164d0 con 0x7ffae40cf4e0 2024-09-17T05:29:27.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.833+0000 7ffaeb000640 1 -- 172.21.15.31:0/3700346489 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffac0073200 msgr2=0x7ffac00756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:27.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.833+0000 7ffaeb000640 1 --2- 172.21.15.31:0/3700346489 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffac0073200 0x7ffac00756c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffae415b3e0 tx=0x7ffacc0091e0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.833+0000 7ffaeb000640 1 -- 172.21.15.31:0/3700346489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae40cf4e0 msgr2=0x7ffae40b66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:27.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.833+0000 7ffaeb000640 1 --2- 172.21.15.31:0/3700346489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae40cf4e0 0x7ffae40b66e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffad4009850 tx=0x7ffad40a5590 comp rx=0 tx=0).stop 2024-09-17T05:29:27.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.833+0000 7ffaeb000640 1 -- 172.21.15.31:0/3700346489 shutdown_connections 2024-09-17T05:29:27.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.833+0000 7ffaeb000640 1 --2- 172.21.15.31:0/3700346489 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffac0073200 0x7ffac00756c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.833+0000 7ffaeb000640 1 --2- 172.21.15.31:0/3700346489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffae415c130 0x7ffae409f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.833+0000 7ffaeb000640 1 --2- 172.21.15.31:0/3700346489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffae415bd50 0x7ffae409efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.833+0000 7ffaeb000640 1 --2- 172.21.15.31:0/3700346489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffae40cf4e0 0x7ffae40b66e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:27.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.833+0000 7ffaeb000640 1 -- 172.21.15.31:0/3700346489 >> 172.21.15.31:0/3700346489 conn(0x7ffae40d1ea0 msgr2=0x7ffae415a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:27.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.833+0000 7ffaeb000640 1 -- 172.21.15.31:0/3700346489 shutdown_connections 2024-09-17T05:29:27.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:27.833+0000 7ffaeb000640 1 -- 172.21.15.31:0/3700346489 wait complete. 2024-09-17T05:29:27.858 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:29:28.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.001+0000 7fdf6a200640 1 -- 172.21.15.31:0/2191601801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf6406cc20 msgr2=0x7fdf640737c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:28.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.001+0000 7fdf6a200640 1 --2- 172.21.15.31:0/2191601801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf6406cc20 0x7fdf640737c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdf640768a0 tx=0x7fdf5401c890 comp rx=0 tx=0).stop 2024-09-17T05:29:28.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.001+0000 7fdf6a200640 1 -- 172.21.15.31:0/2191601801 shutdown_connections 2024-09-17T05:29:28.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.001+0000 7fdf6a200640 1 --2- 172.21.15.31:0/2191601801 >> v2:172.21.15.155:3300/0 conn(0x7fdf6415f7b0 0x7fdf6415fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.001+0000 7fdf6a200640 1 --2- 172.21.15.31:0/2191601801 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf6415c1c0 0x7fdf6406d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.001+0000 7fdf6a200640 1 --2- 172.21.15.31:0/2191601801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf6406cc20 0x7fdf640737c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.001+0000 7fdf6a200640 1 -- 172.21.15.31:0/2191601801 >> 172.21.15.31:0/2191601801 conn(0x7fdf640d0c90 msgr2=0x7fdf640d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:28.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.001+0000 7fdf6a200640 1 -- 172.21.15.31:0/2191601801 shutdown_connections 2024-09-17T05:29:28.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.001+0000 7fdf6a200640 1 -- 172.21.15.31:0/2191601801 wait complete. 2024-09-17T05:29:28.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.001+0000 7fdf6a200640 1 Processor -- start 2024-09-17T05:29:28.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf6a200640 1 -- start start 2024-09-17T05:29:28.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf6a200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf6406cc20 0x7fdf640cef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:28.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf6a200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf6415c1c0 0x7fdf640b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:28.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf6a200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf6415f7b0 0x7fdf641fb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:28.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf6a200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdf640719c0 con 0x7fdf6415f7b0 2024-09-17T05:29:28.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf6a200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdf64071840 con 0x7fdf6415c1c0 2024-09-17T05:29:28.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf6a200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdf64071b40 con 0x7fdf6406cc20 2024-09-17T05:29:28.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf63e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf6415f7b0 0x7fdf641fb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:28.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf63e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf6415f7b0 0x7fdf641fb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40250/0 (socket says 172.21.15.31:40250) 2024-09-17T05:29:28.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf63400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf6406cc20 0x7fdf640cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:28.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf63e00640 1 -- 172.21.15.31:0/3031746278 learned_addr learned my addr 172.21.15.31:0/3031746278 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:28.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf62a00640 1 --2- 172.21.15.31:0/3031746278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf6415c1c0 0x7fdf640b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:28.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf63e00640 1 -- 172.21.15.31:0/3031746278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf6406cc20 msgr2=0x7fdf640cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:28.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf63e00640 1 --2- 172.21.15.31:0/3031746278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf6406cc20 0x7fdf640cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf63e00640 1 -- 172.21.15.31:0/3031746278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf6415c1c0 msgr2=0x7fdf640b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:28.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf63e00640 1 --2- 172.21.15.31:0/3031746278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf6415c1c0 0x7fdf640b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf63e00640 1 -- 172.21.15.31:0/3031746278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf64155e50 con 0x7fdf6415f7b0 2024-09-17T05:29:28.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf63e00640 1 --2- 172.21.15.31:0/3031746278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf6415f7b0 0x7fdf641fb570 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c00b9a0 tx=0x7fdf5c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:28.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf5b400640 1 -- 172.21.15.31:0/3031746278 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c019070 con 0x7fdf6415f7b0 2024-09-17T05:29:28.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf5b400640 1 -- 172.21.15.31:0/3031746278 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf5c00ccb0 con 0x7fdf6415f7b0 2024-09-17T05:29:28.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf5b400640 1 -- 172.21.15.31:0/3031746278 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c0146a0 con 0x7fdf6415f7b0 2024-09-17T05:29:28.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf6a200640 1 -- 172.21.15.31:0/3031746278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf640b24d0 con 0x7fdf6415f7b0 2024-09-17T05:29:28.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf6a200640 1 -- 172.21.15.31:0/3031746278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf640c6260 con 0x7fdf6415f7b0 2024-09-17T05:29:28.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.005+0000 7fdf6a200640 1 -- 172.21.15.31:0/3031746278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf6406d000 con 0x7fdf6415f7b0 2024-09-17T05:29:28.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.009+0000 7fdf5b400640 1 -- 172.21.15.31:0/3031746278 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdf5c01c070 con 0x7fdf6415f7b0 2024-09-17T05:29:28.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.009+0000 7fdf5b400640 1 --2- 172.21.15.31:0/3031746278 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdf44073200 0x7fdf440756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:28.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.009+0000 7fdf5b400640 1 -- 172.21.15.31:0/3031746278 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fdf5c093b30 con 0x7fdf6415f7b0 2024-09-17T05:29:28.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.009+0000 7fdf63400640 1 --2- 172.21.15.31:0/3031746278 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdf44073200 0x7fdf440756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:28.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.009+0000 7fdf63400640 1 --2- 172.21.15.31:0/3031746278 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdf44073200 0x7fdf440756c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdf540af000 tx=0x7fdf5401b0d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:28.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.013+0000 7fdf5b400640 1 -- 172.21.15.31:0/3031746278 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fdf5c05e8d0 con 0x7fdf6415f7b0 2024-09-17T05:29:28.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.189+0000 7fdf6a200640 1 -- 172.21.15.31:0/3031746278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fdf640b6c10 con 0x7fdf6415f7b0 2024-09-17T05:29:28.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.189+0000 7fdf5b400640 1 -- 172.21.15.31:0/3031746278 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) ==== 84+0+65 (secure 0 0 0) 0x7fdf5c063300 con 0x7fdf6415f7b0 2024-09-17T05:29:28.194 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:28.195 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:29:28.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:28.195 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-09-17T05:29:28.195 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-09-17T05:29:28.195 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:28.195 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:29:28.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.193+0000 7fdf6a200640 1 -- 172.21.15.31:0/3031746278 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdf44073200 msgr2=0x7fdf440756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.193+0000 7fdf6a200640 1 --2- 172.21.15.31:0/3031746278 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdf44073200 0x7fdf440756c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdf540af000 tx=0x7fdf5401b0d0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.193+0000 7fdf6a200640 1 -- 172.21.15.31:0/3031746278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf6415f7b0 msgr2=0x7fdf641fb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.193+0000 7fdf6a200640 1 --2- 172.21.15.31:0/3031746278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf6415f7b0 0x7fdf641fb570 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c00b9a0 tx=0x7fdf5c00be60 comp rx=0 tx=0).stop 2024-09-17T05:29:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.193+0000 7fdf6a200640 1 -- 172.21.15.31:0/3031746278 shutdown_connections 2024-09-17T05:29:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.193+0000 7fdf6a200640 1 --2- 172.21.15.31:0/3031746278 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdf44073200 0x7fdf440756c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.193+0000 7fdf6a200640 1 --2- 172.21.15.31:0/3031746278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf6415f7b0 0x7fdf641fb570 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.193+0000 7fdf6a200640 1 --2- 172.21.15.31:0/3031746278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf6415c1c0 0x7fdf640b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.193+0000 7fdf6a200640 1 --2- 172.21.15.31:0/3031746278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf6406cc20 0x7fdf640cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.193+0000 7fdf6a200640 1 -- 172.21.15.31:0/3031746278 >> 172.21.15.31:0/3031746278 conn(0x7fdf640d0c90 msgr2=0x7fdf640c6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.193+0000 7fdf6a200640 1 -- 172.21.15.31:0/3031746278 shutdown_connections 2024-09-17T05:29:28.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.193+0000 7fdf6a200640 1 -- 172.21.15.31:0/3031746278 wait complete. 2024-09-17T05:29:28.216 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:29:28.216 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:29:28.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.361+0000 7f1402400640 1 -- 172.21.15.31:0/1327424728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13fc15e360 msgr2=0x7f13fc0adf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:28.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.361+0000 7f1402400640 1 --2- 172.21.15.31:0/1327424728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13fc15e360 0x7f13fc0adf50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f13ec009840 tx=0x7f13ec01c790 comp rx=0 tx=0).stop 2024-09-17T05:29:28.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.361+0000 7f1402400640 1 -- 172.21.15.31:0/1327424728 shutdown_connections 2024-09-17T05:29:28.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.361+0000 7f1402400640 1 --2- 172.21.15.31:0/1327424728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13fc0aef60 0x7f13fc0ae490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.361+0000 7f1402400640 1 --2- 172.21.15.31:0/1327424728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13fc15e360 0x7f13fc0adf50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.361+0000 7f1402400640 1 -- 172.21.15.31:0/1327424728 >> 172.21.15.31:0/1327424728 conn(0x7f13fc0cfbc0 msgr2=0x7f13fc0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:28.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.361+0000 7f1402400640 1 -- 172.21.15.31:0/1327424728 shutdown_connections 2024-09-17T05:29:28.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.361+0000 7f1402400640 1 -- 172.21.15.31:0/1327424728 wait complete. 2024-09-17T05:29:28.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f1402400640 1 Processor -- start 2024-09-17T05:29:28.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f1402400640 1 -- start start 2024-09-17T05:29:28.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f1402400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13fc0ae9d0 0x7f13fc163fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:28.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f1402400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13fc0aef60 0x7f13fc157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:28.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f1402400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13fc15e360 0x7f13fc149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:28.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f1402400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc167f30 con 0x7f13fc0aef60 2024-09-17T05:29:28.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f1402400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc073fd0 con 0x7f13fc15e360 2024-09-17T05:29:28.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f1402400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f13fc1680b0 con 0x7f13fc0ae9d0 2024-09-17T05:29:28.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f13f3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13fc0aef60 0x7f13fc157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:28.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f13f3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13fc0aef60 0x7f13fc157c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40252/0 (socket says 172.21.15.31:40252) 2024-09-17T05:29:28.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f13f3e00640 1 -- 172.21.15.31:0/2431826514 learned_addr learned my addr 172.21.15.31:0/2431826514 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:28.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f13fb400640 1 --2- 172.21.15.31:0/2431826514 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13fc0ae9d0 0x7f13fc163fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:28.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f13fbe00640 1 --2- 172.21.15.31:0/2431826514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13fc15e360 0x7f13fc149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:28.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f13f3e00640 1 -- 172.21.15.31:0/2431826514 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13fc0ae9d0 msgr2=0x7f13fc163fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:28.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f13f3e00640 1 --2- 172.21.15.31:0/2431826514 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13fc0ae9d0 0x7f13fc163fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f13f3e00640 1 -- 172.21.15.31:0/2431826514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13fc15e360 msgr2=0x7f13fc149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:28.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f13f3e00640 1 --2- 172.21.15.31:0/2431826514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13fc15e360 0x7f13fc149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f13f3e00640 1 -- 172.21.15.31:0/2431826514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13fc09b600 con 0x7f13fc0aef60 2024-09-17T05:29:28.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f13f3e00640 1 --2- 172.21.15.31:0/2431826514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13fc0aef60 0x7f13fc157c40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f13e400e9c0 tx=0x7f13e400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:28.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f13f3400640 1 -- 172.21.15.31:0/2431826514 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e400cd80 con 0x7f13fc0aef60 2024-09-17T05:29:28.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f13f3400640 1 -- 172.21.15.31:0/2431826514 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13e4004020 con 0x7f13fc0aef60 2024-09-17T05:29:28.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f13f3400640 1 -- 172.21.15.31:0/2431826514 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e4004450 con 0x7f13fc0aef60 2024-09-17T05:29:28.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f1402400640 1 -- 172.21.15.31:0/2431826514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13fc09b8e0 con 0x7f13fc0aef60 2024-09-17T05:29:28.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.365+0000 7f1402400640 1 -- 172.21.15.31:0/2431826514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13fc09bbc0 con 0x7f13fc0aef60 2024-09-17T05:29:28.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.369+0000 7f1402400640 1 -- 172.21.15.31:0/2431826514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13fc069410 con 0x7f13fc0aef60 2024-09-17T05:29:28.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.369+0000 7f13f3400640 1 -- 172.21.15.31:0/2431826514 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f13e4003600 con 0x7f13fc0aef60 2024-09-17T05:29:28.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.369+0000 7f13f3400640 1 --2- 172.21.15.31:0/2431826514 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f13d8073200 0x7f13d80756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:28.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.369+0000 7f13f3400640 1 -- 172.21.15.31:0/2431826514 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f13e4094a40 con 0x7f13fc0aef60 2024-09-17T05:29:28.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.369+0000 7f13fb400640 1 --2- 172.21.15.31:0/2431826514 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f13d8073200 0x7f13d80756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:28.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.369+0000 7f13fb400640 1 --2- 172.21.15.31:0/2431826514 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f13d8073200 0x7f13d80756c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f13ec0ae000 tx=0x7f13ec01afd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:28.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.373+0000 7f13f3400640 1 -- 172.21.15.31:0/2431826514 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f13e405fda0 con 0x7f13fc0aef60 2024-09-17T05:29:28.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.549+0000 7f1402400640 1 -- 172.21.15.31:0/2431826514 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f13fc072870 con 0x7f13fc0aef60 2024-09-17T05:29:28.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.989+0000 7f13f3400640 1 -- 172.21.15.31:0/2431826514 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) ==== 138+0+0 (secure 0 0 0) 0x7f13e405f6a0 con 0x7f13fc0aef60 2024-09-17T05:29:28.994 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-09-17T05:29:28.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.993+0000 7f1402400640 1 -- 172.21.15.31:0/2431826514 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f13d8073200 msgr2=0x7f13d80756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:28.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.993+0000 7f1402400640 1 --2- 172.21.15.31:0/2431826514 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f13d8073200 0x7f13d80756c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f13ec0ae000 tx=0x7f13ec01afd0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.993+0000 7f1402400640 1 -- 172.21.15.31:0/2431826514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13fc0aef60 msgr2=0x7f13fc157c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:28.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.993+0000 7f1402400640 1 --2- 172.21.15.31:0/2431826514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13fc0aef60 0x7f13fc157c40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f13e400e9c0 tx=0x7f13e400ee80 comp rx=0 tx=0).stop 2024-09-17T05:29:28.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.993+0000 7f1402400640 1 -- 172.21.15.31:0/2431826514 shutdown_connections 2024-09-17T05:29:28.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.993+0000 7f1402400640 1 --2- 172.21.15.31:0/2431826514 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f13d8073200 0x7f13d80756c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.993+0000 7f1402400640 1 --2- 172.21.15.31:0/2431826514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13fc15e360 0x7f13fc149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.993+0000 7f1402400640 1 --2- 172.21.15.31:0/2431826514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13fc0aef60 0x7f13fc157c40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.993+0000 7f1402400640 1 --2- 172.21.15.31:0/2431826514 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13fc0ae9d0 0x7f13fc163fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:28.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.993+0000 7f1402400640 1 -- 172.21.15.31:0/2431826514 >> 172.21.15.31:0/2431826514 conn(0x7f13fc0cfbc0 msgr2=0x7f13fc09cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:28.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.993+0000 7f1402400640 1 -- 172.21.15.31:0/2431826514 shutdown_connections 2024-09-17T05:29:28.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:28.993+0000 7f1402400640 1 -- 172.21.15.31:0/2431826514 wait complete. 2024-09-17T05:29:29.023 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:29:29.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.173+0000 7f8a04400640 1 -- 172.21.15.31:0/2435714568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89fc1605d0 msgr2=0x7f89fc0d0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:29.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.173+0000 7f8a04400640 1 --2- 172.21.15.31:0/2435714568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89fc1605d0 0x7f89fc0d0690 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009870 tx=0x7f89f001c860 comp rx=0 tx=0).stop 2024-09-17T05:29:29.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.173+0000 7f8a04400640 1 -- 172.21.15.31:0/2435714568 shutdown_connections 2024-09-17T05:29:29.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.173+0000 7f8a04400640 1 --2- 172.21.15.31:0/2435714568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89fc1605d0 0x7f89fc0d0690 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:29.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.173+0000 7f8a04400640 1 -- 172.21.15.31:0/2435714568 >> 172.21.15.31:0/2435714568 conn(0x7f89fc0d1dd0 msgr2=0x7f89fc0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:29.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.173+0000 7f8a04400640 1 -- 172.21.15.31:0/2435714568 shutdown_connections 2024-09-17T05:29:29.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.173+0000 7f8a04400640 1 -- 172.21.15.31:0/2435714568 wait complete. 2024-09-17T05:29:29.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a04400640 1 Processor -- start 2024-09-17T05:29:29.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a04400640 1 -- start start 2024-09-17T05:29:29.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a04400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89fc0afb10 0x7f89fc15ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:29.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a04400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89fc0b1650 0x7f89fc15f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:29.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a04400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89fc1605d0 0x7f89fc15d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:29.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a04400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc0b1220 con 0x7f89fc1605d0 2024-09-17T05:29:29.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a04400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc0b0ee0 con 0x7f89fc0b1650 2024-09-17T05:29:29.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a04400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f89fc0b13a0 con 0x7f89fc0afb10 2024-09-17T05:29:29.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a02400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89fc1605d0 0x7f89fc15d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:29.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a02400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89fc1605d0 0x7f89fc15d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35246/0 (socket says 172.21.15.31:35246) 2024-09-17T05:29:29.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a02400640 1 -- 172.21.15.31:0/2947900096 learned_addr learned my addr 172.21.15.31:0/2947900096 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:29.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a01a00640 1 --2- 172.21.15.31:0/2947900096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89fc0afb10 0x7f89fc15ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:29.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a01000640 1 --2- 172.21.15.31:0/2947900096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89fc0b1650 0x7f89fc15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:29.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a02400640 1 -- 172.21.15.31:0/2947900096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89fc0afb10 msgr2=0x7f89fc15ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:29.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a02400640 1 --2- 172.21.15.31:0/2947900096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89fc0afb10 0x7f89fc15ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:29.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a02400640 1 -- 172.21.15.31:0/2947900096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89fc0b1650 msgr2=0x7f89fc15f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:29.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a02400640 1 --2- 172.21.15.31:0/2947900096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89fc0b1650 0x7f89fc15f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:29.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a02400640 1 -- 172.21.15.31:0/2947900096 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89fc0c9f30 con 0x7f89fc1605d0 2024-09-17T05:29:29.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a02400640 1 --2- 172.21.15.31:0/2947900096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89fc1605d0 0x7f89fc15d6f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f89f400c790 tx=0x7f89f400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:29.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f89f9600640 1 -- 172.21.15.31:0/2947900096 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4003b80 con 0x7f89fc1605d0 2024-09-17T05:29:29.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f89f9600640 1 -- 172.21.15.31:0/2947900096 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89f4003d20 con 0x7f89fc1605d0 2024-09-17T05:29:29.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a04400640 1 -- 172.21.15.31:0/2947900096 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89fc0ca210 con 0x7f89fc1605d0 2024-09-17T05:29:29.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f89f9600640 1 -- 172.21.15.31:0/2947900096 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f400aab0 con 0x7f89fc1605d0 2024-09-17T05:29:29.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.177+0000 7f8a04400640 1 -- 172.21.15.31:0/2947900096 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89fc15f860 con 0x7f89fc1605d0 2024-09-17T05:29:29.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.181+0000 7f8a04400640 1 -- 172.21.15.31:0/2947900096 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89fc0d0690 con 0x7f89fc1605d0 2024-09-17T05:29:29.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.181+0000 7f89f9600640 1 -- 172.21.15.31:0/2947900096 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f89f400ac50 con 0x7f89fc1605d0 2024-09-17T05:29:29.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.181+0000 7f89f9600640 1 --2- 172.21.15.31:0/2947900096 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f89dc073200 0x7f89dc0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:29.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.185+0000 7f89f9600640 1 -- 172.21.15.31:0/2947900096 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5227+0+0 (secure 0 0 0) 0x7f89f4094830 con 0x7f89fc1605d0 2024-09-17T05:29:29.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.185+0000 7f8a01a00640 1 --2- 172.21.15.31:0/2947900096 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f89dc073200 0x7f89dc0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:29.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.185+0000 7f8a01a00640 1 --2- 172.21.15.31:0/2947900096 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f89dc073200 0x7f89dc0756c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f89f00af000 tx=0x7f89f001b0a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:29.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.185+0000 7f89f9600640 1 -- 172.21.15.31:0/2947900096 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f89f405f4e0 con 0x7f89fc1605d0 2024-09-17T05:29:29.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.361+0000 7f8a04400640 1 -- 172.21.15.31:0/2947900096 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f89fc071b20 con 0x7f89fc1605d0 2024-09-17T05:29:30.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:29.997+0000 7f89f9600640 1 -- 172.21.15.31:0/2947900096 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) ==== 170+0+0 (secure 0 0 0) 0x7f89f4063f10 con 0x7f89fc1605d0 2024-09-17T05:29:30.003 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-09-17T05:29:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.001+0000 7f8a04400640 1 -- 172.21.15.31:0/2947900096 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f89dc073200 msgr2=0x7f89dc0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.001+0000 7f8a04400640 1 --2- 172.21.15.31:0/2947900096 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f89dc073200 0x7f89dc0756c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f89f00af000 tx=0x7f89f001b0a0 comp rx=0 tx=0).stop 2024-09-17T05:29:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.001+0000 7f8a04400640 1 -- 172.21.15.31:0/2947900096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89fc1605d0 msgr2=0x7f89fc15d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.001+0000 7f8a04400640 1 --2- 172.21.15.31:0/2947900096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89fc1605d0 0x7f89fc15d6f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f89f400c790 tx=0x7f89f400cc50 comp rx=0 tx=0).stop 2024-09-17T05:29:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.001+0000 7f8a04400640 1 -- 172.21.15.31:0/2947900096 shutdown_connections 2024-09-17T05:29:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.001+0000 7f8a04400640 1 --2- 172.21.15.31:0/2947900096 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f89dc073200 0x7f89dc0756c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.001+0000 7f8a04400640 1 --2- 172.21.15.31:0/2947900096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89fc1605d0 0x7f89fc15d6f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.001+0000 7f8a04400640 1 --2- 172.21.15.31:0/2947900096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89fc0b1650 0x7f89fc15f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.001+0000 7f8a04400640 1 --2- 172.21.15.31:0/2947900096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89fc0afb10 0x7f89fc15ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.001+0000 7f8a04400640 1 -- 172.21.15.31:0/2947900096 >> 172.21.15.31:0/2947900096 conn(0x7f89fc0d1dd0 msgr2=0x7f89fc0b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.001+0000 7f8a04400640 1 -- 172.21.15.31:0/2947900096 shutdown_connections 2024-09-17T05:29:30.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.001+0000 7f8a04400640 1 -- 172.21.15.31:0/2947900096 wait complete. 2024-09-17T05:29:30.042 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:29:30.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.189+0000 7f6282400640 1 -- 172.21.15.31:0/3142108134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f627c0745a0 msgr2=0x7f627c06cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:30.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.189+0000 7f6282400640 1 --2- 172.21.15.31:0/3142108134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f627c0745a0 0x7f627c06cc20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6274009c80 tx=0x7f627401cd70 comp rx=0 tx=0).stop 2024-09-17T05:29:30.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.189+0000 7f6282400640 1 -- 172.21.15.31:0/3142108134 shutdown_connections 2024-09-17T05:29:30.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.189+0000 7f6282400640 1 --2- 172.21.15.31:0/3142108134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f627c0745a0 0x7f627c06cc20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:30.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.189+0000 7f6282400640 1 --2- 172.21.15.31:0/3142108134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f627c06fff0 0x7f627c074060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:30.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.189+0000 7f6282400640 1 -- 172.21.15.31:0/3142108134 >> 172.21.15.31:0/3142108134 conn(0x7f627c0d0cd0 msgr2=0x7f627c0d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:30.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.189+0000 7f6282400640 1 -- 172.21.15.31:0/3142108134 shutdown_connections 2024-09-17T05:29:30.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.189+0000 7f6282400640 1 -- 172.21.15.31:0/3142108134 wait complete. 2024-09-17T05:29:30.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.189+0000 7f6282400640 1 Processor -- start 2024-09-17T05:29:30.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.189+0000 7f6282400640 1 -- start start 2024-09-17T05:29:30.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f6282400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f627c06fff0 0x7f627c1571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:30.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f6282400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f627c0b6350 0x7f627c15a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:30.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f6282400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f627c0cfb20 0x7f627c0cff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:30.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f6282400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f627c169520 con 0x7f627c06fff0 2024-09-17T05:29:30.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f6282400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f627c1693a0 con 0x7f627c0cfb20 2024-09-17T05:29:30.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f6282400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f627c1696a0 con 0x7f627c0b6350 2024-09-17T05:29:30.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f627b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f627c06fff0 0x7f627c1571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:30.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f627b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f627c06fff0 0x7f627c1571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35260/0 (socket says 172.21.15.31:35260) 2024-09-17T05:29:30.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f627b400640 1 -- 172.21.15.31:0/4070428071 learned_addr learned my addr 172.21.15.31:0/4070428071 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:30.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f6273e00640 1 --2- 172.21.15.31:0/4070428071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f627c0b6350 0x7f627c15a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:30.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f627be00640 1 --2- 172.21.15.31:0/4070428071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f627c0cfb20 0x7f627c0cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:30.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f627b400640 1 -- 172.21.15.31:0/4070428071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f627c0b6350 msgr2=0x7f627c15a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:30.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f627b400640 1 --2- 172.21.15.31:0/4070428071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f627c0b6350 0x7f627c15a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:30.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f627b400640 1 -- 172.21.15.31:0/4070428071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f627c0cfb20 msgr2=0x7f627c0cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:30.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f627b400640 1 --2- 172.21.15.31:0/4070428071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f627c0cfb20 0x7f627c0cff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:30.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f627b400640 1 -- 172.21.15.31:0/4070428071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f627c1fb730 con 0x7f627c06fff0 2024-09-17T05:29:30.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f627b400640 1 --2- 172.21.15.31:0/4070428071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f627c06fff0 0x7f627c1571c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f626c00c3c0 tx=0x7f626c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:30.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f6273400640 1 -- 172.21.15.31:0/4070428071 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c0052d0 con 0x7f627c06fff0 2024-09-17T05:29:30.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f6273400640 1 -- 172.21.15.31:0/4070428071 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f626c007020 con 0x7f627c06fff0 2024-09-17T05:29:30.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f6273400640 1 -- 172.21.15.31:0/4070428071 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c007470 con 0x7f627c06fff0 2024-09-17T05:29:30.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f6282400640 1 -- 172.21.15.31:0/4070428071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f627c1fba10 con 0x7f627c06fff0 2024-09-17T05:29:30.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f6282400640 1 -- 172.21.15.31:0/4070428071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f627c157700 con 0x7f627c06fff0 2024-09-17T05:29:30.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.193+0000 7f6282400640 1 -- 172.21.15.31:0/4070428071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f627c074060 con 0x7f627c06fff0 2024-09-17T05:29:30.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.197+0000 7f6273400640 1 -- 172.21.15.31:0/4070428071 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f626c0067e0 con 0x7f627c06fff0 2024-09-17T05:29:30.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.197+0000 7f6273400640 1 --2- 172.21.15.31:0/4070428071 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6258073200 0x7f62580756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:30.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.197+0000 7f6273400640 1 -- 172.21.15.31:0/4070428071 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5609+0+0 (secure 0 0 0) 0x7f626c093550 con 0x7f627c06fff0 2024-09-17T05:29:30.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.197+0000 7f6273e00640 1 --2- 172.21.15.31:0/4070428071 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6258073200 0x7f62580756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:30.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.197+0000 7f6273e00640 1 --2- 172.21.15.31:0/4070428071 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6258073200 0x7f62580756c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f627c0b5f70 tx=0x7f626400b410 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:30.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.201+0000 7f6273400640 1 -- 172.21.15.31:0/4070428071 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f626c001090 con 0x7f627c06fff0 2024-09-17T05:29:30.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:30.413+0000 7f6282400640 1 -- 172.21.15.31:0/4070428071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f627c0d1b00 con 0x7f627c06fff0 2024-09-17T05:29:31.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.001+0000 7f6273400640 1 -- 172.21.15.31:0/4070428071 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7f626c05e000 con 0x7f627c06fff0 2024-09-17T05:29:31.005 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 4 and data pool 5 2024-09-17T05:29:31.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.005+0000 7f6282400640 1 -- 172.21.15.31:0/4070428071 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6258073200 msgr2=0x7f62580756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:31.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.005+0000 7f6282400640 1 --2- 172.21.15.31:0/4070428071 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6258073200 0x7f62580756c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f627c0b5f70 tx=0x7f626400b410 comp rx=0 tx=0).stop 2024-09-17T05:29:31.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.005+0000 7f6282400640 1 -- 172.21.15.31:0/4070428071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f627c06fff0 msgr2=0x7f627c1571c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:31.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.005+0000 7f6282400640 1 --2- 172.21.15.31:0/4070428071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f627c06fff0 0x7f627c1571c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f626c00c3c0 tx=0x7f626c00c880 comp rx=0 tx=0).stop 2024-09-17T05:29:31.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.005+0000 7f6282400640 1 -- 172.21.15.31:0/4070428071 shutdown_connections 2024-09-17T05:29:31.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.005+0000 7f6282400640 1 --2- 172.21.15.31:0/4070428071 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6258073200 0x7f62580756c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.005+0000 7f6282400640 1 --2- 172.21.15.31:0/4070428071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f627c0cfb20 0x7f627c0cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.005+0000 7f6282400640 1 --2- 172.21.15.31:0/4070428071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f627c0b6350 0x7f627c15a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.005+0000 7f6282400640 1 --2- 172.21.15.31:0/4070428071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f627c06fff0 0x7f627c1571c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.005+0000 7f6282400640 1 -- 172.21.15.31:0/4070428071 >> 172.21.15.31:0/4070428071 conn(0x7f627c0d0cd0 msgr2=0x7f627c0cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:31.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.005+0000 7f6282400640 1 -- 172.21.15.31:0/4070428071 shutdown_connections 2024-09-17T05:29:31.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.005+0000 7f6282400640 1 -- 172.21.15.31:0/4070428071 wait complete. 2024-09-17T05:29:31.058 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:29:31.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.201+0000 7f3015e00640 1 -- 172.21.15.31:0/2330885062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301015bea0 msgr2=0x7f30100ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:31.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.201+0000 7f3015e00640 1 --2- 172.21.15.31:0/2330885062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301015bea0 0x7f30100ce670 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f30100745d0 tx=0x7f300001c8e0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.201+0000 7f3015e00640 1 -- 172.21.15.31:0/2330885062 shutdown_connections 2024-09-17T05:29:31.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.201+0000 7f3015e00640 1 --2- 172.21.15.31:0/2330885062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30100d28e0 0x7f30100cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.201+0000 7f3015e00640 1 --2- 172.21.15.31:0/2330885062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301015bea0 0x7f30100ce670 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.201+0000 7f3015e00640 1 -- 172.21.15.31:0/2330885062 >> 172.21.15.31:0/2330885062 conn(0x7f30100d1dc0 msgr2=0x7f30100d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:31.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.201+0000 7f3015e00640 1 -- 172.21.15.31:0/2330885062 shutdown_connections 2024-09-17T05:29:31.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.201+0000 7f3015e00640 1 -- 172.21.15.31:0/2330885062 wait complete. 2024-09-17T05:29:31.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f3015e00640 1 Processor -- start 2024-09-17T05:29:31.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f3015e00640 1 -- start start 2024-09-17T05:29:31.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f3015e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30100cdb30 0x7f30101f96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:31.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f3015e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30100d28e0 0x7f30100cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:31.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f3015e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301015bea0 0x7f30100cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:31.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f3015e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3010169050 con 0x7f301015bea0 2024-09-17T05:29:31.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f3015e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3010168ed0 con 0x7f30100cdb30 2024-09-17T05:29:31.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f3015e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f30101691d0 con 0x7f30100d28e0 2024-09-17T05:29:31.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f300f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301015bea0 0x7f30100cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:31.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f300f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301015bea0 0x7f30100cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35270/0 (socket says 172.21.15.31:35270) 2024-09-17T05:29:31.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f300f400640 1 -- 172.21.15.31:0/1633997462 learned_addr learned my addr 172.21.15.31:0/1633997462 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:31.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f300ea00640 1 --2- 172.21.15.31:0/1633997462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30100cdb30 0x7f30101f96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:31.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f3007e00640 1 --2- 172.21.15.31:0/1633997462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30100d28e0 0x7f30100cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:31.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f300f400640 1 -- 172.21.15.31:0/1633997462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30100d28e0 msgr2=0x7f30100cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:31.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f300f400640 1 --2- 172.21.15.31:0/1633997462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30100d28e0 0x7f30100cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f300f400640 1 -- 172.21.15.31:0/1633997462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30100cdb30 msgr2=0x7f30101f96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:31.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f300f400640 1 --2- 172.21.15.31:0/1633997462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30100cdb30 0x7f30101f96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f300f400640 1 -- 172.21.15.31:0/1633997462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30101552a0 con 0x7f301015bea0 2024-09-17T05:29:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f300ea00640 1 --2- 172.21.15.31:0/1633997462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30100cdb30 0x7f30101f96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:29:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f300f400640 1 --2- 172.21.15.31:0/1633997462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301015bea0 0x7f30100cba20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f300800b970 tx=0x7f300800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f3007400640 1 -- 172.21.15.31:0/1633997462 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3008019070 con 0x7f301015bea0 2024-09-17T05:29:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f3007400640 1 -- 172.21.15.31:0/1633997462 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f300800cc50 con 0x7f301015bea0 2024-09-17T05:29:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f3015e00640 1 -- 172.21.15.31:0/1633997462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30101433c0 con 0x7f301015bea0 2024-09-17T05:29:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f3007400640 1 -- 172.21.15.31:0/1633997462 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30080146a0 con 0x7f301015bea0 2024-09-17T05:29:31.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.205+0000 7f3015e00640 1 -- 172.21.15.31:0/1633997462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3010143980 con 0x7f301015bea0 2024-09-17T05:29:31.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.209+0000 7f3015e00640 1 -- 172.21.15.31:0/1633997462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30100cc9d0 con 0x7f301015bea0 2024-09-17T05:29:31.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.209+0000 7f3007400640 1 -- 172.21.15.31:0/1633997462 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f300801c070 con 0x7f301015bea0 2024-09-17T05:29:31.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.209+0000 7f3007400640 1 --2- 172.21.15.31:0/1633997462 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2fec073200 0x7f2fec0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:31.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.209+0000 7f3007400640 1 -- 172.21.15.31:0/1633997462 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f3008093e40 con 0x7f301015bea0 2024-09-17T05:29:31.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.209+0000 7f300ea00640 1 --2- 172.21.15.31:0/1633997462 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2fec073200 0x7f2fec0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:31.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.209+0000 7f300ea00640 1 --2- 172.21.15.31:0/1633997462 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2fec073200 0x7f2fec0756c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f30000af000 tx=0x7f300001b120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:31.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.213+0000 7f3007400640 1 -- 172.21.15.31:0/1633997462 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f300805e890 con 0x7f301015bea0 2024-09-17T05:29:31.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.389+0000 7f3015e00640 1 -- 172.21.15.31:0/1633997462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30100b7600 con 0x7f301015bea0 2024-09-17T05:29:31.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.393+0000 7f3007400640 1 -- 172.21.15.31:0/1633997462 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16766 (secure 0 0 0) 0x7f30080632c0 con 0x7f301015bea0 2024-09-17T05:29:31.397 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:31.397 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":31,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:29:30.419139+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:29:28.563579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:29:29.374194+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:29:31.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.393+0000 7f3015e00640 1 -- 172.21.15.31:0/1633997462 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2fec073200 msgr2=0x7f2fec0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:31.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.393+0000 7f3015e00640 1 --2- 172.21.15.31:0/1633997462 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2fec073200 0x7f2fec0756c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f30000af000 tx=0x7f300001b120 comp rx=0 tx=0).stop 2024-09-17T05:29:31.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.393+0000 7f3015e00640 1 -- 172.21.15.31:0/1633997462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301015bea0 msgr2=0x7f30100cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:31.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.393+0000 7f3015e00640 1 --2- 172.21.15.31:0/1633997462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301015bea0 0x7f30100cba20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f300800b970 tx=0x7f300800be30 comp rx=0 tx=0).stop 2024-09-17T05:29:31.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.393+0000 7f3015e00640 1 -- 172.21.15.31:0/1633997462 shutdown_connections 2024-09-17T05:29:31.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.393+0000 7f3015e00640 1 --2- 172.21.15.31:0/1633997462 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2fec073200 0x7f2fec0756c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.393+0000 7f3015e00640 1 --2- 172.21.15.31:0/1633997462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301015bea0 0x7f30100cba20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.393+0000 7f3015e00640 1 --2- 172.21.15.31:0/1633997462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30100d28e0 0x7f30100cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.393+0000 7f3015e00640 1 --2- 172.21.15.31:0/1633997462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30100cdb30 0x7f30101f96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.393+0000 7f3015e00640 1 -- 172.21.15.31:0/1633997462 >> 172.21.15.31:0/1633997462 conn(0x7f30100d1dc0 msgr2=0x7f30100cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:31.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.393+0000 7f3015e00640 1 -- 172.21.15.31:0/1633997462 shutdown_connections 2024-09-17T05:29:31.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.393+0000 7f3015e00640 1 -- 172.21.15.31:0/1633997462 wait complete. 2024-09-17T05:29:31.418 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:29:31.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.561+0000 7ff62ce00640 1 -- 172.21.15.31:0/1506204594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6280b2ca0 msgr2=0x7ff6280cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:31.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.561+0000 7ff62ce00640 1 --2- 172.21.15.31:0/1506204594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6280b2ca0 0x7ff6280cefb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff620009bc0 tx=0x7ff62001cb10 comp rx=0 tx=0).stop 2024-09-17T05:29:31.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.561+0000 7ff62ce00640 1 -- 172.21.15.31:0/1506204594 shutdown_connections 2024-09-17T05:29:31.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.561+0000 7ff62ce00640 1 --2- 172.21.15.31:0/1506204594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6280b2ca0 0x7ff6280cefb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.561+0000 7ff62ce00640 1 -- 172.21.15.31:0/1506204594 >> 172.21.15.31:0/1506204594 conn(0x7ff62809aa10 msgr2=0x7ff62809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:31.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.561+0000 7ff62ce00640 1 -- 172.21.15.31:0/1506204594 shutdown_connections 2024-09-17T05:29:31.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.561+0000 7ff62ce00640 1 -- 172.21.15.31:0/1506204594 wait complete. 2024-09-17T05:29:31.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.561+0000 7ff62ce00640 1 Processor -- start 2024-09-17T05:29:31.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.561+0000 7ff62ce00640 1 -- start start 2024-09-17T05:29:31.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.561+0000 7ff62ce00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6280b2ca0 0x7ff628150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:31.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.561+0000 7ff62ce00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6280d01b0 0x7ff628156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:31.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.561+0000 7ff62ce00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff62815f000 0x7ff6281552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:31.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.561+0000 7ff62ce00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff62816a0f0 con 0x7ff6280b2ca0 2024-09-17T05:29:31.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.561+0000 7ff62ce00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff628169f70 con 0x7ff6280d01b0 2024-09-17T05:29:31.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.561+0000 7ff62ce00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff62816a270 con 0x7ff62815f000 2024-09-17T05:29:31.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.561+0000 7ff627400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6280b2ca0 0x7ff628150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:31.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.565+0000 7ff627400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6280b2ca0 0x7ff628150530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35296/0 (socket says 172.21.15.31:35296) 2024-09-17T05:29:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.565+0000 7ff627400640 1 -- 172.21.15.31:0/2067027539 learned_addr learned my addr 172.21.15.31:0/2067027539 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.565+0000 7ff627e00640 1 --2- 172.21.15.31:0/2067027539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff62815f000 0x7ff6281552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.565+0000 7ff61fe00640 1 --2- 172.21.15.31:0/2067027539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6280d01b0 0x7ff628156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.565+0000 7ff627400640 1 -- 172.21.15.31:0/2067027539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff62815f000 msgr2=0x7ff6281552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.565+0000 7ff627400640 1 --2- 172.21.15.31:0/2067027539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff62815f000 0x7ff6281552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.565+0000 7ff627400640 1 -- 172.21.15.31:0/2067027539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6280d01b0 msgr2=0x7ff628156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.565+0000 7ff627400640 1 --2- 172.21.15.31:0/2067027539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6280d01b0 0x7ff628156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.565+0000 7ff627400640 1 -- 172.21.15.31:0/2067027539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff62814f490 con 0x7ff6280b2ca0 2024-09-17T05:29:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.565+0000 7ff627400640 1 --2- 172.21.15.31:0/2067027539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6280b2ca0 0x7ff628150530 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff61800c3f0 tx=0x7ff61800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:31.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.565+0000 7ff61f400640 1 -- 172.21.15.31:0/2067027539 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff618017070 con 0x7ff6280b2ca0 2024-09-17T05:29:31.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.565+0000 7ff61f400640 1 -- 172.21.15.31:0/2067027539 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6180053c0 con 0x7ff6280b2ca0 2024-09-17T05:29:31.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.565+0000 7ff61f400640 1 -- 172.21.15.31:0/2067027539 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff618003860 con 0x7ff6280b2ca0 2024-09-17T05:29:31.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.565+0000 7ff62ce00640 1 -- 172.21.15.31:0/2067027539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff62814f770 con 0x7ff6280b2ca0 2024-09-17T05:29:31.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.565+0000 7ff62ce00640 1 -- 172.21.15.31:0/2067027539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff62814fd30 con 0x7ff6280b2ca0 2024-09-17T05:29:31.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.565+0000 7ff62ce00640 1 -- 172.21.15.31:0/2067027539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff628156cb0 con 0x7ff6280b2ca0 2024-09-17T05:29:31.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.565+0000 7ff61f400640 1 -- 172.21.15.31:0/2067027539 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7ff61801a070 con 0x7ff6280b2ca0 2024-09-17T05:29:31.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.569+0000 7ff61f400640 1 --2- 172.21.15.31:0/2067027539 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff604073200 0x7ff6040756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:31.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.569+0000 7ff61f400640 1 -- 172.21.15.31:0/2067027539 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7ff618093410 con 0x7ff6280b2ca0 2024-09-17T05:29:31.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.569+0000 7ff61fe00640 1 --2- 172.21.15.31:0/2067027539 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff604073200 0x7ff6040756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:31.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.569+0000 7ff61fe00640 1 --2- 172.21.15.31:0/2067027539 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff604073200 0x7ff6040756c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff6100046c0 tx=0x7ff610007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:31.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.573+0000 7ff61f400640 1 -- 172.21.15.31:0/2067027539 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff61805dee0 con 0x7ff6280b2ca0 2024-09-17T05:29:31.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.749+0000 7ff62ce00640 1 -- 172.21.15.31:0/2067027539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6280cefb0 con 0x7ff6280b2ca0 2024-09-17T05:29:31.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.749+0000 7ff61f400640 1 -- 172.21.15.31:0/2067027539 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16766 (secure 0 0 0) 0x7ff618062910 con 0x7ff6280b2ca0 2024-09-17T05:29:31.754 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:31.754 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":31,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:29:30.419139+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:29:28.563579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:29:29.374194+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:29:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.753+0000 7ff62ce00640 1 -- 172.21.15.31:0/2067027539 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff604073200 msgr2=0x7ff6040756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.753+0000 7ff62ce00640 1 --2- 172.21.15.31:0/2067027539 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff604073200 0x7ff6040756c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff6100046c0 tx=0x7ff610007ea0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.753+0000 7ff62ce00640 1 -- 172.21.15.31:0/2067027539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6280b2ca0 msgr2=0x7ff628150530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.753+0000 7ff62ce00640 1 --2- 172.21.15.31:0/2067027539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6280b2ca0 0x7ff628150530 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff61800c3f0 tx=0x7ff61800c8b0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.753+0000 7ff62ce00640 1 -- 172.21.15.31:0/2067027539 shutdown_connections 2024-09-17T05:29:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.753+0000 7ff62ce00640 1 --2- 172.21.15.31:0/2067027539 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff604073200 0x7ff6040756c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.753+0000 7ff62ce00640 1 --2- 172.21.15.31:0/2067027539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff62815f000 0x7ff6281552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.753+0000 7ff62ce00640 1 --2- 172.21.15.31:0/2067027539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6280d01b0 0x7ff628156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.753+0000 7ff62ce00640 1 --2- 172.21.15.31:0/2067027539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6280b2ca0 0x7ff628150530 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.753+0000 7ff62ce00640 1 -- 172.21.15.31:0/2067027539 >> 172.21.15.31:0/2067027539 conn(0x7ff62809aa10 msgr2=0x7ff628075940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.753+0000 7ff62ce00640 1 -- 172.21.15.31:0/2067027539 shutdown_connections 2024-09-17T05:29:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.753+0000 7ff62ce00640 1 -- 172.21.15.31:0/2067027539 wait complete. 2024-09-17T05:29:31.777 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:29:31.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.921+0000 7fc1a4000640 1 -- 172.21.15.31:0/4123787758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc19c15f340 msgr2=0x7fc19c0b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:31.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.921+0000 7fc1a4000640 1 --2- 172.21.15.31:0/4123787758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc19c15f340 0x7fc19c0b34a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc190009900 tx=0x7fc19001c6d0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.921+0000 7fc1a4000640 1 -- 172.21.15.31:0/4123787758 shutdown_connections 2024-09-17T05:29:31.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.921+0000 7fc1a4000640 1 --2- 172.21.15.31:0/4123787758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc19c0b2a00 0x7fc19c0b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.921+0000 7fc1a4000640 1 --2- 172.21.15.31:0/4123787758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc19c15f340 0x7fc19c0b34a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.921+0000 7fc1a4000640 1 -- 172.21.15.31:0/4123787758 >> 172.21.15.31:0/4123787758 conn(0x7fc19c0d1e00 msgr2=0x7fc19c0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:31.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.921+0000 7fc1a4000640 1 -- 172.21.15.31:0/4123787758 shutdown_connections 2024-09-17T05:29:31.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a4000640 1 -- 172.21.15.31:0/4123787758 wait complete. 2024-09-17T05:29:31.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a4000640 1 Processor -- start 2024-09-17T05:29:31.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a4000640 1 -- start start 2024-09-17T05:29:31.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a4000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc19c0b2a00 0x7fc19c163ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:31.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a4000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc19c0ccf10 0x7fc19c154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:31.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a4000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc19c15f340 0x7fc19c0af970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:31.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a4000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c169080 con 0x7fc19c15f340 2024-09-17T05:29:31.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a4000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c168f00 con 0x7fc19c0b2a00 2024-09-17T05:29:31.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a4000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc19c169200 con 0x7fc19c0ccf10 2024-09-17T05:29:31.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a2000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc19c15f340 0x7fc19c0af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:31.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a2000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc19c15f340 0x7fc19c0af970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35308/0 (socket says 172.21.15.31:35308) 2024-09-17T05:29:31.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a2000640 1 -- 172.21.15.31:0/2750298944 learned_addr learned my addr 172.21.15.31:0/2750298944 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:31.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a1600640 1 --2- 172.21.15.31:0/2750298944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc19c0b2a00 0x7fc19c163ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:31.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a0c00640 1 --2- 172.21.15.31:0/2750298944 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc19c0ccf10 0x7fc19c154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:31.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a2000640 1 -- 172.21.15.31:0/2750298944 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc19c0ccf10 msgr2=0x7fc19c154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:31.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a2000640 1 --2- 172.21.15.31:0/2750298944 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc19c0ccf10 0x7fc19c154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a2000640 1 -- 172.21.15.31:0/2750298944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc19c0b2a00 msgr2=0x7fc19c163ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:31.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a2000640 1 --2- 172.21.15.31:0/2750298944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc19c0b2a00 0x7fc19c163ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:31.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a2000640 1 -- 172.21.15.31:0/2750298944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19c0affc0 con 0x7fc19c15f340 2024-09-17T05:29:31.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc1a2000640 1 --2- 172.21.15.31:0/2750298944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc19c15f340 0x7fc19c0af970 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc19400c780 tx=0x7fc19400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:31.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.925+0000 7fc199600640 1 -- 172.21.15.31:0/2750298944 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194004b70 con 0x7fc19c15f340 2024-09-17T05:29:31.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.929+0000 7fc199600640 1 -- 172.21.15.31:0/2750298944 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc194004e00 con 0x7fc19c15f340 2024-09-17T05:29:31.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.929+0000 7fc199600640 1 -- 172.21.15.31:0/2750298944 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19400aa90 con 0x7fc19c15f340 2024-09-17T05:29:31.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.929+0000 7fc1a4000640 1 -- 172.21.15.31:0/2750298944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19c0b02a0 con 0x7fc19c15f340 2024-09-17T05:29:31.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.929+0000 7fc1a4000640 1 -- 172.21.15.31:0/2750298944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc19c159110 con 0x7fc19c15f340 2024-09-17T05:29:31.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.929+0000 7fc1a4000640 1 -- 172.21.15.31:0/2750298944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc19c0cd3a0 con 0x7fc19c15f340 2024-09-17T05:29:31.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.929+0000 7fc199600640 1 -- 172.21.15.31:0/2750298944 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc19400ac30 con 0x7fc19c15f340 2024-09-17T05:29:31.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.929+0000 7fc199600640 1 --2- 172.21.15.31:0/2750298944 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc17c073230 0x7fc17c0756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:31.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.929+0000 7fc199600640 1 -- 172.21.15.31:0/2750298944 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc194094330 con 0x7fc19c15f340 2024-09-17T05:29:31.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.929+0000 7fc1a1600640 1 --2- 172.21.15.31:0/2750298944 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc17c073230 0x7fc17c0756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:31.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.933+0000 7fc1a1600640 1 --2- 172.21.15.31:0/2750298944 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc17c073230 0x7fc17c0756f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc1900ae000 tx=0x7fc19001af10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:31.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:31.933+0000 7fc199600640 1 -- 172.21.15.31:0/2750298944 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc194020070 con 0x7fc19c15f340 2024-09-17T05:29:32.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:32.149+0000 7fc1a4000640 1 -- 172.21.15.31:0/2750298944 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc19c0b7a60 con 0x7fc19c15f340 2024-09-17T05:29:33.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.041+0000 7fc199600640 1 -- 172.21.15.31:0/2750298944 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7fc19405ed80 con 0x7fc19c15f340 2024-09-17T05:29:33.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.041+0000 7fc1a4000640 1 -- 172.21.15.31:0/2750298944 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc17c073230 msgr2=0x7fc17c0756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:33.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.041+0000 7fc1a4000640 1 --2- 172.21.15.31:0/2750298944 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc17c073230 0x7fc17c0756f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc1900ae000 tx=0x7fc19001af10 comp rx=0 tx=0).stop 2024-09-17T05:29:33.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.041+0000 7fc1a4000640 1 -- 172.21.15.31:0/2750298944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc19c15f340 msgr2=0x7fc19c0af970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:33.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.041+0000 7fc1a4000640 1 --2- 172.21.15.31:0/2750298944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc19c15f340 0x7fc19c0af970 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc19400c780 tx=0x7fc19400cc40 comp rx=0 tx=0).stop 2024-09-17T05:29:33.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.041+0000 7fc1a4000640 1 -- 172.21.15.31:0/2750298944 shutdown_connections 2024-09-17T05:29:33.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.041+0000 7fc1a4000640 1 --2- 172.21.15.31:0/2750298944 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc17c073230 0x7fc17c0756f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:33.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.041+0000 7fc1a4000640 1 --2- 172.21.15.31:0/2750298944 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc19c15f340 0x7fc19c0af970 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:33.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.041+0000 7fc1a4000640 1 --2- 172.21.15.31:0/2750298944 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc19c0ccf10 0x7fc19c154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:33.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.041+0000 7fc1a4000640 1 --2- 172.21.15.31:0/2750298944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc19c0b2a00 0x7fc19c163ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:33.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.041+0000 7fc1a4000640 1 -- 172.21.15.31:0/2750298944 >> 172.21.15.31:0/2750298944 conn(0x7fc19c0d1e00 msgr2=0x7fc19c15dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:33.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.041+0000 7fc1a4000640 1 -- 172.21.15.31:0/2750298944 shutdown_connections 2024-09-17T05:29:33.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.041+0000 7fc1a4000640 1 -- 172.21.15.31:0/2750298944 wait complete. 2024-09-17T05:29:33.071 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:29:33.072 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:29:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.221+0000 7f0245e00640 1 -- 172.21.15.31:0/3256737476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02401605d0 msgr2=0x7f02400d0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.221+0000 7f0245e00640 1 --2- 172.21.15.31:0/3256737476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02401605d0 0x7f02400d0690 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0230009900 tx=0x7f023001c8e0 comp rx=0 tx=0).stop 2024-09-17T05:29:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.221+0000 7f0245e00640 1 -- 172.21.15.31:0/3256737476 shutdown_connections 2024-09-17T05:29:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.221+0000 7f0245e00640 1 --2- 172.21.15.31:0/3256737476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02400b1650 0x7f02400b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.221+0000 7f0245e00640 1 --2- 172.21.15.31:0/3256737476 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02401605d0 0x7f02400d0690 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.221+0000 7f0245e00640 1 -- 172.21.15.31:0/3256737476 >> 172.21.15.31:0/3256737476 conn(0x7f02400d1dd0 msgr2=0x7f02400d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.221+0000 7f0245e00640 1 -- 172.21.15.31:0/3256737476 shutdown_connections 2024-09-17T05:29:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.221+0000 7f0245e00640 1 -- 172.21.15.31:0/3256737476 wait complete. 2024-09-17T05:29:33.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f0245e00640 1 Processor -- start 2024-09-17T05:29:33.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f0245e00640 1 -- start start 2024-09-17T05:29:33.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f0245e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02400aeb00 0x7f024015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:33.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f0245e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02400b1650 0x7f024014d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:33.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f0245e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02401605d0 0x7f024015bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:33.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f0245e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f02400b0810 con 0x7f02401605d0 2024-09-17T05:29:33.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f0245e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f02400b0ee0 con 0x7f02400aeb00 2024-09-17T05:29:33.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f0245e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f02400b1220 con 0x7f02400b1650 2024-09-17T05:29:33.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f023f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02401605d0 0x7f024015bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:33.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f023f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02401605d0 0x7f024015bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35320/0 (socket says 172.21.15.31:35320) 2024-09-17T05:29:33.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f023f400640 1 -- 172.21.15.31:0/2373439358 learned_addr learned my addr 172.21.15.31:0/2373439358 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:33.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f0237e00640 1 --2- 172.21.15.31:0/2373439358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02400b1650 0x7f024014d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:33.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f023ea00640 1 --2- 172.21.15.31:0/2373439358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02400aeb00 0x7f024015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:33.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f023f400640 1 -- 172.21.15.31:0/2373439358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02400b1650 msgr2=0x7f024014d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:33.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f023f400640 1 --2- 172.21.15.31:0/2373439358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02400b1650 0x7f024014d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:33.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f023f400640 1 -- 172.21.15.31:0/2373439358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02400aeb00 msgr2=0x7f024015a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:33.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f023f400640 1 --2- 172.21.15.31:0/2373439358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02400aeb00 0x7f024015a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:33.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f023f400640 1 -- 172.21.15.31:0/2373439358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02400b09c0 con 0x7f02401605d0 2024-09-17T05:29:33.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f023f400640 1 --2- 172.21.15.31:0/2373439358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02401605d0 0x7f024015bb80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f023800c7a0 tx=0x7f023800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f0237400640 1 -- 172.21.15.31:0/2373439358 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238003b80 con 0x7f02401605d0 2024-09-17T05:29:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f0237400640 1 -- 172.21.15.31:0/2373439358 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0238003d40 con 0x7f02401605d0 2024-09-17T05:29:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f0237400640 1 -- 172.21.15.31:0/2373439358 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023800aab0 con 0x7f02401605d0 2024-09-17T05:29:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f0245e00640 1 -- 172.21.15.31:0/2373439358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f024014d750 con 0x7f02401605d0 2024-09-17T05:29:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.225+0000 7f0245e00640 1 -- 172.21.15.31:0/2373439358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02401f7cb0 con 0x7f02401605d0 2024-09-17T05:29:33.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.229+0000 7f0245e00640 1 -- 172.21.15.31:0/2373439358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02400b1a30 con 0x7f02401605d0 2024-09-17T05:29:33.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.229+0000 7f0237400640 1 -- 172.21.15.31:0/2373439358 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f023800ac50 con 0x7f02401605d0 2024-09-17T05:29:33.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.229+0000 7f0237400640 1 --2- 172.21.15.31:0/2373439358 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f021c073230 0x7f021c0756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:33.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.229+0000 7f0237400640 1 -- 172.21.15.31:0/2373439358 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0238093e40 con 0x7f02401605d0 2024-09-17T05:29:33.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.229+0000 7f023ea00640 1 --2- 172.21.15.31:0/2373439358 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f021c073230 0x7f021c0756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:33.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.229+0000 7f023ea00640 1 --2- 172.21.15.31:0/2373439358 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f021c073230 0x7f021c0756f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f02300af000 tx=0x7f023001b120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:33.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.233+0000 7f0237400640 1 -- 172.21.15.31:0/2373439358 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f023805e930 con 0x7f02401605d0 2024-09-17T05:29:33.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:33.445+0000 7f0245e00640 1 -- 172.21.15.31:0/2373439358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f02400d22e0 con 0x7f02401605d0 2024-09-17T05:29:34.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.049+0000 7f0237400640 1 -- 172.21.15.31:0/2373439358 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f0238063360 con 0x7f02401605d0 2024-09-17T05:29:34.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.049+0000 7f0245e00640 1 -- 172.21.15.31:0/2373439358 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f021c073230 msgr2=0x7f021c0756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:34.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.049+0000 7f0245e00640 1 --2- 172.21.15.31:0/2373439358 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f021c073230 0x7f021c0756f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f02300af000 tx=0x7f023001b120 comp rx=0 tx=0).stop 2024-09-17T05:29:34.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.049+0000 7f0245e00640 1 -- 172.21.15.31:0/2373439358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02401605d0 msgr2=0x7f024015bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:34.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.049+0000 7f0245e00640 1 --2- 172.21.15.31:0/2373439358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02401605d0 0x7f024015bb80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f023800c7a0 tx=0x7f023800cc60 comp rx=0 tx=0).stop 2024-09-17T05:29:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.049+0000 7f0245e00640 1 -- 172.21.15.31:0/2373439358 shutdown_connections 2024-09-17T05:29:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.049+0000 7f0245e00640 1 --2- 172.21.15.31:0/2373439358 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f021c073230 0x7f021c0756f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.049+0000 7f0245e00640 1 --2- 172.21.15.31:0/2373439358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02401605d0 0x7f024015bb80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.049+0000 7f0245e00640 1 --2- 172.21.15.31:0/2373439358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02400b1650 0x7f024014d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.049+0000 7f0245e00640 1 --2- 172.21.15.31:0/2373439358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02400aeb00 0x7f024015a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.049+0000 7f0245e00640 1 -- 172.21.15.31:0/2373439358 >> 172.21.15.31:0/2373439358 conn(0x7f02400d1dd0 msgr2=0x7f02400aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.049+0000 7f0245e00640 1 -- 172.21.15.31:0/2373439358 shutdown_connections 2024-09-17T05:29:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.049+0000 7f0245e00640 1 -- 172.21.15.31:0/2373439358 wait complete. 2024-09-17T05:29:34.076 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:29:34.076 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:29:34.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.221+0000 7fd732800640 1 -- 172.21.15.31:0/3578586646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd710003a40 msgr2=0x7fd710003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:34.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.221+0000 7fd732800640 1 --2- 172.21.15.31:0/3578586646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd710003a40 0x7fd710003e20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd71c006fa0 tx=0x7fd71c01ce40 comp rx=0 tx=0).stop 2024-09-17T05:29:34.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.221+0000 7fd72be00640 1 -- 172.21.15.31:0/3578586646 reap_dead start 2024-09-17T05:29:34.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.221+0000 7fd732800640 1 -- 172.21.15.31:0/3578586646 shutdown_connections 2024-09-17T05:29:34.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.221+0000 7fd732800640 1 -- 172.21.15.31:0/3578586646 >> 172.21.15.31:0/3578586646 conn(0x7fd72c0b2240 msgr2=0x7fd72c0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:34.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.221+0000 7fd732800640 1 -- 172.21.15.31:0/3578586646 shutdown_connections 2024-09-17T05:29:34.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.221+0000 7fd732800640 1 -- 172.21.15.31:0/3578586646 wait complete. 2024-09-17T05:29:34.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.221+0000 7fd732800640 1 Processor -- start 2024-09-17T05:29:34.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.221+0000 7fd732800640 1 -- start start 2024-09-17T05:29:34.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd732800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd710003a40 0x7fd72c15f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:34.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd732800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd72c157bf0 0x7fd72c0cf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:34.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd732800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c1582b0 0x7fd72c147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:34.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd732800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c168370 con 0x7fd710003a40 2024-09-17T05:29:34.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd732800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1681f0 con 0x7fd72c157bf0 2024-09-17T05:29:34.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd732800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd72c1684f0 con 0x7fd72c1582b0 2024-09-17T05:29:34.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd72b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd710003a40 0x7fd72c15f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:34.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd72b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd710003a40 0x7fd72c15f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35336/0 (socket says 172.21.15.31:35336) 2024-09-17T05:29:34.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd72b400640 1 -- 172.21.15.31:0/2358863517 learned_addr learned my addr 172.21.15.31:0/2358863517 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:34.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd723e00640 1 --2- 172.21.15.31:0/2358863517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd72c157bf0 0x7fd72c0cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:34.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd72be00640 1 --2- 172.21.15.31:0/2358863517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c1582b0 0x7fd72c147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:34.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd72b400640 1 -- 172.21.15.31:0/2358863517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c1582b0 msgr2=0x7fd72c147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:34.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd72b400640 1 --2- 172.21.15.31:0/2358863517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c1582b0 0x7fd72c147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd72b400640 1 -- 172.21.15.31:0/2358863517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd72c157bf0 msgr2=0x7fd72c0cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:34.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd72b400640 1 --2- 172.21.15.31:0/2358863517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd72c157bf0 0x7fd72c0cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd72b400640 1 -- 172.21.15.31:0/2358863517 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72c15b0a0 con 0x7fd710003a40 2024-09-17T05:29:34.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd72b400640 1 --2- 172.21.15.31:0/2358863517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd710003a40 0x7fd72c15f260 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd71c006040 tx=0x7fd71c001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd723400640 1 -- 172.21.15.31:0/2358863517 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71c0014c0 con 0x7fd710003a40 2024-09-17T05:29:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd723400640 1 -- 172.21.15.31:0/2358863517 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd71c001680 con 0x7fd710003a40 2024-09-17T05:29:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd723400640 1 -- 172.21.15.31:0/2358863517 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71c006330 con 0x7fd710003a40 2024-09-17T05:29:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd732800640 1 -- 172.21.15.31:0/2358863517 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd72c15b380 con 0x7fd710003a40 2024-09-17T05:29:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd732800640 1 -- 172.21.15.31:0/2358863517 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd72c158740 con 0x7fd710003a40 2024-09-17T05:29:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.225+0000 7fd732800640 1 -- 172.21.15.31:0/2358863517 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd72c15b550 con 0x7fd710003a40 2024-09-17T05:29:34.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.229+0000 7fd723400640 1 -- 172.21.15.31:0/2358863517 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fd71c0a5ca0 con 0x7fd710003a40 2024-09-17T05:29:34.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.229+0000 7fd723400640 1 --2- 172.21.15.31:0/2358863517 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd708073230 0x7fd7080756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:34.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.229+0000 7fd723400640 1 -- 172.21.15.31:0/2358863517 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fd71c12d670 con 0x7fd710003a40 2024-09-17T05:29:34.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.229+0000 7fd723e00640 1 --2- 172.21.15.31:0/2358863517 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd708073230 0x7fd7080756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:34.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.229+0000 7fd723e00640 1 --2- 172.21.15.31:0/2358863517 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd708073230 0x7fd7080756f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd72c1fb2f0 tx=0x7fd714005f40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:34.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.233+0000 7fd723400640 1 -- 172.21.15.31:0/2358863517 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd71c016bf0 con 0x7fd710003a40 2024-09-17T05:29:34.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.441+0000 7fd732800640 1 -- 172.21.15.31:0/2358863517 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd72c15fa70 con 0x7fd710003a40 2024-09-17T05:29:34.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.441+0000 7fd723400640 1 -- 172.21.15.31:0/2358863517 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5229 (secure 0 0 0) 0x7fd71c0f8040 con 0x7fd710003a40 2024-09-17T05:29:34.447 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:34.447 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"btime":"2024-09-17T05:29:34:044429+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3266973645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3266973645},{"type":"v1","addr":"172.21.15.155:6837","nonce":3266973645}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4673,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3624429107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3624429107},{"type":"v1","addr":"172.21.15.31:6835","nonce":3624429107}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4878,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1163918742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1163918742},{"type":"v1","addr":"172.21.15.31:6834","nonce":1163918742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:29:30.419105+0000","modified":"2024-09-17T05:29:33.450065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4881":{"gid":4881,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/2317915643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2317915643},{"type":"v1","addr":"172.21.15.155:6836","nonce":2317915643}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4881,"qdb_cluster":[4881]},"id":2}]} 2024-09-17T05:29:34.448 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 17 2024-09-17T05:29:34.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.445+0000 7fd732800640 1 -- 172.21.15.31:0/2358863517 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd708073230 msgr2=0x7fd7080756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:34.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.445+0000 7fd732800640 1 --2- 172.21.15.31:0/2358863517 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd708073230 0x7fd7080756f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd72c1fb2f0 tx=0x7fd714005f40 comp rx=0 tx=0).stop 2024-09-17T05:29:34.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.445+0000 7fd732800640 1 -- 172.21.15.31:0/2358863517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd710003a40 msgr2=0x7fd72c15f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:34.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.445+0000 7fd732800640 1 --2- 172.21.15.31:0/2358863517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd710003a40 0x7fd72c15f260 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd71c006040 tx=0x7fd71c001cd0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.445+0000 7fd732800640 1 -- 172.21.15.31:0/2358863517 shutdown_connections 2024-09-17T05:29:34.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.445+0000 7fd732800640 1 --2- 172.21.15.31:0/2358863517 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd708073230 0x7fd7080756f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.445+0000 7fd732800640 1 --2- 172.21.15.31:0/2358863517 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd72c1582b0 0x7fd72c147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.445+0000 7fd732800640 1 --2- 172.21.15.31:0/2358863517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd72c157bf0 0x7fd72c0cf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.445+0000 7fd732800640 1 --2- 172.21.15.31:0/2358863517 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd710003a40 0x7fd72c15f260 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.445+0000 7fd732800640 1 -- 172.21.15.31:0/2358863517 >> 172.21.15.31:0/2358863517 conn(0x7fd72c0b2240 msgr2=0x7fd72c0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:34.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.445+0000 7fd732800640 1 -- 172.21.15.31:0/2358863517 shutdown_connections 2024-09-17T05:29:34.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.445+0000 7fd732800640 1 -- 172.21.15.31:0/2358863517 wait complete. 2024-09-17T05:29:34.469 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:29:34.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.609+0000 7f84c3e00640 1 -- 172.21.15.31:0/1637208873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84bc15bea0 msgr2=0x7f84bc0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:34.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.609+0000 7f84c3e00640 1 --2- 172.21.15.31:0/1637208873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84bc15bea0 0x7f84bc0ce670 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009900 tx=0x7f84b001c850 comp rx=0 tx=0).stop 2024-09-17T05:29:34.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.609+0000 7f84c3e00640 1 -- 172.21.15.31:0/1637208873 shutdown_connections 2024-09-17T05:29:34.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.609+0000 7f84c3e00640 1 --2- 172.21.15.31:0/1637208873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84bc15bea0 0x7f84bc0ce670 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.609+0000 7f84c3e00640 1 -- 172.21.15.31:0/1637208873 >> 172.21.15.31:0/1637208873 conn(0x7f84bc0d1dc0 msgr2=0x7f84bc0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:34.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.609+0000 7f84c3e00640 1 -- 172.21.15.31:0/1637208873 shutdown_connections 2024-09-17T05:29:34.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.609+0000 7f84c3e00640 1 -- 172.21.15.31:0/1637208873 wait complete. 2024-09-17T05:29:34.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c3e00640 1 Processor -- start 2024-09-17T05:29:34.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c3e00640 1 -- start start 2024-09-17T05:29:34.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c3e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84bc0cdb30 0x7f84bc1510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:34.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c3e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84bc0d28e0 0x7f84bc0b1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:34.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84bc15bea0 0x7f84bc159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:34.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c3e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc16a930 con 0x7f84bc15bea0 2024-09-17T05:29:34.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c3e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc16a7b0 con 0x7f84bc0cdb30 2024-09-17T05:29:34.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c3e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f84bc16aab0 con 0x7f84bc0d28e0 2024-09-17T05:29:34.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84bc15bea0 0x7f84bc159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:34.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84bc15bea0 0x7f84bc159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35344/0 (socket says 172.21.15.31:35344) 2024-09-17T05:29:34.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c1400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84bc0cdb30 0x7f84bc1510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:34.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c0a00640 1 --2- 172.21.15.31:0/3542601571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84bc0d28e0 0x7f84bc0b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:34.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c1e00640 1 -- 172.21.15.31:0/3542601571 learned_addr learned my addr 172.21.15.31:0/3542601571 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:34.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c1400640 1 -- 172.21.15.31:0/3542601571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84bc0d28e0 msgr2=0x7f84bc0b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:34.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c1400640 1 --2- 172.21.15.31:0/3542601571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84bc0d28e0 0x7f84bc0b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c1400640 1 -- 172.21.15.31:0/3542601571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84bc15bea0 msgr2=0x7f84bc159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:34.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c1400640 1 --2- 172.21.15.31:0/3542601571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84bc15bea0 0x7f84bc159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c1400640 1 -- 172.21.15.31:0/3542601571 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84bc0b1c50 con 0x7f84bc0cdb30 2024-09-17T05:29:34.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c1e00640 1 --2- 172.21.15.31:0/3542601571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84bc15bea0 0x7f84bc159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:29:34.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c1400640 1 --2- 172.21.15.31:0/3542601571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84bc0cdb30 0x7f84bc1510d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f84b00ac000 tx=0x7f84b0005790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:34.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84b9600640 1 -- 172.21.15.31:0/3542601571 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b00b2040 con 0x7f84bc0cdb30 2024-09-17T05:29:34.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84b9600640 1 -- 172.21.15.31:0/3542601571 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84b0004260 con 0x7f84bc0cdb30 2024-09-17T05:29:34.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84b9600640 1 -- 172.21.15.31:0/3542601571 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0003600 con 0x7f84bc0cdb30 2024-09-17T05:29:34.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c3e00640 1 -- 172.21.15.31:0/3542601571 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84bc0b1f30 con 0x7f84bc0cdb30 2024-09-17T05:29:34.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.613+0000 7f84c3e00640 1 -- 172.21.15.31:0/3542601571 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84bc15a470 con 0x7f84bc0cdb30 2024-09-17T05:29:34.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.617+0000 7f84c3e00640 1 -- 172.21.15.31:0/3542601571 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84bc0b2450 con 0x7f84bc0cdb30 2024-09-17T05:29:34.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.617+0000 7f84b9600640 1 -- 172.21.15.31:0/3542601571 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f84b00037a0 con 0x7f84bc0cdb30 2024-09-17T05:29:34.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.617+0000 7f84b9600640 1 --2- 172.21.15.31:0/3542601571 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f849c0731f0 0x7f849c0756b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:34.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.617+0000 7f84b9600640 1 -- 172.21.15.31:0/3542601571 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f84b012ddc0 con 0x7f84bc0cdb30 2024-09-17T05:29:34.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.617+0000 7f84c0a00640 1 --2- 172.21.15.31:0/3542601571 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f849c0731f0 0x7f849c0756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:34.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.617+0000 7f84c0a00640 1 --2- 172.21.15.31:0/3542601571 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f849c0731f0 0x7f849c0756b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0d2730 tx=0x7f84a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:34.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.621+0000 7f84b9600640 1 -- 172.21.15.31:0/3542601571 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f84bc0b2450 con 0x7f84bc0cdb30 2024-09-17T05:29:34.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.801+0000 7f84c3e00640 1 -- 172.21.15.31:0/3542601571 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84bc0ce670 con 0x7f84bc0cdb30 2024-09-17T05:29:34.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.801+0000 7f84b9600640 1 -- 172.21.15.31:0/3542601571 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16753 (secure 0 0 0) 0x7f84b00164d0 con 0x7f84bc0cdb30 2024-09-17T05:29:34.837 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:34.837 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":32,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:29:32.021289+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:29:28.563579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:29:29.374194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:29:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.805+0000 7f84c3e00640 1 -- 172.21.15.31:0/3542601571 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f849c0731f0 msgr2=0x7f849c0756b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.805+0000 7f84c3e00640 1 --2- 172.21.15.31:0/3542601571 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f849c0731f0 0x7f849c0756b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0d2730 tx=0x7f84a8009040 comp rx=0 tx=0).stop 2024-09-17T05:29:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.805+0000 7f84c3e00640 1 -- 172.21.15.31:0/3542601571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84bc0cdb30 msgr2=0x7f84bc1510d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.805+0000 7f84c3e00640 1 --2- 172.21.15.31:0/3542601571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84bc0cdb30 0x7f84bc1510d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f84b00ac000 tx=0x7f84b0005790 comp rx=0 tx=0).stop 2024-09-17T05:29:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.805+0000 7f84c3e00640 1 -- 172.21.15.31:0/3542601571 shutdown_connections 2024-09-17T05:29:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.805+0000 7f84c3e00640 1 --2- 172.21.15.31:0/3542601571 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f849c0731f0 0x7f849c0756b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.805+0000 7f84c3e00640 1 --2- 172.21.15.31:0/3542601571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84bc15bea0 0x7f84bc159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.805+0000 7f84c3e00640 1 --2- 172.21.15.31:0/3542601571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84bc0d28e0 0x7f84bc0b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.805+0000 7f84c3e00640 1 --2- 172.21.15.31:0/3542601571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84bc0cdb30 0x7f84bc1510d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.805+0000 7f84c3e00640 1 -- 172.21.15.31:0/3542601571 >> 172.21.15.31:0/3542601571 conn(0x7f84bc0d1dc0 msgr2=0x7f84bc0b5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.805+0000 7f84c3e00640 1 -- 172.21.15.31:0/3542601571 shutdown_connections 2024-09-17T05:29:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.805+0000 7f84c3e00640 1 -- 172.21.15.31:0/3542601571 wait complete. 2024-09-17T05:29:34.840 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:29:34.841 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:29:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.985+0000 7fa6d1200640 1 -- 172.21.15.31:0/2631264054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b0003ab0 msgr2=0x7fa6b0003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.985+0000 7fa6d1200640 1 --2- 172.21.15.31:0/2631264054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b0003ab0 0x7fa6b0003ed0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009b30 tx=0x7fa6bc01d1e0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.985+0000 7fa6d1200640 1 -- 172.21.15.31:0/2631264054 shutdown_connections 2024-09-17T05:29:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.985+0000 7fa6d1200640 1 --2- 172.21.15.31:0/2631264054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b0003ab0 0x7fa6b0003ed0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.985+0000 7fa6d1200640 1 -- 172.21.15.31:0/2631264054 >> 172.21.15.31:0/2631264054 conn(0x7fa6cc0d0c90 msgr2=0x7fa6cc0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.985+0000 7fa6d1200640 1 -- 172.21.15.31:0/2631264054 shutdown_connections 2024-09-17T05:29:34.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.985+0000 7fa6d1200640 1 -- 172.21.15.31:0/2631264054 wait complete. 2024-09-17T05:29:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.985+0000 7fa6d1200640 1 Processor -- start 2024-09-17T05:29:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.985+0000 7fa6d1200640 1 -- start start 2024-09-17T05:29:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.985+0000 7fa6d1200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6b0003ab0 0x7fa6cc1e9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6d1200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6cc0b5660 0x7fa6cc0b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6d1200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6cc1fb9b0 0x7fa6cc1fbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:34.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6d1200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc071fe0 con 0x7fa6cc1fb9b0 2024-09-17T05:29:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6d1200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc071e60 con 0x7fa6b0003ab0 2024-09-17T05:29:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6d1200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa6cc072160 con 0x7fa6cc0b5660 2024-09-17T05:29:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6ca800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6cc1fb9b0 0x7fa6cc1fbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6c9e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6b0003ab0 0x7fa6cc1e9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6c1400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6cc0b5660 0x7fa6cc0b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6c9e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6b0003ab0 0x7fa6cc1e9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:47174/0 (socket says 172.21.15.31:47174) 2024-09-17T05:29:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6c9e00640 1 -- 172.21.15.31:0/29296099 learned_addr learned my addr 172.21.15.31:0/29296099 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6ca800640 1 -- 172.21.15.31:0/29296099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6cc0b5660 msgr2=0x7fa6cc0b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6ca800640 1 --2- 172.21.15.31:0/29296099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6cc0b5660 0x7fa6cc0b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6ca800640 1 -- 172.21.15.31:0/29296099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6b0003ab0 msgr2=0x7fa6cc1e9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6ca800640 1 --2- 172.21.15.31:0/29296099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6b0003ab0 0x7fa6cc1e9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:34.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6ca800640 1 -- 172.21.15.31:0/29296099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6cc0b69c0 con 0x7fa6cc1fb9b0 2024-09-17T05:29:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6c9e00640 1 --2- 172.21.15.31:0/29296099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6b0003ab0 0x7fa6cc1e9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:29:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6ca800640 1 --2- 172.21.15.31:0/29296099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6cc1fb9b0 0x7fa6cc1fbe30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc074c20 tx=0x7fa6c40019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6c2a00640 1 -- 172.21.15.31:0/29296099 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4011870 con 0x7fa6cc1fb9b0 2024-09-17T05:29:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6c2a00640 1 -- 172.21.15.31:0/29296099 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6c4017070 con 0x7fa6cc1fb9b0 2024-09-17T05:29:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6c2a00640 1 -- 172.21.15.31:0/29296099 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4011da0 con 0x7fa6cc1fb9b0 2024-09-17T05:29:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6d1200640 1 -- 172.21.15.31:0/29296099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6cc0b6120 con 0x7fa6cc1fb9b0 2024-09-17T05:29:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6d1200640 1 -- 172.21.15.31:0/29296099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6cc0b66e0 con 0x7fa6cc1fb9b0 2024-09-17T05:29:34.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6d1200640 1 -- 172.21.15.31:0/29296099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6cc15f970 con 0x7fa6cc1fb9b0 2024-09-17T05:29:34.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.989+0000 7fa6c2a00640 1 -- 172.21.15.31:0/29296099 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fa6c401c460 con 0x7fa6cc1fb9b0 2024-09-17T05:29:34.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.993+0000 7fa6c2a00640 1 --2- 172.21.15.31:0/29296099 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa6a8073200 0x7fa6a80756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:34.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.993+0000 7fa6c2a00640 1 -- 172.21.15.31:0/29296099 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa6c40947f0 con 0x7fa6cc1fb9b0 2024-09-17T05:29:34.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.993+0000 7fa6c9e00640 1 --2- 172.21.15.31:0/29296099 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa6a8073200 0x7fa6a80756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:34.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.993+0000 7fa6c9e00640 1 --2- 172.21.15.31:0/29296099 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa6a8073200 0x7fa6a80756c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc01ba60 tx=0x7fa6bc019f80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:35.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:34.997+0000 7fa6c2a00640 1 -- 172.21.15.31:0/29296099 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa6c405f250 con 0x7fa6cc1fb9b0 2024-09-17T05:29:35.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.169+0000 7fa6d1200640 1 -- 172.21.15.31:0/29296099 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa6cc0cbce0 con 0x7fa6a8073200 2024-09-17T05:29:35.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.177+0000 7fa6c2a00640 1 -- 172.21.15.31:0/29296099 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239161 (secure 0 0 0) 0x7fa6cc0cbce0 con 0x7fa6a8073200 2024-09-17T05:29:35.182 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:35.184 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:29:35.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.181+0000 7fa6d1200640 1 -- 172.21.15.31:0/29296099 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa6a8073200 msgr2=0x7fa6a80756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:35.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.181+0000 7fa6d1200640 1 --2- 172.21.15.31:0/29296099 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa6a8073200 0x7fa6a80756c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc01ba60 tx=0x7fa6bc019f80 comp rx=0 tx=0).stop 2024-09-17T05:29:35.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.181+0000 7fa6d1200640 1 -- 172.21.15.31:0/29296099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6cc1fb9b0 msgr2=0x7fa6cc1fbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:35.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.181+0000 7fa6d1200640 1 --2- 172.21.15.31:0/29296099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6cc1fb9b0 0x7fa6cc1fbe30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc074c20 tx=0x7fa6c40019c0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.181+0000 7fa6d1200640 1 -- 172.21.15.31:0/29296099 shutdown_connections 2024-09-17T05:29:35.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.181+0000 7fa6d1200640 1 --2- 172.21.15.31:0/29296099 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa6a8073200 0x7fa6a80756c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.181+0000 7fa6d1200640 1 --2- 172.21.15.31:0/29296099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6cc1fb9b0 0x7fa6cc1fbe30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.181+0000 7fa6d1200640 1 --2- 172.21.15.31:0/29296099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6cc0b5660 0x7fa6cc0b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.181+0000 7fa6d1200640 1 --2- 172.21.15.31:0/29296099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6b0003ab0 0x7fa6cc1e9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.181+0000 7fa6d1200640 1 -- 172.21.15.31:0/29296099 >> 172.21.15.31:0/29296099 conn(0x7fa6cc0d0c90 msgr2=0x7fa6cc1556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:35.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.181+0000 7fa6d1200640 1 -- 172.21.15.31:0/29296099 shutdown_connections 2024-09-17T05:29:35.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.181+0000 7fa6d1200640 1 -- 172.21.15.31:0/29296099 wait complete. 2024-09-17T05:29:35.203 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-17T05:29:33.191156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":52,"acting":52,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":224000,"kb_used_data":3552,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750720,"statfs":{"total":773094113280,"available":772864737280,"internally_reserved":0,"allocated":3637248,"data_stored":2074130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.193352"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.003237+0000","last_change":"2024-09-17T05:29:29.003237+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.003237+0000","last_undegraded":"2024-09-17T05:29:29.003237+0000","last_fullsized":"2024-09-17T05:29:29.003237+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:28.989992+0000","last_change":"2024-09-17T05:29:28.989992+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:28.989992+0000","last_undegraded":"2024-09-17T05:29:28.989992+0000","last_fullsized":"2024-09-17T05:29:28.989992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.003792+0000","last_change":"2024-09-17T05:29:29.003792+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.003792+0000","last_undegraded":"2024-09-17T05:29:29.003792+0000","last_fullsized":"2024-09-17T05:29:29.003792+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.001420+0000","last_change":"2024-09-17T05:29:29.001420+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.001420+0000","last_undegraded":"2024-09-17T05:29:29.001420+0000","last_fullsized":"2024-09-17T05:29:29.001420+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.001218+0000","last_change":"2024-09-17T05:29:29.001218+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.001218+0000","last_undegraded":"2024-09-17T05:29:29.001218+0000","last_fullsized":"2024-09-17T05:29:29.001218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.000022+0000","last_change":"2024-09-17T05:29:29.000022+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.000022+0000","last_undegraded":"2024-09-17T05:29:29.000022+0000","last_fullsized":"2024-09-17T05:29:29.000022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.002315+0000","last_change":"2024-09-17T05:29:29.002315+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.002315+0000","last_undegraded":"2024-09-17T05:29:29.002315+0000","last_fullsized":"2024-09-17T05:29:29.002315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.000032+0000","last_change":"2024-09-17T05:29:29.000032+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.000032+0000","last_undegraded":"2024-09-17T05:29:29.000032+0000","last_fullsized":"2024-09-17T05:29:29.000032+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.003144+0000","last_change":"2024-09-17T05:29:29.003144+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.003144+0000","last_undegraded":"2024-09-17T05:29:29.003144+0000","last_fullsized":"2024-09-17T05:29:29.003144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:28.989992+0000","last_change":"2024-09-17T05:29:28.989992+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:28.989992+0000","last_undegraded":"2024-09-17T05:29:28.989992+0000","last_fullsized":"2024-09-17T05:29:28.989992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:28.989992+0000","last_change":"2024-09-17T05:29:28.989992+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:28.989992+0000","last_undegraded":"2024-09-17T05:29:28.989992+0000","last_fullsized":"2024-09-17T05:29:28.989992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.001770+0000","last_change":"2024-09-17T05:29:29.001770+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.001770+0000","last_undegraded":"2024-09-17T05:29:29.001770+0000","last_fullsized":"2024-09-17T05:29:29.001770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.000742+0000","last_change":"2024-09-17T05:29:29.000742+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.000742+0000","last_undegraded":"2024-09-17T05:29:29.000742+0000","last_fullsized":"2024-09-17T05:29:29.000742+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:28.999241+0000","last_change":"2024-09-17T05:29:28.999241+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:28.999241+0000","last_undegraded":"2024-09-17T05:29:28.999241+0000","last_fullsized":"2024-09-17T05:29:28.999241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.002714+0000","last_change":"2024-09-17T05:29:29.002714+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.002714+0000","last_undegraded":"2024-09-17T05:29:29.002714+0000","last_fullsized":"2024-09-17T05:29:29.002714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.001606+0000","last_change":"2024-09-17T05:29:29.001606+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.001606+0000","last_undegraded":"2024-09-17T05:29:29.001606+0000","last_fullsized":"2024-09-17T05:29:29.001606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:28.998897+0000","last_change":"2024-09-17T05:29:28.998897+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:28.998897+0000","last_undegraded":"2024-09-17T05:29:28.998897+0000","last_fullsized":"2024-09-17T05:29:28.998897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.001165+0000","last_change":"2024-09-17T05:29:29.001165+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.001165+0000","last_undegraded":"2024-09-17T05:29:29.001165+0000","last_fullsized":"2024-09-17T05:29:29.001165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.000665+0000","last_change":"2024-09-17T05:29:29.000665+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.000665+0000","last_undegraded":"2024-09-17T05:29:29.000665+0000","last_fullsized":"2024-09-17T05:29:29.000665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.000099+0000","last_change":"2024-09-17T05:29:29.000099+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.000099+0000","last_undegraded":"2024-09-17T05:29:29.000099+0000","last_fullsized":"2024-09-17T05:29:29.000099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:28.989992+0000","last_change":"2024-09-17T05:29:28.989992+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:28.989992+0000","last_undegraded":"2024-09-17T05:29:28.989992+0000","last_fullsized":"2024-09-17T05:29:28.989992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.003506+0000","last_change":"2024-09-17T05:29:29.003506+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.003506+0000","last_undegraded":"2024-09-17T05:29:29.003506+0000","last_fullsized":"2024-09-17T05:29:29.003506+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.000759+0000","last_change":"2024-09-17T05:29:29.000759+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.000759+0000","last_undegraded":"2024-09-17T05:29:29.000759+0000","last_fullsized":"2024-09-17T05:29:29.000759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:28.989992+0000","last_change":"2024-09-17T05:29:28.989992+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:28.989992+0000","last_undegraded":"2024-09-17T05:29:28.989992+0000","last_fullsized":"2024-09-17T05:29:28.989992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:28.998371+0000","last_change":"2024-09-17T05:29:28.998371+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:28.998371+0000","last_undegraded":"2024-09-17T05:29:28.998371+0000","last_fullsized":"2024-09-17T05:29:28.998371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:28.989992+0000","last_change":"2024-09-17T05:29:28.989992+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:28.989992+0000","last_undegraded":"2024-09-17T05:29:28.989992+0000","last_fullsized":"2024-09-17T05:29:28.989992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:28.997970+0000","last_change":"2024-09-17T05:29:28.997970+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:28.997970+0000","last_undegraded":"2024-09-17T05:29:28.997970+0000","last_fullsized":"2024-09-17T05:29:28.997970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:28.989992+0000","last_change":"2024-09-17T05:29:28.989992+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:28.989992+0000","last_undegraded":"2024-09-17T05:29:28.989992+0000","last_fullsized":"2024-09-17T05:29:28.989992+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:28.997780+0000","last_change":"2024-09-17T05:29:28.997780+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:28.997780+0000","last_undegraded":"2024-09-17T05:29:28.997780+0000","last_fullsized":"2024-09-17T05:29:28.997780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.000314+0000","last_change":"2024-09-17T05:29:29.000314+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.000314+0000","last_undegraded":"2024-09-17T05:29:29.000314+0000","last_fullsized":"2024-09-17T05:29:29.000314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.002137+0000","last_change":"2024-09-17T05:29:29.002137+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.002137+0000","last_undegraded":"2024-09-17T05:29:29.002137+0000","last_fullsized":"2024-09-17T05:29:29.002137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:29:29.994016+0000","last_change":"2024-09-17T05:29:29.994016+0000","last_active":"2024-09-17T05:29:29.994016+0000","last_peered":"2024-09-17T05:29:29.994016+0000","last_clean":"2024-09-17T05:29:29.994016+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.994016+0000","last_undegraded":"2024-09-17T05:29:29.994016+0000","last_fullsized":"2024-09-17T05:29:29.994016+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-17T05:29:29.003021+0000","last_change":"2024-09-17T05:29:29.003021+0000","last_active":"2024-09-17T05:29:28.989992+0000","last_peered":"2024-09-17T05:29:28.989992+0000","last_clean":"2024-09-17T05:29:28.989992+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:29:29.003021+0000","last_undegraded":"2024-09-17T05:29:29.003021+0000","last_fullsized":"2024-09-17T05:29:29.003021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":125,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-17T05:29:29.008653+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:29:29.008653+0000","last_peered":"2024-09-17T05:29:29.008653+0000","last_clean":"2024-09-17T05:29:29.008653+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:29:29.008653+0000","last_undegraded":"2024-09-17T05:29:29.008653+0000","last_fullsized":"2024-09-17T05:29:29.008653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":50,"acting":50,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":909312,"data_stored":706405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":303104,"data_stored":110220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":303104,"data_stored":110220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":315392,"data_stored":116037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":303104,"data_stored":110220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":303104,"data_stored":110220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":303104,"data_stored":110220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":897024,"data_stored":700588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:29:35.207 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:29:35.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.388+0000 7f2663200640 1 -- 172.21.15.31:0/3158102156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26640af210 msgr2=0x7f26640b6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:35.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.388+0000 7f2663200640 1 --2- 172.21.15.31:0/3158102156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26640af210 0x7f26640b6470 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f265c009c80 tx=0x7f265c01f5a0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.388+0000 7f2663200640 1 -- 172.21.15.31:0/3158102156 shutdown_connections 2024-09-17T05:29:35.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.388+0000 7f2663200640 1 --2- 172.21.15.31:0/3158102156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26640af210 0x7f26640b6470 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.388+0000 7f2663200640 1 --2- 172.21.15.31:0/3158102156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2664071360 0x7f266406f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.388+0000 7f2663200640 1 -- 172.21.15.31:0/3158102156 >> 172.21.15.31:0/3158102156 conn(0x7f266409aa10 msgr2=0x7f266409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:35.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.388+0000 7f2663200640 1 -- 172.21.15.31:0/3158102156 shutdown_connections 2024-09-17T05:29:35.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.388+0000 7f2663200640 1 -- 172.21.15.31:0/3158102156 wait complete. 2024-09-17T05:29:35.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2663200640 1 Processor -- start 2024-09-17T05:29:35.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2663200640 1 -- start start 2024-09-17T05:29:35.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2663200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2664071360 0x7f266414e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:35.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2663200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2664071740 0x7f266415e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:35.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2663200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26640af210 0x7f266415ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:35.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2663200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f266415e1c0 con 0x7f26640af210 2024-09-17T05:29:35.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2663200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f266415e040 con 0x7f2664071740 2024-09-17T05:29:35.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2663200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f26640b69b0 con 0x7f2664071360 2024-09-17T05:29:35.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2662800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26640af210 0x7f266415ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:35.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2662800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26640af210 0x7f266415ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35382/0 (socket says 172.21.15.31:35382) 2024-09-17T05:29:35.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2662800640 1 -- 172.21.15.31:0/3812061048 learned_addr learned my addr 172.21.15.31:0/3812061048 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:35.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2661e00640 1 --2- 172.21.15.31:0/3812061048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2664071360 0x7f266414e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:35.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2661400640 1 --2- 172.21.15.31:0/3812061048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2664071740 0x7f266415e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:35.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2662800640 1 -- 172.21.15.31:0/3812061048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2664071360 msgr2=0x7f266414e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:35.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2662800640 1 --2- 172.21.15.31:0/3812061048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2664071360 0x7f266414e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2662800640 1 -- 172.21.15.31:0/3812061048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2664071740 msgr2=0x7f266415e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:35.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2662800640 1 --2- 172.21.15.31:0/3812061048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2664071740 0x7f266415e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2662800640 1 -- 172.21.15.31:0/3812061048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266415ee70 con 0x7f26640af210 2024-09-17T05:29:35.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2662800640 1 --2- 172.21.15.31:0/3812061048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26640af210 0x7f266415ff60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f265c009bd0 tx=0x7f265c0092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:35.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f265a000640 1 -- 172.21.15.31:0/3812061048 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c004a50 con 0x7f26640af210 2024-09-17T05:29:35.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f265a000640 1 -- 172.21.15.31:0/3812061048 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f265c004ce0 con 0x7f26640af210 2024-09-17T05:29:35.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f265a000640 1 -- 172.21.15.31:0/3812061048 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c0afb00 con 0x7f26640af210 2024-09-17T05:29:35.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2663200640 1 -- 172.21.15.31:0/3812061048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f266415f150 con 0x7f26640af210 2024-09-17T05:29:35.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2663200640 1 -- 172.21.15.31:0/3812061048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f266415f710 con 0x7f26640af210 2024-09-17T05:29:35.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.392+0000 7f2663200640 1 -- 172.21.15.31:0/3812061048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f266406f710 con 0x7f26640af210 2024-09-17T05:29:35.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.396+0000 7f265a000640 1 -- 172.21.15.31:0/3812061048 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f265c0afca0 con 0x7f26640af210 2024-09-17T05:29:35.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.396+0000 7f265a000640 1 --2- 172.21.15.31:0/3812061048 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2644073200 0x7f26440756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:35.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.396+0000 7f265a000640 1 -- 172.21.15.31:0/3812061048 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f265c132990 con 0x7f26640af210 2024-09-17T05:29:35.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.396+0000 7f2661e00640 1 --2- 172.21.15.31:0/3812061048 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2644073200 0x7f26440756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:35.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.396+0000 7f2661e00640 1 --2- 172.21.15.31:0/3812061048 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2644073200 0x7f26440756c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2654009be0 tx=0x7f26540091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:35.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.400+0000 7f265a000640 1 -- 172.21.15.31:0/3812061048 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f265c0ca030 con 0x7f26640af210 2024-09-17T05:29:35.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.572+0000 7f2663200640 1 -- 172.21.15.31:0/3812061048 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f26640b04d0 con 0x7f2644073200 2024-09-17T05:29:35.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.576+0000 7f265a000640 1 -- 172.21.15.31:0/3812061048 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251938 (secure 0 0 0) 0x7f26640b04d0 con 0x7f2644073200 2024-09-17T05:29:35.584 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:35.586 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:29:35.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.580+0000 7f2663200640 1 -- 172.21.15.31:0/3812061048 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2644073200 msgr2=0x7f26440756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:35.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.580+0000 7f2663200640 1 --2- 172.21.15.31:0/3812061048 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2644073200 0x7f26440756c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2654009be0 tx=0x7f26540091e0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.580+0000 7f2663200640 1 -- 172.21.15.31:0/3812061048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26640af210 msgr2=0x7f266415ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:35.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.580+0000 7f2663200640 1 --2- 172.21.15.31:0/3812061048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26640af210 0x7f266415ff60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f265c009bd0 tx=0x7f265c0092c0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.580+0000 7f2663200640 1 -- 172.21.15.31:0/3812061048 shutdown_connections 2024-09-17T05:29:35.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.580+0000 7f2663200640 1 --2- 172.21.15.31:0/3812061048 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2644073200 0x7f26440756c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.580+0000 7f2663200640 1 --2- 172.21.15.31:0/3812061048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26640af210 0x7f266415ff60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.580+0000 7f2663200640 1 --2- 172.21.15.31:0/3812061048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2664071740 0x7f266415e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.580+0000 7f2663200640 1 --2- 172.21.15.31:0/3812061048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2664071360 0x7f266414e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.580+0000 7f2663200640 1 -- 172.21.15.31:0/3812061048 >> 172.21.15.31:0/3812061048 conn(0x7f266409aa10 msgr2=0x7f26640b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:35.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.580+0000 7f2663200640 1 -- 172.21.15.31:0/3812061048 shutdown_connections 2024-09-17T05:29:35.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.580+0000 7f2663200640 1 -- 172.21.15.31:0/3812061048 wait complete. 2024-09-17T05:29:35.604 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-17T05:29:35.191542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224372,"kb_used_data":3976,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750348,"statfs":{"total":773094113280,"available":772864356352,"internally_reserved":0,"allocated":4071424,"data_stored":2268588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001367"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981693+0000","last_change":"2024-09-17T05:29:31.035257+0000","last_active":"2024-09-17T05:29:32.981693+0000","last_peered":"2024-09-17T05:29:32.981693+0000","last_clean":"2024-09-17T05:29:32.981693+0000","last_became_active":"2024-09-17T05:29:31.034961+0000","last_became_peered":"2024-09-17T05:29:31.034961+0000","last_unstale":"2024-09-17T05:29:32.981693+0000","last_undegraded":"2024-09-17T05:29:32.981693+0000","last_fullsized":"2024-09-17T05:29:32.981693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:04.921623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981768+0000","last_change":"2024-09-17T05:29:31.030389+0000","last_active":"2024-09-17T05:29:32.981768+0000","last_peered":"2024-09-17T05:29:32.981768+0000","last_clean":"2024-09-17T05:29:32.981768+0000","last_became_active":"2024-09-17T05:29:31.030115+0000","last_became_peered":"2024-09-17T05:29:31.030115+0000","last_unstale":"2024-09-17T05:29:32.981768+0000","last_undegraded":"2024-09-17T05:29:32.981768+0000","last_fullsized":"2024-09-17T05:29:32.981768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:37.626106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.039071+0000","last_change":"2024-09-17T05:29:31.048361+0000","last_active":"2024-09-17T05:29:32.039071+0000","last_peered":"2024-09-17T05:29:32.039071+0000","last_clean":"2024-09-17T05:29:32.039071+0000","last_became_active":"2024-09-17T05:29:31.048022+0000","last_became_peered":"2024-09-17T05:29:31.048022+0000","last_unstale":"2024-09-17T05:29:32.039071+0000","last_undegraded":"2024-09-17T05:29:32.039071+0000","last_fullsized":"2024-09-17T05:29:32.039071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:18.970276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.980620+0000","last_change":"2024-09-17T05:29:31.042550+0000","last_active":"2024-09-17T05:29:32.980620+0000","last_peered":"2024-09-17T05:29:32.980620+0000","last_clean":"2024-09-17T05:29:32.980620+0000","last_became_active":"2024-09-17T05:29:31.041576+0000","last_became_peered":"2024-09-17T05:29:31.041576+0000","last_unstale":"2024-09-17T05:29:32.980620+0000","last_undegraded":"2024-09-17T05:29:32.980620+0000","last_fullsized":"2024-09-17T05:29:32.980620+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:21.501538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.980068+0000","last_change":"2024-09-17T05:29:31.032324+0000","last_active":"2024-09-17T05:29:32.980068+0000","last_peered":"2024-09-17T05:29:32.980068+0000","last_clean":"2024-09-17T05:29:32.980068+0000","last_became_active":"2024-09-17T05:29:31.032049+0000","last_became_peered":"2024-09-17T05:29:31.032049+0000","last_unstale":"2024-09-17T05:29:32.980068+0000","last_undegraded":"2024-09-17T05:29:32.980068+0000","last_fullsized":"2024-09-17T05:29:32.980068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:57.447563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.979822+0000","last_change":"2024-09-17T05:29:31.026131+0000","last_active":"2024-09-17T05:29:32.979822+0000","last_peered":"2024-09-17T05:29:32.979822+0000","last_clean":"2024-09-17T05:29:32.979822+0000","last_became_active":"2024-09-17T05:29:31.025771+0000","last_became_peered":"2024-09-17T05:29:31.025771+0000","last_unstale":"2024-09-17T05:29:32.979822+0000","last_undegraded":"2024-09-17T05:29:32.979822+0000","last_fullsized":"2024-09-17T05:29:32.979822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:46.701153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981768+0000","last_change":"2024-09-17T05:29:31.037735+0000","last_active":"2024-09-17T05:29:32.981768+0000","last_peered":"2024-09-17T05:29:32.981768+0000","last_clean":"2024-09-17T05:29:32.981768+0000","last_became_active":"2024-09-17T05:29:31.037189+0000","last_became_peered":"2024-09-17T05:29:31.037189+0000","last_unstale":"2024-09-17T05:29:32.981768+0000","last_undegraded":"2024-09-17T05:29:32.981768+0000","last_fullsized":"2024-09-17T05:29:32.981768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:37.842290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.982058+0000","last_change":"2024-09-17T05:29:31.026022+0000","last_active":"2024-09-17T05:29:32.982058+0000","last_peered":"2024-09-17T05:29:32.982058+0000","last_clean":"2024-09-17T05:29:32.982058+0000","last_became_active":"2024-09-17T05:29:31.025729+0000","last_became_peered":"2024-09-17T05:29:31.025729+0000","last_unstale":"2024-09-17T05:29:32.982058+0000","last_undegraded":"2024-09-17T05:29:32.982058+0000","last_fullsized":"2024-09-17T05:29:32.982058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:38.298679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.040687+0000","last_change":"2024-09-17T05:29:31.047343+0000","last_active":"2024-09-17T05:29:32.040687+0000","last_peered":"2024-09-17T05:29:32.040687+0000","last_clean":"2024-09-17T05:29:32.040687+0000","last_became_active":"2024-09-17T05:29:31.047035+0000","last_became_peered":"2024-09-17T05:29:31.047035+0000","last_unstale":"2024-09-17T05:29:32.040687+0000","last_undegraded":"2024-09-17T05:29:32.040687+0000","last_fullsized":"2024-09-17T05:29:32.040687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:58.768538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.979934+0000","last_change":"2024-09-17T05:29:31.050526+0000","last_active":"2024-09-17T05:29:32.979934+0000","last_peered":"2024-09-17T05:29:32.979934+0000","last_clean":"2024-09-17T05:29:32.979934+0000","last_became_active":"2024-09-17T05:29:31.050279+0000","last_became_peered":"2024-09-17T05:29:31.050279+0000","last_unstale":"2024-09-17T05:29:32.979934+0000","last_undegraded":"2024-09-17T05:29:32.979934+0000","last_fullsized":"2024-09-17T05:29:32.979934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:29.872740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.982426+0000","last_change":"2024-09-17T05:29:31.057477+0000","last_active":"2024-09-17T05:29:32.982426+0000","last_peered":"2024-09-17T05:29:32.982426+0000","last_clean":"2024-09-17T05:29:32.982426+0000","last_became_active":"2024-09-17T05:29:31.057272+0000","last_became_peered":"2024-09-17T05:29:31.057272+0000","last_unstale":"2024-09-17T05:29:32.982426+0000","last_undegraded":"2024-09-17T05:29:32.982426+0000","last_fullsized":"2024-09-17T05:29:32.982426+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:46.050930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.039028+0000","last_change":"2024-09-17T05:29:31.029300+0000","last_active":"2024-09-17T05:29:32.039028+0000","last_peered":"2024-09-17T05:29:32.039028+0000","last_clean":"2024-09-17T05:29:32.039028+0000","last_became_active":"2024-09-17T05:29:31.029037+0000","last_became_peered":"2024-09-17T05:29:31.029037+0000","last_unstale":"2024-09-17T05:29:32.039028+0000","last_undegraded":"2024-09-17T05:29:32.039028+0000","last_fullsized":"2024-09-17T05:29:32.039028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:11.700045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.979367+0000","last_change":"2024-09-17T05:29:31.044985+0000","last_active":"2024-09-17T05:29:32.979367+0000","last_peered":"2024-09-17T05:29:32.979367+0000","last_clean":"2024-09-17T05:29:32.979367+0000","last_became_active":"2024-09-17T05:29:31.044526+0000","last_became_peered":"2024-09-17T05:29:31.044526+0000","last_unstale":"2024-09-17T05:29:32.979367+0000","last_undegraded":"2024-09-17T05:29:32.979367+0000","last_fullsized":"2024-09-17T05:29:32.979367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:41.404523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981140+0000","last_change":"2024-09-17T05:29:31.034220+0000","last_active":"2024-09-17T05:29:32.981140+0000","last_peered":"2024-09-17T05:29:32.981140+0000","last_clean":"2024-09-17T05:29:32.981140+0000","last_became_active":"2024-09-17T05:29:31.033280+0000","last_became_peered":"2024-09-17T05:29:31.033280+0000","last_unstale":"2024-09-17T05:29:32.981140+0000","last_undegraded":"2024-09-17T05:29:32.981140+0000","last_fullsized":"2024-09-17T05:29:32.981140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:39.408940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.038637+0000","last_change":"2024-09-17T05:29:31.035965+0000","last_active":"2024-09-17T05:29:32.038637+0000","last_peered":"2024-09-17T05:29:32.038637+0000","last_clean":"2024-09-17T05:29:32.038637+0000","last_became_active":"2024-09-17T05:29:31.035694+0000","last_became_peered":"2024-09-17T05:29:31.035694+0000","last_unstale":"2024-09-17T05:29:32.038637+0000","last_undegraded":"2024-09-17T05:29:32.038637+0000","last_fullsized":"2024-09-17T05:29:32.038637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:51.268963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.982521+0000","last_change":"2024-09-17T05:29:31.033122+0000","last_active":"2024-09-17T05:29:32.982521+0000","last_peered":"2024-09-17T05:29:32.982521+0000","last_clean":"2024-09-17T05:29:32.982521+0000","last_became_active":"2024-09-17T05:29:31.032817+0000","last_became_peered":"2024-09-17T05:29:31.032817+0000","last_unstale":"2024-09-17T05:29:32.982521+0000","last_undegraded":"2024-09-17T05:29:32.982521+0000","last_fullsized":"2024-09-17T05:29:32.982521+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:25.017291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.982600+0000","last_change":"2024-09-17T05:29:31.037799+0000","last_active":"2024-09-17T05:29:32.982600+0000","last_peered":"2024-09-17T05:29:32.982600+0000","last_clean":"2024-09-17T05:29:32.982600+0000","last_became_active":"2024-09-17T05:29:31.036026+0000","last_became_peered":"2024-09-17T05:29:31.036026+0000","last_unstale":"2024-09-17T05:29:32.982600+0000","last_undegraded":"2024-09-17T05:29:32.982600+0000","last_fullsized":"2024-09-17T05:29:32.982600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:15.451071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981753+0000","last_change":"2024-09-17T05:29:31.048184+0000","last_active":"2024-09-17T05:29:32.981753+0000","last_peered":"2024-09-17T05:29:32.981753+0000","last_clean":"2024-09-17T05:29:32.981753+0000","last_became_active":"2024-09-17T05:29:31.047905+0000","last_became_peered":"2024-09-17T05:29:31.047905+0000","last_unstale":"2024-09-17T05:29:32.981753+0000","last_undegraded":"2024-09-17T05:29:32.981753+0000","last_fullsized":"2024-09-17T05:29:32.981753+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:52.349563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981553+0000","last_change":"2024-09-17T05:29:31.047331+0000","last_active":"2024-09-17T05:29:32.981553+0000","last_peered":"2024-09-17T05:29:32.981553+0000","last_clean":"2024-09-17T05:29:32.981553+0000","last_became_active":"2024-09-17T05:29:31.047018+0000","last_became_peered":"2024-09-17T05:29:31.047018+0000","last_unstale":"2024-09-17T05:29:32.981553+0000","last_undegraded":"2024-09-17T05:29:32.981553+0000","last_fullsized":"2024-09-17T05:29:32.981553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:37.474006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.980327+0000","last_change":"2024-09-17T05:29:31.030940+0000","last_active":"2024-09-17T05:29:32.980327+0000","last_peered":"2024-09-17T05:29:32.980327+0000","last_clean":"2024-09-17T05:29:32.980327+0000","last_became_active":"2024-09-17T05:29:31.024725+0000","last_became_peered":"2024-09-17T05:29:31.024725+0000","last_unstale":"2024-09-17T05:29:32.980327+0000","last_undegraded":"2024-09-17T05:29:32.980327+0000","last_fullsized":"2024-09-17T05:29:32.980327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:21:58.616438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.040251+0000","last_change":"2024-09-17T05:29:31.032704+0000","last_active":"2024-09-17T05:29:32.040251+0000","last_peered":"2024-09-17T05:29:32.040251+0000","last_clean":"2024-09-17T05:29:32.040251+0000","last_became_active":"2024-09-17T05:29:31.032434+0000","last_became_peered":"2024-09-17T05:29:31.032434+0000","last_unstale":"2024-09-17T05:29:32.040251+0000","last_undegraded":"2024-09-17T05:29:32.040251+0000","last_fullsized":"2024-09-17T05:29:32.040251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:21.417092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.040218+0000","last_change":"2024-09-17T05:29:31.031250+0000","last_active":"2024-09-17T05:29:32.040218+0000","last_peered":"2024-09-17T05:29:32.040218+0000","last_clean":"2024-09-17T05:29:32.040218+0000","last_became_active":"2024-09-17T05:29:31.030966+0000","last_became_peered":"2024-09-17T05:29:31.030966+0000","last_unstale":"2024-09-17T05:29:32.040218+0000","last_undegraded":"2024-09-17T05:29:32.040218+0000","last_fullsized":"2024-09-17T05:29:32.040218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:34:56.720469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.031183+0000","last_change":"2024-09-17T05:29:31.028263+0000","last_active":"2024-09-17T05:29:32.031183+0000","last_peered":"2024-09-17T05:29:32.031183+0000","last_clean":"2024-09-17T05:29:32.031183+0000","last_became_active":"2024-09-17T05:29:31.027980+0000","last_became_peered":"2024-09-17T05:29:31.027980+0000","last_unstale":"2024-09-17T05:29:32.031183+0000","last_undegraded":"2024-09-17T05:29:32.031183+0000","last_fullsized":"2024-09-17T05:29:32.031183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:48.705996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.038553+0000","last_change":"2024-09-17T05:29:31.025879+0000","last_active":"2024-09-17T05:29:32.038553+0000","last_peered":"2024-09-17T05:29:32.038553+0000","last_clean":"2024-09-17T05:29:32.038553+0000","last_became_active":"2024-09-17T05:29:31.025577+0000","last_became_peered":"2024-09-17T05:29:31.025577+0000","last_unstale":"2024-09-17T05:29:32.038553+0000","last_undegraded":"2024-09-17T05:29:32.038553+0000","last_fullsized":"2024-09-17T05:29:32.038553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:47.369890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.980951+0000","last_change":"2024-09-17T05:29:31.051988+0000","last_active":"2024-09-17T05:29:32.980951+0000","last_peered":"2024-09-17T05:29:32.980951+0000","last_clean":"2024-09-17T05:29:32.980951+0000","last_became_active":"2024-09-17T05:29:31.051423+0000","last_became_peered":"2024-09-17T05:29:31.051423+0000","last_unstale":"2024-09-17T05:29:32.980951+0000","last_undegraded":"2024-09-17T05:29:32.980951+0000","last_fullsized":"2024-09-17T05:29:32.980951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:38.298679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981905+0000","last_change":"2024-09-17T05:29:31.023972+0000","last_active":"2024-09-17T05:29:32.981905+0000","last_peered":"2024-09-17T05:29:32.981905+0000","last_clean":"2024-09-17T05:29:32.981905+0000","last_became_active":"2024-09-17T05:29:31.023522+0000","last_became_peered":"2024-09-17T05:29:31.023522+0000","last_unstale":"2024-09-17T05:29:32.981905+0000","last_undegraded":"2024-09-17T05:29:32.981905+0000","last_fullsized":"2024-09-17T05:29:32.981905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:06.400608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.980378+0000","last_change":"2024-09-17T05:29:31.040600+0000","last_active":"2024-09-17T05:29:32.980378+0000","last_peered":"2024-09-17T05:29:32.980378+0000","last_clean":"2024-09-17T05:29:32.980378+0000","last_became_active":"2024-09-17T05:29:31.040257+0000","last_became_peered":"2024-09-17T05:29:31.040257+0000","last_unstale":"2024-09-17T05:29:32.980378+0000","last_undegraded":"2024-09-17T05:29:32.980378+0000","last_fullsized":"2024-09-17T05:29:32.980378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:23.961602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.039067+0000","last_change":"2024-09-17T05:29:31.028513+0000","last_active":"2024-09-17T05:29:32.039067+0000","last_peered":"2024-09-17T05:29:32.039067+0000","last_clean":"2024-09-17T05:29:32.039067+0000","last_became_active":"2024-09-17T05:29:31.028260+0000","last_became_peered":"2024-09-17T05:29:31.028260+0000","last_unstale":"2024-09-17T05:29:32.039067+0000","last_undegraded":"2024-09-17T05:29:32.039067+0000","last_fullsized":"2024-09-17T05:29:32.039067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:25.295551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.040298+0000","last_change":"2024-09-17T05:29:31.039886+0000","last_active":"2024-09-17T05:29:32.040298+0000","last_peered":"2024-09-17T05:29:32.040298+0000","last_clean":"2024-09-17T05:29:32.040298+0000","last_became_active":"2024-09-17T05:29:31.039634+0000","last_became_peered":"2024-09-17T05:29:31.039634+0000","last_unstale":"2024-09-17T05:29:32.040298+0000","last_undegraded":"2024-09-17T05:29:32.040298+0000","last_fullsized":"2024-09-17T05:29:32.040298+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:57.326288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981760+0000","last_change":"2024-09-17T05:29:31.038032+0000","last_active":"2024-09-17T05:29:32.981760+0000","last_peered":"2024-09-17T05:29:32.981760+0000","last_clean":"2024-09-17T05:29:32.981760+0000","last_became_active":"2024-09-17T05:29:31.037747+0000","last_became_peered":"2024-09-17T05:29:31.037747+0000","last_unstale":"2024-09-17T05:29:32.981760+0000","last_undegraded":"2024-09-17T05:29:32.981760+0000","last_fullsized":"2024-09-17T05:29:32.981760+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:53.088380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981222+0000","last_change":"2024-09-17T05:29:31.037526+0000","last_active":"2024-09-17T05:29:32.981222+0000","last_peered":"2024-09-17T05:29:32.981222+0000","last_clean":"2024-09-17T05:29:32.981222+0000","last_became_active":"2024-09-17T05:29:31.037016+0000","last_became_peered":"2024-09-17T05:29:31.037016+0000","last_unstale":"2024-09-17T05:29:32.981222+0000","last_undegraded":"2024-09-17T05:29:32.981222+0000","last_fullsized":"2024-09-17T05:29:32.981222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:29.537607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981870+0000","last_change":"2024-09-17T05:29:31.024125+0000","last_active":"2024-09-17T05:29:32.981870+0000","last_peered":"2024-09-17T05:29:32.981870+0000","last_clean":"2024-09-17T05:29:32.981870+0000","last_became_active":"2024-09-17T05:29:31.023853+0000","last_became_peered":"2024-09-17T05:29:31.023853+0000","last_unstale":"2024-09-17T05:29:32.981870+0000","last_undegraded":"2024-09-17T05:29:32.981870+0000","last_fullsized":"2024-09-17T05:29:32.981870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:25.875439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.031829+0000","last_change":"2024-09-17T05:29:31.026083+0000","last_active":"2024-09-17T05:29:32.031829+0000","last_peered":"2024-09-17T05:29:32.031829+0000","last_clean":"2024-09-17T05:29:32.031829+0000","last_became_active":"2024-09-17T05:29:31.025816+0000","last_became_peered":"2024-09-17T05:29:31.025816+0000","last_unstale":"2024-09-17T05:29:32.031829+0000","last_undegraded":"2024-09-17T05:29:32.031829+0000","last_fullsized":"2024-09-17T05:29:32.031829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:13.721412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.982035+0000","last_change":"2024-09-17T05:29:30.038241+0000","last_active":"2024-09-17T05:29:32.982035+0000","last_peered":"2024-09-17T05:29:32.982035+0000","last_clean":"2024-09-17T05:29:32.982035+0000","last_became_active":"2024-09-17T05:29:30.037974+0000","last_became_peered":"2024-09-17T05:29:30.037974+0000","last_unstale":"2024-09-17T05:29:32.982035+0000","last_undegraded":"2024-09-17T05:29:32.982035+0000","last_fullsized":"2024-09-17T05:29:32.982035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:37.719016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981941+0000","last_change":"2024-09-17T05:29:31.033280+0000","last_active":"2024-09-17T05:29:32.981941+0000","last_peered":"2024-09-17T05:29:32.981941+0000","last_clean":"2024-09-17T05:29:32.981941+0000","last_became_active":"2024-09-17T05:29:31.032600+0000","last_became_peered":"2024-09-17T05:29:31.032600+0000","last_unstale":"2024-09-17T05:29:32.981941+0000","last_undegraded":"2024-09-17T05:29:32.981941+0000","last_fullsized":"2024-09-17T05:29:32.981941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:06.445161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.031845+0000","last_change":"2024-09-17T05:29:30.032413+0000","last_active":"2024-09-17T05:29:32.031845+0000","last_peered":"2024-09-17T05:29:32.031845+0000","last_clean":"2024-09-17T05:29:32.031845+0000","last_became_active":"2024-09-17T05:29:30.032149+0000","last_became_peered":"2024-09-17T05:29:30.032149+0000","last_unstale":"2024-09-17T05:29:32.031845+0000","last_undegraded":"2024-09-17T05:29:32.031845+0000","last_fullsized":"2024-09-17T05:29:32.031845+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:17.151481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.040692+0000","last_change":"2024-09-17T05:29:31.031338+0000","last_active":"2024-09-17T05:29:32.040692+0000","last_peered":"2024-09-17T05:29:32.040692+0000","last_clean":"2024-09-17T05:29:32.040692+0000","last_became_active":"2024-09-17T05:29:31.031073+0000","last_became_peered":"2024-09-17T05:29:31.031073+0000","last_unstale":"2024-09-17T05:29:32.040692+0000","last_undegraded":"2024-09-17T05:29:32.040692+0000","last_fullsized":"2024-09-17T05:29:32.040692+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:40.291616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981206+0000","last_change":"2024-09-17T05:29:30.025876+0000","last_active":"2024-09-17T05:29:32.981206+0000","last_peered":"2024-09-17T05:29:32.981206+0000","last_clean":"2024-09-17T05:29:32.981206+0000","last_became_active":"2024-09-17T05:29:30.025550+0000","last_became_peered":"2024-09-17T05:29:30.025550+0000","last_unstale":"2024-09-17T05:29:32.981206+0000","last_undegraded":"2024-09-17T05:29:32.981206+0000","last_fullsized":"2024-09-17T05:29:32.981206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:47.675197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.980553+0000","last_change":"2024-09-17T05:29:31.042039+0000","last_active":"2024-09-17T05:29:32.980553+0000","last_peered":"2024-09-17T05:29:32.980553+0000","last_clean":"2024-09-17T05:29:32.980553+0000","last_became_active":"2024-09-17T05:29:31.041734+0000","last_became_peered":"2024-09-17T05:29:31.041734+0000","last_unstale":"2024-09-17T05:29:32.980553+0000","last_undegraded":"2024-09-17T05:29:32.980553+0000","last_fullsized":"2024-09-17T05:29:32.980553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:04.419060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.980402+0000","last_change":"2024-09-17T05:29:30.020540+0000","last_active":"2024-09-17T05:29:32.980402+0000","last_peered":"2024-09-17T05:29:32.980402+0000","last_clean":"2024-09-17T05:29:32.980402+0000","last_became_active":"2024-09-17T05:29:30.020245+0000","last_became_peered":"2024-09-17T05:29:30.020245+0000","last_unstale":"2024-09-17T05:29:32.980402+0000","last_undegraded":"2024-09-17T05:29:32.980402+0000","last_fullsized":"2024-09-17T05:29:32.980402+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:04:18.077646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981988+0000","last_change":"2024-09-17T05:29:31.024134+0000","last_active":"2024-09-17T05:29:32.981988+0000","last_peered":"2024-09-17T05:29:32.981988+0000","last_clean":"2024-09-17T05:29:32.981988+0000","last_became_active":"2024-09-17T05:29:31.023844+0000","last_became_peered":"2024-09-17T05:29:31.023844+0000","last_unstale":"2024-09-17T05:29:32.981988+0000","last_undegraded":"2024-09-17T05:29:32.981988+0000","last_fullsized":"2024-09-17T05:29:32.981988+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:46.701153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.040368+0000","last_change":"2024-09-17T05:29:30.024679+0000","last_active":"2024-09-17T05:29:32.040368+0000","last_peered":"2024-09-17T05:29:32.040368+0000","last_clean":"2024-09-17T05:29:32.040368+0000","last_became_active":"2024-09-17T05:29:30.024267+0000","last_became_peered":"2024-09-17T05:29:30.024267+0000","last_unstale":"2024-09-17T05:29:32.040368+0000","last_undegraded":"2024-09-17T05:29:32.040368+0000","last_fullsized":"2024-09-17T05:29:32.040368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:08.994679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.038835+0000","last_change":"2024-09-17T05:29:31.038013+0000","last_active":"2024-09-17T05:29:32.038835+0000","last_peered":"2024-09-17T05:29:32.038835+0000","last_clean":"2024-09-17T05:29:32.038835+0000","last_became_active":"2024-09-17T05:29:31.034935+0000","last_became_peered":"2024-09-17T05:29:31.034935+0000","last_unstale":"2024-09-17T05:29:32.038835+0000","last_undegraded":"2024-09-17T05:29:32.038835+0000","last_fullsized":"2024-09-17T05:29:32.038835+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:41.554376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.040086+0000","last_change":"2024-09-17T05:29:30.024639+0000","last_active":"2024-09-17T05:29:32.040086+0000","last_peered":"2024-09-17T05:29:32.040086+0000","last_clean":"2024-09-17T05:29:32.040086+0000","last_became_active":"2024-09-17T05:29:30.024365+0000","last_became_peered":"2024-09-17T05:29:30.024365+0000","last_unstale":"2024-09-17T05:29:32.040086+0000","last_undegraded":"2024-09-17T05:29:32.040086+0000","last_fullsized":"2024-09-17T05:29:32.040086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:07.575837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.039950+0000","last_change":"2024-09-17T05:29:31.034331+0000","last_active":"2024-09-17T05:29:32.039950+0000","last_peered":"2024-09-17T05:29:32.039950+0000","last_clean":"2024-09-17T05:29:32.039950+0000","last_became_active":"2024-09-17T05:29:31.034087+0000","last_became_peered":"2024-09-17T05:29:31.034087+0000","last_unstale":"2024-09-17T05:29:32.039950+0000","last_undegraded":"2024-09-17T05:29:32.039950+0000","last_fullsized":"2024-09-17T05:29:32.039950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:54.917976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.979526+0000","last_change":"2024-09-17T05:29:30.031293+0000","last_active":"2024-09-17T05:29:32.979526+0000","last_peered":"2024-09-17T05:29:32.979526+0000","last_clean":"2024-09-17T05:29:32.979526+0000","last_became_active":"2024-09-17T05:29:30.030986+0000","last_became_peered":"2024-09-17T05:29:30.030986+0000","last_unstale":"2024-09-17T05:29:32.979526+0000","last_undegraded":"2024-09-17T05:29:32.979526+0000","last_fullsized":"2024-09-17T05:29:32.979526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:46.798188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.980828+0000","last_change":"2024-09-17T05:29:31.051979+0000","last_active":"2024-09-17T05:29:32.980828+0000","last_peered":"2024-09-17T05:29:32.980828+0000","last_clean":"2024-09-17T05:29:32.980828+0000","last_became_active":"2024-09-17T05:29:31.051625+0000","last_became_peered":"2024-09-17T05:29:31.051625+0000","last_unstale":"2024-09-17T05:29:32.980828+0000","last_undegraded":"2024-09-17T05:29:32.980828+0000","last_fullsized":"2024-09-17T05:29:32.980828+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:58.195833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.039777+0000","last_change":"2024-09-17T05:29:30.033292+0000","last_active":"2024-09-17T05:29:32.039777+0000","last_peered":"2024-09-17T05:29:32.039777+0000","last_clean":"2024-09-17T05:29:32.039777+0000","last_became_active":"2024-09-17T05:29:30.026990+0000","last_became_peered":"2024-09-17T05:29:30.026990+0000","last_unstale":"2024-09-17T05:29:32.039777+0000","last_undegraded":"2024-09-17T05:29:32.039777+0000","last_fullsized":"2024-09-17T05:29:32.039777+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:55.625306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.039457+0000","last_change":"2024-09-17T05:29:31.029216+0000","last_active":"2024-09-17T05:29:32.039457+0000","last_peered":"2024-09-17T05:29:32.039457+0000","last_clean":"2024-09-17T05:29:32.039457+0000","last_became_active":"2024-09-17T05:29:31.028948+0000","last_became_peered":"2024-09-17T05:29:31.028948+0000","last_unstale":"2024-09-17T05:29:32.039457+0000","last_undegraded":"2024-09-17T05:29:32.039457+0000","last_fullsized":"2024-09-17T05:29:32.039457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:30.086558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981524+0000","last_change":"2024-09-17T05:29:30.025407+0000","last_active":"2024-09-17T05:29:32.981524+0000","last_peered":"2024-09-17T05:29:32.981524+0000","last_clean":"2024-09-17T05:29:32.981524+0000","last_became_active":"2024-09-17T05:29:30.025045+0000","last_became_peered":"2024-09-17T05:29:30.025045+0000","last_unstale":"2024-09-17T05:29:32.981524+0000","last_undegraded":"2024-09-17T05:29:32.981524+0000","last_fullsized":"2024-09-17T05:29:32.981524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:18.593370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981375+0000","last_change":"2024-09-17T05:29:31.047596+0000","last_active":"2024-09-17T05:29:32.981375+0000","last_peered":"2024-09-17T05:29:32.981375+0000","last_clean":"2024-09-17T05:29:32.981375+0000","last_became_active":"2024-09-17T05:29:31.046981+0000","last_became_peered":"2024-09-17T05:29:31.046981+0000","last_unstale":"2024-09-17T05:29:32.981375+0000","last_undegraded":"2024-09-17T05:29:32.981375+0000","last_fullsized":"2024-09-17T05:29:32.981375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:56.447573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.031934+0000","last_change":"2024-09-17T05:29:30.039176+0000","last_active":"2024-09-17T05:29:32.031934+0000","last_peered":"2024-09-17T05:29:32.031934+0000","last_clean":"2024-09-17T05:29:32.031934+0000","last_became_active":"2024-09-17T05:29:30.038879+0000","last_became_peered":"2024-09-17T05:29:30.038879+0000","last_unstale":"2024-09-17T05:29:32.031934+0000","last_undegraded":"2024-09-17T05:29:32.031934+0000","last_fullsized":"2024-09-17T05:29:32.031934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:59.509124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981377+0000","last_change":"2024-09-17T05:29:31.024679+0000","last_active":"2024-09-17T05:29:32.981377+0000","last_peered":"2024-09-17T05:29:32.981377+0000","last_clean":"2024-09-17T05:29:32.981377+0000","last_became_active":"2024-09-17T05:29:31.024423+0000","last_became_peered":"2024-09-17T05:29:31.024423+0000","last_unstale":"2024-09-17T05:29:32.981377+0000","last_undegraded":"2024-09-17T05:29:32.981377+0000","last_fullsized":"2024-09-17T05:29:32.981377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:59:25.138586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.039188+0000","last_change":"2024-09-17T05:29:30.031860+0000","last_active":"2024-09-17T05:29:32.039188+0000","last_peered":"2024-09-17T05:29:32.039188+0000","last_clean":"2024-09-17T05:29:32.039188+0000","last_became_active":"2024-09-17T05:29:30.031367+0000","last_became_peered":"2024-09-17T05:29:30.031367+0000","last_unstale":"2024-09-17T05:29:32.039188+0000","last_undegraded":"2024-09-17T05:29:32.039188+0000","last_fullsized":"2024-09-17T05:29:32.039188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:45.017920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.039093+0000","last_change":"2024-09-17T05:29:31.049071+0000","last_active":"2024-09-17T05:29:32.039093+0000","last_peered":"2024-09-17T05:29:32.039093+0000","last_clean":"2024-09-17T05:29:32.039093+0000","last_became_active":"2024-09-17T05:29:31.048124+0000","last_became_peered":"2024-09-17T05:29:31.048124+0000","last_unstale":"2024-09-17T05:29:32.039093+0000","last_undegraded":"2024-09-17T05:29:32.039093+0000","last_fullsized":"2024-09-17T05:29:32.039093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:21.879491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981331+0000","last_change":"2024-09-17T05:29:30.022479+0000","last_active":"2024-09-17T05:29:32.981331+0000","last_peered":"2024-09-17T05:29:32.981331+0000","last_clean":"2024-09-17T05:29:32.981331+0000","last_became_active":"2024-09-17T05:29:30.022289+0000","last_became_peered":"2024-09-17T05:29:30.022289+0000","last_unstale":"2024-09-17T05:29:32.981331+0000","last_undegraded":"2024-09-17T05:29:32.981331+0000","last_fullsized":"2024-09-17T05:29:32.981331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:28.533583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.980330+0000","last_change":"2024-09-17T05:29:31.051924+0000","last_active":"2024-09-17T05:29:32.980330+0000","last_peered":"2024-09-17T05:29:32.980330+0000","last_clean":"2024-09-17T05:29:32.980330+0000","last_became_active":"2024-09-17T05:29:31.051611+0000","last_became_peered":"2024-09-17T05:29:31.051611+0000","last_unstale":"2024-09-17T05:29:32.980330+0000","last_undegraded":"2024-09-17T05:29:32.980330+0000","last_fullsized":"2024-09-17T05:29:32.980330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:57.326288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.040771+0000","last_change":"2024-09-17T05:29:30.028690+0000","last_active":"2024-09-17T05:29:32.040771+0000","last_peered":"2024-09-17T05:29:32.040771+0000","last_clean":"2024-09-17T05:29:32.040771+0000","last_became_active":"2024-09-17T05:29:30.028443+0000","last_became_peered":"2024-09-17T05:29:30.028443+0000","last_unstale":"2024-09-17T05:29:32.040771+0000","last_undegraded":"2024-09-17T05:29:32.040771+0000","last_fullsized":"2024-09-17T05:29:32.040771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:37.719016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981390+0000","last_change":"2024-09-17T05:29:31.032668+0000","last_active":"2024-09-17T05:29:32.981390+0000","last_peered":"2024-09-17T05:29:32.981390+0000","last_clean":"2024-09-17T05:29:32.981390+0000","last_became_active":"2024-09-17T05:29:31.032232+0000","last_became_peered":"2024-09-17T05:29:31.032232+0000","last_unstale":"2024-09-17T05:29:32.981390+0000","last_undegraded":"2024-09-17T05:29:32.981390+0000","last_fullsized":"2024-09-17T05:29:32.981390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:23.943569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.980405+0000","last_change":"2024-09-17T05:29:30.027854+0000","last_active":"2024-09-17T05:29:32.980405+0000","last_peered":"2024-09-17T05:29:32.980405+0000","last_clean":"2024-09-17T05:29:32.980405+0000","last_became_active":"2024-09-17T05:29:30.027150+0000","last_became_peered":"2024-09-17T05:29:30.027150+0000","last_unstale":"2024-09-17T05:29:32.980405+0000","last_undegraded":"2024-09-17T05:29:32.980405+0000","last_fullsized":"2024-09-17T05:29:32.980405+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:37.719016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.982083+0000","last_change":"2024-09-17T05:29:31.039269+0000","last_active":"2024-09-17T05:29:32.982083+0000","last_peered":"2024-09-17T05:29:32.982083+0000","last_clean":"2024-09-17T05:29:32.982083+0000","last_became_active":"2024-09-17T05:29:31.034973+0000","last_became_peered":"2024-09-17T05:29:31.034973+0000","last_unstale":"2024-09-17T05:29:32.982083+0000","last_undegraded":"2024-09-17T05:29:32.982083+0000","last_fullsized":"2024-09-17T05:29:32.982083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:00.214606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.979194+0000","last_change":"2024-09-17T05:29:30.026403+0000","last_active":"2024-09-17T05:29:32.979194+0000","last_peered":"2024-09-17T05:29:32.979194+0000","last_clean":"2024-09-17T05:29:32.979194+0000","last_became_active":"2024-09-17T05:29:30.026099+0000","last_became_peered":"2024-09-17T05:29:30.026099+0000","last_unstale":"2024-09-17T05:29:32.979194+0000","last_undegraded":"2024-09-17T05:29:32.979194+0000","last_fullsized":"2024-09-17T05:29:32.979194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:49.963436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981220+0000","last_change":"2024-09-17T05:29:31.032282+0000","last_active":"2024-09-17T05:29:32.981220+0000","last_peered":"2024-09-17T05:29:32.981220+0000","last_clean":"2024-09-17T05:29:32.981220+0000","last_became_active":"2024-09-17T05:29:31.032019+0000","last_became_peered":"2024-09-17T05:29:31.032019+0000","last_unstale":"2024-09-17T05:29:32.981220+0000","last_undegraded":"2024-09-17T05:29:32.981220+0000","last_fullsized":"2024-09-17T05:29:32.981220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:22.033352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.979522+0000","last_change":"2024-09-17T05:29:30.033228+0000","last_active":"2024-09-17T05:29:32.979522+0000","last_peered":"2024-09-17T05:29:32.979522+0000","last_clean":"2024-09-17T05:29:32.979522+0000","last_became_active":"2024-09-17T05:29:30.028139+0000","last_became_peered":"2024-09-17T05:29:30.028139+0000","last_unstale":"2024-09-17T05:29:32.979522+0000","last_undegraded":"2024-09-17T05:29:32.979522+0000","last_fullsized":"2024-09-17T05:29:32.979522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:42.503445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.040497+0000","last_change":"2024-09-17T05:29:31.027788+0000","last_active":"2024-09-17T05:29:32.040497+0000","last_peered":"2024-09-17T05:29:32.040497+0000","last_clean":"2024-09-17T05:29:32.040497+0000","last_became_active":"2024-09-17T05:29:31.027514+0000","last_became_peered":"2024-09-17T05:29:31.027514+0000","last_unstale":"2024-09-17T05:29:32.040497+0000","last_undegraded":"2024-09-17T05:29:32.040497+0000","last_fullsized":"2024-09-17T05:29:32.040497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:36.352750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.980862+0000","last_change":"2024-09-17T05:29:30.020135+0000","last_active":"2024-09-17T05:29:32.980862+0000","last_peered":"2024-09-17T05:29:32.980862+0000","last_clean":"2024-09-17T05:29:32.980862+0000","last_became_active":"2024-09-17T05:29:30.019373+0000","last_became_peered":"2024-09-17T05:29:30.019373+0000","last_unstale":"2024-09-17T05:29:32.980862+0000","last_undegraded":"2024-09-17T05:29:32.980862+0000","last_fullsized":"2024-09-17T05:29:32.980862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:34.640534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.039417+0000","last_change":"2024-09-17T05:29:31.024273+0000","last_active":"2024-09-17T05:29:32.039417+0000","last_peered":"2024-09-17T05:29:32.039417+0000","last_clean":"2024-09-17T05:29:32.039417+0000","last_became_active":"2024-09-17T05:29:31.024011+0000","last_became_peered":"2024-09-17T05:29:31.024011+0000","last_unstale":"2024-09-17T05:29:32.039417+0000","last_undegraded":"2024-09-17T05:29:32.039417+0000","last_fullsized":"2024-09-17T05:29:32.039417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:08.191860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.040569+0000","last_change":"2024-09-17T05:29:30.027029+0000","last_active":"2024-09-17T05:29:32.040569+0000","last_peered":"2024-09-17T05:29:32.040569+0000","last_clean":"2024-09-17T05:29:32.040569+0000","last_became_active":"2024-09-17T05:29:30.026725+0000","last_became_peered":"2024-09-17T05:29:30.026725+0000","last_unstale":"2024-09-17T05:29:32.040569+0000","last_undegraded":"2024-09-17T05:29:32.040569+0000","last_fullsized":"2024-09-17T05:29:32.040569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:53.771061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.980503+0000","last_change":"2024-09-17T05:29:31.041411+0000","last_active":"2024-09-17T05:29:32.980503+0000","last_peered":"2024-09-17T05:29:32.980503+0000","last_clean":"2024-09-17T05:29:32.980503+0000","last_became_active":"2024-09-17T05:29:31.041084+0000","last_became_peered":"2024-09-17T05:29:31.041084+0000","last_unstale":"2024-09-17T05:29:32.980503+0000","last_undegraded":"2024-09-17T05:29:32.980503+0000","last_fullsized":"2024-09-17T05:29:32.980503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:40.291616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.040594+0000","last_change":"2024-09-17T05:29:30.022634+0000","last_active":"2024-09-17T05:29:32.040594+0000","last_peered":"2024-09-17T05:29:32.040594+0000","last_clean":"2024-09-17T05:29:32.040594+0000","last_became_active":"2024-09-17T05:29:30.022310+0000","last_became_peered":"2024-09-17T05:29:30.022310+0000","last_unstale":"2024-09-17T05:29:32.040594+0000","last_undegraded":"2024-09-17T05:29:32.040594+0000","last_fullsized":"2024-09-17T05:29:32.040594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:46:03.944777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.979972+0000","last_change":"2024-09-17T05:29:31.021785+0000","last_active":"2024-09-17T05:29:32.979972+0000","last_peered":"2024-09-17T05:29:32.979972+0000","last_clean":"2024-09-17T05:29:32.979972+0000","last_became_active":"2024-09-17T05:29:31.021456+0000","last_became_peered":"2024-09-17T05:29:31.021456+0000","last_unstale":"2024-09-17T05:29:32.979972+0000","last_undegraded":"2024-09-17T05:29:32.979972+0000","last_fullsized":"2024-09-17T05:29:32.979972+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:31.813734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.040517+0000","last_change":"2024-09-17T05:29:30.025496+0000","last_active":"2024-09-17T05:29:32.040517+0000","last_peered":"2024-09-17T05:29:32.040517+0000","last_clean":"2024-09-17T05:29:32.040517+0000","last_became_active":"2024-09-17T05:29:30.025219+0000","last_became_peered":"2024-09-17T05:29:30.025219+0000","last_unstale":"2024-09-17T05:29:32.040517+0000","last_undegraded":"2024-09-17T05:29:32.040517+0000","last_fullsized":"2024-09-17T05:29:32.040517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:32.928878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.979617+0000","last_change":"2024-09-17T05:29:31.024339+0000","last_active":"2024-09-17T05:29:32.979617+0000","last_peered":"2024-09-17T05:29:32.979617+0000","last_clean":"2024-09-17T05:29:32.979617+0000","last_became_active":"2024-09-17T05:29:31.023677+0000","last_became_peered":"2024-09-17T05:29:31.023677+0000","last_unstale":"2024-09-17T05:29:32.979617+0000","last_undegraded":"2024-09-17T05:29:32.979617+0000","last_fullsized":"2024-09-17T05:29:32.979617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:38.912273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.031382+0000","last_change":"2024-09-17T05:29:30.027117+0000","last_active":"2024-09-17T05:29:32.031382+0000","last_peered":"2024-09-17T05:29:32.031382+0000","last_clean":"2024-09-17T05:29:32.031382+0000","last_became_active":"2024-09-17T05:29:30.026830+0000","last_became_peered":"2024-09-17T05:29:30.026830+0000","last_unstale":"2024-09-17T05:29:32.031382+0000","last_undegraded":"2024-09-17T05:29:32.031382+0000","last_fullsized":"2024-09-17T05:29:32.031382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:17.734645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.980400+0000","last_change":"2024-09-17T05:29:31.027977+0000","last_active":"2024-09-17T05:29:32.980400+0000","last_peered":"2024-09-17T05:29:32.980400+0000","last_clean":"2024-09-17T05:29:32.980400+0000","last_became_active":"2024-09-17T05:29:31.027716+0000","last_became_peered":"2024-09-17T05:29:31.027716+0000","last_unstale":"2024-09-17T05:29:32.980400+0000","last_undegraded":"2024-09-17T05:29:32.980400+0000","last_fullsized":"2024-09-17T05:29:32.980400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:56.605773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981210+0000","last_change":"2024-09-17T05:29:30.025711+0000","last_active":"2024-09-17T05:29:32.981210+0000","last_peered":"2024-09-17T05:29:32.981210+0000","last_clean":"2024-09-17T05:29:32.981210+0000","last_became_active":"2024-09-17T05:29:30.025383+0000","last_became_peered":"2024-09-17T05:29:30.025383+0000","last_unstale":"2024-09-17T05:29:32.981210+0000","last_undegraded":"2024-09-17T05:29:32.981210+0000","last_fullsized":"2024-09-17T05:29:32.981210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:46:03.944777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.979353+0000","last_change":"2024-09-17T05:29:31.026848+0000","last_active":"2024-09-17T05:29:32.979353+0000","last_peered":"2024-09-17T05:29:32.979353+0000","last_clean":"2024-09-17T05:29:32.979353+0000","last_became_active":"2024-09-17T05:29:31.026182+0000","last_became_peered":"2024-09-17T05:29:31.026182+0000","last_unstale":"2024-09-17T05:29:32.979353+0000","last_undegraded":"2024-09-17T05:29:32.979353+0000","last_fullsized":"2024-09-17T05:29:32.979353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:18.619243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.039778+0000","last_change":"2024-09-17T05:29:30.023058+0000","last_active":"2024-09-17T05:29:32.039778+0000","last_peered":"2024-09-17T05:29:32.039778+0000","last_clean":"2024-09-17T05:29:32.039778+0000","last_became_active":"2024-09-17T05:29:30.022656+0000","last_became_peered":"2024-09-17T05:29:30.022656+0000","last_unstale":"2024-09-17T05:29:32.039778+0000","last_undegraded":"2024-09-17T05:29:32.039778+0000","last_fullsized":"2024-09-17T05:29:32.039778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:01.930287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981711+0000","last_change":"2024-09-17T05:29:31.037451+0000","last_active":"2024-09-17T05:29:32.981711+0000","last_peered":"2024-09-17T05:29:32.981711+0000","last_clean":"2024-09-17T05:29:32.981711+0000","last_became_active":"2024-09-17T05:29:31.036913+0000","last_became_peered":"2024-09-17T05:29:31.036913+0000","last_unstale":"2024-09-17T05:29:32.981711+0000","last_undegraded":"2024-09-17T05:29:32.981711+0000","last_fullsized":"2024-09-17T05:29:32.981711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:01.049064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.038414+0000","last_change":"2024-09-17T05:29:30.028013+0000","last_active":"2024-09-17T05:29:32.038414+0000","last_peered":"2024-09-17T05:29:32.038414+0000","last_clean":"2024-09-17T05:29:32.038414+0000","last_became_active":"2024-09-17T05:29:30.027808+0000","last_became_peered":"2024-09-17T05:29:30.027808+0000","last_unstale":"2024-09-17T05:29:32.038414+0000","last_undegraded":"2024-09-17T05:29:32.038414+0000","last_fullsized":"2024-09-17T05:29:32.038414+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:52:38.570598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.980193+0000","last_change":"2024-09-17T05:29:31.029139+0000","last_active":"2024-09-17T05:29:32.980193+0000","last_peered":"2024-09-17T05:29:32.980193+0000","last_clean":"2024-09-17T05:29:32.980193+0000","last_became_active":"2024-09-17T05:29:31.028871+0000","last_became_peered":"2024-09-17T05:29:31.028871+0000","last_unstale":"2024-09-17T05:29:32.980193+0000","last_undegraded":"2024-09-17T05:29:32.980193+0000","last_fullsized":"2024-09-17T05:29:32.980193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:44.845248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.980987+0000","last_change":"2024-09-17T05:29:30.033401+0000","last_active":"2024-09-17T05:29:32.980987+0000","last_peered":"2024-09-17T05:29:32.980987+0000","last_clean":"2024-09-17T05:29:32.980987+0000","last_became_active":"2024-09-17T05:29:30.033220+0000","last_became_peered":"2024-09-17T05:29:30.033220+0000","last_unstale":"2024-09-17T05:29:32.980987+0000","last_undegraded":"2024-09-17T05:29:32.980987+0000","last_fullsized":"2024-09-17T05:29:32.980987+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:36.612466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.039480+0000","last_change":"2024-09-17T05:29:31.048795+0000","last_active":"2024-09-17T05:29:32.039480+0000","last_peered":"2024-09-17T05:29:32.039480+0000","last_clean":"2024-09-17T05:29:32.039480+0000","last_became_active":"2024-09-17T05:29:31.048572+0000","last_became_peered":"2024-09-17T05:29:31.048572+0000","last_unstale":"2024-09-17T05:29:32.039480+0000","last_undegraded":"2024-09-17T05:29:32.039480+0000","last_fullsized":"2024-09-17T05:29:32.039480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:52.006627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:33.016470+0000","last_change":"2024-09-17T05:29:30.027015+0000","last_active":"2024-09-17T05:29:33.016470+0000","last_peered":"2024-09-17T05:29:33.016470+0000","last_clean":"2024-09-17T05:29:33.016470+0000","last_became_active":"2024-09-17T05:29:30.026734+0000","last_became_peered":"2024-09-17T05:29:30.026734+0000","last_unstale":"2024-09-17T05:29:33.016470+0000","last_undegraded":"2024-09-17T05:29:33.016470+0000","last_fullsized":"2024-09-17T05:29:33.016470+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:16.539250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.031570+0000","last_change":"2024-09-17T05:29:31.047667+0000","last_active":"2024-09-17T05:29:32.031570+0000","last_peered":"2024-09-17T05:29:32.031570+0000","last_clean":"2024-09-17T05:29:32.031570+0000","last_became_active":"2024-09-17T05:29:31.047356+0000","last_became_peered":"2024-09-17T05:29:31.047356+0000","last_unstale":"2024-09-17T05:29:32.031570+0000","last_undegraded":"2024-09-17T05:29:32.031570+0000","last_fullsized":"2024-09-17T05:29:32.031570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:21.108594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.980559+0000","last_change":"2024-09-17T05:29:30.020232+0000","last_active":"2024-09-17T05:29:32.980559+0000","last_peered":"2024-09-17T05:29:32.980559+0000","last_clean":"2024-09-17T05:29:32.980559+0000","last_became_active":"2024-09-17T05:29:30.019974+0000","last_became_peered":"2024-09-17T05:29:30.019974+0000","last_unstale":"2024-09-17T05:29:32.980559+0000","last_undegraded":"2024-09-17T05:29:32.980559+0000","last_fullsized":"2024-09-17T05:29:32.980559+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:32.928878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981276+0000","last_change":"2024-09-17T05:29:31.036794+0000","last_active":"2024-09-17T05:29:32.981276+0000","last_peered":"2024-09-17T05:29:32.981276+0000","last_clean":"2024-09-17T05:29:32.981276+0000","last_became_active":"2024-09-17T05:29:31.036471+0000","last_became_peered":"2024-09-17T05:29:31.036471+0000","last_unstale":"2024-09-17T05:29:32.981276+0000","last_undegraded":"2024-09-17T05:29:32.981276+0000","last_fullsized":"2024-09-17T05:29:32.981276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:18.027184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.031481+0000","last_change":"2024-09-17T05:29:30.030593+0000","last_active":"2024-09-17T05:29:32.031481+0000","last_peered":"2024-09-17T05:29:32.031481+0000","last_clean":"2024-09-17T05:29:32.031481+0000","last_became_active":"2024-09-17T05:29:30.030314+0000","last_became_peered":"2024-09-17T05:29:30.030314+0000","last_unstale":"2024-09-17T05:29:32.031481+0000","last_undegraded":"2024-09-17T05:29:32.031481+0000","last_fullsized":"2024-09-17T05:29:32.031481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:03.224815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.031468+0000","last_change":"2024-09-17T05:29:31.034326+0000","last_active":"2024-09-17T05:29:32.031468+0000","last_peered":"2024-09-17T05:29:32.031468+0000","last_clean":"2024-09-17T05:29:32.031468+0000","last_became_active":"2024-09-17T05:29:31.033820+0000","last_became_peered":"2024-09-17T05:29:31.033820+0000","last_unstale":"2024-09-17T05:29:32.031468+0000","last_undegraded":"2024-09-17T05:29:32.031468+0000","last_fullsized":"2024-09-17T05:29:32.031468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:43.589542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.980516+0000","last_change":"2024-09-17T05:29:30.027531+0000","last_active":"2024-09-17T05:29:32.980516+0000","last_peered":"2024-09-17T05:29:32.980516+0000","last_clean":"2024-09-17T05:29:32.980516+0000","last_became_active":"2024-09-17T05:29:30.026833+0000","last_became_peered":"2024-09-17T05:29:30.026833+0000","last_unstale":"2024-09-17T05:29:32.980516+0000","last_undegraded":"2024-09-17T05:29:32.980516+0000","last_fullsized":"2024-09-17T05:29:32.980516+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:55.625306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.979339+0000","last_change":"2024-09-17T05:29:31.047375+0000","last_active":"2024-09-17T05:29:32.979339+0000","last_peered":"2024-09-17T05:29:32.979339+0000","last_clean":"2024-09-17T05:29:32.979339+0000","last_became_active":"2024-09-17T05:29:31.047112+0000","last_became_peered":"2024-09-17T05:29:31.047112+0000","last_unstale":"2024-09-17T05:29:32.979339+0000","last_undegraded":"2024-09-17T05:29:32.979339+0000","last_fullsized":"2024-09-17T05:29:32.979339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:25.875439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.039888+0000","last_change":"2024-09-17T05:29:30.029397+0000","last_active":"2024-09-17T05:29:32.039888+0000","last_peered":"2024-09-17T05:29:32.039888+0000","last_clean":"2024-09-17T05:29:32.039888+0000","last_became_active":"2024-09-17T05:29:30.029047+0000","last_became_peered":"2024-09-17T05:29:30.029047+0000","last_unstale":"2024-09-17T05:29:32.039888+0000","last_undegraded":"2024-09-17T05:29:32.039888+0000","last_fullsized":"2024-09-17T05:29:32.039888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:10.347043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.039840+0000","last_change":"2024-09-17T05:29:31.040311+0000","last_active":"2024-09-17T05:29:32.039840+0000","last_peered":"2024-09-17T05:29:32.039840+0000","last_clean":"2024-09-17T05:29:32.039840+0000","last_became_active":"2024-09-17T05:29:31.040038+0000","last_became_peered":"2024-09-17T05:29:31.040038+0000","last_unstale":"2024-09-17T05:29:32.039840+0000","last_undegraded":"2024-09-17T05:29:32.039840+0000","last_fullsized":"2024-09-17T05:29:32.039840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:39.592686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.979408+0000","last_change":"2024-09-17T05:29:30.028120+0000","last_active":"2024-09-17T05:29:32.979408+0000","last_peered":"2024-09-17T05:29:32.979408+0000","last_clean":"2024-09-17T05:29:32.979408+0000","last_became_active":"2024-09-17T05:29:30.027847+0000","last_became_peered":"2024-09-17T05:29:30.027847+0000","last_unstale":"2024-09-17T05:29:32.979408+0000","last_undegraded":"2024-09-17T05:29:32.979408+0000","last_fullsized":"2024-09-17T05:29:32.979408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:28:46.360410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.982361+0000","last_change":"2024-09-17T05:29:31.023027+0000","last_active":"2024-09-17T05:29:32.982361+0000","last_peered":"2024-09-17T05:29:32.982361+0000","last_clean":"2024-09-17T05:29:32.982361+0000","last_became_active":"2024-09-17T05:29:31.022725+0000","last_became_peered":"2024-09-17T05:29:31.022725+0000","last_unstale":"2024-09-17T05:29:32.982361+0000","last_undegraded":"2024-09-17T05:29:32.982361+0000","last_fullsized":"2024-09-17T05:29:32.982361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:29.994016+0000","last_clean_scrub_stamp":"2024-09-17T05:29:29.994016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:32:57.217136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.981143+0000","last_change":"2024-09-17T05:29:30.026649+0000","last_active":"2024-09-17T05:29:32.981143+0000","last_peered":"2024-09-17T05:29:32.981143+0000","last_clean":"2024-09-17T05:29:32.981143+0000","last_became_active":"2024-09-17T05:29:30.026366+0000","last_became_peered":"2024-09-17T05:29:30.026366+0000","last_unstale":"2024-09-17T05:29:32.981143+0000","last_undegraded":"2024-09-17T05:29:32.981143+0000","last_fullsized":"2024-09-17T05:29:32.981143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:29:28.989992+0000","last_clean_scrub_stamp":"2024-09-17T05:29:28.989992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:53.771061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T05:29:32.982157+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:29:32.982157+0000","last_peered":"2024-09-17T05:29:32.982157+0000","last_clean":"2024-09-17T05:29:32.982157+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:29:32.982157+0000","last_undegraded":"2024-09-17T05:29:32.982157+0000","last_fullsized":"2024-09-17T05:29:32.982157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":950272,"data_stored":725837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":360448,"data_stored":135995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":360448,"data_stored":135483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":137013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":135449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":137013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":360448,"data_stored":136051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":946176,"data_stored":725747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:29:35.608 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:29:35.609 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:29:35.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.796+0000 7f9cf3800640 1 -- 172.21.15.31:0/745168266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cec1605d0 msgr2=0x7f9cec0d0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:35.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.796+0000 7f9cf3800640 1 --2- 172.21.15.31:0/745168266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cec1605d0 0x7f9cec0d0690 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9cec073990 tx=0x7f9ce001c800 comp rx=0 tx=0).stop 2024-09-17T05:29:35.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.796+0000 7f9cf3800640 1 -- 172.21.15.31:0/745168266 shutdown_connections 2024-09-17T05:29:35.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.796+0000 7f9cf3800640 1 --2- 172.21.15.31:0/745168266 >> v2:172.21.15.155:3300/0 conn(0x7f9cec0b1650 0x7f9cec0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.796+0000 7f9cf3800640 1 --2- 172.21.15.31:0/745168266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cec1605d0 0x7f9cec0d0690 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.796+0000 7f9cf3800640 1 -- 172.21.15.31:0/745168266 >> 172.21.15.31:0/745168266 conn(0x7f9cec0d1dd0 msgr2=0x7f9cec0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:35.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.796+0000 7f9cf3800640 1 -- 172.21.15.31:0/745168266 shutdown_connections 2024-09-17T05:29:35.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.796+0000 7f9cf3800640 1 -- 172.21.15.31:0/745168266 wait complete. 2024-09-17T05:29:35.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cf3800640 1 Processor -- start 2024-09-17T05:29:35.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cf3800640 1 -- start start 2024-09-17T05:29:35.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cf3800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cec0aeb00 0x7f9cec156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:35.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cf3800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cec0b1650 0x7f9cec0c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:35.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cf3800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cec1605d0 0x7f9cec0c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:35.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cf3800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9cec0b0810 con 0x7f9cec0b1650 2024-09-17T05:29:35.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cf3800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9cec0b0ee0 con 0x7f9cec1605d0 2024-09-17T05:29:35.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cf3800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9cec0b1220 con 0x7f9cec0aeb00 2024-09-17T05:29:35.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cebe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cec0b1650 0x7f9cec0c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:35.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cebe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cec0b1650 0x7f9cec0c8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35410/0 (socket says 172.21.15.31:35410) 2024-09-17T05:29:35.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cebe00640 1 -- 172.21.15.31:0/353026994 learned_addr learned my addr 172.21.15.31:0/353026994 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:35.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cf0e00640 1 --2- 172.21.15.31:0/353026994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cec0aeb00 0x7f9cec156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:35.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cf1800640 1 --2- 172.21.15.31:0/353026994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cec1605d0 0x7f9cec0c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:35.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cebe00640 1 -- 172.21.15.31:0/353026994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cec0aeb00 msgr2=0x7f9cec156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:35.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cebe00640 1 --2- 172.21.15.31:0/353026994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cec0aeb00 0x7f9cec156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cebe00640 1 -- 172.21.15.31:0/353026994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cec1605d0 msgr2=0x7f9cec0c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:35.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cebe00640 1 --2- 172.21.15.31:0/353026994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cec1605d0 0x7f9cec0c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:35.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cebe00640 1 -- 172.21.15.31:0/353026994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cec1574f0 con 0x7f9cec0b1650 2024-09-17T05:29:35.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cebe00640 1 --2- 172.21.15.31:0/353026994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cec0b1650 0x7f9cec0c8ea0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800d980 tx=0x7f9cd800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:35.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9ce8c00640 1 -- 172.21.15.31:0/353026994 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8017070 con 0x7f9cec0b1650 2024-09-17T05:29:35.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9ce8c00640 1 -- 172.21.15.31:0/353026994 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cd8009d20 con 0x7f9cec0b1650 2024-09-17T05:29:35.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9ce8c00640 1 -- 172.21.15.31:0/353026994 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8004280 con 0x7f9cec0b1650 2024-09-17T05:29:35.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cf3800640 1 -- 172.21.15.31:0/353026994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cec145510 con 0x7f9cec0b1650 2024-09-17T05:29:35.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.800+0000 7f9cf3800640 1 -- 172.21.15.31:0/353026994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cec145ad0 con 0x7f9cec0b1650 2024-09-17T05:29:35.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.804+0000 7f9cf3800640 1 -- 172.21.15.31:0/353026994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cec0b1a30 con 0x7f9cec0b1650 2024-09-17T05:29:35.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.804+0000 7f9ce8c00640 1 -- 172.21.15.31:0/353026994 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f9cd8003600 con 0x7f9cec0b1650 2024-09-17T05:29:35.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.804+0000 7f9ce8c00640 1 --2- 172.21.15.31:0/353026994 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9ccc073200 0x7f9ccc0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:35.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.804+0000 7f9ce8c00640 1 -- 172.21.15.31:0/353026994 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f9cd80946d0 con 0x7f9cec0b1650 2024-09-17T05:29:35.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.804+0000 7f9cf0e00640 1 --2- 172.21.15.31:0/353026994 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9ccc073200 0x7f9ccc0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:35.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.804+0000 7f9cf0e00640 1 --2- 172.21.15.31:0/353026994 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9ccc073200 0x7f9ccc0756c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00af000 tx=0x7f9ce001b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:35.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:35.808+0000 7f9ce8c00640 1 -- 172.21.15.31:0/353026994 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9cd805f770 con 0x7f9cec0b1650 2024-09-17T05:29:35.855 INFO:tasks.ceph.mds.b.smithi155.stderr:2024-09-17T05:29:35.851+0000 7f8758800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:29:36.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.048+0000 7f9cf3800640 1 -- 172.21.15.31:0/353026994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f9cec0b0210 con 0x7f9cec0b1650 2024-09-17T05:29:36.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.056+0000 7f9ce8c00640 1 -- 172.21.15.31:0/353026994 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f9cd805f070 con 0x7f9cec0b1650 2024-09-17T05:29:36.060 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-09-17T05:29:36.060 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw== 2024-09-17T05:29:36.060 INFO:teuthology.orchestra.run.smithi031.stdout: caps mds = "allow" 2024-09-17T05:29:36.060 INFO:teuthology.orchestra.run.smithi031.stdout: caps mon = "allow r" 2024-09-17T05:29:36.060 INFO:teuthology.orchestra.run.smithi031.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:29:36.060 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2024-09-17T05:29:36.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.056+0000 7f9cf3800640 1 -- 172.21.15.31:0/353026994 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9ccc073200 msgr2=0x7f9ccc0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:36.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.056+0000 7f9cf3800640 1 --2- 172.21.15.31:0/353026994 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9ccc073200 0x7f9ccc0756c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00af000 tx=0x7f9ce001b040 comp rx=0 tx=0).stop 2024-09-17T05:29:36.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.056+0000 7f9cf3800640 1 -- 172.21.15.31:0/353026994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cec0b1650 msgr2=0x7f9cec0c8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:36.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.056+0000 7f9cf3800640 1 --2- 172.21.15.31:0/353026994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cec0b1650 0x7f9cec0c8ea0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800d980 tx=0x7f9cd800de40 comp rx=0 tx=0).stop 2024-09-17T05:29:36.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.056+0000 7f9cf3800640 1 -- 172.21.15.31:0/353026994 shutdown_connections 2024-09-17T05:29:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.056+0000 7f9cf3800640 1 --2- 172.21.15.31:0/353026994 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9ccc073200 0x7f9ccc0756c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.056+0000 7f9cf3800640 1 --2- 172.21.15.31:0/353026994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9cec1605d0 0x7f9cec0c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.056+0000 7f9cf3800640 1 --2- 172.21.15.31:0/353026994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9cec0b1650 0x7f9cec0c8ea0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.056+0000 7f9cf3800640 1 --2- 172.21.15.31:0/353026994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9cec0aeb00 0x7f9cec156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.056+0000 7f9cf3800640 1 -- 172.21.15.31:0/353026994 >> 172.21.15.31:0/353026994 conn(0x7f9cec0d1dd0 msgr2=0x7f9cec159f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.056+0000 7f9cf3800640 1 -- 172.21.15.31:0/353026994 shutdown_connections 2024-09-17T05:29:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.056+0000 7f9cf3800640 1 -- 172.21.15.31:0/353026994 wait complete. 2024-09-17T05:29:36.082 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:29:36.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.224+0000 7fba52000640 1 -- 172.21.15.31:0/2137398040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba30004810 msgr2=0x7fba30004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:36.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.224+0000 7fba52000640 1 --2- 172.21.15.31:0/2137398040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba30004810 0x7fba30004c90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fba3400ac70 tx=0x7fba3401e0d0 comp rx=0 tx=0).stop 2024-09-17T05:29:36.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.224+0000 7fba4be00640 1 -- 172.21.15.31:0/2137398040 reap_dead start 2024-09-17T05:29:36.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.224+0000 7fba52000640 1 -- 172.21.15.31:0/2137398040 shutdown_connections 2024-09-17T05:29:36.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.224+0000 7fba52000640 1 -- 172.21.15.31:0/2137398040 >> 172.21.15.31:0/2137398040 conn(0x7fba4c0b18f0 msgr2=0x7fba4c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:36.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.224+0000 7fba52000640 1 -- 172.21.15.31:0/2137398040 shutdown_connections 2024-09-17T05:29:36.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.224+0000 7fba52000640 1 -- 172.21.15.31:0/2137398040 wait complete. 2024-09-17T05:29:36.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.224+0000 7fba52000640 1 Processor -- start 2024-09-17T05:29:36.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.224+0000 7fba52000640 1 -- start start 2024-09-17T05:29:36.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.224+0000 7fba52000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba30004810 0x7fba4c1ec470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:36.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.224+0000 7fba52000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba4c15a730 0x7fba4c1fb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:36.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.224+0000 7fba52000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba4c0b0b50 0x7fba4c0b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:36.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.224+0000 7fba52000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c0cf030 con 0x7fba4c0b0b50 2024-09-17T05:29:36.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.224+0000 7fba52000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c0ceeb0 con 0x7fba4c15a730 2024-09-17T05:29:36.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.224+0000 7fba52000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fba4c0cf1b0 con 0x7fba30004810 2024-09-17T05:29:36.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.228+0000 7fba4be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba4c0b0b50 0x7fba4c0b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:36.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.228+0000 7fba4be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba4c0b0b50 0x7fba4c0b1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35416/0 (socket says 172.21.15.31:35416) 2024-09-17T05:29:36.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.228+0000 7fba4be00640 1 -- 172.21.15.31:0/1770346307 learned_addr learned my addr 172.21.15.31:0/1770346307 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:36.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.228+0000 7fba4b400640 1 --2- 172.21.15.31:0/1770346307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba30004810 0x7fba4c1ec470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:36.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.228+0000 7fba43e00640 1 --2- 172.21.15.31:0/1770346307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba4c15a730 0x7fba4c1fb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:36.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.228+0000 7fba4be00640 1 -- 172.21.15.31:0/1770346307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba30004810 msgr2=0x7fba4c1ec470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:36.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.228+0000 7fba4be00640 1 --2- 172.21.15.31:0/1770346307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba30004810 0x7fba4c1ec470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:36.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.228+0000 7fba4be00640 1 -- 172.21.15.31:0/1770346307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba4c15a730 msgr2=0x7fba4c1fb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:36.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.228+0000 7fba4be00640 1 --2- 172.21.15.31:0/1770346307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba4c15a730 0x7fba4c1fb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:36.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.228+0000 7fba4be00640 1 -- 172.21.15.31:0/1770346307 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4c1fbe70 con 0x7fba4c0b0b50 2024-09-17T05:29:36.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.228+0000 7fba4be00640 1 --2- 172.21.15.31:0/1770346307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba4c0b0b50 0x7fba4c0b1000 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0cd4e0 tx=0x7fba44010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:36.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.228+0000 7fba43400640 1 -- 172.21.15.31:0/1770346307 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4400ed50 con 0x7fba4c0b0b50 2024-09-17T05:29:36.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.228+0000 7fba43400640 1 -- 172.21.15.31:0/1770346307 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba44015070 con 0x7fba4c0b0b50 2024-09-17T05:29:36.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.228+0000 7fba43400640 1 -- 172.21.15.31:0/1770346307 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44003be0 con 0x7fba4c0b0b50 2024-09-17T05:29:36.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.228+0000 7fba52000640 1 -- 172.21.15.31:0/1770346307 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba4c1fc150 con 0x7fba4c0b0b50 2024-09-17T05:29:36.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.228+0000 7fba52000640 1 -- 172.21.15.31:0/1770346307 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba4c09aab0 con 0x7fba4c0b0b50 2024-09-17T05:29:36.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.228+0000 7fba52000640 1 -- 172.21.15.31:0/1770346307 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba4c069410 con 0x7fba4c0b0b50 2024-09-17T05:29:36.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.228+0000 7fba43400640 1 -- 172.21.15.31:0/1770346307 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fba44004030 con 0x7fba4c0b0b50 2024-09-17T05:29:36.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.232+0000 7fba43400640 1 --2- 172.21.15.31:0/1770346307 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fba28073200 0x7fba280756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:36.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.232+0000 7fba43400640 1 -- 172.21.15.31:0/1770346307 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fba440947c0 con 0x7fba4c0b0b50 2024-09-17T05:29:36.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.232+0000 7fba4b400640 1 --2- 172.21.15.31:0/1770346307 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fba28073200 0x7fba280756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:36.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.232+0000 7fba4b400640 1 --2- 172.21.15.31:0/1770346307 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fba28073200 0x7fba280756c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fba3c006fd0 tx=0x7fba3c006b40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:36.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.236+0000 7fba43400640 1 -- 172.21.15.31:0/1770346307 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fba4405f210 con 0x7fba4c0b0b50 2024-09-17T05:29:36.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.444+0000 7fba52000640 1 -- 172.21.15.31:0/1770346307 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba4c0acd40 con 0x7fba4c0b0b50 2024-09-17T05:29:36.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.444+0000 7fba43400640 1 -- 172.21.15.31:0/1770346307 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5229 (secure 0 0 0) 0x7fba44063c40 con 0x7fba4c0b0b50 2024-09-17T05:29:36.449 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:36.449 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"btime":"2024-09-17T05:29:34:044429+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3266973645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3266973645},{"type":"v1","addr":"172.21.15.155:6837","nonce":3266973645}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4673,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3624429107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3624429107},{"type":"v1","addr":"172.21.15.31:6835","nonce":3624429107}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4878,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1163918742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1163918742},{"type":"v1","addr":"172.21.15.31:6834","nonce":1163918742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:29:30.419105+0000","modified":"2024-09-17T05:29:33.450065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4881":{"gid":4881,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/2317915643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2317915643},{"type":"v1","addr":"172.21.15.155:6836","nonce":2317915643}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4881,"qdb_cluster":[4881]},"id":2}]} 2024-09-17T05:29:36.450 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 17 2024-09-17T05:29:36.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.444+0000 7fba52000640 1 -- 172.21.15.31:0/1770346307 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fba28073200 msgr2=0x7fba280756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:36.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.444+0000 7fba52000640 1 --2- 172.21.15.31:0/1770346307 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fba28073200 0x7fba280756c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fba3c006fd0 tx=0x7fba3c006b40 comp rx=0 tx=0).stop 2024-09-17T05:29:36.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.444+0000 7fba52000640 1 -- 172.21.15.31:0/1770346307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba4c0b0b50 msgr2=0x7fba4c0b1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:36.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.444+0000 7fba52000640 1 --2- 172.21.15.31:0/1770346307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba4c0b0b50 0x7fba4c0b1000 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0cd4e0 tx=0x7fba44010e80 comp rx=0 tx=0).stop 2024-09-17T05:29:36.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.444+0000 7fba52000640 1 -- 172.21.15.31:0/1770346307 shutdown_connections 2024-09-17T05:29:36.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.444+0000 7fba52000640 1 --2- 172.21.15.31:0/1770346307 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fba28073200 0x7fba280756c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:36.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.444+0000 7fba52000640 1 --2- 172.21.15.31:0/1770346307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba4c0b0b50 0x7fba4c0b1000 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:36.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.444+0000 7fba52000640 1 --2- 172.21.15.31:0/1770346307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba4c15a730 0x7fba4c1fb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:36.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.444+0000 7fba52000640 1 --2- 172.21.15.31:0/1770346307 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba30004810 0x7fba4c1ec470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:36.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.444+0000 7fba52000640 1 -- 172.21.15.31:0/1770346307 >> 172.21.15.31:0/1770346307 conn(0x7fba4c0b18f0 msgr2=0x7fba4c162450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:36.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.444+0000 7fba52000640 1 -- 172.21.15.31:0/1770346307 shutdown_connections 2024-09-17T05:29:36.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:36.444+0000 7fba52000640 1 -- 172.21.15.31:0/1770346307 wait complete. 2024-09-17T05:29:36.874 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:29:30.419105+0000', 'modified': '2024-09-17T05:29:33.450065+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4881}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4881': {'gid': 4881, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6836/2317915643', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 2317915643}, {'type': 'v1', 'addr': '172.21.15.155:6836', 'nonce': 2317915643}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4881, 'qdb_cluster': [4881]} 2024-09-17T05:29:36.874 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:29:36.875 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T05:29:37.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.020+0000 7f574f400640 1 -- 172.21.15.31:0/3746610264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57480b7ab0 msgr2=0x7f57480b7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:37.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.020+0000 7f574f400640 1 --2- 172.21.15.31:0/3746610264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57480b7ab0 0x7f57480b7ec0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f574808e420 tx=0x7f574001cd80 comp rx=0 tx=0).stop 2024-09-17T05:29:37.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.020+0000 7f574f400640 1 -- 172.21.15.31:0/3746610264 shutdown_connections 2024-09-17T05:29:37.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.020+0000 7f574f400640 1 --2- 172.21.15.31:0/3746610264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57480b7ab0 0x7f57480b7ec0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.020+0000 7f574f400640 1 --2- 172.21.15.31:0/3746610264 >> v2:172.21.15.155:3300/0 conn(0x7f57480d2060 0x7f57480cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.020+0000 7f574f400640 1 -- 172.21.15.31:0/3746610264 >> 172.21.15.31:0/3746610264 conn(0x7f57480d3fe0 msgr2=0x7f57480d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:37.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.020+0000 7f574f400640 1 -- 172.21.15.31:0/3746610264 shutdown_connections 2024-09-17T05:29:37.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.020+0000 7f574f400640 1 -- 172.21.15.31:0/3746610264 wait complete. 2024-09-17T05:29:37.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f574f400640 1 Processor -- start 2024-09-17T05:29:37.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f574f400640 1 -- start start 2024-09-17T05:29:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f574f400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57480b7ab0 0x7f57480b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f574f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57480d2060 0x7f57480cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f574f400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57480d2440 0x7f57480cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f574f400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f574816b610 con 0x7f57480d2060 2024-09-17T05:29:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f574f400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f574816b490 con 0x7f57480b7ab0 2024-09-17T05:29:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f574f400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f574816b790 con 0x7f57480d2440 2024-09-17T05:29:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f573fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57480d2060 0x7f57480cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f573fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57480d2060 0x7f57480cc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35442/0 (socket says 172.21.15.31:35442) 2024-09-17T05:29:37.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f573fe00640 1 -- 172.21.15.31:0/2190110000 learned_addr learned my addr 172.21.15.31:0/2190110000 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f574d400640 1 --2- 172.21.15.31:0/2190110000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57480d2440 0x7f57480cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f574ca00640 1 --2- 172.21.15.31:0/2190110000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57480b7ab0 0x7f57480b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f573fe00640 1 -- 172.21.15.31:0/2190110000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57480d2440 msgr2=0x7f57480cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f573fe00640 1 --2- 172.21.15.31:0/2190110000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57480d2440 0x7f57480cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f573fe00640 1 -- 172.21.15.31:0/2190110000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57480b7ab0 msgr2=0x7f57480b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f573fe00640 1 --2- 172.21.15.31:0/2190110000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57480b7ab0 0x7f57480b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f573fe00640 1 -- 172.21.15.31:0/2190110000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57480cb150 con 0x7f57480d2060 2024-09-17T05:29:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f574ca00640 1 --2- 172.21.15.31:0/2190110000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57480b7ab0 0x7f57480b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:37.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f573fe00640 1 --2- 172.21.15.31:0/2190110000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57480d2060 0x7f57480cc770 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f573000c3c0 tx=0x7f573000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:37.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f5745600640 1 -- 172.21.15.31:0/2190110000 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5730017070 con 0x7f57480d2060 2024-09-17T05:29:37.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f5745600640 1 -- 172.21.15.31:0/2190110000 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57300053c0 con 0x7f57480d2060 2024-09-17T05:29:37.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f5745600640 1 -- 172.21.15.31:0/2190110000 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5730003860 con 0x7f57480d2060 2024-09-17T05:29:37.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f574f400640 1 -- 172.21.15.31:0/2190110000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57480ca870 con 0x7f57480d2060 2024-09-17T05:29:37.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.024+0000 7f574f400640 1 -- 172.21.15.31:0/2190110000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57480cae30 con 0x7f57480d2060 2024-09-17T05:29:37.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.028+0000 7f5745600640 1 -- 172.21.15.31:0/2190110000 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f573001a070 con 0x7f57480d2060 2024-09-17T05:29:37.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.028+0000 7f5745600640 1 --2- 172.21.15.31:0/2190110000 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5724073200 0x7f57240756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.028+0000 7f5745600640 1 -- 172.21.15.31:0/2190110000 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f57300934e0 con 0x7f57480d2060 2024-09-17T05:29:37.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.028+0000 7f57528e7000 1 Processor -- start 2024-09-17T05:29:37.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.028+0000 7f574ca00640 1 --2- 172.21.15.31:0/2190110000 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5724073200 0x7f57240756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.028+0000 7f57528e7000 1 -- start start 2024-09-17T05:29:37.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.028+0000 7f574ca00640 1 --2- 172.21.15.31:0/2190110000 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5724073200 0x7f57240756c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5738006fd0 tx=0x7f5738008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:37.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.028+0000 7f57528e7000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90f09d0 0x5578f90f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.028+0000 7f57528e7000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f12f0 0x5578f90a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.028+0000 7f57528e7000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90a4e10 0x5578f90a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.028+0000 7f57528e7000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5578f8fc53f0 con 0x5578f90f12f0 2024-09-17T05:29:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.028+0000 7f57528e7000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5578f8f02b20 con 0x5578f90a4e10 2024-09-17T05:29:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.028+0000 7f57528e7000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5578f8ef1f50 con 0x5578f90f09d0 2024-09-17T05:29:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.028+0000 7f573fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f12f0 0x5578f90a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.028+0000 7f573fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f12f0 0x5578f90a48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35450/0 (socket says 172.21.15.31:35450) 2024-09-17T05:29:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.028+0000 7f573fe00640 1 -- 172.21.15.31:0/4198862844 learned_addr learned my addr 172.21.15.31:0/4198862844 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f574d400640 1 --2- 172.21.15.31:0/4198862844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90a4e10 0x5578f90a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f574ca00640 1 --2- 172.21.15.31:0/4198862844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90f09d0 0x5578f90f0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f573fe00640 1 -- 172.21.15.31:0/4198862844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90f09d0 msgr2=0x5578f90f0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:29:37.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f573fe00640 1 --2- 172.21.15.31:0/4198862844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90f09d0 0x5578f90f0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f573fe00640 1 -- 172.21.15.31:0/4198862844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90a4e10 msgr2=0x5578f90a51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:29:37.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f573fe00640 1 --2- 172.21.15.31:0/4198862844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90a4e10 0x5578f90a51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f573fe00640 1 -- 172.21.15.31:0/4198862844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578f8eb9590 con 0x5578f90f12f0 2024-09-17T05:29:37.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f574d400640 1 --2- 172.21.15.31:0/4198862844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90a4e10 0x5578f90a51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:29:37.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f574ca00640 1 --2- 172.21.15.31:0/4198862844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90f09d0 0x5578f90f0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:29:37.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f573fe00640 1 --2- 172.21.15.31:0/4198862844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f12f0 0x5578f90a48d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f573000a040 tx=0x7f573005dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff3e3e6aa208f35 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:37.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f573d600640 1 -- 172.21.15.31:0/4198862844 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5730067780 con 0x5578f90f12f0 2024-09-17T05:29:37.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f573d600640 1 -- 172.21.15.31:0/4198862844 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57300930d0 con 0x5578f90f12f0 2024-09-17T05:29:37.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f573d600640 1 -- 172.21.15.31:0/4198862844 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5730065bc0 con 0x5578f90f12f0 2024-09-17T05:29:37.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f57528e7000 1 -- 172.21.15.31:0/4198862844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f12f0 msgr2=0x5578f90a48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:37.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f57528e7000 1 --2- 172.21.15.31:0/4198862844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f12f0 0x5578f90a48d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f573000a040 tx=0x7f573005dda0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f57528e7000 1 -- 172.21.15.31:0/4198862844 shutdown_connections 2024-09-17T05:29:37.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f57528e7000 1 --2- 172.21.15.31:0/4198862844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90a4e10 0x5578f90a51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f57528e7000 1 --2- 172.21.15.31:0/4198862844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f12f0 0x5578f90a48d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f57528e7000 1 --2- 172.21.15.31:0/4198862844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90f09d0 0x5578f90f0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f57528e7000 1 -- 172.21.15.31:0/4198862844 >> 172.21.15.31:0/4198862844 conn(0x5578f8f8e130 msgr2=0x5578f90d3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:37.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f57528e7000 1 -- 172.21.15.31:0/4198862844 shutdown_connections 2024-09-17T05:29:37.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f57528e7000 1 -- 172.21.15.31:0/4198862844 wait complete. 2024-09-17T05:29:37.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f57528e7000 1 -- start start 2024-09-17T05:29:37.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f57528e7000 1 Processor -- start 2024-09-17T05:29:37.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f57528e7000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90a4e10 0x5578f90d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f57528e7000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90f09d0 0x5578f90d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f57528e7000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f12f0 0x5578f90d23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f57528e7000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5578f8e8c5d0 con 0x5578f90f12f0 2024-09-17T05:29:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f57528e7000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5578f8ef5d60 con 0x5578f90f09d0 2024-09-17T05:29:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f57528e7000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5578f8e98500 con 0x5578f90a4e10 2024-09-17T05:29:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f57528e7000 10 client.0 _ll_register_callbacks cb 0x5578f8e9c810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:29:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f574d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f12f0 0x5578f90d23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f574d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f12f0 0x5578f90d23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35452/0 (socket says 172.21.15.31:35452) 2024-09-17T05:29:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f574d400640 1 -- 172.21.15.31:0/1678720182 learned_addr learned my addr 172.21.15.31:0/1678720182 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f573fe00640 1 --2- 172.21.15.31:0/1678720182 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90f09d0 0x5578f90d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.032+0000 7f574ca00640 1 --2- 172.21.15.31:0/1678720182 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90a4e10 0x5578f90d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f574d400640 1 -- 172.21.15.31:0/1678720182 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90a4e10 msgr2=0x5578f90d16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:29:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f574d400640 1 --2- 172.21.15.31:0/1678720182 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90a4e10 0x5578f90d16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f574d400640 1 -- 172.21.15.31:0/1678720182 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90f09d0 msgr2=0x5578f90d1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:29:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f574d400640 1 --2- 172.21.15.31:0/1678720182 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90f09d0 0x5578f90d1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f574d400640 1 -- 172.21.15.31:0/1678720182 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578f8e90170 con 0x5578f90f12f0 2024-09-17T05:29:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f574ca00640 1 --2- 172.21.15.31:0/1678720182 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90a4e10 0x5578f90d16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:29:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f574d400640 1 --2- 172.21.15.31:0/1678720182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f12f0 0x5578f90d23b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5740009430 tx=0x7f5740004a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd8d1b27ffe258 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f5736000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:29:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f5736000640 1 -- 172.21.15.31:0/1678720182 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57400bc070 con 0x5578f90f12f0 2024-09-17T05:29:37.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f57528e7000 1 -- 172.21.15.31:0/1678720182 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5578f8e8a0f0 con 0x5578f90f12f0 2024-09-17T05:29:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f5736000640 1 -- 172.21.15.31:0/1678720182 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f57400a5d60 con 0x5578f90f12f0 2024-09-17T05:29:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f5736000640 1 -- 172.21.15.31:0/1678720182 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f57400c4050 con 0x5578f90f12f0 2024-09-17T05:29:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f57528e7000 10 client.5046 fetch_fsmap learned FSMap version 17 2024-09-17T05:29:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f57528e7000 1 -- 172.21.15.31:0/1678720182 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5578f8f76ef0 con 0x5578f90f12f0 2024-09-17T05:29:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f5736000640 1 -- 172.21.15.31:0/1678720182 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5578f8e8a0f0 con 0x5578f90f12f0 2024-09-17T05:29:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f5736000640 1 -- 172.21.15.31:0/1678720182 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f57400c7020 con 0x5578f90f12f0 2024-09-17T05:29:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f57528e7000 10 client.5046 fetch_fsmap finished waiting for FSMap version 17 2024-09-17T05:29:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f57528e7000 10 client.5046 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T05:29:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f57528e7000 20 client.5046 populate_metadata read hostname 'smithi031' 2024-09-17T05:29:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f57528e7000 1 --2- 172.21.15.31:0/1678720182 >> [v2:172.21.15.155:6834/2317915643,v1:172.21.15.155:6836/2317915643] conn(0x5578f90d30f0 0x5578f9102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f57528e7000 4 client.5046 mds_command: new command op to 4881 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:29:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f57528e7000 1 -- 172.21.15.31:0/1678720182 --> [v2:172.21.15.155:6834/2317915643,v1:172.21.15.155:6836/2317915643] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578f8f04a70 con 0x5578f90d30f0 2024-09-17T05:29:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f574ca00640 1 --2- 172.21.15.31:0/1678720182 >> [v2:172.21.15.155:6834/2317915643,v1:172.21.15.155:6836/2317915643] conn(0x5578f90d30f0 0x5578f9102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f574ca00640 1 --2- 172.21.15.31:0/1678720182 >> [v2:172.21.15.155:6834/2317915643,v1:172.21.15.155:6836/2317915643] conn(0x5578f90d30f0 0x5578f9102c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffb8f7d7924f04e2 server_cookie=25d86193aa7b5941 in_seq=0 out_seq=0 2024-09-17T05:29:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f5736000640 10 client.5046 ms_handle_connect on v2:172.21.15.155:6834/2317915643 2024-09-17T05:29:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f5736000640 1 -- 172.21.15.31:0/1678720182 <== mds.0 v2:172.21.15.155:6834/2317915643 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5578f8f04a70 con 0x5578f90d30f0 2024-09-17T05:29:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f5736000640 10 client.5046 handle_command_reply: tid=0 2024-09-17T05:29:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.036+0000 7f57528e7000 1 client.5046 shutdown 2024-09-17T05:29:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.040+0000 7f57528e7000 1 -- 172.21.15.31:0/1678720182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f12f0 msgr2=0x5578f90d23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.040+0000 7f57528e7000 1 --2- 172.21.15.31:0/1678720182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f12f0 0x5578f90d23b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5740009430 tx=0x7f5740004a70 comp rx=0 tx=0).stop 2024-09-17T05:29:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.040+0000 7f57528e7000 1 -- 172.21.15.31:0/1678720182 shutdown_connections 2024-09-17T05:29:37.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.040+0000 7f57528e7000 1 --2- 172.21.15.31:0/1678720182 >> [v2:172.21.15.155:6834/2317915643,v1:172.21.15.155:6836/2317915643] conn(0x5578f90d30f0 0x5578f9102c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.040+0000 7f57528e7000 1 --2- 172.21.15.31:0/1678720182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f12f0 0x5578f90d23b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.040+0000 7f57528e7000 1 --2- 172.21.15.31:0/1678720182 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90f09d0 0x5578f90d1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.040+0000 7f57528e7000 1 --2- 172.21.15.31:0/1678720182 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90a4e10 0x5578f90d16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.040+0000 7f57528e7000 1 -- 172.21.15.31:0/1678720182 >> 172.21.15.31:0/1678720182 conn(0x5578f8f8e130 msgr2=0x5578f90a3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:37.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.040+0000 7f5736000640 0 client.5046 ms_handle_reset on v2:172.21.15.155:6834/2317915643 2024-09-17T05:29:37.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.040+0000 7f57528e7000 1 -- 172.21.15.31:0/1678720182 shutdown_connections 2024-09-17T05:29:37.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.040+0000 7f57528e7000 1 -- 172.21.15.31:0/1678720182 wait complete. 2024-09-17T05:29:37.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.040+0000 7f57528e7000 20 client.5046 trim_cache size 0 max 16384 2024-09-17T05:29:37.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.056+0000 7f57528e7000 1 Processor -- start 2024-09-17T05:29:37.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.056+0000 7f57528e7000 1 -- start start 2024-09-17T05:29:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f57528e7000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90a4e10 0x5578f90efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f57528e7000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f09d0 0x5578f90f0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f57528e7000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90f12f0 0x5578f90a30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f57528e7000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f57482043e0 con 0x5578f90f09d0 2024-09-17T05:29:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f57528e7000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5748203410 con 0x5578f90a4e10 2024-09-17T05:29:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f57528e7000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f57481fb460 con 0x5578f90f12f0 2024-09-17T05:29:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f573fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f09d0 0x5578f90f0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f573fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f09d0 0x5578f90f0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35462/0 (socket says 172.21.15.31:35462) 2024-09-17T05:29:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f573fe00640 1 -- 172.21.15.31:0/3042856142 learned_addr learned my addr 172.21.15.31:0/3042856142 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f574d400640 1 --2- 172.21.15.31:0/3042856142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90f12f0 0x5578f90a30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f574ca00640 1 --2- 172.21.15.31:0/3042856142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90a4e10 0x5578f90efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f573fe00640 1 -- 172.21.15.31:0/3042856142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90f12f0 msgr2=0x5578f90a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:29:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f573fe00640 1 --2- 172.21.15.31:0/3042856142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90f12f0 0x5578f90a30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f573fe00640 1 -- 172.21.15.31:0/3042856142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90a4e10 msgr2=0x5578f90efcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:29:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f573fe00640 1 --2- 172.21.15.31:0/3042856142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90a4e10 0x5578f90efcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f573fe00640 1 -- 172.21.15.31:0/3042856142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578f8f4dd90 con 0x5578f90f09d0 2024-09-17T05:29:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f574ca00640 1 --2- 172.21.15.31:0/3042856142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90a4e10 0x5578f90efcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:37.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f574d400640 1 --2- 172.21.15.31:0/3042856142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90f12f0 0x5578f90a30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:37.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f573fe00640 1 --2- 172.21.15.31:0/3042856142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f09d0 0x5578f90f0200 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f573000c390 tx=0x7f5730000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d297d0a58faa68d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:37.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f573cc00640 1 -- 172.21.15.31:0/3042856142 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5730077030 con 0x5578f90f09d0 2024-09-17T05:29:37.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f573cc00640 1 -- 172.21.15.31:0/3042856142 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5730067780 con 0x5578f90f09d0 2024-09-17T05:29:37.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f573cc00640 1 -- 172.21.15.31:0/3042856142 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57300930d0 con 0x5578f90f09d0 2024-09-17T05:29:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f57528e7000 1 -- 172.21.15.31:0/3042856142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f09d0 msgr2=0x5578f90f0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f57528e7000 1 --2- 172.21.15.31:0/3042856142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f09d0 0x5578f90f0200 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f573000c390 tx=0x7f5730000ee0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f57528e7000 1 -- 172.21.15.31:0/3042856142 shutdown_connections 2024-09-17T05:29:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f57528e7000 1 --2- 172.21.15.31:0/3042856142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90f12f0 0x5578f90a30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f57528e7000 1 --2- 172.21.15.31:0/3042856142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f09d0 0x5578f90f0200 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f57528e7000 1 --2- 172.21.15.31:0/3042856142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90a4e10 0x5578f90efcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f57528e7000 1 -- 172.21.15.31:0/3042856142 >> 172.21.15.31:0/3042856142 conn(0x5578f8f8e130 msgr2=0x5578f90ef5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f57528e7000 1 -- 172.21.15.31:0/3042856142 shutdown_connections 2024-09-17T05:29:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f57528e7000 1 -- 172.21.15.31:0/3042856142 wait complete. 2024-09-17T05:29:37.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f57528e7000 1 -- start start 2024-09-17T05:29:37.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.060+0000 7f57528e7000 1 Processor -- start 2024-09-17T05:29:37.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90a4e10 0x5578f9166e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f09d0 0x5578f9167350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90f12f0 0x5578f9167890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5578f8e8c5d0 con 0x5578f90f09d0 2024-09-17T05:29:37.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5578f9107ce0 con 0x5578f90a4e10 2024-09-17T05:29:37.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5578f8f76a60 con 0x5578f90f12f0 2024-09-17T05:29:37.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 10 client.0 _ll_register_callbacks cb 0x7f5740009b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:29:37.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f573fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f09d0 0x5578f9167350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f573fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f09d0 0x5578f9167350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35474/0 (socket says 172.21.15.31:35474) 2024-09-17T05:29:37.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f573fe00640 1 -- 172.21.15.31:0/2271683664 learned_addr learned my addr 172.21.15.31:0/2271683664 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:37.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f574d400640 1 --2- 172.21.15.31:0/2271683664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90f12f0 0x5578f9167890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f574ca00640 1 --2- 172.21.15.31:0/2271683664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90a4e10 0x5578f9166e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f573fe00640 1 -- 172.21.15.31:0/2271683664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90f12f0 msgr2=0x5578f9167890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:29:37.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f573fe00640 1 --2- 172.21.15.31:0/2271683664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90f12f0 0x5578f9167890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f573fe00640 1 -- 172.21.15.31:0/2271683664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90a4e10 msgr2=0x5578f9166e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:29:37.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f573fe00640 1 --2- 172.21.15.31:0/2271683664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90a4e10 0x5578f9166e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f573fe00640 1 -- 172.21.15.31:0/2271683664 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578f8eb8a90 con 0x5578f90f09d0 2024-09-17T05:29:37.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f574d400640 1 --2- 172.21.15.31:0/2271683664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90f12f0 0x5578f9167890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:37.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f573fe00640 1 --2- 172.21.15.31:0/2271683664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f09d0 0x5578f9167350 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5730062a90 tx=0x7f573005a4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8667b2e66a87ff8a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:37.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f5736000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:29:37.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f5736000640 1 -- 172.21.15.31:0/2271683664 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57300932d0 con 0x5578f90f09d0 2024-09-17T05:29:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f5736000640 1 -- 172.21.15.31:0/2271683664 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f5730065bc0 con 0x5578f90f09d0 2024-09-17T05:29:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 -- 172.21.15.31:0/2271683664 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5730067780 con 0x5578f90f09d0 2024-09-17T05:29:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f5736000640 1 -- 172.21.15.31:0/2271683664 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f5730065e00 con 0x5578f90f09d0 2024-09-17T05:29:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 10 client.5052 fetch_fsmap learned FSMap version 17 2024-09-17T05:29:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 -- 172.21.15.31:0/2271683664 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5578f8e97050 con 0x5578f90f09d0 2024-09-17T05:29:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f5736000640 1 -- 172.21.15.31:0/2271683664 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5730067780 con 0x5578f90f09d0 2024-09-17T05:29:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f5736000640 1 -- 172.21.15.31:0/2271683664 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f573005d100 con 0x5578f90f09d0 2024-09-17T05:29:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 10 client.5052 fetch_fsmap finished waiting for FSMap version 17 2024-09-17T05:29:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 10 client.5052 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T05:29:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 20 client.5052 populate_metadata read hostname 'smithi031' 2024-09-17T05:29:37.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 --2- 172.21.15.31:0/2271683664 >> [v2:172.21.15.155:6834/2317915643,v1:172.21.15.155:6836/2317915643] conn(0x5578f9105070 0x5578f9105450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 4 client.5052 mds_command: new command op to 4881 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:29:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 -- 172.21.15.31:0/2271683664 --> [v2:172.21.15.155:6834/2317915643,v1:172.21.15.155:6836/2317915643] -- command(tid 0: {"prefix": "status"}) -- 0x5578f8f00520 con 0x5578f9105070 2024-09-17T05:29:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f574ca00640 1 --2- 172.21.15.31:0/2271683664 >> [v2:172.21.15.155:6834/2317915643,v1:172.21.15.155:6836/2317915643] conn(0x5578f9105070 0x5578f9105450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f574ca00640 1 --2- 172.21.15.31:0/2271683664 >> [v2:172.21.15.155:6834/2317915643,v1:172.21.15.155:6836/2317915643] conn(0x5578f9105070 0x5578f9105450 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ae31a6adc2bb758 server_cookie=3ba94860defc636 in_seq=0 out_seq=0 2024-09-17T05:29:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f5736000640 10 client.5052 ms_handle_connect on v2:172.21.15.155:6834/2317915643 2024-09-17T05:29:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f5736000640 1 -- 172.21.15.31:0/2271683664 <== mds.0 v2:172.21.15.155:6834/2317915643 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5578f8f00520 con 0x5578f9105070 2024-09-17T05:29:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f5736000640 10 client.5052 handle_command_reply: tid=0 2024-09-17T05:29:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 client.5052 shutdown 2024-09-17T05:29:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 -- 172.21.15.31:0/2271683664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f09d0 msgr2=0x5578f9167350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:37.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 --2- 172.21.15.31:0/2271683664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f09d0 0x5578f9167350 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5730062a90 tx=0x7f573005a4f0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 -- 172.21.15.31:0/2271683664 shutdown_connections 2024-09-17T05:29:37.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 --2- 172.21.15.31:0/2271683664 >> [v2:172.21.15.155:6834/2317915643,v1:172.21.15.155:6836/2317915643] conn(0x5578f9105070 0x5578f9105450 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 --2- 172.21.15.31:0/2271683664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5578f90f12f0 0x5578f9167890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 --2- 172.21.15.31:0/2271683664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5578f90f09d0 0x5578f9167350 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 --2- 172.21.15.31:0/2271683664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5578f90a4e10 0x5578f9166e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f5736000640 0 client.5052 ms_handle_reset on v2:172.21.15.155:6834/2317915643 2024-09-17T05:29:37.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 -- 172.21.15.31:0/2271683664 >> 172.21.15.31:0/2271683664 conn(0x5578f8f8e130 msgr2=0x5578f90a30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:37.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 -- 172.21.15.31:0/2271683664 shutdown_connections 2024-09-17T05:29:37.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.064+0000 7f57528e7000 1 -- 172.21.15.31:0/2271683664 wait complete. 2024-09-17T05:29:37.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.068+0000 7f57528e7000 20 client.5052 trim_cache size 0 max 16384 2024-09-17T05:29:37.078 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:29:37.078 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "b668cd1d-3036-4a29-9e5a-69d0df5776a8", 2024-09-17T05:29:37.078 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-17T05:29:37.078 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4881, 2024-09-17T05:29:37.078 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-09-17T05:29:37.078 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-09-17T05:29:37.078 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-17T05:29:37.078 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 6.0647705670000001, 2024-09-17T05:29:37.079 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 17, 2024-09-17T05:29:37.079 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 32, 2024-09-17T05:29:37.079 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 32, 2024-09-17T05:29:37.079 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 13.043036697 2024-09-17T05:29:37.079 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:29:37.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.068+0000 7f574f400640 1 -- 172.21.15.31:0/2190110000 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5724073200 msgr2=0x7f57240756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:37.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.068+0000 7f574f400640 1 --2- 172.21.15.31:0/2190110000 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5724073200 0x7f57240756c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5738006fd0 tx=0x7f5738008040 comp rx=0 tx=0).stop 2024-09-17T05:29:37.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.068+0000 7f574f400640 1 -- 172.21.15.31:0/2190110000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57480d2060 msgr2=0x7f57480cc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:37.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.068+0000 7f574f400640 1 --2- 172.21.15.31:0/2190110000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57480d2060 0x7f57480cc770 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f573000c3c0 tx=0x7f573000c880 comp rx=0 tx=0).stop 2024-09-17T05:29:37.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.068+0000 7f574f400640 1 -- 172.21.15.31:0/2190110000 shutdown_connections 2024-09-17T05:29:37.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.068+0000 7f574f400640 1 --2- 172.21.15.31:0/2190110000 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5724073200 0x7f57240756c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.068+0000 7f574f400640 1 --2- 172.21.15.31:0/2190110000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57480d2440 0x7f57480cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.068+0000 7f574f400640 1 --2- 172.21.15.31:0/2190110000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57480d2060 0x7f57480cc770 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.068+0000 7f574f400640 1 --2- 172.21.15.31:0/2190110000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57480b7ab0 0x7f57480b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.068+0000 7f574f400640 1 -- 172.21.15.31:0/2190110000 >> 172.21.15.31:0/2190110000 conn(0x7f57480d3fe0 msgr2=0x7f57480b6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:37.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.068+0000 7f574f400640 1 -- 172.21.15.31:0/2190110000 shutdown_connections 2024-09-17T05:29:37.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.068+0000 7f574f400640 1 -- 172.21.15.31:0/2190110000 wait complete. 2024-09-17T05:29:37.092 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:29:37.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.232+0000 7f1836600640 1 -- 172.21.15.31:0/3481913847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18300ced80 msgr2=0x7f18300ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:37.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.232+0000 7f1836600640 1 --2- 172.21.15.31:0/3481913847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18300ced80 0x7f18300ae9b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1818009840 tx=0x7f181801c820 comp rx=0 tx=0).stop 2024-09-17T05:29:37.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.232+0000 7f1836600640 1 -- 172.21.15.31:0/3481913847 shutdown_connections 2024-09-17T05:29:37.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.232+0000 7f1836600640 1 --2- 172.21.15.31:0/3481913847 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18300ced80 0x7f18300ae9b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f1836600640 1 -- 172.21.15.31:0/3481913847 >> 172.21.15.31:0/3481913847 conn(0x7f18300d1dc0 msgr2=0x7f18300d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:37.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f1836600640 1 -- 172.21.15.31:0/3481913847 shutdown_connections 2024-09-17T05:29:37.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f1836600640 1 -- 172.21.15.31:0/3481913847 wait complete. 2024-09-17T05:29:37.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f1836600640 1 Processor -- start 2024-09-17T05:29:37.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f1836600640 1 -- start start 2024-09-17T05:29:37.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f1836600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18300cdb30 0x7f18300c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f1836600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18300ced80 0x7f1830156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f1836600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f183015bea0 0x7f18300c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f1836600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f183016a840 con 0x7f18300cdb30 2024-09-17T05:29:37.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f1836600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f183016a6c0 con 0x7f18300ced80 2024-09-17T05:29:37.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f1836600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f183016a9c0 con 0x7f183015bea0 2024-09-17T05:29:37.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f182f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18300cdb30 0x7f18300c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f182f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18300cdb30 0x7f18300c8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35480/0 (socket says 172.21.15.31:35480) 2024-09-17T05:29:37.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f182f400640 1 -- 172.21.15.31:0/4141519667 learned_addr learned my addr 172.21.15.31:0/4141519667 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:37.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f1827e00640 1 --2- 172.21.15.31:0/4141519667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18300ced80 0x7f1830156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f182fe00640 1 --2- 172.21.15.31:0/4141519667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f183015bea0 0x7f18300c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f182f400640 1 -- 172.21.15.31:0/4141519667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f183015bea0 msgr2=0x7f18300c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f182f400640 1 --2- 172.21.15.31:0/4141519667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f183015bea0 0x7f18300c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f182f400640 1 -- 172.21.15.31:0/4141519667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18300ced80 msgr2=0x7f1830156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f182f400640 1 --2- 172.21.15.31:0/4141519667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18300ced80 0x7f1830156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f182f400640 1 -- 172.21.15.31:0/4141519667 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18300c93d0 con 0x7f18300cdb30 2024-09-17T05:29:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f1827e00640 1 --2- 172.21.15.31:0/4141519667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18300ced80 0x7f1830156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:29:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f182fe00640 1 --2- 172.21.15.31:0/4141519667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f183015bea0 0x7f18300c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:29:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.236+0000 7f182f400640 1 --2- 172.21.15.31:0/4141519667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18300cdb30 0x7f18300c8e90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f182000c430 tx=0x7f182000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.240+0000 7f1827400640 1 -- 172.21.15.31:0/4141519667 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1820017070 con 0x7f18300cdb30 2024-09-17T05:29:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.240+0000 7f1827400640 1 -- 172.21.15.31:0/4141519667 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18200053c0 con 0x7f18300cdb30 2024-09-17T05:29:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.240+0000 7f1836600640 1 -- 172.21.15.31:0/4141519667 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f183006e0c0 con 0x7f18300cdb30 2024-09-17T05:29:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.240+0000 7f1827400640 1 -- 172.21.15.31:0/4141519667 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1820003860 con 0x7f18300cdb30 2024-09-17T05:29:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.240+0000 7f1836600640 1 -- 172.21.15.31:0/4141519667 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f183006e900 con 0x7f18300cdb30 2024-09-17T05:29:37.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.240+0000 7f1836600640 1 -- 172.21.15.31:0/4141519667 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18300b0720 con 0x7f18300cdb30 2024-09-17T05:29:37.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.240+0000 7f1827400640 1 -- 172.21.15.31:0/4141519667 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f182001a070 con 0x7f18300cdb30 2024-09-17T05:29:37.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.240+0000 7f1827400640 1 --2- 172.21.15.31:0/4141519667 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f180c073200 0x7f180c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:37.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.240+0000 7f1827400640 1 -- 172.21.15.31:0/4141519667 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f1820093630 con 0x7f18300cdb30 2024-09-17T05:29:37.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.240+0000 7f1827e00640 1 --2- 172.21.15.31:0/4141519667 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f180c073200 0x7f180c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:37.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.244+0000 7f1827e00640 1 --2- 172.21.15.31:0/4141519667 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f180c073200 0x7f180c0756c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f18180af000 tx=0x7f181801b060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:37.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.244+0000 7f1827400640 1 -- 172.21.15.31:0/4141519667 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f183006e0c0 con 0x7f18300cdb30 2024-09-17T05:29:37.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.460+0000 7f1836600640 1 -- 172.21.15.31:0/4141519667 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f18300ce670 con 0x7f18300cdb30 2024-09-17T05:29:37.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.460+0000 7f1827400640 1 -- 172.21.15.31:0/4141519667 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f182005e6d0 con 0x7f18300cdb30 2024-09-17T05:29:37.465 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:29:37.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.460+0000 7f1836600640 1 -- 172.21.15.31:0/4141519667 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f180c073200 msgr2=0x7f180c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:37.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.460+0000 7f1836600640 1 --2- 172.21.15.31:0/4141519667 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f180c073200 0x7f180c0756c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f18180af000 tx=0x7f181801b060 comp rx=0 tx=0).stop 2024-09-17T05:29:37.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.460+0000 7f1836600640 1 -- 172.21.15.31:0/4141519667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18300cdb30 msgr2=0x7f18300c8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:37.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.460+0000 7f1836600640 1 --2- 172.21.15.31:0/4141519667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18300cdb30 0x7f18300c8e90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f182000c430 tx=0x7f182000c8f0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.460+0000 7f1836600640 1 -- 172.21.15.31:0/4141519667 shutdown_connections 2024-09-17T05:29:37.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.460+0000 7f1836600640 1 --2- 172.21.15.31:0/4141519667 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f180c073200 0x7f180c0756c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.460+0000 7f1836600640 1 --2- 172.21.15.31:0/4141519667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f183015bea0 0x7f18300c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.460+0000 7f1836600640 1 --2- 172.21.15.31:0/4141519667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18300ced80 0x7f1830156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.460+0000 7f1836600640 1 --2- 172.21.15.31:0/4141519667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18300cdb30 0x7f18300c8e90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:37.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.460+0000 7f1836600640 1 -- 172.21.15.31:0/4141519667 >> 172.21.15.31:0/4141519667 conn(0x7f18300d1dc0 msgr2=0x7f18300b54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:37.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.460+0000 7f1836600640 1 -- 172.21.15.31:0/4141519667 shutdown_connections 2024-09-17T05:29:37.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37.460+0000 7f1836600640 1 -- 172.21.15.31:0/4141519667 wait complete. 2024-09-17T05:29:37.486 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:29:37.486 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:29:37.486 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-17T05:29:37.486 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:29:37.486 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:29:37.486 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:29:37.486 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:29:37.486 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:29:37.486 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:29:37.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:37.487 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-17T05:29:37.496 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:29:37.497 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:29:37.497 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:29:37.497 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:37.497 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-17T05:29:37.497 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:37.497 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:29:37.497 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:37.497 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-17T05:29:37.497 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:29:37.498 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:37.498 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-17T05:29:37.498 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:29:37.498 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:37.498 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-17T05:29:37.499 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:29:37.499 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42375sec preferred_lft 42375sec 2024-09-17T05:29:37.499 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-17T05:29:37.499 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:37.499 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:29:37.499 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:37.499 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-17T05:29:37.499 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:29:37.499 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:fe:f3:3e:aa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:37.499 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:29:37.499 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:37.499 INFO:teuthology.orchestra.run.smithi031.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:29:37.499 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:37.500 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:29:37.500 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:37.500 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:29:37.500 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:37.500 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:29:37.500 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:29:37.500 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:29:37.500 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:37.500 INFO:teuthology.orchestra.run.smithi031.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:29:37.501 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:29:37.501 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:29:37.501 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:37.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:37.501 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:29:37.561 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-17T05:29:37.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:37.563 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-17T05:29:37.617 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-17T05:29:37.617 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:29:37.617 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:29:37.617 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:29:37.617 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:29:37.617 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:29:37.618 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:37.618 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:29:37.618 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:29:37.618 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:29:37.618 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:29:37.618 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:29:37.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:37.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:37.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:37.760 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T05:29:37.769 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:29:37.769 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:29:37.770 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:29:37.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:37.770 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-09-17T05:29:37.835 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:29:37.835 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:29:37.891 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:29:37.891 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:29:37.891 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:29:37.947 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-17T05:29:37.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:37.947 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:29:38.038 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:29:38.038 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:29:38.054 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:29:38.054 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:29:38.054 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:29:38.055 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:29:38.055 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:29:38.058 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:29:38.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:38.058 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:29:38.079 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:29:38.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:29:38.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:38.188 INFO:teuthology.orchestra.run.smithi031.stdout:client5023 2024-09-17T05:29:38.189 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:29:38.189 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:38.198 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:29:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.380+0000 7f0ab4600640 1 -- 172.21.15.31:0/996863637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aac0b2e80 msgr2=0x7f0aac0b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.380+0000 7f0ab4600640 1 --2- 172.21.15.31:0/996863637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aac0b2e80 0x7f0aac0b1bd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0a98009900 tx=0x7f0a9801c820 comp rx=0 tx=0).stop 2024-09-17T05:29:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.380+0000 7f0ab4600640 1 -- 172.21.15.31:0/996863637 shutdown_connections 2024-09-17T05:29:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.380+0000 7f0ab4600640 1 --2- 172.21.15.31:0/996863637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0aac0afca0 0x7f0aac0b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.380+0000 7f0ab4600640 1 --2- 172.21.15.31:0/996863637 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aac0b2e80 0x7f0aac0b1bd0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.380+0000 7f0ab4600640 1 -- 172.21.15.31:0/996863637 >> 172.21.15.31:0/996863637 conn(0x7f0aac0d1e30 msgr2=0x7f0aac0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:38.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.380+0000 7f0ab4600640 1 -- 172.21.15.31:0/996863637 shutdown_connections 2024-09-17T05:29:38.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.380+0000 7f0ab4600640 1 -- 172.21.15.31:0/996863637 wait complete. 2024-09-17T05:29:38.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.380+0000 7f0ab4600640 1 Processor -- start 2024-09-17T05:29:38.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.380+0000 7f0ab4600640 1 -- start start 2024-09-17T05:29:38.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.380+0000 7f0ab4600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aac0afca0 0x7f0aac06e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:38.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.380+0000 7f0ab4600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0aac0b2e80 0x7f0aac158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:38.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.380+0000 7f0ab4600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aac15f490 0x7f0aac1fad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:38.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0ab4600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac168e00 con 0x7f0aac0afca0 2024-09-17T05:29:38.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0ab4600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac168c80 con 0x7f0aac15f490 2024-09-17T05:29:38.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0ab4600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0aac168f80 con 0x7f0aac0b2e80 2024-09-17T05:29:38.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0ab1c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aac0afca0 0x7f0aac06e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:38.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0ab1c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aac0afca0 0x7f0aac06e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35498/0 (socket says 172.21.15.31:35498) 2024-09-17T05:29:38.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0ab1c00640 1 -- 172.21.15.31:0/137104871 learned_addr learned my addr 172.21.15.31:0/137104871 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:38.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0ab1200640 1 --2- 172.21.15.31:0/137104871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0aac0b2e80 0x7f0aac158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:38.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0ab1c00640 1 -- 172.21.15.31:0/137104871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0aac0b2e80 msgr2=0x7f0aac158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:38.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0ab1c00640 1 --2- 172.21.15.31:0/137104871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0aac0b2e80 0x7f0aac158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:38.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0ab1c00640 1 -- 172.21.15.31:0/137104871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aac15f490 msgr2=0x7f0aac1fad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0ab2600640 1 --2- 172.21.15.31:0/137104871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aac15f490 0x7f0aac1fad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0ab1c00640 1 --2- 172.21.15.31:0/137104871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aac15f490 0x7f0aac1fad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0ab1c00640 1 -- 172.21.15.31:0/137104871 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac156470 con 0x7f0aac0afca0 2024-09-17T05:29:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0ab2600640 1 --2- 172.21.15.31:0/137104871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aac15f490 0x7f0aac1fad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:29:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0ab1c00640 1 --2- 172.21.15.31:0/137104871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aac0afca0 0x7f0aac06e740 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000c530 tx=0x7f0aa000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0aa9600640 1 -- 172.21.15.31:0/137104871 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0017070 con 0x7f0aac0afca0 2024-09-17T05:29:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0aa9600640 1 -- 172.21.15.31:0/137104871 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0aa00053c0 con 0x7f0aac0afca0 2024-09-17T05:29:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0ab4600640 1 -- 172.21.15.31:0/137104871 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aac06edd0 con 0x7f0aac0afca0 2024-09-17T05:29:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0aa9600640 1 -- 172.21.15.31:0/137104871 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0012890 con 0x7f0aac0afca0 2024-09-17T05:29:38.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0ab4600640 1 -- 172.21.15.31:0/137104871 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aac06f390 con 0x7f0aac0afca0 2024-09-17T05:29:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0ab4600640 1 -- 172.21.15.31:0/137104871 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aac0b0110 con 0x7f0aac0afca0 2024-09-17T05:29:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.384+0000 7f0aa9600640 1 -- 172.21.15.31:0/137104871 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f0aa001a070 con 0x7f0aac0afca0 2024-09-17T05:29:38.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.388+0000 7f0aa9600640 1 --2- 172.21.15.31:0/137104871 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0a8c073200 0x7f0a8c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.388+0000 7f0aa9600640 1 -- 172.21.15.31:0/137104871 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0aa0093590 con 0x7f0aac0afca0 2024-09-17T05:29:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.388+0000 7f0ab1200640 1 --2- 172.21.15.31:0/137104871 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0a8c073200 0x7f0a8c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:38.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.388+0000 7f0ab1200640 1 --2- 172.21.15.31:0/137104871 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0a8c073200 0x7f0a8c0756c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0a980af000 tx=0x7f0a9801b060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:38.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.392+0000 7f0aa9600640 1 -- 172.21.15.31:0/137104871 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0aa005e5a0 con 0x7f0aac0afca0 2024-09-17T05:29:38.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.604+0000 7f0ab4600640 1 -- 172.21.15.31:0/137104871 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0aac0d2750 con 0x7f0aac0afca0 2024-09-17T05:29:38.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.604+0000 7f0aa9600640 1 -- 172.21.15.31:0/137104871 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f0aa005dea0 con 0x7f0aac0afca0 2024-09-17T05:29:38.610 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:29:38.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.608+0000 7f0ab4600640 1 -- 172.21.15.31:0/137104871 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0a8c073200 msgr2=0x7f0a8c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:38.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.608+0000 7f0ab4600640 1 --2- 172.21.15.31:0/137104871 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0a8c073200 0x7f0a8c0756c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0a980af000 tx=0x7f0a9801b060 comp rx=0 tx=0).stop 2024-09-17T05:29:38.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.608+0000 7f0ab4600640 1 -- 172.21.15.31:0/137104871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aac0afca0 msgr2=0x7f0aac06e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:38.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.608+0000 7f0ab4600640 1 --2- 172.21.15.31:0/137104871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aac0afca0 0x7f0aac06e740 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000c530 tx=0x7f0aa000c9f0 comp rx=0 tx=0).stop 2024-09-17T05:29:38.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.608+0000 7f0ab4600640 1 -- 172.21.15.31:0/137104871 shutdown_connections 2024-09-17T05:29:38.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.608+0000 7f0ab4600640 1 --2- 172.21.15.31:0/137104871 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0a8c073200 0x7f0a8c0756c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:38.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.608+0000 7f0ab4600640 1 --2- 172.21.15.31:0/137104871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aac15f490 0x7f0aac1fad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:38.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.608+0000 7f0ab4600640 1 --2- 172.21.15.31:0/137104871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0aac0b2e80 0x7f0aac158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:38.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.608+0000 7f0ab4600640 1 --2- 172.21.15.31:0/137104871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0aac0afca0 0x7f0aac06e740 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:38.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.608+0000 7f0ab4600640 1 -- 172.21.15.31:0/137104871 >> 172.21.15.31:0/137104871 conn(0x7f0aac0d1e30 msgr2=0x7f0aac0ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:38.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.608+0000 7f0ab4600640 1 -- 172.21.15.31:0/137104871 shutdown_connections 2024-09-17T05:29:38.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:38.608+0000 7f0ab4600640 1 -- 172.21.15.31:0/137104871 wait complete. 2024-09-17T05:29:38.633 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:29:38.633 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:29:38.633 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-09-17T05:29:38.633 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:29:38.633 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:29:38.633 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:29:38.633 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:29:38.633 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:29:38.633 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:29:38.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:38.634 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-09-17T05:29:38.644 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:29:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:29:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:29:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-17T05:29:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:38.644 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:29:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-09-17T05:29:38.644 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:29:38.644 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-09-17T05:29:38.645 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:29:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:38.645 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:29:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-17T05:29:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42377sec preferred_lft 42377sec 2024-09-17T05:29:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-09-17T05:29:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:38.645 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:29:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:84:cd:fc:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:38.645 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:29:38.646 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:38.646 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:29:38.646 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:29:38.646 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:29:38.646 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:38.646 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:29:38.646 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:38.646 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:29:38.646 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:29:38.646 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:29:38.646 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:38.646 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:29:38.646 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:29:38.647 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:29:38.647 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:29:38.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:38.648 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:29:38.716 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-17T05:29:38.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:38.718 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-09-17T05:29:38.772 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-09-17T05:29:38.772 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:29:38.773 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-17T05:29:38.773 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:29:38.773 INFO:teuthology.orchestra.run.smithi155.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-17T05:29:38.773 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:29:38.773 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:29:38.773 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:29:38.773 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:29:38.773 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:29:38.773 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:29:38.773 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:29:38.774 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:29:38.774 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:29:38.774 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:29:38.774 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:29:38.774 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:29:38.867 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:29:38.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:38.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:38.919 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-17T05:29:38.928 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:29:38.928 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:29:38.928 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:29:38.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:38.928 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-09-17T05:29:38.992 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:29:38.992 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:29:39.040 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:29:39.040 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:29:39.041 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:29:39.096 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-17T05:29:39.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:39.096 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:29:39.188 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:29:39.188 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:29:39.201 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:29:39.201 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:29:39.201 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:29:39.201 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:29:39.201 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:29:39.205 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:29:39.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:39.205 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:29:39.225 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:29:39.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:29:39.317 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:29:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:39.323 INFO:teuthology.orchestra.run.smithi155.stdout:client5026 2024-09-17T05:29:39.323 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:29:39.323 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:39.331 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:29:39.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.488+0000 7fdb27a00640 1 -- 172.21.15.31:0/1730751984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb2015be10 msgr2=0x7fdb200ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:39.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.488+0000 7fdb27a00640 1 --2- 172.21.15.31:0/1730751984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb2015be10 0x7fdb200ce700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdb200b0fb0 tx=0x7fdb1401f0b0 comp rx=0 tx=0).stop 2024-09-17T05:29:39.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.488+0000 7fdb27a00640 1 -- 172.21.15.31:0/1730751984 shutdown_connections 2024-09-17T05:29:39.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.488+0000 7fdb27a00640 1 --2- 172.21.15.31:0/1730751984 >> v2:172.21.15.155:3300/0 conn(0x7fdb200b0b60 0x7fdb200ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:39.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.488+0000 7fdb27a00640 1 --2- 172.21.15.31:0/1730751984 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb2015be10 0x7fdb200ce700 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:39.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.488+0000 7fdb27a00640 1 -- 172.21.15.31:0/1730751984 >> 172.21.15.31:0/1730751984 conn(0x7fdb200d1da0 msgr2=0x7fdb200d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:39.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.488+0000 7fdb27a00640 1 -- 172.21.15.31:0/1730751984 shutdown_connections 2024-09-17T05:29:39.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.488+0000 7fdb27a00640 1 -- 172.21.15.31:0/1730751984 wait complete. 2024-09-17T05:29:39.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.488+0000 7fdb27a00640 1 Processor -- start 2024-09-17T05:29:39.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb27a00640 1 -- start start 2024-09-17T05:29:39.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb27a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb200b0b60 0x7fdb2014e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:39.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb27a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb2015be10 0x7fdb200b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:39.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb27a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb2015c1f0 0x7fdb200b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:39.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb27a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdb200cd4a0 con 0x7fdb2015c1f0 2024-09-17T05:29:39.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb27a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdb200cd320 con 0x7fdb2015be10 2024-09-17T05:29:39.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb27a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdb200cd620 con 0x7fdb200b0b60 2024-09-17T05:29:39.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb25a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb2015c1f0 0x7fdb200b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:39.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb25a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb2015c1f0 0x7fdb200b7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50750/0 (socket says 172.21.15.31:50750) 2024-09-17T05:29:39.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb25a00640 1 -- 172.21.15.31:0/1571928794 learned_addr learned my addr 172.21.15.31:0/1571928794 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:39.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb1fe00640 1 --2- 172.21.15.31:0/1571928794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb2015be10 0x7fdb200b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:39.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb25000640 1 --2- 172.21.15.31:0/1571928794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb200b0b60 0x7fdb2014e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:39.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb25a00640 1 -- 172.21.15.31:0/1571928794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb200b0b60 msgr2=0x7fdb2014e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:39.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb25a00640 1 --2- 172.21.15.31:0/1571928794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb200b0b60 0x7fdb2014e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:39.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb25a00640 1 -- 172.21.15.31:0/1571928794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb2015be10 msgr2=0x7fdb200b6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:39.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb25a00640 1 --2- 172.21.15.31:0/1571928794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb2015be10 0x7fdb200b6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:39.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb25a00640 1 -- 172.21.15.31:0/1571928794 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2014e730 con 0x7fdb2015c1f0 2024-09-17T05:29:39.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb1fe00640 1 --2- 172.21.15.31:0/1571928794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb2015be10 0x7fdb200b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:39.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb25a00640 1 --2- 172.21.15.31:0/1571928794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb2015c1f0 0x7fdb200b7300 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdb1800ea50 tx=0x7fdb1800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:39.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb1cc00640 1 -- 172.21.15.31:0/1571928794 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1800cdc0 con 0x7fdb2015c1f0 2024-09-17T05:29:39.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb1cc00640 1 -- 172.21.15.31:0/1571928794 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb18004c40 con 0x7fdb2015c1f0 2024-09-17T05:29:39.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb27a00640 1 -- 172.21.15.31:0/1571928794 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb2015a6e0 con 0x7fdb2015c1f0 2024-09-17T05:29:39.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb1cc00640 1 -- 172.21.15.31:0/1571928794 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb18005280 con 0x7fdb2015c1f0 2024-09-17T05:29:39.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb27a00640 1 -- 172.21.15.31:0/1571928794 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb2015aca0 con 0x7fdb2015c1f0 2024-09-17T05:29:39.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.492+0000 7fdb27a00640 1 -- 172.21.15.31:0/1571928794 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb200cdb40 con 0x7fdb2015c1f0 2024-09-17T05:29:39.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.496+0000 7fdb1cc00640 1 -- 172.21.15.31:0/1571928794 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fdb18005420 con 0x7fdb2015c1f0 2024-09-17T05:29:39.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.496+0000 7fdb1cc00640 1 --2- 172.21.15.31:0/1571928794 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdb00073200 0x7fdb000756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:39.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.496+0000 7fdb1cc00640 1 -- 172.21.15.31:0/1571928794 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fdb18094c00 con 0x7fdb2015c1f0 2024-09-17T05:29:39.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.496+0000 7fdb25000640 1 --2- 172.21.15.31:0/1571928794 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdb00073200 0x7fdb000756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:39.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.496+0000 7fdb25000640 1 --2- 172.21.15.31:0/1571928794 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdb00073200 0x7fdb000756c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdb140b2000 tx=0x7fdb1401d8f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:39.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.500+0000 7fdb1cc00640 1 -- 172.21.15.31:0/1571928794 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fdb18016030 con 0x7fdb2015c1f0 2024-09-17T05:29:39.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:39.712+0000 7fdb27a00640 1 -- 172.21.15.31:0/1571928794 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fdb200ccea0 con 0x7fdb2015c1f0 2024-09-17T05:29:40.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.072+0000 7fdb1cc00640 1 -- 172.21.15.31:0/1571928794 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) ==== 136+0+0 (secure 0 0 0) 0x7fdb1805fc10 con 0x7fdb2015c1f0 2024-09-17T05:29:40.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.072+0000 7fdb27a00640 1 -- 172.21.15.31:0/1571928794 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdb00073200 msgr2=0x7fdb000756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:40.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.072+0000 7fdb27a00640 1 --2- 172.21.15.31:0/1571928794 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdb00073200 0x7fdb000756c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdb140b2000 tx=0x7fdb1401d8f0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.072+0000 7fdb27a00640 1 -- 172.21.15.31:0/1571928794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb2015c1f0 msgr2=0x7fdb200b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:40.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.072+0000 7fdb27a00640 1 --2- 172.21.15.31:0/1571928794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb2015c1f0 0x7fdb200b7300 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdb1800ea50 tx=0x7fdb1800ef10 comp rx=0 tx=0).stop 2024-09-17T05:29:40.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.072+0000 7fdb27a00640 1 -- 172.21.15.31:0/1571928794 shutdown_connections 2024-09-17T05:29:40.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.072+0000 7fdb27a00640 1 --2- 172.21.15.31:0/1571928794 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdb00073200 0x7fdb000756c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.072+0000 7fdb27a00640 1 --2- 172.21.15.31:0/1571928794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb2015c1f0 0x7fdb200b7300 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.072+0000 7fdb27a00640 1 --2- 172.21.15.31:0/1571928794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb2015be10 0x7fdb200b6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.072+0000 7fdb27a00640 1 --2- 172.21.15.31:0/1571928794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb200b0b60 0x7fdb2014e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.072+0000 7fdb27a00640 1 -- 172.21.15.31:0/1571928794 >> 172.21.15.31:0/1571928794 conn(0x7fdb200d1da0 msgr2=0x7fdb200aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:40.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.072+0000 7fdb27a00640 1 -- 172.21.15.31:0/1571928794 shutdown_connections 2024-09-17T05:29:40.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.072+0000 7fdb27a00640 1 -- 172.21.15.31:0/1571928794 wait complete. 2024-09-17T05:29:40.098 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:29:40.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.240+0000 7f8c82c00640 1 -- 172.21.15.31:0/164152168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c7c0cefb0 msgr2=0x7f8c7c0cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:40.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.240+0000 7f8c82c00640 1 --2- 172.21.15.31:0/164152168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c7c0cefb0 0x7f8c7c0cc5b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009840 tx=0x7f8c6801c6b0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.240+0000 7f8c82c00640 1 -- 172.21.15.31:0/164152168 shutdown_connections 2024-09-17T05:29:40.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.240+0000 7f8c82c00640 1 --2- 172.21.15.31:0/164152168 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c7c0cefb0 0x7f8c7c0cc5b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.240+0000 7f8c82c00640 1 --2- 172.21.15.31:0/164152168 >> v2:172.21.15.155:3300/0 conn(0x7f8c7c15f000 0x7f8c7c0d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.240+0000 7f8c82c00640 1 -- 172.21.15.31:0/164152168 >> 172.21.15.31:0/164152168 conn(0x7f8c7c09aa10 msgr2=0x7f8c7c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:40.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.240+0000 7f8c82c00640 1 -- 172.21.15.31:0/164152168 shutdown_connections 2024-09-17T05:29:40.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.240+0000 7f8c82c00640 1 -- 172.21.15.31:0/164152168 wait complete. 2024-09-17T05:29:40.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82c00640 1 Processor -- start 2024-09-17T05:29:40.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82c00640 1 -- start start 2024-09-17T05:29:40.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c7c0ccaf0 0x7f8c7c06f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:40.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c7c0cefb0 0x7f8c7c163ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:40.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c7c15f000 0x7f8c7c1599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:40.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c1692c0 con 0x7f8c7c15f000 2024-09-17T05:29:40.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7c169140 con 0x7f8c7c0ccaf0 2024-09-17T05:29:40.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8c7c169440 con 0x7f8c7c0cefb0 2024-09-17T05:29:40.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c7c15f000 0x7f8c7c1599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:40.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c7c15f000 0x7f8c7c1599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50758/0 (socket says 172.21.15.31:50758) 2024-09-17T05:29:40.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82200640 1 -- 172.21.15.31:0/455650329 learned_addr learned my addr 172.21.15.31:0/455650329 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:40.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c81800640 1 --2- 172.21.15.31:0/455650329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c7c0ccaf0 0x7f8c7c06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:40.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c80e00640 1 --2- 172.21.15.31:0/455650329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c7c0cefb0 0x7f8c7c163ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:40.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82200640 1 -- 172.21.15.31:0/455650329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c7c0cefb0 msgr2=0x7f8c7c163ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:40.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82200640 1 --2- 172.21.15.31:0/455650329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c7c0cefb0 0x7f8c7c163ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82200640 1 -- 172.21.15.31:0/455650329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c7c0ccaf0 msgr2=0x7f8c7c06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:40.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82200640 1 --2- 172.21.15.31:0/455650329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c7c0ccaf0 0x7f8c7c06f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82200640 1 -- 172.21.15.31:0/455650329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7c0cb120 con 0x7f8c7c15f000 2024-09-17T05:29:40.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82200640 1 --2- 172.21.15.31:0/455650329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c7c15f000 0x7f8c7c1599d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8c74001440 tx=0x7f8c74001530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:40.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c79600640 1 -- 172.21.15.31:0/455650329 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74016020 con 0x7f8c7c15f000 2024-09-17T05:29:40.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c79600640 1 -- 172.21.15.31:0/455650329 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c7400ab00 con 0x7f8c7c15f000 2024-09-17T05:29:40.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c79600640 1 -- 172.21.15.31:0/455650329 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74012420 con 0x7f8c7c15f000 2024-09-17T05:29:40.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82c00640 1 -- 172.21.15.31:0/455650329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c7c0cb400 con 0x7f8c7c15f000 2024-09-17T05:29:40.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.244+0000 7f8c82c00640 1 -- 172.21.15.31:0/455650329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c7c0cb9c0 con 0x7f8c7c15f000 2024-09-17T05:29:40.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.248+0000 7f8c82c00640 1 -- 172.21.15.31:0/455650329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c7c0cc5b0 con 0x7f8c7c15f000 2024-09-17T05:29:40.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.248+0000 7f8c79600640 1 -- 172.21.15.31:0/455650329 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f8c74019020 con 0x7f8c7c15f000 2024-09-17T05:29:40.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.248+0000 7f8c79600640 1 --2- 172.21.15.31:0/455650329 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8c5c073200 0x7f8c5c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:40.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.248+0000 7f8c79600640 1 -- 172.21.15.31:0/455650329 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f8c740941f0 con 0x7f8c7c15f000 2024-09-17T05:29:40.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.248+0000 7f8c81800640 1 --2- 172.21.15.31:0/455650329 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8c5c073200 0x7f8c5c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:40.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.248+0000 7f8c81800640 1 --2- 172.21.15.31:0/455650329 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8c5c073200 0x7f8c5c0756c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8c70009600 tx=0x7f8c700091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:40.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.252+0000 7f8c79600640 1 -- 172.21.15.31:0/455650329 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8c74020030 con 0x7f8c7c15f000 2024-09-17T05:29:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.456+0000 7f8c82c00640 1 -- 172.21.15.31:0/455650329 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f8c7c164010 con 0x7f8c5c073200 2024-09-17T05:29:40.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.456+0000 7f8c79600640 1 -- 172.21.15.31:0/455650329 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f8c7c164010 con 0x7f8c5c073200 2024-09-17T05:29:40.462 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:29:40.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:29:40.462 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephfs" 2024-09-17T05:29:40.462 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:29:40.462 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:29:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.460+0000 7f8c82c00640 1 -- 172.21.15.31:0/455650329 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8c5c073200 msgr2=0x7f8c5c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.460+0000 7f8c82c00640 1 --2- 172.21.15.31:0/455650329 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8c5c073200 0x7f8c5c0756c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8c70009600 tx=0x7f8c700091e0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.460+0000 7f8c82c00640 1 -- 172.21.15.31:0/455650329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c7c15f000 msgr2=0x7f8c7c1599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:40.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.460+0000 7f8c82c00640 1 --2- 172.21.15.31:0/455650329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c7c15f000 0x7f8c7c1599d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8c74001440 tx=0x7f8c74001530 comp rx=0 tx=0).stop 2024-09-17T05:29:40.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.460+0000 7f8c82c00640 1 -- 172.21.15.31:0/455650329 shutdown_connections 2024-09-17T05:29:40.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.460+0000 7f8c82c00640 1 --2- 172.21.15.31:0/455650329 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8c5c073200 0x7f8c5c0756c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.460+0000 7f8c82c00640 1 --2- 172.21.15.31:0/455650329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c7c15f000 0x7f8c7c1599d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.460+0000 7f8c82c00640 1 --2- 172.21.15.31:0/455650329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c7c0cefb0 0x7f8c7c163ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.460+0000 7f8c82c00640 1 --2- 172.21.15.31:0/455650329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c7c0ccaf0 0x7f8c7c06f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.460+0000 7f8c82c00640 1 -- 172.21.15.31:0/455650329 >> 172.21.15.31:0/455650329 conn(0x7f8c7c09aa10 msgr2=0x7f8c7c0ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:40.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.460+0000 7f8c82c00640 1 -- 172.21.15.31:0/455650329 shutdown_connections 2024-09-17T05:29:40.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.460+0000 7f8c82c00640 1 -- 172.21.15.31:0/455650329 wait complete. 2024-09-17T05:29:40.483 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:29:40.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.628+0000 7f6175a00640 1 -- 172.21.15.31:0/1911960261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61700b0d10 msgr2=0x7f61700d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:40.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.628+0000 7f6175a00640 1 --2- 172.21.15.31:0/1911960261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61700b0d10 0x7f61700d1bb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6170074bf0 tx=0x7f615801c8c0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.628+0000 7f6175a00640 1 -- 172.21.15.31:0/1911960261 shutdown_connections 2024-09-17T05:29:40.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.628+0000 7f6175a00640 1 --2- 172.21.15.31:0/1911960261 >> v2:172.21.15.155:3300/0 conn(0x7f61700d20f0 0x7f61700cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.628+0000 7f6175a00640 1 --2- 172.21.15.31:0/1911960261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61700b0d10 0x7f61700d1bb0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.628+0000 7f6175a00640 1 -- 172.21.15.31:0/1911960261 >> 172.21.15.31:0/1911960261 conn(0x7f617009aa10 msgr2=0x7f617009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:40.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.628+0000 7f6175a00640 1 -- 172.21.15.31:0/1911960261 shutdown_connections 2024-09-17T05:29:40.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.628+0000 7f6175a00640 1 -- 172.21.15.31:0/1911960261 wait complete. 2024-09-17T05:29:40.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175a00640 1 Processor -- start 2024-09-17T05:29:40.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175a00640 1 -- start start 2024-09-17T05:29:40.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61700b0d10 0x7f61700c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:40.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61700d20f0 0x7f617014ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:40.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617015bd40 0x7f617014c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:40.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6170168cb0 con 0x7f617015bd40 2024-09-17T05:29:40.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6170168b30 con 0x7f61700d20f0 2024-09-17T05:29:40.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6170168e30 con 0x7f61700b0d10 2024-09-17T05:29:40.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617015bd40 0x7f617014c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:40.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617015bd40 0x7f617014c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50774/0 (socket says 172.21.15.31:50774) 2024-09-17T05:29:40.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175000640 1 -- 172.21.15.31:0/604300834 learned_addr learned my addr 172.21.15.31:0/604300834 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:40.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f616fe00640 1 --2- 172.21.15.31:0/604300834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61700b0d10 0x7f61700c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:40.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6167e00640 1 --2- 172.21.15.31:0/604300834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61700d20f0 0x7f617014ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:40.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175000640 1 -- 172.21.15.31:0/604300834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61700b0d10 msgr2=0x7f61700c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:40.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175000640 1 --2- 172.21.15.31:0/604300834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61700b0d10 0x7f61700c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175000640 1 -- 172.21.15.31:0/604300834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61700d20f0 msgr2=0x7f617014ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:40.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175000640 1 --2- 172.21.15.31:0/604300834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61700d20f0 0x7f617014ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175000640 1 -- 172.21.15.31:0/604300834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61700c7270 con 0x7f617015bd40 2024-09-17T05:29:40.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175000640 1 --2- 172.21.15.31:0/604300834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617015bd40 0x7f617014c2e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f616800eb20 tx=0x7f616800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:40.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f616cc00640 1 -- 172.21.15.31:0/604300834 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6168004b30 con 0x7f617015bd40 2024-09-17T05:29:40.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f616cc00640 1 -- 172.21.15.31:0/604300834 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6168004cf0 con 0x7f617015bd40 2024-09-17T05:29:40.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f616cc00640 1 -- 172.21.15.31:0/604300834 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6168005280 con 0x7f617015bd40 2024-09-17T05:29:40.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175a00640 1 -- 172.21.15.31:0/604300834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61700c69d0 con 0x7f617015bd40 2024-09-17T05:29:40.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.632+0000 7f6175a00640 1 -- 172.21.15.31:0/604300834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61700c6f90 con 0x7f617015bd40 2024-09-17T05:29:40.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.636+0000 7f6175a00640 1 -- 172.21.15.31:0/604300834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61700d1bb0 con 0x7f617015bd40 2024-09-17T05:29:40.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.636+0000 7f616cc00640 1 -- 172.21.15.31:0/604300834 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f6168005420 con 0x7f617015bd40 2024-09-17T05:29:40.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.636+0000 7f616cc00640 1 --2- 172.21.15.31:0/604300834 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f614c073200 0x7f614c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:40.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.636+0000 7f616cc00640 1 -- 172.21.15.31:0/604300834 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f6168094dd0 con 0x7f617015bd40 2024-09-17T05:29:40.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.636+0000 7f616fe00640 1 --2- 172.21.15.31:0/604300834 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f614c073200 0x7f614c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:40.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.640+0000 7f616fe00640 1 --2- 172.21.15.31:0/604300834 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f614c073200 0x7f614c0756c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6160007fd0 tx=0x7f6160009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:40.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.640+0000 7f616cc00640 1 -- 172.21.15.31:0/604300834 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f616805f820 con 0x7f617015bd40 2024-09-17T05:29:40.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.816+0000 7f6175a00640 1 -- 172.21.15.31:0/604300834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f61700b0970 con 0x7f617015bd40 2024-09-17T05:29:40.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.816+0000 7f616cc00640 1 -- 172.21.15.31:0/604300834 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f6168064250 con 0x7f617015bd40 2024-09-17T05:29:40.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.820+0000 7f6175a00640 1 -- 172.21.15.31:0/604300834 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f614c073200 msgr2=0x7f614c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:40.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.820+0000 7f6175a00640 1 --2- 172.21.15.31:0/604300834 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f614c073200 0x7f614c0756c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6160007fd0 tx=0x7f6160009040 comp rx=0 tx=0).stop 2024-09-17T05:29:40.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.820+0000 7f6175a00640 1 -- 172.21.15.31:0/604300834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617015bd40 msgr2=0x7f617014c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:40.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.820+0000 7f6175a00640 1 --2- 172.21.15.31:0/604300834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617015bd40 0x7f617014c2e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f616800eb20 tx=0x7f616800c2d0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.820+0000 7f6175a00640 1 -- 172.21.15.31:0/604300834 shutdown_connections 2024-09-17T05:29:40.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.820+0000 7f6175a00640 1 --2- 172.21.15.31:0/604300834 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f614c073200 0x7f614c0756c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.820+0000 7f6175a00640 1 --2- 172.21.15.31:0/604300834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617015bd40 0x7f617014c2e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.820+0000 7f6175a00640 1 --2- 172.21.15.31:0/604300834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61700d20f0 0x7f617014ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.820+0000 7f6175a00640 1 --2- 172.21.15.31:0/604300834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61700b0d10 0x7f61700c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:40.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.820+0000 7f6175a00640 1 -- 172.21.15.31:0/604300834 >> 172.21.15.31:0/604300834 conn(0x7f617009aa10 msgr2=0x7f617014edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:40.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.820+0000 7f6175a00640 1 -- 172.21.15.31:0/604300834 shutdown_connections 2024-09-17T05:29:40.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:40.820+0000 7f6175a00640 1 -- 172.21.15.31:0/604300834 wait complete. 2024-09-17T05:29:40.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:40.844 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp3520/subvol16790) 2024-09-17T05:29:40.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:40.877 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-17T05:29:40.930 INFO:teuthology.orchestra.run.smithi031.stdout:cephfs_data 2024-09-17T05:29:40.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:40.931 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/subvol_grp3520/subvol16790) 2024-09-17T05:29:41.004 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:29:41.005 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/mnt.0/./volumes/subvol_grp3520/subvol16790/.meta 2024-09-17T05:29:41.072 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol16790 subvol_grp3520 2024-09-17T05:29:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.264+0000 7fc20e000640 1 -- 172.21.15.31:0/2751582549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc20815a9d0 msgr2=0x7fc2080ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.264+0000 7fc20e000640 1 --2- 172.21.15.31:0/2751582549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc20815a9d0 0x7fc2080ce350 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000aa10 tx=0x7fc1f001dc30 comp rx=0 tx=0).stop 2024-09-17T05:29:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.264+0000 7fc20e000640 1 -- 172.21.15.31:0/2751582549 shutdown_connections 2024-09-17T05:29:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.264+0000 7fc20e000640 1 --2- 172.21.15.31:0/2751582549 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2080ce890 0x7fc20806eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.264+0000 7fc20e000640 1 --2- 172.21.15.31:0/2751582549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc20815a9d0 0x7fc2080ce350 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.264+0000 7fc20e000640 1 -- 172.21.15.31:0/2751582549 >> 172.21.15.31:0/2751582549 conn(0x7fc2080cfbc0 msgr2=0x7fc2080cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:41.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.264+0000 7fc20e000640 1 -- 172.21.15.31:0/2751582549 shutdown_connections 2024-09-17T05:29:41.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.264+0000 7fc20e000640 1 -- 172.21.15.31:0/2751582549 wait complete. 2024-09-17T05:29:41.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.264+0000 7fc20e000640 1 Processor -- start 2024-09-17T05:29:41.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.264+0000 7fc20e000640 1 -- start start 2024-09-17T05:29:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc20e000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2080734f0 0x7fc20814a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc20e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2080ce890 0x7fc20809d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc20e000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc20815a9d0 0x7fc20814b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc20e000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc2081674e0 con 0x7fc2080ce890 2024-09-17T05:29:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc20e000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc208167360 con 0x7fc20815a9d0 2024-09-17T05:29:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc20e000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc208167660 con 0x7fc2080734f0 2024-09-17T05:29:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc1ffe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2080ce890 0x7fc20809d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc1ffe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2080ce890 0x7fc20809d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50798/0 (socket says 172.21.15.31:50798) 2024-09-17T05:29:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc1ffe00640 1 -- 172.21.15.31:0/368760018 learned_addr learned my addr 172.21.15.31:0/368760018 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc207400640 1 --2- 172.21.15.31:0/368760018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2080734f0 0x7fc20814a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc207e00640 1 --2- 172.21.15.31:0/368760018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc20815a9d0 0x7fc20814b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc1ffe00640 1 -- 172.21.15.31:0/368760018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2080734f0 msgr2=0x7fc20814a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc1ffe00640 1 --2- 172.21.15.31:0/368760018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2080734f0 0x7fc20814a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc1ffe00640 1 -- 172.21.15.31:0/368760018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc20815a9d0 msgr2=0x7fc20814b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc1ffe00640 1 --2- 172.21.15.31:0/368760018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc20815a9d0 0x7fc20814b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc1ffe00640 1 -- 172.21.15.31:0/368760018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc208151fa0 con 0x7fc2080ce890 2024-09-17T05:29:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc1ffe00640 1 --2- 172.21.15.31:0/368760018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2080ce890 0x7fc20809d3a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000a960 tx=0x7fc1f00038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc1ff400640 1 -- 172.21.15.31:0/368760018 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f00b3070 con 0x7fc2080ce890 2024-09-17T05:29:41.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc1ff400640 1 -- 172.21.15.31:0/368760018 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1f0003cb0 con 0x7fc2080ce890 2024-09-17T05:29:41.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc1ff400640 1 -- 172.21.15.31:0/368760018 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0003e60 con 0x7fc2080ce890 2024-09-17T05:29:41.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc20e000640 1 -- 172.21.15.31:0/368760018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc20809da10 con 0x7fc2080ce890 2024-09-17T05:29:41.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc20e000640 1 -- 172.21.15.31:0/368760018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc20814dac0 con 0x7fc2080ce890 2024-09-17T05:29:41.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.268+0000 7fc20e000640 1 -- 172.21.15.31:0/368760018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc208069410 con 0x7fc2080ce890 2024-09-17T05:29:41.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.272+0000 7fc1ff400640 1 -- 172.21.15.31:0/368760018 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fc1f00a6d10 con 0x7fc2080ce890 2024-09-17T05:29:41.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.272+0000 7fc1ff400640 1 --2- 172.21.15.31:0/368760018 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc1e4073230 0x7fc1e40756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:41.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.272+0000 7fc1ff400640 1 -- 172.21.15.31:0/368760018 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fc1f012e200 con 0x7fc2080ce890 2024-09-17T05:29:41.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.272+0000 7fc207400640 1 --2- 172.21.15.31:0/368760018 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc1e4073230 0x7fc1e40756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:41.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.272+0000 7fc207400640 1 --2- 172.21.15.31:0/368760018 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc1e4073230 0x7fc1e40756f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8007fd0 tx=0x7fc1f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:41.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.276+0000 7fc1ff400640 1 -- 172.21.15.31:0/368760018 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc1f0017820 con 0x7fc2080ce890 2024-09-17T05:29:41.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.476+0000 7fc20e000640 1 -- 172.21.15.31:0/368760018 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol16790", "group_name": "subvol_grp3520", "target": ["mon-mgr", ""]}) -- 0x7fc208153da0 con 0x7fc1e4073230 2024-09-17T05:29:41.489 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:29:41.487+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:29:41.489 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:29:41.487+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:29:41.489 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:29:41.487+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:29:41.489 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:29:41.487+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:29:41.489 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:29:41.487+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:29:41.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.672+0000 7fc1ff400640 1 -- 172.21.15.31:0/368760018 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fc1f80014b0 con 0x7fc1e4073230 2024-09-17T05:29:41.679 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/subvol_grp3520/subvol16790 2024-09-17T05:29:41.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.676+0000 7fc20e000640 1 -- 172.21.15.31:0/368760018 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc1e4073230 msgr2=0x7fc1e40756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:41.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.676+0000 7fc20e000640 1 --2- 172.21.15.31:0/368760018 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc1e4073230 0x7fc1e40756f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8007fd0 tx=0x7fc1f8009040 comp rx=0 tx=0).stop 2024-09-17T05:29:41.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.676+0000 7fc20e000640 1 -- 172.21.15.31:0/368760018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2080ce890 msgr2=0x7fc20809d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:41.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.676+0000 7fc20e000640 1 --2- 172.21.15.31:0/368760018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2080ce890 0x7fc20809d3a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000a960 tx=0x7fc1f00038b0 comp rx=0 tx=0).stop 2024-09-17T05:29:41.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.676+0000 7fc20e000640 1 -- 172.21.15.31:0/368760018 shutdown_connections 2024-09-17T05:29:41.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.676+0000 7fc20e000640 1 --2- 172.21.15.31:0/368760018 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc1e4073230 0x7fc1e40756f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:41.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.676+0000 7fc20e000640 1 --2- 172.21.15.31:0/368760018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc20815a9d0 0x7fc20814b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:41.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.676+0000 7fc20e000640 1 --2- 172.21.15.31:0/368760018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2080ce890 0x7fc20809d3a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:41.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.676+0000 7fc20e000640 1 --2- 172.21.15.31:0/368760018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2080734f0 0x7fc20814a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:41.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.676+0000 7fc20e000640 1 -- 172.21.15.31:0/368760018 >> 172.21.15.31:0/368760018 conn(0x7fc2080cfbc0 msgr2=0x7fc20815c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:41.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.676+0000 7fc20e000640 1 -- 172.21.15.31:0/368760018 shutdown_connections 2024-09-17T05:29:41.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.676+0000 7fc20e000640 1 -- 172.21.15.31:0/368760018 wait complete. 2024-09-17T05:29:41.700 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol16790 subvol_grp3520 2024-09-17T05:29:41.739 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:29:41.750 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:29:41.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.848+0000 7fae5d000640 1 -- 172.21.15.31:0/2862121122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae58160150 msgr2=0x7fae580b1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:41.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.848+0000 7fae5d000640 1 --2- 172.21.15.31:0/2862121122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae58160150 0x7fae580b1500 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fae50009c80 tx=0x7fae5001cda0 comp rx=0 tx=0).stop 2024-09-17T05:29:41.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.848+0000 7fae5d000640 1 -- 172.21.15.31:0/2862121122 shutdown_connections 2024-09-17T05:29:41.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.848+0000 7fae5d000640 1 --2- 172.21.15.31:0/2862121122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae58160150 0x7fae580b1500 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:41.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.848+0000 7fae5d000640 1 --2- 172.21.15.31:0/2862121122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae580b2a20 0x7fae580d0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:41.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.848+0000 7fae5d000640 1 -- 172.21.15.31:0/2862121122 >> 172.21.15.31:0/2862121122 conn(0x7fae580d1c60 msgr2=0x7fae580d2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:41.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.848+0000 7fae5d000640 1 -- 172.21.15.31:0/2862121122 shutdown_connections 2024-09-17T05:29:41.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.848+0000 7fae5d000640 1 -- 172.21.15.31:0/2862121122 wait complete. 2024-09-17T05:29:41.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.848+0000 7fae5d000640 1 Processor -- start 2024-09-17T05:29:41.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.848+0000 7fae5d000640 1 -- start start 2024-09-17T05:29:41.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae5d000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae580b2a20 0x7fae58154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:41.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae5d000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae580cfca0 0x7fae5815c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:41.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae5d000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae58160150 0x7fae580b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:41.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae5d000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fae58168f60 con 0x7fae580cfca0 2024-09-17T05:29:41.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae5d000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fae580b2840 con 0x7fae580b2a20 2024-09-17T05:29:41.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae5d000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fae581690e0 con 0x7fae58160150 2024-09-17T05:29:41.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae4fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae580cfca0 0x7fae5815c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:41.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae4fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae580cfca0 0x7fae5815c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50812/0 (socket says 172.21.15.31:50812) 2024-09-17T05:29:41.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae4fe00640 1 -- 172.21.15.31:0/1036710918 learned_addr learned my addr 172.21.15.31:0/1036710918 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:41.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae57400640 1 --2- 172.21.15.31:0/1036710918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae580b2a20 0x7fae58154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:41.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae57e00640 1 --2- 172.21.15.31:0/1036710918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae58160150 0x7fae580b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:41.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae4fe00640 1 -- 172.21.15.31:0/1036710918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae58160150 msgr2=0x7fae580b70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:41.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae4fe00640 1 --2- 172.21.15.31:0/1036710918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae58160150 0x7fae580b70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:41.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae4fe00640 1 -- 172.21.15.31:0/1036710918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae580b2a20 msgr2=0x7fae58154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:41.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae4fe00640 1 --2- 172.21.15.31:0/1036710918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae580b2a20 0x7fae58154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:41.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae4fe00640 1 -- 172.21.15.31:0/1036710918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5814a3e0 con 0x7fae580cfca0 2024-09-17T05:29:41.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae4fe00640 1 --2- 172.21.15.31:0/1036710918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae580cfca0 0x7fae5815c4d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fae4000e9c0 tx=0x7fae4000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:41.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae4f400640 1 -- 172.21.15.31:0/1036710918 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4000cd20 con 0x7fae580cfca0 2024-09-17T05:29:41.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae4f400640 1 -- 172.21.15.31:0/1036710918 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae40004030 con 0x7fae580cfca0 2024-09-17T05:29:41.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae4f400640 1 -- 172.21.15.31:0/1036710918 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae40004480 con 0x7fae580cfca0 2024-09-17T05:29:41.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae5d000640 1 -- 172.21.15.31:0/1036710918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae5814a6c0 con 0x7fae580cfca0 2024-09-17T05:29:41.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae5d000640 1 -- 172.21.15.31:0/1036710918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae5814a9a0 con 0x7fae580cfca0 2024-09-17T05:29:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae5d000640 1 -- 172.21.15.31:0/1036710918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae580d0080 con 0x7fae580cfca0 2024-09-17T05:29:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.852+0000 7fae4f400640 1 -- 172.21.15.31:0/1036710918 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fae40003600 con 0x7fae580cfca0 2024-09-17T05:29:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.856+0000 7fae4f400640 1 --2- 172.21.15.31:0/1036710918 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fae34073200 0x7fae340756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.856+0000 7fae4f400640 1 -- 172.21.15.31:0/1036710918 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fae40094bd0 con 0x7fae580cfca0 2024-09-17T05:29:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.856+0000 7fae57400640 1 --2- 172.21.15.31:0/1036710918 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fae34073200 0x7fae340756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:41.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.856+0000 7fae57400640 1 --2- 172.21.15.31:0/1036710918 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fae34073200 0x7fae340756c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fae48007fd0 tx=0x7fae48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:41.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:41.860+0000 7fae4f400640 1 -- 172.21.15.31:0/1036710918 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fae4005f5b0 con 0x7fae580cfca0 2024-09-17T05:29:42.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.060+0000 7fae5d000640 1 -- 172.21.15.31:0/1036710918 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol16790", "group_name": "subvol_grp3520", "target": ["mon-mgr", ""]}) -- 0x7fae580ce820 con 0x7fae34073200 2024-09-17T05:29:42.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.064+0000 7fae4f400640 1 -- 172.21.15.31:0/1036710918 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fae580ce820 con 0x7fae34073200 2024-09-17T05:29:42.071 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/subvol_grp3520/subvol16790 2024-09-17T05:29:42.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.068+0000 7fae5d000640 1 -- 172.21.15.31:0/1036710918 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fae34073200 msgr2=0x7fae340756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:42.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.068+0000 7fae5d000640 1 --2- 172.21.15.31:0/1036710918 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fae34073200 0x7fae340756c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fae48007fd0 tx=0x7fae48009040 comp rx=0 tx=0).stop 2024-09-17T05:29:42.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.068+0000 7fae5d000640 1 -- 172.21.15.31:0/1036710918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae580cfca0 msgr2=0x7fae5815c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:42.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.068+0000 7fae5d000640 1 --2- 172.21.15.31:0/1036710918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae580cfca0 0x7fae5815c4d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fae4000e9c0 tx=0x7fae4000ee80 comp rx=0 tx=0).stop 2024-09-17T05:29:42.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.068+0000 7fae5d000640 1 -- 172.21.15.31:0/1036710918 shutdown_connections 2024-09-17T05:29:42.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.068+0000 7fae5d000640 1 --2- 172.21.15.31:0/1036710918 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fae34073200 0x7fae340756c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:42.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.068+0000 7fae5d000640 1 --2- 172.21.15.31:0/1036710918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae58160150 0x7fae580b70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:42.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.068+0000 7fae5d000640 1 --2- 172.21.15.31:0/1036710918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fae580cfca0 0x7fae5815c4d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:42.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.068+0000 7fae5d000640 1 --2- 172.21.15.31:0/1036710918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae580b2a20 0x7fae58154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:42.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.068+0000 7fae5d000640 1 -- 172.21.15.31:0/1036710918 >> 172.21.15.31:0/1036710918 conn(0x7fae580d1c60 msgr2=0x7fae580b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:42.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.068+0000 7fae5d000640 1 -- 172.21.15.31:0/1036710918 shutdown_connections 2024-09-17T05:29:42.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.068+0000 7fae5d000640 1 -- 172.21.15.31:0/1036710918 wait complete. 2024-09-17T05:29:42.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:42.094 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/77c019d880b978cc0e318c39951ae354.meta) 2024-09-17T05:29:42.166 INFO:teuthology.orchestra.run.smithi031.stdout:[GLOBAL] 2024-09-17T05:29:42.166 INFO:teuthology.orchestra.run.smithi031.stdout:version = 1 2024-09-17T05:29:42.166 INFO:teuthology.orchestra.run.smithi031.stdout:type = subvolume 2024-09-17T05:29:42.166 INFO:teuthology.orchestra.run.smithi031.stdout:path = /volumes/subvol_grp3520/subvol16790 2024-09-17T05:29:42.166 INFO:teuthology.orchestra.run.smithi031.stdout:state = complete 2024-09-17T05:29:42.166 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:42.168 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol16790 subvol_grp3520 2024-09-17T05:29:42.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.360+0000 7fb6fe000640 1 -- 172.21.15.31:0/3463668506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f81561a0 msgr2=0x7fb6f80cd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:42.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.360+0000 7fb6fe000640 1 --2- 172.21.15.31:0/3463668506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f81561a0 0x7fb6f80cd7f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8009840 tx=0x7fb6e801c700 comp rx=0 tx=0).stop 2024-09-17T05:29:42.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.360+0000 7fb6fe000640 1 -- 172.21.15.31:0/3463668506 shutdown_connections 2024-09-17T05:29:42.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.360+0000 7fb6fe000640 1 --2- 172.21.15.31:0/3463668506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6f815fe70 0x7fb6f8073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:42.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.360+0000 7fb6fe000640 1 --2- 172.21.15.31:0/3463668506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f81561a0 0x7fb6f80cd7f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:42.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.360+0000 7fb6fe000640 1 -- 172.21.15.31:0/3463668506 >> 172.21.15.31:0/3463668506 conn(0x7fb6f80b2140 msgr2=0x7fb6f80b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:42.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.360+0000 7fb6fe000640 1 -- 172.21.15.31:0/3463668506 shutdown_connections 2024-09-17T05:29:42.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.360+0000 7fb6fe000640 1 -- 172.21.15.31:0/3463668506 wait complete. 2024-09-17T05:29:42.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.360+0000 7fb6fe000640 1 Processor -- start 2024-09-17T05:29:42.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.360+0000 7fb6fe000640 1 -- start start 2024-09-17T05:29:42.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6fe000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6f80b3440 0x7fb6f80cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:42.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6fe000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6f81561a0 0x7fb6f815e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:42.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6fe000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f815fe70 0x7fb6f815ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:42.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6fe000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f8168fd0 con 0x7fb6f815fe70 2024-09-17T05:29:42.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6fe000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f8168e50 con 0x7fb6f80b3440 2024-09-17T05:29:42.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6fe000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb6f8169150 con 0x7fb6f81561a0 2024-09-17T05:29:42.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6f7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f815fe70 0x7fb6f815ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:42.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6f7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f815fe70 0x7fb6f815ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50832/0 (socket says 172.21.15.31:50832) 2024-09-17T05:29:42.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6f7e00640 1 -- 172.21.15.31:0/2450838985 learned_addr learned my addr 172.21.15.31:0/2450838985 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:42.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6efe00640 1 --2- 172.21.15.31:0/2450838985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6f81561a0 0x7fb6f815e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:42.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6f7400640 1 --2- 172.21.15.31:0/2450838985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6f80b3440 0x7fb6f80cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:42.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6f7e00640 1 -- 172.21.15.31:0/2450838985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6f81561a0 msgr2=0x7fb6f815e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:42.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6f7e00640 1 --2- 172.21.15.31:0/2450838985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6f81561a0 0x7fb6f815e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:42.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6f7e00640 1 -- 172.21.15.31:0/2450838985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6f80b3440 msgr2=0x7fb6f80cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:42.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6f7e00640 1 --2- 172.21.15.31:0/2450838985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6f80b3440 0x7fb6f80cfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:42.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6f7e00640 1 -- 172.21.15.31:0/2450838985 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f8165990 con 0x7fb6f815fe70 2024-09-17T05:29:42.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6efe00640 1 --2- 172.21.15.31:0/2450838985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6f81561a0 0x7fb6f815e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:42.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6f7400640 1 --2- 172.21.15.31:0/2450838985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6f80b3440 0x7fb6f80cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:42.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6f7e00640 1 --2- 172.21.15.31:0/2450838985 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f815fe70 0x7fb6f815ee30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000da10 tx=0x7fb6f000ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:42.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6ef400640 1 -- 172.21.15.31:0/2450838985 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0017070 con 0x7fb6f815fe70 2024-09-17T05:29:42.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6ef400640 1 -- 172.21.15.31:0/2450838985 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6f0004b30 con 0x7fb6f815fe70 2024-09-17T05:29:42.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6ef400640 1 -- 172.21.15.31:0/2450838985 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f000be60 con 0x7fb6f815fe70 2024-09-17T05:29:42.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6fe000640 1 -- 172.21.15.31:0/2450838985 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f81fc2c0 con 0x7fb6f815fe70 2024-09-17T05:29:42.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6fe000640 1 -- 172.21.15.31:0/2450838985 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f81fbfe0 con 0x7fb6f815fe70 2024-09-17T05:29:42.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.364+0000 7fb6fe000640 1 -- 172.21.15.31:0/2450838985 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6f80cd7f0 con 0x7fb6f815fe70 2024-09-17T05:29:42.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.368+0000 7fb6ef400640 1 -- 172.21.15.31:0/2450838985 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fb6f0010460 con 0x7fb6f815fe70 2024-09-17T05:29:42.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.368+0000 7fb6ef400640 1 --2- 172.21.15.31:0/2450838985 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb6d4073200 0x7fb6d40756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:42.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.368+0000 7fb6ef400640 1 -- 172.21.15.31:0/2450838985 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fb6f00946f0 con 0x7fb6f815fe70 2024-09-17T05:29:42.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.368+0000 7fb6f7400640 1 --2- 172.21.15.31:0/2450838985 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb6d4073200 0x7fb6d40756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:42.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.368+0000 7fb6f7400640 1 --2- 172.21.15.31:0/2450838985 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb6d4073200 0x7fb6d40756c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80af000 tx=0x7fb6e801af40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:42.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.372+0000 7fb6ef400640 1 -- 172.21.15.31:0/2450838985 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb6f0020070 con 0x7fb6f815fe70 2024-09-17T05:29:42.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.576+0000 7fb6fe000640 1 -- 172.21.15.31:0/2450838985 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol16790", "group_name": "subvol_grp3520", "target": ["mon-mgr", ""]}) -- 0x7fb6f80ccba0 con 0x7fb6d4073200 2024-09-17T05:29:42.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.608+0000 7fb6ef400640 1 -- 172.21.15.31:0/2450838985 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb6f80ccba0 con 0x7fb6d4073200 2024-09-17T05:29:42.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.612+0000 7fb6fe000640 1 -- 172.21.15.31:0/2450838985 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb6d4073200 msgr2=0x7fb6d40756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:42.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.612+0000 7fb6fe000640 1 --2- 172.21.15.31:0/2450838985 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb6d4073200 0x7fb6d40756c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80af000 tx=0x7fb6e801af40 comp rx=0 tx=0).stop 2024-09-17T05:29:42.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.612+0000 7fb6fe000640 1 -- 172.21.15.31:0/2450838985 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f815fe70 msgr2=0x7fb6f815ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:42.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.612+0000 7fb6fe000640 1 --2- 172.21.15.31:0/2450838985 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f815fe70 0x7fb6f815ee30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000da10 tx=0x7fb6f000ded0 comp rx=0 tx=0).stop 2024-09-17T05:29:42.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.612+0000 7fb6fe000640 1 -- 172.21.15.31:0/2450838985 shutdown_connections 2024-09-17T05:29:42.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.612+0000 7fb6fe000640 1 --2- 172.21.15.31:0/2450838985 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb6d4073200 0x7fb6d40756c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:42.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.612+0000 7fb6fe000640 1 --2- 172.21.15.31:0/2450838985 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f815fe70 0x7fb6f815ee30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:42.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.612+0000 7fb6fe000640 1 --2- 172.21.15.31:0/2450838985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6f81561a0 0x7fb6f815e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:42.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.612+0000 7fb6fe000640 1 --2- 172.21.15.31:0/2450838985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6f80b3440 0x7fb6f80cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:42.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.612+0000 7fb6fe000640 1 -- 172.21.15.31:0/2450838985 >> 172.21.15.31:0/2450838985 conn(0x7fb6f80b2140 msgr2=0x7fb6f806f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:42.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.612+0000 7fb6fe000640 1 -- 172.21.15.31:0/2450838985 shutdown_connections 2024-09-17T05:29:42.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.612+0000 7fb6fe000640 1 -- 172.21.15.31:0/2450838985 wait complete. 2024-09-17T05:29:42.620 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:29:42.615+0000 7faafdc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:29:42.620 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:29:42.615+0000 7faafdc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:29:42.620 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:29:42.615+0000 7faafdc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:29:42.620 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:29:42.615+0000 7faafdc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:29:42.620 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:29:42.615+0000 7faafdc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:29:42.638 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:29:42.635+0000 7faafbe00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:29:42.638 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:29:42.635+0000 7faafbe00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:29:42.638 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:29:42.635+0000 7faafbe00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:29:42.638 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:29:42.635+0000 7faafbe00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:29:42.638 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:29:42.635+0000 7faafbe00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:29:42.639 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:29:42.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:29:42.713 INFO:teuthology.orchestra.run.smithi031.stdout:2 2024-09-17T05:29:42.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:29:42.720 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp3520 2024-09-17T05:29:42.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.864+0000 7f85f8e00640 1 -- 172.21.15.31:0/3308435100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85f415ecd0 msgr2=0x7f85f415b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:42.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.864+0000 7f85f8e00640 1 --2- 172.21.15.31:0/3308435100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85f415ecd0 0x7f85f415b1a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f85f40763e0 tx=0x7f85ec01cd80 comp rx=0 tx=0).stop 2024-09-17T05:29:42.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.864+0000 7f85f8e00640 1 -- 172.21.15.31:0/3308435100 shutdown_connections 2024-09-17T05:29:42.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.864+0000 7f85f8e00640 1 --2- 172.21.15.31:0/3308435100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85f415ecd0 0x7f85f415b1a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:42.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.864+0000 7f85f8e00640 1 --2- 172.21.15.31:0/3308435100 >> v2:172.21.15.155:3300/0 conn(0x7f85f4073f50 0x7f85f415e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:42.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.864+0000 7f85f8e00640 1 --2- 172.21.15.31:0/3308435100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f41585f0 0x7f85f4073a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:42.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.864+0000 7f85f8e00640 1 -- 172.21.15.31:0/3308435100 >> 172.21.15.31:0/3308435100 conn(0x7f85f40cce90 msgr2=0x7f85f40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:42.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.864+0000 7f85f8e00640 1 -- 172.21.15.31:0/3308435100 shutdown_connections 2024-09-17T05:29:42.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.864+0000 7f85f8e00640 1 -- 172.21.15.31:0/3308435100 wait complete. 2024-09-17T05:29:42.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.864+0000 7f85f8e00640 1 Processor -- start 2024-09-17T05:29:42.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.864+0000 7f85f8e00640 1 -- start start 2024-09-17T05:29:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f8e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85f4073f50 0x7f85f4148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f8e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85f41585f0 0x7f85f4149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f8e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f415ecd0 0x7f85f414a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f8e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f85f40cf000 con 0x7f85f4073f50 2024-09-17T05:29:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f8e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f85f40cee80 con 0x7f85f41585f0 2024-09-17T05:29:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f8e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f85f40cf180 con 0x7f85f415ecd0 2024-09-17T05:29:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85f4073f50 0x7f85f4148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85f4073f50 0x7f85f4148da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50856/0 (socket says 172.21.15.31:50856) 2024-09-17T05:29:42.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f1e00640 1 -- 172.21.15.31:0/3499524553 learned_addr learned my addr 172.21.15.31:0/3499524553 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:42.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f2800640 1 --2- 172.21.15.31:0/3499524553 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f415ecd0 0x7f85f414a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:42.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85e9400640 1 --2- 172.21.15.31:0/3499524553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85f41585f0 0x7f85f4149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:42.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f1e00640 1 -- 172.21.15.31:0/3499524553 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f415ecd0 msgr2=0x7f85f414a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:42.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f1e00640 1 --2- 172.21.15.31:0/3499524553 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f415ecd0 0x7f85f414a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:42.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f1e00640 1 -- 172.21.15.31:0/3499524553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85f41585f0 msgr2=0x7f85f4149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:42.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f1e00640 1 --2- 172.21.15.31:0/3499524553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85f41585f0 0x7f85f4149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:42.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f1e00640 1 -- 172.21.15.31:0/3499524553 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f40b5750 con 0x7f85f4073f50 2024-09-17T05:29:42.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f2800640 1 --2- 172.21.15.31:0/3499524553 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f415ecd0 0x7f85f414a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:42.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85e9400640 1 --2- 172.21.15.31:0/3499524553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85f41585f0 0x7f85f4149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:42.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f1e00640 1 --2- 172.21.15.31:0/3499524553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85f4073f50 0x7f85f4148da0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f85e400b550 tx=0x7f85e400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:42.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85eaa00640 1 -- 172.21.15.31:0/3499524553 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e4014070 con 0x7f85f4073f50 2024-09-17T05:29:42.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85eaa00640 1 -- 172.21.15.31:0/3499524553 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85e4010980 con 0x7f85f4073f50 2024-09-17T05:29:42.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f8e00640 1 -- 172.21.15.31:0/3499524553 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f40b5a30 con 0x7f85f4073f50 2024-09-17T05:29:42.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85eaa00640 1 -- 172.21.15.31:0/3499524553 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e4010dd0 con 0x7f85f4073f50 2024-09-17T05:29:42.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f8e00640 1 -- 172.21.15.31:0/3499524553 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f40b5390 con 0x7f85f4073f50 2024-09-17T05:29:42.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85f8e00640 1 -- 172.21.15.31:0/3499524553 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f4073a10 con 0x7f85f4073f50 2024-09-17T05:29:42.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.868+0000 7f85eaa00640 1 -- 172.21.15.31:0/3499524553 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f85e4017070 con 0x7f85f4073f50 2024-09-17T05:29:42.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.872+0000 7f85eaa00640 1 --2- 172.21.15.31:0/3499524553 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f85d0073200 0x7f85d00756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:42.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.872+0000 7f85eaa00640 1 -- 172.21.15.31:0/3499524553 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f85e4093fe0 con 0x7f85f4073f50 2024-09-17T05:29:42.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.872+0000 7f85e9400640 1 --2- 172.21.15.31:0/3499524553 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f85d0073200 0x7f85d00756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:42.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.872+0000 7f85e9400640 1 --2- 172.21.15.31:0/3499524553 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f85d0073200 0x7f85d00756c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f85f4152f30 tx=0x7f85dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:42.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:42.876+0000 7f85eaa00640 1 -- 172.21.15.31:0/3499524553 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f85e405f0e0 con 0x7f85f4073f50 2024-09-17T05:29:43.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.072+0000 7f85f8e00640 1 -- 172.21.15.31:0/3499524553 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp3520", "target": ["mon-mgr", ""]}) -- 0x7f85f4153870 con 0x7f85d0073200 2024-09-17T05:29:43.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.076+0000 7f85eaa00640 1 -- 172.21.15.31:0/3499524553 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f85f4153870 con 0x7f85d0073200 2024-09-17T05:29:43.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.080+0000 7f85f8e00640 1 -- 172.21.15.31:0/3499524553 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f85d0073200 msgr2=0x7f85d00756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:43.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.080+0000 7f85f8e00640 1 --2- 172.21.15.31:0/3499524553 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f85d0073200 0x7f85d00756c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f85f4152f30 tx=0x7f85dc008040 comp rx=0 tx=0).stop 2024-09-17T05:29:43.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.080+0000 7f85f8e00640 1 -- 172.21.15.31:0/3499524553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85f4073f50 msgr2=0x7f85f4148da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:43.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.080+0000 7f85f8e00640 1 --2- 172.21.15.31:0/3499524553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85f4073f50 0x7f85f4148da0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f85e400b550 tx=0x7f85e400ba10 comp rx=0 tx=0).stop 2024-09-17T05:29:43.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.080+0000 7f85f8e00640 1 -- 172.21.15.31:0/3499524553 shutdown_connections 2024-09-17T05:29:43.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.080+0000 7f85f8e00640 1 --2- 172.21.15.31:0/3499524553 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f85d0073200 0x7f85d00756c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:43.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.080+0000 7f85f8e00640 1 --2- 172.21.15.31:0/3499524553 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85f415ecd0 0x7f85f414a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:43.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.080+0000 7f85f8e00640 1 --2- 172.21.15.31:0/3499524553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85f41585f0 0x7f85f4149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:43.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.080+0000 7f85f8e00640 1 --2- 172.21.15.31:0/3499524553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85f4073f50 0x7f85f4148da0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:43.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.080+0000 7f85f8e00640 1 -- 172.21.15.31:0/3499524553 >> 172.21.15.31:0/3499524553 conn(0x7f85f40cce90 msgr2=0x7f85f406f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:43.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.080+0000 7f85f8e00640 1 -- 172.21.15.31:0/3499524553 shutdown_connections 2024-09-17T05:29:43.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.080+0000 7f85f8e00640 1 -- 172.21.15.31:0/3499524553 wait complete. 2024-09-17T05:29:43.104 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:29:43.104 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:29:43.182 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:29:43.263 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:29:43.263 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:29:43.263 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:29:43.263 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:43.272 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:29:43.273 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:43.323 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:29:43.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.512+0000 7fe074000640 1 -- 172.21.15.31:0/2677412952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe06c0cdb30 msgr2=0x7fe06c0cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:43.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.512+0000 7fe074000640 1 --2- 172.21.15.31:0/2677412952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe06c0cdb30 0x7fe06c0cebb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0745d0 tx=0x7fe05801c8c0 comp rx=0 tx=0).stop 2024-09-17T05:29:43.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.512+0000 7fe074000640 1 -- 172.21.15.31:0/2677412952 shutdown_connections 2024-09-17T05:29:43.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.512+0000 7fe074000640 1 --2- 172.21.15.31:0/2677412952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe06c0d28e0 0x7fe06c0cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:43.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.512+0000 7fe074000640 1 --2- 172.21.15.31:0/2677412952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe06c0cdb30 0x7fe06c0cebb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:43.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.512+0000 7fe074000640 1 --2- 172.21.15.31:0/2677412952 >> v2:172.21.15.155:3300/0 conn(0x7fe06c15bea0 0x7fe06c0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:43.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.512+0000 7fe074000640 1 -- 172.21.15.31:0/2677412952 >> 172.21.15.31:0/2677412952 conn(0x7fe06c0d1dc0 msgr2=0x7fe06c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:43.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.512+0000 7fe074000640 1 -- 172.21.15.31:0/2677412952 shutdown_connections 2024-09-17T05:29:43.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.512+0000 7fe074000640 1 -- 172.21.15.31:0/2677412952 wait complete. 2024-09-17T05:29:43.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe074000640 1 Processor -- start 2024-09-17T05:29:43.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe074000640 1 -- start start 2024-09-17T05:29:43.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe074000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe06c0cdb30 0x7fe06c158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:43.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe074000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe06c0d28e0 0x7fe06c0cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:43.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe074000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe06c15bea0 0x7fe06c0cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:43.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe074000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c0af070 con 0x7fe06c15bea0 2024-09-17T05:29:43.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe074000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c0aeef0 con 0x7fe06c0d28e0 2024-09-17T05:29:43.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe074000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe06c0af1f0 con 0x7fe06c0cdb30 2024-09-17T05:29:43.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe072000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe06c15bea0 0x7fe06c0cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:43.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe072000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe06c15bea0 0x7fe06c0cb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50868/0 (socket says 172.21.15.31:50868) 2024-09-17T05:29:43.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe072000640 1 -- 172.21.15.31:0/3579083278 learned_addr learned my addr 172.21.15.31:0/3579083278 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:43.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe071600640 1 --2- 172.21.15.31:0/3579083278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe06c0cdb30 0x7fe06c158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:43.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe070c00640 1 --2- 172.21.15.31:0/3579083278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe06c0d28e0 0x7fe06c0cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:43.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe072000640 1 -- 172.21.15.31:0/3579083278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe06c0cdb30 msgr2=0x7fe06c158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:43.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe072000640 1 --2- 172.21.15.31:0/3579083278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe06c0cdb30 0x7fe06c158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:43.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe072000640 1 -- 172.21.15.31:0/3579083278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe06c0d28e0 msgr2=0x7fe06c0cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:43.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe072000640 1 --2- 172.21.15.31:0/3579083278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe06c0d28e0 0x7fe06c0cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:43.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe072000640 1 -- 172.21.15.31:0/3579083278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe06c1f62b0 con 0x7fe06c15bea0 2024-09-17T05:29:43.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe071600640 1 --2- 172.21.15.31:0/3579083278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe06c0cdb30 0x7fe06c158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:43.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe070c00640 1 --2- 172.21.15.31:0/3579083278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe06c0d28e0 0x7fe06c0cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:43.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe072000640 1 --2- 172.21.15.31:0/3579083278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe06c15bea0 0x7fe06c0cb720 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe06400e990 tx=0x7fe06400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:43.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe069600640 1 -- 172.21.15.31:0/3579083278 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064004d30 con 0x7fe06c15bea0 2024-09-17T05:29:43.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe069600640 1 -- 172.21.15.31:0/3579083278 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe06400cb00 con 0x7fe06c15bea0 2024-09-17T05:29:43.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe074000640 1 -- 172.21.15.31:0/3579083278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe06c1f6590 con 0x7fe06c15bea0 2024-09-17T05:29:43.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe069600640 1 -- 172.21.15.31:0/3579083278 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064005020 con 0x7fe06c15bea0 2024-09-17T05:29:43.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.516+0000 7fe074000640 1 -- 172.21.15.31:0/3579083278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe06c0cb220 con 0x7fe06c15bea0 2024-09-17T05:29:43.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.520+0000 7fe074000640 1 -- 172.21.15.31:0/3579083278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe06c157240 con 0x7fe06c15bea0 2024-09-17T05:29:43.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.520+0000 7fe069600640 1 -- 172.21.15.31:0/3579083278 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7fe0640051c0 con 0x7fe06c15bea0 2024-09-17T05:29:43.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.520+0000 7fe069600640 1 --2- 172.21.15.31:0/3579083278 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe04c073200 0x7fe04c0756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:43.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.520+0000 7fe069600640 1 -- 172.21.15.31:0/3579083278 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe064094b20 con 0x7fe06c15bea0 2024-09-17T05:29:43.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.520+0000 7fe071600640 1 --2- 172.21.15.31:0/3579083278 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe04c073200 0x7fe04c0756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:43.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.520+0000 7fe071600640 1 --2- 172.21.15.31:0/3579083278 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe04c073200 0x7fe04c0756c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe06000bbd0 tx=0x7fe06000b5b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:43.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.524+0000 7fe069600640 1 -- 172.21.15.31:0/3579083278 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe064016030 con 0x7fe06c15bea0 2024-09-17T05:29:43.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.712+0000 7fe074000640 1 -- 172.21.15.31:0/3579083278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe06c0cc9d0 con 0x7fe06c15bea0 2024-09-17T05:29:43.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.712+0000 7fe069600640 1 -- 172.21.15.31:0/3579083278 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) ==== 80+0+0 (secure 0 0 0) 0x7fe06405fbc0 con 0x7fe06c15bea0 2024-09-17T05:29:43.717 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:29:43.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.712+0000 7fe074000640 1 -- 172.21.15.31:0/3579083278 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe04c073200 msgr2=0x7fe04c0756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:43.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.712+0000 7fe074000640 1 --2- 172.21.15.31:0/3579083278 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe04c073200 0x7fe04c0756c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe06000bbd0 tx=0x7fe06000b5b0 comp rx=0 tx=0).stop 2024-09-17T05:29:43.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.712+0000 7fe074000640 1 -- 172.21.15.31:0/3579083278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe06c15bea0 msgr2=0x7fe06c0cb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:43.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.712+0000 7fe074000640 1 --2- 172.21.15.31:0/3579083278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe06c15bea0 0x7fe06c0cb720 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe06400e990 tx=0x7fe06400ee50 comp rx=0 tx=0).stop 2024-09-17T05:29:43.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.712+0000 7fe074000640 1 -- 172.21.15.31:0/3579083278 shutdown_connections 2024-09-17T05:29:43.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.712+0000 7fe074000640 1 --2- 172.21.15.31:0/3579083278 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe04c073200 0x7fe04c0756c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:43.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.712+0000 7fe074000640 1 --2- 172.21.15.31:0/3579083278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe06c15bea0 0x7fe06c0cb720 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:43.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.712+0000 7fe074000640 1 --2- 172.21.15.31:0/3579083278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe06c0d28e0 0x7fe06c0cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:43.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.712+0000 7fe074000640 1 --2- 172.21.15.31:0/3579083278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe06c0cdb30 0x7fe06c158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:43.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.712+0000 7fe074000640 1 -- 172.21.15.31:0/3579083278 >> 172.21.15.31:0/3579083278 conn(0x7fe06c0d1dc0 msgr2=0x7fe06c0b6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:43.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.712+0000 7fe074000640 1 -- 172.21.15.31:0/3579083278 shutdown_connections 2024-09-17T05:29:43.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:43.712+0000 7fe074000640 1 -- 172.21.15.31:0/3579083278 wait complete. 2024-09-17T05:29:43.741 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:29:43.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:43.741 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:29:43.800 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:29:43.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:43.801 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:29:43.815 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:29:43.815 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:29:43.816 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:43.832 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:29:43.832 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:43.884 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:29:44.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.028+0000 7f745ae00640 1 -- 172.21.15.31:0/276210318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7438005220 msgr2=0x7f743800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:44.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.028+0000 7f745ae00640 1 --2- 172.21.15.31:0/276210318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7438005220 0x7f743800b9d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f74540b27a0 tx=0x7f744c01d1c0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.028+0000 7f745ae00640 1 -- 172.21.15.31:0/276210318 shutdown_connections 2024-09-17T05:29:44.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.028+0000 7f745ae00640 1 --2- 172.21.15.31:0/276210318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7438005220 0x7f743800b9d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.028+0000 7f745ae00640 1 -- 172.21.15.31:0/276210318 >> 172.21.15.31:0/276210318 conn(0x7f74540b18f0 msgr2=0x7f74540b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:44.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.028+0000 7f745ae00640 1 -- 172.21.15.31:0/276210318 shutdown_connections 2024-09-17T05:29:44.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.028+0000 7f745ae00640 1 -- 172.21.15.31:0/276210318 wait complete. 2024-09-17T05:29:44.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.028+0000 7f745ae00640 1 Processor -- start 2024-09-17T05:29:44.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.028+0000 7f745ae00640 1 -- start start 2024-09-17T05:29:44.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f745ae00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7438005220 0x7f74541586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:44.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f745ae00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74540ce490 0x7f7454145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:44.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f745ae00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7454145960 0x7f74540c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:44.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f745ae00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f74540cc660 con 0x7f7438005220 2024-09-17T05:29:44.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f745ae00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74540cd780 con 0x7f7454145960 2024-09-17T05:29:44.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f745ae00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f74540cc7e0 con 0x7f74540ce490 2024-09-17T05:29:44.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f7453e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7438005220 0x7f74541586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:44.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f7453e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7438005220 0x7f74541586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50898/0 (socket says 172.21.15.31:50898) 2024-09-17T05:29:44.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f7453e00640 1 -- 172.21.15.31:0/1703407997 learned_addr learned my addr 172.21.15.31:0/1703407997 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:44.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f744be00640 1 --2- 172.21.15.31:0/1703407997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74540ce490 0x7f7454145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:44.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f7458e00640 1 --2- 172.21.15.31:0/1703407997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7454145960 0x7f74540c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:44.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f7453e00640 1 -- 172.21.15.31:0/1703407997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74540ce490 msgr2=0x7f7454145420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:44.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f7453e00640 1 --2- 172.21.15.31:0/1703407997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74540ce490 0x7f7454145420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f7453e00640 1 -- 172.21.15.31:0/1703407997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7454145960 msgr2=0x7f74540c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:44.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f7453e00640 1 --2- 172.21.15.31:0/1703407997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7454145960 0x7f74540c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f7453e00640 1 -- 172.21.15.31:0/1703407997 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74540cdcb0 con 0x7f7438005220 2024-09-17T05:29:44.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f7458e00640 1 --2- 172.21.15.31:0/1703407997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7454145960 0x7f74540c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:44.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f7453e00640 1 --2- 172.21.15.31:0/1703407997 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7438005220 0x7f74541586d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7444011ab0 tx=0x7f7444011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:44.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f7450c00640 1 -- 172.21.15.31:0/1703407997 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744401e070 con 0x7f7438005220 2024-09-17T05:29:44.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f7450c00640 1 -- 172.21.15.31:0/1703407997 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f744400fe70 con 0x7f7438005220 2024-09-17T05:29:44.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f7450c00640 1 -- 172.21.15.31:0/1703407997 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74440042b0 con 0x7f7438005220 2024-09-17T05:29:44.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f745ae00640 1 -- 172.21.15.31:0/1703407997 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7454145e70 con 0x7f7438005220 2024-09-17T05:29:44.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f745ae00640 1 -- 172.21.15.31:0/1703407997 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74540cdf70 con 0x7f7438005220 2024-09-17T05:29:44.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.032+0000 7f745ae00640 1 -- 172.21.15.31:0/1703407997 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7454069410 con 0x7f7438005220 2024-09-17T05:29:44.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.036+0000 7f7450c00640 1 -- 172.21.15.31:0/1703407997 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 97234+0+0 (secure 0 0 0) 0x7f7444021070 con 0x7f7438005220 2024-09-17T05:29:44.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.036+0000 7f7450c00640 1 --2- 172.21.15.31:0/1703407997 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7430073200 0x7f74300756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:44.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.036+0000 7f7450c00640 1 -- 172.21.15.31:0/1703407997 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f7444094bc0 con 0x7f7438005220 2024-09-17T05:29:44.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.036+0000 7f744be00640 1 --2- 172.21.15.31:0/1703407997 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7430073200 0x7f74300756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:44.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.036+0000 7f744be00640 1 --2- 172.21.15.31:0/1703407997 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7430073200 0x7f74300756c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f743c006fd0 tx=0x7f743c006c50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:44.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.040+0000 7f7450c00640 1 -- 172.21.15.31:0/1703407997 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f744405f610 con 0x7f7438005220 2024-09-17T05:29:44.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.096+0000 7f7450c00640 1 -- 172.21.15.31:0/1703407997 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f744405b880 con 0x7f7438005220 2024-09-17T05:29:44.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.232+0000 7f745ae00640 1 -- 172.21.15.31:0/1703407997 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f74540b43b0 con 0x7f7438005220 2024-09-17T05:29:44.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.232+0000 7f7450c00640 1 -- 172.21.15.31:0/1703407997 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) ==== 80+0+0 (secure 0 0 0) 0x7f7444040020 con 0x7f7438005220 2024-09-17T05:29:44.236 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:29:44.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.232+0000 7f745ae00640 1 -- 172.21.15.31:0/1703407997 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7430073200 msgr2=0x7f74300756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:44.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.232+0000 7f745ae00640 1 --2- 172.21.15.31:0/1703407997 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7430073200 0x7f74300756c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f743c006fd0 tx=0x7f743c006c50 comp rx=0 tx=0).stop 2024-09-17T05:29:44.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.232+0000 7f745ae00640 1 -- 172.21.15.31:0/1703407997 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7438005220 msgr2=0x7f74541586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:44.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.232+0000 7f745ae00640 1 --2- 172.21.15.31:0/1703407997 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7438005220 0x7f74541586d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7444011ab0 tx=0x7f7444011f70 comp rx=0 tx=0).stop 2024-09-17T05:29:44.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.232+0000 7f745ae00640 1 -- 172.21.15.31:0/1703407997 shutdown_connections 2024-09-17T05:29:44.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.232+0000 7f745ae00640 1 --2- 172.21.15.31:0/1703407997 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7430073200 0x7f74300756c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.232+0000 7f745ae00640 1 --2- 172.21.15.31:0/1703407997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7454145960 0x7f74540c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.232+0000 7f745ae00640 1 --2- 172.21.15.31:0/1703407997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74540ce490 0x7f7454145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.232+0000 7f745ae00640 1 --2- 172.21.15.31:0/1703407997 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7438005220 0x7f74541586d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.232+0000 7f745ae00640 1 -- 172.21.15.31:0/1703407997 >> 172.21.15.31:0/1703407997 conn(0x7f74540b18f0 msgr2=0x7f74541596a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:44.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.232+0000 7f745ae00640 1 -- 172.21.15.31:0/1703407997 shutdown_connections 2024-09-17T05:29:44.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.232+0000 7f745ae00640 1 -- 172.21.15.31:0/1703407997 wait complete. 2024-09-17T05:29:44.258 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T05:29:44.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:44.258 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T05:29:44.285 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:29:44.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:29:44.286 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:29:44.336 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:29:44.337 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:29:44.337 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:44.346 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:29:44.346 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:29:44.346 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:29:44.346 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:44.392 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:29:44.392 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:29:44.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.532+0000 7fe5fe000640 1 -- 172.21.15.31:0/2053895430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f815bea0 msgr2=0x7fe5f80ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:44.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.532+0000 7fe5fe000640 1 --2- 172.21.15.31:0/2053895430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f815bea0 0x7fe5f80ce670 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8009900 tx=0x7fe5e801c8e0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.532+0000 7fe5fe000640 1 -- 172.21.15.31:0/2053895430 shutdown_connections 2024-09-17T05:29:44.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.532+0000 7fe5fe000640 1 --2- 172.21.15.31:0/2053895430 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5f80cdb30 0x7fe5f80cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.532+0000 7fe5fe000640 1 --2- 172.21.15.31:0/2053895430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f815bea0 0x7fe5f80ce670 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.532+0000 7fe5fe000640 1 -- 172.21.15.31:0/2053895430 >> 172.21.15.31:0/2053895430 conn(0x7fe5f80d1dc0 msgr2=0x7fe5f80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:44.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.532+0000 7fe5fe000640 1 -- 172.21.15.31:0/2053895430 shutdown_connections 2024-09-17T05:29:44.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.532+0000 7fe5fe000640 1 -- 172.21.15.31:0/2053895430 wait complete. 2024-09-17T05:29:44.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5fe000640 1 Processor -- start 2024-09-17T05:29:44.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5fe000640 1 -- start start 2024-09-17T05:29:44.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5fe000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5f80cdb30 0x7fe5f80b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:44.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5fe000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f80d28e0 0x7fe5f8157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:44.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5fe000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5f815bea0 0x7fe5f8154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:44.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5fe000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f8169020 con 0x7fe5f80d28e0 2024-09-17T05:29:44.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5fe000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f8168ea0 con 0x7fe5f80cdb30 2024-09-17T05:29:44.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5fe000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe5f81691a0 con 0x7fe5f815bea0 2024-09-17T05:29:44.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5f6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f80d28e0 0x7fe5f8157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:44.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5f6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f80d28e0 0x7fe5f8157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50918/0 (socket says 172.21.15.31:50918) 2024-09-17T05:29:44.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5f6a00640 1 -- 172.21.15.31:0/3103562121 learned_addr learned my addr 172.21.15.31:0/3103562121 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:44.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5f7400640 1 --2- 172.21.15.31:0/3103562121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5f80cdb30 0x7fe5f80b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:44.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5f7e00640 1 --2- 172.21.15.31:0/3103562121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5f815bea0 0x7fe5f8154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:44.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5f6a00640 1 -- 172.21.15.31:0/3103562121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5f815bea0 msgr2=0x7fe5f8154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:44.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5f6a00640 1 --2- 172.21.15.31:0/3103562121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5f815bea0 0x7fe5f8154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5f6a00640 1 -- 172.21.15.31:0/3103562121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5f80cdb30 msgr2=0x7fe5f80b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:44.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5f6a00640 1 --2- 172.21.15.31:0/3103562121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5f80cdb30 0x7fe5f80b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5f6a00640 1 -- 172.21.15.31:0/3103562121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f8157da0 con 0x7fe5f80d28e0 2024-09-17T05:29:44.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5f7e00640 1 --2- 172.21.15.31:0/3103562121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5f815bea0 0x7fe5f8154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:44.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5f6a00640 1 --2- 172.21.15.31:0/3103562121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f80d28e0 0x7fe5f8157860 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400d950 tx=0x7fe5e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:44.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5ef400640 1 -- 172.21.15.31:0/3103562121 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4017070 con 0x7fe5f80d28e0 2024-09-17T05:29:44.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5ef400640 1 -- 172.21.15.31:0/3103562121 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5e4009d20 con 0x7fe5f80d28e0 2024-09-17T05:29:44.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5ef400640 1 -- 172.21.15.31:0/3103562121 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40106c0 con 0x7fe5f80d28e0 2024-09-17T05:29:44.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5fe000640 1 -- 172.21.15.31:0/3103562121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f80cba60 con 0x7fe5f80d28e0 2024-09-17T05:29:44.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.536+0000 7fe5fe000640 1 -- 172.21.15.31:0/3103562121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f80cc020 con 0x7fe5f80d28e0 2024-09-17T05:29:44.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.540+0000 7fe5fe000640 1 -- 172.21.15.31:0/3103562121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f80cc9d0 con 0x7fe5f80d28e0 2024-09-17T05:29:44.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.540+0000 7fe5ef400640 1 -- 172.21.15.31:0/3103562121 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7fe5e4010860 con 0x7fe5f80d28e0 2024-09-17T05:29:44.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.540+0000 7fe5ef400640 1 --2- 172.21.15.31:0/3103562121 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe5d80733b0 0x7fe5d8075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:44.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.540+0000 7fe5ef400640 1 -- 172.21.15.31:0/3103562121 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe5e40949e0 con 0x7fe5f80d28e0 2024-09-17T05:29:44.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.540+0000 7fe5f7400640 1 --2- 172.21.15.31:0/3103562121 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe5d80733b0 0x7fe5d8075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:44.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.540+0000 7fe5f7400640 1 --2- 172.21.15.31:0/3103562121 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe5d80733b0 0x7fe5d8075870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80af000 tx=0x7fe5e801b120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:44.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.544+0000 7fe5ef400640 1 -- 172.21.15.31:0/3103562121 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe5e405f010 con 0x7fe5f80d28e0 2024-09-17T05:29:44.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.756+0000 7fe5fe000640 1 -- 172.21.15.31:0/3103562121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5f80762f0 con 0x7fe5f80d28e0 2024-09-17T05:29:44.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.756+0000 7fe5ef400640 1 -- 172.21.15.31:0/3103562121 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5229 (secure 0 0 0) 0x7fe5e4063a40 con 0x7fe5f80d28e0 2024-09-17T05:29:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:44.764 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":18,"btime":"2024-09-17T05:29:40:065934+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3266973645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3266973645},{"type":"v1","addr":"172.21.15.155:6837","nonce":3266973645}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4673,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3624429107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3624429107},{"type":"v1","addr":"172.21.15.31:6835","nonce":3624429107}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4878,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1163918742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1163918742},{"type":"v1","addr":"172.21.15.31:6834","nonce":1163918742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:29:30.419105+0000","modified":"2024-09-17T05:29:33.450065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4881":{"gid":4881,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/2317915643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2317915643},{"type":"v1","addr":"172.21.15.155:6836","nonce":2317915643}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4881,"qdb_cluster":[4881]},"id":2}]} 2024-09-17T05:29:44.764 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 18 2024-09-17T05:29:44.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.760+0000 7fe5fe000640 1 -- 172.21.15.31:0/3103562121 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe5d80733b0 msgr2=0x7fe5d8075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:44.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.760+0000 7fe5fe000640 1 --2- 172.21.15.31:0/3103562121 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe5d80733b0 0x7fe5d8075870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80af000 tx=0x7fe5e801b120 comp rx=0 tx=0).stop 2024-09-17T05:29:44.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.760+0000 7fe5fe000640 1 -- 172.21.15.31:0/3103562121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f80d28e0 msgr2=0x7fe5f8157860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:44.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.760+0000 7fe5fe000640 1 --2- 172.21.15.31:0/3103562121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f80d28e0 0x7fe5f8157860 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400d950 tx=0x7fe5e400de10 comp rx=0 tx=0).stop 2024-09-17T05:29:44.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.760+0000 7fe5fe000640 1 -- 172.21.15.31:0/3103562121 shutdown_connections 2024-09-17T05:29:44.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.760+0000 7fe5fe000640 1 --2- 172.21.15.31:0/3103562121 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe5d80733b0 0x7fe5d8075870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.760+0000 7fe5fe000640 1 --2- 172.21.15.31:0/3103562121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5f815bea0 0x7fe5f8154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.760+0000 7fe5fe000640 1 --2- 172.21.15.31:0/3103562121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5f80d28e0 0x7fe5f8157860 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.760+0000 7fe5fe000640 1 --2- 172.21.15.31:0/3103562121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5f80cdb30 0x7fe5f80b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.760+0000 7fe5fe000640 1 -- 172.21.15.31:0/3103562121 >> 172.21.15.31:0/3103562121 conn(0x7fe5f80d1dc0 msgr2=0x7fe5f80b5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:44.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.760+0000 7fe5fe000640 1 -- 172.21.15.31:0/3103562121 shutdown_connections 2024-09-17T05:29:44.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.760+0000 7fe5fe000640 1 -- 172.21.15.31:0/3103562121 wait complete. 2024-09-17T05:29:44.785 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:29:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.924+0000 7f70f6c00640 1 -- 172.21.15.31:0/2691746264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f015bb90 msgr2=0x7f70f015f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.924+0000 7f70f6c00640 1 --2- 172.21.15.31:0/2691746264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f015bb90 0x7f70f015f960 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009900 tx=0x7f70e001c8e0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70f6c00640 1 -- 172.21.15.31:0/2691746264 shutdown_connections 2024-09-17T05:29:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70f6c00640 1 --2- 172.21.15.31:0/2691746264 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70f015bf70 0x7f70f00b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70f6c00640 1 --2- 172.21.15.31:0/2691746264 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f015bb90 0x7f70f015f960 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70f6c00640 1 -- 172.21.15.31:0/2691746264 >> 172.21.15.31:0/2691746264 conn(0x7f70f00d1d90 msgr2=0x7f70f00d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70f6c00640 1 -- 172.21.15.31:0/2691746264 shutdown_connections 2024-09-17T05:29:44.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70f6c00640 1 -- 172.21.15.31:0/2691746264 wait complete. 2024-09-17T05:29:44.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70f6c00640 1 Processor -- start 2024-09-17T05:29:44.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70f6c00640 1 -- start start 2024-09-17T05:29:44.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70f6c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70f00d2940 0x7f70f01f76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:44.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70f6c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f015bb90 0x7f70f0156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:44.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70f6c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70f015bf70 0x7f70f0152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:44.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70f6c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f70f0168ca0 con 0x7f70f015bb90 2024-09-17T05:29:44.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70f6c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f70f00b6640 con 0x7f70f015bf70 2024-09-17T05:29:44.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70f6c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f70f0168e20 con 0x7f70f00d2940 2024-09-17T05:29:44.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70e7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f015bb90 0x7f70f0156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:44.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70e7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f015bb90 0x7f70f0156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50938/0 (socket says 172.21.15.31:50938) 2024-09-17T05:29:44.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70e7400640 1 -- 172.21.15.31:0/3064601350 learned_addr learned my addr 172.21.15.31:0/3064601350 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:44.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70efe00640 1 --2- 172.21.15.31:0/3064601350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70f00d2940 0x7f70f01f76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:44.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70f4c00640 1 --2- 172.21.15.31:0/3064601350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70f015bf70 0x7f70f0152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:44.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70e7400640 1 -- 172.21.15.31:0/3064601350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70f00d2940 msgr2=0x7f70f01f76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:44.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70e7400640 1 --2- 172.21.15.31:0/3064601350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70f00d2940 0x7f70f01f76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70e7400640 1 -- 172.21.15.31:0/3064601350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70f015bf70 msgr2=0x7f70f0152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:44.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70e7400640 1 --2- 172.21.15.31:0/3064601350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70f015bf70 0x7f70f0152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:44.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70e7400640 1 -- 172.21.15.31:0/3064601350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f0156d50 con 0x7f70f015bb90 2024-09-17T05:29:44.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.928+0000 7f70efe00640 1 --2- 172.21.15.31:0/3064601350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70f00d2940 0x7f70f01f76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:44.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.932+0000 7f70e7400640 1 --2- 172.21.15.31:0/3064601350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f015bb90 0x7f70f0156810 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f70d800c500 tx=0x7f70d800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:44.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.932+0000 7f70ecc00640 1 -- 172.21.15.31:0/3064601350 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d80052d0 con 0x7f70f015bb90 2024-09-17T05:29:44.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.932+0000 7f70ecc00640 1 -- 172.21.15.31:0/3064601350 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70d8005470 con 0x7f70f015bb90 2024-09-17T05:29:44.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.932+0000 7f70ecc00640 1 -- 172.21.15.31:0/3064601350 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8012890 con 0x7f70f015bb90 2024-09-17T05:29:44.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.932+0000 7f70f6c00640 1 -- 172.21.15.31:0/3064601350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f0155770 con 0x7f70f015bb90 2024-09-17T05:29:44.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.932+0000 7f70f6c00640 1 -- 172.21.15.31:0/3064601350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f0155d30 con 0x7f70f015bb90 2024-09-17T05:29:44.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.932+0000 7f70f6c00640 1 -- 172.21.15.31:0/3064601350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70f00b53e0 con 0x7f70f015bb90 2024-09-17T05:29:44.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.932+0000 7f70ecc00640 1 -- 172.21.15.31:0/3064601350 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f70d8003600 con 0x7f70f015bb90 2024-09-17T05:29:44.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.932+0000 7f70ecc00640 1 --2- 172.21.15.31:0/3064601350 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f70cc0733b0 0x7f70cc075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:44.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.932+0000 7f70ecc00640 1 -- 172.21.15.31:0/3064601350 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f70d80941c0 con 0x7f70f015bb90 2024-09-17T05:29:44.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.936+0000 7f70efe00640 1 --2- 172.21.15.31:0/3064601350 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f70cc0733b0 0x7f70cc075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:44.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.936+0000 7f70efe00640 1 --2- 172.21.15.31:0/3064601350 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f70cc0733b0 0x7f70cc075870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f70e00af000 tx=0x7f70e001b120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:44.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:44.940+0000 7f70ecc00640 1 -- 172.21.15.31:0/3064601350 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f70d805ee50 con 0x7f70f015bb90 2024-09-17T05:29:45.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.152+0000 7f70f6c00640 1 -- 172.21.15.31:0/3064601350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70f0154340 con 0x7f70f015bb90 2024-09-17T05:29:45.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.152+0000 7f70ecc00640 1 -- 172.21.15.31:0/3064601350 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5229 (secure 0 0 0) 0x7f70d805e750 con 0x7f70f015bb90 2024-09-17T05:29:45.158 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:45.159 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":18,"btime":"2024-09-17T05:29:40:065934+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3266973645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3266973645},{"type":"v1","addr":"172.21.15.155:6837","nonce":3266973645}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4673,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3624429107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3624429107},{"type":"v1","addr":"172.21.15.31:6835","nonce":3624429107}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4878,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1163918742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1163918742},{"type":"v1","addr":"172.21.15.31:6834","nonce":1163918742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:29:30.419105+0000","modified":"2024-09-17T05:29:33.450065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4881":{"gid":4881,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/2317915643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2317915643},{"type":"v1","addr":"172.21.15.155:6836","nonce":2317915643}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4881,"qdb_cluster":[4881]},"id":2}]} 2024-09-17T05:29:45.159 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 18 2024-09-17T05:29:45.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.156+0000 7f70f6c00640 1 -- 172.21.15.31:0/3064601350 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f70cc0733b0 msgr2=0x7f70cc075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:45.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.156+0000 7f70f6c00640 1 --2- 172.21.15.31:0/3064601350 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f70cc0733b0 0x7f70cc075870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f70e00af000 tx=0x7f70e001b120 comp rx=0 tx=0).stop 2024-09-17T05:29:45.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.156+0000 7f70f6c00640 1 -- 172.21.15.31:0/3064601350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f015bb90 msgr2=0x7f70f0156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:45.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.156+0000 7f70f6c00640 1 --2- 172.21.15.31:0/3064601350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f015bb90 0x7f70f0156810 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f70d800c500 tx=0x7f70d800c9c0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.156+0000 7f70f6c00640 1 -- 172.21.15.31:0/3064601350 shutdown_connections 2024-09-17T05:29:45.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.156+0000 7f70f6c00640 1 --2- 172.21.15.31:0/3064601350 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f70cc0733b0 0x7f70cc075870 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.156+0000 7f70f6c00640 1 --2- 172.21.15.31:0/3064601350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70f015bf70 0x7f70f0152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.156+0000 7f70f6c00640 1 --2- 172.21.15.31:0/3064601350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70f015bb90 0x7f70f0156810 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.156+0000 7f70f6c00640 1 --2- 172.21.15.31:0/3064601350 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70f00d2940 0x7f70f01f76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.156+0000 7f70f6c00640 1 -- 172.21.15.31:0/3064601350 >> 172.21.15.31:0/3064601350 conn(0x7f70f00d1d90 msgr2=0x7f70f015f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:45.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.156+0000 7f70f6c00640 1 -- 172.21.15.31:0/3064601350 shutdown_connections 2024-09-17T05:29:45.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.156+0000 7f70f6c00640 1 -- 172.21.15.31:0/3064601350 wait complete. 2024-09-17T05:29:45.180 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:29:45.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.320+0000 7ff3dd800640 1 -- 172.21.15.31:0/1792915557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3d80cdb30 msgr2=0x7ff3d80aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:45.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.320+0000 7ff3dd800640 1 --2- 172.21.15.31:0/1792915557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3d80cdb30 0x7ff3d80aeef0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff3d80cc3a0 tx=0x7ff3d001cd80 comp rx=0 tx=0).stop 2024-09-17T05:29:45.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3dd800640 1 -- 172.21.15.31:0/1792915557 shutdown_connections 2024-09-17T05:29:45.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3dd800640 1 --2- 172.21.15.31:0/1792915557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3d80cdb30 0x7ff3d80aeef0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3dd800640 1 --2- 172.21.15.31:0/1792915557 >> v2:172.21.15.155:3300/0 conn(0x7ff3d80ced80 0x7ff3d80ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3dd800640 1 -- 172.21.15.31:0/1792915557 >> 172.21.15.31:0/1792915557 conn(0x7ff3d80d1dc0 msgr2=0x7ff3d80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:45.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3dd800640 1 -- 172.21.15.31:0/1792915557 shutdown_connections 2024-09-17T05:29:45.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3dd800640 1 -- 172.21.15.31:0/1792915557 wait complete. 2024-09-17T05:29:45.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3dd800640 1 Processor -- start 2024-09-17T05:29:45.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3dd800640 1 -- start start 2024-09-17T05:29:45.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3dd800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3d80cdb30 0x7ff3d80b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:45.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3dd800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3d80ced80 0x7ff3d8150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:45.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3dd800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3d815bea0 0x7ff3d80b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:45.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3dd800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d81692f0 con 0x7ff3d80ced80 2024-09-17T05:29:45.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3dd800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d8169170 con 0x7ff3d80cdb30 2024-09-17T05:29:45.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3dd800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3d8169470 con 0x7ff3d815bea0 2024-09-17T05:29:45.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3cfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3d80ced80 0x7ff3d8150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:45.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3cfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3d80ced80 0x7ff3d8150960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50960/0 (socket says 172.21.15.31:50960) 2024-09-17T05:29:45.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3cfe00640 1 -- 172.21.15.31:0/1678027902 learned_addr learned my addr 172.21.15.31:0/1678027902 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:45.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3d6a00640 1 --2- 172.21.15.31:0/1678027902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3d80cdb30 0x7ff3d80b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:45.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3d7400640 1 --2- 172.21.15.31:0/1678027902 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3d815bea0 0x7ff3d80b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:45.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3cfe00640 1 -- 172.21.15.31:0/1678027902 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3d815bea0 msgr2=0x7ff3d80b64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:45.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3cfe00640 1 --2- 172.21.15.31:0/1678027902 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3d815bea0 0x7ff3d80b64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3cfe00640 1 -- 172.21.15.31:0/1678027902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3d80cdb30 msgr2=0x7ff3d80b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:45.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3cfe00640 1 --2- 172.21.15.31:0/1678027902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3d80cdb30 0x7ff3d80b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3cfe00640 1 -- 172.21.15.31:0/1678027902 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d80b7210 con 0x7ff3d80ced80 2024-09-17T05:29:45.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3cfe00640 1 --2- 172.21.15.31:0/1678027902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3d80ced80 0x7ff3d8150960 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000d9b0 tx=0x7ff3c000de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:45.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3cea00640 1 -- 172.21.15.31:0/1678027902 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0017070 con 0x7ff3d80ced80 2024-09-17T05:29:45.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3cea00640 1 -- 172.21.15.31:0/1678027902 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3c0009cc0 con 0x7ff3d80ced80 2024-09-17T05:29:45.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3cea00640 1 -- 172.21.15.31:0/1678027902 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0005280 con 0x7ff3d80ced80 2024-09-17T05:29:45.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.324+0000 7ff3dd800640 1 -- 172.21.15.31:0/1678027902 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d80b74b0 con 0x7ff3d80ced80 2024-09-17T05:29:45.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.328+0000 7ff3dd800640 1 -- 172.21.15.31:0/1678027902 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d80b7a70 con 0x7ff3d80ced80 2024-09-17T05:29:45.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.328+0000 7ff3dd800640 1 -- 172.21.15.31:0/1678027902 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3d80ce670 con 0x7ff3d80ced80 2024-09-17T05:29:45.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.328+0000 7ff3cea00640 1 -- 172.21.15.31:0/1678027902 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7ff3c0005420 con 0x7ff3d80ced80 2024-09-17T05:29:45.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.328+0000 7ff3cea00640 1 --2- 172.21.15.31:0/1678027902 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff3b40733e0 0x7ff3b40758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:45.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.328+0000 7ff3cea00640 1 -- 172.21.15.31:0/1678027902 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff3c0094740 con 0x7ff3d80ced80 2024-09-17T05:29:45.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.328+0000 7ff3d6a00640 1 --2- 172.21.15.31:0/1678027902 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff3b40733e0 0x7ff3b40758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:45.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.332+0000 7ff3d6a00640 1 --2- 172.21.15.31:0/1678027902 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff3b40733e0 0x7ff3b40758a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8007fd0 tx=0x7ff3c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:45.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.332+0000 7ff3cea00640 1 -- 172.21.15.31:0/1678027902 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff3c005eeb0 con 0x7ff3d80ced80 2024-09-17T05:29:45.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.512+0000 7ff3dd800640 1 -- 172.21.15.31:0/1678027902 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3d80725b0 con 0x7ff3d80ced80 2024-09-17T05:29:45.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.512+0000 7ff3cea00640 1 -- 172.21.15.31:0/1678027902 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16753 (secure 0 0 0) 0x7ff3c00638e0 con 0x7ff3d80ced80 2024-09-17T05:29:45.519 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:45.519 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":32,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:29:32.021289+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:29:28.563579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:29:29.374194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:29:45.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.516+0000 7ff3dd800640 1 -- 172.21.15.31:0/1678027902 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff3b40733e0 msgr2=0x7ff3b40758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:45.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.516+0000 7ff3dd800640 1 --2- 172.21.15.31:0/1678027902 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff3b40733e0 0x7ff3b40758a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8007fd0 tx=0x7ff3c8009040 comp rx=0 tx=0).stop 2024-09-17T05:29:45.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.516+0000 7ff3dd800640 1 -- 172.21.15.31:0/1678027902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3d80ced80 msgr2=0x7ff3d8150960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:45.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.516+0000 7ff3dd800640 1 --2- 172.21.15.31:0/1678027902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3d80ced80 0x7ff3d8150960 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000d9b0 tx=0x7ff3c000de70 comp rx=0 tx=0).stop 2024-09-17T05:29:45.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.516+0000 7ff3dd800640 1 -- 172.21.15.31:0/1678027902 shutdown_connections 2024-09-17T05:29:45.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.516+0000 7ff3dd800640 1 --2- 172.21.15.31:0/1678027902 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff3b40733e0 0x7ff3b40758a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.516+0000 7ff3dd800640 1 --2- 172.21.15.31:0/1678027902 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3d815bea0 0x7ff3d80b64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.516+0000 7ff3dd800640 1 --2- 172.21.15.31:0/1678027902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3d80ced80 0x7ff3d8150960 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.516+0000 7ff3dd800640 1 --2- 172.21.15.31:0/1678027902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3d80cdb30 0x7ff3d80b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.516+0000 7ff3dd800640 1 -- 172.21.15.31:0/1678027902 >> 172.21.15.31:0/1678027902 conn(0x7ff3d80d1dc0 msgr2=0x7ff3d80d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:45.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.516+0000 7ff3dd800640 1 -- 172.21.15.31:0/1678027902 shutdown_connections 2024-09-17T05:29:45.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.516+0000 7ff3dd800640 1 -- 172.21.15.31:0/1678027902 wait complete. 2024-09-17T05:29:45.542 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:29:45.542 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:29:45.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.684+0000 7f8c0ea00640 1 -- 172.21.15.31:0/2118094506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c0815f300 msgr2=0x7f8c080cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:45.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.684+0000 7f8c0ea00640 1 --2- 172.21.15.31:0/2118094506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c0815f300 0x7f8c080cfca0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009840 tx=0x7f8bf801f010 comp rx=0 tx=0).stop 2024-09-17T05:29:45.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.684+0000 7f8c0ea00640 1 -- 172.21.15.31:0/2118094506 shutdown_connections 2024-09-17T05:29:45.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.684+0000 7f8c0ea00640 1 --2- 172.21.15.31:0/2118094506 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c080b2d60 0x7f8c080af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.684+0000 7f8c0ea00640 1 --2- 172.21.15.31:0/2118094506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c0815f300 0x7f8c080cfca0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.684+0000 7f8c0ea00640 1 -- 172.21.15.31:0/2118094506 >> 172.21.15.31:0/2118094506 conn(0x7f8c080d1e30 msgr2=0x7f8c080d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:45.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.684+0000 7f8c0ea00640 1 -- 172.21.15.31:0/2118094506 shutdown_connections 2024-09-17T05:29:45.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.684+0000 7f8c0ea00640 1 -- 172.21.15.31:0/2118094506 wait complete. 2024-09-17T05:29:45.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.684+0000 7f8c0ea00640 1 Processor -- start 2024-09-17T05:29:45.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.684+0000 7f8c0ea00640 1 -- start start 2024-09-17T05:29:45.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c0ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c080b2d60 0x7f8c081f7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:45.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c0ea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c0815f300 0x7f8c080b7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:45.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c0ea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c0815f6e0 0x7f8c081e81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:45.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c0ea00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8c080affe0 con 0x7f8c080b2d60 2024-09-17T05:29:45.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c0ea00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8c080afe60 con 0x7f8c0815f6e0 2024-09-17T05:29:45.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c0ea00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8c080b0160 con 0x7f8c0815f300 2024-09-17T05:29:45.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c07e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c080b2d60 0x7f8c081f7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:45.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c07e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c080b2d60 0x7f8c081f7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50984/0 (socket says 172.21.15.31:50984) 2024-09-17T05:29:45.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c07e00640 1 -- 172.21.15.31:0/2816596403 learned_addr learned my addr 172.21.15.31:0/2816596403 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:45.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c07e00640 1 -- 172.21.15.31:0/2816596403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c0815f300 msgr2=0x7f8c080b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:45.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c07e00640 1 --2- 172.21.15.31:0/2816596403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c0815f300 0x7f8c080b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c07e00640 1 -- 172.21.15.31:0/2816596403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c0815f6e0 msgr2=0x7f8c081e81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:45.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c07e00640 1 --2- 172.21.15.31:0/2816596403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c0815f6e0 0x7f8c081e81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c07e00640 1 -- 172.21.15.31:0/2816596403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c081f8e70 con 0x7f8c080b2d60 2024-09-17T05:29:45.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c07e00640 1 --2- 172.21.15.31:0/2816596403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c080b2d60 0x7f8c081f7710 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009790 tx=0x7f8bf8004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:45.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c04c00640 1 -- 172.21.15.31:0/2816596403 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf80b5040 con 0x7f8c080b2d60 2024-09-17T05:29:45.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c04c00640 1 -- 172.21.15.31:0/2816596403 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bf8005220 con 0x7f8c080b2d60 2024-09-17T05:29:45.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c0ea00640 1 -- 172.21.15.31:0/2816596403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c081f80b0 con 0x7f8c080b2d60 2024-09-17T05:29:45.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c04c00640 1 -- 172.21.15.31:0/2816596403 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf80046d0 con 0x7f8c080b2d60 2024-09-17T05:29:45.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c0ea00640 1 -- 172.21.15.31:0/2816596403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c081f8670 con 0x7f8c080b2d60 2024-09-17T05:29:45.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c0ea00640 1 -- 172.21.15.31:0/2816596403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c080af710 con 0x7f8c080b2d60 2024-09-17T05:29:45.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.688+0000 7f8c04c00640 1 -- 172.21.15.31:0/2816596403 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f8bf80c1060 con 0x7f8c080b2d60 2024-09-17T05:29:45.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.692+0000 7f8c04c00640 1 --2- 172.21.15.31:0/2816596403 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8be40733b0 0x7f8be4075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:45.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.692+0000 7f8c04c00640 1 -- 172.21.15.31:0/2816596403 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f8bf8131390 con 0x7f8c080b2d60 2024-09-17T05:29:45.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.692+0000 7f8bffe00640 1 --2- 172.21.15.31:0/2816596403 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8be40733b0 0x7f8be4075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:45.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.692+0000 7f8bffe00640 1 --2- 172.21.15.31:0/2816596403 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8be40733b0 0x7f8be4075870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00046c0 tx=0x7f8bf0007910 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:45.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.696+0000 7f8c04c00640 1 -- 172.21.15.31:0/2816596403 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8bf8018b70 con 0x7f8c080b2d60 2024-09-17T05:29:45.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.908+0000 7f8c0ea00640 1 -- 172.21.15.31:0/2816596403 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c0815b710 con 0x7f8c080b2d60 2024-09-17T05:29:45.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.908+0000 7f8c04c00640 1 -- 172.21.15.31:0/2816596403 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5229 (secure 0 0 0) 0x7f8bf80fc0a0 con 0x7f8c080b2d60 2024-09-17T05:29:45.913 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:45.913 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":18,"btime":"2024-09-17T05:29:40:065934+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3266973645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3266973645},{"type":"v1","addr":"172.21.15.155:6837","nonce":3266973645}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4673,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3624429107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3624429107},{"type":"v1","addr":"172.21.15.31:6835","nonce":3624429107}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4878,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1163918742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1163918742},{"type":"v1","addr":"172.21.15.31:6834","nonce":1163918742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:29:30.419105+0000","modified":"2024-09-17T05:29:33.450065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4881":{"gid":4881,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/2317915643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2317915643},{"type":"v1","addr":"172.21.15.155:6836","nonce":2317915643}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4881,"qdb_cluster":[4881]},"id":2}]} 2024-09-17T05:29:45.913 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 18 2024-09-17T05:29:45.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.908+0000 7f8c0ea00640 1 -- 172.21.15.31:0/2816596403 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8be40733b0 msgr2=0x7f8be4075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:45.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.908+0000 7f8c0ea00640 1 --2- 172.21.15.31:0/2816596403 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8be40733b0 0x7f8be4075870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00046c0 tx=0x7f8bf0007910 comp rx=0 tx=0).stop 2024-09-17T05:29:45.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.908+0000 7f8c0ea00640 1 -- 172.21.15.31:0/2816596403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c080b2d60 msgr2=0x7f8c081f7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:45.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.908+0000 7f8c0ea00640 1 --2- 172.21.15.31:0/2816596403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c080b2d60 0x7f8c081f7710 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009790 tx=0x7f8bf8004620 comp rx=0 tx=0).stop 2024-09-17T05:29:45.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.908+0000 7f8c0ea00640 1 -- 172.21.15.31:0/2816596403 shutdown_connections 2024-09-17T05:29:45.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.908+0000 7f8c0ea00640 1 --2- 172.21.15.31:0/2816596403 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8be40733b0 0x7f8be4075870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.908+0000 7f8c0ea00640 1 --2- 172.21.15.31:0/2816596403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c0815f6e0 0x7f8c081e81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.908+0000 7f8c0ea00640 1 --2- 172.21.15.31:0/2816596403 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c0815f300 0x7f8c080b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.908+0000 7f8c0ea00640 1 --2- 172.21.15.31:0/2816596403 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c080b2d60 0x7f8c081f7710 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:45.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.908+0000 7f8c0ea00640 1 -- 172.21.15.31:0/2816596403 >> 172.21.15.31:0/2816596403 conn(0x7f8c080d1e30 msgr2=0x7f8c0815bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:45.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.908+0000 7f8c0ea00640 1 -- 172.21.15.31:0/2816596403 shutdown_connections 2024-09-17T05:29:45.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:45.908+0000 7f8c0ea00640 1 -- 172.21.15.31:0/2816596403 wait complete. 2024-09-17T05:29:45.936 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:29:46.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.080+0000 7fa215c00640 1 -- 172.21.15.31:0/498839492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1f4004d50 msgr2=0x7fa1f40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:46.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.080+0000 7fa215c00640 1 --2- 172.21.15.31:0/498839492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1f4004d50 0x7fa1f40051d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa20800c640 tx=0x7fa20801d2a0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.080+0000 7fa20f400640 1 -- 172.21.15.31:0/498839492 reap_dead start 2024-09-17T05:29:46.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.080+0000 7fa215c00640 1 -- 172.21.15.31:0/498839492 shutdown_connections 2024-09-17T05:29:46.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.080+0000 7fa215c00640 1 -- 172.21.15.31:0/498839492 >> 172.21.15.31:0/498839492 conn(0x7fa2100d1dc0 msgr2=0x7fa2100d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:46.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.080+0000 7fa215c00640 1 -- 172.21.15.31:0/498839492 shutdown_connections 2024-09-17T05:29:46.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.080+0000 7fa215c00640 1 -- 172.21.15.31:0/498839492 wait complete. 2024-09-17T05:29:46.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.080+0000 7fa215c00640 1 Processor -- start 2024-09-17T05:29:46.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.080+0000 7fa215c00640 1 -- start start 2024-09-17T05:29:46.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa215c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4004d50 0x7fa210157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:46.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa215c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2100c91a0 0x7fa210157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:46.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa215c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2101f5750 0x7fa2101f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:46.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa215c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa2100cfb30 con 0x7fa2101f5750 2024-09-17T05:29:46.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa215c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa21015c490 con 0x7fa1f4004d50 2024-09-17T05:29:46.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa215c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa2100ce670 con 0x7fa2100c91a0 2024-09-17T05:29:46.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa20f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2101f5750 0x7fa2101f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:46.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa20f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2101f5750 0x7fa2101f5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51006/0 (socket says 172.21.15.31:51006) 2024-09-17T05:29:46.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa20f400640 1 -- 172.21.15.31:0/4012200537 learned_addr learned my addr 172.21.15.31:0/4012200537 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:46.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa20ea00640 1 --2- 172.21.15.31:0/4012200537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4004d50 0x7fa210157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:46.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa207e00640 1 --2- 172.21.15.31:0/4012200537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2100c91a0 0x7fa210157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:46.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa20f400640 1 -- 172.21.15.31:0/4012200537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2100c91a0 msgr2=0x7fa210157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:46.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa20f400640 1 --2- 172.21.15.31:0/4012200537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2100c91a0 0x7fa210157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa20f400640 1 -- 172.21.15.31:0/4012200537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4004d50 msgr2=0x7fa210157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:46.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa20f400640 1 --2- 172.21.15.31:0/4012200537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4004d50 0x7fa210157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa20f400640 1 -- 172.21.15.31:0/4012200537 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2100c96f0 con 0x7fa2101f5750 2024-09-17T05:29:46.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa20f400640 1 --2- 172.21.15.31:0/4012200537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2101f5750 0x7fa2101f5b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa20800c640 tx=0x7fa2080021b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:46.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa206a00640 1 -- 172.21.15.31:0/4012200537 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa208004e60 con 0x7fa2101f5750 2024-09-17T05:29:46.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa206a00640 1 -- 172.21.15.31:0/4012200537 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa208003b80 con 0x7fa2101f5750 2024-09-17T05:29:46.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa215c00640 1 -- 172.21.15.31:0/4012200537 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2100c99d0 con 0x7fa2101f5750 2024-09-17T05:29:46.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa206a00640 1 -- 172.21.15.31:0/4012200537 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa208001fe0 con 0x7fa2101f5750 2024-09-17T05:29:46.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa215c00640 1 -- 172.21.15.31:0/4012200537 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa210157ca0 con 0x7fa2101f5750 2024-09-17T05:29:46.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.084+0000 7fa215c00640 1 -- 172.21.15.31:0/4012200537 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2101f4540 con 0x7fa2101f5750 2024-09-17T05:29:46.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.088+0000 7fa206a00640 1 -- 172.21.15.31:0/4012200537 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7fa208006080 con 0x7fa2101f5750 2024-09-17T05:29:46.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.088+0000 7fa206a00640 1 --2- 172.21.15.31:0/4012200537 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa1ec0733b0 0x7fa1ec075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:46.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.088+0000 7fa206a00640 1 -- 172.21.15.31:0/4012200537 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa20812e510 con 0x7fa2101f5750 2024-09-17T05:29:46.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.088+0000 7fa20ea00640 1 --2- 172.21.15.31:0/4012200537 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa1ec0733b0 0x7fa1ec075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:46.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.088+0000 7fa20ea00640 1 --2- 172.21.15.31:0/4012200537 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa1ec0733b0 0x7fa1ec075870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa2100c8840 tx=0x7fa2000091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:46.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.092+0000 7fa206a00640 1 -- 172.21.15.31:0/4012200537 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa208017050 con 0x7fa2101f5750 2024-09-17T05:29:46.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.312+0000 7fa215c00640 1 -- 172.21.15.31:0/4012200537 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa210071c30 con 0x7fa2101f5750 2024-09-17T05:29:46.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.312+0000 7fa206a00640 1 -- 172.21.15.31:0/4012200537 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5229 (secure 0 0 0) 0x7fa2080f9260 con 0x7fa2101f5750 2024-09-17T05:29:46.319 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:46.320 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":18,"btime":"2024-09-17T05:29:40:065934+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3266973645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3266973645},{"type":"v1","addr":"172.21.15.155:6837","nonce":3266973645}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4673,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3624429107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3624429107},{"type":"v1","addr":"172.21.15.31:6835","nonce":3624429107}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4878,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1163918742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1163918742},{"type":"v1","addr":"172.21.15.31:6834","nonce":1163918742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:29:30.419105+0000","modified":"2024-09-17T05:29:33.450065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4881":{"gid":4881,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/2317915643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2317915643},{"type":"v1","addr":"172.21.15.155:6836","nonce":2317915643}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4881,"qdb_cluster":[4881]},"id":2}]} 2024-09-17T05:29:46.320 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 18 2024-09-17T05:29:46.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.316+0000 7fa215c00640 1 -- 172.21.15.31:0/4012200537 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa1ec0733b0 msgr2=0x7fa1ec075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:46.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.316+0000 7fa215c00640 1 --2- 172.21.15.31:0/4012200537 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa1ec0733b0 0x7fa1ec075870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa2100c8840 tx=0x7fa2000091e0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.316+0000 7fa215c00640 1 -- 172.21.15.31:0/4012200537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2101f5750 msgr2=0x7fa2101f5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:46.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.316+0000 7fa215c00640 1 --2- 172.21.15.31:0/4012200537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2101f5750 0x7fa2101f5b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa20800c640 tx=0x7fa2080021b0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.316+0000 7fa215c00640 1 -- 172.21.15.31:0/4012200537 shutdown_connections 2024-09-17T05:29:46.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.316+0000 7fa215c00640 1 --2- 172.21.15.31:0/4012200537 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa1ec0733b0 0x7fa1ec075870 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.316+0000 7fa215c00640 1 --2- 172.21.15.31:0/4012200537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2101f5750 0x7fa2101f5b90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.316+0000 7fa215c00640 1 --2- 172.21.15.31:0/4012200537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa2100c91a0 0x7fa210157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.316+0000 7fa215c00640 1 --2- 172.21.15.31:0/4012200537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1f4004d50 0x7fa210157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.316+0000 7fa215c00640 1 -- 172.21.15.31:0/4012200537 >> 172.21.15.31:0/4012200537 conn(0x7fa2100d1dc0 msgr2=0x7fa210070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:46.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.316+0000 7fa215c00640 1 -- 172.21.15.31:0/4012200537 shutdown_connections 2024-09-17T05:29:46.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.316+0000 7fa215c00640 1 -- 172.21.15.31:0/4012200537 wait complete. 2024-09-17T05:29:46.341 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:29:46.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.480+0000 7fe357200640 1 -- 172.21.15.31:0/3720303634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3500cdb30 msgr2=0x7fe3500cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:46.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.480+0000 7fe357200640 1 --2- 172.21.15.31:0/3720303634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3500cdb30 0x7fe3500cebb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe3500cdf50 tx=0x7fe33801c8c0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe357200640 1 -- 172.21.15.31:0/3720303634 shutdown_connections 2024-09-17T05:29:46.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe357200640 1 --2- 172.21.15.31:0/3720303634 >> v2:172.21.15.155:3300/0 conn(0x7fe3500d28e0 0x7fe3500cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe357200640 1 --2- 172.21.15.31:0/3720303634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3500cdb30 0x7fe3500cebb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe357200640 1 --2- 172.21.15.31:0/3720303634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe35015bea0 0x7fe3500ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe357200640 1 -- 172.21.15.31:0/3720303634 >> 172.21.15.31:0/3720303634 conn(0x7fe3500d1dc0 msgr2=0x7fe3500d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:46.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe357200640 1 -- 172.21.15.31:0/3720303634 shutdown_connections 2024-09-17T05:29:46.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe357200640 1 -- 172.21.15.31:0/3720303634 wait complete. 2024-09-17T05:29:46.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe357200640 1 Processor -- start 2024-09-17T05:29:46.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe357200640 1 -- start start 2024-09-17T05:29:46.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe357200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3500cdb30 0x7fe3500b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:46.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe357200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3500d28e0 0x7fe350148020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:46.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe357200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe35015bea0 0x7fe350159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:46.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe357200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe3500af0a0 con 0x7fe3500cdb30 2024-09-17T05:29:46.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe357200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe3500aef20 con 0x7fe3500d28e0 2024-09-17T05:29:46.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe357200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe3500af220 con 0x7fe35015bea0 2024-09-17T05:29:46.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe34fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3500cdb30 0x7fe3500b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:46.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe34fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3500cdb30 0x7fe3500b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51010/0 (socket says 172.21.15.31:51010) 2024-09-17T05:29:46.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe34fe00640 1 -- 172.21.15.31:0/4267222660 learned_addr learned my addr 172.21.15.31:0/4267222660 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:46.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe355200640 1 --2- 172.21.15.31:0/4267222660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe35015bea0 0x7fe350159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:46.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe347e00640 1 --2- 172.21.15.31:0/4267222660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3500d28e0 0x7fe350148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:46.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe34fe00640 1 -- 172.21.15.31:0/4267222660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe35015bea0 msgr2=0x7fe350159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:46.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe34fe00640 1 --2- 172.21.15.31:0/4267222660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe35015bea0 0x7fe350159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe34fe00640 1 -- 172.21.15.31:0/4267222660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3500d28e0 msgr2=0x7fe350148020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:46.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe34fe00640 1 --2- 172.21.15.31:0/4267222660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3500d28e0 0x7fe350148020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe34fe00640 1 -- 172.21.15.31:0/4267222660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe350148560 con 0x7fe3500cdb30 2024-09-17T05:29:46.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe34fe00640 1 --2- 172.21.15.31:0/4267222660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3500cdb30 0x7fe3500b3570 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe34000c9f0 tx=0x7fe34000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:46.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.484+0000 7fe34cc00640 1 -- 172.21.15.31:0/4267222660 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340007b50 con 0x7fe3500cdb30 2024-09-17T05:29:46.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.488+0000 7fe34cc00640 1 -- 172.21.15.31:0/4267222660 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe340007de0 con 0x7fe3500cdb30 2024-09-17T05:29:46.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.488+0000 7fe357200640 1 -- 172.21.15.31:0/4267222660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe350159bd0 con 0x7fe3500cdb30 2024-09-17T05:29:46.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.488+0000 7fe34cc00640 1 -- 172.21.15.31:0/4267222660 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34000f6b0 con 0x7fe3500cdb30 2024-09-17T05:29:46.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.488+0000 7fe357200640 1 -- 172.21.15.31:0/4267222660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3501fb3a0 con 0x7fe3500cdb30 2024-09-17T05:29:46.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.488+0000 7fe357200640 1 -- 172.21.15.31:0/4267222660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3500cc9d0 con 0x7fe3500cdb30 2024-09-17T05:29:46.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.488+0000 7fe34cc00640 1 -- 172.21.15.31:0/4267222660 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7fe34000f850 con 0x7fe3500cdb30 2024-09-17T05:29:46.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.488+0000 7fe34cc00640 1 --2- 172.21.15.31:0/4267222660 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe32c0733e0 0x7fe32c0758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:46.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.488+0000 7fe34cc00640 1 -- 172.21.15.31:0/4267222660 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe340094c90 con 0x7fe3500cdb30 2024-09-17T05:29:46.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.488+0000 7fe347e00640 1 --2- 172.21.15.31:0/4267222660 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe32c0733e0 0x7fe32c0758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:46.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.492+0000 7fe347e00640 1 --2- 172.21.15.31:0/4267222660 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe32c0733e0 0x7fe32c0758a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe3380af000 tx=0x7fe33801b100 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:46.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.492+0000 7fe34cc00640 1 -- 172.21.15.31:0/4267222660 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe340014030 con 0x7fe3500cdb30 2024-09-17T05:29:46.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.672+0000 7fe357200640 1 -- 172.21.15.31:0/4267222660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe350159030 con 0x7fe3500cdb30 2024-09-17T05:29:46.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.672+0000 7fe34cc00640 1 -- 172.21.15.31:0/4267222660 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16753 (secure 0 0 0) 0x7fe34005f9a0 con 0x7fe3500cdb30 2024-09-17T05:29:46.677 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:46.677 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":32,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:29:32.021289+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:29:28.563579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:29:29.374194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:29:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.672+0000 7fe357200640 1 -- 172.21.15.31:0/4267222660 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe32c0733e0 msgr2=0x7fe32c0758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.672+0000 7fe357200640 1 --2- 172.21.15.31:0/4267222660 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe32c0733e0 0x7fe32c0758a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe3380af000 tx=0x7fe33801b100 comp rx=0 tx=0).stop 2024-09-17T05:29:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.672+0000 7fe357200640 1 -- 172.21.15.31:0/4267222660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3500cdb30 msgr2=0x7fe3500b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.672+0000 7fe357200640 1 --2- 172.21.15.31:0/4267222660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3500cdb30 0x7fe3500b3570 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe34000c9f0 tx=0x7fe34000ceb0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.672+0000 7fe357200640 1 -- 172.21.15.31:0/4267222660 shutdown_connections 2024-09-17T05:29:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.672+0000 7fe357200640 1 --2- 172.21.15.31:0/4267222660 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe32c0733e0 0x7fe32c0758a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.672+0000 7fe357200640 1 --2- 172.21.15.31:0/4267222660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe35015bea0 0x7fe350159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.672+0000 7fe357200640 1 --2- 172.21.15.31:0/4267222660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3500d28e0 0x7fe350148020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.672+0000 7fe357200640 1 --2- 172.21.15.31:0/4267222660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3500cdb30 0x7fe3500b3570 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.672+0000 7fe357200640 1 -- 172.21.15.31:0/4267222660 >> 172.21.15.31:0/4267222660 conn(0x7fe3500d1dc0 msgr2=0x7fe3500b4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.672+0000 7fe357200640 1 -- 172.21.15.31:0/4267222660 shutdown_connections 2024-09-17T05:29:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.672+0000 7fe357200640 1 -- 172.21.15.31:0/4267222660 wait complete. 2024-09-17T05:29:46.698 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:29:46.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.840+0000 7fa98e400640 1 -- 172.21.15.31:0/793400401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa98815dea0 msgr2=0x7fa9880b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:46.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.840+0000 7fa98e400640 1 --2- 172.21.15.31:0/793400401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa98815dea0 0x7fa9880b3150 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa98806dbc0 tx=0x7fa97801c7d0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.840+0000 7fa98e400640 1 -- 172.21.15.31:0/793400401 shutdown_connections 2024-09-17T05:29:46.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.840+0000 7fa98e400640 1 --2- 172.21.15.31:0/793400401 >> v2:172.21.15.155:3300/0 conn(0x7fa98815e280 0x7fa9880ae990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.840+0000 7fa98e400640 1 --2- 172.21.15.31:0/793400401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa98815dea0 0x7fa9880b3150 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.840+0000 7fa98e400640 1 -- 172.21.15.31:0/793400401 >> 172.21.15.31:0/793400401 conn(0x7fa9880d1da0 msgr2=0x7fa9880d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:46.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.840+0000 7fa98e400640 1 -- 172.21.15.31:0/793400401 shutdown_connections 2024-09-17T05:29:46.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.840+0000 7fa98e400640 1 -- 172.21.15.31:0/793400401 wait complete. 2024-09-17T05:29:46.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.840+0000 7fa98e400640 1 Processor -- start 2024-09-17T05:29:46.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.840+0000 7fa98e400640 1 -- start start 2024-09-17T05:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa98e400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9880aeed0 0x7fa988156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa98e400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa98815dea0 0x7fa98809bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa98e400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa98815e280 0x7fa9880b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa98e400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa98816b310 con 0x7fa9880aeed0 2024-09-17T05:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa98e400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa98816b190 con 0x7fa98815dea0 2024-09-17T05:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa98e400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa98816b490 con 0x7fa98815e280 2024-09-17T05:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa987400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9880aeed0 0x7fa988156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa987400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9880aeed0 0x7fa988156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51022/0 (socket says 172.21.15.31:51022) 2024-09-17T05:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa987400640 1 -- 172.21.15.31:0/249243221 learned_addr learned my addr 172.21.15.31:0/249243221 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa987400640 1 -- 172.21.15.31:0/249243221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa98815e280 msgr2=0x7fa9880b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa987400640 1 --2- 172.21.15.31:0/249243221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa98815e280 0x7fa9880b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa987400640 1 -- 172.21.15.31:0/249243221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa98815dea0 msgr2=0x7fa98809bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:46.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa987400640 1 --2- 172.21.15.31:0/249243221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa98815dea0 0x7fa98809bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:46.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa987400640 1 -- 172.21.15.31:0/249243221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa98809c050 con 0x7fa9880aeed0 2024-09-17T05:29:46.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa987400640 1 --2- 172.21.15.31:0/249243221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9880aeed0 0x7fa988156850 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa9780193e0 tx=0x7fa9780040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:46.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa97f400640 1 -- 172.21.15.31:0/249243221 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9780bc070 con 0x7fa9880aeed0 2024-09-17T05:29:46.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa97f400640 1 -- 172.21.15.31:0/249243221 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa978003600 con 0x7fa9880aeed0 2024-09-17T05:29:46.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa97f400640 1 -- 172.21.15.31:0/249243221 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9780b2040 con 0x7fa9880aeed0 2024-09-17T05:29:46.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa98e400640 1 -- 172.21.15.31:0/249243221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa988161440 con 0x7fa9880aeed0 2024-09-17T05:29:46.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa98e400640 1 -- 172.21.15.31:0/249243221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa988161700 con 0x7fa9880aeed0 2024-09-17T05:29:46.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa98e400640 1 -- 172.21.15.31:0/249243221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9880b3150 con 0x7fa9880aeed0 2024-09-17T05:29:46.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.844+0000 7fa97f400640 1 -- 172.21.15.31:0/249243221 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7fa9780bf070 con 0x7fa9880aeed0 2024-09-17T05:29:46.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.848+0000 7fa97f400640 1 --2- 172.21.15.31:0/249243221 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa9680733b0 0x7fa968075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:46.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.848+0000 7fa97f400640 1 -- 172.21.15.31:0/249243221 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa97812df70 con 0x7fa9880aeed0 2024-09-17T05:29:46.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.848+0000 7fa986a00640 1 --2- 172.21.15.31:0/249243221 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa9680733b0 0x7fa968075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:46.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.848+0000 7fa986a00640 1 --2- 172.21.15.31:0/249243221 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa9680733b0 0x7fa968075870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa9740058d0 tx=0x7fa974005860 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:46.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:46.852+0000 7fa97f400640 1 -- 172.21.15.31:0/249243221 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa9780163f0 con 0x7fa9880aeed0 2024-09-17T05:29:47.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.064+0000 7fa98e400640 1 -- 172.21.15.31:0/249243221 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa9880d24c0 con 0x7fa9880aeed0 2024-09-17T05:29:47.070 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-09-17T05:29:47.064+0000 7f21d0200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:29:47.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.068+0000 7fa97f400640 1 -- 172.21.15.31:0/249243221 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7fa9780f8c80 con 0x7fa9880aeed0 2024-09-17T05:29:47.072 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:29:47.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.072+0000 7fa98e400640 1 -- 172.21.15.31:0/249243221 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa9680733b0 msgr2=0x7fa968075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:47.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.072+0000 7fa98e400640 1 --2- 172.21.15.31:0/249243221 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa9680733b0 0x7fa968075870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa9740058d0 tx=0x7fa974005860 comp rx=0 tx=0).stop 2024-09-17T05:29:47.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.072+0000 7fa98e400640 1 -- 172.21.15.31:0/249243221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9880aeed0 msgr2=0x7fa988156850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:47.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.072+0000 7fa98e400640 1 --2- 172.21.15.31:0/249243221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9880aeed0 0x7fa988156850 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa9780193e0 tx=0x7fa9780040c0 comp rx=0 tx=0).stop 2024-09-17T05:29:47.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.072+0000 7fa98e400640 1 -- 172.21.15.31:0/249243221 shutdown_connections 2024-09-17T05:29:47.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.072+0000 7fa98e400640 1 --2- 172.21.15.31:0/249243221 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa9680733b0 0x7fa968075870 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:47.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.072+0000 7fa98e400640 1 --2- 172.21.15.31:0/249243221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa98815e280 0x7fa9880b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:47.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.072+0000 7fa98e400640 1 --2- 172.21.15.31:0/249243221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa98815dea0 0x7fa98809bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:47.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.072+0000 7fa98e400640 1 --2- 172.21.15.31:0/249243221 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9880aeed0 0x7fa988156850 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:47.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.072+0000 7fa98e400640 1 -- 172.21.15.31:0/249243221 >> 172.21.15.31:0/249243221 conn(0x7fa9880d1da0 msgr2=0x7fa988071950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:47.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.072+0000 7fa98e400640 1 -- 172.21.15.31:0/249243221 shutdown_connections 2024-09-17T05:29:47.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.072+0000 7fa98e400640 1 -- 172.21.15.31:0/249243221 wait complete. 2024-09-17T05:29:47.097 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:29:47.144 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-17T05:29:47.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.244+0000 7f6000c00640 1 -- 172.21.15.31:0/2379076258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc0b1190 msgr2=0x7f5ffc0ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:47.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.244+0000 7f6000c00640 1 --2- 172.21.15.31:0/2379076258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc0b1190 0x7f5ffc0ce270 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4009900 tx=0x7f5fe401c6d0 comp rx=0 tx=0).stop 2024-09-17T05:29:47.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.244+0000 7f6000c00640 1 -- 172.21.15.31:0/2379076258 shutdown_connections 2024-09-17T05:29:47.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.244+0000 7f6000c00640 1 --2- 172.21.15.31:0/2379076258 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ffc0ce7b0 0x7f5ffc0cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:47.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.244+0000 7f6000c00640 1 --2- 172.21.15.31:0/2379076258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc0b1190 0x7f5ffc0ce270 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:47.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.244+0000 7f6000c00640 1 -- 172.21.15.31:0/2379076258 >> 172.21.15.31:0/2379076258 conn(0x7f5ffc0d1df0 msgr2=0x7f5ffc0d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:47.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.244+0000 7f6000c00640 1 -- 172.21.15.31:0/2379076258 shutdown_connections 2024-09-17T05:29:47.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.244+0000 7f6000c00640 1 -- 172.21.15.31:0/2379076258 wait complete. 2024-09-17T05:29:47.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.244+0000 7f6000c00640 1 Processor -- start 2024-09-17T05:29:47.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.244+0000 7f6000c00640 1 -- start start 2024-09-17T05:29:47.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f6000c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ffc0b1190 0x7f5ffc150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:47.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f6000c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc0ce7b0 0x7f5ffc158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:47.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f6000c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ffc1603f0 0x7f5ffc15f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:47.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f6000c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc0b3290 con 0x7f5ffc0ce7b0 2024-09-17T05:29:47.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f6000c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc0b2b50 con 0x7f5ffc0b1190 2024-09-17T05:29:47.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f6000c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5ffc0b3410 con 0x7f5ffc1603f0 2024-09-17T05:29:47.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f5ff3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc0ce7b0 0x7f5ffc158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:47.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f5ff9e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ffc0b1190 0x7f5ffc150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:47.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f5ff9e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ffc0b1190 0x7f5ffc150160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:51684/0 (socket says 172.21.15.31:51684) 2024-09-17T05:29:47.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f5ff9e00640 1 -- 172.21.15.31:0/1078051147 learned_addr learned my addr 172.21.15.31:0/1078051147 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:47.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f5ffa800640 1 --2- 172.21.15.31:0/1078051147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ffc1603f0 0x7f5ffc15f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:47.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f5ff3e00640 1 -- 172.21.15.31:0/1078051147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ffc1603f0 msgr2=0x7f5ffc15f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:47.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f5ff3e00640 1 --2- 172.21.15.31:0/1078051147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ffc1603f0 0x7f5ffc15f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:47.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f5ff3e00640 1 -- 172.21.15.31:0/1078051147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ffc0b1190 msgr2=0x7f5ffc150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:47.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f5ff3e00640 1 --2- 172.21.15.31:0/1078051147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ffc0b1190 0x7f5ffc150160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:47.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f5ff3e00640 1 -- 172.21.15.31:0/1078051147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ffc157580 con 0x7f5ffc0ce7b0 2024-09-17T05:29:47.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f5ff9e00640 1 --2- 172.21.15.31:0/1078051147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ffc0b1190 0x7f5ffc150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:29:47.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f5ff3e00640 1 --2- 172.21.15.31:0/1078051147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc0ce7b0 0x7f5ffc158f50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc074050 tx=0x7f5fe40a5620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:47.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f5ff2000640 1 -- 172.21.15.31:0/1078051147 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe40b2040 con 0x7f5ffc0ce7b0 2024-09-17T05:29:47.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f5ff2000640 1 -- 172.21.15.31:0/1078051147 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fe4004430 con 0x7f5ffc0ce7b0 2024-09-17T05:29:47.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f5ff2000640 1 -- 172.21.15.31:0/1078051147 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4003860 con 0x7f5ffc0ce7b0 2024-09-17T05:29:47.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f6000c00640 1 -- 172.21.15.31:0/1078051147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ffc157840 con 0x7f5ffc0ce7b0 2024-09-17T05:29:47.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f6000c00640 1 -- 172.21.15.31:0/1078051147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ffc157e00 con 0x7f5ffc0ce7b0 2024-09-17T05:29:47.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f6000c00640 1 -- 172.21.15.31:0/1078051147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ffc0ce270 con 0x7f5ffc0ce7b0 2024-09-17T05:29:47.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.248+0000 7f5ff2000640 1 -- 172.21.15.31:0/1078051147 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f5fe40bf060 con 0x7f5ffc0ce7b0 2024-09-17T05:29:47.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.252+0000 7f5ff2000640 1 --2- 172.21.15.31:0/1078051147 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5fd80733b0 0x7f5fd8075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:47.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.252+0000 7f5ff2000640 1 -- 172.21.15.31:0/1078051147 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f5fe412e370 con 0x7f5ffc0ce7b0 2024-09-17T05:29:47.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.252+0000 7f5ff9e00640 1 --2- 172.21.15.31:0/1078051147 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5fd80733b0 0x7f5fd8075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:47.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.252+0000 7f5ff9e00640 1 --2- 172.21.15.31:0/1078051147 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5fd80733b0 0x7f5fd8075870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009da0 tx=0x7f5fec009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:47.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.256+0000 7f5ff2000640 1 -- 172.21.15.31:0/1078051147 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5ffc0cebc0 con 0x7f5ffc0ce7b0 2024-09-17T05:29:47.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:47.472+0000 7f6000c00640 1 -- 172.21.15.31:0/1078051147 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5ffc0b7d70 con 0x7f5ffc0ce7b0 2024-09-17T05:29:48.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.108+0000 7f5ff2000640 1 -- 172.21.15.31:0/1078051147 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f5fe40f9020 con 0x7f5ffc0ce7b0 2024-09-17T05:29:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.108+0000 7f6000c00640 1 -- 172.21.15.31:0/1078051147 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5fd80733b0 msgr2=0x7f5fd8075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.108+0000 7f6000c00640 1 --2- 172.21.15.31:0/1078051147 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5fd80733b0 0x7f5fd8075870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009da0 tx=0x7f5fec009110 comp rx=0 tx=0).stop 2024-09-17T05:29:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.108+0000 7f6000c00640 1 -- 172.21.15.31:0/1078051147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc0ce7b0 msgr2=0x7f5ffc158f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:48.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.108+0000 7f6000c00640 1 --2- 172.21.15.31:0/1078051147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc0ce7b0 0x7f5ffc158f50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc074050 tx=0x7f5fe40a5620 comp rx=0 tx=0).stop 2024-09-17T05:29:48.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.108+0000 7f6000c00640 1 -- 172.21.15.31:0/1078051147 shutdown_connections 2024-09-17T05:29:48.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.108+0000 7f6000c00640 1 --2- 172.21.15.31:0/1078051147 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5fd80733b0 0x7f5fd8075870 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:48.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.108+0000 7f6000c00640 1 --2- 172.21.15.31:0/1078051147 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ffc1603f0 0x7f5ffc15f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:48.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.108+0000 7f6000c00640 1 --2- 172.21.15.31:0/1078051147 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ffc0ce7b0 0x7f5ffc158f50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:48.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.108+0000 7f6000c00640 1 --2- 172.21.15.31:0/1078051147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ffc0b1190 0x7f5ffc150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:48.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.108+0000 7f6000c00640 1 -- 172.21.15.31:0/1078051147 >> 172.21.15.31:0/1078051147 conn(0x7f5ffc0d1df0 msgr2=0x7f5ffc15d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:48.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.108+0000 7f6000c00640 1 -- 172.21.15.31:0/1078051147 shutdown_connections 2024-09-17T05:29:48.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.108+0000 7f6000c00640 1 -- 172.21.15.31:0/1078051147 wait complete. 2024-09-17T05:29:48.138 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:29:48.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.288+0000 7f93d5600640 1 -- 172.21.15.31:0/2151259346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d015c1f0 msgr2=0x7f93d00cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:48.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.288+0000 7f93d5600640 1 --2- 172.21.15.31:0/2151259346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d015c1f0 0x7f93d00cec40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f93b8009840 tx=0x7f93b801f010 comp rx=0 tx=0).stop 2024-09-17T05:29:48.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.288+0000 7f93d5600640 1 -- 172.21.15.31:0/2151259346 shutdown_connections 2024-09-17T05:29:48.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.288+0000 7f93d5600640 1 --2- 172.21.15.31:0/2151259346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d015c1f0 0x7f93d00cec40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:48.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.288+0000 7f93d5600640 1 --2- 172.21.15.31:0/2151259346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93d015be10 0x7f93d00ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:48.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.288+0000 7f93d5600640 1 -- 172.21.15.31:0/2151259346 >> 172.21.15.31:0/2151259346 conn(0x7f93d00d1da0 msgr2=0x7f93d00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:48.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.288+0000 7f93d5600640 1 -- 172.21.15.31:0/2151259346 shutdown_connections 2024-09-17T05:29:48.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.288+0000 7f93d5600640 1 -- 172.21.15.31:0/2151259346 wait complete. 2024-09-17T05:29:48.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93d5600640 1 Processor -- start 2024-09-17T05:29:48.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93d5600640 1 -- start start 2024-09-17T05:29:48.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93d5600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d00b0b60 0x7f93d01f8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:48.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93d5600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93d015be10 0x7f93d01f8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:48.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93d5600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93d015c1f0 0x7f93d00b6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:48.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93d5600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f93d00cf510 con 0x7f93d00b0b60 2024-09-17T05:29:48.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93d5600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f93d00cf390 con 0x7f93d015c1f0 2024-09-17T05:29:48.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93d5600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f93d0160290 con 0x7f93d015be10 2024-09-17T05:29:48.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93cea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d00b0b60 0x7f93d01f8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:48.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93cea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d00b0b60 0x7f93d01f8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51066/0 (socket says 172.21.15.31:51066) 2024-09-17T05:29:48.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93cea00640 1 -- 172.21.15.31:0/1417329364 learned_addr learned my addr 172.21.15.31:0/1417329364 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:48.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93cea00640 1 -- 172.21.15.31:0/1417329364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93d015be10 msgr2=0x7f93d01f8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:48.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93cea00640 1 --2- 172.21.15.31:0/1417329364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93d015be10 0x7f93d01f8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:48.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93cea00640 1 -- 172.21.15.31:0/1417329364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93d015c1f0 msgr2=0x7f93d00b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:48.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93cea00640 1 --2- 172.21.15.31:0/1417329364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93d015c1f0 0x7f93d00b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93cea00640 1 -- 172.21.15.31:0/1417329364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d00b6fb0 con 0x7f93d00b0b60 2024-09-17T05:29:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93cea00640 1 --2- 172.21.15.31:0/1417329364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d00b0b60 0x7f93d01f8820 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f93c000d950 tx=0x7f93c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93c7400640 1 -- 172.21.15.31:0/1417329364 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0017070 con 0x7f93d00b0b60 2024-09-17T05:29:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93c7400640 1 -- 172.21.15.31:0/1417329364 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93c0009d20 con 0x7f93d00b0b60 2024-09-17T05:29:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93c7400640 1 -- 172.21.15.31:0/1417329364 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c00106c0 con 0x7f93d00b0b60 2024-09-17T05:29:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93d5600640 1 -- 172.21.15.31:0/1417329364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d01f4e40 con 0x7f93d00b0b60 2024-09-17T05:29:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93d5600640 1 -- 172.21.15.31:0/1417329364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d01f5400 con 0x7f93d00b0b60 2024-09-17T05:29:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.292+0000 7f93d5600640 1 -- 172.21.15.31:0/1417329364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93d0160780 con 0x7f93d00b0b60 2024-09-17T05:29:48.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.296+0000 7f93c7400640 1 -- 172.21.15.31:0/1417329364 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f93c0010860 con 0x7f93d00b0b60 2024-09-17T05:29:48.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.296+0000 7f93c7400640 1 --2- 172.21.15.31:0/1417329364 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f93ac0733b0 0x7f93ac075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:48.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.296+0000 7f93c7400640 1 -- 172.21.15.31:0/1417329364 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f93c0094a60 con 0x7f93d00b0b60 2024-09-17T05:29:48.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.296+0000 7f93c6000640 1 --2- 172.21.15.31:0/1417329364 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f93ac0733b0 0x7f93ac075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:48.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.296+0000 7f93c6000640 1 --2- 172.21.15.31:0/1417329364 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f93ac0733b0 0x7f93ac075870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f93b80b2000 tx=0x7f93b801bdb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:48.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.300+0000 7f93c7400640 1 -- 172.21.15.31:0/1417329364 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f93c005f710 con 0x7f93d00b0b60 2024-09-17T05:29:48.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:48.488+0000 7f93d5600640 1 -- 172.21.15.31:0/1417329364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f93d0070350 con 0x7f93d00b0b60 2024-09-17T05:29:49.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.112+0000 7f93c7400640 1 -- 172.21.15.31:0/1417329364 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v34) ==== 181+0+0 (secure 0 0 0) 0x7f93c005f010 con 0x7f93d00b0b60 2024-09-17T05:29:49.119 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:29:49.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.116+0000 7f93d5600640 1 -- 172.21.15.31:0/1417329364 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f93ac0733b0 msgr2=0x7f93ac075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:49.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.116+0000 7f93d5600640 1 --2- 172.21.15.31:0/1417329364 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f93ac0733b0 0x7f93ac075870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f93b80b2000 tx=0x7f93b801bdb0 comp rx=0 tx=0).stop 2024-09-17T05:29:49.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.116+0000 7f93d5600640 1 -- 172.21.15.31:0/1417329364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d00b0b60 msgr2=0x7f93d01f8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:49.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.116+0000 7f93d5600640 1 --2- 172.21.15.31:0/1417329364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d00b0b60 0x7f93d01f8820 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f93c000d950 tx=0x7f93c000de10 comp rx=0 tx=0).stop 2024-09-17T05:29:49.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.116+0000 7f93d5600640 1 -- 172.21.15.31:0/1417329364 shutdown_connections 2024-09-17T05:29:49.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.116+0000 7f93d5600640 1 --2- 172.21.15.31:0/1417329364 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f93ac0733b0 0x7f93ac075870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:49.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.116+0000 7f93d5600640 1 --2- 172.21.15.31:0/1417329364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93d015c1f0 0x7f93d00b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:49.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.116+0000 7f93d5600640 1 --2- 172.21.15.31:0/1417329364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93d015be10 0x7f93d01f8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:49.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.116+0000 7f93d5600640 1 --2- 172.21.15.31:0/1417329364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d00b0b60 0x7f93d01f8820 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:49.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.116+0000 7f93d5600640 1 -- 172.21.15.31:0/1417329364 >> 172.21.15.31:0/1417329364 conn(0x7f93d00d1da0 msgr2=0x7f93d00cdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:49.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.116+0000 7f93d5600640 1 -- 172.21.15.31:0/1417329364 shutdown_connections 2024-09-17T05:29:49.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.116+0000 7f93d5600640 1 -- 172.21.15.31:0/1417329364 wait complete. 2024-09-17T05:29:49.148 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:29:49.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.296+0000 7f88c9e00640 1 -- 172.21.15.31:0/2767883972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88c40734f0 msgr2=0x7f88c415a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:49.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.296+0000 7f88c9e00640 1 --2- 172.21.15.31:0/2767883972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88c40734f0 0x7f88c415a9d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009840 tx=0x7f88b401c760 comp rx=0 tx=0).stop 2024-09-17T05:29:49.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.296+0000 7f88c9e00640 1 -- 172.21.15.31:0/2767883972 shutdown_connections 2024-09-17T05:29:49.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.296+0000 7f88c9e00640 1 --2- 172.21.15.31:0/2767883972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88c40cea60 0x7f88c406eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:49.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.296+0000 7f88c9e00640 1 --2- 172.21.15.31:0/2767883972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88c40734f0 0x7f88c415a9d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:49.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.296+0000 7f88c9e00640 1 -- 172.21.15.31:0/2767883972 >> 172.21.15.31:0/2767883972 conn(0x7f88c40cfbc0 msgr2=0x7f88c40cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:49.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.296+0000 7f88c9e00640 1 -- 172.21.15.31:0/2767883972 shutdown_connections 2024-09-17T05:29:49.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.296+0000 7f88c9e00640 1 -- 172.21.15.31:0/2767883972 wait complete. 2024-09-17T05:29:49.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88c9e00640 1 Processor -- start 2024-09-17T05:29:49.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88c9e00640 1 -- start start 2024-09-17T05:29:49.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88c9e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88c40734f0 0x7f88c414ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:49.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88c9e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88c40cea60 0x7f88c415c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:49.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88c9e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88c40cf440 0x7f88c415cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:49.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88c9e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f88c41676f0 con 0x7f88c40cea60 2024-09-17T05:29:49.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88c9e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f88c4167570 con 0x7f88c40cf440 2024-09-17T05:29:49.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88c9e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f88c4167870 con 0x7f88c40734f0 2024-09-17T05:29:49.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88bbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88c40cea60 0x7f88c415c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:49.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88bbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88c40cea60 0x7f88c415c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55682/0 (socket says 172.21.15.31:55682) 2024-09-17T05:29:49.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88bbe00640 1 -- 172.21.15.31:0/942975199 learned_addr learned my addr 172.21.15.31:0/942975199 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:49.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88c2a00640 1 --2- 172.21.15.31:0/942975199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88c40734f0 0x7f88c414ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:49.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88c3400640 1 --2- 172.21.15.31:0/942975199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88c40cf440 0x7f88c415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:49.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88bbe00640 1 -- 172.21.15.31:0/942975199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88c40734f0 msgr2=0x7f88c414ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:49.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88bbe00640 1 --2- 172.21.15.31:0/942975199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88c40734f0 0x7f88c414ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:49.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88bbe00640 1 -- 172.21.15.31:0/942975199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88c40cf440 msgr2=0x7f88c415cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:49.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88bbe00640 1 --2- 172.21.15.31:0/942975199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88c40cf440 0x7f88c415cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:49.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88bbe00640 1 -- 172.21.15.31:0/942975199 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c41f9c40 con 0x7f88c40cea60 2024-09-17T05:29:49.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88bbe00640 1 --2- 172.21.15.31:0/942975199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88c40cea60 0x7f88c415c7a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00c400 tx=0x7f88ac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:49.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88bb400640 1 -- 172.21.15.31:0/942975199 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac011790 con 0x7f88c40cea60 2024-09-17T05:29:49.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88bb400640 1 -- 172.21.15.31:0/942975199 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88ac017070 con 0x7f88c40cea60 2024-09-17T05:29:49.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88bb400640 1 -- 172.21.15.31:0/942975199 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac011cc0 con 0x7f88c40cea60 2024-09-17T05:29:49.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88c9e00640 1 -- 172.21.15.31:0/942975199 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c40b4d60 con 0x7f88c40cea60 2024-09-17T05:29:49.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.300+0000 7f88c9e00640 1 -- 172.21.15.31:0/942975199 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c414f170 con 0x7f88c40cea60 2024-09-17T05:29:49.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.304+0000 7f88c9e00640 1 -- 172.21.15.31:0/942975199 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c4069410 con 0x7f88c40cea60 2024-09-17T05:29:49.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.304+0000 7f88bb400640 1 -- 172.21.15.31:0/942975199 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f88ac01c460 con 0x7f88c40cea60 2024-09-17T05:29:49.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.304+0000 7f88bb400640 1 --2- 172.21.15.31:0/942975199 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f88a00733b0 0x7f88a0075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:49.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.304+0000 7f88bb400640 1 -- 172.21.15.31:0/942975199 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5357+0+0 (secure 0 0 0) 0x7f88ac094320 con 0x7f88c40cea60 2024-09-17T05:29:49.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.304+0000 7f88c2a00640 1 --2- 172.21.15.31:0/942975199 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f88a00733b0 0x7f88a0075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:49.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.304+0000 7f88c2a00640 1 --2- 172.21.15.31:0/942975199 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f88a00733b0 0x7f88a0075870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f88b40af000 tx=0x7f88b401afa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:49.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.308+0000 7f88bb400640 1 -- 172.21.15.31:0/942975199 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f88ac05f100 con 0x7f88c40cea60 2024-09-17T05:29:49.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:49.492+0000 7f88c9e00640 1 -- 172.21.15.31:0/942975199 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f88c414f460 con 0x7f88c40cea60 2024-09-17T05:29:50.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.116+0000 7f88bb400640 1 -- 172.21.15.31:0/942975199 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v35) ==== 169+0+0 (secure 0 0 0) 0x7f88ac05ea00 con 0x7f88c40cea60 2024-09-17T05:29:50.124 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-09-17T05:29:50.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.124+0000 7f88c9e00640 1 -- 172.21.15.31:0/942975199 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f88a00733b0 msgr2=0x7f88a0075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:50.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.124+0000 7f88c9e00640 1 --2- 172.21.15.31:0/942975199 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f88a00733b0 0x7f88a0075870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f88b40af000 tx=0x7f88b401afa0 comp rx=0 tx=0).stop 2024-09-17T05:29:50.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.124+0000 7f88c9e00640 1 -- 172.21.15.31:0/942975199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88c40cea60 msgr2=0x7f88c415c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:50.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.124+0000 7f88c9e00640 1 --2- 172.21.15.31:0/942975199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88c40cea60 0x7f88c415c7a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00c400 tx=0x7f88ac00c8c0 comp rx=0 tx=0).stop 2024-09-17T05:29:50.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.124+0000 7f88c9e00640 1 -- 172.21.15.31:0/942975199 shutdown_connections 2024-09-17T05:29:50.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.124+0000 7f88c9e00640 1 --2- 172.21.15.31:0/942975199 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f88a00733b0 0x7f88a0075870 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:50.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.124+0000 7f88c9e00640 1 --2- 172.21.15.31:0/942975199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88c40cf440 0x7f88c415cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:50.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.124+0000 7f88c9e00640 1 --2- 172.21.15.31:0/942975199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88c40cea60 0x7f88c415c7a0 secure :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00c400 tx=0x7f88ac00c8c0 comp rx=0 tx=0).stop 2024-09-17T05:29:50.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.124+0000 7f88c9e00640 1 --2- 172.21.15.31:0/942975199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88c40734f0 0x7f88c414ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:50.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.124+0000 7f88c9e00640 1 -- 172.21.15.31:0/942975199 >> 172.21.15.31:0/942975199 conn(0x7f88c40cfbc0 msgr2=0x7f88c4150190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:50.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.124+0000 7f88c9e00640 1 -- 172.21.15.31:0/942975199 shutdown_connections 2024-09-17T05:29:50.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.124+0000 7f88c9e00640 1 -- 172.21.15.31:0/942975199 wait complete. 2024-09-17T05:29:50.161 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:29:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.312+0000 7fdf42800640 1 -- 172.21.15.31:0/4151746320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf3c15bea0 msgr2=0x7fdf3c0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.312+0000 7fdf42800640 1 --2- 172.21.15.31:0/4151746320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf3c15bea0 0x7fdf3c0ce670 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0cc3a0 tx=0x7fdf2c01c830 comp rx=0 tx=0).stop 2024-09-17T05:29:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.312+0000 7fdf42800640 1 -- 172.21.15.31:0/4151746320 shutdown_connections 2024-09-17T05:29:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.312+0000 7fdf42800640 1 --2- 172.21.15.31:0/4151746320 >> v2:172.21.15.155:3300/0 conn(0x7fdf3c0d28e0 0x7fdf3c0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.312+0000 7fdf42800640 1 --2- 172.21.15.31:0/4151746320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf3c15bea0 0x7fdf3c0ce670 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.312+0000 7fdf42800640 1 -- 172.21.15.31:0/4151746320 >> 172.21.15.31:0/4151746320 conn(0x7fdf3c0d1dc0 msgr2=0x7fdf3c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.312+0000 7fdf42800640 1 -- 172.21.15.31:0/4151746320 shutdown_connections 2024-09-17T05:29:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.312+0000 7fdf42800640 1 -- 172.21.15.31:0/4151746320 wait complete. 2024-09-17T05:29:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.312+0000 7fdf42800640 1 Processor -- start 2024-09-17T05:29:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.312+0000 7fdf42800640 1 -- start start 2024-09-17T05:29:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf42800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf3c0cdb30 0x7fdf3c158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf42800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf3c0d28e0 0x7fdf3c0b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf42800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf3c15bea0 0x7fdf3c0c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf42800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c168fc0 con 0x7fdf3c15bea0 2024-09-17T05:29:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf42800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3c168e40 con 0x7fdf3c0cdb30 2024-09-17T05:29:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf42800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdf3c169140 con 0x7fdf3c0d28e0 2024-09-17T05:29:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf3be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf3c15bea0 0x7fdf3c0c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf3b400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf3c0cdb30 0x7fdf3c158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf3be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf3c15bea0 0x7fdf3c0c7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55700/0 (socket says 172.21.15.31:55700) 2024-09-17T05:29:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf3be00640 1 -- 172.21.15.31:0/991200478 learned_addr learned my addr 172.21.15.31:0/991200478 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf3aa00640 1 --2- 172.21.15.31:0/991200478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf3c0d28e0 0x7fdf3c0b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf3b400640 1 -- 172.21.15.31:0/991200478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf3c0d28e0 msgr2=0x7fdf3c0b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf3b400640 1 --2- 172.21.15.31:0/991200478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf3c0d28e0 0x7fdf3c0b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf3b400640 1 -- 172.21.15.31:0/991200478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf3c15bea0 msgr2=0x7fdf3c0c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf3b400640 1 --2- 172.21.15.31:0/991200478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf3c15bea0 0x7fdf3c0c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf3b400640 1 -- 172.21.15.31:0/991200478 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3c159a70 con 0x7fdf3c0cdb30 2024-09-17T05:29:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf3b400640 1 --2- 172.21.15.31:0/991200478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf3c0cdb30 0x7fdf3c158260 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0ac000 tx=0x7fdf2c0a5600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf33400640 1 -- 172.21.15.31:0/991200478 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c0b2040 con 0x7fdf3c0cdb30 2024-09-17T05:29:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf33400640 1 -- 172.21.15.31:0/991200478 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf2c0043d0 con 0x7fdf3c0cdb30 2024-09-17T05:29:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf33400640 1 -- 172.21.15.31:0/991200478 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c003860 con 0x7fdf3c0cdb30 2024-09-17T05:29:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf42800640 1 -- 172.21.15.31:0/991200478 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf3c1f9010 con 0x7fdf3c0cdb30 2024-09-17T05:29:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf42800640 1 -- 172.21.15.31:0/991200478 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf3c1f95d0 con 0x7fdf3c0cdb30 2024-09-17T05:29:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf42800640 1 -- 172.21.15.31:0/991200478 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf3c0cc9d0 con 0x7fdf3c0cdb30 2024-09-17T05:29:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.316+0000 7fdf33400640 1 -- 172.21.15.31:0/991200478 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7fdf2c003a00 con 0x7fdf3c0cdb30 2024-09-17T05:29:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.320+0000 7fdf33400640 1 --2- 172.21.15.31:0/991200478 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdf1c0733b0 0x7fdf1c075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.320+0000 7fdf33400640 1 -- 172.21.15.31:0/991200478 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fdf2c12dab0 con 0x7fdf3c0cdb30 2024-09-17T05:29:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.320+0000 7fdf3aa00640 1 --2- 172.21.15.31:0/991200478 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdf1c0733b0 0x7fdf1c075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:50.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.320+0000 7fdf3aa00640 1 --2- 172.21.15.31:0/991200478 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdf1c0733b0 0x7fdf1c075870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0cd0b0 tx=0x7fdf28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:50.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.324+0000 7fdf33400640 1 -- 172.21.15.31:0/991200478 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fdf2c0164b0 con 0x7fdf3c0cdb30 2024-09-17T05:29:50.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.500+0000 7fdf42800640 1 -- 172.21.15.31:0/991200478 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7fdf3c0b1dd0 con 0x7fdf3c0cdb30 2024-09-17T05:29:50.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.504+0000 7fdf33400640 1 -- 172.21.15.31:0/991200478 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v29) ==== 71+0+0 (secure 0 0 0) 0x7fdf2c0f8520 con 0x7fdf3c0cdb30 2024-09-17T05:29:50.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.508+0000 7fdf42800640 1 -- 172.21.15.31:0/991200478 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdf1c0733b0 msgr2=0x7fdf1c075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:50.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.508+0000 7fdf42800640 1 --2- 172.21.15.31:0/991200478 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdf1c0733b0 0x7fdf1c075870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c0cd0b0 tx=0x7fdf28009040 comp rx=0 tx=0).stop 2024-09-17T05:29:50.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.508+0000 7fdf42800640 1 -- 172.21.15.31:0/991200478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf3c0cdb30 msgr2=0x7fdf3c158260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:50.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.508+0000 7fdf42800640 1 --2- 172.21.15.31:0/991200478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf3c0cdb30 0x7fdf3c158260 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0ac000 tx=0x7fdf2c0a5600 comp rx=0 tx=0).stop 2024-09-17T05:29:50.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.508+0000 7fdf42800640 1 -- 172.21.15.31:0/991200478 shutdown_connections 2024-09-17T05:29:50.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.508+0000 7fdf42800640 1 --2- 172.21.15.31:0/991200478 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdf1c0733b0 0x7fdf1c075870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:50.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.508+0000 7fdf42800640 1 --2- 172.21.15.31:0/991200478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf3c15bea0 0x7fdf3c0c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:50.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.508+0000 7fdf42800640 1 --2- 172.21.15.31:0/991200478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf3c0d28e0 0x7fdf3c0b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:50.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.508+0000 7fdf42800640 1 --2- 172.21.15.31:0/991200478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf3c0cdb30 0x7fdf3c158260 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:50.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.508+0000 7fdf42800640 1 -- 172.21.15.31:0/991200478 >> 172.21.15.31:0/991200478 conn(0x7fdf3c0d1dc0 msgr2=0x7fdf3c0b68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:50.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.508+0000 7fdf42800640 1 -- 172.21.15.31:0/991200478 shutdown_connections 2024-09-17T05:29:50.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.508+0000 7fdf42800640 1 -- 172.21.15.31:0/991200478 wait complete. 2024-09-17T05:29:50.531 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2024-09-17T05:29:50.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.672+0000 7fab8d400640 1 -- 172.21.15.31:0/2045963862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab88071360 msgr2=0x7fab8806f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:50.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.672+0000 7fab8d400640 1 --2- 172.21.15.31:0/2045963862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab88071360 0x7fab8806f710 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fab78009840 tx=0x7fab7801f010 comp rx=0 tx=0).stop 2024-09-17T05:29:50.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.672+0000 7fab8d400640 1 -- 172.21.15.31:0/2045963862 shutdown_connections 2024-09-17T05:29:50.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.672+0000 7fab8d400640 1 --2- 172.21.15.31:0/2045963862 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab88071740 0x7fab880aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:50.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.672+0000 7fab8d400640 1 --2- 172.21.15.31:0/2045963862 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab88071360 0x7fab8806f710 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:50.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.672+0000 7fab8d400640 1 -- 172.21.15.31:0/2045963862 >> 172.21.15.31:0/2045963862 conn(0x7fab8809aa10 msgr2=0x7fab8809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:50.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.672+0000 7fab8d400640 1 -- 172.21.15.31:0/2045963862 shutdown_connections 2024-09-17T05:29:50.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.672+0000 7fab8d400640 1 -- 172.21.15.31:0/2045963862 wait complete. 2024-09-17T05:29:50.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8d400640 1 Processor -- start 2024-09-17T05:29:50.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8d400640 1 -- start start 2024-09-17T05:29:50.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8d400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab88071360 0x7fab880b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:50.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8d400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab88071740 0x7fab88149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:50.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab880af040 0x7fab88149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:50.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8d400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fab880af4f0 con 0x7fab880af040 2024-09-17T05:29:50.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8d400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fab880b6ca0 con 0x7fab88071360 2024-09-17T05:29:50.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8d400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fab880af670 con 0x7fab88071740 2024-09-17T05:29:50.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab880af040 0x7fab88149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:50.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab880af040 0x7fab88149aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55716/0 (socket says 172.21.15.31:55716) 2024-09-17T05:29:50.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8ca00640 1 -- 172.21.15.31:0/1887828257 learned_addr learned my addr 172.21.15.31:0/1887828257 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:50.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab87e00640 1 --2- 172.21.15.31:0/1887828257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab88071360 0x7fab880b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:50.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab7fe00640 1 --2- 172.21.15.31:0/1887828257 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab88071740 0x7fab88149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:50.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8ca00640 1 -- 172.21.15.31:0/1887828257 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab88071740 msgr2=0x7fab88149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:50.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8ca00640 1 --2- 172.21.15.31:0/1887828257 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab88071740 0x7fab88149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:50.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8ca00640 1 -- 172.21.15.31:0/1887828257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab88071360 msgr2=0x7fab880b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:50.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8ca00640 1 --2- 172.21.15.31:0/1887828257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab88071360 0x7fab880b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:50.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8ca00640 1 -- 172.21.15.31:0/1887828257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8814c460 con 0x7fab880af040 2024-09-17T05:29:50.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8ca00640 1 --2- 172.21.15.31:0/1887828257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab880af040 0x7fab88149aa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fab80002240 tx=0x7fab8000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:50.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab84c00640 1 -- 172.21.15.31:0/1887828257 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab80017070 con 0x7fab880af040 2024-09-17T05:29:50.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8d400640 1 -- 172.21.15.31:0/1887828257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8814c740 con 0x7fab880af040 2024-09-17T05:29:50.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab84c00640 1 -- 172.21.15.31:0/1887828257 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab80003c70 con 0x7fab880af040 2024-09-17T05:29:50.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab84c00640 1 -- 172.21.15.31:0/1887828257 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab800052d0 con 0x7fab880af040 2024-09-17T05:29:50.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8d400640 1 -- 172.21.15.31:0/1887828257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8814cd00 con 0x7fab880af040 2024-09-17T05:29:50.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.676+0000 7fab8d400640 1 -- 172.21.15.31:0/1887828257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab880aeb00 con 0x7fab880af040 2024-09-17T05:29:50.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.680+0000 7fab84c00640 1 -- 172.21.15.31:0/1887828257 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7fab8001a070 con 0x7fab880af040 2024-09-17T05:29:50.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.680+0000 7fab84c00640 1 --2- 172.21.15.31:0/1887828257 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fab640733b0 0x7fab64075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:50.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.680+0000 7fab84c00640 1 -- 172.21.15.31:0/1887828257 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fab80093870 con 0x7fab880af040 2024-09-17T05:29:50.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.680+0000 7fab87e00640 1 --2- 172.21.15.31:0/1887828257 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fab640733b0 0x7fab64075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:50.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.680+0000 7fab87e00640 1 --2- 172.21.15.31:0/1887828257 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fab640733b0 0x7fab64075870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fab780b2000 tx=0x7fab7801d850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:50.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.684+0000 7fab84c00640 1 -- 172.21.15.31:0/1887828257 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fab80095e20 con 0x7fab880af040 2024-09-17T05:29:50.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:50.924+0000 7fab8d400640 1 -- 172.21.15.31:0/1887828257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7fab880b6140 con 0x7fab880af040 2024-09-17T05:29:51.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.120+0000 7fab84c00640 1 -- 172.21.15.31:0/1887828257 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v85) ==== 158+0+0 (secure 0 0 0) 0x7fab80063e20 con 0x7fab880af040 2024-09-17T05:29:51.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.124+0000 7fab8d400640 1 -- 172.21.15.31:0/1887828257 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fab640733b0 msgr2=0x7fab64075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:51.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.124+0000 7fab8d400640 1 --2- 172.21.15.31:0/1887828257 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fab640733b0 0x7fab64075870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fab780b2000 tx=0x7fab7801d850 comp rx=0 tx=0).stop 2024-09-17T05:29:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.124+0000 7fab8d400640 1 -- 172.21.15.31:0/1887828257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab880af040 msgr2=0x7fab88149aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.124+0000 7fab8d400640 1 --2- 172.21.15.31:0/1887828257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab880af040 0x7fab88149aa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fab80002240 tx=0x7fab8000cb90 comp rx=0 tx=0).stop 2024-09-17T05:29:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.124+0000 7fab8d400640 1 -- 172.21.15.31:0/1887828257 shutdown_connections 2024-09-17T05:29:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.124+0000 7fab8d400640 1 --2- 172.21.15.31:0/1887828257 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fab640733b0 0x7fab64075870 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.124+0000 7fab8d400640 1 --2- 172.21.15.31:0/1887828257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab880af040 0x7fab88149aa0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.124+0000 7fab8d400640 1 --2- 172.21.15.31:0/1887828257 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fab88071740 0x7fab88149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.124+0000 7fab8d400640 1 --2- 172.21.15.31:0/1887828257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab88071360 0x7fab880b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.124+0000 7fab8d400640 1 -- 172.21.15.31:0/1887828257 >> 172.21.15.31:0/1887828257 conn(0x7fab8809aa10 msgr2=0x7fab880b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.124+0000 7fab8d400640 1 -- 172.21.15.31:0/1887828257 shutdown_connections 2024-09-17T05:29:51.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.124+0000 7fab8d400640 1 -- 172.21.15.31:0/1887828257 wait complete. 2024-09-17T05:29:51.149 INFO:tasks.cephfs_test_runner:Validate binary .meta file on legacy subvol root doesn't break the system ... ok 2024-09-17T05:29:51.150 INFO:tasks.cephfs_test_runner:Starting test: test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:29:51.150 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:29:51.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.292+0000 7f9b69000640 1 -- 172.21.15.31:0/1813755235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b6415af60 msgr2=0x7f9b640cffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:51.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.292+0000 7f9b69000640 1 --2- 172.21.15.31:0/1813755235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b6415af60 0x7f9b640cffc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009900 tx=0x7f9b5401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.292+0000 7f9b69000640 1 -- 172.21.15.31:0/1813755235 shutdown_connections 2024-09-17T05:29:51.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.292+0000 7f9b69000640 1 --2- 172.21.15.31:0/1813755235 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b640737c0 0x7f9b64073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.292+0000 7f9b69000640 1 --2- 172.21.15.31:0/1813755235 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b6415af60 0x7f9b640cffc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.292+0000 7f9b69000640 1 -- 172.21.15.31:0/1813755235 >> 172.21.15.31:0/1813755235 conn(0x7f9b640d0c90 msgr2=0x7f9b640d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:51.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.292+0000 7f9b69000640 1 -- 172.21.15.31:0/1813755235 shutdown_connections 2024-09-17T05:29:51.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.292+0000 7f9b69000640 1 -- 172.21.15.31:0/1813755235 wait complete. 2024-09-17T05:29:51.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b69000640 1 Processor -- start 2024-09-17T05:29:51.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b69000640 1 -- start start 2024-09-17T05:29:51.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b69000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b640737c0 0x7f9b641566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:51.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b69000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b64074160 0x7f9b64163e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:51.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b69000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b6415af60 0x7f9b640b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:51.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b69000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9b64167b40 con 0x7f9b6415af60 2024-09-17T05:29:51.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b69000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9b64070b70 con 0x7f9b64074160 2024-09-17T05:29:51.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b69000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9b64167cc0 con 0x7f9b640737c0 2024-09-17T05:29:51.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b62800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b6415af60 0x7f9b640b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:51.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b62800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b6415af60 0x7f9b640b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55748/0 (socket says 172.21.15.31:55748) 2024-09-17T05:29:51.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b62800640 1 -- 172.21.15.31:0/411181435 learned_addr learned my addr 172.21.15.31:0/411181435 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:51.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b61e00640 1 --2- 172.21.15.31:0/411181435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b640737c0 0x7f9b641566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:51.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b5be00640 1 --2- 172.21.15.31:0/411181435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b64074160 0x7f9b64163e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:51.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b62800640 1 -- 172.21.15.31:0/411181435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b640737c0 msgr2=0x7f9b641566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:51.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b62800640 1 --2- 172.21.15.31:0/411181435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b640737c0 0x7f9b641566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b62800640 1 -- 172.21.15.31:0/411181435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b64074160 msgr2=0x7f9b64163e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:51.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b62800640 1 --2- 172.21.15.31:0/411181435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b64074160 0x7f9b64163e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b62800640 1 -- 172.21.15.31:0/411181435 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b64156bf0 con 0x7f9b6415af60 2024-09-17T05:29:51.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b61e00640 1 --2- 172.21.15.31:0/411181435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b640737c0 0x7f9b641566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:51.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b62800640 1 --2- 172.21.15.31:0/411181435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b6415af60 0x7f9b640b3ac0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00c7a0 tx=0x7f9b5c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:51.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b5a000640 1 -- 172.21.15.31:0/411181435 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c003b80 con 0x7f9b6415af60 2024-09-17T05:29:51.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b5a000640 1 -- 172.21.15.31:0/411181435 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b5c003d40 con 0x7f9b6415af60 2024-09-17T05:29:51.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b69000640 1 -- 172.21.15.31:0/411181435 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b641647e0 con 0x7f9b6415af60 2024-09-17T05:29:51.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b5a000640 1 -- 172.21.15.31:0/411181435 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c00aab0 con 0x7f9b6415af60 2024-09-17T05:29:51.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.296+0000 7f9b69000640 1 -- 172.21.15.31:0/411181435 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b64165080 con 0x7f9b6415af60 2024-09-17T05:29:51.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.300+0000 7f9b69000640 1 -- 172.21.15.31:0/411181435 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b64164bd0 con 0x7f9b6415af60 2024-09-17T05:29:51.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.300+0000 7f9b5a000640 1 -- 172.21.15.31:0/411181435 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f9b5c00ac50 con 0x7f9b6415af60 2024-09-17T05:29:51.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.300+0000 7f9b5a000640 1 --2- 172.21.15.31:0/411181435 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9b400733b0 0x7f9b40075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:51.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.300+0000 7f9b5a000640 1 -- 172.21.15.31:0/411181435 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f9b5c0941f0 con 0x7f9b6415af60 2024-09-17T05:29:51.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.300+0000 7f9b61e00640 1 --2- 172.21.15.31:0/411181435 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9b400733b0 0x7f9b40075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:51.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.304+0000 7f9b61e00640 1 --2- 172.21.15.31:0/411181435 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9b400733b0 0x7f9b40075870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9b540af000 tx=0x7f9b5401b120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:51.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.304+0000 7f9b5a000640 1 -- 172.21.15.31:0/411181435 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9b5c05f170 con 0x7f9b6415af60 2024-09-17T05:29:51.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.480+0000 7f9b69000640 1 -- 172.21.15.31:0/411181435 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b64073c50 con 0x7f9b6415af60 2024-09-17T05:29:51.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.480+0000 7f9b5a000640 1 -- 172.21.15.31:0/411181435 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13058 (secure 0 0 0) 0x7f9b64073c50 con 0x7f9b6415af60 2024-09-17T05:29:51.487 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:51.488 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":35,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:29:50.118841+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:6836/2317915643":"2024-09-18T05:29:47.070137+0000","172.21.15.155:6834/2317915643":"2024-09-18T05:29:47.070137+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:29:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.484+0000 7f9b69000640 1 -- 172.21.15.31:0/411181435 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9b400733b0 msgr2=0x7f9b40075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.484+0000 7f9b69000640 1 --2- 172.21.15.31:0/411181435 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9b400733b0 0x7f9b40075870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9b540af000 tx=0x7f9b5401b120 comp rx=0 tx=0).stop 2024-09-17T05:29:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.484+0000 7f9b69000640 1 -- 172.21.15.31:0/411181435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b6415af60 msgr2=0x7f9b640b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.484+0000 7f9b69000640 1 --2- 172.21.15.31:0/411181435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b6415af60 0x7f9b640b3ac0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00c7a0 tx=0x7f9b5c00cc60 comp rx=0 tx=0).stop 2024-09-17T05:29:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.484+0000 7f9b69000640 1 -- 172.21.15.31:0/411181435 shutdown_connections 2024-09-17T05:29:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.484+0000 7f9b69000640 1 --2- 172.21.15.31:0/411181435 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9b400733b0 0x7f9b40075870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.484+0000 7f9b69000640 1 --2- 172.21.15.31:0/411181435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b6415af60 0x7f9b640b3ac0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.484+0000 7f9b69000640 1 --2- 172.21.15.31:0/411181435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b64074160 0x7f9b64163e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.484+0000 7f9b69000640 1 --2- 172.21.15.31:0/411181435 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b640737c0 0x7f9b641566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.484+0000 7f9b69000640 1 -- 172.21.15.31:0/411181435 >> 172.21.15.31:0/411181435 conn(0x7f9b640d0c90 msgr2=0x7f9b640ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:51.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.484+0000 7f9b69000640 1 -- 172.21.15.31:0/411181435 shutdown_connections 2024-09-17T05:29:51.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.484+0000 7f9b69000640 1 -- 172.21.15.31:0/411181435 wait complete. 2024-09-17T05:29:51.510 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:28:33.209612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:29:51.510 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:29:51.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb7b800640 1 -- 172.21.15.31:0/3782822977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb740cff20 msgr2=0x7fbb740d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:51.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb7b800640 1 --2- 172.21.15.31:0/3782822977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb740cff20 0x7fbb740d0300 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009840 tx=0x7fbb6401f010 comp rx=0 tx=0).stop 2024-09-17T05:29:51.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb7b800640 1 -- 172.21.15.31:0/3782822977 shutdown_connections 2024-09-17T05:29:51.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb7b800640 1 --2- 172.21.15.31:0/3782822977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb740b2d80 0x7fbb740d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb7b800640 1 --2- 172.21.15.31:0/3782822977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb740cff20 0x7fbb740d0300 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb7b800640 1 -- 172.21.15.31:0/3782822977 >> 172.21.15.31:0/3782822977 conn(0x7fbb740d1dc0 msgr2=0x7fbb740d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:51.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb7b800640 1 -- 172.21.15.31:0/3782822977 shutdown_connections 2024-09-17T05:29:51.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb7b800640 1 -- 172.21.15.31:0/3782822977 wait complete. 2024-09-17T05:29:51.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb7b800640 1 Processor -- start 2024-09-17T05:29:51.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb7b800640 1 -- start start 2024-09-17T05:29:51.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb7b800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb740b14c0 0x7fbb7406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:51.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb7b800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb740b2d80 0x7fbb741e7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:51.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb7b800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb740cff20 0x7fbb741f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:51.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb7b800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbb740af880 con 0x7fbb740b2d80 2024-09-17T05:29:51.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb7b800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbb740af700 con 0x7fbb740b14c0 2024-09-17T05:29:51.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb7b800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbb740afa00 con 0x7fbb740cff20 2024-09-17T05:29:51.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb6be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb740b2d80 0x7fbb741e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:51.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb6be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb740b2d80 0x7fbb741e7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55762/0 (socket says 172.21.15.31:55762) 2024-09-17T05:29:51.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb6be00640 1 -- 172.21.15.31:0/1641504853 learned_addr learned my addr 172.21.15.31:0/1641504853 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:51.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb78e00640 1 --2- 172.21.15.31:0/1641504853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb740b14c0 0x7fbb7406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:51.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb79800640 1 --2- 172.21.15.31:0/1641504853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb740cff20 0x7fbb741f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:51.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb6be00640 1 -- 172.21.15.31:0/1641504853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb740cff20 msgr2=0x7fbb741f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:51.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb6be00640 1 --2- 172.21.15.31:0/1641504853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb740cff20 0x7fbb741f5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb6be00640 1 -- 172.21.15.31:0/1641504853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb740b14c0 msgr2=0x7fbb7406efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:51.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb6be00640 1 --2- 172.21.15.31:0/1641504853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb740b14c0 0x7fbb7406efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb6be00640 1 -- 172.21.15.31:0/1641504853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7406a2e0 con 0x7fbb740b2d80 2024-09-17T05:29:51.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.656+0000 7fbb79800640 1 --2- 172.21.15.31:0/1641504853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb740cff20 0x7fbb741f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:29:51.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.660+0000 7fbb6be00640 1 --2- 172.21.15.31:0/1641504853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb740b2d80 0x7fbb741e7240 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c00e9c0 tx=0x7fbb5c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:51.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.660+0000 7fbb71600640 1 -- 172.21.15.31:0/1641504853 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c00cd80 con 0x7fbb740b2d80 2024-09-17T05:29:51.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.660+0000 7fbb71600640 1 -- 172.21.15.31:0/1641504853 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb5c004020 con 0x7fbb740b2d80 2024-09-17T05:29:51.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.660+0000 7fbb71600640 1 -- 172.21.15.31:0/1641504853 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c004450 con 0x7fbb740b2d80 2024-09-17T05:29:51.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.660+0000 7fbb7b800640 1 -- 172.21.15.31:0/1641504853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb740c8480 con 0x7fbb740b2d80 2024-09-17T05:29:51.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.660+0000 7fbb7b800640 1 -- 172.21.15.31:0/1641504853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb7406e7e0 con 0x7fbb740b2d80 2024-09-17T05:29:51.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.660+0000 7fbb7b800640 1 -- 172.21.15.31:0/1641504853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb740b1940 con 0x7fbb740b2d80 2024-09-17T05:29:51.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.660+0000 7fbb71600640 1 -- 172.21.15.31:0/1641504853 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7fbb5c003600 con 0x7fbb740b2d80 2024-09-17T05:29:51.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.660+0000 7fbb71600640 1 --2- 172.21.15.31:0/1641504853 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbb500733b0 0x7fbb50075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:51.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.660+0000 7fbb71600640 1 -- 172.21.15.31:0/1641504853 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fbb5c094ed0 con 0x7fbb740b2d80 2024-09-17T05:29:51.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.660+0000 7fbb78e00640 1 --2- 172.21.15.31:0/1641504853 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbb500733b0 0x7fbb50075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:51.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.664+0000 7fbb78e00640 1 --2- 172.21.15.31:0/1641504853 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbb500733b0 0x7fbb50075870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbb640b2000 tx=0x7fbb6401d850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:51.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.664+0000 7fbb71600640 1 -- 172.21.15.31:0/1641504853 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fbb5c05fe50 con 0x7fbb740b2d80 2024-09-17T05:29:51.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.840+0000 7fbb7b800640 1 -- 172.21.15.31:0/1641504853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbb74071820 con 0x7fbb740b2d80 2024-09-17T05:29:51.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.840+0000 7fbb71600640 1 -- 172.21.15.31:0/1641504853 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) ==== 93+0+10 (secure 0 0 0) 0x7fbb5c05f750 con 0x7fbb740b2d80 2024-09-17T05:29:51.846 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-09-17T05:29:51.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.844+0000 7fbb7b800640 1 -- 172.21.15.31:0/1641504853 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbb500733b0 msgr2=0x7fbb50075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:51.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.844+0000 7fbb7b800640 1 --2- 172.21.15.31:0/1641504853 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbb500733b0 0x7fbb50075870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbb640b2000 tx=0x7fbb6401d850 comp rx=0 tx=0).stop 2024-09-17T05:29:51.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.844+0000 7fbb7b800640 1 -- 172.21.15.31:0/1641504853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb740b2d80 msgr2=0x7fbb741e7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:51.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.844+0000 7fbb7b800640 1 --2- 172.21.15.31:0/1641504853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb740b2d80 0x7fbb741e7240 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c00e9c0 tx=0x7fbb5c00ee80 comp rx=0 tx=0).stop 2024-09-17T05:29:51.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.844+0000 7fbb7b800640 1 -- 172.21.15.31:0/1641504853 shutdown_connections 2024-09-17T05:29:51.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.844+0000 7fbb7b800640 1 --2- 172.21.15.31:0/1641504853 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbb500733b0 0x7fbb50075870 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.844+0000 7fbb7b800640 1 --2- 172.21.15.31:0/1641504853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb740cff20 0x7fbb741f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.844+0000 7fbb7b800640 1 --2- 172.21.15.31:0/1641504853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb740b2d80 0x7fbb741e7240 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.844+0000 7fbb7b800640 1 --2- 172.21.15.31:0/1641504853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb740b14c0 0x7fbb7406efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:51.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.844+0000 7fbb7b800640 1 -- 172.21.15.31:0/1641504853 >> 172.21.15.31:0/1641504853 conn(0x7fbb740d1dc0 msgr2=0x7fbb740cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:51.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.844+0000 7fbb7b800640 1 -- 172.21.15.31:0/1641504853 shutdown_connections 2024-09-17T05:29:51.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:51.844+0000 7fbb7b800640 1 -- 172.21.15.31:0/1641504853 wait complete. 2024-09-17T05:29:51.868 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2024-09-17T05:29:52.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6fa00640 1 -- 172.21.15.31:0/2660700204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6815bea0 msgr2=0x7f8a680ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:52.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6fa00640 1 --2- 172.21.15.31:0/2660700204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6815bea0 0x7f8a680ce670 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009840 tx=0x7f8a5c01c740 comp rx=0 tx=0).stop 2024-09-17T05:29:52.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6fa00640 1 -- 172.21.15.31:0/2660700204 shutdown_connections 2024-09-17T05:29:52.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6fa00640 1 --2- 172.21.15.31:0/2660700204 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680cdb30 0x7f8a680cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:52.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6fa00640 1 --2- 172.21.15.31:0/2660700204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6815bea0 0x7f8a680ce670 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:52.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6fa00640 1 -- 172.21.15.31:0/2660700204 >> 172.21.15.31:0/2660700204 conn(0x7f8a680d1dc0 msgr2=0x7f8a680d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:52.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6fa00640 1 -- 172.21.15.31:0/2660700204 shutdown_connections 2024-09-17T05:29:52.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6fa00640 1 -- 172.21.15.31:0/2660700204 wait complete. 2024-09-17T05:29:52.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6fa00640 1 Processor -- start 2024-09-17T05:29:52.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6fa00640 1 -- start start 2024-09-17T05:29:52.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6fa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a680cdb30 0x7f8a6809f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:52.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6fa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680d28e0 0x7f8a681f84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:52.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6fa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6815bea0 0x7f8a681f8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:52.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6fa00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8a68168fc0 con 0x7f8a680cdb30 2024-09-17T05:29:52.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6fa00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8a68168e40 con 0x7f8a6815bea0 2024-09-17T05:29:52.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6fa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8a68169140 con 0x7f8a680d28e0 2024-09-17T05:29:52.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6d000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a680cdb30 0x7f8a6809f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:52.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6d000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a680cdb30 0x7f8a6809f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55774/0 (socket says 172.21.15.31:55774) 2024-09-17T05:29:52.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6d000640 1 -- 172.21.15.31:0/1232077530 learned_addr learned my addr 172.21.15.31:0/1232077530 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:52.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6d000640 1 -- 172.21.15.31:0/1232077530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680d28e0 msgr2=0x7f8a681f84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:52.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a67e00640 1 --2- 172.21.15.31:0/1232077530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680d28e0 0x7f8a681f84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:52.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6da00640 1 --2- 172.21.15.31:0/1232077530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6815bea0 0x7f8a681f8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:52.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6d000640 1 --2- 172.21.15.31:0/1232077530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680d28e0 0x7f8a681f84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:52.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6d000640 1 -- 172.21.15.31:0/1232077530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6815bea0 msgr2=0x7f8a681f8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:52.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6d000640 1 --2- 172.21.15.31:0/1232077530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6815bea0 0x7f8a681f8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:52.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6d000640 1 -- 172.21.15.31:0/1232077530 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a680b5e80 con 0x7f8a680cdb30 2024-09-17T05:29:52.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a67e00640 1 --2- 172.21.15.31:0/1232077530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680d28e0 0x7f8a681f84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:29:52.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.012+0000 7f8a6da00640 1 --2- 172.21.15.31:0/1232077530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6815bea0 0x7f8a681f8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:29:52.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.016+0000 7f8a6d000640 1 --2- 172.21.15.31:0/1232077530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a680cdb30 0x7f8a6809f3d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c01c570 tx=0x7f8a5c005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:52.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.016+0000 7f8a64c00640 1 -- 172.21.15.31:0/1232077530 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0ac030 con 0x7f8a680cdb30 2024-09-17T05:29:52.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.016+0000 7f8a64c00640 1 -- 172.21.15.31:0/1232077530 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a5c004ac0 con 0x7f8a680cdb30 2024-09-17T05:29:52.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.016+0000 7f8a6fa00640 1 -- 172.21.15.31:0/1232077530 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a680b6160 con 0x7f8a680cdb30 2024-09-17T05:29:52.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.016+0000 7f8a64c00640 1 -- 172.21.15.31:0/1232077530 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0a6700 con 0x7f8a680cdb30 2024-09-17T05:29:52.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.016+0000 7f8a6fa00640 1 -- 172.21.15.31:0/1232077530 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a680b6720 con 0x7f8a680cdb30 2024-09-17T05:29:52.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.016+0000 7f8a6fa00640 1 -- 172.21.15.31:0/1232077530 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a680cc9d0 con 0x7f8a680cdb30 2024-09-17T05:29:52.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.016+0000 7f8a64c00640 1 -- 172.21.15.31:0/1232077530 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f8a5c0af070 con 0x7f8a680cdb30 2024-09-17T05:29:52.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.016+0000 7f8a64c00640 1 --2- 172.21.15.31:0/1232077530 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8a480733b0 0x7f8a48075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:52.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.016+0000 7f8a64c00640 1 -- 172.21.15.31:0/1232077530 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f8a5c12e260 con 0x7f8a680cdb30 2024-09-17T05:29:52.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.020+0000 7f8a67e00640 1 --2- 172.21.15.31:0/1232077530 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8a480733b0 0x7f8a48075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:52.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.020+0000 7f8a67e00640 1 --2- 172.21.15.31:0/1232077530 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8a480733b0 0x7f8a48075870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8a681572c0 tx=0x7f8a540091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:52.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.020+0000 7f8a64c00640 1 -- 172.21.15.31:0/1232077530 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8a5c016330 con 0x7f8a680cdb30 2024-09-17T05:29:52.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:52.260+0000 7f8a6fa00640 1 -- 172.21.15.31:0/1232077530 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) -- 0x7f8a680762f0 con 0x7f8a680cdb30 2024-09-17T05:29:53.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.128+0000 7f8a64c00640 1 -- 172.21.15.31:0/1232077530 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v87) ==== 143+0+0 (secure 0 0 0) 0x7f8a5c0f9270 con 0x7f8a680cdb30 2024-09-17T05:29:53.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.132+0000 7f8a6fa00640 1 -- 172.21.15.31:0/1232077530 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8a480733b0 msgr2=0x7f8a48075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:53.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.132+0000 7f8a6fa00640 1 --2- 172.21.15.31:0/1232077530 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8a480733b0 0x7f8a48075870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8a681572c0 tx=0x7f8a540091e0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.132+0000 7f8a6fa00640 1 -- 172.21.15.31:0/1232077530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a680cdb30 msgr2=0x7f8a6809f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:53.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.132+0000 7f8a6fa00640 1 --2- 172.21.15.31:0/1232077530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a680cdb30 0x7f8a6809f3d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c01c570 tx=0x7f8a5c005750 comp rx=0 tx=0).stop 2024-09-17T05:29:53.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.132+0000 7f8a6fa00640 1 -- 172.21.15.31:0/1232077530 shutdown_connections 2024-09-17T05:29:53.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.132+0000 7f8a6fa00640 1 --2- 172.21.15.31:0/1232077530 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8a480733b0 0x7f8a48075870 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.132+0000 7f8a6fa00640 1 --2- 172.21.15.31:0/1232077530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6815bea0 0x7f8a681f8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.132+0000 7f8a6fa00640 1 --2- 172.21.15.31:0/1232077530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a680d28e0 0x7f8a681f84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.132+0000 7f8a6fa00640 1 --2- 172.21.15.31:0/1232077530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a680cdb30 0x7f8a6809f3d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.132+0000 7f8a6fa00640 1 -- 172.21.15.31:0/1232077530 >> 172.21.15.31:0/1232077530 conn(0x7f8a680d1dc0 msgr2=0x7f8a68071420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:53.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.132+0000 7f8a6fa00640 1 -- 172.21.15.31:0/1232077530 shutdown_connections 2024-09-17T05:29:53.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.132+0000 7f8a6fa00640 1 -- 172.21.15.31:0/1232077530 wait complete. 2024-09-17T05:29:53.162 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:29:53.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.308+0000 7f3c4aa00640 1 -- 172.21.15.31:0/1909498571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c4406f1d0 msgr2=0x7f3c440d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:53.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.308+0000 7f3c4aa00640 1 --2- 172.21.15.31:0/1909498571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c4406f1d0 0x7f3c440d0960 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3c44072dd0 tx=0x7f3c3c01caf0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.308+0000 7f3c4aa00640 1 -- 172.21.15.31:0/1909498571 shutdown_connections 2024-09-17T05:29:53.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.308+0000 7f3c4aa00640 1 --2- 172.21.15.31:0/1909498571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c4406f1d0 0x7f3c440d0960 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.308+0000 7f3c4aa00640 1 --2- 172.21.15.31:0/1909498571 >> v2:172.21.15.155:3300/0 conn(0x7f3c44159990 0x7f3c440d0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.308+0000 7f3c4aa00640 1 -- 172.21.15.31:0/1909498571 >> 172.21.15.31:0/1909498571 conn(0x7f3c440b2240 msgr2=0x7f3c440b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:53.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.308+0000 7f3c4aa00640 1 -- 172.21.15.31:0/1909498571 shutdown_connections 2024-09-17T05:29:53.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.308+0000 7f3c4aa00640 1 -- 172.21.15.31:0/1909498571 wait complete. 2024-09-17T05:29:53.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.308+0000 7f3c4aa00640 1 Processor -- start 2024-09-17T05:29:53.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.308+0000 7f3c4aa00640 1 -- start start 2024-09-17T05:29:53.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c4aa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c4406f1d0 0x7f3c44153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:53.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c4aa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c440afac0 0x7f3c44158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:53.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c4aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c44159990 0x7f3c4414fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:53.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c4aa00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3c441691e0 con 0x7f3c44159990 2024-09-17T05:29:53.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c4aa00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3c44169060 con 0x7f3c440afac0 2024-09-17T05:29:53.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c4aa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3c44169360 con 0x7f3c4406f1d0 2024-09-17T05:29:53.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c48a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c44159990 0x7f3c4414fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:53.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c48a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c44159990 0x7f3c4414fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55790/0 (socket says 172.21.15.31:55790) 2024-09-17T05:29:53.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c48a00640 1 -- 172.21.15.31:0/2991307330 learned_addr learned my addr 172.21.15.31:0/2991307330 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:53.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c43e00640 1 --2- 172.21.15.31:0/2991307330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c4406f1d0 0x7f3c44153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:53.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c3b400640 1 --2- 172.21.15.31:0/2991307330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c440afac0 0x7f3c44158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:53.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c48a00640 1 -- 172.21.15.31:0/2991307330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c4406f1d0 msgr2=0x7f3c44153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:53.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c48a00640 1 --2- 172.21.15.31:0/2991307330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c4406f1d0 0x7f3c44153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c48a00640 1 -- 172.21.15.31:0/2991307330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c440afac0 msgr2=0x7f3c44158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:53.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c48a00640 1 --2- 172.21.15.31:0/2991307330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c440afac0 0x7f3c44158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c48a00640 1 -- 172.21.15.31:0/2991307330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4415f050 con 0x7f3c44159990 2024-09-17T05:29:53.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c48a00640 1 --2- 172.21.15.31:0/2991307330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c44159990 0x7f3c4414fc70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009b10 tx=0x7f3c3c0a5810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:53.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c40c00640 1 -- 172.21.15.31:0/2991307330 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0bb070 con 0x7f3c44159990 2024-09-17T05:29:53.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c40c00640 1 -- 172.21.15.31:0/2991307330 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c3c004d40 con 0x7f3c44159990 2024-09-17T05:29:53.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c40c00640 1 -- 172.21.15.31:0/2991307330 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0b2040 con 0x7f3c44159990 2024-09-17T05:29:53.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c4aa00640 1 -- 172.21.15.31:0/2991307330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c44157cd0 con 0x7f3c44159990 2024-09-17T05:29:53.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c4aa00640 1 -- 172.21.15.31:0/2991307330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c44158570 con 0x7f3c44159990 2024-09-17T05:29:53.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.312+0000 7f3c4aa00640 1 -- 172.21.15.31:0/2991307330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c4406cc20 con 0x7f3c44159990 2024-09-17T05:29:53.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.316+0000 7f3c40c00640 1 -- 172.21.15.31:0/2991307330 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f3c3c0a5980 con 0x7f3c44159990 2024-09-17T05:29:53.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.316+0000 7f3c40c00640 1 --2- 172.21.15.31:0/2991307330 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3c200733b0 0x7f3c20075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:53.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.316+0000 7f3c40c00640 1 -- 172.21.15.31:0/2991307330 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f3c3c12e0b0 con 0x7f3c44159990 2024-09-17T05:29:53.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.316+0000 7f3c43e00640 1 --2- 172.21.15.31:0/2991307330 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3c200733b0 0x7f3c20075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:53.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.316+0000 7f3c43e00640 1 --2- 172.21.15.31:0/2991307330 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3c200733b0 0x7f3c20075870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400bc00 tx=0x7f3c3400b390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:53.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.320+0000 7f3c40c00640 1 -- 172.21.15.31:0/2991307330 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f3c3c016770 con 0x7f3c44159990 2024-09-17T05:29:53.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.496+0000 7f3c4aa00640 1 -- 172.21.15.31:0/2991307330 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f3c44157ea0 con 0x7f3c44159990 2024-09-17T05:29:53.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.496+0000 7f3c40c00640 1 -- 172.21.15.31:0/2991307330 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v29) ==== 59+0+1998 (secure 0 0 0) 0x7f3c3c0f8a90 con 0x7f3c44159990 2024-09-17T05:29:53.502 INFO:teuthology.orchestra.run.smithi031.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:29:53.502 INFO:teuthology.orchestra.run.smithi031.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:29:53.502 INFO:teuthology.orchestra.run.smithi031.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:29:53.502 INFO:teuthology.orchestra.run.smithi031.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:29:53.502 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6159.333103 2024-09-17T05:29:53.502 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4566.558105 2024-09-17T05:29:53.503 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4575.968427 2024-09-17T05:29:53.503 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4702.806393 2024-09-17T05:29:53.503 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4956.728274 2024-09-17T05:29:53.503 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 6604.257199 2024-09-17T05:29:53.503 INFO:teuthology.orchestra.run.smithi031.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4779.165073 2024-09-17T05:29:53.503 INFO:teuthology.orchestra.run.smithi031.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4673.795919 2024-09-17T05:29:53.503 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds 20/20 2024-09-17T05:29:53.503 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:29:53.504 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_ms 2/2 2024-09-17T05:29:53.504 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_frag true 2024-09-17T05:29:53.504 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:29:53.504 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:29:53.504 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_verify_scatter true 2024-09-17T05:29:53.504 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:29:53.504 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:29:53.504 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:29:53.505 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced client_mount_timeout 600 2024-09-17T05:29:53.505 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_client 20/20 2024-09-17T05:29:53.505 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_ms 1/1 2024-09-17T05:29:53.505 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:29:53.505 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:29:53.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.500+0000 7f3c4aa00640 1 -- 172.21.15.31:0/2991307330 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3c200733b0 msgr2=0x7f3c20075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:53.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.500+0000 7f3c4aa00640 1 --2- 172.21.15.31:0/2991307330 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3c200733b0 0x7f3c20075870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400bc00 tx=0x7f3c3400b390 comp rx=0 tx=0).stop 2024-09-17T05:29:53.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.500+0000 7f3c4aa00640 1 -- 172.21.15.31:0/2991307330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c44159990 msgr2=0x7f3c4414fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:53.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.500+0000 7f3c4aa00640 1 --2- 172.21.15.31:0/2991307330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c44159990 0x7f3c4414fc70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009b10 tx=0x7f3c3c0a5810 comp rx=0 tx=0).stop 2024-09-17T05:29:53.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.500+0000 7f3c4aa00640 1 -- 172.21.15.31:0/2991307330 shutdown_connections 2024-09-17T05:29:53.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.500+0000 7f3c4aa00640 1 --2- 172.21.15.31:0/2991307330 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3c200733b0 0x7f3c20075870 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.500+0000 7f3c4aa00640 1 --2- 172.21.15.31:0/2991307330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c44159990 0x7f3c4414fc70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.500+0000 7f3c4aa00640 1 --2- 172.21.15.31:0/2991307330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c440afac0 0x7f3c44158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.500+0000 7f3c4aa00640 1 --2- 172.21.15.31:0/2991307330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c4406f1d0 0x7f3c44153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.500+0000 7f3c4aa00640 1 -- 172.21.15.31:0/2991307330 >> 172.21.15.31:0/2991307330 conn(0x7f3c440b2240 msgr2=0x7f3c44152fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:53.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.500+0000 7f3c4aa00640 1 -- 172.21.15.31:0/2991307330 shutdown_connections 2024-09-17T05:29:53.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.500+0000 7f3c4aa00640 1 -- 172.21.15.31:0/2991307330 wait complete. 2024-09-17T05:29:53.523 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:29:53.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.668+0000 7fbbebc00640 1 -- 172.21.15.31:0/2438235917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbe415be10 msgr2=0x7fbbe41602f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:53.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.668+0000 7fbbebc00640 1 --2- 172.21.15.31:0/2438235917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbe415be10 0x7fbbe41602f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4073720 tx=0x7fbbd401c8c0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.668+0000 7fbbebc00640 1 -- 172.21.15.31:0/2438235917 shutdown_connections 2024-09-17T05:29:53.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.668+0000 7fbbebc00640 1 --2- 172.21.15.31:0/2438235917 >> v2:172.21.15.155:3300/0 conn(0x7fbbe406cc20 0x7fbbe406d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.668+0000 7fbbebc00640 1 --2- 172.21.15.31:0/2438235917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbe415be10 0x7fbbe41602f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.668+0000 7fbbebc00640 1 -- 172.21.15.31:0/2438235917 >> 172.21.15.31:0/2438235917 conn(0x7fbbe40cd740 msgr2=0x7fbbe40cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:53.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.668+0000 7fbbebc00640 1 -- 172.21.15.31:0/2438235917 shutdown_connections 2024-09-17T05:29:53.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.668+0000 7fbbebc00640 1 -- 172.21.15.31:0/2438235917 wait complete. 2024-09-17T05:29:53.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.668+0000 7fbbebc00640 1 Processor -- start 2024-09-17T05:29:53.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.668+0000 7fbbebc00640 1 -- start start 2024-09-17T05:29:53.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbebc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbe406cc20 0x7fbbe40c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:53.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbebc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbe40cbeb0 0x7fbbe4151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:53.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbebc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbe415be10 0x7fbbe4150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:53.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbebc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe4168f40 con 0x7fbbe40cbeb0 2024-09-17T05:29:53.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbebc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe4168dc0 con 0x7fbbe415be10 2024-09-17T05:29:53.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbebc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe41690c0 con 0x7fbbe406cc20 2024-09-17T05:29:53.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbdbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbe40cbeb0 0x7fbbe4151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:53.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbdbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbe40cbeb0 0x7fbbe4151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55804/0 (socket says 172.21.15.31:55804) 2024-09-17T05:29:53.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbdbe00640 1 -- 172.21.15.31:0/2830828971 learned_addr learned my addr 172.21.15.31:0/2830828971 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:53.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbe9200640 1 --2- 172.21.15.31:0/2830828971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbe406cc20 0x7fbbe40c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:53.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbe9c00640 1 --2- 172.21.15.31:0/2830828971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbe415be10 0x7fbbe4150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:53.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbdbe00640 1 -- 172.21.15.31:0/2830828971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbe406cc20 msgr2=0x7fbbe40c3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:53.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbdbe00640 1 --2- 172.21.15.31:0/2830828971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbe406cc20 0x7fbbe40c3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbdbe00640 1 -- 172.21.15.31:0/2830828971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbe415be10 msgr2=0x7fbbe4150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:53.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbdbe00640 1 --2- 172.21.15.31:0/2830828971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbe415be10 0x7fbbe4150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbdbe00640 1 -- 172.21.15.31:0/2830828971 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe40c4050 con 0x7fbbe40cbeb0 2024-09-17T05:29:53.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbe9200640 1 --2- 172.21.15.31:0/2830828971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbe406cc20 0x7fbbe40c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:53.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbe9c00640 1 --2- 172.21.15.31:0/2830828971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbe415be10 0x7fbbe4150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:29:53.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbdbe00640 1 --2- 172.21.15.31:0/2830828971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbe40cbeb0 0x7fbbe4151750 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00c480 tx=0x7fbbcc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:53.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbe1600640 1 -- 172.21.15.31:0/2830828971 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc012830 con 0x7fbbe40cbeb0 2024-09-17T05:29:53.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbe1600640 1 -- 172.21.15.31:0/2830828971 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbcc017070 con 0x7fbbe40cbeb0 2024-09-17T05:29:53.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbebc00640 1 -- 172.21.15.31:0/2830828971 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe4158530 con 0x7fbbe40cbeb0 2024-09-17T05:29:53.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbe1600640 1 -- 172.21.15.31:0/2830828971 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc012d80 con 0x7fbbe40cbeb0 2024-09-17T05:29:53.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbebc00640 1 -- 172.21.15.31:0/2830828971 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe40d03f0 con 0x7fbbe40cbeb0 2024-09-17T05:29:53.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.672+0000 7fbbebc00640 1 -- 172.21.15.31:0/2830828971 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe406d090 con 0x7fbbe40cbeb0 2024-09-17T05:29:53.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.676+0000 7fbbe1600640 1 -- 172.21.15.31:0/2830828971 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7fbbcc01c460 con 0x7fbbe40cbeb0 2024-09-17T05:29:53.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.676+0000 7fbbe1600640 1 --2- 172.21.15.31:0/2830828971 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbbc00733e0 0x7fbbc00758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:53.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.676+0000 7fbbe1600640 1 -- 172.21.15.31:0/2830828971 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fbbcc0940c0 con 0x7fbbe40cbeb0 2024-09-17T05:29:53.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.676+0000 7fbbe9200640 1 --2- 172.21.15.31:0/2830828971 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbbc00733e0 0x7fbbc00758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:53.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.676+0000 7fbbe9200640 1 --2- 172.21.15.31:0/2830828971 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbbc00733e0 0x7fbbc00758a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40af000 tx=0x7fbbd401b100 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:53.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.680+0000 7fbbe1600640 1 -- 172.21.15.31:0/2830828971 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fbbcc05f0d0 con 0x7fbbe40cbeb0 2024-09-17T05:29:53.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.856+0000 7fbbebc00640 1 -- 172.21.15.31:0/2830828971 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fbbe4158a50 con 0x7fbbe40cbeb0 2024-09-17T05:29:53.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.860+0000 7fbbe1600640 1 -- 172.21.15.31:0/2830828971 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7fbbcc05e9d0 con 0x7fbbe40cbeb0 2024-09-17T05:29:53.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.860+0000 7fbbebc00640 1 -- 172.21.15.31:0/2830828971 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbbc00733e0 msgr2=0x7fbbc00758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:53.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.860+0000 7fbbebc00640 1 --2- 172.21.15.31:0/2830828971 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbbc00733e0 0x7fbbc00758a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40af000 tx=0x7fbbd401b100 comp rx=0 tx=0).stop 2024-09-17T05:29:53.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.860+0000 7fbbebc00640 1 -- 172.21.15.31:0/2830828971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbe40cbeb0 msgr2=0x7fbbe4151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:53.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.860+0000 7fbbebc00640 1 --2- 172.21.15.31:0/2830828971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbe40cbeb0 0x7fbbe4151750 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00c480 tx=0x7fbbcc00c940 comp rx=0 tx=0).stop 2024-09-17T05:29:53.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.860+0000 7fbbebc00640 1 -- 172.21.15.31:0/2830828971 shutdown_connections 2024-09-17T05:29:53.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.860+0000 7fbbebc00640 1 --2- 172.21.15.31:0/2830828971 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbbc00733e0 0x7fbbc00758a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.860+0000 7fbbebc00640 1 --2- 172.21.15.31:0/2830828971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbe415be10 0x7fbbe4150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.860+0000 7fbbebc00640 1 --2- 172.21.15.31:0/2830828971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbbe40cbeb0 0x7fbbe4151750 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.860+0000 7fbbebc00640 1 --2- 172.21.15.31:0/2830828971 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbe406cc20 0x7fbbe40c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:53.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.860+0000 7fbbebc00640 1 -- 172.21.15.31:0/2830828971 >> 172.21.15.31:0/2830828971 conn(0x7fbbe40cd740 msgr2=0x7fbbe41520d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:53.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.860+0000 7fbbebc00640 1 -- 172.21.15.31:0/2830828971 shutdown_connections 2024-09-17T05:29:53.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:53.860+0000 7fbbebc00640 1 -- 172.21.15.31:0/2830828971 wait complete. 2024-09-17T05:29:53.887 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:29:53.887 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:29:53.969 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:29:54.059 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:29:54.059 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:29:54.059 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:54.068 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:29:54.068 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:29:54.068 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:54.077 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:29:54.078 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:29:54.078 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:54.124 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:29:54.124 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:29:54.124 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:29:54.132 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:29:54.132 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:29:54.133 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:29:54.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.308+0000 7ff5b3600640 1 -- 172.21.15.31:0/149716585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5ac15bea0 msgr2=0x7ff5ac0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:54.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.308+0000 7ff5b3600640 1 --2- 172.21.15.31:0/149716585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5ac15bea0 0x7ff5ac0ce670 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff59c009840 tx=0x7ff59c01c820 comp rx=0 tx=0).stop 2024-09-17T05:29:54.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.308+0000 7ff5b3600640 1 -- 172.21.15.31:0/149716585 shutdown_connections 2024-09-17T05:29:54.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.308+0000 7ff5b3600640 1 --2- 172.21.15.31:0/149716585 >> v2:172.21.15.155:3300/0 conn(0x7ff5ac0d28e0 0x7ff5ac0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:54.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.308+0000 7ff5b3600640 1 --2- 172.21.15.31:0/149716585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5ac15bea0 0x7ff5ac0ce670 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:54.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.308+0000 7ff5b3600640 1 -- 172.21.15.31:0/149716585 >> 172.21.15.31:0/149716585 conn(0x7ff5ac0d1dc0 msgr2=0x7ff5ac0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:54.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.308+0000 7ff5b3600640 1 -- 172.21.15.31:0/149716585 shutdown_connections 2024-09-17T05:29:54.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.308+0000 7ff5b3600640 1 -- 172.21.15.31:0/149716585 wait complete. 2024-09-17T05:29:54.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5b3600640 1 Processor -- start 2024-09-17T05:29:54.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5b3600640 1 -- start start 2024-09-17T05:29:54.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5b3600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5ac0cdb30 0x7ff5ac14d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:54.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5b3600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5ac0d28e0 0x7ff5ac09e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:54.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5b3600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5ac15bea0 0x7ff5ac0b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:54.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5b3600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ac168fc0 con 0x7ff5ac0d28e0 2024-09-17T05:29:54.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5b3600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ac168e40 con 0x7ff5ac0cdb30 2024-09-17T05:29:54.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5b3600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff5ac169140 con 0x7ff5ac15bea0 2024-09-17T05:29:54.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5a3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5ac0d28e0 0x7ff5ac09e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:54.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5a3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5ac0d28e0 0x7ff5ac09e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55810/0 (socket says 172.21.15.31:55810) 2024-09-17T05:29:54.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5a3e00640 1 -- 172.21.15.31:0/3583803331 learned_addr learned my addr 172.21.15.31:0/3583803331 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:29:54.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5b0c00640 1 --2- 172.21.15.31:0/3583803331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5ac0cdb30 0x7ff5ac14d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:54.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5b1600640 1 --2- 172.21.15.31:0/3583803331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5ac15bea0 0x7ff5ac0b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:54.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5a3e00640 1 -- 172.21.15.31:0/3583803331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5ac15bea0 msgr2=0x7ff5ac0b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:54.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5a3e00640 1 --2- 172.21.15.31:0/3583803331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5ac15bea0 0x7ff5ac0b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:54.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5a3e00640 1 -- 172.21.15.31:0/3583803331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5ac0cdb30 msgr2=0x7ff5ac14d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:54.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5a3e00640 1 --2- 172.21.15.31:0/3583803331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5ac0cdb30 0x7ff5ac14d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:54.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5a3e00640 1 -- 172.21.15.31:0/3583803331 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5ac1f7890 con 0x7ff5ac0d28e0 2024-09-17T05:29:54.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5a3e00640 1 --2- 172.21.15.31:0/3583803331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5ac0d28e0 0x7ff5ac09e1b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff59400c4c0 tx=0x7ff59400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:54.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5a9600640 1 -- 172.21.15.31:0/3583803331 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff594011790 con 0x7ff5ac0d28e0 2024-09-17T05:29:54.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5a9600640 1 -- 172.21.15.31:0/3583803331 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff594017070 con 0x7ff5ac0d28e0 2024-09-17T05:29:54.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5b3600640 1 -- 172.21.15.31:0/3583803331 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5ac1fb310 con 0x7ff5ac0d28e0 2024-09-17T05:29:54.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5a9600640 1 -- 172.21.15.31:0/3583803331 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff594011ce0 con 0x7ff5ac0d28e0 2024-09-17T05:29:54.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.312+0000 7ff5b3600640 1 -- 172.21.15.31:0/3583803331 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5ac1fb8d0 con 0x7ff5ac0d28e0 2024-09-17T05:29:54.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.316+0000 7ff5b3600640 1 -- 172.21.15.31:0/3583803331 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5ac0cc9d0 con 0x7ff5ac0d28e0 2024-09-17T05:29:54.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.316+0000 7ff5a9600640 1 -- 172.21.15.31:0/3583803331 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7ff59401c460 con 0x7ff5ac0d28e0 2024-09-17T05:29:54.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.316+0000 7ff5a9600640 1 --2- 172.21.15.31:0/3583803331 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff5880733b0 0x7ff588075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:29:54.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.316+0000 7ff5a9600640 1 -- 172.21.15.31:0/3583803331 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7ff594093ff0 con 0x7ff5ac0d28e0 2024-09-17T05:29:54.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.316+0000 7ff5b0c00640 1 --2- 172.21.15.31:0/3583803331 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff5880733b0 0x7ff588075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:29:54.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.316+0000 7ff5b0c00640 1 --2- 172.21.15.31:0/3583803331 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff5880733b0 0x7ff588075870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0af000 tx=0x7ff59c01b060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:29:54.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.320+0000 7ff5a9600640 1 -- 172.21.15.31:0/3583803331 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff59405f100 con 0x7ff5ac0d28e0 2024-09-17T05:29:54.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.532+0000 7ff5b3600640 1 -- 172.21.15.31:0/3583803331 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5ac0af7a0 con 0x7ff5ac0d28e0 2024-09-17T05:29:54.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.532+0000 7ff5a9600640 1 -- 172.21.15.31:0/3583803331 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3917 (secure 0 0 0) 0x7ff59405ea00 con 0x7ff5ac0d28e0 2024-09-17T05:29:54.538 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:29:54.538 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"btime":"2024-09-17T05:29:48:105722+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3266973645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3266973645},{"type":"v1","addr":"172.21.15.155:6837","nonce":3266973645}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4673,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3624429107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3624429107},{"type":"v1","addr":"172.21.15.31:6835","nonce":3624429107}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4878,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1163918742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1163918742},{"type":"v1","addr":"172.21.15.31:6834","nonce":1163918742}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5128,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/3360673633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3360673633},{"type":"v1","addr":"172.21.15.155:6836","nonce":3360673633}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-09-17T05:29:54.538 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 20 2024-09-17T05:29:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.536+0000 7ff5b3600640 1 -- 172.21.15.31:0/3583803331 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff5880733b0 msgr2=0x7ff588075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.536+0000 7ff5b3600640 1 --2- 172.21.15.31:0/3583803331 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff5880733b0 0x7ff588075870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0af000 tx=0x7ff59c01b060 comp rx=0 tx=0).stop 2024-09-17T05:29:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.536+0000 7ff5b3600640 1 -- 172.21.15.31:0/3583803331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5ac0d28e0 msgr2=0x7ff5ac09e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:29:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.536+0000 7ff5b3600640 1 --2- 172.21.15.31:0/3583803331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5ac0d28e0 0x7ff5ac09e1b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff59400c4c0 tx=0x7ff59400c8c0 comp rx=0 tx=0).stop 2024-09-17T05:29:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.536+0000 7ff5b3600640 1 -- 172.21.15.31:0/3583803331 shutdown_connections 2024-09-17T05:29:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.536+0000 7ff5b3600640 1 --2- 172.21.15.31:0/3583803331 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff5880733b0 0x7ff588075870 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.536+0000 7ff5b3600640 1 --2- 172.21.15.31:0/3583803331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5ac15bea0 0x7ff5ac0b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:54.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.536+0000 7ff5b3600640 1 --2- 172.21.15.31:0/3583803331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5ac0d28e0 0x7ff5ac09e1b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:54.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.536+0000 7ff5b3600640 1 --2- 172.21.15.31:0/3583803331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5ac0cdb30 0x7ff5ac14d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:29:54.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.536+0000 7ff5b3600640 1 -- 172.21.15.31:0/3583803331 >> 172.21.15.31:0/3583803331 conn(0x7ff5ac0d1dc0 msgr2=0x7ff5ac06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:29:54.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.536+0000 7ff5b3600640 1 -- 172.21.15.31:0/3583803331 shutdown_connections 2024-09-17T05:29:54.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:29:54.536+0000 7ff5b3600640 1 -- 172.21.15.31:0/3583803331 wait complete. 2024-09-17T05:29:54.560 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:29:54.560 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:29:54.560 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:29:54.560 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:29:54.560 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:29:54.561 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:29:54.561 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:29:54.561 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:29:54.561 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:29:54.561 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:29:54.561 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:29:54.561 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:29:54.561 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:29:54.562 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:29:54.562 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:29:54.562 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:29:54.577 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:29:54.580 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:29:54.581 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:29:54.581 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:29:54.582 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:29:54.582 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:29:54.626 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:29:54.626 DEBUG:teuthology.parallel:result is None 2024-09-17T05:29:54.627 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:29:54.627 DEBUG:teuthology.parallel:result is None 2024-09-17T05:29:54.627 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:29:54.628 DEBUG:teuthology.parallel:result is None 2024-09-17T05:29:54.712 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-17T05:29:54.712 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-17T05:29:54.713 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-17T05:29:56.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-17T05:30:00.577 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:30:00.577 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:30:00.581 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:30:00.581 DEBUG:teuthology.parallel:result is None 2024-09-17T05:30:00.582 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:30:00.671 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-17T05:30:00.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.736+0000 7fa0d5a00640 1 -- 172.21.15.31:0/670431267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0d015bdb0 msgr2=0x7fa0d00d27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:00.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.736+0000 7fa0d5a00640 1 --2- 172.21.15.31:0/670431267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0d015bdb0 0x7fa0d00d27f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009840 tx=0x7fa0c001f010 comp rx=0 tx=0).stop 2024-09-17T05:30:00.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.736+0000 7fa0d5a00640 1 -- 172.21.15.31:0/670431267 shutdown_connections 2024-09-17T05:30:00.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.736+0000 7fa0d5a00640 1 --2- 172.21.15.31:0/670431267 >> v2:172.21.15.155:3300/0 conn(0x7fa0d015f8a0 0x7fa0d015fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:00.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.736+0000 7fa0d5a00640 1 --2- 172.21.15.31:0/670431267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0d015bdb0 0x7fa0d00d27f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:00.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.736+0000 7fa0d5a00640 1 -- 172.21.15.31:0/670431267 >> 172.21.15.31:0/670431267 conn(0x7fa0d00d1c40 msgr2=0x7fa0d00d2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:00.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.736+0000 7fa0d5a00640 1 -- 172.21.15.31:0/670431267 shutdown_connections 2024-09-17T05:30:00.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.736+0000 7fa0d5a00640 1 -- 172.21.15.31:0/670431267 wait complete. 2024-09-17T05:30:00.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.736+0000 7fa0d5a00640 1 Processor -- start 2024-09-17T05:30:00.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.736+0000 7fa0d5a00640 1 -- start start 2024-09-17T05:30:00.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0d5a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0d00d0670 0x7fa0d015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:00.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0d5a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d015bdb0 0x7fa0d00cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:00.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0d5a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0d015f8a0 0x7fa0d00c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:00.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0d5a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d00b4e00 con 0x7fa0d015f8a0 2024-09-17T05:30:00.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0d5a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d00b4c80 con 0x7fa0d015bdb0 2024-09-17T05:30:00.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0d5a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa0d00b4f80 con 0x7fa0d00d0670 2024-09-17T05:30:00.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0d5000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0d015f8a0 0x7fa0d00c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:00.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0d5000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0d015f8a0 0x7fa0d00c98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38652/0 (socket says 172.21.15.31:38652) 2024-09-17T05:30:00.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0d5000640 1 -- 172.21.15.31:0/4150409085 learned_addr learned my addr 172.21.15.31:0/4150409085 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:00.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0c7e00640 1 --2- 172.21.15.31:0/4150409085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d015bdb0 0x7fa0d00cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:00.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0cfe00640 1 --2- 172.21.15.31:0/4150409085 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0d00d0670 0x7fa0d015aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:00.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0d5000640 1 -- 172.21.15.31:0/4150409085 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0d00d0670 msgr2=0x7fa0d015aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:00.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0d5000640 1 --2- 172.21.15.31:0/4150409085 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0d00d0670 0x7fa0d015aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:00.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0d5000640 1 -- 172.21.15.31:0/4150409085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d015bdb0 msgr2=0x7fa0d00cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:00.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0d5000640 1 --2- 172.21.15.31:0/4150409085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d015bdb0 0x7fa0d00cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:00.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0d5000640 1 -- 172.21.15.31:0/4150409085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d015e0a0 con 0x7fa0d015f8a0 2024-09-17T05:30:00.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0d5000640 1 --2- 172.21.15.31:0/4150409085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0d015f8a0 0x7fa0d00c98b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800eab0 tx=0x7fa0c800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:00.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0ccc00640 1 -- 172.21.15.31:0/4150409085 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c800cea0 con 0x7fa0d015f8a0 2024-09-17T05:30:00.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0ccc00640 1 -- 172.21.15.31:0/4150409085 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0c8004b30 con 0x7fa0d015f8a0 2024-09-17T05:30:00.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0ccc00640 1 -- 172.21.15.31:0/4150409085 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8005020 con 0x7fa0d015f8a0 2024-09-17T05:30:00.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0d5a00640 1 -- 172.21.15.31:0/4150409085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0d015e380 con 0x7fa0d015f8a0 2024-09-17T05:30:00.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0d5a00640 1 -- 172.21.15.31:0/4150409085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0d015e940 con 0x7fa0d015f8a0 2024-09-17T05:30:00.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.740+0000 7fa0d5a00640 1 -- 172.21.15.31:0/4150409085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0d00b5510 con 0x7fa0d015f8a0 2024-09-17T05:30:00.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.744+0000 7fa0ccc00640 1 -- 172.21.15.31:0/4150409085 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7fa0c80051c0 con 0x7fa0d015f8a0 2024-09-17T05:30:00.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.744+0000 7fa0ccc00640 1 --2- 172.21.15.31:0/4150409085 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa0ac0733b0 0x7fa0ac075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:00.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.744+0000 7fa0ccc00640 1 -- 172.21.15.31:0/4150409085 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fa0c8094dc0 con 0x7fa0d015f8a0 2024-09-17T05:30:00.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.744+0000 7fa0cfe00640 1 --2- 172.21.15.31:0/4150409085 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa0ac0733b0 0x7fa0ac075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:00.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.744+0000 7fa0cfe00640 1 --2- 172.21.15.31:0/4150409085 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa0ac0733b0 0x7fa0ac075870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00b2000 tx=0x7fa0c001d850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:00.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.748+0000 7fa0ccc00640 1 -- 172.21.15.31:0/4150409085 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa0c805f820 con 0x7fa0d015f8a0 2024-09-17T05:30:00.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:00.936+0000 7fa0d5a00640 1 -- 172.21.15.31:0/4150409085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa0d006f800 con 0x7fa0d015f8a0 2024-09-17T05:30:02.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.256+0000 7fa0ccc00640 1 -- 172.21.15.31:0/4150409085 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v40) ==== 97+0+0 (secure 0 0 0) 0x7fa0c8064250 con 0x7fa0d015f8a0 2024-09-17T05:30:02.263 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2024-09-17T05:30:02.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.260+0000 7fa0d5a00640 1 -- 172.21.15.31:0/4150409085 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa0ac0733b0 msgr2=0x7fa0ac075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:02.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.260+0000 7fa0d5a00640 1 --2- 172.21.15.31:0/4150409085 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa0ac0733b0 0x7fa0ac075870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00b2000 tx=0x7fa0c001d850 comp rx=0 tx=0).stop 2024-09-17T05:30:02.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.260+0000 7fa0d5a00640 1 -- 172.21.15.31:0/4150409085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0d015f8a0 msgr2=0x7fa0d00c98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:02.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.260+0000 7fa0d5a00640 1 --2- 172.21.15.31:0/4150409085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0d015f8a0 0x7fa0d00c98b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800eab0 tx=0x7fa0c800ef70 comp rx=0 tx=0).stop 2024-09-17T05:30:02.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.260+0000 7fa0d5a00640 1 -- 172.21.15.31:0/4150409085 shutdown_connections 2024-09-17T05:30:02.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.260+0000 7fa0d5a00640 1 --2- 172.21.15.31:0/4150409085 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa0ac0733b0 0x7fa0ac075870 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:02.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.260+0000 7fa0d5a00640 1 --2- 172.21.15.31:0/4150409085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0d015f8a0 0x7fa0d00c98b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:02.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.260+0000 7fa0d5a00640 1 --2- 172.21.15.31:0/4150409085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d015bdb0 0x7fa0d00cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:02.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.260+0000 7fa0d5a00640 1 --2- 172.21.15.31:0/4150409085 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0d00d0670 0x7fa0d015aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:02.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.260+0000 7fa0d5a00640 1 -- 172.21.15.31:0/4150409085 >> 172.21.15.31:0/4150409085 conn(0x7fa0d00d1c40 msgr2=0x7fa0d00d2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:02.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.260+0000 7fa0d5a00640 1 -- 172.21.15.31:0/4150409085 shutdown_connections 2024-09-17T05:30:02.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.260+0000 7fa0d5a00640 1 -- 172.21.15.31:0/4150409085 wait complete. 2024-09-17T05:30:02.290 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:30:02.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.436+0000 7f5d97600640 1 -- 172.21.15.31:0/3092545510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d9015bea0 msgr2=0x7f5d900ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:02.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.436+0000 7f5d97600640 1 --2- 172.21.15.31:0/3092545510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d9015bea0 0x7f5d900ce670 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009900 tx=0x7f5d8401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:30:02.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.436+0000 7f5d97600640 1 -- 172.21.15.31:0/3092545510 shutdown_connections 2024-09-17T05:30:02.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.436+0000 7f5d97600640 1 --2- 172.21.15.31:0/3092545510 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d900cdb30 0x7f5d900cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.436+0000 7f5d97600640 1 --2- 172.21.15.31:0/3092545510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d9015bea0 0x7f5d900ce670 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.436+0000 7f5d97600640 1 -- 172.21.15.31:0/3092545510 >> 172.21.15.31:0/3092545510 conn(0x7f5d900d1dc0 msgr2=0x7f5d900d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.436+0000 7f5d97600640 1 -- 172.21.15.31:0/3092545510 shutdown_connections 2024-09-17T05:30:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.436+0000 7f5d97600640 1 -- 172.21.15.31:0/3092545510 wait complete. 2024-09-17T05:30:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.436+0000 7f5d97600640 1 Processor -- start 2024-09-17T05:30:02.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d97600640 1 -- start start 2024-09-17T05:30:02.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d97600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d900cdb30 0x7f5d900b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:02.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d97600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d900d28e0 0x7f5d900b6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:02.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d97600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9015bea0 0x7f5d901fb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:02.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d97600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5d90168fc0 con 0x7f5d900cdb30 2024-09-17T05:30:02.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d97600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5d90168e40 con 0x7f5d900d28e0 2024-09-17T05:30:02.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d97600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5d90169140 con 0x7f5d9015bea0 2024-09-17T05:30:02.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d94c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d900cdb30 0x7f5d900b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:02.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d94c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d900cdb30 0x7f5d900b2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38682/0 (socket says 172.21.15.31:38682) 2024-09-17T05:30:02.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d94c00640 1 -- 172.21.15.31:0/4145287965 learned_addr learned my addr 172.21.15.31:0/4145287965 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:02.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d8fe00640 1 --2- 172.21.15.31:0/4145287965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d900d28e0 0x7f5d900b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:02.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d94c00640 1 -- 172.21.15.31:0/4145287965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9015bea0 msgr2=0x7f5d901fb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:02.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d95600640 1 --2- 172.21.15.31:0/4145287965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9015bea0 0x7f5d901fb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:02.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d94c00640 1 --2- 172.21.15.31:0/4145287965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9015bea0 0x7f5d901fb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:02.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d94c00640 1 -- 172.21.15.31:0/4145287965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d900d28e0 msgr2=0x7f5d900b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:02.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d94c00640 1 --2- 172.21.15.31:0/4145287965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d900d28e0 0x7f5d900b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:02.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d94c00640 1 -- 172.21.15.31:0/4145287965 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d900b31a0 con 0x7f5d900cdb30 2024-09-17T05:30:02.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d95600640 1 --2- 172.21.15.31:0/4145287965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9015bea0 0x7f5d901fb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:30:02.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d8fe00640 1 --2- 172.21.15.31:0/4145287965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d900d28e0 0x7f5d900b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:30:02.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d94c00640 1 --2- 172.21.15.31:0/4145287965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d900cdb30 0x7f5d900b2bc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009850 tx=0x7f5d840a5810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:02.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d8cc00640 1 -- 172.21.15.31:0/4145287965 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d840b2040 con 0x7f5d900cdb30 2024-09-17T05:30:02.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d8cc00640 1 -- 172.21.15.31:0/4145287965 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d840043c0 con 0x7f5d900cdb30 2024-09-17T05:30:02.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d97600640 1 -- 172.21.15.31:0/4145287965 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d900b3480 con 0x7f5d900cdb30 2024-09-17T05:30:02.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d8cc00640 1 -- 172.21.15.31:0/4145287965 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d84005270 con 0x7f5d900cdb30 2024-09-17T05:30:02.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d97600640 1 -- 172.21.15.31:0/4145287965 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d901fb2b0 con 0x7f5d900cdb30 2024-09-17T05:30:02.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.440+0000 7f5d97600640 1 -- 172.21.15.31:0/4145287965 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d900cc9d0 con 0x7f5d900cdb30 2024-09-17T05:30:02.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.444+0000 7f5d8cc00640 1 -- 172.21.15.31:0/4145287965 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f5d84005410 con 0x7f5d900cdb30 2024-09-17T05:30:02.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.444+0000 7f5d8cc00640 1 --2- 172.21.15.31:0/4145287965 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5d700733b0 0x7f5d70075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:02.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.444+0000 7f5d8cc00640 1 -- 172.21.15.31:0/4145287965 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4857+0+0 (secure 0 0 0) 0x7f5d8412dee0 con 0x7f5d900cdb30 2024-09-17T05:30:02.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.444+0000 7f5d8fe00640 1 --2- 172.21.15.31:0/4145287965 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5d700733b0 0x7f5d70075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:02.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.444+0000 7f5d8fe00640 1 --2- 172.21.15.31:0/4145287965 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5d700733b0 0x7f5d70075870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5d900c9060 tx=0x7f5d7c00b2c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:02.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.448+0000 7f5d8cc00640 1 -- 172.21.15.31:0/4145287965 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5d840164d0 con 0x7f5d900cdb30 2024-09-17T05:30:02.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.684+0000 7f5d97600640 1 -- 172.21.15.31:0/4145287965 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f5d90151820 con 0x7f5d900cdb30 2024-09-17T05:30:02.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.684+0000 7f5d8cc00640 1 -- 172.21.15.31:0/4145287965 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f5d840f8f40 con 0x7f5d900cdb30 2024-09-17T05:30:02.690 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:02.690 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:30:02.690 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2024-09-17T05:30:02.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.690 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2024-09-17T05:30:02.690 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmoloQARAAbTcR/1F1qz7Crjdu1NPSgw==", 2024-09-17T05:30:02.690 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:30:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:30:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:30:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:30:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:30:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2024-09-17T05:30:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmYrdRDRAAkaDz03U3lMZlkLEVFYlTaw==", 2024-09-17T05:30:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:30:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:30:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:30:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:30:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:30:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2024-09-17T05:30:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmpFRCCBAAZRsuAVwSxuMGDeoYCwWFeg==", 2024-09-17T05:30:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:30:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:30:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:30:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:30:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:30:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2024-09-17T05:30:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lm23PSFBAAuO+k0kWY28PN7+pEtlUniQ==", 2024-09-17T05:30:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:30:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:30:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:30:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:30:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:30:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2024-09-17T05:30:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBTE+lm0miKHxAA2C1pfwBxJtKQhu4xuPumxg==", 2024-09-17T05:30:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:30:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:30:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:30:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:30:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2024-09-17T05:30:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBWE+lmdQi7NRAA2v4ETg4jynbPF0K4E73KAA==", 2024-09-17T05:30:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:30:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:30:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:30:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:30:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2024-09-17T05:30:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBaE+lm18eUEBAA8gAhUx9UNa2Lk4uyFBd7Nw==", 2024-09-17T05:30:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:30:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:30:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:30:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:30:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2024-09-17T05:30:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBdE+lm00moJBAAizrxOP4rI4fGR91dYzlEkw==", 2024-09-17T05:30:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:30:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:30:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:30:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:30:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2024-09-17T05:30:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBjE+lmhdtUJhAA7+KM8DwQriFwMbpqXAPTuA==", 2024-09-17T05:30:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:30:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:30:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:30:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:30:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2024-09-17T05:30:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBmE+lm5cByOhAAiMnQIv2O41am/3E+0dp4sg==", 2024-09-17T05:30:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:30:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:30:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:30:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:30:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2024-09-17T05:30:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBqE+lm19FhExAAo/Sfj2SX5+Y2/Fxz8mbiNQ==", 2024-09-17T05:30:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:30:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:30:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:30:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:30:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2024-09-17T05:30:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBtE+lmISDbKBAAapUBS+t+N1vUcCbdJic8Dw==", 2024-09-17T05:30:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:30:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:30:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:30:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:30:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2024-09-17T05:30:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw==", 2024-09-17T05:30:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:30:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2024-09-17T05:30:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:30:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:30:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2024-09-17T05:30:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmb2pmIhAA7p+G+WnB7ujZZdSlaossYg==", 2024-09-17T05:30:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:30:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:30:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:30:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:30:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:30:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2024-09-17T05:30:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmAPPaHhAAyz/gKunaNFyrdkAUy50qmQ==", 2024-09-17T05:30:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:30:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:30:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:30:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:30:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:30:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2024-09-17T05:30:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lml72BKBAAgAji5TWedU7azT5oQz3fYg==", 2024-09-17T05:30:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:30:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:30:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:30:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:30:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:30:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2024-09-17T05:30:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmtgltIRAAeTv/U/vZ9ZIuGN4JXTHD0A==", 2024-09-17T05:30:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:30:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:30:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:30:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:30:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:30:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2024-09-17T05:30:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmTt2oOBAAmR5ykU4WbEzlKFiwI7sMdg==", 2024-09-17T05:30:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:30:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:30:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:30:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:30:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2024-09-17T05:30:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmKILYNBAAojM8RIq92dO2DQyXppReIw==", 2024-09-17T05:30:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:30:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:30:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:30:02.706 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:30:02.706 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.706 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:02.706 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:30:02.706 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:30:02.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.688+0000 7f5d97600640 1 -- 172.21.15.31:0/4145287965 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5d700733b0 msgr2=0x7f5d70075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:02.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.688+0000 7f5d97600640 1 --2- 172.21.15.31:0/4145287965 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5d700733b0 0x7f5d70075870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5d900c9060 tx=0x7f5d7c00b2c0 comp rx=0 tx=0).stop 2024-09-17T05:30:02.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.688+0000 7f5d97600640 1 -- 172.21.15.31:0/4145287965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d900cdb30 msgr2=0x7f5d900b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:02.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.688+0000 7f5d97600640 1 --2- 172.21.15.31:0/4145287965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d900cdb30 0x7f5d900b2bc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009850 tx=0x7f5d840a5810 comp rx=0 tx=0).stop 2024-09-17T05:30:02.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.688+0000 7f5d97600640 1 -- 172.21.15.31:0/4145287965 shutdown_connections 2024-09-17T05:30:02.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.688+0000 7f5d97600640 1 --2- 172.21.15.31:0/4145287965 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5d700733b0 0x7f5d70075870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:02.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.688+0000 7f5d97600640 1 --2- 172.21.15.31:0/4145287965 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d9015bea0 0x7f5d901fb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:02.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.688+0000 7f5d97600640 1 --2- 172.21.15.31:0/4145287965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d900d28e0 0x7f5d900b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:02.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.688+0000 7f5d97600640 1 --2- 172.21.15.31:0/4145287965 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d900cdb30 0x7f5d900b2bc0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:02.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.688+0000 7f5d97600640 1 -- 172.21.15.31:0/4145287965 >> 172.21.15.31:0/4145287965 conn(0x7f5d900d1dc0 msgr2=0x7f5d900cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:02.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.688+0000 7f5d97600640 1 -- 172.21.15.31:0/4145287965 shutdown_connections 2024-09-17T05:30:02.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.688+0000 7f5d97600640 1 -- 172.21.15.31:0/4145287965 wait complete. 2024-09-17T05:30:02.713 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:30:02.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.856+0000 7fb1c4c00640 1 -- 172.21.15.31:0/443348249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1a4004bc0 msgr2=0x7fb1a4004fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:02.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.856+0000 7fb1c4c00640 1 --2- 172.21.15.31:0/443348249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1a4004bc0 0x7fb1a4004fe0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00016f0 tx=0x7fb1b001c770 comp rx=0 tx=0).stop 2024-09-17T05:30:02.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.856+0000 7fb1c4c00640 1 -- 172.21.15.31:0/443348249 shutdown_connections 2024-09-17T05:30:02.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.856+0000 7fb1c4c00640 1 --2- 172.21.15.31:0/443348249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1a4004bc0 0x7fb1a4004fe0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:02.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.856+0000 7fb1c4c00640 1 -- 172.21.15.31:0/443348249 >> 172.21.15.31:0/443348249 conn(0x7fb1c00b18f0 msgr2=0x7fb1c00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:02.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.856+0000 7fb1c4c00640 1 -- 172.21.15.31:0/443348249 shutdown_connections 2024-09-17T05:30:02.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.856+0000 7fb1c4c00640 1 -- 172.21.15.31:0/443348249 wait complete. 2024-09-17T05:30:02.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.856+0000 7fb1c4c00640 1 Processor -- start 2024-09-17T05:30:02.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.856+0000 7fb1c4c00640 1 -- start start 2024-09-17T05:30:02.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1c4c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1a4004bc0 0x7fb1c01f9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:02.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1c4c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1c01e8ad0 0x7fb1c014b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:02.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1c4c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1c01eb590 0x7fb1c00af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:02.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1c4c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c00ceba0 con 0x7fb1a4004bc0 2024-09-17T05:30:02.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1c4c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c00cea20 con 0x7fb1c01eb590 2024-09-17T05:30:02.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1c4c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c00ced20 con 0x7fb1c01e8ad0 2024-09-17T05:30:02.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1bde00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1a4004bc0 0x7fb1c01f9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:02.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1bde00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1a4004bc0 0x7fb1c01f9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38696/0 (socket says 172.21.15.31:38696) 2024-09-17T05:30:02.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1bde00640 1 -- 172.21.15.31:0/3666569844 learned_addr learned my addr 172.21.15.31:0/3666569844 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:02.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1be800640 1 --2- 172.21.15.31:0/3666569844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1c01eb590 0x7fb1c00af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:02.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1b7e00640 1 --2- 172.21.15.31:0/3666569844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1c01e8ad0 0x7fb1c014b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:02.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1bde00640 1 -- 172.21.15.31:0/3666569844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1c01e8ad0 msgr2=0x7fb1c014b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:02.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1bde00640 1 --2- 172.21.15.31:0/3666569844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1c01e8ad0 0x7fb1c014b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:02.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1bde00640 1 -- 172.21.15.31:0/3666569844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1c01eb590 msgr2=0x7fb1c00af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:02.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1bde00640 1 --2- 172.21.15.31:0/3666569844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1c01eb590 0x7fb1c00af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:02.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1bde00640 1 -- 172.21.15.31:0/3666569844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c01fa500 con 0x7fb1a4004bc0 2024-09-17T05:30:02.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1bde00640 1 --2- 172.21.15.31:0/3666569844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1a4004bc0 0x7fb1c01f9fc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb1b001ae70 tx=0x7fb1b0003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:02.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1b6000640 1 -- 172.21.15.31:0/3666569844 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b00ae070 con 0x7fb1a4004bc0 2024-09-17T05:30:02.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1b6000640 1 -- 172.21.15.31:0/3666569844 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1b0003e50 con 0x7fb1a4004bc0 2024-09-17T05:30:02.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1b6000640 1 -- 172.21.15.31:0/3666569844 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0001310 con 0x7fb1a4004bc0 2024-09-17T05:30:02.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1c4c00640 1 -- 172.21.15.31:0/3666569844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c014bc50 con 0x7fb1a4004bc0 2024-09-17T05:30:02.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1c4c00640 1 -- 172.21.15.31:0/3666569844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c01eaab0 con 0x7fb1a4004bc0 2024-09-17T05:30:02.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1c4c00640 1 -- 172.21.15.31:0/3666569844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c0069410 con 0x7fb1a4004bc0 2024-09-17T05:30:02.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.860+0000 7fb1b6000640 1 -- 172.21.15.31:0/3666569844 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7fb1b0006350 con 0x7fb1a4004bc0 2024-09-17T05:30:02.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.864+0000 7fb1b6000640 1 --2- 172.21.15.31:0/3666569844 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb19c073410 0x7fb19c0758d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:02.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.864+0000 7fb1b6000640 1 -- 172.21.15.31:0/3666569844 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4857+0+0 (secure 0 0 0) 0x7fb1b012e310 con 0x7fb1a4004bc0 2024-09-17T05:30:02.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.864+0000 7fb1b7e00640 1 --2- 172.21.15.31:0/3666569844 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb19c073410 0x7fb19c0758d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:02.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.864+0000 7fb1b7e00640 1 --2- 172.21.15.31:0/3666569844 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb19c073410 0x7fb19c0758d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0158f70 tx=0x7fb1a80091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:02.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:02.868+0000 7fb1b6000640 1 -- 172.21.15.31:0/3666569844 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb1b00164d0 con 0x7fb1a4004bc0 2024-09-17T05:30:03.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.044+0000 7fb1c4c00640 1 -- 172.21.15.31:0/3666569844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb1c00cd610 con 0x7fb1a4004bc0 2024-09-17T05:30:03.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.044+0000 7fb1b6000640 1 -- 172.21.15.31:0/3666569844 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) ==== 84+0+65 (secure 0 0 0) 0x7fb1b00f8d40 con 0x7fb1a4004bc0 2024-09-17T05:30:03.050 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:03.050 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:30:03.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:03.050 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-09-17T05:30:03.050 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-09-17T05:30:03.050 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:03.051 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:30:03.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.048+0000 7fb1c4c00640 1 -- 172.21.15.31:0/3666569844 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb19c073410 msgr2=0x7fb19c0758d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:03.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.048+0000 7fb1c4c00640 1 --2- 172.21.15.31:0/3666569844 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb19c073410 0x7fb19c0758d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0158f70 tx=0x7fb1a80091e0 comp rx=0 tx=0).stop 2024-09-17T05:30:03.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.048+0000 7fb1c4c00640 1 -- 172.21.15.31:0/3666569844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1a4004bc0 msgr2=0x7fb1c01f9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:03.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.048+0000 7fb1c4c00640 1 --2- 172.21.15.31:0/3666569844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1a4004bc0 0x7fb1c01f9fc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb1b001ae70 tx=0x7fb1b0003c60 comp rx=0 tx=0).stop 2024-09-17T05:30:03.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.048+0000 7fb1c4c00640 1 -- 172.21.15.31:0/3666569844 shutdown_connections 2024-09-17T05:30:03.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.048+0000 7fb1c4c00640 1 --2- 172.21.15.31:0/3666569844 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb19c073410 0x7fb19c0758d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:03.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.048+0000 7fb1c4c00640 1 --2- 172.21.15.31:0/3666569844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1c01eb590 0x7fb1c00af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:03.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.048+0000 7fb1c4c00640 1 --2- 172.21.15.31:0/3666569844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1c01e8ad0 0x7fb1c014b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:03.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.048+0000 7fb1c4c00640 1 --2- 172.21.15.31:0/3666569844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1a4004bc0 0x7fb1c01f9fc0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:03.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.048+0000 7fb1c4c00640 1 -- 172.21.15.31:0/3666569844 >> 172.21.15.31:0/3666569844 conn(0x7fb1c00b18f0 msgr2=0x7fb1c00cbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:03.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.048+0000 7fb1c4c00640 1 -- 172.21.15.31:0/3666569844 shutdown_connections 2024-09-17T05:30:03.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.048+0000 7fb1c4c00640 1 -- 172.21.15.31:0/3666569844 wait complete. 2024-09-17T05:30:03.072 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:30:03.072 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:30:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f2966200640 1 -- 172.21.15.31:0/1489831290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f296015be10 msgr2=0x7f29600ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f2966200640 1 --2- 172.21.15.31:0/1489831290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f296015be10 0x7f29600ce700 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f29600746b0 tx=0x7f295001c8c0 comp rx=0 tx=0).stop 2024-09-17T05:30:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f2966200640 1 -- 172.21.15.31:0/1489831290 shutdown_connections 2024-09-17T05:30:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f2966200640 1 --2- 172.21.15.31:0/1489831290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29600b0b60 0x7f29600cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f2966200640 1 --2- 172.21.15.31:0/1489831290 >> v2:172.21.15.155:3300/0 conn(0x7f296015c1f0 0x7f29600cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f2966200640 1 --2- 172.21.15.31:0/1489831290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f296015be10 0x7f29600ce700 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f2966200640 1 -- 172.21.15.31:0/1489831290 >> 172.21.15.31:0/1489831290 conn(0x7f29600d1da0 msgr2=0x7f29600d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f2966200640 1 -- 172.21.15.31:0/1489831290 shutdown_connections 2024-09-17T05:30:03.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f2966200640 1 -- 172.21.15.31:0/1489831290 wait complete. 2024-09-17T05:30:03.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f2966200640 1 Processor -- start 2024-09-17T05:30:03.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f2966200640 1 -- start start 2024-09-17T05:30:03.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f2966200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29600b0b60 0x7f296014dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:03.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f2966200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f296015be10 0x7f2960153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:03.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f2966200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f296015c1f0 0x7f2960158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:03.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f2966200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f29600ccf60 con 0x7f296015c1f0 2024-09-17T05:30:03.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f2966200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f29600ccde0 con 0x7f296015be10 2024-09-17T05:30:03.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f2966200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f29600cd0e0 con 0x7f29600b0b60 2024-09-17T05:30:03.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f295fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f296015c1f0 0x7f2960158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:03.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.220+0000 7f295f400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29600b0b60 0x7f296014dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:03.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.224+0000 7f295fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f296015c1f0 0x7f2960158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38718/0 (socket says 172.21.15.31:38718) 2024-09-17T05:30:03.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.224+0000 7f295f400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29600b0b60 0x7f296014dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:53284/0 (socket says 172.21.15.31:53284) 2024-09-17T05:30:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.224+0000 7f295fe00640 1 -- 172.21.15.31:0/2978355615 learned_addr learned my addr 172.21.15.31:0/2978355615 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.224+0000 7f2957e00640 1 --2- 172.21.15.31:0/2978355615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f296015be10 0x7f2960153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.224+0000 7f295fe00640 1 -- 172.21.15.31:0/2978355615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29600b0b60 msgr2=0x7f296014dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.224+0000 7f295fe00640 1 --2- 172.21.15.31:0/2978355615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29600b0b60 0x7f296014dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.224+0000 7f295fe00640 1 -- 172.21.15.31:0/2978355615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f296015be10 msgr2=0x7f2960153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.224+0000 7f295fe00640 1 --2- 172.21.15.31:0/2978355615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f296015be10 0x7f2960153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.224+0000 7f295fe00640 1 -- 172.21.15.31:0/2978355615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296006f9f0 con 0x7f296015c1f0 2024-09-17T05:30:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.224+0000 7f295fe00640 1 --2- 172.21.15.31:0/2978355615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f296015c1f0 0x7f2960158c70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f295800e9c0 tx=0x7f295800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.224+0000 7f2957400640 1 -- 172.21.15.31:0/2978355615 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295800cd80 con 0x7f296015c1f0 2024-09-17T05:30:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.224+0000 7f2957400640 1 -- 172.21.15.31:0/2978355615 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2958004b30 con 0x7f296015c1f0 2024-09-17T05:30:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.224+0000 7f2957400640 1 -- 172.21.15.31:0/2978355615 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2958005020 con 0x7f296015c1f0 2024-09-17T05:30:03.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.224+0000 7f2966200640 1 -- 172.21.15.31:0/2978355615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2960152c20 con 0x7f296015c1f0 2024-09-17T05:30:03.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.224+0000 7f2966200640 1 -- 172.21.15.31:0/2978355615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29601531e0 con 0x7f296015c1f0 2024-09-17T05:30:03.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.224+0000 7f2966200640 1 -- 172.21.15.31:0/2978355615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29600cd590 con 0x7f296015c1f0 2024-09-17T05:30:03.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.228+0000 7f2957400640 1 -- 172.21.15.31:0/2978355615 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f29580051c0 con 0x7f296015c1f0 2024-09-17T05:30:03.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.228+0000 7f2957400640 1 --2- 172.21.15.31:0/2978355615 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f293c0733b0 0x7f293c075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:03.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.228+0000 7f2957400640 1 -- 172.21.15.31:0/2978355615 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4857+0+0 (secure 0 0 0) 0x7f2958094a60 con 0x7f296015c1f0 2024-09-17T05:30:03.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.228+0000 7f295f400640 1 --2- 172.21.15.31:0/2978355615 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f293c0733b0 0x7f293c075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:03.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.228+0000 7f295f400640 1 --2- 172.21.15.31:0/2978355615 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f293c0733b0 0x7f293c075870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f29500af000 tx=0x7f295001b100 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:03.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.236+0000 7f2957400640 1 -- 172.21.15.31:0/2978355615 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2958016030 con 0x7f296015c1f0 2024-09-17T05:30:03.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:03.416+0000 7f2966200640 1 -- 172.21.15.31:0/2978355615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f296006fd20 con 0x7f296015c1f0 2024-09-17T05:30:03.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-17T05:30:04.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.276+0000 7f2957400640 1 -- 172.21.15.31:0/2978355615 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v41) ==== 138+0+0 (secure 0 0 0) 0x7f295805f520 con 0x7f296015c1f0 2024-09-17T05:30:04.283 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-09-17T05:30:04.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.280+0000 7f2966200640 1 -- 172.21.15.31:0/2978355615 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f293c0733b0 msgr2=0x7f293c075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:04.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.280+0000 7f2966200640 1 --2- 172.21.15.31:0/2978355615 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f293c0733b0 0x7f293c075870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f29500af000 tx=0x7f295001b100 comp rx=0 tx=0).stop 2024-09-17T05:30:04.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.280+0000 7f2966200640 1 -- 172.21.15.31:0/2978355615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f296015c1f0 msgr2=0x7f2960158c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:04.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.280+0000 7f2966200640 1 --2- 172.21.15.31:0/2978355615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f296015c1f0 0x7f2960158c70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f295800e9c0 tx=0x7f295800ee80 comp rx=0 tx=0).stop 2024-09-17T05:30:04.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.280+0000 7f2966200640 1 -- 172.21.15.31:0/2978355615 shutdown_connections 2024-09-17T05:30:04.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.280+0000 7f2966200640 1 --2- 172.21.15.31:0/2978355615 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f293c0733b0 0x7f293c075870 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:04.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.280+0000 7f2966200640 1 --2- 172.21.15.31:0/2978355615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f296015c1f0 0x7f2960158c70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:04.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.280+0000 7f2966200640 1 --2- 172.21.15.31:0/2978355615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f296015be10 0x7f2960153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:04.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.280+0000 7f2966200640 1 --2- 172.21.15.31:0/2978355615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f29600b0b60 0x7f296014dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:04.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.280+0000 7f2966200640 1 -- 172.21.15.31:0/2978355615 >> 172.21.15.31:0/2978355615 conn(0x7f29600d1da0 msgr2=0x7f29600b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:04.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.280+0000 7f2966200640 1 -- 172.21.15.31:0/2978355615 shutdown_connections 2024-09-17T05:30:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.280+0000 7f2966200640 1 -- 172.21.15.31:0/2978355615 wait complete. 2024-09-17T05:30:04.315 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:30:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.468+0000 7fa54a800640 1 -- 172.21.15.31:0/351247029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5440b4cf0 msgr2=0x7fa54406f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.468+0000 7fa54a800640 1 --2- 172.21.15.31:0/351247029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5440b4cf0 0x7fa54406f1c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009bc0 tx=0x7fa53c01cb10 comp rx=0 tx=0).stop 2024-09-17T05:30:04.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.468+0000 7fa54a800640 1 -- 172.21.15.31:0/351247029 shutdown_connections 2024-09-17T05:30:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.468+0000 7fa54a800640 1 --2- 172.21.15.31:0/351247029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5440b4cf0 0x7fa54406f1c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.468+0000 7fa54a800640 1 -- 172.21.15.31:0/351247029 >> 172.21.15.31:0/351247029 conn(0x7fa5440b18f0 msgr2=0x7fa5440b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.468+0000 7fa54a800640 1 -- 172.21.15.31:0/351247029 shutdown_connections 2024-09-17T05:30:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.468+0000 7fa54a800640 1 -- 172.21.15.31:0/351247029 wait complete. 2024-09-17T05:30:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa54a800640 1 Processor -- start 2024-09-17T05:30:04.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa54a800640 1 -- start start 2024-09-17T05:30:04.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa54a800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5440b4cf0 0x7fa5441fb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:04.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa54a800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa54415e260 0x7fa5441f87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:04.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa54a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5441f8d30 0x7fa544156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:04.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa54a800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa544169340 con 0x7fa5441f8d30 2024-09-17T05:30:04.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa54a800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa5441691c0 con 0x7fa5440b4cf0 2024-09-17T05:30:04.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa54a800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa5441694c0 con 0x7fa54415e260 2024-09-17T05:30:04.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa543e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5441f8d30 0x7fa544156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:04.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa543e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5441f8d30 0x7fa544156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38730/0 (socket says 172.21.15.31:38730) 2024-09-17T05:30:04.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa543e00640 1 -- 172.21.15.31:0/1625204577 learned_addr learned my addr 172.21.15.31:0/1625204577 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:04.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa53aa00640 1 --2- 172.21.15.31:0/1625204577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa54415e260 0x7fa5441f87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:04.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa543400640 1 --2- 172.21.15.31:0/1625204577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5440b4cf0 0x7fa5441fb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:04.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa543e00640 1 -- 172.21.15.31:0/1625204577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa54415e260 msgr2=0x7fa5441f87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:04.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa543e00640 1 --2- 172.21.15.31:0/1625204577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa54415e260 0x7fa5441f87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:04.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa543e00640 1 -- 172.21.15.31:0/1625204577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5440b4cf0 msgr2=0x7fa5441fb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:04.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa543e00640 1 --2- 172.21.15.31:0/1625204577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5440b4cf0 0x7fa5441fb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:04.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa543e00640 1 -- 172.21.15.31:0/1625204577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5441fbda0 con 0x7fa5441f8d30 2024-09-17T05:30:04.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa543e00640 1 --2- 172.21.15.31:0/1625204577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5441f8d30 0x7fa544156f60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0b0040 tx=0x7fa53c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:04.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa53be00640 1 -- 172.21.15.31:0/1625204577 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c0b2040 con 0x7fa5441f8d30 2024-09-17T05:30:04.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa53be00640 1 -- 172.21.15.31:0/1625204577 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa53c004040 con 0x7fa5441f8d30 2024-09-17T05:30:04.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa53be00640 1 -- 172.21.15.31:0/1625204577 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c004430 con 0x7fa5441f8d30 2024-09-17T05:30:04.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa54a800640 1 -- 172.21.15.31:0/1625204577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5441fc080 con 0x7fa5441f8d30 2024-09-17T05:30:04.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa54a800640 1 -- 172.21.15.31:0/1625204577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5441f82d0 con 0x7fa5441f8d30 2024-09-17T05:30:04.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.472+0000 7fa54a800640 1 -- 172.21.15.31:0/1625204577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa544069410 con 0x7fa5441f8d30 2024-09-17T05:30:04.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.476+0000 7fa53be00640 1 -- 172.21.15.31:0/1625204577 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7fa53c0bd030 con 0x7fa5441f8d30 2024-09-17T05:30:04.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.476+0000 7fa53be00640 1 --2- 172.21.15.31:0/1625204577 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa5200733b0 0x7fa520075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:04.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.476+0000 7fa53be00640 1 -- 172.21.15.31:0/1625204577 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5227+0+0 (secure 0 0 0) 0x7fa53c12ebb0 con 0x7fa5441f8d30 2024-09-17T05:30:04.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.476+0000 7fa543400640 1 --2- 172.21.15.31:0/1625204577 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa5200733b0 0x7fa520075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:04.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.476+0000 7fa543400640 1 --2- 172.21.15.31:0/1625204577 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa5200733b0 0x7fa520075870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa534001640 tx=0x7fa534009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:04.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.480+0000 7fa53be00640 1 -- 172.21.15.31:0/1625204577 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa53c0c4060 con 0x7fa5441f8d30 2024-09-17T05:30:04.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:04.656+0000 7fa54a800640 1 -- 172.21.15.31:0/1625204577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa5440b2bf0 con 0x7fa5441f8d30 2024-09-17T05:30:05.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.288+0000 7fa53be00640 1 -- 172.21.15.31:0/1625204577 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v42) ==== 170+0+0 (secure 0 0 0) 0x7fa53c016790 con 0x7fa5441f8d30 2024-09-17T05:30:05.294 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-09-17T05:30:05.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.292+0000 7fa54a800640 1 -- 172.21.15.31:0/1625204577 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa5200733b0 msgr2=0x7fa520075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:05.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.292+0000 7fa54a800640 1 --2- 172.21.15.31:0/1625204577 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa5200733b0 0x7fa520075870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa534001640 tx=0x7fa534009040 comp rx=0 tx=0).stop 2024-09-17T05:30:05.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.292+0000 7fa54a800640 1 -- 172.21.15.31:0/1625204577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5441f8d30 msgr2=0x7fa544156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:05.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.292+0000 7fa54a800640 1 --2- 172.21.15.31:0/1625204577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5441f8d30 0x7fa544156f60 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0b0040 tx=0x7fa53c005b00 comp rx=0 tx=0).stop 2024-09-17T05:30:05.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.292+0000 7fa54a800640 1 -- 172.21.15.31:0/1625204577 shutdown_connections 2024-09-17T05:30:05.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.292+0000 7fa54a800640 1 --2- 172.21.15.31:0/1625204577 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa5200733b0 0x7fa520075870 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:05.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.292+0000 7fa54a800640 1 --2- 172.21.15.31:0/1625204577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5441f8d30 0x7fa544156f60 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:05.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.292+0000 7fa54a800640 1 --2- 172.21.15.31:0/1625204577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa54415e260 0x7fa5441f87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:05.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.292+0000 7fa54a800640 1 --2- 172.21.15.31:0/1625204577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5440b4cf0 0x7fa5441fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:05.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.292+0000 7fa54a800640 1 -- 172.21.15.31:0/1625204577 >> 172.21.15.31:0/1625204577 conn(0x7fa5440b18f0 msgr2=0x7fa54415f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:05.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.292+0000 7fa54a800640 1 -- 172.21.15.31:0/1625204577 shutdown_connections 2024-09-17T05:30:05.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.292+0000 7fa54a800640 1 -- 172.21.15.31:0/1625204577 wait complete. 2024-09-17T05:30:05.340 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:30:05.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.488+0000 7f9d47600640 1 -- 172.21.15.31:0/1315054231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d4015c130 msgr2=0x7f9d400ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:05.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.488+0000 7f9d47600640 1 --2- 172.21.15.31:0/1315054231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d4015c130 0x7f9d400ceb20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009840 tx=0x7f9d2801c700 comp rx=0 tx=0).stop 2024-09-17T05:30:05.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.488+0000 7f9d47600640 1 -- 172.21.15.31:0/1315054231 shutdown_connections 2024-09-17T05:30:05.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.488+0000 7f9d47600640 1 --2- 172.21.15.31:0/1315054231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d4015c130 0x7f9d400ceb20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:05.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.488+0000 7f9d47600640 1 --2- 172.21.15.31:0/1315054231 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d4015bd50 0x7f9d400ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:05.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.488+0000 7f9d47600640 1 -- 172.21.15.31:0/1315054231 >> 172.21.15.31:0/1315054231 conn(0x7f9d400d1ea0 msgr2=0x7f9d400d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:05.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.488+0000 7f9d47600640 1 -- 172.21.15.31:0/1315054231 shutdown_connections 2024-09-17T05:30:05.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.488+0000 7f9d47600640 1 -- 172.21.15.31:0/1315054231 wait complete. 2024-09-17T05:30:05.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.488+0000 7f9d47600640 1 Processor -- start 2024-09-17T05:30:05.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d47600640 1 -- start start 2024-09-17T05:30:05.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d47600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d400cf4e0 0x7f9d400b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:05.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d47600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d4015bd50 0x7f9d4014ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:05.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d47600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d4015c130 0x7f9d401549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:05.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d47600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9d40168e50 con 0x7f9d4015c130 2024-09-17T05:30:05.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d47600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9d40168cd0 con 0x7f9d400cf4e0 2024-09-17T05:30:05.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d47600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9d40168fd0 con 0x7f9d4015bd50 2024-09-17T05:30:05.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d45600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d4015c130 0x7f9d401549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:05.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d45600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d4015c130 0x7f9d401549a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38738/0 (socket says 172.21.15.31:38738) 2024-09-17T05:30:05.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d45600640 1 -- 172.21.15.31:0/1796617062 learned_addr learned my addr 172.21.15.31:0/1796617062 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:05.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d44c00640 1 --2- 172.21.15.31:0/1796617062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d400cf4e0 0x7f9d400b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:05.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d37e00640 1 --2- 172.21.15.31:0/1796617062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d4015bd50 0x7f9d4014ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:05.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d45600640 1 -- 172.21.15.31:0/1796617062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d4015bd50 msgr2=0x7f9d4014ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:05.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d45600640 1 --2- 172.21.15.31:0/1796617062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d4015bd50 0x7f9d4014ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:05.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d45600640 1 -- 172.21.15.31:0/1796617062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d400cf4e0 msgr2=0x7f9d400b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:05.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d45600640 1 --2- 172.21.15.31:0/1796617062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d400cf4e0 0x7f9d400b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:05.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d45600640 1 -- 172.21.15.31:0/1796617062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d400b5210 con 0x7f9d4015c130 2024-09-17T05:30:05.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d44c00640 1 --2- 172.21.15.31:0/1796617062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d400cf4e0 0x7f9d400b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:30:05.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d45600640 1 --2- 172.21.15.31:0/1796617062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d4015c130 0x7f9d401549a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800cbc0 tx=0x7f9d3800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:05.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d3d600640 1 -- 172.21.15.31:0/1796617062 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d38016020 con 0x7f9d4015c130 2024-09-17T05:30:05.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d3d600640 1 -- 172.21.15.31:0/1796617062 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d3800ab00 con 0x7f9d4015c130 2024-09-17T05:30:05.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d47600640 1 -- 172.21.15.31:0/1796617062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d4014ef60 con 0x7f9d4015c130 2024-09-17T05:30:05.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d3d600640 1 -- 172.21.15.31:0/1796617062 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d38012420 con 0x7f9d4015c130 2024-09-17T05:30:05.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d47600640 1 -- 172.21.15.31:0/1796617062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d400b5790 con 0x7f9d4015c130 2024-09-17T05:30:05.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.492+0000 7f9d47600640 1 -- 172.21.15.31:0/1796617062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d400c5dd0 con 0x7f9d4015c130 2024-09-17T05:30:05.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.496+0000 7f9d3d600640 1 -- 172.21.15.31:0/1796617062 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f9d38019020 con 0x7f9d4015c130 2024-09-17T05:30:05.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.496+0000 7f9d3d600640 1 --2- 172.21.15.31:0/1796617062 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9d1c0733e0 0x7f9d1c0758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:05.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.496+0000 7f9d3d600640 1 -- 172.21.15.31:0/1796617062 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5609+0+0 (secure 0 0 0) 0x7f9d38094ed0 con 0x7f9d4015c130 2024-09-17T05:30:05.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.496+0000 7f9d44c00640 1 --2- 172.21.15.31:0/1796617062 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9d1c0733e0 0x7f9d1c0758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:05.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.496+0000 7f9d44c00640 1 --2- 172.21.15.31:0/1796617062 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9d1c0733e0 0x7f9d1c0758a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009c30 tx=0x7f9d300091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:05.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.500+0000 7f9d3d600640 1 -- 172.21.15.31:0/1796617062 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9d38020020 con 0x7f9d4015c130 2024-09-17T05:30:05.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:05.712+0000 7f9d47600640 1 -- 172.21.15.31:0/1796617062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9d400cebe0 con 0x7f9d4015c130 2024-09-17T05:30:06.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.292+0000 7f9d3d600640 1 -- 172.21.15.31:0/1796617062 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v24) ==== 172+0+0 (secure 0 0 0) 0x7f9d3805fbb0 con 0x7f9d4015c130 2024-09-17T05:30:06.296 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 6 and data pool 7 2024-09-17T05:30:06.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.296+0000 7f9d47600640 1 -- 172.21.15.31:0/1796617062 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9d1c0733e0 msgr2=0x7f9d1c0758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:06.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.296+0000 7f9d47600640 1 --2- 172.21.15.31:0/1796617062 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9d1c0733e0 0x7f9d1c0758a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009c30 tx=0x7f9d300091e0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.296+0000 7f9d47600640 1 -- 172.21.15.31:0/1796617062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d4015c130 msgr2=0x7f9d401549a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:06.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.296+0000 7f9d47600640 1 --2- 172.21.15.31:0/1796617062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d4015c130 0x7f9d401549a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800cbc0 tx=0x7f9d3800ccb0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.300+0000 7f9d47600640 1 -- 172.21.15.31:0/1796617062 shutdown_connections 2024-09-17T05:30:06.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.300+0000 7f9d47600640 1 --2- 172.21.15.31:0/1796617062 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9d1c0733e0 0x7f9d1c0758a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.300+0000 7f9d47600640 1 --2- 172.21.15.31:0/1796617062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d4015c130 0x7f9d401549a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.300+0000 7f9d47600640 1 --2- 172.21.15.31:0/1796617062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d4015bd50 0x7f9d4014ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.300+0000 7f9d47600640 1 --2- 172.21.15.31:0/1796617062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d400cf4e0 0x7f9d400b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.300+0000 7f9d47600640 1 -- 172.21.15.31:0/1796617062 >> 172.21.15.31:0/1796617062 conn(0x7f9d400d1ea0 msgr2=0x7f9d400d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:06.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.300+0000 7f9d47600640 1 -- 172.21.15.31:0/1796617062 shutdown_connections 2024-09-17T05:30:06.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.300+0000 7f9d47600640 1 -- 172.21.15.31:0/1796617062 wait complete. 2024-09-17T05:30:06.359 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:30:06.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.504+0000 7f0306e00640 1 -- 172.21.15.31:0/2706861753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f030015f110 msgr2=0x7f03000af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:06.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.504+0000 7f0306e00640 1 --2- 172.21.15.31:0/2706861753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f030015f110 0x7f03000af770 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f03000cf860 tx=0x7f02f401cd80 comp rx=0 tx=0).stop 2024-09-17T05:30:06.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.504+0000 7f0306e00640 1 -- 172.21.15.31:0/2706861753 shutdown_connections 2024-09-17T05:30:06.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.504+0000 7f0306e00640 1 --2- 172.21.15.31:0/2706861753 >> v2:172.21.15.155:3300/0 conn(0x7f030015f4f0 0x7f0300074340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.504+0000 7f0306e00640 1 --2- 172.21.15.31:0/2706861753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f030015f110 0x7f03000af770 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.504+0000 7f0306e00640 1 -- 172.21.15.31:0/2706861753 >> 172.21.15.31:0/2706861753 conn(0x7f0300073490 msgr2=0x7f03000d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:06.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.504+0000 7f0306e00640 1 -- 172.21.15.31:0/2706861753 shutdown_connections 2024-09-17T05:30:06.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.504+0000 7f0306e00640 1 -- 172.21.15.31:0/2706861753 wait complete. 2024-09-17T05:30:06.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306e00640 1 Processor -- start 2024-09-17T05:30:06.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306e00640 1 -- start start 2024-09-17T05:30:06.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03000af240 0x7f03000c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:06.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f030015f110 0x7f0300150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:06.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f030015f4f0 0x7f03001511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0300168490 con 0x7f030015f4f0 2024-09-17T05:30:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0300168310 con 0x7f030015f110 2024-09-17T05:30:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0300168610 con 0x7f03000af240 2024-09-17T05:30:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f030015f4f0 0x7f03001511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f030015f4f0 0x7f03001511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38756/0 (socket says 172.21.15.31:38756) 2024-09-17T05:30:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306400640 1 -- 172.21.15.31:0/4274686807 learned_addr learned my addr 172.21.15.31:0/4274686807 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0305000640 1 --2- 172.21.15.31:0/4274686807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f030015f110 0x7f0300150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0305a00640 1 --2- 172.21.15.31:0/4274686807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03000af240 0x7f03000c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306400640 1 -- 172.21.15.31:0/4274686807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03000af240 msgr2=0x7f03000c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:06.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306400640 1 --2- 172.21.15.31:0/4274686807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03000af240 0x7f03000c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306400640 1 -- 172.21.15.31:0/4274686807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f030015f110 msgr2=0x7f0300150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:06.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306400640 1 --2- 172.21.15.31:0/4274686807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f030015f110 0x7f0300150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306400640 1 -- 172.21.15.31:0/4274686807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03001f6d90 con 0x7f030015f4f0 2024-09-17T05:30:06.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306400640 1 --2- 172.21.15.31:0/4274686807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f030015f4f0 0x7f03001511a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f02f8001ec0 tx=0x7f02f800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:06.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f02fd600640 1 -- 172.21.15.31:0/4274686807 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f8017070 con 0x7f030015f4f0 2024-09-17T05:30:06.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f02fd600640 1 -- 172.21.15.31:0/4274686807 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02f80053c0 con 0x7f030015f4f0 2024-09-17T05:30:06.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306e00640 1 -- 172.21.15.31:0/4274686807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03001f73d0 con 0x7f030015f4f0 2024-09-17T05:30:06.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f02fd600640 1 -- 172.21.15.31:0/4274686807 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f8003860 con 0x7f030015f4f0 2024-09-17T05:30:06.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306e00640 1 -- 172.21.15.31:0/4274686807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03001f7990 con 0x7f030015f4f0 2024-09-17T05:30:06.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.508+0000 7f0306e00640 1 -- 172.21.15.31:0/4274686807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03000af770 con 0x7f030015f4f0 2024-09-17T05:30:06.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.512+0000 7f02fd600640 1 -- 172.21.15.31:0/4274686807 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f02f801a070 con 0x7f030015f4f0 2024-09-17T05:30:06.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.512+0000 7f02fd600640 1 --2- 172.21.15.31:0/4274686807 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f02e00733b0 0x7f02e0075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:06.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.512+0000 7f02fd600640 1 -- 172.21.15.31:0/4274686807 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f02f8093a30 con 0x7f030015f4f0 2024-09-17T05:30:06.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.512+0000 7f0305a00640 1 --2- 172.21.15.31:0/4274686807 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f02e00733b0 0x7f02e0075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:06.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.512+0000 7f0305a00640 1 --2- 172.21.15.31:0/4274686807 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f02e00733b0 0x7f02e0075870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f02f40af000 tx=0x7f02f401b5c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:06.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.516+0000 7f02fd600640 1 -- 172.21.15.31:0/4274686807 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f02f805e6b0 con 0x7f030015f4f0 2024-09-17T05:30:06.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.696+0000 7f0306e00640 1 -- 172.21.15.31:0/4274686807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0300073b60 con 0x7f030015f4f0 2024-09-17T05:30:06.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.696+0000 7f02fd600640 1 -- 172.21.15.31:0/4274686807 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+16710 (secure 0 0 0) 0x7f02f805dfb0 con 0x7f030015f4f0 2024-09-17T05:30:06.701 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:06.701 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":43,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:30:05.719889+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:30:03.431634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T05:30:04.672605+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:30:06.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.696+0000 7f0306e00640 1 -- 172.21.15.31:0/4274686807 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f02e00733b0 msgr2=0x7f02e0075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.696+0000 7f0306e00640 1 --2- 172.21.15.31:0/4274686807 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f02e00733b0 0x7f02e0075870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f02f40af000 tx=0x7f02f401b5c0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.696+0000 7f0306e00640 1 -- 172.21.15.31:0/4274686807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f030015f4f0 msgr2=0x7f03001511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.696+0000 7f0306e00640 1 --2- 172.21.15.31:0/4274686807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f030015f4f0 0x7f03001511a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f02f8001ec0 tx=0x7f02f800c890 comp rx=0 tx=0).stop 2024-09-17T05:30:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.696+0000 7f0306e00640 1 -- 172.21.15.31:0/4274686807 shutdown_connections 2024-09-17T05:30:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.696+0000 7f0306e00640 1 --2- 172.21.15.31:0/4274686807 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f02e00733b0 0x7f02e0075870 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.696+0000 7f0306e00640 1 --2- 172.21.15.31:0/4274686807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f030015f4f0 0x7f03001511a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.696+0000 7f0306e00640 1 --2- 172.21.15.31:0/4274686807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f030015f110 0x7f0300150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.696+0000 7f0306e00640 1 --2- 172.21.15.31:0/4274686807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03000af240 0x7f03000c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.696+0000 7f0306e00640 1 -- 172.21.15.31:0/4274686807 >> 172.21.15.31:0/4274686807 conn(0x7f0300073490 msgr2=0x7f0300153f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:06.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.696+0000 7f0306e00640 1 -- 172.21.15.31:0/4274686807 shutdown_connections 2024-09-17T05:30:06.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.696+0000 7f0306e00640 1 -- 172.21.15.31:0/4274686807 wait complete. 2024-09-17T05:30:06.723 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:30:06.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.864+0000 7f7235e00640 1 -- 172.21.15.31:0/3149320379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72300d0fc0 msgr2=0x7f72300d19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:06.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.864+0000 7f7235e00640 1 --2- 172.21.15.31:0/3149320379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72300d0fc0 0x7f72300d19d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f723006fe30 tx=0x7f722801cd50 comp rx=0 tx=0).stop 2024-09-17T05:30:06.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.864+0000 7f7235e00640 1 -- 172.21.15.31:0/3149320379 shutdown_connections 2024-09-17T05:30:06.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.864+0000 7f7235e00640 1 --2- 172.21.15.31:0/3149320379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72300d0fc0 0x7f72300d19d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.864+0000 7f7235e00640 1 --2- 172.21.15.31:0/3149320379 >> v2:172.21.15.155:3300/0 conn(0x7f72301617b0 0x7f72300d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.864+0000 7f7235e00640 1 --2- 172.21.15.31:0/3149320379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72301613d0 0x7f72300d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.864+0000 7f7235e00640 1 -- 172.21.15.31:0/3149320379 >> 172.21.15.31:0/3149320379 conn(0x7f72300d3e00 msgr2=0x7f72300d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:06.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.864+0000 7f7235e00640 1 -- 172.21.15.31:0/3149320379 shutdown_connections 2024-09-17T05:30:06.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.864+0000 7f7235e00640 1 -- 172.21.15.31:0/3149320379 wait complete. 2024-09-17T05:30:06.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.864+0000 7f7235e00640 1 Processor -- start 2024-09-17T05:30:06.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.864+0000 7f7235e00640 1 -- start start 2024-09-17T05:30:06.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7235e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72300d0fc0 0x7f72300ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:06.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7235e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72301613d0 0x7f7230150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:06.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7235e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72301617b0 0x7f72301fa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:06.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7235e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f72300b70e0 con 0x7f72301617b0 2024-09-17T05:30:06.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7235e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f72300b6f60 con 0x7f72300d0fc0 2024-09-17T05:30:06.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7235e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f72300b7260 con 0x7f72301613d0 2024-09-17T05:30:06.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7235400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72301617b0 0x7f72301fa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:06.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7235400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72301617b0 0x7f72301fa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38780/0 (socket says 172.21.15.31:38780) 2024-09-17T05:30:06.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7235400640 1 -- 172.21.15.31:0/865142114 learned_addr learned my addr 172.21.15.31:0/865142114 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:06.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f722fe00640 1 --2- 172.21.15.31:0/865142114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72301613d0 0x7f7230150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:06.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7234a00640 1 --2- 172.21.15.31:0/865142114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72300d0fc0 0x7f72300ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:06.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7235400640 1 -- 172.21.15.31:0/865142114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72301613d0 msgr2=0x7f7230150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:06.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7235400640 1 --2- 172.21.15.31:0/865142114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72301613d0 0x7f7230150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7235400640 1 -- 172.21.15.31:0/865142114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72300d0fc0 msgr2=0x7f72300ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:06.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7235400640 1 --2- 172.21.15.31:0/865142114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72300d0fc0 0x7f72300ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:06.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7235400640 1 -- 172.21.15.31:0/865142114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7230150e10 con 0x7f72301617b0 2024-09-17T05:30:06.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7235400640 1 --2- 172.21.15.31:0/865142114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72301617b0 0x7f72301fa970 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7228009bd0 tx=0x7f72280092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:06.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f722cc00640 1 -- 172.21.15.31:0/865142114 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72280bb070 con 0x7f72301617b0 2024-09-17T05:30:06.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f722cc00640 1 -- 172.21.15.31:0/865142114 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7228004d40 con 0x7f72301617b0 2024-09-17T05:30:06.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f722cc00640 1 -- 172.21.15.31:0/865142114 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72280b2040 con 0x7f72301617b0 2024-09-17T05:30:06.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7235e00640 1 -- 172.21.15.31:0/865142114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72301510f0 con 0x7f72301617b0 2024-09-17T05:30:06.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7235e00640 1 -- 172.21.15.31:0/865142114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7230159d70 con 0x7f72301617b0 2024-09-17T05:30:06.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f7235e00640 1 -- 172.21.15.31:0/865142114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72301514e0 con 0x7f72301617b0 2024-09-17T05:30:06.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.868+0000 7f722cc00640 1 -- 172.21.15.31:0/865142114 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f72280be070 con 0x7f72301617b0 2024-09-17T05:30:06.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.872+0000 7f722cc00640 1 --2- 172.21.15.31:0/865142114 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f72100733b0 0x7f7210075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:06.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.872+0000 7f722cc00640 1 -- 172.21.15.31:0/865142114 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f722812e1b0 con 0x7f72301617b0 2024-09-17T05:30:06.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.872+0000 7f7234a00640 1 --2- 172.21.15.31:0/865142114 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f72100733b0 0x7f7210075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:06.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.872+0000 7f7234a00640 1 --2- 172.21.15.31:0/865142114 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f72100733b0 0x7f7210075870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f722400bb70 tx=0x7f722400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:06.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:06.876+0000 7f722cc00640 1 -- 172.21.15.31:0/865142114 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7228016970 con 0x7f72301617b0 2024-09-17T05:30:07.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.052+0000 7f7235e00640 1 -- 172.21.15.31:0/865142114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72300d19d0 con 0x7f72301617b0 2024-09-17T05:30:07.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.052+0000 7f722cc00640 1 -- 172.21.15.31:0/865142114 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+16710 (secure 0 0 0) 0x7f72280f89a0 con 0x7f72301617b0 2024-09-17T05:30:07.057 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:07.058 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":43,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:30:05.719889+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:30:03.431634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T05:30:04.672605+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:30:07.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.056+0000 7f7235e00640 1 -- 172.21.15.31:0/865142114 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f72100733b0 msgr2=0x7f7210075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:07.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.056+0000 7f7235e00640 1 --2- 172.21.15.31:0/865142114 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f72100733b0 0x7f7210075870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f722400bb70 tx=0x7f722400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:30:07.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.056+0000 7f7235e00640 1 -- 172.21.15.31:0/865142114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72301617b0 msgr2=0x7f72301fa970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:07.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.056+0000 7f7235e00640 1 --2- 172.21.15.31:0/865142114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72301617b0 0x7f72301fa970 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7228009bd0 tx=0x7f72280092c0 comp rx=0 tx=0).stop 2024-09-17T05:30:07.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.056+0000 7f7235e00640 1 -- 172.21.15.31:0/865142114 shutdown_connections 2024-09-17T05:30:07.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.056+0000 7f7235e00640 1 --2- 172.21.15.31:0/865142114 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f72100733b0 0x7f7210075870 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:07.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.056+0000 7f7235e00640 1 --2- 172.21.15.31:0/865142114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72301617b0 0x7f72301fa970 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:07.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.056+0000 7f7235e00640 1 --2- 172.21.15.31:0/865142114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72301613d0 0x7f7230150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:07.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.056+0000 7f7235e00640 1 --2- 172.21.15.31:0/865142114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72300d0fc0 0x7f72300ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:07.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.056+0000 7f7235e00640 1 -- 172.21.15.31:0/865142114 >> 172.21.15.31:0/865142114 conn(0x7f72300d3e00 msgr2=0x7f723006ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:07.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.056+0000 7f7235e00640 1 -- 172.21.15.31:0/865142114 shutdown_connections 2024-09-17T05:30:07.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.056+0000 7f7235e00640 1 -- 172.21.15.31:0/865142114 wait complete. 2024-09-17T05:30:07.080 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:30:07.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.224+0000 7f5add200640 1 -- 172.21.15.31:0/1706158738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ad806ffd0 msgr2=0x7f5ad80cc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:07.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.224+0000 7f5add200640 1 --2- 172.21.15.31:0/1706158738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ad806ffd0 0x7f5ad80cc740 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009840 tx=0x7f5ac001c790 comp rx=0 tx=0).stop 2024-09-17T05:30:07.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.224+0000 7f5add200640 1 -- 172.21.15.31:0/1706158738 shutdown_connections 2024-09-17T05:30:07.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.224+0000 7f5add200640 1 --2- 172.21.15.31:0/1706158738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ad80ccc80 0x7f5ad8164fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:07.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.224+0000 7f5add200640 1 --2- 172.21.15.31:0/1706158738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ad806ffd0 0x7f5ad80cc740 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:07.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.224+0000 7f5add200640 1 -- 172.21.15.31:0/1706158738 >> 172.21.15.31:0/1706158738 conn(0x7f5ad80b18f0 msgr2=0x7f5ad80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:07.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.224+0000 7f5add200640 1 -- 172.21.15.31:0/1706158738 shutdown_connections 2024-09-17T05:30:07.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.224+0000 7f5add200640 1 -- 172.21.15.31:0/1706158738 wait complete. 2024-09-17T05:30:07.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5add200640 1 Processor -- start 2024-09-17T05:30:07.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5add200640 1 -- start start 2024-09-17T05:30:07.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5add200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ad806ffd0 0x7f5ad8072c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:07.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5add200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ad8070960 0x7f5ad80b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:07.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5add200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ad80ccc80 0x7f5ad80b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:07.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5add200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad8167f40 con 0x7f5ad806ffd0 2024-09-17T05:30:07.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5add200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad80cd230 con 0x7f5ad8070960 2024-09-17T05:30:07.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5add200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad81680c0 con 0x7f5ad80ccc80 2024-09-17T05:30:07.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5ad5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ad806ffd0 0x7f5ad8072c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:07.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5ad5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ad806ffd0 0x7f5ad8072c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38792/0 (socket says 172.21.15.31:38792) 2024-09-17T05:30:07.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5ad5e00640 1 -- 172.21.15.31:0/1306274465 learned_addr learned my addr 172.21.15.31:0/1306274465 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:07.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5acfe00640 1 --2- 172.21.15.31:0/1306274465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ad8070960 0x7f5ad80b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:07.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5ad6800640 1 --2- 172.21.15.31:0/1306274465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ad80ccc80 0x7f5ad80b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:07.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5ad5e00640 1 -- 172.21.15.31:0/1306274465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ad80ccc80 msgr2=0x7f5ad80b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:07.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5ad5e00640 1 --2- 172.21.15.31:0/1306274465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ad80ccc80 0x7f5ad80b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:07.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5ad5e00640 1 -- 172.21.15.31:0/1306274465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ad8070960 msgr2=0x7f5ad80b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:07.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5ad5e00640 1 --2- 172.21.15.31:0/1306274465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ad8070960 0x7f5ad80b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:07.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5ad5e00640 1 -- 172.21.15.31:0/1306274465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad80735c0 con 0x7f5ad806ffd0 2024-09-17T05:30:07.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5ad5e00640 1 --2- 172.21.15.31:0/1306274465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ad806ffd0 0x7f5ad8072c40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800c4c0 tx=0x7f5ac800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:07.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5ace000640 1 -- 172.21.15.31:0/1306274465 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8016020 con 0x7f5ad806ffd0 2024-09-17T05:30:07.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5ace000640 1 -- 172.21.15.31:0/1306274465 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ac8012940 con 0x7f5ad806ffd0 2024-09-17T05:30:07.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5ace000640 1 -- 172.21.15.31:0/1306274465 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8012d90 con 0x7f5ad806ffd0 2024-09-17T05:30:07.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5add200640 1 -- 172.21.15.31:0/1306274465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad80738a0 con 0x7f5ad806ffd0 2024-09-17T05:30:07.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5add200640 1 -- 172.21.15.31:0/1306274465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad8073e60 con 0x7f5ad806ffd0 2024-09-17T05:30:07.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.228+0000 7f5add200640 1 -- 172.21.15.31:0/1306274465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad8069410 con 0x7f5ad806ffd0 2024-09-17T05:30:07.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.232+0000 7f5ace000640 1 -- 172.21.15.31:0/1306274465 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f5ac8019020 con 0x7f5ad806ffd0 2024-09-17T05:30:07.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.232+0000 7f5ace000640 1 --2- 172.21.15.31:0/1306274465 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5ab40733e0 0x7f5ab40758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:07.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.232+0000 7f5ace000640 1 -- 172.21.15.31:0/1306274465 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5709+0+0 (secure 0 0 0) 0x7f5ac8094720 con 0x7f5ad806ffd0 2024-09-17T05:30:07.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.232+0000 7f5acfe00640 1 --2- 172.21.15.31:0/1306274465 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5ab40733e0 0x7f5ab40758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:07.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.232+0000 7f5acfe00640 1 --2- 172.21.15.31:0/1306274465 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5ab40733e0 0x7f5ab40758a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00af000 tx=0x7f5ac001afd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:07.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.236+0000 7f5ace000640 1 -- 172.21.15.31:0/1306274465 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5ac8020020 con 0x7f5ad806ffd0 2024-09-17T05:30:07.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:07.456+0000 7f5add200640 1 -- 172.21.15.31:0/1306274465 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5ad80cd3d0 con 0x7f5ad806ffd0 2024-09-17T05:30:08.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.324+0000 7f5ace000640 1 -- 172.21.15.31:0/1306274465 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7f5ac805f3e0 con 0x7f5ad806ffd0 2024-09-17T05:30:08.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.328+0000 7f5add200640 1 -- 172.21.15.31:0/1306274465 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5ab40733e0 msgr2=0x7f5ab40758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:08.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.328+0000 7f5add200640 1 --2- 172.21.15.31:0/1306274465 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5ab40733e0 0x7f5ab40758a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00af000 tx=0x7f5ac001afd0 comp rx=0 tx=0).stop 2024-09-17T05:30:08.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.328+0000 7f5add200640 1 -- 172.21.15.31:0/1306274465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ad806ffd0 msgr2=0x7f5ad8072c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:08.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.328+0000 7f5add200640 1 --2- 172.21.15.31:0/1306274465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ad806ffd0 0x7f5ad8072c40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800c4c0 tx=0x7f5ac800c980 comp rx=0 tx=0).stop 2024-09-17T05:30:08.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.328+0000 7f5add200640 1 -- 172.21.15.31:0/1306274465 shutdown_connections 2024-09-17T05:30:08.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.328+0000 7f5add200640 1 --2- 172.21.15.31:0/1306274465 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5ab40733e0 0x7f5ab40758a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:08.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.328+0000 7f5add200640 1 --2- 172.21.15.31:0/1306274465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ad80ccc80 0x7f5ad80b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:08.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.328+0000 7f5add200640 1 --2- 172.21.15.31:0/1306274465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ad8070960 0x7f5ad80b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:08.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.328+0000 7f5add200640 1 --2- 172.21.15.31:0/1306274465 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ad806ffd0 0x7f5ad8072c40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:08.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.328+0000 7f5add200640 1 -- 172.21.15.31:0/1306274465 >> 172.21.15.31:0/1306274465 conn(0x7f5ad80b18f0 msgr2=0x7f5ad80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:08.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.328+0000 7f5add200640 1 -- 172.21.15.31:0/1306274465 shutdown_connections 2024-09-17T05:30:08.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.328+0000 7f5add200640 1 -- 172.21.15.31:0/1306274465 wait complete. 2024-09-17T05:30:08.359 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:30:08.359 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:30:08.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd48d600640 1 -- 172.21.15.31:0/716970830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd46c003a10 msgr2=0x7fd46c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:08.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd48d600640 1 --2- 172.21.15.31:0/716970830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd46c003a10 0x7fd46c003e10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd478001770 tx=0x7fd47801c7c0 comp rx=0 tx=0).stop 2024-09-17T05:30:08.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd48d600640 1 -- 172.21.15.31:0/716970830 shutdown_connections 2024-09-17T05:30:08.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd48d600640 1 --2- 172.21.15.31:0/716970830 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd46c003a10 0x7fd46c003e10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:08.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd48d600640 1 -- 172.21.15.31:0/716970830 >> 172.21.15.31:0/716970830 conn(0x7fd4880d0cd0 msgr2=0x7fd4880d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:08.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd48d600640 1 -- 172.21.15.31:0/716970830 shutdown_connections 2024-09-17T05:30:08.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd48d600640 1 -- 172.21.15.31:0/716970830 wait complete. 2024-09-17T05:30:08.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd48d600640 1 Processor -- start 2024-09-17T05:30:08.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd48d600640 1 -- start start 2024-09-17T05:30:08.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd48d600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd46c003a10 0x7fd4880c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:08.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd48d600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4880b4160 0x7fd4881f7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:08.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd48d600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd48815f990 0x7fd4880b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:08.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd48d600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd48806d370 con 0x7fd4880b4160 2024-09-17T05:30:08.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd48d600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd48806d1f0 con 0x7fd46c003a10 2024-09-17T05:30:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd48d600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd48806d4f0 con 0x7fd48815f990 2024-09-17T05:30:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd47fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4880b4160 0x7fd4881f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd47fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4880b4160 0x7fd4881f7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38806/0 (socket says 172.21.15.31:38806) 2024-09-17T05:30:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd47fe00640 1 -- 172.21.15.31:0/2638320638 learned_addr learned my addr 172.21.15.31:0/2638320638 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd486a00640 1 --2- 172.21.15.31:0/2638320638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd46c003a10 0x7fd4880c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.512+0000 7fd487400640 1 --2- 172.21.15.31:0/2638320638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd48815f990 0x7fd4880b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.516+0000 7fd47fe00640 1 -- 172.21.15.31:0/2638320638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd48815f990 msgr2=0x7fd4880b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.516+0000 7fd47fe00640 1 --2- 172.21.15.31:0/2638320638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd48815f990 0x7fd4880b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.516+0000 7fd47fe00640 1 -- 172.21.15.31:0/2638320638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd46c003a10 msgr2=0x7fd4880c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.516+0000 7fd47fe00640 1 --2- 172.21.15.31:0/2638320638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd46c003a10 0x7fd4880c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.516+0000 7fd47fe00640 1 -- 172.21.15.31:0/2638320638 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48815e810 con 0x7fd4880b4160 2024-09-17T05:30:08.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.516+0000 7fd47fe00640 1 --2- 172.21.15.31:0/2638320638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4880b4160 0x7fd4881f7270 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd470001250 tx=0x7fd47000ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:08.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.516+0000 7fd47ea00640 1 -- 172.21.15.31:0/2638320638 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd470015020 con 0x7fd4880b4160 2024-09-17T05:30:08.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.516+0000 7fd47ea00640 1 -- 172.21.15.31:0/2638320638 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd470010980 con 0x7fd4880b4160 2024-09-17T05:30:08.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.516+0000 7fd48d600640 1 -- 172.21.15.31:0/2638320638 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd48815eaf0 con 0x7fd4880b4160 2024-09-17T05:30:08.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.516+0000 7fd47ea00640 1 -- 172.21.15.31:0/2638320638 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd470010dd0 con 0x7fd4880b4160 2024-09-17T05:30:08.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.516+0000 7fd48d600640 1 -- 172.21.15.31:0/2638320638 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd48815f0b0 con 0x7fd4880b4160 2024-09-17T05:30:08.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.516+0000 7fd48d600640 1 -- 172.21.15.31:0/2638320638 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4880cf830 con 0x7fd4880b4160 2024-09-17T05:30:08.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.516+0000 7fd47ea00640 1 -- 172.21.15.31:0/2638320638 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7fd470018020 con 0x7fd4880b4160 2024-09-17T05:30:08.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.520+0000 7fd47ea00640 1 --2- 172.21.15.31:0/2638320638 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd4640733b0 0x7fd464075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:08.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.520+0000 7fd47ea00640 1 -- 172.21.15.31:0/2638320638 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fd470094c30 con 0x7fd4880b4160 2024-09-17T05:30:08.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.520+0000 7fd486a00640 1 --2- 172.21.15.31:0/2638320638 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd4640733b0 0x7fd464075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.520+0000 7fd486a00640 1 --2- 172.21.15.31:0/2638320638 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd4640733b0 0x7fd464075870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd4780a8000 tx=0x7fd478019560 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:08.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.524+0000 7fd47ea00640 1 -- 172.21.15.31:0/2638320638 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd47001f020 con 0x7fd4880b4160 2024-09-17T05:30:08.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:08.732+0000 7fd48d600640 1 -- 172.21.15.31:0/2638320638 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd4880ce270 con 0x7fd4880b4160 2024-09-17T05:30:09.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.328+0000 7fd47ea00640 1 -- 172.21.15.31:0/2638320638 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7fd47005f320 con 0x7fd4880b4160 2024-09-17T05:30:09.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.332+0000 7fd48d600640 1 -- 172.21.15.31:0/2638320638 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd4640733b0 msgr2=0x7fd464075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:09.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.332+0000 7fd48d600640 1 --2- 172.21.15.31:0/2638320638 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd4640733b0 0x7fd464075870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd4780a8000 tx=0x7fd478019560 comp rx=0 tx=0).stop 2024-09-17T05:30:09.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.332+0000 7fd48d600640 1 -- 172.21.15.31:0/2638320638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4880b4160 msgr2=0x7fd4881f7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:09.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.332+0000 7fd48d600640 1 --2- 172.21.15.31:0/2638320638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4880b4160 0x7fd4881f7270 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd470001250 tx=0x7fd47000ea20 comp rx=0 tx=0).stop 2024-09-17T05:30:09.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.332+0000 7fd48d600640 1 -- 172.21.15.31:0/2638320638 shutdown_connections 2024-09-17T05:30:09.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.332+0000 7fd48d600640 1 --2- 172.21.15.31:0/2638320638 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd4640733b0 0x7fd464075870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:09.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.332+0000 7fd48d600640 1 --2- 172.21.15.31:0/2638320638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd48815f990 0x7fd4880b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:09.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.332+0000 7fd48d600640 1 --2- 172.21.15.31:0/2638320638 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4880b4160 0x7fd4881f7270 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:09.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.332+0000 7fd48d600640 1 --2- 172.21.15.31:0/2638320638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd46c003a10 0x7fd4880c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:09.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.332+0000 7fd48d600640 1 -- 172.21.15.31:0/2638320638 >> 172.21.15.31:0/2638320638 conn(0x7fd4880d0cd0 msgr2=0x7fd4880cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:09.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.332+0000 7fd48d600640 1 -- 172.21.15.31:0/2638320638 shutdown_connections 2024-09-17T05:30:09.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.332+0000 7fd48d600640 1 -- 172.21.15.31:0/2638320638 wait complete. 2024-09-17T05:30:09.362 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:30:09.362 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:30:09.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.508+0000 7f9245400640 1 -- 172.21.15.31:0/2333862320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92400cdb30 msgr2=0x7f92400af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:09.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.508+0000 7f9245400640 1 --2- 172.21.15.31:0/2333862320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92400cdb30 0x7f92400af0c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9238009bc0 tx=0x7f923801cba0 comp rx=0 tx=0).stop 2024-09-17T05:30:09.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.508+0000 7f9245400640 1 -- 172.21.15.31:0/2333862320 shutdown_connections 2024-09-17T05:30:09.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.508+0000 7f9245400640 1 --2- 172.21.15.31:0/2333862320 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92400cdb30 0x7f92400af0c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:09.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.508+0000 7f9245400640 1 -- 172.21.15.31:0/2333862320 >> 172.21.15.31:0/2333862320 conn(0x7f92400d1dc0 msgr2=0x7f92400d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:09.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.508+0000 7f9245400640 1 -- 172.21.15.31:0/2333862320 shutdown_connections 2024-09-17T05:30:09.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.508+0000 7f9245400640 1 -- 172.21.15.31:0/2333862320 wait complete. 2024-09-17T05:30:09.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.508+0000 7f9245400640 1 Processor -- start 2024-09-17T05:30:09.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.508+0000 7f9245400640 1 -- start start 2024-09-17T05:30:09.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f9245400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92400cdb30 0x7f9240159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:09.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f9245400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92400ced80 0x7f92400cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:09.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f9245400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f924015bea0 0x7f92401f8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:09.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f9245400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f924016a8a0 con 0x7f92400cdb30 2024-09-17T05:30:09.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f9245400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f924016a720 con 0x7f924015bea0 2024-09-17T05:30:09.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f9245400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f924016aa20 con 0x7f92400ced80 2024-09-17T05:30:09.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f923e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92400cdb30 0x7f9240159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:09.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f923e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92400cdb30 0x7f9240159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44928/0 (socket says 172.21.15.31:44928) 2024-09-17T05:30:09.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f923e800640 1 -- 172.21.15.31:0/419154190 learned_addr learned my addr 172.21.15.31:0/419154190 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:09.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f923f200640 1 --2- 172.21.15.31:0/419154190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f924015bea0 0x7f92401f8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:09.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f923de00640 1 --2- 172.21.15.31:0/419154190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92400ced80 0x7f92400cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:09.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f923e800640 1 -- 172.21.15.31:0/419154190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92400ced80 msgr2=0x7f92400cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:09.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f923e800640 1 --2- 172.21.15.31:0/419154190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92400ced80 0x7f92400cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:09.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f923e800640 1 -- 172.21.15.31:0/419154190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f924015bea0 msgr2=0x7f92401f8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:09.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f923e800640 1 --2- 172.21.15.31:0/419154190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f924015bea0 0x7f92401f8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:09.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f923e800640 1 -- 172.21.15.31:0/419154190 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92400ca010 con 0x7f92400cdb30 2024-09-17T05:30:09.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f923e800640 1 --2- 172.21.15.31:0/419154190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92400cdb30 0x7f9240159fa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f923000b410 tx=0x7f923000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:09.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f9236a00640 1 -- 172.21.15.31:0/419154190 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9230015030 con 0x7f92400cdb30 2024-09-17T05:30:09.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f9236a00640 1 -- 172.21.15.31:0/419154190 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9230004020 con 0x7f92400cdb30 2024-09-17T05:30:09.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f9236a00640 1 -- 172.21.15.31:0/419154190 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92300044b0 con 0x7f92400cdb30 2024-09-17T05:30:09.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f9245400640 1 -- 172.21.15.31:0/419154190 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92400ca2f0 con 0x7f92400cdb30 2024-09-17T05:30:09.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f9245400640 1 -- 172.21.15.31:0/419154190 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92400ca8b0 con 0x7f92400cdb30 2024-09-17T05:30:09.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.512+0000 7f9245400640 1 -- 172.21.15.31:0/419154190 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92400ce670 con 0x7f92400cdb30 2024-09-17T05:30:09.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.516+0000 7f9236a00640 1 -- 172.21.15.31:0/419154190 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f9230018070 con 0x7f92400cdb30 2024-09-17T05:30:09.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.516+0000 7f9236a00640 1 --2- 172.21.15.31:0/419154190 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f92200733b0 0x7f9220075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:09.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.516+0000 7f9236a00640 1 -- 172.21.15.31:0/419154190 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f9230094080 con 0x7f92400cdb30 2024-09-17T05:30:09.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.516+0000 7f923de00640 1 --2- 172.21.15.31:0/419154190 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f92200733b0 0x7f9220075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:09.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.516+0000 7f923de00640 1 --2- 172.21.15.31:0/419154190 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f92200733b0 0x7f9220075870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f924006e100 tx=0x7f922c007ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:09.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.520+0000 7f9236a00640 1 -- 172.21.15.31:0/419154190 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f923005e740 con 0x7f92400cdb30 2024-09-17T05:30:09.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.728+0000 7f9245400640 1 -- 172.21.15.31:0/419154190 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92400cc040 con 0x7f92400cdb30 2024-09-17T05:30:09.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.732+0000 7f9236a00640 1 -- 172.21.15.31:0/419154190 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5223 (secure 0 0 0) 0x7f9230063170 con 0x7f92400cdb30 2024-09-17T05:30:09.736 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:09.736 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":28,"btime":"2024-09-17T05:30:09:329600+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:30:09.737 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 28 2024-09-17T05:30:09.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.732+0000 7f9245400640 1 -- 172.21.15.31:0/419154190 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f92200733b0 msgr2=0x7f9220075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:09.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.732+0000 7f9245400640 1 --2- 172.21.15.31:0/419154190 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f92200733b0 0x7f9220075870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f924006e100 tx=0x7f922c007ea0 comp rx=0 tx=0).stop 2024-09-17T05:30:09.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.732+0000 7f9245400640 1 -- 172.21.15.31:0/419154190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92400cdb30 msgr2=0x7f9240159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:09.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.732+0000 7f9245400640 1 --2- 172.21.15.31:0/419154190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92400cdb30 0x7f9240159fa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f923000b410 tx=0x7f923000b8d0 comp rx=0 tx=0).stop 2024-09-17T05:30:09.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.732+0000 7f9245400640 1 -- 172.21.15.31:0/419154190 shutdown_connections 2024-09-17T05:30:09.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.732+0000 7f9245400640 1 --2- 172.21.15.31:0/419154190 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f92200733b0 0x7f9220075870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:09.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.732+0000 7f9245400640 1 --2- 172.21.15.31:0/419154190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f924015bea0 0x7f92401f8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:09.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.732+0000 7f9245400640 1 --2- 172.21.15.31:0/419154190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f92400ced80 0x7f92400cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:09.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.732+0000 7f9245400640 1 --2- 172.21.15.31:0/419154190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f92400cdb30 0x7f9240159fa0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:09.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.732+0000 7f9245400640 1 -- 172.21.15.31:0/419154190 >> 172.21.15.31:0/419154190 conn(0x7f92400d1dc0 msgr2=0x7f92400d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:09.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.732+0000 7f9245400640 1 -- 172.21.15.31:0/419154190 shutdown_connections 2024-09-17T05:30:09.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.732+0000 7f9245400640 1 -- 172.21.15.31:0/419154190 wait complete. 2024-09-17T05:30:09.759 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:30:09.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.900+0000 7f58f8200640 1 -- 172.21.15.31:0/4218478449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d8004d50 msgr2=0x7f58d80051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:09.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.900+0000 7f58f8200640 1 --2- 172.21.15.31:0/4218478449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d8004d50 0x7f58d80051b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009ee0 tx=0x7f58e801d5f0 comp rx=0 tx=0).stop 2024-09-17T05:30:09.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.900+0000 7f58f6200640 1 -- 172.21.15.31:0/4218478449 reap_dead start 2024-09-17T05:30:09.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.900+0000 7f58f8200640 1 -- 172.21.15.31:0/4218478449 shutdown_connections 2024-09-17T05:30:09.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.900+0000 7f58f8200640 1 -- 172.21.15.31:0/4218478449 >> 172.21.15.31:0/4218478449 conn(0x7f58f00d1da0 msgr2=0x7f58f00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:09.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.900+0000 7f58f8200640 1 -- 172.21.15.31:0/4218478449 shutdown_connections 2024-09-17T05:30:09.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.900+0000 7f58f8200640 1 -- 172.21.15.31:0/4218478449 wait complete. 2024-09-17T05:30:09.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.900+0000 7f58f8200640 1 Processor -- start 2024-09-17T05:30:09.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.900+0000 7f58f8200640 1 -- start start 2024-09-17T05:30:09.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58f8200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d8004d50 0x7f58f01eebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:09.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58f8200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58f0159890 0x7f58f01f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:09.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58f8200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58f01f5c00 0x7f58f01f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:09.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58f8200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f58f00ccfc0 con 0x7f58d8004d50 2024-09-17T05:30:09.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58f8200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f58f00d2b50 con 0x7f58f01f5c00 2024-09-17T05:30:09.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58f8200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f58f00cd140 con 0x7f58f0159890 2024-09-17T05:30:09.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58f5800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d8004d50 0x7f58f01eebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:09.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58f5800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d8004d50 0x7f58f01eebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44946/0 (socket says 172.21.15.31:44946) 2024-09-17T05:30:09.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58f5800640 1 -- 172.21.15.31:0/1787192996 learned_addr learned my addr 172.21.15.31:0/1787192996 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:09.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58f5800640 1 -- 172.21.15.31:0/1787192996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58f0159890 msgr2=0x7f58f01f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:09.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58f5800640 1 --2- 172.21.15.31:0/1787192996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58f0159890 0x7f58f01f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:09.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58f5800640 1 -- 172.21.15.31:0/1787192996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58f01f5c00 msgr2=0x7f58f01f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:09.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58f5800640 1 --2- 172.21.15.31:0/1787192996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58f01f5c00 0x7f58f01f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:09.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58f5800640 1 -- 172.21.15.31:0/1787192996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f01f5a00 con 0x7f58d8004d50 2024-09-17T05:30:09.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58f5800640 1 --2- 172.21.15.31:0/1787192996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d8004d50 0x7f58f01eebb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f58e4003ed0 tx=0x7f58e4001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:09.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58ed600640 1 -- 172.21.15.31:0/1787192996 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4015070 con 0x7f58d8004d50 2024-09-17T05:30:09.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58ed600640 1 -- 172.21.15.31:0/1787192996 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58e4011840 con 0x7f58d8004d50 2024-09-17T05:30:09.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58ed600640 1 -- 172.21.15.31:0/1787192996 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4011c30 con 0x7f58d8004d50 2024-09-17T05:30:09.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58f8200640 1 -- 172.21.15.31:0/1787192996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f006df40 con 0x7f58d8004d50 2024-09-17T05:30:09.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58f8200640 1 -- 172.21.15.31:0/1787192996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f006e500 con 0x7f58d8004d50 2024-09-17T05:30:09.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.904+0000 7f58f8200640 1 -- 172.21.15.31:0/1787192996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58f00cc8b0 con 0x7f58d8004d50 2024-09-17T05:30:09.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.908+0000 7f58ed600640 1 -- 172.21.15.31:0/1787192996 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f58e4018070 con 0x7f58d8004d50 2024-09-17T05:30:09.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.908+0000 7f58ed600640 1 --2- 172.21.15.31:0/1787192996 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f58d00733e0 0x7f58d00758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:09.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.908+0000 7f58ed600640 1 -- 172.21.15.31:0/1787192996 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f58e40950f0 con 0x7f58d8004d50 2024-09-17T05:30:09.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.908+0000 7f58f4e00640 1 --2- 172.21.15.31:0/1787192996 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f58d00733e0 0x7f58d00758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:09.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.908+0000 7f58f4e00640 1 --2- 172.21.15.31:0/1787192996 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f58d00733e0 0x7f58d00758a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f58dc000fe0 tx=0x7f58dc001e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:09.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:09.912+0000 7f58ed600640 1 -- 172.21.15.31:0/1787192996 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f58f01f5a00 con 0x7f58d8004d50 2024-09-17T05:30:10.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.088+0000 7f58f8200640 1 -- 172.21.15.31:0/1787192996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58f00b77c0 con 0x7f58d8004d50 2024-09-17T05:30:10.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.088+0000 7f58ed600640 1 -- 172.21.15.31:0/1787192996 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16697 (secure 0 0 0) 0x7f58e405fd70 con 0x7f58d8004d50 2024-09-17T05:30:10.094 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:10.095 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":44,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:30:07.295941+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:30:03.431634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T05:30:04.672605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:30:10.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.092+0000 7f58f8200640 1 -- 172.21.15.31:0/1787192996 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f58d00733e0 msgr2=0x7f58d00758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:10.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.092+0000 7f58f8200640 1 --2- 172.21.15.31:0/1787192996 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f58d00733e0 0x7f58d00758a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f58dc000fe0 tx=0x7f58dc001e50 comp rx=0 tx=0).stop 2024-09-17T05:30:10.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.092+0000 7f58f8200640 1 -- 172.21.15.31:0/1787192996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d8004d50 msgr2=0x7f58f01eebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:10.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.092+0000 7f58f8200640 1 --2- 172.21.15.31:0/1787192996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d8004d50 0x7f58f01eebb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f58e4003ed0 tx=0x7f58e4001640 comp rx=0 tx=0).stop 2024-09-17T05:30:10.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.092+0000 7f58f8200640 1 -- 172.21.15.31:0/1787192996 shutdown_connections 2024-09-17T05:30:10.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.092+0000 7f58f8200640 1 --2- 172.21.15.31:0/1787192996 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f58d00733e0 0x7f58d00758a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.092+0000 7f58f8200640 1 --2- 172.21.15.31:0/1787192996 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58f01f5c00 0x7f58f01f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.092+0000 7f58f8200640 1 --2- 172.21.15.31:0/1787192996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58f0159890 0x7f58f01f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.092+0000 7f58f8200640 1 --2- 172.21.15.31:0/1787192996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58d8004d50 0x7f58f01eebb0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.092+0000 7f58f8200640 1 -- 172.21.15.31:0/1787192996 >> 172.21.15.31:0/1787192996 conn(0x7f58f00d1da0 msgr2=0x7f58f0071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:10.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.092+0000 7f58f8200640 1 -- 172.21.15.31:0/1787192996 shutdown_connections 2024-09-17T05:30:10.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.092+0000 7f58f8200640 1 -- 172.21.15.31:0/1787192996 wait complete. 2024-09-17T05:30:10.116 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:30:10.116 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:30:10.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.256+0000 7fd7f2000640 1 -- 172.21.15.31:0/4005217366 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7ec0b2590 msgr2=0x7fd7ec0b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:10.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.256+0000 7fd7f2000640 1 --2- 172.21.15.31:0/4005217366 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7ec0b2590 0x7fd7ec0b29e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec09b750 tx=0x7fd7e401c7a0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f2000640 1 -- 172.21.15.31:0/4005217366 shutdown_connections 2024-09-17T05:30:10.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f2000640 1 --2- 172.21.15.31:0/4005217366 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7ec0b2590 0x7fd7ec0b29e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f2000640 1 --2- 172.21.15.31:0/4005217366 >> v2:172.21.15.155:3300/0 conn(0x7fd7ec15f000 0x7fd7ec0d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f2000640 1 -- 172.21.15.31:0/4005217366 >> 172.21.15.31:0/4005217366 conn(0x7fd7ec09aa10 msgr2=0x7fd7ec09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:10.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f2000640 1 -- 172.21.15.31:0/4005217366 shutdown_connections 2024-09-17T05:30:10.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f2000640 1 -- 172.21.15.31:0/4005217366 wait complete. 2024-09-17T05:30:10.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f2000640 1 Processor -- start 2024-09-17T05:30:10.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f2000640 1 -- start start 2024-09-17T05:30:10.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f2000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7ec0b2590 0x7fd7ec155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:10.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f2000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7ec0cefb0 0x7fd7ec0b68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:10.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f2000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7ec15f000 0x7fd7ec151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:10.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f2000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec168ea0 con 0x7fd7ec15f000 2024-09-17T05:30:10.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f2000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec168d20 con 0x7fd7ec0b2590 2024-09-17T05:30:10.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f2000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd7ec169020 con 0x7fd7ec0cefb0 2024-09-17T05:30:10.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f1600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7ec15f000 0x7fd7ec151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:10.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f1600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7ec15f000 0x7fd7ec151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44962/0 (socket says 172.21.15.31:44962) 2024-09-17T05:30:10.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f1600640 1 -- 172.21.15.31:0/2593917938 learned_addr learned my addr 172.21.15.31:0/2593917938 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:10.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f0c00640 1 --2- 172.21.15.31:0/2593917938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7ec0b2590 0x7fd7ec155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:10.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7ebe00640 1 --2- 172.21.15.31:0/2593917938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7ec0cefb0 0x7fd7ec0b68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:10.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f1600640 1 -- 172.21.15.31:0/2593917938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7ec0cefb0 msgr2=0x7fd7ec0b68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:10.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f1600640 1 --2- 172.21.15.31:0/2593917938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7ec0cefb0 0x7fd7ec0b68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f1600640 1 -- 172.21.15.31:0/2593917938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7ec0b2590 msgr2=0x7fd7ec155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:10.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f1600640 1 --2- 172.21.15.31:0/2593917938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7ec0b2590 0x7fd7ec155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f1600640 1 -- 172.21.15.31:0/2593917938 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ec0b0cb0 con 0x7fd7ec15f000 2024-09-17T05:30:10.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.260+0000 7fd7f1600640 1 --2- 172.21.15.31:0/2593917938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7ec15f000 0x7fd7ec151780 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40193b0 tx=0x7fd7e40a66c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:10.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.264+0000 7fd7e8c00640 1 -- 172.21.15.31:0/2593917938 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40042c0 con 0x7fd7ec15f000 2024-09-17T05:30:10.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.264+0000 7fd7e8c00640 1 -- 172.21.15.31:0/2593917938 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7e4004460 con 0x7fd7ec15f000 2024-09-17T05:30:10.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.264+0000 7fd7f2000640 1 -- 172.21.15.31:0/2593917938 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7ec156410 con 0x7fd7ec15f000 2024-09-17T05:30:10.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.264+0000 7fd7e8c00640 1 -- 172.21.15.31:0/2593917938 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4005290 con 0x7fd7ec15f000 2024-09-17T05:30:10.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.264+0000 7fd7f2000640 1 -- 172.21.15.31:0/2593917938 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7ec1fb140 con 0x7fd7ec15f000 2024-09-17T05:30:10.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.264+0000 7fd7f2000640 1 -- 172.21.15.31:0/2593917938 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7ec0b29e0 con 0x7fd7ec15f000 2024-09-17T05:30:10.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.264+0000 7fd7e8c00640 1 -- 172.21.15.31:0/2593917938 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7fd7e40b7070 con 0x7fd7ec15f000 2024-09-17T05:30:10.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.264+0000 7fd7e8c00640 1 --2- 172.21.15.31:0/2593917938 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd7cc0733b0 0x7fd7cc075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:10.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.264+0000 7fd7e8c00640 1 -- 172.21.15.31:0/2593917938 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fd7e412eb40 con 0x7fd7ec15f000 2024-09-17T05:30:10.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.264+0000 7fd7f0c00640 1 --2- 172.21.15.31:0/2593917938 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd7cc0733b0 0x7fd7cc075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:10.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.268+0000 7fd7f0c00640 1 --2- 172.21.15.31:0/2593917938 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd7cc0733b0 0x7fd7cc075870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0005fd0 tx=0x7fd7e000a780 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:10.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.268+0000 7fd7e8c00640 1 -- 172.21.15.31:0/2593917938 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd7e40ac030 con 0x7fd7ec15f000 2024-09-17T05:30:10.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.444+0000 7fd7f2000640 1 -- 172.21.15.31:0/2593917938 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd7ec0cdf60 con 0x7fd7cc0733b0 2024-09-17T05:30:10.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.448+0000 7fd7e8c00640 1 -- 172.21.15.31:0/2593917938 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243366 (secure 0 0 0) 0x7fd7ec0cdf60 con 0x7fd7cc0733b0 2024-09-17T05:30:10.457 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:10.458 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:30:10.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.452+0000 7fd7f2000640 1 -- 172.21.15.31:0/2593917938 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd7cc0733b0 msgr2=0x7fd7cc075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:10.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.452+0000 7fd7f2000640 1 --2- 172.21.15.31:0/2593917938 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd7cc0733b0 0x7fd7cc075870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0005fd0 tx=0x7fd7e000a780 comp rx=0 tx=0).stop 2024-09-17T05:30:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.452+0000 7fd7f2000640 1 -- 172.21.15.31:0/2593917938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7ec15f000 msgr2=0x7fd7ec151780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.452+0000 7fd7f2000640 1 --2- 172.21.15.31:0/2593917938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7ec15f000 0x7fd7ec151780 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40193b0 tx=0x7fd7e40a66c0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.452+0000 7fd7f2000640 1 -- 172.21.15.31:0/2593917938 shutdown_connections 2024-09-17T05:30:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.452+0000 7fd7f2000640 1 --2- 172.21.15.31:0/2593917938 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd7cc0733b0 0x7fd7cc075870 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.452+0000 7fd7f2000640 1 --2- 172.21.15.31:0/2593917938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7ec15f000 0x7fd7ec151780 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.452+0000 7fd7f2000640 1 --2- 172.21.15.31:0/2593917938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7ec0cefb0 0x7fd7ec0b68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.452+0000 7fd7f2000640 1 --2- 172.21.15.31:0/2593917938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7ec0b2590 0x7fd7ec155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.452+0000 7fd7f2000640 1 -- 172.21.15.31:0/2593917938 >> 172.21.15.31:0/2593917938 conn(0x7fd7ec09aa10 msgr2=0x7fd7ec0af040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.452+0000 7fd7f2000640 1 -- 172.21.15.31:0/2593917938 shutdown_connections 2024-09-17T05:30:10.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.452+0000 7fd7f2000640 1 -- 172.21.15.31:0/2593917938 wait complete. 2024-09-17T05:30:10.477 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-09-17T05:30:09.199184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":117,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":106,"acting":106,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":225248,"kb_used_data":4848,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749472,"statfs":{"total":773094113280,"available":772863459328,"internally_reserved":0,"allocated":4964352,"data_stored":2660491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.910135"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983219+0000","last_change":"2024-09-17T05:30:06.321869+0000","last_active":"2024-09-17T05:30:07.983219+0000","last_peered":"2024-09-17T05:30:07.983219+0000","last_clean":"2024-09-17T05:30:07.983219+0000","last_became_active":"2024-09-17T05:30:06.321455+0000","last_became_peered":"2024-09-17T05:30:06.321455+0000","last_unstale":"2024-09-17T05:30:07.983219+0000","last_undegraded":"2024-09-17T05:30:07.983219+0000","last_fullsized":"2024-09-17T05:30:07.983219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:44.473010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980453+0000","last_change":"2024-09-17T05:30:06.338103+0000","last_active":"2024-09-17T05:30:07.980453+0000","last_peered":"2024-09-17T05:30:07.980453+0000","last_clean":"2024-09-17T05:30:07.980453+0000","last_became_active":"2024-09-17T05:30:06.337712+0000","last_became_peered":"2024-09-17T05:30:06.337712+0000","last_unstale":"2024-09-17T05:30:07.980453+0000","last_undegraded":"2024-09-17T05:30:07.980453+0000","last_fullsized":"2024-09-17T05:30:07.980453+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:01.151033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983371+0000","last_change":"2024-09-17T05:30:06.317638+0000","last_active":"2024-09-17T05:30:07.983371+0000","last_peered":"2024-09-17T05:30:07.983371+0000","last_clean":"2024-09-17T05:30:07.983371+0000","last_became_active":"2024-09-17T05:30:06.315836+0000","last_became_peered":"2024-09-17T05:30:06.315836+0000","last_unstale":"2024-09-17T05:30:07.983371+0000","last_undegraded":"2024-09-17T05:30:07.983371+0000","last_fullsized":"2024-09-17T05:30:07.983371+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:15.759144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979737+0000","last_change":"2024-09-17T05:30:06.335575+0000","last_active":"2024-09-17T05:30:07.979737+0000","last_peered":"2024-09-17T05:30:07.979737+0000","last_clean":"2024-09-17T05:30:07.979737+0000","last_became_active":"2024-09-17T05:30:06.335241+0000","last_became_peered":"2024-09-17T05:30:06.335241+0000","last_unstale":"2024-09-17T05:30:07.979737+0000","last_undegraded":"2024-09-17T05:30:07.979737+0000","last_fullsized":"2024-09-17T05:30:07.979737+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:21.682116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981155+0000","last_change":"2024-09-17T05:30:06.342344+0000","last_active":"2024-09-17T05:30:07.981155+0000","last_peered":"2024-09-17T05:30:07.981155+0000","last_clean":"2024-09-17T05:30:07.981155+0000","last_became_active":"2024-09-17T05:30:06.341691+0000","last_became_peered":"2024-09-17T05:30:06.341691+0000","last_unstale":"2024-09-17T05:30:07.981155+0000","last_undegraded":"2024-09-17T05:30:07.981155+0000","last_fullsized":"2024-09-17T05:30:07.981155+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:44.473010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981052+0000","last_change":"2024-09-17T05:30:06.335792+0000","last_active":"2024-09-17T05:30:07.981052+0000","last_peered":"2024-09-17T05:30:07.981052+0000","last_clean":"2024-09-17T05:30:07.981052+0000","last_became_active":"2024-09-17T05:30:06.335480+0000","last_became_peered":"2024-09-17T05:30:06.335480+0000","last_unstale":"2024-09-17T05:30:07.981052+0000","last_undegraded":"2024-09-17T05:30:07.981052+0000","last_fullsized":"2024-09-17T05:30:07.981052+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:23.591461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980367+0000","last_change":"2024-09-17T05:30:06.341158+0000","last_active":"2024-09-17T05:30:07.980367+0000","last_peered":"2024-09-17T05:30:07.980367+0000","last_clean":"2024-09-17T05:30:07.980367+0000","last_became_active":"2024-09-17T05:30:06.340860+0000","last_became_peered":"2024-09-17T05:30:06.340860+0000","last_unstale":"2024-09-17T05:30:07.980367+0000","last_undegraded":"2024-09-17T05:30:07.980367+0000","last_fullsized":"2024-09-17T05:30:07.980367+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:19.820487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983177+0000","last_change":"2024-09-17T05:30:06.307784+0000","last_active":"2024-09-17T05:30:07.983177+0000","last_peered":"2024-09-17T05:30:07.983177+0000","last_clean":"2024-09-17T05:30:07.983177+0000","last_became_active":"2024-09-17T05:30:06.307523+0000","last_became_peered":"2024-09-17T05:30:06.307523+0000","last_unstale":"2024-09-17T05:30:07.983177+0000","last_undegraded":"2024-09-17T05:30:07.983177+0000","last_fullsized":"2024-09-17T05:30:07.983177+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:46.123430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980003+0000","last_change":"2024-09-17T05:30:06.341111+0000","last_active":"2024-09-17T05:30:07.980003+0000","last_peered":"2024-09-17T05:30:07.980003+0000","last_clean":"2024-09-17T05:30:07.980003+0000","last_became_active":"2024-09-17T05:30:06.340826+0000","last_became_peered":"2024-09-17T05:30:06.340826+0000","last_unstale":"2024-09-17T05:30:07.980003+0000","last_undegraded":"2024-09-17T05:30:07.980003+0000","last_fullsized":"2024-09-17T05:30:07.980003+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:39.847537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980167+0000","last_change":"2024-09-17T05:30:06.336071+0000","last_active":"2024-09-17T05:30:07.980167+0000","last_peered":"2024-09-17T05:30:07.980167+0000","last_clean":"2024-09-17T05:30:07.980167+0000","last_became_active":"2024-09-17T05:30:06.335275+0000","last_became_peered":"2024-09-17T05:30:06.335275+0000","last_unstale":"2024-09-17T05:30:07.980167+0000","last_undegraded":"2024-09-17T05:30:07.980167+0000","last_fullsized":"2024-09-17T05:30:07.980167+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:58.105556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983191+0000","last_change":"2024-09-17T05:30:06.307863+0000","last_active":"2024-09-17T05:30:07.983191+0000","last_peered":"2024-09-17T05:30:07.983191+0000","last_clean":"2024-09-17T05:30:07.983191+0000","last_became_active":"2024-09-17T05:30:06.307597+0000","last_became_peered":"2024-09-17T05:30:06.307597+0000","last_unstale":"2024-09-17T05:30:07.983191+0000","last_undegraded":"2024-09-17T05:30:07.983191+0000","last_fullsized":"2024-09-17T05:30:07.983191+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:23.591461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.289285+0000","last_change":"2024-09-17T05:30:04.289285+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.289285+0000","last_undegraded":"2024-09-17T05:30:04.289285+0000","last_fullsized":"2024-09-17T05:30:04.289285+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.293050+0000","last_change":"2024-09-17T05:30:04.293050+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.293050+0000","last_undegraded":"2024-09-17T05:30:04.293050+0000","last_fullsized":"2024-09-17T05:30:04.293050+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983603+0000","last_change":"2024-09-17T05:30:06.328218+0000","last_active":"2024-09-17T05:30:07.983603+0000","last_peered":"2024-09-17T05:30:07.983603+0000","last_clean":"2024-09-17T05:30:07.983603+0000","last_became_active":"2024-09-17T05:30:06.327401+0000","last_became_peered":"2024-09-17T05:30:06.327401+0000","last_unstale":"2024-09-17T05:30:07.983603+0000","last_undegraded":"2024-09-17T05:30:07.983603+0000","last_fullsized":"2024-09-17T05:30:07.983603+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:02.179760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.288872+0000","last_change":"2024-09-17T05:30:04.288872+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.288872+0000","last_undegraded":"2024-09-17T05:30:04.288872+0000","last_fullsized":"2024-09-17T05:30:04.288872+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.295600+0000","last_change":"2024-09-17T05:30:04.295600+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.295600+0000","last_undegraded":"2024-09-17T05:30:04.295600+0000","last_fullsized":"2024-09-17T05:30:04.295600+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.289363+0000","last_change":"2024-09-17T05:30:04.289363+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.289363+0000","last_undegraded":"2024-09-17T05:30:04.289363+0000","last_fullsized":"2024-09-17T05:30:04.289363+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980259+0000","last_change":"2024-09-17T05:30:06.325560+0000","last_active":"2024-09-17T05:30:07.980259+0000","last_peered":"2024-09-17T05:30:07.980259+0000","last_clean":"2024-09-17T05:30:07.980259+0000","last_became_active":"2024-09-17T05:30:06.325277+0000","last_became_peered":"2024-09-17T05:30:06.325277+0000","last_unstale":"2024-09-17T05:30:07.980259+0000","last_undegraded":"2024-09-17T05:30:07.980259+0000","last_fullsized":"2024-09-17T05:30:07.980259+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:55.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.293179+0000","last_change":"2024-09-17T05:30:04.293179+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.293179+0000","last_undegraded":"2024-09-17T05:30:04.293179+0000","last_fullsized":"2024-09-17T05:30:04.293179+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979944+0000","last_change":"2024-09-17T05:30:06.316204+0000","last_active":"2024-09-17T05:30:07.979944+0000","last_peered":"2024-09-17T05:30:07.979944+0000","last_clean":"2024-09-17T05:30:07.979944+0000","last_became_active":"2024-09-17T05:30:06.315889+0000","last_became_peered":"2024-09-17T05:30:06.315889+0000","last_unstale":"2024-09-17T05:30:07.979944+0000","last_undegraded":"2024-09-17T05:30:07.979944+0000","last_fullsized":"2024-09-17T05:30:07.979944+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:11:29.366814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983052+0000","last_change":"2024-09-17T05:30:05.310665+0000","last_active":"2024-09-17T05:30:07.983052+0000","last_peered":"2024-09-17T05:30:07.983052+0000","last_clean":"2024-09-17T05:30:07.983052+0000","last_became_active":"2024-09-17T05:30:05.310386+0000","last_became_peered":"2024-09-17T05:30:05.310386+0000","last_unstale":"2024-09-17T05:30:07.983052+0000","last_undegraded":"2024-09-17T05:30:07.983052+0000","last_fullsized":"2024-09-17T05:30:07.983052+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:05.244402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979862+0000","last_change":"2024-09-17T05:30:05.320099+0000","last_active":"2024-09-17T05:30:07.979862+0000","last_peered":"2024-09-17T05:30:07.979862+0000","last_clean":"2024-09-17T05:30:07.979862+0000","last_became_active":"2024-09-17T05:30:05.319784+0000","last_became_peered":"2024-09-17T05:30:05.319784+0000","last_unstale":"2024-09-17T05:30:07.979862+0000","last_undegraded":"2024-09-17T05:30:07.979862+0000","last_fullsized":"2024-09-17T05:30:07.979862+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:45.978034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.292475+0000","last_change":"2024-09-17T05:30:04.292475+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.292475+0000","last_undegraded":"2024-09-17T05:30:04.292475+0000","last_fullsized":"2024-09-17T05:30:04.292475+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981364+0000","last_change":"2024-09-17T05:30:05.319325+0000","last_active":"2024-09-17T05:30:07.981364+0000","last_peered":"2024-09-17T05:30:07.981364+0000","last_clean":"2024-09-17T05:30:07.981364+0000","last_became_active":"2024-09-17T05:30:05.319073+0000","last_became_peered":"2024-09-17T05:30:05.319073+0000","last_unstale":"2024-09-17T05:30:07.981364+0000","last_undegraded":"2024-09-17T05:30:07.981364+0000","last_fullsized":"2024-09-17T05:30:07.981364+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:42.469849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.296140+0000","last_change":"2024-09-17T05:30:04.296140+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.296140+0000","last_undegraded":"2024-09-17T05:30:04.296140+0000","last_fullsized":"2024-09-17T05:30:04.296140+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.292731+0000","last_change":"2024-09-17T05:30:04.292731+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.292731+0000","last_undegraded":"2024-09-17T05:30:04.292731+0000","last_fullsized":"2024-09-17T05:30:04.292731+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.288294+0000","last_change":"2024-09-17T05:30:04.288294+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.288294+0000","last_undegraded":"2024-09-17T05:30:04.288294+0000","last_fullsized":"2024-09-17T05:30:04.288294+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980759+0000","last_change":"2024-09-17T05:30:06.335728+0000","last_active":"2024-09-17T05:30:07.980759+0000","last_peered":"2024-09-17T05:30:07.980759+0000","last_clean":"2024-09-17T05:30:07.980759+0000","last_became_active":"2024-09-17T05:30:06.335019+0000","last_became_peered":"2024-09-17T05:30:06.335019+0000","last_unstale":"2024-09-17T05:30:07.980759+0000","last_undegraded":"2024-09-17T05:30:07.980759+0000","last_fullsized":"2024-09-17T05:30:07.980759+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:46.123430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.295575+0000","last_change":"2024-09-17T05:30:04.295575+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.295575+0000","last_undegraded":"2024-09-17T05:30:04.295575+0000","last_fullsized":"2024-09-17T05:30:04.295575+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.287605+0000","last_change":"2024-09-17T05:30:04.287605+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.287605+0000","last_undegraded":"2024-09-17T05:30:04.287605+0000","last_fullsized":"2024-09-17T05:30:04.287605+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979984+0000","last_change":"2024-09-17T05:30:05.325941+0000","last_active":"2024-09-17T05:30:07.979984+0000","last_peered":"2024-09-17T05:30:07.979984+0000","last_clean":"2024-09-17T05:30:07.979984+0000","last_became_active":"2024-09-17T05:30:05.325555+0000","last_became_peered":"2024-09-17T05:30:05.325555+0000","last_unstale":"2024-09-17T05:30:07.979984+0000","last_undegraded":"2024-09-17T05:30:07.979984+0000","last_fullsized":"2024-09-17T05:30:07.979984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:53.248264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.292831+0000","last_change":"2024-09-17T05:30:04.292831+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.292831+0000","last_undegraded":"2024-09-17T05:30:04.292831+0000","last_fullsized":"2024-09-17T05:30:04.292831+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981411+0000","last_change":"2024-09-17T05:30:06.324125+0000","last_active":"2024-09-17T05:30:07.981411+0000","last_peered":"2024-09-17T05:30:07.981411+0000","last_clean":"2024-09-17T05:30:07.981411+0000","last_became_active":"2024-09-17T05:30:06.323889+0000","last_became_peered":"2024-09-17T05:30:06.323889+0000","last_unstale":"2024-09-17T05:30:07.981411+0000","last_undegraded":"2024-09-17T05:30:07.981411+0000","last_fullsized":"2024-09-17T05:30:07.981411+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:02.179760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.292422+0000","last_change":"2024-09-17T05:30:04.292422+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.292422+0000","last_undegraded":"2024-09-17T05:30:04.292422+0000","last_fullsized":"2024-09-17T05:30:04.292422+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983072+0000","last_change":"2024-09-17T05:30:05.317351+0000","last_active":"2024-09-17T05:30:07.983072+0000","last_peered":"2024-09-17T05:30:07.983072+0000","last_clean":"2024-09-17T05:30:07.983072+0000","last_became_active":"2024-09-17T05:30:05.315615+0000","last_became_peered":"2024-09-17T05:30:05.315615+0000","last_unstale":"2024-09-17T05:30:07.983072+0000","last_undegraded":"2024-09-17T05:30:07.983072+0000","last_fullsized":"2024-09-17T05:30:07.983072+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:20.670899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.287590+0000","last_change":"2024-09-17T05:30:04.287590+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.287590+0000","last_undegraded":"2024-09-17T05:30:04.287590+0000","last_fullsized":"2024-09-17T05:30:04.287590+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.287594+0000","last_change":"2024-09-17T05:30:04.287594+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.287594+0000","last_undegraded":"2024-09-17T05:30:04.287594+0000","last_fullsized":"2024-09-17T05:30:04.287594+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.982840+0000","last_change":"2024-09-17T05:30:05.319225+0000","last_active":"2024-09-17T05:30:07.982840+0000","last_peered":"2024-09-17T05:30:07.982840+0000","last_clean":"2024-09-17T05:30:07.982840+0000","last_became_active":"2024-09-17T05:30:05.318757+0000","last_became_peered":"2024-09-17T05:30:05.318757+0000","last_unstale":"2024-09-17T05:30:07.982840+0000","last_undegraded":"2024-09-17T05:30:07.982840+0000","last_fullsized":"2024-09-17T05:30:07.982840+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:28.145122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979805+0000","last_change":"2024-09-17T05:30:05.322027+0000","last_active":"2024-09-17T05:30:07.979805+0000","last_peered":"2024-09-17T05:30:07.979805+0000","last_clean":"2024-09-17T05:30:07.979805+0000","last_became_active":"2024-09-17T05:30:05.321704+0000","last_became_peered":"2024-09-17T05:30:05.321704+0000","last_unstale":"2024-09-17T05:30:07.979805+0000","last_undegraded":"2024-09-17T05:30:07.979805+0000","last_fullsized":"2024-09-17T05:30:07.979805+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:15.832365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979830+0000","last_change":"2024-09-17T05:30:06.340286+0000","last_active":"2024-09-17T05:30:07.979830+0000","last_peered":"2024-09-17T05:30:07.979830+0000","last_clean":"2024-09-17T05:30:07.979830+0000","last_became_active":"2024-09-17T05:30:06.340000+0000","last_became_peered":"2024-09-17T05:30:06.340000+0000","last_unstale":"2024-09-17T05:30:07.979830+0000","last_undegraded":"2024-09-17T05:30:07.979830+0000","last_fullsized":"2024-09-17T05:30:07.979830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:54.770556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.295567+0000","last_change":"2024-09-17T05:30:04.295567+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.295567+0000","last_undegraded":"2024-09-17T05:30:04.295567+0000","last_fullsized":"2024-09-17T05:30:04.295567+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.287594+0000","last_change":"2024-09-17T05:30:04.287594+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.287594+0000","last_undegraded":"2024-09-17T05:30:04.287594+0000","last_fullsized":"2024-09-17T05:30:04.287594+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980666+0000","last_change":"2024-09-17T05:30:06.332073+0000","last_active":"2024-09-17T05:30:07.980666+0000","last_peered":"2024-09-17T05:30:07.980666+0000","last_clean":"2024-09-17T05:30:07.980666+0000","last_became_active":"2024-09-17T05:30:06.331396+0000","last_became_peered":"2024-09-17T05:30:06.331396+0000","last_unstale":"2024-09-17T05:30:07.980666+0000","last_undegraded":"2024-09-17T05:30:07.980666+0000","last_fullsized":"2024-09-17T05:30:07.980666+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:18.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.295576+0000","last_change":"2024-09-17T05:30:04.295576+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.295576+0000","last_undegraded":"2024-09-17T05:30:04.295576+0000","last_fullsized":"2024-09-17T05:30:04.295576+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.289139+0000","last_change":"2024-09-17T05:30:04.289139+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.289139+0000","last_undegraded":"2024-09-17T05:30:04.289139+0000","last_fullsized":"2024-09-17T05:30:04.289139+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.295713+0000","last_change":"2024-09-17T05:30:04.295713+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.295713+0000","last_undegraded":"2024-09-17T05:30:04.295713+0000","last_fullsized":"2024-09-17T05:30:04.295713+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.292477+0000","last_change":"2024-09-17T05:30:04.292477+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.292477+0000","last_undegraded":"2024-09-17T05:30:04.292477+0000","last_fullsized":"2024-09-17T05:30:04.292477+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983039+0000","last_change":"2024-09-17T05:30:06.318509+0000","last_active":"2024-09-17T05:30:07.983039+0000","last_peered":"2024-09-17T05:30:07.983039+0000","last_clean":"2024-09-17T05:30:07.983039+0000","last_became_active":"2024-09-17T05:30:06.318104+0000","last_became_peered":"2024-09-17T05:30:06.318104+0000","last_unstale":"2024-09-17T05:30:07.983039+0000","last_undegraded":"2024-09-17T05:30:07.983039+0000","last_fullsized":"2024-09-17T05:30:07.983039+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:18.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.288797+0000","last_change":"2024-09-17T05:30:04.288797+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.288797+0000","last_undegraded":"2024-09-17T05:30:04.288797+0000","last_fullsized":"2024-09-17T05:30:04.288797+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980103+0000","last_change":"2024-09-17T05:30:05.317797+0000","last_active":"2024-09-17T05:30:07.980103+0000","last_peered":"2024-09-17T05:30:07.980103+0000","last_clean":"2024-09-17T05:30:07.980103+0000","last_became_active":"2024-09-17T05:30:05.317453+0000","last_became_peered":"2024-09-17T05:30:05.317453+0000","last_unstale":"2024-09-17T05:30:07.980103+0000","last_undegraded":"2024-09-17T05:30:07.980103+0000","last_fullsized":"2024-09-17T05:30:07.980103+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:56.157479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981257+0000","last_change":"2024-09-17T05:30:06.340137+0000","last_active":"2024-09-17T05:30:07.981257+0000","last_peered":"2024-09-17T05:30:07.981257+0000","last_clean":"2024-09-17T05:30:07.981257+0000","last_became_active":"2024-09-17T05:30:06.335162+0000","last_became_peered":"2024-09-17T05:30:06.335162+0000","last_unstale":"2024-09-17T05:30:07.981257+0000","last_undegraded":"2024-09-17T05:30:07.981257+0000","last_fullsized":"2024-09-17T05:30:07.981257+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:15.759144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983535+0000","last_change":"2024-09-17T05:30:05.319479+0000","last_active":"2024-09-17T05:30:07.983535+0000","last_peered":"2024-09-17T05:30:07.983535+0000","last_clean":"2024-09-17T05:30:07.983535+0000","last_became_active":"2024-09-17T05:30:05.319190+0000","last_became_peered":"2024-09-17T05:30:05.319190+0000","last_unstale":"2024-09-17T05:30:07.983535+0000","last_undegraded":"2024-09-17T05:30:07.983535+0000","last_fullsized":"2024-09-17T05:30:07.983535+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:53.759339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":147,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T05:30:04.297654+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:30:04.297654+0000","last_peered":"2024-09-17T05:30:04.297654+0000","last_clean":"2024-09-17T05:30:04.297654+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:30:04.297654+0000","last_undegraded":"2024-09-17T05:30:04.297654+0000","last_fullsized":"2024-09-17T05:30:04.297654+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":2},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1064960,"data_stored":774912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":178727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":178727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":178727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":178727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":178727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":203956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1093632,"data_stored":787988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:30:10.481 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:30:10.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.660+0000 7f45c1800640 1 -- 172.21.15.31:0/2475426855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45bc0cdb30 msgr2=0x7f45bc0cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:10.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.660+0000 7f45c1800640 1 --2- 172.21.15.31:0/2475426855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45bc0cdb30 0x7f45bc0cebb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0745d0 tx=0x7f45a401c830 comp rx=0 tx=0).stop 2024-09-17T05:30:10.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.660+0000 7f45c1800640 1 -- 172.21.15.31:0/2475426855 shutdown_connections 2024-09-17T05:30:10.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.660+0000 7f45c1800640 1 --2- 172.21.15.31:0/2475426855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45bc0cdb30 0x7f45bc0cebb0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.660+0000 7f45c1800640 1 --2- 172.21.15.31:0/2475426855 >> v2:172.21.15.155:3300/0 conn(0x7f45bc15bea0 0x7f45bc0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.660+0000 7f45c1800640 1 -- 172.21.15.31:0/2475426855 >> 172.21.15.31:0/2475426855 conn(0x7f45bc0d1dc0 msgr2=0x7f45bc0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:10.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.660+0000 7f45c1800640 1 -- 172.21.15.31:0/2475426855 shutdown_connections 2024-09-17T05:30:10.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.660+0000 7f45c1800640 1 -- 172.21.15.31:0/2475426855 wait complete. 2024-09-17T05:30:10.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45c1800640 1 Processor -- start 2024-09-17T05:30:10.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45c1800640 1 -- start start 2024-09-17T05:30:10.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45c1800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45bc0cdb30 0x7f45bc0c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:10.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45c1800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45bc0d28e0 0x7f45bc0cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:10.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45c1800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45bc15bea0 0x7f45bc0c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:10.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45c1800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f45bc168f10 con 0x7f45bc0d28e0 2024-09-17T05:30:10.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45c1800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f45bc168d90 con 0x7f45bc0cdb30 2024-09-17T05:30:10.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45c1800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f45bc169090 con 0x7f45bc15bea0 2024-09-17T05:30:10.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45b3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45bc0d28e0 0x7f45bc0cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:10.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45b3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45bc0d28e0 0x7f45bc0cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44976/0 (socket says 172.21.15.31:44976) 2024-09-17T05:30:10.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45b3e00640 1 -- 172.21.15.31:0/3932691443 learned_addr learned my addr 172.21.15.31:0/3932691443 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:10.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45baa00640 1 --2- 172.21.15.31:0/3932691443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45bc0cdb30 0x7f45bc0c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:10.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45bb400640 1 --2- 172.21.15.31:0/3932691443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45bc15bea0 0x7f45bc0c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:10.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45b3e00640 1 -- 172.21.15.31:0/3932691443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45bc15bea0 msgr2=0x7f45bc0c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:10.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45b3e00640 1 --2- 172.21.15.31:0/3932691443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45bc15bea0 0x7f45bc0c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45b3e00640 1 -- 172.21.15.31:0/3932691443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45bc0cdb30 msgr2=0x7f45bc0c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:10.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45b3e00640 1 --2- 172.21.15.31:0/3932691443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45bc0cdb30 0x7f45bc0c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45b3e00640 1 -- 172.21.15.31:0/3932691443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45bc0c6820 con 0x7f45bc0d28e0 2024-09-17T05:30:10.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45baa00640 1 --2- 172.21.15.31:0/3932691443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45bc0cdb30 0x7f45bc0c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:30:10.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45bb400640 1 --2- 172.21.15.31:0/3932691443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45bc15bea0 0x7f45bc0c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:30:10.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45b3e00640 1 --2- 172.21.15.31:0/3932691443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45bc0d28e0 0x7f45bc0cb340 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f45a40b0040 tx=0x7f45a40a5710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:10.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45b2a00640 1 -- 172.21.15.31:0/3932691443 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a40b2040 con 0x7f45bc0d28e0 2024-09-17T05:30:10.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45b2a00640 1 -- 172.21.15.31:0/3932691443 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45a4004420 con 0x7f45bc0d28e0 2024-09-17T05:30:10.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45c1800640 1 -- 172.21.15.31:0/3932691443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45bc157470 con 0x7f45bc0d28e0 2024-09-17T05:30:10.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45b2a00640 1 -- 172.21.15.31:0/3932691443 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a4005280 con 0x7f45bc0d28e0 2024-09-17T05:30:10.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.664+0000 7f45c1800640 1 -- 172.21.15.31:0/3932691443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45bc157a30 con 0x7f45bc0d28e0 2024-09-17T05:30:10.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.668+0000 7f45c1800640 1 -- 172.21.15.31:0/3932691443 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45bc0cc9d0 con 0x7f45bc0d28e0 2024-09-17T05:30:10.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.668+0000 7f45b2a00640 1 -- 172.21.15.31:0/3932691443 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f45a4005420 con 0x7f45bc0d28e0 2024-09-17T05:30:10.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.668+0000 7f45b2a00640 1 --2- 172.21.15.31:0/3932691443 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f45980733b0 0x7f4598075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:10.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.668+0000 7f45b2a00640 1 -- 172.21.15.31:0/3932691443 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f45a412e8a0 con 0x7f45bc0d28e0 2024-09-17T05:30:10.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.668+0000 7f45baa00640 1 --2- 172.21.15.31:0/3932691443 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f45980733b0 0x7f4598075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:10.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.668+0000 7f45baa00640 1 --2- 172.21.15.31:0/3932691443 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f45980733b0 0x7f4598075870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f45ac005fd0 tx=0x7f45ac005f00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:10.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.672+0000 7f45b2a00640 1 -- 172.21.15.31:0/3932691443 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f45a40164b0 con 0x7f45bc0d28e0 2024-09-17T05:30:10.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.844+0000 7f45c1800640 1 -- 172.21.15.31:0/3932691443 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45bc071e40 con 0x7f45980733b0 2024-09-17T05:30:10.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.848+0000 7f45b2a00640 1 -- 172.21.15.31:0/3932691443 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243366 (secure 0 0 0) 0x7f45bc071e40 con 0x7f45980733b0 2024-09-17T05:30:10.856 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:10.858 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:30:10.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.852+0000 7f45c1800640 1 -- 172.21.15.31:0/3932691443 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f45980733b0 msgr2=0x7f4598075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:10.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.852+0000 7f45c1800640 1 --2- 172.21.15.31:0/3932691443 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f45980733b0 0x7f4598075870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f45ac005fd0 tx=0x7f45ac005f00 comp rx=0 tx=0).stop 2024-09-17T05:30:10.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.852+0000 7f45c1800640 1 -- 172.21.15.31:0/3932691443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45bc0d28e0 msgr2=0x7f45bc0cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:10.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.852+0000 7f45c1800640 1 --2- 172.21.15.31:0/3932691443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45bc0d28e0 0x7f45bc0cb340 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f45a40b0040 tx=0x7f45a40a5710 comp rx=0 tx=0).stop 2024-09-17T05:30:10.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.852+0000 7f45c1800640 1 -- 172.21.15.31:0/3932691443 shutdown_connections 2024-09-17T05:30:10.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.852+0000 7f45c1800640 1 --2- 172.21.15.31:0/3932691443 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f45980733b0 0x7f4598075870 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.852+0000 7f45c1800640 1 --2- 172.21.15.31:0/3932691443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45bc15bea0 0x7f45bc0c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.852+0000 7f45c1800640 1 --2- 172.21.15.31:0/3932691443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f45bc0d28e0 0x7f45bc0cb340 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.852+0000 7f45c1800640 1 --2- 172.21.15.31:0/3932691443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45bc0cdb30 0x7f45bc0c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:10.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.852+0000 7f45c1800640 1 -- 172.21.15.31:0/3932691443 >> 172.21.15.31:0/3932691443 conn(0x7f45bc0d1dc0 msgr2=0x7f45bc06f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:10.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.852+0000 7f45c1800640 1 -- 172.21.15.31:0/3932691443 shutdown_connections 2024-09-17T05:30:10.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:10.852+0000 7f45c1800640 1 -- 172.21.15.31:0/3932691443 wait complete. 2024-09-17T05:30:10.877 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-09-17T05:30:09.199184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":117,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":106,"acting":106,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":225248,"kb_used_data":4848,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749472,"statfs":{"total":773094113280,"available":772863459328,"internally_reserved":0,"allocated":4964352,"data_stored":2660491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.910135"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983219+0000","last_change":"2024-09-17T05:30:06.321869+0000","last_active":"2024-09-17T05:30:07.983219+0000","last_peered":"2024-09-17T05:30:07.983219+0000","last_clean":"2024-09-17T05:30:07.983219+0000","last_became_active":"2024-09-17T05:30:06.321455+0000","last_became_peered":"2024-09-17T05:30:06.321455+0000","last_unstale":"2024-09-17T05:30:07.983219+0000","last_undegraded":"2024-09-17T05:30:07.983219+0000","last_fullsized":"2024-09-17T05:30:07.983219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:44.473010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980453+0000","last_change":"2024-09-17T05:30:06.338103+0000","last_active":"2024-09-17T05:30:07.980453+0000","last_peered":"2024-09-17T05:30:07.980453+0000","last_clean":"2024-09-17T05:30:07.980453+0000","last_became_active":"2024-09-17T05:30:06.337712+0000","last_became_peered":"2024-09-17T05:30:06.337712+0000","last_unstale":"2024-09-17T05:30:07.980453+0000","last_undegraded":"2024-09-17T05:30:07.980453+0000","last_fullsized":"2024-09-17T05:30:07.980453+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:01.151033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983371+0000","last_change":"2024-09-17T05:30:06.317638+0000","last_active":"2024-09-17T05:30:07.983371+0000","last_peered":"2024-09-17T05:30:07.983371+0000","last_clean":"2024-09-17T05:30:07.983371+0000","last_became_active":"2024-09-17T05:30:06.315836+0000","last_became_peered":"2024-09-17T05:30:06.315836+0000","last_unstale":"2024-09-17T05:30:07.983371+0000","last_undegraded":"2024-09-17T05:30:07.983371+0000","last_fullsized":"2024-09-17T05:30:07.983371+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:15.759144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979737+0000","last_change":"2024-09-17T05:30:06.335575+0000","last_active":"2024-09-17T05:30:07.979737+0000","last_peered":"2024-09-17T05:30:07.979737+0000","last_clean":"2024-09-17T05:30:07.979737+0000","last_became_active":"2024-09-17T05:30:06.335241+0000","last_became_peered":"2024-09-17T05:30:06.335241+0000","last_unstale":"2024-09-17T05:30:07.979737+0000","last_undegraded":"2024-09-17T05:30:07.979737+0000","last_fullsized":"2024-09-17T05:30:07.979737+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:21.682116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981155+0000","last_change":"2024-09-17T05:30:06.342344+0000","last_active":"2024-09-17T05:30:07.981155+0000","last_peered":"2024-09-17T05:30:07.981155+0000","last_clean":"2024-09-17T05:30:07.981155+0000","last_became_active":"2024-09-17T05:30:06.341691+0000","last_became_peered":"2024-09-17T05:30:06.341691+0000","last_unstale":"2024-09-17T05:30:07.981155+0000","last_undegraded":"2024-09-17T05:30:07.981155+0000","last_fullsized":"2024-09-17T05:30:07.981155+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:44.473010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981052+0000","last_change":"2024-09-17T05:30:06.335792+0000","last_active":"2024-09-17T05:30:07.981052+0000","last_peered":"2024-09-17T05:30:07.981052+0000","last_clean":"2024-09-17T05:30:07.981052+0000","last_became_active":"2024-09-17T05:30:06.335480+0000","last_became_peered":"2024-09-17T05:30:06.335480+0000","last_unstale":"2024-09-17T05:30:07.981052+0000","last_undegraded":"2024-09-17T05:30:07.981052+0000","last_fullsized":"2024-09-17T05:30:07.981052+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:23.591461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980367+0000","last_change":"2024-09-17T05:30:06.341158+0000","last_active":"2024-09-17T05:30:07.980367+0000","last_peered":"2024-09-17T05:30:07.980367+0000","last_clean":"2024-09-17T05:30:07.980367+0000","last_became_active":"2024-09-17T05:30:06.340860+0000","last_became_peered":"2024-09-17T05:30:06.340860+0000","last_unstale":"2024-09-17T05:30:07.980367+0000","last_undegraded":"2024-09-17T05:30:07.980367+0000","last_fullsized":"2024-09-17T05:30:07.980367+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:19.820487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983177+0000","last_change":"2024-09-17T05:30:06.307784+0000","last_active":"2024-09-17T05:30:07.983177+0000","last_peered":"2024-09-17T05:30:07.983177+0000","last_clean":"2024-09-17T05:30:07.983177+0000","last_became_active":"2024-09-17T05:30:06.307523+0000","last_became_peered":"2024-09-17T05:30:06.307523+0000","last_unstale":"2024-09-17T05:30:07.983177+0000","last_undegraded":"2024-09-17T05:30:07.983177+0000","last_fullsized":"2024-09-17T05:30:07.983177+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:46.123430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980003+0000","last_change":"2024-09-17T05:30:06.341111+0000","last_active":"2024-09-17T05:30:07.980003+0000","last_peered":"2024-09-17T05:30:07.980003+0000","last_clean":"2024-09-17T05:30:07.980003+0000","last_became_active":"2024-09-17T05:30:06.340826+0000","last_became_peered":"2024-09-17T05:30:06.340826+0000","last_unstale":"2024-09-17T05:30:07.980003+0000","last_undegraded":"2024-09-17T05:30:07.980003+0000","last_fullsized":"2024-09-17T05:30:07.980003+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:39.847537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980167+0000","last_change":"2024-09-17T05:30:06.336071+0000","last_active":"2024-09-17T05:30:07.980167+0000","last_peered":"2024-09-17T05:30:07.980167+0000","last_clean":"2024-09-17T05:30:07.980167+0000","last_became_active":"2024-09-17T05:30:06.335275+0000","last_became_peered":"2024-09-17T05:30:06.335275+0000","last_unstale":"2024-09-17T05:30:07.980167+0000","last_undegraded":"2024-09-17T05:30:07.980167+0000","last_fullsized":"2024-09-17T05:30:07.980167+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:58.105556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983191+0000","last_change":"2024-09-17T05:30:06.307863+0000","last_active":"2024-09-17T05:30:07.983191+0000","last_peered":"2024-09-17T05:30:07.983191+0000","last_clean":"2024-09-17T05:30:07.983191+0000","last_became_active":"2024-09-17T05:30:06.307597+0000","last_became_peered":"2024-09-17T05:30:06.307597+0000","last_unstale":"2024-09-17T05:30:07.983191+0000","last_undegraded":"2024-09-17T05:30:07.983191+0000","last_fullsized":"2024-09-17T05:30:07.983191+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:23.591461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.289285+0000","last_change":"2024-09-17T05:30:04.289285+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.289285+0000","last_undegraded":"2024-09-17T05:30:04.289285+0000","last_fullsized":"2024-09-17T05:30:04.289285+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.293050+0000","last_change":"2024-09-17T05:30:04.293050+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.293050+0000","last_undegraded":"2024-09-17T05:30:04.293050+0000","last_fullsized":"2024-09-17T05:30:04.293050+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983603+0000","last_change":"2024-09-17T05:30:06.328218+0000","last_active":"2024-09-17T05:30:07.983603+0000","last_peered":"2024-09-17T05:30:07.983603+0000","last_clean":"2024-09-17T05:30:07.983603+0000","last_became_active":"2024-09-17T05:30:06.327401+0000","last_became_peered":"2024-09-17T05:30:06.327401+0000","last_unstale":"2024-09-17T05:30:07.983603+0000","last_undegraded":"2024-09-17T05:30:07.983603+0000","last_fullsized":"2024-09-17T05:30:07.983603+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:02.179760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.288872+0000","last_change":"2024-09-17T05:30:04.288872+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.288872+0000","last_undegraded":"2024-09-17T05:30:04.288872+0000","last_fullsized":"2024-09-17T05:30:04.288872+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.295600+0000","last_change":"2024-09-17T05:30:04.295600+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.295600+0000","last_undegraded":"2024-09-17T05:30:04.295600+0000","last_fullsized":"2024-09-17T05:30:04.295600+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.289363+0000","last_change":"2024-09-17T05:30:04.289363+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.289363+0000","last_undegraded":"2024-09-17T05:30:04.289363+0000","last_fullsized":"2024-09-17T05:30:04.289363+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980259+0000","last_change":"2024-09-17T05:30:06.325560+0000","last_active":"2024-09-17T05:30:07.980259+0000","last_peered":"2024-09-17T05:30:07.980259+0000","last_clean":"2024-09-17T05:30:07.980259+0000","last_became_active":"2024-09-17T05:30:06.325277+0000","last_became_peered":"2024-09-17T05:30:06.325277+0000","last_unstale":"2024-09-17T05:30:07.980259+0000","last_undegraded":"2024-09-17T05:30:07.980259+0000","last_fullsized":"2024-09-17T05:30:07.980259+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:55.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.293179+0000","last_change":"2024-09-17T05:30:04.293179+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.293179+0000","last_undegraded":"2024-09-17T05:30:04.293179+0000","last_fullsized":"2024-09-17T05:30:04.293179+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979944+0000","last_change":"2024-09-17T05:30:06.316204+0000","last_active":"2024-09-17T05:30:07.979944+0000","last_peered":"2024-09-17T05:30:07.979944+0000","last_clean":"2024-09-17T05:30:07.979944+0000","last_became_active":"2024-09-17T05:30:06.315889+0000","last_became_peered":"2024-09-17T05:30:06.315889+0000","last_unstale":"2024-09-17T05:30:07.979944+0000","last_undegraded":"2024-09-17T05:30:07.979944+0000","last_fullsized":"2024-09-17T05:30:07.979944+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:11:29.366814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983052+0000","last_change":"2024-09-17T05:30:05.310665+0000","last_active":"2024-09-17T05:30:07.983052+0000","last_peered":"2024-09-17T05:30:07.983052+0000","last_clean":"2024-09-17T05:30:07.983052+0000","last_became_active":"2024-09-17T05:30:05.310386+0000","last_became_peered":"2024-09-17T05:30:05.310386+0000","last_unstale":"2024-09-17T05:30:07.983052+0000","last_undegraded":"2024-09-17T05:30:07.983052+0000","last_fullsized":"2024-09-17T05:30:07.983052+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:05.244402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979862+0000","last_change":"2024-09-17T05:30:05.320099+0000","last_active":"2024-09-17T05:30:07.979862+0000","last_peered":"2024-09-17T05:30:07.979862+0000","last_clean":"2024-09-17T05:30:07.979862+0000","last_became_active":"2024-09-17T05:30:05.319784+0000","last_became_peered":"2024-09-17T05:30:05.319784+0000","last_unstale":"2024-09-17T05:30:07.979862+0000","last_undegraded":"2024-09-17T05:30:07.979862+0000","last_fullsized":"2024-09-17T05:30:07.979862+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:45.978034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.292475+0000","last_change":"2024-09-17T05:30:04.292475+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.292475+0000","last_undegraded":"2024-09-17T05:30:04.292475+0000","last_fullsized":"2024-09-17T05:30:04.292475+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981364+0000","last_change":"2024-09-17T05:30:05.319325+0000","last_active":"2024-09-17T05:30:07.981364+0000","last_peered":"2024-09-17T05:30:07.981364+0000","last_clean":"2024-09-17T05:30:07.981364+0000","last_became_active":"2024-09-17T05:30:05.319073+0000","last_became_peered":"2024-09-17T05:30:05.319073+0000","last_unstale":"2024-09-17T05:30:07.981364+0000","last_undegraded":"2024-09-17T05:30:07.981364+0000","last_fullsized":"2024-09-17T05:30:07.981364+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:42.469849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.296140+0000","last_change":"2024-09-17T05:30:04.296140+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.296140+0000","last_undegraded":"2024-09-17T05:30:04.296140+0000","last_fullsized":"2024-09-17T05:30:04.296140+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.292731+0000","last_change":"2024-09-17T05:30:04.292731+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.292731+0000","last_undegraded":"2024-09-17T05:30:04.292731+0000","last_fullsized":"2024-09-17T05:30:04.292731+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.288294+0000","last_change":"2024-09-17T05:30:04.288294+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.288294+0000","last_undegraded":"2024-09-17T05:30:04.288294+0000","last_fullsized":"2024-09-17T05:30:04.288294+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980759+0000","last_change":"2024-09-17T05:30:06.335728+0000","last_active":"2024-09-17T05:30:07.980759+0000","last_peered":"2024-09-17T05:30:07.980759+0000","last_clean":"2024-09-17T05:30:07.980759+0000","last_became_active":"2024-09-17T05:30:06.335019+0000","last_became_peered":"2024-09-17T05:30:06.335019+0000","last_unstale":"2024-09-17T05:30:07.980759+0000","last_undegraded":"2024-09-17T05:30:07.980759+0000","last_fullsized":"2024-09-17T05:30:07.980759+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:46.123430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.295575+0000","last_change":"2024-09-17T05:30:04.295575+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.295575+0000","last_undegraded":"2024-09-17T05:30:04.295575+0000","last_fullsized":"2024-09-17T05:30:04.295575+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.287605+0000","last_change":"2024-09-17T05:30:04.287605+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.287605+0000","last_undegraded":"2024-09-17T05:30:04.287605+0000","last_fullsized":"2024-09-17T05:30:04.287605+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979984+0000","last_change":"2024-09-17T05:30:05.325941+0000","last_active":"2024-09-17T05:30:07.979984+0000","last_peered":"2024-09-17T05:30:07.979984+0000","last_clean":"2024-09-17T05:30:07.979984+0000","last_became_active":"2024-09-17T05:30:05.325555+0000","last_became_peered":"2024-09-17T05:30:05.325555+0000","last_unstale":"2024-09-17T05:30:07.979984+0000","last_undegraded":"2024-09-17T05:30:07.979984+0000","last_fullsized":"2024-09-17T05:30:07.979984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:53.248264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.292831+0000","last_change":"2024-09-17T05:30:04.292831+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.292831+0000","last_undegraded":"2024-09-17T05:30:04.292831+0000","last_fullsized":"2024-09-17T05:30:04.292831+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981411+0000","last_change":"2024-09-17T05:30:06.324125+0000","last_active":"2024-09-17T05:30:07.981411+0000","last_peered":"2024-09-17T05:30:07.981411+0000","last_clean":"2024-09-17T05:30:07.981411+0000","last_became_active":"2024-09-17T05:30:06.323889+0000","last_became_peered":"2024-09-17T05:30:06.323889+0000","last_unstale":"2024-09-17T05:30:07.981411+0000","last_undegraded":"2024-09-17T05:30:07.981411+0000","last_fullsized":"2024-09-17T05:30:07.981411+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:02.179760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.292422+0000","last_change":"2024-09-17T05:30:04.292422+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.292422+0000","last_undegraded":"2024-09-17T05:30:04.292422+0000","last_fullsized":"2024-09-17T05:30:04.292422+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983072+0000","last_change":"2024-09-17T05:30:05.317351+0000","last_active":"2024-09-17T05:30:07.983072+0000","last_peered":"2024-09-17T05:30:07.983072+0000","last_clean":"2024-09-17T05:30:07.983072+0000","last_became_active":"2024-09-17T05:30:05.315615+0000","last_became_peered":"2024-09-17T05:30:05.315615+0000","last_unstale":"2024-09-17T05:30:07.983072+0000","last_undegraded":"2024-09-17T05:30:07.983072+0000","last_fullsized":"2024-09-17T05:30:07.983072+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:20.670899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.287590+0000","last_change":"2024-09-17T05:30:04.287590+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.287590+0000","last_undegraded":"2024-09-17T05:30:04.287590+0000","last_fullsized":"2024-09-17T05:30:04.287590+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.287594+0000","last_change":"2024-09-17T05:30:04.287594+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.287594+0000","last_undegraded":"2024-09-17T05:30:04.287594+0000","last_fullsized":"2024-09-17T05:30:04.287594+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.982840+0000","last_change":"2024-09-17T05:30:05.319225+0000","last_active":"2024-09-17T05:30:07.982840+0000","last_peered":"2024-09-17T05:30:07.982840+0000","last_clean":"2024-09-17T05:30:07.982840+0000","last_became_active":"2024-09-17T05:30:05.318757+0000","last_became_peered":"2024-09-17T05:30:05.318757+0000","last_unstale":"2024-09-17T05:30:07.982840+0000","last_undegraded":"2024-09-17T05:30:07.982840+0000","last_fullsized":"2024-09-17T05:30:07.982840+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:28.145122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979805+0000","last_change":"2024-09-17T05:30:05.322027+0000","last_active":"2024-09-17T05:30:07.979805+0000","last_peered":"2024-09-17T05:30:07.979805+0000","last_clean":"2024-09-17T05:30:07.979805+0000","last_became_active":"2024-09-17T05:30:05.321704+0000","last_became_peered":"2024-09-17T05:30:05.321704+0000","last_unstale":"2024-09-17T05:30:07.979805+0000","last_undegraded":"2024-09-17T05:30:07.979805+0000","last_fullsized":"2024-09-17T05:30:07.979805+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:15.832365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979830+0000","last_change":"2024-09-17T05:30:06.340286+0000","last_active":"2024-09-17T05:30:07.979830+0000","last_peered":"2024-09-17T05:30:07.979830+0000","last_clean":"2024-09-17T05:30:07.979830+0000","last_became_active":"2024-09-17T05:30:06.340000+0000","last_became_peered":"2024-09-17T05:30:06.340000+0000","last_unstale":"2024-09-17T05:30:07.979830+0000","last_undegraded":"2024-09-17T05:30:07.979830+0000","last_fullsized":"2024-09-17T05:30:07.979830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:54.770556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.295567+0000","last_change":"2024-09-17T05:30:04.295567+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.295567+0000","last_undegraded":"2024-09-17T05:30:04.295567+0000","last_fullsized":"2024-09-17T05:30:04.295567+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.287594+0000","last_change":"2024-09-17T05:30:04.287594+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.287594+0000","last_undegraded":"2024-09-17T05:30:04.287594+0000","last_fullsized":"2024-09-17T05:30:04.287594+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980666+0000","last_change":"2024-09-17T05:30:06.332073+0000","last_active":"2024-09-17T05:30:07.980666+0000","last_peered":"2024-09-17T05:30:07.980666+0000","last_clean":"2024-09-17T05:30:07.980666+0000","last_became_active":"2024-09-17T05:30:06.331396+0000","last_became_peered":"2024-09-17T05:30:06.331396+0000","last_unstale":"2024-09-17T05:30:07.980666+0000","last_undegraded":"2024-09-17T05:30:07.980666+0000","last_fullsized":"2024-09-17T05:30:07.980666+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:18.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.295576+0000","last_change":"2024-09-17T05:30:04.295576+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.295576+0000","last_undegraded":"2024-09-17T05:30:04.295576+0000","last_fullsized":"2024-09-17T05:30:04.295576+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.289139+0000","last_change":"2024-09-17T05:30:04.289139+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.289139+0000","last_undegraded":"2024-09-17T05:30:04.289139+0000","last_fullsized":"2024-09-17T05:30:04.289139+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.295713+0000","last_change":"2024-09-17T05:30:04.295713+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.295713+0000","last_undegraded":"2024-09-17T05:30:04.295713+0000","last_fullsized":"2024-09-17T05:30:04.295713+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.292477+0000","last_change":"2024-09-17T05:30:04.292477+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.292477+0000","last_undegraded":"2024-09-17T05:30:04.292477+0000","last_fullsized":"2024-09-17T05:30:04.292477+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983039+0000","last_change":"2024-09-17T05:30:06.318509+0000","last_active":"2024-09-17T05:30:07.983039+0000","last_peered":"2024-09-17T05:30:07.983039+0000","last_clean":"2024-09-17T05:30:07.983039+0000","last_became_active":"2024-09-17T05:30:06.318104+0000","last_became_peered":"2024-09-17T05:30:06.318104+0000","last_unstale":"2024-09-17T05:30:07.983039+0000","last_undegraded":"2024-09-17T05:30:07.983039+0000","last_fullsized":"2024-09-17T05:30:07.983039+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:18.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":41,"state":"creating+peering","last_fresh":"2024-09-17T05:30:04.288797+0000","last_change":"2024-09-17T05:30:04.288797+0000","last_active":"2024-09-17T05:30:04.272004+0000","last_peered":"2024-09-17T05:30:04.272004+0000","last_clean":"2024-09-17T05:30:04.272004+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:04.288797+0000","last_undegraded":"2024-09-17T05:30:04.288797+0000","last_fullsized":"2024-09-17T05:30:04.288797+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:30:05.283221+0000","last_change":"2024-09-17T05:30:05.283221+0000","last_active":"2024-09-17T05:30:05.283221+0000","last_peered":"2024-09-17T05:30:05.283221+0000","last_clean":"2024-09-17T05:30:05.283221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:30:05.283221+0000","last_undegraded":"2024-09-17T05:30:05.283221+0000","last_fullsized":"2024-09-17T05:30:05.283221+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980103+0000","last_change":"2024-09-17T05:30:05.317797+0000","last_active":"2024-09-17T05:30:07.980103+0000","last_peered":"2024-09-17T05:30:07.980103+0000","last_clean":"2024-09-17T05:30:07.980103+0000","last_became_active":"2024-09-17T05:30:05.317453+0000","last_became_peered":"2024-09-17T05:30:05.317453+0000","last_unstale":"2024-09-17T05:30:07.980103+0000","last_undegraded":"2024-09-17T05:30:07.980103+0000","last_fullsized":"2024-09-17T05:30:07.980103+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:56.157479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981257+0000","last_change":"2024-09-17T05:30:06.340137+0000","last_active":"2024-09-17T05:30:07.981257+0000","last_peered":"2024-09-17T05:30:07.981257+0000","last_clean":"2024-09-17T05:30:07.981257+0000","last_became_active":"2024-09-17T05:30:06.335162+0000","last_became_peered":"2024-09-17T05:30:06.335162+0000","last_unstale":"2024-09-17T05:30:07.981257+0000","last_undegraded":"2024-09-17T05:30:07.981257+0000","last_fullsized":"2024-09-17T05:30:07.981257+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:15.759144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983535+0000","last_change":"2024-09-17T05:30:05.319479+0000","last_active":"2024-09-17T05:30:07.983535+0000","last_peered":"2024-09-17T05:30:07.983535+0000","last_clean":"2024-09-17T05:30:07.983535+0000","last_became_active":"2024-09-17T05:30:05.319190+0000","last_became_peered":"2024-09-17T05:30:05.319190+0000","last_unstale":"2024-09-17T05:30:07.983535+0000","last_undegraded":"2024-09-17T05:30:07.983535+0000","last_fullsized":"2024-09-17T05:30:07.983535+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:53.759339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":147,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T05:30:04.297654+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:30:04.297654+0000","last_peered":"2024-09-17T05:30:04.297654+0000","last_clean":"2024-09-17T05:30:04.297654+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:30:04.297654+0000","last_undegraded":"2024-09-17T05:30:04.297654+0000","last_fullsized":"2024-09-17T05:30:04.297654+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":2},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1064960,"data_stored":774912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":178727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":178727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":178727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":178727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":178727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":203956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1093632,"data_stored":787988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:30:10.881 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:30:11.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.060+0000 7f469f000640 1 -- 172.21.15.31:0/2850404948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4698073170 msgr2=0x7f469806f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:11.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.060+0000 7f469f000640 1 --2- 172.21.15.31:0/2850404948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4698073170 0x7f469806f520 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f46800098f0 tx=0x7f468001c8e0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.060+0000 7f469f000640 1 -- 172.21.15.31:0/2850404948 shutdown_connections 2024-09-17T05:30:11.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.060+0000 7f469f000640 1 --2- 172.21.15.31:0/2850404948 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f469806d330 0x7f469806fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.060+0000 7f469f000640 1 --2- 172.21.15.31:0/2850404948 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4698073170 0x7f469806f520 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.060+0000 7f469f000640 1 -- 172.21.15.31:0/2850404948 >> 172.21.15.31:0/2850404948 conn(0x7f46980b2240 msgr2=0x7f46980b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:11.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.060+0000 7f469f000640 1 -- 172.21.15.31:0/2850404948 shutdown_connections 2024-09-17T05:30:11.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.060+0000 7f469f000640 1 -- 172.21.15.31:0/2850404948 wait complete. 2024-09-17T05:30:11.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.060+0000 7f469f000640 1 Processor -- start 2024-09-17T05:30:11.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.060+0000 7f469f000640 1 -- start start 2024-09-17T05:30:11.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f469f000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f469806d330 0x7f4698161f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:11.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f469f000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4698073170 0x7f46981415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:11.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f469f000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46980ce800 0x7f46981f6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:11.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f469f000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f46981682f0 con 0x7f4698073170 2024-09-17T05:30:11.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f469f000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4698168170 con 0x7f46980ce800 2024-09-17T05:30:11.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f469f000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4698168470 con 0x7f469806d330 2024-09-17T05:30:11.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f468f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4698073170 0x7f46981415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:11.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f468f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4698073170 0x7f46981415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45004/0 (socket says 172.21.15.31:45004) 2024-09-17T05:30:11.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f468f400640 1 -- 172.21.15.31:0/3883076483 learned_addr learned my addr 172.21.15.31:0/3883076483 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:11.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f469d000640 1 --2- 172.21.15.31:0/3883076483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46980ce800 0x7f46981f6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:11.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f4697e00640 1 --2- 172.21.15.31:0/3883076483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f469806d330 0x7f4698161f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:11.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f468f400640 1 -- 172.21.15.31:0/3883076483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f469806d330 msgr2=0x7f4698161f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:11.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f468f400640 1 --2- 172.21.15.31:0/3883076483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f469806d330 0x7f4698161f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f468f400640 1 -- 172.21.15.31:0/3883076483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46980ce800 msgr2=0x7f46981f6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:11.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f468f400640 1 --2- 172.21.15.31:0/3883076483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46980ce800 0x7f46981f6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f468f400640 1 -- 172.21.15.31:0/3883076483 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4698142580 con 0x7f4698073170 2024-09-17T05:30:11.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f469d000640 1 --2- 172.21.15.31:0/3883076483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46980ce800 0x7f46981f6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:30:11.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f468f400640 1 --2- 172.21.15.31:0/3883076483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4698073170 0x7f46981415f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f468001af90 tx=0x7f46800057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:11.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f4694c00640 1 -- 172.21.15.31:0/3883076483 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46800b2040 con 0x7f4698073170 2024-09-17T05:30:11.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f4694c00640 1 -- 172.21.15.31:0/3883076483 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46800a5d50 con 0x7f4698073170 2024-09-17T05:30:11.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f4694c00640 1 -- 172.21.15.31:0/3883076483 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680005280 con 0x7f4698073170 2024-09-17T05:30:11.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f469f000640 1 -- 172.21.15.31:0/3883076483 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46980a9ff0 con 0x7f4698073170 2024-09-17T05:30:11.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f469f000640 1 -- 172.21.15.31:0/3883076483 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4698161780 con 0x7f4698073170 2024-09-17T05:30:11.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f469f000640 1 -- 172.21.15.31:0/3883076483 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f469806cc20 con 0x7f4698073170 2024-09-17T05:30:11.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.064+0000 7f4694c00640 1 -- 172.21.15.31:0/3883076483 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f46800bd060 con 0x7f4698073170 2024-09-17T05:30:11.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.068+0000 7f4694c00640 1 --2- 172.21.15.31:0/3883076483 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f46740733b0 0x7f4674075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:11.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.068+0000 7f4694c00640 1 -- 172.21.15.31:0/3883076483 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f468012e180 con 0x7f4698073170 2024-09-17T05:30:11.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.068+0000 7f4697e00640 1 --2- 172.21.15.31:0/3883076483 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f46740733b0 0x7f4674075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:11.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.068+0000 7f4697e00640 1 --2- 172.21.15.31:0/3883076483 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f46740733b0 0x7f4674075870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4688000f70 tx=0x7f4688009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:11.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.072+0000 7f4694c00640 1 -- 172.21.15.31:0/3883076483 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f46800164d0 con 0x7f4698073170 2024-09-17T05:30:11.162 INFO:tasks.ceph.mds.a.smithi031.stderr:2024-09-17T05:30:11.156+0000 7f0c3b000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:30:11.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.244+0000 7f469f000640 1 -- 172.21.15.31:0/3883076483 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4698144860 con 0x7f46740733b0 2024-09-17T05:30:11.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.248+0000 7f4694c00640 1 -- 172.21.15.31:0/3883076483 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7f4698144860 con 0x7f46740733b0 2024-09-17T05:30:11.257 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:11.259 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:30:11.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.252+0000 7f469f000640 1 -- 172.21.15.31:0/3883076483 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f46740733b0 msgr2=0x7f4674075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:11.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.252+0000 7f469f000640 1 --2- 172.21.15.31:0/3883076483 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f46740733b0 0x7f4674075870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4688000f70 tx=0x7f4688009040 comp rx=0 tx=0).stop 2024-09-17T05:30:11.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.252+0000 7f469f000640 1 -- 172.21.15.31:0/3883076483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4698073170 msgr2=0x7f46981415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:11.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.252+0000 7f469f000640 1 --2- 172.21.15.31:0/3883076483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4698073170 0x7f46981415f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f468001af90 tx=0x7f46800057a0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.252+0000 7f469f000640 1 -- 172.21.15.31:0/3883076483 shutdown_connections 2024-09-17T05:30:11.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.252+0000 7f469f000640 1 --2- 172.21.15.31:0/3883076483 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f46740733b0 0x7f4674075870 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.252+0000 7f469f000640 1 --2- 172.21.15.31:0/3883076483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46980ce800 0x7f46981f6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.252+0000 7f469f000640 1 --2- 172.21.15.31:0/3883076483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4698073170 0x7f46981415f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.252+0000 7f469f000640 1 --2- 172.21.15.31:0/3883076483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f469806d330 0x7f4698161f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.252+0000 7f469f000640 1 -- 172.21.15.31:0/3883076483 >> 172.21.15.31:0/3883076483 conn(0x7f46980b2240 msgr2=0x7f469806f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:11.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.252+0000 7f469f000640 1 -- 172.21.15.31:0/3883076483 shutdown_connections 2024-09-17T05:30:11.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.252+0000 7f469f000640 1 -- 172.21.15.31:0/3883076483 wait complete. 2024-09-17T05:30:11.280 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-09-17T05:30:11.199768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225604,"kb_used_data":5180,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749116,"statfs":{"total":773094113280,"available":772863094784,"internally_reserved":0,"allocated":5304320,"data_stored":2810344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001581"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983941+0000","last_change":"2024-09-17T05:30:06.324569+0000","last_active":"2024-09-17T05:30:07.983941+0000","last_peered":"2024-09-17T05:30:07.983941+0000","last_clean":"2024-09-17T05:30:07.983941+0000","last_became_active":"2024-09-17T05:30:06.324329+0000","last_became_peered":"2024-09-17T05:30:06.324329+0000","last_unstale":"2024-09-17T05:30:07.983941+0000","last_undegraded":"2024-09-17T05:30:07.983941+0000","last_fullsized":"2024-09-17T05:30:07.983941+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:45.362534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983219+0000","last_change":"2024-09-17T05:30:06.321869+0000","last_active":"2024-09-17T05:30:07.983219+0000","last_peered":"2024-09-17T05:30:07.983219+0000","last_clean":"2024-09-17T05:30:07.983219+0000","last_became_active":"2024-09-17T05:30:06.321455+0000","last_became_peered":"2024-09-17T05:30:06.321455+0000","last_unstale":"2024-09-17T05:30:07.983219+0000","last_undegraded":"2024-09-17T05:30:07.983219+0000","last_fullsized":"2024-09-17T05:30:07.983219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:44.473010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306744+0000","last_change":"2024-09-17T05:30:06.316783+0000","last_active":"2024-09-17T05:30:07.306744+0000","last_peered":"2024-09-17T05:30:07.306744+0000","last_clean":"2024-09-17T05:30:07.306744+0000","last_became_active":"2024-09-17T05:30:06.316512+0000","last_became_peered":"2024-09-17T05:30:06.316512+0000","last_unstale":"2024-09-17T05:30:07.306744+0000","last_undegraded":"2024-09-17T05:30:07.306744+0000","last_fullsized":"2024-09-17T05:30:07.306744+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:29.139353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980453+0000","last_change":"2024-09-17T05:30:06.338103+0000","last_active":"2024-09-17T05:30:07.980453+0000","last_peered":"2024-09-17T05:30:07.980453+0000","last_clean":"2024-09-17T05:30:07.980453+0000","last_became_active":"2024-09-17T05:30:06.337712+0000","last_became_peered":"2024-09-17T05:30:06.337712+0000","last_unstale":"2024-09-17T05:30:07.980453+0000","last_undegraded":"2024-09-17T05:30:07.980453+0000","last_fullsized":"2024-09-17T05:30:07.980453+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:01.151033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983371+0000","last_change":"2024-09-17T05:30:06.317638+0000","last_active":"2024-09-17T05:30:07.983371+0000","last_peered":"2024-09-17T05:30:07.983371+0000","last_clean":"2024-09-17T05:30:07.983371+0000","last_became_active":"2024-09-17T05:30:06.315836+0000","last_became_peered":"2024-09-17T05:30:06.315836+0000","last_unstale":"2024-09-17T05:30:07.983371+0000","last_undegraded":"2024-09-17T05:30:07.983371+0000","last_fullsized":"2024-09-17T05:30:07.983371+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:15.759144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980825+0000","last_change":"2024-09-17T05:30:06.326405+0000","last_active":"2024-09-17T05:30:07.980825+0000","last_peered":"2024-09-17T05:30:07.980825+0000","last_clean":"2024-09-17T05:30:07.980825+0000","last_became_active":"2024-09-17T05:30:06.326093+0000","last_became_peered":"2024-09-17T05:30:06.326093+0000","last_unstale":"2024-09-17T05:30:07.980825+0000","last_undegraded":"2024-09-17T05:30:07.980825+0000","last_fullsized":"2024-09-17T05:30:07.980825+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:19.864402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983696+0000","last_change":"2024-09-17T05:30:06.340085+0000","last_active":"2024-09-17T05:30:07.983696+0000","last_peered":"2024-09-17T05:30:07.983696+0000","last_clean":"2024-09-17T05:30:07.983696+0000","last_became_active":"2024-09-17T05:30:06.339801+0000","last_became_peered":"2024-09-17T05:30:06.339801+0000","last_unstale":"2024-09-17T05:30:07.983696+0000","last_undegraded":"2024-09-17T05:30:07.983696+0000","last_fullsized":"2024-09-17T05:30:07.983696+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:12.149437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979737+0000","last_change":"2024-09-17T05:30:06.335575+0000","last_active":"2024-09-17T05:30:07.979737+0000","last_peered":"2024-09-17T05:30:07.979737+0000","last_clean":"2024-09-17T05:30:07.979737+0000","last_became_active":"2024-09-17T05:30:06.335241+0000","last_became_peered":"2024-09-17T05:30:06.335241+0000","last_unstale":"2024-09-17T05:30:07.979737+0000","last_undegraded":"2024-09-17T05:30:07.979737+0000","last_fullsized":"2024-09-17T05:30:07.979737+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:21.682116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981155+0000","last_change":"2024-09-17T05:30:06.342344+0000","last_active":"2024-09-17T05:30:07.981155+0000","last_peered":"2024-09-17T05:30:07.981155+0000","last_clean":"2024-09-17T05:30:07.981155+0000","last_became_active":"2024-09-17T05:30:06.341691+0000","last_became_peered":"2024-09-17T05:30:06.341691+0000","last_unstale":"2024-09-17T05:30:07.981155+0000","last_undegraded":"2024-09-17T05:30:07.981155+0000","last_fullsized":"2024-09-17T05:30:07.981155+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:44.473010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981052+0000","last_change":"2024-09-17T05:30:06.335792+0000","last_active":"2024-09-17T05:30:07.981052+0000","last_peered":"2024-09-17T05:30:07.981052+0000","last_clean":"2024-09-17T05:30:07.981052+0000","last_became_active":"2024-09-17T05:30:06.335480+0000","last_became_peered":"2024-09-17T05:30:06.335480+0000","last_unstale":"2024-09-17T05:30:07.981052+0000","last_undegraded":"2024-09-17T05:30:07.981052+0000","last_fullsized":"2024-09-17T05:30:07.981052+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:23.591461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980367+0000","last_change":"2024-09-17T05:30:06.341158+0000","last_active":"2024-09-17T05:30:07.980367+0000","last_peered":"2024-09-17T05:30:07.980367+0000","last_clean":"2024-09-17T05:30:07.980367+0000","last_became_active":"2024-09-17T05:30:06.340860+0000","last_became_peered":"2024-09-17T05:30:06.340860+0000","last_unstale":"2024-09-17T05:30:07.980367+0000","last_undegraded":"2024-09-17T05:30:07.980367+0000","last_fullsized":"2024-09-17T05:30:07.980367+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:19.820487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983177+0000","last_change":"2024-09-17T05:30:06.307784+0000","last_active":"2024-09-17T05:30:07.983177+0000","last_peered":"2024-09-17T05:30:07.983177+0000","last_clean":"2024-09-17T05:30:07.983177+0000","last_became_active":"2024-09-17T05:30:06.307523+0000","last_became_peered":"2024-09-17T05:30:06.307523+0000","last_unstale":"2024-09-17T05:30:07.983177+0000","last_undegraded":"2024-09-17T05:30:07.983177+0000","last_fullsized":"2024-09-17T05:30:07.983177+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:46.123430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300058+0000","last_change":"2024-09-17T05:30:06.331592+0000","last_active":"2024-09-17T05:30:07.300058+0000","last_peered":"2024-09-17T05:30:07.300058+0000","last_clean":"2024-09-17T05:30:07.300058+0000","last_became_active":"2024-09-17T05:30:06.329676+0000","last_became_peered":"2024-09-17T05:30:06.329676+0000","last_unstale":"2024-09-17T05:30:07.300058+0000","last_undegraded":"2024-09-17T05:30:07.300058+0000","last_fullsized":"2024-09-17T05:30:07.300058+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:33.485038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980003+0000","last_change":"2024-09-17T05:30:06.341111+0000","last_active":"2024-09-17T05:30:07.980003+0000","last_peered":"2024-09-17T05:30:07.980003+0000","last_clean":"2024-09-17T05:30:07.980003+0000","last_became_active":"2024-09-17T05:30:06.340826+0000","last_became_peered":"2024-09-17T05:30:06.340826+0000","last_unstale":"2024-09-17T05:30:07.980003+0000","last_undegraded":"2024-09-17T05:30:07.980003+0000","last_fullsized":"2024-09-17T05:30:07.980003+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:39.847537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980475+0000","last_change":"2024-09-17T05:30:06.321441+0000","last_active":"2024-09-17T05:30:07.980475+0000","last_peered":"2024-09-17T05:30:07.980475+0000","last_clean":"2024-09-17T05:30:07.980475+0000","last_became_active":"2024-09-17T05:30:06.320838+0000","last_became_peered":"2024-09-17T05:30:06.320838+0000","last_unstale":"2024-09-17T05:30:07.980475+0000","last_undegraded":"2024-09-17T05:30:07.980475+0000","last_fullsized":"2024-09-17T05:30:07.980475+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:27.273165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975246+0000","last_change":"2024-09-17T05:30:06.330815+0000","last_active":"2024-09-17T05:30:07.975246+0000","last_peered":"2024-09-17T05:30:07.975246+0000","last_clean":"2024-09-17T05:30:07.975246+0000","last_became_active":"2024-09-17T05:30:06.330540+0000","last_became_peered":"2024-09-17T05:30:06.330540+0000","last_unstale":"2024-09-17T05:30:07.975246+0000","last_undegraded":"2024-09-17T05:30:07.975246+0000","last_fullsized":"2024-09-17T05:30:07.975246+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:50.740276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.307055+0000","last_change":"2024-09-17T05:30:06.313882+0000","last_active":"2024-09-17T05:30:07.307055+0000","last_peered":"2024-09-17T05:30:07.307055+0000","last_clean":"2024-09-17T05:30:07.307055+0000","last_became_active":"2024-09-17T05:30:06.312977+0000","last_became_peered":"2024-09-17T05:30:06.312977+0000","last_unstale":"2024-09-17T05:30:07.307055+0000","last_undegraded":"2024-09-17T05:30:07.307055+0000","last_fullsized":"2024-09-17T05:30:07.307055+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:08:35.053465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306709+0000","last_change":"2024-09-17T05:30:06.330143+0000","last_active":"2024-09-17T05:30:07.306709+0000","last_peered":"2024-09-17T05:30:07.306709+0000","last_clean":"2024-09-17T05:30:07.306709+0000","last_became_active":"2024-09-17T05:30:06.329890+0000","last_became_peered":"2024-09-17T05:30:06.329890+0000","last_unstale":"2024-09-17T05:30:07.306709+0000","last_undegraded":"2024-09-17T05:30:07.306709+0000","last_fullsized":"2024-09-17T05:30:07.306709+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:51.494900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975823+0000","last_change":"2024-09-17T05:30:06.330201+0000","last_active":"2024-09-17T05:30:07.975823+0000","last_peered":"2024-09-17T05:30:07.975823+0000","last_clean":"2024-09-17T05:30:07.975823+0000","last_became_active":"2024-09-17T05:30:06.329892+0000","last_became_peered":"2024-09-17T05:30:06.329892+0000","last_unstale":"2024-09-17T05:30:07.975823+0000","last_undegraded":"2024-09-17T05:30:07.975823+0000","last_fullsized":"2024-09-17T05:30:07.975823+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:52.043780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300424+0000","last_change":"2024-09-17T05:30:06.326530+0000","last_active":"2024-09-17T05:30:07.300424+0000","last_peered":"2024-09-17T05:30:07.300424+0000","last_clean":"2024-09-17T05:30:07.300424+0000","last_became_active":"2024-09-17T05:30:06.326217+0000","last_became_peered":"2024-09-17T05:30:06.326217+0000","last_unstale":"2024-09-17T05:30:07.300424+0000","last_undegraded":"2024-09-17T05:30:07.300424+0000","last_fullsized":"2024-09-17T05:30:07.300424+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:20.876601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980934+0000","last_change":"2024-09-17T05:30:06.326921+0000","last_active":"2024-09-17T05:30:07.980934+0000","last_peered":"2024-09-17T05:30:07.980934+0000","last_clean":"2024-09-17T05:30:07.980934+0000","last_became_active":"2024-09-17T05:30:06.326659+0000","last_became_peered":"2024-09-17T05:30:06.326659+0000","last_unstale":"2024-09-17T05:30:07.980934+0000","last_undegraded":"2024-09-17T05:30:07.980934+0000","last_fullsized":"2024-09-17T05:30:07.980934+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:31.349115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980167+0000","last_change":"2024-09-17T05:30:06.336071+0000","last_active":"2024-09-17T05:30:07.980167+0000","last_peered":"2024-09-17T05:30:07.980167+0000","last_clean":"2024-09-17T05:30:07.980167+0000","last_became_active":"2024-09-17T05:30:06.335275+0000","last_became_peered":"2024-09-17T05:30:06.335275+0000","last_unstale":"2024-09-17T05:30:07.980167+0000","last_undegraded":"2024-09-17T05:30:07.980167+0000","last_fullsized":"2024-09-17T05:30:07.980167+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:58.105556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975191+0000","last_change":"2024-09-17T05:30:06.324782+0000","last_active":"2024-09-17T05:30:07.975191+0000","last_peered":"2024-09-17T05:30:07.975191+0000","last_clean":"2024-09-17T05:30:07.975191+0000","last_became_active":"2024-09-17T05:30:06.324484+0000","last_became_peered":"2024-09-17T05:30:06.324484+0000","last_unstale":"2024-09-17T05:30:07.975191+0000","last_undegraded":"2024-09-17T05:30:07.975191+0000","last_fullsized":"2024-09-17T05:30:07.975191+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:59.232774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975602+0000","last_change":"2024-09-17T05:30:06.320703+0000","last_active":"2024-09-17T05:30:07.975602+0000","last_peered":"2024-09-17T05:30:07.975602+0000","last_clean":"2024-09-17T05:30:07.975602+0000","last_became_active":"2024-09-17T05:30:06.320432+0000","last_became_peered":"2024-09-17T05:30:06.320432+0000","last_unstale":"2024-09-17T05:30:07.975602+0000","last_undegraded":"2024-09-17T05:30:07.975602+0000","last_fullsized":"2024-09-17T05:30:07.975602+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:47:10.927229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975655+0000","last_change":"2024-09-17T05:30:06.340184+0000","last_active":"2024-09-17T05:30:07.975655+0000","last_peered":"2024-09-17T05:30:07.975655+0000","last_clean":"2024-09-17T05:30:07.975655+0000","last_became_active":"2024-09-17T05:30:06.339844+0000","last_became_peered":"2024-09-17T05:30:06.339844+0000","last_unstale":"2024-09-17T05:30:07.975655+0000","last_undegraded":"2024-09-17T05:30:07.975655+0000","last_fullsized":"2024-09-17T05:30:07.975655+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:21.303474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300275+0000","last_change":"2024-09-17T05:30:06.325741+0000","last_active":"2024-09-17T05:30:07.300275+0000","last_peered":"2024-09-17T05:30:07.300275+0000","last_clean":"2024-09-17T05:30:07.300275+0000","last_became_active":"2024-09-17T05:30:06.323875+0000","last_became_peered":"2024-09-17T05:30:06.323875+0000","last_unstale":"2024-09-17T05:30:07.300275+0000","last_undegraded":"2024-09-17T05:30:07.300275+0000","last_fullsized":"2024-09-17T05:30:07.300275+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:28.377585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306617+0000","last_change":"2024-09-17T05:30:06.309486+0000","last_active":"2024-09-17T05:30:07.306617+0000","last_peered":"2024-09-17T05:30:07.306617+0000","last_clean":"2024-09-17T05:30:07.306617+0000","last_became_active":"2024-09-17T05:30:06.309117+0000","last_became_peered":"2024-09-17T05:30:06.309117+0000","last_unstale":"2024-09-17T05:30:07.306617+0000","last_undegraded":"2024-09-17T05:30:07.306617+0000","last_fullsized":"2024-09-17T05:30:07.306617+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:40.183144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983191+0000","last_change":"2024-09-17T05:30:06.307863+0000","last_active":"2024-09-17T05:30:07.983191+0000","last_peered":"2024-09-17T05:30:07.983191+0000","last_clean":"2024-09-17T05:30:07.983191+0000","last_became_active":"2024-09-17T05:30:06.307597+0000","last_became_peered":"2024-09-17T05:30:06.307597+0000","last_unstale":"2024-09-17T05:30:07.983191+0000","last_undegraded":"2024-09-17T05:30:07.983191+0000","last_fullsized":"2024-09-17T05:30:07.983191+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:23.591461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975439+0000","last_change":"2024-09-17T05:30:06.326327+0000","last_active":"2024-09-17T05:30:07.975439+0000","last_peered":"2024-09-17T05:30:07.975439+0000","last_clean":"2024-09-17T05:30:07.975439+0000","last_became_active":"2024-09-17T05:30:06.326080+0000","last_became_peered":"2024-09-17T05:30:06.326080+0000","last_unstale":"2024-09-17T05:30:07.975439+0000","last_undegraded":"2024-09-17T05:30:07.975439+0000","last_fullsized":"2024-09-17T05:30:07.975439+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:12.915311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306433+0000","last_change":"2024-09-17T05:30:06.313960+0000","last_active":"2024-09-17T05:30:07.306433+0000","last_peered":"2024-09-17T05:30:07.306433+0000","last_clean":"2024-09-17T05:30:07.306433+0000","last_became_active":"2024-09-17T05:30:06.313697+0000","last_became_peered":"2024-09-17T05:30:06.313697+0000","last_unstale":"2024-09-17T05:30:07.306433+0000","last_undegraded":"2024-09-17T05:30:07.306433+0000","last_fullsized":"2024-09-17T05:30:07.306433+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:36.122412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980787+0000","last_change":"2024-09-17T05:30:06.321560+0000","last_active":"2024-09-17T05:30:07.980787+0000","last_peered":"2024-09-17T05:30:07.980787+0000","last_clean":"2024-09-17T05:30:07.980787+0000","last_became_active":"2024-09-17T05:30:06.321157+0000","last_became_peered":"2024-09-17T05:30:06.321157+0000","last_unstale":"2024-09-17T05:30:07.980787+0000","last_undegraded":"2024-09-17T05:30:07.980787+0000","last_fullsized":"2024-09-17T05:30:07.980787+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:26.633690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.299919+0000","last_change":"2024-09-17T05:30:06.314723+0000","last_active":"2024-09-17T05:30:07.299919+0000","last_peered":"2024-09-17T05:30:07.299919+0000","last_clean":"2024-09-17T05:30:07.299919+0000","last_became_active":"2024-09-17T05:30:06.314281+0000","last_became_peered":"2024-09-17T05:30:06.314281+0000","last_unstale":"2024-09-17T05:30:07.299919+0000","last_undegraded":"2024-09-17T05:30:07.299919+0000","last_fullsized":"2024-09-17T05:30:07.299919+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:39.708265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.303579+0000","last_change":"2024-09-17T05:30:06.341890+0000","last_active":"2024-09-17T05:30:07.303579+0000","last_peered":"2024-09-17T05:30:07.303579+0000","last_clean":"2024-09-17T05:30:07.303579+0000","last_became_active":"2024-09-17T05:30:06.340710+0000","last_became_peered":"2024-09-17T05:30:06.340710+0000","last_unstale":"2024-09-17T05:30:07.303579+0000","last_undegraded":"2024-09-17T05:30:07.303579+0000","last_fullsized":"2024-09-17T05:30:07.303579+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:10.264251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981297+0000","last_change":"2024-09-17T05:30:05.317839+0000","last_active":"2024-09-17T05:30:07.981297+0000","last_peered":"2024-09-17T05:30:07.981297+0000","last_clean":"2024-09-17T05:30:07.981297+0000","last_became_active":"2024-09-17T05:30:05.317232+0000","last_became_peered":"2024-09-17T05:30:05.317232+0000","last_unstale":"2024-09-17T05:30:07.981297+0000","last_undegraded":"2024-09-17T05:30:07.981297+0000","last_fullsized":"2024-09-17T05:30:07.981297+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:08.447005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975543+0000","last_change":"2024-09-17T05:30:06.317027+0000","last_active":"2024-09-17T05:30:07.975543+0000","last_peered":"2024-09-17T05:30:07.975543+0000","last_clean":"2024-09-17T05:30:07.975543+0000","last_became_active":"2024-09-17T05:30:06.316750+0000","last_became_peered":"2024-09-17T05:30:06.316750+0000","last_unstale":"2024-09-17T05:30:07.975543+0000","last_undegraded":"2024-09-17T05:30:07.975543+0000","last_fullsized":"2024-09-17T05:30:07.975543+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:42.185698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306908+0000","last_change":"2024-09-17T05:30:05.322455+0000","last_active":"2024-09-17T05:30:07.306908+0000","last_peered":"2024-09-17T05:30:07.306908+0000","last_clean":"2024-09-17T05:30:07.306908+0000","last_became_active":"2024-09-17T05:30:05.321568+0000","last_became_peered":"2024-09-17T05:30:05.321568+0000","last_unstale":"2024-09-17T05:30:07.306908+0000","last_undegraded":"2024-09-17T05:30:07.306908+0000","last_fullsized":"2024-09-17T05:30:07.306908+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:26.627551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983603+0000","last_change":"2024-09-17T05:30:06.328218+0000","last_active":"2024-09-17T05:30:07.983603+0000","last_peered":"2024-09-17T05:30:07.983603+0000","last_clean":"2024-09-17T05:30:07.983603+0000","last_became_active":"2024-09-17T05:30:06.327401+0000","last_became_peered":"2024-09-17T05:30:06.327401+0000","last_unstale":"2024-09-17T05:30:07.983603+0000","last_undegraded":"2024-09-17T05:30:07.983603+0000","last_fullsized":"2024-09-17T05:30:07.983603+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:02.179760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.303592+0000","last_change":"2024-09-17T05:30:05.311818+0000","last_active":"2024-09-17T05:30:07.303592+0000","last_peered":"2024-09-17T05:30:07.303592+0000","last_clean":"2024-09-17T05:30:07.303592+0000","last_became_active":"2024-09-17T05:30:05.311531+0000","last_became_peered":"2024-09-17T05:30:05.311531+0000","last_unstale":"2024-09-17T05:30:07.303592+0000","last_undegraded":"2024-09-17T05:30:07.303592+0000","last_fullsized":"2024-09-17T05:30:07.303592+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:20.595118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.303692+0000","last_change":"2024-09-17T05:30:06.325494+0000","last_active":"2024-09-17T05:30:07.303692+0000","last_peered":"2024-09-17T05:30:07.303692+0000","last_clean":"2024-09-17T05:30:07.303692+0000","last_became_active":"2024-09-17T05:30:06.325221+0000","last_became_peered":"2024-09-17T05:30:06.325221+0000","last_unstale":"2024-09-17T05:30:07.303692+0000","last_undegraded":"2024-09-17T05:30:07.303692+0000","last_fullsized":"2024-09-17T05:30:07.303692+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:26.520589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983801+0000","last_change":"2024-09-17T05:30:05.322973+0000","last_active":"2024-09-17T05:30:07.983801+0000","last_peered":"2024-09-17T05:30:07.983801+0000","last_clean":"2024-09-17T05:30:07.983801+0000","last_became_active":"2024-09-17T05:30:05.322630+0000","last_became_peered":"2024-09-17T05:30:05.322630+0000","last_unstale":"2024-09-17T05:30:07.983801+0000","last_undegraded":"2024-09-17T05:30:07.983801+0000","last_fullsized":"2024-09-17T05:30:07.983801+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:33.104861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306449+0000","last_change":"2024-09-17T05:30:06.320760+0000","last_active":"2024-09-17T05:30:07.306449+0000","last_peered":"2024-09-17T05:30:07.306449+0000","last_clean":"2024-09-17T05:30:07.306449+0000","last_became_active":"2024-09-17T05:30:06.320555+0000","last_became_peered":"2024-09-17T05:30:06.320555+0000","last_unstale":"2024-09-17T05:30:07.306449+0000","last_undegraded":"2024-09-17T05:30:07.306449+0000","last_fullsized":"2024-09-17T05:30:07.306449+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:32.703154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981003+0000","last_change":"2024-09-17T05:30:05.304552+0000","last_active":"2024-09-17T05:30:07.981003+0000","last_peered":"2024-09-17T05:30:07.981003+0000","last_clean":"2024-09-17T05:30:07.981003+0000","last_became_active":"2024-09-17T05:30:05.304231+0000","last_became_peered":"2024-09-17T05:30:05.304231+0000","last_unstale":"2024-09-17T05:30:07.981003+0000","last_undegraded":"2024-09-17T05:30:07.981003+0000","last_fullsized":"2024-09-17T05:30:07.981003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:08:34.042249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980259+0000","last_change":"2024-09-17T05:30:06.325560+0000","last_active":"2024-09-17T05:30:07.980259+0000","last_peered":"2024-09-17T05:30:07.980259+0000","last_clean":"2024-09-17T05:30:07.980259+0000","last_became_active":"2024-09-17T05:30:06.325277+0000","last_became_peered":"2024-09-17T05:30:06.325277+0000","last_unstale":"2024-09-17T05:30:07.980259+0000","last_undegraded":"2024-09-17T05:30:07.980259+0000","last_fullsized":"2024-09-17T05:30:07.980259+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:55.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306504+0000","last_change":"2024-09-17T05:30:05.317320+0000","last_active":"2024-09-17T05:30:07.306504+0000","last_peered":"2024-09-17T05:30:07.306504+0000","last_clean":"2024-09-17T05:30:07.306504+0000","last_became_active":"2024-09-17T05:30:05.316339+0000","last_became_peered":"2024-09-17T05:30:05.316339+0000","last_unstale":"2024-09-17T05:30:07.306504+0000","last_undegraded":"2024-09-17T05:30:07.306504+0000","last_fullsized":"2024-09-17T05:30:07.306504+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:11.751995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979944+0000","last_change":"2024-09-17T05:30:06.316204+0000","last_active":"2024-09-17T05:30:07.979944+0000","last_peered":"2024-09-17T05:30:07.979944+0000","last_clean":"2024-09-17T05:30:07.979944+0000","last_became_active":"2024-09-17T05:30:06.315889+0000","last_became_peered":"2024-09-17T05:30:06.315889+0000","last_unstale":"2024-09-17T05:30:07.979944+0000","last_undegraded":"2024-09-17T05:30:07.979944+0000","last_fullsized":"2024-09-17T05:30:07.979944+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:11:29.366814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983052+0000","last_change":"2024-09-17T05:30:05.310665+0000","last_active":"2024-09-17T05:30:07.983052+0000","last_peered":"2024-09-17T05:30:07.983052+0000","last_clean":"2024-09-17T05:30:07.983052+0000","last_became_active":"2024-09-17T05:30:05.310386+0000","last_became_peered":"2024-09-17T05:30:05.310386+0000","last_unstale":"2024-09-17T05:30:07.983052+0000","last_undegraded":"2024-09-17T05:30:07.983052+0000","last_fullsized":"2024-09-17T05:30:07.983052+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:05.244402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975208+0000","last_change":"2024-09-17T05:30:06.324092+0000","last_active":"2024-09-17T05:30:07.975208+0000","last_peered":"2024-09-17T05:30:07.975208+0000","last_clean":"2024-09-17T05:30:07.975208+0000","last_became_active":"2024-09-17T05:30:06.323729+0000","last_became_peered":"2024-09-17T05:30:06.323729+0000","last_unstale":"2024-09-17T05:30:07.975208+0000","last_undegraded":"2024-09-17T05:30:07.975208+0000","last_fullsized":"2024-09-17T05:30:07.975208+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:00.306496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979862+0000","last_change":"2024-09-17T05:30:05.320099+0000","last_active":"2024-09-17T05:30:07.979862+0000","last_peered":"2024-09-17T05:30:07.979862+0000","last_clean":"2024-09-17T05:30:07.979862+0000","last_became_active":"2024-09-17T05:30:05.319784+0000","last_became_peered":"2024-09-17T05:30:05.319784+0000","last_unstale":"2024-09-17T05:30:07.979862+0000","last_undegraded":"2024-09-17T05:30:07.979862+0000","last_fullsized":"2024-09-17T05:30:07.979862+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:45.978034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306898+0000","last_change":"2024-09-17T05:30:06.325993+0000","last_active":"2024-09-17T05:30:07.306898+0000","last_peered":"2024-09-17T05:30:07.306898+0000","last_clean":"2024-09-17T05:30:07.306898+0000","last_became_active":"2024-09-17T05:30:06.325740+0000","last_became_peered":"2024-09-17T05:30:06.325740+0000","last_unstale":"2024-09-17T05:30:07.306898+0000","last_undegraded":"2024-09-17T05:30:07.306898+0000","last_fullsized":"2024-09-17T05:30:07.306898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:09.458221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306985+0000","last_change":"2024-09-17T05:30:05.317752+0000","last_active":"2024-09-17T05:30:07.306985+0000","last_peered":"2024-09-17T05:30:07.306985+0000","last_clean":"2024-09-17T05:30:07.306985+0000","last_became_active":"2024-09-17T05:30:05.317390+0000","last_became_peered":"2024-09-17T05:30:05.317390+0000","last_unstale":"2024-09-17T05:30:07.306985+0000","last_undegraded":"2024-09-17T05:30:07.306985+0000","last_fullsized":"2024-09-17T05:30:07.306985+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:41.174482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.984020+0000","last_change":"2024-09-17T05:30:06.318563+0000","last_active":"2024-09-17T05:30:07.984020+0000","last_peered":"2024-09-17T05:30:07.984020+0000","last_clean":"2024-09-17T05:30:07.984020+0000","last_became_active":"2024-09-17T05:30:06.318311+0000","last_became_peered":"2024-09-17T05:30:06.318311+0000","last_unstale":"2024-09-17T05:30:07.984020+0000","last_undegraded":"2024-09-17T05:30:07.984020+0000","last_fullsized":"2024-09-17T05:30:07.984020+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:46.303739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981364+0000","last_change":"2024-09-17T05:30:05.319325+0000","last_active":"2024-09-17T05:30:07.981364+0000","last_peered":"2024-09-17T05:30:07.981364+0000","last_clean":"2024-09-17T05:30:07.981364+0000","last_became_active":"2024-09-17T05:30:05.319073+0000","last_became_peered":"2024-09-17T05:30:05.319073+0000","last_unstale":"2024-09-17T05:30:07.981364+0000","last_undegraded":"2024-09-17T05:30:07.981364+0000","last_fullsized":"2024-09-17T05:30:07.981364+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:42.469849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981729+0000","last_change":"2024-09-17T05:30:06.328855+0000","last_active":"2024-09-17T05:30:07.981729+0000","last_peered":"2024-09-17T05:30:07.981729+0000","last_clean":"2024-09-17T05:30:07.981729+0000","last_became_active":"2024-09-17T05:30:06.327889+0000","last_became_peered":"2024-09-17T05:30:06.327889+0000","last_unstale":"2024-09-17T05:30:07.981729+0000","last_undegraded":"2024-09-17T05:30:07.981729+0000","last_fullsized":"2024-09-17T05:30:07.981729+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:21:32.790498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.984049+0000","last_change":"2024-09-17T05:30:05.325847+0000","last_active":"2024-09-17T05:30:07.984049+0000","last_peered":"2024-09-17T05:30:07.984049+0000","last_clean":"2024-09-17T05:30:07.984049+0000","last_became_active":"2024-09-17T05:30:05.325555+0000","last_became_peered":"2024-09-17T05:30:05.325555+0000","last_unstale":"2024-09-17T05:30:07.984049+0000","last_undegraded":"2024-09-17T05:30:07.984049+0000","last_fullsized":"2024-09-17T05:30:07.984049+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:50.483684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983999+0000","last_change":"2024-09-17T05:30:06.340675+0000","last_active":"2024-09-17T05:30:07.983999+0000","last_peered":"2024-09-17T05:30:07.983999+0000","last_clean":"2024-09-17T05:30:07.983999+0000","last_became_active":"2024-09-17T05:30:06.340429+0000","last_became_peered":"2024-09-17T05:30:06.340429+0000","last_unstale":"2024-09-17T05:30:07.983999+0000","last_undegraded":"2024-09-17T05:30:07.983999+0000","last_fullsized":"2024-09-17T05:30:07.983999+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:10.151279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300482+0000","last_change":"2024-09-17T05:30:05.319324+0000","last_active":"2024-09-17T05:30:07.300482+0000","last_peered":"2024-09-17T05:30:07.300482+0000","last_clean":"2024-09-17T05:30:07.300482+0000","last_became_active":"2024-09-17T05:30:05.319027+0000","last_became_peered":"2024-09-17T05:30:05.319027+0000","last_unstale":"2024-09-17T05:30:07.300482+0000","last_undegraded":"2024-09-17T05:30:07.300482+0000","last_fullsized":"2024-09-17T05:30:07.300482+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:17.785457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975385+0000","last_change":"2024-09-17T05:30:06.320266+0000","last_active":"2024-09-17T05:30:07.975385+0000","last_peered":"2024-09-17T05:30:07.975385+0000","last_clean":"2024-09-17T05:30:07.975385+0000","last_became_active":"2024-09-17T05:30:06.319980+0000","last_became_peered":"2024-09-17T05:30:06.319980+0000","last_unstale":"2024-09-17T05:30:07.975385+0000","last_undegraded":"2024-09-17T05:30:07.975385+0000","last_fullsized":"2024-09-17T05:30:07.975385+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:41.689813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981119+0000","last_change":"2024-09-17T05:30:05.317446+0000","last_active":"2024-09-17T05:30:07.981119+0000","last_peered":"2024-09-17T05:30:07.981119+0000","last_clean":"2024-09-17T05:30:07.981119+0000","last_became_active":"2024-09-17T05:30:05.317157+0000","last_became_peered":"2024-09-17T05:30:05.317157+0000","last_unstale":"2024-09-17T05:30:07.981119+0000","last_undegraded":"2024-09-17T05:30:07.981119+0000","last_fullsized":"2024-09-17T05:30:07.981119+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:48.813550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980759+0000","last_change":"2024-09-17T05:30:06.335728+0000","last_active":"2024-09-17T05:30:07.980759+0000","last_peered":"2024-09-17T05:30:07.980759+0000","last_clean":"2024-09-17T05:30:07.980759+0000","last_became_active":"2024-09-17T05:30:06.335019+0000","last_became_peered":"2024-09-17T05:30:06.335019+0000","last_unstale":"2024-09-17T05:30:07.980759+0000","last_undegraded":"2024-09-17T05:30:07.980759+0000","last_fullsized":"2024-09-17T05:30:07.980759+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:46.123430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983634+0000","last_change":"2024-09-17T05:30:05.319744+0000","last_active":"2024-09-17T05:30:07.983634+0000","last_peered":"2024-09-17T05:30:07.983634+0000","last_clean":"2024-09-17T05:30:07.983634+0000","last_became_active":"2024-09-17T05:30:05.319478+0000","last_became_peered":"2024-09-17T05:30:05.319478+0000","last_unstale":"2024-09-17T05:30:07.983634+0000","last_undegraded":"2024-09-17T05:30:07.983634+0000","last_fullsized":"2024-09-17T05:30:07.983634+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:29.060749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980018+0000","last_change":"2024-09-17T05:30:06.322896+0000","last_active":"2024-09-17T05:30:07.980018+0000","last_peered":"2024-09-17T05:30:07.980018+0000","last_clean":"2024-09-17T05:30:07.980018+0000","last_became_active":"2024-09-17T05:30:06.322165+0000","last_became_peered":"2024-09-17T05:30:06.322165+0000","last_unstale":"2024-09-17T05:30:07.980018+0000","last_undegraded":"2024-09-17T05:30:07.980018+0000","last_fullsized":"2024-09-17T05:30:07.980018+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:31.155570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980611+0000","last_change":"2024-09-17T05:30:05.322669+0000","last_active":"2024-09-17T05:30:07.980611+0000","last_peered":"2024-09-17T05:30:07.980611+0000","last_clean":"2024-09-17T05:30:07.980611+0000","last_became_active":"2024-09-17T05:30:05.321429+0000","last_became_peered":"2024-09-17T05:30:05.321429+0000","last_unstale":"2024-09-17T05:30:07.980611+0000","last_undegraded":"2024-09-17T05:30:07.980611+0000","last_fullsized":"2024-09-17T05:30:07.980611+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:14.517825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983709+0000","last_change":"2024-09-17T05:30:06.323916+0000","last_active":"2024-09-17T05:30:07.983709+0000","last_peered":"2024-09-17T05:30:07.983709+0000","last_clean":"2024-09-17T05:30:07.983709+0000","last_became_active":"2024-09-17T05:30:06.323648+0000","last_became_peered":"2024-09-17T05:30:06.323648+0000","last_unstale":"2024-09-17T05:30:07.983709+0000","last_undegraded":"2024-09-17T05:30:07.983709+0000","last_fullsized":"2024-09-17T05:30:07.983709+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:14.523342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979984+0000","last_change":"2024-09-17T05:30:05.325941+0000","last_active":"2024-09-17T05:30:07.979984+0000","last_peered":"2024-09-17T05:30:07.979984+0000","last_clean":"2024-09-17T05:30:07.979984+0000","last_became_active":"2024-09-17T05:30:05.325555+0000","last_became_peered":"2024-09-17T05:30:05.325555+0000","last_unstale":"2024-09-17T05:30:07.979984+0000","last_undegraded":"2024-09-17T05:30:07.979984+0000","last_fullsized":"2024-09-17T05:30:07.979984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:53.248264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300481+0000","last_change":"2024-09-17T05:30:06.310721+0000","last_active":"2024-09-17T05:30:07.300481+0000","last_peered":"2024-09-17T05:30:07.300481+0000","last_clean":"2024-09-17T05:30:07.300481+0000","last_became_active":"2024-09-17T05:30:06.310439+0000","last_became_peered":"2024-09-17T05:30:06.310439+0000","last_unstale":"2024-09-17T05:30:07.300481+0000","last_undegraded":"2024-09-17T05:30:07.300481+0000","last_fullsized":"2024-09-17T05:30:07.300481+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:01.164644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300253+0000","last_change":"2024-09-17T05:30:05.325974+0000","last_active":"2024-09-17T05:30:07.300253+0000","last_peered":"2024-09-17T05:30:07.300253+0000","last_clean":"2024-09-17T05:30:07.300253+0000","last_became_active":"2024-09-17T05:30:05.325587+0000","last_became_peered":"2024-09-17T05:30:05.325587+0000","last_unstale":"2024-09-17T05:30:07.300253+0000","last_undegraded":"2024-09-17T05:30:07.300253+0000","last_fullsized":"2024-09-17T05:30:07.300253+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:22.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981411+0000","last_change":"2024-09-17T05:30:06.324125+0000","last_active":"2024-09-17T05:30:07.981411+0000","last_peered":"2024-09-17T05:30:07.981411+0000","last_clean":"2024-09-17T05:30:07.981411+0000","last_became_active":"2024-09-17T05:30:06.323889+0000","last_became_peered":"2024-09-17T05:30:06.323889+0000","last_unstale":"2024-09-17T05:30:07.981411+0000","last_undegraded":"2024-09-17T05:30:07.981411+0000","last_fullsized":"2024-09-17T05:30:07.981411+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:02.179760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306975+0000","last_change":"2024-09-17T05:30:05.318534+0000","last_active":"2024-09-17T05:30:07.306975+0000","last_peered":"2024-09-17T05:30:07.306975+0000","last_clean":"2024-09-17T05:30:07.306975+0000","last_became_active":"2024-09-17T05:30:05.318295+0000","last_became_peered":"2024-09-17T05:30:05.318295+0000","last_unstale":"2024-09-17T05:30:07.306975+0000","last_undegraded":"2024-09-17T05:30:07.306975+0000","last_fullsized":"2024-09-17T05:30:07.306975+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:56.087814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975580+0000","last_change":"2024-09-17T05:30:06.331809+0000","last_active":"2024-09-17T05:30:07.975580+0000","last_peered":"2024-09-17T05:30:07.975580+0000","last_clean":"2024-09-17T05:30:07.975580+0000","last_became_active":"2024-09-17T05:30:06.331496+0000","last_became_peered":"2024-09-17T05:30:06.331496+0000","last_unstale":"2024-09-17T05:30:07.975580+0000","last_undegraded":"2024-09-17T05:30:07.975580+0000","last_fullsized":"2024-09-17T05:30:07.975580+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:47.169886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983072+0000","last_change":"2024-09-17T05:30:05.317351+0000","last_active":"2024-09-17T05:30:07.983072+0000","last_peered":"2024-09-17T05:30:07.983072+0000","last_clean":"2024-09-17T05:30:07.983072+0000","last_became_active":"2024-09-17T05:30:05.315615+0000","last_became_peered":"2024-09-17T05:30:05.315615+0000","last_unstale":"2024-09-17T05:30:07.983072+0000","last_undegraded":"2024-09-17T05:30:07.983072+0000","last_fullsized":"2024-09-17T05:30:07.983072+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:20.670899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975864+0000","last_change":"2024-09-17T05:30:06.323503+0000","last_active":"2024-09-17T05:30:07.975864+0000","last_peered":"2024-09-17T05:30:07.975864+0000","last_clean":"2024-09-17T05:30:07.975864+0000","last_became_active":"2024-09-17T05:30:06.323215+0000","last_became_peered":"2024-09-17T05:30:06.323215+0000","last_unstale":"2024-09-17T05:30:07.975864+0000","last_undegraded":"2024-09-17T05:30:07.975864+0000","last_fullsized":"2024-09-17T05:30:07.975864+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:59.484368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981563+0000","last_change":"2024-09-17T05:30:05.321166+0000","last_active":"2024-09-17T05:30:07.981563+0000","last_peered":"2024-09-17T05:30:07.981563+0000","last_clean":"2024-09-17T05:30:07.981563+0000","last_became_active":"2024-09-17T05:30:05.320876+0000","last_became_peered":"2024-09-17T05:30:05.320876+0000","last_unstale":"2024-09-17T05:30:07.981563+0000","last_undegraded":"2024-09-17T05:30:07.981563+0000","last_fullsized":"2024-09-17T05:30:07.981563+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:06.806797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980877+0000","last_change":"2024-09-17T05:30:06.331593+0000","last_active":"2024-09-17T05:30:07.980877+0000","last_peered":"2024-09-17T05:30:07.980877+0000","last_clean":"2024-09-17T05:30:07.980877+0000","last_became_active":"2024-09-17T05:30:06.328034+0000","last_became_peered":"2024-09-17T05:30:06.328034+0000","last_unstale":"2024-09-17T05:30:07.980877+0000","last_undegraded":"2024-09-17T05:30:07.980877+0000","last_fullsized":"2024-09-17T05:30:07.980877+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:51.251941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981285+0000","last_change":"2024-09-17T05:30:05.304880+0000","last_active":"2024-09-17T05:30:07.981285+0000","last_peered":"2024-09-17T05:30:07.981285+0000","last_clean":"2024-09-17T05:30:07.981285+0000","last_became_active":"2024-09-17T05:30:05.304284+0000","last_became_peered":"2024-09-17T05:30:05.304284+0000","last_unstale":"2024-09-17T05:30:07.981285+0000","last_undegraded":"2024-09-17T05:30:07.981285+0000","last_fullsized":"2024-09-17T05:30:07.981285+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:48.792196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.303380+0000","last_change":"2024-09-17T05:30:06.336975+0000","last_active":"2024-09-17T05:30:07.303380+0000","last_peered":"2024-09-17T05:30:07.303380+0000","last_clean":"2024-09-17T05:30:07.303380+0000","last_became_active":"2024-09-17T05:30:06.336526+0000","last_became_peered":"2024-09-17T05:30:06.336526+0000","last_unstale":"2024-09-17T05:30:07.303380+0000","last_undegraded":"2024-09-17T05:30:07.303380+0000","last_fullsized":"2024-09-17T05:30:07.303380+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:29.608158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.982840+0000","last_change":"2024-09-17T05:30:05.319225+0000","last_active":"2024-09-17T05:30:07.982840+0000","last_peered":"2024-09-17T05:30:07.982840+0000","last_clean":"2024-09-17T05:30:07.982840+0000","last_became_active":"2024-09-17T05:30:05.318757+0000","last_became_peered":"2024-09-17T05:30:05.318757+0000","last_unstale":"2024-09-17T05:30:07.982840+0000","last_undegraded":"2024-09-17T05:30:07.982840+0000","last_fullsized":"2024-09-17T05:30:07.982840+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:28.145122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300066+0000","last_change":"2024-09-17T05:30:06.311407+0000","last_active":"2024-09-17T05:30:07.300066+0000","last_peered":"2024-09-17T05:30:07.300066+0000","last_clean":"2024-09-17T05:30:07.300066+0000","last_became_active":"2024-09-17T05:30:06.311072+0000","last_became_peered":"2024-09-17T05:30:06.311072+0000","last_unstale":"2024-09-17T05:30:07.300066+0000","last_undegraded":"2024-09-17T05:30:07.300066+0000","last_fullsized":"2024-09-17T05:30:07.300066+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:13.587884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979805+0000","last_change":"2024-09-17T05:30:05.322027+0000","last_active":"2024-09-17T05:30:07.979805+0000","last_peered":"2024-09-17T05:30:07.979805+0000","last_clean":"2024-09-17T05:30:07.979805+0000","last_became_active":"2024-09-17T05:30:05.321704+0000","last_became_peered":"2024-09-17T05:30:05.321704+0000","last_unstale":"2024-09-17T05:30:07.979805+0000","last_undegraded":"2024-09-17T05:30:07.979805+0000","last_fullsized":"2024-09-17T05:30:07.979805+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:15.832365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979830+0000","last_change":"2024-09-17T05:30:06.340286+0000","last_active":"2024-09-17T05:30:07.979830+0000","last_peered":"2024-09-17T05:30:07.979830+0000","last_clean":"2024-09-17T05:30:07.979830+0000","last_became_active":"2024-09-17T05:30:06.340000+0000","last_became_peered":"2024-09-17T05:30:06.340000+0000","last_unstale":"2024-09-17T05:30:07.979830+0000","last_undegraded":"2024-09-17T05:30:07.979830+0000","last_fullsized":"2024-09-17T05:30:07.979830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:54.770556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983295+0000","last_change":"2024-09-17T05:30:05.315124+0000","last_active":"2024-09-17T05:30:07.983295+0000","last_peered":"2024-09-17T05:30:07.983295+0000","last_clean":"2024-09-17T05:30:07.983295+0000","last_became_active":"2024-09-17T05:30:05.314810+0000","last_became_peered":"2024-09-17T05:30:05.314810+0000","last_unstale":"2024-09-17T05:30:07.983295+0000","last_undegraded":"2024-09-17T05:30:07.983295+0000","last_fullsized":"2024-09-17T05:30:07.983295+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:23.210611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975736+0000","last_change":"2024-09-17T05:30:06.320245+0000","last_active":"2024-09-17T05:30:07.975736+0000","last_peered":"2024-09-17T05:30:07.975736+0000","last_clean":"2024-09-17T05:30:07.975736+0000","last_became_active":"2024-09-17T05:30:06.319945+0000","last_became_peered":"2024-09-17T05:30:06.319945+0000","last_unstale":"2024-09-17T05:30:07.975736+0000","last_undegraded":"2024-09-17T05:30:07.975736+0000","last_fullsized":"2024-09-17T05:30:07.975736+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:37.456433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981138+0000","last_change":"2024-09-17T05:30:05.316670+0000","last_active":"2024-09-17T05:30:07.981138+0000","last_peered":"2024-09-17T05:30:07.981138+0000","last_clean":"2024-09-17T05:30:07.981138+0000","last_became_active":"2024-09-17T05:30:05.316423+0000","last_became_peered":"2024-09-17T05:30:05.316423+0000","last_unstale":"2024-09-17T05:30:07.981138+0000","last_undegraded":"2024-09-17T05:30:07.981138+0000","last_fullsized":"2024-09-17T05:30:07.981138+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:46.803998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980666+0000","last_change":"2024-09-17T05:30:06.332073+0000","last_active":"2024-09-17T05:30:07.980666+0000","last_peered":"2024-09-17T05:30:07.980666+0000","last_clean":"2024-09-17T05:30:07.980666+0000","last_became_active":"2024-09-17T05:30:06.331396+0000","last_became_peered":"2024-09-17T05:30:06.331396+0000","last_unstale":"2024-09-17T05:30:07.980666+0000","last_undegraded":"2024-09-17T05:30:07.980666+0000","last_fullsized":"2024-09-17T05:30:07.980666+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:18.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.984087+0000","last_change":"2024-09-17T05:30:05.319860+0000","last_active":"2024-09-17T05:30:07.984087+0000","last_peered":"2024-09-17T05:30:07.984087+0000","last_clean":"2024-09-17T05:30:07.984087+0000","last_became_active":"2024-09-17T05:30:05.319572+0000","last_became_peered":"2024-09-17T05:30:05.319572+0000","last_unstale":"2024-09-17T05:30:07.984087+0000","last_undegraded":"2024-09-17T05:30:07.984087+0000","last_fullsized":"2024-09-17T05:30:07.984087+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:06.333614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.984046+0000","last_change":"2024-09-17T05:30:06.330620+0000","last_active":"2024-09-17T05:30:07.984046+0000","last_peered":"2024-09-17T05:30:07.984046+0000","last_clean":"2024-09-17T05:30:07.984046+0000","last_became_active":"2024-09-17T05:30:06.330347+0000","last_became_peered":"2024-09-17T05:30:06.330347+0000","last_unstale":"2024-09-17T05:30:07.984046+0000","last_undegraded":"2024-09-17T05:30:07.984046+0000","last_fullsized":"2024-09-17T05:30:07.984046+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:48.623576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.303283+0000","last_change":"2024-09-17T05:30:05.318218+0000","last_active":"2024-09-17T05:30:07.303283+0000","last_peered":"2024-09-17T05:30:07.303283+0000","last_clean":"2024-09-17T05:30:07.303283+0000","last_became_active":"2024-09-17T05:30:05.317928+0000","last_became_peered":"2024-09-17T05:30:05.317928+0000","last_unstale":"2024-09-17T05:30:07.303283+0000","last_undegraded":"2024-09-17T05:30:07.303283+0000","last_fullsized":"2024-09-17T05:30:07.303283+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:11.904095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981066+0000","last_change":"2024-09-17T05:30:06.338495+0000","last_active":"2024-09-17T05:30:07.981066+0000","last_peered":"2024-09-17T05:30:07.981066+0000","last_clean":"2024-09-17T05:30:07.981066+0000","last_became_active":"2024-09-17T05:30:06.338093+0000","last_became_peered":"2024-09-17T05:30:06.338093+0000","last_unstale":"2024-09-17T05:30:07.981066+0000","last_undegraded":"2024-09-17T05:30:07.981066+0000","last_fullsized":"2024-09-17T05:30:07.981066+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:48.159252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983902+0000","last_change":"2024-09-17T05:30:05.320765+0000","last_active":"2024-09-17T05:30:07.983902+0000","last_peered":"2024-09-17T05:30:07.983902+0000","last_clean":"2024-09-17T05:30:07.983902+0000","last_became_active":"2024-09-17T05:30:05.320465+0000","last_became_peered":"2024-09-17T05:30:05.320465+0000","last_unstale":"2024-09-17T05:30:07.983902+0000","last_undegraded":"2024-09-17T05:30:07.983902+0000","last_fullsized":"2024-09-17T05:30:07.983902+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:39.171928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981466+0000","last_change":"2024-09-17T05:30:06.334369+0000","last_active":"2024-09-17T05:30:07.981466+0000","last_peered":"2024-09-17T05:30:07.981466+0000","last_clean":"2024-09-17T05:30:07.981466+0000","last_became_active":"2024-09-17T05:30:06.333791+0000","last_became_peered":"2024-09-17T05:30:06.333791+0000","last_unstale":"2024-09-17T05:30:07.981466+0000","last_undegraded":"2024-09-17T05:30:07.981466+0000","last_fullsized":"2024-09-17T05:30:07.981466+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:52.860356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306543+0000","last_change":"2024-09-17T05:30:05.322511+0000","last_active":"2024-09-17T05:30:07.306543+0000","last_peered":"2024-09-17T05:30:07.306543+0000","last_clean":"2024-09-17T05:30:07.306543+0000","last_became_active":"2024-09-17T05:30:05.321575+0000","last_became_peered":"2024-09-17T05:30:05.321575+0000","last_unstale":"2024-09-17T05:30:07.306543+0000","last_undegraded":"2024-09-17T05:30:07.306543+0000","last_fullsized":"2024-09-17T05:30:07.306543+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:20.595118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983039+0000","last_change":"2024-09-17T05:30:06.318509+0000","last_active":"2024-09-17T05:30:07.983039+0000","last_peered":"2024-09-17T05:30:07.983039+0000","last_clean":"2024-09-17T05:30:07.983039+0000","last_became_active":"2024-09-17T05:30:06.318104+0000","last_became_peered":"2024-09-17T05:30:06.318104+0000","last_unstale":"2024-09-17T05:30:07.983039+0000","last_undegraded":"2024-09-17T05:30:07.983039+0000","last_fullsized":"2024-09-17T05:30:07.983039+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:18.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.303176+0000","last_change":"2024-09-17T05:30:05.321359+0000","last_active":"2024-09-17T05:30:07.303176+0000","last_peered":"2024-09-17T05:30:07.303176+0000","last_clean":"2024-09-17T05:30:07.303176+0000","last_became_active":"2024-09-17T05:30:05.321017+0000","last_became_peered":"2024-09-17T05:30:05.321017+0000","last_unstale":"2024-09-17T05:30:07.303176+0000","last_undegraded":"2024-09-17T05:30:07.303176+0000","last_fullsized":"2024-09-17T05:30:07.303176+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:49.729060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306816+0000","last_change":"2024-09-17T05:30:06.324838+0000","last_active":"2024-09-17T05:30:07.306816+0000","last_peered":"2024-09-17T05:30:07.306816+0000","last_clean":"2024-09-17T05:30:07.306816+0000","last_became_active":"2024-09-17T05:30:06.324511+0000","last_became_peered":"2024-09-17T05:30:06.324511+0000","last_unstale":"2024-09-17T05:30:07.306816+0000","last_undegraded":"2024-09-17T05:30:07.306816+0000","last_fullsized":"2024-09-17T05:30:07.306816+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:07.818014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980103+0000","last_change":"2024-09-17T05:30:05.317797+0000","last_active":"2024-09-17T05:30:07.980103+0000","last_peered":"2024-09-17T05:30:07.980103+0000","last_clean":"2024-09-17T05:30:07.980103+0000","last_became_active":"2024-09-17T05:30:05.317453+0000","last_became_peered":"2024-09-17T05:30:05.317453+0000","last_unstale":"2024-09-17T05:30:07.980103+0000","last_undegraded":"2024-09-17T05:30:07.980103+0000","last_fullsized":"2024-09-17T05:30:07.980103+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:56.157479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981257+0000","last_change":"2024-09-17T05:30:06.340137+0000","last_active":"2024-09-17T05:30:07.981257+0000","last_peered":"2024-09-17T05:30:07.981257+0000","last_clean":"2024-09-17T05:30:07.981257+0000","last_became_active":"2024-09-17T05:30:06.335162+0000","last_became_peered":"2024-09-17T05:30:06.335162+0000","last_unstale":"2024-09-17T05:30:07.981257+0000","last_undegraded":"2024-09-17T05:30:07.981257+0000","last_fullsized":"2024-09-17T05:30:07.981257+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:15.759144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983535+0000","last_change":"2024-09-17T05:30:05.319479+0000","last_active":"2024-09-17T05:30:07.983535+0000","last_peered":"2024-09-17T05:30:07.983535+0000","last_clean":"2024-09-17T05:30:07.983535+0000","last_became_active":"2024-09-17T05:30:05.319190+0000","last_became_peered":"2024-09-17T05:30:05.319190+0000","last_unstale":"2024-09-17T05:30:07.983535+0000","last_undegraded":"2024-09-17T05:30:07.983535+0000","last_fullsized":"2024-09-17T05:30:07.983535+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:53.759339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":153,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983297+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:30:07.983297+0000","last_peered":"2024-09-17T05:30:07.983297+0000","last_clean":"2024-09-17T05:30:07.983297+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:30:07.983297+0000","last_undegraded":"2024-09-17T05:30:07.983297+0000","last_fullsized":"2024-09-17T05:30:07.983297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1105920,"data_stored":794344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":516096,"data_stored":204558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":520192,"data_stored":205498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":520192,"data_stored":204524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":524288,"data_stored":205520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":512000,"data_stored":203956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":203956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1093632,"data_stored":787988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:30:11.287 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:30:11.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.468+0000 7fb58c800640 1 -- 172.21.15.31:0/1685231412 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5840b2760 msgr2=0x7fb5840d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:11.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.468+0000 7fb58c800640 1 --2- 172.21.15.31:0/1685231412 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5840b2760 0x7fb5840d0260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb574009840 tx=0x7fb57401c790 comp rx=0 tx=0).stop 2024-09-17T05:30:11.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.468+0000 7fb58c800640 1 -- 172.21.15.31:0/1685231412 shutdown_connections 2024-09-17T05:30:11.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.468+0000 7fb58c800640 1 --2- 172.21.15.31:0/1685231412 >> v2:172.21.15.155:3300/0 conn(0x7fb5840b2d00 0x7fb5841605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.468+0000 7fb58c800640 1 --2- 172.21.15.31:0/1685231412 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5840b2760 0x7fb5840d0260 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.468+0000 7fb58c800640 1 -- 172.21.15.31:0/1685231412 >> 172.21.15.31:0/1685231412 conn(0x7fb5840d1e40 msgr2=0x7fb5840d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:11.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.468+0000 7fb58c800640 1 -- 172.21.15.31:0/1685231412 shutdown_connections 2024-09-17T05:30:11.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.468+0000 7fb58c800640 1 -- 172.21.15.31:0/1685231412 wait complete. 2024-09-17T05:30:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb58c800640 1 Processor -- start 2024-09-17T05:30:11.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb58c800640 1 -- start start 2024-09-17T05:30:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb58c800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5840b2760 0x7fb584158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:11.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb58c800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5840b2d00 0x7fb5841f8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb58c800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5840cfe80 0x7fb5841f9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb58c800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb5840b0900 con 0x7fb5840b2760 2024-09-17T05:30:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb58c800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb5840b0780 con 0x7fb5840cfe80 2024-09-17T05:30:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb58c800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb5840b0a80 con 0x7fb5840b2d00 2024-09-17T05:30:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb589e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5840b2760 0x7fb584158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb589e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5840b2760 0x7fb584158cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45016/0 (socket says 172.21.15.31:45016) 2024-09-17T05:30:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb589e00640 1 -- 172.21.15.31:0/1081942755 learned_addr learned my addr 172.21.15.31:0/1081942755 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb589400640 1 --2- 172.21.15.31:0/1081942755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5840b2d00 0x7fb5841f8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb58a800640 1 --2- 172.21.15.31:0/1081942755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5840cfe80 0x7fb5841f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb589e00640 1 -- 172.21.15.31:0/1081942755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5840b2d00 msgr2=0x7fb5841f8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:11.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb589e00640 1 --2- 172.21.15.31:0/1081942755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5840b2d00 0x7fb5841f8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb589e00640 1 -- 172.21.15.31:0/1081942755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5840cfe80 msgr2=0x7fb5841f9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:11.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb589e00640 1 --2- 172.21.15.31:0/1081942755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5840cfe80 0x7fb5841f9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb589e00640 1 -- 172.21.15.31:0/1081942755 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5840c6c40 con 0x7fb5840b2760 2024-09-17T05:30:11.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb589e00640 1 --2- 172.21.15.31:0/1081942755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5840b2760 0x7fb584158cc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb57800c400 tx=0x7fb57800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:11.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb57e000640 1 -- 172.21.15.31:0/1081942755 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb578011790 con 0x7fb5840b2760 2024-09-17T05:30:11.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.472+0000 7fb57e000640 1 -- 172.21.15.31:0/1081942755 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb578017070 con 0x7fb5840b2760 2024-09-17T05:30:11.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.476+0000 7fb58c800640 1 -- 172.21.15.31:0/1081942755 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb58415acd0 con 0x7fb5840b2760 2024-09-17T05:30:11.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.476+0000 7fb57e000640 1 -- 172.21.15.31:0/1081942755 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb578011cc0 con 0x7fb5840b2760 2024-09-17T05:30:11.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.476+0000 7fb58c800640 1 -- 172.21.15.31:0/1081942755 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5840b5d70 con 0x7fb5840b2760 2024-09-17T05:30:11.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.476+0000 7fb58c800640 1 -- 172.21.15.31:0/1081942755 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5840d0260 con 0x7fb5840b2760 2024-09-17T05:30:11.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.476+0000 7fb57e000640 1 -- 172.21.15.31:0/1081942755 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7fb57801c460 con 0x7fb5840b2760 2024-09-17T05:30:11.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.476+0000 7fb57e000640 1 --2- 172.21.15.31:0/1081942755 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb5680733b0 0x7fb568075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:11.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.476+0000 7fb57e000640 1 -- 172.21.15.31:0/1081942755 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fb578094360 con 0x7fb5840b2760 2024-09-17T05:30:11.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.476+0000 7fb589400640 1 --2- 172.21.15.31:0/1081942755 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb5680733b0 0x7fb568075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:11.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.480+0000 7fb589400640 1 --2- 172.21.15.31:0/1081942755 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb5680733b0 0x7fb568075870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb5740ae000 tx=0x7fb57401afd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:11.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.480+0000 7fb57e000640 1 -- 172.21.15.31:0/1081942755 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb5840c6c40 con 0x7fb5840b2760 2024-09-17T05:30:11.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.716+0000 7fb58c800640 1 -- 172.21.15.31:0/1081942755 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb584071b00 con 0x7fb5840b2760 2024-09-17T05:30:11.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.720+0000 7fb57e000640 1 -- 172.21.15.31:0/1081942755 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1474 (secure 0 0 0) 0x7fb5840d0c80 con 0x7fb5840b2760 2024-09-17T05:30:11.724 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:11.724 INFO:teuthology.orchestra.run.smithi031.stdout:{"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":111,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":44,"num_osds":8,"num_up_osds":8,"osd_up_since":1726550913,"num_in_osds":8,"osd_in_since":1726550903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":231018496,"bytes_avail":772863094784,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":28,"btime":"2024-09-17T05:30:09:329600+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5295}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-17T05:29:47.194407+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T05:30:11.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.720+0000 7fb58c800640 1 -- 172.21.15.31:0/1081942755 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb5680733b0 msgr2=0x7fb568075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:11.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.720+0000 7fb58c800640 1 --2- 172.21.15.31:0/1081942755 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb5680733b0 0x7fb568075870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb5740ae000 tx=0x7fb57401afd0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.720+0000 7fb58c800640 1 -- 172.21.15.31:0/1081942755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5840b2760 msgr2=0x7fb584158cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:11.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.720+0000 7fb58c800640 1 --2- 172.21.15.31:0/1081942755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5840b2760 0x7fb584158cc0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb57800c400 tx=0x7fb57800c800 comp rx=0 tx=0).stop 2024-09-17T05:30:11.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.720+0000 7fb58c800640 1 -- 172.21.15.31:0/1081942755 shutdown_connections 2024-09-17T05:30:11.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.720+0000 7fb58c800640 1 --2- 172.21.15.31:0/1081942755 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb5680733b0 0x7fb568075870 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.720+0000 7fb58c800640 1 --2- 172.21.15.31:0/1081942755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5840cfe80 0x7fb5841f9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.720+0000 7fb58c800640 1 --2- 172.21.15.31:0/1081942755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5840b2d00 0x7fb5841f8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.720+0000 7fb58c800640 1 --2- 172.21.15.31:0/1081942755 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5840b2760 0x7fb584158cc0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.720+0000 7fb58c800640 1 -- 172.21.15.31:0/1081942755 >> 172.21.15.31:0/1081942755 conn(0x7fb5840d1e40 msgr2=0x7fb584072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:11.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.720+0000 7fb58c800640 1 -- 172.21.15.31:0/1081942755 shutdown_connections 2024-09-17T05:30:11.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.720+0000 7fb58c800640 1 -- 172.21.15.31:0/1081942755 wait complete. 2024-09-17T05:30:11.745 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:30:11.745 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:30:11.842 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:30:11.847 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:30:11.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.888+0000 7fdd57200640 1 -- 172.21.15.31:0/4196472704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd3c005220 msgr2=0x7fdd3c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:11.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.888+0000 7fdd57200640 1 --2- 172.21.15.31:0/4196472704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd3c005220 0x7fdd3c00b9d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdd50001e60 tx=0x7fdd5001f350 comp rx=0 tx=0).stop 2024-09-17T05:30:11.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.888+0000 7fdd57200640 1 -- 172.21.15.31:0/4196472704 shutdown_connections 2024-09-17T05:30:11.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.888+0000 7fdd57200640 1 --2- 172.21.15.31:0/4196472704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd3c005220 0x7fdd3c00b9d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.888+0000 7fdd57200640 1 -- 172.21.15.31:0/4196472704 >> 172.21.15.31:0/4196472704 conn(0x7fdd5809aa10 msgr2=0x7fdd5809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:11.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.888+0000 7fdd57200640 1 -- 172.21.15.31:0/4196472704 shutdown_connections 2024-09-17T05:30:11.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.888+0000 7fdd57200640 1 -- 172.21.15.31:0/4196472704 wait complete. 2024-09-17T05:30:11.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.888+0000 7fdd57200640 1 Processor -- start 2024-09-17T05:30:11.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd57200640 1 -- start start 2024-09-17T05:30:11.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd57200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd3c005220 0x7fdd5814ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:11.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd57200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd580cb7f0 0x7fdd580b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:11.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd57200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd580ca1e0 0x7fdd580b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:11.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd57200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdd580cf340 con 0x7fdd3c005220 2024-09-17T05:30:11.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd57200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdd580cf1c0 con 0x7fdd580ca1e0 2024-09-17T05:30:11.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd57200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdd580b29e0 con 0x7fdd580cb7f0 2024-09-17T05:30:11.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd55e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd3c005220 0x7fdd5814ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:11.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd55e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd3c005220 0x7fdd5814ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45042/0 (socket says 172.21.15.31:45042) 2024-09-17T05:30:11.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd55e00640 1 -- 172.21.15.31:0/2838471593 learned_addr learned my addr 172.21.15.31:0/2838471593 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:11.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd56800640 1 --2- 172.21.15.31:0/2838471593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd580ca1e0 0x7fdd580b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:11.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd4d400640 1 --2- 172.21.15.31:0/2838471593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd580cb7f0 0x7fdd580b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:11.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd55e00640 1 -- 172.21.15.31:0/2838471593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd580cb7f0 msgr2=0x7fdd580b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:11.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd55e00640 1 --2- 172.21.15.31:0/2838471593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd580cb7f0 0x7fdd580b00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd55e00640 1 -- 172.21.15.31:0/2838471593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd580ca1e0 msgr2=0x7fdd580b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:11.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd55e00640 1 --2- 172.21.15.31:0/2838471593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd580ca1e0 0x7fdd580b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:11.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd55e00640 1 -- 172.21.15.31:0/2838471593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd580ca750 con 0x7fdd3c005220 2024-09-17T05:30:11.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd4d400640 1 --2- 172.21.15.31:0/2838471593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd580cb7f0 0x7fdd580b00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:30:11.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd56800640 1 --2- 172.21.15.31:0/2838471593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd580ca1e0 0x7fdd580b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:30:11.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd55e00640 1 --2- 172.21.15.31:0/2838471593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd3c005220 0x7fdd5814ffb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdd480064b0 tx=0x7fdd480039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:11.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd4ea00640 1 -- 172.21.15.31:0/2838471593 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48015070 con 0x7fdd3c005220 2024-09-17T05:30:11.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd4ea00640 1 -- 172.21.15.31:0/2838471593 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd48011860 con 0x7fdd3c005220 2024-09-17T05:30:11.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd57200640 1 -- 172.21.15.31:0/2838471593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd580caa30 con 0x7fdd3c005220 2024-09-17T05:30:11.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd4ea00640 1 -- 172.21.15.31:0/2838471593 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48011cb0 con 0x7fdd3c005220 2024-09-17T05:30:11.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd57200640 1 -- 172.21.15.31:0/2838471593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd580caff0 con 0x7fdd3c005220 2024-09-17T05:30:11.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.892+0000 7fdd57200640 1 -- 172.21.15.31:0/2838471593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd580afba0 con 0x7fdd3c005220 2024-09-17T05:30:11.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.896+0000 7fdd4ea00640 1 -- 172.21.15.31:0/2838471593 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7fdd48018070 con 0x7fdd3c005220 2024-09-17T05:30:11.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.896+0000 7fdd4ea00640 1 --2- 172.21.15.31:0/2838471593 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdd340733e0 0x7fdd340758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:11.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.896+0000 7fdd4ea00640 1 -- 172.21.15.31:0/2838471593 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fdd48095370 con 0x7fdd3c005220 2024-09-17T05:30:11.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.896+0000 7fdd4d400640 1 --2- 172.21.15.31:0/2838471593 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdd340733e0 0x7fdd340758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:11.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.896+0000 7fdd4d400640 1 --2- 172.21.15.31:0/2838471593 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdd340733e0 0x7fdd340758a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdd580c4a40 tx=0x7fdd400091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:11.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:11.900+0000 7fdd4ea00640 1 -- 172.21.15.31:0/2838471593 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fdd4805fff0 con 0x7fdd3c005220 2024-09-17T05:30:12.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:12.072+0000 7fdd57200640 1 -- 172.21.15.31:0/2838471593 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdd580af5e0 con 0x7fdd340733e0 2024-09-17T05:30:12.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:12.076+0000 7fdd4ea00640 1 -- 172.21.15.31:0/2838471593 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7fdd580af5e0 con 0x7fdd340733e0 2024-09-17T05:30:12.085 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:12.086 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:30:12.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:12.080+0000 7fdd57200640 1 -- 172.21.15.31:0/2838471593 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdd340733e0 msgr2=0x7fdd340758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:12.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:12.080+0000 7fdd57200640 1 --2- 172.21.15.31:0/2838471593 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdd340733e0 0x7fdd340758a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdd580c4a40 tx=0x7fdd400091e0 comp rx=0 tx=0).stop 2024-09-17T05:30:12.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:12.080+0000 7fdd57200640 1 -- 172.21.15.31:0/2838471593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd3c005220 msgr2=0x7fdd5814ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:12.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:12.080+0000 7fdd57200640 1 --2- 172.21.15.31:0/2838471593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd3c005220 0x7fdd5814ffb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdd480064b0 tx=0x7fdd480039d0 comp rx=0 tx=0).stop 2024-09-17T05:30:12.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:12.080+0000 7fdd57200640 1 -- 172.21.15.31:0/2838471593 shutdown_connections 2024-09-17T05:30:12.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:12.080+0000 7fdd57200640 1 --2- 172.21.15.31:0/2838471593 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdd340733e0 0x7fdd340758a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:12.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:12.080+0000 7fdd57200640 1 --2- 172.21.15.31:0/2838471593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd580ca1e0 0x7fdd580b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:12.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:12.080+0000 7fdd57200640 1 --2- 172.21.15.31:0/2838471593 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd580cb7f0 0x7fdd580b00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:12.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:12.080+0000 7fdd57200640 1 --2- 172.21.15.31:0/2838471593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd3c005220 0x7fdd5814ffb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:12.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:12.080+0000 7fdd57200640 1 -- 172.21.15.31:0/2838471593 >> 172.21.15.31:0/2838471593 conn(0x7fdd5809aa10 msgr2=0x7fdd580ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:12.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:12.080+0000 7fdd57200640 1 -- 172.21.15.31:0/2838471593 shutdown_connections 2024-09-17T05:30:12.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:12.080+0000 7fdd57200640 1 -- 172.21.15.31:0/2838471593 wait complete. 2024-09-17T05:30:12.105 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-09-17T05:30:11.199768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225604,"kb_used_data":5180,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749116,"statfs":{"total":773094113280,"available":772863094784,"internally_reserved":0,"allocated":5304320,"data_stored":2810344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001581"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983941+0000","last_change":"2024-09-17T05:30:06.324569+0000","last_active":"2024-09-17T05:30:07.983941+0000","last_peered":"2024-09-17T05:30:07.983941+0000","last_clean":"2024-09-17T05:30:07.983941+0000","last_became_active":"2024-09-17T05:30:06.324329+0000","last_became_peered":"2024-09-17T05:30:06.324329+0000","last_unstale":"2024-09-17T05:30:07.983941+0000","last_undegraded":"2024-09-17T05:30:07.983941+0000","last_fullsized":"2024-09-17T05:30:07.983941+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:45.362534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983219+0000","last_change":"2024-09-17T05:30:06.321869+0000","last_active":"2024-09-17T05:30:07.983219+0000","last_peered":"2024-09-17T05:30:07.983219+0000","last_clean":"2024-09-17T05:30:07.983219+0000","last_became_active":"2024-09-17T05:30:06.321455+0000","last_became_peered":"2024-09-17T05:30:06.321455+0000","last_unstale":"2024-09-17T05:30:07.983219+0000","last_undegraded":"2024-09-17T05:30:07.983219+0000","last_fullsized":"2024-09-17T05:30:07.983219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:44.473010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306744+0000","last_change":"2024-09-17T05:30:06.316783+0000","last_active":"2024-09-17T05:30:07.306744+0000","last_peered":"2024-09-17T05:30:07.306744+0000","last_clean":"2024-09-17T05:30:07.306744+0000","last_became_active":"2024-09-17T05:30:06.316512+0000","last_became_peered":"2024-09-17T05:30:06.316512+0000","last_unstale":"2024-09-17T05:30:07.306744+0000","last_undegraded":"2024-09-17T05:30:07.306744+0000","last_fullsized":"2024-09-17T05:30:07.306744+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:29.139353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980453+0000","last_change":"2024-09-17T05:30:06.338103+0000","last_active":"2024-09-17T05:30:07.980453+0000","last_peered":"2024-09-17T05:30:07.980453+0000","last_clean":"2024-09-17T05:30:07.980453+0000","last_became_active":"2024-09-17T05:30:06.337712+0000","last_became_peered":"2024-09-17T05:30:06.337712+0000","last_unstale":"2024-09-17T05:30:07.980453+0000","last_undegraded":"2024-09-17T05:30:07.980453+0000","last_fullsized":"2024-09-17T05:30:07.980453+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:01.151033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983371+0000","last_change":"2024-09-17T05:30:06.317638+0000","last_active":"2024-09-17T05:30:07.983371+0000","last_peered":"2024-09-17T05:30:07.983371+0000","last_clean":"2024-09-17T05:30:07.983371+0000","last_became_active":"2024-09-17T05:30:06.315836+0000","last_became_peered":"2024-09-17T05:30:06.315836+0000","last_unstale":"2024-09-17T05:30:07.983371+0000","last_undegraded":"2024-09-17T05:30:07.983371+0000","last_fullsized":"2024-09-17T05:30:07.983371+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:15.759144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980825+0000","last_change":"2024-09-17T05:30:06.326405+0000","last_active":"2024-09-17T05:30:07.980825+0000","last_peered":"2024-09-17T05:30:07.980825+0000","last_clean":"2024-09-17T05:30:07.980825+0000","last_became_active":"2024-09-17T05:30:06.326093+0000","last_became_peered":"2024-09-17T05:30:06.326093+0000","last_unstale":"2024-09-17T05:30:07.980825+0000","last_undegraded":"2024-09-17T05:30:07.980825+0000","last_fullsized":"2024-09-17T05:30:07.980825+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:19.864402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983696+0000","last_change":"2024-09-17T05:30:06.340085+0000","last_active":"2024-09-17T05:30:07.983696+0000","last_peered":"2024-09-17T05:30:07.983696+0000","last_clean":"2024-09-17T05:30:07.983696+0000","last_became_active":"2024-09-17T05:30:06.339801+0000","last_became_peered":"2024-09-17T05:30:06.339801+0000","last_unstale":"2024-09-17T05:30:07.983696+0000","last_undegraded":"2024-09-17T05:30:07.983696+0000","last_fullsized":"2024-09-17T05:30:07.983696+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:12.149437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979737+0000","last_change":"2024-09-17T05:30:06.335575+0000","last_active":"2024-09-17T05:30:07.979737+0000","last_peered":"2024-09-17T05:30:07.979737+0000","last_clean":"2024-09-17T05:30:07.979737+0000","last_became_active":"2024-09-17T05:30:06.335241+0000","last_became_peered":"2024-09-17T05:30:06.335241+0000","last_unstale":"2024-09-17T05:30:07.979737+0000","last_undegraded":"2024-09-17T05:30:07.979737+0000","last_fullsized":"2024-09-17T05:30:07.979737+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:21.682116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981155+0000","last_change":"2024-09-17T05:30:06.342344+0000","last_active":"2024-09-17T05:30:07.981155+0000","last_peered":"2024-09-17T05:30:07.981155+0000","last_clean":"2024-09-17T05:30:07.981155+0000","last_became_active":"2024-09-17T05:30:06.341691+0000","last_became_peered":"2024-09-17T05:30:06.341691+0000","last_unstale":"2024-09-17T05:30:07.981155+0000","last_undegraded":"2024-09-17T05:30:07.981155+0000","last_fullsized":"2024-09-17T05:30:07.981155+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:44.473010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981052+0000","last_change":"2024-09-17T05:30:06.335792+0000","last_active":"2024-09-17T05:30:07.981052+0000","last_peered":"2024-09-17T05:30:07.981052+0000","last_clean":"2024-09-17T05:30:07.981052+0000","last_became_active":"2024-09-17T05:30:06.335480+0000","last_became_peered":"2024-09-17T05:30:06.335480+0000","last_unstale":"2024-09-17T05:30:07.981052+0000","last_undegraded":"2024-09-17T05:30:07.981052+0000","last_fullsized":"2024-09-17T05:30:07.981052+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:23.591461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980367+0000","last_change":"2024-09-17T05:30:06.341158+0000","last_active":"2024-09-17T05:30:07.980367+0000","last_peered":"2024-09-17T05:30:07.980367+0000","last_clean":"2024-09-17T05:30:07.980367+0000","last_became_active":"2024-09-17T05:30:06.340860+0000","last_became_peered":"2024-09-17T05:30:06.340860+0000","last_unstale":"2024-09-17T05:30:07.980367+0000","last_undegraded":"2024-09-17T05:30:07.980367+0000","last_fullsized":"2024-09-17T05:30:07.980367+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:19.820487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983177+0000","last_change":"2024-09-17T05:30:06.307784+0000","last_active":"2024-09-17T05:30:07.983177+0000","last_peered":"2024-09-17T05:30:07.983177+0000","last_clean":"2024-09-17T05:30:07.983177+0000","last_became_active":"2024-09-17T05:30:06.307523+0000","last_became_peered":"2024-09-17T05:30:06.307523+0000","last_unstale":"2024-09-17T05:30:07.983177+0000","last_undegraded":"2024-09-17T05:30:07.983177+0000","last_fullsized":"2024-09-17T05:30:07.983177+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:46.123430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300058+0000","last_change":"2024-09-17T05:30:06.331592+0000","last_active":"2024-09-17T05:30:07.300058+0000","last_peered":"2024-09-17T05:30:07.300058+0000","last_clean":"2024-09-17T05:30:07.300058+0000","last_became_active":"2024-09-17T05:30:06.329676+0000","last_became_peered":"2024-09-17T05:30:06.329676+0000","last_unstale":"2024-09-17T05:30:07.300058+0000","last_undegraded":"2024-09-17T05:30:07.300058+0000","last_fullsized":"2024-09-17T05:30:07.300058+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:33.485038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980003+0000","last_change":"2024-09-17T05:30:06.341111+0000","last_active":"2024-09-17T05:30:07.980003+0000","last_peered":"2024-09-17T05:30:07.980003+0000","last_clean":"2024-09-17T05:30:07.980003+0000","last_became_active":"2024-09-17T05:30:06.340826+0000","last_became_peered":"2024-09-17T05:30:06.340826+0000","last_unstale":"2024-09-17T05:30:07.980003+0000","last_undegraded":"2024-09-17T05:30:07.980003+0000","last_fullsized":"2024-09-17T05:30:07.980003+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:39.847537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980475+0000","last_change":"2024-09-17T05:30:06.321441+0000","last_active":"2024-09-17T05:30:07.980475+0000","last_peered":"2024-09-17T05:30:07.980475+0000","last_clean":"2024-09-17T05:30:07.980475+0000","last_became_active":"2024-09-17T05:30:06.320838+0000","last_became_peered":"2024-09-17T05:30:06.320838+0000","last_unstale":"2024-09-17T05:30:07.980475+0000","last_undegraded":"2024-09-17T05:30:07.980475+0000","last_fullsized":"2024-09-17T05:30:07.980475+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:27.273165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975246+0000","last_change":"2024-09-17T05:30:06.330815+0000","last_active":"2024-09-17T05:30:07.975246+0000","last_peered":"2024-09-17T05:30:07.975246+0000","last_clean":"2024-09-17T05:30:07.975246+0000","last_became_active":"2024-09-17T05:30:06.330540+0000","last_became_peered":"2024-09-17T05:30:06.330540+0000","last_unstale":"2024-09-17T05:30:07.975246+0000","last_undegraded":"2024-09-17T05:30:07.975246+0000","last_fullsized":"2024-09-17T05:30:07.975246+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:50.740276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.307055+0000","last_change":"2024-09-17T05:30:06.313882+0000","last_active":"2024-09-17T05:30:07.307055+0000","last_peered":"2024-09-17T05:30:07.307055+0000","last_clean":"2024-09-17T05:30:07.307055+0000","last_became_active":"2024-09-17T05:30:06.312977+0000","last_became_peered":"2024-09-17T05:30:06.312977+0000","last_unstale":"2024-09-17T05:30:07.307055+0000","last_undegraded":"2024-09-17T05:30:07.307055+0000","last_fullsized":"2024-09-17T05:30:07.307055+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:08:35.053465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306709+0000","last_change":"2024-09-17T05:30:06.330143+0000","last_active":"2024-09-17T05:30:07.306709+0000","last_peered":"2024-09-17T05:30:07.306709+0000","last_clean":"2024-09-17T05:30:07.306709+0000","last_became_active":"2024-09-17T05:30:06.329890+0000","last_became_peered":"2024-09-17T05:30:06.329890+0000","last_unstale":"2024-09-17T05:30:07.306709+0000","last_undegraded":"2024-09-17T05:30:07.306709+0000","last_fullsized":"2024-09-17T05:30:07.306709+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:51.494900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975823+0000","last_change":"2024-09-17T05:30:06.330201+0000","last_active":"2024-09-17T05:30:07.975823+0000","last_peered":"2024-09-17T05:30:07.975823+0000","last_clean":"2024-09-17T05:30:07.975823+0000","last_became_active":"2024-09-17T05:30:06.329892+0000","last_became_peered":"2024-09-17T05:30:06.329892+0000","last_unstale":"2024-09-17T05:30:07.975823+0000","last_undegraded":"2024-09-17T05:30:07.975823+0000","last_fullsized":"2024-09-17T05:30:07.975823+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:52.043780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300424+0000","last_change":"2024-09-17T05:30:06.326530+0000","last_active":"2024-09-17T05:30:07.300424+0000","last_peered":"2024-09-17T05:30:07.300424+0000","last_clean":"2024-09-17T05:30:07.300424+0000","last_became_active":"2024-09-17T05:30:06.326217+0000","last_became_peered":"2024-09-17T05:30:06.326217+0000","last_unstale":"2024-09-17T05:30:07.300424+0000","last_undegraded":"2024-09-17T05:30:07.300424+0000","last_fullsized":"2024-09-17T05:30:07.300424+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:20.876601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980934+0000","last_change":"2024-09-17T05:30:06.326921+0000","last_active":"2024-09-17T05:30:07.980934+0000","last_peered":"2024-09-17T05:30:07.980934+0000","last_clean":"2024-09-17T05:30:07.980934+0000","last_became_active":"2024-09-17T05:30:06.326659+0000","last_became_peered":"2024-09-17T05:30:06.326659+0000","last_unstale":"2024-09-17T05:30:07.980934+0000","last_undegraded":"2024-09-17T05:30:07.980934+0000","last_fullsized":"2024-09-17T05:30:07.980934+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:31.349115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980167+0000","last_change":"2024-09-17T05:30:06.336071+0000","last_active":"2024-09-17T05:30:07.980167+0000","last_peered":"2024-09-17T05:30:07.980167+0000","last_clean":"2024-09-17T05:30:07.980167+0000","last_became_active":"2024-09-17T05:30:06.335275+0000","last_became_peered":"2024-09-17T05:30:06.335275+0000","last_unstale":"2024-09-17T05:30:07.980167+0000","last_undegraded":"2024-09-17T05:30:07.980167+0000","last_fullsized":"2024-09-17T05:30:07.980167+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:58.105556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975191+0000","last_change":"2024-09-17T05:30:06.324782+0000","last_active":"2024-09-17T05:30:07.975191+0000","last_peered":"2024-09-17T05:30:07.975191+0000","last_clean":"2024-09-17T05:30:07.975191+0000","last_became_active":"2024-09-17T05:30:06.324484+0000","last_became_peered":"2024-09-17T05:30:06.324484+0000","last_unstale":"2024-09-17T05:30:07.975191+0000","last_undegraded":"2024-09-17T05:30:07.975191+0000","last_fullsized":"2024-09-17T05:30:07.975191+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:59.232774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975602+0000","last_change":"2024-09-17T05:30:06.320703+0000","last_active":"2024-09-17T05:30:07.975602+0000","last_peered":"2024-09-17T05:30:07.975602+0000","last_clean":"2024-09-17T05:30:07.975602+0000","last_became_active":"2024-09-17T05:30:06.320432+0000","last_became_peered":"2024-09-17T05:30:06.320432+0000","last_unstale":"2024-09-17T05:30:07.975602+0000","last_undegraded":"2024-09-17T05:30:07.975602+0000","last_fullsized":"2024-09-17T05:30:07.975602+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:47:10.927229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975655+0000","last_change":"2024-09-17T05:30:06.340184+0000","last_active":"2024-09-17T05:30:07.975655+0000","last_peered":"2024-09-17T05:30:07.975655+0000","last_clean":"2024-09-17T05:30:07.975655+0000","last_became_active":"2024-09-17T05:30:06.339844+0000","last_became_peered":"2024-09-17T05:30:06.339844+0000","last_unstale":"2024-09-17T05:30:07.975655+0000","last_undegraded":"2024-09-17T05:30:07.975655+0000","last_fullsized":"2024-09-17T05:30:07.975655+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:21.303474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300275+0000","last_change":"2024-09-17T05:30:06.325741+0000","last_active":"2024-09-17T05:30:07.300275+0000","last_peered":"2024-09-17T05:30:07.300275+0000","last_clean":"2024-09-17T05:30:07.300275+0000","last_became_active":"2024-09-17T05:30:06.323875+0000","last_became_peered":"2024-09-17T05:30:06.323875+0000","last_unstale":"2024-09-17T05:30:07.300275+0000","last_undegraded":"2024-09-17T05:30:07.300275+0000","last_fullsized":"2024-09-17T05:30:07.300275+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:28.377585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306617+0000","last_change":"2024-09-17T05:30:06.309486+0000","last_active":"2024-09-17T05:30:07.306617+0000","last_peered":"2024-09-17T05:30:07.306617+0000","last_clean":"2024-09-17T05:30:07.306617+0000","last_became_active":"2024-09-17T05:30:06.309117+0000","last_became_peered":"2024-09-17T05:30:06.309117+0000","last_unstale":"2024-09-17T05:30:07.306617+0000","last_undegraded":"2024-09-17T05:30:07.306617+0000","last_fullsized":"2024-09-17T05:30:07.306617+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:40.183144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983191+0000","last_change":"2024-09-17T05:30:06.307863+0000","last_active":"2024-09-17T05:30:07.983191+0000","last_peered":"2024-09-17T05:30:07.983191+0000","last_clean":"2024-09-17T05:30:07.983191+0000","last_became_active":"2024-09-17T05:30:06.307597+0000","last_became_peered":"2024-09-17T05:30:06.307597+0000","last_unstale":"2024-09-17T05:30:07.983191+0000","last_undegraded":"2024-09-17T05:30:07.983191+0000","last_fullsized":"2024-09-17T05:30:07.983191+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:23.591461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975439+0000","last_change":"2024-09-17T05:30:06.326327+0000","last_active":"2024-09-17T05:30:07.975439+0000","last_peered":"2024-09-17T05:30:07.975439+0000","last_clean":"2024-09-17T05:30:07.975439+0000","last_became_active":"2024-09-17T05:30:06.326080+0000","last_became_peered":"2024-09-17T05:30:06.326080+0000","last_unstale":"2024-09-17T05:30:07.975439+0000","last_undegraded":"2024-09-17T05:30:07.975439+0000","last_fullsized":"2024-09-17T05:30:07.975439+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:12.915311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306433+0000","last_change":"2024-09-17T05:30:06.313960+0000","last_active":"2024-09-17T05:30:07.306433+0000","last_peered":"2024-09-17T05:30:07.306433+0000","last_clean":"2024-09-17T05:30:07.306433+0000","last_became_active":"2024-09-17T05:30:06.313697+0000","last_became_peered":"2024-09-17T05:30:06.313697+0000","last_unstale":"2024-09-17T05:30:07.306433+0000","last_undegraded":"2024-09-17T05:30:07.306433+0000","last_fullsized":"2024-09-17T05:30:07.306433+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:36.122412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980787+0000","last_change":"2024-09-17T05:30:06.321560+0000","last_active":"2024-09-17T05:30:07.980787+0000","last_peered":"2024-09-17T05:30:07.980787+0000","last_clean":"2024-09-17T05:30:07.980787+0000","last_became_active":"2024-09-17T05:30:06.321157+0000","last_became_peered":"2024-09-17T05:30:06.321157+0000","last_unstale":"2024-09-17T05:30:07.980787+0000","last_undegraded":"2024-09-17T05:30:07.980787+0000","last_fullsized":"2024-09-17T05:30:07.980787+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:26.633690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.299919+0000","last_change":"2024-09-17T05:30:06.314723+0000","last_active":"2024-09-17T05:30:07.299919+0000","last_peered":"2024-09-17T05:30:07.299919+0000","last_clean":"2024-09-17T05:30:07.299919+0000","last_became_active":"2024-09-17T05:30:06.314281+0000","last_became_peered":"2024-09-17T05:30:06.314281+0000","last_unstale":"2024-09-17T05:30:07.299919+0000","last_undegraded":"2024-09-17T05:30:07.299919+0000","last_fullsized":"2024-09-17T05:30:07.299919+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:39.708265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.303579+0000","last_change":"2024-09-17T05:30:06.341890+0000","last_active":"2024-09-17T05:30:07.303579+0000","last_peered":"2024-09-17T05:30:07.303579+0000","last_clean":"2024-09-17T05:30:07.303579+0000","last_became_active":"2024-09-17T05:30:06.340710+0000","last_became_peered":"2024-09-17T05:30:06.340710+0000","last_unstale":"2024-09-17T05:30:07.303579+0000","last_undegraded":"2024-09-17T05:30:07.303579+0000","last_fullsized":"2024-09-17T05:30:07.303579+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:10.264251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981297+0000","last_change":"2024-09-17T05:30:05.317839+0000","last_active":"2024-09-17T05:30:07.981297+0000","last_peered":"2024-09-17T05:30:07.981297+0000","last_clean":"2024-09-17T05:30:07.981297+0000","last_became_active":"2024-09-17T05:30:05.317232+0000","last_became_peered":"2024-09-17T05:30:05.317232+0000","last_unstale":"2024-09-17T05:30:07.981297+0000","last_undegraded":"2024-09-17T05:30:07.981297+0000","last_fullsized":"2024-09-17T05:30:07.981297+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:08.447005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975543+0000","last_change":"2024-09-17T05:30:06.317027+0000","last_active":"2024-09-17T05:30:07.975543+0000","last_peered":"2024-09-17T05:30:07.975543+0000","last_clean":"2024-09-17T05:30:07.975543+0000","last_became_active":"2024-09-17T05:30:06.316750+0000","last_became_peered":"2024-09-17T05:30:06.316750+0000","last_unstale":"2024-09-17T05:30:07.975543+0000","last_undegraded":"2024-09-17T05:30:07.975543+0000","last_fullsized":"2024-09-17T05:30:07.975543+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:42.185698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306908+0000","last_change":"2024-09-17T05:30:05.322455+0000","last_active":"2024-09-17T05:30:07.306908+0000","last_peered":"2024-09-17T05:30:07.306908+0000","last_clean":"2024-09-17T05:30:07.306908+0000","last_became_active":"2024-09-17T05:30:05.321568+0000","last_became_peered":"2024-09-17T05:30:05.321568+0000","last_unstale":"2024-09-17T05:30:07.306908+0000","last_undegraded":"2024-09-17T05:30:07.306908+0000","last_fullsized":"2024-09-17T05:30:07.306908+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:26.627551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983603+0000","last_change":"2024-09-17T05:30:06.328218+0000","last_active":"2024-09-17T05:30:07.983603+0000","last_peered":"2024-09-17T05:30:07.983603+0000","last_clean":"2024-09-17T05:30:07.983603+0000","last_became_active":"2024-09-17T05:30:06.327401+0000","last_became_peered":"2024-09-17T05:30:06.327401+0000","last_unstale":"2024-09-17T05:30:07.983603+0000","last_undegraded":"2024-09-17T05:30:07.983603+0000","last_fullsized":"2024-09-17T05:30:07.983603+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:02.179760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.303592+0000","last_change":"2024-09-17T05:30:05.311818+0000","last_active":"2024-09-17T05:30:07.303592+0000","last_peered":"2024-09-17T05:30:07.303592+0000","last_clean":"2024-09-17T05:30:07.303592+0000","last_became_active":"2024-09-17T05:30:05.311531+0000","last_became_peered":"2024-09-17T05:30:05.311531+0000","last_unstale":"2024-09-17T05:30:07.303592+0000","last_undegraded":"2024-09-17T05:30:07.303592+0000","last_fullsized":"2024-09-17T05:30:07.303592+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:20.595118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.303692+0000","last_change":"2024-09-17T05:30:06.325494+0000","last_active":"2024-09-17T05:30:07.303692+0000","last_peered":"2024-09-17T05:30:07.303692+0000","last_clean":"2024-09-17T05:30:07.303692+0000","last_became_active":"2024-09-17T05:30:06.325221+0000","last_became_peered":"2024-09-17T05:30:06.325221+0000","last_unstale":"2024-09-17T05:30:07.303692+0000","last_undegraded":"2024-09-17T05:30:07.303692+0000","last_fullsized":"2024-09-17T05:30:07.303692+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:26.520589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983801+0000","last_change":"2024-09-17T05:30:05.322973+0000","last_active":"2024-09-17T05:30:07.983801+0000","last_peered":"2024-09-17T05:30:07.983801+0000","last_clean":"2024-09-17T05:30:07.983801+0000","last_became_active":"2024-09-17T05:30:05.322630+0000","last_became_peered":"2024-09-17T05:30:05.322630+0000","last_unstale":"2024-09-17T05:30:07.983801+0000","last_undegraded":"2024-09-17T05:30:07.983801+0000","last_fullsized":"2024-09-17T05:30:07.983801+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:33.104861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306449+0000","last_change":"2024-09-17T05:30:06.320760+0000","last_active":"2024-09-17T05:30:07.306449+0000","last_peered":"2024-09-17T05:30:07.306449+0000","last_clean":"2024-09-17T05:30:07.306449+0000","last_became_active":"2024-09-17T05:30:06.320555+0000","last_became_peered":"2024-09-17T05:30:06.320555+0000","last_unstale":"2024-09-17T05:30:07.306449+0000","last_undegraded":"2024-09-17T05:30:07.306449+0000","last_fullsized":"2024-09-17T05:30:07.306449+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:32.703154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981003+0000","last_change":"2024-09-17T05:30:05.304552+0000","last_active":"2024-09-17T05:30:07.981003+0000","last_peered":"2024-09-17T05:30:07.981003+0000","last_clean":"2024-09-17T05:30:07.981003+0000","last_became_active":"2024-09-17T05:30:05.304231+0000","last_became_peered":"2024-09-17T05:30:05.304231+0000","last_unstale":"2024-09-17T05:30:07.981003+0000","last_undegraded":"2024-09-17T05:30:07.981003+0000","last_fullsized":"2024-09-17T05:30:07.981003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:08:34.042249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980259+0000","last_change":"2024-09-17T05:30:06.325560+0000","last_active":"2024-09-17T05:30:07.980259+0000","last_peered":"2024-09-17T05:30:07.980259+0000","last_clean":"2024-09-17T05:30:07.980259+0000","last_became_active":"2024-09-17T05:30:06.325277+0000","last_became_peered":"2024-09-17T05:30:06.325277+0000","last_unstale":"2024-09-17T05:30:07.980259+0000","last_undegraded":"2024-09-17T05:30:07.980259+0000","last_fullsized":"2024-09-17T05:30:07.980259+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:55.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306504+0000","last_change":"2024-09-17T05:30:05.317320+0000","last_active":"2024-09-17T05:30:07.306504+0000","last_peered":"2024-09-17T05:30:07.306504+0000","last_clean":"2024-09-17T05:30:07.306504+0000","last_became_active":"2024-09-17T05:30:05.316339+0000","last_became_peered":"2024-09-17T05:30:05.316339+0000","last_unstale":"2024-09-17T05:30:07.306504+0000","last_undegraded":"2024-09-17T05:30:07.306504+0000","last_fullsized":"2024-09-17T05:30:07.306504+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:11.751995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979944+0000","last_change":"2024-09-17T05:30:06.316204+0000","last_active":"2024-09-17T05:30:07.979944+0000","last_peered":"2024-09-17T05:30:07.979944+0000","last_clean":"2024-09-17T05:30:07.979944+0000","last_became_active":"2024-09-17T05:30:06.315889+0000","last_became_peered":"2024-09-17T05:30:06.315889+0000","last_unstale":"2024-09-17T05:30:07.979944+0000","last_undegraded":"2024-09-17T05:30:07.979944+0000","last_fullsized":"2024-09-17T05:30:07.979944+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:11:29.366814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983052+0000","last_change":"2024-09-17T05:30:05.310665+0000","last_active":"2024-09-17T05:30:07.983052+0000","last_peered":"2024-09-17T05:30:07.983052+0000","last_clean":"2024-09-17T05:30:07.983052+0000","last_became_active":"2024-09-17T05:30:05.310386+0000","last_became_peered":"2024-09-17T05:30:05.310386+0000","last_unstale":"2024-09-17T05:30:07.983052+0000","last_undegraded":"2024-09-17T05:30:07.983052+0000","last_fullsized":"2024-09-17T05:30:07.983052+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:05.244402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975208+0000","last_change":"2024-09-17T05:30:06.324092+0000","last_active":"2024-09-17T05:30:07.975208+0000","last_peered":"2024-09-17T05:30:07.975208+0000","last_clean":"2024-09-17T05:30:07.975208+0000","last_became_active":"2024-09-17T05:30:06.323729+0000","last_became_peered":"2024-09-17T05:30:06.323729+0000","last_unstale":"2024-09-17T05:30:07.975208+0000","last_undegraded":"2024-09-17T05:30:07.975208+0000","last_fullsized":"2024-09-17T05:30:07.975208+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:00.306496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979862+0000","last_change":"2024-09-17T05:30:05.320099+0000","last_active":"2024-09-17T05:30:07.979862+0000","last_peered":"2024-09-17T05:30:07.979862+0000","last_clean":"2024-09-17T05:30:07.979862+0000","last_became_active":"2024-09-17T05:30:05.319784+0000","last_became_peered":"2024-09-17T05:30:05.319784+0000","last_unstale":"2024-09-17T05:30:07.979862+0000","last_undegraded":"2024-09-17T05:30:07.979862+0000","last_fullsized":"2024-09-17T05:30:07.979862+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:45.978034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306898+0000","last_change":"2024-09-17T05:30:06.325993+0000","last_active":"2024-09-17T05:30:07.306898+0000","last_peered":"2024-09-17T05:30:07.306898+0000","last_clean":"2024-09-17T05:30:07.306898+0000","last_became_active":"2024-09-17T05:30:06.325740+0000","last_became_peered":"2024-09-17T05:30:06.325740+0000","last_unstale":"2024-09-17T05:30:07.306898+0000","last_undegraded":"2024-09-17T05:30:07.306898+0000","last_fullsized":"2024-09-17T05:30:07.306898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:09.458221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306985+0000","last_change":"2024-09-17T05:30:05.317752+0000","last_active":"2024-09-17T05:30:07.306985+0000","last_peered":"2024-09-17T05:30:07.306985+0000","last_clean":"2024-09-17T05:30:07.306985+0000","last_became_active":"2024-09-17T05:30:05.317390+0000","last_became_peered":"2024-09-17T05:30:05.317390+0000","last_unstale":"2024-09-17T05:30:07.306985+0000","last_undegraded":"2024-09-17T05:30:07.306985+0000","last_fullsized":"2024-09-17T05:30:07.306985+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:41.174482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.984020+0000","last_change":"2024-09-17T05:30:06.318563+0000","last_active":"2024-09-17T05:30:07.984020+0000","last_peered":"2024-09-17T05:30:07.984020+0000","last_clean":"2024-09-17T05:30:07.984020+0000","last_became_active":"2024-09-17T05:30:06.318311+0000","last_became_peered":"2024-09-17T05:30:06.318311+0000","last_unstale":"2024-09-17T05:30:07.984020+0000","last_undegraded":"2024-09-17T05:30:07.984020+0000","last_fullsized":"2024-09-17T05:30:07.984020+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:46.303739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981364+0000","last_change":"2024-09-17T05:30:05.319325+0000","last_active":"2024-09-17T05:30:07.981364+0000","last_peered":"2024-09-17T05:30:07.981364+0000","last_clean":"2024-09-17T05:30:07.981364+0000","last_became_active":"2024-09-17T05:30:05.319073+0000","last_became_peered":"2024-09-17T05:30:05.319073+0000","last_unstale":"2024-09-17T05:30:07.981364+0000","last_undegraded":"2024-09-17T05:30:07.981364+0000","last_fullsized":"2024-09-17T05:30:07.981364+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:42.469849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981729+0000","last_change":"2024-09-17T05:30:06.328855+0000","last_active":"2024-09-17T05:30:07.981729+0000","last_peered":"2024-09-17T05:30:07.981729+0000","last_clean":"2024-09-17T05:30:07.981729+0000","last_became_active":"2024-09-17T05:30:06.327889+0000","last_became_peered":"2024-09-17T05:30:06.327889+0000","last_unstale":"2024-09-17T05:30:07.981729+0000","last_undegraded":"2024-09-17T05:30:07.981729+0000","last_fullsized":"2024-09-17T05:30:07.981729+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:21:32.790498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.984049+0000","last_change":"2024-09-17T05:30:05.325847+0000","last_active":"2024-09-17T05:30:07.984049+0000","last_peered":"2024-09-17T05:30:07.984049+0000","last_clean":"2024-09-17T05:30:07.984049+0000","last_became_active":"2024-09-17T05:30:05.325555+0000","last_became_peered":"2024-09-17T05:30:05.325555+0000","last_unstale":"2024-09-17T05:30:07.984049+0000","last_undegraded":"2024-09-17T05:30:07.984049+0000","last_fullsized":"2024-09-17T05:30:07.984049+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:50.483684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983999+0000","last_change":"2024-09-17T05:30:06.340675+0000","last_active":"2024-09-17T05:30:07.983999+0000","last_peered":"2024-09-17T05:30:07.983999+0000","last_clean":"2024-09-17T05:30:07.983999+0000","last_became_active":"2024-09-17T05:30:06.340429+0000","last_became_peered":"2024-09-17T05:30:06.340429+0000","last_unstale":"2024-09-17T05:30:07.983999+0000","last_undegraded":"2024-09-17T05:30:07.983999+0000","last_fullsized":"2024-09-17T05:30:07.983999+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:10.151279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300482+0000","last_change":"2024-09-17T05:30:05.319324+0000","last_active":"2024-09-17T05:30:07.300482+0000","last_peered":"2024-09-17T05:30:07.300482+0000","last_clean":"2024-09-17T05:30:07.300482+0000","last_became_active":"2024-09-17T05:30:05.319027+0000","last_became_peered":"2024-09-17T05:30:05.319027+0000","last_unstale":"2024-09-17T05:30:07.300482+0000","last_undegraded":"2024-09-17T05:30:07.300482+0000","last_fullsized":"2024-09-17T05:30:07.300482+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:17.785457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975385+0000","last_change":"2024-09-17T05:30:06.320266+0000","last_active":"2024-09-17T05:30:07.975385+0000","last_peered":"2024-09-17T05:30:07.975385+0000","last_clean":"2024-09-17T05:30:07.975385+0000","last_became_active":"2024-09-17T05:30:06.319980+0000","last_became_peered":"2024-09-17T05:30:06.319980+0000","last_unstale":"2024-09-17T05:30:07.975385+0000","last_undegraded":"2024-09-17T05:30:07.975385+0000","last_fullsized":"2024-09-17T05:30:07.975385+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:41.689813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981119+0000","last_change":"2024-09-17T05:30:05.317446+0000","last_active":"2024-09-17T05:30:07.981119+0000","last_peered":"2024-09-17T05:30:07.981119+0000","last_clean":"2024-09-17T05:30:07.981119+0000","last_became_active":"2024-09-17T05:30:05.317157+0000","last_became_peered":"2024-09-17T05:30:05.317157+0000","last_unstale":"2024-09-17T05:30:07.981119+0000","last_undegraded":"2024-09-17T05:30:07.981119+0000","last_fullsized":"2024-09-17T05:30:07.981119+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:48.813550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980759+0000","last_change":"2024-09-17T05:30:06.335728+0000","last_active":"2024-09-17T05:30:07.980759+0000","last_peered":"2024-09-17T05:30:07.980759+0000","last_clean":"2024-09-17T05:30:07.980759+0000","last_became_active":"2024-09-17T05:30:06.335019+0000","last_became_peered":"2024-09-17T05:30:06.335019+0000","last_unstale":"2024-09-17T05:30:07.980759+0000","last_undegraded":"2024-09-17T05:30:07.980759+0000","last_fullsized":"2024-09-17T05:30:07.980759+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:46.123430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983634+0000","last_change":"2024-09-17T05:30:05.319744+0000","last_active":"2024-09-17T05:30:07.983634+0000","last_peered":"2024-09-17T05:30:07.983634+0000","last_clean":"2024-09-17T05:30:07.983634+0000","last_became_active":"2024-09-17T05:30:05.319478+0000","last_became_peered":"2024-09-17T05:30:05.319478+0000","last_unstale":"2024-09-17T05:30:07.983634+0000","last_undegraded":"2024-09-17T05:30:07.983634+0000","last_fullsized":"2024-09-17T05:30:07.983634+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:29.060749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980018+0000","last_change":"2024-09-17T05:30:06.322896+0000","last_active":"2024-09-17T05:30:07.980018+0000","last_peered":"2024-09-17T05:30:07.980018+0000","last_clean":"2024-09-17T05:30:07.980018+0000","last_became_active":"2024-09-17T05:30:06.322165+0000","last_became_peered":"2024-09-17T05:30:06.322165+0000","last_unstale":"2024-09-17T05:30:07.980018+0000","last_undegraded":"2024-09-17T05:30:07.980018+0000","last_fullsized":"2024-09-17T05:30:07.980018+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:31.155570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980611+0000","last_change":"2024-09-17T05:30:05.322669+0000","last_active":"2024-09-17T05:30:07.980611+0000","last_peered":"2024-09-17T05:30:07.980611+0000","last_clean":"2024-09-17T05:30:07.980611+0000","last_became_active":"2024-09-17T05:30:05.321429+0000","last_became_peered":"2024-09-17T05:30:05.321429+0000","last_unstale":"2024-09-17T05:30:07.980611+0000","last_undegraded":"2024-09-17T05:30:07.980611+0000","last_fullsized":"2024-09-17T05:30:07.980611+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:14.517825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983709+0000","last_change":"2024-09-17T05:30:06.323916+0000","last_active":"2024-09-17T05:30:07.983709+0000","last_peered":"2024-09-17T05:30:07.983709+0000","last_clean":"2024-09-17T05:30:07.983709+0000","last_became_active":"2024-09-17T05:30:06.323648+0000","last_became_peered":"2024-09-17T05:30:06.323648+0000","last_unstale":"2024-09-17T05:30:07.983709+0000","last_undegraded":"2024-09-17T05:30:07.983709+0000","last_fullsized":"2024-09-17T05:30:07.983709+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:14.523342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979984+0000","last_change":"2024-09-17T05:30:05.325941+0000","last_active":"2024-09-17T05:30:07.979984+0000","last_peered":"2024-09-17T05:30:07.979984+0000","last_clean":"2024-09-17T05:30:07.979984+0000","last_became_active":"2024-09-17T05:30:05.325555+0000","last_became_peered":"2024-09-17T05:30:05.325555+0000","last_unstale":"2024-09-17T05:30:07.979984+0000","last_undegraded":"2024-09-17T05:30:07.979984+0000","last_fullsized":"2024-09-17T05:30:07.979984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:53.248264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300481+0000","last_change":"2024-09-17T05:30:06.310721+0000","last_active":"2024-09-17T05:30:07.300481+0000","last_peered":"2024-09-17T05:30:07.300481+0000","last_clean":"2024-09-17T05:30:07.300481+0000","last_became_active":"2024-09-17T05:30:06.310439+0000","last_became_peered":"2024-09-17T05:30:06.310439+0000","last_unstale":"2024-09-17T05:30:07.300481+0000","last_undegraded":"2024-09-17T05:30:07.300481+0000","last_fullsized":"2024-09-17T05:30:07.300481+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:01.164644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300253+0000","last_change":"2024-09-17T05:30:05.325974+0000","last_active":"2024-09-17T05:30:07.300253+0000","last_peered":"2024-09-17T05:30:07.300253+0000","last_clean":"2024-09-17T05:30:07.300253+0000","last_became_active":"2024-09-17T05:30:05.325587+0000","last_became_peered":"2024-09-17T05:30:05.325587+0000","last_unstale":"2024-09-17T05:30:07.300253+0000","last_undegraded":"2024-09-17T05:30:07.300253+0000","last_fullsized":"2024-09-17T05:30:07.300253+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:22.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981411+0000","last_change":"2024-09-17T05:30:06.324125+0000","last_active":"2024-09-17T05:30:07.981411+0000","last_peered":"2024-09-17T05:30:07.981411+0000","last_clean":"2024-09-17T05:30:07.981411+0000","last_became_active":"2024-09-17T05:30:06.323889+0000","last_became_peered":"2024-09-17T05:30:06.323889+0000","last_unstale":"2024-09-17T05:30:07.981411+0000","last_undegraded":"2024-09-17T05:30:07.981411+0000","last_fullsized":"2024-09-17T05:30:07.981411+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:02.179760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306975+0000","last_change":"2024-09-17T05:30:05.318534+0000","last_active":"2024-09-17T05:30:07.306975+0000","last_peered":"2024-09-17T05:30:07.306975+0000","last_clean":"2024-09-17T05:30:07.306975+0000","last_became_active":"2024-09-17T05:30:05.318295+0000","last_became_peered":"2024-09-17T05:30:05.318295+0000","last_unstale":"2024-09-17T05:30:07.306975+0000","last_undegraded":"2024-09-17T05:30:07.306975+0000","last_fullsized":"2024-09-17T05:30:07.306975+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:56.087814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975580+0000","last_change":"2024-09-17T05:30:06.331809+0000","last_active":"2024-09-17T05:30:07.975580+0000","last_peered":"2024-09-17T05:30:07.975580+0000","last_clean":"2024-09-17T05:30:07.975580+0000","last_became_active":"2024-09-17T05:30:06.331496+0000","last_became_peered":"2024-09-17T05:30:06.331496+0000","last_unstale":"2024-09-17T05:30:07.975580+0000","last_undegraded":"2024-09-17T05:30:07.975580+0000","last_fullsized":"2024-09-17T05:30:07.975580+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:47.169886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983072+0000","last_change":"2024-09-17T05:30:05.317351+0000","last_active":"2024-09-17T05:30:07.983072+0000","last_peered":"2024-09-17T05:30:07.983072+0000","last_clean":"2024-09-17T05:30:07.983072+0000","last_became_active":"2024-09-17T05:30:05.315615+0000","last_became_peered":"2024-09-17T05:30:05.315615+0000","last_unstale":"2024-09-17T05:30:07.983072+0000","last_undegraded":"2024-09-17T05:30:07.983072+0000","last_fullsized":"2024-09-17T05:30:07.983072+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:20.670899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975864+0000","last_change":"2024-09-17T05:30:06.323503+0000","last_active":"2024-09-17T05:30:07.975864+0000","last_peered":"2024-09-17T05:30:07.975864+0000","last_clean":"2024-09-17T05:30:07.975864+0000","last_became_active":"2024-09-17T05:30:06.323215+0000","last_became_peered":"2024-09-17T05:30:06.323215+0000","last_unstale":"2024-09-17T05:30:07.975864+0000","last_undegraded":"2024-09-17T05:30:07.975864+0000","last_fullsized":"2024-09-17T05:30:07.975864+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:59.484368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981563+0000","last_change":"2024-09-17T05:30:05.321166+0000","last_active":"2024-09-17T05:30:07.981563+0000","last_peered":"2024-09-17T05:30:07.981563+0000","last_clean":"2024-09-17T05:30:07.981563+0000","last_became_active":"2024-09-17T05:30:05.320876+0000","last_became_peered":"2024-09-17T05:30:05.320876+0000","last_unstale":"2024-09-17T05:30:07.981563+0000","last_undegraded":"2024-09-17T05:30:07.981563+0000","last_fullsized":"2024-09-17T05:30:07.981563+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:06.806797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980877+0000","last_change":"2024-09-17T05:30:06.331593+0000","last_active":"2024-09-17T05:30:07.980877+0000","last_peered":"2024-09-17T05:30:07.980877+0000","last_clean":"2024-09-17T05:30:07.980877+0000","last_became_active":"2024-09-17T05:30:06.328034+0000","last_became_peered":"2024-09-17T05:30:06.328034+0000","last_unstale":"2024-09-17T05:30:07.980877+0000","last_undegraded":"2024-09-17T05:30:07.980877+0000","last_fullsized":"2024-09-17T05:30:07.980877+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:51.251941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981285+0000","last_change":"2024-09-17T05:30:05.304880+0000","last_active":"2024-09-17T05:30:07.981285+0000","last_peered":"2024-09-17T05:30:07.981285+0000","last_clean":"2024-09-17T05:30:07.981285+0000","last_became_active":"2024-09-17T05:30:05.304284+0000","last_became_peered":"2024-09-17T05:30:05.304284+0000","last_unstale":"2024-09-17T05:30:07.981285+0000","last_undegraded":"2024-09-17T05:30:07.981285+0000","last_fullsized":"2024-09-17T05:30:07.981285+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:48.792196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.303380+0000","last_change":"2024-09-17T05:30:06.336975+0000","last_active":"2024-09-17T05:30:07.303380+0000","last_peered":"2024-09-17T05:30:07.303380+0000","last_clean":"2024-09-17T05:30:07.303380+0000","last_became_active":"2024-09-17T05:30:06.336526+0000","last_became_peered":"2024-09-17T05:30:06.336526+0000","last_unstale":"2024-09-17T05:30:07.303380+0000","last_undegraded":"2024-09-17T05:30:07.303380+0000","last_fullsized":"2024-09-17T05:30:07.303380+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:29.608158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.982840+0000","last_change":"2024-09-17T05:30:05.319225+0000","last_active":"2024-09-17T05:30:07.982840+0000","last_peered":"2024-09-17T05:30:07.982840+0000","last_clean":"2024-09-17T05:30:07.982840+0000","last_became_active":"2024-09-17T05:30:05.318757+0000","last_became_peered":"2024-09-17T05:30:05.318757+0000","last_unstale":"2024-09-17T05:30:07.982840+0000","last_undegraded":"2024-09-17T05:30:07.982840+0000","last_fullsized":"2024-09-17T05:30:07.982840+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:28.145122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300066+0000","last_change":"2024-09-17T05:30:06.311407+0000","last_active":"2024-09-17T05:30:07.300066+0000","last_peered":"2024-09-17T05:30:07.300066+0000","last_clean":"2024-09-17T05:30:07.300066+0000","last_became_active":"2024-09-17T05:30:06.311072+0000","last_became_peered":"2024-09-17T05:30:06.311072+0000","last_unstale":"2024-09-17T05:30:07.300066+0000","last_undegraded":"2024-09-17T05:30:07.300066+0000","last_fullsized":"2024-09-17T05:30:07.300066+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:13.587884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979805+0000","last_change":"2024-09-17T05:30:05.322027+0000","last_active":"2024-09-17T05:30:07.979805+0000","last_peered":"2024-09-17T05:30:07.979805+0000","last_clean":"2024-09-17T05:30:07.979805+0000","last_became_active":"2024-09-17T05:30:05.321704+0000","last_became_peered":"2024-09-17T05:30:05.321704+0000","last_unstale":"2024-09-17T05:30:07.979805+0000","last_undegraded":"2024-09-17T05:30:07.979805+0000","last_fullsized":"2024-09-17T05:30:07.979805+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:15.832365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979830+0000","last_change":"2024-09-17T05:30:06.340286+0000","last_active":"2024-09-17T05:30:07.979830+0000","last_peered":"2024-09-17T05:30:07.979830+0000","last_clean":"2024-09-17T05:30:07.979830+0000","last_became_active":"2024-09-17T05:30:06.340000+0000","last_became_peered":"2024-09-17T05:30:06.340000+0000","last_unstale":"2024-09-17T05:30:07.979830+0000","last_undegraded":"2024-09-17T05:30:07.979830+0000","last_fullsized":"2024-09-17T05:30:07.979830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:54.770556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983295+0000","last_change":"2024-09-17T05:30:05.315124+0000","last_active":"2024-09-17T05:30:07.983295+0000","last_peered":"2024-09-17T05:30:07.983295+0000","last_clean":"2024-09-17T05:30:07.983295+0000","last_became_active":"2024-09-17T05:30:05.314810+0000","last_became_peered":"2024-09-17T05:30:05.314810+0000","last_unstale":"2024-09-17T05:30:07.983295+0000","last_undegraded":"2024-09-17T05:30:07.983295+0000","last_fullsized":"2024-09-17T05:30:07.983295+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:23.210611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975736+0000","last_change":"2024-09-17T05:30:06.320245+0000","last_active":"2024-09-17T05:30:07.975736+0000","last_peered":"2024-09-17T05:30:07.975736+0000","last_clean":"2024-09-17T05:30:07.975736+0000","last_became_active":"2024-09-17T05:30:06.319945+0000","last_became_peered":"2024-09-17T05:30:06.319945+0000","last_unstale":"2024-09-17T05:30:07.975736+0000","last_undegraded":"2024-09-17T05:30:07.975736+0000","last_fullsized":"2024-09-17T05:30:07.975736+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:37.456433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981138+0000","last_change":"2024-09-17T05:30:05.316670+0000","last_active":"2024-09-17T05:30:07.981138+0000","last_peered":"2024-09-17T05:30:07.981138+0000","last_clean":"2024-09-17T05:30:07.981138+0000","last_became_active":"2024-09-17T05:30:05.316423+0000","last_became_peered":"2024-09-17T05:30:05.316423+0000","last_unstale":"2024-09-17T05:30:07.981138+0000","last_undegraded":"2024-09-17T05:30:07.981138+0000","last_fullsized":"2024-09-17T05:30:07.981138+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:46.803998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980666+0000","last_change":"2024-09-17T05:30:06.332073+0000","last_active":"2024-09-17T05:30:07.980666+0000","last_peered":"2024-09-17T05:30:07.980666+0000","last_clean":"2024-09-17T05:30:07.980666+0000","last_became_active":"2024-09-17T05:30:06.331396+0000","last_became_peered":"2024-09-17T05:30:06.331396+0000","last_unstale":"2024-09-17T05:30:07.980666+0000","last_undegraded":"2024-09-17T05:30:07.980666+0000","last_fullsized":"2024-09-17T05:30:07.980666+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:18.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.984087+0000","last_change":"2024-09-17T05:30:05.319860+0000","last_active":"2024-09-17T05:30:07.984087+0000","last_peered":"2024-09-17T05:30:07.984087+0000","last_clean":"2024-09-17T05:30:07.984087+0000","last_became_active":"2024-09-17T05:30:05.319572+0000","last_became_peered":"2024-09-17T05:30:05.319572+0000","last_unstale":"2024-09-17T05:30:07.984087+0000","last_undegraded":"2024-09-17T05:30:07.984087+0000","last_fullsized":"2024-09-17T05:30:07.984087+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:06.333614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.984046+0000","last_change":"2024-09-17T05:30:06.330620+0000","last_active":"2024-09-17T05:30:07.984046+0000","last_peered":"2024-09-17T05:30:07.984046+0000","last_clean":"2024-09-17T05:30:07.984046+0000","last_became_active":"2024-09-17T05:30:06.330347+0000","last_became_peered":"2024-09-17T05:30:06.330347+0000","last_unstale":"2024-09-17T05:30:07.984046+0000","last_undegraded":"2024-09-17T05:30:07.984046+0000","last_fullsized":"2024-09-17T05:30:07.984046+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:48.623576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.303283+0000","last_change":"2024-09-17T05:30:05.318218+0000","last_active":"2024-09-17T05:30:07.303283+0000","last_peered":"2024-09-17T05:30:07.303283+0000","last_clean":"2024-09-17T05:30:07.303283+0000","last_became_active":"2024-09-17T05:30:05.317928+0000","last_became_peered":"2024-09-17T05:30:05.317928+0000","last_unstale":"2024-09-17T05:30:07.303283+0000","last_undegraded":"2024-09-17T05:30:07.303283+0000","last_fullsized":"2024-09-17T05:30:07.303283+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:11.904095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981066+0000","last_change":"2024-09-17T05:30:06.338495+0000","last_active":"2024-09-17T05:30:07.981066+0000","last_peered":"2024-09-17T05:30:07.981066+0000","last_clean":"2024-09-17T05:30:07.981066+0000","last_became_active":"2024-09-17T05:30:06.338093+0000","last_became_peered":"2024-09-17T05:30:06.338093+0000","last_unstale":"2024-09-17T05:30:07.981066+0000","last_undegraded":"2024-09-17T05:30:07.981066+0000","last_fullsized":"2024-09-17T05:30:07.981066+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:48.159252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983902+0000","last_change":"2024-09-17T05:30:05.320765+0000","last_active":"2024-09-17T05:30:07.983902+0000","last_peered":"2024-09-17T05:30:07.983902+0000","last_clean":"2024-09-17T05:30:07.983902+0000","last_became_active":"2024-09-17T05:30:05.320465+0000","last_became_peered":"2024-09-17T05:30:05.320465+0000","last_unstale":"2024-09-17T05:30:07.983902+0000","last_undegraded":"2024-09-17T05:30:07.983902+0000","last_fullsized":"2024-09-17T05:30:07.983902+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:39.171928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981466+0000","last_change":"2024-09-17T05:30:06.334369+0000","last_active":"2024-09-17T05:30:07.981466+0000","last_peered":"2024-09-17T05:30:07.981466+0000","last_clean":"2024-09-17T05:30:07.981466+0000","last_became_active":"2024-09-17T05:30:06.333791+0000","last_became_peered":"2024-09-17T05:30:06.333791+0000","last_unstale":"2024-09-17T05:30:07.981466+0000","last_undegraded":"2024-09-17T05:30:07.981466+0000","last_fullsized":"2024-09-17T05:30:07.981466+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:52.860356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306543+0000","last_change":"2024-09-17T05:30:05.322511+0000","last_active":"2024-09-17T05:30:07.306543+0000","last_peered":"2024-09-17T05:30:07.306543+0000","last_clean":"2024-09-17T05:30:07.306543+0000","last_became_active":"2024-09-17T05:30:05.321575+0000","last_became_peered":"2024-09-17T05:30:05.321575+0000","last_unstale":"2024-09-17T05:30:07.306543+0000","last_undegraded":"2024-09-17T05:30:07.306543+0000","last_fullsized":"2024-09-17T05:30:07.306543+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:20.595118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983039+0000","last_change":"2024-09-17T05:30:06.318509+0000","last_active":"2024-09-17T05:30:07.983039+0000","last_peered":"2024-09-17T05:30:07.983039+0000","last_clean":"2024-09-17T05:30:07.983039+0000","last_became_active":"2024-09-17T05:30:06.318104+0000","last_became_peered":"2024-09-17T05:30:06.318104+0000","last_unstale":"2024-09-17T05:30:07.983039+0000","last_undegraded":"2024-09-17T05:30:07.983039+0000","last_fullsized":"2024-09-17T05:30:07.983039+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:18.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.303176+0000","last_change":"2024-09-17T05:30:05.321359+0000","last_active":"2024-09-17T05:30:07.303176+0000","last_peered":"2024-09-17T05:30:07.303176+0000","last_clean":"2024-09-17T05:30:07.303176+0000","last_became_active":"2024-09-17T05:30:05.321017+0000","last_became_peered":"2024-09-17T05:30:05.321017+0000","last_unstale":"2024-09-17T05:30:07.303176+0000","last_undegraded":"2024-09-17T05:30:07.303176+0000","last_fullsized":"2024-09-17T05:30:07.303176+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:49.729060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306816+0000","last_change":"2024-09-17T05:30:06.324838+0000","last_active":"2024-09-17T05:30:07.306816+0000","last_peered":"2024-09-17T05:30:07.306816+0000","last_clean":"2024-09-17T05:30:07.306816+0000","last_became_active":"2024-09-17T05:30:06.324511+0000","last_became_peered":"2024-09-17T05:30:06.324511+0000","last_unstale":"2024-09-17T05:30:07.306816+0000","last_undegraded":"2024-09-17T05:30:07.306816+0000","last_fullsized":"2024-09-17T05:30:07.306816+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:07.818014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980103+0000","last_change":"2024-09-17T05:30:05.317797+0000","last_active":"2024-09-17T05:30:07.980103+0000","last_peered":"2024-09-17T05:30:07.980103+0000","last_clean":"2024-09-17T05:30:07.980103+0000","last_became_active":"2024-09-17T05:30:05.317453+0000","last_became_peered":"2024-09-17T05:30:05.317453+0000","last_unstale":"2024-09-17T05:30:07.980103+0000","last_undegraded":"2024-09-17T05:30:07.980103+0000","last_fullsized":"2024-09-17T05:30:07.980103+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:56.157479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981257+0000","last_change":"2024-09-17T05:30:06.340137+0000","last_active":"2024-09-17T05:30:07.981257+0000","last_peered":"2024-09-17T05:30:07.981257+0000","last_clean":"2024-09-17T05:30:07.981257+0000","last_became_active":"2024-09-17T05:30:06.335162+0000","last_became_peered":"2024-09-17T05:30:06.335162+0000","last_unstale":"2024-09-17T05:30:07.981257+0000","last_undegraded":"2024-09-17T05:30:07.981257+0000","last_fullsized":"2024-09-17T05:30:07.981257+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:15.759144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983535+0000","last_change":"2024-09-17T05:30:05.319479+0000","last_active":"2024-09-17T05:30:07.983535+0000","last_peered":"2024-09-17T05:30:07.983535+0000","last_clean":"2024-09-17T05:30:07.983535+0000","last_became_active":"2024-09-17T05:30:05.319190+0000","last_became_peered":"2024-09-17T05:30:05.319190+0000","last_unstale":"2024-09-17T05:30:07.983535+0000","last_undegraded":"2024-09-17T05:30:07.983535+0000","last_fullsized":"2024-09-17T05:30:07.983535+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:53.759339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":153,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983297+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:30:07.983297+0000","last_peered":"2024-09-17T05:30:07.983297+0000","last_clean":"2024-09-17T05:30:07.983297+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:30:07.983297+0000","last_undegraded":"2024-09-17T05:30:07.983297+0000","last_fullsized":"2024-09-17T05:30:07.983297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1105920,"data_stored":794344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":516096,"data_stored":204558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":520192,"data_stored":205498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":520192,"data_stored":204524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":524288,"data_stored":205520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":512000,"data_stored":203956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":203956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1093632,"data_stored":787988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:30:15.109 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:30:15.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.260+0000 7f13f7c00640 1 -- 172.21.15.31:0/1801021277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13f00b49e0 msgr2=0x7f13f00acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:15.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.260+0000 7f13f7c00640 1 --2- 172.21.15.31:0/1801021277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13f00b49e0 0x7f13f00acd40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f13f00708e0 tx=0x7f13e801cc60 comp rx=0 tx=0).stop 2024-09-17T05:30:15.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f7c00640 1 -- 172.21.15.31:0/1801021277 shutdown_connections 2024-09-17T05:30:15.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f7c00640 1 --2- 172.21.15.31:0/1801021277 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13f00b49e0 0x7f13f00acd40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:15.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f7c00640 1 --2- 172.21.15.31:0/1801021277 >> v2:172.21.15.155:3300/0 conn(0x7f13f00cd100 0x7f13f006f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:15.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f7c00640 1 -- 172.21.15.31:0/1801021277 >> 172.21.15.31:0/1801021277 conn(0x7f13f00b18f0 msgr2=0x7f13f00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:15.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f7c00640 1 -- 172.21.15.31:0/1801021277 shutdown_connections 2024-09-17T05:30:15.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f7c00640 1 -- 172.21.15.31:0/1801021277 wait complete. 2024-09-17T05:30:15.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f7c00640 1 Processor -- start 2024-09-17T05:30:15.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f7c00640 1 -- start start 2024-09-17T05:30:15.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f7c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13f00b49e0 0x7f13f0154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:15.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f7c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13f00cd100 0x7f13f0157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:15.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f7c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13f015dae0 0x7f13f01525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f7c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f13f00cf170 con 0x7f13f015dae0 2024-09-17T05:30:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f7c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f13f00ceff0 con 0x7f13f00cd100 2024-09-17T05:30:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f7c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f13f00cf2f0 con 0x7f13f00b49e0 2024-09-17T05:30:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f5c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13f015dae0 0x7f13f01525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f5c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13f015dae0 0x7f13f01525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45050/0 (socket says 172.21.15.31:45050) 2024-09-17T05:30:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f5c00640 1 -- 172.21.15.31:0/44837787 learned_addr learned my addr 172.21.15.31:0/44837787 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13efe00640 1 --2- 172.21.15.31:0/44837787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13f00cd100 0x7f13f0157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f5200640 1 --2- 172.21.15.31:0/44837787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13f00b49e0 0x7f13f0154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f5c00640 1 -- 172.21.15.31:0/44837787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13f00b49e0 msgr2=0x7f13f0154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f5c00640 1 --2- 172.21.15.31:0/44837787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13f00b49e0 0x7f13f0154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:15.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f5c00640 1 -- 172.21.15.31:0/44837787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13f00cd100 msgr2=0x7f13f0157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:15.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f5c00640 1 --2- 172.21.15.31:0/44837787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13f00cd100 0x7f13f0157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:15.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f5c00640 1 -- 172.21.15.31:0/44837787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f0157b70 con 0x7f13f015dae0 2024-09-17T05:30:15.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13efe00640 1 --2- 172.21.15.31:0/44837787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13f00cd100 0x7f13f0157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:30:15.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.264+0000 7f13f5c00640 1 --2- 172.21.15.31:0/44837787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13f015dae0 0x7f13f01525e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f13e8009bd0 tx=0x7f13e8009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:15.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.268+0000 7f13ecc00640 1 -- 172.21.15.31:0/44837787 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e80bb070 con 0x7f13f015dae0 2024-09-17T05:30:15.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.268+0000 7f13ecc00640 1 -- 172.21.15.31:0/44837787 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13e8004d40 con 0x7f13f015dae0 2024-09-17T05:30:15.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.268+0000 7f13ecc00640 1 -- 172.21.15.31:0/44837787 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e80b2040 con 0x7f13f015dae0 2024-09-17T05:30:15.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.268+0000 7f13f7c00640 1 -- 172.21.15.31:0/44837787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f0157e50 con 0x7f13f015dae0 2024-09-17T05:30:15.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.268+0000 7f13f7c00640 1 -- 172.21.15.31:0/44837787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f01643c0 con 0x7f13f015dae0 2024-09-17T05:30:15.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.268+0000 7f13f7c00640 1 -- 172.21.15.31:0/44837787 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13f0069410 con 0x7f13f015dae0 2024-09-17T05:30:15.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.268+0000 7f13ecc00640 1 -- 172.21.15.31:0/44837787 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f13e80be070 con 0x7f13f015dae0 2024-09-17T05:30:15.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.268+0000 7f13ecc00640 1 --2- 172.21.15.31:0/44837787 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f13d00733b0 0x7f13d0075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:15.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.268+0000 7f13ecc00640 1 -- 172.21.15.31:0/44837787 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f13e812e320 con 0x7f13f015dae0 2024-09-17T05:30:15.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.268+0000 7f13f5200640 1 --2- 172.21.15.31:0/44837787 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f13d00733b0 0x7f13d0075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:15.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.272+0000 7f13f5200640 1 --2- 172.21.15.31:0/44837787 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f13d00733b0 0x7f13d0075870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f13f01596b0 tx=0x7f13e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:15.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.272+0000 7f13ecc00640 1 -- 172.21.15.31:0/44837787 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f13e8016970 con 0x7f13f015dae0 2024-09-17T05:30:15.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.448+0000 7f13f7c00640 1 -- 172.21.15.31:0/44837787 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f13f00acd40 con 0x7f13d00733b0 2024-09-17T05:30:15.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.456+0000 7f13ecc00640 1 -- 172.21.15.31:0/44837787 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f13f00acd40 con 0x7f13d00733b0 2024-09-17T05:30:15.462 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:15.464 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:30:15.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.456+0000 7f13f7c00640 1 -- 172.21.15.31:0/44837787 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f13d00733b0 msgr2=0x7f13d0075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:15.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.456+0000 7f13f7c00640 1 --2- 172.21.15.31:0/44837787 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f13d00733b0 0x7f13d0075870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f13f01596b0 tx=0x7f13e4009040 comp rx=0 tx=0).stop 2024-09-17T05:30:15.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.456+0000 7f13f7c00640 1 -- 172.21.15.31:0/44837787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13f015dae0 msgr2=0x7f13f01525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:15.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.456+0000 7f13f7c00640 1 --2- 172.21.15.31:0/44837787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13f015dae0 0x7f13f01525e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f13e8009bd0 tx=0x7f13e8009300 comp rx=0 tx=0).stop 2024-09-17T05:30:15.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.456+0000 7f13f7c00640 1 -- 172.21.15.31:0/44837787 shutdown_connections 2024-09-17T05:30:15.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.456+0000 7f13f7c00640 1 --2- 172.21.15.31:0/44837787 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f13d00733b0 0x7f13d0075870 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:15.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.456+0000 7f13f7c00640 1 --2- 172.21.15.31:0/44837787 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13f015dae0 0x7f13f01525e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:15.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.456+0000 7f13f7c00640 1 --2- 172.21.15.31:0/44837787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13f00cd100 0x7f13f0157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:15.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.456+0000 7f13f7c00640 1 --2- 172.21.15.31:0/44837787 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13f00b49e0 0x7f13f0154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:15.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.460+0000 7f13f7c00640 1 -- 172.21.15.31:0/44837787 >> 172.21.15.31:0/44837787 conn(0x7f13f00b18f0 msgr2=0x7f13f006f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:15.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.460+0000 7f13f7c00640 1 -- 172.21.15.31:0/44837787 shutdown_connections 2024-09-17T05:30:15.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.460+0000 7f13f7c00640 1 -- 172.21.15.31:0/44837787 wait complete. 2024-09-17T05:30:15.483 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-09-17T05:30:15.200730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225608,"kb_used_data":5192,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749112,"statfs":{"total":773094113280,"available":772863090688,"internally_reserved":0,"allocated":5316608,"data_stored":2816644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.900124"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983941+0000","last_change":"2024-09-17T05:30:06.324569+0000","last_active":"2024-09-17T05:30:07.983941+0000","last_peered":"2024-09-17T05:30:07.983941+0000","last_clean":"2024-09-17T05:30:07.983941+0000","last_became_active":"2024-09-17T05:30:06.324329+0000","last_became_peered":"2024-09-17T05:30:06.324329+0000","last_unstale":"2024-09-17T05:30:07.983941+0000","last_undegraded":"2024-09-17T05:30:07.983941+0000","last_fullsized":"2024-09-17T05:30:07.983941+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:45.362534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983219+0000","last_change":"2024-09-17T05:30:06.321869+0000","last_active":"2024-09-17T05:30:07.983219+0000","last_peered":"2024-09-17T05:30:07.983219+0000","last_clean":"2024-09-17T05:30:07.983219+0000","last_became_active":"2024-09-17T05:30:06.321455+0000","last_became_peered":"2024-09-17T05:30:06.321455+0000","last_unstale":"2024-09-17T05:30:07.983219+0000","last_undegraded":"2024-09-17T05:30:07.983219+0000","last_fullsized":"2024-09-17T05:30:07.983219+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:44.473010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306744+0000","last_change":"2024-09-17T05:30:06.316783+0000","last_active":"2024-09-17T05:30:07.306744+0000","last_peered":"2024-09-17T05:30:07.306744+0000","last_clean":"2024-09-17T05:30:07.306744+0000","last_became_active":"2024-09-17T05:30:06.316512+0000","last_became_peered":"2024-09-17T05:30:06.316512+0000","last_unstale":"2024-09-17T05:30:07.306744+0000","last_undegraded":"2024-09-17T05:30:07.306744+0000","last_fullsized":"2024-09-17T05:30:07.306744+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:29.139353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980453+0000","last_change":"2024-09-17T05:30:06.338103+0000","last_active":"2024-09-17T05:30:07.980453+0000","last_peered":"2024-09-17T05:30:07.980453+0000","last_clean":"2024-09-17T05:30:07.980453+0000","last_became_active":"2024-09-17T05:30:06.337712+0000","last_became_peered":"2024-09-17T05:30:06.337712+0000","last_unstale":"2024-09-17T05:30:07.980453+0000","last_undegraded":"2024-09-17T05:30:07.980453+0000","last_fullsized":"2024-09-17T05:30:07.980453+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:01.151033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983371+0000","last_change":"2024-09-17T05:30:06.317638+0000","last_active":"2024-09-17T05:30:07.983371+0000","last_peered":"2024-09-17T05:30:07.983371+0000","last_clean":"2024-09-17T05:30:07.983371+0000","last_became_active":"2024-09-17T05:30:06.315836+0000","last_became_peered":"2024-09-17T05:30:06.315836+0000","last_unstale":"2024-09-17T05:30:07.983371+0000","last_undegraded":"2024-09-17T05:30:07.983371+0000","last_fullsized":"2024-09-17T05:30:07.983371+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:15.759144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980825+0000","last_change":"2024-09-17T05:30:06.326405+0000","last_active":"2024-09-17T05:30:07.980825+0000","last_peered":"2024-09-17T05:30:07.980825+0000","last_clean":"2024-09-17T05:30:07.980825+0000","last_became_active":"2024-09-17T05:30:06.326093+0000","last_became_peered":"2024-09-17T05:30:06.326093+0000","last_unstale":"2024-09-17T05:30:07.980825+0000","last_undegraded":"2024-09-17T05:30:07.980825+0000","last_fullsized":"2024-09-17T05:30:07.980825+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:19.864402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983696+0000","last_change":"2024-09-17T05:30:06.340085+0000","last_active":"2024-09-17T05:30:07.983696+0000","last_peered":"2024-09-17T05:30:07.983696+0000","last_clean":"2024-09-17T05:30:07.983696+0000","last_became_active":"2024-09-17T05:30:06.339801+0000","last_became_peered":"2024-09-17T05:30:06.339801+0000","last_unstale":"2024-09-17T05:30:07.983696+0000","last_undegraded":"2024-09-17T05:30:07.983696+0000","last_fullsized":"2024-09-17T05:30:07.983696+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:12.149437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979737+0000","last_change":"2024-09-17T05:30:06.335575+0000","last_active":"2024-09-17T05:30:07.979737+0000","last_peered":"2024-09-17T05:30:07.979737+0000","last_clean":"2024-09-17T05:30:07.979737+0000","last_became_active":"2024-09-17T05:30:06.335241+0000","last_became_peered":"2024-09-17T05:30:06.335241+0000","last_unstale":"2024-09-17T05:30:07.979737+0000","last_undegraded":"2024-09-17T05:30:07.979737+0000","last_fullsized":"2024-09-17T05:30:07.979737+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:21.682116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981155+0000","last_change":"2024-09-17T05:30:06.342344+0000","last_active":"2024-09-17T05:30:07.981155+0000","last_peered":"2024-09-17T05:30:07.981155+0000","last_clean":"2024-09-17T05:30:07.981155+0000","last_became_active":"2024-09-17T05:30:06.341691+0000","last_became_peered":"2024-09-17T05:30:06.341691+0000","last_unstale":"2024-09-17T05:30:07.981155+0000","last_undegraded":"2024-09-17T05:30:07.981155+0000","last_fullsized":"2024-09-17T05:30:07.981155+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:44.473010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981052+0000","last_change":"2024-09-17T05:30:06.335792+0000","last_active":"2024-09-17T05:30:07.981052+0000","last_peered":"2024-09-17T05:30:07.981052+0000","last_clean":"2024-09-17T05:30:07.981052+0000","last_became_active":"2024-09-17T05:30:06.335480+0000","last_became_peered":"2024-09-17T05:30:06.335480+0000","last_unstale":"2024-09-17T05:30:07.981052+0000","last_undegraded":"2024-09-17T05:30:07.981052+0000","last_fullsized":"2024-09-17T05:30:07.981052+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:23.591461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980367+0000","last_change":"2024-09-17T05:30:06.341158+0000","last_active":"2024-09-17T05:30:07.980367+0000","last_peered":"2024-09-17T05:30:07.980367+0000","last_clean":"2024-09-17T05:30:07.980367+0000","last_became_active":"2024-09-17T05:30:06.340860+0000","last_became_peered":"2024-09-17T05:30:06.340860+0000","last_unstale":"2024-09-17T05:30:07.980367+0000","last_undegraded":"2024-09-17T05:30:07.980367+0000","last_fullsized":"2024-09-17T05:30:07.980367+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:19.820487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983177+0000","last_change":"2024-09-17T05:30:06.307784+0000","last_active":"2024-09-17T05:30:07.983177+0000","last_peered":"2024-09-17T05:30:07.983177+0000","last_clean":"2024-09-17T05:30:07.983177+0000","last_became_active":"2024-09-17T05:30:06.307523+0000","last_became_peered":"2024-09-17T05:30:06.307523+0000","last_unstale":"2024-09-17T05:30:07.983177+0000","last_undegraded":"2024-09-17T05:30:07.983177+0000","last_fullsized":"2024-09-17T05:30:07.983177+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:46.123430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300058+0000","last_change":"2024-09-17T05:30:06.331592+0000","last_active":"2024-09-17T05:30:07.300058+0000","last_peered":"2024-09-17T05:30:07.300058+0000","last_clean":"2024-09-17T05:30:07.300058+0000","last_became_active":"2024-09-17T05:30:06.329676+0000","last_became_peered":"2024-09-17T05:30:06.329676+0000","last_unstale":"2024-09-17T05:30:07.300058+0000","last_undegraded":"2024-09-17T05:30:07.300058+0000","last_fullsized":"2024-09-17T05:30:07.300058+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:33.485038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980003+0000","last_change":"2024-09-17T05:30:06.341111+0000","last_active":"2024-09-17T05:30:07.980003+0000","last_peered":"2024-09-17T05:30:07.980003+0000","last_clean":"2024-09-17T05:30:07.980003+0000","last_became_active":"2024-09-17T05:30:06.340826+0000","last_became_peered":"2024-09-17T05:30:06.340826+0000","last_unstale":"2024-09-17T05:30:07.980003+0000","last_undegraded":"2024-09-17T05:30:07.980003+0000","last_fullsized":"2024-09-17T05:30:07.980003+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:39.847537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980475+0000","last_change":"2024-09-17T05:30:06.321441+0000","last_active":"2024-09-17T05:30:07.980475+0000","last_peered":"2024-09-17T05:30:07.980475+0000","last_clean":"2024-09-17T05:30:07.980475+0000","last_became_active":"2024-09-17T05:30:06.320838+0000","last_became_peered":"2024-09-17T05:30:06.320838+0000","last_unstale":"2024-09-17T05:30:07.980475+0000","last_undegraded":"2024-09-17T05:30:07.980475+0000","last_fullsized":"2024-09-17T05:30:07.980475+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:27.273165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975246+0000","last_change":"2024-09-17T05:30:06.330815+0000","last_active":"2024-09-17T05:30:07.975246+0000","last_peered":"2024-09-17T05:30:07.975246+0000","last_clean":"2024-09-17T05:30:07.975246+0000","last_became_active":"2024-09-17T05:30:06.330540+0000","last_became_peered":"2024-09-17T05:30:06.330540+0000","last_unstale":"2024-09-17T05:30:07.975246+0000","last_undegraded":"2024-09-17T05:30:07.975246+0000","last_fullsized":"2024-09-17T05:30:07.975246+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:50.740276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.307055+0000","last_change":"2024-09-17T05:30:06.313882+0000","last_active":"2024-09-17T05:30:07.307055+0000","last_peered":"2024-09-17T05:30:07.307055+0000","last_clean":"2024-09-17T05:30:07.307055+0000","last_became_active":"2024-09-17T05:30:06.312977+0000","last_became_peered":"2024-09-17T05:30:06.312977+0000","last_unstale":"2024-09-17T05:30:07.307055+0000","last_undegraded":"2024-09-17T05:30:07.307055+0000","last_fullsized":"2024-09-17T05:30:07.307055+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:08:35.053465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306709+0000","last_change":"2024-09-17T05:30:06.330143+0000","last_active":"2024-09-17T05:30:07.306709+0000","last_peered":"2024-09-17T05:30:07.306709+0000","last_clean":"2024-09-17T05:30:07.306709+0000","last_became_active":"2024-09-17T05:30:06.329890+0000","last_became_peered":"2024-09-17T05:30:06.329890+0000","last_unstale":"2024-09-17T05:30:07.306709+0000","last_undegraded":"2024-09-17T05:30:07.306709+0000","last_fullsized":"2024-09-17T05:30:07.306709+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:51.494900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975823+0000","last_change":"2024-09-17T05:30:06.330201+0000","last_active":"2024-09-17T05:30:07.975823+0000","last_peered":"2024-09-17T05:30:07.975823+0000","last_clean":"2024-09-17T05:30:07.975823+0000","last_became_active":"2024-09-17T05:30:06.329892+0000","last_became_peered":"2024-09-17T05:30:06.329892+0000","last_unstale":"2024-09-17T05:30:07.975823+0000","last_undegraded":"2024-09-17T05:30:07.975823+0000","last_fullsized":"2024-09-17T05:30:07.975823+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:52.043780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300424+0000","last_change":"2024-09-17T05:30:06.326530+0000","last_active":"2024-09-17T05:30:07.300424+0000","last_peered":"2024-09-17T05:30:07.300424+0000","last_clean":"2024-09-17T05:30:07.300424+0000","last_became_active":"2024-09-17T05:30:06.326217+0000","last_became_peered":"2024-09-17T05:30:06.326217+0000","last_unstale":"2024-09-17T05:30:07.300424+0000","last_undegraded":"2024-09-17T05:30:07.300424+0000","last_fullsized":"2024-09-17T05:30:07.300424+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:20.876601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980934+0000","last_change":"2024-09-17T05:30:06.326921+0000","last_active":"2024-09-17T05:30:07.980934+0000","last_peered":"2024-09-17T05:30:07.980934+0000","last_clean":"2024-09-17T05:30:07.980934+0000","last_became_active":"2024-09-17T05:30:06.326659+0000","last_became_peered":"2024-09-17T05:30:06.326659+0000","last_unstale":"2024-09-17T05:30:07.980934+0000","last_undegraded":"2024-09-17T05:30:07.980934+0000","last_fullsized":"2024-09-17T05:30:07.980934+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:31:31.349115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980167+0000","last_change":"2024-09-17T05:30:06.336071+0000","last_active":"2024-09-17T05:30:07.980167+0000","last_peered":"2024-09-17T05:30:07.980167+0000","last_clean":"2024-09-17T05:30:07.980167+0000","last_became_active":"2024-09-17T05:30:06.335275+0000","last_became_peered":"2024-09-17T05:30:06.335275+0000","last_unstale":"2024-09-17T05:30:07.980167+0000","last_undegraded":"2024-09-17T05:30:07.980167+0000","last_fullsized":"2024-09-17T05:30:07.980167+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:58.105556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975191+0000","last_change":"2024-09-17T05:30:06.324782+0000","last_active":"2024-09-17T05:30:07.975191+0000","last_peered":"2024-09-17T05:30:07.975191+0000","last_clean":"2024-09-17T05:30:07.975191+0000","last_became_active":"2024-09-17T05:30:06.324484+0000","last_became_peered":"2024-09-17T05:30:06.324484+0000","last_unstale":"2024-09-17T05:30:07.975191+0000","last_undegraded":"2024-09-17T05:30:07.975191+0000","last_fullsized":"2024-09-17T05:30:07.975191+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:59.232774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975602+0000","last_change":"2024-09-17T05:30:06.320703+0000","last_active":"2024-09-17T05:30:07.975602+0000","last_peered":"2024-09-17T05:30:07.975602+0000","last_clean":"2024-09-17T05:30:07.975602+0000","last_became_active":"2024-09-17T05:30:06.320432+0000","last_became_peered":"2024-09-17T05:30:06.320432+0000","last_unstale":"2024-09-17T05:30:07.975602+0000","last_undegraded":"2024-09-17T05:30:07.975602+0000","last_fullsized":"2024-09-17T05:30:07.975602+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:47:10.927229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975655+0000","last_change":"2024-09-17T05:30:06.340184+0000","last_active":"2024-09-17T05:30:07.975655+0000","last_peered":"2024-09-17T05:30:07.975655+0000","last_clean":"2024-09-17T05:30:07.975655+0000","last_became_active":"2024-09-17T05:30:06.339844+0000","last_became_peered":"2024-09-17T05:30:06.339844+0000","last_unstale":"2024-09-17T05:30:07.975655+0000","last_undegraded":"2024-09-17T05:30:07.975655+0000","last_fullsized":"2024-09-17T05:30:07.975655+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:21.303474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300275+0000","last_change":"2024-09-17T05:30:06.325741+0000","last_active":"2024-09-17T05:30:07.300275+0000","last_peered":"2024-09-17T05:30:07.300275+0000","last_clean":"2024-09-17T05:30:07.300275+0000","last_became_active":"2024-09-17T05:30:06.323875+0000","last_became_peered":"2024-09-17T05:30:06.323875+0000","last_unstale":"2024-09-17T05:30:07.300275+0000","last_undegraded":"2024-09-17T05:30:07.300275+0000","last_fullsized":"2024-09-17T05:30:07.300275+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:28.377585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306617+0000","last_change":"2024-09-17T05:30:06.309486+0000","last_active":"2024-09-17T05:30:07.306617+0000","last_peered":"2024-09-17T05:30:07.306617+0000","last_clean":"2024-09-17T05:30:07.306617+0000","last_became_active":"2024-09-17T05:30:06.309117+0000","last_became_peered":"2024-09-17T05:30:06.309117+0000","last_unstale":"2024-09-17T05:30:07.306617+0000","last_undegraded":"2024-09-17T05:30:07.306617+0000","last_fullsized":"2024-09-17T05:30:07.306617+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:40.183144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983191+0000","last_change":"2024-09-17T05:30:06.307863+0000","last_active":"2024-09-17T05:30:07.983191+0000","last_peered":"2024-09-17T05:30:07.983191+0000","last_clean":"2024-09-17T05:30:07.983191+0000","last_became_active":"2024-09-17T05:30:06.307597+0000","last_became_peered":"2024-09-17T05:30:06.307597+0000","last_unstale":"2024-09-17T05:30:07.983191+0000","last_undegraded":"2024-09-17T05:30:07.983191+0000","last_fullsized":"2024-09-17T05:30:07.983191+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:23.591461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975439+0000","last_change":"2024-09-17T05:30:06.326327+0000","last_active":"2024-09-17T05:30:07.975439+0000","last_peered":"2024-09-17T05:30:07.975439+0000","last_clean":"2024-09-17T05:30:07.975439+0000","last_became_active":"2024-09-17T05:30:06.326080+0000","last_became_peered":"2024-09-17T05:30:06.326080+0000","last_unstale":"2024-09-17T05:30:07.975439+0000","last_undegraded":"2024-09-17T05:30:07.975439+0000","last_fullsized":"2024-09-17T05:30:07.975439+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:12.915311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306433+0000","last_change":"2024-09-17T05:30:06.313960+0000","last_active":"2024-09-17T05:30:07.306433+0000","last_peered":"2024-09-17T05:30:07.306433+0000","last_clean":"2024-09-17T05:30:07.306433+0000","last_became_active":"2024-09-17T05:30:06.313697+0000","last_became_peered":"2024-09-17T05:30:06.313697+0000","last_unstale":"2024-09-17T05:30:07.306433+0000","last_undegraded":"2024-09-17T05:30:07.306433+0000","last_fullsized":"2024-09-17T05:30:07.306433+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:36.122412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980787+0000","last_change":"2024-09-17T05:30:06.321560+0000","last_active":"2024-09-17T05:30:07.980787+0000","last_peered":"2024-09-17T05:30:07.980787+0000","last_clean":"2024-09-17T05:30:07.980787+0000","last_became_active":"2024-09-17T05:30:06.321157+0000","last_became_peered":"2024-09-17T05:30:06.321157+0000","last_unstale":"2024-09-17T05:30:07.980787+0000","last_undegraded":"2024-09-17T05:30:07.980787+0000","last_fullsized":"2024-09-17T05:30:07.980787+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:26.633690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.299919+0000","last_change":"2024-09-17T05:30:06.314723+0000","last_active":"2024-09-17T05:30:07.299919+0000","last_peered":"2024-09-17T05:30:07.299919+0000","last_clean":"2024-09-17T05:30:07.299919+0000","last_became_active":"2024-09-17T05:30:06.314281+0000","last_became_peered":"2024-09-17T05:30:06.314281+0000","last_unstale":"2024-09-17T05:30:07.299919+0000","last_undegraded":"2024-09-17T05:30:07.299919+0000","last_fullsized":"2024-09-17T05:30:07.299919+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:39.708265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.303579+0000","last_change":"2024-09-17T05:30:06.341890+0000","last_active":"2024-09-17T05:30:07.303579+0000","last_peered":"2024-09-17T05:30:07.303579+0000","last_clean":"2024-09-17T05:30:07.303579+0000","last_became_active":"2024-09-17T05:30:06.340710+0000","last_became_peered":"2024-09-17T05:30:06.340710+0000","last_unstale":"2024-09-17T05:30:07.303579+0000","last_undegraded":"2024-09-17T05:30:07.303579+0000","last_fullsized":"2024-09-17T05:30:07.303579+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:10.264251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981297+0000","last_change":"2024-09-17T05:30:05.317839+0000","last_active":"2024-09-17T05:30:07.981297+0000","last_peered":"2024-09-17T05:30:07.981297+0000","last_clean":"2024-09-17T05:30:07.981297+0000","last_became_active":"2024-09-17T05:30:05.317232+0000","last_became_peered":"2024-09-17T05:30:05.317232+0000","last_unstale":"2024-09-17T05:30:07.981297+0000","last_undegraded":"2024-09-17T05:30:07.981297+0000","last_fullsized":"2024-09-17T05:30:07.981297+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:08.447005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975543+0000","last_change":"2024-09-17T05:30:06.317027+0000","last_active":"2024-09-17T05:30:07.975543+0000","last_peered":"2024-09-17T05:30:07.975543+0000","last_clean":"2024-09-17T05:30:07.975543+0000","last_became_active":"2024-09-17T05:30:06.316750+0000","last_became_peered":"2024-09-17T05:30:06.316750+0000","last_unstale":"2024-09-17T05:30:07.975543+0000","last_undegraded":"2024-09-17T05:30:07.975543+0000","last_fullsized":"2024-09-17T05:30:07.975543+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:42.185698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306908+0000","last_change":"2024-09-17T05:30:05.322455+0000","last_active":"2024-09-17T05:30:07.306908+0000","last_peered":"2024-09-17T05:30:07.306908+0000","last_clean":"2024-09-17T05:30:07.306908+0000","last_became_active":"2024-09-17T05:30:05.321568+0000","last_became_peered":"2024-09-17T05:30:05.321568+0000","last_unstale":"2024-09-17T05:30:07.306908+0000","last_undegraded":"2024-09-17T05:30:07.306908+0000","last_fullsized":"2024-09-17T05:30:07.306908+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:26.627551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983603+0000","last_change":"2024-09-17T05:30:06.328218+0000","last_active":"2024-09-17T05:30:07.983603+0000","last_peered":"2024-09-17T05:30:07.983603+0000","last_clean":"2024-09-17T05:30:07.983603+0000","last_became_active":"2024-09-17T05:30:06.327401+0000","last_became_peered":"2024-09-17T05:30:06.327401+0000","last_unstale":"2024-09-17T05:30:07.983603+0000","last_undegraded":"2024-09-17T05:30:07.983603+0000","last_fullsized":"2024-09-17T05:30:07.983603+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:02.179760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.303592+0000","last_change":"2024-09-17T05:30:05.311818+0000","last_active":"2024-09-17T05:30:07.303592+0000","last_peered":"2024-09-17T05:30:07.303592+0000","last_clean":"2024-09-17T05:30:07.303592+0000","last_became_active":"2024-09-17T05:30:05.311531+0000","last_became_peered":"2024-09-17T05:30:05.311531+0000","last_unstale":"2024-09-17T05:30:07.303592+0000","last_undegraded":"2024-09-17T05:30:07.303592+0000","last_fullsized":"2024-09-17T05:30:07.303592+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:20.595118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.303692+0000","last_change":"2024-09-17T05:30:06.325494+0000","last_active":"2024-09-17T05:30:07.303692+0000","last_peered":"2024-09-17T05:30:07.303692+0000","last_clean":"2024-09-17T05:30:07.303692+0000","last_became_active":"2024-09-17T05:30:06.325221+0000","last_became_peered":"2024-09-17T05:30:06.325221+0000","last_unstale":"2024-09-17T05:30:07.303692+0000","last_undegraded":"2024-09-17T05:30:07.303692+0000","last_fullsized":"2024-09-17T05:30:07.303692+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:26.520589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983801+0000","last_change":"2024-09-17T05:30:05.322973+0000","last_active":"2024-09-17T05:30:07.983801+0000","last_peered":"2024-09-17T05:30:07.983801+0000","last_clean":"2024-09-17T05:30:07.983801+0000","last_became_active":"2024-09-17T05:30:05.322630+0000","last_became_peered":"2024-09-17T05:30:05.322630+0000","last_unstale":"2024-09-17T05:30:07.983801+0000","last_undegraded":"2024-09-17T05:30:07.983801+0000","last_fullsized":"2024-09-17T05:30:07.983801+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:33.104861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306449+0000","last_change":"2024-09-17T05:30:06.320760+0000","last_active":"2024-09-17T05:30:07.306449+0000","last_peered":"2024-09-17T05:30:07.306449+0000","last_clean":"2024-09-17T05:30:07.306449+0000","last_became_active":"2024-09-17T05:30:06.320555+0000","last_became_peered":"2024-09-17T05:30:06.320555+0000","last_unstale":"2024-09-17T05:30:07.306449+0000","last_undegraded":"2024-09-17T05:30:07.306449+0000","last_fullsized":"2024-09-17T05:30:07.306449+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:32.703154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981003+0000","last_change":"2024-09-17T05:30:05.304552+0000","last_active":"2024-09-17T05:30:07.981003+0000","last_peered":"2024-09-17T05:30:07.981003+0000","last_clean":"2024-09-17T05:30:07.981003+0000","last_became_active":"2024-09-17T05:30:05.304231+0000","last_became_peered":"2024-09-17T05:30:05.304231+0000","last_unstale":"2024-09-17T05:30:07.981003+0000","last_undegraded":"2024-09-17T05:30:07.981003+0000","last_fullsized":"2024-09-17T05:30:07.981003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:08:34.042249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980259+0000","last_change":"2024-09-17T05:30:06.325560+0000","last_active":"2024-09-17T05:30:07.980259+0000","last_peered":"2024-09-17T05:30:07.980259+0000","last_clean":"2024-09-17T05:30:07.980259+0000","last_became_active":"2024-09-17T05:30:06.325277+0000","last_became_peered":"2024-09-17T05:30:06.325277+0000","last_unstale":"2024-09-17T05:30:07.980259+0000","last_undegraded":"2024-09-17T05:30:07.980259+0000","last_fullsized":"2024-09-17T05:30:07.980259+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:55.897303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306504+0000","last_change":"2024-09-17T05:30:05.317320+0000","last_active":"2024-09-17T05:30:07.306504+0000","last_peered":"2024-09-17T05:30:07.306504+0000","last_clean":"2024-09-17T05:30:07.306504+0000","last_became_active":"2024-09-17T05:30:05.316339+0000","last_became_peered":"2024-09-17T05:30:05.316339+0000","last_unstale":"2024-09-17T05:30:07.306504+0000","last_undegraded":"2024-09-17T05:30:07.306504+0000","last_fullsized":"2024-09-17T05:30:07.306504+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:11.751995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979944+0000","last_change":"2024-09-17T05:30:06.316204+0000","last_active":"2024-09-17T05:30:07.979944+0000","last_peered":"2024-09-17T05:30:07.979944+0000","last_clean":"2024-09-17T05:30:07.979944+0000","last_became_active":"2024-09-17T05:30:06.315889+0000","last_became_peered":"2024-09-17T05:30:06.315889+0000","last_unstale":"2024-09-17T05:30:07.979944+0000","last_undegraded":"2024-09-17T05:30:07.979944+0000","last_fullsized":"2024-09-17T05:30:07.979944+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:11:29.366814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983052+0000","last_change":"2024-09-17T05:30:05.310665+0000","last_active":"2024-09-17T05:30:07.983052+0000","last_peered":"2024-09-17T05:30:07.983052+0000","last_clean":"2024-09-17T05:30:07.983052+0000","last_became_active":"2024-09-17T05:30:05.310386+0000","last_became_peered":"2024-09-17T05:30:05.310386+0000","last_unstale":"2024-09-17T05:30:07.983052+0000","last_undegraded":"2024-09-17T05:30:07.983052+0000","last_fullsized":"2024-09-17T05:30:07.983052+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:59:05.244402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975208+0000","last_change":"2024-09-17T05:30:06.324092+0000","last_active":"2024-09-17T05:30:07.975208+0000","last_peered":"2024-09-17T05:30:07.975208+0000","last_clean":"2024-09-17T05:30:07.975208+0000","last_became_active":"2024-09-17T05:30:06.323729+0000","last_became_peered":"2024-09-17T05:30:06.323729+0000","last_unstale":"2024-09-17T05:30:07.975208+0000","last_undegraded":"2024-09-17T05:30:07.975208+0000","last_fullsized":"2024-09-17T05:30:07.975208+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:00.306496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979862+0000","last_change":"2024-09-17T05:30:05.320099+0000","last_active":"2024-09-17T05:30:07.979862+0000","last_peered":"2024-09-17T05:30:07.979862+0000","last_clean":"2024-09-17T05:30:07.979862+0000","last_became_active":"2024-09-17T05:30:05.319784+0000","last_became_peered":"2024-09-17T05:30:05.319784+0000","last_unstale":"2024-09-17T05:30:07.979862+0000","last_undegraded":"2024-09-17T05:30:07.979862+0000","last_fullsized":"2024-09-17T05:30:07.979862+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:45.978034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306898+0000","last_change":"2024-09-17T05:30:06.325993+0000","last_active":"2024-09-17T05:30:07.306898+0000","last_peered":"2024-09-17T05:30:07.306898+0000","last_clean":"2024-09-17T05:30:07.306898+0000","last_became_active":"2024-09-17T05:30:06.325740+0000","last_became_peered":"2024-09-17T05:30:06.325740+0000","last_unstale":"2024-09-17T05:30:07.306898+0000","last_undegraded":"2024-09-17T05:30:07.306898+0000","last_fullsized":"2024-09-17T05:30:07.306898+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:09.458221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306985+0000","last_change":"2024-09-17T05:30:05.317752+0000","last_active":"2024-09-17T05:30:07.306985+0000","last_peered":"2024-09-17T05:30:07.306985+0000","last_clean":"2024-09-17T05:30:07.306985+0000","last_became_active":"2024-09-17T05:30:05.317390+0000","last_became_peered":"2024-09-17T05:30:05.317390+0000","last_unstale":"2024-09-17T05:30:07.306985+0000","last_undegraded":"2024-09-17T05:30:07.306985+0000","last_fullsized":"2024-09-17T05:30:07.306985+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:41.174482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.984020+0000","last_change":"2024-09-17T05:30:06.318563+0000","last_active":"2024-09-17T05:30:07.984020+0000","last_peered":"2024-09-17T05:30:07.984020+0000","last_clean":"2024-09-17T05:30:07.984020+0000","last_became_active":"2024-09-17T05:30:06.318311+0000","last_became_peered":"2024-09-17T05:30:06.318311+0000","last_unstale":"2024-09-17T05:30:07.984020+0000","last_undegraded":"2024-09-17T05:30:07.984020+0000","last_fullsized":"2024-09-17T05:30:07.984020+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:46.303739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981364+0000","last_change":"2024-09-17T05:30:05.319325+0000","last_active":"2024-09-17T05:30:07.981364+0000","last_peered":"2024-09-17T05:30:07.981364+0000","last_clean":"2024-09-17T05:30:07.981364+0000","last_became_active":"2024-09-17T05:30:05.319073+0000","last_became_peered":"2024-09-17T05:30:05.319073+0000","last_unstale":"2024-09-17T05:30:07.981364+0000","last_undegraded":"2024-09-17T05:30:07.981364+0000","last_fullsized":"2024-09-17T05:30:07.981364+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:42.469849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981729+0000","last_change":"2024-09-17T05:30:06.328855+0000","last_active":"2024-09-17T05:30:07.981729+0000","last_peered":"2024-09-17T05:30:07.981729+0000","last_clean":"2024-09-17T05:30:07.981729+0000","last_became_active":"2024-09-17T05:30:06.327889+0000","last_became_peered":"2024-09-17T05:30:06.327889+0000","last_unstale":"2024-09-17T05:30:07.981729+0000","last_undegraded":"2024-09-17T05:30:07.981729+0000","last_fullsized":"2024-09-17T05:30:07.981729+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:21:32.790498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.984049+0000","last_change":"2024-09-17T05:30:05.325847+0000","last_active":"2024-09-17T05:30:07.984049+0000","last_peered":"2024-09-17T05:30:07.984049+0000","last_clean":"2024-09-17T05:30:07.984049+0000","last_became_active":"2024-09-17T05:30:05.325555+0000","last_became_peered":"2024-09-17T05:30:05.325555+0000","last_unstale":"2024-09-17T05:30:07.984049+0000","last_undegraded":"2024-09-17T05:30:07.984049+0000","last_fullsized":"2024-09-17T05:30:07.984049+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:50.483684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983999+0000","last_change":"2024-09-17T05:30:06.340675+0000","last_active":"2024-09-17T05:30:07.983999+0000","last_peered":"2024-09-17T05:30:07.983999+0000","last_clean":"2024-09-17T05:30:07.983999+0000","last_became_active":"2024-09-17T05:30:06.340429+0000","last_became_peered":"2024-09-17T05:30:06.340429+0000","last_unstale":"2024-09-17T05:30:07.983999+0000","last_undegraded":"2024-09-17T05:30:07.983999+0000","last_fullsized":"2024-09-17T05:30:07.983999+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:10.151279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300482+0000","last_change":"2024-09-17T05:30:05.319324+0000","last_active":"2024-09-17T05:30:07.300482+0000","last_peered":"2024-09-17T05:30:07.300482+0000","last_clean":"2024-09-17T05:30:07.300482+0000","last_became_active":"2024-09-17T05:30:05.319027+0000","last_became_peered":"2024-09-17T05:30:05.319027+0000","last_unstale":"2024-09-17T05:30:07.300482+0000","last_undegraded":"2024-09-17T05:30:07.300482+0000","last_fullsized":"2024-09-17T05:30:07.300482+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:17.785457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975385+0000","last_change":"2024-09-17T05:30:06.320266+0000","last_active":"2024-09-17T05:30:07.975385+0000","last_peered":"2024-09-17T05:30:07.975385+0000","last_clean":"2024-09-17T05:30:07.975385+0000","last_became_active":"2024-09-17T05:30:06.319980+0000","last_became_peered":"2024-09-17T05:30:06.319980+0000","last_unstale":"2024-09-17T05:30:07.975385+0000","last_undegraded":"2024-09-17T05:30:07.975385+0000","last_fullsized":"2024-09-17T05:30:07.975385+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:41.689813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981119+0000","last_change":"2024-09-17T05:30:05.317446+0000","last_active":"2024-09-17T05:30:07.981119+0000","last_peered":"2024-09-17T05:30:07.981119+0000","last_clean":"2024-09-17T05:30:07.981119+0000","last_became_active":"2024-09-17T05:30:05.317157+0000","last_became_peered":"2024-09-17T05:30:05.317157+0000","last_unstale":"2024-09-17T05:30:07.981119+0000","last_undegraded":"2024-09-17T05:30:07.981119+0000","last_fullsized":"2024-09-17T05:30:07.981119+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:48.813550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980759+0000","last_change":"2024-09-17T05:30:06.335728+0000","last_active":"2024-09-17T05:30:07.980759+0000","last_peered":"2024-09-17T05:30:07.980759+0000","last_clean":"2024-09-17T05:30:07.980759+0000","last_became_active":"2024-09-17T05:30:06.335019+0000","last_became_peered":"2024-09-17T05:30:06.335019+0000","last_unstale":"2024-09-17T05:30:07.980759+0000","last_undegraded":"2024-09-17T05:30:07.980759+0000","last_fullsized":"2024-09-17T05:30:07.980759+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:46.123430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983634+0000","last_change":"2024-09-17T05:30:05.319744+0000","last_active":"2024-09-17T05:30:07.983634+0000","last_peered":"2024-09-17T05:30:07.983634+0000","last_clean":"2024-09-17T05:30:07.983634+0000","last_became_active":"2024-09-17T05:30:05.319478+0000","last_became_peered":"2024-09-17T05:30:05.319478+0000","last_unstale":"2024-09-17T05:30:07.983634+0000","last_undegraded":"2024-09-17T05:30:07.983634+0000","last_fullsized":"2024-09-17T05:30:07.983634+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:29.060749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980018+0000","last_change":"2024-09-17T05:30:06.322896+0000","last_active":"2024-09-17T05:30:07.980018+0000","last_peered":"2024-09-17T05:30:07.980018+0000","last_clean":"2024-09-17T05:30:07.980018+0000","last_became_active":"2024-09-17T05:30:06.322165+0000","last_became_peered":"2024-09-17T05:30:06.322165+0000","last_unstale":"2024-09-17T05:30:07.980018+0000","last_undegraded":"2024-09-17T05:30:07.980018+0000","last_fullsized":"2024-09-17T05:30:07.980018+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:32:31.155570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980611+0000","last_change":"2024-09-17T05:30:05.322669+0000","last_active":"2024-09-17T05:30:07.980611+0000","last_peered":"2024-09-17T05:30:07.980611+0000","last_clean":"2024-09-17T05:30:07.980611+0000","last_became_active":"2024-09-17T05:30:05.321429+0000","last_became_peered":"2024-09-17T05:30:05.321429+0000","last_unstale":"2024-09-17T05:30:07.980611+0000","last_undegraded":"2024-09-17T05:30:07.980611+0000","last_fullsized":"2024-09-17T05:30:07.980611+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:14.517825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983709+0000","last_change":"2024-09-17T05:30:06.323916+0000","last_active":"2024-09-17T05:30:07.983709+0000","last_peered":"2024-09-17T05:30:07.983709+0000","last_clean":"2024-09-17T05:30:07.983709+0000","last_became_active":"2024-09-17T05:30:06.323648+0000","last_became_peered":"2024-09-17T05:30:06.323648+0000","last_unstale":"2024-09-17T05:30:07.983709+0000","last_undegraded":"2024-09-17T05:30:07.983709+0000","last_fullsized":"2024-09-17T05:30:07.983709+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:14.523342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":23,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979984+0000","last_change":"2024-09-17T05:30:05.325941+0000","last_active":"2024-09-17T05:30:07.979984+0000","last_peered":"2024-09-17T05:30:07.979984+0000","last_clean":"2024-09-17T05:30:07.979984+0000","last_became_active":"2024-09-17T05:30:05.325555+0000","last_became_peered":"2024-09-17T05:30:05.325555+0000","last_unstale":"2024-09-17T05:30:07.979984+0000","last_undegraded":"2024-09-17T05:30:07.979984+0000","last_fullsized":"2024-09-17T05:30:07.979984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:53.248264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300481+0000","last_change":"2024-09-17T05:30:06.310721+0000","last_active":"2024-09-17T05:30:07.300481+0000","last_peered":"2024-09-17T05:30:07.300481+0000","last_clean":"2024-09-17T05:30:07.300481+0000","last_became_active":"2024-09-17T05:30:06.310439+0000","last_became_peered":"2024-09-17T05:30:06.310439+0000","last_unstale":"2024-09-17T05:30:07.300481+0000","last_undegraded":"2024-09-17T05:30:07.300481+0000","last_fullsized":"2024-09-17T05:30:07.300481+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:01.164644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300253+0000","last_change":"2024-09-17T05:30:05.325974+0000","last_active":"2024-09-17T05:30:07.300253+0000","last_peered":"2024-09-17T05:30:07.300253+0000","last_clean":"2024-09-17T05:30:07.300253+0000","last_became_active":"2024-09-17T05:30:05.325587+0000","last_became_peered":"2024-09-17T05:30:05.325587+0000","last_unstale":"2024-09-17T05:30:07.300253+0000","last_undegraded":"2024-09-17T05:30:07.300253+0000","last_fullsized":"2024-09-17T05:30:07.300253+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:22.080200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981411+0000","last_change":"2024-09-17T05:30:06.324125+0000","last_active":"2024-09-17T05:30:07.981411+0000","last_peered":"2024-09-17T05:30:07.981411+0000","last_clean":"2024-09-17T05:30:07.981411+0000","last_became_active":"2024-09-17T05:30:06.323889+0000","last_became_peered":"2024-09-17T05:30:06.323889+0000","last_unstale":"2024-09-17T05:30:07.981411+0000","last_undegraded":"2024-09-17T05:30:07.981411+0000","last_fullsized":"2024-09-17T05:30:07.981411+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:02.179760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306975+0000","last_change":"2024-09-17T05:30:05.318534+0000","last_active":"2024-09-17T05:30:07.306975+0000","last_peered":"2024-09-17T05:30:07.306975+0000","last_clean":"2024-09-17T05:30:07.306975+0000","last_became_active":"2024-09-17T05:30:05.318295+0000","last_became_peered":"2024-09-17T05:30:05.318295+0000","last_unstale":"2024-09-17T05:30:07.306975+0000","last_undegraded":"2024-09-17T05:30:07.306975+0000","last_fullsized":"2024-09-17T05:30:07.306975+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:56.087814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975580+0000","last_change":"2024-09-17T05:30:06.331809+0000","last_active":"2024-09-17T05:30:07.975580+0000","last_peered":"2024-09-17T05:30:07.975580+0000","last_clean":"2024-09-17T05:30:07.975580+0000","last_became_active":"2024-09-17T05:30:06.331496+0000","last_became_peered":"2024-09-17T05:30:06.331496+0000","last_unstale":"2024-09-17T05:30:07.975580+0000","last_undegraded":"2024-09-17T05:30:07.975580+0000","last_fullsized":"2024-09-17T05:30:07.975580+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:47.169886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983072+0000","last_change":"2024-09-17T05:30:05.317351+0000","last_active":"2024-09-17T05:30:07.983072+0000","last_peered":"2024-09-17T05:30:07.983072+0000","last_clean":"2024-09-17T05:30:07.983072+0000","last_became_active":"2024-09-17T05:30:05.315615+0000","last_became_peered":"2024-09-17T05:30:05.315615+0000","last_unstale":"2024-09-17T05:30:07.983072+0000","last_undegraded":"2024-09-17T05:30:07.983072+0000","last_fullsized":"2024-09-17T05:30:07.983072+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:20.670899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975864+0000","last_change":"2024-09-17T05:30:06.323503+0000","last_active":"2024-09-17T05:30:07.975864+0000","last_peered":"2024-09-17T05:30:07.975864+0000","last_clean":"2024-09-17T05:30:07.975864+0000","last_became_active":"2024-09-17T05:30:06.323215+0000","last_became_peered":"2024-09-17T05:30:06.323215+0000","last_unstale":"2024-09-17T05:30:07.975864+0000","last_undegraded":"2024-09-17T05:30:07.975864+0000","last_fullsized":"2024-09-17T05:30:07.975864+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:59.484368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981563+0000","last_change":"2024-09-17T05:30:05.321166+0000","last_active":"2024-09-17T05:30:07.981563+0000","last_peered":"2024-09-17T05:30:07.981563+0000","last_clean":"2024-09-17T05:30:07.981563+0000","last_became_active":"2024-09-17T05:30:05.320876+0000","last_became_peered":"2024-09-17T05:30:05.320876+0000","last_unstale":"2024-09-17T05:30:07.981563+0000","last_undegraded":"2024-09-17T05:30:07.981563+0000","last_fullsized":"2024-09-17T05:30:07.981563+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:06.806797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980877+0000","last_change":"2024-09-17T05:30:06.331593+0000","last_active":"2024-09-17T05:30:07.980877+0000","last_peered":"2024-09-17T05:30:07.980877+0000","last_clean":"2024-09-17T05:30:07.980877+0000","last_became_active":"2024-09-17T05:30:06.328034+0000","last_became_peered":"2024-09-17T05:30:06.328034+0000","last_unstale":"2024-09-17T05:30:07.980877+0000","last_undegraded":"2024-09-17T05:30:07.980877+0000","last_fullsized":"2024-09-17T05:30:07.980877+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:51.251941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981285+0000","last_change":"2024-09-17T05:30:05.304880+0000","last_active":"2024-09-17T05:30:07.981285+0000","last_peered":"2024-09-17T05:30:07.981285+0000","last_clean":"2024-09-17T05:30:07.981285+0000","last_became_active":"2024-09-17T05:30:05.304284+0000","last_became_peered":"2024-09-17T05:30:05.304284+0000","last_unstale":"2024-09-17T05:30:07.981285+0000","last_undegraded":"2024-09-17T05:30:07.981285+0000","last_fullsized":"2024-09-17T05:30:07.981285+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:48.792196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.303380+0000","last_change":"2024-09-17T05:30:06.336975+0000","last_active":"2024-09-17T05:30:07.303380+0000","last_peered":"2024-09-17T05:30:07.303380+0000","last_clean":"2024-09-17T05:30:07.303380+0000","last_became_active":"2024-09-17T05:30:06.336526+0000","last_became_peered":"2024-09-17T05:30:06.336526+0000","last_unstale":"2024-09-17T05:30:07.303380+0000","last_undegraded":"2024-09-17T05:30:07.303380+0000","last_fullsized":"2024-09-17T05:30:07.303380+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:29.608158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.982840+0000","last_change":"2024-09-17T05:30:05.319225+0000","last_active":"2024-09-17T05:30:07.982840+0000","last_peered":"2024-09-17T05:30:07.982840+0000","last_clean":"2024-09-17T05:30:07.982840+0000","last_became_active":"2024-09-17T05:30:05.318757+0000","last_became_peered":"2024-09-17T05:30:05.318757+0000","last_unstale":"2024-09-17T05:30:07.982840+0000","last_undegraded":"2024-09-17T05:30:07.982840+0000","last_fullsized":"2024-09-17T05:30:07.982840+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:28.145122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.300066+0000","last_change":"2024-09-17T05:30:06.311407+0000","last_active":"2024-09-17T05:30:07.300066+0000","last_peered":"2024-09-17T05:30:07.300066+0000","last_clean":"2024-09-17T05:30:07.300066+0000","last_became_active":"2024-09-17T05:30:06.311072+0000","last_became_peered":"2024-09-17T05:30:06.311072+0000","last_unstale":"2024-09-17T05:30:07.300066+0000","last_undegraded":"2024-09-17T05:30:07.300066+0000","last_fullsized":"2024-09-17T05:30:07.300066+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:13.587884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979805+0000","last_change":"2024-09-17T05:30:05.322027+0000","last_active":"2024-09-17T05:30:07.979805+0000","last_peered":"2024-09-17T05:30:07.979805+0000","last_clean":"2024-09-17T05:30:07.979805+0000","last_became_active":"2024-09-17T05:30:05.321704+0000","last_became_peered":"2024-09-17T05:30:05.321704+0000","last_unstale":"2024-09-17T05:30:07.979805+0000","last_undegraded":"2024-09-17T05:30:07.979805+0000","last_fullsized":"2024-09-17T05:30:07.979805+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:15.832365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.979830+0000","last_change":"2024-09-17T05:30:06.340286+0000","last_active":"2024-09-17T05:30:07.979830+0000","last_peered":"2024-09-17T05:30:07.979830+0000","last_clean":"2024-09-17T05:30:07.979830+0000","last_became_active":"2024-09-17T05:30:06.340000+0000","last_became_peered":"2024-09-17T05:30:06.340000+0000","last_unstale":"2024-09-17T05:30:07.979830+0000","last_undegraded":"2024-09-17T05:30:07.979830+0000","last_fullsized":"2024-09-17T05:30:07.979830+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:54.770556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983295+0000","last_change":"2024-09-17T05:30:05.315124+0000","last_active":"2024-09-17T05:30:07.983295+0000","last_peered":"2024-09-17T05:30:07.983295+0000","last_clean":"2024-09-17T05:30:07.983295+0000","last_became_active":"2024-09-17T05:30:05.314810+0000","last_became_peered":"2024-09-17T05:30:05.314810+0000","last_unstale":"2024-09-17T05:30:07.983295+0000","last_undegraded":"2024-09-17T05:30:07.983295+0000","last_fullsized":"2024-09-17T05:30:07.983295+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:23.210611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.975736+0000","last_change":"2024-09-17T05:30:06.320245+0000","last_active":"2024-09-17T05:30:07.975736+0000","last_peered":"2024-09-17T05:30:07.975736+0000","last_clean":"2024-09-17T05:30:07.975736+0000","last_became_active":"2024-09-17T05:30:06.319945+0000","last_became_peered":"2024-09-17T05:30:06.319945+0000","last_unstale":"2024-09-17T05:30:07.975736+0000","last_undegraded":"2024-09-17T05:30:07.975736+0000","last_fullsized":"2024-09-17T05:30:07.975736+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:37.456433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981138+0000","last_change":"2024-09-17T05:30:05.316670+0000","last_active":"2024-09-17T05:30:07.981138+0000","last_peered":"2024-09-17T05:30:07.981138+0000","last_clean":"2024-09-17T05:30:07.981138+0000","last_became_active":"2024-09-17T05:30:05.316423+0000","last_became_peered":"2024-09-17T05:30:05.316423+0000","last_unstale":"2024-09-17T05:30:07.981138+0000","last_undegraded":"2024-09-17T05:30:07.981138+0000","last_fullsized":"2024-09-17T05:30:07.981138+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:46.803998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980666+0000","last_change":"2024-09-17T05:30:06.332073+0000","last_active":"2024-09-17T05:30:07.980666+0000","last_peered":"2024-09-17T05:30:07.980666+0000","last_clean":"2024-09-17T05:30:07.980666+0000","last_became_active":"2024-09-17T05:30:06.331396+0000","last_became_peered":"2024-09-17T05:30:06.331396+0000","last_unstale":"2024-09-17T05:30:07.980666+0000","last_undegraded":"2024-09-17T05:30:07.980666+0000","last_fullsized":"2024-09-17T05:30:07.980666+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:18.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.984087+0000","last_change":"2024-09-17T05:30:05.319860+0000","last_active":"2024-09-17T05:30:07.984087+0000","last_peered":"2024-09-17T05:30:07.984087+0000","last_clean":"2024-09-17T05:30:07.984087+0000","last_became_active":"2024-09-17T05:30:05.319572+0000","last_became_peered":"2024-09-17T05:30:05.319572+0000","last_unstale":"2024-09-17T05:30:07.984087+0000","last_undegraded":"2024-09-17T05:30:07.984087+0000","last_fullsized":"2024-09-17T05:30:07.984087+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:06.333614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.984046+0000","last_change":"2024-09-17T05:30:06.330620+0000","last_active":"2024-09-17T05:30:07.984046+0000","last_peered":"2024-09-17T05:30:07.984046+0000","last_clean":"2024-09-17T05:30:07.984046+0000","last_became_active":"2024-09-17T05:30:06.330347+0000","last_became_peered":"2024-09-17T05:30:06.330347+0000","last_unstale":"2024-09-17T05:30:07.984046+0000","last_undegraded":"2024-09-17T05:30:07.984046+0000","last_fullsized":"2024-09-17T05:30:07.984046+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:48.623576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.303283+0000","last_change":"2024-09-17T05:30:05.318218+0000","last_active":"2024-09-17T05:30:07.303283+0000","last_peered":"2024-09-17T05:30:07.303283+0000","last_clean":"2024-09-17T05:30:07.303283+0000","last_became_active":"2024-09-17T05:30:05.317928+0000","last_became_peered":"2024-09-17T05:30:05.317928+0000","last_unstale":"2024-09-17T05:30:07.303283+0000","last_undegraded":"2024-09-17T05:30:07.303283+0000","last_fullsized":"2024-09-17T05:30:07.303283+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:11.904095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981066+0000","last_change":"2024-09-17T05:30:06.338495+0000","last_active":"2024-09-17T05:30:07.981066+0000","last_peered":"2024-09-17T05:30:07.981066+0000","last_clean":"2024-09-17T05:30:07.981066+0000","last_became_active":"2024-09-17T05:30:06.338093+0000","last_became_peered":"2024-09-17T05:30:06.338093+0000","last_unstale":"2024-09-17T05:30:07.981066+0000","last_undegraded":"2024-09-17T05:30:07.981066+0000","last_fullsized":"2024-09-17T05:30:07.981066+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:48.159252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983902+0000","last_change":"2024-09-17T05:30:05.320765+0000","last_active":"2024-09-17T05:30:07.983902+0000","last_peered":"2024-09-17T05:30:07.983902+0000","last_clean":"2024-09-17T05:30:07.983902+0000","last_became_active":"2024-09-17T05:30:05.320465+0000","last_became_peered":"2024-09-17T05:30:05.320465+0000","last_unstale":"2024-09-17T05:30:07.983902+0000","last_undegraded":"2024-09-17T05:30:07.983902+0000","last_fullsized":"2024-09-17T05:30:07.983902+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:39.171928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981466+0000","last_change":"2024-09-17T05:30:06.334369+0000","last_active":"2024-09-17T05:30:07.981466+0000","last_peered":"2024-09-17T05:30:07.981466+0000","last_clean":"2024-09-17T05:30:07.981466+0000","last_became_active":"2024-09-17T05:30:06.333791+0000","last_became_peered":"2024-09-17T05:30:06.333791+0000","last_unstale":"2024-09-17T05:30:07.981466+0000","last_undegraded":"2024-09-17T05:30:07.981466+0000","last_fullsized":"2024-09-17T05:30:07.981466+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:52.860356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306543+0000","last_change":"2024-09-17T05:30:05.322511+0000","last_active":"2024-09-17T05:30:07.306543+0000","last_peered":"2024-09-17T05:30:07.306543+0000","last_clean":"2024-09-17T05:30:07.306543+0000","last_became_active":"2024-09-17T05:30:05.321575+0000","last_became_peered":"2024-09-17T05:30:05.321575+0000","last_unstale":"2024-09-17T05:30:07.306543+0000","last_undegraded":"2024-09-17T05:30:07.306543+0000","last_fullsized":"2024-09-17T05:30:07.306543+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:20.595118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983039+0000","last_change":"2024-09-17T05:30:06.318509+0000","last_active":"2024-09-17T05:30:07.983039+0000","last_peered":"2024-09-17T05:30:07.983039+0000","last_clean":"2024-09-17T05:30:07.983039+0000","last_became_active":"2024-09-17T05:30:06.318104+0000","last_became_peered":"2024-09-17T05:30:06.318104+0000","last_unstale":"2024-09-17T05:30:07.983039+0000","last_undegraded":"2024-09-17T05:30:07.983039+0000","last_fullsized":"2024-09-17T05:30:07.983039+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:18.776876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.303176+0000","last_change":"2024-09-17T05:30:05.321359+0000","last_active":"2024-09-17T05:30:07.303176+0000","last_peered":"2024-09-17T05:30:07.303176+0000","last_clean":"2024-09-17T05:30:07.303176+0000","last_became_active":"2024-09-17T05:30:05.321017+0000","last_became_peered":"2024-09-17T05:30:05.321017+0000","last_unstale":"2024-09-17T05:30:07.303176+0000","last_undegraded":"2024-09-17T05:30:07.303176+0000","last_fullsized":"2024-09-17T05:30:07.303176+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:49.729060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.306816+0000","last_change":"2024-09-17T05:30:06.324838+0000","last_active":"2024-09-17T05:30:07.306816+0000","last_peered":"2024-09-17T05:30:07.306816+0000","last_clean":"2024-09-17T05:30:07.306816+0000","last_became_active":"2024-09-17T05:30:06.324511+0000","last_became_peered":"2024-09-17T05:30:06.324511+0000","last_unstale":"2024-09-17T05:30:07.306816+0000","last_undegraded":"2024-09-17T05:30:07.306816+0000","last_fullsized":"2024-09-17T05:30:07.306816+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:07.818014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.980103+0000","last_change":"2024-09-17T05:30:05.317797+0000","last_active":"2024-09-17T05:30:07.980103+0000","last_peered":"2024-09-17T05:30:07.980103+0000","last_clean":"2024-09-17T05:30:07.980103+0000","last_became_active":"2024-09-17T05:30:05.317453+0000","last_became_peered":"2024-09-17T05:30:05.317453+0000","last_unstale":"2024-09-17T05:30:07.980103+0000","last_undegraded":"2024-09-17T05:30:07.980103+0000","last_fullsized":"2024-09-17T05:30:07.980103+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:56.157479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.981257+0000","last_change":"2024-09-17T05:30:06.340137+0000","last_active":"2024-09-17T05:30:07.981257+0000","last_peered":"2024-09-17T05:30:07.981257+0000","last_clean":"2024-09-17T05:30:07.981257+0000","last_became_active":"2024-09-17T05:30:06.335162+0000","last_became_peered":"2024-09-17T05:30:06.335162+0000","last_unstale":"2024-09-17T05:30:07.981257+0000","last_undegraded":"2024-09-17T05:30:07.981257+0000","last_fullsized":"2024-09-17T05:30:07.981257+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:05.283221+0000","last_clean_scrub_stamp":"2024-09-17T05:30:05.283221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:15.759144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983535+0000","last_change":"2024-09-17T05:30:05.319479+0000","last_active":"2024-09-17T05:30:07.983535+0000","last_peered":"2024-09-17T05:30:07.983535+0000","last_clean":"2024-09-17T05:30:07.983535+0000","last_became_active":"2024-09-17T05:30:05.319190+0000","last_became_peered":"2024-09-17T05:30:05.319190+0000","last_unstale":"2024-09-17T05:30:07.983535+0000","last_undegraded":"2024-09-17T05:30:07.983535+0000","last_fullsized":"2024-09-17T05:30:07.983535+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:30:04.272004+0000","last_clean_scrub_stamp":"2024-09-17T05:30:04.272004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:53.759339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":153,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:30:07.983297+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:30:07.983297+0000","last_peered":"2024-09-17T05:30:07.983297+0000","last_clean":"2024-09-17T05:30:07.983297+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:30:07.983297+0000","last_undegraded":"2024-09-17T05:30:07.983297+0000","last_fullsized":"2024-09-17T05:30:07.983297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1105920,"data_stored":794344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":516096,"data_stored":204558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509464,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":520192,"data_stored":205498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":520192,"data_stored":204524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":524288,"data_stored":205520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":512000,"data_stored":203956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542167,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":203956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1105920,"data_stored":794288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:30:15.487 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:30:15.487 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:30:15.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.676+0000 7f4eb1c00640 1 -- 172.21.15.31:0/2736210422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4eac15f340 msgr2=0x7f4eac0b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:15.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.676+0000 7f4eb1c00640 1 --2- 172.21.15.31:0/2736210422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4eac15f340 0x7f4eac0b34a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4eac073ef0 tx=0x7f4e9c01c890 comp rx=0 tx=0).stop 2024-09-17T05:30:15.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.676+0000 7f4eb1c00640 1 -- 172.21.15.31:0/2736210422 shutdown_connections 2024-09-17T05:30:15.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.676+0000 7f4eb1c00640 1 --2- 172.21.15.31:0/2736210422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eac0ccf10 0x7f4eac0cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:15.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.676+0000 7f4eb1c00640 1 --2- 172.21.15.31:0/2736210422 >> v2:172.21.15.155:3300/0 conn(0x7f4eac0b2a00 0x7f4eac0b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:15.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.676+0000 7f4eb1c00640 1 --2- 172.21.15.31:0/2736210422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4eac15f340 0x7f4eac0b34a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:15.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.676+0000 7f4eb1c00640 1 -- 172.21.15.31:0/2736210422 >> 172.21.15.31:0/2736210422 conn(0x7f4eac0d1e00 msgr2=0x7f4eac0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:15.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.676+0000 7f4eb1c00640 1 -- 172.21.15.31:0/2736210422 shutdown_connections 2024-09-17T05:30:15.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.676+0000 7f4eb1c00640 1 -- 172.21.15.31:0/2736210422 wait complete. 2024-09-17T05:30:15.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.676+0000 7f4eb1c00640 1 Processor -- start 2024-09-17T05:30:15.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.676+0000 7f4eb1c00640 1 -- start start 2024-09-17T05:30:15.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.676+0000 7f4eb1c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eac0b2a00 0x7f4eac157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:15.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.676+0000 7f4eb1c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4eac0ccf10 0x7f4eac0ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:15.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.676+0000 7f4eb1c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eac15f340 0x7f4eac15ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:15.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.676+0000 7f4eb1c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac0b1a20 con 0x7f4eac0ccf10 2024-09-17T05:30:15.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.676+0000 7f4eb1c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac0b18a0 con 0x7f4eac0b2a00 2024-09-17T05:30:15.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.676+0000 7f4eb1c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4eac0b1ba0 con 0x7f4eac15f340 2024-09-17T05:30:15.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.680+0000 7f4ea3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4eac0ccf10 0x7f4eac0ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:15.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.680+0000 7f4eaaa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eac0b2a00 0x7f4eac157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:15.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.680+0000 7f4ea3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4eac0ccf10 0x7f4eac0ca650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45068/0 (socket says 172.21.15.31:45068) 2024-09-17T05:30:15.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.680+0000 7f4ea3e00640 1 -- 172.21.15.31:0/2111083660 learned_addr learned my addr 172.21.15.31:0/2111083660 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:15.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.680+0000 7f4eab400640 1 --2- 172.21.15.31:0/2111083660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eac15f340 0x7f4eac15ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:15.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.680+0000 7f4ea3e00640 1 -- 172.21.15.31:0/2111083660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eac15f340 msgr2=0x7f4eac15ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:15.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.680+0000 7f4ea3e00640 1 --2- 172.21.15.31:0/2111083660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eac15f340 0x7f4eac15ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:15.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.680+0000 7f4ea3e00640 1 -- 172.21.15.31:0/2111083660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eac0b2a00 msgr2=0x7f4eac157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:15.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.680+0000 7f4ea3e00640 1 --2- 172.21.15.31:0/2111083660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eac0b2a00 0x7f4eac157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:15.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.680+0000 7f4ea3e00640 1 -- 172.21.15.31:0/2111083660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eac158730 con 0x7f4eac0ccf10 2024-09-17T05:30:15.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.680+0000 7f4ea3e00640 1 --2- 172.21.15.31:0/2111083660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4eac0ccf10 0x7f4eac0ca650 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4e9400d770 tx=0x7f4e9400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:15.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.680+0000 7f4ea2a00640 1 -- 172.21.15.31:0/2111083660 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e94017070 con 0x7f4eac0ccf10 2024-09-17T05:30:15.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.680+0000 7f4ea2a00640 1 -- 172.21.15.31:0/2111083660 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e94009d20 con 0x7f4eac0ccf10 2024-09-17T05:30:15.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.680+0000 7f4eb1c00640 1 -- 172.21.15.31:0/2111083660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eac158a10 con 0x7f4eac0ccf10 2024-09-17T05:30:15.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.680+0000 7f4ea2a00640 1 -- 172.21.15.31:0/2111083660 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e940106c0 con 0x7f4eac0ccf10 2024-09-17T05:30:15.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.680+0000 7f4eb1c00640 1 -- 172.21.15.31:0/2111083660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eac158cf0 con 0x7f4eac0ccf10 2024-09-17T05:30:15.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.680+0000 7f4eb1c00640 1 -- 172.21.15.31:0/2111083660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eac0cd380 con 0x7f4eac0ccf10 2024-09-17T05:30:15.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.680+0000 7f4ea2a00640 1 -- 172.21.15.31:0/2111083660 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f4e9401a070 con 0x7f4eac0ccf10 2024-09-17T05:30:15.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.684+0000 7f4ea2a00640 1 --2- 172.21.15.31:0/2111083660 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4e880733b0 0x7f4e88075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:15.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.684+0000 7f4ea2a00640 1 -- 172.21.15.31:0/2111083660 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f4e94094690 con 0x7f4eac0ccf10 2024-09-17T05:30:15.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.684+0000 7f4eaaa00640 1 --2- 172.21.15.31:0/2111083660 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4e880733b0 0x7f4e88075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:15.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.684+0000 7f4eaaa00640 1 --2- 172.21.15.31:0/2111083660 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4e880733b0 0x7f4e88075870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0af000 tx=0x7f4e9c0a7040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:15.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.688+0000 7f4ea2a00640 1 -- 172.21.15.31:0/2111083660 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4e9405ee00 con 0x7f4eac0ccf10 2024-09-17T05:30:15.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.928+0000 7f4eb1c00640 1 -- 172.21.15.31:0/2111083660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f4eac0725e0 con 0x7f4eac0ccf10 2024-09-17T05:30:15.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.928+0000 7f4ea2a00640 1 -- 172.21.15.31:0/2111083660 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f4e94063830 con 0x7f4eac0ccf10 2024-09-17T05:30:15.935 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-09-17T05:30:15.936 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw== 2024-09-17T05:30:15.936 INFO:teuthology.orchestra.run.smithi031.stdout: caps mds = "allow" 2024-09-17T05:30:15.936 INFO:teuthology.orchestra.run.smithi031.stdout: caps mon = "allow r" 2024-09-17T05:30:15.936 INFO:teuthology.orchestra.run.smithi031.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:30:15.936 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2024-09-17T05:30:15.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.932+0000 7f4eb1c00640 1 -- 172.21.15.31:0/2111083660 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4e880733b0 msgr2=0x7f4e88075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:15.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.932+0000 7f4eb1c00640 1 --2- 172.21.15.31:0/2111083660 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4e880733b0 0x7f4e88075870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0af000 tx=0x7f4e9c0a7040 comp rx=0 tx=0).stop 2024-09-17T05:30:15.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.932+0000 7f4eb1c00640 1 -- 172.21.15.31:0/2111083660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4eac0ccf10 msgr2=0x7f4eac0ca650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:15.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.932+0000 7f4eb1c00640 1 --2- 172.21.15.31:0/2111083660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4eac0ccf10 0x7f4eac0ca650 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4e9400d770 tx=0x7f4e9400dc30 comp rx=0 tx=0).stop 2024-09-17T05:30:15.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.932+0000 7f4eb1c00640 1 -- 172.21.15.31:0/2111083660 shutdown_connections 2024-09-17T05:30:15.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.932+0000 7f4eb1c00640 1 --2- 172.21.15.31:0/2111083660 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4e880733b0 0x7f4e88075870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:15.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.932+0000 7f4eb1c00640 1 --2- 172.21.15.31:0/2111083660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4eac15f340 0x7f4eac15ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:15.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.932+0000 7f4eb1c00640 1 --2- 172.21.15.31:0/2111083660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4eac0ccf10 0x7f4eac0ca650 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:15.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.932+0000 7f4eb1c00640 1 --2- 172.21.15.31:0/2111083660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4eac0b2a00 0x7f4eac157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:15.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.932+0000 7f4eb1c00640 1 -- 172.21.15.31:0/2111083660 >> 172.21.15.31:0/2111083660 conn(0x7f4eac0d1e00 msgr2=0x7f4eac0b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:15.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.932+0000 7f4eb1c00640 1 -- 172.21.15.31:0/2111083660 shutdown_connections 2024-09-17T05:30:15.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:15.932+0000 7f4eb1c00640 1 -- 172.21.15.31:0/2111083660 wait complete. 2024-09-17T05:30:15.957 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:30:16.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f1a00400640 1 -- 172.21.15.31:0/388202906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f8072c90 msgr2=0x7f19f80730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:16.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f1a00400640 1 --2- 172.21.15.31:0/388202906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f8072c90 0x7f19f80730e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009c80 tx=0x7f19f001f560 comp rx=0 tx=0).stop 2024-09-17T05:30:16.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f1a00400640 1 -- 172.21.15.31:0/388202906 shutdown_connections 2024-09-17T05:30:16.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f1a00400640 1 --2- 172.21.15.31:0/388202906 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f8072c90 0x7f19f80730e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f1a00400640 1 --2- 172.21.15.31:0/388202906 >> v2:172.21.15.155:3300/0 conn(0x7f19f80af150 0x7f19f80705f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f1a00400640 1 -- 172.21.15.31:0/388202906 >> 172.21.15.31:0/388202906 conn(0x7f19f80b1c20 msgr2=0x7f19f80b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:16.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f1a00400640 1 -- 172.21.15.31:0/388202906 shutdown_connections 2024-09-17T05:30:16.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f1a00400640 1 -- 172.21.15.31:0/388202906 wait complete. 2024-09-17T05:30:16.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f1a00400640 1 Processor -- start 2024-09-17T05:30:16.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f1a00400640 1 -- start start 2024-09-17T05:30:16.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f1a00400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19f8072c90 0x7f19f80cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f1a00400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19f80af150 0x7f19f80c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f1a00400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f815e1b0 0x7f19f809cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f1a00400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f19f80ae720 con 0x7f19f815e1b0 2024-09-17T05:30:16.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f1a00400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f19f80ae5a0 con 0x7f19f8072c90 2024-09-17T05:30:16.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f1a00400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f19f80ae8a0 con 0x7f19f80af150 2024-09-17T05:30:16.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f19fe400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f815e1b0 0x7f19f809cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f19fe400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f815e1b0 0x7f19f809cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45086/0 (socket says 172.21.15.31:45086) 2024-09-17T05:30:16.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f19fe400640 1 -- 172.21.15.31:0/2763175128 learned_addr learned my addr 172.21.15.31:0/2763175128 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:16.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f19fda00640 1 --2- 172.21.15.31:0/2763175128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19f8072c90 0x7f19f80cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.100+0000 7f19fd000640 1 --2- 172.21.15.31:0/2763175128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19f80af150 0x7f19f80c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.104+0000 7f19fe400640 1 -- 172.21.15.31:0/2763175128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19f80af150 msgr2=0x7f19f80c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:16.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.104+0000 7f19fe400640 1 --2- 172.21.15.31:0/2763175128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19f80af150 0x7f19f80c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.104+0000 7f19fe400640 1 -- 172.21.15.31:0/2763175128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19f8072c90 msgr2=0x7f19f80cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:16.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.104+0000 7f19fe400640 1 --2- 172.21.15.31:0/2763175128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19f8072c90 0x7f19f80cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.104+0000 7f19fe400640 1 -- 172.21.15.31:0/2763175128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f80c9b10 con 0x7f19f815e1b0 2024-09-17T05:30:16.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.104+0000 7f19fe400640 1 --2- 172.21.15.31:0/2763175128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f815e1b0 0x7f19f809cc80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009bd0 tx=0x7f19f0009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:16.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.104+0000 7f19f5600640 1 -- 172.21.15.31:0/2763175128 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f00b5070 con 0x7f19f815e1b0 2024-09-17T05:30:16.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.104+0000 7f19f5600640 1 -- 172.21.15.31:0/2763175128 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19f00b6040 con 0x7f19f815e1b0 2024-09-17T05:30:16.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.104+0000 7f19f5600640 1 -- 172.21.15.31:0/2763175128 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f0004e60 con 0x7f19f815e1b0 2024-09-17T05:30:16.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.104+0000 7f1a00400640 1 -- 172.21.15.31:0/2763175128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f80c9df0 con 0x7f19f815e1b0 2024-09-17T05:30:16.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.104+0000 7f1a00400640 1 -- 172.21.15.31:0/2763175128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f815b800 con 0x7f19f815e1b0 2024-09-17T05:30:16.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.104+0000 7f1a00400640 1 -- 172.21.15.31:0/2763175128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f80aed50 con 0x7f19f815e1b0 2024-09-17T05:30:16.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.104+0000 7f19f5600640 1 -- 172.21.15.31:0/2763175128 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f19f00b0b10 con 0x7f19f815e1b0 2024-09-17T05:30:16.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.108+0000 7f19f5600640 1 --2- 172.21.15.31:0/2763175128 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f19d80733b0 0x7f19d8075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.108+0000 7f19f5600640 1 -- 172.21.15.31:0/2763175128 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f19f0132c60 con 0x7f19f815e1b0 2024-09-17T05:30:16.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.108+0000 7f19fda00640 1 --2- 172.21.15.31:0/2763175128 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f19d80733b0 0x7f19d8075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.108+0000 7f19fda00640 1 --2- 172.21.15.31:0/2763175128 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f19d80733b0 0x7f19d8075870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f19ec007fd0 tx=0x7f19ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:16.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.108+0000 7f19f5600640 1 -- 172.21.15.31:0/2763175128 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f19f00c8020 con 0x7f19f815e1b0 2024-09-17T05:30:16.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.320+0000 7f1a00400640 1 -- 172.21.15.31:0/2763175128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19f80b5200 con 0x7f19f815e1b0 2024-09-17T05:30:16.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.320+0000 7f19f5600640 1 -- 172.21.15.31:0/2763175128 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5223 (secure 0 0 0) 0x7f19f00190c0 con 0x7f19f815e1b0 2024-09-17T05:30:16.327 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:16.327 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":28,"btime":"2024-09-17T05:30:09:329600+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:30:16.328 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 28 2024-09-17T05:30:16.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.324+0000 7f1a00400640 1 -- 172.21.15.31:0/2763175128 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f19d80733b0 msgr2=0x7f19d8075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:16.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.324+0000 7f1a00400640 1 --2- 172.21.15.31:0/2763175128 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f19d80733b0 0x7f19d8075870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f19ec007fd0 tx=0x7f19ec009040 comp rx=0 tx=0).stop 2024-09-17T05:30:16.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.324+0000 7f1a00400640 1 -- 172.21.15.31:0/2763175128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f815e1b0 msgr2=0x7f19f809cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:16.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.324+0000 7f1a00400640 1 --2- 172.21.15.31:0/2763175128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f815e1b0 0x7f19f809cc80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009bd0 tx=0x7f19f0009370 comp rx=0 tx=0).stop 2024-09-17T05:30:16.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.324+0000 7f1a00400640 1 -- 172.21.15.31:0/2763175128 shutdown_connections 2024-09-17T05:30:16.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.324+0000 7f1a00400640 1 --2- 172.21.15.31:0/2763175128 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f19d80733b0 0x7f19d8075870 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.324+0000 7f1a00400640 1 --2- 172.21.15.31:0/2763175128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19f815e1b0 0x7f19f809cc80 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.324+0000 7f1a00400640 1 --2- 172.21.15.31:0/2763175128 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19f80af150 0x7f19f80c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.324+0000 7f1a00400640 1 --2- 172.21.15.31:0/2763175128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19f8072c90 0x7f19f80cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.324+0000 7f1a00400640 1 -- 172.21.15.31:0/2763175128 >> 172.21.15.31:0/2763175128 conn(0x7f19f80b1c20 msgr2=0x7f19f80b2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:16.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.324+0000 7f1a00400640 1 -- 172.21.15.31:0/2763175128 shutdown_connections 2024-09-17T05:30:16.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.324+0000 7f1a00400640 1 -- 172.21.15.31:0/2763175128 wait complete. 2024-09-17T05:30:16.753 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:30:05.719854+0000', 'modified': '2024-09-17T05:30:08.738854+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5295}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5295': {'gid': 5295, 'name': 'a', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6835/561523453', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6833', 'nonce': 561523453}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 561523453}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5295, 'qdb_cluster': [5295]} 2024-09-17T05:30:16.753 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:30:16.754 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T05:30:16.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.900+0000 7f0b85c00640 1 -- 172.21.15.31:0/3230567379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b800cf4e0 msgr2=0x7f0b800cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:16.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.900+0000 7f0b85c00640 1 --2- 172.21.15.31:0/3230567379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b800cf4e0 0x7f0b800cd950 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0b78009bc0 tx=0x7f0b7801ca80 comp rx=0 tx=0).stop 2024-09-17T05:30:16.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.900+0000 7f0b85c00640 1 -- 172.21.15.31:0/3230567379 shutdown_connections 2024-09-17T05:30:16.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.900+0000 7f0b85c00640 1 --2- 172.21.15.31:0/3230567379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b800cf4e0 0x7f0b800cd950 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.900+0000 7f0b85c00640 1 --2- 172.21.15.31:0/3230567379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b8015bd50 0x7f0b800ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.900+0000 7f0b85c00640 1 -- 172.21.15.31:0/3230567379 >> 172.21.15.31:0/3230567379 conn(0x7f0b800d1ea0 msgr2=0x7f0b800d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:16.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.900+0000 7f0b85c00640 1 -- 172.21.15.31:0/3230567379 shutdown_connections 2024-09-17T05:30:16.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.900+0000 7f0b85c00640 1 -- 172.21.15.31:0/3230567379 wait complete. 2024-09-17T05:30:16.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.900+0000 7f0b85c00640 1 Processor -- start 2024-09-17T05:30:16.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.900+0000 7f0b85c00640 1 -- start start 2024-09-17T05:30:16.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b85c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b800cf4e0 0x7f0b800b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b85c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b8015bd50 0x7f0b8014fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b85c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b8015c130 0x7f0b80159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b85c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0b80168e50 con 0x7f0b8015bd50 2024-09-17T05:30:16.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b85c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0b80168cd0 con 0x7f0b8015c130 2024-09-17T05:30:16.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b85c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0b80168fd0 con 0x7f0b800cf4e0 2024-09-17T05:30:16.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b77e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b8015bd50 0x7f0b8014fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b77e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b8015bd50 0x7f0b8014fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45100/0 (socket says 172.21.15.31:45100) 2024-09-17T05:30:16.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b77e00640 1 -- 172.21.15.31:0/2656902080 learned_addr learned my addr 172.21.15.31:0/2656902080 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:16.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b7ea00640 1 --2- 172.21.15.31:0/2656902080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b800cf4e0 0x7f0b800b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b7f400640 1 --2- 172.21.15.31:0/2656902080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b8015c130 0x7f0b80159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b77e00640 1 -- 172.21.15.31:0/2656902080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b800cf4e0 msgr2=0x7f0b800b4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:16.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b77e00640 1 --2- 172.21.15.31:0/2656902080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b800cf4e0 0x7f0b800b4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b77e00640 1 -- 172.21.15.31:0/2656902080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b8015c130 msgr2=0x7f0b80159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:16.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b77e00640 1 --2- 172.21.15.31:0/2656902080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b8015c130 0x7f0b80159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b77e00640 1 -- 172.21.15.31:0/2656902080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b800c9010 con 0x7f0b8015bd50 2024-09-17T05:30:16.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b77e00640 1 --2- 172.21.15.31:0/2656902080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b8015bd50 0x7f0b8014fd10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800c430 tx=0x7f0b6800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:16.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b76a00640 1 -- 172.21.15.31:0/2656902080 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68011790 con 0x7f0b8015bd50 2024-09-17T05:30:16.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b76a00640 1 -- 172.21.15.31:0/2656902080 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b68017070 con 0x7f0b8015bd50 2024-09-17T05:30:16.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b85c00640 1 -- 172.21.15.31:0/2656902080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b800c92b0 con 0x7f0b8015bd50 2024-09-17T05:30:16.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b76a00640 1 -- 172.21.15.31:0/2656902080 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68011ce0 con 0x7f0b8015bd50 2024-09-17T05:30:16.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.904+0000 7f0b85c00640 1 -- 172.21.15.31:0/2656902080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b800c9870 con 0x7f0b8015bd50 2024-09-17T05:30:16.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b76a00640 1 -- 172.21.15.31:0/2656902080 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f0b6801c460 con 0x7f0b8015bd50 2024-09-17T05:30:16.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b76a00640 1 --2- 172.21.15.31:0/2656902080 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0b5c0733e0 0x7f0b5c0758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b88f82000 1 Processor -- start 2024-09-17T05:30:16.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b76a00640 1 -- 172.21.15.31:0/2656902080 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f0b68094370 con 0x7f0b8015bd50 2024-09-17T05:30:16.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b88f82000 1 -- start start 2024-09-17T05:30:16.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b7ea00640 1 --2- 172.21.15.31:0/2656902080 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0b5c0733e0 0x7f0b5c0758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b88f82000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb939d0 0x55f00fb93db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b7ea00640 1 --2- 172.21.15.31:0/2656902080 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0b5c0733e0 0x7f0b5c0758a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009600 tx=0x7f0b700091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:16.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b88f82000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb942f0 0x55f00fb478d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b88f82000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb47e10 0x55f00fb481f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b88f82000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f00fa683f0 con 0x55f00fb939d0 2024-09-17T05:30:16.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b88f82000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f00f9a5b20 con 0x55f00fb47e10 2024-09-17T05:30:16.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b88f82000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55f00f994f50 con 0x55f00fb942f0 2024-09-17T05:30:16.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b7ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb939d0 0x55f00fb93db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b7ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb939d0 0x55f00fb93db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45106/0 (socket says 172.21.15.31:45106) 2024-09-17T05:30:16.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b7ea00640 1 -- 172.21.15.31:0/2792805954 learned_addr learned my addr 172.21.15.31:0/2792805954 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:16.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b77e00640 1 --2- 172.21.15.31:0/2792805954 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb942f0 0x55f00fb478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b7f400640 1 --2- 172.21.15.31:0/2792805954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb47e10 0x55f00fb481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b7ea00640 1 -- 172.21.15.31:0/2792805954 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb942f0 msgr2=0x55f00fb478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:30:16.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b7ea00640 1 --2- 172.21.15.31:0/2792805954 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb942f0 0x55f00fb478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b7ea00640 1 -- 172.21.15.31:0/2792805954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb47e10 msgr2=0x55f00fb481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:30:16.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b7ea00640 1 --2- 172.21.15.31:0/2792805954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb47e10 0x55f00fb481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b7ea00640 1 -- 172.21.15.31:0/2792805954 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f00f95c590 con 0x55f00fb939d0 2024-09-17T05:30:16.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.908+0000 7f0b7ea00640 1 --2- 172.21.15.31:0/2792805954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb939d0 0x55f00fb93db0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000e600 tx=0x7f0b70014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbaf53bb388a9888 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:16.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b6f400640 1 -- 172.21.15.31:0/2792805954 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70004020 con 0x55f00fb939d0 2024-09-17T05:30:16.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b6f400640 1 -- 172.21.15.31:0/2792805954 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b700042b0 con 0x55f00fb939d0 2024-09-17T05:30:16.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b6f400640 1 -- 172.21.15.31:0/2792805954 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70003800 con 0x55f00fb939d0 2024-09-17T05:30:16.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b88f82000 1 -- 172.21.15.31:0/2792805954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb939d0 msgr2=0x55f00fb93db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:16.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2792805954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb939d0 0x55f00fb93db0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000e600 tx=0x7f0b70014000 comp rx=0 tx=0).stop 2024-09-17T05:30:16.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b88f82000 1 -- 172.21.15.31:0/2792805954 shutdown_connections 2024-09-17T05:30:16.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2792805954 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb47e10 0x55f00fb481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2792805954 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb942f0 0x55f00fb478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2792805954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb939d0 0x55f00fb93db0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b88f82000 1 -- 172.21.15.31:0/2792805954 >> 172.21.15.31:0/2792805954 conn(0x55f00fa31130 msgr2=0x55f00fb76e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:16.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b88f82000 1 -- 172.21.15.31:0/2792805954 shutdown_connections 2024-09-17T05:30:16.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b88f82000 1 -- 172.21.15.31:0/2792805954 wait complete. 2024-09-17T05:30:16.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b88f82000 1 -- start start 2024-09-17T05:30:16.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b88f82000 1 Processor -- start 2024-09-17T05:30:16.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b88f82000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb47e10 0x55f00fb746a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b88f82000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb939d0 0x55f00fb74e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b88f82000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb942f0 0x55f00fb753b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b88f82000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f00f92f5d0 con 0x55f00fb47e10 2024-09-17T05:30:16.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b88f82000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f00f998d60 con 0x55f00fb942f0 2024-09-17T05:30:16.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b88f82000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55f00f93b500 con 0x55f00fb939d0 2024-09-17T05:30:16.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b88f82000 10 client.0 _ll_register_callbacks cb 0x55f00f93f810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:30:16.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b7ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb47e10 0x55f00fb746a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b7ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb47e10 0x55f00fb746a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45114/0 (socket says 172.21.15.31:45114) 2024-09-17T05:30:16.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b7ea00640 1 -- 172.21.15.31:0/2409267565 learned_addr learned my addr 172.21.15.31:0/2409267565 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:16.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b77e00640 1 --2- 172.21.15.31:0/2409267565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb939d0 0x55f00fb74e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b7f400640 1 --2- 172.21.15.31:0/2409267565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb942f0 0x55f00fb753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b7ea00640 1 -- 172.21.15.31:0/2409267565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb939d0 msgr2=0x55f00fb74e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:30:16.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b7ea00640 1 --2- 172.21.15.31:0/2409267565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb939d0 0x55f00fb74e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b7ea00640 1 -- 172.21.15.31:0/2409267565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb942f0 msgr2=0x55f00fb753b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:30:16.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b7ea00640 1 --2- 172.21.15.31:0/2409267565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb942f0 0x55f00fb753b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b7ea00640 1 -- 172.21.15.31:0/2409267565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f00f933170 con 0x55f00fb47e10 2024-09-17T05:30:16.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b77e00640 1 --2- 172.21.15.31:0/2409267565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb939d0 0x55f00fb74e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:30:16.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b7ea00640 1 --2- 172.21.15.31:0/2409267565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb47e10 0x55f00fb746a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000eac0 tx=0x7f0b7000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e8796b0d558109 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:16.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.912+0000 7f0b63e00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:30:16.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b63e00640 1 -- 172.21.15.31:0/2409267565 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70035060 con 0x55f00fb47e10 2024-09-17T05:30:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 1 -- 172.21.15.31:0/2409267565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f00f92d0f0 con 0x55f00fb47e10 2024-09-17T05:30:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b63e00640 1 -- 172.21.15.31:0/2409267565 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f0b70004450 con 0x55f00fb47e10 2024-09-17T05:30:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b63e00640 1 -- 172.21.15.31:0/2409267565 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0b7003b050 con 0x55f00fb47e10 2024-09-17T05:30:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 10 client.5451 fetch_fsmap learned FSMap version 28 2024-09-17T05:30:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 1 -- 172.21.15.31:0/2409267565 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x55f00fa19ef0 con 0x55f00fb47e10 2024-09-17T05:30:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b63e00640 1 -- 172.21.15.31:0/2409267565 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f00f92d0f0 con 0x55f00fb47e10 2024-09-17T05:30:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b63e00640 1 -- 172.21.15.31:0/2409267565 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f0b7003e020 con 0x55f00fb47e10 2024-09-17T05:30:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 10 client.5451 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T05:30:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 10 client.5451 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:30:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 20 client.5451 populate_metadata read hostname 'smithi031' 2024-09-17T05:30:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2409267565 >> [v2:172.21.15.31:6833/561523453,v1:172.21.15.31:6835/561523453] conn(0x55f00fb760f0 0x55f00fba5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 4 client.5451 mds_command: new command op to 5295 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:30:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 1 -- 172.21.15.31:0/2409267565 --> [v2:172.21.15.31:6833/561523453,v1:172.21.15.31:6835/561523453] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f00f9a7a70 con 0x55f00fb760f0 2024-09-17T05:30:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b77e00640 1 --2- 172.21.15.31:0/2409267565 >> [v2:172.21.15.31:6833/561523453,v1:172.21.15.31:6835/561523453] conn(0x55f00fb760f0 0x55f00fba5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b77e00640 1 --2- 172.21.15.31:0/2409267565 >> [v2:172.21.15.31:6833/561523453,v1:172.21.15.31:6835/561523453] conn(0x55f00fb760f0 0x55f00fba5c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efd7275f6d5b0842 server_cookie=e6e340b907d3e47 in_seq=0 out_seq=0 2024-09-17T05:30:16.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b63e00640 10 client.5451 ms_handle_connect on v2:172.21.15.31:6833/561523453 2024-09-17T05:30:16.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b63e00640 1 -- 172.21.15.31:0/2409267565 <== mds.0 v2:172.21.15.31:6833/561523453 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f00f9a7a70 con 0x55f00fb760f0 2024-09-17T05:30:16.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b63e00640 10 client.5451 handle_command_reply: tid=0 2024-09-17T05:30:16.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 1 client.5451 shutdown 2024-09-17T05:30:16.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 1 -- 172.21.15.31:0/2409267565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb47e10 msgr2=0x55f00fb746a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:16.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2409267565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb47e10 0x55f00fb746a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000eac0 tx=0x7f0b7000ed30 comp rx=0 tx=0).stop 2024-09-17T05:30:16.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 1 -- 172.21.15.31:0/2409267565 shutdown_connections 2024-09-17T05:30:16.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2409267565 >> [v2:172.21.15.31:6833/561523453,v1:172.21.15.31:6835/561523453] conn(0x55f00fb760f0 0x55f00fba5c90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2409267565 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb942f0 0x55f00fb753b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2409267565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb939d0 0x55f00fb74e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2409267565 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb47e10 0x55f00fb746a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b63e00640 0 client.5451 ms_handle_reset on v2:172.21.15.31:6833/561523453 2024-09-17T05:30:16.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 1 -- 172.21.15.31:0/2409267565 >> 172.21.15.31:0/2409267565 conn(0x55f00fa31130 msgr2=0x55f00fb46fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:16.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 1 -- 172.21.15.31:0/2409267565 shutdown_connections 2024-09-17T05:30:16.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 1 -- 172.21.15.31:0/2409267565 wait complete. 2024-09-17T05:30:16.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.916+0000 7f0b88f82000 20 client.5451 trim_cache size 0 max 16384 2024-09-17T05:30:16.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b88f82000 1 Processor -- start 2024-09-17T05:30:16.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b88f82000 1 -- start start 2024-09-17T05:30:16.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b88f82000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb47e10 0x55f00fc05bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b88f82000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb939d0 0x55f00fc06100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b88f82000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb942f0 0x55f00fc06640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b88f82000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0b80203eb0 con 0x55f00fb942f0 2024-09-17T05:30:16.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b88f82000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0b80202ed0 con 0x55f00fb939d0 2024-09-17T05:30:16.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b88f82000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0b80159350 con 0x55f00fb47e10 2024-09-17T05:30:16.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b7f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb942f0 0x55f00fc06640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b7f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb942f0 0x55f00fc06640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45128/0 (socket says 172.21.15.31:45128) 2024-09-17T05:30:16.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b7f400640 1 -- 172.21.15.31:0/2565507485 learned_addr learned my addr 172.21.15.31:0/2565507485 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:16.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b7ea00640 1 --2- 172.21.15.31:0/2565507485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb47e10 0x55f00fc05bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b77e00640 1 --2- 172.21.15.31:0/2565507485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb939d0 0x55f00fc06100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b7f400640 1 -- 172.21.15.31:0/2565507485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb47e10 msgr2=0x55f00fc05bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:30:16.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b7f400640 1 --2- 172.21.15.31:0/2565507485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb47e10 0x55f00fc05bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b7f400640 1 -- 172.21.15.31:0/2565507485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb939d0 msgr2=0x55f00fc06100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:30:16.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b7f400640 1 --2- 172.21.15.31:0/2565507485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb939d0 0x55f00fc06100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b7f400640 1 -- 172.21.15.31:0/2565507485 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f00f9f0d90 con 0x55f00fb942f0 2024-09-17T05:30:16.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b7f400640 1 --2- 172.21.15.31:0/2565507485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb942f0 0x55f00fc06640 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0b78009bc0 tx=0x7f0b78019820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b65819f5cae818c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:16.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b6ea00640 1 -- 172.21.15.31:0/2565507485 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b780b2040 con 0x55f00fb942f0 2024-09-17T05:30:16.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b6ea00640 1 -- 172.21.15.31:0/2565507485 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b78004a50 con 0x55f00fb942f0 2024-09-17T05:30:16.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.936+0000 7f0b6ea00640 1 -- 172.21.15.31:0/2565507485 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b78004e20 con 0x55f00fb942f0 2024-09-17T05:30:16.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 1 -- 172.21.15.31:0/2565507485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb942f0 msgr2=0x55f00fc06640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:16.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2565507485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb942f0 0x55f00fc06640 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0b78009bc0 tx=0x7f0b78019820 comp rx=0 tx=0).stop 2024-09-17T05:30:16.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 1 -- 172.21.15.31:0/2565507485 shutdown_connections 2024-09-17T05:30:16.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2565507485 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb942f0 0x55f00fc06640 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2565507485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb939d0 0x55f00fc06100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2565507485 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb47e10 0x55f00fc05bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 1 -- 172.21.15.31:0/2565507485 >> 172.21.15.31:0/2565507485 conn(0x55f00fa31130 msgr2=0x55f00fb4fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:16.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 1 -- 172.21.15.31:0/2565507485 shutdown_connections 2024-09-17T05:30:16.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 1 -- 172.21.15.31:0/2565507485 wait complete. 2024-09-17T05:30:16.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 1 -- start start 2024-09-17T05:30:16.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 1 Processor -- start 2024-09-17T05:30:16.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb47e10 0x55f00fc097e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb939d0 0x55f00fc09d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb942f0 0x55f00fc0a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f00f960ec0 con 0x55f00fb942f0 2024-09-17T05:30:16.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f00f99d390 con 0x55f00fb939d0 2024-09-17T05:30:16.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55f00fa54730 con 0x55f00fb47e10 2024-09-17T05:30:16.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 10 client.0 _ll_register_callbacks cb 0x7f0b64003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:30:16.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b7f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb942f0 0x55f00fc0a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b7f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb942f0 0x55f00fc0a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45142/0 (socket says 172.21.15.31:45142) 2024-09-17T05:30:16.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b7f400640 1 -- 172.21.15.31:0/2665330344 learned_addr learned my addr 172.21.15.31:0/2665330344 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:16.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b7ea00640 1 --2- 172.21.15.31:0/2665330344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb47e10 0x55f00fc097e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b7f400640 1 -- 172.21.15.31:0/2665330344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb47e10 msgr2=0x55f00fc097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:30:16.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b7f400640 1 --2- 172.21.15.31:0/2665330344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb47e10 0x55f00fc097e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b7f400640 1 -- 172.21.15.31:0/2665330344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb939d0 msgr2=0x55f00fc09d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:30:16.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b7f400640 1 --2- 172.21.15.31:0/2665330344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb939d0 0x55f00fc09d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b7f400640 1 -- 172.21.15.31:0/2665330344 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f00f95ba90 con 0x55f00fb942f0 2024-09-17T05:30:16.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b7f400640 1 --2- 172.21.15.31:0/2665330344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb942f0 0x55f00fc0a260 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0b7801a6b0 tx=0x7f0b78005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78a9c0abbee29c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:16.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b63e00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:30:16.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b63e00640 1 -- 172.21.15.31:0/2665330344 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b780c7070 con 0x55f00fb942f0 2024-09-17T05:30:16.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b88f82000 1 -- 172.21.15.31:0/2665330344 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b78004a50 con 0x55f00fb942f0 2024-09-17T05:30:16.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.940+0000 7f0b63e00640 1 -- 172.21.15.31:0/2665330344 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f0b78003980 con 0x55f00fb942f0 2024-09-17T05:30:16.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b63e00640 1 -- 172.21.15.31:0/2665330344 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0b780d2050 con 0x55f00fb942f0 2024-09-17T05:30:16.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 10 client.5457 fetch_fsmap learned FSMap version 28 2024-09-17T05:30:16.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 1 -- 172.21.15.31:0/2665330344 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x55f00f93a050 con 0x55f00fb942f0 2024-09-17T05:30:16.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b63e00640 1 -- 172.21.15.31:0/2665330344 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b78004a50 con 0x55f00fb942f0 2024-09-17T05:30:16.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b63e00640 1 -- 172.21.15.31:0/2665330344 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7f0b780d5020 con 0x55f00fb942f0 2024-09-17T05:30:16.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 10 client.5457 fetch_fsmap finished waiting for FSMap version 28 2024-09-17T05:30:16.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 10 client.5457 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:30:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 20 client.5457 populate_metadata read hostname 'smithi031' 2024-09-17T05:30:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2665330344 >> [v2:172.21.15.31:6833/561523453,v1:172.21.15.31:6835/561523453] conn(0x55f00fba8390 0x55f00fba8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 4 client.5457 mds_command: new command op to 5295 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:30:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 1 -- 172.21.15.31:0/2665330344 --> [v2:172.21.15.31:6833/561523453,v1:172.21.15.31:6835/561523453] -- command(tid 0: {"prefix": "status"}) -- 0x55f00f9a3520 con 0x55f00fba8390 2024-09-17T05:30:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b7ea00640 1 --2- 172.21.15.31:0/2665330344 >> [v2:172.21.15.31:6833/561523453,v1:172.21.15.31:6835/561523453] conn(0x55f00fba8390 0x55f00fba8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b7ea00640 1 --2- 172.21.15.31:0/2665330344 >> [v2:172.21.15.31:6833/561523453,v1:172.21.15.31:6835/561523453] conn(0x55f00fba8390 0x55f00fba8770 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed318d786bbb53c5 server_cookie=45dd8a3d8fc8bc8a in_seq=0 out_seq=0 2024-09-17T05:30:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b63e00640 10 client.5457 ms_handle_connect on v2:172.21.15.31:6833/561523453 2024-09-17T05:30:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b63e00640 1 -- 172.21.15.31:0/2665330344 <== mds.0 v2:172.21.15.31:6833/561523453 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x55f00f9a3520 con 0x55f00fba8390 2024-09-17T05:30:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b63e00640 10 client.5457 handle_command_reply: tid=0 2024-09-17T05:30:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 1 client.5457 shutdown 2024-09-17T05:30:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 1 -- 172.21.15.31:0/2665330344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb942f0 msgr2=0x55f00fc0a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2665330344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb942f0 0x55f00fc0a260 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0b7801a6b0 tx=0x7f0b78005c70 comp rx=0 tx=0).stop 2024-09-17T05:30:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 1 -- 172.21.15.31:0/2665330344 shutdown_connections 2024-09-17T05:30:16.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2665330344 >> [v2:172.21.15.31:6833/561523453,v1:172.21.15.31:6835/561523453] conn(0x55f00fba8390 0x55f00fba8770 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2665330344 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f00fb942f0 0x55f00fc0a260 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2665330344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f00fb939d0 0x55f00fc09d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b63e00640 0 client.5457 ms_handle_reset on v2:172.21.15.31:6833/561523453 2024-09-17T05:30:16.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 1 --2- 172.21.15.31:0/2665330344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f00fb47e10 0x55f00fc097e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 1 -- 172.21.15.31:0/2665330344 >> 172.21.15.31:0/2665330344 conn(0x55f00fa31130 msgr2=0x55f00fb925b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:16.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 1 -- 172.21.15.31:0/2665330344 shutdown_connections 2024-09-17T05:30:16.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 1 -- 172.21.15.31:0/2665330344 wait complete. 2024-09-17T05:30:16.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b88f82000 20 client.5457 trim_cache size 0 max 16384 2024-09-17T05:30:16.954 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:30:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "b668cd1d-3036-4a29-9e5a-69d0df5776a8", 2024-09-17T05:30:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-17T05:30:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 5295, 2024-09-17T05:30:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-09-17T05:30:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-09-17T05:30:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-17T05:30:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 10.651766746, 2024-09-17T05:30:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 28, 2024-09-17T05:30:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 44, 2024-09-17T05:30:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 44, 2024-09-17T05:30:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 22.233593999 2024-09-17T05:30:16.954 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:30:16.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b85c00640 1 -- 172.21.15.31:0/2656902080 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0b5c0733e0 msgr2=0x7f0b5c0758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:16.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b85c00640 1 --2- 172.21.15.31:0/2656902080 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0b5c0733e0 0x7f0b5c0758a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009600 tx=0x7f0b700091e0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b85c00640 1 -- 172.21.15.31:0/2656902080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b8015bd50 msgr2=0x7f0b8014fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:16.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b85c00640 1 --2- 172.21.15.31:0/2656902080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b8015bd50 0x7f0b8014fd10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800c430 tx=0x7f0b6800c8f0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b85c00640 1 -- 172.21.15.31:0/2656902080 shutdown_connections 2024-09-17T05:30:16.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b85c00640 1 --2- 172.21.15.31:0/2656902080 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0b5c0733e0 0x7f0b5c0758a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b85c00640 1 --2- 172.21.15.31:0/2656902080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b8015c130 0x7f0b80159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b85c00640 1 --2- 172.21.15.31:0/2656902080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b8015bd50 0x7f0b8014fd10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b85c00640 1 --2- 172.21.15.31:0/2656902080 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b800cf4e0 0x7f0b800b4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:16.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b85c00640 1 -- 172.21.15.31:0/2656902080 >> 172.21.15.31:0/2656902080 conn(0x7f0b800d1ea0 msgr2=0x7f0b800c7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:16.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b85c00640 1 -- 172.21.15.31:0/2656902080 shutdown_connections 2024-09-17T05:30:16.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:16.944+0000 7f0b85c00640 1 -- 172.21.15.31:0/2656902080 wait complete. 2024-09-17T05:30:16.970 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:30:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f8349000640 1 -- 172.21.15.31:0/4134960012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8344074330 msgr2=0x7f834406f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f8349000640 1 --2- 172.21.15.31:0/4134960012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8344074330 0x7f834406f9a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f833c009c80 tx=0x7f833c01cd70 comp rx=0 tx=0).stop 2024-09-17T05:30:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f8349000640 1 -- 172.21.15.31:0/4134960012 shutdown_connections 2024-09-17T05:30:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f8349000640 1 --2- 172.21.15.31:0/4134960012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8344074330 0x7f834406f9a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f8349000640 1 --2- 172.21.15.31:0/4134960012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f834415af60 0x7f83440cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f8349000640 1 -- 172.21.15.31:0/4134960012 >> 172.21.15.31:0/4134960012 conn(0x7f83440d0c90 msgr2=0x7f83440d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f8349000640 1 -- 172.21.15.31:0/4134960012 shutdown_connections 2024-09-17T05:30:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f8349000640 1 -- 172.21.15.31:0/4134960012 wait complete. 2024-09-17T05:30:17.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f8349000640 1 Processor -- start 2024-09-17T05:30:17.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f8349000640 1 -- start start 2024-09-17T05:30:17.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f8349000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83440737c0 0x7f83440c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:17.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f8349000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8344074330 0x7f83441fb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:17.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f8349000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f834415af60 0x7f83440b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:17.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f8349000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8344167ab0 con 0x7f8344074330 2024-09-17T05:30:17.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f8349000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8344167930 con 0x7f834415af60 2024-09-17T05:30:17.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f8349000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8344167c30 con 0x7f83440737c0 2024-09-17T05:30:17.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f833be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8344074330 0x7f83441fb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:17.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f833be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8344074330 0x7f83441fb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45162/0 (socket says 172.21.15.31:45162) 2024-09-17T05:30:17.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f833be00640 1 -- 172.21.15.31:0/1165204187 learned_addr learned my addr 172.21.15.31:0/1165204187 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:17.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f8342800640 1 --2- 172.21.15.31:0/1165204187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f834415af60 0x7f83440b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:17.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.112+0000 7f8341e00640 1 --2- 172.21.15.31:0/1165204187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83440737c0 0x7f83440c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:17.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.116+0000 7f833be00640 1 -- 172.21.15.31:0/1165204187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83440737c0 msgr2=0x7f83440c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:17.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.116+0000 7f833be00640 1 --2- 172.21.15.31:0/1165204187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83440737c0 0x7f83440c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:17.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.116+0000 7f833be00640 1 -- 172.21.15.31:0/1165204187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f834415af60 msgr2=0x7f83440b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:17.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.116+0000 7f833be00640 1 --2- 172.21.15.31:0/1165204187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f834415af60 0x7f83440b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:17.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.116+0000 7f833be00640 1 -- 172.21.15.31:0/1165204187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83440b53f0 con 0x7f8344074330 2024-09-17T05:30:17.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.116+0000 7f833be00640 1 --2- 172.21.15.31:0/1165204187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8344074330 0x7f83441fb390 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f832c00c430 tx=0x7f832c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:17.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.116+0000 7f833a000640 1 -- 172.21.15.31:0/1165204187 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c017070 con 0x7f8344074330 2024-09-17T05:30:17.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.116+0000 7f833a000640 1 -- 172.21.15.31:0/1165204187 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f832c0053e0 con 0x7f8344074330 2024-09-17T05:30:17.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.116+0000 7f833a000640 1 -- 172.21.15.31:0/1165204187 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c003860 con 0x7f8344074330 2024-09-17T05:30:17.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.116+0000 7f8349000640 1 -- 172.21.15.31:0/1165204187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83440b56d0 con 0x7f8344074330 2024-09-17T05:30:17.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.116+0000 7f8349000640 1 -- 172.21.15.31:0/1165204187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83441fae70 con 0x7f8344074330 2024-09-17T05:30:17.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.116+0000 7f8349000640 1 -- 172.21.15.31:0/1165204187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f834406f9a0 con 0x7f8344074330 2024-09-17T05:30:17.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.116+0000 7f833a000640 1 -- 172.21.15.31:0/1165204187 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f832c01a070 con 0x7f8344074330 2024-09-17T05:30:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.120+0000 7f833a000640 1 --2- 172.21.15.31:0/1165204187 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f83200733b0 0x7f8320075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.120+0000 7f833a000640 1 -- 172.21.15.31:0/1165204187 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f832c0938f0 con 0x7f8344074330 2024-09-17T05:30:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.120+0000 7f8341e00640 1 --2- 172.21.15.31:0/1165204187 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f83200733b0 0x7f8320075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:17.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.120+0000 7f8341e00640 1 --2- 172.21.15.31:0/1165204187 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f83200733b0 0x7f8320075870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f833400bb50 tx=0x7f833400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:17.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.124+0000 7f833a000640 1 -- 172.21.15.31:0/1165204187 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f832c001130 con 0x7f8344074330 2024-09-17T05:30:17.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.348+0000 7f8349000640 1 -- 172.21.15.31:0/1165204187 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f83441fb040 con 0x7f8344074330 2024-09-17T05:30:17.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.348+0000 7f833a000640 1 -- 172.21.15.31:0/1165204187 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7f832c05dfd0 con 0x7f8344074330 2024-09-17T05:30:17.354 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:30:17.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.352+0000 7f8349000640 1 -- 172.21.15.31:0/1165204187 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f83200733b0 msgr2=0x7f8320075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:17.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.352+0000 7f8349000640 1 --2- 172.21.15.31:0/1165204187 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f83200733b0 0x7f8320075870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f833400bb50 tx=0x7f833400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:30:17.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.352+0000 7f8349000640 1 -- 172.21.15.31:0/1165204187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8344074330 msgr2=0x7f83441fb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:17.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.352+0000 7f8349000640 1 --2- 172.21.15.31:0/1165204187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8344074330 0x7f83441fb390 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f832c00c430 tx=0x7f832c00c8f0 comp rx=0 tx=0).stop 2024-09-17T05:30:17.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.352+0000 7f8349000640 1 -- 172.21.15.31:0/1165204187 shutdown_connections 2024-09-17T05:30:17.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.352+0000 7f8349000640 1 --2- 172.21.15.31:0/1165204187 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f83200733b0 0x7f8320075870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:17.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.352+0000 7f8349000640 1 --2- 172.21.15.31:0/1165204187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f834415af60 0x7f83440b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:17.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.352+0000 7f8349000640 1 --2- 172.21.15.31:0/1165204187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8344074330 0x7f83441fb390 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:17.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.352+0000 7f8349000640 1 --2- 172.21.15.31:0/1165204187 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f83440737c0 0x7f83440c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:17.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.352+0000 7f8349000640 1 -- 172.21.15.31:0/1165204187 >> 172.21.15.31:0/1165204187 conn(0x7f83440d0c90 msgr2=0x7f8344157b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:17.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.352+0000 7f8349000640 1 -- 172.21.15.31:0/1165204187 shutdown_connections 2024-09-17T05:30:17.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17.352+0000 7f8349000640 1 -- 172.21.15.31:0/1165204187 wait complete. 2024-09-17T05:30:17.377 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:30:17.377 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:30:17.377 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-17T05:30:17.378 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:30:17.378 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:30:17.378 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:30:17.378 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:30:17.378 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:30:17.378 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:30:17.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:30:17.379 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-17T05:30:17.390 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:30:17.390 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:30:17.390 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:30:17.390 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:30:17.390 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-17T05:30:17.390 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:30:17.391 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:30:17.391 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:30:17.391 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-17T05:30:17.391 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:30:17.391 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:30:17.391 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-17T05:30:17.391 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:30:17.392 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-17T05:30:17.392 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-17T05:30:17.392 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:30:17.392 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42335sec preferred_lft 42335sec 2024-09-17T05:30:17.392 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-17T05:30:17.392 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:30:17.393 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:30:17.393 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:30:17.393 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-17T05:30:17.393 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:30:17.393 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:fe:f3:3e:aa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:30:17.393 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:30:17.394 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:30:17.394 INFO:teuthology.orchestra.run.smithi031.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:30:17.394 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:30:17.394 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:30:17.394 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:30:17.394 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:30:17.395 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:30:17.395 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:30:17.395 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:30:17.395 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:30:17.395 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:30:17.395 INFO:teuthology.orchestra.run.smithi031.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:30:17.396 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:30:17.396 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:30:17.396 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:30:17.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:30:17.397 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:30:17.449 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-17T05:30:17.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:30:17.451 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-17T05:30:17.508 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-17T05:30:17.508 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:30:17.509 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:30:17.509 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:30:17.509 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:30:17.509 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:30:17.509 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:30:17.509 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:30:17.509 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:30:17.509 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:30:17.509 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:30:17.510 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:30:17.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:30:17.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:30:17.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:30:17.646 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T05:30:17.655 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:30:17.655 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:30:17.655 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:30:17.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:30:17.656 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-09-17T05:30:17.719 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:30:17.719 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:30:17.771 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:30:17.771 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:30:17.771 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:30:17.822 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-17T05:30:17.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:30:17.822 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:30:17.913 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:30:17.913 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:30:17.928 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:30:17.928 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:30:17.929 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:30:17.929 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:30:17.929 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:30:17.932 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:30:17.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:30:17.932 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:30:17.953 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:30:18.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:30:18.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:30:18.064 INFO:teuthology.orchestra.run.smithi031.stdout:client5350 2024-09-17T05:30:18.064 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:30:18.064 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:30:18.073 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:30:18.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.260+0000 7f2e05000640 1 -- 172.21.15.31:0/2764332796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e000ced80 msgr2=0x7f2e000ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:18.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.260+0000 7f2e05000640 1 --2- 172.21.15.31:0/2764332796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e000ced80 0x7f2e000ae9b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2de8009840 tx=0x7f2de801c820 comp rx=0 tx=0).stop 2024-09-17T05:30:18.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.260+0000 7f2e05000640 1 -- 172.21.15.31:0/2764332796 shutdown_connections 2024-09-17T05:30:18.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.260+0000 7f2e05000640 1 --2- 172.21.15.31:0/2764332796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e000ced80 0x7f2e000ae9b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:18.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.260+0000 7f2e05000640 1 -- 172.21.15.31:0/2764332796 >> 172.21.15.31:0/2764332796 conn(0x7f2e000d1dc0 msgr2=0x7f2e000d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:18.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.260+0000 7f2e05000640 1 -- 172.21.15.31:0/2764332796 shutdown_connections 2024-09-17T05:30:18.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.260+0000 7f2e05000640 1 -- 172.21.15.31:0/2764332796 wait complete. 2024-09-17T05:30:18.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.260+0000 7f2e05000640 1 Processor -- start 2024-09-17T05:30:18.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.260+0000 7f2e05000640 1 -- start start 2024-09-17T05:30:18.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2e05000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e000cdb30 0x7f2e000b5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:18.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2e05000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e000ced80 0x7f2e00153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:18.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2e05000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e0015bea0 0x7f2e00156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:18.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2e05000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0016a8a0 con 0x7f2e0015bea0 2024-09-17T05:30:18.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2e05000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0016a720 con 0x7f2e000ced80 2024-09-17T05:30:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2e05000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0016aa20 con 0x7f2e000cdb30 2024-09-17T05:30:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2dfe800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e0015bea0 0x7f2e00156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2dfe800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e0015bea0 0x7f2e00156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45178/0 (socket says 172.21.15.31:45178) 2024-09-17T05:30:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2dfe800640 1 -- 172.21.15.31:0/1474547761 learned_addr learned my addr 172.21.15.31:0/1474547761 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2df7e00640 1 --2- 172.21.15.31:0/1474547761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e000ced80 0x7f2e00153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2dfde00640 1 --2- 172.21.15.31:0/1474547761 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e000cdb30 0x7f2e000b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2dfe800640 1 -- 172.21.15.31:0/1474547761 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e000cdb30 msgr2=0x7f2e000b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2dfe800640 1 --2- 172.21.15.31:0/1474547761 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e000cdb30 0x7f2e000b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2dfe800640 1 -- 172.21.15.31:0/1474547761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e000ced80 msgr2=0x7f2e00153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2dfe800640 1 --2- 172.21.15.31:0/1474547761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e000ced80 0x7f2e00153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:18.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2dfe800640 1 -- 172.21.15.31:0/1474547761 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e000b5dc0 con 0x7f2e0015bea0 2024-09-17T05:30:18.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2dfe800640 1 --2- 172.21.15.31:0/1474547761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e0015bea0 0x7f2e00156350 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2df800cbe0 tx=0x7f2df800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:18.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2df6000640 1 -- 172.21.15.31:0/1474547761 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df8016020 con 0x7f2e0015bea0 2024-09-17T05:30:18.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2df6000640 1 -- 172.21.15.31:0/1474547761 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2df800ab40 con 0x7f2e0015bea0 2024-09-17T05:30:18.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2df6000640 1 -- 172.21.15.31:0/1474547761 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df8012420 con 0x7f2e0015bea0 2024-09-17T05:30:18.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2e05000640 1 -- 172.21.15.31:0/1474547761 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e000b6060 con 0x7f2e0015bea0 2024-09-17T05:30:18.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2e05000640 1 -- 172.21.15.31:0/1474547761 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e000b6620 con 0x7f2e0015bea0 2024-09-17T05:30:18.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.264+0000 7f2e05000640 1 -- 172.21.15.31:0/1474547761 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e000ce670 con 0x7f2e0015bea0 2024-09-17T05:30:18.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.268+0000 7f2df6000640 1 -- 172.21.15.31:0/1474547761 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f2df8019020 con 0x7f2e0015bea0 2024-09-17T05:30:18.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.268+0000 7f2df6000640 1 --2- 172.21.15.31:0/1474547761 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2ddc0733e0 0x7f2ddc0758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:18.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.268+0000 7f2df6000640 1 -- 172.21.15.31:0/1474547761 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f2df8094310 con 0x7f2e0015bea0 2024-09-17T05:30:18.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.268+0000 7f2dfde00640 1 --2- 172.21.15.31:0/1474547761 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2ddc0733e0 0x7f2ddc0758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:18.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.268+0000 7f2dfde00640 1 --2- 172.21.15.31:0/1474547761 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2ddc0733e0 0x7f2ddc0758a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2df0000c10 tx=0x7f2df0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:18.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.272+0000 7f2df6000640 1 -- 172.21.15.31:0/1474547761 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2df8020030 con 0x7f2e0015bea0 2024-09-17T05:30:18.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.484+0000 7f2e05000640 1 -- 172.21.15.31:0/1474547761 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2e0006e5f0 con 0x7f2e0015bea0 2024-09-17T05:30:18.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.484+0000 7f2df6000640 1 -- 172.21.15.31:0/1474547761 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7f2df805ea70 con 0x7f2e0015bea0 2024-09-17T05:30:18.491 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:30:18.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.488+0000 7f2e05000640 1 -- 172.21.15.31:0/1474547761 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2ddc0733e0 msgr2=0x7f2ddc0758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:18.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.488+0000 7f2e05000640 1 --2- 172.21.15.31:0/1474547761 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2ddc0733e0 0x7f2ddc0758a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2df0000c10 tx=0x7f2df0009040 comp rx=0 tx=0).stop 2024-09-17T05:30:18.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.488+0000 7f2e05000640 1 -- 172.21.15.31:0/1474547761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e0015bea0 msgr2=0x7f2e00156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:18.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.488+0000 7f2e05000640 1 --2- 172.21.15.31:0/1474547761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e0015bea0 0x7f2e00156350 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2df800cbe0 tx=0x7f2df800ccd0 comp rx=0 tx=0).stop 2024-09-17T05:30:18.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.488+0000 7f2e05000640 1 -- 172.21.15.31:0/1474547761 shutdown_connections 2024-09-17T05:30:18.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.488+0000 7f2e05000640 1 --2- 172.21.15.31:0/1474547761 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2ddc0733e0 0x7f2ddc0758a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:18.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.488+0000 7f2e05000640 1 --2- 172.21.15.31:0/1474547761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e0015bea0 0x7f2e00156350 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:18.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.488+0000 7f2e05000640 1 --2- 172.21.15.31:0/1474547761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e000ced80 0x7f2e00153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:18.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.488+0000 7f2e05000640 1 --2- 172.21.15.31:0/1474547761 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e000cdb30 0x7f2e000b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:18.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.488+0000 7f2e05000640 1 -- 172.21.15.31:0/1474547761 >> 172.21.15.31:0/1474547761 conn(0x7f2e000d1dc0 msgr2=0x7f2e0006f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:18.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.488+0000 7f2e05000640 1 -- 172.21.15.31:0/1474547761 shutdown_connections 2024-09-17T05:30:18.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:18.488+0000 7f2e05000640 1 -- 172.21.15.31:0/1474547761 wait complete. 2024-09-17T05:30:18.514 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:30:18.514 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:30:18.514 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-09-17T05:30:18.515 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:30:18.515 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:30:18.515 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:30:18.515 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:30:18.515 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:30:18.515 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:30:18.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:30:18.516 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-09-17T05:30:18.526 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:30:18.527 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:30:18.527 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:30:18.527 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:30:18.527 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-17T05:30:18.527 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:30:18.527 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:30:18.527 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:30:18.527 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-09-17T05:30:18.527 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:30:18.527 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:30:18.527 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-09-17T05:30:18.528 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:30:18.528 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-09-17T05:30:18.528 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:30:18.528 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-09-17T05:30:18.528 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-17T05:30:18.528 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42337sec preferred_lft 42337sec 2024-09-17T05:30:18.528 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-09-17T05:30:18.528 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:30:18.528 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:30:18.528 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:84:cd:fc:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:30:18.528 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:30:18.528 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:30:18.528 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:30:18.529 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:30:18.529 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:30:18.529 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:30:18.529 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:30:18.529 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:30:18.529 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:30:18.529 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:30:18.529 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:30:18.529 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:30:18.529 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:30:18.529 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:30:18.529 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:30:18.529 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:30:18.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:30:18.530 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:30:18.591 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-17T05:30:18.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:30:18.593 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-09-17T05:30:18.648 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-09-17T05:30:18.648 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:30:18.648 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-17T05:30:18.648 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:30:18.648 INFO:teuthology.orchestra.run.smithi155.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-17T05:30:18.648 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:30:18.648 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:30:18.649 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:30:18.649 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:30:18.649 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:30:18.649 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:30:18.649 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:30:18.649 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:30:18.649 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:30:18.649 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:30:18.649 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:30:18.650 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:30:18.742 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:30:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:30:18.784 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:30:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:30:18.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:30:18.792 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-17T05:30:18.800 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:30:18.800 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:30:18.801 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:30:18.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:30:18.802 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-09-17T05:30:18.863 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:30:18.863 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:30:18.915 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:30:18.916 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:30:18.916 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:30:18.968 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-17T05:30:18.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:30:18.968 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:30:19.060 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:30:19.060 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:30:19.076 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:30:19.076 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:30:19.076 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:30:19.076 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:30:19.076 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:30:19.080 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:30:19.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:30:19.080 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:30:19.099 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:30:19.190 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:30:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:30:19.193 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:30:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:30:19.200 INFO:teuthology.orchestra.run.smithi155.stdout:client5472 2024-09-17T05:30:19.200 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:30:19.201 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:30:19.211 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:30:19.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.368+0000 7f27aaa00640 1 -- 172.21.15.31:0/3090424151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a415be10 msgr2=0x7f27a40ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:19.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.368+0000 7f27aaa00640 1 --2- 172.21.15.31:0/3090424151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a415be10 0x7f27a40ce700 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f27a40746b0 tx=0x7f279401f0b0 comp rx=0 tx=0).stop 2024-09-17T05:30:19.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.368+0000 7f27aaa00640 1 -- 172.21.15.31:0/3090424151 shutdown_connections 2024-09-17T05:30:19.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.368+0000 7f27aaa00640 1 --2- 172.21.15.31:0/3090424151 >> v2:172.21.15.155:3300/0 conn(0x7f27a415c1f0 0x7f27a40cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:19.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.368+0000 7f27aaa00640 1 --2- 172.21.15.31:0/3090424151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a415be10 0x7f27a40ce700 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:19.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.368+0000 7f27aaa00640 1 -- 172.21.15.31:0/3090424151 >> 172.21.15.31:0/3090424151 conn(0x7f27a40d1da0 msgr2=0x7f27a40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:19.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.368+0000 7f27aaa00640 1 -- 172.21.15.31:0/3090424151 shutdown_connections 2024-09-17T05:30:19.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.368+0000 7f27aaa00640 1 -- 172.21.15.31:0/3090424151 wait complete. 2024-09-17T05:30:19.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27aaa00640 1 Processor -- start 2024-09-17T05:30:19.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27aaa00640 1 -- start start 2024-09-17T05:30:19.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27aaa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27a40b0b60 0x7f27a4154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:19.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27aaa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27a415be10 0x7f27a414d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:19.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27aaa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a415c1f0 0x7f27a4152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:19.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27aaa00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f27a40cf510 con 0x7f27a415c1f0 2024-09-17T05:30:19.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27aaa00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f27a40cf390 con 0x7f27a40b0b60 2024-09-17T05:30:19.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27aaa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f27a4160290 con 0x7f27a415be10 2024-09-17T05:30:19.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27a8a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a415c1f0 0x7f27a4152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:19.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27a3e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27a40b0b60 0x7f27a4154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:19.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27a3e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27a40b0b60 0x7f27a4154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:36374/0 (socket says 172.21.15.31:36374) 2024-09-17T05:30:19.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27a3e00640 1 -- 172.21.15.31:0/3821691531 learned_addr learned my addr 172.21.15.31:0/3821691531 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:19.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27a3400640 1 --2- 172.21.15.31:0/3821691531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27a415be10 0x7f27a414d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:19.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27a3400640 1 -- 172.21.15.31:0/3821691531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27a40b0b60 msgr2=0x7f27a4154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:19.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27a3400640 1 --2- 172.21.15.31:0/3821691531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27a40b0b60 0x7f27a4154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:19.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27a3400640 1 -- 172.21.15.31:0/3821691531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a415c1f0 msgr2=0x7f27a4152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:19.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27a3400640 1 --2- 172.21.15.31:0/3821691531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a415c1f0 0x7f27a4152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:19.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27a3400640 1 -- 172.21.15.31:0/3821691531 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a4153ba0 con 0x7f27a415be10 2024-09-17T05:30:19.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27a3e00640 1 --2- 172.21.15.31:0/3821691531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27a40b0b60 0x7f27a4154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:30:19.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27a8a00640 1 --2- 172.21.15.31:0/3821691531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a415c1f0 0x7f27a4152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:30:19.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.372+0000 7f27a3400640 1 --2- 172.21.15.31:0/3821691531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27a415be10 0x7f27a414d1e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f279000e6c0 tx=0x7f279000eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:19.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.376+0000 7f279be00640 1 -- 172.21.15.31:0/3821691531 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279000ca50 con 0x7f27a415be10 2024-09-17T05:30:19.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.376+0000 7f279be00640 1 -- 172.21.15.31:0/3821691531 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f279000cce0 con 0x7f27a415be10 2024-09-17T05:30:19.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.376+0000 7f279be00640 1 -- 172.21.15.31:0/3821691531 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790010690 con 0x7f27a415be10 2024-09-17T05:30:19.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.376+0000 7f27aaa00640 1 -- 172.21.15.31:0/3821691531 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a4153e80 con 0x7f27a415be10 2024-09-17T05:30:19.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.376+0000 7f27aaa00640 1 -- 172.21.15.31:0/3821691531 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a40b6130 con 0x7f27a415be10 2024-09-17T05:30:19.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.376+0000 7f27aaa00640 1 -- 172.21.15.31:0/3821691531 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27a41607b0 con 0x7f27a415be10 2024-09-17T05:30:19.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.376+0000 7f279be00640 1 -- 172.21.15.31:0/3821691531 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f2790010830 con 0x7f27a415be10 2024-09-17T05:30:19.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.376+0000 7f279be00640 1 --2- 172.21.15.31:0/3821691531 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f27840733b0 0x7f2784075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:19.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.376+0000 7f279be00640 1 -- 172.21.15.31:0/3821691531 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f2790094d90 con 0x7f27a415be10 2024-09-17T05:30:19.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.376+0000 7f27a3e00640 1 --2- 172.21.15.31:0/3821691531 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f27840733b0 0x7f2784075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:19.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.380+0000 7f27a3e00640 1 --2- 172.21.15.31:0/3821691531 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f27840733b0 0x7f2784075870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f27940aafd0 tx=0x7f27940aa040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:19.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.380+0000 7f279be00640 1 -- 172.21.15.31:0/3821691531 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f279005f510 con 0x7f27a415be10 2024-09-17T05:30:19.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:19.596+0000 7f27aaa00640 1 -- 172.21.15.31:0/3821691531 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f27a40b6300 con 0x7f27a415be10 2024-09-17T05:30:20.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.376+0000 7f279be00640 1 -- 172.21.15.31:0/3821691531 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v29) ==== 136+0+0 (secure 0 0 0) 0x7f2790063f40 con 0x7f27a415be10 2024-09-17T05:30:20.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.376+0000 7f27aaa00640 1 -- 172.21.15.31:0/3821691531 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f27840733b0 msgr2=0x7f2784075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:20.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.376+0000 7f27aaa00640 1 --2- 172.21.15.31:0/3821691531 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f27840733b0 0x7f2784075870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f27940aafd0 tx=0x7f27940aa040 comp rx=0 tx=0).stop 2024-09-17T05:30:20.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.376+0000 7f27aaa00640 1 -- 172.21.15.31:0/3821691531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27a415be10 msgr2=0x7f27a414d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:20.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.376+0000 7f27aaa00640 1 --2- 172.21.15.31:0/3821691531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27a415be10 0x7f27a414d1e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f279000e6c0 tx=0x7f279000eb80 comp rx=0 tx=0).stop 2024-09-17T05:30:20.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.376+0000 7f27aaa00640 1 -- 172.21.15.31:0/3821691531 shutdown_connections 2024-09-17T05:30:20.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.376+0000 7f27aaa00640 1 --2- 172.21.15.31:0/3821691531 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f27840733b0 0x7f2784075870 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:20.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.376+0000 7f27aaa00640 1 --2- 172.21.15.31:0/3821691531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f27a415c1f0 0x7f27a4152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:20.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.376+0000 7f27aaa00640 1 --2- 172.21.15.31:0/3821691531 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27a415be10 0x7f27a414d1e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:20.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.376+0000 7f27aaa00640 1 --2- 172.21.15.31:0/3821691531 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27a40b0b60 0x7f27a4154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:20.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.376+0000 7f27aaa00640 1 -- 172.21.15.31:0/3821691531 >> 172.21.15.31:0/3821691531 conn(0x7f27a40d1da0 msgr2=0x7f27a40cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:20.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.376+0000 7f27aaa00640 1 -- 172.21.15.31:0/3821691531 shutdown_connections 2024-09-17T05:30:20.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.376+0000 7f27aaa00640 1 -- 172.21.15.31:0/3821691531 wait complete. 2024-09-17T05:30:20.406 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:30:20.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d97400640 1 -- 172.21.15.31:0/1449918129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d9015c1c0 msgr2=0x7f6d9006d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:20.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d97400640 1 --2- 172.21.15.31:0/1449918129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d9015c1c0 0x7f6d9006d000 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6d900b3820 tx=0x7f6d7801c890 comp rx=0 tx=0).stop 2024-09-17T05:30:20.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d97400640 1 -- 172.21.15.31:0/1449918129 shutdown_connections 2024-09-17T05:30:20.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d97400640 1 --2- 172.21.15.31:0/1449918129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d9015f7b0 0x7f6d9015fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:20.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d97400640 1 --2- 172.21.15.31:0/1449918129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d9015c1c0 0x7f6d9006d000 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:20.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d97400640 1 --2- 172.21.15.31:0/1449918129 >> v2:172.21.15.155:3300/0 conn(0x7f6d9006cc20 0x7f6d900737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d97400640 1 -- 172.21.15.31:0/1449918129 >> 172.21.15.31:0/1449918129 conn(0x7f6d900d0c90 msgr2=0x7f6d900d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d97400640 1 -- 172.21.15.31:0/1449918129 shutdown_connections 2024-09-17T05:30:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d97400640 1 -- 172.21.15.31:0/1449918129 wait complete. 2024-09-17T05:30:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d97400640 1 Processor -- start 2024-09-17T05:30:20.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d97400640 1 -- start start 2024-09-17T05:30:20.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d97400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d9006cc20 0x7f6d90166130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:20.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d97400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d9015c1c0 0x7f6d90165aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:20.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d97400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d9015f7b0 0x7f6d90164cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:20.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d97400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6d900719c0 con 0x7f6d9015f7b0 2024-09-17T05:30:20.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d97400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6d90071840 con 0x7f6d9006cc20 2024-09-17T05:30:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d97400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6d90071b40 con 0x7f6d9015c1c0 2024-09-17T05:30:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d95400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d9015f7b0 0x7f6d90164cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d95400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d9015f7b0 0x7f6d90164cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40134/0 (socket says 172.21.15.31:40134) 2024-09-17T05:30:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d95400640 1 -- 172.21.15.31:0/4285554294 learned_addr learned my addr 172.21.15.31:0/4285554294 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d87e00640 1 --2- 172.21.15.31:0/4285554294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d9015c1c0 0x7f6d90165aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d94a00640 1 --2- 172.21.15.31:0/4285554294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d9006cc20 0x7f6d90166130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d95400640 1 -- 172.21.15.31:0/4285554294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d9015c1c0 msgr2=0x7f6d90165aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d95400640 1 --2- 172.21.15.31:0/4285554294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d9015c1c0 0x7f6d90165aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d95400640 1 -- 172.21.15.31:0/4285554294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d9006cc20 msgr2=0x7f6d90166130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d95400640 1 --2- 172.21.15.31:0/4285554294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d9006cc20 0x7f6d90166130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d95400640 1 -- 172.21.15.31:0/4285554294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d90165210 con 0x7f6d9015f7b0 2024-09-17T05:30:20.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.556+0000 7f6d94a00640 1 --2- 172.21.15.31:0/4285554294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d9006cc20 0x7f6d90166130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:30:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.560+0000 7f6d95400640 1 --2- 172.21.15.31:0/4285554294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d9015f7b0 0x7f6d90164cd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800cce0 tx=0x7f6d8800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.560+0000 7f6d8d600640 1 -- 172.21.15.31:0/4285554294 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8800f450 con 0x7f6d9015f7b0 2024-09-17T05:30:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.560+0000 7f6d8d600640 1 -- 172.21.15.31:0/4285554294 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d8800f6e0 con 0x7f6d9015f7b0 2024-09-17T05:30:20.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.560+0000 7f6d97400640 1 -- 172.21.15.31:0/4285554294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d9015e5d0 con 0x7f6d9015f7b0 2024-09-17T05:30:20.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.560+0000 7f6d8d600640 1 -- 172.21.15.31:0/4285554294 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8800fb30 con 0x7f6d9015f7b0 2024-09-17T05:30:20.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.560+0000 7f6d97400640 1 -- 172.21.15.31:0/4285554294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d901668b0 con 0x7f6d9015f7b0 2024-09-17T05:30:20.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.560+0000 7f6d97400640 1 -- 172.21.15.31:0/4285554294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d900737c0 con 0x7f6d9015f7b0 2024-09-17T05:30:20.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.560+0000 7f6d8d600640 1 -- 172.21.15.31:0/4285554294 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f6d88018400 con 0x7f6d9015f7b0 2024-09-17T05:30:20.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.560+0000 7f6d8d600640 1 --2- 172.21.15.31:0/4285554294 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6d6c0733e0 0x7f6d6c0758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:20.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.560+0000 7f6d8d600640 1 -- 172.21.15.31:0/4285554294 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f6d88095210 con 0x7f6d9015f7b0 2024-09-17T05:30:20.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.564+0000 7f6d94a00640 1 --2- 172.21.15.31:0/4285554294 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6d6c0733e0 0x7f6d6c0758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:20.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.564+0000 7f6d94a00640 1 --2- 172.21.15.31:0/4285554294 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6d6c0733e0 0x7f6d6c0758a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6d80005fd0 tx=0x7f6d80005ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:20.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.564+0000 7f6d8d600640 1 -- 172.21.15.31:0/4285554294 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6d88014030 con 0x7f6d9015f7b0 2024-09-17T05:30:20.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.764+0000 7f6d97400640 1 -- 172.21.15.31:0/4285554294 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f6d901f8780 con 0x7f6d6c0733e0 2024-09-17T05:30:20.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.768+0000 7f6d8d600640 1 -- 172.21.15.31:0/4285554294 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f6d901f8780 con 0x7f6d6c0733e0 2024-09-17T05:30:20.772 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:30:20.772 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:30:20.772 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephfs" 2024-09-17T05:30:20.772 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:30:20.772 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:30:20.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.768+0000 7f6d97400640 1 -- 172.21.15.31:0/4285554294 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6d6c0733e0 msgr2=0x7f6d6c0758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:20.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.768+0000 7f6d97400640 1 --2- 172.21.15.31:0/4285554294 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6d6c0733e0 0x7f6d6c0758a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6d80005fd0 tx=0x7f6d80005ee0 comp rx=0 tx=0).stop 2024-09-17T05:30:20.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.768+0000 7f6d97400640 1 -- 172.21.15.31:0/4285554294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d9015f7b0 msgr2=0x7f6d90164cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:20.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.768+0000 7f6d97400640 1 --2- 172.21.15.31:0/4285554294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d9015f7b0 0x7f6d90164cd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800cce0 tx=0x7f6d8800a620 comp rx=0 tx=0).stop 2024-09-17T05:30:20.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.768+0000 7f6d97400640 1 -- 172.21.15.31:0/4285554294 shutdown_connections 2024-09-17T05:30:20.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.768+0000 7f6d97400640 1 --2- 172.21.15.31:0/4285554294 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6d6c0733e0 0x7f6d6c0758a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:20.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.768+0000 7f6d97400640 1 --2- 172.21.15.31:0/4285554294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d9015f7b0 0x7f6d90164cd0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:20.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.768+0000 7f6d97400640 1 --2- 172.21.15.31:0/4285554294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d9015c1c0 0x7f6d90165aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:20.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.768+0000 7f6d97400640 1 --2- 172.21.15.31:0/4285554294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d9006cc20 0x7f6d90166130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:20.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.768+0000 7f6d97400640 1 -- 172.21.15.31:0/4285554294 >> 172.21.15.31:0/4285554294 conn(0x7f6d900d0c90 msgr2=0x7f6d900af680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:20.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.768+0000 7f6d97400640 1 -- 172.21.15.31:0/4285554294 shutdown_connections 2024-09-17T05:30:20.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.768+0000 7f6d97400640 1 -- 172.21.15.31:0/4285554294 wait complete. 2024-09-17T05:30:20.794 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:30:20.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.940+0000 7f86c8e00640 1 -- 172.21.15.31:0/4077349741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c40afb10 msgr2=0x7f86c40affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:20.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.940+0000 7f86c8e00640 1 --2- 172.21.15.31:0/4077349741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c40afb10 0x7f86c40affc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f86c4073810 tx=0x7f86bc01cd80 comp rx=0 tx=0).stop 2024-09-17T05:30:20.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.940+0000 7f86c8e00640 1 -- 172.21.15.31:0/4077349741 shutdown_connections 2024-09-17T05:30:20.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.940+0000 7f86c8e00640 1 --2- 172.21.15.31:0/4077349741 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c40afb10 0x7f86c40affc0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:20.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.940+0000 7f86c8e00640 1 --2- 172.21.15.31:0/4077349741 >> v2:172.21.15.155:3300/0 conn(0x7f86c41605d0 0x7f86c40d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:20.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.940+0000 7f86c8e00640 1 -- 172.21.15.31:0/4077349741 >> 172.21.15.31:0/4077349741 conn(0x7f86c40d1dd0 msgr2=0x7f86c40d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:20.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.940+0000 7f86c8e00640 1 -- 172.21.15.31:0/4077349741 shutdown_connections 2024-09-17T05:30:20.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.940+0000 7f86c8e00640 1 -- 172.21.15.31:0/4077349741 wait complete. 2024-09-17T05:30:20.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.940+0000 7f86c8e00640 1 Processor -- start 2024-09-17T05:30:20.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.940+0000 7f86c8e00640 1 -- start start 2024-09-17T05:30:20.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86c8e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c40afb10 0x7f86c415e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:20.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86c8e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c40b1650 0x7f86c41f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:20.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86c8e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86c41605d0 0x7f86c4153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:20.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86c8e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f86c4169540 con 0x7f86c40b1650 2024-09-17T05:30:20.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86c8e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f86c40b1430 con 0x7f86c40afb10 2024-09-17T05:30:20.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86c8e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f86c41696c0 con 0x7f86c41605d0 2024-09-17T05:30:20.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86bbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c40b1650 0x7f86c41f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:20.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86c1e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c40afb10 0x7f86c415e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:20.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86bbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c40b1650 0x7f86c41f65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40154/0 (socket says 172.21.15.31:40154) 2024-09-17T05:30:20.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86c2800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86c41605d0 0x7f86c4153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:20.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86bbe00640 1 -- 172.21.15.31:0/1321462809 learned_addr learned my addr 172.21.15.31:0/1321462809 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:20.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86bbe00640 1 -- 172.21.15.31:0/1321462809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86c41605d0 msgr2=0x7f86c4153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:20.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86bbe00640 1 --2- 172.21.15.31:0/1321462809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86c41605d0 0x7f86c4153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:20.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86bbe00640 1 -- 172.21.15.31:0/1321462809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c40afb10 msgr2=0x7f86c415e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:20.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86bbe00640 1 --2- 172.21.15.31:0/1321462809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c40afb10 0x7f86c415e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:20.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86bbe00640 1 -- 172.21.15.31:0/1321462809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c4151f70 con 0x7f86c40b1650 2024-09-17T05:30:20.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86bbe00640 1 --2- 172.21.15.31:0/1321462809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c40b1650 0x7f86c41f65c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00c500 tx=0x7f86ac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:20.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86ba000640 1 -- 172.21.15.31:0/1321462809 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac017070 con 0x7f86c40b1650 2024-09-17T05:30:20.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86ba000640 1 -- 172.21.15.31:0/1321462809 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86ac0053c0 con 0x7f86c40b1650 2024-09-17T05:30:20.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86ba000640 1 -- 172.21.15.31:0/1321462809 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac012890 con 0x7f86c40b1650 2024-09-17T05:30:20.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86c8e00640 1 -- 172.21.15.31:0/1321462809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c4152250 con 0x7f86c40b1650 2024-09-17T05:30:20.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86c8e00640 1 -- 172.21.15.31:0/1321462809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c4152810 con 0x7f86c40b1650 2024-09-17T05:30:20.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86c8e00640 1 -- 172.21.15.31:0/1321462809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c40affc0 con 0x7f86c40b1650 2024-09-17T05:30:20.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.944+0000 7f86ba000640 1 -- 172.21.15.31:0/1321462809 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f86ac01a070 con 0x7f86c40b1650 2024-09-17T05:30:20.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.948+0000 7f86ba000640 1 --2- 172.21.15.31:0/1321462809 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f86a00733b0 0x7f86a0075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:20.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.948+0000 7f86ba000640 1 -- 172.21.15.31:0/1321462809 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f86ac093840 con 0x7f86c40b1650 2024-09-17T05:30:20.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.948+0000 7f86c1e00640 1 --2- 172.21.15.31:0/1321462809 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f86a00733b0 0x7f86a0075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:20.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.948+0000 7f86c1e00640 1 --2- 172.21.15.31:0/1321462809 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f86a00733b0 0x7f86a0075870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f86c40cc340 tx=0x7f86b400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:20.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:20.952+0000 7f86ba000640 1 -- 172.21.15.31:0/1321462809 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f86ac05df30 con 0x7f86c40b1650 2024-09-17T05:30:21.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.124+0000 7f86c8e00640 1 -- 172.21.15.31:0/1321462809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f86c40d1080 con 0x7f86c40b1650 2024-09-17T05:30:21.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.128+0000 7f86ba000640 1 -- 172.21.15.31:0/1321462809 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7f86ac062960 con 0x7f86c40b1650 2024-09-17T05:30:21.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.128+0000 7f86c8e00640 1 -- 172.21.15.31:0/1321462809 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f86a00733b0 msgr2=0x7f86a0075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:21.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.128+0000 7f86c8e00640 1 --2- 172.21.15.31:0/1321462809 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f86a00733b0 0x7f86a0075870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f86c40cc340 tx=0x7f86b400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.128+0000 7f86c8e00640 1 -- 172.21.15.31:0/1321462809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c40b1650 msgr2=0x7f86c41f65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:21.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.128+0000 7f86c8e00640 1 --2- 172.21.15.31:0/1321462809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c40b1650 0x7f86c41f65c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00c500 tx=0x7f86ac00c9c0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.128+0000 7f86c8e00640 1 -- 172.21.15.31:0/1321462809 shutdown_connections 2024-09-17T05:30:21.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.128+0000 7f86c8e00640 1 --2- 172.21.15.31:0/1321462809 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f86a00733b0 0x7f86a0075870 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.128+0000 7f86c8e00640 1 --2- 172.21.15.31:0/1321462809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86c41605d0 0x7f86c4153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.128+0000 7f86c8e00640 1 --2- 172.21.15.31:0/1321462809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c40b1650 0x7f86c41f65c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.128+0000 7f86c8e00640 1 --2- 172.21.15.31:0/1321462809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c40afb10 0x7f86c415e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.128+0000 7f86c8e00640 1 -- 172.21.15.31:0/1321462809 >> 172.21.15.31:0/1321462809 conn(0x7f86c40d1dd0 msgr2=0x7f86c40cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:21.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.128+0000 7f86c8e00640 1 -- 172.21.15.31:0/1321462809 shutdown_connections 2024-09-17T05:30:21.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.128+0000 7f86c8e00640 1 -- 172.21.15.31:0/1321462809 wait complete. 2024-09-17T05:30:21.154 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:30:21.154 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:30:21.167 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:30:21.167 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:30:21.216 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:30:21.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.404+0000 7fb12b200640 1 -- 172.21.15.31:0/805685219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb124155080 msgr2=0x7fb1240cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:21.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.404+0000 7fb12b200640 1 --2- 172.21.15.31:0/805685219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb124155080 0x7fb1240cd510 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb118009900 tx=0x7fb11801c880 comp rx=0 tx=0).stop 2024-09-17T05:30:21.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.404+0000 7fb12b200640 1 -- 172.21.15.31:0/805685219 shutdown_connections 2024-09-17T05:30:21.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.404+0000 7fb12b200640 1 --2- 172.21.15.31:0/805685219 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb1240cda50 0x7fb1240cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.404+0000 7fb12b200640 1 --2- 172.21.15.31:0/805685219 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb124155080 0x7fb1240cd510 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.404+0000 7fb12b200640 1 -- 172.21.15.31:0/805685219 >> 172.21.15.31:0/805685219 conn(0x7fb12406dd30 msgr2=0x7fb12406e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:21.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.404+0000 7fb12b200640 1 -- 172.21.15.31:0/805685219 shutdown_connections 2024-09-17T05:30:21.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.404+0000 7fb12b200640 1 -- 172.21.15.31:0/805685219 wait complete. 2024-09-17T05:30:21.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.404+0000 7fb12b200640 1 Processor -- start 2024-09-17T05:30:21.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.404+0000 7fb12b200640 1 -- start start 2024-09-17T05:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb12b200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1240cb8a0 0x7fb1240af020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb12b200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1240cda50 0x7fb12415c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb12b200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb124155080 0x7fb1241f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb12b200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb124167d40 con 0x7fb1240cb8a0 2024-09-17T05:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb12b200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb124167bc0 con 0x7fb1240cda50 2024-09-17T05:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb12b200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb124167ec0 con 0x7fb124155080 2024-09-17T05:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb129e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1240cb8a0 0x7fb1240af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb129e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1240cb8a0 0x7fb1240af020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40174/0 (socket says 172.21.15.31:40174) 2024-09-17T05:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb129e00640 1 -- 172.21.15.31:0/3107608658 learned_addr learned my addr 172.21.15.31:0/3107608658 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb129400640 1 --2- 172.21.15.31:0/3107608658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1240cda50 0x7fb12415c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb12a800640 1 --2- 172.21.15.31:0/3107608658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb124155080 0x7fb1241f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:21.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb129e00640 1 -- 172.21.15.31:0/3107608658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb124155080 msgr2=0x7fb1241f80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:21.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb129e00640 1 --2- 172.21.15.31:0/3107608658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb124155080 0x7fb1241f80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb129e00640 1 -- 172.21.15.31:0/3107608658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1240cda50 msgr2=0x7fb12415c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:21.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb129e00640 1 --2- 172.21.15.31:0/3107608658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1240cda50 0x7fb12415c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb129e00640 1 -- 172.21.15.31:0/3107608658 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1240bfc70 con 0x7fb1240cb8a0 2024-09-17T05:30:21.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb129e00640 1 --2- 172.21.15.31:0/3107608658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1240cb8a0 0x7fb1240af020 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb118009850 tx=0x7fb1180a55f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:21.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb11e000640 1 -- 172.21.15.31:0/3107608658 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1180b2040 con 0x7fb1240cb8a0 2024-09-17T05:30:21.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb11e000640 1 -- 172.21.15.31:0/3107608658 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb118004470 con 0x7fb1240cb8a0 2024-09-17T05:30:21.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb11e000640 1 -- 172.21.15.31:0/3107608658 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb118005280 con 0x7fb1240cb8a0 2024-09-17T05:30:21.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb12b200640 1 -- 172.21.15.31:0/3107608658 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1240af660 con 0x7fb1240cb8a0 2024-09-17T05:30:21.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb12b200640 1 -- 172.21.15.31:0/3107608658 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1240c01f0 con 0x7fb1240cb8a0 2024-09-17T05:30:21.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb12b200640 1 -- 172.21.15.31:0/3107608658 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1240cb360 con 0x7fb1240cb8a0 2024-09-17T05:30:21.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.408+0000 7fb11e000640 1 -- 172.21.15.31:0/3107608658 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7fb118005420 con 0x7fb1240cb8a0 2024-09-17T05:30:21.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.412+0000 7fb11e000640 1 --2- 172.21.15.31:0/3107608658 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb1080733b0 0x7fb108075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:21.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.412+0000 7fb11e000640 1 -- 172.21.15.31:0/3107608658 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fb11812e0f0 con 0x7fb1240cb8a0 2024-09-17T05:30:21.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.412+0000 7fb129400640 1 --2- 172.21.15.31:0/3107608658 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb1080733b0 0x7fb108075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:21.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.412+0000 7fb129400640 1 --2- 172.21.15.31:0/3107608658 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb1080733b0 0x7fb108075870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb1240b20c0 tx=0x7fb114005f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:21.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.416+0000 7fb11e000640 1 -- 172.21.15.31:0/3107608658 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb1180164d0 con 0x7fb1240cb8a0 2024-09-17T05:30:21.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.604+0000 7fb12b200640 1 -- 172.21.15.31:0/3107608658 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb1240c4410 con 0x7fb1240cb8a0 2024-09-17T05:30:21.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.604+0000 7fb11e000640 1 -- 172.21.15.31:0/3107608658 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) ==== 80+0+0 (secure 0 0 0) 0x7fb1180f8d80 con 0x7fb1240cb8a0 2024-09-17T05:30:21.609 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:30:21.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.608+0000 7fb12b200640 1 -- 172.21.15.31:0/3107608658 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb1080733b0 msgr2=0x7fb108075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:21.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.608+0000 7fb12b200640 1 --2- 172.21.15.31:0/3107608658 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb1080733b0 0x7fb108075870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb1240b20c0 tx=0x7fb114005f50 comp rx=0 tx=0).stop 2024-09-17T05:30:21.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.608+0000 7fb12b200640 1 -- 172.21.15.31:0/3107608658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1240cb8a0 msgr2=0x7fb1240af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:21.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.608+0000 7fb12b200640 1 --2- 172.21.15.31:0/3107608658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1240cb8a0 0x7fb1240af020 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb118009850 tx=0x7fb1180a55f0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.608+0000 7fb12b200640 1 -- 172.21.15.31:0/3107608658 shutdown_connections 2024-09-17T05:30:21.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.608+0000 7fb12b200640 1 --2- 172.21.15.31:0/3107608658 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb1080733b0 0x7fb108075870 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.608+0000 7fb12b200640 1 --2- 172.21.15.31:0/3107608658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb124155080 0x7fb1241f80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.608+0000 7fb12b200640 1 --2- 172.21.15.31:0/3107608658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb1240cda50 0x7fb12415c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.608+0000 7fb12b200640 1 --2- 172.21.15.31:0/3107608658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1240cb8a0 0x7fb1240af020 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.608+0000 7fb12b200640 1 -- 172.21.15.31:0/3107608658 >> 172.21.15.31:0/3107608658 conn(0x7fb12406dd30 msgr2=0x7fb1240c3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:21.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.608+0000 7fb12b200640 1 -- 172.21.15.31:0/3107608658 shutdown_connections 2024-09-17T05:30:21.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.608+0000 7fb12b200640 1 -- 172.21.15.31:0/3107608658 wait complete. 2024-09-17T05:30:21.631 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:30:21.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:30:21.632 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:30:21.659 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:30:21.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:30:21.659 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:30:21.713 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:30:21.713 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:30:21.723 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:30:21.724 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:30:21.778 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:30:21.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.920+0000 7f76b3e00640 1 -- 172.21.15.31:0/1106578336 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76b40cc720 msgr2=0x7f76b415cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:21.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.920+0000 7f76b3e00640 1 --2- 172.21.15.31:0/1106578336 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76b40cc720 0x7f76b415cc90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f76a4009840 tx=0x7f76a401c7f0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.920+0000 7f76b3e00640 1 -- 172.21.15.31:0/1106578336 shutdown_connections 2024-09-17T05:30:21.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.920+0000 7f76b3e00640 1 --2- 172.21.15.31:0/1106578336 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76b40cc720 0x7f76b415cc90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.920+0000 7f76b3e00640 1 -- 172.21.15.31:0/1106578336 >> 172.21.15.31:0/1106578336 conn(0x7f76b406dd30 msgr2=0x7f76b406e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:21.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.920+0000 7f76b3e00640 1 -- 172.21.15.31:0/1106578336 shutdown_connections 2024-09-17T05:30:21.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.920+0000 7f76b3e00640 1 -- 172.21.15.31:0/1106578336 wait complete. 2024-09-17T05:30:21.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3e00640 1 Processor -- start 2024-09-17T05:30:21.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3e00640 1 -- start start 2024-09-17T05:30:21.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76b40c70b0 0x7f76b40ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:21.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76b40cc720 0x7f76b41f7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:21.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76b40cd0d0 0x7f76b40b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:21.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f76b4169f70 con 0x7f76b40cd0d0 2024-09-17T05:30:21.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f76b4169df0 con 0x7f76b40c70b0 2024-09-17T05:30:21.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f76b416a0f0 con 0x7f76b40cc720 2024-09-17T05:30:21.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76b40cd0d0 0x7f76b40b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:21.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76b40cd0d0 0x7f76b40b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40178/0 (socket says 172.21.15.31:40178) 2024-09-17T05:30:21.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3400640 1 -- 172.21.15.31:0/1660528643 learned_addr learned my addr 172.21.15.31:0/1660528643 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:21.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b2a00640 1 --2- 172.21.15.31:0/1660528643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76b40c70b0 0x7f76b40ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:21.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76abe00640 1 --2- 172.21.15.31:0/1660528643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76b40cc720 0x7f76b41f7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:21.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3400640 1 -- 172.21.15.31:0/1660528643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76b40cc720 msgr2=0x7f76b41f7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:21.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3400640 1 --2- 172.21.15.31:0/1660528643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76b40cc720 0x7f76b41f7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3400640 1 -- 172.21.15.31:0/1660528643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76b40c70b0 msgr2=0x7f76b40ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:21.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3400640 1 --2- 172.21.15.31:0/1660528643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76b40c70b0 0x7f76b40ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:21.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3400640 1 -- 172.21.15.31:0/1660528643 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b41f8db0 con 0x7f76b40cd0d0 2024-09-17T05:30:21.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3400640 1 --2- 172.21.15.31:0/1660528643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76b40cd0d0 0x7f76b40b0640 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00c730 tx=0x7f76ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:21.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76aaa00640 1 -- 172.21.15.31:0/1660528643 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac003b80 con 0x7f76b40cd0d0 2024-09-17T05:30:21.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76aaa00640 1 -- 172.21.15.31:0/1660528643 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76ac003d20 con 0x7f76b40cd0d0 2024-09-17T05:30:21.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76aaa00640 1 -- 172.21.15.31:0/1660528643 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac00aab0 con 0x7f76b40cd0d0 2024-09-17T05:30:21.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3e00640 1 -- 172.21.15.31:0/1660528643 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b40b3dc0 con 0x7f76b40cd0d0 2024-09-17T05:30:21.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.924+0000 7f76b3e00640 1 -- 172.21.15.31:0/1660528643 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b41f8990 con 0x7f76b40cd0d0 2024-09-17T05:30:21.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.928+0000 7f76b3e00640 1 -- 172.21.15.31:0/1660528643 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b415cc90 con 0x7f76b40cd0d0 2024-09-17T05:30:21.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.928+0000 7f76aaa00640 1 -- 172.21.15.31:0/1660528643 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f76ac00ac50 con 0x7f76b40cd0d0 2024-09-17T05:30:21.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.928+0000 7f76aaa00640 1 --2- 172.21.15.31:0/1660528643 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f76900733b0 0x7f7690075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:21.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.928+0000 7f76aaa00640 1 -- 172.21.15.31:0/1660528643 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f76ac094440 con 0x7f76b40cd0d0 2024-09-17T05:30:21.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.928+0000 7f76b2a00640 1 --2- 172.21.15.31:0/1660528643 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f76900733b0 0x7f7690075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:21.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.928+0000 7f76b2a00640 1 --2- 172.21.15.31:0/1660528643 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f76900733b0 0x7f7690075870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f76a40af000 tx=0x7f76a401b030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:21.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:21.932+0000 7f76aaa00640 1 -- 172.21.15.31:0/1660528643 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f76ac05f0c0 con 0x7f76b40cd0d0 2024-09-17T05:30:22.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.120+0000 7f76b3e00640 1 -- 172.21.15.31:0/1660528643 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f76b415bbe0 con 0x7f76b40cd0d0 2024-09-17T05:30:22.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.120+0000 7f76aaa00640 1 -- 172.21.15.31:0/1660528643 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) ==== 80+0+0 (secure 0 0 0) 0x7f76ac05e9c0 con 0x7f76b40cd0d0 2024-09-17T05:30:22.126 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:30:22.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.124+0000 7f76b3e00640 1 -- 172.21.15.31:0/1660528643 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f76900733b0 msgr2=0x7f7690075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:22.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.124+0000 7f76b3e00640 1 --2- 172.21.15.31:0/1660528643 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f76900733b0 0x7f7690075870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f76a40af000 tx=0x7f76a401b030 comp rx=0 tx=0).stop 2024-09-17T05:30:22.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.124+0000 7f76b3e00640 1 -- 172.21.15.31:0/1660528643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76b40cd0d0 msgr2=0x7f76b40b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:22.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.124+0000 7f76b3e00640 1 --2- 172.21.15.31:0/1660528643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76b40cd0d0 0x7f76b40b0640 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00c730 tx=0x7f76ac00cbf0 comp rx=0 tx=0).stop 2024-09-17T05:30:22.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.124+0000 7f76b3e00640 1 -- 172.21.15.31:0/1660528643 shutdown_connections 2024-09-17T05:30:22.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.124+0000 7f76b3e00640 1 --2- 172.21.15.31:0/1660528643 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f76900733b0 0x7f7690075870 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:22.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.124+0000 7f76b3e00640 1 --2- 172.21.15.31:0/1660528643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76b40cd0d0 0x7f76b40b0640 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:22.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.124+0000 7f76b3e00640 1 --2- 172.21.15.31:0/1660528643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76b40cc720 0x7f76b41f7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:22.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.124+0000 7f76b3e00640 1 --2- 172.21.15.31:0/1660528643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76b40c70b0 0x7f76b40ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:22.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.124+0000 7f76b3e00640 1 -- 172.21.15.31:0/1660528643 >> 172.21.15.31:0/1660528643 conn(0x7f76b406dd30 msgr2=0x7f76b415ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:22.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.124+0000 7f76b3e00640 1 -- 172.21.15.31:0/1660528643 shutdown_connections 2024-09-17T05:30:22.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.124+0000 7f76b3e00640 1 -- 172.21.15.31:0/1660528643 wait complete. 2024-09-17T05:30:22.148 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T05:30:22.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:30:22.148 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T05:30:22.177 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:30:22.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:30:22.178 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:30:22.229 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:30:22.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.376+0000 7f5fc9600640 1 -- 172.21.15.31:0/3058527141 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fa8004d50 msgr2=0x7f5fa80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:22.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.376+0000 7f5fc9600640 1 --2- 172.21.15.31:0/3058527141 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fa8004d50 0x7f5fa80051d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009ee0 tx=0x7f5fbc01d5f0 comp rx=0 tx=0).stop 2024-09-17T05:30:22.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.376+0000 7f5fc3400640 1 -- 172.21.15.31:0/3058527141 reap_dead start 2024-09-17T05:30:22.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.376+0000 7f5fc9600640 1 -- 172.21.15.31:0/3058527141 shutdown_connections 2024-09-17T05:30:22.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.376+0000 7f5fc9600640 1 -- 172.21.15.31:0/3058527141 >> 172.21.15.31:0/3058527141 conn(0x7f5fc40d1dc0 msgr2=0x7f5fc40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:22.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.376+0000 7f5fc9600640 1 -- 172.21.15.31:0/3058527141 shutdown_connections 2024-09-17T05:30:22.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.376+0000 7f5fc9600640 1 -- 172.21.15.31:0/3058527141 wait complete. 2024-09-17T05:30:22.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.376+0000 7f5fc9600640 1 Processor -- start 2024-09-17T05:30:22.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.376+0000 7f5fc9600640 1 -- start start 2024-09-17T05:30:22.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.376+0000 7f5fc9600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fa8004d50 0x7f5fc40b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:22.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.376+0000 7f5fc9600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fc40b4bf0 0x7f5fc40cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:22.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.376+0000 7f5fc9600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fc41f7fb0 0x7f5fc41f8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:22.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.376+0000 7f5fc9600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc40d2a60 con 0x7f5fc41f7fb0 2024-09-17T05:30:22.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.376+0000 7f5fc9600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc40d28e0 con 0x7f5fa8004d50 2024-09-17T05:30:22.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.376+0000 7f5fc9600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc40d2be0 con 0x7f5fc40b4bf0 2024-09-17T05:30:22.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.376+0000 7f5fc3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fc41f7fb0 0x7f5fc41f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:22.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.376+0000 7f5fc3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fc41f7fb0 0x7f5fc41f8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40200/0 (socket says 172.21.15.31:40200) 2024-09-17T05:30:22.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.376+0000 7f5fc3400640 1 -- 172.21.15.31:0/3233896224 learned_addr learned my addr 172.21.15.31:0/3233896224 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:22.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.380+0000 7f5fc2a00640 1 --2- 172.21.15.31:0/3233896224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fa8004d50 0x7f5fc40b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:22.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.380+0000 7f5fbbe00640 1 --2- 172.21.15.31:0/3233896224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fc40b4bf0 0x7f5fc40cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:22.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.380+0000 7f5fc3400640 1 -- 172.21.15.31:0/3233896224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fc40b4bf0 msgr2=0x7f5fc40cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:22.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.380+0000 7f5fc3400640 1 --2- 172.21.15.31:0/3233896224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fc40b4bf0 0x7f5fc40cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:22.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.380+0000 7f5fc3400640 1 -- 172.21.15.31:0/3233896224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fa8004d50 msgr2=0x7f5fc40b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:22.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.380+0000 7f5fc3400640 1 --2- 172.21.15.31:0/3233896224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fa8004d50 0x7f5fc40b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:22.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.380+0000 7f5fc3400640 1 -- 172.21.15.31:0/3233896224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc41f89a0 con 0x7f5fc41f7fb0 2024-09-17T05:30:22.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.380+0000 7f5fbbe00640 1 --2- 172.21.15.31:0/3233896224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fc40b4bf0 0x7f5fc40cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:30:22.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.380+0000 7f5fc3400640 1 --2- 172.21.15.31:0/3233896224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fc41f7fb0 0x7f5fc41f8460 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009ee0 tx=0x7f5fbc004f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:22.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.380+0000 7f5fbaa00640 1 -- 172.21.15.31:0/3233896224 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc0ad050 con 0x7f5fc41f7fb0 2024-09-17T05:30:22.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.380+0000 7f5fbaa00640 1 -- 172.21.15.31:0/3233896224 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fbc0a7a90 con 0x7f5fc41f7fb0 2024-09-17T05:30:22.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.380+0000 7f5fc9600640 1 -- 172.21.15.31:0/3233896224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc40b5070 con 0x7f5fc41f7fb0 2024-09-17T05:30:22.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.380+0000 7f5fbaa00640 1 -- 172.21.15.31:0/3233896224 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc009200 con 0x7f5fc41f7fb0 2024-09-17T05:30:22.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.380+0000 7f5fc9600640 1 -- 172.21.15.31:0/3233896224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc41fc630 con 0x7f5fc41f7fb0 2024-09-17T05:30:22.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.384+0000 7f5fc9600640 1 -- 172.21.15.31:0/3233896224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc40cfcb0 con 0x7f5fc41f7fb0 2024-09-17T05:30:22.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.384+0000 7f5fbaa00640 1 -- 172.21.15.31:0/3233896224 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f5fbc0b0070 con 0x7f5fc41f7fb0 2024-09-17T05:30:22.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.384+0000 7f5fbaa00640 1 --2- 172.21.15.31:0/3233896224 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5fa00733b0 0x7f5fa0075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:22.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.384+0000 7f5fbaa00640 1 -- 172.21.15.31:0/3233896224 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f5fbc12f2c0 con 0x7f5fc41f7fb0 2024-09-17T05:30:22.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.384+0000 7f5fc2a00640 1 --2- 172.21.15.31:0/3233896224 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5fa00733b0 0x7f5fa0075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:22.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.388+0000 7f5fc2a00640 1 --2- 172.21.15.31:0/3233896224 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5fa00733b0 0x7f5fa0075870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4000fc0 tx=0x7f5fb4001ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:22.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.388+0000 7f5fbaa00640 1 -- 172.21.15.31:0/3233896224 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5fc41f89a0 con 0x7f5fc41f7fb0 2024-09-17T05:30:22.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.600+0000 7f5fc9600640 1 -- 172.21.15.31:0/3233896224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5fc40b0450 con 0x7f5fc41f7fb0 2024-09-17T05:30:22.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.600+0000 7f5fbaa00640 1 -- 172.21.15.31:0/3233896224 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7f5fbc017340 con 0x7f5fc41f7fb0 2024-09-17T05:30:22.605 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:22.605 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T05:30:20:371375+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:30:22.606 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T05:30:22.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.600+0000 7f5fc9600640 1 -- 172.21.15.31:0/3233896224 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5fa00733b0 msgr2=0x7f5fa0075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:22.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.600+0000 7f5fc9600640 1 --2- 172.21.15.31:0/3233896224 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5fa00733b0 0x7f5fa0075870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4000fc0 tx=0x7f5fb4001ce0 comp rx=0 tx=0).stop 2024-09-17T05:30:22.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.600+0000 7f5fc9600640 1 -- 172.21.15.31:0/3233896224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fc41f7fb0 msgr2=0x7f5fc41f8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:22.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.600+0000 7f5fc9600640 1 --2- 172.21.15.31:0/3233896224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fc41f7fb0 0x7f5fc41f8460 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009ee0 tx=0x7f5fbc004f50 comp rx=0 tx=0).stop 2024-09-17T05:30:22.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.600+0000 7f5fc9600640 1 -- 172.21.15.31:0/3233896224 shutdown_connections 2024-09-17T05:30:22.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.600+0000 7f5fc9600640 1 --2- 172.21.15.31:0/3233896224 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5fa00733b0 0x7f5fa0075870 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:22.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.600+0000 7f5fc9600640 1 --2- 172.21.15.31:0/3233896224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5fc41f7fb0 0x7f5fc41f8460 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:22.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.600+0000 7f5fc9600640 1 --2- 172.21.15.31:0/3233896224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5fc40b4bf0 0x7f5fc40cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:22.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.600+0000 7f5fc9600640 1 --2- 172.21.15.31:0/3233896224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fa8004d50 0x7f5fc40b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:22.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.600+0000 7f5fc9600640 1 -- 172.21.15.31:0/3233896224 >> 172.21.15.31:0/3233896224 conn(0x7f5fc40d1dc0 msgr2=0x7f5fc406e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:22.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.600+0000 7f5fc9600640 1 -- 172.21.15.31:0/3233896224 shutdown_connections 2024-09-17T05:30:22.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.600+0000 7f5fc9600640 1 -- 172.21.15.31:0/3233896224 wait complete. 2024-09-17T05:30:22.627 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:30:22.793 INFO:teuthology.orchestra.run.smithi031.stdout:[] 2024-09-17T05:30:22.794 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-17T05:30:22.794 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol89880 2024-09-17T05:30:22.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a9ca00640 1 -- 172.21.15.31:0/1114092985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a9806f070 msgr2=0x7f8a9806f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:22.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a9ca00640 1 --2- 172.21.15.31:0/1114092985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a9806f070 0x7f8a9806f4c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8a90005fd0 tx=0x7f8a9001cb70 comp rx=0 tx=0).stop 2024-09-17T05:30:22.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a9ca00640 1 -- 172.21.15.31:0/1114092985 shutdown_connections 2024-09-17T05:30:22.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a9ca00640 1 --2- 172.21.15.31:0/1114092985 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a9806f070 0x7f8a9806f4c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:22.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a9ca00640 1 --2- 172.21.15.31:0/1114092985 >> v2:172.21.15.155:3300/0 conn(0x7f8a980cca10 0x7f8a980cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:22.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a9ca00640 1 -- 172.21.15.31:0/1114092985 >> 172.21.15.31:0/1114092985 conn(0x7f8a980b2060 msgr2=0x7f8a980b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:22.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a9ca00640 1 -- 172.21.15.31:0/1114092985 shutdown_connections 2024-09-17T05:30:22.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a9ca00640 1 -- 172.21.15.31:0/1114092985 wait complete. 2024-09-17T05:30:22.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a9ca00640 1 Processor -- start 2024-09-17T05:30:22.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a9ca00640 1 -- start start 2024-09-17T05:30:22.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a9ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a9806f070 0x7f8a9815c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:22.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a9ca00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a980cca10 0x7f8a980c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:22.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a9ca00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a9815be00 0x7f8a981fae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:22.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a9ca00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8a98168f70 con 0x7f8a9806f070 2024-09-17T05:30:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a9ca00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8a98168df0 con 0x7f8a980cca10 2024-09-17T05:30:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a9ca00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8a981690f0 con 0x7f8a9815be00 2024-09-17T05:30:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a95e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a9806f070 0x7f8a9815c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a95e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a9806f070 0x7f8a9815c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40216/0 (socket says 172.21.15.31:40216) 2024-09-17T05:30:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a95e00640 1 -- 172.21.15.31:0/3381197495 learned_addr learned my addr 172.21.15.31:0/3381197495 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a96800640 1 --2- 172.21.15.31:0/3381197495 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a9815be00 0x7f8a981fae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a8d400640 1 --2- 172.21.15.31:0/3381197495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a980cca10 0x7f8a980c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a95e00640 1 -- 172.21.15.31:0/3381197495 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a9815be00 msgr2=0x7f8a981fae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a95e00640 1 --2- 172.21.15.31:0/3381197495 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a9815be00 0x7f8a981fae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a95e00640 1 -- 172.21.15.31:0/3381197495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a980cca10 msgr2=0x7f8a980c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a95e00640 1 --2- 172.21.15.31:0/3381197495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a980cca10 0x7f8a980c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:22.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.940+0000 7f8a95e00640 1 -- 172.21.15.31:0/3381197495 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9815e990 con 0x7f8a9806f070 2024-09-17T05:30:22.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.944+0000 7f8a95e00640 1 --2- 172.21.15.31:0/3381197495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a9806f070 0x7f8a9815c3f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800c430 tx=0x7f8a8800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:22.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.944+0000 7f8a8ea00640 1 -- 172.21.15.31:0/3381197495 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88011790 con 0x7f8a9806f070 2024-09-17T05:30:22.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.944+0000 7f8a8ea00640 1 -- 172.21.15.31:0/3381197495 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a88017070 con 0x7f8a9806f070 2024-09-17T05:30:22.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.944+0000 7f8a8ea00640 1 -- 172.21.15.31:0/3381197495 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88011cc0 con 0x7f8a9806f070 2024-09-17T05:30:22.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.944+0000 7f8a9ca00640 1 -- 172.21.15.31:0/3381197495 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9815ec70 con 0x7f8a9806f070 2024-09-17T05:30:22.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.944+0000 7f8a9ca00640 1 -- 172.21.15.31:0/3381197495 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a9815f230 con 0x7f8a9806f070 2024-09-17T05:30:22.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.944+0000 7f8a9ca00640 1 -- 172.21.15.31:0/3381197495 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a9806f4c0 con 0x7f8a9806f070 2024-09-17T05:30:22.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.944+0000 7f8a8ea00640 1 -- 172.21.15.31:0/3381197495 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f8a8801c460 con 0x7f8a9806f070 2024-09-17T05:30:22.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.944+0000 7f8a8ea00640 1 --2- 172.21.15.31:0/3381197495 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8a740733e0 0x7f8a740758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:22.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.948+0000 7f8a8ea00640 1 -- 172.21.15.31:0/3381197495 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f8a880941d0 con 0x7f8a9806f070 2024-09-17T05:30:22.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.948+0000 7f8a8d400640 1 --2- 172.21.15.31:0/3381197495 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8a740733e0 0x7f8a740758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:22.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.948+0000 7f8a8d400640 1 --2- 172.21.15.31:0/3381197495 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8a740733e0 0x7f8a740758a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009600 tx=0x7f8a800091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:22.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:22.952+0000 7f8a8ea00640 1 -- 172.21.15.31:0/3381197495 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8a8805e890 con 0x7f8a9806f070 2024-09-17T05:30:23.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.148+0000 7f8a9ca00640 1 -- 172.21.15.31:0/3381197495 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol89880", "target": ["mon-mgr", ""]}) -- 0x7f8a980b25e0 con 0x7f8a740733e0 2024-09-17T05:30:23.163 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:30:23.159+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:30:23.163 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:30:23.159+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:30:23.163 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:30:23.159+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:30:23.163 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:30:23.159+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:30:23.163 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:30:23.159+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:30:23.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.196+0000 7f8a8ea00640 1 -- 172.21.15.31:0/3381197495 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8a980b25e0 con 0x7f8a740733e0 2024-09-17T05:30:23.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.200+0000 7f8a9ca00640 1 -- 172.21.15.31:0/3381197495 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8a740733e0 msgr2=0x7f8a740758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:23.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.200+0000 7f8a9ca00640 1 --2- 172.21.15.31:0/3381197495 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8a740733e0 0x7f8a740758a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009600 tx=0x7f8a800091e0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.200+0000 7f8a9ca00640 1 -- 172.21.15.31:0/3381197495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a9806f070 msgr2=0x7f8a9815c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:23.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.200+0000 7f8a9ca00640 1 --2- 172.21.15.31:0/3381197495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a9806f070 0x7f8a9815c3f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800c430 tx=0x7f8a8800c8f0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.200+0000 7f8a9ca00640 1 -- 172.21.15.31:0/3381197495 shutdown_connections 2024-09-17T05:30:23.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.200+0000 7f8a9ca00640 1 --2- 172.21.15.31:0/3381197495 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8a740733e0 0x7f8a740758a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.200+0000 7f8a9ca00640 1 --2- 172.21.15.31:0/3381197495 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a9815be00 0x7f8a981fae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.200+0000 7f8a9ca00640 1 --2- 172.21.15.31:0/3381197495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a980cca10 0x7f8a980c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.200+0000 7f8a9ca00640 1 --2- 172.21.15.31:0/3381197495 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a9806f070 0x7f8a9815c3f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.200+0000 7f8a9ca00640 1 -- 172.21.15.31:0/3381197495 >> 172.21.15.31:0/3381197495 conn(0x7f8a980b2060 msgr2=0x7f8a980b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:23.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.200+0000 7f8a9ca00640 1 -- 172.21.15.31:0/3381197495 shutdown_connections 2024-09-17T05:30:23.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.200+0000 7f8a9ca00640 1 -- 172.21.15.31:0/3381197495 wait complete. 2024-09-17T05:30:23.223 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:30:23.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.364+0000 7f13e8e00640 1 -- 172.21.15.31:0/3516803962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13e415c130 msgr2=0x7f13e40ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:23.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.364+0000 7f13e8e00640 1 --2- 172.21.15.31:0/3516803962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13e415c130 0x7f13e40ceb20 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f13e4073a20 tx=0x7f13cc01c7a0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.364+0000 7f13e8e00640 1 -- 172.21.15.31:0/3516803962 shutdown_connections 2024-09-17T05:30:23.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.364+0000 7f13e8e00640 1 --2- 172.21.15.31:0/3516803962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13e415c130 0x7f13e40ceb20 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.364+0000 7f13e8e00640 1 --2- 172.21.15.31:0/3516803962 >> v2:172.21.15.155:3300/0 conn(0x7f13e415bd50 0x7f13e40ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.364+0000 7f13e8e00640 1 -- 172.21.15.31:0/3516803962 >> 172.21.15.31:0/3516803962 conn(0x7f13e40d1ea0 msgr2=0x7f13e40d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:23.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.364+0000 7f13e8e00640 1 -- 172.21.15.31:0/3516803962 shutdown_connections 2024-09-17T05:30:23.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.364+0000 7f13e8e00640 1 -- 172.21.15.31:0/3516803962 wait complete. 2024-09-17T05:30:23.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e8e00640 1 Processor -- start 2024-09-17T05:30:23.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e8e00640 1 -- start start 2024-09-17T05:30:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e8e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13e40cf4e0 0x7f13e4148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e8e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13e415bd50 0x7f13e406f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e8e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13e415c130 0x7f13e40b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e8e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f13e4168e50 con 0x7f13e40cf4e0 2024-09-17T05:30:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e8e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f13e4168cd0 con 0x7f13e415bd50 2024-09-17T05:30:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e8e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f13e4168fd0 con 0x7f13e415c130 2024-09-17T05:30:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13e40cf4e0 0x7f13e4148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13e40cf4e0 0x7f13e4148190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40230/0 (socket says 172.21.15.31:40230) 2024-09-17T05:30:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e1e00640 1 -- 172.21.15.31:0/3204305131 learned_addr learned my addr 172.21.15.31:0/3204305131 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:23.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e2800640 1 --2- 172.21.15.31:0/3204305131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13e415c130 0x7f13e40b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:23.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13dbe00640 1 --2- 172.21.15.31:0/3204305131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13e415bd50 0x7f13e406f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:23.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e1e00640 1 -- 172.21.15.31:0/3204305131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13e415c130 msgr2=0x7f13e40b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:23.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e1e00640 1 --2- 172.21.15.31:0/3204305131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13e415c130 0x7f13e40b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e1e00640 1 -- 172.21.15.31:0/3204305131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13e415bd50 msgr2=0x7f13e406f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:23.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e1e00640 1 --2- 172.21.15.31:0/3204305131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13e415bd50 0x7f13e406f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e1e00640 1 -- 172.21.15.31:0/3204305131 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e41486d0 con 0x7f13e40cf4e0 2024-09-17T05:30:23.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e1e00640 1 --2- 172.21.15.31:0/3204305131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13e40cf4e0 0x7f13e4148190 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f13d400b550 tx=0x7f13d400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:23.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13da000640 1 -- 172.21.15.31:0/3204305131 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4014070 con 0x7f13e40cf4e0 2024-09-17T05:30:23.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13da000640 1 -- 172.21.15.31:0/3204305131 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13d4010980 con 0x7f13e40cf4e0 2024-09-17T05:30:23.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13da000640 1 -- 172.21.15.31:0/3204305131 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4010dd0 con 0x7f13e40cf4e0 2024-09-17T05:30:23.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e8e00640 1 -- 172.21.15.31:0/3204305131 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e406dd30 con 0x7f13e40cf4e0 2024-09-17T05:30:23.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.368+0000 7f13e8e00640 1 -- 172.21.15.31:0/3204305131 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e406e2d0 con 0x7f13e40cf4e0 2024-09-17T05:30:23.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.372+0000 7f13e8e00640 1 -- 172.21.15.31:0/3204305131 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e40c5dd0 con 0x7f13e40cf4e0 2024-09-17T05:30:23.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.372+0000 7f13da000640 1 -- 172.21.15.31:0/3204305131 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 6) ==== 97387+0+0 (secure 0 0 0) 0x7f13d4017070 con 0x7f13e40cf4e0 2024-09-17T05:30:23.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.372+0000 7f13da000640 1 --2- 172.21.15.31:0/3204305131 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f13c00733b0 0x7f13c0075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:23.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.372+0000 7f13da000640 1 -- 172.21.15.31:0/3204305131 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f13d4094490 con 0x7f13e40cf4e0 2024-09-17T05:30:23.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.372+0000 7f13dbe00640 1 --2- 172.21.15.31:0/3204305131 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f13c00733b0 0x7f13c0075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:23.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.372+0000 7f13dbe00640 1 --2- 172.21.15.31:0/3204305131 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f13c00733b0 0x7f13c0075870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f13cc0af000 tx=0x7f13cc01afe0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:23.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.376+0000 7f13da000640 1 -- 172.21.15.31:0/3204305131 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f13d405f110 con 0x7f13e40cf4e0 2024-09-17T05:30:23.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.392+0000 7f13da000640 1 -- 172.21.15.31:0/3204305131 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 7) ==== 97438+0+0 (secure 0 0 0) 0x7f13d405ac80 con 0x7f13e40cf4e0 2024-09-17T05:30:23.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.588+0000 7f13e8e00640 1 -- 172.21.15.31:0/3204305131 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13e40cebe0 con 0x7f13e40cf4e0 2024-09-17T05:30:23.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.592+0000 7f13da000640 1 -- 172.21.15.31:0/3204305131 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7f13d406c1e0 con 0x7f13e40cf4e0 2024-09-17T05:30:23.596 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:23.596 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T05:30:20:371375+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:30:23.596 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T05:30:23.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.592+0000 7f13e8e00640 1 -- 172.21.15.31:0/3204305131 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f13c00733b0 msgr2=0x7f13c0075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:23.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.592+0000 7f13e8e00640 1 --2- 172.21.15.31:0/3204305131 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f13c00733b0 0x7f13c0075870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f13cc0af000 tx=0x7f13cc01afe0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.592+0000 7f13e8e00640 1 -- 172.21.15.31:0/3204305131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13e40cf4e0 msgr2=0x7f13e4148190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:23.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.592+0000 7f13e8e00640 1 --2- 172.21.15.31:0/3204305131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13e40cf4e0 0x7f13e4148190 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f13d400b550 tx=0x7f13d400ba10 comp rx=0 tx=0).stop 2024-09-17T05:30:23.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.592+0000 7f13e8e00640 1 -- 172.21.15.31:0/3204305131 shutdown_connections 2024-09-17T05:30:23.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.592+0000 7f13e8e00640 1 --2- 172.21.15.31:0/3204305131 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f13c00733b0 0x7f13c0075870 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.592+0000 7f13e8e00640 1 --2- 172.21.15.31:0/3204305131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f13e415c130 0x7f13e40b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.592+0000 7f13e8e00640 1 --2- 172.21.15.31:0/3204305131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13e415bd50 0x7f13e406f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.592+0000 7f13e8e00640 1 --2- 172.21.15.31:0/3204305131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f13e40cf4e0 0x7f13e4148190 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.592+0000 7f13e8e00640 1 -- 172.21.15.31:0/3204305131 >> 172.21.15.31:0/3204305131 conn(0x7f13e40d1ea0 msgr2=0x7f13e4159bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:23.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.592+0000 7f13e8e00640 1 -- 172.21.15.31:0/3204305131 shutdown_connections 2024-09-17T05:30:23.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.592+0000 7f13e8e00640 1 -- 172.21.15.31:0/3204305131 wait complete. 2024-09-17T05:30:23.618 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:30:23.782 INFO:teuthology.orchestra.run.smithi031.stdout:[{"id":5416,"entity":{"name":{"type":"client","num":5416},"addr":{"type":"any","addr":"172.21.15.155:0","nonce":881827995}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":15,"uptime":0.59999283999999997,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.970307505749044,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5416 172.21.15.155:0/881827995","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi155","pid":"28855","root":"/"}}] 2024-09-17T05:30:23.782 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi155", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28855", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.155:0", "nonce": 881827995, "type": "any" }, "name": { "num": 5416, "type": "client" } }, "id": 5416, "inst": "client.5416 172.21.15.155:0/881827995", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 15, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.970307505749044 }, "state": "open", "uptime": 0.59999284 } ] 2024-09-17T05:30:23.783 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:30:23.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.924+0000 7f3d8dc00640 1 -- 172.21.15.31:0/1701460563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880b4810 msgr2=0x7f3d880ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:23.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.924+0000 7f3d8dc00640 1 --2- 172.21.15.31:0/1701460563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880b4810 0x7f3d880ce810 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3d8806aab0 tx=0x7f3d8001ccf0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.924+0000 7f3d8dc00640 1 -- 172.21.15.31:0/1701460563 shutdown_connections 2024-09-17T05:30:23.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.924+0000 7f3d8dc00640 1 --2- 172.21.15.31:0/1701460563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880b4810 0x7f3d880ce810 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.924+0000 7f3d8dc00640 1 --2- 172.21.15.31:0/1701460563 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d880cd100 0x7f3d880b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.924+0000 7f3d8dc00640 1 --2- 172.21.15.31:0/1701460563 >> v2:172.21.15.155:3300/0 conn(0x7f3d8815dae0 0x7f3d880acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.924+0000 7f3d8dc00640 1 -- 172.21.15.31:0/1701460563 >> 172.21.15.31:0/1701460563 conn(0x7f3d880b18f0 msgr2=0x7f3d880b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:23.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.924+0000 7f3d8dc00640 1 -- 172.21.15.31:0/1701460563 shutdown_connections 2024-09-17T05:30:23.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.924+0000 7f3d8dc00640 1 -- 172.21.15.31:0/1701460563 wait complete. 2024-09-17T05:30:23.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.924+0000 7f3d8dc00640 1 Processor -- start 2024-09-17T05:30:23.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.924+0000 7f3d8dc00640 1 -- start start 2024-09-17T05:30:23.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.924+0000 7f3d8dc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880b4810 0x7f3d88150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:23.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.924+0000 7f3d8dc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d880cd100 0x7f3d881598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:23.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.924+0000 7f3d8dc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8815dae0 0x7f3d8809cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:23.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.924+0000 7f3d8dc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3d880cc9f0 con 0x7f3d880b4810 2024-09-17T05:30:23.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.924+0000 7f3d8dc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3d880cc870 con 0x7f3d880cd100 2024-09-17T05:30:23.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.924+0000 7f3d8dc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3d880ccb70 con 0x7f3d8815dae0 2024-09-17T05:30:23.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.924+0000 7f3d86a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880b4810 0x7f3d88150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:23.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.928+0000 7f3d86a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880b4810 0x7f3d88150760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40246/0 (socket says 172.21.15.31:40246) 2024-09-17T05:30:23.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.928+0000 7f3d86a00640 1 -- 172.21.15.31:0/851578174 learned_addr learned my addr 172.21.15.31:0/851578174 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:23.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.928+0000 7f3d87400640 1 --2- 172.21.15.31:0/851578174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8815dae0 0x7f3d8809cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:23.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.928+0000 7f3d7e000640 1 --2- 172.21.15.31:0/851578174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d880cd100 0x7f3d881598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:23.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.928+0000 7f3d86a00640 1 -- 172.21.15.31:0/851578174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8815dae0 msgr2=0x7f3d8809cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:23.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.928+0000 7f3d86a00640 1 --2- 172.21.15.31:0/851578174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8815dae0 0x7f3d8809cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.928+0000 7f3d86a00640 1 -- 172.21.15.31:0/851578174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d880cd100 msgr2=0x7f3d881598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:23.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.928+0000 7f3d86a00640 1 --2- 172.21.15.31:0/851578174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d880cd100 0x7f3d881598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:23.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.928+0000 7f3d86a00640 1 -- 172.21.15.31:0/851578174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d88153840 con 0x7f3d880b4810 2024-09-17T05:30:23.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.928+0000 7f3d7e000640 1 --2- 172.21.15.31:0/851578174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d880cd100 0x7f3d881598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:30:23.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.928+0000 7f3d86a00640 1 --2- 172.21.15.31:0/851578174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880b4810 0x7f3d88150760 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800ca20 tx=0x7f3d7800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:23.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.928+0000 7f3d7f400640 1 -- 172.21.15.31:0/851578174 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d78007c70 con 0x7f3d880b4810 2024-09-17T05:30:23.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.928+0000 7f3d7f400640 1 -- 172.21.15.31:0/851578174 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d7800f450 con 0x7f3d880b4810 2024-09-17T05:30:23.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.928+0000 7f3d7f400640 1 -- 172.21.15.31:0/851578174 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7800f8a0 con 0x7f3d880b4810 2024-09-17T05:30:23.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.928+0000 7f3d8dc00640 1 -- 172.21.15.31:0/851578174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d88153b20 con 0x7f3d880b4810 2024-09-17T05:30:23.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.928+0000 7f3d8dc00640 1 -- 172.21.15.31:0/851578174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d881f6ea0 con 0x7f3d880b4810 2024-09-17T05:30:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.928+0000 7f3d8dc00640 1 -- 172.21.15.31:0/851578174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d88069410 con 0x7f3d880b4810 2024-09-17T05:30:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.928+0000 7f3d7f400640 1 -- 172.21.15.31:0/851578174 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 7) ==== 97438+0+0 (secure 0 0 0) 0x7f3d7800fa40 con 0x7f3d880b4810 2024-09-17T05:30:23.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.932+0000 7f3d7f400640 1 --2- 172.21.15.31:0/851578174 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3d64073440 0x7f3d64075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:23.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.932+0000 7f3d7f400640 1 -- 172.21.15.31:0/851578174 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f3d78094f60 con 0x7f3d880b4810 2024-09-17T05:30:23.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.932+0000 7f3d7e000640 1 --2- 172.21.15.31:0/851578174 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3d64073440 0x7f3d64075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:23.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.932+0000 7f3d7e000640 1 --2- 172.21.15.31:0/851578174 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3d64073440 0x7f3d64075900 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3d880b1170 tx=0x7f3d70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:23.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:23.936+0000 7f3d7f400640 1 -- 172.21.15.31:0/851578174 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f3d78014030 con 0x7f3d880b4810 2024-09-17T05:30:24.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:24.144+0000 7f3d8dc00640 1 -- 172.21.15.31:0/851578174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d880b42d0 con 0x7f3d880b4810 2024-09-17T05:30:24.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:24.144+0000 7f3d7f400640 1 -- 172.21.15.31:0/851578174 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7f3d7805fb10 con 0x7f3d880b4810 2024-09-17T05:30:24.150 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:24.150 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T05:30:20:371375+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:30:24.151 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T05:30:24.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:24.148+0000 7f3d8dc00640 1 -- 172.21.15.31:0/851578174 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3d64073440 msgr2=0x7f3d64075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:24.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:24.148+0000 7f3d8dc00640 1 --2- 172.21.15.31:0/851578174 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3d64073440 0x7f3d64075900 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3d880b1170 tx=0x7f3d70008040 comp rx=0 tx=0).stop 2024-09-17T05:30:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:24.148+0000 7f3d8dc00640 1 -- 172.21.15.31:0/851578174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880b4810 msgr2=0x7f3d88150760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:24.148+0000 7f3d8dc00640 1 --2- 172.21.15.31:0/851578174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880b4810 0x7f3d88150760 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3d7800ca20 tx=0x7f3d7800cee0 comp rx=0 tx=0).stop 2024-09-17T05:30:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:24.148+0000 7f3d8dc00640 1 -- 172.21.15.31:0/851578174 shutdown_connections 2024-09-17T05:30:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:24.148+0000 7f3d8dc00640 1 --2- 172.21.15.31:0/851578174 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3d64073440 0x7f3d64075900 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:24.148+0000 7f3d8dc00640 1 --2- 172.21.15.31:0/851578174 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d8815dae0 0x7f3d8809cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:24.148+0000 7f3d8dc00640 1 --2- 172.21.15.31:0/851578174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d880cd100 0x7f3d881598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:24.148+0000 7f3d8dc00640 1 --2- 172.21.15.31:0/851578174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880b4810 0x7f3d88150760 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:24.148+0000 7f3d8dc00640 1 -- 172.21.15.31:0/851578174 >> 172.21.15.31:0/851578174 conn(0x7f3d880b18f0 msgr2=0x7f3d8815c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:24.148+0000 7f3d8dc00640 1 -- 172.21.15.31:0/851578174 shutdown_connections 2024-09-17T05:30:24.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:24.148+0000 7f3d8dc00640 1 -- 172.21.15.31:0/851578174 wait complete. 2024-09-17T05:30:24.172 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:30:24.337 INFO:teuthology.orchestra.run.smithi031.stdout:[{"id":5416,"entity":{"name":{"type":"client","num":5416},"addr":{"type":"any","addr":"172.21.15.155:0","nonce":881827995}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":15,"uptime":1.1559867319999999,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.942102159149858,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5416 172.21.15.155:0/881827995","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi155","pid":"28855","root":"/"}}] 2024-09-17T05:30:24.338 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi155", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28855", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.155:0", "nonce": 881827995, "type": "any" }, "name": { "num": 5416, "type": "client" } }, "id": 5416, "inst": "client.5416 172.21.15.155:0/881827995", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 15, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.942102159149858 }, "state": "open", "uptime": 1.155986732 } ] 2024-09-17T05:30:24.338 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:30:29.339 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:30:29.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.492+0000 7efea6600640 1 -- 172.21.15.31:0/3840395994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efea0159990 msgr2=0x7efea00d0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.492+0000 7efea6600640 1 --2- 172.21.15.31:0/3840395994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efea0159990 0x7efea00d0420 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efe90009840 tx=0x7efe9001c820 comp rx=0 tx=0).stop 2024-09-17T05:30:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.492+0000 7efea6600640 1 -- 172.21.15.31:0/3840395994 shutdown_connections 2024-09-17T05:30:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.492+0000 7efea6600640 1 --2- 172.21.15.31:0/3840395994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efea00afac0 0x7efea00d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.492+0000 7efea6600640 1 --2- 172.21.15.31:0/3840395994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efea0159990 0x7efea00d0420 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.492+0000 7efea6600640 1 -- 172.21.15.31:0/3840395994 >> 172.21.15.31:0/3840395994 conn(0x7efea00b2240 msgr2=0x7efea00b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.492+0000 7efea6600640 1 -- 172.21.15.31:0/3840395994 shutdown_connections 2024-09-17T05:30:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.492+0000 7efea6600640 1 -- 172.21.15.31:0/3840395994 wait complete. 2024-09-17T05:30:29.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.492+0000 7efea6600640 1 Processor -- start 2024-09-17T05:30:29.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.492+0000 7efea6600640 1 -- start start 2024-09-17T05:30:29.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efea6600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efea006f1d0 0x7efea00b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:29.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efea6600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efea00afac0 0x7efea01565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:29.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efea6600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efea0159990 0x7efea0156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:29.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efea6600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efea01691e0 con 0x7efea0159990 2024-09-17T05:30:29.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efea6600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efea0169060 con 0x7efea00afac0 2024-09-17T05:30:29.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efea6600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efea0169360 con 0x7efea006f1d0 2024-09-17T05:30:29.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efe9fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efea0159990 0x7efea0156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:29.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efe9fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efea0159990 0x7efea0156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48484/0 (socket says 172.21.15.31:48484) 2024-09-17T05:30:29.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efe9fe00640 1 -- 172.21.15.31:0/672591319 learned_addr learned my addr 172.21.15.31:0/672591319 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:29.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efe97e00640 1 --2- 172.21.15.31:0/672591319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efea00afac0 0x7efea01565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:29.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efe9f400640 1 --2- 172.21.15.31:0/672591319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efea006f1d0 0x7efea00b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:29.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efe9fe00640 1 -- 172.21.15.31:0/672591319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efea006f1d0 msgr2=0x7efea00b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:29.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efe9fe00640 1 --2- 172.21.15.31:0/672591319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efea006f1d0 0x7efea00b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:29.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efe9fe00640 1 -- 172.21.15.31:0/672591319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efea00afac0 msgr2=0x7efea01565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:29.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efe9fe00640 1 --2- 172.21.15.31:0/672591319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efea00afac0 0x7efea01565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:29.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efe9fe00640 1 -- 172.21.15.31:0/672591319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea00cd470 con 0x7efea0159990 2024-09-17T05:30:29.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efe9fe00640 1 --2- 172.21.15.31:0/672591319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efea0159990 0x7efea0156b10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efe9800cbf0 tx=0x7efe9800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:29.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efe97400640 1 -- 172.21.15.31:0/672591319 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe98016020 con 0x7efea0159990 2024-09-17T05:30:29.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efe97400640 1 -- 172.21.15.31:0/672591319 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe9800ab00 con 0x7efea0159990 2024-09-17T05:30:29.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efea6600640 1 -- 172.21.15.31:0/672591319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea00cd750 con 0x7efea0159990 2024-09-17T05:30:29.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efe97400640 1 -- 172.21.15.31:0/672591319 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe98012420 con 0x7efea0159990 2024-09-17T05:30:29.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efea6600640 1 -- 172.21.15.31:0/672591319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea014f420 con 0x7efea0159990 2024-09-17T05:30:29.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.496+0000 7efea6600640 1 -- 172.21.15.31:0/672591319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efea00cd990 con 0x7efea0159990 2024-09-17T05:30:29.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.500+0000 7efe97400640 1 -- 172.21.15.31:0/672591319 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 7) ==== 97438+0+0 (secure 0 0 0) 0x7efe98019020 con 0x7efea0159990 2024-09-17T05:30:29.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.500+0000 7efe97400640 1 --2- 172.21.15.31:0/672591319 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe7c073440 0x7efe7c075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:29.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.500+0000 7efe97400640 1 -- 172.21.15.31:0/672591319 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7efe98094930 con 0x7efea0159990 2024-09-17T05:30:29.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.500+0000 7efe9f400640 1 --2- 172.21.15.31:0/672591319 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe7c073440 0x7efe7c075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:29.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.500+0000 7efe9f400640 1 --2- 172.21.15.31:0/672591319 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe7c073440 0x7efe7c075900 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efe900af000 tx=0x7efe9001b060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:29.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.504+0000 7efe97400640 1 -- 172.21.15.31:0/672591319 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7efea00cd990 con 0x7efea0159990 2024-09-17T05:30:29.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.716+0000 7efea6600640 1 -- 172.21.15.31:0/672591319 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efea006cc20 con 0x7efea0159990 2024-09-17T05:30:29.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.716+0000 7efe97400640 1 -- 172.21.15.31:0/672591319 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7efe98020020 con 0x7efea0159990 2024-09-17T05:30:29.723 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:29.723 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T05:30:20:371375+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:30:29.723 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T05:30:29.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.720+0000 7efea6600640 1 -- 172.21.15.31:0/672591319 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe7c073440 msgr2=0x7efe7c075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:29.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.720+0000 7efea6600640 1 --2- 172.21.15.31:0/672591319 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe7c073440 0x7efe7c075900 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efe900af000 tx=0x7efe9001b060 comp rx=0 tx=0).stop 2024-09-17T05:30:29.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.720+0000 7efea6600640 1 -- 172.21.15.31:0/672591319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efea0159990 msgr2=0x7efea0156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:29.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.720+0000 7efea6600640 1 --2- 172.21.15.31:0/672591319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efea0159990 0x7efea0156b10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efe9800cbf0 tx=0x7efe9800cce0 comp rx=0 tx=0).stop 2024-09-17T05:30:29.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.720+0000 7efea6600640 1 -- 172.21.15.31:0/672591319 shutdown_connections 2024-09-17T05:30:29.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.720+0000 7efea6600640 1 --2- 172.21.15.31:0/672591319 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efe7c073440 0x7efe7c075900 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:29.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.720+0000 7efea6600640 1 --2- 172.21.15.31:0/672591319 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efea0159990 0x7efea0156b10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:29.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.720+0000 7efea6600640 1 --2- 172.21.15.31:0/672591319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efea00afac0 0x7efea01565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:29.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.720+0000 7efea6600640 1 --2- 172.21.15.31:0/672591319 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efea006f1d0 0x7efea00b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:29.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.720+0000 7efea6600640 1 -- 172.21.15.31:0/672591319 >> 172.21.15.31:0/672591319 conn(0x7efea00b2240 msgr2=0x7efea0155e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:29.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.720+0000 7efea6600640 1 -- 172.21.15.31:0/672591319 shutdown_connections 2024-09-17T05:30:29.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:29.720+0000 7efea6600640 1 -- 172.21.15.31:0/672591319 wait complete. 2024-09-17T05:30:29.747 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:30:29.912 INFO:teuthology.orchestra.run.smithi031.stdout:[{"id":5416,"entity":{"name":{"type":"client","num":5416},"addr":{"type":"any","addr":"172.21.15.155:0","nonce":881827995}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":6.7319391829999997,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.661231123310742,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5416 172.21.15.155:0/881827995","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi155","pid":"28855","root":"/"}}] 2024-09-17T05:30:29.912 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi155", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28855", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.155:0", "nonce": 881827995, "type": "any" }, "name": { "num": 5416, "type": "client" } }, "id": 5416, "inst": "client.5416 172.21.15.155:0/881827995", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.661231123310742 }, "state": "open", "uptime": 6.731939183 } ] 2024-09-17T05:30:29.913 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:30:34.913 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:30:35.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.068+0000 7f0953e00640 1 -- 172.21.15.31:0/3297277375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0938003c40 msgr2=0x7f0938004040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:35.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.068+0000 7f0953e00640 1 --2- 172.21.15.31:0/3297277375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0938003c40 0x7f0938004040 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0944009d30 tx=0x7f094401d430 comp rx=0 tx=0).stop 2024-09-17T05:30:35.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.068+0000 7f0953e00640 1 -- 172.21.15.31:0/3297277375 shutdown_connections 2024-09-17T05:30:35.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.068+0000 7f0953e00640 1 --2- 172.21.15.31:0/3297277375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0938003c40 0x7f0938004040 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:35.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.068+0000 7f0953e00640 1 -- 172.21.15.31:0/3297277375 >> 172.21.15.31:0/3297277375 conn(0x7f095409aa10 msgr2=0x7f095409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:35.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.068+0000 7f0953e00640 1 -- 172.21.15.31:0/3297277375 shutdown_connections 2024-09-17T05:30:35.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.068+0000 7f0953e00640 1 -- 172.21.15.31:0/3297277375 wait complete. 2024-09-17T05:30:35.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.068+0000 7f0953e00640 1 Processor -- start 2024-09-17T05:30:35.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.068+0000 7f0953e00640 1 -- start start 2024-09-17T05:30:35.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.068+0000 7f0953e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0938003c40 0x7f095415d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:35.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.068+0000 7f0953e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f095414e440 0x7f095414bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:35.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f0953e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09541eb9c0 0x7f09541ebe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:35.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f0953e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f09540d1d60 con 0x7f0938003c40 2024-09-17T05:30:35.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f0953e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f09540d1be0 con 0x7f095414e440 2024-09-17T05:30:35.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f0953e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f09540d1ee0 con 0x7f09541eb9c0 2024-09-17T05:30:35.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f0952a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0938003c40 0x7f095415d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:35.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f0952a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0938003c40 0x7f095415d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:48506/0 (socket says 172.21.15.31:48506) 2024-09-17T05:30:35.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f0952a00640 1 -- 172.21.15.31:0/2702448883 learned_addr learned my addr 172.21.15.31:0/2702448883 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:35.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f0953400640 1 --2- 172.21.15.31:0/2702448883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09541eb9c0 0x7f09541ebe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f094be00640 1 --2- 172.21.15.31:0/2702448883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f095414e440 0x7f095414bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f0952a00640 1 -- 172.21.15.31:0/2702448883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09541eb9c0 msgr2=0x7f09541ebe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f0952a00640 1 --2- 172.21.15.31:0/2702448883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09541eb9c0 0x7f09541ebe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f0952a00640 1 -- 172.21.15.31:0/2702448883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f095414e440 msgr2=0x7f095414bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f0952a00640 1 --2- 172.21.15.31:0/2702448883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f095414e440 0x7f095414bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f0952a00640 1 -- 172.21.15.31:0/2702448883 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09540c7630 con 0x7f0938003c40 2024-09-17T05:30:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f0953400640 1 --2- 172.21.15.31:0/2702448883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09541eb9c0 0x7f09541ebe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:30:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f0952a00640 1 --2- 172.21.15.31:0/2702448883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0938003c40 0x7f095415d9f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f094401d260 tx=0x7f09440056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f094aa00640 1 -- 172.21.15.31:0/2702448883 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0944009900 con 0x7f0938003c40 2024-09-17T05:30:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f094aa00640 1 -- 172.21.15.31:0/2702448883 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09440044c0 con 0x7f0938003c40 2024-09-17T05:30:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f094aa00640 1 -- 172.21.15.31:0/2702448883 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0944004910 con 0x7f0938003c40 2024-09-17T05:30:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f0953e00640 1 -- 172.21.15.31:0/2702448883 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f095414c0f0 con 0x7f0938003c40 2024-09-17T05:30:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f0953e00640 1 -- 172.21.15.31:0/2702448883 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f095414ebc0 con 0x7f0938003c40 2024-09-17T05:30:35.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f0953e00640 1 -- 172.21.15.31:0/2702448883 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f095415f730 con 0x7f0938003c40 2024-09-17T05:30:35.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.072+0000 7f094aa00640 1 -- 172.21.15.31:0/2702448883 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 7) ==== 97438+0+0 (secure 0 0 0) 0x7f09440c0020 con 0x7f0938003c40 2024-09-17T05:30:35.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.076+0000 7f094aa00640 1 --2- 172.21.15.31:0/2702448883 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0930073440 0x7f0930075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:35.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.076+0000 7f094aa00640 1 -- 172.21.15.31:0/2702448883 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f094412f8b0 con 0x7f0938003c40 2024-09-17T05:30:35.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.076+0000 7f094be00640 1 --2- 172.21.15.31:0/2702448883 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0930073440 0x7f0930075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:35.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.076+0000 7f094be00640 1 --2- 172.21.15.31:0/2702448883 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0930073440 0x7f0930075900 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f095415df30 tx=0x7f093c000ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:35.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.080+0000 7f094aa00640 1 -- 172.21.15.31:0/2702448883 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f09440c7020 con 0x7f0938003c40 2024-09-17T05:30:35.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.292+0000 7f0953e00640 1 -- 172.21.15.31:0/2702448883 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09540710e0 con 0x7f0938003c40 2024-09-17T05:30:35.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.292+0000 7f094aa00640 1 -- 172.21.15.31:0/2702448883 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7f09540c7630 con 0x7f0938003c40 2024-09-17T05:30:35.298 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:35.298 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T05:30:20:371375+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:30:35.298 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T05:30:35.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.296+0000 7f0953e00640 1 -- 172.21.15.31:0/2702448883 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0930073440 msgr2=0x7f0930075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:35.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.296+0000 7f0953e00640 1 --2- 172.21.15.31:0/2702448883 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0930073440 0x7f0930075900 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f095415df30 tx=0x7f093c000ee0 comp rx=0 tx=0).stop 2024-09-17T05:30:35.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.296+0000 7f0953e00640 1 -- 172.21.15.31:0/2702448883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0938003c40 msgr2=0x7f095415d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:35.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.296+0000 7f0953e00640 1 --2- 172.21.15.31:0/2702448883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0938003c40 0x7f095415d9f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f094401d260 tx=0x7f09440056a0 comp rx=0 tx=0).stop 2024-09-17T05:30:35.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.296+0000 7f0953e00640 1 -- 172.21.15.31:0/2702448883 shutdown_connections 2024-09-17T05:30:35.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.296+0000 7f0953e00640 1 --2- 172.21.15.31:0/2702448883 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0930073440 0x7f0930075900 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:35.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.296+0000 7f0953e00640 1 --2- 172.21.15.31:0/2702448883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f09541eb9c0 0x7f09541ebe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:35.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.296+0000 7f0953e00640 1 --2- 172.21.15.31:0/2702448883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f095414e440 0x7f095414bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:35.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.296+0000 7f0953e00640 1 --2- 172.21.15.31:0/2702448883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0938003c40 0x7f095415d9f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:35.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.296+0000 7f0953e00640 1 -- 172.21.15.31:0/2702448883 >> 172.21.15.31:0/2702448883 conn(0x7f095409aa10 msgr2=0x7f09540b6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:35.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.296+0000 7f0953e00640 1 -- 172.21.15.31:0/2702448883 shutdown_connections 2024-09-17T05:30:35.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:35.296+0000 7f0953e00640 1 -- 172.21.15.31:0/2702448883 wait complete. 2024-09-17T05:30:35.320 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:30:35.485 INFO:teuthology.orchestra.run.smithi031.stdout:[{"id":5416,"entity":{"name":{"type":"client","num":5416},"addr":{"type":"any","addr":"172.21.15.155:0","nonce":881827995}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":12.303892981000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.384152956050734,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5416 172.21.15.155:0/881827995","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi155","pid":"28855","root":"/"}}] 2024-09-17T05:30:35.485 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi155", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28855", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.155:0", "nonce": 881827995, "type": "any" }, "name": { "num": 5416, "type": "client" } }, "id": 5416, "inst": "client.5416 172.21.15.155:0/881827995", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.384152956050734 }, "state": "open", "uptime": 12.303892981 } ] 2024-09-17T05:30:35.486 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:30:40.486 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:30:40.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.644+0000 7fa3b3200640 1 -- 172.21.15.31:0/1586175622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa398004da0 msgr2=0x7fa398005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:40.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.644+0000 7fa3b3200640 1 --2- 172.21.15.31:0/1586175622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa398004da0 0x7fa398005220 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00c610 tx=0x7fa3ac01f9a0 comp rx=0 tx=0).stop 2024-09-17T05:30:40.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.644+0000 7fa3b2800640 1 -- 172.21.15.31:0/1586175622 reap_dead start 2024-09-17T05:30:40.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.644+0000 7fa3b3200640 1 -- 172.21.15.31:0/1586175622 shutdown_connections 2024-09-17T05:30:40.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.644+0000 7fa3b3200640 1 -- 172.21.15.31:0/1586175622 >> 172.21.15.31:0/1586175622 conn(0x7fa3b406dd30 msgr2=0x7fa3b406e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:40.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.644+0000 7fa3b3200640 1 -- 172.21.15.31:0/1586175622 shutdown_connections 2024-09-17T05:30:40.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.644+0000 7fa3b3200640 1 -- 172.21.15.31:0/1586175622 wait complete. 2024-09-17T05:30:40.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b3200640 1 Processor -- start 2024-09-17T05:30:40.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b3200640 1 -- start start 2024-09-17T05:30:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b3200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa398004da0 0x7fa3b406d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b3200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b40c3990 0x7fa3b40c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b3200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3b40ca4b0 0x7fa3b40ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b3200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b40cd8a0 con 0x7fa398004da0 2024-09-17T05:30:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b3200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b40cd720 con 0x7fa3b40c3990 2024-09-17T05:30:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b3200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b40cf130 con 0x7fa3b40ca4b0 2024-09-17T05:30:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa398004da0 0x7fa3b406d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa398004da0 0x7fa3b406d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56938/0 (socket says 172.21.15.31:56938) 2024-09-17T05:30:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b1e00640 1 -- 172.21.15.31:0/2119278090 learned_addr learned my addr 172.21.15.31:0/2119278090 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b1e00640 1 -- 172.21.15.31:0/2119278090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3b40ca4b0 msgr2=0x7fa3b40ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:40.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b1e00640 1 --2- 172.21.15.31:0/2119278090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3b40ca4b0 0x7fa3b40ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:40.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b1e00640 1 -- 172.21.15.31:0/2119278090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b40c3990 msgr2=0x7fa3b40c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:40.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b1e00640 1 --2- 172.21.15.31:0/2119278090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b40c3990 0x7fa3b40c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:40.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b1e00640 1 -- 172.21.15.31:0/2119278090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b4154c40 con 0x7fa398004da0 2024-09-17T05:30:40.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b1e00640 1 --2- 172.21.15.31:0/2119278090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa398004da0 0x7fa3b406d770 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4011ac0 tx=0x7fa3a4011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:40.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3aa000640 1 -- 172.21.15.31:0/2119278090 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a401e070 con 0x7fa398004da0 2024-09-17T05:30:40.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3aa000640 1 -- 172.21.15.31:0/2119278090 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3a4004460 con 0x7fa398004da0 2024-09-17T05:30:40.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3aa000640 1 -- 172.21.15.31:0/2119278090 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a400fc60 con 0x7fa398004da0 2024-09-17T05:30:40.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b3200640 1 -- 172.21.15.31:0/2119278090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b41f6f30 con 0x7fa398004da0 2024-09-17T05:30:40.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.648+0000 7fa3b3200640 1 -- 172.21.15.31:0/2119278090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b41f2ed0 con 0x7fa398004da0 2024-09-17T05:30:40.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.652+0000 7fa3b3200640 1 -- 172.21.15.31:0/2119278090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b40cf620 con 0x7fa398004da0 2024-09-17T05:30:40.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.652+0000 7fa3aa000640 1 -- 172.21.15.31:0/2119278090 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 7) ==== 97438+0+0 (secure 0 0 0) 0x7fa3a4021070 con 0x7fa398004da0 2024-09-17T05:30:40.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.652+0000 7fa3aa000640 1 --2- 172.21.15.31:0/2119278090 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa390073470 0x7fa390075930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:40.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.652+0000 7fa3aa000640 1 -- 172.21.15.31:0/2119278090 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fa3a40950c0 con 0x7fa398004da0 2024-09-17T05:30:40.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.652+0000 7fa3abe00640 1 --2- 172.21.15.31:0/2119278090 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa390073470 0x7fa390075930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:40.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.652+0000 7fa3abe00640 1 --2- 172.21.15.31:0/2119278090 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa390073470 0x7fa390075930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa39c000fc0 tx=0x7fa39c000f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:40.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.656+0000 7fa3aa000640 1 -- 172.21.15.31:0/2119278090 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa3a405f720 con 0x7fa398004da0 2024-09-17T05:30:40.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.868+0000 7fa3b3200640 1 -- 172.21.15.31:0/2119278090 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3b406e3f0 con 0x7fa398004da0 2024-09-17T05:30:40.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.868+0000 7fa3aa000640 1 -- 172.21.15.31:0/2119278090 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7fa3a4064150 con 0x7fa398004da0 2024-09-17T05:30:40.874 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:40.874 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T05:30:20:371375+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:30:40.874 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T05:30:40.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.872+0000 7fa3b3200640 1 -- 172.21.15.31:0/2119278090 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa390073470 msgr2=0x7fa390075930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:40.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.872+0000 7fa3b3200640 1 --2- 172.21.15.31:0/2119278090 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa390073470 0x7fa390075930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa39c000fc0 tx=0x7fa39c000f30 comp rx=0 tx=0).stop 2024-09-17T05:30:40.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.872+0000 7fa3b3200640 1 -- 172.21.15.31:0/2119278090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa398004da0 msgr2=0x7fa3b406d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:40.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.872+0000 7fa3b3200640 1 --2- 172.21.15.31:0/2119278090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa398004da0 0x7fa3b406d770 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4011ac0 tx=0x7fa3a4011f80 comp rx=0 tx=0).stop 2024-09-17T05:30:40.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.872+0000 7fa3b3200640 1 -- 172.21.15.31:0/2119278090 shutdown_connections 2024-09-17T05:30:40.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.872+0000 7fa3b3200640 1 --2- 172.21.15.31:0/2119278090 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa390073470 0x7fa390075930 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:40.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.872+0000 7fa3b3200640 1 --2- 172.21.15.31:0/2119278090 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3b40ca4b0 0x7fa3b40ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:40.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.872+0000 7fa3b3200640 1 --2- 172.21.15.31:0/2119278090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b40c3990 0x7fa3b40c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:40.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.872+0000 7fa3b3200640 1 --2- 172.21.15.31:0/2119278090 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa398004da0 0x7fa3b406d770 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:40.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.872+0000 7fa3b3200640 1 -- 172.21.15.31:0/2119278090 >> 172.21.15.31:0/2119278090 conn(0x7fa3b406dd30 msgr2=0x7fa3b406f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:40.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.872+0000 7fa3b3200640 1 -- 172.21.15.31:0/2119278090 shutdown_connections 2024-09-17T05:30:40.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:40.872+0000 7fa3b3200640 1 -- 172.21.15.31:0/2119278090 wait complete. 2024-09-17T05:30:40.896 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:30:41.061 INFO:teuthology.orchestra.run.smithi031.stdout:[{"id":5416,"entity":{"name":{"type":"client","num":5416},"addr":{"type":"any","addr":"172.21.15.155:0","nonce":881827995}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":17.879846668999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.110423918074996,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5416 172.21.15.155:0/881827995","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi155","pid":"28855","root":"/"}}] 2024-09-17T05:30:41.061 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi155", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28855", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.155:0", "nonce": 881827995, "type": "any" }, "name": { "num": 5416, "type": "client" } }, "id": 5416, "inst": "client.5416 172.21.15.155:0/881827995", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.110423918074996 }, "state": "open", "uptime": 17.879846669 } ] 2024-09-17T05:30:41.061 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:30:41.910 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:30:41.914 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:30:46.063 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:30:46.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.216+0000 7ff0af200640 1 -- 172.21.15.31:0/898225760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0b00cefb0 msgr2=0x7ff0b00cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:46.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.216+0000 7ff0af200640 1 --2- 172.21.15.31:0/898225760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0b00cefb0 0x7ff0b00cc5b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00c56a0 tx=0x7ff09801c580 comp rx=0 tx=0).stop 2024-09-17T05:30:46.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.216+0000 7ff0af200640 1 -- 172.21.15.31:0/898225760 shutdown_connections 2024-09-17T05:30:46.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.216+0000 7ff0af200640 1 --2- 172.21.15.31:0/898225760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0b00cefb0 0x7ff0b00cc5b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:46.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.216+0000 7ff0af200640 1 --2- 172.21.15.31:0/898225760 >> v2:172.21.15.155:3300/0 conn(0x7ff0b015f000 0x7ff0b00d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:46.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.216+0000 7ff0af200640 1 -- 172.21.15.31:0/898225760 >> 172.21.15.31:0/898225760 conn(0x7ff0b009aa10 msgr2=0x7ff0b009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:46.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.216+0000 7ff0af200640 1 -- 172.21.15.31:0/898225760 shutdown_connections 2024-09-17T05:30:46.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.216+0000 7ff0af200640 1 -- 172.21.15.31:0/898225760 wait complete. 2024-09-17T05:30:46.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0af200640 1 Processor -- start 2024-09-17T05:30:46.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0af200640 1 -- start start 2024-09-17T05:30:46.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0af200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b00ccaf0 0x7ff0b0158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:46.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0af200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0b00cefb0 0x7ff0b015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0af200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b015f000 0x7ff0b0071c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0af200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b0169290 con 0x7ff0b00cefb0 2024-09-17T05:30:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0af200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b0169110 con 0x7ff0b00ccaf0 2024-09-17T05:30:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0af200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b0169410 con 0x7ff0b015f000 2024-09-17T05:30:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0a7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0b00cefb0 0x7ff0b015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0a7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0b00cefb0 0x7ff0b015b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56960/0 (socket says 172.21.15.31:56960) 2024-09-17T05:30:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0a7e00640 1 -- 172.21.15.31:0/1024392759 learned_addr learned my addr 172.21.15.31:0/1024392759 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0ade00640 1 --2- 172.21.15.31:0/1024392759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b00ccaf0 0x7ff0b0158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0ae800640 1 --2- 172.21.15.31:0/1024392759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b015f000 0x7ff0b0071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0a7e00640 1 -- 172.21.15.31:0/1024392759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b015f000 msgr2=0x7ff0b0071c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0a7e00640 1 --2- 172.21.15.31:0/1024392759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b015f000 0x7ff0b0071c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0a7e00640 1 -- 172.21.15.31:0/1024392759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b00ccaf0 msgr2=0x7ff0b0158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:46.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0a7e00640 1 --2- 172.21.15.31:0/1024392759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b00ccaf0 0x7ff0b0158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0a7e00640 1 -- 172.21.15.31:0/1024392759 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b006d0e0 con 0x7ff0b00cefb0 2024-09-17T05:30:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0ae800640 1 --2- 172.21.15.31:0/1024392759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b015f000 0x7ff0b0071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:30:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0a7e00640 1 --2- 172.21.15.31:0/1024392759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0b00cefb0 0x7ff0b015b7a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff09801ac30 tx=0x7ff0980ab4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0a6000640 1 -- 172.21.15.31:0/1024392759 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0980abae0 con 0x7ff0b00cefb0 2024-09-17T05:30:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0a6000640 1 -- 172.21.15.31:0/1024392759 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0980b9070 con 0x7ff0b00cefb0 2024-09-17T05:30:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0a6000640 1 -- 172.21.15.31:0/1024392759 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098005030 con 0x7ff0b00cefb0 2024-09-17T05:30:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0af200640 1 -- 172.21.15.31:0/1024392759 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b00d01b0 con 0x7ff0b00cefb0 2024-09-17T05:30:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.220+0000 7ff0af200640 1 -- 172.21.15.31:0/1024392759 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b00c8f80 con 0x7ff0b00cefb0 2024-09-17T05:30:46.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.224+0000 7ff0af200640 1 -- 172.21.15.31:0/1024392759 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0b00cc5b0 con 0x7ff0b00cefb0 2024-09-17T05:30:46.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.224+0000 7ff0a6000640 1 -- 172.21.15.31:0/1024392759 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 7) ==== 97438+0+0 (secure 0 0 0) 0x7ff0980051f0 con 0x7ff0b00cefb0 2024-09-17T05:30:46.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.224+0000 7ff0a6000640 1 --2- 172.21.15.31:0/1024392759 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff08c073440 0x7ff08c075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:46.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.224+0000 7ff0a6000640 1 -- 172.21.15.31:0/1024392759 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7ff09812f220 con 0x7ff0b00cefb0 2024-09-17T05:30:46.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.224+0000 7ff0ade00640 1 --2- 172.21.15.31:0/1024392759 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff08c073440 0x7ff08c075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:46.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.224+0000 7ff0ade00640 1 --2- 172.21.15.31:0/1024392759 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff08c073440 0x7ff08c075900 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff0b015b730 tx=0x7ff0a000b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:46.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.228+0000 7ff0a6000640 1 -- 172.21.15.31:0/1024392759 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff0b00cf400 con 0x7ff0b00cefb0 2024-09-17T05:30:46.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.444+0000 7ff0af200640 1 -- 172.21.15.31:0/1024392759 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0b0076210 con 0x7ff0b00cefb0 2024-09-17T05:30:46.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.444+0000 7ff0a6000640 1 -- 172.21.15.31:0/1024392759 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7ff0980f9e90 con 0x7ff0b00cefb0 2024-09-17T05:30:46.449 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:46.449 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T05:30:20:371375+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:30:46.450 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T05:30:46.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.444+0000 7ff0af200640 1 -- 172.21.15.31:0/1024392759 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff08c073440 msgr2=0x7ff08c075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:46.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.444+0000 7ff0af200640 1 --2- 172.21.15.31:0/1024392759 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff08c073440 0x7ff08c075900 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff0b015b730 tx=0x7ff0a000b2e0 comp rx=0 tx=0).stop 2024-09-17T05:30:46.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.444+0000 7ff0af200640 1 -- 172.21.15.31:0/1024392759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0b00cefb0 msgr2=0x7ff0b015b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:46.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.444+0000 7ff0af200640 1 --2- 172.21.15.31:0/1024392759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0b00cefb0 0x7ff0b015b7a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff09801ac30 tx=0x7ff0980ab4d0 comp rx=0 tx=0).stop 2024-09-17T05:30:46.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.448+0000 7ff0af200640 1 -- 172.21.15.31:0/1024392759 shutdown_connections 2024-09-17T05:30:46.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.448+0000 7ff0af200640 1 --2- 172.21.15.31:0/1024392759 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff08c073440 0x7ff08c075900 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:46.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.448+0000 7ff0af200640 1 --2- 172.21.15.31:0/1024392759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b015f000 0x7ff0b0071c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:46.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.448+0000 7ff0af200640 1 --2- 172.21.15.31:0/1024392759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0b00cefb0 0x7ff0b015b7a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:46.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.448+0000 7ff0af200640 1 --2- 172.21.15.31:0/1024392759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b00ccaf0 0x7ff0b0158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:46.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.448+0000 7ff0af200640 1 -- 172.21.15.31:0/1024392759 >> 172.21.15.31:0/1024392759 conn(0x7ff0b009aa10 msgr2=0x7ff0b00759a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:46.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.448+0000 7ff0af200640 1 -- 172.21.15.31:0/1024392759 shutdown_connections 2024-09-17T05:30:46.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:46.448+0000 7ff0af200640 1 -- 172.21.15.31:0/1024392759 wait complete. 2024-09-17T05:30:46.473 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:30:46.639 INFO:teuthology.orchestra.run.smithi031.stdout:[{"id":5416,"entity":{"name":{"type":"client","num":5416},"addr":{"type":"any","addr":"172.21.15.155:0","nonce":881827995}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":12,"uptime":23.459800256000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.840006165277408,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5416 172.21.15.155:0/881827995","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi155","pid":"28855","root":"/"}}] 2024-09-17T05:30:46.639 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi155", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28855", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.155:0", "nonce": 881827995, "type": "any" }, "name": { "num": 5416, "type": "client" } }, "id": 5416, "inst": "client.5416 172.21.15.155:0/881827995", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 12, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.84000616527741 }, "state": "open", "uptime": 23.459800256 } ] 2024-09-17T05:30:46.640 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:30:51.640 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:30:51.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.796+0000 7f61c1000640 1 -- 172.21.15.31:0/3463865046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61a0004e70 msgr2=0x7f61a000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:51.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.796+0000 7f61c1000640 1 --2- 172.21.15.31:0/3463865046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61a0004e70 0x7f61a000b9d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f61b4001dc0 tx=0x7f61b401caf0 comp rx=0 tx=0).stop 2024-09-17T05:30:51.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.796+0000 7f61ba800640 1 -- 172.21.15.31:0/3463865046 reap_dead start 2024-09-17T05:30:51.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.796+0000 7f61c1000640 1 -- 172.21.15.31:0/3463865046 shutdown_connections 2024-09-17T05:30:51.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.796+0000 7f61c1000640 1 -- 172.21.15.31:0/3463865046 >> 172.21.15.31:0/3463865046 conn(0x7f61bc0d1e30 msgr2=0x7f61bc0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:51.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.796+0000 7f61c1000640 1 -- 172.21.15.31:0/3463865046 shutdown_connections 2024-09-17T05:30:51.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.796+0000 7f61c1000640 1 -- 172.21.15.31:0/3463865046 wait complete. 2024-09-17T05:30:51.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.796+0000 7f61c1000640 1 Processor -- start 2024-09-17T05:30:51.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.796+0000 7f61c1000640 1 -- start start 2024-09-17T05:30:51.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.796+0000 7f61c1000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61a0004e70 0x7f61bc0c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:51.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.796+0000 7f61c1000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61bc15d080 0x7f61bc1f8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:51.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.796+0000 7f61c1000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61bc1f92e0 0x7f61bc1f9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:51.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.796+0000 7f61c1000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc167e00 con 0x7f61a0004e70 2024-09-17T05:30:51.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.796+0000 7f61c1000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc167c80 con 0x7f61bc15d080 2024-09-17T05:30:51.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.796+0000 7f61c1000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f61bc167f80 con 0x7f61bc1f92e0 2024-09-17T05:30:51.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61b9e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61a0004e70 0x7f61bc0c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:51.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61b9e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61a0004e70 0x7f61bc0c8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44102/0 (socket says 172.21.15.31:44102) 2024-09-17T05:30:51.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61b9e00640 1 -- 172.21.15.31:0/2455235099 learned_addr learned my addr 172.21.15.31:0/2455235099 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:51.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61ba800640 1 --2- 172.21.15.31:0/2455235099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61bc1f92e0 0x7f61bc1f9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:51.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61b3e00640 1 --2- 172.21.15.31:0/2455235099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61bc15d080 0x7f61bc1f8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:51.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61b9e00640 1 -- 172.21.15.31:0/2455235099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61bc1f92e0 msgr2=0x7f61bc1f9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:51.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61b9e00640 1 --2- 172.21.15.31:0/2455235099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61bc1f92e0 0x7f61bc1f9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:51.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61b9e00640 1 -- 172.21.15.31:0/2455235099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61bc15d080 msgr2=0x7f61bc1f8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:51.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61b9e00640 1 --2- 172.21.15.31:0/2455235099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61bc15d080 0x7f61bc1f8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:51.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61b9e00640 1 -- 172.21.15.31:0/2455235099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61bc159260 con 0x7f61a0004e70 2024-09-17T05:30:51.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61ba800640 1 --2- 172.21.15.31:0/2455235099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61bc1f92e0 0x7f61bc1f9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:30:51.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61b9e00640 1 --2- 172.21.15.31:0/2455235099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61a0004e70 0x7f61bc0c8030 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00e600 tx=0x7f61ac00ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:51.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61b2000640 1 -- 172.21.15.31:0/2455235099 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac015070 con 0x7f61a0004e70 2024-09-17T05:30:51.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61b2000640 1 -- 172.21.15.31:0/2455235099 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61ac010980 con 0x7f61a0004e70 2024-09-17T05:30:51.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61b2000640 1 -- 172.21.15.31:0/2455235099 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac010db0 con 0x7f61a0004e70 2024-09-17T05:30:51.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61c1000640 1 -- 172.21.15.31:0/2455235099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61bc0b5cf0 con 0x7f61a0004e70 2024-09-17T05:30:51.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61c1000640 1 -- 172.21.15.31:0/2455235099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61bc162810 con 0x7f61a0004e70 2024-09-17T05:30:51.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61c1000640 1 -- 172.21.15.31:0/2455235099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61bc159480 con 0x7f61a0004e70 2024-09-17T05:30:51.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.800+0000 7f61b2000640 1 -- 172.21.15.31:0/2455235099 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 7) ==== 97438+0+0 (secure 0 0 0) 0x7f61ac018070 con 0x7f61a0004e70 2024-09-17T05:30:51.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.804+0000 7f61b2000640 1 --2- 172.21.15.31:0/2455235099 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6198073440 0x7f6198075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:51.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.804+0000 7f61b2000640 1 -- 172.21.15.31:0/2455235099 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f61ac094b20 con 0x7f61a0004e70 2024-09-17T05:30:51.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.804+0000 7f61b3e00640 1 --2- 172.21.15.31:0/2455235099 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6198073440 0x7f6198075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:51.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.804+0000 7f61b3e00640 1 --2- 172.21.15.31:0/2455235099 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6198073440 0x7f6198075900 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009c60 tx=0x7f61a40091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:51.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:51.808+0000 7f61b2000640 1 -- 172.21.15.31:0/2455235099 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f61bc0b5cf0 con 0x7f61a0004e70 2024-09-17T05:30:52.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:52.020+0000 7f61c1000640 1 -- 172.21.15.31:0/2455235099 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61bc1629e0 con 0x7f61a0004e70 2024-09-17T05:30:52.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:52.020+0000 7f61b2000640 1 -- 172.21.15.31:0/2455235099 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7f61bc159260 con 0x7f61a0004e70 2024-09-17T05:30:52.025 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:52.025 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T05:30:20:371375+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:30:52.025 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T05:30:52.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:52.020+0000 7f61c1000640 1 -- 172.21.15.31:0/2455235099 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6198073440 msgr2=0x7f6198075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:52.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:52.020+0000 7f61c1000640 1 --2- 172.21.15.31:0/2455235099 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6198073440 0x7f6198075900 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009c60 tx=0x7f61a40091e0 comp rx=0 tx=0).stop 2024-09-17T05:30:52.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:52.020+0000 7f61c1000640 1 -- 172.21.15.31:0/2455235099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61a0004e70 msgr2=0x7f61bc0c8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:52.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:52.020+0000 7f61c1000640 1 --2- 172.21.15.31:0/2455235099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61a0004e70 0x7f61bc0c8030 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00e600 tx=0x7f61ac00ea00 comp rx=0 tx=0).stop 2024-09-17T05:30:52.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:52.020+0000 7f61c1000640 1 -- 172.21.15.31:0/2455235099 shutdown_connections 2024-09-17T05:30:52.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:52.020+0000 7f61c1000640 1 --2- 172.21.15.31:0/2455235099 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6198073440 0x7f6198075900 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:52.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:52.020+0000 7f61c1000640 1 --2- 172.21.15.31:0/2455235099 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61bc1f92e0 0x7f61bc1f9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:52.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:52.020+0000 7f61c1000640 1 --2- 172.21.15.31:0/2455235099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61bc15d080 0x7f61bc1f8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:52.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:52.020+0000 7f61c1000640 1 --2- 172.21.15.31:0/2455235099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61a0004e70 0x7f61bc0c8030 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:52.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:52.020+0000 7f61c1000640 1 -- 172.21.15.31:0/2455235099 >> 172.21.15.31:0/2455235099 conn(0x7f61bc0d1e30 msgr2=0x7f61bc0b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:52.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:52.020+0000 7f61c1000640 1 -- 172.21.15.31:0/2455235099 shutdown_connections 2024-09-17T05:30:52.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:52.020+0000 7f61c1000640 1 -- 172.21.15.31:0/2455235099 wait complete. 2024-09-17T05:30:52.047 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:30:52.213 INFO:teuthology.orchestra.run.smithi031.stdout:[{"id":5416,"entity":{"name":{"type":"client","num":5416},"addr":{"type":"any","addr":"172.21.15.155:0","nonce":881827995}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":11,"uptime":29.031753842000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.573432651389719,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5416 172.21.15.155:0/881827995","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi155","pid":"28855","root":"/"}}] 2024-09-17T05:30:52.214 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi155", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28855", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.155:0", "nonce": 881827995, "type": "any" }, "name": { "num": 5416, "type": "client" } }, "id": 5416, "inst": "client.5416 172.21.15.155:0/881827995", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 11, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.57343265138972 }, "state": "open", "uptime": 29.031753842 } ] 2024-09-17T05:30:52.214 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:30:57.215 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:30:57.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.367+0000 7f0670800640 1 -- 172.21.15.31:0/915431121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06680b2d00 msgr2=0x7f06681605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:57.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.367+0000 7f0670800640 1 --2- 172.21.15.31:0/915431121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06680b2d00 0x7f06681605d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0664009c80 tx=0x7f066401cd10 comp rx=0 tx=0).stop 2024-09-17T05:30:57.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.367+0000 7f0670800640 1 -- 172.21.15.31:0/915431121 shutdown_connections 2024-09-17T05:30:57.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.367+0000 7f0670800640 1 --2- 172.21.15.31:0/915431121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06680b2d00 0x7f06681605d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:57.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.367+0000 7f0670800640 1 --2- 172.21.15.31:0/915431121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06680b2760 0x7f06680d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:57.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.367+0000 7f0670800640 1 -- 172.21.15.31:0/915431121 >> 172.21.15.31:0/915431121 conn(0x7f06680d1e40 msgr2=0x7f06680d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:57.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.367+0000 7f0670800640 1 -- 172.21.15.31:0/915431121 shutdown_connections 2024-09-17T05:30:57.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.367+0000 7f0670800640 1 -- 172.21.15.31:0/915431121 wait complete. 2024-09-17T05:30:57.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f0670800640 1 Processor -- start 2024-09-17T05:30:57.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f0670800640 1 -- start start 2024-09-17T05:30:57.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f0670800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06680b2760 0x7f06680cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:57.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f0670800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06680b2d00 0x7f06680ce460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:57.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f0670800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06680cfe80 0x7f066815a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:57.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f0670800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f06680b0960 con 0x7f06680cfe80 2024-09-17T05:30:57.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f0670800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f06680b07e0 con 0x7f06680b2d00 2024-09-17T05:30:57.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f0670800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f06680b0ae0 con 0x7f06680b2760 2024-09-17T05:30:57.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f066e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06680cfe80 0x7f066815a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:57.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f066e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06680cfe80 0x7f066815a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44134/0 (socket says 172.21.15.31:44134) 2024-09-17T05:30:57.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f066e800640 1 -- 172.21.15.31:0/2856405689 learned_addr learned my addr 172.21.15.31:0/2856405689 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:30:57.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f066d400640 1 --2- 172.21.15.31:0/2856405689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06680b2d00 0x7f06680ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:57.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f066de00640 1 --2- 172.21.15.31:0/2856405689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06680b2760 0x7f06680cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:57.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f066e800640 1 -- 172.21.15.31:0/2856405689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06680b2760 msgr2=0x7f06680cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:57.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f066e800640 1 --2- 172.21.15.31:0/2856405689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06680b2760 0x7f06680cdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:57.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f066e800640 1 -- 172.21.15.31:0/2856405689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06680b2d00 msgr2=0x7f06680ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:57.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f066e800640 1 --2- 172.21.15.31:0/2856405689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06680b2d00 0x7f06680ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:57.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f066e800640 1 -- 172.21.15.31:0/2856405689 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06680b4c70 con 0x7f06680cfe80 2024-09-17T05:30:57.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f066de00640 1 --2- 172.21.15.31:0/2856405689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06680b2760 0x7f06680cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:30:57.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f066e800640 1 --2- 172.21.15.31:0/2856405689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06680cfe80 0x7f066815a8f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f066401b3c0 tx=0x7f0664009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:57.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f0662000640 1 -- 172.21.15.31:0/2856405689 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06640bb070 con 0x7f06680cfe80 2024-09-17T05:30:57.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f0662000640 1 -- 172.21.15.31:0/2856405689 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0664004e00 con 0x7f06680cfe80 2024-09-17T05:30:57.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f0670800640 1 -- 172.21.15.31:0/2856405689 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f066815b4d0 con 0x7f06680cfe80 2024-09-17T05:30:57.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f0662000640 1 -- 172.21.15.31:0/2856405689 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06640b2040 con 0x7f06680cfe80 2024-09-17T05:30:57.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.371+0000 7f0670800640 1 -- 172.21.15.31:0/2856405689 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f066815ba90 con 0x7f06680cfe80 2024-09-17T05:30:57.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.375+0000 7f0670800640 1 -- 172.21.15.31:0/2856405689 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06680b4e40 con 0x7f06680cfe80 2024-09-17T05:30:57.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.375+0000 7f0662000640 1 -- 172.21.15.31:0/2856405689 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 7) ==== 97438+0+0 (secure 0 0 0) 0x7f06640a5b60 con 0x7f06680cfe80 2024-09-17T05:30:57.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.375+0000 7f0662000640 1 --2- 172.21.15.31:0/2856405689 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f064c073470 0x7f064c075930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:30:57.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.375+0000 7f0662000640 1 -- 172.21.15.31:0/2856405689 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f066412e550 con 0x7f06680cfe80 2024-09-17T05:30:57.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.375+0000 7f066de00640 1 --2- 172.21.15.31:0/2856405689 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f064c073470 0x7f064c075930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:30:57.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.375+0000 7f066de00640 1 --2- 172.21.15.31:0/2856405689 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f064c073470 0x7f064c075930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f065c000f70 tx=0x7f065c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:30:57.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.379+0000 7f0662000640 1 -- 172.21.15.31:0/2856405689 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0664016990 con 0x7f06680cfe80 2024-09-17T05:30:57.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.591+0000 7f0670800640 1 -- 172.21.15.31:0/2856405689 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06680d0260 con 0x7f06680cfe80 2024-09-17T05:30:57.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.595+0000 7f0662000640 1 -- 172.21.15.31:0/2856405689 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7f06640f8a70 con 0x7f06680cfe80 2024-09-17T05:30:57.600 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:30:57.600 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T05:30:20:371375+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:30:57.600 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T05:30:57.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.595+0000 7f0670800640 1 -- 172.21.15.31:0/2856405689 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f064c073470 msgr2=0x7f064c075930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:57.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.595+0000 7f0670800640 1 --2- 172.21.15.31:0/2856405689 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f064c073470 0x7f064c075930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f065c000f70 tx=0x7f065c009040 comp rx=0 tx=0).stop 2024-09-17T05:30:57.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.595+0000 7f0670800640 1 -- 172.21.15.31:0/2856405689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06680cfe80 msgr2=0x7f066815a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:30:57.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.595+0000 7f0670800640 1 --2- 172.21.15.31:0/2856405689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06680cfe80 0x7f066815a8f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f066401b3c0 tx=0x7f0664009390 comp rx=0 tx=0).stop 2024-09-17T05:30:57.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.595+0000 7f0670800640 1 -- 172.21.15.31:0/2856405689 shutdown_connections 2024-09-17T05:30:57.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.595+0000 7f0670800640 1 --2- 172.21.15.31:0/2856405689 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f064c073470 0x7f064c075930 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:57.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.595+0000 7f0670800640 1 --2- 172.21.15.31:0/2856405689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06680cfe80 0x7f066815a8f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:57.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.595+0000 7f0670800640 1 --2- 172.21.15.31:0/2856405689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06680b2d00 0x7f06680ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:57.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.595+0000 7f0670800640 1 --2- 172.21.15.31:0/2856405689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f06680b2760 0x7f06680cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:30:57.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.595+0000 7f0670800640 1 -- 172.21.15.31:0/2856405689 >> 172.21.15.31:0/2856405689 conn(0x7f06680d1e40 msgr2=0x7f066815ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:30:57.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.595+0000 7f0670800640 1 -- 172.21.15.31:0/2856405689 shutdown_connections 2024-09-17T05:30:57.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:30:57.595+0000 7f0670800640 1 -- 172.21.15.31:0/2856405689 wait complete. 2024-09-17T05:30:57.622 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:30:57.786 INFO:teuthology.orchestra.run.smithi031.stdout:[{"id":5416,"entity":{"name":{"type":"client","num":5416},"addr":{"type":"any","addr":"172.21.15.155:0","nonce":881827995}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":10,"uptime":34.603707360000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.310268997568468,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5416 172.21.15.155:0/881827995","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi155","pid":"28855","root":"/"}}] 2024-09-17T05:30:57.787 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi155", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28855", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.155:0", "nonce": 881827995, "type": "any" }, "name": { "num": 5416, "type": "client" } }, "id": 5416, "inst": "client.5416 172.21.15.155:0/881827995", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.310268997568468 }, "state": "open", "uptime": 34.60370736 } ] 2024-09-17T05:30:57.787 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:31:02.789 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:31:02.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26ec200640 1 -- 172.21.15.31:0/2591920745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26e40cfe80 msgr2=0x7f26e40d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:02.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26ec200640 1 --2- 172.21.15.31:0/2591920745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26e40cfe80 0x7f26e40d0260 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009840 tx=0x7f26d801c790 comp rx=0 tx=0).stop 2024-09-17T05:31:02.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26ec200640 1 -- 172.21.15.31:0/2591920745 shutdown_connections 2024-09-17T05:31:02.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26ec200640 1 --2- 172.21.15.31:0/2591920745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26e40b2760 0x7f26e41605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:02.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26ec200640 1 --2- 172.21.15.31:0/2591920745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26e40cfe80 0x7f26e40d0260 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:02.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26ec200640 1 -- 172.21.15.31:0/2591920745 >> 172.21.15.31:0/2591920745 conn(0x7f26e40d1e40 msgr2=0x7f26e40d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:02.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26ec200640 1 -- 172.21.15.31:0/2591920745 shutdown_connections 2024-09-17T05:31:02.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26ec200640 1 -- 172.21.15.31:0/2591920745 wait complete. 2024-09-17T05:31:02.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26ec200640 1 Processor -- start 2024-09-17T05:31:02.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26ec200640 1 -- start start 2024-09-17T05:31:02.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26ec200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26e40b2760 0x7f26e4154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:02.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26ec200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26e40b2d00 0x7f26e40b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:02.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26ec200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26e40cfe80 0x7f26e40cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:02.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26ec200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f26e40b0980 con 0x7f26e40b2d00 2024-09-17T05:31:02.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26ec200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f26e40b0800 con 0x7f26e40b2760 2024-09-17T05:31:02.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26ec200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f26e40b0b00 con 0x7f26e40cfe80 2024-09-17T05:31:02.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26e8e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26e40b2d00 0x7f26e40b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:02.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26e8e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26e40b2d00 0x7f26e40b5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59726/0 (socket says 172.21.15.31:59726) 2024-09-17T05:31:02.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26e8e00640 1 -- 172.21.15.31:0/2305672311 learned_addr learned my addr 172.21.15.31:0/2305672311 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:02.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26e9800640 1 --2- 172.21.15.31:0/2305672311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26e40b2760 0x7f26e4154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:02.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.943+0000 7f26ea200640 1 --2- 172.21.15.31:0/2305672311 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26e40cfe80 0x7f26e40cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:02.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.947+0000 7f26e8e00640 1 -- 172.21.15.31:0/2305672311 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26e40cfe80 msgr2=0x7f26e40cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:02.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.947+0000 7f26e8e00640 1 --2- 172.21.15.31:0/2305672311 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26e40cfe80 0x7f26e40cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:02.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.947+0000 7f26e8e00640 1 -- 172.21.15.31:0/2305672311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26e40b2760 msgr2=0x7f26e4154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:02.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.947+0000 7f26e8e00640 1 --2- 172.21.15.31:0/2305672311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26e40b2760 0x7f26e4154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:02.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.947+0000 7f26e8e00640 1 -- 172.21.15.31:0/2305672311 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e40c9240 con 0x7f26e40b2d00 2024-09-17T05:31:02.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.947+0000 7f26e8e00640 1 --2- 172.21.15.31:0/2305672311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26e40b2d00 0x7f26e40b5340 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c730 tx=0x7f26d000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:02.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.947+0000 7f26e1600640 1 -- 172.21.15.31:0/2305672311 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0017070 con 0x7f26e40b2d00 2024-09-17T05:31:02.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.947+0000 7f26e1600640 1 -- 172.21.15.31:0/2305672311 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26d00051a0 con 0x7f26e40b2d00 2024-09-17T05:31:02.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.947+0000 7f26e1600640 1 -- 172.21.15.31:0/2305672311 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d000a640 con 0x7f26e40b2d00 2024-09-17T05:31:02.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.947+0000 7f26ec200640 1 -- 172.21.15.31:0/2305672311 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e40c9520 con 0x7f26e40b2d00 2024-09-17T05:31:02.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.947+0000 7f26ec200640 1 -- 172.21.15.31:0/2305672311 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e40c9ae0 con 0x7f26e40b2d00 2024-09-17T05:31:02.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.947+0000 7f26ec200640 1 -- 172.21.15.31:0/2305672311 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e40d0260 con 0x7f26e40b2d00 2024-09-17T05:31:02.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.947+0000 7f26e1600640 1 -- 172.21.15.31:0/2305672311 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 7) ==== 97438+0+0 (secure 0 0 0) 0x7f26d001a070 con 0x7f26e40b2d00 2024-09-17T05:31:02.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.947+0000 7f26e1600640 1 --2- 172.21.15.31:0/2305672311 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f26c4073440 0x7f26c4075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:02.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.951+0000 7f26e1600640 1 -- 172.21.15.31:0/2305672311 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f26d0093ab0 con 0x7f26e40b2d00 2024-09-17T05:31:02.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.951+0000 7f26e9800640 1 --2- 172.21.15.31:0/2305672311 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f26c4073440 0x7f26c4075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:02.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.951+0000 7f26e9800640 1 --2- 172.21.15.31:0/2305672311 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f26c4073440 0x7f26c4075900 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f26d80ae000 tx=0x7f26d801afd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:02.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:02.955+0000 7f26e1600640 1 -- 172.21.15.31:0/2305672311 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f26e40d0c80 con 0x7f26e40b2d00 2024-09-17T05:31:03.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:03.167+0000 7f26ec200640 1 -- 172.21.15.31:0/2305672311 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26e4154570 con 0x7f26e40b2d00 2024-09-17T05:31:03.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:03.167+0000 7f26e1600640 1 -- 172.21.15.31:0/2305672311 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7f26d005dfc0 con 0x7f26e40b2d00 2024-09-17T05:31:03.173 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:03.173 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T05:30:20:371375+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:31:03.173 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T05:31:03.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:03.167+0000 7f26ec200640 1 -- 172.21.15.31:0/2305672311 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f26c4073440 msgr2=0x7f26c4075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:03.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:03.167+0000 7f26ec200640 1 --2- 172.21.15.31:0/2305672311 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f26c4073440 0x7f26c4075900 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f26d80ae000 tx=0x7f26d801afd0 comp rx=0 tx=0).stop 2024-09-17T05:31:03.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:03.167+0000 7f26ec200640 1 -- 172.21.15.31:0/2305672311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26e40b2d00 msgr2=0x7f26e40b5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:03.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:03.167+0000 7f26ec200640 1 --2- 172.21.15.31:0/2305672311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26e40b2d00 0x7f26e40b5340 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c730 tx=0x7f26d000cbf0 comp rx=0 tx=0).stop 2024-09-17T05:31:03.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:03.167+0000 7f26ec200640 1 -- 172.21.15.31:0/2305672311 shutdown_connections 2024-09-17T05:31:03.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:03.167+0000 7f26ec200640 1 --2- 172.21.15.31:0/2305672311 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f26c4073440 0x7f26c4075900 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:03.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:03.167+0000 7f26ec200640 1 --2- 172.21.15.31:0/2305672311 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26e40cfe80 0x7f26e40cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:03.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:03.167+0000 7f26ec200640 1 --2- 172.21.15.31:0/2305672311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26e40b2d00 0x7f26e40b5340 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:03.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:03.167+0000 7f26ec200640 1 --2- 172.21.15.31:0/2305672311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26e40b2760 0x7f26e4154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:03.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:03.167+0000 7f26ec200640 1 -- 172.21.15.31:0/2305672311 >> 172.21.15.31:0/2305672311 conn(0x7f26e40d1e40 msgr2=0x7f26e4070a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:03.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:03.167+0000 7f26ec200640 1 -- 172.21.15.31:0/2305672311 shutdown_connections 2024-09-17T05:31:03.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:03.167+0000 7f26ec200640 1 -- 172.21.15.31:0/2305672311 wait complete. 2024-09-17T05:31:03.194 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:31:03.359 INFO:teuthology.orchestra.run.smithi031.stdout:[{"id":5416,"entity":{"name":{"type":"client","num":5416},"addr":{"type":"any","addr":"172.21.15.155:0","nonce":881827995}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":10,"uptime":40.179660775000002,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.050286283513174,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5416 172.21.15.155:0/881827995","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi155","pid":"28855","root":"/"}}] 2024-09-17T05:31:03.359 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi155", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28855", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.155:0", "nonce": 881827995, "type": "any" }, "name": { "num": 5416, "type": "client" } }, "id": 5416, "inst": "client.5416 172.21.15.155:0/881827995", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.050286283513174 }, "state": "open", "uptime": 40.179660775 } ] 2024-09-17T05:31:03.360 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:31:08.361 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:31:08.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.515+0000 7fe6da200640 1 -- 172.21.15.31:0/367054943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6b8004d50 msgr2=0x7fe6b80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:08.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.515+0000 7fe6da200640 1 --2- 172.21.15.31:0/367054943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6b8004d50 0x7fe6b80051d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc009eb0 tx=0x7fe6cc01d5f0 comp rx=0 tx=0).stop 2024-09-17T05:31:08.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.515+0000 7fe6d3e00640 1 -- 172.21.15.31:0/367054943 reap_dead start 2024-09-17T05:31:08.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.515+0000 7fe6da200640 1 -- 172.21.15.31:0/367054943 shutdown_connections 2024-09-17T05:31:08.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.515+0000 7fe6da200640 1 -- 172.21.15.31:0/367054943 >> 172.21.15.31:0/367054943 conn(0x7fe6d40d1dc0 msgr2=0x7fe6d40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.515+0000 7fe6da200640 1 -- 172.21.15.31:0/367054943 shutdown_connections 2024-09-17T05:31:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.515+0000 7fe6da200640 1 -- 172.21.15.31:0/367054943 wait complete. 2024-09-17T05:31:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6da200640 1 Processor -- start 2024-09-17T05:31:08.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6da200640 1 -- start start 2024-09-17T05:31:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6da200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6b8004d50 0x7fe6d40b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6da200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d40b6900 0x7fe6d415b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6da200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d41e9d00 0x7fe6d41ea160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6da200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d415c470 con 0x7fe6d41e9d00 2024-09-17T05:31:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6da200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d40d2af0 con 0x7fe6b8004d50 2024-09-17T05:31:08.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6da200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d40ae9b0 con 0x7fe6d40b6900 2024-09-17T05:31:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6d3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d41e9d00 0x7fe6d41ea160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6d3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d41e9d00 0x7fe6d41ea160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59736/0 (socket says 172.21.15.31:59736) 2024-09-17T05:31:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6d3e00640 1 -- 172.21.15.31:0/1387114170 learned_addr learned my addr 172.21.15.31:0/1387114170 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6d3400640 1 --2- 172.21.15.31:0/1387114170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6b8004d50 0x7fe6d40b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6cbe00640 1 --2- 172.21.15.31:0/1387114170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d40b6900 0x7fe6d415b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6d3e00640 1 -- 172.21.15.31:0/1387114170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d40b6900 msgr2=0x7fe6d415b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6d3e00640 1 --2- 172.21.15.31:0/1387114170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d40b6900 0x7fe6d415b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6d3e00640 1 -- 172.21.15.31:0/1387114170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6b8004d50 msgr2=0x7fe6d40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6d3e00640 1 --2- 172.21.15.31:0/1387114170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6b8004d50 0x7fe6d40b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6d3e00640 1 -- 172.21.15.31:0/1387114170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d40b79a0 con 0x7fe6d41e9d00 2024-09-17T05:31:08.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6d3e00640 1 --2- 172.21.15.31:0/1387114170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d41e9d00 0x7fe6d41ea160 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc009eb0 tx=0x7fe6cc004f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:08.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6cb400640 1 -- 172.21.15.31:0/1387114170 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc0ad050 con 0x7fe6d41e9d00 2024-09-17T05:31:08.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6cb400640 1 -- 172.21.15.31:0/1387114170 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6cc0a7a90 con 0x7fe6d41e9d00 2024-09-17T05:31:08.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6cb400640 1 -- 172.21.15.31:0/1387114170 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc009200 con 0x7fe6d41e9d00 2024-09-17T05:31:08.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6da200640 1 -- 172.21.15.31:0/1387114170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d40b3510 con 0x7fe6d41e9d00 2024-09-17T05:31:08.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6da200640 1 -- 172.21.15.31:0/1387114170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d40b7070 con 0x7fe6d41e9d00 2024-09-17T05:31:08.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.519+0000 7fe6da200640 1 -- 172.21.15.31:0/1387114170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d40ce670 con 0x7fe6d41e9d00 2024-09-17T05:31:08.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.523+0000 7fe6cb400640 1 -- 172.21.15.31:0/1387114170 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 7) ==== 97438+0+0 (secure 0 0 0) 0x7fe6cc0b0070 con 0x7fe6d41e9d00 2024-09-17T05:31:08.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.523+0000 7fe6cb400640 1 --2- 172.21.15.31:0/1387114170 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe6b0073440 0x7fe6b0075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:08.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.523+0000 7fe6cb400640 1 -- 172.21.15.31:0/1387114170 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fe6cc12f350 con 0x7fe6d41e9d00 2024-09-17T05:31:08.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.523+0000 7fe6d3400640 1 --2- 172.21.15.31:0/1387114170 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe6b0073440 0x7fe6b0075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:08.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.523+0000 7fe6d3400640 1 --2- 172.21.15.31:0/1387114170 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe6b0073440 0x7fe6b0075900 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4001cd0 tx=0x7fe6c4006730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:08.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.527+0000 7fe6cb400640 1 -- 172.21.15.31:0/1387114170 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe6cc017300 con 0x7fe6d41e9d00 2024-09-17T05:31:08.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.739+0000 7fe6da200640 1 -- 172.21.15.31:0/1387114170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6d40b4c80 con 0x7fe6d41e9d00 2024-09-17T05:31:08.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.739+0000 7fe6cb400640 1 -- 172.21.15.31:0/1387114170 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7fe6cc0f98f0 con 0x7fe6d41e9d00 2024-09-17T05:31:08.746 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:08.746 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T05:30:20:371375+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:31:08.746 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T05:31:08.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.743+0000 7fe6da200640 1 -- 172.21.15.31:0/1387114170 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe6b0073440 msgr2=0x7fe6b0075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:08.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.743+0000 7fe6da200640 1 --2- 172.21.15.31:0/1387114170 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe6b0073440 0x7fe6b0075900 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4001cd0 tx=0x7fe6c4006730 comp rx=0 tx=0).stop 2024-09-17T05:31:08.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.743+0000 7fe6da200640 1 -- 172.21.15.31:0/1387114170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d41e9d00 msgr2=0x7fe6d41ea160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:08.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.743+0000 7fe6da200640 1 --2- 172.21.15.31:0/1387114170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d41e9d00 0x7fe6d41ea160 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc009eb0 tx=0x7fe6cc004f50 comp rx=0 tx=0).stop 2024-09-17T05:31:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.743+0000 7fe6da200640 1 -- 172.21.15.31:0/1387114170 shutdown_connections 2024-09-17T05:31:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.743+0000 7fe6da200640 1 --2- 172.21.15.31:0/1387114170 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe6b0073440 0x7fe6b0075900 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.743+0000 7fe6da200640 1 --2- 172.21.15.31:0/1387114170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d41e9d00 0x7fe6d41ea160 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.743+0000 7fe6da200640 1 --2- 172.21.15.31:0/1387114170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d40b6900 0x7fe6d415b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.743+0000 7fe6da200640 1 --2- 172.21.15.31:0/1387114170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6b8004d50 0x7fe6d40b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.743+0000 7fe6da200640 1 -- 172.21.15.31:0/1387114170 >> 172.21.15.31:0/1387114170 conn(0x7fe6d40d1dc0 msgr2=0x7fe6d406eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.743+0000 7fe6da200640 1 -- 172.21.15.31:0/1387114170 shutdown_connections 2024-09-17T05:31:08.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:08.743+0000 7fe6da200640 1 -- 172.21.15.31:0/1387114170 wait complete. 2024-09-17T05:31:08.769 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:31:08.933 INFO:teuthology.orchestra.run.smithi031.stdout:[{"id":5416,"entity":{"name":{"type":"client","num":5416},"addr":{"type":"any","addr":"172.21.15.155:0","nonce":881827995}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":9,"uptime":45.751614156999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.793814426824078,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5416 172.21.15.155:0/881827995","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi155","pid":"28855","root":"/"}}] 2024-09-17T05:31:08.934 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi155", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28855", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.155:0", "nonce": 881827995, "type": "any" }, "name": { "num": 5416, "type": "client" } }, "id": 5416, "inst": "client.5416 172.21.15.155:0/881827995", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 9, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.793814426824078 }, "state": "open", "uptime": 45.751614157 } ] 2024-09-17T05:31:08.934 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:31:11.971 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:31:11.975 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:31:13.935 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:31:14.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.087+0000 7f4be5400640 1 -- 172.21.15.31:0/2725447976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4be00b49e0 msgr2=0x7f4be00acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:14.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.087+0000 7f4be5400640 1 --2- 172.21.15.31:0/2725447976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4be00b49e0 0x7f4be00acd40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800ad90 tx=0x7f4bd801dc20 comp rx=0 tx=0).stop 2024-09-17T05:31:14.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.087+0000 7f4be5400640 1 -- 172.21.15.31:0/2725447976 shutdown_connections 2024-09-17T05:31:14.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.087+0000 7f4be5400640 1 --2- 172.21.15.31:0/2725447976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4be00b49e0 0x7f4be00acd40 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:14.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.087+0000 7f4be5400640 1 --2- 172.21.15.31:0/2725447976 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4be00cd100 0x7f4be006f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:14.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.087+0000 7f4be5400640 1 -- 172.21.15.31:0/2725447976 >> 172.21.15.31:0/2725447976 conn(0x7f4be00b18f0 msgr2=0x7f4be00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:14.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.087+0000 7f4be5400640 1 -- 172.21.15.31:0/2725447976 shutdown_connections 2024-09-17T05:31:14.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.087+0000 7f4be5400640 1 -- 172.21.15.31:0/2725447976 wait complete. 2024-09-17T05:31:14.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4be5400640 1 Processor -- start 2024-09-17T05:31:14.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4be5400640 1 -- start start 2024-09-17T05:31:14.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4be5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4be00b49e0 0x7f4be009aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:14.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4be5400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4be00cd100 0x7f4be01586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:14.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4be5400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4be015dae0 0x7f4be009cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:14.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4be5400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4be00cf1a0 con 0x7f4be00b49e0 2024-09-17T05:31:14.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4be5400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4be00cf020 con 0x7f4be00cd100 2024-09-17T05:31:14.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4be5400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4be00cf320 con 0x7f4be015dae0 2024-09-17T05:31:14.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4bde800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4be00b49e0 0x7f4be009aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:14.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4bde800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4be00b49e0 0x7f4be009aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39928/0 (socket says 172.21.15.31:39928) 2024-09-17T05:31:14.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4bde800640 1 -- 172.21.15.31:0/1116842986 learned_addr learned my addr 172.21.15.31:0/1116842986 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:14.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4bdf200640 1 --2- 172.21.15.31:0/1116842986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4be015dae0 0x7f4be009cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:14.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4bde800640 1 -- 172.21.15.31:0/1116842986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4be015dae0 msgr2=0x7f4be009cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:14.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4bde800640 1 --2- 172.21.15.31:0/1116842986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4be015dae0 0x7f4be009cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:14.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4bde800640 1 -- 172.21.15.31:0/1116842986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4be00cd100 msgr2=0x7f4be01586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:14.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4bde800640 1 --2- 172.21.15.31:0/1116842986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4be00cd100 0x7f4be01586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:14.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4bde800640 1 -- 172.21.15.31:0/1116842986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be01f85b0 con 0x7f4be00b49e0 2024-09-17T05:31:14.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4bde800640 1 --2- 172.21.15.31:0/1116842986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4be00b49e0 0x7f4be009aa80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4bd000c3c0 tx=0x7f4bd000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:14.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4bd6a00640 1 -- 172.21.15.31:0/1116842986 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0017070 con 0x7f4be00b49e0 2024-09-17T05:31:14.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4bd6a00640 1 -- 172.21.15.31:0/1116842986 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bd00053c0 con 0x7f4be00b49e0 2024-09-17T05:31:14.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4be5400640 1 -- 172.21.15.31:0/1116842986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be01f8890 con 0x7f4be00b49e0 2024-09-17T05:31:14.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4bd6a00640 1 -- 172.21.15.31:0/1116842986 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0003860 con 0x7f4be00b49e0 2024-09-17T05:31:14.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.091+0000 7f4be5400640 1 -- 172.21.15.31:0/1116842986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be0162730 con 0x7f4be00b49e0 2024-09-17T05:31:14.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.095+0000 7f4be5400640 1 -- 172.21.15.31:0/1116842986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be0069410 con 0x7f4be00b49e0 2024-09-17T05:31:14.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.095+0000 7f4bd6a00640 1 -- 172.21.15.31:0/1116842986 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 7) ==== 97438+0+0 (secure 0 0 0) 0x7f4bd001a070 con 0x7f4be00b49e0 2024-09-17T05:31:14.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.095+0000 7f4bd6a00640 1 --2- 172.21.15.31:0/1116842986 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4bbc073440 0x7f4bbc075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:14.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.095+0000 7f4bd6a00640 1 -- 172.21.15.31:0/1116842986 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f4bd00938f0 con 0x7f4be00b49e0 2024-09-17T05:31:14.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.095+0000 7f4bd7e00640 1 --2- 172.21.15.31:0/1116842986 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4bbc073440 0x7f4bbc075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:14.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.095+0000 7f4bd7e00640 1 --2- 172.21.15.31:0/1116842986 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4bbc073440 0x7f4bbc075900 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4be009da00 tx=0x7f4bc800b410 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:14.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.099+0000 7f4bd6a00640 1 -- 172.21.15.31:0/1116842986 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4bd005df60 con 0x7f4be00b49e0 2024-09-17T05:31:14.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.311+0000 7f4be5400640 1 -- 172.21.15.31:0/1116842986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4be0162900 con 0x7f4be00b49e0 2024-09-17T05:31:14.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.311+0000 7f4bd6a00640 1 -- 172.21.15.31:0/1116842986 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7f4bd0062990 con 0x7f4be00b49e0 2024-09-17T05:31:14.318 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:14.318 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T05:30:20:371375+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:31:14.318 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T05:31:14.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.315+0000 7f4be5400640 1 -- 172.21.15.31:0/1116842986 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4bbc073440 msgr2=0x7f4bbc075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:14.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.315+0000 7f4be5400640 1 --2- 172.21.15.31:0/1116842986 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4bbc073440 0x7f4bbc075900 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4be009da00 tx=0x7f4bc800b410 comp rx=0 tx=0).stop 2024-09-17T05:31:14.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.315+0000 7f4be5400640 1 -- 172.21.15.31:0/1116842986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4be00b49e0 msgr2=0x7f4be009aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:14.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.315+0000 7f4be5400640 1 --2- 172.21.15.31:0/1116842986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4be00b49e0 0x7f4be009aa80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4bd000c3c0 tx=0x7f4bd000c880 comp rx=0 tx=0).stop 2024-09-17T05:31:14.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.315+0000 7f4be5400640 1 -- 172.21.15.31:0/1116842986 shutdown_connections 2024-09-17T05:31:14.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.315+0000 7f4be5400640 1 --2- 172.21.15.31:0/1116842986 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4bbc073440 0x7f4bbc075900 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:14.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.315+0000 7f4be5400640 1 --2- 172.21.15.31:0/1116842986 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4be015dae0 0x7f4be009cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:14.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.315+0000 7f4be5400640 1 --2- 172.21.15.31:0/1116842986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4be00cd100 0x7f4be01586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:14.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.315+0000 7f4be5400640 1 --2- 172.21.15.31:0/1116842986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4be00b49e0 0x7f4be009aa80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:14.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.315+0000 7f4be5400640 1 -- 172.21.15.31:0/1116842986 >> 172.21.15.31:0/1116842986 conn(0x7f4be00b18f0 msgr2=0x7f4be0159920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:14.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.315+0000 7f4be5400640 1 -- 172.21.15.31:0/1116842986 shutdown_connections 2024-09-17T05:31:14.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:14.315+0000 7f4be5400640 1 -- 172.21.15.31:0/1116842986 wait complete. 2024-09-17T05:31:14.340 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:31:14.506 INFO:teuthology.orchestra.run.smithi031.stdout:[{"id":5416,"entity":{"name":{"type":"client","num":5416},"addr":{"type":"any","addr":"172.21.15.155:0","nonce":881827995}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":51.323567478000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.540623214987779,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5416 172.21.15.155:0/881827995","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi155","pid":"28855","root":"/"}}] 2024-09-17T05:31:14.507 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi155", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28855", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.155:0", "nonce": 881827995, "type": "any" }, "name": { "num": 5416, "type": "client" } }, "id": 5416, "inst": "client.5416 172.21.15.155:0/881827995", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.54062321498778 }, "state": "open", "uptime": 51.323567478 } ] 2024-09-17T05:31:14.507 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:31:19.508 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:31:19.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.663+0000 7f0bc0200640 1 -- 172.21.15.31:0/4118778211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bb806e7a0 msgr2=0x7f0bb806ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:19.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.663+0000 7f0bc0200640 1 --2- 172.21.15.31:0/4118778211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bb806e7a0 0x7f0bb806ec30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009c80 tx=0x7f0bb001f560 comp rx=0 tx=0).stop 2024-09-17T05:31:19.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.663+0000 7f0bc0200640 1 -- 172.21.15.31:0/4118778211 shutdown_connections 2024-09-17T05:31:19.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.663+0000 7f0bc0200640 1 --2- 172.21.15.31:0/4118778211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bb806e7a0 0x7f0bb806ec30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:19.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.663+0000 7f0bc0200640 1 --2- 172.21.15.31:0/4118778211 >> v2:172.21.15.155:3300/0 conn(0x7f0bb815c3e0 0x7f0bb815c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:19.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.663+0000 7f0bc0200640 1 -- 172.21.15.31:0/4118778211 >> 172.21.15.31:0/4118778211 conn(0x7f0bb80b18f0 msgr2=0x7f0bb80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:19.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.663+0000 7f0bc0200640 1 -- 172.21.15.31:0/4118778211 shutdown_connections 2024-09-17T05:31:19.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.663+0000 7f0bc0200640 1 -- 172.21.15.31:0/4118778211 wait complete. 2024-09-17T05:31:19.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.663+0000 7f0bc0200640 1 Processor -- start 2024-09-17T05:31:19.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.663+0000 7f0bc0200640 1 -- start start 2024-09-17T05:31:19.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bc0200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb806e7a0 0x7f0bb814a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:19.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bc0200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb815bfa0 0x7f0bb80ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:19.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bc0200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bb815c3e0 0x7f0bb815a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:19.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bc0200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb806f170 con 0x7f0bb815c3e0 2024-09-17T05:31:19.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bc0200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb8074960 con 0x7f0bb806e7a0 2024-09-17T05:31:19.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bc0200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb806f2f0 con 0x7f0bb815bfa0 2024-09-17T05:31:19.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bbe200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bb815c3e0 0x7f0bb815a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:19.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bbe200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bb815c3e0 0x7f0bb815a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46162/0 (socket says 172.21.15.31:46162) 2024-09-17T05:31:19.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bbe200640 1 -- 172.21.15.31:0/4044356586 learned_addr learned my addr 172.21.15.31:0/4044356586 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:19.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bbd800640 1 --2- 172.21.15.31:0/4044356586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb806e7a0 0x7f0bb814a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:19.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bbce00640 1 --2- 172.21.15.31:0/4044356586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb815bfa0 0x7f0bb80ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:19.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bbe200640 1 -- 172.21.15.31:0/4044356586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb815bfa0 msgr2=0x7f0bb80ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:19.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bbe200640 1 --2- 172.21.15.31:0/4044356586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb815bfa0 0x7f0bb80ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:19.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bbe200640 1 -- 172.21.15.31:0/4044356586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb806e7a0 msgr2=0x7f0bb814a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:19.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bbe200640 1 --2- 172.21.15.31:0/4044356586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb806e7a0 0x7f0bb814a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:19.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bbe200640 1 -- 172.21.15.31:0/4044356586 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb80cd3b0 con 0x7f0bb815c3e0 2024-09-17T05:31:19.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bbce00640 1 --2- 172.21.15.31:0/4044356586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb815bfa0 0x7f0bb80ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:31:19.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bbe200640 1 --2- 172.21.15.31:0/4044356586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bb815c3e0 0x7f0bb815a5f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009bd0 tx=0x7f0bb0009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:19.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bb5600640 1 -- 172.21.15.31:0/4044356586 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00c0070 con 0x7f0bb815c3e0 2024-09-17T05:31:19.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bb5600640 1 -- 172.21.15.31:0/4044356586 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bb00b6040 con 0x7f0bb815c3e0 2024-09-17T05:31:19.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bb5600640 1 -- 172.21.15.31:0/4044356586 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00b5070 con 0x7f0bb815c3e0 2024-09-17T05:31:19.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bc0200640 1 -- 172.21.15.31:0/4044356586 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb80cadd0 con 0x7f0bb815c3e0 2024-09-17T05:31:19.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bc0200640 1 -- 172.21.15.31:0/4044356586 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb81f4da0 con 0x7f0bb815c3e0 2024-09-17T05:31:19.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.667+0000 7f0bc0200640 1 -- 172.21.15.31:0/4044356586 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb8069410 con 0x7f0bb815c3e0 2024-09-17T05:31:19.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.671+0000 7f0bb5600640 1 -- 172.21.15.31:0/4044356586 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 7) ==== 97438+0+0 (secure 0 0 0) 0x7f0bb00b0b10 con 0x7f0bb815c3e0 2024-09-17T05:31:19.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.671+0000 7f0bb5600640 1 --2- 172.21.15.31:0/4044356586 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0b98073440 0x7f0b98075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:19.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.671+0000 7f0bb5600640 1 -- 172.21.15.31:0/4044356586 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f0bb0131b80 con 0x7f0bb815c3e0 2024-09-17T05:31:19.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.671+0000 7f0bbd800640 1 --2- 172.21.15.31:0/4044356586 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0b98073440 0x7f0b98075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:19.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.671+0000 7f0bbd800640 1 --2- 172.21.15.31:0/4044356586 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0b98073440 0x7f0b98075900 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00bb50 tx=0x7f0bac00b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:19.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.675+0000 7f0bb5600640 1 -- 172.21.15.31:0/4044356586 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0bb00190c0 con 0x7f0bb815c3e0 2024-09-17T05:31:19.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.887+0000 7f0bc0200640 1 -- 172.21.15.31:0/4044356586 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0bb80704d0 con 0x7f0bb815c3e0 2024-09-17T05:31:19.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.887+0000 7f0bb5600640 1 -- 172.21.15.31:0/4044356586 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7f0bb00fc090 con 0x7f0bb815c3e0 2024-09-17T05:31:19.895 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:19.895 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T05:30:20:371375+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:31:19.895 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T05:31:19.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.891+0000 7f0bc0200640 1 -- 172.21.15.31:0/4044356586 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0b98073440 msgr2=0x7f0b98075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.891+0000 7f0bc0200640 1 --2- 172.21.15.31:0/4044356586 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0b98073440 0x7f0b98075900 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00bb50 tx=0x7f0bac00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:31:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.891+0000 7f0bc0200640 1 -- 172.21.15.31:0/4044356586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bb815c3e0 msgr2=0x7f0bb815a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.891+0000 7f0bc0200640 1 --2- 172.21.15.31:0/4044356586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bb815c3e0 0x7f0bb815a5f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009bd0 tx=0x7f0bb0009370 comp rx=0 tx=0).stop 2024-09-17T05:31:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.891+0000 7f0bc0200640 1 -- 172.21.15.31:0/4044356586 shutdown_connections 2024-09-17T05:31:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.891+0000 7f0bc0200640 1 --2- 172.21.15.31:0/4044356586 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0b98073440 0x7f0b98075900 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.891+0000 7f0bc0200640 1 --2- 172.21.15.31:0/4044356586 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bb815c3e0 0x7f0bb815a5f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.891+0000 7f0bc0200640 1 --2- 172.21.15.31:0/4044356586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bb815bfa0 0x7f0bb80ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.891+0000 7f0bc0200640 1 --2- 172.21.15.31:0/4044356586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bb806e7a0 0x7f0bb814a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.891+0000 7f0bc0200640 1 -- 172.21.15.31:0/4044356586 >> 172.21.15.31:0/4044356586 conn(0x7f0bb80b18f0 msgr2=0x7f0bb815e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:19.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.891+0000 7f0bc0200640 1 -- 172.21.15.31:0/4044356586 shutdown_connections 2024-09-17T05:31:19.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:19.891+0000 7f0bc0200640 1 -- 172.21.15.31:0/4044356586 wait complete. 2024-09-17T05:31:19.916 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:31:20.081 INFO:teuthology.orchestra.run.smithi031.stdout:[{"id":5416,"entity":{"name":{"type":"client","num":5416},"addr":{"type":"any","addr":"172.21.15.155:0","nonce":881827995}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":56.899520699999997,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.290492402655286,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5416 172.21.15.155:0/881827995","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi155","pid":"28855","root":"/"}}] 2024-09-17T05:31:20.082 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi155", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28855", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.155:0", "nonce": 881827995, "type": "any" }, "name": { "num": 5416, "type": "client" } }, "id": 5416, "inst": "client.5416 172.21.15.155:0/881827995", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.290492402655286 }, "state": "open", "uptime": 56.8995207 } ] 2024-09-17T05:31:20.082 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:31:25.083 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:31:25.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.263+0000 7fee0b800640 1 -- 172.21.15.31:0/652600771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee040cfe90 msgr2=0x7fee040d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:25.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.263+0000 7fee0b800640 1 --2- 172.21.15.31:0/652600771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee040cfe90 0x7fee040d0270 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fee04073f40 tx=0x7fedf001f0b0 comp rx=0 tx=0).stop 2024-09-17T05:31:25.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.263+0000 7fee0b800640 1 -- 172.21.15.31:0/652600771 shutdown_connections 2024-09-17T05:31:25.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.263+0000 7fee0b800640 1 --2- 172.21.15.31:0/652600771 >> v2:172.21.15.155:3300/0 conn(0x7fee040b2cf0 0x7fee04160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:25.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.263+0000 7fee0b800640 1 --2- 172.21.15.31:0/652600771 >> v2:172.21.15.31:3300/0 conn(0x7fee040d07b0 0x7fee0415fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:25.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.263+0000 7fee0b800640 1 --2- 172.21.15.31:0/652600771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee040cfe90 0x7fee040d0270 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:25.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.263+0000 7fee0b800640 1 -- 172.21.15.31:0/652600771 >> 172.21.15.31:0/652600771 conn(0x7fee040d1dc0 msgr2=0x7fee040d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:25.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.263+0000 7fee0b800640 1 -- 172.21.15.31:0/652600771 shutdown_connections 2024-09-17T05:31:25.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.263+0000 7fee0b800640 1 -- 172.21.15.31:0/652600771 wait complete. 2024-09-17T05:31:25.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee0b800640 1 Processor -- start 2024-09-17T05:31:25.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee0b800640 1 -- start start 2024-09-17T05:31:25.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee0b800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee040b2cf0 0x7fee040cf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:25.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee0b800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee040cfe90 0x7fee040b7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:25.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee0b800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee040d07b0 0x7fee041f4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:25.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee0b800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fee040b18f0 con 0x7fee040d07b0 2024-09-17T05:31:25.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee0b800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fee040b1770 con 0x7fee040b2cf0 2024-09-17T05:31:25.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee0b800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fee040b1a70 con 0x7fee040cfe90 2024-09-17T05:31:25.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee09800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee040d07b0 0x7fee041f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:25.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee08e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee040b2cf0 0x7fee040cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:25.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee09800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee040d07b0 0x7fee041f4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46188/0 (socket says 172.21.15.31:46188) 2024-09-17T05:31:25.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee09800640 1 -- 172.21.15.31:0/2272371607 learned_addr learned my addr 172.21.15.31:0/2272371607 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:25.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee03e00640 1 --2- 172.21.15.31:0/2272371607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee040cfe90 0x7fee040b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:25.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee09800640 1 -- 172.21.15.31:0/2272371607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee040cfe90 msgr2=0x7fee040b7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:25.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee09800640 1 --2- 172.21.15.31:0/2272371607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee040cfe90 0x7fee040b7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:25.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee09800640 1 -- 172.21.15.31:0/2272371607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee040b2cf0 msgr2=0x7fee040cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:25.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee09800640 1 --2- 172.21.15.31:0/2272371607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee040b2cf0 0x7fee040cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:25.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee09800640 1 -- 172.21.15.31:0/2272371607 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee041f5c30 con 0x7fee040d07b0 2024-09-17T05:31:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.267+0000 7fee08e00640 1 --2- 172.21.15.31:0/2272371607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee040b2cf0 0x7fee040cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:31:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.271+0000 7fee09800640 1 --2- 172.21.15.31:0/2272371607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee040d07b0 0x7fee041f4d70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fedfc00ccb0 tx=0x7fedfc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.271+0000 7fee00c00640 1 -- 172.21.15.31:0/2272371607 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc004b30 con 0x7fee040d07b0 2024-09-17T05:31:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.271+0000 7fee00c00640 1 -- 172.21.15.31:0/2272371607 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedfc004de0 con 0x7fee040d07b0 2024-09-17T05:31:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.271+0000 7fee00c00640 1 -- 172.21.15.31:0/2272371607 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc005280 con 0x7fee040d07b0 2024-09-17T05:31:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.271+0000 7fee0b800640 1 -- 172.21.15.31:0/2272371607 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee041f5670 con 0x7fee040d07b0 2024-09-17T05:31:25.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.271+0000 7fee0b800640 1 -- 172.21.15.31:0/2272371607 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee041f5f40 con 0x7fee040d07b0 2024-09-17T05:31:25.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.271+0000 7fee0b800640 1 -- 172.21.15.31:0/2272371607 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee040d0270 con 0x7fee040d07b0 2024-09-17T05:31:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.275+0000 7fee00c00640 1 -- 172.21.15.31:0/2272371607 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 7) ==== 97438+0+0 (secure 0 0 0) 0x7fedfc0054e0 con 0x7fee040d07b0 2024-09-17T05:31:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.275+0000 7fee00c00640 1 --2- 172.21.15.31:0/2272371607 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fede4073510 0x7fede40759d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:25.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.275+0000 7fee00c00640 1 -- 172.21.15.31:0/2272371607 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fedfc095190 con 0x7fee040d07b0 2024-09-17T05:31:25.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.275+0000 7fee08e00640 1 --2- 172.21.15.31:0/2272371607 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fede4073510 0x7fede40759d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:25.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.275+0000 7fee08e00640 1 --2- 172.21.15.31:0/2272371607 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fede4073510 0x7fede40759d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fedf00b2000 tx=0x7fedf001d8f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:25.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.279+0000 7fee00c00640 1 -- 172.21.15.31:0/2272371607 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fedfc014030 con 0x7fee040d07b0 2024-09-17T05:31:25.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.499+0000 7fee0b800640 1 -- 172.21.15.31:0/2272371607 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee040c8730 con 0x7fee040d07b0 2024-09-17T05:31:25.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.499+0000 7fee00c00640 1 -- 172.21.15.31:0/2272371607 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7fedfc05f7b0 con 0x7fee040d07b0 2024-09-17T05:31:25.504 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:25.505 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T05:30:20:371375+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:31:25.505 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T05:31:25.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.499+0000 7fee0b800640 1 -- 172.21.15.31:0/2272371607 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fede4073510 msgr2=0x7fede40759d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:25.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.499+0000 7fee0b800640 1 --2- 172.21.15.31:0/2272371607 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fede4073510 0x7fede40759d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fedf00b2000 tx=0x7fedf001d8f0 comp rx=0 tx=0).stop 2024-09-17T05:31:25.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.499+0000 7fee0b800640 1 -- 172.21.15.31:0/2272371607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee040d07b0 msgr2=0x7fee041f4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:25.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.499+0000 7fee0b800640 1 --2- 172.21.15.31:0/2272371607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee040d07b0 0x7fee041f4d70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fedfc00ccb0 tx=0x7fedfc00a620 comp rx=0 tx=0).stop 2024-09-17T05:31:25.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.499+0000 7fee0b800640 1 -- 172.21.15.31:0/2272371607 shutdown_connections 2024-09-17T05:31:25.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.499+0000 7fee0b800640 1 --2- 172.21.15.31:0/2272371607 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fede4073510 0x7fede40759d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:25.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.499+0000 7fee0b800640 1 --2- 172.21.15.31:0/2272371607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee040d07b0 0x7fee041f4d70 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:25.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.499+0000 7fee0b800640 1 --2- 172.21.15.31:0/2272371607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee040cfe90 0x7fee040b7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:25.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.499+0000 7fee0b800640 1 --2- 172.21.15.31:0/2272371607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee040b2cf0 0x7fee040cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:25.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.503+0000 7fee0b800640 1 -- 172.21.15.31:0/2272371607 >> 172.21.15.31:0/2272371607 conn(0x7fee040d1dc0 msgr2=0x7fee040aea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:25.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.503+0000 7fee0b800640 1 -- 172.21.15.31:0/2272371607 shutdown_connections 2024-09-17T05:31:25.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:25.503+0000 7fee0b800640 1 -- 172.21.15.31:0/2272371607 wait complete. 2024-09-17T05:31:25.526 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:31:25.691 INFO:teuthology.orchestra.run.smithi031.stdout:[] 2024-09-17T05:31:25.691 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-17T05:31:25.692 DEBUG:tasks.ceph_test_case:wait_until_true: success in 55s and 0 retries 2024-09-17T05:31:25.692 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:31:25.692 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:31:25.761 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:31:25.849 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:31:25.850 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:31:25.850 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:31:25.850 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:31:25.859 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:31:25.859 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:31:25.859 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:31:25.859 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:31:25.868 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:31:25.868 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:31:25.868 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:31:25.868 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:31:25.914 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:31:25.914 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:31:25.915 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:31:25.915 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:31:25.924 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:31:25.924 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:31:26.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.103+0000 7fe9f8e00640 1 -- 172.21.15.31:0/4134968537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f415c130 msgr2=0x7fe9f40cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:26.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.103+0000 7fe9f8e00640 1 --2- 172.21.15.31:0/4134968537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f415c130 0x7fe9f40cce80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe9f406d870 tx=0x7fe9ec01cc60 comp rx=0 tx=0).stop 2024-09-17T05:31:26.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.103+0000 7fe9f8e00640 1 -- 172.21.15.31:0/4134968537 shutdown_connections 2024-09-17T05:31:26.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.103+0000 7fe9f8e00640 1 --2- 172.21.15.31:0/4134968537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f415c130 0x7fe9f40cce80 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.103+0000 7fe9f8e00640 1 --2- 172.21.15.31:0/4134968537 >> v2:172.21.15.155:3300/0 conn(0x7fe9f40cecf0 0x7fe9f40cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.103+0000 7fe9f8e00640 1 -- 172.21.15.31:0/4134968537 >> 172.21.15.31:0/4134968537 conn(0x7fe9f40d1ea0 msgr2=0x7fe9f40d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:26.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.103+0000 7fe9f8e00640 1 -- 172.21.15.31:0/4134968537 shutdown_connections 2024-09-17T05:31:26.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.103+0000 7fe9f8e00640 1 -- 172.21.15.31:0/4134968537 wait complete. 2024-09-17T05:31:26.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.103+0000 7fe9f8e00640 1 Processor -- start 2024-09-17T05:31:26.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.103+0000 7fe9f8e00640 1 -- start start 2024-09-17T05:31:26.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f8e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f40cecf0 0x7fe9f4156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:26.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f8e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9f415bd50 0x7fe9f40b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:26.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f8e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9f415c130 0x7fe9f415ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:26.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f8e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f4169540 con 0x7fe9f40cecf0 2024-09-17T05:31:26.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f8e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f41693c0 con 0x7fe9f415bd50 2024-09-17T05:31:26.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f8e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe9f41696c0 con 0x7fe9f415c130 2024-09-17T05:31:26.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f40cecf0 0x7fe9f4156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:26.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f40cecf0 0x7fe9f4156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46202/0 (socket says 172.21.15.31:46202) 2024-09-17T05:31:26.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f1e00640 1 -- 172.21.15.31:0/541639341 learned_addr learned my addr 172.21.15.31:0/541639341 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:26.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9ebe00640 1 --2- 172.21.15.31:0/541639341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9f415bd50 0x7fe9f40b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:26.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f2800640 1 --2- 172.21.15.31:0/541639341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9f415c130 0x7fe9f415ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:26.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f1e00640 1 -- 172.21.15.31:0/541639341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9f415c130 msgr2=0x7fe9f415ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:26.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f1e00640 1 --2- 172.21.15.31:0/541639341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9f415c130 0x7fe9f415ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f1e00640 1 -- 172.21.15.31:0/541639341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9f415bd50 msgr2=0x7fe9f40b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:26.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f1e00640 1 --2- 172.21.15.31:0/541639341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9f415bd50 0x7fe9f40b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f1e00640 1 -- 172.21.15.31:0/541639341 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f40aedc0 con 0x7fe9f40cecf0 2024-09-17T05:31:26.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f1e00640 1 --2- 172.21.15.31:0/541639341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f40cecf0 0x7fe9f4156590 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400c500 tx=0x7fe9e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:26.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9ea000640 1 -- 172.21.15.31:0/541639341 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4017070 con 0x7fe9f40cecf0 2024-09-17T05:31:26.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9ea000640 1 -- 172.21.15.31:0/541639341 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9e40053c0 con 0x7fe9f40cecf0 2024-09-17T05:31:26.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f8e00640 1 -- 172.21.15.31:0/541639341 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f40c9490 con 0x7fe9f40cecf0 2024-09-17T05:31:26.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9ea000640 1 -- 172.21.15.31:0/541639341 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4012890 con 0x7fe9f40cecf0 2024-09-17T05:31:26.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f8e00640 1 -- 172.21.15.31:0/541639341 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f4156ad0 con 0x7fe9f40cecf0 2024-09-17T05:31:26.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9f8e00640 1 -- 172.21.15.31:0/541639341 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9f40ce5e0 con 0x7fe9f40cecf0 2024-09-17T05:31:26.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.107+0000 7fe9ea000640 1 -- 172.21.15.31:0/541639341 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 7) ==== 97438+0+0 (secure 0 0 0) 0x7fe9e401a070 con 0x7fe9f40cecf0 2024-09-17T05:31:26.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.111+0000 7fe9ea000640 1 --2- 172.21.15.31:0/541639341 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe9d0073440 0x7fe9d0075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:26.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.111+0000 7fe9ea000640 1 -- 172.21.15.31:0/541639341 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fe9e40939f0 con 0x7fe9f40cecf0 2024-09-17T05:31:26.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.111+0000 7fe9ebe00640 1 --2- 172.21.15.31:0/541639341 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe9d0073440 0x7fe9d0075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:26.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.111+0000 7fe9ebe00640 1 --2- 172.21.15.31:0/541639341 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe9d0073440 0x7fe9d0075900 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40d1020 tx=0x7fe9dc0091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:26.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.115+0000 7fe9ea000640 1 -- 172.21.15.31:0/541639341 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe9e405df10 con 0x7fe9f40cecf0 2024-09-17T05:31:26.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.327+0000 7fe9f8e00640 1 -- 172.21.15.31:0/541639341 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9f40c9660 con 0x7fe9f40cecf0 2024-09-17T05:31:26.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.327+0000 7fe9ea000640 1 -- 172.21.15.31:0/541639341 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7fe9e4062940 con 0x7fe9f40cecf0 2024-09-17T05:31:26.333 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:26.334 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T05:30:20:371375+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:31:26.334 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T05:31:26.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.331+0000 7fe9f8e00640 1 -- 172.21.15.31:0/541639341 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe9d0073440 msgr2=0x7fe9d0075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:26.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.331+0000 7fe9f8e00640 1 --2- 172.21.15.31:0/541639341 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe9d0073440 0x7fe9d0075900 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40d1020 tx=0x7fe9dc0091e0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.331+0000 7fe9f8e00640 1 -- 172.21.15.31:0/541639341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f40cecf0 msgr2=0x7fe9f4156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:26.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.331+0000 7fe9f8e00640 1 --2- 172.21.15.31:0/541639341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f40cecf0 0x7fe9f4156590 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400c500 tx=0x7fe9e400c9c0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.331+0000 7fe9f8e00640 1 -- 172.21.15.31:0/541639341 shutdown_connections 2024-09-17T05:31:26.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.331+0000 7fe9f8e00640 1 --2- 172.21.15.31:0/541639341 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe9d0073440 0x7fe9d0075900 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.331+0000 7fe9f8e00640 1 --2- 172.21.15.31:0/541639341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9f415c130 0x7fe9f415ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.331+0000 7fe9f8e00640 1 --2- 172.21.15.31:0/541639341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9f415bd50 0x7fe9f40b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.331+0000 7fe9f8e00640 1 --2- 172.21.15.31:0/541639341 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9f40cecf0 0x7fe9f4156590 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.331+0000 7fe9f8e00640 1 -- 172.21.15.31:0/541639341 >> 172.21.15.31:0/541639341 conn(0x7fe9f40d1ea0 msgr2=0x7fe9f40d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:26.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.331+0000 7fe9f8e00640 1 -- 172.21.15.31:0/541639341 shutdown_connections 2024-09-17T05:31:26.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.331+0000 7fe9f8e00640 1 -- 172.21.15.31:0/541639341 wait complete. 2024-09-17T05:31:26.356 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:31:26.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.495+0000 7fc728000640 1 -- 172.21.15.31:0/267937569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7200d28e0 msgr2=0x7fc7200cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:26.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.495+0000 7fc728000640 1 --2- 172.21.15.31:0/267937569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7200d28e0 0x7fc7200cebb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc718009c80 tx=0x7fc71801cda0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.495+0000 7fc728000640 1 -- 172.21.15.31:0/267937569 shutdown_connections 2024-09-17T05:31:26.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.495+0000 7fc728000640 1 --2- 172.21.15.31:0/267937569 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7200d28e0 0x7fc7200cebb0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.495+0000 7fc728000640 1 --2- 172.21.15.31:0/267937569 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc72015bea0 0x7fc7200ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.495+0000 7fc728000640 1 -- 172.21.15.31:0/267937569 >> 172.21.15.31:0/267937569 conn(0x7fc7200d1dc0 msgr2=0x7fc7200d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:26.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.495+0000 7fc728000640 1 -- 172.21.15.31:0/267937569 shutdown_connections 2024-09-17T05:31:26.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.495+0000 7fc728000640 1 -- 172.21.15.31:0/267937569 wait complete. 2024-09-17T05:31:26.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc728000640 1 Processor -- start 2024-09-17T05:31:26.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc728000640 1 -- start start 2024-09-17T05:31:26.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc728000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7200cdb30 0x7fc720156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:26.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc728000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7200d28e0 0x7fc720159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:26.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc728000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc72015bea0 0x7fc72015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:26.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc728000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc720169020 con 0x7fc7200d28e0 2024-09-17T05:31:26.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc728000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc720168ea0 con 0x7fc72015bea0 2024-09-17T05:31:26.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc728000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc7201691a0 con 0x7fc7200cdb30 2024-09-17T05:31:26.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc724c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7200d28e0 0x7fc720159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:26.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc724c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7200d28e0 0x7fc720159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46226/0 (socket says 172.21.15.31:46226) 2024-09-17T05:31:26.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc724c00640 1 -- 172.21.15.31:0/2951442127 learned_addr learned my addr 172.21.15.31:0/2951442127 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:26.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc725600640 1 --2- 172.21.15.31:0/2951442127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7200cdb30 0x7fc720156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:26.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc726000640 1 --2- 172.21.15.31:0/2951442127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc72015bea0 0x7fc72015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:26.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc724c00640 1 -- 172.21.15.31:0/2951442127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7200cdb30 msgr2=0x7fc720156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:26.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc724c00640 1 --2- 172.21.15.31:0/2951442127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7200cdb30 0x7fc720156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc724c00640 1 -- 172.21.15.31:0/2951442127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc72015bea0 msgr2=0x7fc72015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:26.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc724c00640 1 --2- 172.21.15.31:0/2951442127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc72015bea0 0x7fc72015a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc724c00640 1 -- 172.21.15.31:0/2951442127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7200c9810 con 0x7fc7200d28e0 2024-09-17T05:31:26.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc726000640 1 --2- 172.21.15.31:0/2951442127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc72015bea0 0x7fc72015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:31:26.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc724c00640 1 --2- 172.21.15.31:0/2951442127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7200d28e0 0x7fc720159eb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00c500 tx=0x7fc70c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:26.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc71d600640 1 -- 172.21.15.31:0/2951442127 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c017070 con 0x7fc7200d28e0 2024-09-17T05:31:26.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc71d600640 1 -- 172.21.15.31:0/2951442127 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc70c0053c0 con 0x7fc7200d28e0 2024-09-17T05:31:26.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc71d600640 1 -- 172.21.15.31:0/2951442127 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c012890 con 0x7fc7200d28e0 2024-09-17T05:31:26.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc728000640 1 -- 172.21.15.31:0/2951442127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7200c9af0 con 0x7fc7200d28e0 2024-09-17T05:31:26.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc728000640 1 -- 172.21.15.31:0/2951442127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7200ca0b0 con 0x7fc7200d28e0 2024-09-17T05:31:26.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.499+0000 7fc728000640 1 -- 172.21.15.31:0/2951442127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7200cc9d0 con 0x7fc7200d28e0 2024-09-17T05:31:26.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.503+0000 7fc71d600640 1 -- 172.21.15.31:0/2951442127 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 7) ==== 97438+0+0 (secure 0 0 0) 0x7fc70c01a070 con 0x7fc7200d28e0 2024-09-17T05:31:26.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.503+0000 7fc71d600640 1 --2- 172.21.15.31:0/2951442127 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc700073440 0x7fc700075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:26.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.503+0000 7fc71d600640 1 -- 172.21.15.31:0/2951442127 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fc70c093a40 con 0x7fc7200d28e0 2024-09-17T05:31:26.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.503+0000 7fc725600640 1 --2- 172.21.15.31:0/2951442127 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc700073440 0x7fc700075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:26.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.503+0000 7fc725600640 1 --2- 172.21.15.31:0/2951442127 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc700073440 0x7fc700075900 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc714004630 tx=0x7fc71400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:26.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.507+0000 7fc71d600640 1 -- 172.21.15.31:0/2951442127 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc70c05df60 con 0x7fc7200d28e0 2024-09-17T05:31:26.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.719+0000 7fc728000640 1 -- 172.21.15.31:0/2951442127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7200762f0 con 0x7fc7200d28e0 2024-09-17T05:31:26.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.719+0000 7fc71d600640 1 -- 172.21.15.31:0/2951442127 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7fc70c062990 con 0x7fc7200d28e0 2024-09-17T05:31:26.724 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:26.724 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T05:30:20:371375+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:31:26.724 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T05:31:26.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.719+0000 7fc728000640 1 -- 172.21.15.31:0/2951442127 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc700073440 msgr2=0x7fc700075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:26.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.719+0000 7fc728000640 1 --2- 172.21.15.31:0/2951442127 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc700073440 0x7fc700075900 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc714004630 tx=0x7fc71400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.719+0000 7fc728000640 1 -- 172.21.15.31:0/2951442127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7200d28e0 msgr2=0x7fc720159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:26.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.719+0000 7fc728000640 1 --2- 172.21.15.31:0/2951442127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7200d28e0 0x7fc720159eb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00c500 tx=0x7fc70c00c9c0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.719+0000 7fc728000640 1 -- 172.21.15.31:0/2951442127 shutdown_connections 2024-09-17T05:31:26.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.719+0000 7fc728000640 1 --2- 172.21.15.31:0/2951442127 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc700073440 0x7fc700075900 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.719+0000 7fc728000640 1 --2- 172.21.15.31:0/2951442127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc72015bea0 0x7fc72015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.719+0000 7fc728000640 1 --2- 172.21.15.31:0/2951442127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7200d28e0 0x7fc720159eb0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.719+0000 7fc728000640 1 --2- 172.21.15.31:0/2951442127 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7200cdb30 0x7fc720156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.719+0000 7fc728000640 1 -- 172.21.15.31:0/2951442127 >> 172.21.15.31:0/2951442127 conn(0x7fc7200d1dc0 msgr2=0x7fc72006f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:26.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.719+0000 7fc728000640 1 -- 172.21.15.31:0/2951442127 shutdown_connections 2024-09-17T05:31:26.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.719+0000 7fc728000640 1 -- 172.21.15.31:0/2951442127 wait complete. 2024-09-17T05:31:26.746 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:31:26.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.887+0000 7f76d7800640 1 -- 172.21.15.31:0/2944354021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76d00d28e0 msgr2=0x7f76d00cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:26.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.887+0000 7f76d7800640 1 --2- 172.21.15.31:0/2944354021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76d00d28e0 0x7f76d00cc9d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f76d0074010 tx=0x7f76c801cd80 comp rx=0 tx=0).stop 2024-09-17T05:31:26.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.887+0000 7f76d7800640 1 -- 172.21.15.31:0/2944354021 shutdown_connections 2024-09-17T05:31:26.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.887+0000 7f76d7800640 1 --2- 172.21.15.31:0/2944354021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76d00d28e0 0x7f76d00cc9d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.887+0000 7f76d7800640 1 --2- 172.21.15.31:0/2944354021 >> v2:172.21.15.155:3300/0 conn(0x7f76d00cdb30 0x7f76d00cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.887+0000 7f76d7800640 1 --2- 172.21.15.31:0/2944354021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76d015bea0 0x7f76d00ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.887+0000 7f76d7800640 1 -- 172.21.15.31:0/2944354021 >> 172.21.15.31:0/2944354021 conn(0x7f76d00d1dc0 msgr2=0x7f76d00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:26.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.887+0000 7f76d7800640 1 -- 172.21.15.31:0/2944354021 shutdown_connections 2024-09-17T05:31:26.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.887+0000 7f76d7800640 1 -- 172.21.15.31:0/2944354021 wait complete. 2024-09-17T05:31:26.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d7800640 1 Processor -- start 2024-09-17T05:31:26.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d7800640 1 -- start start 2024-09-17T05:31:26.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d7800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76d00cdb30 0x7f76d015a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:26.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d7800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76d00d28e0 0x7f76d015a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:26.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d7800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76d015bea0 0x7f76d0148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:26.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d7800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f76d00af1b0 con 0x7f76d00cdb30 2024-09-17T05:31:26.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d7800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f76d00af030 con 0x7f76d00d28e0 2024-09-17T05:31:26.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d7800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f76d00af330 con 0x7f76d015bea0 2024-09-17T05:31:26.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d4e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76d00cdb30 0x7f76d015a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:26.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d4e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76d00cdb30 0x7f76d015a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46240/0 (socket says 172.21.15.31:46240) 2024-09-17T05:31:26.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d4e00640 1 -- 172.21.15.31:0/2968441072 learned_addr learned my addr 172.21.15.31:0/2968441072 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:26.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76cfe00640 1 --2- 172.21.15.31:0/2968441072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76d00d28e0 0x7f76d015a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:26.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d5800640 1 --2- 172.21.15.31:0/2968441072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76d015bea0 0x7f76d0148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:26.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d4e00640 1 -- 172.21.15.31:0/2968441072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76d015bea0 msgr2=0x7f76d0148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:26.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d4e00640 1 --2- 172.21.15.31:0/2968441072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76d015bea0 0x7f76d0148600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d4e00640 1 -- 172.21.15.31:0/2968441072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76d00d28e0 msgr2=0x7f76d015a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:26.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d4e00640 1 --2- 172.21.15.31:0/2968441072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76d00d28e0 0x7f76d015a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:26.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d4e00640 1 -- 172.21.15.31:0/2968441072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d00cbca0 con 0x7f76d00cdb30 2024-09-17T05:31:26.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d4e00640 1 --2- 172.21.15.31:0/2968441072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76d00cdb30 0x7f76d015a190 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f76c400b410 tx=0x7f76c400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:26.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76ccc00640 1 -- 172.21.15.31:0/2968441072 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4015020 con 0x7f76d00cdb30 2024-09-17T05:31:26.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76ccc00640 1 -- 172.21.15.31:0/2968441072 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76c4011920 con 0x7f76d00cdb30 2024-09-17T05:31:26.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76ccc00640 1 -- 172.21.15.31:0/2968441072 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4011d70 con 0x7f76d00cdb30 2024-09-17T05:31:26.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d7800640 1 -- 172.21.15.31:0/2968441072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d00cb9c0 con 0x7f76d00cdb30 2024-09-17T05:31:26.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d7800640 1 -- 172.21.15.31:0/2968441072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d00cb690 con 0x7f76d00cdb30 2024-09-17T05:31:26.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.891+0000 7f76d7800640 1 -- 172.21.15.31:0/2968441072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d00af8e0 con 0x7f76d00cdb30 2024-09-17T05:31:26.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.895+0000 7f76ccc00640 1 -- 172.21.15.31:0/2968441072 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 7) ==== 97438+0+0 (secure 0 0 0) 0x7f76c4018020 con 0x7f76d00cdb30 2024-09-17T05:31:26.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.895+0000 7f76ccc00640 1 --2- 172.21.15.31:0/2968441072 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f76b0073440 0x7f76b0075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:26.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.895+0000 7f76ccc00640 1 -- 172.21.15.31:0/2968441072 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f76c4094500 con 0x7f76d00cdb30 2024-09-17T05:31:26.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.895+0000 7f76cfe00640 1 --2- 172.21.15.31:0/2968441072 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f76b0073440 0x7f76b0075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:26.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.895+0000 7f76cfe00640 1 --2- 172.21.15.31:0/2968441072 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f76b0073440 0x7f76b0075900 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f76d00b4650 tx=0x7f76bc00a2d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:26.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:26.899+0000 7f76ccc00640 1 -- 172.21.15.31:0/2968441072 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f76c401f020 con 0x7f76d00cdb30 2024-09-17T05:31:27.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.079+0000 7f76d7800640 1 -- 172.21.15.31:0/2968441072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76d00c86e0 con 0x7f76d00cdb30 2024-09-17T05:31:27.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.079+0000 7f76ccc00640 1 -- 172.21.15.31:0/2968441072 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16849 (secure 0 0 0) 0x7f76c405eaa0 con 0x7f76d00cdb30 2024-09-17T05:31:27.085 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:27.085 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":46,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:30:26.399174+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:30:03.431634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T05:30:04.672605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2a","mappings":[{"from":0,"to":5}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:31:27.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.083+0000 7f76d7800640 1 -- 172.21.15.31:0/2968441072 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f76b0073440 msgr2=0x7f76b0075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:27.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.083+0000 7f76d7800640 1 --2- 172.21.15.31:0/2968441072 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f76b0073440 0x7f76b0075900 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f76d00b4650 tx=0x7f76bc00a2d0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.083+0000 7f76d7800640 1 -- 172.21.15.31:0/2968441072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76d00cdb30 msgr2=0x7f76d015a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:27.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.083+0000 7f76d7800640 1 --2- 172.21.15.31:0/2968441072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76d00cdb30 0x7f76d015a190 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f76c400b410 tx=0x7f76c400b8d0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.083+0000 7f76d7800640 1 -- 172.21.15.31:0/2968441072 shutdown_connections 2024-09-17T05:31:27.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.083+0000 7f76d7800640 1 --2- 172.21.15.31:0/2968441072 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f76b0073440 0x7f76b0075900 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.083+0000 7f76d7800640 1 --2- 172.21.15.31:0/2968441072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76d015bea0 0x7f76d0148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.083+0000 7f76d7800640 1 --2- 172.21.15.31:0/2968441072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f76d00d28e0 0x7f76d015a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.083+0000 7f76d7800640 1 --2- 172.21.15.31:0/2968441072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76d00cdb30 0x7f76d015a190 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.083+0000 7f76d7800640 1 -- 172.21.15.31:0/2968441072 >> 172.21.15.31:0/2968441072 conn(0x7f76d00d1dc0 msgr2=0x7f76d00b76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:27.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.083+0000 7f76d7800640 1 -- 172.21.15.31:0/2968441072 shutdown_connections 2024-09-17T05:31:27.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.083+0000 7f76d7800640 1 -- 172.21.15.31:0/2968441072 wait complete. 2024-09-17T05:31:27.107 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:31:27.107 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:31:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.247+0000 7f8b3b400640 1 -- 172.21.15.31:0/211907492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b18003c20 msgr2=0x7f8b18004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.247+0000 7f8b3b400640 1 --2- 172.21.15.31:0/211907492 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b18003c20 0x7f8b18004020 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009d30 tx=0x7f8b2401d410 comp rx=0 tx=0).stop 2024-09-17T05:31:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.247+0000 7f8b39400640 1 -- 172.21.15.31:0/211907492 reap_dead start 2024-09-17T05:31:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b3b400640 1 -- 172.21.15.31:0/211907492 shutdown_connections 2024-09-17T05:31:27.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b3b400640 1 -- 172.21.15.31:0/211907492 >> 172.21.15.31:0/211907492 conn(0x7f8b340d1dc0 msgr2=0x7f8b340d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b3b400640 1 -- 172.21.15.31:0/211907492 shutdown_connections 2024-09-17T05:31:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b3b400640 1 -- 172.21.15.31:0/211907492 wait complete. 2024-09-17T05:31:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b3b400640 1 Processor -- start 2024-09-17T05:31:27.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b3b400640 1 -- start start 2024-09-17T05:31:27.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b3b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b18003c20 0x7f8b3409d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:27.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b3b400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b340cbb20 0x7f8b341f9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:27.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b3b400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b341f9580 0x7f8b341f9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:27.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b3b400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8b34167d00 con 0x7f8b18003c20 2024-09-17T05:31:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b3b400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8b34167b80 con 0x7f8b340cbb20 2024-09-17T05:31:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b3b400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8b34167e80 con 0x7f8b341f9580 2024-09-17T05:31:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b38a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b18003c20 0x7f8b3409d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b38a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b18003c20 0x7f8b3409d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46252/0 (socket says 172.21.15.31:46252) 2024-09-17T05:31:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b38a00640 1 -- 172.21.15.31:0/2802200339 learned_addr learned my addr 172.21.15.31:0/2802200339 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b2be00640 1 --2- 172.21.15.31:0/2802200339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b340cbb20 0x7f8b341f9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b39400640 1 --2- 172.21.15.31:0/2802200339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b341f9580 0x7f8b341f9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b38a00640 1 -- 172.21.15.31:0/2802200339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b341f9580 msgr2=0x7f8b341f9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b38a00640 1 --2- 172.21.15.31:0/2802200339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b341f9580 0x7f8b341f9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b38a00640 1 -- 172.21.15.31:0/2802200339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b340cbb20 msgr2=0x7f8b341f9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:27.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b38a00640 1 --2- 172.21.15.31:0/2802200339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b340cbb20 0x7f8b341f9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b38a00640 1 -- 172.21.15.31:0/2802200339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3409d890 con 0x7f8b18003c20 2024-09-17T05:31:27.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b38a00640 1 --2- 172.21.15.31:0/2802200339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b18003c20 0x7f8b3409d040 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009c50 tx=0x7f8b24005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:27.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.251+0000 7f8b31600640 1 -- 172.21.15.31:0/2802200339 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b24009900 con 0x7f8b18003c20 2024-09-17T05:31:27.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.255+0000 7f8b31600640 1 -- 172.21.15.31:0/2802200339 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b240043d0 con 0x7f8b18003c20 2024-09-17T05:31:27.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.255+0000 7f8b31600640 1 -- 172.21.15.31:0/2802200339 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b24004a10 con 0x7f8b18003c20 2024-09-17T05:31:27.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.255+0000 7f8b3b400640 1 -- 172.21.15.31:0/2802200339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b3409db30 con 0x7f8b18003c20 2024-09-17T05:31:27.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.255+0000 7f8b3b400640 1 -- 172.21.15.31:0/2802200339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b340cc070 con 0x7f8b18003c20 2024-09-17T05:31:27.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.255+0000 7f8b3b400640 1 -- 172.21.15.31:0/2802200339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b340cc9d0 con 0x7f8b18003c20 2024-09-17T05:31:27.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.255+0000 7f8b31600640 1 -- 172.21.15.31:0/2802200339 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 7) ==== 97438+0+0 (secure 0 0 0) 0x7f8b240c0020 con 0x7f8b18003c20 2024-09-17T05:31:27.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.255+0000 7f8b31600640 1 --2- 172.21.15.31:0/2802200339 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8b10073440 0x7f8b10075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:27.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.255+0000 7f8b31600640 1 -- 172.21.15.31:0/2802200339 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f8b2412f480 con 0x7f8b18003c20 2024-09-17T05:31:27.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.255+0000 7f8b2be00640 1 --2- 172.21.15.31:0/2802200339 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8b10073440 0x7f8b10075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:27.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.259+0000 7f8b2be00640 1 --2- 172.21.15.31:0/2802200339 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8b10073440 0x7f8b10075900 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8b340cb630 tx=0x7f8b1c001e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:27.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.259+0000 7f8b31600640 1 -- 172.21.15.31:0/2802200339 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8b240c7020 con 0x7f8b18003c20 2024-09-17T05:31:27.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.471+0000 7f8b3b400640 1 -- 172.21.15.31:0/2802200339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b3415aed0 con 0x7f8b18003c20 2024-09-17T05:31:27.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.471+0000 7f8b31600640 1 -- 172.21.15.31:0/2802200339 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7f8b24017120 con 0x7f8b18003c20 2024-09-17T05:31:27.479 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:27.479 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T05:30:20:371375+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:31:27.479 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T05:31:27.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.475+0000 7f8b3b400640 1 -- 172.21.15.31:0/2802200339 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8b10073440 msgr2=0x7f8b10075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:27.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.475+0000 7f8b3b400640 1 --2- 172.21.15.31:0/2802200339 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8b10073440 0x7f8b10075900 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8b340cb630 tx=0x7f8b1c001e30 comp rx=0 tx=0).stop 2024-09-17T05:31:27.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.475+0000 7f8b3b400640 1 -- 172.21.15.31:0/2802200339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b18003c20 msgr2=0x7f8b3409d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:27.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.475+0000 7f8b3b400640 1 --2- 172.21.15.31:0/2802200339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b18003c20 0x7f8b3409d040 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009c50 tx=0x7f8b24005620 comp rx=0 tx=0).stop 2024-09-17T05:31:27.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.475+0000 7f8b3b400640 1 -- 172.21.15.31:0/2802200339 shutdown_connections 2024-09-17T05:31:27.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.475+0000 7f8b3b400640 1 --2- 172.21.15.31:0/2802200339 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8b10073440 0x7f8b10075900 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.475+0000 7f8b3b400640 1 --2- 172.21.15.31:0/2802200339 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b341f9580 0x7f8b341f9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.475+0000 7f8b3b400640 1 --2- 172.21.15.31:0/2802200339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b340cbb20 0x7f8b341f9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.475+0000 7f8b3b400640 1 --2- 172.21.15.31:0/2802200339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b18003c20 0x7f8b3409d040 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.475+0000 7f8b3b400640 1 -- 172.21.15.31:0/2802200339 >> 172.21.15.31:0/2802200339 conn(0x7f8b340d1dc0 msgr2=0x7f8b340ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:27.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.475+0000 7f8b3b400640 1 -- 172.21.15.31:0/2802200339 shutdown_connections 2024-09-17T05:31:27.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.475+0000 7f8b3b400640 1 -- 172.21.15.31:0/2802200339 wait complete. 2024-09-17T05:31:27.500 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:31:27.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.643+0000 7f9744a00640 1 -- 172.21.15.31:0/3044515330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f974015e330 msgr2=0x7f97400d1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:27.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.643+0000 7f9744a00640 1 --2- 172.21.15.31:0/3044515330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f974015e330 0x7f97400d1140 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9738009c80 tx=0x7f97400b0bf0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.643+0000 7f9744a00640 1 -- 172.21.15.31:0/3044515330 shutdown_connections 2024-09-17T05:31:27.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.643+0000 7f9744a00640 1 --2- 172.21.15.31:0/3044515330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f974015e330 0x7f97400d1140 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.643+0000 7f9744a00640 1 -- 172.21.15.31:0/3044515330 >> 172.21.15.31:0/3044515330 conn(0x7f97400d1dc0 msgr2=0x7f97400d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:27.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.643+0000 7f9744a00640 1 -- 172.21.15.31:0/3044515330 shutdown_connections 2024-09-17T05:31:27.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.643+0000 7f9744a00640 1 -- 172.21.15.31:0/3044515330 wait complete. 2024-09-17T05:31:27.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.643+0000 7f9744a00640 1 Processor -- start 2024-09-17T05:31:27.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f9744a00640 1 -- start start 2024-09-17T05:31:27.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f9744a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f974006ee50 0x7f97400b7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:27.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f9744a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f974015df50 0x7f9740153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:27.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f9744a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974015e330 0x7f9740070980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:27.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f9744a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f974016c530 con 0x7f974006ee50 2024-09-17T05:31:27.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f9744a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f974016c3b0 con 0x7f974015e330 2024-09-17T05:31:27.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f9744a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f974016c6b0 con 0x7f974015df50 2024-09-17T05:31:27.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f973de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f974006ee50 0x7f97400b7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:27.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f973de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f974006ee50 0x7f97400b7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46272/0 (socket says 172.21.15.31:46272) 2024-09-17T05:31:27.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f973de00640 1 -- 172.21.15.31:0/3308648180 learned_addr learned my addr 172.21.15.31:0/3308648180 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:27.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f973e800640 1 --2- 172.21.15.31:0/3308648180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974015e330 0x7f9740070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:27.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f9735400640 1 --2- 172.21.15.31:0/3308648180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f974015df50 0x7f9740153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:27.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f973de00640 1 -- 172.21.15.31:0/3308648180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f974015df50 msgr2=0x7f9740153fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:27.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f973de00640 1 --2- 172.21.15.31:0/3308648180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f974015df50 0x7f9740153fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f973de00640 1 -- 172.21.15.31:0/3308648180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974015e330 msgr2=0x7f9740070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:27.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f973de00640 1 --2- 172.21.15.31:0/3308648180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974015e330 0x7f9740070980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f973de00640 1 -- 172.21.15.31:0/3308648180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974009f760 con 0x7f974006ee50 2024-09-17T05:31:27.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f973e800640 1 --2- 172.21.15.31:0/3308648180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974015e330 0x7f9740070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:31:27.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f9735400640 1 --2- 172.21.15.31:0/3308648180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f974015df50 0x7f9740153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:31:27.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f973de00640 1 --2- 172.21.15.31:0/3308648180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f974006ee50 0x7f97400b7640 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f973000c530 tx=0x7f973000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:27.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f9736a00640 1 -- 172.21.15.31:0/3308648180 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9730017070 con 0x7f974006ee50 2024-09-17T05:31:27.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f9736a00640 1 -- 172.21.15.31:0/3308648180 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9730003600 con 0x7f974006ee50 2024-09-17T05:31:27.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f9736a00640 1 -- 172.21.15.31:0/3308648180 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9730003a50 con 0x7f974006ee50 2024-09-17T05:31:27.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f9744a00640 1 -- 172.21.15.31:0/3308648180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9740159ea0 con 0x7f974006ee50 2024-09-17T05:31:27.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f9744a00640 1 -- 172.21.15.31:0/3308648180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9740156d80 con 0x7f974006ee50 2024-09-17T05:31:27.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.647+0000 7f9744a00640 1 -- 172.21.15.31:0/3308648180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97400afcd0 con 0x7f974006ee50 2024-09-17T05:31:27.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.651+0000 7f9736a00640 1 -- 172.21.15.31:0/3308648180 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f973001a070 con 0x7f974006ee50 2024-09-17T05:31:27.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.651+0000 7f9736a00640 1 --2- 172.21.15.31:0/3308648180 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f971c0733b0 0x7f971c075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:27.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.651+0000 7f9736a00640 1 -- 172.21.15.31:0/3308648180 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f9730093a10 con 0x7f974006ee50 2024-09-17T05:31:27.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.651+0000 7f9735400640 1 --2- 172.21.15.31:0/3308648180 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f971c0733b0 0x7f971c075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:27.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.651+0000 7f9735400640 1 --2- 172.21.15.31:0/3308648180 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f971c0733b0 0x7f971c075870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f97400b0070 tx=0x7f9728009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:27.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.655+0000 7f9736a00640 1 -- 172.21.15.31:0/3308648180 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f973005e7a0 con 0x7f974006ee50 2024-09-17T05:31:27.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.867+0000 7f9744a00640 1 -- 172.21.15.31:0/3308648180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9740159c70 con 0x7f974006ee50 2024-09-17T05:31:27.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.867+0000 7f9736a00640 1 -- 172.21.15.31:0/3308648180 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5223 (secure 0 0 0) 0x7f973005e0a0 con 0x7f974006ee50 2024-09-17T05:31:27.872 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:27.872 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"btime":"2024-09-17T05:30:20:371375+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:30:05.719854+0000","modified":"2024-09-17T05:30:08.738854+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5295},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5295":{"gid":5295,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/561523453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":561523453},{"type":"v1","addr":"172.21.15.31:6835","nonce":561523453}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5295,"qdb_cluster":[5295]},"id":3}]} 2024-09-17T05:31:27.872 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 29 2024-09-17T05:31:27.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.867+0000 7f9744a00640 1 -- 172.21.15.31:0/3308648180 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f971c0733b0 msgr2=0x7f971c075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:27.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.867+0000 7f9744a00640 1 --2- 172.21.15.31:0/3308648180 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f971c0733b0 0x7f971c075870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f97400b0070 tx=0x7f9728009040 comp rx=0 tx=0).stop 2024-09-17T05:31:27.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.867+0000 7f9744a00640 1 -- 172.21.15.31:0/3308648180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f974006ee50 msgr2=0x7f97400b7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:27.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.867+0000 7f9744a00640 1 --2- 172.21.15.31:0/3308648180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f974006ee50 0x7f97400b7640 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f973000c530 tx=0x7f973000c9f0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.867+0000 7f9744a00640 1 -- 172.21.15.31:0/3308648180 shutdown_connections 2024-09-17T05:31:27.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.867+0000 7f9744a00640 1 --2- 172.21.15.31:0/3308648180 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f971c0733b0 0x7f971c075870 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.867+0000 7f9744a00640 1 --2- 172.21.15.31:0/3308648180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974015e330 0x7f9740070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.867+0000 7f9744a00640 1 --2- 172.21.15.31:0/3308648180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f974015df50 0x7f9740153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.867+0000 7f9744a00640 1 --2- 172.21.15.31:0/3308648180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f974006ee50 0x7f97400b7640 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:27.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.867+0000 7f9744a00640 1 -- 172.21.15.31:0/3308648180 >> 172.21.15.31:0/3308648180 conn(0x7f97400d1dc0 msgr2=0x7f97400d0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:27.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.867+0000 7f9744a00640 1 -- 172.21.15.31:0/3308648180 shutdown_connections 2024-09-17T05:31:27.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:27.867+0000 7f9744a00640 1 -- 172.21.15.31:0/3308648180 wait complete. 2024-09-17T05:31:27.894 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:31:28.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.035+0000 7fdb1a800640 1 -- 172.21.15.31:0/3212460081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb1415bb90 msgr2=0x7fdb1415f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:28.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.035+0000 7fdb1a800640 1 --2- 172.21.15.31:0/3212460081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb1415bb90 0x7fdb1415f960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009840 tx=0x7fdb0401c820 comp rx=0 tx=0).stop 2024-09-17T05:31:28.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.035+0000 7fdb1a800640 1 -- 172.21.15.31:0/3212460081 shutdown_connections 2024-09-17T05:31:28.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.035+0000 7fdb1a800640 1 --2- 172.21.15.31:0/3212460081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb1415bf70 0x7fdb140b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.035+0000 7fdb1a800640 1 --2- 172.21.15.31:0/3212460081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb1415bb90 0x7fdb1415f960 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.035+0000 7fdb1a800640 1 -- 172.21.15.31:0/3212460081 >> 172.21.15.31:0/3212460081 conn(0x7fdb140d1d90 msgr2=0x7fdb140d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:28.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.035+0000 7fdb1a800640 1 -- 172.21.15.31:0/3212460081 shutdown_connections 2024-09-17T05:31:28.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.035+0000 7fdb1a800640 1 -- 172.21.15.31:0/3212460081 wait complete. 2024-09-17T05:31:28.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.035+0000 7fdb1a800640 1 Processor -- start 2024-09-17T05:31:28.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.035+0000 7fdb1a800640 1 -- start start 2024-09-17T05:31:28.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb1a800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb140d2940 0x7fdb1406df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:28.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb1a800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb1415bb90 0x7fdb1414ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:28.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb1a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb1415bf70 0x7fdb1406e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:28.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb1a800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdb14168ca0 con 0x7fdb1415bf70 2024-09-17T05:31:28.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb1a800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdb140b6670 con 0x7fdb1415bb90 2024-09-17T05:31:28.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb1a800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdb14168e20 con 0x7fdb140d2940 2024-09-17T05:31:28.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb13e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb1415bf70 0x7fdb1406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:28.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb13e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb1415bf70 0x7fdb1406e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46284/0 (socket says 172.21.15.31:46284) 2024-09-17T05:31:28.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb13e00640 1 -- 172.21.15.31:0/1117263266 learned_addr learned my addr 172.21.15.31:0/1117263266 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:28.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb13400640 1 --2- 172.21.15.31:0/1117263266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb140d2940 0x7fdb1406df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:28.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb0be00640 1 --2- 172.21.15.31:0/1117263266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb1415bb90 0x7fdb1414ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:28.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb13e00640 1 -- 172.21.15.31:0/1117263266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb140d2940 msgr2=0x7fdb1406df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:28.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb13e00640 1 --2- 172.21.15.31:0/1117263266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb140d2940 0x7fdb1406df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb13e00640 1 -- 172.21.15.31:0/1117263266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb1415bb90 msgr2=0x7fdb1414ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:28.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb13e00640 1 --2- 172.21.15.31:0/1117263266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb1415bb90 0x7fdb1414ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb13e00640 1 -- 172.21.15.31:0/1117263266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1414f820 con 0x7fdb1415bf70 2024-09-17T05:31:28.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb13e00640 1 --2- 172.21.15.31:0/1117263266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb1415bf70 0x7fdb1406e890 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00ea80 tx=0x7fdb0c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:28.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb0b400640 1 -- 172.21.15.31:0/1117263266 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c004b30 con 0x7fdb1415bf70 2024-09-17T05:31:28.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb0b400640 1 -- 172.21.15.31:0/1117263266 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb0c004cf0 con 0x7fdb1415bf70 2024-09-17T05:31:28.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb0b400640 1 -- 172.21.15.31:0/1117263266 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c005280 con 0x7fdb1415bf70 2024-09-17T05:31:28.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb1a800640 1 -- 172.21.15.31:0/1117263266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb1406e5d0 con 0x7fdb1415bf70 2024-09-17T05:31:28.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb1a800640 1 -- 172.21.15.31:0/1117263266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb141574d0 con 0x7fdb1415bf70 2024-09-17T05:31:28.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.039+0000 7fdb1a800640 1 -- 172.21.15.31:0/1117263266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb140b53e0 con 0x7fdb1415bf70 2024-09-17T05:31:28.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.043+0000 7fdb0b400640 1 -- 172.21.15.31:0/1117263266 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7fdb0c005420 con 0x7fdb1415bf70 2024-09-17T05:31:28.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.043+0000 7fdb0b400640 1 --2- 172.21.15.31:0/1117263266 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdaf00733b0 0x7fdaf0075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:28.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.043+0000 7fdb0b400640 1 -- 172.21.15.31:0/1117263266 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7fdb0c095420 con 0x7fdb1415bf70 2024-09-17T05:31:28.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.043+0000 7fdb13400640 1 --2- 172.21.15.31:0/1117263266 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdaf00733b0 0x7fdaf0075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:28.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.043+0000 7fdb13400640 1 --2- 172.21.15.31:0/1117263266 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdaf00733b0 0x7fdaf0075870 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdb040af000 tx=0x7fdb0401b060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:28.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.047+0000 7fdb0b400640 1 -- 172.21.15.31:0/1117263266 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fdb0c060060 con 0x7fdb1415bf70 2024-09-17T05:31:28.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.223+0000 7fdb1a800640 1 -- 172.21.15.31:0/1117263266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb140b79c0 con 0x7fdb1415bf70 2024-09-17T05:31:28.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.223+0000 7fdb0b400640 1 -- 172.21.15.31:0/1117263266 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16849 (secure 0 0 0) 0x7fdb0c079e20 con 0x7fdb1415bf70 2024-09-17T05:31:28.230 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:28.230 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":46,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:30:26.399174+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:30:03.431634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T05:30:04.672605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2a","mappings":[{"from":0,"to":5}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:31:28.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.227+0000 7fdb1a800640 1 -- 172.21.15.31:0/1117263266 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdaf00733b0 msgr2=0x7fdaf0075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:28.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.227+0000 7fdb1a800640 1 --2- 172.21.15.31:0/1117263266 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdaf00733b0 0x7fdaf0075870 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdb040af000 tx=0x7fdb0401b060 comp rx=0 tx=0).stop 2024-09-17T05:31:28.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.227+0000 7fdb1a800640 1 -- 172.21.15.31:0/1117263266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb1415bf70 msgr2=0x7fdb1406e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:28.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.227+0000 7fdb1a800640 1 --2- 172.21.15.31:0/1117263266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb1415bf70 0x7fdb1406e890 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00ea80 tx=0x7fdb0c00ef40 comp rx=0 tx=0).stop 2024-09-17T05:31:28.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.227+0000 7fdb1a800640 1 -- 172.21.15.31:0/1117263266 shutdown_connections 2024-09-17T05:31:28.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.227+0000 7fdb1a800640 1 --2- 172.21.15.31:0/1117263266 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fdaf00733b0 0x7fdaf0075870 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.227+0000 7fdb1a800640 1 --2- 172.21.15.31:0/1117263266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb1415bf70 0x7fdb1406e890 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.227+0000 7fdb1a800640 1 --2- 172.21.15.31:0/1117263266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb1415bb90 0x7fdb1414ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.227+0000 7fdb1a800640 1 --2- 172.21.15.31:0/1117263266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb140d2940 0x7fdb1406df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.227+0000 7fdb1a800640 1 -- 172.21.15.31:0/1117263266 >> 172.21.15.31:0/1117263266 conn(0x7fdb140d1d90 msgr2=0x7fdb1415f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:28.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.227+0000 7fdb1a800640 1 -- 172.21.15.31:0/1117263266 shutdown_connections 2024-09-17T05:31:28.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.227+0000 7fdb1a800640 1 -- 172.21.15.31:0/1117263266 wait complete. 2024-09-17T05:31:28.251 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:31:28.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.391+0000 7f24aaa00640 1 -- 172.21.15.31:0/3295303559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24a415bd50 msgr2=0x7f24a40ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:28.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.391+0000 7f24aaa00640 1 --2- 172.21.15.31:0/3295303559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24a415bd50 0x7f24a40ce5e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2494009900 tx=0x7f249401c7c0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.391+0000 7f24aaa00640 1 -- 172.21.15.31:0/3295303559 shutdown_connections 2024-09-17T05:31:28.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.391+0000 7f24aaa00640 1 --2- 172.21.15.31:0/3295303559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24a415bd50 0x7f24a40ce5e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.391+0000 7f24aaa00640 1 -- 172.21.15.31:0/3295303559 >> 172.21.15.31:0/3295303559 conn(0x7f24a40d1ea0 msgr2=0x7f24a40d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:28.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.391+0000 7f24aaa00640 1 -- 172.21.15.31:0/3295303559 shutdown_connections 2024-09-17T05:31:28.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.391+0000 7f24aaa00640 1 -- 172.21.15.31:0/3295303559 wait complete. 2024-09-17T05:31:28.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24aaa00640 1 Processor -- start 2024-09-17T05:31:28.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24aaa00640 1 -- start start 2024-09-17T05:31:28.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24aaa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24a40cf4e0 0x7f24a4153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:28.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24aaa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a415bd50 0x7f24a414e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:28.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24aaa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24a415c130 0x7f24a4156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:28.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24aaa00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f24a416a670 con 0x7f24a415c130 2024-09-17T05:31:28.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24aaa00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f24a416a4f0 con 0x7f24a40cf4e0 2024-09-17T05:31:28.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24aaa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f24a416a7f0 con 0x7f24a415bd50 2024-09-17T05:31:28.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24a8a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24a415c130 0x7f24a4156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:28.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24a8a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24a415c130 0x7f24a4156310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46294/0 (socket says 172.21.15.31:46294) 2024-09-17T05:31:28.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24a8a00640 1 -- 172.21.15.31:0/251204364 learned_addr learned my addr 172.21.15.31:0/251204364 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:28.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24a3e00640 1 --2- 172.21.15.31:0/251204364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24a40cf4e0 0x7f24a4153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:28.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f249be00640 1 --2- 172.21.15.31:0/251204364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a415bd50 0x7f24a414e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:28.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24a8a00640 1 -- 172.21.15.31:0/251204364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a415bd50 msgr2=0x7f24a414e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:28.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24a8a00640 1 --2- 172.21.15.31:0/251204364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a415bd50 0x7f24a414e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24a8a00640 1 -- 172.21.15.31:0/251204364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24a40cf4e0 msgr2=0x7f24a4153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:28.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24a8a00640 1 --2- 172.21.15.31:0/251204364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24a40cf4e0 0x7f24a4153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24a8a00640 1 -- 172.21.15.31:0/251204364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a406e990 con 0x7f24a415c130 2024-09-17T05:31:28.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f249be00640 1 --2- 172.21.15.31:0/251204364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a415bd50 0x7f24a414e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:31:28.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24a8a00640 1 --2- 172.21.15.31:0/251204364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24a415c130 0x7f24a4156310 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f249c00c7b0 tx=0x7f249c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:28.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24a0c00640 1 -- 172.21.15.31:0/251204364 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c004b70 con 0x7f24a415c130 2024-09-17T05:31:28.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24a0c00640 1 -- 172.21.15.31:0/251204364 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f249c004e00 con 0x7f24a415c130 2024-09-17T05:31:28.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24a0c00640 1 -- 172.21.15.31:0/251204364 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c00aab0 con 0x7f24a415c130 2024-09-17T05:31:28.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24aaa00640 1 -- 172.21.15.31:0/251204364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a406ec70 con 0x7f24a415c130 2024-09-17T05:31:28.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.395+0000 7f24aaa00640 1 -- 172.21.15.31:0/251204364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a406f230 con 0x7f24a415c130 2024-09-17T05:31:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.399+0000 7f24aaa00640 1 -- 172.21.15.31:0/251204364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a40ce5e0 con 0x7f24a415c130 2024-09-17T05:31:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.399+0000 7f24a0c00640 1 -- 172.21.15.31:0/251204364 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f249c00ac50 con 0x7f24a415c130 2024-09-17T05:31:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.399+0000 7f24a0c00640 1 --2- 172.21.15.31:0/251204364 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f24800733b0 0x7f2480075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.399+0000 7f24a0c00640 1 -- 172.21.15.31:0/251204364 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5767+0+0 (secure 0 0 0) 0x7f249c094910 con 0x7f24a415c130 2024-09-17T05:31:28.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.399+0000 7f24a3e00640 1 --2- 172.21.15.31:0/251204364 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f24800733b0 0x7f2480075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:28.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.399+0000 7f24a3e00640 1 --2- 172.21.15.31:0/251204364 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f24800733b0 0x7f2480075870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f24940af000 tx=0x7f249401b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:28.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.403+0000 7f24a0c00640 1 -- 172.21.15.31:0/251204364 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f249c020070 con 0x7f24a415c130 2024-09-17T05:31:28.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.615+0000 7f24aaa00640 1 -- 172.21.15.31:0/251204364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f24a40cfca0 con 0x7f24a415c130 2024-09-17T05:31:28.621 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-09-17T05:31:28.615+0000 7f21d0200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:31:28.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.619+0000 7f24a0c00640 1 -- 172.21.15.31:0/251204364 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7f249c05f550 con 0x7f24a415c130 2024-09-17T05:31:28.623 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:31:28.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.619+0000 7f24aaa00640 1 -- 172.21.15.31:0/251204364 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f24800733b0 msgr2=0x7f2480075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:28.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.619+0000 7f24aaa00640 1 --2- 172.21.15.31:0/251204364 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f24800733b0 0x7f2480075870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f24940af000 tx=0x7f249401b000 comp rx=0 tx=0).stop 2024-09-17T05:31:28.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.619+0000 7f24aaa00640 1 -- 172.21.15.31:0/251204364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24a415c130 msgr2=0x7f24a4156310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:28.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.619+0000 7f24aaa00640 1 --2- 172.21.15.31:0/251204364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24a415c130 0x7f24a4156310 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f249c00c7b0 tx=0x7f249c00cc70 comp rx=0 tx=0).stop 2024-09-17T05:31:28.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.619+0000 7f24aaa00640 1 -- 172.21.15.31:0/251204364 shutdown_connections 2024-09-17T05:31:28.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.619+0000 7f24aaa00640 1 --2- 172.21.15.31:0/251204364 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f24800733b0 0x7f2480075870 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.619+0000 7f24aaa00640 1 --2- 172.21.15.31:0/251204364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24a415c130 0x7f24a4156310 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.619+0000 7f24aaa00640 1 --2- 172.21.15.31:0/251204364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24a415bd50 0x7f24a414e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.619+0000 7f24aaa00640 1 --2- 172.21.15.31:0/251204364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24a40cf4e0 0x7f24a4153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.619+0000 7f24aaa00640 1 -- 172.21.15.31:0/251204364 >> 172.21.15.31:0/251204364 conn(0x7f24a40d1ea0 msgr2=0x7f24a40717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:28.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.619+0000 7f24aaa00640 1 -- 172.21.15.31:0/251204364 shutdown_connections 2024-09-17T05:31:28.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.619+0000 7f24aaa00640 1 -- 172.21.15.31:0/251204364 wait complete. 2024-09-17T05:31:28.647 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:31:28.689 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-17T05:31:28.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.791+0000 7f30c6200640 1 -- 172.21.15.31:0/2413835424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30c00d0950 msgr2=0x7f30c00aeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:28.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.791+0000 7f30c6200640 1 --2- 172.21.15.31:0/2413835424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30c00d0950 0x7f30c00aeb50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f30b8009c80 tx=0x7f30b801cd30 comp rx=0 tx=0).stop 2024-09-17T05:31:28.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.791+0000 7f30c6200640 1 -- 172.21.15.31:0/2413835424 shutdown_connections 2024-09-17T05:31:28.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.791+0000 7f30c6200640 1 --2- 172.21.15.31:0/2413835424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30c00d0950 0x7f30c00aeb50 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.791+0000 7f30c6200640 1 --2- 172.21.15.31:0/2413835424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30c015bf70 0x7f30c00d28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.791+0000 7f30c6200640 1 -- 172.21.15.31:0/2413835424 >> 172.21.15.31:0/2413835424 conn(0x7f30c00d1e00 msgr2=0x7f30c00d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:28.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.791+0000 7f30c6200640 1 -- 172.21.15.31:0/2413835424 shutdown_connections 2024-09-17T05:31:28.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.791+0000 7f30c6200640 1 -- 172.21.15.31:0/2413835424 wait complete. 2024-09-17T05:31:28.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30c6200640 1 Processor -- start 2024-09-17T05:31:28.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30c6200640 1 -- start start 2024-09-17T05:31:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30c6200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30c00b0f50 0x7f30c014eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30c6200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30c00d0950 0x7f30c01fb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30c6200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30c015bf70 0x7f30c01578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30c6200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f30c0168d40 con 0x7f30c00d0950 2024-09-17T05:31:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30c6200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f30c0168bc0 con 0x7f30c00b0f50 2024-09-17T05:31:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30c6200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f30c0168ec0 con 0x7f30c015bf70 2024-09-17T05:31:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30b7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30c00d0950 0x7f30c01fb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30b7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30c00d0950 0x7f30c01fb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59352/0 (socket says 172.21.15.31:59352) 2024-09-17T05:31:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30b7e00640 1 -- 172.21.15.31:0/903239347 learned_addr learned my addr 172.21.15.31:0/903239347 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30bfe00640 1 --2- 172.21.15.31:0/903239347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30c015bf70 0x7f30c01578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30bf400640 1 --2- 172.21.15.31:0/903239347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30c00b0f50 0x7f30c014eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30b7e00640 1 -- 172.21.15.31:0/903239347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30c015bf70 msgr2=0x7f30c01578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30b7e00640 1 --2- 172.21.15.31:0/903239347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30c015bf70 0x7f30c01578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30b7e00640 1 -- 172.21.15.31:0/903239347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30c00b0f50 msgr2=0x7f30c014eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30b7e00640 1 --2- 172.21.15.31:0/903239347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30c00b0f50 0x7f30c014eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30b7e00640 1 -- 172.21.15.31:0/903239347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c01fbd20 con 0x7f30c00d0950 2024-09-17T05:31:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30bf400640 1 --2- 172.21.15.31:0/903239347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30c00b0f50 0x7f30c014eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:31:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30b7e00640 1 --2- 172.21.15.31:0/903239347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30c00d0950 0x7f30c01fb7e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f30a800c400 tx=0x7f30a800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30b7400640 1 -- 172.21.15.31:0/903239347 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8017070 con 0x7f30c00d0950 2024-09-17T05:31:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30b7400640 1 -- 172.21.15.31:0/903239347 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30a8003600 con 0x7f30c00d0950 2024-09-17T05:31:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30b7400640 1 -- 172.21.15.31:0/903239347 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8003a50 con 0x7f30c00d0950 2024-09-17T05:31:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30c6200640 1 -- 172.21.15.31:0/903239347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30c0150350 con 0x7f30c00d0950 2024-09-17T05:31:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30c6200640 1 -- 172.21.15.31:0/903239347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30c0150bb0 con 0x7f30c00d0950 2024-09-17T05:31:28.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.795+0000 7f30c6200640 1 -- 172.21.15.31:0/903239347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30c00aeb50 con 0x7f30c00d0950 2024-09-17T05:31:28.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.799+0000 7f30b7400640 1 -- 172.21.15.31:0/903239347 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f30a801a070 con 0x7f30c00d0950 2024-09-17T05:31:28.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.799+0000 7f30b7400640 1 --2- 172.21.15.31:0/903239347 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f309c0733e0 0x7f309c0758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:28.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.799+0000 7f30b7400640 1 -- 172.21.15.31:0/903239347 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5853+0+0 (secure 0 0 0) 0x7f30a8093910 con 0x7f30c00d0950 2024-09-17T05:31:28.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.799+0000 7f30bf400640 1 --2- 172.21.15.31:0/903239347 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f309c0733e0 0x7f309c0758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:28.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.799+0000 7f30bf400640 1 --2- 172.21.15.31:0/903239347 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f309c0733e0 0x7f309c0758a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f30b0009b90 tx=0x7f30b00091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:28.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:28.803+0000 7f30b7400640 1 -- 172.21.15.31:0/903239347 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f30c01fbd20 con 0x7f30c00d0950 2024-09-17T05:31:29.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.015+0000 7f30c6200640 1 -- 172.21.15.31:0/903239347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f30c0158ff0 con 0x7f30c00d0950 2024-09-17T05:31:29.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.623+0000 7f30b7400640 1 -- 172.21.15.31:0/903239347 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7f30a805df40 con 0x7f30c00d0950 2024-09-17T05:31:29.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.623+0000 7f30c6200640 1 -- 172.21.15.31:0/903239347 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f309c0733e0 msgr2=0x7f309c0758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:29.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.623+0000 7f30c6200640 1 --2- 172.21.15.31:0/903239347 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f309c0733e0 0x7f309c0758a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f30b0009b90 tx=0x7f30b00091e0 comp rx=0 tx=0).stop 2024-09-17T05:31:29.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.623+0000 7f30c6200640 1 -- 172.21.15.31:0/903239347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30c00d0950 msgr2=0x7f30c01fb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:29.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.623+0000 7f30c6200640 1 --2- 172.21.15.31:0/903239347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30c00d0950 0x7f30c01fb7e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f30a800c400 tx=0x7f30a800c8c0 comp rx=0 tx=0).stop 2024-09-17T05:31:29.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.623+0000 7f30c6200640 1 -- 172.21.15.31:0/903239347 shutdown_connections 2024-09-17T05:31:29.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.623+0000 7f30c6200640 1 --2- 172.21.15.31:0/903239347 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f309c0733e0 0x7f309c0758a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:29.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.623+0000 7f30c6200640 1 --2- 172.21.15.31:0/903239347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30c015bf70 0x7f30c01578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:29.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.623+0000 7f30c6200640 1 --2- 172.21.15.31:0/903239347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30c00d0950 0x7f30c01fb7e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:29.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.623+0000 7f30c6200640 1 --2- 172.21.15.31:0/903239347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30c00b0f50 0x7f30c014eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:29.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.623+0000 7f30c6200640 1 -- 172.21.15.31:0/903239347 >> 172.21.15.31:0/903239347 conn(0x7f30c00d1e00 msgr2=0x7f30c00d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:29.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.623+0000 7f30c6200640 1 -- 172.21.15.31:0/903239347 shutdown_connections 2024-09-17T05:31:29.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.623+0000 7f30c6200640 1 -- 172.21.15.31:0/903239347 wait complete. 2024-09-17T05:31:29.653 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:31:29.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.839+0000 7f99ac200640 1 -- 172.21.15.31:0/505460876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99a40b4450 msgr2=0x7f99a406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:29.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.839+0000 7f99ac200640 1 --2- 172.21.15.31:0/505460876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99a40b4450 0x7f99a406f5d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f999c009bc0 tx=0x7f999c01cb90 comp rx=0 tx=0).stop 2024-09-17T05:31:29.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.839+0000 7f99ac200640 1 -- 172.21.15.31:0/505460876 shutdown_connections 2024-09-17T05:31:29.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.839+0000 7f99ac200640 1 --2- 172.21.15.31:0/505460876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99a40b4450 0x7f99a406f5d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:29.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.839+0000 7f99ac200640 1 --2- 172.21.15.31:0/505460876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99a415a2f0 0x7f99a40b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:29.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.839+0000 7f99ac200640 1 -- 172.21.15.31:0/505460876 >> 172.21.15.31:0/505460876 conn(0x7f99a406cc20 msgr2=0x7f99a406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:29.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.839+0000 7f99ac200640 1 -- 172.21.15.31:0/505460876 shutdown_connections 2024-09-17T05:31:29.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.839+0000 7f99ac200640 1 -- 172.21.15.31:0/505460876 wait complete. 2024-09-17T05:31:29.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.839+0000 7f99ac200640 1 Processor -- start 2024-09-17T05:31:29.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.839+0000 7f99ac200640 1 -- start start 2024-09-17T05:31:29.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99ac200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99a40701e0 0x7f99a414dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:29.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99ac200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99a40b4450 0x7f99a41fb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:29.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99ac200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99a415a2f0 0x7f99a4167090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:29.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99ac200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f99a4068ee0 con 0x7f99a40701e0 2024-09-17T05:31:29.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99ac200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f99a4068d60 con 0x7f99a40b4450 2024-09-17T05:31:29.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99ac200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f99a4151f10 con 0x7f99a415a2f0 2024-09-17T05:31:29.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99a9800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99a40701e0 0x7f99a414dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:29.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99a9800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99a40701e0 0x7f99a414dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59370/0 (socket says 172.21.15.31:59370) 2024-09-17T05:31:29.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99a9800640 1 -- 172.21.15.31:0/971546946 learned_addr learned my addr 172.21.15.31:0/971546946 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:29.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99a9800640 1 -- 172.21.15.31:0/971546946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99a415a2f0 msgr2=0x7f99a4167090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:29.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99aa200640 1 --2- 172.21.15.31:0/971546946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99a415a2f0 0x7f99a4167090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:29.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99a8e00640 1 --2- 172.21.15.31:0/971546946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99a40b4450 0x7f99a41fb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:29.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99a9800640 1 --2- 172.21.15.31:0/971546946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99a415a2f0 0x7f99a4167090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:29.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99a9800640 1 -- 172.21.15.31:0/971546946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99a40b4450 msgr2=0x7f99a41fb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:29.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99a9800640 1 --2- 172.21.15.31:0/971546946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99a40b4450 0x7f99a41fb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:29.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99a9800640 1 -- 172.21.15.31:0/971546946 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a41f8330 con 0x7f99a40701e0 2024-09-17T05:31:29.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99aa200640 1 --2- 172.21.15.31:0/971546946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99a415a2f0 0x7f99a4167090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:31:29.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99a8e00640 1 --2- 172.21.15.31:0/971546946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99a40b4450 0x7f99a41fb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:31:29.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99a9800640 1 --2- 172.21.15.31:0/971546946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99a40701e0 0x7f99a414dc70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f99980058d0 tx=0x7f999800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:29.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99a1600640 1 -- 172.21.15.31:0/971546946 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9998017070 con 0x7f99a40701e0 2024-09-17T05:31:29.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99a1600640 1 -- 172.21.15.31:0/971546946 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9998009d20 con 0x7f99a40701e0 2024-09-17T05:31:29.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99a1600640 1 -- 172.21.15.31:0/971546946 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99980106c0 con 0x7f99a40701e0 2024-09-17T05:31:29.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99ac200640 1 -- 172.21.15.31:0/971546946 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a41f8610 con 0x7f99a40701e0 2024-09-17T05:31:29.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99ac200640 1 -- 172.21.15.31:0/971546946 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a414e640 con 0x7f99a40701e0 2024-09-17T05:31:29.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.843+0000 7f99ac200640 1 -- 172.21.15.31:0/971546946 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a4167f80 con 0x7f99a40701e0 2024-09-17T05:31:29.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.847+0000 7f99a1600640 1 -- 172.21.15.31:0/971546946 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f999801a070 con 0x7f99a40701e0 2024-09-17T05:31:29.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.847+0000 7f99a1600640 1 --2- 172.21.15.31:0/971546946 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f99840733e0 0x7f99840758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:29.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.847+0000 7f99a1600640 1 -- 172.21.15.31:0/971546946 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5853+0+0 (secure 0 0 0) 0x7f99980947b0 con 0x7f99a40701e0 2024-09-17T05:31:29.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.847+0000 7f99a8e00640 1 --2- 172.21.15.31:0/971546946 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f99840733e0 0x7f99840758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:29.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.847+0000 7f99a8e00640 1 --2- 172.21.15.31:0/971546946 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f99840733e0 0x7f99840758a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f99a40adba0 tx=0x7f9990009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:29.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:29.851+0000 7f99a1600640 1 -- 172.21.15.31:0/971546946 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f999805f430 con 0x7f99a40701e0 2024-09-17T05:31:30.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.027+0000 7f99ac200640 1 -- 172.21.15.31:0/971546946 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f99a41590b0 con 0x7f99a40701e0 2024-09-17T05:31:30.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.623+0000 7f99a1600640 1 -- 172.21.15.31:0/971546946 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v48) ==== 181+0+0 (secure 0 0 0) 0x7f999805ed30 con 0x7f99a40701e0 2024-09-17T05:31:30.630 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:31:30.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.627+0000 7f99ac200640 1 -- 172.21.15.31:0/971546946 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f99840733e0 msgr2=0x7f99840758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:30.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.627+0000 7f99ac200640 1 --2- 172.21.15.31:0/971546946 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f99840733e0 0x7f99840758a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f99a40adba0 tx=0x7f9990009040 comp rx=0 tx=0).stop 2024-09-17T05:31:30.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.627+0000 7f99ac200640 1 -- 172.21.15.31:0/971546946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99a40701e0 msgr2=0x7f99a414dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:30.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.627+0000 7f99ac200640 1 --2- 172.21.15.31:0/971546946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99a40701e0 0x7f99a414dc70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f99980058d0 tx=0x7f999800dde0 comp rx=0 tx=0).stop 2024-09-17T05:31:30.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.627+0000 7f99ac200640 1 -- 172.21.15.31:0/971546946 shutdown_connections 2024-09-17T05:31:30.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.627+0000 7f99ac200640 1 --2- 172.21.15.31:0/971546946 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f99840733e0 0x7f99840758a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:30.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.627+0000 7f99ac200640 1 --2- 172.21.15.31:0/971546946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99a415a2f0 0x7f99a4167090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:30.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.627+0000 7f99ac200640 1 --2- 172.21.15.31:0/971546946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f99a40b4450 0x7f99a41fb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:30.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.627+0000 7f99ac200640 1 --2- 172.21.15.31:0/971546946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99a40701e0 0x7f99a414dc70 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:30.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.627+0000 7f99ac200640 1 -- 172.21.15.31:0/971546946 >> 172.21.15.31:0/971546946 conn(0x7f99a406cc20 msgr2=0x7f99a41595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:30.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.627+0000 7f99ac200640 1 -- 172.21.15.31:0/971546946 shutdown_connections 2024-09-17T05:31:30.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.627+0000 7f99ac200640 1 -- 172.21.15.31:0/971546946 wait complete. 2024-09-17T05:31:30.656 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:31:30.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.807+0000 7f83a1400640 1 -- 172.21.15.31:0/2982229414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8380004810 msgr2=0x7f8380004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:30.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.807+0000 7f83a1400640 1 --2- 172.21.15.31:0/2982229414 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8380004810 0x7f8380004c90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f839c074590 tx=0x7f838401d250 comp rx=0 tx=0).stop 2024-09-17T05:31:30.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.807+0000 7f839b200640 1 -- 172.21.15.31:0/2982229414 reap_dead start 2024-09-17T05:31:30.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.807+0000 7f83a1400640 1 -- 172.21.15.31:0/2982229414 shutdown_connections 2024-09-17T05:31:30.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.807+0000 7f83a1400640 1 -- 172.21.15.31:0/2982229414 >> 172.21.15.31:0/2982229414 conn(0x7f839c0d1da0 msgr2=0x7f839c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:30.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.807+0000 7f83a1400640 1 -- 172.21.15.31:0/2982229414 shutdown_connections 2024-09-17T05:31:30.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.807+0000 7f83a1400640 1 -- 172.21.15.31:0/2982229414 wait complete. 2024-09-17T05:31:30.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f83a1400640 1 Processor -- start 2024-09-17T05:31:30.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f83a1400640 1 -- start start 2024-09-17T05:31:30.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f83a1400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8380004810 0x7f839c0b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:30.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f83a1400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f839c0c5aa0 0x7f839c0b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:30.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f83a1400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f839c0b6ae0 0x7f839c1f5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:30.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f83a1400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f839c0cc3f0 con 0x7f839c0c5aa0 2024-09-17T05:31:30.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f83a1400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f839c06f000 con 0x7f8380004810 2024-09-17T05:31:30.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f83a1400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f839c0cc570 con 0x7f839c0b6ae0 2024-09-17T05:31:30.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f8391e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f839c0c5aa0 0x7f839c0b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:30.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f8391e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f839c0c5aa0 0x7f839c0b65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59392/0 (socket says 172.21.15.31:59392) 2024-09-17T05:31:30.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f8391e00640 1 -- 172.21.15.31:0/3214185230 learned_addr learned my addr 172.21.15.31:0/3214185230 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:30.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f839b200640 1 --2- 172.21.15.31:0/3214185230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f839c0b6ae0 0x7f839c1f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:30.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f839a800640 1 --2- 172.21.15.31:0/3214185230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8380004810 0x7f839c0b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:30.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f8391e00640 1 -- 172.21.15.31:0/3214185230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f839c0b6ae0 msgr2=0x7f839c1f5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:30.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f8391e00640 1 --2- 172.21.15.31:0/3214185230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f839c0b6ae0 0x7f839c1f5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:30.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f8391e00640 1 -- 172.21.15.31:0/3214185230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8380004810 msgr2=0x7f839c0b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:30.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f8391e00640 1 --2- 172.21.15.31:0/3214185230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8380004810 0x7f839c0b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:30.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f8391e00640 1 -- 172.21.15.31:0/3214185230 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c0b6f70 con 0x7f839c0c5aa0 2024-09-17T05:31:30.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f839a800640 1 --2- 172.21.15.31:0/3214185230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8380004810 0x7f839c0b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:31:30.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f8391e00640 1 --2- 172.21.15.31:0/3214185230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f839c0c5aa0 0x7f839c0b65a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f838401d080 tx=0x7f83840055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:30.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f8393400640 1 -- 172.21.15.31:0/3214185230 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83840b1040 con 0x7f839c0c5aa0 2024-09-17T05:31:30.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f8393400640 1 -- 172.21.15.31:0/3214185230 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83840bb070 con 0x7f839c0c5aa0 2024-09-17T05:31:30.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f83a1400640 1 -- 172.21.15.31:0/3214185230 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839c0b5110 con 0x7f839c0c5aa0 2024-09-17T05:31:30.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f8393400640 1 -- 172.21.15.31:0/3214185230 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83840a5e60 con 0x7f839c0c5aa0 2024-09-17T05:31:30.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.811+0000 7f83a1400640 1 -- 172.21.15.31:0/3214185230 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839c0b74c0 con 0x7f839c0c5aa0 2024-09-17T05:31:30.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.815+0000 7f83a1400640 1 -- 172.21.15.31:0/3214185230 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f839c0cca90 con 0x7f839c0c5aa0 2024-09-17T05:31:30.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.815+0000 7f8393400640 1 -- 172.21.15.31:0/3214185230 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f83840046d0 con 0x7f839c0c5aa0 2024-09-17T05:31:30.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.815+0000 7f8393400640 1 --2- 172.21.15.31:0/3214185230 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f83780733b0 0x7f8378075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:30.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.815+0000 7f8393400640 1 -- 172.21.15.31:0/3214185230 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5415+0+0 (secure 0 0 0) 0x7f838412f2e0 con 0x7f839c0c5aa0 2024-09-17T05:31:30.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.815+0000 7f839a800640 1 --2- 172.21.15.31:0/3214185230 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f83780733b0 0x7f8378075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:30.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.819+0000 7f839a800640 1 --2- 172.21.15.31:0/3214185230 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f83780733b0 0x7f8378075870 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f838c009b00 tx=0x7f838c0091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:30.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.819+0000 7f8393400640 1 -- 172.21.15.31:0/3214185230 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8384016f60 con 0x7f839c0c5aa0 2024-09-17T05:31:31.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:30.995+0000 7f83a1400640 1 -- 172.21.15.31:0/3214185230 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f839c161910 con 0x7f839c0c5aa0 2024-09-17T05:31:31.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.631+0000 7f8393400640 1 -- 172.21.15.31:0/3214185230 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v49) ==== 169+0+0 (secure 0 0 0) 0x7f83840f9ac0 con 0x7f839c0c5aa0 2024-09-17T05:31:31.636 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-09-17T05:31:31.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.635+0000 7f83a1400640 1 -- 172.21.15.31:0/3214185230 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f83780733b0 msgr2=0x7f8378075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:31.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.635+0000 7f83a1400640 1 --2- 172.21.15.31:0/3214185230 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f83780733b0 0x7f8378075870 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f838c009b00 tx=0x7f838c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:31:31.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.635+0000 7f83a1400640 1 -- 172.21.15.31:0/3214185230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f839c0c5aa0 msgr2=0x7f839c0b65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:31.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.635+0000 7f83a1400640 1 --2- 172.21.15.31:0/3214185230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f839c0c5aa0 0x7f839c0b65a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f838401d080 tx=0x7f83840055d0 comp rx=0 tx=0).stop 2024-09-17T05:31:31.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.635+0000 7f83a1400640 1 -- 172.21.15.31:0/3214185230 shutdown_connections 2024-09-17T05:31:31.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.635+0000 7f83a1400640 1 --2- 172.21.15.31:0/3214185230 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f83780733b0 0x7f8378075870 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:31.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.635+0000 7f83a1400640 1 --2- 172.21.15.31:0/3214185230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f839c0b6ae0 0x7f839c1f5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:31.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.635+0000 7f83a1400640 1 --2- 172.21.15.31:0/3214185230 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f839c0c5aa0 0x7f839c0b65a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:31.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.635+0000 7f83a1400640 1 --2- 172.21.15.31:0/3214185230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8380004810 0x7f839c0b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:31.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.635+0000 7f83a1400640 1 -- 172.21.15.31:0/3214185230 >> 172.21.15.31:0/3214185230 conn(0x7f839c0d1da0 msgr2=0x7f839c0b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:31.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.635+0000 7f83a1400640 1 -- 172.21.15.31:0/3214185230 shutdown_connections 2024-09-17T05:31:31.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.635+0000 7f83a1400640 1 -- 172.21.15.31:0/3214185230 wait complete. 2024-09-17T05:31:31.668 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:31:31.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb03b200640 1 -- 172.21.15.31:0/3387171304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb03c06ef70 msgr2=0x7fb03c06f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:31.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb03b200640 1 --2- 172.21.15.31:0/3387171304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb03c06ef70 0x7fb03c06f350 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0b5bc0 tx=0x7fb02c01c830 comp rx=0 tx=0).stop 2024-09-17T05:31:31.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb03b200640 1 -- 172.21.15.31:0/3387171304 shutdown_connections 2024-09-17T05:31:31.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb03b200640 1 --2- 172.21.15.31:0/3387171304 >> v2:172.21.15.155:3300/0 conn(0x7fb03c0d0550 0x7fb03c072cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:31.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb03b200640 1 --2- 172.21.15.31:0/3387171304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb03c06ef70 0x7fb03c06f350 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:31.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb03b200640 1 -- 172.21.15.31:0/3387171304 >> 172.21.15.31:0/3387171304 conn(0x7fb03c0cfa30 msgr2=0x7fb03c0cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:31.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb03b200640 1 -- 172.21.15.31:0/3387171304 shutdown_connections 2024-09-17T05:31:31.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb03b200640 1 -- 172.21.15.31:0/3387171304 wait complete. 2024-09-17T05:31:31.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb03b200640 1 Processor -- start 2024-09-17T05:31:31.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb03b200640 1 -- start start 2024-09-17T05:31:31.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb03b200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb03c06ef70 0x7fb03c14ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:31.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb03b200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb03c073210 0x7fb03c15c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:31.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb03b200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb03c0d0550 0x7fb03c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb03b200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb03c167960 con 0x7fb03c06ef70 2024-09-17T05:31:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb03b200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb03c1677e0 con 0x7fb03c0d0550 2024-09-17T05:31:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb03b200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb03c167ae0 con 0x7fb03c073210 2024-09-17T05:31:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb039e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb03c06ef70 0x7fb03c14ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb039e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb03c06ef70 0x7fb03c14ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59410/0 (socket says 172.21.15.31:59410) 2024-09-17T05:31:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb039e00640 1 -- 172.21.15.31:0/2575806958 learned_addr learned my addr 172.21.15.31:0/2575806958 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb033e00640 1 --2- 172.21.15.31:0/2575806958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb03c073210 0x7fb03c15c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb03a800640 1 --2- 172.21.15.31:0/2575806958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb03c0d0550 0x7fb03c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb039e00640 1 -- 172.21.15.31:0/2575806958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb03c073210 msgr2=0x7fb03c15c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb039e00640 1 --2- 172.21.15.31:0/2575806958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb03c073210 0x7fb03c15c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb039e00640 1 -- 172.21.15.31:0/2575806958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb03c0d0550 msgr2=0x7fb03c15c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:31.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb039e00640 1 --2- 172.21.15.31:0/2575806958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb03c0d0550 0x7fb03c15c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:31.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.815+0000 7fb039e00640 1 -- 172.21.15.31:0/2575806958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb03c14f150 con 0x7fb03c06ef70 2024-09-17T05:31:31.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.819+0000 7fb039e00640 1 --2- 172.21.15.31:0/2575806958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb03c06ef70 0x7fb03c14ec10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0b0040 tx=0x7fb02c0a5700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:31.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.819+0000 7fb032000640 1 -- 172.21.15.31:0/2575806958 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c0b2040 con 0x7fb03c06ef70 2024-09-17T05:31:31.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.819+0000 7fb032000640 1 -- 172.21.15.31:0/2575806958 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb02c0043c0 con 0x7fb03c06ef70 2024-09-17T05:31:31.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.819+0000 7fb03b200640 1 -- 172.21.15.31:0/2575806958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb03c162290 con 0x7fb03c06ef70 2024-09-17T05:31:31.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.819+0000 7fb032000640 1 -- 172.21.15.31:0/2575806958 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c005290 con 0x7fb03c06ef70 2024-09-17T05:31:31.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.819+0000 7fb03b200640 1 -- 172.21.15.31:0/2575806958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb03c162850 con 0x7fb03c06ef70 2024-09-17T05:31:31.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.819+0000 7fb03b200640 1 -- 172.21.15.31:0/2575806958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb03c06f350 con 0x7fb03c06ef70 2024-09-17T05:31:31.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.819+0000 7fb032000640 1 -- 172.21.15.31:0/2575806958 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7fb02c005430 con 0x7fb03c06ef70 2024-09-17T05:31:31.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.823+0000 7fb032000640 1 --2- 172.21.15.31:0/2575806958 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb0180733b0 0x7fb018075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:31.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.823+0000 7fb032000640 1 -- 172.21.15.31:0/2575806958 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7fb02c12dec0 con 0x7fb03c06ef70 2024-09-17T05:31:31.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.823+0000 7fb033e00640 1 --2- 172.21.15.31:0/2575806958 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb0180733b0 0x7fb018075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:31.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.823+0000 7fb033e00640 1 --2- 172.21.15.31:0/2575806958 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb0180733b0 0x7fb018075870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb024006fd0 tx=0x7fb024008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:31.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:31.827+0000 7fb032000640 1 -- 172.21.15.31:0/2575806958 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb02c0164b0 con 0x7fb03c06ef70 2024-09-17T05:31:32.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.003+0000 7fb03b200640 1 -- 172.21.15.31:0/2575806958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7fb03c069900 con 0x7fb03c06ef70 2024-09-17T05:31:32.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.007+0000 7fb032000640 1 -- 172.21.15.31:0/2575806958 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v31) ==== 71+0+0 (secure 0 0 0) 0x7fb02c0f8ed0 con 0x7fb03c06ef70 2024-09-17T05:31:32.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.011+0000 7fb03b200640 1 -- 172.21.15.31:0/2575806958 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb0180733b0 msgr2=0x7fb018075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:32.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.011+0000 7fb03b200640 1 --2- 172.21.15.31:0/2575806958 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb0180733b0 0x7fb018075870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb024006fd0 tx=0x7fb024008040 comp rx=0 tx=0).stop 2024-09-17T05:31:32.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.011+0000 7fb03b200640 1 -- 172.21.15.31:0/2575806958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb03c06ef70 msgr2=0x7fb03c14ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:32.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.011+0000 7fb03b200640 1 --2- 172.21.15.31:0/2575806958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb03c06ef70 0x7fb03c14ec10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0b0040 tx=0x7fb02c0a5700 comp rx=0 tx=0).stop 2024-09-17T05:31:32.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.011+0000 7fb03b200640 1 -- 172.21.15.31:0/2575806958 shutdown_connections 2024-09-17T05:31:32.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.011+0000 7fb03b200640 1 --2- 172.21.15.31:0/2575806958 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb0180733b0 0x7fb018075870 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:32.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.011+0000 7fb03b200640 1 --2- 172.21.15.31:0/2575806958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb03c0d0550 0x7fb03c15c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:32.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.011+0000 7fb03b200640 1 --2- 172.21.15.31:0/2575806958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb03c073210 0x7fb03c15c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:32.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.011+0000 7fb03b200640 1 --2- 172.21.15.31:0/2575806958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb03c06ef70 0x7fb03c14ec10 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:32.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.011+0000 7fb03b200640 1 -- 172.21.15.31:0/2575806958 >> 172.21.15.31:0/2575806958 conn(0x7fb03c0cfa30 msgr2=0x7fb03c0b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:32.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.011+0000 7fb03b200640 1 -- 172.21.15.31:0/2575806958 shutdown_connections 2024-09-17T05:31:32.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.011+0000 7fb03b200640 1 -- 172.21.15.31:0/2575806958 wait complete. 2024-09-17T05:31:32.035 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2024-09-17T05:31:32.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.179+0000 7fd123400640 1 -- 172.21.15.31:0/666427975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd11c0cecf0 msgr2=0x7fd11c0cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:32.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.179+0000 7fd123400640 1 --2- 172.21.15.31:0/666427975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd11c0cecf0 0x7fd11c0cc940 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd108009840 tx=0x7fd10801c700 comp rx=0 tx=0).stop 2024-09-17T05:31:32.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.179+0000 7fd123400640 1 -- 172.21.15.31:0/666427975 shutdown_connections 2024-09-17T05:31:32.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.179+0000 7fd123400640 1 --2- 172.21.15.31:0/666427975 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd11c15c130 0x7fd11c0cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:32.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.179+0000 7fd123400640 1 --2- 172.21.15.31:0/666427975 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd11c0cecf0 0x7fd11c0cc940 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:32.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.179+0000 7fd123400640 1 -- 172.21.15.31:0/666427975 >> 172.21.15.31:0/666427975 conn(0x7fd11c0d1ea0 msgr2=0x7fd11c0d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:32.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.179+0000 7fd123400640 1 -- 172.21.15.31:0/666427975 shutdown_connections 2024-09-17T05:31:32.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.179+0000 7fd123400640 1 -- 172.21.15.31:0/666427975 wait complete. 2024-09-17T05:31:32.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.179+0000 7fd123400640 1 Processor -- start 2024-09-17T05:31:32.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.179+0000 7fd123400640 1 -- start start 2024-09-17T05:31:32.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd123400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd11c0cecf0 0x7fd11c1421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:32.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd123400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd11c15bd50 0x7fd11c14f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:32.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd123400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd11c15c130 0x7fd11c14fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:32.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd123400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c1694a0 con 0x7fd11c15bd50 2024-09-17T05:31:32.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd123400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c169320 con 0x7fd11c15c130 2024-09-17T05:31:32.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd123400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd11c169620 con 0x7fd11c0cecf0 2024-09-17T05:31:32.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd11be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd11c15bd50 0x7fd11c14f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:32.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd11be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd11c15bd50 0x7fd11c14f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59422/0 (socket says 172.21.15.31:59422) 2024-09-17T05:31:32.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd11be00640 1 -- 172.21.15.31:0/2100953583 learned_addr learned my addr 172.21.15.31:0/2100953583 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:32.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd120a00640 1 --2- 172.21.15.31:0/2100953583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd11c0cecf0 0x7fd11c1421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:32.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd11be00640 1 -- 172.21.15.31:0/2100953583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd11c0cecf0 msgr2=0x7fd11c1421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:32.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd11be00640 1 --2- 172.21.15.31:0/2100953583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd11c0cecf0 0x7fd11c1421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:32.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd121400640 1 --2- 172.21.15.31:0/2100953583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd11c15c130 0x7fd11c14fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:32.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd11be00640 1 -- 172.21.15.31:0/2100953583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd11c15c130 msgr2=0x7fd11c14fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:32.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd11be00640 1 --2- 172.21.15.31:0/2100953583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd11c15c130 0x7fd11c14fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:32.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd11be00640 1 -- 172.21.15.31:0/2100953583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11c0b6a00 con 0x7fd11c15bd50 2024-09-17T05:31:32.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd120a00640 1 --2- 172.21.15.31:0/2100953583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd11c0cecf0 0x7fd11c1421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:31:32.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd121400640 1 --2- 172.21.15.31:0/2100953583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd11c15c130 0x7fd11c14fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:31:32.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd11be00640 1 --2- 172.21.15.31:0/2100953583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd11c15bd50 0x7fd11c14f890 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd108009790 tx=0x7fd1080a56f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:32.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd118c00640 1 -- 172.21.15.31:0/2100953583 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1080b2040 con 0x7fd11c15bd50 2024-09-17T05:31:32.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd118c00640 1 -- 172.21.15.31:0/2100953583 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd108004430 con 0x7fd11c15bd50 2024-09-17T05:31:32.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd118c00640 1 -- 172.21.15.31:0/2100953583 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd108003840 con 0x7fd11c15bd50 2024-09-17T05:31:32.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd123400640 1 -- 172.21.15.31:0/2100953583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd11c06fd40 con 0x7fd11c15bd50 2024-09-17T05:31:32.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd123400640 1 -- 172.21.15.31:0/2100953583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd11c0b6ca0 con 0x7fd11c15bd50 2024-09-17T05:31:32.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.183+0000 7fd123400640 1 -- 172.21.15.31:0/2100953583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd11c0ce5e0 con 0x7fd11c15bd50 2024-09-17T05:31:32.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.187+0000 7fd118c00640 1 -- 172.21.15.31:0/2100953583 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7fd1080bd060 con 0x7fd11c15bd50 2024-09-17T05:31:32.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.187+0000 7fd118c00640 1 --2- 172.21.15.31:0/2100953583 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd0fc0733e0 0x7fd0fc0758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:32.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.187+0000 7fd118c00640 1 -- 172.21.15.31:0/2100953583 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7fd10812d950 con 0x7fd11c15bd50 2024-09-17T05:31:32.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.187+0000 7fd120a00640 1 --2- 172.21.15.31:0/2100953583 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd0fc0733e0 0x7fd0fc0758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:32.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.187+0000 7fd120a00640 1 --2- 172.21.15.31:0/2100953583 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd0fc0733e0 0x7fd0fc0758a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd110000f70 tx=0x7fd110009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:32.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.191+0000 7fd118c00640 1 -- 172.21.15.31:0/2100953583 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd108016410 con 0x7fd11c15bd50 2024-09-17T05:31:32.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.427+0000 7fd123400640 1 -- 172.21.15.31:0/2100953583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) -- 0x7fd11c0b4660 con 0x7fd11c15bd50 2024-09-17T05:31:32.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.635+0000 7fd118c00640 1 -- 172.21.15.31:0/2100953583 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v160) ==== 140+0+0 (secure 0 0 0) 0x7fd1080f88d0 con 0x7fd11c15bd50 2024-09-17T05:31:32.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.635+0000 7fd123400640 1 -- 172.21.15.31:0/2100953583 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd0fc0733e0 msgr2=0x7fd0fc0758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:32.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.635+0000 7fd123400640 1 --2- 172.21.15.31:0/2100953583 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd0fc0733e0 0x7fd0fc0758a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd110000f70 tx=0x7fd110009040 comp rx=0 tx=0).stop 2024-09-17T05:31:32.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.635+0000 7fd123400640 1 -- 172.21.15.31:0/2100953583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd11c15bd50 msgr2=0x7fd11c14f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:32.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.635+0000 7fd123400640 1 --2- 172.21.15.31:0/2100953583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd11c15bd50 0x7fd11c14f890 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd108009790 tx=0x7fd1080a56f0 comp rx=0 tx=0).stop 2024-09-17T05:31:32.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.635+0000 7fd123400640 1 -- 172.21.15.31:0/2100953583 shutdown_connections 2024-09-17T05:31:32.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.635+0000 7fd123400640 1 --2- 172.21.15.31:0/2100953583 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd0fc0733e0 0x7fd0fc0758a0 secure :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd110000f70 tx=0x7fd110009040 comp rx=0 tx=0).stop 2024-09-17T05:31:32.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.635+0000 7fd123400640 1 --2- 172.21.15.31:0/2100953583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd11c15c130 0x7fd11c14fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:32.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.635+0000 7fd123400640 1 --2- 172.21.15.31:0/2100953583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd11c15bd50 0x7fd11c14f890 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:32.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.635+0000 7fd123400640 1 --2- 172.21.15.31:0/2100953583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd11c0cecf0 0x7fd11c1421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:32.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.635+0000 7fd123400640 1 -- 172.21.15.31:0/2100953583 >> 172.21.15.31:0/2100953583 conn(0x7fd11c0d1ea0 msgr2=0x7fd11c0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:32.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.635+0000 7fd123400640 1 -- 172.21.15.31:0/2100953583 shutdown_connections 2024-09-17T05:31:32.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.635+0000 7fd123400640 1 -- 172.21.15.31:0/2100953583 wait complete. 2024-09-17T05:31:32.661 INFO:tasks.cephfs_test_runner:test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-09-17T05:31:32.662 INFO:tasks.cephfs_test_runner:Starting test: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate handcrafted .meta file on legacy subvol root doesn't break the system 2024-09-17T05:31:32.662 INFO:tasks.cephfs_test_runner:test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:31:32.662 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:31:32.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.803+0000 7fe1a9200640 1 -- 172.21.15.31:0/2847999407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1a40b2590 msgr2=0x7fe1a40b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:32.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.803+0000 7fe1a9200640 1 --2- 172.21.15.31:0/2847999407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1a40b2590 0x7fe1a40b29e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40c56a0 tx=0x7fe19c01ccf0 comp rx=0 tx=0).stop 2024-09-17T05:31:32.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.803+0000 7fe1a9200640 1 -- 172.21.15.31:0/2847999407 shutdown_connections 2024-09-17T05:31:32.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.803+0000 7fe1a9200640 1 --2- 172.21.15.31:0/2847999407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1a40b2590 0x7fe1a40b29e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:32.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.803+0000 7fe1a9200640 1 --2- 172.21.15.31:0/2847999407 >> v2:172.21.15.155:3300/0 conn(0x7fe1a40d01b0 0x7fe1a40cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:32.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.803+0000 7fe1a9200640 1 -- 172.21.15.31:0/2847999407 >> 172.21.15.31:0/2847999407 conn(0x7fe1a409aa10 msgr2=0x7fe1a409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:32.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.803+0000 7fe1a9200640 1 -- 172.21.15.31:0/2847999407 shutdown_connections 2024-09-17T05:31:32.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.803+0000 7fe1a9200640 1 -- 172.21.15.31:0/2847999407 wait complete. 2024-09-17T05:31:32.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a9200640 1 Processor -- start 2024-09-17T05:31:32.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a9200640 1 -- start start 2024-09-17T05:31:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a9200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1a40b2590 0x7fe1a40b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a9200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1a40d01b0 0x7fe1a415de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a9200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1a415f000 0x7fe1a4149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a9200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a4168e70 con 0x7fe1a40b2590 2024-09-17T05:31:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a9200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a4168cf0 con 0x7fe1a40d01b0 2024-09-17T05:31:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a9200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a4168ff0 con 0x7fe1a415f000 2024-09-17T05:31:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1a40b2590 0x7fe1a40b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1a40b2590 0x7fe1a40b4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59452/0 (socket says 172.21.15.31:59452) 2024-09-17T05:31:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a3400640 1 -- 172.21.15.31:0/3109155634 learned_addr learned my addr 172.21.15.31:0/3109155634 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe19aa00640 1 --2- 172.21.15.31:0/3109155634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1a40d01b0 0x7fe1a415de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a3e00640 1 --2- 172.21.15.31:0/3109155634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1a415f000 0x7fe1a4149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:32.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a3400640 1 -- 172.21.15.31:0/3109155634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1a415f000 msgr2=0x7fe1a4149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:32.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a3400640 1 --2- 172.21.15.31:0/3109155634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1a415f000 0x7fe1a4149b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:32.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a3400640 1 -- 172.21.15.31:0/3109155634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1a40d01b0 msgr2=0x7fe1a415de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:32.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a3400640 1 --2- 172.21.15.31:0/3109155634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1a40d01b0 0x7fe1a415de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:32.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a3400640 1 -- 172.21.15.31:0/3109155634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a4163e50 con 0x7fe1a40b2590 2024-09-17T05:31:32.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe19aa00640 1 --2- 172.21.15.31:0/3109155634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1a40d01b0 0x7fe1a415de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:31:32.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a3400640 1 --2- 172.21.15.31:0/3109155634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1a40b2590 0x7fe1a40b4a00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe19400c3f0 tx=0x7fe19400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:32.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe19be00640 1 -- 172.21.15.31:0/3109155634 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194017070 con 0x7fe1a40b2590 2024-09-17T05:31:32.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe19be00640 1 -- 172.21.15.31:0/3109155634 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1940053c0 con 0x7fe1a40b2590 2024-09-17T05:31:32.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe19be00640 1 -- 172.21.15.31:0/3109155634 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194003860 con 0x7fe1a40b2590 2024-09-17T05:31:32.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a9200640 1 -- 172.21.15.31:0/3109155634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a4164130 con 0x7fe1a40b2590 2024-09-17T05:31:32.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a9200640 1 -- 172.21.15.31:0/3109155634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a41649d0 con 0x7fe1a40b2590 2024-09-17T05:31:32.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.807+0000 7fe1a9200640 1 -- 172.21.15.31:0/3109155634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a40b29e0 con 0x7fe1a40b2590 2024-09-17T05:31:32.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.811+0000 7fe19be00640 1 -- 172.21.15.31:0/3109155634 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7fe19401a070 con 0x7fe1a40b2590 2024-09-17T05:31:32.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.811+0000 7fe19be00640 1 --2- 172.21.15.31:0/3109155634 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe1800733b0 0x7fe180075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:32.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.811+0000 7fe19be00640 1 -- 172.21.15.31:0/3109155634 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7fe194093680 con 0x7fe1a40b2590 2024-09-17T05:31:32.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.811+0000 7fe19aa00640 1 --2- 172.21.15.31:0/3109155634 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe1800733b0 0x7fe180075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:32.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.811+0000 7fe19aa00640 1 --2- 172.21.15.31:0/3109155634 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe1800733b0 0x7fe180075870 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0058d0 tx=0x7fe18c005860 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:32.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.815+0000 7fe19be00640 1 -- 172.21.15.31:0/3109155634 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe19405e600 con 0x7fe1a40b2590 2024-09-17T05:31:32.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.991+0000 7fe1a9200640 1 -- 172.21.15.31:0/3109155634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1a4164300 con 0x7fe1a40b2590 2024-09-17T05:31:32.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.995+0000 7fe19be00640 1 -- 172.21.15.31:0/3109155634 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+13054 (secure 0 0 0) 0x7fe19405df00 con 0x7fe1a40b2590 2024-09-17T05:31:32.999 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:33.000 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":49,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:31:31.631125+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6835/561523453":"2024-09-18T05:31:28.621440+0000","172.21.15.31:6833/561523453":"2024-09-18T05:31:28.621440+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:31:33.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.995+0000 7fe1a9200640 1 -- 172.21.15.31:0/3109155634 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe1800733b0 msgr2=0x7fe180075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:33.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.995+0000 7fe1a9200640 1 --2- 172.21.15.31:0/3109155634 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe1800733b0 0x7fe180075870 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0058d0 tx=0x7fe18c005860 comp rx=0 tx=0).stop 2024-09-17T05:31:33.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.995+0000 7fe1a9200640 1 -- 172.21.15.31:0/3109155634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1a40b2590 msgr2=0x7fe1a40b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:33.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.995+0000 7fe1a9200640 1 --2- 172.21.15.31:0/3109155634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1a40b2590 0x7fe1a40b4a00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe19400c3f0 tx=0x7fe19400c8b0 comp rx=0 tx=0).stop 2024-09-17T05:31:33.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.995+0000 7fe1a9200640 1 -- 172.21.15.31:0/3109155634 shutdown_connections 2024-09-17T05:31:33.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.995+0000 7fe1a9200640 1 --2- 172.21.15.31:0/3109155634 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe1800733b0 0x7fe180075870 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:33.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.995+0000 7fe1a9200640 1 --2- 172.21.15.31:0/3109155634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1a415f000 0x7fe1a4149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:33.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.995+0000 7fe1a9200640 1 --2- 172.21.15.31:0/3109155634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe1a40d01b0 0x7fe1a415de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:33.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.995+0000 7fe1a9200640 1 --2- 172.21.15.31:0/3109155634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1a40b2590 0x7fe1a40b4a00 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:33.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.995+0000 7fe1a9200640 1 -- 172.21.15.31:0/3109155634 >> 172.21.15.31:0/3109155634 conn(0x7fe1a409aa10 msgr2=0x7fe1a40cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:33.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.995+0000 7fe1a9200640 1 -- 172.21.15.31:0/3109155634 shutdown_connections 2024-09-17T05:31:33.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:32.995+0000 7fe1a9200640 1 -- 172.21.15.31:0/3109155634 wait complete. 2024-09-17T05:31:33.021 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:28:33.209612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:31:33.021 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:31:33.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.163+0000 7f744e800640 1 -- 172.21.15.31:0/1793765303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74481605d0 msgr2=0x7f74480d0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:33.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.163+0000 7f744e800640 1 --2- 172.21.15.31:0/1793765303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74481605d0 0x7f74480d0690 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7438009900 tx=0x7f743801c8e0 comp rx=0 tx=0).stop 2024-09-17T05:31:33.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f744e800640 1 -- 172.21.15.31:0/1793765303 shutdown_connections 2024-09-17T05:31:33.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f744e800640 1 --2- 172.21.15.31:0/1793765303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74480afb10 0x7f74480affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:33.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f744e800640 1 --2- 172.21.15.31:0/1793765303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74481605d0 0x7f74480d0690 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:33.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f744e800640 1 -- 172.21.15.31:0/1793765303 >> 172.21.15.31:0/1793765303 conn(0x7f74480d1dd0 msgr2=0x7f74480d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:33.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f744e800640 1 -- 172.21.15.31:0/1793765303 shutdown_connections 2024-09-17T05:31:33.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f744e800640 1 -- 172.21.15.31:0/1793765303 wait complete. 2024-09-17T05:31:33.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f744e800640 1 Processor -- start 2024-09-17T05:31:33.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f744e800640 1 -- start start 2024-09-17T05:31:33.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f744e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74480afb10 0x7f7448151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:33.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f744e800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74480b1650 0x7f744815aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:33.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f744e800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74481605d0 0x7f7448157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:33.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f744e800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f74480b0e60 con 0x7f74480afb10 2024-09-17T05:31:33.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f744e800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74480b1430 con 0x7f74480b1650 2024-09-17T05:31:33.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f744e800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7448169540 con 0x7f74481605d0 2024-09-17T05:31:33.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f7447400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74480afb10 0x7f7448151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:33.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f7447400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74480afb10 0x7f7448151ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59466/0 (socket says 172.21.15.31:59466) 2024-09-17T05:31:33.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f7447400640 1 -- 172.21.15.31:0/3111210833 learned_addr learned my addr 172.21.15.31:0/3111210833 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:33.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f743fe00640 1 --2- 172.21.15.31:0/3111210833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74480b1650 0x7f744815aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:33.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f7447e00640 1 --2- 172.21.15.31:0/3111210833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74481605d0 0x7f7448157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:33.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f7447400640 1 -- 172.21.15.31:0/3111210833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74481605d0 msgr2=0x7f7448157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:33.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f7447400640 1 --2- 172.21.15.31:0/3111210833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74481605d0 0x7f7448157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:33.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f7447400640 1 -- 172.21.15.31:0/3111210833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74480b1650 msgr2=0x7f744815aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:33.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f7447400640 1 --2- 172.21.15.31:0/3111210833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74480b1650 0x7f744815aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:33.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f7447400640 1 -- 172.21.15.31:0/3111210833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744815b420 con 0x7f74480afb10 2024-09-17T05:31:33.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f7447e00640 1 --2- 172.21.15.31:0/3111210833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74481605d0 0x7f7448157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:31:33.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f7447400640 1 --2- 172.21.15.31:0/3111210833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74480afb10 0x7f7448151ea0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7438009850 tx=0x7f74380a5620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:33.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.167+0000 7f743f400640 1 -- 172.21.15.31:0/3111210833 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74380b2040 con 0x7f74480afb10 2024-09-17T05:31:33.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.171+0000 7f743f400640 1 -- 172.21.15.31:0/3111210833 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74380043b0 con 0x7f74480afb10 2024-09-17T05:31:33.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.171+0000 7f743f400640 1 -- 172.21.15.31:0/3111210833 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7438005280 con 0x7f74480afb10 2024-09-17T05:31:33.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.171+0000 7f744e800640 1 -- 172.21.15.31:0/3111210833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74480b6bd0 con 0x7f74480afb10 2024-09-17T05:31:33.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.171+0000 7f744e800640 1 -- 172.21.15.31:0/3111210833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74480b7190 con 0x7f74480afb10 2024-09-17T05:31:33.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.171+0000 7f744e800640 1 -- 172.21.15.31:0/3111210833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74480affc0 con 0x7f74480afb10 2024-09-17T05:31:33.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.171+0000 7f743f400640 1 -- 172.21.15.31:0/3111210833 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f7438005420 con 0x7f74480afb10 2024-09-17T05:31:33.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.171+0000 7f743f400640 1 --2- 172.21.15.31:0/3111210833 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f74240733b0 0x7f7424075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:33.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.171+0000 7f743f400640 1 -- 172.21.15.31:0/3111210833 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f743812d9c0 con 0x7f74480afb10 2024-09-17T05:31:33.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.171+0000 7f743fe00640 1 --2- 172.21.15.31:0/3111210833 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f74240733b0 0x7f7424075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:33.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.175+0000 7f743fe00640 1 --2- 172.21.15.31:0/3111210833 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f74240733b0 0x7f7424075870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f744815aa20 tx=0x7f7430009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:33.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.175+0000 7f743f400640 1 -- 172.21.15.31:0/3111210833 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f74380164d0 con 0x7f74480afb10 2024-09-17T05:31:33.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.351+0000 7f744e800640 1 -- 172.21.15.31:0/3111210833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f74480d1080 con 0x7f74480afb10 2024-09-17T05:31:33.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.351+0000 7f743f400640 1 -- 172.21.15.31:0/3111210833 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) ==== 93+0+10 (secure 0 0 0) 0x7f74380f8950 con 0x7f74480afb10 2024-09-17T05:31:33.358 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-09-17T05:31:33.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.355+0000 7f744e800640 1 -- 172.21.15.31:0/3111210833 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f74240733b0 msgr2=0x7f7424075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:33.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.355+0000 7f744e800640 1 --2- 172.21.15.31:0/3111210833 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f74240733b0 0x7f7424075870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f744815aa20 tx=0x7f7430009040 comp rx=0 tx=0).stop 2024-09-17T05:31:33.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.355+0000 7f744e800640 1 -- 172.21.15.31:0/3111210833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74480afb10 msgr2=0x7f7448151ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:33.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.355+0000 7f744e800640 1 --2- 172.21.15.31:0/3111210833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74480afb10 0x7f7448151ea0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7438009850 tx=0x7f74380a5620 comp rx=0 tx=0).stop 2024-09-17T05:31:33.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.355+0000 7f744e800640 1 -- 172.21.15.31:0/3111210833 shutdown_connections 2024-09-17T05:31:33.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.355+0000 7f744e800640 1 --2- 172.21.15.31:0/3111210833 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f74240733b0 0x7f7424075870 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:33.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.355+0000 7f744e800640 1 --2- 172.21.15.31:0/3111210833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74481605d0 0x7f7448157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:33.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.355+0000 7f744e800640 1 --2- 172.21.15.31:0/3111210833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74480b1650 0x7f744815aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:33.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.355+0000 7f744e800640 1 --2- 172.21.15.31:0/3111210833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74480afb10 0x7f7448151ea0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:33.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.355+0000 7f744e800640 1 -- 172.21.15.31:0/3111210833 >> 172.21.15.31:0/3111210833 conn(0x7f74480d1dd0 msgr2=0x7f7448166130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:33.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.355+0000 7f744e800640 1 -- 172.21.15.31:0/3111210833 shutdown_connections 2024-09-17T05:31:33.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.355+0000 7f744e800640 1 -- 172.21.15.31:0/3111210833 wait complete. 2024-09-17T05:31:33.380 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2024-09-17T05:31:33.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.523+0000 7f7f43000640 1 -- 172.21.15.31:0/1249752086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f20003c70 msgr2=0x7f7f20004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:33.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.523+0000 7f7f43000640 1 --2- 172.21.15.31:0/1249752086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f20003c70 0x7f7f20004090 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c006eb0 tx=0x7f7f2c01ce00 comp rx=0 tx=0).stop 2024-09-17T05:31:33.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.523+0000 7f7f41000640 1 -- 172.21.15.31:0/1249752086 reap_dead start 2024-09-17T05:31:33.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.523+0000 7f7f43000640 1 -- 172.21.15.31:0/1249752086 shutdown_connections 2024-09-17T05:31:33.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.523+0000 7f7f43000640 1 -- 172.21.15.31:0/1249752086 >> 172.21.15.31:0/1249752086 conn(0x7f7f3c0d1dc0 msgr2=0x7f7f3c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:33.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.523+0000 7f7f43000640 1 -- 172.21.15.31:0/1249752086 shutdown_connections 2024-09-17T05:31:33.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.523+0000 7f7f43000640 1 -- 172.21.15.31:0/1249752086 wait complete. 2024-09-17T05:31:33.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.523+0000 7f7f43000640 1 Processor -- start 2024-09-17T05:31:33.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.523+0000 7f7f43000640 1 -- start start 2024-09-17T05:31:33.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.523+0000 7f7f43000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f20003c70 0x7f7f3c1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:33.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.523+0000 7f7f43000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f3c157130 0x7f7f3c15e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:33.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f43000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f3c15ed00 0x7f7f3c15f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:33.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f43000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3c0d1550 con 0x7f7f3c15ed00 2024-09-17T05:31:33.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f43000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3c0d13d0 con 0x7f7f20003c70 2024-09-17T05:31:33.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f43000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7f3c16a520 con 0x7f7f3c157130 2024-09-17T05:31:33.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f41000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f3c15ed00 0x7f7f3c15f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:33.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f41000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f3c15ed00 0x7f7f3c15f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59488/0 (socket says 172.21.15.31:59488) 2024-09-17T05:31:33.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f41000640 1 -- 172.21.15.31:0/155290868 learned_addr learned my addr 172.21.15.31:0/155290868 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:33.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f3be00640 1 --2- 172.21.15.31:0/155290868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f20003c70 0x7f7f3c1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:33.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f33e00640 1 --2- 172.21.15.31:0/155290868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f3c157130 0x7f7f3c15e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:33.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f41000640 1 -- 172.21.15.31:0/155290868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f3c157130 msgr2=0x7f7f3c15e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:33.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f41000640 1 --2- 172.21.15.31:0/155290868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f3c157130 0x7f7f3c15e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:33.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f41000640 1 -- 172.21.15.31:0/155290868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f20003c70 msgr2=0x7f7f3c1569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:33.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f41000640 1 --2- 172.21.15.31:0/155290868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f20003c70 0x7f7f3c1569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:33.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f41000640 1 -- 172.21.15.31:0/155290868 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f3c1fc060 con 0x7f7f3c15ed00 2024-09-17T05:31:33.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f41000640 1 --2- 172.21.15.31:0/155290868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f3c15ed00 0x7f7f3c15f180 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c15e710 tx=0x7f7f34001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:33.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f38c00640 1 -- 172.21.15.31:0/155290868 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f34011870 con 0x7f7f3c15ed00 2024-09-17T05:31:33.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f38c00640 1 -- 172.21.15.31:0/155290868 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f34017070 con 0x7f7f3c15ed00 2024-09-17T05:31:33.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f38c00640 1 -- 172.21.15.31:0/155290868 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f34011e00 con 0x7f7f3c15ed00 2024-09-17T05:31:33.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f43000640 1 -- 172.21.15.31:0/155290868 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f3c156f00 con 0x7f7f3c15ed00 2024-09-17T05:31:33.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f43000640 1 -- 172.21.15.31:0/155290868 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f3c1fb2a0 con 0x7f7f3c15ed00 2024-09-17T05:31:33.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f43000640 1 -- 172.21.15.31:0/155290868 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f3c169840 con 0x7f7f3c15ed00 2024-09-17T05:31:33.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.527+0000 7f7f38c00640 1 -- 172.21.15.31:0/155290868 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f7f3401c460 con 0x7f7f3c15ed00 2024-09-17T05:31:33.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.531+0000 7f7f38c00640 1 --2- 172.21.15.31:0/155290868 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7f180733b0 0x7f7f18075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:33.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.531+0000 7f7f38c00640 1 -- 172.21.15.31:0/155290868 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f7f34094b90 con 0x7f7f3c15ed00 2024-09-17T05:31:33.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.531+0000 7f7f3be00640 1 --2- 172.21.15.31:0/155290868 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7f180733b0 0x7f7f18075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:33.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.531+0000 7f7f3be00640 1 --2- 172.21.15.31:0/155290868 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7f180733b0 0x7f7f18075870 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0ab000 tx=0x7f7f2c019c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:33.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.535+0000 7f7f38c00640 1 -- 172.21.15.31:0/155290868 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7f3405fb10 con 0x7f7f3c15ed00 2024-09-17T05:31:33.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:33.775+0000 7f7f43000640 1 -- 172.21.15.31:0/155290868 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f7f3c06e6c0 con 0x7f7f3c15ed00 2024-09-17T05:31:34.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.643+0000 7f7f38c00640 1 -- 172.21.15.31:0/155290868 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v162) ==== 164+0+0 (secure 0 0 0) 0x7f7f3405f410 con 0x7f7f3c15ed00 2024-09-17T05:31:34.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.643+0000 7f7f43000640 1 -- 172.21.15.31:0/155290868 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7f180733b0 msgr2=0x7f7f18075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:34.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.643+0000 7f7f43000640 1 --2- 172.21.15.31:0/155290868 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7f180733b0 0x7f7f18075870 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0ab000 tx=0x7f7f2c019c40 comp rx=0 tx=0).stop 2024-09-17T05:31:34.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.643+0000 7f7f43000640 1 -- 172.21.15.31:0/155290868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f3c15ed00 msgr2=0x7f7f3c15f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:34.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.643+0000 7f7f43000640 1 --2- 172.21.15.31:0/155290868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f3c15ed00 0x7f7f3c15f180 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c15e710 tx=0x7f7f34001b90 comp rx=0 tx=0).stop 2024-09-17T05:31:34.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.643+0000 7f7f43000640 1 -- 172.21.15.31:0/155290868 shutdown_connections 2024-09-17T05:31:34.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.643+0000 7f7f43000640 1 --2- 172.21.15.31:0/155290868 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7f180733b0 0x7f7f18075870 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:34.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.643+0000 7f7f43000640 1 --2- 172.21.15.31:0/155290868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f3c15ed00 0x7f7f3c15f180 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:34.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.643+0000 7f7f43000640 1 --2- 172.21.15.31:0/155290868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f3c157130 0x7f7f3c15e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:34.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.643+0000 7f7f43000640 1 --2- 172.21.15.31:0/155290868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f20003c70 0x7f7f3c1569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:34.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.643+0000 7f7f43000640 1 -- 172.21.15.31:0/155290868 >> 172.21.15.31:0/155290868 conn(0x7f7f3c0d1dc0 msgr2=0x7f7f3c15cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:34.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.643+0000 7f7f43000640 1 -- 172.21.15.31:0/155290868 shutdown_connections 2024-09-17T05:31:34.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.643+0000 7f7f43000640 1 -- 172.21.15.31:0/155290868 wait complete. 2024-09-17T05:31:34.673 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:31:34.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.819+0000 7f95ee600640 1 -- 172.21.15.31:0/371543297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95e80b49e0 msgr2=0x7f95e80acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:34.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.819+0000 7f95ee600640 1 --2- 172.21.15.31:0/371543297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95e80b49e0 0x7f95e80acd40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f95e000ad90 tx=0x7f95e001dc20 comp rx=0 tx=0).stop 2024-09-17T05:31:34.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.819+0000 7f95ee600640 1 -- 172.21.15.31:0/371543297 shutdown_connections 2024-09-17T05:31:34.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.819+0000 7f95ee600640 1 --2- 172.21.15.31:0/371543297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95e80b49e0 0x7f95e80acd40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:34.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.819+0000 7f95ee600640 1 --2- 172.21.15.31:0/371543297 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95e80cd100 0x7f95e806f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:34.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.819+0000 7f95ee600640 1 -- 172.21.15.31:0/371543297 >> 172.21.15.31:0/371543297 conn(0x7f95e80b18f0 msgr2=0x7f95e80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:34.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.819+0000 7f95ee600640 1 -- 172.21.15.31:0/371543297 shutdown_connections 2024-09-17T05:31:34.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.819+0000 7f95ee600640 1 -- 172.21.15.31:0/371543297 wait complete. 2024-09-17T05:31:34.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.819+0000 7f95ee600640 1 Processor -- start 2024-09-17T05:31:34.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.819+0000 7f95ee600640 1 -- start start 2024-09-17T05:31:34.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95ee600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95e80b49e0 0x7f95e8073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:34.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95ee600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95e80cd100 0x7f95e809cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:34.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95ee600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95e815dae0 0x7f95e814d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:34.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95ee600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f95e80cf1f0 con 0x7f95e80b49e0 2024-09-17T05:31:34.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95ee600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f95e80cf070 con 0x7f95e80cd100 2024-09-17T05:31:34.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95ee600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f95e80cf370 con 0x7f95e815dae0 2024-09-17T05:31:34.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95e7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95e80b49e0 0x7f95e8073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:34.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95e7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95e80b49e0 0x7f95e8073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59516/0 (socket says 172.21.15.31:59516) 2024-09-17T05:31:34.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95e7400640 1 -- 172.21.15.31:0/274618660 learned_addr learned my addr 172.21.15.31:0/274618660 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:34.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95e7400640 1 -- 172.21.15.31:0/274618660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95e815dae0 msgr2=0x7f95e814d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:34.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95e7400640 1 --2- 172.21.15.31:0/274618660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95e815dae0 0x7f95e814d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:34.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95e7400640 1 -- 172.21.15.31:0/274618660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95e80cd100 msgr2=0x7f95e809cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:34.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95dfe00640 1 --2- 172.21.15.31:0/274618660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95e80cd100 0x7f95e809cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:34.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95e7400640 1 --2- 172.21.15.31:0/274618660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95e80cd100 0x7f95e809cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:34.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95e7400640 1 -- 172.21.15.31:0/274618660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e81632d0 con 0x7f95e80b49e0 2024-09-17T05:31:34.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95dfe00640 1 --2- 172.21.15.31:0/274618660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95e80cd100 0x7f95e809cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:31:34.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95e7400640 1 --2- 172.21.15.31:0/274618660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95e80b49e0 0x7f95e8073090 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f95d800c3c0 tx=0x7f95d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:34.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95df400640 1 -- 172.21.15.31:0/274618660 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d8017070 con 0x7f95e80b49e0 2024-09-17T05:31:34.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95df400640 1 -- 172.21.15.31:0/274618660 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95d80053c0 con 0x7f95e80b49e0 2024-09-17T05:31:34.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95df400640 1 -- 172.21.15.31:0/274618660 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d8003860 con 0x7f95e80b49e0 2024-09-17T05:31:34.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95ee600640 1 -- 172.21.15.31:0/274618660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e81635b0 con 0x7f95e80b49e0 2024-09-17T05:31:34.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95ee600640 1 -- 172.21.15.31:0/274618660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e8163e50 con 0x7f95e80b49e0 2024-09-17T05:31:34.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95ee600640 1 -- 172.21.15.31:0/274618660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e809aa10 con 0x7f95e80b49e0 2024-09-17T05:31:34.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.823+0000 7f95df400640 1 -- 172.21.15.31:0/274618660 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f95d801a070 con 0x7f95e80b49e0 2024-09-17T05:31:34.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.827+0000 7f95df400640 1 --2- 172.21.15.31:0/274618660 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f95c40733b0 0x7f95c4075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:34.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.827+0000 7f95df400640 1 -- 172.21.15.31:0/274618660 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f95d80936b0 con 0x7f95e80b49e0 2024-09-17T05:31:34.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.827+0000 7f95dfe00640 1 --2- 172.21.15.31:0/274618660 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f95c40733b0 0x7f95c4075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:34.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.827+0000 7f95dfe00640 1 --2- 172.21.15.31:0/274618660 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f95c40733b0 0x7f95c4075870 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f95e81592a0 tx=0x7f95d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:34.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:34.831+0000 7f95df400640 1 -- 172.21.15.31:0/274618660 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f95e809aa10 con 0x7f95e80b49e0 2024-09-17T05:31:35.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.003+0000 7f95ee600640 1 -- 172.21.15.31:0/274618660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f95e80d09b0 con 0x7f95e80b49e0 2024-09-17T05:31:35.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.007+0000 7f95df400640 1 -- 172.21.15.31:0/274618660 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+1998 (secure 0 0 0) 0x7f95d805e630 con 0x7f95e80b49e0 2024-09-17T05:31:35.011 INFO:teuthology.orchestra.run.smithi031.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:31:35.011 INFO:teuthology.orchestra.run.smithi031.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:31:35.011 INFO:teuthology.orchestra.run.smithi031.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6159.333103 2024-09-17T05:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4566.558105 2024-09-17T05:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4575.968427 2024-09-17T05:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4702.806393 2024-09-17T05:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4956.728274 2024-09-17T05:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 6604.257199 2024-09-17T05:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4779.165073 2024-09-17T05:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4673.795919 2024-09-17T05:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds 20/20 2024-09-17T05:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:31:35.012 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_ms 2/2 2024-09-17T05:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_frag true 2024-09-17T05:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_verify_scatter true 2024-09-17T05:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced client_mount_timeout 600 2024-09-17T05:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_client 20/20 2024-09-17T05:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_ms 1/1 2024-09-17T05:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:31:35.013 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:31:35.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.007+0000 7f95ee600640 1 -- 172.21.15.31:0/274618660 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f95c40733b0 msgr2=0x7f95c4075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:35.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.007+0000 7f95ee600640 1 --2- 172.21.15.31:0/274618660 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f95c40733b0 0x7f95c4075870 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f95e81592a0 tx=0x7f95d0008040 comp rx=0 tx=0).stop 2024-09-17T05:31:35.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.007+0000 7f95ee600640 1 -- 172.21.15.31:0/274618660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95e80b49e0 msgr2=0x7f95e8073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:35.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.007+0000 7f95ee600640 1 --2- 172.21.15.31:0/274618660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95e80b49e0 0x7f95e8073090 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f95d800c3c0 tx=0x7f95d800c880 comp rx=0 tx=0).stop 2024-09-17T05:31:35.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.007+0000 7f95ee600640 1 -- 172.21.15.31:0/274618660 shutdown_connections 2024-09-17T05:31:35.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.007+0000 7f95ee600640 1 --2- 172.21.15.31:0/274618660 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f95c40733b0 0x7f95c4075870 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:35.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.007+0000 7f95ee600640 1 --2- 172.21.15.31:0/274618660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95e815dae0 0x7f95e814d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:35.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.007+0000 7f95ee600640 1 --2- 172.21.15.31:0/274618660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95e80cd100 0x7f95e809cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:35.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.007+0000 7f95ee600640 1 --2- 172.21.15.31:0/274618660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95e80b49e0 0x7f95e8073090 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:35.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.007+0000 7f95ee600640 1 -- 172.21.15.31:0/274618660 >> 172.21.15.31:0/274618660 conn(0x7f95e80b18f0 msgr2=0x7f95e8159940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:35.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.007+0000 7f95ee600640 1 -- 172.21.15.31:0/274618660 shutdown_connections 2024-09-17T05:31:35.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.007+0000 7f95ee600640 1 -- 172.21.15.31:0/274618660 wait complete. 2024-09-17T05:31:35.033 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:31:35.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f673be00640 1 -- 172.21.15.31:0/4222525303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f671c003a60 msgr2=0x7f671c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:35.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f673be00640 1 --2- 172.21.15.31:0/4222525303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f671c003a60 0x7f671c003e80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6728009b60 tx=0x7f672801d2b0 comp rx=0 tx=0).stop 2024-09-17T05:31:35.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f6739e00640 1 -- 172.21.15.31:0/4222525303 reap_dead start 2024-09-17T05:31:35.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f673be00640 1 -- 172.21.15.31:0/4222525303 shutdown_connections 2024-09-17T05:31:35.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f673be00640 1 -- 172.21.15.31:0/4222525303 >> 172.21.15.31:0/4222525303 conn(0x7f67340d1dd0 msgr2=0x7f67340d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:35.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f673be00640 1 -- 172.21.15.31:0/4222525303 shutdown_connections 2024-09-17T05:31:35.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f673be00640 1 -- 172.21.15.31:0/4222525303 wait complete. 2024-09-17T05:31:35.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f673be00640 1 Processor -- start 2024-09-17T05:31:35.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f673be00640 1 -- start start 2024-09-17T05:31:35.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f673be00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f671c003a60 0x7f673406f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:35.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f673be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67341fbb30 0x7f67340c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:35.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f673be00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67340c8520 0x7f6734158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:35.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f673be00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f67340b0e50 con 0x7f67341fbb30 2024-09-17T05:31:35.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f673be00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f67340b0cd0 con 0x7f671c003a60 2024-09-17T05:31:35.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f673be00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f67340b1220 con 0x7f67340c8520 2024-09-17T05:31:35.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f6738a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67341fbb30 0x7f67340c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:35.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f6738a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67341fbb30 0x7f67340c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59536/0 (socket says 172.21.15.31:59536) 2024-09-17T05:31:35.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f6738a00640 1 -- 172.21.15.31:0/2206698394 learned_addr learned my addr 172.21.15.31:0/2206698394 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:35.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f6739400640 1 --2- 172.21.15.31:0/2206698394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f671c003a60 0x7f673406f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:35.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.179+0000 7f6739e00640 1 --2- 172.21.15.31:0/2206698394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67340c8520 0x7f6734158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:35.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.183+0000 7f6738a00640 1 -- 172.21.15.31:0/2206698394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67340c8520 msgr2=0x7f6734158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:35.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.183+0000 7f6738a00640 1 --2- 172.21.15.31:0/2206698394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67340c8520 0x7f6734158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:35.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.183+0000 7f6738a00640 1 -- 172.21.15.31:0/2206698394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f671c003a60 msgr2=0x7f673406f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:35.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.183+0000 7f6738a00640 1 --2- 172.21.15.31:0/2206698394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f671c003a60 0x7f673406f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:35.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.183+0000 7f6738a00640 1 -- 172.21.15.31:0/2206698394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673406e1a0 con 0x7f67341fbb30 2024-09-17T05:31:35.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.183+0000 7f6738a00640 1 --2- 172.21.15.31:0/2206698394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67341fbb30 0x7f67340c7fe0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6720011a50 tx=0x7f6720011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:35.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.183+0000 7f6731600640 1 -- 172.21.15.31:0/2206698394 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672001f070 con 0x7f67341fbb30 2024-09-17T05:31:35.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.183+0000 7f6731600640 1 -- 172.21.15.31:0/2206698394 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f672000fe80 con 0x7f67341fbb30 2024-09-17T05:31:35.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.183+0000 7f6731600640 1 -- 172.21.15.31:0/2206698394 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6720012690 con 0x7f67341fbb30 2024-09-17T05:31:35.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.183+0000 7f673be00640 1 -- 172.21.15.31:0/2206698394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f673406e480 con 0x7f67341fbb30 2024-09-17T05:31:35.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.183+0000 7f673be00640 1 -- 172.21.15.31:0/2206698394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f673406ea40 con 0x7f67341fbb30 2024-09-17T05:31:35.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.183+0000 7f673be00640 1 -- 172.21.15.31:0/2206698394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67340d0690 con 0x7f67341fbb30 2024-09-17T05:31:35.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.183+0000 7f6731600640 1 -- 172.21.15.31:0/2206698394 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f6720022070 con 0x7f67341fbb30 2024-09-17T05:31:35.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.187+0000 7f6731600640 1 --2- 172.21.15.31:0/2206698394 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f67140733e0 0x7f67140758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:35.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.187+0000 7f6731600640 1 -- 172.21.15.31:0/2206698394 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f6720094da0 con 0x7f67341fbb30 2024-09-17T05:31:35.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.187+0000 7f6739400640 1 --2- 172.21.15.31:0/2206698394 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f67140733e0 0x7f67140758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:35.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.187+0000 7f6739400640 1 --2- 172.21.15.31:0/2206698394 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f67140733e0 0x7f67140758a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f67280ae000 tx=0x7f672801a050 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:35.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.191+0000 7f6731600640 1 -- 172.21.15.31:0/2206698394 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f672005f780 con 0x7f67341fbb30 2024-09-17T05:31:35.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.363+0000 7f673be00640 1 -- 172.21.15.31:0/2206698394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f67340cec30 con 0x7f67341fbb30 2024-09-17T05:31:35.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.371+0000 7f6731600640 1 -- 172.21.15.31:0/2206698394 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f67200641b0 con 0x7f67341fbb30 2024-09-17T05:31:35.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.371+0000 7f673be00640 1 -- 172.21.15.31:0/2206698394 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f67140733e0 msgr2=0x7f67140758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:35.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.371+0000 7f673be00640 1 --2- 172.21.15.31:0/2206698394 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f67140733e0 0x7f67140758a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f67280ae000 tx=0x7f672801a050 comp rx=0 tx=0).stop 2024-09-17T05:31:35.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.371+0000 7f673be00640 1 -- 172.21.15.31:0/2206698394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67341fbb30 msgr2=0x7f67340c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:35.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.371+0000 7f673be00640 1 --2- 172.21.15.31:0/2206698394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67341fbb30 0x7f67340c7fe0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6720011a50 tx=0x7f6720011f10 comp rx=0 tx=0).stop 2024-09-17T05:31:35.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.371+0000 7f673be00640 1 -- 172.21.15.31:0/2206698394 shutdown_connections 2024-09-17T05:31:35.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.371+0000 7f673be00640 1 --2- 172.21.15.31:0/2206698394 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f67140733e0 0x7f67140758a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:35.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.371+0000 7f673be00640 1 --2- 172.21.15.31:0/2206698394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67340c8520 0x7f6734158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:35.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.371+0000 7f673be00640 1 --2- 172.21.15.31:0/2206698394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67341fbb30 0x7f67340c7fe0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:35.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.371+0000 7f673be00640 1 --2- 172.21.15.31:0/2206698394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f671c003a60 0x7f673406f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:35.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.371+0000 7f673be00640 1 -- 172.21.15.31:0/2206698394 >> 172.21.15.31:0/2206698394 conn(0x7f67340d1dd0 msgr2=0x7f6734071950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:35.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.371+0000 7f673be00640 1 -- 172.21.15.31:0/2206698394 shutdown_connections 2024-09-17T05:31:35.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.371+0000 7f673be00640 1 -- 172.21.15.31:0/2206698394 wait complete. 2024-09-17T05:31:35.397 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:31:35.397 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:31:35.485 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:31:35.586 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:31:35.586 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:31:35.586 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:31:35.595 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:31:35.595 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:31:35.595 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:31:35.604 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:31:35.604 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:31:35.604 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:31:35.646 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:31:35.646 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:31:35.646 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:31:35.656 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:31:35.656 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:31:35.656 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:31:35.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.835+0000 7f6606400640 1 -- 172.21.15.31:0/1188745419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f660015bea0 msgr2=0x7f66000ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:35.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.835+0000 7f6606400640 1 --2- 172.21.15.31:0/1188745419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f660015bea0 0x7f66000ce670 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009840 tx=0x7f65f001c820 comp rx=0 tx=0).stop 2024-09-17T05:31:35.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.835+0000 7f6606400640 1 -- 172.21.15.31:0/1188745419 shutdown_connections 2024-09-17T05:31:35.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.835+0000 7f6606400640 1 --2- 172.21.15.31:0/1188745419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66000cdb30 0x7f66000cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:35.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.835+0000 7f6606400640 1 --2- 172.21.15.31:0/1188745419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f660015bea0 0x7f66000ce670 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:35.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.835+0000 7f6606400640 1 -- 172.21.15.31:0/1188745419 >> 172.21.15.31:0/1188745419 conn(0x7f66000d1dc0 msgr2=0x7f66000d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:35.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.835+0000 7f6606400640 1 -- 172.21.15.31:0/1188745419 shutdown_connections 2024-09-17T05:31:35.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.835+0000 7f6606400640 1 -- 172.21.15.31:0/1188745419 wait complete. 2024-09-17T05:31:35.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.835+0000 7f6606400640 1 Processor -- start 2024-09-17T05:31:35.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.835+0000 7f6606400640 1 -- start start 2024-09-17T05:31:35.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f6606400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66000cdb30 0x7f66000cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:35.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f6606400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66000d28e0 0x7f66000b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:35.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f6606400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f660015bea0 0x7f66000b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:35.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f6606400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6600169020 con 0x7f660015bea0 2024-09-17T05:31:35.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f6606400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6600168ea0 con 0x7f66000d28e0 2024-09-17T05:31:35.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f6606400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f66001691a0 con 0x7f66000cdb30 2024-09-17T05:31:35.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f65ffe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f660015bea0 0x7f66000b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:35.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f65ffe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f660015bea0 0x7f66000b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59550/0 (socket says 172.21.15.31:59550) 2024-09-17T05:31:35.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f65ffe00640 1 -- 172.21.15.31:0/1188284670 learned_addr learned my addr 172.21.15.31:0/1188284670 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:35.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f65ff400640 1 --2- 172.21.15.31:0/1188284670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66000cdb30 0x7f66000cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:35.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f65f7e00640 1 --2- 172.21.15.31:0/1188284670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66000d28e0 0x7f66000b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:35.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f65ffe00640 1 -- 172.21.15.31:0/1188284670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66000cdb30 msgr2=0x7f66000cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:35.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f65ffe00640 1 --2- 172.21.15.31:0/1188284670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66000cdb30 0x7f66000cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:35.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f65ffe00640 1 -- 172.21.15.31:0/1188284670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66000d28e0 msgr2=0x7f66000b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:35.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f65ffe00640 1 --2- 172.21.15.31:0/1188284670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66000d28e0 0x7f66000b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:35.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f65ffe00640 1 -- 172.21.15.31:0/1188284670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660006fb80 con 0x7f660015bea0 2024-09-17T05:31:35.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f65ff400640 1 --2- 172.21.15.31:0/1188284670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66000cdb30 0x7f66000cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:31:35.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f65ffe00640 1 --2- 172.21.15.31:0/1188284670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f660015bea0 0x7f66000b2b00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f65f800c730 tx=0x7f65f800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:35.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f65f7400640 1 -- 172.21.15.31:0/1188284670 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8003db0 con 0x7f660015bea0 2024-09-17T05:31:35.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f65f7400640 1 -- 172.21.15.31:0/1188284670 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65f800ce40 con 0x7f660015bea0 2024-09-17T05:31:35.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f65f7400640 1 -- 172.21.15.31:0/1188284670 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f80052d0 con 0x7f660015bea0 2024-09-17T05:31:35.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f6606400640 1 -- 172.21.15.31:0/1188284670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f660006df80 con 0x7f660015bea0 2024-09-17T05:31:35.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f6606400640 1 -- 172.21.15.31:0/1188284670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f660006e540 con 0x7f660015bea0 2024-09-17T05:31:35.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.839+0000 7f6606400640 1 -- 172.21.15.31:0/1188284670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f660006e740 con 0x7f660015bea0 2024-09-17T05:31:35.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.843+0000 7f65f7400640 1 -- 172.21.15.31:0/1188284670 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f65f8005470 con 0x7f660015bea0 2024-09-17T05:31:35.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.843+0000 7f65f7400640 1 --2- 172.21.15.31:0/1188284670 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f65dc0733e0 0x7f65dc0758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:35.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.843+0000 7f65f7400640 1 -- 172.21.15.31:0/1188284670 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f65f8094180 con 0x7f660015bea0 2024-09-17T05:31:35.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.843+0000 7f65ff400640 1 --2- 172.21.15.31:0/1188284670 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f65dc0733e0 0x7f65dc0758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:35.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.843+0000 7f65ff400640 1 --2- 172.21.15.31:0/1188284670 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f65dc0733e0 0x7f65dc0758a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f65f00af000 tx=0x7f65f001b060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:35.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:35.847+0000 7f65f7400640 1 -- 172.21.15.31:0/1188284670 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f660006e740 con 0x7f660015bea0 2024-09-17T05:31:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.059+0000 7f6606400640 1 -- 172.21.15.31:0/1188284670 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66000cc9d0 con 0x7f660015bea0 2024-09-17T05:31:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.059+0000 7f65f7400640 1 -- 172.21.15.31:0/1188284670 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+3914 (secure 0 0 0) 0x7f65f805f1a0 con 0x7f660015bea0 2024-09-17T05:31:36.064 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:36.064 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":31,"btime":"2024-09-17T05:31:29:624077+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/594639804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":594639804},{"type":"v1","addr":"172.21.15.155:6835","nonce":594639804}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3413860098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3413860098},{"type":"v1","addr":"172.21.15.155:6837","nonce":3413860098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5292,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1496220110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1496220110},{"type":"v1","addr":"172.21.15.31:6834","nonce":1496220110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5652,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1520005016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1520005016},{"type":"v1","addr":"172.21.15.31:6835","nonce":1520005016}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[]} 2024-09-17T05:31:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 31 2024-09-17T05:31:36.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.059+0000 7f6606400640 1 -- 172.21.15.31:0/1188284670 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f65dc0733e0 msgr2=0x7f65dc0758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:36.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.059+0000 7f6606400640 1 --2- 172.21.15.31:0/1188284670 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f65dc0733e0 0x7f65dc0758a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f65f00af000 tx=0x7f65f001b060 comp rx=0 tx=0).stop 2024-09-17T05:31:36.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.059+0000 7f6606400640 1 -- 172.21.15.31:0/1188284670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f660015bea0 msgr2=0x7f66000b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:36.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.059+0000 7f6606400640 1 --2- 172.21.15.31:0/1188284670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f660015bea0 0x7f66000b2b00 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f65f800c730 tx=0x7f65f800cbf0 comp rx=0 tx=0).stop 2024-09-17T05:31:36.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.059+0000 7f6606400640 1 -- 172.21.15.31:0/1188284670 shutdown_connections 2024-09-17T05:31:36.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.059+0000 7f6606400640 1 --2- 172.21.15.31:0/1188284670 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f65dc0733e0 0x7f65dc0758a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:36.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.059+0000 7f6606400640 1 --2- 172.21.15.31:0/1188284670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f660015bea0 0x7f66000b2b00 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:36.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.059+0000 7f6606400640 1 --2- 172.21.15.31:0/1188284670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66000d28e0 0x7f66000b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:36.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.059+0000 7f6606400640 1 --2- 172.21.15.31:0/1188284670 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66000cdb30 0x7f66000cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:36.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.059+0000 7f6606400640 1 -- 172.21.15.31:0/1188284670 >> 172.21.15.31:0/1188284670 conn(0x7f66000d1dc0 msgr2=0x7f66000b6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:36.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.059+0000 7f6606400640 1 -- 172.21.15.31:0/1188284670 shutdown_connections 2024-09-17T05:31:36.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.059+0000 7f6606400640 1 -- 172.21.15.31:0/1188284670 wait complete. 2024-09-17T05:31:36.086 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:31:36.086 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:31:36.087 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:31:36.087 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:31:36.087 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:31:36.087 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:31:36.087 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:31:36.087 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:31:36.087 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:31:36.088 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:31:36.088 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:31:36.088 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:31:36.088 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:31:36.088 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:31:36.088 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:31:36.088 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:31:36.099 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:31:36.099 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:31:36.100 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:31:36.100 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:31:36.105 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:31:36.105 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:31:36.106 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:31:36.106 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:31:36.145 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:31:36.146 DEBUG:teuthology.parallel:result is None 2024-09-17T05:31:36.147 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:31:36.147 DEBUG:teuthology.parallel:result is None 2024-09-17T05:31:36.153 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:31:36.153 DEBUG:teuthology.parallel:result is None 2024-09-17T05:31:36.155 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:31:36.155 DEBUG:teuthology.parallel:result is None 2024-09-17T05:31:36.155 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:31:36.233 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-17T05:31:36.235 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-17T05:31:36.246 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-17T05:31:36.246 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-17T05:31:36.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.303+0000 7fbd42c00640 1 -- 172.21.15.31:0/2378810838 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd3c06f9a0 msgr2=0x7fbd3c06fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:36.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.303+0000 7fbd42c00640 1 --2- 172.21.15.31:0/2378810838 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd3c06f9a0 0x7fbd3c06fe30 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c0d1b50 tx=0x7fbd3401cd50 comp rx=0 tx=0).stop 2024-09-17T05:31:36.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.303+0000 7fbd42c00640 1 -- 172.21.15.31:0/2378810838 shutdown_connections 2024-09-17T05:31:36.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.303+0000 7fbd42c00640 1 --2- 172.21.15.31:0/2378810838 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd3c06f9a0 0x7fbd3c06fe30 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:36.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.303+0000 7fbd42c00640 1 --2- 172.21.15.31:0/2378810838 >> v2:172.21.15.155:3300/0 conn(0x7fbd3c0cffc0 0x7fbd3c073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:36.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.303+0000 7fbd42c00640 1 -- 172.21.15.31:0/2378810838 >> 172.21.15.31:0/2378810838 conn(0x7fbd3c0d0c90 msgr2=0x7fbd3c0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:36.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.303+0000 7fbd42c00640 1 -- 172.21.15.31:0/2378810838 shutdown_connections 2024-09-17T05:31:36.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.303+0000 7fbd42c00640 1 -- 172.21.15.31:0/2378810838 wait complete. 2024-09-17T05:31:36.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.303+0000 7fbd42c00640 1 Processor -- start 2024-09-17T05:31:36.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.303+0000 7fbd42c00640 1 -- start start 2024-09-17T05:31:36.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd42c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd3c06f9a0 0x7fbd3c0af960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:36.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd42c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd3c0cffc0 0x7fbd3c0ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:36.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd42c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd3c15af60 0x7fbd3c0b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:36.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd42c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c167cc0 con 0x7fbd3c15af60 2024-09-17T05:31:36.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd42c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c167b40 con 0x7fbd3c0cffc0 2024-09-17T05:31:36.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd42c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbd3c167e40 con 0x7fbd3c06f9a0 2024-09-17T05:31:36.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd40c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd3c15af60 0x7fbd3c0b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:36.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd40c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd3c15af60 0x7fbd3c0b5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59630/0 (socket says 172.21.15.31:59630) 2024-09-17T05:31:36.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd40c00640 1 -- 172.21.15.31:0/2382745821 learned_addr learned my addr 172.21.15.31:0/2382745821 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:36.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd3b400640 1 --2- 172.21.15.31:0/2382745821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd3c0cffc0 0x7fbd3c0ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:36.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd3be00640 1 --2- 172.21.15.31:0/2382745821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd3c06f9a0 0x7fbd3c0af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:36.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd40c00640 1 -- 172.21.15.31:0/2382745821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd3c06f9a0 msgr2=0x7fbd3c0af960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:36.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd40c00640 1 --2- 172.21.15.31:0/2382745821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd3c06f9a0 0x7fbd3c0af960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:36.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd40c00640 1 -- 172.21.15.31:0/2382745821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd3c0cffc0 msgr2=0x7fbd3c0ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:36.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd40c00640 1 --2- 172.21.15.31:0/2382745821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd3c0cffc0 0x7fbd3c0ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:36.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd40c00640 1 -- 172.21.15.31:0/2382745821 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3c0afea0 con 0x7fbd3c15af60 2024-09-17T05:31:36.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd40c00640 1 --2- 172.21.15.31:0/2382745821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd3c15af60 0x7fbd3c0b5390 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbd34009bd0 tx=0x7fbd34003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:36.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd33e00640 1 -- 172.21.15.31:0/2382745821 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd340bb070 con 0x7fbd3c15af60 2024-09-17T05:31:36.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd33e00640 1 -- 172.21.15.31:0/2382745821 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd34004e00 con 0x7fbd3c15af60 2024-09-17T05:31:36.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd33e00640 1 -- 172.21.15.31:0/2382745821 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd340b2040 con 0x7fbd3c15af60 2024-09-17T05:31:36.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd42c00640 1 -- 172.21.15.31:0/2382745821 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3c0c9b60 con 0x7fbd3c15af60 2024-09-17T05:31:36.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd42c00640 1 -- 172.21.15.31:0/2382745821 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd3c154990 con 0x7fbd3c15af60 2024-09-17T05:31:36.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd42c00640 1 -- 172.21.15.31:0/2382745821 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd3c06fe30 con 0x7fbd3c15af60 2024-09-17T05:31:36.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.307+0000 7fbd33e00640 1 -- 172.21.15.31:0/2382745821 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7fbd340be070 con 0x7fbd3c15af60 2024-09-17T05:31:36.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.311+0000 7fbd33e00640 1 --2- 172.21.15.31:0/2382745821 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbd1c0733b0 0x7fbd1c075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:36.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.311+0000 7fbd33e00640 1 -- 172.21.15.31:0/2382745821 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7fbd3412dfe0 con 0x7fbd3c15af60 2024-09-17T05:31:36.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.311+0000 7fbd3be00640 1 --2- 172.21.15.31:0/2382745821 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbd1c0733b0 0x7fbd1c075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:36.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.311+0000 7fbd3be00640 1 --2- 172.21.15.31:0/2382745821 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbd1c0733b0 0x7fbd1c075870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c001650 tx=0x7fbd2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:36.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.315+0000 7fbd33e00640 1 -- 172.21.15.31:0/2382745821 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fbd34016970 con 0x7fbd3c15af60 2024-09-17T05:31:36.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.499+0000 7fbd42c00640 1 -- 172.21.15.31:0/2382745821 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fbd3c06ad30 con 0x7fbd3c15af60 2024-09-17T05:31:36.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.663+0000 7fbd33e00640 1 -- 172.21.15.31:0/2382745821 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) ==== 97+0+0 (secure 0 0 0) 0x7fbd340f8fa0 con 0x7fbd3c15af60 2024-09-17T05:31:36.671 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2024-09-17T05:31:36.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.667+0000 7fbd42c00640 1 -- 172.21.15.31:0/2382745821 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbd1c0733b0 msgr2=0x7fbd1c075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:36.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.667+0000 7fbd42c00640 1 --2- 172.21.15.31:0/2382745821 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbd1c0733b0 0x7fbd1c075870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c001650 tx=0x7fbd2c009040 comp rx=0 tx=0).stop 2024-09-17T05:31:36.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.667+0000 7fbd42c00640 1 -- 172.21.15.31:0/2382745821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd3c15af60 msgr2=0x7fbd3c0b5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:36.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.667+0000 7fbd42c00640 1 --2- 172.21.15.31:0/2382745821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd3c15af60 0x7fbd3c0b5390 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fbd34009bd0 tx=0x7fbd34003f60 comp rx=0 tx=0).stop 2024-09-17T05:31:36.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.667+0000 7fbd42c00640 1 -- 172.21.15.31:0/2382745821 shutdown_connections 2024-09-17T05:31:36.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.667+0000 7fbd42c00640 1 --2- 172.21.15.31:0/2382745821 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbd1c0733b0 0x7fbd1c075870 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:36.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.667+0000 7fbd42c00640 1 --2- 172.21.15.31:0/2382745821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd3c15af60 0x7fbd3c0b5390 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:36.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.667+0000 7fbd42c00640 1 --2- 172.21.15.31:0/2382745821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd3c0cffc0 0x7fbd3c0ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:36.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.667+0000 7fbd42c00640 1 --2- 172.21.15.31:0/2382745821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd3c06f9a0 0x7fbd3c0af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:36.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.667+0000 7fbd42c00640 1 -- 172.21.15.31:0/2382745821 >> 172.21.15.31:0/2382745821 conn(0x7fbd3c0d0c90 msgr2=0x7fbd3c0a1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:36.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.667+0000 7fbd42c00640 1 -- 172.21.15.31:0/2382745821 shutdown_connections 2024-09-17T05:31:36.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.667+0000 7fbd42c00640 1 -- 172.21.15.31:0/2382745821 wait complete. 2024-09-17T05:31:36.696 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:31:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.839+0000 7fcbe8400640 1 -- 172.21.15.31:0/3411380359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbe00cf4e0 msgr2=0x7fcbe00c5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.839+0000 7fcbe8400640 1 --2- 172.21.15.31:0/3411380359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbe00cf4e0 0x7fcbe00c5dd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00d0a60 tx=0x7fcbd801cc40 comp rx=0 tx=0).stop 2024-09-17T05:31:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.839+0000 7fcbe8400640 1 -- 172.21.15.31:0/3411380359 shutdown_connections 2024-09-17T05:31:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.839+0000 7fcbe8400640 1 --2- 172.21.15.31:0/3411380359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbe00cf4e0 0x7fcbe00c5dd0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.839+0000 7fcbe8400640 1 --2- 172.21.15.31:0/3411380359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbe015c130 0x7fcbe00ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.839+0000 7fcbe8400640 1 --2- 172.21.15.31:0/3411380359 >> v2:172.21.15.155:3300/0 conn(0x7fcbe015bd50 0x7fcbe00ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.839+0000 7fcbe8400640 1 -- 172.21.15.31:0/3411380359 >> 172.21.15.31:0/3411380359 conn(0x7fcbe00d1ea0 msgr2=0x7fcbe00d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.839+0000 7fcbe8400640 1 -- 172.21.15.31:0/3411380359 shutdown_connections 2024-09-17T05:31:36.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.839+0000 7fcbe8400640 1 -- 172.21.15.31:0/3411380359 wait complete. 2024-09-17T05:31:36.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.839+0000 7fcbe8400640 1 Processor -- start 2024-09-17T05:31:36.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.839+0000 7fcbe8400640 1 -- start start 2024-09-17T05:31:36.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe8400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbe00cf4e0 0x7fcbe0151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:36.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe8400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbe015bd50 0x7fcbe00c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:36.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe8400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbe015c130 0x7fcbe00b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:36.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe8400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe00cccd0 con 0x7fcbe015c130 2024-09-17T05:31:36.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe8400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe00ccb50 con 0x7fcbe015bd50 2024-09-17T05:31:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe8400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe00cce50 con 0x7fcbe00cf4e0 2024-09-17T05:31:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe6400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbe015c130 0x7fcbe00b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe6400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbe015c130 0x7fcbe00b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59658/0 (socket says 172.21.15.31:59658) 2024-09-17T05:31:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe6400640 1 -- 172.21.15.31:0/3727924019 learned_addr learned my addr 172.21.15.31:0/3727924019 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe5000640 1 --2- 172.21.15.31:0/3727924019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbe015bd50 0x7fcbe00c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe5a00640 1 --2- 172.21.15.31:0/3727924019 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbe00cf4e0 0x7fcbe0151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe6400640 1 -- 172.21.15.31:0/3727924019 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbe00cf4e0 msgr2=0x7fcbe0151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe6400640 1 --2- 172.21.15.31:0/3727924019 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbe00cf4e0 0x7fcbe0151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe6400640 1 -- 172.21.15.31:0/3727924019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbe015bd50 msgr2=0x7fcbe00c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe6400640 1 --2- 172.21.15.31:0/3727924019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbe015bd50 0x7fcbe00c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe6400640 1 -- 172.21.15.31:0/3727924019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe00c9980 con 0x7fcbe015c130 2024-09-17T05:31:36.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe6400640 1 --2- 172.21.15.31:0/3727924019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbe015c130 0x7fcbe00b3990 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcbd801b2f0 tx=0x7fcbd8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbdd600640 1 -- 172.21.15.31:0/3727924019 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd80bb070 con 0x7fcbe015c130 2024-09-17T05:31:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbdd600640 1 -- 172.21.15.31:0/3727924019 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbd8004b40 con 0x7fcbe015c130 2024-09-17T05:31:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbdd600640 1 -- 172.21.15.31:0/3727924019 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd80b2040 con 0x7fcbe015c130 2024-09-17T05:31:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe8400640 1 -- 172.21.15.31:0/3727924019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe01f85f0 con 0x7fcbe015c130 2024-09-17T05:31:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe8400640 1 -- 172.21.15.31:0/3727924019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe00c9640 con 0x7fcbe015c130 2024-09-17T05:31:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbe8400640 1 -- 172.21.15.31:0/3727924019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe00c5dd0 con 0x7fcbe015c130 2024-09-17T05:31:36.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.843+0000 7fcbdd600640 1 -- 172.21.15.31:0/3727924019 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7fcbd8004460 con 0x7fcbe015c130 2024-09-17T05:31:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.847+0000 7fcbdd600640 1 --2- 172.21.15.31:0/3727924019 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fcbc00733b0 0x7fcbc0075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.847+0000 7fcbdd600640 1 -- 172.21.15.31:0/3727924019 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7fcbd812e260 con 0x7fcbe015c130 2024-09-17T05:31:36.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.847+0000 7fcbe5a00640 1 --2- 172.21.15.31:0/3727924019 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fcbc00733b0 0x7fcbc0075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:36.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.847+0000 7fcbe5a00640 1 --2- 172.21.15.31:0/3727924019 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fcbc00733b0 0x7fcbc0075870 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009990 tx=0x7fcbd4009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:36.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:36.851+0000 7fcbdd600640 1 -- 172.21.15.31:0/3727924019 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fcbd8016950 con 0x7fcbe015c130 2024-09-17T05:31:37.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.087+0000 7fcbe8400640 1 -- 172.21.15.31:0/3727924019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fcbe0159a10 con 0x7fcbe015c130 2024-09-17T05:31:37.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.087+0000 7fcbdd600640 1 -- 172.21.15.31:0/3727924019 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7fcbd80f8d20 con 0x7fcbe015c130 2024-09-17T05:31:37.094 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:37.094 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:31:37.094 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2024-09-17T05:31:37.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.094 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2024-09-17T05:31:37.094 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmoloQARAAbTcR/1F1qz7Crjdu1NPSgw==", 2024-09-17T05:31:37.094 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.094 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:31:37.094 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:31:37.095 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:31:37.095 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:31:37.095 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:31:37.095 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.095 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2024-09-17T05:31:37.095 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmYrdRDRAAkaDz03U3lMZlkLEVFYlTaw==", 2024-09-17T05:31:37.095 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.095 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:31:37.095 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:31:37.095 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:31:37.095 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:31:37.095 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:31:37.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.096 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2024-09-17T05:31:37.096 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmpFRCCBAAZRsuAVwSxuMGDeoYCwWFeg==", 2024-09-17T05:31:37.096 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.096 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:31:37.096 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:31:37.096 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:31:37.096 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:31:37.096 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:31:37.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.096 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2024-09-17T05:31:37.097 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lm23PSFBAAuO+k0kWY28PN7+pEtlUniQ==", 2024-09-17T05:31:37.097 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.097 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:31:37.097 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:31:37.097 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:31:37.097 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:31:37.097 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.097 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:31:37.097 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.097 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2024-09-17T05:31:37.097 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBTE+lm0miKHxAA2C1pfwBxJtKQhu4xuPumxg==", 2024-09-17T05:31:37.097 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.097 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:31:37.098 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:31:37.098 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:31:37.098 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:31:37.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.098 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2024-09-17T05:31:37.098 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBWE+lmdQi7NRAA2v4ETg4jynbPF0K4E73KAA==", 2024-09-17T05:31:37.098 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.098 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:31:37.098 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:31:37.098 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:31:37.098 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:31:37.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.099 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2024-09-17T05:31:37.099 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBaE+lm18eUEBAA8gAhUx9UNa2Lk4uyFBd7Nw==", 2024-09-17T05:31:37.099 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.099 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:31:37.099 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:31:37.099 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:31:37.099 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:31:37.099 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.099 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2024-09-17T05:31:37.099 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBdE+lm00moJBAAizrxOP4rI4fGR91dYzlEkw==", 2024-09-17T05:31:37.099 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.099 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:31:37.099 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:31:37.100 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:31:37.100 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:31:37.100 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.100 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2024-09-17T05:31:37.100 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBjE+lmhdtUJhAA7+KM8DwQriFwMbpqXAPTuA==", 2024-09-17T05:31:37.100 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.100 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:31:37.100 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:31:37.100 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:31:37.100 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:31:37.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.101 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2024-09-17T05:31:37.101 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBmE+lm5cByOhAAiMnQIv2O41am/3E+0dp4sg==", 2024-09-17T05:31:37.101 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.101 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:31:37.101 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:31:37.101 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:31:37.101 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:31:37.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.101 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2024-09-17T05:31:37.101 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBqE+lm19FhExAAo/Sfj2SX5+Y2/Fxz8mbiNQ==", 2024-09-17T05:31:37.102 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.102 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:31:37.102 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:31:37.102 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:31:37.102 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:31:37.102 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.102 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2024-09-17T05:31:37.102 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBtE+lmISDbKBAAapUBS+t+N1vUcCbdJic8Dw==", 2024-09-17T05:31:37.103 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.103 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:31:37.103 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:31:37.103 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:31:37.103 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:31:37.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.103 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2024-09-17T05:31:37.103 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw==", 2024-09-17T05:31:37.103 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.103 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:31:37.104 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2024-09-17T05:31:37.104 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:31:37.104 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:31:37.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.104 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2024-09-17T05:31:37.104 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmb2pmIhAA7p+G+WnB7ujZZdSlaossYg==", 2024-09-17T05:31:37.104 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.104 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:31:37.104 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:31:37.104 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:31:37.104 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:31:37.105 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:31:37.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.105 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2024-09-17T05:31:37.105 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmAPPaHhAAyz/gKunaNFyrdkAUy50qmQ==", 2024-09-17T05:31:37.105 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.105 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:31:37.105 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:31:37.105 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:31:37.105 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:31:37.105 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:31:37.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.106 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2024-09-17T05:31:37.106 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lml72BKBAAgAji5TWedU7azT5oQz3fYg==", 2024-09-17T05:31:37.106 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.106 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:31:37.106 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:31:37.106 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:31:37.106 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:31:37.106 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:31:37.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.106 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2024-09-17T05:31:37.106 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmtgltIRAAeTv/U/vZ9ZIuGN4JXTHD0A==", 2024-09-17T05:31:37.107 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.107 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:31:37.107 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:31:37.107 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:31:37.107 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:31:37.107 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:31:37.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.107 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2024-09-17T05:31:37.107 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmTt2oOBAAmR5ykU4WbEzlKFiwI7sMdg==", 2024-09-17T05:31:37.107 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.107 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:31:37.108 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:31:37.108 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:31:37.108 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:31:37.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.108 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2024-09-17T05:31:37.108 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmKILYNBAAojM8RIq92dO2DQyXppReIw==", 2024-09-17T05:31:37.108 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:37.108 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:31:37.108 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:31:37.108 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:31:37.108 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.108 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.109 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:31:37.109 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:31:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.091+0000 7fcbe8400640 1 -- 172.21.15.31:0/3727924019 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fcbc00733b0 msgr2=0x7fcbc0075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.091+0000 7fcbe8400640 1 --2- 172.21.15.31:0/3727924019 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fcbc00733b0 0x7fcbc0075870 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009990 tx=0x7fcbd4009110 comp rx=0 tx=0).stop 2024-09-17T05:31:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.091+0000 7fcbe8400640 1 -- 172.21.15.31:0/3727924019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbe015c130 msgr2=0x7fcbe00b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.091+0000 7fcbe8400640 1 --2- 172.21.15.31:0/3727924019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbe015c130 0x7fcbe00b3990 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcbd801b2f0 tx=0x7fcbd8004270 comp rx=0 tx=0).stop 2024-09-17T05:31:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.091+0000 7fcbe8400640 1 -- 172.21.15.31:0/3727924019 shutdown_connections 2024-09-17T05:31:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.091+0000 7fcbe8400640 1 --2- 172.21.15.31:0/3727924019 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fcbc00733b0 0x7fcbc0075870 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.091+0000 7fcbe8400640 1 --2- 172.21.15.31:0/3727924019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbe015c130 0x7fcbe00b3990 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.091+0000 7fcbe8400640 1 --2- 172.21.15.31:0/3727924019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbe015bd50 0x7fcbe00c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.091+0000 7fcbe8400640 1 --2- 172.21.15.31:0/3727924019 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbe00cf4e0 0x7fcbe0151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.091+0000 7fcbe8400640 1 -- 172.21.15.31:0/3727924019 >> 172.21.15.31:0/3727924019 conn(0x7fcbe00d1ea0 msgr2=0x7fcbe00d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.091+0000 7fcbe8400640 1 -- 172.21.15.31:0/3727924019 shutdown_connections 2024-09-17T05:31:37.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.091+0000 7fcbe8400640 1 -- 172.21.15.31:0/3727924019 wait complete. 2024-09-17T05:31:37.115 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:31:37.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd989e00640 1 -- 172.21.15.31:0/3385510660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd968003c20 msgr2=0x7fd968004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:37.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd989e00640 1 --2- 172.21.15.31:0/3385510660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd968003c20 0x7fd968004020 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd974009b90 tx=0x7fd97401d270 comp rx=0 tx=0).stop 2024-09-17T05:31:37.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd983400640 1 -- 172.21.15.31:0/3385510660 reap_dead start 2024-09-17T05:31:37.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd989e00640 1 -- 172.21.15.31:0/3385510660 shutdown_connections 2024-09-17T05:31:37.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd989e00640 1 -- 172.21.15.31:0/3385510660 >> 172.21.15.31:0/3385510660 conn(0x7fd9840b18f0 msgr2=0x7fd9840b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:37.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd989e00640 1 -- 172.21.15.31:0/3385510660 shutdown_connections 2024-09-17T05:31:37.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd989e00640 1 -- 172.21.15.31:0/3385510660 wait complete. 2024-09-17T05:31:37.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd989e00640 1 Processor -- start 2024-09-17T05:31:37.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd989e00640 1 -- start start 2024-09-17T05:31:37.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd989e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd968003c20 0x7fd984150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:37.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd989e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd984157160 0x7fd9841575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:37.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd989e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9840ad280 0x7fd9840ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:37.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd989e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd984167210 con 0x7fd984157160 2024-09-17T05:31:37.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd989e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd984167090 con 0x7fd968003c20 2024-09-17T05:31:37.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd989e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd984167390 con 0x7fd9840ad280 2024-09-17T05:31:37.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd97be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd984157160 0x7fd9841575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:37.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd97be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd984157160 0x7fd9841575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59666/0 (socket says 172.21.15.31:59666) 2024-09-17T05:31:37.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd97be00640 1 -- 172.21.15.31:0/2219153583 learned_addr learned my addr 172.21.15.31:0/2219153583 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:37.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd982a00640 1 --2- 172.21.15.31:0/2219153583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd968003c20 0x7fd984150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:37.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.259+0000 7fd983400640 1 --2- 172.21.15.31:0/2219153583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9840ad280 0x7fd9840ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:37.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.263+0000 7fd97be00640 1 -- 172.21.15.31:0/2219153583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9840ad280 msgr2=0x7fd9840ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:37.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.263+0000 7fd97be00640 1 --2- 172.21.15.31:0/2219153583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9840ad280 0x7fd9840ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:37.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.263+0000 7fd97be00640 1 -- 172.21.15.31:0/2219153583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd968003c20 msgr2=0x7fd984150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:37.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.263+0000 7fd97be00640 1 --2- 172.21.15.31:0/2219153583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd968003c20 0x7fd984150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:37.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.263+0000 7fd97be00640 1 -- 172.21.15.31:0/2219153583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9841560c0 con 0x7fd984157160 2024-09-17T05:31:37.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.263+0000 7fd97be00640 1 --2- 172.21.15.31:0/2219153583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd984157160 0x7fd9841575e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd96c003f20 tx=0x7fd96c0018d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:37.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.263+0000 7fd97b400640 1 -- 172.21.15.31:0/2219153583 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c015070 con 0x7fd984157160 2024-09-17T05:31:37.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.263+0000 7fd97b400640 1 -- 172.21.15.31:0/2219153583 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd96c011920 con 0x7fd984157160 2024-09-17T05:31:37.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.263+0000 7fd97b400640 1 -- 172.21.15.31:0/2219153583 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c011d70 con 0x7fd984157160 2024-09-17T05:31:37.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.263+0000 7fd989e00640 1 -- 172.21.15.31:0/2219153583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9841563a0 con 0x7fd984157160 2024-09-17T05:31:37.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.263+0000 7fd989e00640 1 -- 172.21.15.31:0/2219153583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd984156960 con 0x7fd984157160 2024-09-17T05:31:37.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.263+0000 7fd989e00640 1 -- 172.21.15.31:0/2219153583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd984069410 con 0x7fd984157160 2024-09-17T05:31:37.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.263+0000 7fd97b400640 1 -- 172.21.15.31:0/2219153583 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7fd96c0103c0 con 0x7fd984157160 2024-09-17T05:31:37.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.263+0000 7fd97b400640 1 --2- 172.21.15.31:0/2219153583 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd9600733b0 0x7fd960075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:37.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.267+0000 7fd97b400640 1 -- 172.21.15.31:0/2219153583 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7fd96c094eb0 con 0x7fd984157160 2024-09-17T05:31:37.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.267+0000 7fd982a00640 1 --2- 172.21.15.31:0/2219153583 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd9600733b0 0x7fd960075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:37.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.267+0000 7fd982a00640 1 --2- 172.21.15.31:0/2219153583 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd9600733b0 0x7fd960075870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd9740ae000 tx=0x7fd97401a010 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:37.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.267+0000 7fd97b400640 1 -- 172.21.15.31:0/2219153583 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd96c05f8c0 con 0x7fd984157160 2024-09-17T05:31:37.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.447+0000 7fd989e00640 1 -- 172.21.15.31:0/2219153583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd9840cca10 con 0x7fd984157160 2024-09-17T05:31:37.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.447+0000 7fd97b400640 1 -- 172.21.15.31:0/2219153583 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) ==== 84+0+65 (secure 0 0 0) 0x7fd96c0642f0 con 0x7fd984157160 2024-09-17T05:31:37.455 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:37.455 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:31:37.455 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:37.455 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-09-17T05:31:37.455 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-09-17T05:31:37.455 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:37.455 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:31:37.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.451+0000 7fd989e00640 1 -- 172.21.15.31:0/2219153583 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd9600733b0 msgr2=0x7fd960075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:37.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.451+0000 7fd989e00640 1 --2- 172.21.15.31:0/2219153583 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd9600733b0 0x7fd960075870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd9740ae000 tx=0x7fd97401a010 comp rx=0 tx=0).stop 2024-09-17T05:31:37.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.451+0000 7fd989e00640 1 -- 172.21.15.31:0/2219153583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd984157160 msgr2=0x7fd9841575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:37.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.451+0000 7fd989e00640 1 --2- 172.21.15.31:0/2219153583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd984157160 0x7fd9841575e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd96c003f20 tx=0x7fd96c0018d0 comp rx=0 tx=0).stop 2024-09-17T05:31:37.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.451+0000 7fd989e00640 1 -- 172.21.15.31:0/2219153583 shutdown_connections 2024-09-17T05:31:37.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.451+0000 7fd989e00640 1 --2- 172.21.15.31:0/2219153583 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd9600733b0 0x7fd960075870 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:37.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.451+0000 7fd989e00640 1 --2- 172.21.15.31:0/2219153583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9840ad280 0x7fd9840ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:37.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.451+0000 7fd989e00640 1 --2- 172.21.15.31:0/2219153583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd984157160 0x7fd9841575e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:37.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.451+0000 7fd989e00640 1 --2- 172.21.15.31:0/2219153583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd968003c20 0x7fd984150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:37.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.451+0000 7fd989e00640 1 -- 172.21.15.31:0/2219153583 >> 172.21.15.31:0/2219153583 conn(0x7fd9840b18f0 msgr2=0x7fd984153a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:37.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.451+0000 7fd989e00640 1 -- 172.21.15.31:0/2219153583 shutdown_connections 2024-09-17T05:31:37.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.451+0000 7fd989e00640 1 -- 172.21.15.31:0/2219153583 wait complete. 2024-09-17T05:31:37.475 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:31:37.475 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:31:37.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c52c00640 1 -- 172.21.15.31:0/1564566381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c4c15bf60 msgr2=0x7f2c4c0733a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:37.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c52c00640 1 --2- 172.21.15.31:0/1564566381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c4c15bf60 0x7f2c4c0733a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c009840 tx=0x7f2c3c01c790 comp rx=0 tx=0).stop 2024-09-17T05:31:37.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c52c00640 1 -- 172.21.15.31:0/1564566381 shutdown_connections 2024-09-17T05:31:37.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c52c00640 1 --2- 172.21.15.31:0/1564566381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c4c15bf60 0x7f2c4c0733a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:37.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c52c00640 1 -- 172.21.15.31:0/1564566381 >> 172.21.15.31:0/1564566381 conn(0x7f2c4c0cfbc0 msgr2=0x7f2c4c0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:37.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c52c00640 1 -- 172.21.15.31:0/1564566381 shutdown_connections 2024-09-17T05:31:37.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c52c00640 1 -- 172.21.15.31:0/1564566381 wait complete. 2024-09-17T05:31:37.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c52c00640 1 Processor -- start 2024-09-17T05:31:37.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c52c00640 1 -- start start 2024-09-17T05:31:37.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c52c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c4c0b5170 0x7f2c4c157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:37.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c52c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c4c0cdac0 0x7f2c4c15d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:37.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c52c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c4c15bf60 0x7f2c4c15e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:37.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c52c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c0ce260 con 0x7f2c4c0cdac0 2024-09-17T05:31:37.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c52c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c0ce0e0 con 0x7f2c4c0b5170 2024-09-17T05:31:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c52c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4c16a2f0 con 0x7f2c4c15bf60 2024-09-17T05:31:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c43e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c4c0cdac0 0x7f2c4c15d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c43e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c4c0cdac0 0x7f2c4c15d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59672/0 (socket says 172.21.15.31:59672) 2024-09-17T05:31:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c43e00640 1 -- 172.21.15.31:0/1808488855 learned_addr learned my addr 172.21.15.31:0/1808488855 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c4be00640 1 --2- 172.21.15.31:0/1808488855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c4c0b5170 0x7f2c4c157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c50c00640 1 --2- 172.21.15.31:0/1808488855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c4c15bf60 0x7f2c4c15e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c43e00640 1 -- 172.21.15.31:0/1808488855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c4c15bf60 msgr2=0x7f2c4c15e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c43e00640 1 --2- 172.21.15.31:0/1808488855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c4c15bf60 0x7f2c4c15e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c43e00640 1 -- 172.21.15.31:0/1808488855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c4c0b5170 msgr2=0x7f2c4c157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c43e00640 1 --2- 172.21.15.31:0/1808488855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c4c0b5170 0x7f2c4c157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:37.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c43e00640 1 -- 172.21.15.31:0/1808488855 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4c15c500 con 0x7f2c4c0cdac0 2024-09-17T05:31:37.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.623+0000 7f2c50c00640 1 --2- 172.21.15.31:0/1808488855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c4c15bf60 0x7f2c4c15e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:31:37.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.627+0000 7f2c43e00640 1 --2- 172.21.15.31:0/1808488855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c4c0cdac0 0x7f2c4c15d2c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400c490 tx=0x7f2c3400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:37.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.627+0000 7f2c48c00640 1 -- 172.21.15.31:0/1808488855 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c340052d0 con 0x7f2c4c0cdac0 2024-09-17T05:31:37.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.627+0000 7f2c48c00640 1 -- 172.21.15.31:0/1808488855 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c34005490 con 0x7f2c4c0cdac0 2024-09-17T05:31:37.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.627+0000 7f2c52c00640 1 -- 172.21.15.31:0/1808488855 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4c15c7e0 con 0x7f2c4c0cdac0 2024-09-17T05:31:37.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.627+0000 7f2c48c00640 1 -- 172.21.15.31:0/1808488855 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c34012870 con 0x7f2c4c0cdac0 2024-09-17T05:31:37.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.627+0000 7f2c52c00640 1 -- 172.21.15.31:0/1808488855 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c4c15efa0 con 0x7f2c4c0cdac0 2024-09-17T05:31:37.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.627+0000 7f2c52c00640 1 -- 172.21.15.31:0/1808488855 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c4c069410 con 0x7f2c4c0cdac0 2024-09-17T05:31:37.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.627+0000 7f2c48c00640 1 -- 172.21.15.31:0/1808488855 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f2c34012a10 con 0x7f2c4c0cdac0 2024-09-17T05:31:37.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.627+0000 7f2c48c00640 1 --2- 172.21.15.31:0/1808488855 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2c280733e0 0x7f2c280758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:37.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.631+0000 7f2c48c00640 1 -- 172.21.15.31:0/1808488855 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7f2c34093e50 con 0x7f2c4c0cdac0 2024-09-17T05:31:37.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.631+0000 7f2c4be00640 1 --2- 172.21.15.31:0/1808488855 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2c280733e0 0x7f2c280758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:37.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.631+0000 7f2c4be00640 1 --2- 172.21.15.31:0/1808488855 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2c280733e0 0x7f2c280758a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0af000 tx=0x7f2c3c01afd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:37.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.635+0000 7f2c48c00640 1 -- 172.21.15.31:0/1808488855 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2c3405eeb0 con 0x7f2c4c0cdac0 2024-09-17T05:31:37.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:37.815+0000 7f2c52c00640 1 -- 172.21.15.31:0/1808488855 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2c4c0733a0 con 0x7f2c4c0cdac0 2024-09-17T05:31:38.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.687+0000 7f2c48c00640 1 -- 172.21.15.31:0/1808488855 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v54) ==== 138+0+0 (secure 0 0 0) 0x7f2c3405e7b0 con 0x7f2c4c0cdac0 2024-09-17T05:31:38.693 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-09-17T05:31:38.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.691+0000 7f2c52c00640 1 -- 172.21.15.31:0/1808488855 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2c280733e0 msgr2=0x7f2c280758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:38.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.691+0000 7f2c52c00640 1 --2- 172.21.15.31:0/1808488855 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2c280733e0 0x7f2c280758a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0af000 tx=0x7f2c3c01afd0 comp rx=0 tx=0).stop 2024-09-17T05:31:38.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.691+0000 7f2c52c00640 1 -- 172.21.15.31:0/1808488855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c4c0cdac0 msgr2=0x7f2c4c15d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:38.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.691+0000 7f2c52c00640 1 --2- 172.21.15.31:0/1808488855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c4c0cdac0 0x7f2c4c15d2c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2c3400c490 tx=0x7f2c3400c950 comp rx=0 tx=0).stop 2024-09-17T05:31:38.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.691+0000 7f2c52c00640 1 -- 172.21.15.31:0/1808488855 shutdown_connections 2024-09-17T05:31:38.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.691+0000 7f2c52c00640 1 --2- 172.21.15.31:0/1808488855 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2c280733e0 0x7f2c280758a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:38.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.691+0000 7f2c52c00640 1 --2- 172.21.15.31:0/1808488855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2c4c15bf60 0x7f2c4c15e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:38.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.691+0000 7f2c52c00640 1 --2- 172.21.15.31:0/1808488855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c4c0cdac0 0x7f2c4c15d2c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:38.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.691+0000 7f2c52c00640 1 --2- 172.21.15.31:0/1808488855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c4c0b5170 0x7f2c4c157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:38.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.691+0000 7f2c52c00640 1 -- 172.21.15.31:0/1808488855 >> 172.21.15.31:0/1808488855 conn(0x7f2c4c0cfbc0 msgr2=0x7f2c4c072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:38.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.691+0000 7f2c52c00640 1 -- 172.21.15.31:0/1808488855 shutdown_connections 2024-09-17T05:31:38.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.691+0000 7f2c52c00640 1 -- 172.21.15.31:0/1808488855 wait complete. 2024-09-17T05:31:38.725 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:31:38.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.879+0000 7f1c57800640 1 -- 172.21.15.31:0/1395806924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c5015be10 msgr2=0x7f1c501602f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:38.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.879+0000 7f1c57800640 1 --2- 172.21.15.31:0/1395806924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c5015be10 0x7f1c501602f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1c44009900 tx=0x7f1c4401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:31:38.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.879+0000 7f1c57800640 1 -- 172.21.15.31:0/1395806924 shutdown_connections 2024-09-17T05:31:38.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.879+0000 7f1c57800640 1 --2- 172.21.15.31:0/1395806924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c5006cc20 0x7f1c5006d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:38.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.879+0000 7f1c57800640 1 --2- 172.21.15.31:0/1395806924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c5015be10 0x7f1c501602f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:38.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.879+0000 7f1c57800640 1 -- 172.21.15.31:0/1395806924 >> 172.21.15.31:0/1395806924 conn(0x7f1c500cd740 msgr2=0x7f1c500cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:38.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.879+0000 7f1c57800640 1 -- 172.21.15.31:0/1395806924 shutdown_connections 2024-09-17T05:31:38.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.879+0000 7f1c57800640 1 -- 172.21.15.31:0/1395806924 wait complete. 2024-09-17T05:31:38.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.879+0000 7f1c57800640 1 Processor -- start 2024-09-17T05:31:38.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.879+0000 7f1c57800640 1 -- start start 2024-09-17T05:31:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c57800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c5006cc20 0x7f1c501f8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c57800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c500cbeb0 0x7f1c5014b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c57800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c5015be10 0x7f1c5014bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c57800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1c50168f40 con 0x7f1c500cbeb0 2024-09-17T05:31:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c57800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1c50168dc0 con 0x7f1c5015be10 2024-09-17T05:31:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c57800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1c501690c0 con 0x7f1c5006cc20 2024-09-17T05:31:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c4fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c500cbeb0 0x7f1c5014b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c4fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c500cbeb0 0x7f1c5014b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54518/0 (socket says 172.21.15.31:54518) 2024-09-17T05:31:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c4fe00640 1 -- 172.21.15.31:0/2190149030 learned_addr learned my addr 172.21.15.31:0/2190149030 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c54e00640 1 --2- 172.21.15.31:0/2190149030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c5006cc20 0x7f1c501f8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:38.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c55800640 1 --2- 172.21.15.31:0/2190149030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c5015be10 0x7f1c5014bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:38.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c4fe00640 1 -- 172.21.15.31:0/2190149030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c5006cc20 msgr2=0x7f1c501f8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:38.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c4fe00640 1 --2- 172.21.15.31:0/2190149030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c5006cc20 0x7f1c501f8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:38.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c4fe00640 1 -- 172.21.15.31:0/2190149030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c5015be10 msgr2=0x7f1c5014bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:38.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c4fe00640 1 --2- 172.21.15.31:0/2190149030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c5015be10 0x7f1c5014bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:38.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c4fe00640 1 -- 172.21.15.31:0/2190149030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c500ca6a0 con 0x7f1c500cbeb0 2024-09-17T05:31:38.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c4fe00640 1 --2- 172.21.15.31:0/2190149030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c500cbeb0 0x7f1c5014b570 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00c500 tx=0x7f1c3c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:38.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c4cc00640 1 -- 172.21.15.31:0/2190149030 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c017070 con 0x7f1c500cbeb0 2024-09-17T05:31:38.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c4cc00640 1 -- 172.21.15.31:0/2190149030 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c3c0053c0 con 0x7f1c500cbeb0 2024-09-17T05:31:38.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c4cc00640 1 -- 172.21.15.31:0/2190149030 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c012890 con 0x7f1c500cbeb0 2024-09-17T05:31:38.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c57800640 1 -- 172.21.15.31:0/2190149030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c500ca980 con 0x7f1c500cbeb0 2024-09-17T05:31:38.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c57800640 1 -- 172.21.15.31:0/2190149030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c501f7a70 con 0x7f1c500cbeb0 2024-09-17T05:31:38.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.883+0000 7f1c57800640 1 -- 172.21.15.31:0/2190149030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c5006d0b0 con 0x7f1c500cbeb0 2024-09-17T05:31:38.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.887+0000 7f1c4cc00640 1 -- 172.21.15.31:0/2190149030 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f1c3c01a070 con 0x7f1c500cbeb0 2024-09-17T05:31:38.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.887+0000 7f1c4cc00640 1 --2- 172.21.15.31:0/2190149030 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1c300733e0 0x7f1c300758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:38.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.887+0000 7f1c4cc00640 1 -- 172.21.15.31:0/2190149030 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5227+0+0 (secure 0 0 0) 0x7f1c3c0938a0 con 0x7f1c500cbeb0 2024-09-17T05:31:38.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.887+0000 7f1c54e00640 1 --2- 172.21.15.31:0/2190149030 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1c300733e0 0x7f1c300758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:38.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.887+0000 7f1c54e00640 1 --2- 172.21.15.31:0/2190149030 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1c300733e0 0x7f1c300758a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1c440af000 tx=0x7f1c4401b120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:38.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:38.891+0000 7f1c4cc00640 1 -- 172.21.15.31:0/2190149030 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f1c3c021080 con 0x7f1c500cbeb0 2024-09-17T05:31:39.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.071+0000 7f1c57800640 1 -- 172.21.15.31:0/2190149030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1c50073a40 con 0x7f1c500cbeb0 2024-09-17T05:31:39.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.695+0000 7f1c4cc00640 1 -- 172.21.15.31:0/2190149030 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v55) ==== 170+0+0 (secure 0 0 0) 0x7f1c3c05e1f0 con 0x7f1c500cbeb0 2024-09-17T05:31:39.700 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-09-17T05:31:39.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.695+0000 7f1c57800640 1 -- 172.21.15.31:0/2190149030 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1c300733e0 msgr2=0x7f1c300758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:39.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.695+0000 7f1c57800640 1 --2- 172.21.15.31:0/2190149030 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1c300733e0 0x7f1c300758a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1c440af000 tx=0x7f1c4401b120 comp rx=0 tx=0).stop 2024-09-17T05:31:39.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.695+0000 7f1c57800640 1 -- 172.21.15.31:0/2190149030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c500cbeb0 msgr2=0x7f1c5014b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:39.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.695+0000 7f1c57800640 1 --2- 172.21.15.31:0/2190149030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c500cbeb0 0x7f1c5014b570 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00c500 tx=0x7f1c3c00c9c0 comp rx=0 tx=0).stop 2024-09-17T05:31:39.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.695+0000 7f1c57800640 1 -- 172.21.15.31:0/2190149030 shutdown_connections 2024-09-17T05:31:39.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.695+0000 7f1c57800640 1 --2- 172.21.15.31:0/2190149030 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1c300733e0 0x7f1c300758a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:39.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.695+0000 7f1c57800640 1 --2- 172.21.15.31:0/2190149030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c5015be10 0x7f1c5014bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:39.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.695+0000 7f1c57800640 1 --2- 172.21.15.31:0/2190149030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c500cbeb0 0x7f1c5014b570 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:39.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.695+0000 7f1c57800640 1 --2- 172.21.15.31:0/2190149030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c5006cc20 0x7f1c501f8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:39.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.695+0000 7f1c57800640 1 -- 172.21.15.31:0/2190149030 >> 172.21.15.31:0/2190149030 conn(0x7f1c500cd740 msgr2=0x7f1c50073c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:39.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.695+0000 7f1c57800640 1 -- 172.21.15.31:0/2190149030 shutdown_connections 2024-09-17T05:31:39.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.695+0000 7f1c57800640 1 -- 172.21.15.31:0/2190149030 wait complete. 2024-09-17T05:31:39.742 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:31:39.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.887+0000 7fa337200640 1 -- 172.21.15.31:0/2646766561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3300739f0 msgr2=0x7fa3300cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:39.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.887+0000 7fa337200640 1 --2- 172.21.15.31:0/2646766561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3300739f0 0x7fa3300cf560 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa3300b6a60 tx=0x7fa32401c7a0 comp rx=0 tx=0).stop 2024-09-17T05:31:39.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.887+0000 7fa337200640 1 -- 172.21.15.31:0/2646766561 shutdown_connections 2024-09-17T05:31:39.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.887+0000 7fa337200640 1 --2- 172.21.15.31:0/2646766561 >> v2:172.21.15.155:3300/0 conn(0x7fa3300d1650 0x7fa3300d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:39.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.887+0000 7fa337200640 1 --2- 172.21.15.31:0/2646766561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3300739f0 0x7fa3300cf560 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:39.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.887+0000 7fa337200640 1 -- 172.21.15.31:0/2646766561 >> 172.21.15.31:0/2646766561 conn(0x7fa3300d0b30 msgr2=0x7fa3300d0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:39.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.887+0000 7fa337200640 1 -- 172.21.15.31:0/2646766561 shutdown_connections 2024-09-17T05:31:39.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.887+0000 7fa337200640 1 -- 172.21.15.31:0/2646766561 wait complete. 2024-09-17T05:31:39.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.887+0000 7fa337200640 1 Processor -- start 2024-09-17T05:31:39.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.887+0000 7fa337200640 1 -- start start 2024-09-17T05:31:39.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.887+0000 7fa337200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3300739f0 0x7fa330154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:39.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.887+0000 7fa337200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3300cbb90 0x7fa3300c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:39.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.887+0000 7fa337200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3300d1650 0x7fa3300711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:39.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.887+0000 7fa337200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa330168330 con 0x7fa3300cbb90 2024-09-17T05:31:39.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.887+0000 7fa337200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa3301681b0 con 0x7fa3300739f0 2024-09-17T05:31:39.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.887+0000 7fa337200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa3301684b0 con 0x7fa3300d1650 2024-09-17T05:31:39.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.887+0000 7fa335400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3300cbb90 0x7fa3300c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:39.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.891+0000 7fa335400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3300cbb90 0x7fa3300c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54524/0 (socket says 172.21.15.31:54524) 2024-09-17T05:31:39.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.891+0000 7fa335400640 1 -- 172.21.15.31:0/1166925110 learned_addr learned my addr 172.21.15.31:0/1166925110 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:39.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.891+0000 7fa335e00640 1 --2- 172.21.15.31:0/1166925110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3300739f0 0x7fa330154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:39.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.891+0000 7fa336800640 1 --2- 172.21.15.31:0/1166925110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3300d1650 0x7fa3300711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:39.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.891+0000 7fa335400640 1 -- 172.21.15.31:0/1166925110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3300d1650 msgr2=0x7fa3300711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:39.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.891+0000 7fa335400640 1 --2- 172.21.15.31:0/1166925110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3300d1650 0x7fa3300711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:39.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.891+0000 7fa335400640 1 -- 172.21.15.31:0/1166925110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3300739f0 msgr2=0x7fa330154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:39.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.891+0000 7fa335400640 1 --2- 172.21.15.31:0/1166925110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3300739f0 0x7fa330154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:39.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.891+0000 7fa335400640 1 -- 172.21.15.31:0/1166925110 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa330154a70 con 0x7fa3300cbb90 2024-09-17T05:31:39.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.891+0000 7fa335400640 1 --2- 172.21.15.31:0/1166925110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3300cbb90 0x7fa3300c9c50 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa32000c500 tx=0x7fa32000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:39.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.891+0000 7fa32a000640 1 -- 172.21.15.31:0/1166925110 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320017070 con 0x7fa3300cbb90 2024-09-17T05:31:39.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.891+0000 7fa32a000640 1 -- 172.21.15.31:0/1166925110 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa320003600 con 0x7fa3300cbb90 2024-09-17T05:31:39.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.891+0000 7fa32a000640 1 -- 172.21.15.31:0/1166925110 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320003a90 con 0x7fa3300cbb90 2024-09-17T05:31:39.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.891+0000 7fa337200640 1 -- 172.21.15.31:0/1166925110 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3301560e0 con 0x7fa3300cbb90 2024-09-17T05:31:39.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.891+0000 7fa337200640 1 -- 172.21.15.31:0/1166925110 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3301566a0 con 0x7fa3300cbb90 2024-09-17T05:31:39.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.891+0000 7fa337200640 1 -- 172.21.15.31:0/1166925110 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa33015e6e0 con 0x7fa3300cbb90 2024-09-17T05:31:39.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.891+0000 7fa32a000640 1 -- 172.21.15.31:0/1166925110 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7fa32001a070 con 0x7fa3300cbb90 2024-09-17T05:31:39.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.895+0000 7fa32a000640 1 --2- 172.21.15.31:0/1166925110 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa3140733b0 0x7fa314075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:39.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.895+0000 7fa32a000640 1 -- 172.21.15.31:0/1166925110 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5609+0+0 (secure 0 0 0) 0x7fa320093a90 con 0x7fa3300cbb90 2024-09-17T05:31:39.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.895+0000 7fa335e00640 1 --2- 172.21.15.31:0/1166925110 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa3140733b0 0x7fa314075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:39.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.895+0000 7fa335e00640 1 --2- 172.21.15.31:0/1166925110 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa3140733b0 0x7fa314075870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa3240af000 tx=0x7fa3240b2040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:39.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:39.899+0000 7fa32a000640 1 -- 172.21.15.31:0/1166925110 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa32005e8c0 con 0x7fa3300cbb90 2024-09-17T05:31:40.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.111+0000 7fa337200640 1 -- 172.21.15.31:0/1166925110 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa3300b6ab0 con 0x7fa3300cbb90 2024-09-17T05:31:40.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.695+0000 7fa32a000640 1 -- 172.21.15.31:0/1166925110 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v34) ==== 172+0+0 (secure 0 0 0) 0x7fa32005e1c0 con 0x7fa3300cbb90 2024-09-17T05:31:40.701 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 8 and data pool 9 2024-09-17T05:31:40.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.703+0000 7fa337200640 1 -- 172.21.15.31:0/1166925110 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa3140733b0 msgr2=0x7fa314075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:40.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.703+0000 7fa337200640 1 --2- 172.21.15.31:0/1166925110 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa3140733b0 0x7fa314075870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa3240af000 tx=0x7fa3240b2040 comp rx=0 tx=0).stop 2024-09-17T05:31:40.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.703+0000 7fa337200640 1 -- 172.21.15.31:0/1166925110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3300cbb90 msgr2=0x7fa3300c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:40.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.703+0000 7fa337200640 1 --2- 172.21.15.31:0/1166925110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3300cbb90 0x7fa3300c9c50 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa32000c500 tx=0x7fa32000c9c0 comp rx=0 tx=0).stop 2024-09-17T05:31:40.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.703+0000 7fa337200640 1 -- 172.21.15.31:0/1166925110 shutdown_connections 2024-09-17T05:31:40.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.703+0000 7fa337200640 1 --2- 172.21.15.31:0/1166925110 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa3140733b0 0x7fa314075870 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:40.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.703+0000 7fa337200640 1 --2- 172.21.15.31:0/1166925110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3300d1650 0x7fa3300711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:40.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.703+0000 7fa337200640 1 --2- 172.21.15.31:0/1166925110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3300cbb90 0x7fa3300c9c50 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:40.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.703+0000 7fa337200640 1 --2- 172.21.15.31:0/1166925110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3300739f0 0x7fa330154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:40.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.703+0000 7fa337200640 1 -- 172.21.15.31:0/1166925110 >> 172.21.15.31:0/1166925110 conn(0x7fa3300d0b30 msgr2=0x7fa3300c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:40.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.707+0000 7fa337200640 1 -- 172.21.15.31:0/1166925110 shutdown_connections 2024-09-17T05:31:40.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.707+0000 7fa337200640 1 -- 172.21.15.31:0/1166925110 wait complete. 2024-09-17T05:31:40.754 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:31:40.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.895+0000 7f8b80c00640 1 -- 172.21.15.31:0/2461931694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b7c0ced80 msgr2=0x7f8b7c0ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:40.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.895+0000 7f8b80c00640 1 --2- 172.21.15.31:0/2461931694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b7c0ced80 0x7f8b7c0ae9b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0cf340 tx=0x7f8b6801c8c0 comp rx=0 tx=0).stop 2024-09-17T05:31:40.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.895+0000 7f8b80c00640 1 -- 172.21.15.31:0/2461931694 shutdown_connections 2024-09-17T05:31:40.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.895+0000 7f8b80c00640 1 --2- 172.21.15.31:0/2461931694 >> v2:172.21.15.155:3300/0 conn(0x7f8b7c0cdb30 0x7f8b7c0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:40.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.895+0000 7f8b80c00640 1 --2- 172.21.15.31:0/2461931694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b7c0ced80 0x7f8b7c0ae9b0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:40.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.895+0000 7f8b80c00640 1 -- 172.21.15.31:0/2461931694 >> 172.21.15.31:0/2461931694 conn(0x7f8b7c0d1dc0 msgr2=0x7f8b7c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:40.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.895+0000 7f8b80c00640 1 -- 172.21.15.31:0/2461931694 shutdown_connections 2024-09-17T05:31:40.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.895+0000 7f8b80c00640 1 -- 172.21.15.31:0/2461931694 wait complete. 2024-09-17T05:31:40.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.895+0000 7f8b80c00640 1 Processor -- start 2024-09-17T05:31:40.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.895+0000 7f8b80c00640 1 -- start start 2024-09-17T05:31:40.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b80c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b7c0cdb30 0x7f8b7c1556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:40.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b80c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b7c0ced80 0x7f8b7c15cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:40.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b80c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b7c15bea0 0x7f8b7c15d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:40.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b80c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c1692f0 con 0x7f8b7c15bea0 2024-09-17T05:31:40.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b80c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8b7c169170 con 0x7f8b7c0cdb30 2024-09-17T05:31:40.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b80c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8b7c169470 con 0x7f8b7c0ced80 2024-09-17T05:31:40.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b7a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b7c15bea0 0x7f8b7c15d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:40.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b7a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b7c15bea0 0x7f8b7c15d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54536/0 (socket says 172.21.15.31:54536) 2024-09-17T05:31:40.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b7a800640 1 -- 172.21.15.31:0/2815309686 learned_addr learned my addr 172.21.15.31:0/2815309686 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:40.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b79e00640 1 --2- 172.21.15.31:0/2815309686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b7c0cdb30 0x7f8b7c1556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:40.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b79400640 1 --2- 172.21.15.31:0/2815309686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b7c0ced80 0x7f8b7c15cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:40.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b7a800640 1 -- 172.21.15.31:0/2815309686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b7c0ced80 msgr2=0x7f8b7c15cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:40.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b7a800640 1 --2- 172.21.15.31:0/2815309686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b7c0ced80 0x7f8b7c15cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:40.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b7a800640 1 -- 172.21.15.31:0/2815309686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b7c0cdb30 msgr2=0x7f8b7c1556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:40.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b7a800640 1 --2- 172.21.15.31:0/2815309686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b7c0cdb30 0x7f8b7c1556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:40.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b7a800640 1 -- 172.21.15.31:0/2815309686 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b7c1f7f00 con 0x7f8b7c15bea0 2024-09-17T05:31:40.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b79400640 1 --2- 172.21.15.31:0/2815309686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b7c0ced80 0x7f8b7c15cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:31:40.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b79e00640 1 --2- 172.21.15.31:0/2815309686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b7c0cdb30 0x7f8b7c1556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:31:40.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b7a800640 1 --2- 172.21.15.31:0/2815309686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b7c15bea0 0x7f8b7c15d080 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400b970 tx=0x7f8b7400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:40.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b72000640 1 -- 172.21.15.31:0/2815309686 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74019070 con 0x7f8b7c15bea0 2024-09-17T05:31:40.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b72000640 1 -- 172.21.15.31:0/2815309686 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b7400cc50 con 0x7f8b7c15bea0 2024-09-17T05:31:40.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b80c00640 1 -- 172.21.15.31:0/2815309686 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b7c1f81e0 con 0x7f8b7c15bea0 2024-09-17T05:31:40.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b72000640 1 -- 172.21.15.31:0/2815309686 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b740146a0 con 0x7f8b7c15bea0 2024-09-17T05:31:40.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b80c00640 1 -- 172.21.15.31:0/2815309686 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b7c1f87a0 con 0x7f8b7c15bea0 2024-09-17T05:31:40.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b80c00640 1 -- 172.21.15.31:0/2815309686 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b7c0ce670 con 0x7f8b7c15bea0 2024-09-17T05:31:40.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.899+0000 7f8b72000640 1 -- 172.21.15.31:0/2815309686 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f8b7401c070 con 0x7f8b7c15bea0 2024-09-17T05:31:40.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.903+0000 7f8b72000640 1 --2- 172.21.15.31:0/2815309686 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8b5c0733b0 0x7f8b5c075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:40.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.903+0000 7f8b72000640 1 -- 172.21.15.31:0/2815309686 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7f8b74094380 con 0x7f8b7c15bea0 2024-09-17T05:31:40.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.903+0000 7f8b79e00640 1 --2- 172.21.15.31:0/2815309686 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8b5c0733b0 0x7f8b5c075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:40.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.903+0000 7f8b79e00640 1 --2- 172.21.15.31:0/2815309686 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8b5c0733b0 0x7f8b5c075870 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0016b0 tx=0x7f8b6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:40.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:40.907+0000 7f8b72000640 1 -- 172.21.15.31:0/2815309686 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8b7405f090 con 0x7f8b7c15bea0 2024-09-17T05:31:41.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.083+0000 7f8b80c00640 1 -- 172.21.15.31:0/2815309686 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b7c0762f0 con 0x7f8b7c15bea0 2024-09-17T05:31:41.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.083+0000 7f8b72000640 1 -- 172.21.15.31:0/2815309686 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16762 (secure 0 0 0) 0x7f8b7405e990 con 0x7f8b7c15bea0 2024-09-17T05:31:41.091 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:41.091 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":56,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:31:40.115988+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:31:37.829320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T05:31:39.086190+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:31:41.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.087+0000 7f8b80c00640 1 -- 172.21.15.31:0/2815309686 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8b5c0733b0 msgr2=0x7f8b5c075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:41.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.087+0000 7f8b80c00640 1 --2- 172.21.15.31:0/2815309686 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8b5c0733b0 0x7f8b5c075870 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0016b0 tx=0x7f8b6c009040 comp rx=0 tx=0).stop 2024-09-17T05:31:41.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.087+0000 7f8b80c00640 1 -- 172.21.15.31:0/2815309686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b7c15bea0 msgr2=0x7f8b7c15d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:41.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.087+0000 7f8b80c00640 1 --2- 172.21.15.31:0/2815309686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b7c15bea0 0x7f8b7c15d080 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400b970 tx=0x7f8b7400be30 comp rx=0 tx=0).stop 2024-09-17T05:31:41.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.087+0000 7f8b80c00640 1 -- 172.21.15.31:0/2815309686 shutdown_connections 2024-09-17T05:31:41.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.087+0000 7f8b80c00640 1 --2- 172.21.15.31:0/2815309686 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8b5c0733b0 0x7f8b5c075870 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:41.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.087+0000 7f8b80c00640 1 --2- 172.21.15.31:0/2815309686 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8b7c15bea0 0x7f8b7c15d080 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:41.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.087+0000 7f8b80c00640 1 --2- 172.21.15.31:0/2815309686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8b7c0ced80 0x7f8b7c15cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:41.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.087+0000 7f8b80c00640 1 --2- 172.21.15.31:0/2815309686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8b7c0cdb30 0x7f8b7c1556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:41.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.087+0000 7f8b80c00640 1 -- 172.21.15.31:0/2815309686 >> 172.21.15.31:0/2815309686 conn(0x7f8b7c0d1dc0 msgr2=0x7f8b7c0b60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:41.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.087+0000 7f8b80c00640 1 -- 172.21.15.31:0/2815309686 shutdown_connections 2024-09-17T05:31:41.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.087+0000 7f8b80c00640 1 -- 172.21.15.31:0/2815309686 wait complete. 2024-09-17T05:31:41.112 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:31:41.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.251+0000 7fe41fe00640 1 -- 172.21.15.31:0/2361707935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4180d28e0 msgr2=0x7fe4180cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.251+0000 7fe41fe00640 1 --2- 172.21.15.31:0/2361707935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4180d28e0 0x7fe4180cebb0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe410009bc0 tx=0x7fe41001cba0 comp rx=0 tx=0).stop 2024-09-17T05:31:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.251+0000 7fe41fe00640 1 -- 172.21.15.31:0/2361707935 shutdown_connections 2024-09-17T05:31:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.251+0000 7fe41fe00640 1 --2- 172.21.15.31:0/2361707935 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4180d28e0 0x7fe4180cebb0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.251+0000 7fe41fe00640 1 --2- 172.21.15.31:0/2361707935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe41815bea0 0x7fe4180ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.251+0000 7fe41fe00640 1 -- 172.21.15.31:0/2361707935 >> 172.21.15.31:0/2361707935 conn(0x7fe4180d1dc0 msgr2=0x7fe4180d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.251+0000 7fe41fe00640 1 -- 172.21.15.31:0/2361707935 shutdown_connections 2024-09-17T05:31:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.251+0000 7fe41fe00640 1 -- 172.21.15.31:0/2361707935 wait complete. 2024-09-17T05:31:41.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41fe00640 1 Processor -- start 2024-09-17T05:31:41.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41fe00640 1 -- start start 2024-09-17T05:31:41.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41fe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4180cdb30 0x7fe4181543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:41.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4180d28e0 0x7fe418152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:41.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe41815bea0 0x7fe4180b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:41.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41fe00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe418169020 con 0x7fe41815bea0 2024-09-17T05:31:41.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41fe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe418168ea0 con 0x7fe4180cdb30 2024-09-17T05:31:41.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41fe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe4181691a0 con 0x7fe4180d28e0 2024-09-17T05:31:41.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe41815bea0 0x7fe4180b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:41.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe41815bea0 0x7fe4180b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54554/0 (socket says 172.21.15.31:54554) 2024-09-17T05:31:41.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41de00640 1 -- 172.21.15.31:0/2434860570 learned_addr learned my addr 172.21.15.31:0/2434860570 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:41.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41ca00640 1 --2- 172.21.15.31:0/2434860570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4180d28e0 0x7fe418152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:41.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41de00640 1 -- 172.21.15.31:0/2434860570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4180d28e0 msgr2=0x7fe418152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:41.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41d400640 1 --2- 172.21.15.31:0/2434860570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4180cdb30 0x7fe4181543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:41.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41de00640 1 --2- 172.21.15.31:0/2434860570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4180d28e0 0x7fe418152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:41.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41de00640 1 -- 172.21.15.31:0/2434860570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4180cdb30 msgr2=0x7fe4181543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:41.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41de00640 1 --2- 172.21.15.31:0/2434860570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4180cdb30 0x7fe4181543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:41.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41de00640 1 -- 172.21.15.31:0/2434860570 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe418153630 con 0x7fe41815bea0 2024-09-17T05:31:41.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41ca00640 1 --2- 172.21.15.31:0/2434860570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4180d28e0 0x7fe418152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:31:41.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41d400640 1 --2- 172.21.15.31:0/2434860570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4180cdb30 0x7fe4181543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:31:41.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41de00640 1 --2- 172.21.15.31:0/2434860570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe41815bea0 0x7fe4180b39b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe41001a7d0 tx=0x7fe4100a5b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:41.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe415600640 1 -- 172.21.15.31:0/2434860570 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4100bb070 con 0x7fe41815bea0 2024-09-17T05:31:41.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe415600640 1 -- 172.21.15.31:0/2434860570 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe410004e00 con 0x7fe41815bea0 2024-09-17T05:31:41.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe415600640 1 -- 172.21.15.31:0/2434860570 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4100b2040 con 0x7fe41815bea0 2024-09-17T05:31:41.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41fe00640 1 -- 172.21.15.31:0/2434860570 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4181538f0 con 0x7fe41815bea0 2024-09-17T05:31:41.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.255+0000 7fe41fe00640 1 -- 172.21.15.31:0/2434860570 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe418153eb0 con 0x7fe41815bea0 2024-09-17T05:31:41.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.259+0000 7fe41fe00640 1 -- 172.21.15.31:0/2434860570 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4180cc9d0 con 0x7fe41815bea0 2024-09-17T05:31:41.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.259+0000 7fe415600640 1 -- 172.21.15.31:0/2434860570 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7fe410004360 con 0x7fe41815bea0 2024-09-17T05:31:41.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.259+0000 7fe415600640 1 --2- 172.21.15.31:0/2434860570 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe3f80733b0 0x7fe3f8075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:41.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.259+0000 7fe415600640 1 -- 172.21.15.31:0/2434860570 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7fe41012e680 con 0x7fe41815bea0 2024-09-17T05:31:41.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.259+0000 7fe41d400640 1 --2- 172.21.15.31:0/2434860570 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe3f80733b0 0x7fe3f8075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:41.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.259+0000 7fe41d400640 1 --2- 172.21.15.31:0/2434860570 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe3f80733b0 0x7fe3f8075870 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe41809f500 tx=0x7fe40c005d20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:41.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.263+0000 7fe415600640 1 -- 172.21.15.31:0/2434860570 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe4100a5e20 con 0x7fe41815bea0 2024-09-17T05:31:41.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.439+0000 7fe41fe00640 1 -- 172.21.15.31:0/2434860570 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe418154080 con 0x7fe41815bea0 2024-09-17T05:31:41.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.439+0000 7fe415600640 1 -- 172.21.15.31:0/2434860570 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16762 (secure 0 0 0) 0x7fe410016790 con 0x7fe41815bea0 2024-09-17T05:31:41.447 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:41.447 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":56,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:31:40.115988+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:31:37.829320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T05:31:39.086190+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:31:41.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.443+0000 7fe41fe00640 1 -- 172.21.15.31:0/2434860570 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe3f80733b0 msgr2=0x7fe3f8075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:41.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.443+0000 7fe41fe00640 1 --2- 172.21.15.31:0/2434860570 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe3f80733b0 0x7fe3f8075870 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe41809f500 tx=0x7fe40c005d20 comp rx=0 tx=0).stop 2024-09-17T05:31:41.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.443+0000 7fe41fe00640 1 -- 172.21.15.31:0/2434860570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe41815bea0 msgr2=0x7fe4180b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:41.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.443+0000 7fe41fe00640 1 --2- 172.21.15.31:0/2434860570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe41815bea0 0x7fe4180b39b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe41001a7d0 tx=0x7fe4100a5b00 comp rx=0 tx=0).stop 2024-09-17T05:31:41.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.443+0000 7fe41fe00640 1 -- 172.21.15.31:0/2434860570 shutdown_connections 2024-09-17T05:31:41.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.443+0000 7fe41fe00640 1 --2- 172.21.15.31:0/2434860570 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe3f80733b0 0x7fe3f8075870 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:41.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.443+0000 7fe41fe00640 1 --2- 172.21.15.31:0/2434860570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe41815bea0 0x7fe4180b39b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:41.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.443+0000 7fe41fe00640 1 --2- 172.21.15.31:0/2434860570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4180d28e0 0x7fe418152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:41.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.443+0000 7fe41fe00640 1 --2- 172.21.15.31:0/2434860570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4180cdb30 0x7fe4181543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:41.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.443+0000 7fe41fe00640 1 -- 172.21.15.31:0/2434860570 >> 172.21.15.31:0/2434860570 conn(0x7fe4180d1dc0 msgr2=0x7fe4181591e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:41.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.443+0000 7fe41fe00640 1 -- 172.21.15.31:0/2434860570 shutdown_connections 2024-09-17T05:31:41.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.443+0000 7fe41fe00640 1 -- 172.21.15.31:0/2434860570 wait complete. 2024-09-17T05:31:41.470 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:31:41.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.615+0000 7ffa4e800640 1 -- 172.21.15.31:0/1580753453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa480d20f0 msgr2=0x7ffa480ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:41.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.615+0000 7ffa4e800640 1 --2- 172.21.15.31:0/1580753453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa480d20f0 0x7ffa480ce670 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ffa480cf780 tx=0x7ffa4001ca60 comp rx=0 tx=0).stop 2024-09-17T05:31:41.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.615+0000 7ffa4e800640 1 -- 172.21.15.31:0/1580753453 shutdown_connections 2024-09-17T05:31:41.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.615+0000 7ffa4e800640 1 --2- 172.21.15.31:0/1580753453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa480d20f0 0x7ffa480ce670 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:41.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.615+0000 7ffa4e800640 1 --2- 172.21.15.31:0/1580753453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa480b0d10 0x7ffa480d1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:41.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.615+0000 7ffa4e800640 1 --2- 172.21.15.31:0/1580753453 >> v2:172.21.15.155:3300/0 conn(0x7ffa4815bd40 0x7ffa480d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:41.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.615+0000 7ffa4e800640 1 -- 172.21.15.31:0/1580753453 >> 172.21.15.31:0/1580753453 conn(0x7ffa4809aa10 msgr2=0x7ffa4809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:41.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.615+0000 7ffa4e800640 1 -- 172.21.15.31:0/1580753453 shutdown_connections 2024-09-17T05:31:41.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.615+0000 7ffa4e800640 1 -- 172.21.15.31:0/1580753453 wait complete. 2024-09-17T05:31:41.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.615+0000 7ffa4e800640 1 Processor -- start 2024-09-17T05:31:41.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.615+0000 7ffa4e800640 1 -- start start 2024-09-17T05:31:41.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4e800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa480b0d10 0x7ffa4814e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:41.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4e800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa480d20f0 0x7ffa480cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:41.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa4815bd40 0x7ffa4806ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4e800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ffa480cce60 con 0x7ffa4815bd40 2024-09-17T05:31:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4e800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffa480ccce0 con 0x7ffa480d20f0 2024-09-17T05:31:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4e800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffa480ccfe0 con 0x7ffa480b0d10 2024-09-17T05:31:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa4815bd40 0x7ffa4806ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa4815bd40 0x7ffa4806ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54572/0 (socket says 172.21.15.31:54572) 2024-09-17T05:31:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4de00640 1 -- 172.21.15.31:0/782818813 learned_addr learned my addr 172.21.15.31:0/782818813 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4d400640 1 --2- 172.21.15.31:0/782818813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa480b0d10 0x7ffa4814e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4ca00640 1 --2- 172.21.15.31:0/782818813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa480d20f0 0x7ffa480cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4de00640 1 -- 172.21.15.31:0/782818813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa480b0d10 msgr2=0x7ffa4814e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4de00640 1 --2- 172.21.15.31:0/782818813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa480b0d10 0x7ffa4814e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4de00640 1 -- 172.21.15.31:0/782818813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa480d20f0 msgr2=0x7ffa480cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:41.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4de00640 1 --2- 172.21.15.31:0/782818813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa480d20f0 0x7ffa480cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:41.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4de00640 1 -- 172.21.15.31:0/782818813 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa480c9f20 con 0x7ffa4815bd40 2024-09-17T05:31:41.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4ca00640 1 --2- 172.21.15.31:0/782818813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa480d20f0 0x7ffa480cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:31:41.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4de00640 1 --2- 172.21.15.31:0/782818813 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa4815bd40 0x7ffa4806ed50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ffa4001a6f0 tx=0x7ffa400a5820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:41.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa45600640 1 -- 172.21.15.31:0/782818813 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa400bb070 con 0x7ffa4815bd40 2024-09-17T05:31:41.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa45600640 1 -- 172.21.15.31:0/782818813 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa40004e00 con 0x7ffa4815bd40 2024-09-17T05:31:41.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4e800640 1 -- 172.21.15.31:0/782818813 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa480ca200 con 0x7ffa4815bd40 2024-09-17T05:31:41.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa45600640 1 -- 172.21.15.31:0/782818813 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa400b2040 con 0x7ffa4815bd40 2024-09-17T05:31:41.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4e800640 1 -- 172.21.15.31:0/782818813 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa480ca7c0 con 0x7ffa4815bd40 2024-09-17T05:31:41.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa4e800640 1 -- 172.21.15.31:0/782818813 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa480cd500 con 0x7ffa4815bd40 2024-09-17T05:31:41.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.619+0000 7ffa45600640 1 -- 172.21.15.31:0/782818813 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7ffa400be070 con 0x7ffa4815bd40 2024-09-17T05:31:41.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.623+0000 7ffa45600640 1 --2- 172.21.15.31:0/782818813 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffa280733b0 0x7ffa28075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.623+0000 7ffa45600640 1 -- 172.21.15.31:0/782818813 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7ffa4012dde0 con 0x7ffa4815bd40 2024-09-17T05:31:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.623+0000 7ffa4d400640 1 --2- 172.21.15.31:0/782818813 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffa280733b0 0x7ffa28075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.623+0000 7ffa4d400640 1 --2- 172.21.15.31:0/782818813 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffa280733b0 0x7ffa28075870 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c005fd0 tx=0x7ffa3c005e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:41.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.627+0000 7ffa45600640 1 -- 172.21.15.31:0/782818813 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ffa40016970 con 0x7ffa4815bd40 2024-09-17T05:31:41.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:41.843+0000 7ffa4e800640 1 -- 172.21.15.31:0/782818813 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ffa480ce710 con 0x7ffa4815bd40 2024-09-17T05:31:42.055 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:31:42.059 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:31:42.680 INFO:tasks.ceph.mds.a.smithi031.stderr:2024-09-17T05:31:42.679+0000 7f7db1a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:31:42.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.719+0000 7ffa45600640 1 -- 172.21.15.31:0/782818813 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v37) ==== 118+0+0 (secure 0 0 0) 0x7ffa400f8af0 con 0x7ffa4815bd40 2024-09-17T05:31:42.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.723+0000 7ffa4e800640 1 -- 172.21.15.31:0/782818813 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffa280733b0 msgr2=0x7ffa28075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:42.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.723+0000 7ffa4e800640 1 --2- 172.21.15.31:0/782818813 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffa280733b0 0x7ffa28075870 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c005fd0 tx=0x7ffa3c005e40 comp rx=0 tx=0).stop 2024-09-17T05:31:42.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.723+0000 7ffa4e800640 1 -- 172.21.15.31:0/782818813 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa4815bd40 msgr2=0x7ffa4806ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:42.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.723+0000 7ffa4e800640 1 --2- 172.21.15.31:0/782818813 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa4815bd40 0x7ffa4806ed50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ffa4001a6f0 tx=0x7ffa400a5820 comp rx=0 tx=0).stop 2024-09-17T05:31:42.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.723+0000 7ffa4e800640 1 -- 172.21.15.31:0/782818813 shutdown_connections 2024-09-17T05:31:42.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.723+0000 7ffa4e800640 1 --2- 172.21.15.31:0/782818813 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffa280733b0 0x7ffa28075870 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:42.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.723+0000 7ffa4e800640 1 --2- 172.21.15.31:0/782818813 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa4815bd40 0x7ffa4806ed50 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:42.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.723+0000 7ffa4e800640 1 --2- 172.21.15.31:0/782818813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa480d20f0 0x7ffa480cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:42.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.723+0000 7ffa4e800640 1 --2- 172.21.15.31:0/782818813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa480b0d10 0x7ffa4814e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:42.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.723+0000 7ffa4e800640 1 -- 172.21.15.31:0/782818813 >> 172.21.15.31:0/782818813 conn(0x7ffa4809aa10 msgr2=0x7ffa480aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:42.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.723+0000 7ffa4e800640 1 -- 172.21.15.31:0/782818813 shutdown_connections 2024-09-17T05:31:42.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.723+0000 7ffa4e800640 1 -- 172.21.15.31:0/782818813 wait complete. 2024-09-17T05:31:42.754 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:31:42.754 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:31:42.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.903+0000 7fedf7400640 1 -- 172.21.15.31:0/2758071311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedf00afb10 msgr2=0x7fedf00affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:42.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.903+0000 7fedf7400640 1 --2- 172.21.15.31:0/2758071311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedf00afb10 0x7fedf00affc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fede8009c80 tx=0x7fede801cda0 comp rx=0 tx=0).stop 2024-09-17T05:31:42.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.903+0000 7fedf7400640 1 -- 172.21.15.31:0/2758071311 shutdown_connections 2024-09-17T05:31:42.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.903+0000 7fedf7400640 1 --2- 172.21.15.31:0/2758071311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedf00afb10 0x7fedf00affc0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:42.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.903+0000 7fedf7400640 1 --2- 172.21.15.31:0/2758071311 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedf00b1650 0x7fedf00b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:42.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.903+0000 7fedf7400640 1 -- 172.21.15.31:0/2758071311 >> 172.21.15.31:0/2758071311 conn(0x7fedf00d1dd0 msgr2=0x7fedf00d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:42.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.903+0000 7fedf7400640 1 -- 172.21.15.31:0/2758071311 shutdown_connections 2024-09-17T05:31:42.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.903+0000 7fedf7400640 1 -- 172.21.15.31:0/2758071311 wait complete. 2024-09-17T05:31:42.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.903+0000 7fedf7400640 1 Processor -- start 2024-09-17T05:31:42.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.903+0000 7fedf7400640 1 -- start start 2024-09-17T05:31:42.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedf7400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedf00afb10 0x7fedf0151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:42.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedf7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedf00b1650 0x7fedf00cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:42.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedf7400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedf01605d0 0x7fedf006dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:42.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedf7400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fedf0169540 con 0x7fedf00b1650 2024-09-17T05:31:42.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedf7400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fedf00b1430 con 0x7fedf01605d0 2024-09-17T05:31:42.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedf7400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fedf01696c0 con 0x7fedf00afb10 2024-09-17T05:31:42.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedefe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedf00b1650 0x7fedf00cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:42.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedefe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedf00b1650 0x7fedf00cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54594/0 (socket says 172.21.15.31:54594) 2024-09-17T05:31:42.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedefe00640 1 -- 172.21.15.31:0/110382292 learned_addr learned my addr 172.21.15.31:0/110382292 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:42.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedf4a00640 1 --2- 172.21.15.31:0/110382292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedf00afb10 0x7fedf0151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:42.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedefe00640 1 -- 172.21.15.31:0/110382292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedf00afb10 msgr2=0x7fedf0151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:42.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedf5400640 1 --2- 172.21.15.31:0/110382292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedf01605d0 0x7fedf006dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:42.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedefe00640 1 --2- 172.21.15.31:0/110382292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedf00afb10 0x7fedf0151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:42.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedefe00640 1 -- 172.21.15.31:0/110382292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedf01605d0 msgr2=0x7fedf006dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:42.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedefe00640 1 --2- 172.21.15.31:0/110382292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedf01605d0 0x7fedf006dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:42.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedefe00640 1 -- 172.21.15.31:0/110382292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf00ccaa0 con 0x7fedf00b1650 2024-09-17T05:31:42.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedf4a00640 1 --2- 172.21.15.31:0/110382292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedf00afb10 0x7fedf0151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:31:42.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedf5400640 1 --2- 172.21.15.31:0/110382292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedf01605d0 0x7fedf006dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:31:42.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedefe00640 1 --2- 172.21.15.31:0/110382292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedf00b1650 0x7fedf00cdb40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7feddc00d950 tx=0x7feddc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:42.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedecc00640 1 -- 172.21.15.31:0/110382292 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc017070 con 0x7fedf00b1650 2024-09-17T05:31:42.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedecc00640 1 -- 172.21.15.31:0/110382292 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feddc009d20 con 0x7fedf00b1650 2024-09-17T05:31:42.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedecc00640 1 -- 172.21.15.31:0/110382292 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc0106c0 con 0x7fedf00b1650 2024-09-17T05:31:42.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedf7400640 1 -- 172.21.15.31:0/110382292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf00ccd80 con 0x7fedf00b1650 2024-09-17T05:31:42.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedf7400640 1 -- 172.21.15.31:0/110382292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf00cd340 con 0x7fedf00b1650 2024-09-17T05:31:42.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.907+0000 7fedf7400640 1 -- 172.21.15.31:0/110382292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf00affc0 con 0x7fedf00b1650 2024-09-17T05:31:42.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.911+0000 7fedecc00640 1 -- 172.21.15.31:0/110382292 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7feddc010860 con 0x7fedf00b1650 2024-09-17T05:31:42.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.911+0000 7fedecc00640 1 --2- 172.21.15.31:0/110382292 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fedd00733b0 0x7fedd0075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:42.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.911+0000 7fedecc00640 1 -- 172.21.15.31:0/110382292 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7feddc094a00 con 0x7fedf00b1650 2024-09-17T05:31:42.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.911+0000 7fedf4a00640 1 --2- 172.21.15.31:0/110382292 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fedd00733b0 0x7fedd0075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:42.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.911+0000 7fedf4a00640 1 --2- 172.21.15.31:0/110382292 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fedd00733b0 0x7fedd0075870 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fede4000f70 tx=0x7fede4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:42.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:42.915+0000 7fedecc00640 1 -- 172.21.15.31:0/110382292 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7feddc05f710 con 0x7fedf00b1650 2024-09-17T05:31:43.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.123+0000 7fedf7400640 1 -- 172.21.15.31:0/110382292 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fedf00d1080 con 0x7fedf00b1650 2024-09-17T05:31:43.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.727+0000 7fedecc00640 1 -- 172.21.15.31:0/110382292 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7feddc05f010 con 0x7fedf00b1650 2024-09-17T05:31:43.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.731+0000 7fedf7400640 1 -- 172.21.15.31:0/110382292 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fedd00733b0 msgr2=0x7fedd0075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:43.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.731+0000 7fedf7400640 1 --2- 172.21.15.31:0/110382292 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fedd00733b0 0x7fedd0075870 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fede4000f70 tx=0x7fede4009040 comp rx=0 tx=0).stop 2024-09-17T05:31:43.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.731+0000 7fedf7400640 1 -- 172.21.15.31:0/110382292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedf00b1650 msgr2=0x7fedf00cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:43.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.731+0000 7fedf7400640 1 --2- 172.21.15.31:0/110382292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedf00b1650 0x7fedf00cdb40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7feddc00d950 tx=0x7feddc00de10 comp rx=0 tx=0).stop 2024-09-17T05:31:43.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.731+0000 7fedf7400640 1 -- 172.21.15.31:0/110382292 shutdown_connections 2024-09-17T05:31:43.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.731+0000 7fedf7400640 1 --2- 172.21.15.31:0/110382292 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fedd00733b0 0x7fedd0075870 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:43.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.731+0000 7fedf7400640 1 --2- 172.21.15.31:0/110382292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedf01605d0 0x7fedf006dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:43.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.731+0000 7fedf7400640 1 --2- 172.21.15.31:0/110382292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fedf00b1650 0x7fedf00cdb40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:43.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.731+0000 7fedf7400640 1 --2- 172.21.15.31:0/110382292 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fedf00afb10 0x7fedf0151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:43.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.731+0000 7fedf7400640 1 -- 172.21.15.31:0/110382292 >> 172.21.15.31:0/110382292 conn(0x7fedf00d1dd0 msgr2=0x7fedf00b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:43.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.731+0000 7fedf7400640 1 -- 172.21.15.31:0/110382292 shutdown_connections 2024-09-17T05:31:43.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.731+0000 7fedf7400640 1 -- 172.21.15.31:0/110382292 wait complete. 2024-09-17T05:31:43.758 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:31:43.758 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:31:43.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb89200640 1 -- 172.21.15.31:0/1618327671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8415c130 msgr2=0x7fbb840ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:43.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb89200640 1 --2- 172.21.15.31:0/1618327671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8415c130 0x7fbb840ceb20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009900 tx=0x7fbb6c01c7c0 comp rx=0 tx=0).stop 2024-09-17T05:31:43.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb89200640 1 -- 172.21.15.31:0/1618327671 shutdown_connections 2024-09-17T05:31:43.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb89200640 1 --2- 172.21.15.31:0/1618327671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8415c130 0x7fbb840ceb20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:43.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb89200640 1 --2- 172.21.15.31:0/1618327671 >> v2:172.21.15.155:3300/0 conn(0x7fbb8415bd50 0x7fbb840ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:43.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb89200640 1 -- 172.21.15.31:0/1618327671 >> 172.21.15.31:0/1618327671 conn(0x7fbb840d1ea0 msgr2=0x7fbb840d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:43.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb89200640 1 -- 172.21.15.31:0/1618327671 shutdown_connections 2024-09-17T05:31:43.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb89200640 1 -- 172.21.15.31:0/1618327671 wait complete. 2024-09-17T05:31:43.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb89200640 1 Processor -- start 2024-09-17T05:31:43.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb89200640 1 -- start start 2024-09-17T05:31:43.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb89200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb840cf4e0 0x7fbb840aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:43.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb89200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb8415bd50 0x7fbb8415af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:43.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb89200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8415c130 0x7fbb84159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:43.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb89200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbb84168e50 con 0x7fbb8415bd50 2024-09-17T05:31:43.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb89200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbb84168cd0 con 0x7fbb840cf4e0 2024-09-17T05:31:43.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb89200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbb84168fd0 con 0x7fbb8415c130 2024-09-17T05:31:43.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb7be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb8415bd50 0x7fbb8415af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:43.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb7be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb8415bd50 0x7fbb8415af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54604/0 (socket says 172.21.15.31:54604) 2024-09-17T05:31:43.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb7be00640 1 -- 172.21.15.31:0/2091338714 learned_addr learned my addr 172.21.15.31:0/2091338714 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:43.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb82800640 1 --2- 172.21.15.31:0/2091338714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8415c130 0x7fbb84159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:43.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.903+0000 7fbb81e00640 1 --2- 172.21.15.31:0/2091338714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb840cf4e0 0x7fbb840aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:43.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.907+0000 7fbb7be00640 1 -- 172.21.15.31:0/2091338714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8415c130 msgr2=0x7fbb84159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:43.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.907+0000 7fbb7be00640 1 --2- 172.21.15.31:0/2091338714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8415c130 0x7fbb84159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:43.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.907+0000 7fbb7be00640 1 -- 172.21.15.31:0/2091338714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb840cf4e0 msgr2=0x7fbb840aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:43.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.907+0000 7fbb7be00640 1 --2- 172.21.15.31:0/2091338714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb840cf4e0 0x7fbb840aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:43.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.907+0000 7fbb7be00640 1 -- 172.21.15.31:0/2091338714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb840cbb90 con 0x7fbb8415bd50 2024-09-17T05:31:43.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.907+0000 7fbb7be00640 1 --2- 172.21.15.31:0/2091338714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb8415bd50 0x7fbb8415af30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009850 tx=0x7fbb6c005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:43.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.907+0000 7fbb7a000640 1 -- 172.21.15.31:0/2091338714 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0b2040 con 0x7fbb8415bd50 2024-09-17T05:31:43.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.907+0000 7fbb7a000640 1 -- 172.21.15.31:0/2091338714 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb6c004240 con 0x7fbb8415bd50 2024-09-17T05:31:43.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.907+0000 7fbb89200640 1 -- 172.21.15.31:0/2091338714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb840cbe40 con 0x7fbb8415bd50 2024-09-17T05:31:43.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.907+0000 7fbb7a000640 1 -- 172.21.15.31:0/2091338714 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c005030 con 0x7fbb8415bd50 2024-09-17T05:31:43.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.907+0000 7fbb89200640 1 -- 172.21.15.31:0/2091338714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb8415a730 con 0x7fbb8415bd50 2024-09-17T05:31:43.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.907+0000 7fbb89200640 1 -- 172.21.15.31:0/2091338714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb840c5dd0 con 0x7fbb8415bd50 2024-09-17T05:31:43.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.907+0000 7fbb7a000640 1 -- 172.21.15.31:0/2091338714 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7fbb6c0051d0 con 0x7fbb8415bd50 2024-09-17T05:31:43.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.907+0000 7fbb7a000640 1 --2- 172.21.15.31:0/2091338714 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbb600733e0 0x7fbb600758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:43.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.911+0000 7fbb7a000640 1 -- 172.21.15.31:0/2091338714 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fbb6c12de50 con 0x7fbb8415bd50 2024-09-17T05:31:43.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.911+0000 7fbb81e00640 1 --2- 172.21.15.31:0/2091338714 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbb600733e0 0x7fbb600758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:43.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.911+0000 7fbb81e00640 1 --2- 172.21.15.31:0/2091338714 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbb600733e0 0x7fbb600758a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009600 tx=0x7fbb740091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:43.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:43.911+0000 7fbb7a000640 1 -- 172.21.15.31:0/2091338714 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fbb6c0164d0 con 0x7fbb8415bd50 2024-09-17T05:31:44.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.123+0000 7fbb89200640 1 -- 172.21.15.31:0/2091338714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb84076360 con 0x7fbb8415bd50 2024-09-17T05:31:44.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.123+0000 7fbb7a000640 1 -- 172.21.15.31:0/2091338714 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5229 (secure 0 0 0) 0x7fbb6c0f8480 con 0x7fbb8415bd50 2024-09-17T05:31:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:44.130 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":38,"btime":"2024-09-17T05:31:43:727701+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/3185006969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3185006969},{"type":"v1","addr":"172.21.15.155:6836","nonce":3185006969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3957768567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3957768567},{"type":"v1","addr":"172.21.15.155:6837","nonce":3957768567}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5748,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3936847081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3936847081},{"type":"v1","addr":"172.21.15.31:6833","nonce":3936847081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:31:40.115955+0000","modified":"2024-09-17T05:31:43.131088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1272884249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1272884249},{"type":"v1","addr":"172.21.15.31:6835","nonce":1272884249}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5751,"qdb_cluster":[5751]},"id":4}]} 2024-09-17T05:31:44.131 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 38 2024-09-17T05:31:44.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.127+0000 7fbb89200640 1 -- 172.21.15.31:0/2091338714 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbb600733e0 msgr2=0x7fbb600758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:44.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.127+0000 7fbb89200640 1 --2- 172.21.15.31:0/2091338714 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbb600733e0 0x7fbb600758a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009600 tx=0x7fbb740091e0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.127+0000 7fbb89200640 1 -- 172.21.15.31:0/2091338714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb8415bd50 msgr2=0x7fbb8415af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.127+0000 7fbb89200640 1 --2- 172.21.15.31:0/2091338714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb8415bd50 0x7fbb8415af30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009850 tx=0x7fbb6c005760 comp rx=0 tx=0).stop 2024-09-17T05:31:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.127+0000 7fbb89200640 1 -- 172.21.15.31:0/2091338714 shutdown_connections 2024-09-17T05:31:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.127+0000 7fbb89200640 1 --2- 172.21.15.31:0/2091338714 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbb600733e0 0x7fbb600758a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.127+0000 7fbb89200640 1 --2- 172.21.15.31:0/2091338714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb8415c130 0x7fbb84159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.127+0000 7fbb89200640 1 --2- 172.21.15.31:0/2091338714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb8415bd50 0x7fbb8415af30 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.127+0000 7fbb89200640 1 --2- 172.21.15.31:0/2091338714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb840cf4e0 0x7fbb840aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.127+0000 7fbb89200640 1 -- 172.21.15.31:0/2091338714 >> 172.21.15.31:0/2091338714 conn(0x7fbb840d1ea0 msgr2=0x7fbb84071790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.127+0000 7fbb89200640 1 -- 172.21.15.31:0/2091338714 shutdown_connections 2024-09-17T05:31:44.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.127+0000 7fbb89200640 1 -- 172.21.15.31:0/2091338714 wait complete. 2024-09-17T05:31:44.152 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:31:44.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f3d000640 1 -- 172.21.15.31:0/442116790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f1c003ab0 msgr2=0x7f2f1c003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:44.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f3d000640 1 --2- 172.21.15.31:0/442116790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f1c003ab0 0x7f2f1c003ed0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2f28009b30 tx=0x7f2f2801d210 comp rx=0 tx=0).stop 2024-09-17T05:31:44.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f3d000640 1 -- 172.21.15.31:0/442116790 shutdown_connections 2024-09-17T05:31:44.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f3d000640 1 --2- 172.21.15.31:0/442116790 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f1c003ab0 0x7f2f1c003ed0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f3d000640 1 -- 172.21.15.31:0/442116790 >> 172.21.15.31:0/442116790 conn(0x7f2f380d3fe0 msgr2=0x7f2f380d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:44.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f3d000640 1 -- 172.21.15.31:0/442116790 shutdown_connections 2024-09-17T05:31:44.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f3d000640 1 -- 172.21.15.31:0/442116790 wait complete. 2024-09-17T05:31:44.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f3d000640 1 Processor -- start 2024-09-17T05:31:44.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f3d000640 1 -- start start 2024-09-17T05:31:44.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f3d000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f1c003ab0 0x7f2f381555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:44.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f3d000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f380cb0b0 0x7f2f3809fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:44.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f3d000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f380cb530 0x7f2f380a0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:44.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f3d000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2f380d0fd0 con 0x7f2f1c003ab0 2024-09-17T05:31:44.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f3d000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2f380d0e50 con 0x7f2f380cb0b0 2024-09-17T05:31:44.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f3d000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2f380d1150 con 0x7f2f380cb530 2024-09-17T05:31:44.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f35e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f1c003ab0 0x7f2f381555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:44.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f35e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f1c003ab0 0x7f2f381555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54620/0 (socket says 172.21.15.31:54620) 2024-09-17T05:31:44.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f35e00640 1 -- 172.21.15.31:0/1573922244 learned_addr learned my addr 172.21.15.31:0/1573922244 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:44.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f2fe00640 1 --2- 172.21.15.31:0/1573922244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f380cb0b0 0x7f2f3809fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:44.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.295+0000 7f2f36800640 1 --2- 172.21.15.31:0/1573922244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f380cb530 0x7f2f380a0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:44.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.299+0000 7f2f35e00640 1 -- 172.21.15.31:0/1573922244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f380cb530 msgr2=0x7f2f380a0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:44.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.299+0000 7f2f35e00640 1 --2- 172.21.15.31:0/1573922244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f380cb530 0x7f2f380a0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.299+0000 7f2f35e00640 1 -- 172.21.15.31:0/1573922244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f380cb0b0 msgr2=0x7f2f3809fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:44.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.299+0000 7f2f35e00640 1 --2- 172.21.15.31:0/1573922244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f380cb0b0 0x7f2f3809fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.299+0000 7f2f35e00640 1 -- 172.21.15.31:0/1573922244 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f3809dcf0 con 0x7f2f1c003ab0 2024-09-17T05:31:44.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.299+0000 7f2f35e00640 1 --2- 172.21.15.31:0/1573922244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f1c003ab0 0x7f2f381555b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2f2801d040 tx=0x7f2f28005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:44.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.299+0000 7f2f2e000640 1 -- 172.21.15.31:0/1573922244 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f280b1040 con 0x7f2f1c003ab0 2024-09-17T05:31:44.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.299+0000 7f2f2e000640 1 -- 172.21.15.31:0/1573922244 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f28004110 con 0x7f2f1c003ab0 2024-09-17T05:31:44.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.299+0000 7f2f2e000640 1 -- 172.21.15.31:0/1573922244 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f280ac7b0 con 0x7f2f1c003ab0 2024-09-17T05:31:44.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.299+0000 7f2f3d000640 1 -- 172.21.15.31:0/1573922244 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f381fc770 con 0x7f2f1c003ab0 2024-09-17T05:31:44.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.299+0000 7f2f3d000640 1 -- 172.21.15.31:0/1573922244 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f3809e270 con 0x7f2f1c003ab0 2024-09-17T05:31:44.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.299+0000 7f2f3d000640 1 -- 172.21.15.31:0/1573922244 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f380d16b0 con 0x7f2f1c003ab0 2024-09-17T05:31:44.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.299+0000 7f2f2e000640 1 -- 172.21.15.31:0/1573922244 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f2f280bf060 con 0x7f2f1c003ab0 2024-09-17T05:31:44.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.299+0000 7f2f2e000640 1 --2- 172.21.15.31:0/1573922244 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2f140733e0 0x7f2f140758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:44.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.299+0000 7f2f2e000640 1 -- 172.21.15.31:0/1573922244 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f2f2812e8a0 con 0x7f2f1c003ab0 2024-09-17T05:31:44.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.303+0000 7f2f2fe00640 1 --2- 172.21.15.31:0/1573922244 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2f140733e0 0x7f2f140758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:44.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.303+0000 7f2f2fe00640 1 --2- 172.21.15.31:0/1573922244 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2f140733e0 0x7f2f140758a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2f20001ec0 tx=0x7f2f20006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:44.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.303+0000 7f2f2e000640 1 -- 172.21.15.31:0/1573922244 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2f28016f20 con 0x7f2f1c003ab0 2024-09-17T05:31:44.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.483+0000 7f2f3d000640 1 -- 172.21.15.31:0/1573922244 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2f380a1ee0 con 0x7f2f1c003ab0 2024-09-17T05:31:44.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.483+0000 7f2f2e000640 1 -- 172.21.15.31:0/1573922244 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16749 (secure 0 0 0) 0x7f2f280f8f80 con 0x7f2f1c003ab0 2024-09-17T05:31:44.489 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:44.489 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":57,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:31:41.713876+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:31:37.829320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T05:31:39.086190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:31:44.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.483+0000 7f2f3d000640 1 -- 172.21.15.31:0/1573922244 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2f140733e0 msgr2=0x7f2f140758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:44.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.483+0000 7f2f3d000640 1 --2- 172.21.15.31:0/1573922244 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2f140733e0 0x7f2f140758a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2f20001ec0 tx=0x7f2f20006040 comp rx=0 tx=0).stop 2024-09-17T05:31:44.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.483+0000 7f2f3d000640 1 -- 172.21.15.31:0/1573922244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f1c003ab0 msgr2=0x7f2f381555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:44.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.483+0000 7f2f3d000640 1 --2- 172.21.15.31:0/1573922244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f1c003ab0 0x7f2f381555b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2f2801d040 tx=0x7f2f28005520 comp rx=0 tx=0).stop 2024-09-17T05:31:44.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.487+0000 7f2f3d000640 1 -- 172.21.15.31:0/1573922244 shutdown_connections 2024-09-17T05:31:44.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.487+0000 7f2f3d000640 1 --2- 172.21.15.31:0/1573922244 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2f140733e0 0x7f2f140758a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.487+0000 7f2f3d000640 1 --2- 172.21.15.31:0/1573922244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f380cb530 0x7f2f380a0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.487+0000 7f2f3d000640 1 --2- 172.21.15.31:0/1573922244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f380cb0b0 0x7f2f3809fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.487+0000 7f2f3d000640 1 --2- 172.21.15.31:0/1573922244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f1c003ab0 0x7f2f381555b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.487+0000 7f2f3d000640 1 -- 172.21.15.31:0/1573922244 >> 172.21.15.31:0/1573922244 conn(0x7f2f380d3fe0 msgr2=0x7f2f38160c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:44.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.487+0000 7f2f3d000640 1 -- 172.21.15.31:0/1573922244 shutdown_connections 2024-09-17T05:31:44.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.487+0000 7f2f3d000640 1 -- 172.21.15.31:0/1573922244 wait complete. 2024-09-17T05:31:44.511 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:31:44.511 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:31:44.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.651+0000 7fa9e2400640 1 -- 172.21.15.31:0/4030301809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9dc0ced80 msgr2=0x7fa9dc0ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:44.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.651+0000 7fa9e2400640 1 --2- 172.21.15.31:0/4030301809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9dc0ced80 0x7fa9dc0ae9b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009840 tx=0x7fa9c401c740 comp rx=0 tx=0).stop 2024-09-17T05:31:44.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.651+0000 7fa9e2400640 1 -- 172.21.15.31:0/4030301809 shutdown_connections 2024-09-17T05:31:44.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.651+0000 7fa9e2400640 1 --2- 172.21.15.31:0/4030301809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9dc0ced80 0x7fa9dc0ae9b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.651+0000 7fa9e2400640 1 -- 172.21.15.31:0/4030301809 >> 172.21.15.31:0/4030301809 conn(0x7fa9dc0d1dc0 msgr2=0x7fa9dc0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:44.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.651+0000 7fa9e2400640 1 -- 172.21.15.31:0/4030301809 shutdown_connections 2024-09-17T05:31:44.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.651+0000 7fa9e2400640 1 -- 172.21.15.31:0/4030301809 wait complete. 2024-09-17T05:31:44.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9e2400640 1 Processor -- start 2024-09-17T05:31:44.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9e2400640 1 -- start start 2024-09-17T05:31:44.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9e2400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9dc0cdb30 0x7fa9dc1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:44.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9e2400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9dc0ced80 0x7fa9dc150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:44.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9e2400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9dc15bea0 0x7fa9dc151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:44.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9e2400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc16a840 con 0x7fa9dc15bea0 2024-09-17T05:31:44.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9e2400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc16a6c0 con 0x7fa9dc0ced80 2024-09-17T05:31:44.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9e2400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa9dc16a9c0 con 0x7fa9dc0cdb30 2024-09-17T05:31:44.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9dbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9dc15bea0 0x7fa9dc151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:44.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9dbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9dc15bea0 0x7fa9dc151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54628/0 (socket says 172.21.15.31:54628) 2024-09-17T05:31:44.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9dbe00640 1 -- 172.21.15.31:0/1954744796 learned_addr learned my addr 172.21.15.31:0/1954744796 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:44.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9d3e00640 1 --2- 172.21.15.31:0/1954744796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9dc0ced80 0x7fa9dc150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:44.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9db400640 1 --2- 172.21.15.31:0/1954744796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9dc0cdb30 0x7fa9dc1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:44.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9dbe00640 1 -- 172.21.15.31:0/1954744796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9dc0cdb30 msgr2=0x7fa9dc1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:44.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9dbe00640 1 --2- 172.21.15.31:0/1954744796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9dc0cdb30 0x7fa9dc1551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9dbe00640 1 -- 172.21.15.31:0/1954744796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9dc0ced80 msgr2=0x7fa9dc150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:44.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9dbe00640 1 --2- 172.21.15.31:0/1954744796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9dc0ced80 0x7fa9dc150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9dbe00640 1 -- 172.21.15.31:0/1954744796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9dc0c9270 con 0x7fa9dc15bea0 2024-09-17T05:31:44.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9d3e00640 1 --2- 172.21.15.31:0/1954744796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9dc0ced80 0x7fa9dc150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:31:44.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9dbe00640 1 --2- 172.21.15.31:0/1954744796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9dc15bea0 0x7fa9dc151bb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400c7f0 tx=0x7fa9d400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:44.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9d3400640 1 -- 172.21.15.31:0/1954744796 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4003b80 con 0x7fa9dc15bea0 2024-09-17T05:31:44.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9d3400640 1 -- 172.21.15.31:0/1954744796 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9d4003d20 con 0x7fa9dc15bea0 2024-09-17T05:31:44.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9e2400640 1 -- 172.21.15.31:0/1954744796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9dc0c9550 con 0x7fa9dc15bea0 2024-09-17T05:31:44.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9d3400640 1 -- 172.21.15.31:0/1954744796 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d400aab0 con 0x7fa9dc15bea0 2024-09-17T05:31:44.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.655+0000 7fa9e2400640 1 -- 172.21.15.31:0/1954744796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9dc0c9b10 con 0x7fa9dc15bea0 2024-09-17T05:31:44.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.659+0000 7fa9e2400640 1 -- 172.21.15.31:0/1954744796 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9dc0ce670 con 0x7fa9dc15bea0 2024-09-17T05:31:44.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.659+0000 7fa9d3400640 1 -- 172.21.15.31:0/1954744796 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7fa9d400ac50 con 0x7fa9dc15bea0 2024-09-17T05:31:44.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.659+0000 7fa9d3400640 1 --2- 172.21.15.31:0/1954744796 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa9b80733e0 0x7fa9b80758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:44.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.659+0000 7fa9d3400640 1 -- 172.21.15.31:0/1954744796 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fa9d4094560 con 0x7fa9dc15bea0 2024-09-17T05:31:44.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.659+0000 7fa9db400640 1 --2- 172.21.15.31:0/1954744796 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa9b80733e0 0x7fa9b80758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:44.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.659+0000 7fa9db400640 1 --2- 172.21.15.31:0/1954744796 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa9b80733e0 0x7fa9b80758a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc001230 tx=0x7fa9cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:44.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.663+0000 7fa9d3400640 1 -- 172.21.15.31:0/1954744796 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa9d405f150 con 0x7fa9dc15bea0 2024-09-17T05:31:44.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.843+0000 7fa9e2400640 1 -- 172.21.15.31:0/1954744796 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa9dc0008e0 con 0x7fa9b80733e0 2024-09-17T05:31:44.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.851+0000 7fa9d3400640 1 -- 172.21.15.31:0/1954744796 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238988 (secure 0 0 0) 0x7fa9dc0008e0 con 0x7fa9b80733e0 2024-09-17T05:31:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:44.859 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:31:44.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.851+0000 7fa9e2400640 1 -- 172.21.15.31:0/1954744796 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa9b80733e0 msgr2=0x7fa9b80758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:44.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.851+0000 7fa9e2400640 1 --2- 172.21.15.31:0/1954744796 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa9b80733e0 0x7fa9b80758a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc001230 tx=0x7fa9cc009040 comp rx=0 tx=0).stop 2024-09-17T05:31:44.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.851+0000 7fa9e2400640 1 -- 172.21.15.31:0/1954744796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9dc15bea0 msgr2=0x7fa9dc151bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:44.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.851+0000 7fa9e2400640 1 --2- 172.21.15.31:0/1954744796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9dc15bea0 0x7fa9dc151bb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400c7f0 tx=0x7fa9d400ccb0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.851+0000 7fa9e2400640 1 -- 172.21.15.31:0/1954744796 shutdown_connections 2024-09-17T05:31:44.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.851+0000 7fa9e2400640 1 --2- 172.21.15.31:0/1954744796 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa9b80733e0 0x7fa9b80758a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.851+0000 7fa9e2400640 1 --2- 172.21.15.31:0/1954744796 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9dc15bea0 0x7fa9dc151bb0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.851+0000 7fa9e2400640 1 --2- 172.21.15.31:0/1954744796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9dc0ced80 0x7fa9dc150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.851+0000 7fa9e2400640 1 --2- 172.21.15.31:0/1954744796 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9dc0cdb30 0x7fa9dc1551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:44.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.851+0000 7fa9e2400640 1 -- 172.21.15.31:0/1954744796 >> 172.21.15.31:0/1954744796 conn(0x7fa9dc0d1dc0 msgr2=0x7fa9dc0d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:44.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.851+0000 7fa9e2400640 1 -- 172.21.15.31:0/1954744796 shutdown_connections 2024-09-17T05:31:44.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:44.855+0000 7fa9e2400640 1 -- 172.21.15.31:0/1954744796 wait complete. 2024-09-17T05:31:44.878 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-09-17T05:31:43.224161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":42,"acting":42,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":230696,"kb_used_data":6128,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744024,"statfs":{"total":773094113280,"available":772857880576,"internally_reserved":0,"allocated":6275072,"data_stored":3248190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.526538"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:38.690575+0000","last_change":"2024-09-17T05:31:38.690575+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.690575+0000","last_undegraded":"2024-09-17T05:31:38.690575+0000","last_fullsized":"2024-09-17T05:31:38.690575+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.700918+0000","last_change":"2024-09-17T05:31:38.700918+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.700918+0000","last_undegraded":"2024-09-17T05:31:38.700918+0000","last_fullsized":"2024-09-17T05:31:38.700918+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:38.690575+0000","last_change":"2024-09-17T05:31:38.690575+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.690575+0000","last_undegraded":"2024-09-17T05:31:38.690575+0000","last_fullsized":"2024-09-17T05:31:38.690575+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:38.690575+0000","last_change":"2024-09-17T05:31:38.690575+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.690575+0000","last_undegraded":"2024-09-17T05:31:38.690575+0000","last_fullsized":"2024-09-17T05:31:38.690575+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.704236+0000","last_change":"2024-09-17T05:31:38.704236+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.704236+0000","last_undegraded":"2024-09-17T05:31:38.704236+0000","last_fullsized":"2024-09-17T05:31:38.704236+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:38.690575+0000","last_change":"2024-09-17T05:31:38.690575+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.690575+0000","last_undegraded":"2024-09-17T05:31:38.690575+0000","last_fullsized":"2024-09-17T05:31:38.690575+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:38.690575+0000","last_change":"2024-09-17T05:31:38.690575+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.690575+0000","last_undegraded":"2024-09-17T05:31:38.690575+0000","last_fullsized":"2024-09-17T05:31:38.690575+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.703658+0000","last_change":"2024-09-17T05:31:38.703658+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.703658+0000","last_undegraded":"2024-09-17T05:31:38.703658+0000","last_fullsized":"2024-09-17T05:31:38.703658+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.704163+0000","last_change":"2024-09-17T05:31:38.704163+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.704163+0000","last_undegraded":"2024-09-17T05:31:38.704163+0000","last_fullsized":"2024-09-17T05:31:38.704163+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.699628+0000","last_change":"2024-09-17T05:31:38.699628+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.699628+0000","last_undegraded":"2024-09-17T05:31:38.699628+0000","last_fullsized":"2024-09-17T05:31:38.699628+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.704340+0000","last_change":"2024-09-17T05:31:38.704340+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.704340+0000","last_undegraded":"2024-09-17T05:31:38.704340+0000","last_fullsized":"2024-09-17T05:31:38.704340+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.703702+0000","last_change":"2024-09-17T05:31:38.703702+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.703702+0000","last_undegraded":"2024-09-17T05:31:38.703702+0000","last_fullsized":"2024-09-17T05:31:38.703702+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.701080+0000","last_change":"2024-09-17T05:31:38.701080+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.701080+0000","last_undegraded":"2024-09-17T05:31:38.701080+0000","last_fullsized":"2024-09-17T05:31:38.701080+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.700312+0000","last_change":"2024-09-17T05:31:38.700312+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.700312+0000","last_undegraded":"2024-09-17T05:31:38.700312+0000","last_fullsized":"2024-09-17T05:31:38.700312+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:38.690575+0000","last_change":"2024-09-17T05:31:38.690575+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.690575+0000","last_undegraded":"2024-09-17T05:31:38.690575+0000","last_fullsized":"2024-09-17T05:31:38.690575+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.704322+0000","last_change":"2024-09-17T05:31:38.704322+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.704322+0000","last_undegraded":"2024-09-17T05:31:38.704322+0000","last_fullsized":"2024-09-17T05:31:38.704322+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.699619+0000","last_change":"2024-09-17T05:31:38.699619+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.699619+0000","last_undegraded":"2024-09-17T05:31:38.699619+0000","last_fullsized":"2024-09-17T05:31:38.699619+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:38.690575+0000","last_change":"2024-09-17T05:31:38.690575+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.690575+0000","last_undegraded":"2024-09-17T05:31:38.690575+0000","last_fullsized":"2024-09-17T05:31:38.690575+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:38.690575+0000","last_change":"2024-09-17T05:31:38.690575+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.690575+0000","last_undegraded":"2024-09-17T05:31:38.690575+0000","last_fullsized":"2024-09-17T05:31:38.690575+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:38.690575+0000","last_change":"2024-09-17T05:31:38.690575+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.690575+0000","last_undegraded":"2024-09-17T05:31:38.690575+0000","last_fullsized":"2024-09-17T05:31:38.690575+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.699619+0000","last_change":"2024-09-17T05:31:38.699619+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.699619+0000","last_undegraded":"2024-09-17T05:31:38.699619+0000","last_fullsized":"2024-09-17T05:31:38.699619+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.704011+0000","last_change":"2024-09-17T05:31:38.704011+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.704011+0000","last_undegraded":"2024-09-17T05:31:38.704011+0000","last_fullsized":"2024-09-17T05:31:38.704011+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:38.690575+0000","last_change":"2024-09-17T05:31:38.690575+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.690575+0000","last_undegraded":"2024-09-17T05:31:38.690575+0000","last_fullsized":"2024-09-17T05:31:38.690575+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.704699+0000","last_change":"2024-09-17T05:31:38.704699+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.704699+0000","last_undegraded":"2024-09-17T05:31:38.704699+0000","last_fullsized":"2024-09-17T05:31:38.704699+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:38.690575+0000","last_change":"2024-09-17T05:31:38.690575+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.690575+0000","last_undegraded":"2024-09-17T05:31:38.690575+0000","last_fullsized":"2024-09-17T05:31:38.690575+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.699909+0000","last_change":"2024-09-17T05:31:38.699909+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.699909+0000","last_undegraded":"2024-09-17T05:31:38.699909+0000","last_fullsized":"2024-09-17T05:31:38.699909+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:38.690575+0000","last_change":"2024-09-17T05:31:38.690575+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.690575+0000","last_undegraded":"2024-09-17T05:31:38.690575+0000","last_fullsized":"2024-09-17T05:31:38.690575+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.705142+0000","last_change":"2024-09-17T05:31:38.705142+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.705142+0000","last_undegraded":"2024-09-17T05:31:38.705142+0000","last_fullsized":"2024-09-17T05:31:38.705142+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.703835+0000","last_change":"2024-09-17T05:31:38.703835+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.703835+0000","last_undegraded":"2024-09-17T05:31:38.703835+0000","last_fullsized":"2024-09-17T05:31:38.703835+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.703993+0000","last_change":"2024-09-17T05:31:38.703993+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.703993+0000","last_undegraded":"2024-09-17T05:31:38.703993+0000","last_fullsized":"2024-09-17T05:31:38.703993+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.699619+0000","last_change":"2024-09-17T05:31:38.699619+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.699619+0000","last_undegraded":"2024-09-17T05:31:38.699619+0000","last_fullsized":"2024-09-17T05:31:38.699619+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:31:39.693730+0000","last_change":"2024-09-17T05:31:39.693730+0000","last_active":"2024-09-17T05:31:39.693730+0000","last_peered":"2024-09-17T05:31:39.693730+0000","last_clean":"2024-09-17T05:31:39.693730+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:39.693730+0000","last_undegraded":"2024-09-17T05:31:39.693730+0000","last_fullsized":"2024-09-17T05:31:39.693730+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":54,"state":"creating+peering","last_fresh":"2024-09-17T05:31:38.700008+0000","last_change":"2024-09-17T05:31:38.700008+0000","last_active":"2024-09-17T05:31:38.690575+0000","last_peered":"2024-09-17T05:31:38.690575+0000","last_clean":"2024-09-17T05:31:38.690575+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:31:38.700008+0000","last_undegraded":"2024-09-17T05:31:38.700008+0000","last_fullsized":"2024-09-17T05:31:38.700008+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":172,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-17T05:31:38.704585+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:31:38.704585+0000","last_peered":"2024-09-17T05:31:38.704585+0000","last_clean":"2024-09-17T05:31:38.704585+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:31:38.704585+0000","last_undegraded":"2024-09-17T05:31:38.704585+0000","last_fullsized":"2024-09-17T05:31:38.704585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":5},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":1232896,"data_stored":850254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":259886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509481,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":638976,"data_stored":259886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":259886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":259886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":259886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542184,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31808,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":626688,"data_stored":254069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1220608,"data_stored":844437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:31:44.883 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:31:45.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.067+0000 7fa518000640 1 -- 172.21.15.31:0/948159327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa51015e4a0 msgr2=0x7fa510068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:45.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.067+0000 7fa518000640 1 --2- 172.21.15.31:0/948159327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa51015e4a0 0x7fa510068c40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa504009840 tx=0x7fa50401c820 comp rx=0 tx=0).stop 2024-09-17T05:31:45.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.067+0000 7fa518000640 1 -- 172.21.15.31:0/948159327 shutdown_connections 2024-09-17T05:31:45.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.067+0000 7fa518000640 1 --2- 172.21.15.31:0/948159327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa51015e4a0 0x7fa510068c40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.067+0000 7fa518000640 1 -- 172.21.15.31:0/948159327 >> 172.21.15.31:0/948159327 conn(0x7fa5100b1f10 msgr2=0x7fa5100b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:45.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.067+0000 7fa518000640 1 -- 172.21.15.31:0/948159327 shutdown_connections 2024-09-17T05:31:45.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.067+0000 7fa518000640 1 -- 172.21.15.31:0/948159327 wait complete. 2024-09-17T05:31:45.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.067+0000 7fa518000640 1 Processor -- start 2024-09-17T05:31:45.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.067+0000 7fa518000640 1 -- start start 2024-09-17T05:31:45.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa518000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5100af4f0 0x7fa5100b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:45.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa518000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa51015e4a0 0x7fa510099500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:45.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa518000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5101550c0 0x7fa510155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:45.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa518000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa510169770 con 0x7fa5100af4f0 2024-09-17T05:31:45.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa518000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa5101695f0 con 0x7fa5101550c0 2024-09-17T05:31:45.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa518000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa5101698f0 con 0x7fa51015e4a0 2024-09-17T05:31:45.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa515600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5100af4f0 0x7fa5100b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:45.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa515600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5100af4f0 0x7fa5100b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54652/0 (socket says 172.21.15.31:54652) 2024-09-17T05:31:45.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa515600640 1 -- 172.21.15.31:0/1080710197 learned_addr learned my addr 172.21.15.31:0/1080710197 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:45.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa514c00640 1 --2- 172.21.15.31:0/1080710197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa51015e4a0 0x7fa510099500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:45.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa516000640 1 --2- 172.21.15.31:0/1080710197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5101550c0 0x7fa510155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:45.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa515600640 1 -- 172.21.15.31:0/1080710197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa51015e4a0 msgr2=0x7fa510099500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:45.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa515600640 1 --2- 172.21.15.31:0/1080710197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa51015e4a0 0x7fa510099500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa515600640 1 -- 172.21.15.31:0/1080710197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5101550c0 msgr2=0x7fa510155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:45.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa515600640 1 --2- 172.21.15.31:0/1080710197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5101550c0 0x7fa510155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa515600640 1 -- 172.21.15.31:0/1080710197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa510099d20 con 0x7fa5100af4f0 2024-09-17T05:31:45.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa514c00640 1 --2- 172.21.15.31:0/1080710197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa51015e4a0 0x7fa510099500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:31:45.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa515600640 1 --2- 172.21.15.31:0/1080710197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5100af4f0 0x7fa5100b22f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa50401aed0 tx=0x7fa504004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:45.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa50d600640 1 -- 172.21.15.31:0/1080710197 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5040044f0 con 0x7fa5100af4f0 2024-09-17T05:31:45.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa50d600640 1 -- 172.21.15.31:0/1080710197 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa504005070 con 0x7fa5100af4f0 2024-09-17T05:31:45.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa518000640 1 -- 172.21.15.31:0/1080710197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa510155e40 con 0x7fa5100af4f0 2024-09-17T05:31:45.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa50d600640 1 -- 172.21.15.31:0/1080710197 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa504005460 con 0x7fa5100af4f0 2024-09-17T05:31:45.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa518000640 1 -- 172.21.15.31:0/1080710197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa510155a90 con 0x7fa5100af4f0 2024-09-17T05:31:45.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa518000640 1 -- 172.21.15.31:0/1080710197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa510068c40 con 0x7fa5100af4f0 2024-09-17T05:31:45.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.071+0000 7fa50d600640 1 -- 172.21.15.31:0/1080710197 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7fa5040046d0 con 0x7fa5100af4f0 2024-09-17T05:31:45.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.075+0000 7fa50d600640 1 --2- 172.21.15.31:0/1080710197 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa4f00733b0 0x7fa4f0075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:45.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.075+0000 7fa50d600640 1 -- 172.21.15.31:0/1080710197 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fa50412f560 con 0x7fa5100af4f0 2024-09-17T05:31:45.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.075+0000 7fa514c00640 1 --2- 172.21.15.31:0/1080710197 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa4f00733b0 0x7fa4f0075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:45.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.075+0000 7fa514c00640 1 --2- 172.21.15.31:0/1080710197 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa4f00733b0 0x7fa4f0075870 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa5100ade10 tx=0x7fa4fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:45.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.079+0000 7fa50d600640 1 -- 172.21.15.31:0/1080710197 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa504016410 con 0x7fa5100af4f0 2024-09-17T05:31:45.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.247+0000 7fa518000640 1 -- 172.21.15.31:0/1080710197 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa5100745d0 con 0x7fa4f00733b0 2024-09-17T05:31:45.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.255+0000 7fa50d600640 1 -- 172.21.15.31:0/1080710197 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251944 (secure 0 0 0) 0x7fa5100745d0 con 0x7fa4f00733b0 2024-09-17T05:31:45.261 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:45.263 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:31:45.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.255+0000 7fa518000640 1 -- 172.21.15.31:0/1080710197 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa4f00733b0 msgr2=0x7fa4f0075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:45.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.259+0000 7fa518000640 1 --2- 172.21.15.31:0/1080710197 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa4f00733b0 0x7fa4f0075870 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa5100ade10 tx=0x7fa4fc009040 comp rx=0 tx=0).stop 2024-09-17T05:31:45.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.259+0000 7fa518000640 1 -- 172.21.15.31:0/1080710197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5100af4f0 msgr2=0x7fa5100b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:45.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.259+0000 7fa518000640 1 --2- 172.21.15.31:0/1080710197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5100af4f0 0x7fa5100b22f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa50401aed0 tx=0x7fa504004040 comp rx=0 tx=0).stop 2024-09-17T05:31:45.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.259+0000 7fa518000640 1 -- 172.21.15.31:0/1080710197 shutdown_connections 2024-09-17T05:31:45.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.259+0000 7fa518000640 1 --2- 172.21.15.31:0/1080710197 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa4f00733b0 0x7fa4f0075870 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.259+0000 7fa518000640 1 --2- 172.21.15.31:0/1080710197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5101550c0 0x7fa510155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.259+0000 7fa518000640 1 --2- 172.21.15.31:0/1080710197 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa51015e4a0 0x7fa510099500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.259+0000 7fa518000640 1 --2- 172.21.15.31:0/1080710197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5100af4f0 0x7fa5100b22f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.259+0000 7fa518000640 1 -- 172.21.15.31:0/1080710197 >> 172.21.15.31:0/1080710197 conn(0x7fa5100b1f10 msgr2=0x7fa51015a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:45.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.259+0000 7fa518000640 1 -- 172.21.15.31:0/1080710197 shutdown_connections 2024-09-17T05:31:45.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.259+0000 7fa518000640 1 -- 172.21.15.31:0/1080710197 wait complete. 2024-09-17T05:31:45.282 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-09-17T05:31:45.224748+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239384,"kb_used_data":6504,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735336,"statfs":{"total":773094113280,"available":772848984064,"internally_reserved":0,"allocated":6660096,"data_stored":3419380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001419"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.744463+0000","last_change":"2024-09-17T05:31:40.725456+0000","last_active":"2024-09-17T05:31:41.744463+0000","last_peered":"2024-09-17T05:31:41.744463+0000","last_clean":"2024-09-17T05:31:41.744463+0000","last_became_active":"2024-09-17T05:31:40.725202+0000","last_became_peered":"2024-09-17T05:31:40.725202+0000","last_unstale":"2024-09-17T05:31:41.744463+0000","last_undegraded":"2024-09-17T05:31:41.744463+0000","last_fullsized":"2024-09-17T05:31:41.744463+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:41.755341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.743743+0000","last_change":"2024-09-17T05:31:40.726773+0000","last_active":"2024-09-17T05:31:41.743743+0000","last_peered":"2024-09-17T05:31:41.743743+0000","last_clean":"2024-09-17T05:31:41.743743+0000","last_became_active":"2024-09-17T05:31:40.726481+0000","last_became_peered":"2024-09-17T05:31:40.726481+0000","last_unstale":"2024-09-17T05:31:41.743743+0000","last_undegraded":"2024-09-17T05:31:41.743743+0000","last_fullsized":"2024-09-17T05:31:41.743743+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:07.899058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.746853+0000","last_change":"2024-09-17T05:31:40.726383+0000","last_active":"2024-09-17T05:31:41.746853+0000","last_peered":"2024-09-17T05:31:41.746853+0000","last_clean":"2024-09-17T05:31:41.746853+0000","last_became_active":"2024-09-17T05:31:40.726090+0000","last_became_peered":"2024-09-17T05:31:40.726090+0000","last_unstale":"2024-09-17T05:31:41.746853+0000","last_undegraded":"2024-09-17T05:31:41.746853+0000","last_fullsized":"2024-09-17T05:31:41.746853+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:46:18.692515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.728017+0000","last_change":"2024-09-17T05:31:40.731226+0000","last_active":"2024-09-17T05:31:41.728017+0000","last_peered":"2024-09-17T05:31:41.728017+0000","last_clean":"2024-09-17T05:31:41.728017+0000","last_became_active":"2024-09-17T05:31:40.730961+0000","last_became_peered":"2024-09-17T05:31:40.730961+0000","last_unstale":"2024-09-17T05:31:41.728017+0000","last_undegraded":"2024-09-17T05:31:41.728017+0000","last_fullsized":"2024-09-17T05:31:41.728017+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:10.744244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.745115+0000","last_change":"2024-09-17T05:31:40.730069+0000","last_active":"2024-09-17T05:31:41.745115+0000","last_peered":"2024-09-17T05:31:41.745115+0000","last_clean":"2024-09-17T05:31:41.745115+0000","last_became_active":"2024-09-17T05:31:40.729618+0000","last_became_peered":"2024-09-17T05:31:40.729618+0000","last_unstale":"2024-09-17T05:31:41.745115+0000","last_undegraded":"2024-09-17T05:31:41.745115+0000","last_fullsized":"2024-09-17T05:31:41.745115+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:59.889004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.721731+0000","last_change":"2024-09-17T05:31:40.730904+0000","last_active":"2024-09-17T05:31:41.721731+0000","last_peered":"2024-09-17T05:31:41.721731+0000","last_clean":"2024-09-17T05:31:41.721731+0000","last_became_active":"2024-09-17T05:31:40.730641+0000","last_became_peered":"2024-09-17T05:31:40.730641+0000","last_unstale":"2024-09-17T05:31:41.721731+0000","last_undegraded":"2024-09-17T05:31:41.721731+0000","last_fullsized":"2024-09-17T05:31:41.721731+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:04.300342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.727395+0000","last_change":"2024-09-17T05:31:40.740503+0000","last_active":"2024-09-17T05:31:41.727395+0000","last_peered":"2024-09-17T05:31:41.727395+0000","last_clean":"2024-09-17T05:31:41.727395+0000","last_became_active":"2024-09-17T05:31:40.740067+0000","last_became_peered":"2024-09-17T05:31:40.740067+0000","last_unstale":"2024-09-17T05:31:41.727395+0000","last_undegraded":"2024-09-17T05:31:41.727395+0000","last_fullsized":"2024-09-17T05:31:41.727395+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:34.924221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.743202+0000","last_change":"2024-09-17T05:31:40.720589+0000","last_active":"2024-09-17T05:31:41.743202+0000","last_peered":"2024-09-17T05:31:41.743202+0000","last_clean":"2024-09-17T05:31:41.743202+0000","last_became_active":"2024-09-17T05:31:40.720346+0000","last_became_peered":"2024-09-17T05:31:40.720346+0000","last_unstale":"2024-09-17T05:31:41.743202+0000","last_undegraded":"2024-09-17T05:31:41.743202+0000","last_fullsized":"2024-09-17T05:31:41.743202+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:01.555913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.728295+0000","last_change":"2024-09-17T05:31:40.734092+0000","last_active":"2024-09-17T05:31:41.728295+0000","last_peered":"2024-09-17T05:31:41.728295+0000","last_clean":"2024-09-17T05:31:41.728295+0000","last_became_active":"2024-09-17T05:31:40.733775+0000","last_became_peered":"2024-09-17T05:31:40.733775+0000","last_unstale":"2024-09-17T05:31:41.728295+0000","last_undegraded":"2024-09-17T05:31:41.728295+0000","last_fullsized":"2024-09-17T05:31:41.728295+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:44.038323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.743355+0000","last_change":"2024-09-17T05:31:40.737482+0000","last_active":"2024-09-17T05:31:41.743355+0000","last_peered":"2024-09-17T05:31:41.743355+0000","last_clean":"2024-09-17T05:31:41.743355+0000","last_became_active":"2024-09-17T05:31:40.731286+0000","last_became_peered":"2024-09-17T05:31:40.731286+0000","last_unstale":"2024-09-17T05:31:41.743355+0000","last_undegraded":"2024-09-17T05:31:41.743355+0000","last_fullsized":"2024-09-17T05:31:41.743355+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:52:22.569761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.743343+0000","last_change":"2024-09-17T05:31:40.721165+0000","last_active":"2024-09-17T05:31:41.743343+0000","last_peered":"2024-09-17T05:31:41.743343+0000","last_clean":"2024-09-17T05:31:41.743343+0000","last_became_active":"2024-09-17T05:31:40.720919+0000","last_became_peered":"2024-09-17T05:31:40.720919+0000","last_unstale":"2024-09-17T05:31:41.743343+0000","last_undegraded":"2024-09-17T05:31:41.743343+0000","last_fullsized":"2024-09-17T05:31:41.743343+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:05.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.727647+0000","last_change":"2024-09-17T05:31:40.721051+0000","last_active":"2024-09-17T05:31:41.727647+0000","last_peered":"2024-09-17T05:31:41.727647+0000","last_clean":"2024-09-17T05:31:41.727647+0000","last_became_active":"2024-09-17T05:31:40.720740+0000","last_became_peered":"2024-09-17T05:31:40.720740+0000","last_unstale":"2024-09-17T05:31:41.727647+0000","last_undegraded":"2024-09-17T05:31:41.727647+0000","last_fullsized":"2024-09-17T05:31:41.727647+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:56.982702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.747430+0000","last_change":"2024-09-17T05:31:40.735203+0000","last_active":"2024-09-17T05:31:41.747430+0000","last_peered":"2024-09-17T05:31:41.747430+0000","last_clean":"2024-09-17T05:31:41.747430+0000","last_became_active":"2024-09-17T05:31:40.734325+0000","last_became_peered":"2024-09-17T05:31:40.734325+0000","last_unstale":"2024-09-17T05:31:41.747430+0000","last_undegraded":"2024-09-17T05:31:41.747430+0000","last_fullsized":"2024-09-17T05:31:41.747430+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:06:24.504687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.728090+0000","last_change":"2024-09-17T05:31:40.733925+0000","last_active":"2024-09-17T05:31:41.728090+0000","last_peered":"2024-09-17T05:31:41.728090+0000","last_clean":"2024-09-17T05:31:41.728090+0000","last_became_active":"2024-09-17T05:31:40.733608+0000","last_became_peered":"2024-09-17T05:31:40.733608+0000","last_unstale":"2024-09-17T05:31:41.728090+0000","last_undegraded":"2024-09-17T05:31:41.728090+0000","last_fullsized":"2024-09-17T05:31:41.728090+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:24.860822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.727307+0000","last_change":"2024-09-17T05:31:40.733629+0000","last_active":"2024-09-17T05:31:41.727307+0000","last_peered":"2024-09-17T05:31:41.727307+0000","last_clean":"2024-09-17T05:31:41.727307+0000","last_became_active":"2024-09-17T05:31:40.733331+0000","last_became_peered":"2024-09-17T05:31:40.733331+0000","last_unstale":"2024-09-17T05:31:41.727307+0000","last_undegraded":"2024-09-17T05:31:41.727307+0000","last_fullsized":"2024-09-17T05:31:41.727307+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:20.722165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.721588+0000","last_change":"2024-09-17T05:31:40.735083+0000","last_active":"2024-09-17T05:31:41.721588+0000","last_peered":"2024-09-17T05:31:41.721588+0000","last_clean":"2024-09-17T05:31:41.721588+0000","last_became_active":"2024-09-17T05:31:40.734812+0000","last_became_peered":"2024-09-17T05:31:40.734812+0000","last_unstale":"2024-09-17T05:31:41.721588+0000","last_undegraded":"2024-09-17T05:31:41.721588+0000","last_fullsized":"2024-09-17T05:31:41.721588+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:04.063852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.744553+0000","last_change":"2024-09-17T05:31:40.729793+0000","last_active":"2024-09-17T05:31:41.744553+0000","last_peered":"2024-09-17T05:31:41.744553+0000","last_clean":"2024-09-17T05:31:41.744553+0000","last_became_active":"2024-09-17T05:31:40.729362+0000","last_became_peered":"2024-09-17T05:31:40.729362+0000","last_unstale":"2024-09-17T05:31:41.744553+0000","last_undegraded":"2024-09-17T05:31:41.744553+0000","last_fullsized":"2024-09-17T05:31:41.744553+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:07.795855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.747098+0000","last_change":"2024-09-17T05:31:40.726161+0000","last_active":"2024-09-17T05:31:41.747098+0000","last_peered":"2024-09-17T05:31:41.747098+0000","last_clean":"2024-09-17T05:31:41.747098+0000","last_became_active":"2024-09-17T05:31:40.725852+0000","last_became_peered":"2024-09-17T05:31:40.725852+0000","last_unstale":"2024-09-17T05:31:41.747098+0000","last_undegraded":"2024-09-17T05:31:41.747098+0000","last_fullsized":"2024-09-17T05:31:41.747098+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:54.944372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.744934+0000","last_change":"2024-09-17T05:31:40.724243+0000","last_active":"2024-09-17T05:31:41.744934+0000","last_peered":"2024-09-17T05:31:41.744934+0000","last_clean":"2024-09-17T05:31:41.744934+0000","last_became_active":"2024-09-17T05:31:40.721675+0000","last_became_peered":"2024-09-17T05:31:40.721675+0000","last_unstale":"2024-09-17T05:31:41.744934+0000","last_undegraded":"2024-09-17T05:31:41.744934+0000","last_fullsized":"2024-09-17T05:31:41.744934+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:19.131001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.743459+0000","last_change":"2024-09-17T05:31:40.734236+0000","last_active":"2024-09-17T05:31:41.743459+0000","last_peered":"2024-09-17T05:31:41.743459+0000","last_clean":"2024-09-17T05:31:41.743459+0000","last_became_active":"2024-09-17T05:31:40.733603+0000","last_became_peered":"2024-09-17T05:31:40.733603+0000","last_unstale":"2024-09-17T05:31:41.743459+0000","last_undegraded":"2024-09-17T05:31:41.743459+0000","last_fullsized":"2024-09-17T05:31:41.743459+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:28.934380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.746286+0000","last_change":"2024-09-17T05:31:40.728705+0000","last_active":"2024-09-17T05:31:41.746286+0000","last_peered":"2024-09-17T05:31:41.746286+0000","last_clean":"2024-09-17T05:31:41.746286+0000","last_became_active":"2024-09-17T05:31:40.728294+0000","last_became_peered":"2024-09-17T05:31:40.728294+0000","last_unstale":"2024-09-17T05:31:41.746286+0000","last_undegraded":"2024-09-17T05:31:41.746286+0000","last_fullsized":"2024-09-17T05:31:41.746286+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:23.728819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.743036+0000","last_change":"2024-09-17T05:31:40.730358+0000","last_active":"2024-09-17T05:31:41.743036+0000","last_peered":"2024-09-17T05:31:41.743036+0000","last_clean":"2024-09-17T05:31:41.743036+0000","last_became_active":"2024-09-17T05:31:40.730112+0000","last_became_peered":"2024-09-17T05:31:40.730112+0000","last_unstale":"2024-09-17T05:31:41.743036+0000","last_undegraded":"2024-09-17T05:31:41.743036+0000","last_fullsized":"2024-09-17T05:31:41.743036+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:09.983832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.746103+0000","last_change":"2024-09-17T05:31:40.718739+0000","last_active":"2024-09-17T05:31:41.746103+0000","last_peered":"2024-09-17T05:31:41.746103+0000","last_clean":"2024-09-17T05:31:41.746103+0000","last_became_active":"2024-09-17T05:31:40.718098+0000","last_became_peered":"2024-09-17T05:31:40.718098+0000","last_unstale":"2024-09-17T05:31:41.746103+0000","last_undegraded":"2024-09-17T05:31:41.746103+0000","last_fullsized":"2024-09-17T05:31:41.746103+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:07.029766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.746634+0000","last_change":"2024-09-17T05:31:40.739520+0000","last_active":"2024-09-17T05:31:41.746634+0000","last_peered":"2024-09-17T05:31:41.746634+0000","last_clean":"2024-09-17T05:31:41.746634+0000","last_became_active":"2024-09-17T05:31:40.739091+0000","last_became_peered":"2024-09-17T05:31:40.739091+0000","last_unstale":"2024-09-17T05:31:41.746634+0000","last_undegraded":"2024-09-17T05:31:41.746634+0000","last_fullsized":"2024-09-17T05:31:41.746634+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:05.566080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.744713+0000","last_change":"2024-09-17T05:31:40.730645+0000","last_active":"2024-09-17T05:31:41.744713+0000","last_peered":"2024-09-17T05:31:41.744713+0000","last_clean":"2024-09-17T05:31:41.744713+0000","last_became_active":"2024-09-17T05:31:40.730379+0000","last_became_peered":"2024-09-17T05:31:40.730379+0000","last_unstale":"2024-09-17T05:31:41.744713+0000","last_undegraded":"2024-09-17T05:31:41.744713+0000","last_fullsized":"2024-09-17T05:31:41.744713+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:58.632338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.726817+0000","last_change":"2024-09-17T05:31:40.730452+0000","last_active":"2024-09-17T05:31:41.726817+0000","last_peered":"2024-09-17T05:31:41.726817+0000","last_clean":"2024-09-17T05:31:41.726817+0000","last_became_active":"2024-09-17T05:31:40.730192+0000","last_became_peered":"2024-09-17T05:31:40.730192+0000","last_unstale":"2024-09-17T05:31:41.726817+0000","last_undegraded":"2024-09-17T05:31:41.726817+0000","last_fullsized":"2024-09-17T05:31:41.726817+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:26.385299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.722152+0000","last_change":"2024-09-17T05:31:40.734311+0000","last_active":"2024-09-17T05:31:41.722152+0000","last_peered":"2024-09-17T05:31:41.722152+0000","last_clean":"2024-09-17T05:31:41.722152+0000","last_became_active":"2024-09-17T05:31:40.734049+0000","last_became_peered":"2024-09-17T05:31:40.734049+0000","last_unstale":"2024-09-17T05:31:41.722152+0000","last_undegraded":"2024-09-17T05:31:41.722152+0000","last_fullsized":"2024-09-17T05:31:41.722152+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:09.834379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.744258+0000","last_change":"2024-09-17T05:31:40.729001+0000","last_active":"2024-09-17T05:31:41.744258+0000","last_peered":"2024-09-17T05:31:41.744258+0000","last_clean":"2024-09-17T05:31:41.744258+0000","last_became_active":"2024-09-17T05:31:40.728734+0000","last_became_peered":"2024-09-17T05:31:40.728734+0000","last_unstale":"2024-09-17T05:31:41.744258+0000","last_undegraded":"2024-09-17T05:31:41.744258+0000","last_fullsized":"2024-09-17T05:31:41.744258+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:25.905410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.744301+0000","last_change":"2024-09-17T05:31:40.719242+0000","last_active":"2024-09-17T05:31:41.744301+0000","last_peered":"2024-09-17T05:31:41.744301+0000","last_clean":"2024-09-17T05:31:41.744301+0000","last_became_active":"2024-09-17T05:31:40.716054+0000","last_became_peered":"2024-09-17T05:31:40.716054+0000","last_unstale":"2024-09-17T05:31:41.744301+0000","last_undegraded":"2024-09-17T05:31:41.744301+0000","last_fullsized":"2024-09-17T05:31:41.744301+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:03.315617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.746162+0000","last_change":"2024-09-17T05:31:40.727837+0000","last_active":"2024-09-17T05:31:41.746162+0000","last_peered":"2024-09-17T05:31:41.746162+0000","last_clean":"2024-09-17T05:31:41.746162+0000","last_became_active":"2024-09-17T05:31:40.727573+0000","last_became_peered":"2024-09-17T05:31:40.727573+0000","last_unstale":"2024-09-17T05:31:41.746162+0000","last_undegraded":"2024-09-17T05:31:41.746162+0000","last_fullsized":"2024-09-17T05:31:41.746162+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:29.308137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.744006+0000","last_change":"2024-09-17T05:31:40.732277+0000","last_active":"2024-09-17T05:31:41.744006+0000","last_peered":"2024-09-17T05:31:41.744006+0000","last_clean":"2024-09-17T05:31:41.744006+0000","last_became_active":"2024-09-17T05:31:40.729585+0000","last_became_peered":"2024-09-17T05:31:40.729585+0000","last_unstale":"2024-09-17T05:31:41.744006+0000","last_undegraded":"2024-09-17T05:31:41.744006+0000","last_fullsized":"2024-09-17T05:31:41.744006+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:14.593654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.721616+0000","last_change":"2024-09-17T05:31:40.721198+0000","last_active":"2024-09-17T05:31:41.721616+0000","last_peered":"2024-09-17T05:31:41.721616+0000","last_clean":"2024-09-17T05:31:41.721616+0000","last_became_active":"2024-09-17T05:31:40.720806+0000","last_became_peered":"2024-09-17T05:31:40.720806+0000","last_unstale":"2024-09-17T05:31:41.721616+0000","last_undegraded":"2024-09-17T05:31:41.721616+0000","last_fullsized":"2024-09-17T05:31:41.721616+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:07.136811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.722291+0000","last_change":"2024-09-17T05:31:40.732895+0000","last_active":"2024-09-17T05:31:41.722291+0000","last_peered":"2024-09-17T05:31:41.722291+0000","last_clean":"2024-09-17T05:31:41.722291+0000","last_became_active":"2024-09-17T05:31:40.732653+0000","last_became_peered":"2024-09-17T05:31:40.732653+0000","last_unstale":"2024-09-17T05:31:41.722291+0000","last_undegraded":"2024-09-17T05:31:41.722291+0000","last_fullsized":"2024-09-17T05:31:41.722291+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:10.744244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.722318+0000","last_change":"2024-09-17T05:31:39.724238+0000","last_active":"2024-09-17T05:31:41.722318+0000","last_peered":"2024-09-17T05:31:41.722318+0000","last_clean":"2024-09-17T05:31:41.722318+0000","last_became_active":"2024-09-17T05:31:39.723884+0000","last_became_peered":"2024-09-17T05:31:39.723884+0000","last_unstale":"2024-09-17T05:31:41.722318+0000","last_undegraded":"2024-09-17T05:31:41.722318+0000","last_fullsized":"2024-09-17T05:31:41.722318+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:47.811898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.743786+0000","last_change":"2024-09-17T05:31:40.728508+0000","last_active":"2024-09-17T05:31:41.743786+0000","last_peered":"2024-09-17T05:31:41.743786+0000","last_clean":"2024-09-17T05:31:41.743786+0000","last_became_active":"2024-09-17T05:31:40.728221+0000","last_became_peered":"2024-09-17T05:31:40.728221+0000","last_unstale":"2024-09-17T05:31:41.743786+0000","last_undegraded":"2024-09-17T05:31:41.743786+0000","last_fullsized":"2024-09-17T05:31:41.743786+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:07.201008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.743644+0000","last_change":"2024-09-17T05:31:39.725383+0000","last_active":"2024-09-17T05:31:41.743644+0000","last_peered":"2024-09-17T05:31:41.743644+0000","last_clean":"2024-09-17T05:31:41.743644+0000","last_became_active":"2024-09-17T05:31:39.725073+0000","last_became_peered":"2024-09-17T05:31:39.725073+0000","last_unstale":"2024-09-17T05:31:41.743644+0000","last_undegraded":"2024-09-17T05:31:41.743644+0000","last_fullsized":"2024-09-17T05:31:41.743644+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:59.572864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.721984+0000","last_change":"2024-09-17T05:31:40.726658+0000","last_active":"2024-09-17T05:31:41.721984+0000","last_peered":"2024-09-17T05:31:41.721984+0000","last_clean":"2024-09-17T05:31:41.721984+0000","last_became_active":"2024-09-17T05:31:40.726413+0000","last_became_peered":"2024-09-17T05:31:40.726413+0000","last_unstale":"2024-09-17T05:31:41.721984+0000","last_undegraded":"2024-09-17T05:31:41.721984+0000","last_fullsized":"2024-09-17T05:31:41.721984+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:51.386801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.722304+0000","last_change":"2024-09-17T05:31:39.720792+0000","last_active":"2024-09-17T05:31:41.722304+0000","last_peered":"2024-09-17T05:31:41.722304+0000","last_clean":"2024-09-17T05:31:41.722304+0000","last_became_active":"2024-09-17T05:31:39.720451+0000","last_became_peered":"2024-09-17T05:31:39.720451+0000","last_unstale":"2024-09-17T05:31:41.722304+0000","last_undegraded":"2024-09-17T05:31:41.722304+0000","last_fullsized":"2024-09-17T05:31:41.722304+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:15.776935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.722196+0000","last_change":"2024-09-17T05:31:40.735742+0000","last_active":"2024-09-17T05:31:41.722196+0000","last_peered":"2024-09-17T05:31:41.722196+0000","last_clean":"2024-09-17T05:31:41.722196+0000","last_became_active":"2024-09-17T05:31:40.735439+0000","last_became_peered":"2024-09-17T05:31:40.735439+0000","last_unstale":"2024-09-17T05:31:41.722196+0000","last_undegraded":"2024-09-17T05:31:41.722196+0000","last_fullsized":"2024-09-17T05:31:41.722196+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:56.982702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.727756+0000","last_change":"2024-09-17T05:31:39.724445+0000","last_active":"2024-09-17T05:31:41.727756+0000","last_peered":"2024-09-17T05:31:41.727756+0000","last_clean":"2024-09-17T05:31:41.727756+0000","last_became_active":"2024-09-17T05:31:39.724133+0000","last_became_peered":"2024-09-17T05:31:39.724133+0000","last_unstale":"2024-09-17T05:31:41.727756+0000","last_undegraded":"2024-09-17T05:31:41.727756+0000","last_fullsized":"2024-09-17T05:31:41.727756+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:20.825812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.743230+0000","last_change":"2024-09-17T05:31:40.722817+0000","last_active":"2024-09-17T05:31:41.743230+0000","last_peered":"2024-09-17T05:31:41.743230+0000","last_clean":"2024-09-17T05:31:41.743230+0000","last_became_active":"2024-09-17T05:31:40.722011+0000","last_became_peered":"2024-09-17T05:31:40.722011+0000","last_unstale":"2024-09-17T05:31:41.743230+0000","last_undegraded":"2024-09-17T05:31:41.743230+0000","last_fullsized":"2024-09-17T05:31:41.743230+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:40.868154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.727108+0000","last_change":"2024-09-17T05:31:39.722264+0000","last_active":"2024-09-17T05:31:41.727108+0000","last_peered":"2024-09-17T05:31:41.727108+0000","last_clean":"2024-09-17T05:31:41.727108+0000","last_became_active":"2024-09-17T05:31:39.721986+0000","last_became_peered":"2024-09-17T05:31:39.721986+0000","last_unstale":"2024-09-17T05:31:41.727108+0000","last_undegraded":"2024-09-17T05:31:41.727108+0000","last_fullsized":"2024-09-17T05:31:41.727108+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:24.965085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.744006+0000","last_change":"2024-09-17T05:31:40.736217+0000","last_active":"2024-09-17T05:31:41.744006+0000","last_peered":"2024-09-17T05:31:41.744006+0000","last_clean":"2024-09-17T05:31:41.744006+0000","last_became_active":"2024-09-17T05:31:40.734477+0000","last_became_peered":"2024-09-17T05:31:40.734477+0000","last_unstale":"2024-09-17T05:31:41.744006+0000","last_undegraded":"2024-09-17T05:31:41.744006+0000","last_fullsized":"2024-09-17T05:31:41.744006+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:31.906545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.721583+0000","last_change":"2024-09-17T05:31:39.724761+0000","last_active":"2024-09-17T05:31:41.721583+0000","last_peered":"2024-09-17T05:31:41.721583+0000","last_clean":"2024-09-17T05:31:41.721583+0000","last_became_active":"2024-09-17T05:31:39.724483+0000","last_became_peered":"2024-09-17T05:31:39.724483+0000","last_unstale":"2024-09-17T05:31:41.721583+0000","last_undegraded":"2024-09-17T05:31:41.721583+0000","last_fullsized":"2024-09-17T05:31:41.721583+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:33:38.339163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.746637+0000","last_change":"2024-09-17T05:31:40.739897+0000","last_active":"2024-09-17T05:31:41.746637+0000","last_peered":"2024-09-17T05:31:41.746637+0000","last_clean":"2024-09-17T05:31:41.746637+0000","last_became_active":"2024-09-17T05:31:40.736705+0000","last_became_peered":"2024-09-17T05:31:40.736705+0000","last_unstale":"2024-09-17T05:31:41.746637+0000","last_undegraded":"2024-09-17T05:31:41.746637+0000","last_fullsized":"2024-09-17T05:31:41.746637+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:59.148882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.727936+0000","last_change":"2024-09-17T05:31:39.719627+0000","last_active":"2024-09-17T05:31:41.727936+0000","last_peered":"2024-09-17T05:31:41.727936+0000","last_clean":"2024-09-17T05:31:41.727936+0000","last_became_active":"2024-09-17T05:31:39.718542+0000","last_became_peered":"2024-09-17T05:31:39.718542+0000","last_unstale":"2024-09-17T05:31:41.727936+0000","last_undegraded":"2024-09-17T05:31:41.727936+0000","last_fullsized":"2024-09-17T05:31:41.727936+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:40.286543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.743007+0000","last_change":"2024-09-17T05:31:40.731249+0000","last_active":"2024-09-17T05:31:41.743007+0000","last_peered":"2024-09-17T05:31:41.743007+0000","last_clean":"2024-09-17T05:31:41.743007+0000","last_became_active":"2024-09-17T05:31:40.730705+0000","last_became_peered":"2024-09-17T05:31:40.730705+0000","last_unstale":"2024-09-17T05:31:41.743007+0000","last_undegraded":"2024-09-17T05:31:41.743007+0000","last_fullsized":"2024-09-17T05:31:41.743007+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:54.954318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.726094+0000","last_change":"2024-09-17T05:31:39.727114+0000","last_active":"2024-09-17T05:31:41.726094+0000","last_peered":"2024-09-17T05:31:41.726094+0000","last_clean":"2024-09-17T05:31:41.726094+0000","last_became_active":"2024-09-17T05:31:39.726815+0000","last_became_peered":"2024-09-17T05:31:39.726815+0000","last_unstale":"2024-09-17T05:31:41.726094+0000","last_undegraded":"2024-09-17T05:31:41.726094+0000","last_fullsized":"2024-09-17T05:31:41.726094+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:31.891760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.728221+0000","last_change":"2024-09-17T05:31:40.745346+0000","last_active":"2024-09-17T05:31:41.728221+0000","last_peered":"2024-09-17T05:31:41.728221+0000","last_clean":"2024-09-17T05:31:41.728221+0000","last_became_active":"2024-09-17T05:31:40.745113+0000","last_became_peered":"2024-09-17T05:31:40.745113+0000","last_unstale":"2024-09-17T05:31:41.728221+0000","last_undegraded":"2024-09-17T05:31:41.728221+0000","last_fullsized":"2024-09-17T05:31:41.728221+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:37:28.333783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.747674+0000","last_change":"2024-09-17T05:31:39.734114+0000","last_active":"2024-09-17T05:31:41.747674+0000","last_peered":"2024-09-17T05:31:41.747674+0000","last_clean":"2024-09-17T05:31:41.747674+0000","last_became_active":"2024-09-17T05:31:39.733831+0000","last_became_peered":"2024-09-17T05:31:39.733831+0000","last_unstale":"2024-09-17T05:31:41.747674+0000","last_undegraded":"2024-09-17T05:31:41.747674+0000","last_fullsized":"2024-09-17T05:31:41.747674+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:23.857667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.747011+0000","last_change":"2024-09-17T05:31:40.733462+0000","last_active":"2024-09-17T05:31:41.747011+0000","last_peered":"2024-09-17T05:31:41.747011+0000","last_clean":"2024-09-17T05:31:41.747011+0000","last_became_active":"2024-09-17T05:31:40.733000+0000","last_became_peered":"2024-09-17T05:31:40.733000+0000","last_unstale":"2024-09-17T05:31:41.747011+0000","last_undegraded":"2024-09-17T05:31:41.747011+0000","last_fullsized":"2024-09-17T05:31:41.747011+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:46.794663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.743728+0000","last_change":"2024-09-17T05:31:39.722821+0000","last_active":"2024-09-17T05:31:41.743728+0000","last_peered":"2024-09-17T05:31:41.743728+0000","last_clean":"2024-09-17T05:31:41.743728+0000","last_became_active":"2024-09-17T05:31:39.722520+0000","last_became_peered":"2024-09-17T05:31:39.722520+0000","last_unstale":"2024-09-17T05:31:41.743728+0000","last_undegraded":"2024-09-17T05:31:41.743728+0000","last_fullsized":"2024-09-17T05:31:41.743728+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:15.643262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.743609+0000","last_change":"2024-09-17T05:31:40.733828+0000","last_active":"2024-09-17T05:31:41.743609+0000","last_peered":"2024-09-17T05:31:41.743609+0000","last_clean":"2024-09-17T05:31:41.743609+0000","last_became_active":"2024-09-17T05:31:40.733575+0000","last_became_peered":"2024-09-17T05:31:40.733575+0000","last_unstale":"2024-09-17T05:31:41.743609+0000","last_undegraded":"2024-09-17T05:31:41.743609+0000","last_fullsized":"2024-09-17T05:31:41.743609+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:27.270866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.747464+0000","last_change":"2024-09-17T05:31:39.733235+0000","last_active":"2024-09-17T05:31:41.747464+0000","last_peered":"2024-09-17T05:31:41.747464+0000","last_clean":"2024-09-17T05:31:41.747464+0000","last_became_active":"2024-09-17T05:31:39.732921+0000","last_became_peered":"2024-09-17T05:31:39.732921+0000","last_unstale":"2024-09-17T05:31:41.747464+0000","last_undegraded":"2024-09-17T05:31:41.747464+0000","last_fullsized":"2024-09-17T05:31:41.747464+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:33.921066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.747106+0000","last_change":"2024-09-17T05:31:40.732509+0000","last_active":"2024-09-17T05:31:41.747106+0000","last_peered":"2024-09-17T05:31:41.747106+0000","last_clean":"2024-09-17T05:31:41.747106+0000","last_became_active":"2024-09-17T05:31:40.732172+0000","last_became_peered":"2024-09-17T05:31:40.732172+0000","last_unstale":"2024-09-17T05:31:41.747106+0000","last_undegraded":"2024-09-17T05:31:41.747106+0000","last_fullsized":"2024-09-17T05:31:41.747106+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:01:51.335616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":21,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.727523+0000","last_change":"2024-09-17T05:31:39.725761+0000","last_active":"2024-09-17T05:31:41.727523+0000","last_peered":"2024-09-17T05:31:41.727523+0000","last_clean":"2024-09-17T05:31:41.727523+0000","last_became_active":"2024-09-17T05:31:39.724444+0000","last_became_peered":"2024-09-17T05:31:39.724444+0000","last_unstale":"2024-09-17T05:31:41.727523+0000","last_undegraded":"2024-09-17T05:31:41.727523+0000","last_fullsized":"2024-09-17T05:31:41.727523+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:35.855332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.726529+0000","last_change":"2024-09-17T05:31:40.728304+0000","last_active":"2024-09-17T05:31:41.726529+0000","last_peered":"2024-09-17T05:31:41.726529+0000","last_clean":"2024-09-17T05:31:41.726529+0000","last_became_active":"2024-09-17T05:31:40.727664+0000","last_became_peered":"2024-09-17T05:31:40.727664+0000","last_unstale":"2024-09-17T05:31:41.726529+0000","last_undegraded":"2024-09-17T05:31:41.726529+0000","last_fullsized":"2024-09-17T05:31:41.726529+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:07.136811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.743965+0000","last_change":"2024-09-17T05:31:39.722643+0000","last_active":"2024-09-17T05:31:41.743965+0000","last_peered":"2024-09-17T05:31:41.743965+0000","last_clean":"2024-09-17T05:31:41.743965+0000","last_became_active":"2024-09-17T05:31:39.722353+0000","last_became_peered":"2024-09-17T05:31:39.722353+0000","last_unstale":"2024-09-17T05:31:41.743965+0000","last_undegraded":"2024-09-17T05:31:41.743965+0000","last_fullsized":"2024-09-17T05:31:41.743965+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:13.140746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.746536+0000","last_change":"2024-09-17T05:31:40.734790+0000","last_active":"2024-09-17T05:31:41.746536+0000","last_peered":"2024-09-17T05:31:41.746536+0000","last_clean":"2024-09-17T05:31:41.746536+0000","last_became_active":"2024-09-17T05:31:40.734413+0000","last_became_peered":"2024-09-17T05:31:40.734413+0000","last_unstale":"2024-09-17T05:31:41.746536+0000","last_undegraded":"2024-09-17T05:31:41.746536+0000","last_fullsized":"2024-09-17T05:31:41.746536+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:35.796554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.747547+0000","last_change":"2024-09-17T05:31:39.725413+0000","last_active":"2024-09-17T05:31:41.747547+0000","last_peered":"2024-09-17T05:31:41.747547+0000","last_clean":"2024-09-17T05:31:41.747547+0000","last_became_active":"2024-09-17T05:31:39.725133+0000","last_became_peered":"2024-09-17T05:31:39.725133+0000","last_unstale":"2024-09-17T05:31:41.747547+0000","last_undegraded":"2024-09-17T05:31:41.747547+0000","last_fullsized":"2024-09-17T05:31:41.747547+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:47.930696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.726457+0000","last_change":"2024-09-17T05:31:40.733429+0000","last_active":"2024-09-17T05:31:41.726457+0000","last_peered":"2024-09-17T05:31:41.726457+0000","last_clean":"2024-09-17T05:31:41.726457+0000","last_became_active":"2024-09-17T05:31:40.732990+0000","last_became_peered":"2024-09-17T05:31:40.732990+0000","last_unstale":"2024-09-17T05:31:41.726457+0000","last_undegraded":"2024-09-17T05:31:41.726457+0000","last_fullsized":"2024-09-17T05:31:41.726457+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:30:37.464887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.728060+0000","last_change":"2024-09-17T05:31:39.724970+0000","last_active":"2024-09-17T05:31:41.728060+0000","last_peered":"2024-09-17T05:31:41.728060+0000","last_clean":"2024-09-17T05:31:41.728060+0000","last_became_active":"2024-09-17T05:31:39.724714+0000","last_became_peered":"2024-09-17T05:31:39.724714+0000","last_unstale":"2024-09-17T05:31:41.728060+0000","last_undegraded":"2024-09-17T05:31:41.728060+0000","last_fullsized":"2024-09-17T05:31:41.728060+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:01.398130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.746194+0000","last_change":"2024-09-17T05:31:40.719084+0000","last_active":"2024-09-17T05:31:41.746194+0000","last_peered":"2024-09-17T05:31:41.746194+0000","last_clean":"2024-09-17T05:31:41.746194+0000","last_became_active":"2024-09-17T05:31:40.718440+0000","last_became_peered":"2024-09-17T05:31:40.718440+0000","last_unstale":"2024-09-17T05:31:41.746194+0000","last_undegraded":"2024-09-17T05:31:41.746194+0000","last_fullsized":"2024-09-17T05:31:41.746194+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:39.927015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":23,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.745904+0000","last_change":"2024-09-17T05:31:39.732442+0000","last_active":"2024-09-17T05:31:41.745904+0000","last_peered":"2024-09-17T05:31:41.745904+0000","last_clean":"2024-09-17T05:31:41.745904+0000","last_became_active":"2024-09-17T05:31:39.732125+0000","last_became_peered":"2024-09-17T05:31:39.732125+0000","last_unstale":"2024-09-17T05:31:41.745904+0000","last_undegraded":"2024-09-17T05:31:41.745904+0000","last_fullsized":"2024-09-17T05:31:41.745904+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:19.719009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.747312+0000","last_change":"2024-09-17T05:31:40.737621+0000","last_active":"2024-09-17T05:31:41.747312+0000","last_peered":"2024-09-17T05:31:41.747312+0000","last_clean":"2024-09-17T05:31:41.747312+0000","last_became_active":"2024-09-17T05:31:40.737259+0000","last_became_peered":"2024-09-17T05:31:40.737259+0000","last_unstale":"2024-09-17T05:31:41.747312+0000","last_undegraded":"2024-09-17T05:31:41.747312+0000","last_fullsized":"2024-09-17T05:31:41.747312+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:38.397130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.744612+0000","last_change":"2024-09-17T05:31:39.722884+0000","last_active":"2024-09-17T05:31:41.744612+0000","last_peered":"2024-09-17T05:31:41.744612+0000","last_clean":"2024-09-17T05:31:41.744612+0000","last_became_active":"2024-09-17T05:31:39.722601+0000","last_became_peered":"2024-09-17T05:31:39.722601+0000","last_unstale":"2024-09-17T05:31:41.744612+0000","last_undegraded":"2024-09-17T05:31:41.744612+0000","last_fullsized":"2024-09-17T05:31:41.744612+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:54:16.349702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.726724+0000","last_change":"2024-09-17T05:31:40.727855+0000","last_active":"2024-09-17T05:31:41.726724+0000","last_peered":"2024-09-17T05:31:41.726724+0000","last_clean":"2024-09-17T05:31:41.726724+0000","last_became_active":"2024-09-17T05:31:40.727579+0000","last_became_peered":"2024-09-17T05:31:40.727579+0000","last_unstale":"2024-09-17T05:31:41.726724+0000","last_undegraded":"2024-09-17T05:31:41.726724+0000","last_fullsized":"2024-09-17T05:31:41.726724+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:10.569605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.722435+0000","last_change":"2024-09-17T05:31:39.727415+0000","last_active":"2024-09-17T05:31:41.722435+0000","last_peered":"2024-09-17T05:31:41.722435+0000","last_clean":"2024-09-17T05:31:41.722435+0000","last_became_active":"2024-09-17T05:31:39.727103+0000","last_became_peered":"2024-09-17T05:31:39.727103+0000","last_unstale":"2024-09-17T05:31:41.722435+0000","last_undegraded":"2024-09-17T05:31:41.722435+0000","last_fullsized":"2024-09-17T05:31:41.722435+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:40.286543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.743661+0000","last_change":"2024-09-17T05:31:40.722065+0000","last_active":"2024-09-17T05:31:41.743661+0000","last_peered":"2024-09-17T05:31:41.743661+0000","last_clean":"2024-09-17T05:31:41.743661+0000","last_became_active":"2024-09-17T05:31:40.720580+0000","last_became_peered":"2024-09-17T05:31:40.720580+0000","last_unstale":"2024-09-17T05:31:41.743661+0000","last_undegraded":"2024-09-17T05:31:41.743661+0000","last_fullsized":"2024-09-17T05:31:41.743661+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:52.970372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.727338+0000","last_change":"2024-09-17T05:31:39.730894+0000","last_active":"2024-09-17T05:31:41.727338+0000","last_peered":"2024-09-17T05:31:41.727338+0000","last_clean":"2024-09-17T05:31:41.727338+0000","last_became_active":"2024-09-17T05:31:39.730572+0000","last_became_peered":"2024-09-17T05:31:39.730572+0000","last_unstale":"2024-09-17T05:31:41.727338+0000","last_undegraded":"2024-09-17T05:31:41.727338+0000","last_fullsized":"2024-09-17T05:31:41.727338+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:30.663750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.747321+0000","last_change":"2024-09-17T05:31:40.730605+0000","last_active":"2024-09-17T05:31:41.747321+0000","last_peered":"2024-09-17T05:31:41.747321+0000","last_clean":"2024-09-17T05:31:41.747321+0000","last_became_active":"2024-09-17T05:31:40.728769+0000","last_became_peered":"2024-09-17T05:31:40.728769+0000","last_unstale":"2024-09-17T05:31:41.747321+0000","last_undegraded":"2024-09-17T05:31:41.747321+0000","last_fullsized":"2024-09-17T05:31:41.747321+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:50.083284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.721919+0000","last_change":"2024-09-17T05:31:39.728150+0000","last_active":"2024-09-17T05:31:41.721919+0000","last_peered":"2024-09-17T05:31:41.721919+0000","last_clean":"2024-09-17T05:31:41.721919+0000","last_became_active":"2024-09-17T05:31:39.726017+0000","last_became_peered":"2024-09-17T05:31:39.726017+0000","last_unstale":"2024-09-17T05:31:41.721919+0000","last_undegraded":"2024-09-17T05:31:41.721919+0000","last_fullsized":"2024-09-17T05:31:41.721919+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:42:30.663750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.726788+0000","last_change":"2024-09-17T05:31:40.727949+0000","last_active":"2024-09-17T05:31:41.726788+0000","last_peered":"2024-09-17T05:31:41.726788+0000","last_clean":"2024-09-17T05:31:41.726788+0000","last_became_active":"2024-09-17T05:31:40.727288+0000","last_became_peered":"2024-09-17T05:31:40.727288+0000","last_unstale":"2024-09-17T05:31:41.726788+0000","last_undegraded":"2024-09-17T05:31:41.726788+0000","last_fullsized":"2024-09-17T05:31:41.726788+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:04.300342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.744088+0000","last_change":"2024-09-17T05:31:39.727294+0000","last_active":"2024-09-17T05:31:41.744088+0000","last_peered":"2024-09-17T05:31:41.744088+0000","last_clean":"2024-09-17T05:31:41.744088+0000","last_became_active":"2024-09-17T05:31:39.726952+0000","last_became_peered":"2024-09-17T05:31:39.726952+0000","last_unstale":"2024-09-17T05:31:41.744088+0000","last_undegraded":"2024-09-17T05:31:41.744088+0000","last_fullsized":"2024-09-17T05:31:41.744088+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:25.377281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.721884+0000","last_change":"2024-09-17T05:31:40.733612+0000","last_active":"2024-09-17T05:31:41.721884+0000","last_peered":"2024-09-17T05:31:41.721884+0000","last_clean":"2024-09-17T05:31:41.721884+0000","last_became_active":"2024-09-17T05:31:40.733369+0000","last_became_peered":"2024-09-17T05:31:40.733369+0000","last_unstale":"2024-09-17T05:31:41.721884+0000","last_undegraded":"2024-09-17T05:31:41.721884+0000","last_fullsized":"2024-09-17T05:31:41.721884+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:26.385299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.742843+0000","last_change":"2024-09-17T05:31:39.727446+0000","last_active":"2024-09-17T05:31:41.742843+0000","last_peered":"2024-09-17T05:31:41.742843+0000","last_clean":"2024-09-17T05:31:41.742843+0000","last_became_active":"2024-09-17T05:31:39.727195+0000","last_became_peered":"2024-09-17T05:31:39.727195+0000","last_unstale":"2024-09-17T05:31:41.742843+0000","last_undegraded":"2024-09-17T05:31:41.742843+0000","last_fullsized":"2024-09-17T05:31:41.742843+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:08.348055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.721652+0000","last_change":"2024-09-17T05:31:40.732185+0000","last_active":"2024-09-17T05:31:41.721652+0000","last_peered":"2024-09-17T05:31:41.721652+0000","last_clean":"2024-09-17T05:31:41.721652+0000","last_became_active":"2024-09-17T05:31:40.731933+0000","last_became_peered":"2024-09-17T05:31:40.731933+0000","last_unstale":"2024-09-17T05:31:41.721652+0000","last_undegraded":"2024-09-17T05:31:41.721652+0000","last_fullsized":"2024-09-17T05:31:41.721652+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:10.569605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.726267+0000","last_change":"2024-09-17T05:31:39.722895+0000","last_active":"2024-09-17T05:31:41.726267+0000","last_peered":"2024-09-17T05:31:41.726267+0000","last_clean":"2024-09-17T05:31:41.726267+0000","last_became_active":"2024-09-17T05:31:39.722479+0000","last_became_peered":"2024-09-17T05:31:39.722479+0000","last_unstale":"2024-09-17T05:31:41.726267+0000","last_undegraded":"2024-09-17T05:31:41.726267+0000","last_fullsized":"2024-09-17T05:31:41.726267+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:47.811898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.727506+0000","last_change":"2024-09-17T05:31:40.734459+0000","last_active":"2024-09-17T05:31:41.727506+0000","last_peered":"2024-09-17T05:31:41.727506+0000","last_clean":"2024-09-17T05:31:41.727506+0000","last_became_active":"2024-09-17T05:31:40.734090+0000","last_became_peered":"2024-09-17T05:31:40.734090+0000","last_unstale":"2024-09-17T05:31:41.727506+0000","last_undegraded":"2024-09-17T05:31:41.727506+0000","last_fullsized":"2024-09-17T05:31:41.727506+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:51.386801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.743845+0000","last_change":"2024-09-17T05:31:39.725468+0000","last_active":"2024-09-17T05:31:41.743845+0000","last_peered":"2024-09-17T05:31:41.743845+0000","last_clean":"2024-09-17T05:31:41.743845+0000","last_became_active":"2024-09-17T05:31:39.725210+0000","last_became_peered":"2024-09-17T05:31:39.725210+0000","last_unstale":"2024-09-17T05:31:41.743845+0000","last_undegraded":"2024-09-17T05:31:41.743845+0000","last_fullsized":"2024-09-17T05:31:41.743845+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:47.131007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.727514+0000","last_change":"2024-09-17T05:31:40.727813+0000","last_active":"2024-09-17T05:31:41.727514+0000","last_peered":"2024-09-17T05:31:41.727514+0000","last_clean":"2024-09-17T05:31:41.727514+0000","last_became_active":"2024-09-17T05:31:40.727382+0000","last_became_peered":"2024-09-17T05:31:40.727382+0000","last_unstale":"2024-09-17T05:31:41.727514+0000","last_undegraded":"2024-09-17T05:31:41.727514+0000","last_fullsized":"2024-09-17T05:31:41.727514+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:09.834379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:42.714101+0000","last_change":"2024-09-17T05:31:39.724565+0000","last_active":"2024-09-17T05:31:42.714101+0000","last_peered":"2024-09-17T05:31:42.714101+0000","last_clean":"2024-09-17T05:31:42.714101+0000","last_became_active":"2024-09-17T05:31:39.724286+0000","last_became_peered":"2024-09-17T05:31:39.724286+0000","last_unstale":"2024-09-17T05:31:42.714101+0000","last_undegraded":"2024-09-17T05:31:42.714101+0000","last_fullsized":"2024-09-17T05:31:42.714101+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:01.398130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.743803+0000","last_change":"2024-09-17T05:31:40.729648+0000","last_active":"2024-09-17T05:31:41.743803+0000","last_peered":"2024-09-17T05:31:41.743803+0000","last_clean":"2024-09-17T05:31:41.743803+0000","last_became_active":"2024-09-17T05:31:40.729113+0000","last_became_peered":"2024-09-17T05:31:40.729113+0000","last_unstale":"2024-09-17T05:31:41.743803+0000","last_undegraded":"2024-09-17T05:31:41.743803+0000","last_fullsized":"2024-09-17T05:31:41.743803+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:32.834456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.746851+0000","last_change":"2024-09-17T05:31:39.721392+0000","last_active":"2024-09-17T05:31:41.746851+0000","last_peered":"2024-09-17T05:31:41.746851+0000","last_clean":"2024-09-17T05:31:41.746851+0000","last_became_active":"2024-09-17T05:31:39.721096+0000","last_became_peered":"2024-09-17T05:31:39.721096+0000","last_unstale":"2024-09-17T05:31:41.746851+0000","last_undegraded":"2024-09-17T05:31:41.746851+0000","last_fullsized":"2024-09-17T05:31:41.746851+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:19.711094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.722356+0000","last_change":"2024-09-17T05:31:40.736053+0000","last_active":"2024-09-17T05:31:41.722356+0000","last_peered":"2024-09-17T05:31:41.722356+0000","last_clean":"2024-09-17T05:31:41.722356+0000","last_became_active":"2024-09-17T05:31:40.735799+0000","last_became_peered":"2024-09-17T05:31:40.735799+0000","last_unstale":"2024-09-17T05:31:41.722356+0000","last_undegraded":"2024-09-17T05:31:41.722356+0000","last_fullsized":"2024-09-17T05:31:41.722356+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:01.503945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.727853+0000","last_change":"2024-09-17T05:31:39.718723+0000","last_active":"2024-09-17T05:31:41.727853+0000","last_peered":"2024-09-17T05:31:41.727853+0000","last_clean":"2024-09-17T05:31:41.727853+0000","last_became_active":"2024-09-17T05:31:39.718350+0000","last_became_peered":"2024-09-17T05:31:39.718350+0000","last_unstale":"2024-09-17T05:31:41.727853+0000","last_undegraded":"2024-09-17T05:31:41.727853+0000","last_fullsized":"2024-09-17T05:31:41.727853+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:21.517076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.743418+0000","last_change":"2024-09-17T05:31:40.726405+0000","last_active":"2024-09-17T05:31:41.743418+0000","last_peered":"2024-09-17T05:31:41.743418+0000","last_clean":"2024-09-17T05:31:41.743418+0000","last_became_active":"2024-09-17T05:31:40.726136+0000","last_became_peered":"2024-09-17T05:31:40.726136+0000","last_unstale":"2024-09-17T05:31:41.743418+0000","last_undegraded":"2024-09-17T05:31:41.743418+0000","last_fullsized":"2024-09-17T05:31:41.743418+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:33.469119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.742729+0000","last_change":"2024-09-17T05:31:39.724293+0000","last_active":"2024-09-17T05:31:41.742729+0000","last_peered":"2024-09-17T05:31:41.742729+0000","last_clean":"2024-09-17T05:31:41.742729+0000","last_became_active":"2024-09-17T05:31:39.724023+0000","last_became_peered":"2024-09-17T05:31:39.724023+0000","last_unstale":"2024-09-17T05:31:41.742729+0000","last_undegraded":"2024-09-17T05:31:41.742729+0000","last_fullsized":"2024-09-17T05:31:41.742729+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:19.245077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.746749+0000","last_change":"2024-09-17T05:31:40.718138+0000","last_active":"2024-09-17T05:31:41.746749+0000","last_peered":"2024-09-17T05:31:41.746749+0000","last_clean":"2024-09-17T05:31:41.746749+0000","last_became_active":"2024-09-17T05:31:40.717832+0000","last_became_peered":"2024-09-17T05:31:40.717832+0000","last_unstale":"2024-09-17T05:31:41.746749+0000","last_undegraded":"2024-09-17T05:31:41.746749+0000","last_fullsized":"2024-09-17T05:31:41.746749+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:59.966419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.727873+0000","last_change":"2024-09-17T05:31:39.724650+0000","last_active":"2024-09-17T05:31:41.727873+0000","last_peered":"2024-09-17T05:31:41.727873+0000","last_clean":"2024-09-17T05:31:41.727873+0000","last_became_active":"2024-09-17T05:31:39.724386+0000","last_became_peered":"2024-09-17T05:31:39.724386+0000","last_unstale":"2024-09-17T05:31:41.727873+0000","last_undegraded":"2024-09-17T05:31:41.727873+0000","last_fullsized":"2024-09-17T05:31:41.727873+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:21.449853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.742543+0000","last_change":"2024-09-17T05:31:40.738681+0000","last_active":"2024-09-17T05:31:41.742543+0000","last_peered":"2024-09-17T05:31:41.742543+0000","last_clean":"2024-09-17T05:31:41.742543+0000","last_became_active":"2024-09-17T05:31:40.738345+0000","last_became_peered":"2024-09-17T05:31:40.738345+0000","last_unstale":"2024-09-17T05:31:41.742543+0000","last_undegraded":"2024-09-17T05:31:41.742543+0000","last_fullsized":"2024-09-17T05:31:41.742543+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:25.662451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.742563+0000","last_change":"2024-09-17T05:31:39.721223+0000","last_active":"2024-09-17T05:31:41.742563+0000","last_peered":"2024-09-17T05:31:41.742563+0000","last_clean":"2024-09-17T05:31:41.742563+0000","last_became_active":"2024-09-17T05:31:39.720256+0000","last_became_peered":"2024-09-17T05:31:39.720256+0000","last_unstale":"2024-09-17T05:31:41.742563+0000","last_undegraded":"2024-09-17T05:31:41.742563+0000","last_fullsized":"2024-09-17T05:31:41.742563+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:18.769888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.743037+0000","last_change":"2024-09-17T05:31:40.730934+0000","last_active":"2024-09-17T05:31:41.743037+0000","last_peered":"2024-09-17T05:31:41.743037+0000","last_clean":"2024-09-17T05:31:41.743037+0000","last_became_active":"2024-09-17T05:31:40.730427+0000","last_became_peered":"2024-09-17T05:31:40.730427+0000","last_unstale":"2024-09-17T05:31:41.743037+0000","last_undegraded":"2024-09-17T05:31:41.743037+0000","last_fullsized":"2024-09-17T05:31:41.743037+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:17.520824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.742934+0000","last_change":"2024-09-17T05:31:39.721343+0000","last_active":"2024-09-17T05:31:41.742934+0000","last_peered":"2024-09-17T05:31:41.742934+0000","last_clean":"2024-09-17T05:31:41.742934+0000","last_became_active":"2024-09-17T05:31:39.720040+0000","last_became_peered":"2024-09-17T05:31:39.720040+0000","last_unstale":"2024-09-17T05:31:41.742934+0000","last_undegraded":"2024-09-17T05:31:41.742934+0000","last_fullsized":"2024-09-17T05:31:41.742934+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:29.106609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.742805+0000","last_change":"2024-09-17T05:31:40.717981+0000","last_active":"2024-09-17T05:31:41.742805+0000","last_peered":"2024-09-17T05:31:41.742805+0000","last_clean":"2024-09-17T05:31:41.742805+0000","last_became_active":"2024-09-17T05:31:40.717716+0000","last_became_peered":"2024-09-17T05:31:40.717716+0000","last_unstale":"2024-09-17T05:31:41.742805+0000","last_undegraded":"2024-09-17T05:31:41.742805+0000","last_fullsized":"2024-09-17T05:31:41.742805+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:39.693730+0000","last_clean_scrub_stamp":"2024-09-17T05:31:39.693730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:16:46.430701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.746721+0000","last_change":"2024-09-17T05:31:39.718167+0000","last_active":"2024-09-17T05:31:41.746721+0000","last_peered":"2024-09-17T05:31:41.746721+0000","last_clean":"2024-09-17T05:31:41.746721+0000","last_became_active":"2024-09-17T05:31:39.717862+0000","last_became_peered":"2024-09-17T05:31:39.717862+0000","last_unstale":"2024-09-17T05:31:41.746721+0000","last_undegraded":"2024-09-17T05:31:41.746721+0000","last_fullsized":"2024-09-17T05:31:41.746721+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:31:38.690575+0000","last_clean_scrub_stamp":"2024-09-17T05:31:38.690575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:45.556791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":178,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:31:41.745914+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:31:41.745914+0000","last_peered":"2024-09-17T05:31:41.745914+0000","last_clean":"2024-09-17T05:31:41.745914+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:31:41.745914+0000","last_undegraded":"2024-09-17T05:31:41.745914+0000","last_fullsized":"2024-09-17T05:31:41.745914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1277952,"data_stored":869756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":675840,"data_stored":279228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509482,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31868,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":688128,"data_stored":280840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509482,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":279284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":279284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":679936,"data_stored":279318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":684032,"data_stored":279880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542184,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1286144,"data_stored":871790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:31:45.286 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:31:45.286 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:31:45.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.471+0000 7f9440000640 1 -- 172.21.15.31:0/1134051331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943815f840 msgr2=0x7f943815fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:45.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.471+0000 7f9440000640 1 --2- 172.21.15.31:0/1134051331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943815f840 0x7f943815fcd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f94380763e0 tx=0x7f943001cd60 comp rx=0 tx=0).stop 2024-09-17T05:31:45.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.471+0000 7f9440000640 1 -- 172.21.15.31:0/1134051331 shutdown_connections 2024-09-17T05:31:45.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.471+0000 7f9440000640 1 --2- 172.21.15.31:0/1134051331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943815f840 0x7f943815fcd0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.471+0000 7f9440000640 1 --2- 172.21.15.31:0/1134051331 >> v2:172.21.15.155:3300/0 conn(0x7f94380c6b00 0x7f943806d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.471+0000 7f9440000640 1 --2- 172.21.15.31:0/1134051331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9438152b90 0x7f943806f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.471+0000 7f9440000640 1 -- 172.21.15.31:0/1134051331 >> 172.21.15.31:0/1134051331 conn(0x7f94380cce90 msgr2=0x7f94380cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:45.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.471+0000 7f9440000640 1 -- 172.21.15.31:0/1134051331 shutdown_connections 2024-09-17T05:31:45.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.471+0000 7f9440000640 1 -- 172.21.15.31:0/1134051331 wait complete. 2024-09-17T05:31:45.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.471+0000 7f9440000640 1 Processor -- start 2024-09-17T05:31:45.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.471+0000 7f9440000640 1 -- start start 2024-09-17T05:31:45.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.471+0000 7f9440000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94380c6b00 0x7f94381fb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:45.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.471+0000 7f9440000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9438152b90 0x7f94381455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:45.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.471+0000 7f9440000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943815f840 0x7f94380ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:45.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.471+0000 7f9440000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f943815c3d0 con 0x7f943815f840 2024-09-17T05:31:45.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.471+0000 7f9440000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f943815c250 con 0x7f9438152b90 2024-09-17T05:31:45.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.471+0000 7f9440000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f943815c550 con 0x7f94380c6b00 2024-09-17T05:31:45.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.475+0000 7f943e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943815f840 0x7f94380ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.475+0000 7f943e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943815f840 0x7f94380ce8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54662/0 (socket says 172.21.15.31:54662) 2024-09-17T05:31:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.475+0000 7f943e000640 1 -- 172.21.15.31:0/1059328615 learned_addr learned my addr 172.21.15.31:0/1059328615 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.475+0000 7f943d600640 1 --2- 172.21.15.31:0/1059328615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94380c6b00 0x7f94381fb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.475+0000 7f943cc00640 1 --2- 172.21.15.31:0/1059328615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9438152b90 0x7f94381455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.475+0000 7f943e000640 1 -- 172.21.15.31:0/1059328615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94380c6b00 msgr2=0x7f94381fb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.475+0000 7f943e000640 1 --2- 172.21.15.31:0/1059328615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94380c6b00 0x7f94381fb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.475+0000 7f943e000640 1 -- 172.21.15.31:0/1059328615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9438152b90 msgr2=0x7f94381455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.475+0000 7f943e000640 1 --2- 172.21.15.31:0/1059328615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9438152b90 0x7f94381455a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.475+0000 7f943e000640 1 -- 172.21.15.31:0/1059328615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94381fbd80 con 0x7f943815f840 2024-09-17T05:31:45.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.475+0000 7f943e000640 1 --2- 172.21.15.31:0/1059328615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943815f840 0x7f94380ce8f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f943001d600 tx=0x7f9430009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:45.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.475+0000 7f9435600640 1 -- 172.21.15.31:0/1059328615 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94300bb070 con 0x7f943815f840 2024-09-17T05:31:45.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.475+0000 7f9435600640 1 -- 172.21.15.31:0/1059328615 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9430004d40 con 0x7f943815f840 2024-09-17T05:31:45.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.475+0000 7f9440000640 1 -- 172.21.15.31:0/1059328615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94380cfa40 con 0x7f943815f840 2024-09-17T05:31:45.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.475+0000 7f9435600640 1 -- 172.21.15.31:0/1059328615 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94300b2040 con 0x7f943815f840 2024-09-17T05:31:45.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.475+0000 7f9440000640 1 -- 172.21.15.31:0/1059328615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94380ce0f0 con 0x7f943815f840 2024-09-17T05:31:45.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.475+0000 7f9440000640 1 -- 172.21.15.31:0/1059328615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f943806f090 con 0x7f943815f840 2024-09-17T05:31:45.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.475+0000 7f9435600640 1 -- 172.21.15.31:0/1059328615 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f94300be070 con 0x7f943815f840 2024-09-17T05:31:45.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.479+0000 7f9435600640 1 --2- 172.21.15.31:0/1059328615 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f94180733b0 0x7f9418075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:45.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.479+0000 7f9435600640 1 -- 172.21.15.31:0/1059328615 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f943012e0f0 con 0x7f943815f840 2024-09-17T05:31:45.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.479+0000 7f943d600640 1 --2- 172.21.15.31:0/1059328615 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f94180733b0 0x7f9418075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:45.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.479+0000 7f943d600640 1 --2- 172.21.15.31:0/1059328615 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f94180733b0 0x7f9418075870 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f942c00bb80 tx=0x7f942c00b390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:45.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.479+0000 7f9435600640 1 -- 172.21.15.31:0/1059328615 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9430016950 con 0x7f943815f840 2024-09-17T05:31:45.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.723+0000 7f9440000640 1 -- 172.21.15.31:0/1059328615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f943814c950 con 0x7f943815f840 2024-09-17T05:31:45.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.723+0000 7f9435600640 1 -- 172.21.15.31:0/1059328615 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f94300f8860 con 0x7f943815f840 2024-09-17T05:31:45.730 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-09-17T05:31:45.730 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw== 2024-09-17T05:31:45.730 INFO:teuthology.orchestra.run.smithi031.stdout: caps mds = "allow" 2024-09-17T05:31:45.730 INFO:teuthology.orchestra.run.smithi031.stdout: caps mon = "allow r" 2024-09-17T05:31:45.730 INFO:teuthology.orchestra.run.smithi031.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:31:45.730 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2024-09-17T05:31:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.727+0000 7f9440000640 1 -- 172.21.15.31:0/1059328615 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f94180733b0 msgr2=0x7f9418075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.727+0000 7f9440000640 1 --2- 172.21.15.31:0/1059328615 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f94180733b0 0x7f9418075870 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f942c00bb80 tx=0x7f942c00b390 comp rx=0 tx=0).stop 2024-09-17T05:31:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.727+0000 7f9440000640 1 -- 172.21.15.31:0/1059328615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943815f840 msgr2=0x7f94380ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.727+0000 7f9440000640 1 --2- 172.21.15.31:0/1059328615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943815f840 0x7f94380ce8f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f943001d600 tx=0x7f9430009350 comp rx=0 tx=0).stop 2024-09-17T05:31:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.727+0000 7f9440000640 1 -- 172.21.15.31:0/1059328615 shutdown_connections 2024-09-17T05:31:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.727+0000 7f9440000640 1 --2- 172.21.15.31:0/1059328615 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f94180733b0 0x7f9418075870 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.727+0000 7f9440000640 1 --2- 172.21.15.31:0/1059328615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f943815f840 0x7f94380ce8f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.727+0000 7f9440000640 1 --2- 172.21.15.31:0/1059328615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9438152b90 0x7f94381455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.727+0000 7f9440000640 1 --2- 172.21.15.31:0/1059328615 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94380c6b00 0x7f94381fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.727+0000 7f9440000640 1 -- 172.21.15.31:0/1059328615 >> 172.21.15.31:0/1059328615 conn(0x7f94380cce90 msgr2=0x7f943815e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:45.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.727+0000 7f9440000640 1 -- 172.21.15.31:0/1059328615 shutdown_connections 2024-09-17T05:31:45.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.727+0000 7f9440000640 1 -- 172.21.15.31:0/1059328615 wait complete. 2024-09-17T05:31:45.755 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:31:45.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.895+0000 7fc01d000640 1 -- 172.21.15.31:0/4292655134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0180cffc0 msgr2=0x7fc018073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:45.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.895+0000 7fc01d000640 1 --2- 172.21.15.31:0/4292655134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0180cffc0 0x7fc018073ed0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc000009840 tx=0x7fc00001c7f0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.895+0000 7fc01d000640 1 -- 172.21.15.31:0/4292655134 shutdown_connections 2024-09-17T05:31:45.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.895+0000 7fc01d000640 1 --2- 172.21.15.31:0/4292655134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc01806f9a0 0x7fc01806fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.895+0000 7fc01d000640 1 --2- 172.21.15.31:0/4292655134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0180cffc0 0x7fc018073ed0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.895+0000 7fc01d000640 1 -- 172.21.15.31:0/4292655134 >> 172.21.15.31:0/4292655134 conn(0x7fc0180d0c90 msgr2=0x7fc0180d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:45.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.895+0000 7fc01d000640 1 -- 172.21.15.31:0/4292655134 shutdown_connections 2024-09-17T05:31:45.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.895+0000 7fc01d000640 1 -- 172.21.15.31:0/4292655134 wait complete. 2024-09-17T05:31:45.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc01d000640 1 Processor -- start 2024-09-17T05:31:45.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc01d000640 1 -- start start 2024-09-17T05:31:45.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc01d000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc01806f9a0 0x7fc0180737a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:45.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc01d000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0180cffc0 0x7fc018073ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:45.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc01d000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc01815af60 0x7fc018155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:45.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc01d000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc018167cc0 con 0x7fc0180cffc0 2024-09-17T05:31:45.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc01d000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc018167b40 con 0x7fc01806f9a0 2024-09-17T05:31:45.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc01d000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc018167e40 con 0x7fc01815af60 2024-09-17T05:31:45.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc00fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0180cffc0 0x7fc018073ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:45.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc00fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0180cffc0 0x7fc018073ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54680/0 (socket says 172.21.15.31:54680) 2024-09-17T05:31:45.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc00fe00640 1 -- 172.21.15.31:0/2762898750 learned_addr learned my addr 172.21.15.31:0/2762898750 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:45.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc015e00640 1 --2- 172.21.15.31:0/2762898750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc01806f9a0 0x7fc0180737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:45.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc016800640 1 --2- 172.21.15.31:0/2762898750 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc01815af60 0x7fc018155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:45.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc00fe00640 1 -- 172.21.15.31:0/2762898750 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc01815af60 msgr2=0x7fc018155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:45.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc00fe00640 1 --2- 172.21.15.31:0/2762898750 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc01815af60 0x7fc018155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc00fe00640 1 -- 172.21.15.31:0/2762898750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc01806f9a0 msgr2=0x7fc0180737a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:45.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc00fe00640 1 --2- 172.21.15.31:0/2762898750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc01806f9a0 0x7fc0180737a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:45.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc00fe00640 1 -- 172.21.15.31:0/2762898750 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc018156f00 con 0x7fc0180cffc0 2024-09-17T05:31:45.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc00fe00640 1 --2- 172.21.15.31:0/2762898750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0180cffc0 0x7fc018073ce0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc000009790 tx=0x7fc000004220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:45.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc00e000640 1 -- 172.21.15.31:0/2762898750 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0000bb070 con 0x7fc0180cffc0 2024-09-17T05:31:45.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc00e000640 1 -- 172.21.15.31:0/2762898750 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc000005320 con 0x7fc0180cffc0 2024-09-17T05:31:45.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc00e000640 1 -- 172.21.15.31:0/2762898750 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0000b2040 con 0x7fc0180cffc0 2024-09-17T05:31:45.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc01d000640 1 -- 172.21.15.31:0/2762898750 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0181f8d20 con 0x7fc0180cffc0 2024-09-17T05:31:45.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.899+0000 7fc01d000640 1 -- 172.21.15.31:0/2762898750 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0180c3d50 con 0x7fc0180cffc0 2024-09-17T05:31:45.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.903+0000 7fc01d000640 1 -- 172.21.15.31:0/2762898750 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc01806fe00 con 0x7fc0180cffc0 2024-09-17T05:31:45.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.903+0000 7fc00e000640 1 -- 172.21.15.31:0/2762898750 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7fc0000a5810 con 0x7fc0180cffc0 2024-09-17T05:31:45.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.903+0000 7fc00e000640 1 --2- 172.21.15.31:0/2762898750 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbff40733b0 0x7fbff4075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:45.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.903+0000 7fc00e000640 1 -- 172.21.15.31:0/2762898750 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fc00012e160 con 0x7fc0180cffc0 2024-09-17T05:31:45.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.903+0000 7fc015e00640 1 --2- 172.21.15.31:0/2762898750 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbff40733b0 0x7fbff4075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:45.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.903+0000 7fc015e00640 1 --2- 172.21.15.31:0/2762898750 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbff40733b0 0x7fbff4075870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc0080015f0 tx=0x7fc008009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:45.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:45.907+0000 7fc00e000640 1 -- 172.21.15.31:0/2762898750 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc000016410 con 0x7fc0180cffc0 2024-09-17T05:31:46.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.123+0000 7fc01d000640 1 -- 172.21.15.31:0/2762898750 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0180ca900 con 0x7fc0180cffc0 2024-09-17T05:31:46.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.123+0000 7fc00e000640 1 -- 172.21.15.31:0/2762898750 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5229 (secure 0 0 0) 0x7fc0000f8de0 con 0x7fc0180cffc0 2024-09-17T05:31:46.128 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:46.128 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":38,"btime":"2024-09-17T05:31:43:727701+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/3185006969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3185006969},{"type":"v1","addr":"172.21.15.155:6836","nonce":3185006969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3957768567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3957768567},{"type":"v1","addr":"172.21.15.155:6837","nonce":3957768567}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5748,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3936847081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3936847081},{"type":"v1","addr":"172.21.15.31:6833","nonce":3936847081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:31:40.115955+0000","modified":"2024-09-17T05:31:43.131088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1272884249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1272884249},{"type":"v1","addr":"172.21.15.31:6835","nonce":1272884249}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5751,"qdb_cluster":[5751]},"id":4}]} 2024-09-17T05:31:46.128 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 38 2024-09-17T05:31:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.123+0000 7fc01d000640 1 -- 172.21.15.31:0/2762898750 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbff40733b0 msgr2=0x7fbff4075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.123+0000 7fc01d000640 1 --2- 172.21.15.31:0/2762898750 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbff40733b0 0x7fbff4075870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc0080015f0 tx=0x7fc008009040 comp rx=0 tx=0).stop 2024-09-17T05:31:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.123+0000 7fc01d000640 1 -- 172.21.15.31:0/2762898750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0180cffc0 msgr2=0x7fc018073ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.123+0000 7fc01d000640 1 --2- 172.21.15.31:0/2762898750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0180cffc0 0x7fc018073ce0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc000009790 tx=0x7fc000004220 comp rx=0 tx=0).stop 2024-09-17T05:31:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.123+0000 7fc01d000640 1 -- 172.21.15.31:0/2762898750 shutdown_connections 2024-09-17T05:31:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.123+0000 7fc01d000640 1 --2- 172.21.15.31:0/2762898750 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbff40733b0 0x7fbff4075870 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.123+0000 7fc01d000640 1 --2- 172.21.15.31:0/2762898750 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc01815af60 0x7fc018155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.123+0000 7fc01d000640 1 --2- 172.21.15.31:0/2762898750 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0180cffc0 0x7fc018073ce0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.123+0000 7fc01d000640 1 --2- 172.21.15.31:0/2762898750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc01806f9a0 0x7fc0180737a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.123+0000 7fc01d000640 1 -- 172.21.15.31:0/2762898750 >> 172.21.15.31:0/2762898750 conn(0x7fc0180d0c90 msgr2=0x7fc018159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:46.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.123+0000 7fc01d000640 1 -- 172.21.15.31:0/2762898750 shutdown_connections 2024-09-17T05:31:46.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.123+0000 7fc01d000640 1 -- 172.21.15.31:0/2762898750 wait complete. 2024-09-17T05:31:46.553 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:31:40.115955+0000', 'modified': '2024-09-17T05:31:43.131088+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5751}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5751': {'gid': 5751, 'name': 'a', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/1272884249', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 1272884249}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 1272884249}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5751, 'qdb_cluster': [5751]} 2024-09-17T05:31:46.553 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:31:46.553 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T05:31:46.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff363e00640 1 -- 172.21.15.31:0/4215899915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff348003c70 msgr2=0x7ff348004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:46.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff363e00640 1 --2- 172.21.15.31:0/4215899915 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff348003c70 0x7ff348004070 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff354006f00 tx=0x7ff35401ce80 comp rx=0 tx=0).stop 2024-09-17T05:31:46.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff363400640 1 -- 172.21.15.31:0/4215899915 reap_dead start 2024-09-17T05:31:46.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff363e00640 1 -- 172.21.15.31:0/4215899915 shutdown_connections 2024-09-17T05:31:46.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff363e00640 1 -- 172.21.15.31:0/4215899915 >> 172.21.15.31:0/4215899915 conn(0x7ff3640d3dd0 msgr2=0x7ff3640d41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:46.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff363e00640 1 -- 172.21.15.31:0/4215899915 shutdown_connections 2024-09-17T05:31:46.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff363e00640 1 -- 172.21.15.31:0/4215899915 wait complete. 2024-09-17T05:31:46.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff363e00640 1 Processor -- start 2024-09-17T05:31:46.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff363e00640 1 -- start start 2024-09-17T05:31:46.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff363e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff348003c70 0x7ff36415cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff363e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3641f8460 0x7ff3640b4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff363e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3641f78c0 0x7ff3641f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff363e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff3640b62f0 con 0x7ff348003c70 2024-09-17T05:31:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff363e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3640b6170 con 0x7ff3641f8460 2024-09-17T05:31:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff363e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3640b6470 con 0x7ff3641f78c0 2024-09-17T05:31:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff362a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff348003c70 0x7ff36415cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff362a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff348003c70 0x7ff36415cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54702/0 (socket says 172.21.15.31:54702) 2024-09-17T05:31:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff362a00640 1 -- 172.21.15.31:0/692450362 learned_addr learned my addr 172.21.15.31:0/692450362 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff362000640 1 --2- 172.21.15.31:0/692450362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3641f8460 0x7ff3640b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff363400640 1 --2- 172.21.15.31:0/692450362 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3641f78c0 0x7ff3641f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff362a00640 1 -- 172.21.15.31:0/692450362 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3641f78c0 msgr2=0x7ff3641f7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff362a00640 1 --2- 172.21.15.31:0/692450362 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3641f78c0 0x7ff3641f7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff362a00640 1 -- 172.21.15.31:0/692450362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3641f8460 msgr2=0x7ff3640b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff362a00640 1 --2- 172.21.15.31:0/692450362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3641f8460 0x7ff3640b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff362a00640 1 -- 172.21.15.31:0/692450362 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3640a11f0 con 0x7ff348003c70 2024-09-17T05:31:46.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff363400640 1 --2- 172.21.15.31:0/692450362 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3641f78c0 0x7ff3641f7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:31:46.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.699+0000 7ff362a00640 1 --2- 172.21.15.31:0/692450362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff348003c70 0x7ff36415cfa0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff35401c940 tx=0x7ff354006b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:46.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.703+0000 7ff35aa00640 1 -- 172.21.15.31:0/692450362 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff354001500 con 0x7ff348003c70 2024-09-17T05:31:46.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.703+0000 7ff35aa00640 1 -- 172.21.15.31:0/692450362 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3540016a0 con 0x7ff348003c70 2024-09-17T05:31:46.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.703+0000 7ff35aa00640 1 -- 172.21.15.31:0/692450362 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3540064a0 con 0x7ff348003c70 2024-09-17T05:31:46.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.703+0000 7ff363e00640 1 -- 172.21.15.31:0/692450362 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3640cd0b0 con 0x7ff348003c70 2024-09-17T05:31:46.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.703+0000 7ff363e00640 1 -- 172.21.15.31:0/692450362 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3640cd650 con 0x7ff348003c70 2024-09-17T05:31:46.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.703+0000 7ff35aa00640 1 -- 172.21.15.31:0/692450362 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7ff354003600 con 0x7ff348003c70 2024-09-17T05:31:46.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.703+0000 7ff35aa00640 1 --2- 172.21.15.31:0/692450362 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff3440733b0 0x7ff344075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.703+0000 7ff35aa00640 1 -- 172.21.15.31:0/692450362 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7ff35412d9f0 con 0x7ff348003c70 2024-09-17T05:31:46.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.703+0000 7ff36caa5000 1 Processor -- start 2024-09-17T05:31:46.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff36caa5000 1 -- start start 2024-09-17T05:31:46.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff362000640 1 --2- 172.21.15.31:0/692450362 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff3440733b0 0x7ff344075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff362000640 1 --2- 172.21.15.31:0/692450362 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff3440733b0 0x7ff344075870 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff3640a1c50 tx=0x7ff3500091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:46.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff36caa5000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95fdc9d0 0x559e95fdcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff36caa5000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95fdd2f0 0x559e95f908d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff36caa5000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95f90e10 0x559e95f911f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff36caa5000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559e95eb13f0 con 0x559e95f90e10 2024-09-17T05:31:46.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff36caa5000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559e95deeb20 con 0x559e95fdd2f0 2024-09-17T05:31:46.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff36caa5000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x559e95dddf50 con 0x559e95fdc9d0 2024-09-17T05:31:46.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff363400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95f90e10 0x559e95f911f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff363400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95f90e10 0x559e95f911f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54708/0 (socket says 172.21.15.31:54708) 2024-09-17T05:31:46.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff363400640 1 -- 172.21.15.31:0/524162337 learned_addr learned my addr 172.21.15.31:0/524162337 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:46.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff362000640 1 --2- 172.21.15.31:0/524162337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95fdd2f0 0x559e95f908d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff362a00640 1 --2- 172.21.15.31:0/524162337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95fdc9d0 0x559e95fdcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff363400640 1 -- 172.21.15.31:0/524162337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95fdc9d0 msgr2=0x559e95fdcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:31:46.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff363400640 1 --2- 172.21.15.31:0/524162337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95fdc9d0 0x559e95fdcdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff363400640 1 -- 172.21.15.31:0/524162337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95fdd2f0 msgr2=0x559e95f908d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:31:46.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff363400640 1 --2- 172.21.15.31:0/524162337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95fdd2f0 0x559e95f908d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff363400640 1 -- 172.21.15.31:0/524162337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e95da5590 con 0x559e95f90e10 2024-09-17T05:31:46.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff363400640 1 --2- 172.21.15.31:0/524162337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95f90e10 0x559e95f911f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff36406ff10 tx=0x7ff35c006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d4a2bf14bf81b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:46.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff34f400640 1 -- 172.21.15.31:0/524162337 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c013650 con 0x559e95f90e10 2024-09-17T05:31:46.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff34f400640 1 -- 172.21.15.31:0/524162337 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff35c017030 con 0x559e95f90e10 2024-09-17T05:31:46.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff34f400640 1 -- 172.21.15.31:0/524162337 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c013b80 con 0x559e95f90e10 2024-09-17T05:31:46.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff36caa5000 1 -- 172.21.15.31:0/524162337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95f90e10 msgr2=0x559e95f911f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:46.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff36caa5000 1 --2- 172.21.15.31:0/524162337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95f90e10 0x559e95f911f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff36406ff10 tx=0x7ff35c006420 comp rx=0 tx=0).stop 2024-09-17T05:31:46.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff36caa5000 1 -- 172.21.15.31:0/524162337 shutdown_connections 2024-09-17T05:31:46.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff36caa5000 1 --2- 172.21.15.31:0/524162337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95f90e10 0x559e95f911f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff36caa5000 1 --2- 172.21.15.31:0/524162337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95fdd2f0 0x559e95f908d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff36caa5000 1 --2- 172.21.15.31:0/524162337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95fdc9d0 0x559e95fdcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff36caa5000 1 -- 172.21.15.31:0/524162337 >> 172.21.15.31:0/524162337 conn(0x559e95e7a130 msgr2=0x559e95fbfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:46.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff36caa5000 1 -- 172.21.15.31:0/524162337 shutdown_connections 2024-09-17T05:31:46.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff36caa5000 1 -- 172.21.15.31:0/524162337 wait complete. 2024-09-17T05:31:46.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff36caa5000 1 -- start start 2024-09-17T05:31:46.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.707+0000 7ff36caa5000 1 Processor -- start 2024-09-17T05:31:46.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff36caa5000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95f90e10 0x559e95fbd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff36caa5000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95fdc9d0 0x559e95fbde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff36caa5000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95fdd2f0 0x559e95fbe3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff36caa5000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559e95d785d0 con 0x559e95fdd2f0 2024-09-17T05:31:46.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff36caa5000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559e95de1d60 con 0x559e95fdc9d0 2024-09-17T05:31:46.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff36caa5000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x559e95d84500 con 0x559e95f90e10 2024-09-17T05:31:46.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff36caa5000 10 client.0 _ll_register_callbacks cb 0x559e95d88810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:31:46.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff363400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95fdd2f0 0x559e95fbe3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff363400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95fdd2f0 0x559e95fbe3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54720/0 (socket says 172.21.15.31:54720) 2024-09-17T05:31:46.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff363400640 1 -- 172.21.15.31:0/672210410 learned_addr learned my addr 172.21.15.31:0/672210410 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:46.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff362a00640 1 --2- 172.21.15.31:0/672210410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95f90e10 0x559e95fbd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff362000640 1 --2- 172.21.15.31:0/672210410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95fdc9d0 0x559e95fbde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff363400640 1 -- 172.21.15.31:0/672210410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95f90e10 msgr2=0x559e95fbd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:31:46.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff363400640 1 --2- 172.21.15.31:0/672210410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95f90e10 0x559e95fbd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff363400640 1 -- 172.21.15.31:0/672210410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95fdc9d0 msgr2=0x559e95fbde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:31:46.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff363400640 1 --2- 172.21.15.31:0/672210410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95fdc9d0 0x559e95fbde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff363400640 1 -- 172.21.15.31:0/672210410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e95d7c170 con 0x559e95fdd2f0 2024-09-17T05:31:46.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff362000640 1 --2- 172.21.15.31:0/672210410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95fdc9d0 0x559e95fbde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:31:46.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff363400640 1 --2- 172.21.15.31:0/672210410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95fdd2f0 0x559e95fbe3b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff3640d4db0 tx=0x7ff35c00abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12ff489020231aa server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:46.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff343e00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:31:46.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff343e00640 1 -- 172.21.15.31:0/672210410 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c013920 con 0x559e95fdd2f0 2024-09-17T05:31:46.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff36caa5000 1 -- 172.21.15.31:0/672210410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559e95d760f0 con 0x559e95fdd2f0 2024-09-17T05:31:46.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff343e00640 1 -- 172.21.15.31:0/672210410 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7ff35c013ac0 con 0x559e95fdd2f0 2024-09-17T05:31:46.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff343e00640 1 -- 172.21.15.31:0/672210410 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ff35c031050 con 0x559e95fdd2f0 2024-09-17T05:31:46.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff36caa5000 10 client.5889 fetch_fsmap learned FSMap version 38 2024-09-17T05:31:46.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff36caa5000 1 -- 172.21.15.31:0/672210410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x559e95e62ef0 con 0x559e95fdd2f0 2024-09-17T05:31:46.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff343e00640 1 -- 172.21.15.31:0/672210410 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x559e95d760f0 con 0x559e95fdd2f0 2024-09-17T05:31:46.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff343e00640 1 -- 172.21.15.31:0/672210410 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 38) ==== 3502+0+0 (secure 0 0 0) 0x7ff35c034020 con 0x559e95fdd2f0 2024-09-17T05:31:46.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff36caa5000 10 client.5889 fetch_fsmap finished waiting for FSMap version 38 2024-09-17T05:31:46.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff36caa5000 10 client.5889 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:31:46.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff36caa5000 20 client.5889 populate_metadata read hostname 'smithi031' 2024-09-17T05:31:46.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff36caa5000 1 --2- 172.21.15.31:0/672210410 >> [v2:172.21.15.31:6834/1272884249,v1:172.21.15.31:6835/1272884249] conn(0x559e95fbf0f0 0x559e95feec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff36caa5000 4 client.5889 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:31:46.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff36caa5000 1 -- 172.21.15.31:0/672210410 --> [v2:172.21.15.31:6834/1272884249,v1:172.21.15.31:6835/1272884249] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e95df0a70 con 0x559e95fbf0f0 2024-09-17T05:31:46.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff362a00640 1 --2- 172.21.15.31:0/672210410 >> [v2:172.21.15.31:6834/1272884249,v1:172.21.15.31:6835/1272884249] conn(0x559e95fbf0f0 0x559e95feec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff362a00640 1 --2- 172.21.15.31:0/672210410 >> [v2:172.21.15.31:6834/1272884249,v1:172.21.15.31:6835/1272884249] conn(0x559e95fbf0f0 0x559e95feec90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0401bf980dc28b9 server_cookie=a15b06ef38df00c9 in_seq=0 out_seq=0 2024-09-17T05:31:46.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.711+0000 7ff343e00640 10 client.5889 ms_handle_connect on v2:172.21.15.31:6834/1272884249 2024-09-17T05:31:46.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.715+0000 7ff343e00640 1 -- 172.21.15.31:0/672210410 <== mds.0 v2:172.21.15.31:6834/1272884249 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559e95df0a70 con 0x559e95fbf0f0 2024-09-17T05:31:46.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.715+0000 7ff343e00640 10 client.5889 handle_command_reply: tid=0 2024-09-17T05:31:46.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.715+0000 7ff36caa5000 1 client.5889 shutdown 2024-09-17T05:31:46.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.715+0000 7ff36caa5000 1 -- 172.21.15.31:0/672210410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95fdd2f0 msgr2=0x559e95fbe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:46.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.715+0000 7ff36caa5000 1 --2- 172.21.15.31:0/672210410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95fdd2f0 0x559e95fbe3b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff3640d4db0 tx=0x7ff35c00abc0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.715+0000 7ff36caa5000 1 -- 172.21.15.31:0/672210410 shutdown_connections 2024-09-17T05:31:46.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.715+0000 7ff36caa5000 1 --2- 172.21.15.31:0/672210410 >> [v2:172.21.15.31:6834/1272884249,v1:172.21.15.31:6835/1272884249] conn(0x559e95fbf0f0 0x559e95feec90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.715+0000 7ff36caa5000 1 --2- 172.21.15.31:0/672210410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95fdd2f0 0x559e95fbe3b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.715+0000 7ff36caa5000 1 --2- 172.21.15.31:0/672210410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95fdc9d0 0x559e95fbde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.715+0000 7ff343e00640 0 client.5889 ms_handle_reset on v2:172.21.15.31:6834/1272884249 2024-09-17T05:31:46.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.715+0000 7ff36caa5000 1 --2- 172.21.15.31:0/672210410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95f90e10 0x559e95fbd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.715+0000 7ff36caa5000 1 -- 172.21.15.31:0/672210410 >> 172.21.15.31:0/672210410 conn(0x559e95e7a130 msgr2=0x559e95f8ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:46.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.715+0000 7ff36caa5000 1 -- 172.21.15.31:0/672210410 shutdown_connections 2024-09-17T05:31:46.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.715+0000 7ff36caa5000 1 -- 172.21.15.31:0/672210410 wait complete. 2024-09-17T05:31:46.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.715+0000 7ff36caa5000 20 client.5889 trim_cache size 0 max 16384 2024-09-17T05:31:46.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.731+0000 7ff36caa5000 1 Processor -- start 2024-09-17T05:31:46.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.731+0000 7ff36caa5000 1 -- start start 2024-09-17T05:31:46.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff36caa5000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95f90e10 0x559e95fdbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff36caa5000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95fdc9d0 0x559e95fdc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff36caa5000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95fdd2f0 0x559e95f8f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff36caa5000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff3642015b0 con 0x559e95f90e10 2024-09-17T05:31:46.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff36caa5000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3642005d0 con 0x559e95fdc9d0 2024-09-17T05:31:46.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff36caa5000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3640cc6a0 con 0x559e95fdd2f0 2024-09-17T05:31:46.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff362a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95f90e10 0x559e95fdbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff362a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95f90e10 0x559e95fdbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54732/0 (socket says 172.21.15.31:54732) 2024-09-17T05:31:46.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff362a00640 1 -- 172.21.15.31:0/776977038 learned_addr learned my addr 172.21.15.31:0/776977038 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:46.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff362000640 1 --2- 172.21.15.31:0/776977038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95fdc9d0 0x559e95fdc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff363400640 1 --2- 172.21.15.31:0/776977038 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95fdd2f0 0x559e95f8f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff362a00640 1 -- 172.21.15.31:0/776977038 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95fdd2f0 msgr2=0x559e95f8f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:31:46.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff362a00640 1 --2- 172.21.15.31:0/776977038 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95fdd2f0 0x559e95f8f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff362a00640 1 -- 172.21.15.31:0/776977038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95fdc9d0 msgr2=0x559e95fdc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:31:46.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff362a00640 1 --2- 172.21.15.31:0/776977038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95fdc9d0 0x559e95fdc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff362a00640 1 -- 172.21.15.31:0/776977038 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e95e39d90 con 0x559e95f90e10 2024-09-17T05:31:46.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff362a00640 1 --2- 172.21.15.31:0/776977038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95f90e10 0x559e95fdbcc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff3540f7e80 tx=0x7ff3540ff040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811c8added51cc81 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:46.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff34ea00640 1 -- 172.21.15.31:0/776977038 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3540f7660 con 0x559e95f90e10 2024-09-17T05:31:46.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff34ea00640 1 -- 172.21.15.31:0/776977038 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3540f85f0 con 0x559e95f90e10 2024-09-17T05:31:46.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff34ea00640 1 -- 172.21.15.31:0/776977038 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3540f7ef0 con 0x559e95f90e10 2024-09-17T05:31:46.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff36caa5000 1 -- 172.21.15.31:0/776977038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95f90e10 msgr2=0x559e95fdbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:46.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff36caa5000 1 --2- 172.21.15.31:0/776977038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95f90e10 0x559e95fdbcc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff3540f7e80 tx=0x7ff3540ff040 comp rx=0 tx=0).stop 2024-09-17T05:31:46.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff36caa5000 1 -- 172.21.15.31:0/776977038 shutdown_connections 2024-09-17T05:31:46.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff36caa5000 1 --2- 172.21.15.31:0/776977038 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95fdd2f0 0x559e95f8f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff36caa5000 1 --2- 172.21.15.31:0/776977038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95fdc9d0 0x559e95fdc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff36caa5000 1 --2- 172.21.15.31:0/776977038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95f90e10 0x559e95fdbcc0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff36caa5000 1 -- 172.21.15.31:0/776977038 >> 172.21.15.31:0/776977038 conn(0x559e95e7a130 msgr2=0x559e95fdb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:46.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff36caa5000 1 -- 172.21.15.31:0/776977038 shutdown_connections 2024-09-17T05:31:46.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff36caa5000 1 -- 172.21.15.31:0/776977038 wait complete. 2024-09-17T05:31:46.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff36caa5000 1 -- start start 2024-09-17T05:31:46.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.735+0000 7ff36caa5000 1 Processor -- start 2024-09-17T05:31:46.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff36caa5000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95f90e10 0x559e960529f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff36caa5000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95fdc9d0 0x559e96052f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff36caa5000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95fdd2f0 0x559e96053470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff36caa5000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559e95ded8f0 con 0x559e95fdc9d0 2024-09-17T05:31:46.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff36caa5000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559e95e62a60 con 0x559e95f90e10 2024-09-17T05:31:46.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff36caa5000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x559e95e9d730 con 0x559e95fdd2f0 2024-09-17T05:31:46.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff36caa5000 10 client.0 _ll_register_callbacks cb 0x7ff3500098d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:31:46.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff362000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95fdc9d0 0x559e96052f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff362000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95fdc9d0 0x559e96052f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54740/0 (socket says 172.21.15.31:54740) 2024-09-17T05:31:46.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff362000640 1 -- 172.21.15.31:0/3345045224 learned_addr learned my addr 172.21.15.31:0/3345045224 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:46.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff362a00640 1 --2- 172.21.15.31:0/3345045224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95f90e10 0x559e960529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff363400640 1 --2- 172.21.15.31:0/3345045224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95fdd2f0 0x559e96053470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff362000640 1 -- 172.21.15.31:0/3345045224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95fdd2f0 msgr2=0x559e96053470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:31:46.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff362000640 1 --2- 172.21.15.31:0/3345045224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95fdd2f0 0x559e96053470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff362000640 1 -- 172.21.15.31:0/3345045224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95f90e10 msgr2=0x559e960529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:31:46.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff362000640 1 --2- 172.21.15.31:0/3345045224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95f90e10 0x559e960529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff362000640 1 -- 172.21.15.31:0/3345045224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e95da4a90 con 0x559e95fdc9d0 2024-09-17T05:31:46.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff362000640 1 --2- 172.21.15.31:0/3345045224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95fdc9d0 0x559e96052f30 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff350004620 tx=0x7ff3500046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b3efc0c5b366a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:46.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff343e00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:31:46.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff343e00640 1 -- 172.21.15.31:0/3345045224 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff350030060 con 0x559e95fdc9d0 2024-09-17T05:31:46.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff343e00640 1 -- 172.21.15.31:0/3345045224 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7ff350003dd0 con 0x559e95fdc9d0 2024-09-17T05:31:46.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.739+0000 7ff36caa5000 1 -- 172.21.15.31:0/3345045224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3540f85f0 con 0x559e95fdc9d0 2024-09-17T05:31:46.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff343e00640 1 -- 172.21.15.31:0/3345045224 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ff350036050 con 0x559e95fdc9d0 2024-09-17T05:31:46.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 10 client.5895 fetch_fsmap learned FSMap version 38 2024-09-17T05:31:46.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 1 -- 172.21.15.31:0/3345045224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x559e95d83050 con 0x559e95fdc9d0 2024-09-17T05:31:46.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff343e00640 1 -- 172.21.15.31:0/3345045224 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3540f85f0 con 0x559e95fdc9d0 2024-09-17T05:31:46.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff343e00640 1 -- 172.21.15.31:0/3345045224 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 38) ==== 3502+0+0 (secure 0 0 0) 0x7ff350039020 con 0x559e95fdc9d0 2024-09-17T05:31:46.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 10 client.5895 fetch_fsmap finished waiting for FSMap version 38 2024-09-17T05:31:46.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 10 client.5895 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:31:46.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 20 client.5895 populate_metadata read hostname 'smithi031' 2024-09-17T05:31:46.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 1 --2- 172.21.15.31:0/3345045224 >> [v2:172.21.15.31:6834/1272884249,v1:172.21.15.31:6835/1272884249] conn(0x559e95ff2120 0x559e95ff1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 4 client.5895 mds_command: new command op to 5751 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:31:46.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 1 -- 172.21.15.31:0/3345045224 --> [v2:172.21.15.31:6834/1272884249,v1:172.21.15.31:6835/1272884249] -- command(tid 0: {"prefix": "status"}) -- 0x559e95dec520 con 0x559e95ff2120 2024-09-17T05:31:46.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff362a00640 1 --2- 172.21.15.31:0/3345045224 >> [v2:172.21.15.31:6834/1272884249,v1:172.21.15.31:6835/1272884249] conn(0x559e95ff2120 0x559e95ff1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff362a00640 1 --2- 172.21.15.31:0/3345045224 >> [v2:172.21.15.31:6834/1272884249,v1:172.21.15.31:6835/1272884249] conn(0x559e95ff2120 0x559e95ff1240 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41ee8b202029f55 server_cookie=8074f735fc522545 in_seq=0 out_seq=0 2024-09-17T05:31:46.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff343e00640 10 client.5895 ms_handle_connect on v2:172.21.15.31:6834/1272884249 2024-09-17T05:31:46.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff343e00640 1 -- 172.21.15.31:0/3345045224 <== mds.0 v2:172.21.15.31:6834/1272884249 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x559e95dec520 con 0x559e95ff2120 2024-09-17T05:31:46.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff343e00640 10 client.5895 handle_command_reply: tid=0 2024-09-17T05:31:46.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 1 client.5895 shutdown 2024-09-17T05:31:46.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 1 -- 172.21.15.31:0/3345045224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95fdc9d0 msgr2=0x559e96052f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:46.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 1 --2- 172.21.15.31:0/3345045224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95fdc9d0 0x559e96052f30 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff350004620 tx=0x7ff3500046d0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 1 -- 172.21.15.31:0/3345045224 shutdown_connections 2024-09-17T05:31:46.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 1 --2- 172.21.15.31:0/3345045224 >> [v2:172.21.15.31:6834/1272884249,v1:172.21.15.31:6835/1272884249] conn(0x559e95ff2120 0x559e95ff1240 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 1 --2- 172.21.15.31:0/3345045224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559e95fdd2f0 0x559e96053470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff343e00640 0 client.5895 ms_handle_reset on v2:172.21.15.31:6834/1272884249 2024-09-17T05:31:46.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 1 --2- 172.21.15.31:0/3345045224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559e95fdc9d0 0x559e96052f30 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 1 --2- 172.21.15.31:0/3345045224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559e95f90e10 0x559e960529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 1 -- 172.21.15.31:0/3345045224 >> 172.21.15.31:0/3345045224 conn(0x559e95e7a130 msgr2=0x559e95f8f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:46.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 1 -- 172.21.15.31:0/3345045224 shutdown_connections 2024-09-17T05:31:46.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 1 -- 172.21.15.31:0/3345045224 wait complete. 2024-09-17T05:31:46.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff36caa5000 20 client.5895 trim_cache size 0 max 16384 2024-09-17T05:31:46.752 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:31:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "b668cd1d-3036-4a29-9e5a-69d0df5776a8", 2024-09-17T05:31:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-17T05:31:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 5751, 2024-09-17T05:31:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-09-17T05:31:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-09-17T05:31:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-17T05:31:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 6.0459362030000001, 2024-09-17T05:31:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 38, 2024-09-17T05:31:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 57, 2024-09-17T05:31:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 57, 2024-09-17T05:31:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 10.508309267 2024-09-17T05:31:46.753 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:31:46.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff363e00640 1 -- 172.21.15.31:0/692450362 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff3440733b0 msgr2=0x7ff344075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:46.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff363e00640 1 --2- 172.21.15.31:0/692450362 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff3440733b0 0x7ff344075870 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff3640a1c50 tx=0x7ff3500091e0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff363e00640 1 -- 172.21.15.31:0/692450362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff348003c70 msgr2=0x7ff36415cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:46.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff363e00640 1 --2- 172.21.15.31:0/692450362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff348003c70 0x7ff36415cfa0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff35401c940 tx=0x7ff354006b70 comp rx=0 tx=0).stop 2024-09-17T05:31:46.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff363e00640 1 -- 172.21.15.31:0/692450362 shutdown_connections 2024-09-17T05:31:46.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff363e00640 1 --2- 172.21.15.31:0/692450362 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff3440733b0 0x7ff344075870 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff363e00640 1 --2- 172.21.15.31:0/692450362 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3641f78c0 0x7ff3641f7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff363e00640 1 --2- 172.21.15.31:0/692450362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3641f8460 0x7ff3640b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff363e00640 1 --2- 172.21.15.31:0/692450362 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff348003c70 0x7ff36415cfa0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff363e00640 1 -- 172.21.15.31:0/692450362 >> 172.21.15.31:0/692450362 conn(0x7ff3640d3dd0 msgr2=0x7ff364160670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:46.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff363e00640 1 -- 172.21.15.31:0/692450362 shutdown_connections 2024-09-17T05:31:46.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.743+0000 7ff363e00640 1 -- 172.21.15.31:0/692450362 wait complete. 2024-09-17T05:31:46.769 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:31:46.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.911+0000 7f6e35600640 1 -- 172.21.15.31:0/1041517180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e14004810 msgr2=0x7f6e14004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:46.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.911+0000 7f6e35600640 1 --2- 172.21.15.31:0/1041517180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e14004810 0x7f6e14004c90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f6e18006f90 tx=0x7f6e1801cea0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.911+0000 7f6e35600640 1 -- 172.21.15.31:0/1041517180 shutdown_connections 2024-09-17T05:31:46.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.911+0000 7f6e35600640 1 --2- 172.21.15.31:0/1041517180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e14004810 0x7f6e14004c90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.911+0000 7f6e35600640 1 -- 172.21.15.31:0/1041517180 >> 172.21.15.31:0/1041517180 conn(0x7f6e300d1dc0 msgr2=0x7f6e300d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:46.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.911+0000 7f6e35600640 1 -- 172.21.15.31:0/1041517180 shutdown_connections 2024-09-17T05:31:46.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.911+0000 7f6e35600640 1 -- 172.21.15.31:0/1041517180 wait complete. 2024-09-17T05:31:46.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.911+0000 7f6e35600640 1 Processor -- start 2024-09-17T05:31:46.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.911+0000 7f6e35600640 1 -- start start 2024-09-17T05:31:46.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.911+0000 7f6e35600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e14004810 0x7f6e30155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.911+0000 7f6e35600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e301fad20 0x7f6e301eaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.911+0000 7f6e35600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e30156450 0x7f6e300b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.911+0000 7f6e35600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3006ebb0 con 0x7f6e30156450 2024-09-17T05:31:46.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.911+0000 7f6e35600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3006ea30 con 0x7f6e14004810 2024-09-17T05:31:46.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.911+0000 7f6e35600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6e300d0870 con 0x7f6e301fad20 2024-09-17T05:31:46.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.915+0000 7f6e2f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e30156450 0x7f6e300b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.915+0000 7f6e2ea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e14004810 0x7f6e30155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.915+0000 7f6e2f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e30156450 0x7f6e300b6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54764/0 (socket says 172.21.15.31:54764) 2024-09-17T05:31:46.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.915+0000 7f6e2f400640 1 -- 172.21.15.31:0/1690258412 learned_addr learned my addr 172.21.15.31:0/1690258412 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:46.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.915+0000 7f6e26000640 1 --2- 172.21.15.31:0/1690258412 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e301fad20 0x7f6e301eaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.915+0000 7f6e2f400640 1 -- 172.21.15.31:0/1690258412 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e301fad20 msgr2=0x7f6e301eaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:46.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.915+0000 7f6e2f400640 1 --2- 172.21.15.31:0/1690258412 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e301fad20 0x7f6e301eaa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.915+0000 7f6e2f400640 1 -- 172.21.15.31:0/1690258412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e14004810 msgr2=0x7f6e30155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:46.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.915+0000 7f6e2f400640 1 --2- 172.21.15.31:0/1690258412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e14004810 0x7f6e30155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:46.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.915+0000 7f6e2f400640 1 -- 172.21.15.31:0/1690258412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e301f76e0 con 0x7f6e30156450 2024-09-17T05:31:46.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.915+0000 7f6e2f400640 1 --2- 172.21.15.31:0/1690258412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e30156450 0x7f6e300b6dc0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6e28011b40 tx=0x7f6e2800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:46.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.915+0000 7f6e27400640 1 -- 172.21.15.31:0/1690258412 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e28004b30 con 0x7f6e30156450 2024-09-17T05:31:46.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.915+0000 7f6e27400640 1 -- 172.21.15.31:0/1690258412 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e28004cd0 con 0x7f6e30156450 2024-09-17T05:31:46.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.915+0000 7f6e27400640 1 -- 172.21.15.31:0/1690258412 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e28003be0 con 0x7f6e30156450 2024-09-17T05:31:46.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.915+0000 7f6e35600640 1 -- 172.21.15.31:0/1690258412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e301fb220 con 0x7f6e30156450 2024-09-17T05:31:46.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.915+0000 7f6e35600640 1 -- 172.21.15.31:0/1690258412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e301fb7e0 con 0x7f6e30156450 2024-09-17T05:31:46.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.915+0000 7f6e35600640 1 -- 172.21.15.31:0/1690258412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e300d0dd0 con 0x7f6e30156450 2024-09-17T05:31:46.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.915+0000 7f6e27400640 1 -- 172.21.15.31:0/1690258412 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f6e28004050 con 0x7f6e30156450 2024-09-17T05:31:46.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.919+0000 7f6e27400640 1 --2- 172.21.15.31:0/1690258412 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6e0c0733e0 0x7f6e0c0758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:46.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.919+0000 7f6e27400640 1 -- 172.21.15.31:0/1690258412 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f6e28095270 con 0x7f6e30156450 2024-09-17T05:31:46.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.919+0000 7f6e2ea00640 1 --2- 172.21.15.31:0/1690258412 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6e0c0733e0 0x7f6e0c0758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:46.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.919+0000 7f6e2ea00640 1 --2- 172.21.15.31:0/1690258412 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6e0c0733e0 0x7f6e0c0758a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6e20000c10 tx=0x7f6e20006b20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:46.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:46.923+0000 7f6e27400640 1 -- 172.21.15.31:0/1690258412 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6e2805f9e0 con 0x7f6e30156450 2024-09-17T05:31:47.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:47.131+0000 7f6e35600640 1 -- 172.21.15.31:0/1690258412 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6e30158ff0 con 0x7f6e30156450 2024-09-17T05:31:47.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:47.135+0000 7f6e27400640 1 -- 172.21.15.31:0/1690258412 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) ==== 53+0+73 (secure 0 0 0) 0x7f6e28064410 con 0x7f6e30156450 2024-09-17T05:31:47.139 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:31:47.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:47.135+0000 7f6e35600640 1 -- 172.21.15.31:0/1690258412 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6e0c0733e0 msgr2=0x7f6e0c0758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:47.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:47.135+0000 7f6e35600640 1 --2- 172.21.15.31:0/1690258412 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6e0c0733e0 0x7f6e0c0758a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6e20000c10 tx=0x7f6e20006b20 comp rx=0 tx=0).stop 2024-09-17T05:31:47.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:47.135+0000 7f6e35600640 1 -- 172.21.15.31:0/1690258412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e30156450 msgr2=0x7f6e300b6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:47.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:47.135+0000 7f6e35600640 1 --2- 172.21.15.31:0/1690258412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e30156450 0x7f6e300b6dc0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6e28011b40 tx=0x7f6e2800f3c0 comp rx=0 tx=0).stop 2024-09-17T05:31:47.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:47.135+0000 7f6e35600640 1 -- 172.21.15.31:0/1690258412 shutdown_connections 2024-09-17T05:31:47.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:47.135+0000 7f6e35600640 1 --2- 172.21.15.31:0/1690258412 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6e0c0733e0 0x7f6e0c0758a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:47.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:47.135+0000 7f6e35600640 1 --2- 172.21.15.31:0/1690258412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e30156450 0x7f6e300b6dc0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:47.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:47.135+0000 7f6e35600640 1 --2- 172.21.15.31:0/1690258412 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e301fad20 0x7f6e301eaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:47.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:47.135+0000 7f6e35600640 1 --2- 172.21.15.31:0/1690258412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e14004810 0x7f6e30155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:47.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:47.135+0000 7f6e35600640 1 -- 172.21.15.31:0/1690258412 >> 172.21.15.31:0/1690258412 conn(0x7f6e300d1dc0 msgr2=0x7f6e300b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:47.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:47.135+0000 7f6e35600640 1 -- 172.21.15.31:0/1690258412 shutdown_connections 2024-09-17T05:31:47.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:47.135+0000 7f6e35600640 1 -- 172.21.15.31:0/1690258412 wait complete. 2024-09-17T05:31:47.161 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:31:47.161 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:31:47.161 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-17T05:31:47.162 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:31:47.162 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:31:47.162 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:31:47.162 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:31:47.162 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:31:47.162 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:31:47.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:47.162 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-17T05:31:47.171 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:31:47.171 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:31:47.172 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:31:47.172 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:31:47.172 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-17T05:31:47.172 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:31:47.172 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:31:47.172 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:31:47.172 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-17T05:31:47.172 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:31:47.172 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:31:47.172 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-17T05:31:47.172 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:31:47.173 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-17T05:31:47.173 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-17T05:31:47.173 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:31:47.173 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42245sec preferred_lft 42245sec 2024-09-17T05:31:47.173 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-17T05:31:47.173 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:31:47.173 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:31:47.173 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:31:47.173 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-17T05:31:47.173 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:31:47.173 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:fe:f3:3e:aa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:31:47.173 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:31:47.173 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:31:47.174 INFO:teuthology.orchestra.run.smithi031.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:31:47.174 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:31:47.174 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:31:47.174 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:31:47.174 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:31:47.174 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:31:47.174 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:31:47.174 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:31:47.174 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:31:47.174 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:31:47.174 INFO:teuthology.orchestra.run.smithi031.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:31:47.174 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:31:47.174 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:31:47.174 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:31:47.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:47.175 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:31:47.236 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-17T05:31:47.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:47.238 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-17T05:31:47.291 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-17T05:31:47.292 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:31:47.292 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:31:47.292 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:31:47.292 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:31:47.292 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:31:47.292 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:31:47.292 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:31:47.293 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:31:47.293 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:31:47.293 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:31:47.293 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:31:47.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:31:47.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:31:47.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:47.435 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T05:31:47.445 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:31:47.445 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:31:47.445 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:31:47.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:47.445 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-09-17T05:31:47.506 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:31:47.506 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:31:47.558 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:31:47.559 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:31:47.559 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:31:47.614 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-17T05:31:47.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:47.614 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:31:47.703 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:31:47.704 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:31:47.717 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:31:47.717 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:31:47.717 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:31:47.717 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:31:47.717 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:31:47.721 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:31:47.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:47.722 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:31:47.742 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:31:47.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:31:47.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:31:47.855 INFO:teuthology.orchestra.run.smithi031.stdout:client5904 2024-09-17T05:31:47.856 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:31:47.856 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:31:47.865 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:31:48.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.051+0000 7ff982c00640 1 -- 172.21.15.31:0/1131898202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff960003c20 msgr2=0x7ff960004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:48.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.051+0000 7ff982c00640 1 --2- 172.21.15.31:0/1131898202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff960003c20 0x7ff960004020 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009b90 tx=0x7ff96c01d270 comp rx=0 tx=0).stop 2024-09-17T05:31:48.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.051+0000 7ff980c00640 1 -- 172.21.15.31:0/1131898202 reap_dead start 2024-09-17T05:31:48.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.051+0000 7ff982c00640 1 -- 172.21.15.31:0/1131898202 shutdown_connections 2024-09-17T05:31:48.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.051+0000 7ff982c00640 1 -- 172.21.15.31:0/1131898202 >> 172.21.15.31:0/1131898202 conn(0x7ff97c0d1dc0 msgr2=0x7ff97c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:48.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.051+0000 7ff982c00640 1 -- 172.21.15.31:0/1131898202 shutdown_connections 2024-09-17T05:31:48.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.051+0000 7ff982c00640 1 -- 172.21.15.31:0/1131898202 wait complete. 2024-09-17T05:31:48.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff982c00640 1 Processor -- start 2024-09-17T05:31:48.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff982c00640 1 -- start start 2024-09-17T05:31:48.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff982c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff960003c20 0x7ff97c0c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:48.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff982c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff97c09ef60 0x7ff97c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:48.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff982c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff97c09c4b0 0x7ff97c09c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:48.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff982c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c167d90 con 0x7ff960003c20 2024-09-17T05:31:48.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff982c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c15c450 con 0x7ff97c09ef60 2024-09-17T05:31:48.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff982c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff97c167f10 con 0x7ff97c09c4b0 2024-09-17T05:31:48.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff97be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff960003c20 0x7ff97c0c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:48.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff97be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff960003c20 0x7ff97c0c8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54786/0 (socket says 172.21.15.31:54786) 2024-09-17T05:31:48.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff97be00640 1 -- 172.21.15.31:0/2893461144 learned_addr learned my addr 172.21.15.31:0/2893461144 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:48.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff973e00640 1 --2- 172.21.15.31:0/2893461144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff97c09ef60 0x7ff97c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:48.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff980c00640 1 --2- 172.21.15.31:0/2893461144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff97c09c4b0 0x7ff97c09c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:48.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff97be00640 1 -- 172.21.15.31:0/2893461144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff97c09c4b0 msgr2=0x7ff97c09c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:48.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff97be00640 1 --2- 172.21.15.31:0/2893461144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff97c09c4b0 0x7ff97c09c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:48.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff97be00640 1 -- 172.21.15.31:0/2893461144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff97c09ef60 msgr2=0x7ff97c15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:48.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff97be00640 1 --2- 172.21.15.31:0/2893461144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff97c09ef60 0x7ff97c15a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:48.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff97be00640 1 -- 172.21.15.31:0/2893461144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97c0c8c70 con 0x7ff960003c20 2024-09-17T05:31:48.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff97be00640 1 --2- 172.21.15.31:0/2893461144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff960003c20 0x7ff97c0c8730 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0af040 tx=0x7ff96c005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:48.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff978c00640 1 -- 172.21.15.31:0/2893461144 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c0b1040 con 0x7ff960003c20 2024-09-17T05:31:48.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff978c00640 1 -- 172.21.15.31:0/2893461144 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff96c0bb070 con 0x7ff960003c20 2024-09-17T05:31:48.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff978c00640 1 -- 172.21.15.31:0/2893461144 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c004290 con 0x7ff960003c20 2024-09-17T05:31:48.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff982c00640 1 -- 172.21.15.31:0/2893461144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff97c09fac0 con 0x7ff960003c20 2024-09-17T05:31:48.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.055+0000 7ff982c00640 1 -- 172.21.15.31:0/2893461144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff97c0ca150 con 0x7ff960003c20 2024-09-17T05:31:48.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.059+0000 7ff982c00640 1 -- 172.21.15.31:0/2893461144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff97c0cd190 con 0x7ff960003c20 2024-09-17T05:31:48.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.059+0000 7ff978c00640 1 -- 172.21.15.31:0/2893461144 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7ff96c0046d0 con 0x7ff960003c20 2024-09-17T05:31:48.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.059+0000 7ff978c00640 1 --2- 172.21.15.31:0/2893461144 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff9580733e0 0x7ff9580758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:48.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.059+0000 7ff978c00640 1 -- 172.21.15.31:0/2893461144 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7ff96c12f620 con 0x7ff960003c20 2024-09-17T05:31:48.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.059+0000 7ff973e00640 1 --2- 172.21.15.31:0/2893461144 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff9580733e0 0x7ff9580758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:48.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.059+0000 7ff973e00640 1 --2- 172.21.15.31:0/2893461144 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff9580733e0 0x7ff9580758a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff964000f70 tx=0x7ff964000ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:48.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.063+0000 7ff978c00640 1 -- 172.21.15.31:0/2893461144 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff97c0c8c70 con 0x7ff960003c20 2024-09-17T05:31:48.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.279+0000 7ff982c00640 1 -- 172.21.15.31:0/2893461144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff97c09f500 con 0x7ff960003c20 2024-09-17T05:31:48.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.279+0000 7ff978c00640 1 -- 172.21.15.31:0/2893461144 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) ==== 53+0+73 (secure 0 0 0) 0x7ff96c016fc0 con 0x7ff960003c20 2024-09-17T05:31:48.286 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:31:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.283+0000 7ff982c00640 1 -- 172.21.15.31:0/2893461144 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff9580733e0 msgr2=0x7ff9580758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.283+0000 7ff982c00640 1 --2- 172.21.15.31:0/2893461144 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff9580733e0 0x7ff9580758a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff964000f70 tx=0x7ff964000ee0 comp rx=0 tx=0).stop 2024-09-17T05:31:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.283+0000 7ff982c00640 1 -- 172.21.15.31:0/2893461144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff960003c20 msgr2=0x7ff97c0c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:48.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.283+0000 7ff982c00640 1 --2- 172.21.15.31:0/2893461144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff960003c20 0x7ff97c0c8730 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0af040 tx=0x7ff96c005590 comp rx=0 tx=0).stop 2024-09-17T05:31:48.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.283+0000 7ff982c00640 1 -- 172.21.15.31:0/2893461144 shutdown_connections 2024-09-17T05:31:48.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.283+0000 7ff982c00640 1 --2- 172.21.15.31:0/2893461144 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff9580733e0 0x7ff9580758a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:48.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.283+0000 7ff982c00640 1 --2- 172.21.15.31:0/2893461144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff97c09c4b0 0x7ff97c09c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:48.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.283+0000 7ff982c00640 1 --2- 172.21.15.31:0/2893461144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff97c09ef60 0x7ff97c15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:48.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.283+0000 7ff982c00640 1 --2- 172.21.15.31:0/2893461144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff960003c20 0x7ff97c0c8730 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:48.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.283+0000 7ff982c00640 1 -- 172.21.15.31:0/2893461144 >> 172.21.15.31:0/2893461144 conn(0x7ff97c0d1dc0 msgr2=0x7ff97c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:48.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.283+0000 7ff982c00640 1 -- 172.21.15.31:0/2893461144 shutdown_connections 2024-09-17T05:31:48.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:48.283+0000 7ff982c00640 1 -- 172.21.15.31:0/2893461144 wait complete. 2024-09-17T05:31:48.307 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:31:48.307 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:31:48.307 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-09-17T05:31:48.307 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:31:48.307 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:31:48.307 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:31:48.307 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:31:48.307 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:31:48.308 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:31:48.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:48.308 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-09-17T05:31:48.318 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:31:48.318 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:31:48.318 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:31:48.318 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:31:48.318 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-17T05:31:48.318 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:31:48.318 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:31:48.318 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:31:48.318 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-09-17T05:31:48.319 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:31:48.319 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:31:48.319 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-09-17T05:31:48.319 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:31:48.319 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-09-17T05:31:48.319 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:31:48.319 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-09-17T05:31:48.319 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-17T05:31:48.319 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42247sec preferred_lft 42247sec 2024-09-17T05:31:48.319 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-09-17T05:31:48.319 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:31:48.319 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:31:48.319 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:84:cd:fc:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:31:48.319 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:31:48.320 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:31:48.320 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:31:48.320 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:31:48.320 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:31:48.320 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:31:48.320 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:31:48.320 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:31:48.320 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:31:48.320 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:31:48.320 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:31:48.320 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:31:48.320 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:31:48.321 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:31:48.321 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:31:48.321 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:31:48.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:48.322 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:31:48.386 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-17T05:31:48.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:48.389 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-09-17T05:31:48.442 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-09-17T05:31:48.442 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:31:48.442 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-17T05:31:48.443 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:31:48.443 INFO:teuthology.orchestra.run.smithi155.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-17T05:31:48.443 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:31:48.443 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:31:48.443 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:31:48.443 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:31:48.443 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:31:48.443 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:31:48.443 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:31:48.443 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:31:48.444 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:31:48.444 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:31:48.444 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:31:48.444 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:31:48.539 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:31:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:31:48.582 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:31:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:31:48.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:48.589 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-17T05:31:48.598 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:31:48.598 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:31:48.599 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:31:48.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:48.599 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-09-17T05:31:48.666 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:31:48.666 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:31:48.714 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:31:48.714 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:31:48.715 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:31:48.766 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-17T05:31:48.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:48.766 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:31:48.854 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:31:48.854 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:31:48.868 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:31:48.869 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:31:48.869 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:31:48.869 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:31:48.869 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:31:48.873 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:31:48.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:48.873 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:31:48.892 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:31:48.981 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:31:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:31:48.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:31:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:31:48.991 INFO:teuthology.orchestra.run.smithi155.stdout:client5680 2024-09-17T05:31:48.992 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:31:48.992 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:31:49.002 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:31:49.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.155+0000 7fc6c5800640 1 -- 172.21.15.31:0/1220116904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a40051d0 msgr2=0x7fc6a400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:49.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.155+0000 7fc6c5800640 1 --2- 172.21.15.31:0/1220116904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a40051d0 0x7fc6a400b9d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8009eb0 tx=0x7fc6b801d5f0 comp rx=0 tx=0).stop 2024-09-17T05:31:49.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.155+0000 7fc6c5800640 1 -- 172.21.15.31:0/1220116904 shutdown_connections 2024-09-17T05:31:49.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.155+0000 7fc6c5800640 1 --2- 172.21.15.31:0/1220116904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a40051d0 0x7fc6a400b9d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:49.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.155+0000 7fc6c5800640 1 -- 172.21.15.31:0/1220116904 >> 172.21.15.31:0/1220116904 conn(0x7fc6c00d1da0 msgr2=0x7fc6c00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:49.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.155+0000 7fc6c5800640 1 -- 172.21.15.31:0/1220116904 shutdown_connections 2024-09-17T05:31:49.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.155+0000 7fc6c5800640 1 -- 172.21.15.31:0/1220116904 wait complete. 2024-09-17T05:31:49.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.155+0000 7fc6c5800640 1 Processor -- start 2024-09-17T05:31:49.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.155+0000 7fc6c5800640 1 -- start start 2024-09-17T05:31:49.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6c5800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a40051d0 0x7fc6c01f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6c5800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6c00cbaa0 0x7fc6c01f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6c5800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6c01f6720 0x7fc6c01e6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6c5800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c00d02e0 con 0x7fc6a40051d0 2024-09-17T05:31:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6c5800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c00d2c30 con 0x7fc6c01f6720 2024-09-17T05:31:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6c5800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc6c00d0460 con 0x7fc6c00cbaa0 2024-09-17T05:31:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6bfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a40051d0 0x7fc6c01f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6bfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a40051d0 0x7fc6c01f2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34922/0 (socket says 172.21.15.31:34922) 2024-09-17T05:31:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6bfe00640 1 -- 172.21.15.31:0/1828186733 learned_addr learned my addr 172.21.15.31:0/1828186733 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6b7400640 1 --2- 172.21.15.31:0/1828186733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6c00cbaa0 0x7fc6c01f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6c4e00640 1 --2- 172.21.15.31:0/1828186733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6c01f6720 0x7fc6c01e6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6bfe00640 1 -- 172.21.15.31:0/1828186733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6c00cbaa0 msgr2=0x7fc6c01f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:49.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6bfe00640 1 --2- 172.21.15.31:0/1828186733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6c00cbaa0 0x7fc6c01f61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:49.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6bfe00640 1 -- 172.21.15.31:0/1828186733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6c01f6720 msgr2=0x7fc6c01e6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:49.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6bfe00640 1 --2- 172.21.15.31:0/1828186733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6c01f6720 0x7fc6c01e6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:49.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6bfe00640 1 -- 172.21.15.31:0/1828186733 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c01f5a40 con 0x7fc6a40051d0 2024-09-17T05:31:49.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6bfe00640 1 --2- 172.21.15.31:0/1828186733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a40051d0 0x7fc6c01f2e80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0004d20 tx=0x7fc6b0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:49.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6bcc00640 1 -- 172.21.15.31:0/1828186733 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0011660 con 0x7fc6a40051d0 2024-09-17T05:31:49.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6bcc00640 1 -- 172.21.15.31:0/1828186733 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6b0016070 con 0x7fc6a40051d0 2024-09-17T05:31:49.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6bcc00640 1 -- 172.21.15.31:0/1828186733 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0011bb0 con 0x7fc6a40051d0 2024-09-17T05:31:49.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6c5800640 1 -- 172.21.15.31:0/1828186733 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c00c80f0 con 0x7fc6a40051d0 2024-09-17T05:31:49.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6c5800640 1 -- 172.21.15.31:0/1828186733 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c00c8690 con 0x7fc6a40051d0 2024-09-17T05:31:49.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6c5800640 1 -- 172.21.15.31:0/1828186733 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c015eff0 con 0x7fc6a40051d0 2024-09-17T05:31:49.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.159+0000 7fc6bcc00640 1 -- 172.21.15.31:0/1828186733 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7fc6b001b460 con 0x7fc6a40051d0 2024-09-17T05:31:49.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.163+0000 7fc6bcc00640 1 --2- 172.21.15.31:0/1828186733 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc69c0733b0 0x7fc69c075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:49.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.163+0000 7fc6bcc00640 1 -- 172.21.15.31:0/1828186733 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fc6b0094d40 con 0x7fc6a40051d0 2024-09-17T05:31:49.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.163+0000 7fc6b7400640 1 --2- 172.21.15.31:0/1828186733 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc69c0733b0 0x7fc69c075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:49.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.163+0000 7fc6b7400640 1 --2- 172.21.15.31:0/1828186733 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc69c0733b0 0x7fc69c075870 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8001870 tx=0x7fc6a8006040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:49.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.167+0000 7fc6bcc00640 1 -- 172.21.15.31:0/1828186733 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc6b005f9c0 con 0x7fc6a40051d0 2024-09-17T05:31:49.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.379+0000 7fc6c5800640 1 -- 172.21.15.31:0/1828186733 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fc6c00c5630 con 0x7fc6a40051d0 2024-09-17T05:31:49.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.755+0000 7fc6bcc00640 1 -- 172.21.15.31:0/1828186733 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v39) ==== 136+0+0 (secure 0 0 0) 0x7fc6b005f2c0 con 0x7fc6a40051d0 2024-09-17T05:31:49.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.759+0000 7fc6c5800640 1 -- 172.21.15.31:0/1828186733 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc69c0733b0 msgr2=0x7fc69c075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:49.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.759+0000 7fc6c5800640 1 --2- 172.21.15.31:0/1828186733 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc69c0733b0 0x7fc69c075870 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8001870 tx=0x7fc6a8006040 comp rx=0 tx=0).stop 2024-09-17T05:31:49.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.759+0000 7fc6c5800640 1 -- 172.21.15.31:0/1828186733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a40051d0 msgr2=0x7fc6c01f2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:49.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.759+0000 7fc6c5800640 1 --2- 172.21.15.31:0/1828186733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a40051d0 0x7fc6c01f2e80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0004d20 tx=0x7fc6b0001640 comp rx=0 tx=0).stop 2024-09-17T05:31:49.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.759+0000 7fc6c5800640 1 -- 172.21.15.31:0/1828186733 shutdown_connections 2024-09-17T05:31:49.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.759+0000 7fc6c5800640 1 --2- 172.21.15.31:0/1828186733 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fc69c0733b0 0x7fc69c075870 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:49.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.759+0000 7fc6c5800640 1 --2- 172.21.15.31:0/1828186733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6c01f6720 0x7fc6c01e6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:49.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.759+0000 7fc6c5800640 1 --2- 172.21.15.31:0/1828186733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6c00cbaa0 0x7fc6c01f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:49.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.759+0000 7fc6c5800640 1 --2- 172.21.15.31:0/1828186733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6a40051d0 0x7fc6c01f2e80 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:49.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.759+0000 7fc6c5800640 1 -- 172.21.15.31:0/1828186733 >> 172.21.15.31:0/1828186733 conn(0x7fc6c00d1da0 msgr2=0x7fc6c015ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:49.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.759+0000 7fc6c5800640 1 -- 172.21.15.31:0/1828186733 shutdown_connections 2024-09-17T05:31:49.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.759+0000 7fc6c5800640 1 -- 172.21.15.31:0/1828186733 wait complete. 2024-09-17T05:31:49.780 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:31:49.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.927+0000 7f6d4e800640 1 -- 172.21.15.31:0/230651412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d300051d0 msgr2=0x7f6d3000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:49.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.927+0000 7f6d4e800640 1 --2- 172.21.15.31:0/230651412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d300051d0 0x7f6d3000b9d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6d40001f50 tx=0x7f6d4001cc20 comp rx=0 tx=0).stop 2024-09-17T05:31:49.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.927+0000 7f6d4de00640 1 -- 172.21.15.31:0/230651412 reap_dead start 2024-09-17T05:31:49.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.927+0000 7f6d4e800640 1 -- 172.21.15.31:0/230651412 shutdown_connections 2024-09-17T05:31:49.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.927+0000 7f6d4e800640 1 -- 172.21.15.31:0/230651412 >> 172.21.15.31:0/230651412 conn(0x7f6d48073490 msgr2=0x7f6d480d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:49.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.927+0000 7f6d4e800640 1 -- 172.21.15.31:0/230651412 shutdown_connections 2024-09-17T05:31:49.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.927+0000 7f6d4e800640 1 -- 172.21.15.31:0/230651412 wait complete. 2024-09-17T05:31:49.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4e800640 1 Processor -- start 2024-09-17T05:31:49.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4e800640 1 -- start start 2024-09-17T05:31:49.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d300051d0 0x7f6d48157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:49.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4e800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d480b58f0 0x7f6d480c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:49.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4e800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d480b5d70 0x7f6d480c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:49.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4e800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6d480d1020 con 0x7f6d300051d0 2024-09-17T05:31:49.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4e800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6d480d0ea0 con 0x7f6d480b58f0 2024-09-17T05:31:49.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4e800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6d480d11a0 con 0x7f6d480b5d70 2024-09-17T05:31:49.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d300051d0 0x7f6d48157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:49.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d300051d0 0x7f6d48157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34934/0 (socket says 172.21.15.31:34934) 2024-09-17T05:31:49.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4d400640 1 -- 172.21.15.31:0/1982011734 learned_addr learned my addr 172.21.15.31:0/1982011734 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:49.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4ca00640 1 --2- 172.21.15.31:0/1982011734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d480b58f0 0x7f6d480c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:49.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4de00640 1 --2- 172.21.15.31:0/1982011734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d480b5d70 0x7f6d480c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:49.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4d400640 1 -- 172.21.15.31:0/1982011734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d480b5d70 msgr2=0x7f6d480c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:49.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4d400640 1 --2- 172.21.15.31:0/1982011734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d480b5d70 0x7f6d480c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:49.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4d400640 1 -- 172.21.15.31:0/1982011734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d480b58f0 msgr2=0x7f6d480c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:49.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4d400640 1 --2- 172.21.15.31:0/1982011734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d480b58f0 0x7f6d480c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:49.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4d400640 1 -- 172.21.15.31:0/1982011734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d480c7510 con 0x7f6d300051d0 2024-09-17T05:31:49.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4ca00640 1 --2- 172.21.15.31:0/1982011734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d480b58f0 0x7f6d480c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:31:49.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4d400640 1 --2- 172.21.15.31:0/1982011734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d300051d0 0x7f6d48157010 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0119e0 tx=0x7f6d3c011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:49.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d45600640 1 -- 172.21.15.31:0/1982011734 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00fd20 con 0x7f6d300051d0 2024-09-17T05:31:49.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d45600640 1 -- 172.21.15.31:0/1982011734 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d3c004030 con 0x7f6d300051d0 2024-09-17T05:31:49.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d45600640 1 -- 172.21.15.31:0/1982011734 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c004460 con 0x7f6d300051d0 2024-09-17T05:31:49.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4e800640 1 -- 172.21.15.31:0/1982011734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d480c77f0 con 0x7f6d300051d0 2024-09-17T05:31:49.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4e800640 1 -- 172.21.15.31:0/1982011734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d480c7db0 con 0x7f6d300051d0 2024-09-17T05:31:49.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.931+0000 7f6d4e800640 1 -- 172.21.15.31:0/1982011734 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d480ce830 con 0x7f6d300051d0 2024-09-17T05:31:49.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.935+0000 7f6d45600640 1 -- 172.21.15.31:0/1982011734 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f6d3c003600 con 0x7f6d300051d0 2024-09-17T05:31:49.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.935+0000 7f6d45600640 1 --2- 172.21.15.31:0/1982011734 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6d280733b0 0x7f6d28075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:49.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.935+0000 7f6d45600640 1 -- 172.21.15.31:0/1982011734 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f6d3c0953d0 con 0x7f6d300051d0 2024-09-17T05:31:49.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.935+0000 7f6d4ca00640 1 --2- 172.21.15.31:0/1982011734 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6d280733b0 0x7f6d28075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:49.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.935+0000 7f6d4ca00640 1 --2- 172.21.15.31:0/1982011734 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6d280733b0 0x7f6d28075870 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6d480ca750 tx=0x7f6d34000ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:49.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:49.939+0000 7f6d45600640 1 -- 172.21.15.31:0/1982011734 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6d3c060050 con 0x7f6d300051d0 2024-09-17T05:31:50.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.139+0000 7f6d4e800640 1 -- 172.21.15.31:0/1982011734 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f6d480afe30 con 0x7f6d280733b0 2024-09-17T05:31:50.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.139+0000 7f6d45600640 1 -- 172.21.15.31:0/1982011734 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f6d480afe30 con 0x7f6d280733b0 2024-09-17T05:31:50.140 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:31:50.141 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:50.141 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephfs" 2024-09-17T05:31:50.141 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:50.141 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:31:50.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.139+0000 7f6d4e800640 1 -- 172.21.15.31:0/1982011734 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6d280733b0 msgr2=0x7f6d28075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:50.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.139+0000 7f6d4e800640 1 --2- 172.21.15.31:0/1982011734 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6d280733b0 0x7f6d28075870 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6d480ca750 tx=0x7f6d34000ee0 comp rx=0 tx=0).stop 2024-09-17T05:31:50.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.139+0000 7f6d4e800640 1 -- 172.21.15.31:0/1982011734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d300051d0 msgr2=0x7f6d48157010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:50.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.139+0000 7f6d4e800640 1 --2- 172.21.15.31:0/1982011734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d300051d0 0x7f6d48157010 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0119e0 tx=0x7f6d3c011ea0 comp rx=0 tx=0).stop 2024-09-17T05:31:50.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.143+0000 7f6d4e800640 1 -- 172.21.15.31:0/1982011734 shutdown_connections 2024-09-17T05:31:50.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.143+0000 7f6d4e800640 1 --2- 172.21.15.31:0/1982011734 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6d280733b0 0x7f6d28075870 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:50.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.143+0000 7f6d4e800640 1 --2- 172.21.15.31:0/1982011734 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d480b5d70 0x7f6d480c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:50.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.143+0000 7f6d4e800640 1 --2- 172.21.15.31:0/1982011734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d480b58f0 0x7f6d480c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:50.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.143+0000 7f6d4e800640 1 --2- 172.21.15.31:0/1982011734 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d300051d0 0x7f6d48157010 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:50.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.143+0000 7f6d4e800640 1 -- 172.21.15.31:0/1982011734 >> 172.21.15.31:0/1982011734 conn(0x7f6d48073490 msgr2=0x7f6d480b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:50.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.143+0000 7f6d4e800640 1 -- 172.21.15.31:0/1982011734 shutdown_connections 2024-09-17T05:31:50.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.143+0000 7f6d4e800640 1 -- 172.21.15.31:0/1982011734 wait complete. 2024-09-17T05:31:50.165 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:31:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.315+0000 7f0f91a00640 1 -- 172.21.15.31:0/2940781738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f70003c40 msgr2=0x7f0f70004040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.315+0000 7f0f91a00640 1 --2- 172.21.15.31:0/2940781738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f70003c40 0x7f0f70004040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c006f90 tx=0x7f0f7c01cc20 comp rx=0 tx=0).stop 2024-09-17T05:31:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.315+0000 7f0f91a00640 1 -- 172.21.15.31:0/2940781738 shutdown_connections 2024-09-17T05:31:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.315+0000 7f0f91a00640 1 --2- 172.21.15.31:0/2940781738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f70003c40 0x7f0f70004040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.315+0000 7f0f91a00640 1 -- 172.21.15.31:0/2940781738 >> 172.21.15.31:0/2940781738 conn(0x7f0f8c0d1dd0 msgr2=0x7f0f8c0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.315+0000 7f0f91a00640 1 -- 172.21.15.31:0/2940781738 shutdown_connections 2024-09-17T05:31:50.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.315+0000 7f0f91a00640 1 -- 172.21.15.31:0/2940781738 wait complete. 2024-09-17T05:31:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.315+0000 7f0f91a00640 1 Processor -- start 2024-09-17T05:31:50.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.315+0000 7f0f91a00640 1 -- start start 2024-09-17T05:31:50.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f91a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f70003c40 0x7f0f8c0cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f91a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f8c1f8e90 0x7f0f8c14db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f91a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f8c1f8280 0x7f0f8c1f8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f91a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c0b0e50 con 0x7f0f70003c40 2024-09-17T05:31:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f91a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8c0b0cd0 con 0x7f0f8c1f8e90 2024-09-17T05:31:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f91a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0f8c0b1220 con 0x7f0f8c1f8280 2024-09-17T05:31:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f8aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f70003c40 0x7f0f8c0cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f8aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f70003c40 0x7f0f8c0cb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34942/0 (socket says 172.21.15.31:34942) 2024-09-17T05:31:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f8aa00640 1 -- 172.21.15.31:0/2963406794 learned_addr learned my addr 172.21.15.31:0/2963406794 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f8b400640 1 --2- 172.21.15.31:0/2963406794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f8c1f8280 0x7f0f8c1f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f8a000640 1 --2- 172.21.15.31:0/2963406794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f8c1f8e90 0x7f0f8c14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f8aa00640 1 -- 172.21.15.31:0/2963406794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f8c1f8280 msgr2=0x7f0f8c1f8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:50.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f8aa00640 1 --2- 172.21.15.31:0/2963406794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f8c1f8280 0x7f0f8c1f8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f8aa00640 1 -- 172.21.15.31:0/2963406794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f8c1f8e90 msgr2=0x7f0f8c14db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f8aa00640 1 --2- 172.21.15.31:0/2963406794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f8c1f8e90 0x7f0f8c14db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f8aa00640 1 -- 172.21.15.31:0/2963406794 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8c14e4c0 con 0x7f0f70003c40 2024-09-17T05:31:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f8aa00640 1 --2- 172.21.15.31:0/2963406794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f70003c40 0x7f0f8c0cb880 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c000f70 tx=0x7f0f7c006c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f82a00640 1 -- 172.21.15.31:0/2963406794 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c006160 con 0x7f0f70003c40 2024-09-17T05:31:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f82a00640 1 -- 172.21.15.31:0/2963406794 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f7c006300 con 0x7f0f70003c40 2024-09-17T05:31:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f91a00640 1 -- 172.21.15.31:0/2963406794 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f8c14e7a0 con 0x7f0f70003c40 2024-09-17T05:31:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f82a00640 1 -- 172.21.15.31:0/2963406794 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c0a5980 con 0x7f0f70003c40 2024-09-17T05:31:50.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f91a00640 1 -- 172.21.15.31:0/2963406794 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f8c0cbdc0 con 0x7f0f70003c40 2024-09-17T05:31:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.319+0000 7f0f91a00640 1 -- 172.21.15.31:0/2963406794 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f8c0b1a30 con 0x7f0f70003c40 2024-09-17T05:31:50.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.323+0000 7f0f82a00640 1 -- 172.21.15.31:0/2963406794 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f0f7c0a5b20 con 0x7f0f70003c40 2024-09-17T05:31:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.323+0000 7f0f82a00640 1 --2- 172.21.15.31:0/2963406794 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0f6c0733b0 0x7f0f6c075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:50.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.323+0000 7f0f82a00640 1 -- 172.21.15.31:0/2963406794 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f0f7c12de50 con 0x7f0f70003c40 2024-09-17T05:31:50.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.323+0000 7f0f8a000640 1 --2- 172.21.15.31:0/2963406794 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0f6c0733b0 0x7f0f6c075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:50.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.323+0000 7f0f8a000640 1 --2- 172.21.15.31:0/2963406794 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0f6c0733b0 0x7f0f6c075870 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0d26a0 tx=0x7f0f780091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:50.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.327+0000 7f0f82a00640 1 -- 172.21.15.31:0/2963406794 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0f7c016c90 con 0x7f0f70003c40 2024-09-17T05:31:50.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.503+0000 7f0f91a00640 1 -- 172.21.15.31:0/2963406794 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0f8c0d1080 con 0x7f0f70003c40 2024-09-17T05:31:50.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.503+0000 7f0f82a00640 1 -- 172.21.15.31:0/2963406794 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f0f7c0f8510 con 0x7f0f70003c40 2024-09-17T05:31:50.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.507+0000 7f0f91a00640 1 -- 172.21.15.31:0/2963406794 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0f6c0733b0 msgr2=0x7f0f6c075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:50.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.507+0000 7f0f91a00640 1 --2- 172.21.15.31:0/2963406794 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0f6c0733b0 0x7f0f6c075870 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0d26a0 tx=0x7f0f780091e0 comp rx=0 tx=0).stop 2024-09-17T05:31:50.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.507+0000 7f0f91a00640 1 -- 172.21.15.31:0/2963406794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f70003c40 msgr2=0x7f0f8c0cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:50.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.507+0000 7f0f91a00640 1 --2- 172.21.15.31:0/2963406794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f70003c40 0x7f0f8c0cb880 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c000f70 tx=0x7f0f7c006c50 comp rx=0 tx=0).stop 2024-09-17T05:31:50.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.507+0000 7f0f91a00640 1 -- 172.21.15.31:0/2963406794 shutdown_connections 2024-09-17T05:31:50.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.507+0000 7f0f91a00640 1 --2- 172.21.15.31:0/2963406794 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0f6c0733b0 0x7f0f6c075870 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:50.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.507+0000 7f0f91a00640 1 --2- 172.21.15.31:0/2963406794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f8c1f8280 0x7f0f8c1f8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:50.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.507+0000 7f0f91a00640 1 --2- 172.21.15.31:0/2963406794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f8c1f8e90 0x7f0f8c14db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:50.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.507+0000 7f0f91a00640 1 --2- 172.21.15.31:0/2963406794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f70003c40 0x7f0f8c0cb880 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:50.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.507+0000 7f0f91a00640 1 -- 172.21.15.31:0/2963406794 >> 172.21.15.31:0/2963406794 conn(0x7f0f8c0d1dd0 msgr2=0x7f0f8c0ccf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:50.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.507+0000 7f0f91a00640 1 -- 172.21.15.31:0/2963406794 shutdown_connections 2024-09-17T05:31:50.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.507+0000 7f0f91a00640 1 -- 172.21.15.31:0/2963406794 wait complete. 2024-09-17T05:31:50.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:50.528 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/_nogroup/subvol98920) 2024-09-17T05:31:50.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:50.556 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-17T05:31:50.612 INFO:teuthology.orchestra.run.smithi031.stdout:cephfs_data 2024-09-17T05:31:50.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:50.613 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/_nogroup/subvol98920) 2024-09-17T05:31:50.679 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol53841 2024-09-17T05:31:50.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa77b400640 1 -- 172.21.15.31:0/1506046922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7740cbdb0 msgr2=0x7fa7740b2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:50.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa77b400640 1 --2- 172.21.15.31:0/1506046922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7740cbdb0 0x7fa7740b2740 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa77406ed00 tx=0x7fa76001c890 comp rx=0 tx=0).stop 2024-09-17T05:31:50.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa77b400640 1 -- 172.21.15.31:0/1506046922 shutdown_connections 2024-09-17T05:31:50.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa77b400640 1 --2- 172.21.15.31:0/1506046922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7740cbdb0 0x7fa7740b2740 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:50.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa77b400640 1 --2- 172.21.15.31:0/1506046922 >> v2:172.21.15.155:3300/0 conn(0x7fa77415ac70 0x7fa7740cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:50.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa77b400640 1 -- 172.21.15.31:0/1506046922 >> 172.21.15.31:0/1506046922 conn(0x7fa7740cd740 msgr2=0x7fa7740cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:50.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa77b400640 1 -- 172.21.15.31:0/1506046922 shutdown_connections 2024-09-17T05:31:50.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa77b400640 1 -- 172.21.15.31:0/1506046922 wait complete. 2024-09-17T05:31:50.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa77b400640 1 Processor -- start 2024-09-17T05:31:50.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa77b400640 1 -- start start 2024-09-17T05:31:50.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa77b400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7740b2c80 0x7fa7740c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:50.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa77b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7740cbdb0 0x7fa7740af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:50.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa77b400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa77415ac70 0x7fa7740afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:50.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa77b400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa774167b50 con 0x7fa7740cbdb0 2024-09-17T05:31:50.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa77b400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa7741679d0 con 0x7fa77415ac70 2024-09-17T05:31:50.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa77b400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa774167cd0 con 0x7fa7740b2c80 2024-09-17T05:31:50.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa773e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7740cbdb0 0x7fa7740af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:50.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa773e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7740cbdb0 0x7fa7740af620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34962/0 (socket says 172.21.15.31:34962) 2024-09-17T05:31:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa773e00640 1 -- 172.21.15.31:0/3112586048 learned_addr learned my addr 172.21.15.31:0/3112586048 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa778a00640 1 --2- 172.21.15.31:0/3112586048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7740b2c80 0x7fa7740c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa779400640 1 --2- 172.21.15.31:0/3112586048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa77415ac70 0x7fa7740afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa773e00640 1 -- 172.21.15.31:0/3112586048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7740b2c80 msgr2=0x7fa7740c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa773e00640 1 --2- 172.21.15.31:0/3112586048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7740b2c80 0x7fa7740c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa773e00640 1 -- 172.21.15.31:0/3112586048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa77415ac70 msgr2=0x7fa7740afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa773e00640 1 --2- 172.21.15.31:0/3112586048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa77415ac70 0x7fa7740afb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa773e00640 1 -- 172.21.15.31:0/3112586048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa774154d00 con 0x7fa7740cbdb0 2024-09-17T05:31:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.871+0000 7fa773e00640 1 --2- 172.21.15.31:0/3112586048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7740cbdb0 0x7fa7740af620 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa7600b0040 tx=0x7fa7600a57b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.875+0000 7fa770c00640 1 -- 172.21.15.31:0/3112586048 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7600b2040 con 0x7fa7740cbdb0 2024-09-17T05:31:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.875+0000 7fa770c00640 1 -- 172.21.15.31:0/3112586048 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa760005020 con 0x7fa7740cbdb0 2024-09-17T05:31:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.875+0000 7fa770c00640 1 -- 172.21.15.31:0/3112586048 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760005470 con 0x7fa7740cbdb0 2024-09-17T05:31:50.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.875+0000 7fa77b400640 1 -- 172.21.15.31:0/3112586048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa77415c560 con 0x7fa7740cbdb0 2024-09-17T05:31:50.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.875+0000 7fa77b400640 1 -- 172.21.15.31:0/3112586048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa774156170 con 0x7fa7740cbdb0 2024-09-17T05:31:50.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.875+0000 7fa77b400640 1 -- 172.21.15.31:0/3112586048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7740b2740 con 0x7fa7740cbdb0 2024-09-17T05:31:50.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.875+0000 7fa770c00640 1 -- 172.21.15.31:0/3112586048 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7fa7600046d0 con 0x7fa7740cbdb0 2024-09-17T05:31:50.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.875+0000 7fa770c00640 1 --2- 172.21.15.31:0/3112586048 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa7540733b0 0x7fa754075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:50.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.875+0000 7fa770c00640 1 -- 172.21.15.31:0/3112586048 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fa76012e0d0 con 0x7fa7740cbdb0 2024-09-17T05:31:50.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.875+0000 7fa778a00640 1 --2- 172.21.15.31:0/3112586048 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa7540733b0 0x7fa754075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:50.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.879+0000 7fa778a00640 1 --2- 172.21.15.31:0/3112586048 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa7540733b0 0x7fa754075870 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa76800bb50 tx=0x7fa76800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:50.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:50.879+0000 7fa770c00640 1 -- 172.21.15.31:0/3112586048 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa7600164b0 con 0x7fa7740cbdb0 2024-09-17T05:31:51.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.095+0000 7fa77b400640 1 -- 172.21.15.31:0/3112586048 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol53841", "target": ["mon-mgr", ""]}) -- 0x7fa7740c4590 con 0x7fa7540733b0 2024-09-17T05:31:51.100 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:31:51.102+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:31:51.100 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:31:51.102+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:31:51.101 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:31:51.102+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:31:51.101 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:31:51.102+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:31:51.101 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:31:51.102+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:31:51.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.143+0000 7fa770c00640 1 -- 172.21.15.31:0/3112586048 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa7740c4590 con 0x7fa7540733b0 2024-09-17T05:31:51.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.147+0000 7fa77b400640 1 -- 172.21.15.31:0/3112586048 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa7540733b0 msgr2=0x7fa754075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:51.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.147+0000 7fa77b400640 1 --2- 172.21.15.31:0/3112586048 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa7540733b0 0x7fa754075870 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa76800bb50 tx=0x7fa76800b2e0 comp rx=0 tx=0).stop 2024-09-17T05:31:51.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.147+0000 7fa77b400640 1 -- 172.21.15.31:0/3112586048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7740cbdb0 msgr2=0x7fa7740af620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:51.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.147+0000 7fa77b400640 1 --2- 172.21.15.31:0/3112586048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7740cbdb0 0x7fa7740af620 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa7600b0040 tx=0x7fa7600a57b0 comp rx=0 tx=0).stop 2024-09-17T05:31:51.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.147+0000 7fa77b400640 1 -- 172.21.15.31:0/3112586048 shutdown_connections 2024-09-17T05:31:51.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.147+0000 7fa77b400640 1 --2- 172.21.15.31:0/3112586048 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa7540733b0 0x7fa754075870 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:51.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.147+0000 7fa77b400640 1 --2- 172.21.15.31:0/3112586048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa77415ac70 0x7fa7740afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:51.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.147+0000 7fa77b400640 1 --2- 172.21.15.31:0/3112586048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7740cbdb0 0x7fa7740af620 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:51.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.147+0000 7fa77b400640 1 --2- 172.21.15.31:0/3112586048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7740b2c80 0x7fa7740c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:51.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.147+0000 7fa77b400640 1 -- 172.21.15.31:0/3112586048 >> 172.21.15.31:0/3112586048 conn(0x7fa7740cd740 msgr2=0x7fa774071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:51.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.147+0000 7fa77b400640 1 -- 172.21.15.31:0/3112586048 shutdown_connections 2024-09-17T05:31:51.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.147+0000 7fa77b400640 1 -- 172.21.15.31:0/3112586048 wait complete. 2024-09-17T05:31:51.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:51.167 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp ./volumes/_nogroup/subvol53841/.meta ./volumes/_nogroup/subvol98920) 2024-09-17T05:31:51.254 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol98920 2024-09-17T05:31:51.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.403+0000 7f8f33e00640 1 -- 172.21.15.31:0/111817309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c1605d0 msgr2=0x7f8f2c0d0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:51.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.403+0000 7f8f33e00640 1 --2- 172.21.15.31:0/111817309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c1605d0 0x7f8f2c0d0690 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009900 tx=0x7f8f2001c8e0 comp rx=0 tx=0).stop 2024-09-17T05:31:51.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.403+0000 7f8f33e00640 1 -- 172.21.15.31:0/111817309 shutdown_connections 2024-09-17T05:31:51.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.403+0000 7f8f33e00640 1 --2- 172.21.15.31:0/111817309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c0b1650 0x7f8f2c0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:51.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.403+0000 7f8f33e00640 1 --2- 172.21.15.31:0/111817309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c1605d0 0x7f8f2c0d0690 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:51.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.403+0000 7f8f33e00640 1 -- 172.21.15.31:0/111817309 >> 172.21.15.31:0/111817309 conn(0x7f8f2c0d1dd0 msgr2=0x7f8f2c0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:51.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.403+0000 7f8f33e00640 1 -- 172.21.15.31:0/111817309 shutdown_connections 2024-09-17T05:31:51.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.403+0000 7f8f33e00640 1 -- 172.21.15.31:0/111817309 wait complete. 2024-09-17T05:31:51.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.403+0000 7f8f33e00640 1 Processor -- start 2024-09-17T05:31:51.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.403+0000 7f8f33e00640 1 -- start start 2024-09-17T05:31:51.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.403+0000 7f8f33e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c0aeb00 0x7f8f2c0c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:51.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.403+0000 7f8f33e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c0b1650 0x7f8f2c1f96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:51.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.403+0000 7f8f33e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f2c1605d0 0x7f8f2c0b6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:51.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.403+0000 7f8f33e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c0b1220 con 0x7f8f2c1605d0 2024-09-17T05:31:51.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.403+0000 7f8f33e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c0b0ee0 con 0x7f8f2c0b1650 2024-09-17T05:31:51.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.403+0000 7f8f33e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8f2c0b13a0 con 0x7f8f2c0aeb00 2024-09-17T05:31:51.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f31e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f2c1605d0 0x7f8f2c0b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:51.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f31e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f2c1605d0 0x7f8f2c0b6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34974/0 (socket says 172.21.15.31:34974) 2024-09-17T05:31:51.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f31e00640 1 -- 172.21.15.31:0/2903508630 learned_addr learned my addr 172.21.15.31:0/2903508630 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:51.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f31400640 1 --2- 172.21.15.31:0/2903508630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c0aeb00 0x7f8f2c0c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:51.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f30a00640 1 --2- 172.21.15.31:0/2903508630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c0b1650 0x7f8f2c1f96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:51.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f31400640 1 -- 172.21.15.31:0/2903508630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c0b1650 msgr2=0x7f8f2c1f96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:51.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f31400640 1 --2- 172.21.15.31:0/2903508630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c0b1650 0x7f8f2c1f96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:51.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f31400640 1 -- 172.21.15.31:0/2903508630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f2c1605d0 msgr2=0x7f8f2c0b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:51.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f31400640 1 --2- 172.21.15.31:0/2903508630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f2c1605d0 0x7f8f2c0b6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:51.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f31400640 1 -- 172.21.15.31:0/2903508630 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2c1f9c00 con 0x7f8f2c0aeb00 2024-09-17T05:31:51.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f31e00640 1 --2- 172.21.15.31:0/2903508630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f2c1605d0 0x7f8f2c0b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:31:51.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f31400640 1 --2- 172.21.15.31:0/2903508630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c0aeb00 0x7f8f2c0c8740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8f200ac000 tx=0x7f8f20005e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:51.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f29600640 1 -- 172.21.15.31:0/2903508630 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f200b2040 con 0x7f8f2c0aeb00 2024-09-17T05:31:51.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f29600640 1 -- 172.21.15.31:0/2903508630 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f20004250 con 0x7f8f2c0aeb00 2024-09-17T05:31:51.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f29600640 1 -- 172.21.15.31:0/2903508630 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f20003600 con 0x7f8f2c0aeb00 2024-09-17T05:31:51.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f33e00640 1 -- 172.21.15.31:0/2903508630 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f2c14ead0 con 0x7f8f2c0aeb00 2024-09-17T05:31:51.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f33e00640 1 -- 172.21.15.31:0/2903508630 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f2c14f090 con 0x7f8f2c0aeb00 2024-09-17T05:31:51.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f33e00640 1 -- 172.21.15.31:0/2903508630 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f2c0b1a30 con 0x7f8f2c0aeb00 2024-09-17T05:31:51.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.407+0000 7f8f29600640 1 -- 172.21.15.31:0/2903508630 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 8) ==== 97387+0+0 (secure 0 0 0) 0x7f8f200037c0 con 0x7f8f2c0aeb00 2024-09-17T05:31:51.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.411+0000 7f8f29600640 1 --2- 172.21.15.31:0/2903508630 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8f0c0733b0 0x7f8f0c075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:51.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.411+0000 7f8f29600640 1 -- 172.21.15.31:0/2903508630 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f8f2012e070 con 0x7f8f2c0aeb00 2024-09-17T05:31:51.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.411+0000 7f8f30a00640 1 --2- 172.21.15.31:0/2903508630 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8f0c0733b0 0x7f8f0c075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:51.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.411+0000 7f8f30a00640 1 --2- 172.21.15.31:0/2903508630 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8f0c0733b0 0x7f8f0c075870 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8f18009600 tx=0x7f8f18012040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:51.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.415+0000 7f8f29600640 1 -- 172.21.15.31:0/2903508630 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8f200164d0 con 0x7f8f2c0aeb00 2024-09-17T05:31:51.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.615+0000 7f8f33e00640 1 -- 172.21.15.31:0/2903508630 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol98920", "target": ["mon-mgr", ""]}) -- 0x7f8f2c0d1080 con 0x7f8f0c0733b0 2024-09-17T05:31:51.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.651+0000 7f8f29600640 1 -- 172.21.15.31:0/2903508630 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7f8f2c0d1080 con 0x7f8f0c0733b0 2024-09-17T05:31:51.655 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/_nogroup/subvol98920 2024-09-17T05:31:51.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.655+0000 7f8f33e00640 1 -- 172.21.15.31:0/2903508630 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8f0c0733b0 msgr2=0x7f8f0c075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:51.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.655+0000 7f8f33e00640 1 --2- 172.21.15.31:0/2903508630 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8f0c0733b0 0x7f8f0c075870 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8f18009600 tx=0x7f8f18012040 comp rx=0 tx=0).stop 2024-09-17T05:31:51.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.655+0000 7f8f33e00640 1 -- 172.21.15.31:0/2903508630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c0aeb00 msgr2=0x7f8f2c0c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:51.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.655+0000 7f8f33e00640 1 --2- 172.21.15.31:0/2903508630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c0aeb00 0x7f8f2c0c8740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8f200ac000 tx=0x7f8f20005e00 comp rx=0 tx=0).stop 2024-09-17T05:31:51.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.655+0000 7f8f33e00640 1 -- 172.21.15.31:0/2903508630 shutdown_connections 2024-09-17T05:31:51.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.655+0000 7f8f33e00640 1 --2- 172.21.15.31:0/2903508630 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8f0c0733b0 0x7f8f0c075870 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:51.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.655+0000 7f8f33e00640 1 --2- 172.21.15.31:0/2903508630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f2c1605d0 0x7f8f2c0b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:51.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.655+0000 7f8f33e00640 1 --2- 172.21.15.31:0/2903508630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f2c0b1650 0x7f8f2c1f96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:51.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.655+0000 7f8f33e00640 1 --2- 172.21.15.31:0/2903508630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f2c0aeb00 0x7f8f2c0c8740 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:51.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.655+0000 7f8f33e00640 1 -- 172.21.15.31:0/2903508630 >> 172.21.15.31:0/2903508630 conn(0x7f8f2c0d1dd0 msgr2=0x7f8f2c0cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:51.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.655+0000 7f8f33e00640 1 -- 172.21.15.31:0/2903508630 shutdown_connections 2024-09-17T05:31:51.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.655+0000 7f8f33e00640 1 -- 172.21.15.31:0/2903508630 wait complete. 2024-09-17T05:31:51.676 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol98920 2024-09-17T05:31:51.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.827+0000 7fadce000640 1 -- 172.21.15.31:0/2530413999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc80afb10 msgr2=0x7fadc80affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:51.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.827+0000 7fadce000640 1 --2- 172.21.15.31:0/2530413999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc80afb10 0x7fadc80affc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009bf0 tx=0x7fadc001cb00 comp rx=0 tx=0).stop 2024-09-17T05:31:51.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.827+0000 7fadce000640 1 -- 172.21.15.31:0/2530413999 shutdown_connections 2024-09-17T05:31:51.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.827+0000 7fadce000640 1 --2- 172.21.15.31:0/2530413999 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc80afb10 0x7fadc80affc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:51.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.827+0000 7fadce000640 1 -- 172.21.15.31:0/2530413999 >> 172.21.15.31:0/2530413999 conn(0x7fadc80d1dd0 msgr2=0x7fadc80d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:51.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.827+0000 7fadce000640 1 -- 172.21.15.31:0/2530413999 shutdown_connections 2024-09-17T05:31:51.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.827+0000 7fadce000640 1 -- 172.21.15.31:0/2530413999 wait complete. 2024-09-17T05:31:51.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadce000640 1 Processor -- start 2024-09-17T05:31:51.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadce000640 1 -- start start 2024-09-17T05:31:51.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadce000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc80afb10 0x7fadc8155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:51.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadce000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc80b1650 0x7fadc81673a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:51.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadce000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadc81605d0 0x7fadc80b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:51.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadce000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fadc816a6d0 con 0x7fadc81605d0 2024-09-17T05:31:51.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadce000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fadc816a550 con 0x7fadc80afb10 2024-09-17T05:31:51.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadce000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fadc816a850 con 0x7fadc80b1650 2024-09-17T05:31:51.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadc7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadc81605d0 0x7fadc80b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:51.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadc7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadc81605d0 0x7fadc80b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34986/0 (socket says 172.21.15.31:34986) 2024-09-17T05:31:51.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadc7e00640 1 -- 172.21.15.31:0/3676449566 learned_addr learned my addr 172.21.15.31:0/3676449566 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:51.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadc7400640 1 --2- 172.21.15.31:0/3676449566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc80afb10 0x7fadc8155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:51.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadc6a00640 1 --2- 172.21.15.31:0/3676449566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc80b1650 0x7fadc81673a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:51.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadc7e00640 1 -- 172.21.15.31:0/3676449566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc80b1650 msgr2=0x7fadc81673a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:51.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadc7e00640 1 --2- 172.21.15.31:0/3676449566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc80b1650 0x7fadc81673a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:51.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadc7e00640 1 -- 172.21.15.31:0/3676449566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc80afb10 msgr2=0x7fadc8155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:51.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadc7e00640 1 --2- 172.21.15.31:0/3676449566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc80afb10 0x7fadc8155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:51.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadc7e00640 1 -- 172.21.15.31:0/3676449566 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc81fbf30 con 0x7fadc81605d0 2024-09-17T05:31:51.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadc7e00640 1 --2- 172.21.15.31:0/3676449566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadc81605d0 0x7fadc80b3850 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fadc001b1b0 tx=0x7fadc0009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:51.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadbf400640 1 -- 172.21.15.31:0/3676449566 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc00bb070 con 0x7fadc81605d0 2024-09-17T05:31:51.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadbf400640 1 -- 172.21.15.31:0/3676449566 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadc0003e30 con 0x7fadc81605d0 2024-09-17T05:31:51.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadbf400640 1 -- 172.21.15.31:0/3676449566 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc00b2040 con 0x7fadc81605d0 2024-09-17T05:31:51.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadce000640 1 -- 172.21.15.31:0/3676449566 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc8154750 con 0x7fadc81605d0 2024-09-17T05:31:51.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.831+0000 7fadce000640 1 -- 172.21.15.31:0/3676449566 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc8154d10 con 0x7fadc81605d0 2024-09-17T05:31:51.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.835+0000 7fadce000640 1 -- 172.21.15.31:0/3676449566 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc80affc0 con 0x7fadc81605d0 2024-09-17T05:31:51.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.835+0000 7fadbf400640 1 -- 172.21.15.31:0/3676449566 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 9) ==== 97438+0+0 (secure 0 0 0) 0x7fadc0004cb0 con 0x7fadc81605d0 2024-09-17T05:31:51.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.835+0000 7fadbf400640 1 --2- 172.21.15.31:0/3676449566 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fada8073470 0x7fada8075930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:51.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.835+0000 7fadbf400640 1 -- 172.21.15.31:0/3676449566 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fadc012dff0 con 0x7fadc81605d0 2024-09-17T05:31:51.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.835+0000 7fadc7400640 1 --2- 172.21.15.31:0/3676449566 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fada8073470 0x7fada8075930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:51.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.835+0000 7fadc7400640 1 --2- 172.21.15.31:0/3676449566 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fada8073470 0x7fada8075930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fadb8001230 tx=0x7fadb8001760 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:51.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:51.839+0000 7fadbf400640 1 -- 172.21.15.31:0/3676449566 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fadc00166f0 con 0x7fadc81605d0 2024-09-17T05:31:52.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:52.043+0000 7fadce000640 1 -- 172.21.15.31:0/3676449566 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol98920", "target": ["mon-mgr", ""]}) -- 0x7fadc80d1080 con 0x7fada8073470 2024-09-17T05:31:52.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:52.047+0000 7fadbf400640 1 -- 172.21.15.31:0/3676449566 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7fadc80d1080 con 0x7fada8073470 2024-09-17T05:31:52.048 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/_nogroup/subvol98920 2024-09-17T05:31:52.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:52.047+0000 7fadce000640 1 -- 172.21.15.31:0/3676449566 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fada8073470 msgr2=0x7fada8075930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:52.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:52.047+0000 7fadce000640 1 --2- 172.21.15.31:0/3676449566 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fada8073470 0x7fada8075930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fadb8001230 tx=0x7fadb8001760 comp rx=0 tx=0).stop 2024-09-17T05:31:52.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:52.047+0000 7fadce000640 1 -- 172.21.15.31:0/3676449566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadc81605d0 msgr2=0x7fadc80b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:52.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:52.047+0000 7fadce000640 1 --2- 172.21.15.31:0/3676449566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadc81605d0 0x7fadc80b3850 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fadc001b1b0 tx=0x7fadc0009280 comp rx=0 tx=0).stop 2024-09-17T05:31:52.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:52.047+0000 7fadce000640 1 -- 172.21.15.31:0/3676449566 shutdown_connections 2024-09-17T05:31:52.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:52.047+0000 7fadce000640 1 --2- 172.21.15.31:0/3676449566 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fada8073470 0x7fada8075930 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:52.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:52.047+0000 7fadce000640 1 --2- 172.21.15.31:0/3676449566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fadc81605d0 0x7fadc80b3850 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:52.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:52.047+0000 7fadce000640 1 --2- 172.21.15.31:0/3676449566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fadc80b1650 0x7fadc81673a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:52.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:52.047+0000 7fadce000640 1 --2- 172.21.15.31:0/3676449566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fadc80afb10 0x7fadc8155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:52.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:52.047+0000 7fadce000640 1 -- 172.21.15.31:0/3676449566 >> 172.21.15.31:0/3676449566 conn(0x7fadc80d1dd0 msgr2=0x7fadc80b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:52.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:52.047+0000 7fadce000640 1 -- 172.21.15.31:0/3676449566 shutdown_connections 2024-09-17T05:31:52.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:52.047+0000 7fadce000640 1 -- 172.21.15.31:0/3676449566 wait complete. 2024-09-17T05:31:52.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:31:52.070 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/2a48e2f93f31f4f5c70d7bb8f05c2e6a.meta) 2024-09-17T05:31:56.252 INFO:teuthology.orchestra.run.smithi031.stdout:[GLOBAL] 2024-09-17T05:31:56.252 INFO:teuthology.orchestra.run.smithi031.stdout:version = 1 2024-09-17T05:31:56.252 INFO:teuthology.orchestra.run.smithi031.stdout:type = subvolume 2024-09-17T05:31:56.252 INFO:teuthology.orchestra.run.smithi031.stdout:path = /volumes/_nogroup/subvol98920 2024-09-17T05:31:56.252 INFO:teuthology.orchestra.run.smithi031.stdout:state = complete 2024-09-17T05:31:56.252 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:56.254 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume authorize cephfs subvol98920 alice 2024-09-17T05:31:56.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.411+0000 7f9950a00640 1 -- 172.21.15.31:0/438990553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f994c15be10 msgr2=0x7f994c0ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:56.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.411+0000 7f9950a00640 1 --2- 172.21.15.31:0/438990553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f994c15be10 0x7f994c0ce700 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f994c0746b0 tx=0x7f993c01c8c0 comp rx=0 tx=0).stop 2024-09-17T05:31:56.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.411+0000 7f9950a00640 1 -- 172.21.15.31:0/438990553 shutdown_connections 2024-09-17T05:31:56.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.411+0000 7f9950a00640 1 --2- 172.21.15.31:0/438990553 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f994c0b0b60 0x7f994c0cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:56.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.411+0000 7f9950a00640 1 --2- 172.21.15.31:0/438990553 >> v2:172.21.15.155:3300/0 conn(0x7f994c15c1f0 0x7f994c0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:56.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.411+0000 7f9950a00640 1 --2- 172.21.15.31:0/438990553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f994c15be10 0x7f994c0ce700 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:56.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.411+0000 7f9950a00640 1 -- 172.21.15.31:0/438990553 >> 172.21.15.31:0/438990553 conn(0x7f994c0d1da0 msgr2=0x7f994c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:56.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9950a00640 1 -- 172.21.15.31:0/438990553 shutdown_connections 2024-09-17T05:31:56.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9950a00640 1 -- 172.21.15.31:0/438990553 wait complete. 2024-09-17T05:31:56.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9950a00640 1 Processor -- start 2024-09-17T05:31:56.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9950a00640 1 -- start start 2024-09-17T05:31:56.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9950a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f994c0b0b60 0x7f994c0c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:56.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9950a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f994c15be10 0x7f994c1ee4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:56.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9950a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f994c15c1f0 0x7f994c1fb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:56.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9950a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f994c0ccf60 con 0x7f994c0b0b60 2024-09-17T05:31:56.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9950a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f994c0ccde0 con 0x7f994c15be10 2024-09-17T05:31:56.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9950a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f994c0cd0e0 con 0x7f994c15c1f0 2024-09-17T05:31:56.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9949e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f994c0b0b60 0x7f994c0c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:56.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9949e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f994c0b0b60 0x7f994c0c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35012/0 (socket says 172.21.15.31:35012) 2024-09-17T05:31:56.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9949e00640 1 -- 172.21.15.31:0/992382689 learned_addr learned my addr 172.21.15.31:0/992382689 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:56.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9943e00640 1 --2- 172.21.15.31:0/992382689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f994c15be10 0x7f994c1ee4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:56.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f994a800640 1 --2- 172.21.15.31:0/992382689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f994c15c1f0 0x7f994c1fb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:56.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9949e00640 1 -- 172.21.15.31:0/992382689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f994c15c1f0 msgr2=0x7f994c1fb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:56.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9949e00640 1 --2- 172.21.15.31:0/992382689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f994c15c1f0 0x7f994c1fb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:56.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9949e00640 1 -- 172.21.15.31:0/992382689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f994c15be10 msgr2=0x7f994c1ee4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:56.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9949e00640 1 --2- 172.21.15.31:0/992382689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f994c15be10 0x7f994c1ee4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:56.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9949e00640 1 -- 172.21.15.31:0/992382689 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994c0b75f0 con 0x7f994c0b0b60 2024-09-17T05:31:56.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.415+0000 7f9949e00640 1 --2- 172.21.15.31:0/992382689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f994c0b0b60 0x7f994c0c8190 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f993c01af70 tx=0x7f993c0a56b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:56.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.419+0000 7f9942000640 1 -- 172.21.15.31:0/992382689 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c0ba020 con 0x7f994c0b0b60 2024-09-17T05:31:56.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.419+0000 7f9942000640 1 -- 172.21.15.31:0/992382689 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f993c004470 con 0x7f994c0b0b60 2024-09-17T05:31:56.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.419+0000 7f9942000640 1 -- 172.21.15.31:0/992382689 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c0b2040 con 0x7f994c0b0b60 2024-09-17T05:31:56.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.419+0000 7f9950a00640 1 -- 172.21.15.31:0/992382689 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994c0b78d0 con 0x7f994c0b0b60 2024-09-17T05:31:56.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.419+0000 7f9950a00640 1 -- 172.21.15.31:0/992382689 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f994c0b72c0 con 0x7f994c0b0b60 2024-09-17T05:31:56.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.419+0000 7f9950a00640 1 -- 172.21.15.31:0/992382689 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f994c0b7b10 con 0x7f994c0b0b60 2024-09-17T05:31:56.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.419+0000 7f9942000640 1 -- 172.21.15.31:0/992382689 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 9) ==== 97438+0+0 (secure 0 0 0) 0x7f993c005290 con 0x7f994c0b0b60 2024-09-17T05:31:56.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.423+0000 7f9942000640 1 --2- 172.21.15.31:0/992382689 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9928073440 0x7f9928075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:56.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.423+0000 7f9942000640 1 -- 172.21.15.31:0/992382689 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f993c12e530 con 0x7f994c0b0b60 2024-09-17T05:31:56.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.423+0000 7f9943e00640 1 --2- 172.21.15.31:0/992382689 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9928073440 0x7f9928075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:56.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.423+0000 7f9943e00640 1 --2- 172.21.15.31:0/992382689 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9928073440 0x7f9928075900 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f994c09fce0 tx=0x7f993400b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:56.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.427+0000 7f9942000640 1 -- 172.21.15.31:0/992382689 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f994c0b7b10 con 0x7f994c0b0b60 2024-09-17T05:31:56.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.631+0000 7f9950a00640 1 -- 172.21.15.31:0/992382689 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "fs subvolume authorize", "vol_name": "cephfs", "sub_name": "subvol98920", "auth_id": "alice", "target": ["mon-mgr", ""]}) -- 0x7f994c070350 con 0x7f9928073440 2024-09-17T05:31:56.642 INFO:tasks.ceph.mgr.x.smithi155.stderr:Creating meta for ID alice with tenant None 2024-09-17T05:31:56.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.679+0000 7f9942000640 1 -- 172.21.15.31:0/992382689 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f994c070350 con 0x7f9928073440 2024-09-17T05:31:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.679+0000 7f9950a00640 1 -- 172.21.15.31:0/992382689 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9928073440 msgr2=0x7f9928075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.679+0000 7f9950a00640 1 --2- 172.21.15.31:0/992382689 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9928073440 0x7f9928075900 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f994c09fce0 tx=0x7f993400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:31:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.679+0000 7f9950a00640 1 -- 172.21.15.31:0/992382689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f994c0b0b60 msgr2=0x7f994c0c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:56.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.679+0000 7f9950a00640 1 --2- 172.21.15.31:0/992382689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f994c0b0b60 0x7f994c0c8190 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f993c01af70 tx=0x7f993c0a56b0 comp rx=0 tx=0).stop 2024-09-17T05:31:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.679+0000 7f9950a00640 1 -- 172.21.15.31:0/992382689 shutdown_connections 2024-09-17T05:31:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.679+0000 7f9950a00640 1 --2- 172.21.15.31:0/992382689 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9928073440 0x7f9928075900 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.679+0000 7f9950a00640 1 --2- 172.21.15.31:0/992382689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f994c15c1f0 0x7f994c1fb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.679+0000 7f9950a00640 1 --2- 172.21.15.31:0/992382689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f994c15be10 0x7f994c1ee4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.679+0000 7f9950a00640 1 --2- 172.21.15.31:0/992382689 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f994c0b0b60 0x7f994c0c8190 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.679+0000 7f9950a00640 1 -- 172.21.15.31:0/992382689 >> 172.21.15.31:0/992382689 conn(0x7f994c0d1da0 msgr2=0x7f994c165080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.679+0000 7f9950a00640 1 -- 172.21.15.31:0/992382689 shutdown_connections 2024-09-17T05:31:56.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.679+0000 7f9950a00640 1 -- 172.21.15.31:0/992382689 wait complete. 2024-09-17T05:31:56.702 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.alice --format=json-pretty 2024-09-17T05:31:56.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a55200640 1 -- 172.21.15.31:0/2580973119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a50073170 msgr2=0x7f9a5006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:56.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a55200640 1 --2- 172.21.15.31:0/2580973119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a50073170 0x7f9a5006d160 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9a5006d950 tx=0x7f9a3801c7e0 comp rx=0 tx=0).stop 2024-09-17T05:31:56.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a55200640 1 -- 172.21.15.31:0/2580973119 shutdown_connections 2024-09-17T05:31:56.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a55200640 1 --2- 172.21.15.31:0/2580973119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a50073170 0x7f9a5006d160 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:56.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a55200640 1 --2- 172.21.15.31:0/2580973119 >> v2:172.21.15.155:3300/0 conn(0x7f9a500ce800 0x7f9a5006cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:56.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a55200640 1 -- 172.21.15.31:0/2580973119 >> 172.21.15.31:0/2580973119 conn(0x7f9a500b2240 msgr2=0x7f9a500b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:56.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a55200640 1 -- 172.21.15.31:0/2580973119 shutdown_connections 2024-09-17T05:31:56.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a55200640 1 -- 172.21.15.31:0/2580973119 wait complete. 2024-09-17T05:31:56.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a55200640 1 Processor -- start 2024-09-17T05:31:56.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a55200640 1 -- start start 2024-09-17T05:31:56.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a55200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a50073170 0x7f9a5015a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:56.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a55200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a500ce800 0x7f9a50163db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:56.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a55200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a50143fe0 0x7f9a500a9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:56.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a55200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9a50168290 con 0x7f9a50073170 2024-09-17T05:31:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a55200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9a50168110 con 0x7f9a50143fe0 2024-09-17T05:31:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a55200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9a50168410 con 0x7f9a500ce800 2024-09-17T05:31:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a4de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a50073170 0x7f9a5015a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a4de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a50073170 0x7f9a5015a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35026/0 (socket says 172.21.15.31:35026) 2024-09-17T05:31:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a4de00640 1 -- 172.21.15.31:0/1342355316 learned_addr learned my addr 172.21.15.31:0/1342355316 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a47e00640 1 --2- 172.21.15.31:0/1342355316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a500ce800 0x7f9a50163db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a4e800640 1 --2- 172.21.15.31:0/1342355316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a50143fe0 0x7f9a500a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a4de00640 1 -- 172.21.15.31:0/1342355316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a500ce800 msgr2=0x7f9a50163db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a4de00640 1 --2- 172.21.15.31:0/1342355316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a500ce800 0x7f9a50163db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a4de00640 1 -- 172.21.15.31:0/1342355316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a50143fe0 msgr2=0x7f9a500a9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.855+0000 7f9a4de00640 1 --2- 172.21.15.31:0/1342355316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a50143fe0 0x7f9a500a9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.859+0000 7f9a4de00640 1 -- 172.21.15.31:0/1342355316 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a50164850 con 0x7f9a50073170 2024-09-17T05:31:56.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.859+0000 7f9a4e800640 1 --2- 172.21.15.31:0/1342355316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a50143fe0 0x7f9a500a9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:31:56.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.859+0000 7f9a4de00640 1 --2- 172.21.15.31:0/1342355316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a50073170 0x7f9a5015a970 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000d950 tx=0x7f9a4000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:56.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.859+0000 7f9a46000640 1 -- 172.21.15.31:0/1342355316 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a40017070 con 0x7f9a50073170 2024-09-17T05:31:56.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.859+0000 7f9a46000640 1 -- 172.21.15.31:0/1342355316 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a40009d20 con 0x7f9a50073170 2024-09-17T05:31:56.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.859+0000 7f9a46000640 1 -- 172.21.15.31:0/1342355316 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a400106c0 con 0x7f9a50073170 2024-09-17T05:31:56.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.859+0000 7f9a55200640 1 -- 172.21.15.31:0/1342355316 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a5015c750 con 0x7f9a50073170 2024-09-17T05:31:56.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.859+0000 7f9a55200640 1 -- 172.21.15.31:0/1342355316 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a5015cd10 con 0x7f9a50073170 2024-09-17T05:31:56.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.859+0000 7f9a55200640 1 -- 172.21.15.31:0/1342355316 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a5015d140 con 0x7f9a50073170 2024-09-17T05:31:56.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.859+0000 7f9a46000640 1 -- 172.21.15.31:0/1342355316 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 9) ==== 97438+0+0 (secure 0 0 0) 0x7f9a40010860 con 0x7f9a50073170 2024-09-17T05:31:56.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.859+0000 7f9a46000640 1 --2- 172.21.15.31:0/1342355316 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9a2c073470 0x7f9a2c075930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:56.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.863+0000 7f9a46000640 1 -- 172.21.15.31:0/1342355316 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f9a40094ba0 con 0x7f9a50073170 2024-09-17T05:31:56.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.863+0000 7f9a47e00640 1 --2- 172.21.15.31:0/1342355316 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9a2c073470 0x7f9a2c075930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:56.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.863+0000 7f9a47e00640 1 --2- 172.21.15.31:0/1342355316 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9a2c073470 0x7f9a2c075930 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9a380ae000 tx=0x7f9a3801b020 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:56.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:56.863+0000 7f9a46000640 1 -- 172.21.15.31:0/1342355316 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9a4005f740 con 0x7f9a50073170 2024-09-17T05:31:57.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.099+0000 7f9a55200640 1 -- 172.21.15.31:0/1342355316 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.alice", "format": "json-pretty"} v 0) -- 0x7f9a5015e8b0 con 0x7f9a50073170 2024-09-17T05:31:57.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.099+0000 7f9a46000640 1 -- 172.21.15.31:0/1342355316 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.alice", "format": "json-pretty"}]=0 v19) ==== 107+0+280 (secure 0 0 0) 0x7f9a4005f040 con 0x7f9a50073170 2024-09-17T05:31:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:31:57.102 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:31:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:31:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.alice", 2024-09-17T05:31:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBMFOlmLDc2JxAANJIF8t+mZVbqi2S63EIK3g==", 2024-09-17T05:31:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:31:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow rw path=/volumes/_nogroup/subvol98920", 2024-09-17T05:31:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2024-09-17T05:31:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw pool=cephfs_data" 2024-09-17T05:31:57.103 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:57.103 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:31:57.103 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:31:57.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.103+0000 7f9a55200640 1 -- 172.21.15.31:0/1342355316 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9a2c073470 msgr2=0x7f9a2c075930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:57.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.103+0000 7f9a55200640 1 --2- 172.21.15.31:0/1342355316 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9a2c073470 0x7f9a2c075930 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9a380ae000 tx=0x7f9a3801b020 comp rx=0 tx=0).stop 2024-09-17T05:31:57.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.103+0000 7f9a55200640 1 -- 172.21.15.31:0/1342355316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a50073170 msgr2=0x7f9a5015a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:57.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.103+0000 7f9a55200640 1 --2- 172.21.15.31:0/1342355316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a50073170 0x7f9a5015a970 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000d950 tx=0x7f9a4000de10 comp rx=0 tx=0).stop 2024-09-17T05:31:57.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.103+0000 7f9a55200640 1 -- 172.21.15.31:0/1342355316 shutdown_connections 2024-09-17T05:31:57.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.103+0000 7f9a55200640 1 --2- 172.21.15.31:0/1342355316 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9a2c073470 0x7f9a2c075930 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.103+0000 7f9a55200640 1 --2- 172.21.15.31:0/1342355316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a50143fe0 0x7f9a500a9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.103+0000 7f9a55200640 1 --2- 172.21.15.31:0/1342355316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a500ce800 0x7f9a50163db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.103+0000 7f9a55200640 1 --2- 172.21.15.31:0/1342355316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a50073170 0x7f9a5015a970 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.103+0000 7f9a55200640 1 -- 172.21.15.31:0/1342355316 >> 172.21.15.31:0/1342355316 conn(0x7f9a500b2240 msgr2=0x7f9a5006f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:57.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.103+0000 7f9a55200640 1 -- 172.21.15.31:0/1342355316 shutdown_connections 2024-09-17T05:31:57.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.103+0000 7f9a55200640 1 -- 172.21.15.31:0/1342355316 wait complete. 2024-09-17T05:31:57.123 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol98920 2024-09-17T05:31:57.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.271+0000 7f474e400640 1 -- 172.21.15.31:0/4279637329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f474815db50 msgr2=0x7f47480acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:57.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.271+0000 7f474e400640 1 --2- 172.21.15.31:0/4279637329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f474815db50 0x7f47480acd40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f473800a950 tx=0x7f473801dae0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f474e400640 1 -- 172.21.15.31:0/4279637329 shutdown_connections 2024-09-17T05:31:57.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f474e400640 1 --2- 172.21.15.31:0/4279637329 >> v2:172.21.15.155:3300/0 conn(0x7f47480b4a50 0x7f47480ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f474e400640 1 --2- 172.21.15.31:0/4279637329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f474815db50 0x7f47480acd40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f474e400640 1 -- 172.21.15.31:0/4279637329 >> 172.21.15.31:0/4279637329 conn(0x7f47480b18f0 msgr2=0x7f47480b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:57.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f474e400640 1 -- 172.21.15.31:0/4279637329 shutdown_connections 2024-09-17T05:31:57.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f474e400640 1 -- 172.21.15.31:0/4279637329 wait complete. 2024-09-17T05:31:57.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f474e400640 1 Processor -- start 2024-09-17T05:31:57.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f474e400640 1 -- start start 2024-09-17T05:31:57.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f474e400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47480b4a50 0x7f47480c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:57.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f474e400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47480cd100 0x7f47481fba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:57.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f474e400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f474815db50 0x7f47481f8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:57.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f474e400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4748167120 con 0x7f474815db50 2024-09-17T05:31:57.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f474e400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f47480cf550 con 0x7f47480b4a50 2024-09-17T05:31:57.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f474e400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f47481672a0 con 0x7f47480cd100 2024-09-17T05:31:57.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f4747e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f474815db50 0x7f47481f8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:57.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f4747e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f474815db50 0x7f47481f8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35040/0 (socket says 172.21.15.31:35040) 2024-09-17T05:31:57.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f4747e00640 1 -- 172.21.15.31:0/1647659546 learned_addr learned my addr 172.21.15.31:0/1647659546 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:57.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f473ea00640 1 --2- 172.21.15.31:0/1647659546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47480cd100 0x7f47481fba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:57.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f4747400640 1 --2- 172.21.15.31:0/1647659546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47480b4a50 0x7f47480c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:57.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f4747e00640 1 -- 172.21.15.31:0/1647659546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47480cd100 msgr2=0x7f47481fba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:57.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f4747e00640 1 --2- 172.21.15.31:0/1647659546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47480cd100 0x7f47481fba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f4747e00640 1 -- 172.21.15.31:0/1647659546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47480b4a50 msgr2=0x7f47480c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:57.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f4747e00640 1 --2- 172.21.15.31:0/1647659546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47480b4a50 0x7f47480c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f4747e00640 1 -- 172.21.15.31:0/1647659546 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47481fbfb0 con 0x7f474815db50 2024-09-17T05:31:57.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f473ea00640 1 --2- 172.21.15.31:0/1647659546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47480cd100 0x7f47481fba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:31:57.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.275+0000 7f4747400640 1 --2- 172.21.15.31:0/1647659546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47480b4a50 0x7f47480c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:31:57.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.279+0000 7f4747e00640 1 --2- 172.21.15.31:0/1647659546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f474815db50 0x7f47481f8440 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f474000ef60 tx=0x7f474000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:57.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.279+0000 7f473fe00640 1 -- 172.21.15.31:0/1647659546 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4740004b30 con 0x7f474815db50 2024-09-17T05:31:57.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.279+0000 7f473fe00640 1 -- 172.21.15.31:0/1647659546 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4740004dc0 con 0x7f474815db50 2024-09-17T05:31:57.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.279+0000 7f473fe00640 1 -- 172.21.15.31:0/1647659546 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474000b7d0 con 0x7f474815db50 2024-09-17T05:31:57.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.279+0000 7f474e400640 1 -- 172.21.15.31:0/1647659546 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47481f7c60 con 0x7f474815db50 2024-09-17T05:31:57.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.279+0000 7f474e400640 1 -- 172.21.15.31:0/1647659546 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47480b14d0 con 0x7f474815db50 2024-09-17T05:31:57.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.279+0000 7f474e400640 1 -- 172.21.15.31:0/1647659546 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4748069410 con 0x7f474815db50 2024-09-17T05:31:57.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.279+0000 7f473fe00640 1 -- 172.21.15.31:0/1647659546 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 9) ==== 97438+0+0 (secure 0 0 0) 0x7f474000b970 con 0x7f474815db50 2024-09-17T05:31:57.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.279+0000 7f473fe00640 1 --2- 172.21.15.31:0/1647659546 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4724073440 0x7f4724075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:57.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.279+0000 7f473fe00640 1 -- 172.21.15.31:0/1647659546 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f4740094ff0 con 0x7f474815db50 2024-09-17T05:31:57.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.279+0000 7f4747400640 1 --2- 172.21.15.31:0/1647659546 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4724073440 0x7f4724075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:57.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.283+0000 7f4747400640 1 --2- 172.21.15.31:0/1647659546 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4724073440 0x7f4724075900 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f47380b0000 tx=0x7f473801c320 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:57.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.283+0000 7f473fe00640 1 -- 172.21.15.31:0/1647659546 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f47481fbfb0 con 0x7f474815db50 2024-09-17T05:31:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.487+0000 7f474e400640 1 -- 172.21.15.31:0/1647659546 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol98920", "target": ["mon-mgr", ""]}) -- 0x7f474806eb00 con 0x7f4724073440 2024-09-17T05:31:57.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.519+0000 7f473fe00640 1 -- 172.21.15.31:0/1647659546 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f474806eb00 con 0x7f4724073440 2024-09-17T05:31:57.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.523+0000 7f474e400640 1 -- 172.21.15.31:0/1647659546 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4724073440 msgr2=0x7f4724075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:57.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.523+0000 7f474e400640 1 --2- 172.21.15.31:0/1647659546 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4724073440 0x7f4724075900 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f47380b0000 tx=0x7f473801c320 comp rx=0 tx=0).stop 2024-09-17T05:31:57.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.523+0000 7f474e400640 1 -- 172.21.15.31:0/1647659546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f474815db50 msgr2=0x7f47481f8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:57.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.523+0000 7f474e400640 1 --2- 172.21.15.31:0/1647659546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f474815db50 0x7f47481f8440 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f474000ef60 tx=0x7f474000ef90 comp rx=0 tx=0).stop 2024-09-17T05:31:57.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.523+0000 7f474e400640 1 -- 172.21.15.31:0/1647659546 shutdown_connections 2024-09-17T05:31:57.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.523+0000 7f474e400640 1 --2- 172.21.15.31:0/1647659546 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4724073440 0x7f4724075900 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.523+0000 7f474e400640 1 --2- 172.21.15.31:0/1647659546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f474815db50 0x7f47481f8440 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.523+0000 7f474e400640 1 --2- 172.21.15.31:0/1647659546 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f47480cd100 0x7f47481fba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.523+0000 7f474e400640 1 --2- 172.21.15.31:0/1647659546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47480b4a50 0x7f47480c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.523+0000 7f474e400640 1 -- 172.21.15.31:0/1647659546 >> 172.21.15.31:0/1647659546 conn(0x7f47480b18f0 msgr2=0x7f4748073fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:57.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.523+0000 7f474e400640 1 -- 172.21.15.31:0/1647659546 shutdown_connections 2024-09-17T05:31:57.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.523+0000 7f474e400640 1 -- 172.21.15.31:0/1647659546 wait complete. 2024-09-17T05:31:57.526 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:31:57.526+0000 7faafbe00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:31:57.526 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:31:57.526+0000 7faafbe00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:31:57.526 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:31:57.526+0000 7faafbe00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:31:57.527 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:31:57.526+0000 7faafbe00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:31:57.527 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:31:57.526+0000 7faafbe00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:31:57.544 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:31:57.546+0000 7faafdc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:31:57.544 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:31:57.546+0000 7faafdc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:31:57.544 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:31:57.546+0000 7faafdc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:31:57.544 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:31:57.546+0000 7faafdc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:31:57.544 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:31:57.546+0000 7faafdc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:31:57.546 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol53841 2024-09-17T05:31:57.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.695+0000 7fad6d200640 1 -- 172.21.15.31:0/1402035702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad680b1650 msgr2=0x7fad680b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:57.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.695+0000 7fad6d200640 1 --2- 172.21.15.31:0/1402035702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad680b1650 0x7fad680b1a30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fad68073810 tx=0x7fad5001c8a0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.695+0000 7fad6d200640 1 -- 172.21.15.31:0/1402035702 shutdown_connections 2024-09-17T05:31:57.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.695+0000 7fad6d200640 1 --2- 172.21.15.31:0/1402035702 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad680aeb00 0x7fad680aefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.695+0000 7fad6d200640 1 --2- 172.21.15.31:0/1402035702 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad680b1650 0x7fad680b1a30 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.695+0000 7fad6d200640 1 --2- 172.21.15.31:0/1402035702 >> v2:172.21.15.155:3300/0 conn(0x7fad681605d0 0x7fad680d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.695+0000 7fad6d200640 1 -- 172.21.15.31:0/1402035702 >> 172.21.15.31:0/1402035702 conn(0x7fad680d1dd0 msgr2=0x7fad680d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:31:57.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.695+0000 7fad6d200640 1 -- 172.21.15.31:0/1402035702 shutdown_connections 2024-09-17T05:31:57.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.695+0000 7fad6d200640 1 -- 172.21.15.31:0/1402035702 wait complete. 2024-09-17T05:31:57.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.695+0000 7fad6d200640 1 Processor -- start 2024-09-17T05:31:57.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.695+0000 7fad6d200640 1 -- start start 2024-09-17T05:31:57.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad6d200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad680aeb00 0x7fad681545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:57.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad6d200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad680b1650 0x7fad6815cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:57.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad6d200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad681605d0 0x7fad681f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:57.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad6d200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fad680b13a0 con 0x7fad680b1650 2024-09-17T05:31:57.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad6d200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fad680b1220 con 0x7fad680aeb00 2024-09-17T05:31:57.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad6d200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fad680afd00 con 0x7fad681605d0 2024-09-17T05:31:57.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad5fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad680b1650 0x7fad6815cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:57.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad5fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad680b1650 0x7fad6815cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35062/0 (socket says 172.21.15.31:35062) 2024-09-17T05:31:57.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad5fe00640 1 -- 172.21.15.31:0/3876245908 learned_addr learned my addr 172.21.15.31:0/3876245908 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:31:57.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad65e00640 1 --2- 172.21.15.31:0/3876245908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad680aeb00 0x7fad681545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:57.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad66800640 1 --2- 172.21.15.31:0/3876245908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad681605d0 0x7fad681f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:57.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad5fe00640 1 -- 172.21.15.31:0/3876245908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad681605d0 msgr2=0x7fad681f6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:57.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad5fe00640 1 --2- 172.21.15.31:0/3876245908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad681605d0 0x7fad681f6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad5fe00640 1 -- 172.21.15.31:0/3876245908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad680aeb00 msgr2=0x7fad681545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:31:57.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad5fe00640 1 --2- 172.21.15.31:0/3876245908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad680aeb00 0x7fad681545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:31:57.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad5fe00640 1 -- 172.21.15.31:0/3876245908 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6815ee90 con 0x7fad680b1650 2024-09-17T05:31:57.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad66800640 1 --2- 172.21.15.31:0/3876245908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad681605d0 0x7fad681f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:31:57.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad5fe00640 1 --2- 172.21.15.31:0/3876245908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad680b1650 0x7fad6815cc70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fad500b0040 tx=0x7fad500a5520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:57.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad5e000640 1 -- 172.21.15.31:0/3876245908 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad500ba020 con 0x7fad680b1650 2024-09-17T05:31:57.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad5e000640 1 -- 172.21.15.31:0/3876245908 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad500044b0 con 0x7fad680b1650 2024-09-17T05:31:57.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad5e000640 1 -- 172.21.15.31:0/3876245908 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad500b2040 con 0x7fad680b1650 2024-09-17T05:31:57.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad6d200640 1 -- 172.21.15.31:0/3876245908 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad680b4e30 con 0x7fad680b1650 2024-09-17T05:31:57.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad6d200640 1 -- 172.21.15.31:0/3876245908 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad680b53f0 con 0x7fad680b1650 2024-09-17T05:31:57.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad6d200640 1 -- 172.21.15.31:0/3876245908 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad680b1a30 con 0x7fad680b1650 2024-09-17T05:31:57.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.699+0000 7fad5e000640 1 -- 172.21.15.31:0/3876245908 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 9) ==== 97438+0+0 (secure 0 0 0) 0x7fad50005270 con 0x7fad680b1650 2024-09-17T05:31:57.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.703+0000 7fad5e000640 1 --2- 172.21.15.31:0/3876245908 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fad44073440 0x7fad44075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:31:57.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.703+0000 7fad5e000640 1 -- 172.21.15.31:0/3876245908 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fad5012e240 con 0x7fad680b1650 2024-09-17T05:31:57.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.703+0000 7fad65e00640 1 --2- 172.21.15.31:0/3876245908 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fad44073440 0x7fad44075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:31:57.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.703+0000 7fad65e00640 1 --2- 172.21.15.31:0/3876245908 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fad44073440 0x7fad44075900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fad5800bbd0 tx=0x7fad5800b2e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:31:57.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.707+0000 7fad5e000640 1 -- 172.21.15.31:0/3876245908 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fad50016490 con 0x7fad680b1650 2024-09-17T05:31:57.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:57.907+0000 7fad6d200640 1 -- 172.21.15.31:0/3876245908 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol53841", "target": ["mon-mgr", ""]}) -- 0x7fad680b4c80 con 0x7fad44073440 2024-09-17T05:31:59.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:31:59.795+0000 7fad5e000640 1 -- 172.21.15.31:0/3876245908 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7fad500f4b30 con 0x7fad680b1650 2024-09-17T05:32:06.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.255+0000 7fad5e000640 1 -- 172.21.15.31:0/3876245908 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fad680b4c80 con 0x7fad44073440 2024-09-17T05:32:06.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.259+0000 7fad6d200640 1 -- 172.21.15.31:0/3876245908 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fad44073440 msgr2=0x7fad44075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:06.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.259+0000 7fad6d200640 1 --2- 172.21.15.31:0/3876245908 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fad44073440 0x7fad44075900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fad5800bbd0 tx=0x7fad5800b2e0 comp rx=0 tx=0).stop 2024-09-17T05:32:06.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.259+0000 7fad6d200640 1 -- 172.21.15.31:0/3876245908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad680b1650 msgr2=0x7fad6815cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:06.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.259+0000 7fad6d200640 1 --2- 172.21.15.31:0/3876245908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad680b1650 0x7fad6815cc70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fad500b0040 tx=0x7fad500a5520 comp rx=0 tx=0).stop 2024-09-17T05:32:06.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.259+0000 7fad6d200640 1 -- 172.21.15.31:0/3876245908 shutdown_connections 2024-09-17T05:32:06.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.259+0000 7fad6d200640 1 --2- 172.21.15.31:0/3876245908 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fad44073440 0x7fad44075900 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:06.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.259+0000 7fad6d200640 1 --2- 172.21.15.31:0/3876245908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad681605d0 0x7fad681f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:06.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.259+0000 7fad6d200640 1 --2- 172.21.15.31:0/3876245908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fad680b1650 0x7fad6815cc70 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:06.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.259+0000 7fad6d200640 1 --2- 172.21.15.31:0/3876245908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad680aeb00 0x7fad681545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:06.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.259+0000 7fad6d200640 1 -- 172.21.15.31:0/3876245908 >> 172.21.15.31:0/3876245908 conn(0x7fad680d1dd0 msgr2=0x7fad68070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:06.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.259+0000 7fad6d200640 1 -- 172.21.15.31:0/3876245908 shutdown_connections 2024-09-17T05:32:06.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.259+0000 7fad6d200640 1 -- 172.21.15.31:0/3876245908 wait complete. 2024-09-17T05:32:06.290 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:32:06.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:32:06.347 INFO:teuthology.orchestra.run.smithi031.stdout:2 2024-09-17T05:32:06.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:32:06.355 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:32:06.355 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:32:06.473 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:32:06.581 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:32:06.581 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:32:06.581 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:32:06.581 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:06.590 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:32:06.590 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:06.643 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:32:06.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8937400640 1 -- 172.21.15.31:0/2082290333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89300b49e0 msgr2=0x7f89300acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:06.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8937400640 1 --2- 172.21.15.31:0/2082290333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89300b49e0 0x7f89300acd40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f89300708e0 tx=0x7f892801dd70 comp rx=0 tx=0).stop 2024-09-17T05:32:06.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8937400640 1 -- 172.21.15.31:0/2082290333 shutdown_connections 2024-09-17T05:32:06.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8937400640 1 --2- 172.21.15.31:0/2082290333 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f89300b49e0 0x7f89300acd40 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:06.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8937400640 1 --2- 172.21.15.31:0/2082290333 >> v2:172.21.15.155:3300/0 conn(0x7f89300cd100 0x7f893006f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:06.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8937400640 1 -- 172.21.15.31:0/2082290333 >> 172.21.15.31:0/2082290333 conn(0x7f89300b18f0 msgr2=0x7f89300b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:06.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8937400640 1 -- 172.21.15.31:0/2082290333 shutdown_connections 2024-09-17T05:32:06.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8937400640 1 -- 172.21.15.31:0/2082290333 wait complete. 2024-09-17T05:32:06.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8937400640 1 Processor -- start 2024-09-17T05:32:06.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8937400640 1 -- start start 2024-09-17T05:32:06.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8937400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89300b49e0 0x7f89300afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:06.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8937400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89300cd100 0x7f89301fb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:06.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8937400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f893015dae0 0x7f89301fbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:06.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8937400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f89300cf170 con 0x7f893015dae0 2024-09-17T05:32:06.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8937400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f89300ceff0 con 0x7f89300cd100 2024-09-17T05:32:06.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8937400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f89300cf2f0 con 0x7f89300b49e0 2024-09-17T05:32:06.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8935400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f893015dae0 0x7f89301fbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:06.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8935400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f893015dae0 0x7f89301fbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35186/0 (socket says 172.21.15.31:35186) 2024-09-17T05:32:06.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.839+0000 7f8935400640 1 -- 172.21.15.31:0/1413923613 learned_addr learned my addr 172.21.15.31:0/1413923613 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:06.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.843+0000 7f8934a00640 1 --2- 172.21.15.31:0/1413923613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89300b49e0 0x7f89300afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:06.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.843+0000 7f892fe00640 1 --2- 172.21.15.31:0/1413923613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89300cd100 0x7f89301fb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:06.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.843+0000 7f8935400640 1 -- 172.21.15.31:0/1413923613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89300b49e0 msgr2=0x7f89300afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:06.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.843+0000 7f8935400640 1 --2- 172.21.15.31:0/1413923613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89300b49e0 0x7f89300afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:06.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.843+0000 7f8935400640 1 -- 172.21.15.31:0/1413923613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89300cd100 msgr2=0x7f89301fb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:06.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.843+0000 7f8935400640 1 --2- 172.21.15.31:0/1413923613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89300cd100 0x7f89301fb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:06.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.843+0000 7f8935400640 1 -- 172.21.15.31:0/1413923613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89300b0c50 con 0x7f893015dae0 2024-09-17T05:32:06.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.843+0000 7f8935400640 1 --2- 172.21.15.31:0/1413923613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f893015dae0 0x7f89301fbd50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8928009bd0 tx=0x7f89280a6aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:06.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.843+0000 7f892cc00640 1 -- 172.21.15.31:0/1413923613 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89280b3040 con 0x7f893015dae0 2024-09-17T05:32:06.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.843+0000 7f892cc00640 1 -- 172.21.15.31:0/1413923613 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89280043b0 con 0x7f893015dae0 2024-09-17T05:32:06.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.843+0000 7f892cc00640 1 -- 172.21.15.31:0/1413923613 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89280047e0 con 0x7f893015dae0 2024-09-17T05:32:06.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.843+0000 7f8937400640 1 -- 172.21.15.31:0/1413923613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89300b03b0 con 0x7f893015dae0 2024-09-17T05:32:06.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.843+0000 7f8937400640 1 -- 172.21.15.31:0/1413923613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89300b0970 con 0x7f893015dae0 2024-09-17T05:32:06.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.843+0000 7f8937400640 1 -- 172.21.15.31:0/1413923613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8930069410 con 0x7f893015dae0 2024-09-17T05:32:06.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.843+0000 7f892cc00640 1 -- 172.21.15.31:0/1413923613 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f89280ae440 con 0x7f893015dae0 2024-09-17T05:32:06.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.843+0000 7f892cc00640 1 --2- 172.21.15.31:0/1413923613 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8910073590 0x7f8910075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:06.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.847+0000 7f892cc00640 1 -- 172.21.15.31:0/1413923613 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f892812f280 con 0x7f893015dae0 2024-09-17T05:32:06.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.847+0000 7f8934a00640 1 --2- 172.21.15.31:0/1413923613 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8910073590 0x7f8910075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:06.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.847+0000 7f8934a00640 1 --2- 172.21.15.31:0/1413923613 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8910073590 0x7f8910075a50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8924001650 tx=0x7f8924009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:06.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:06.851+0000 7f892cc00640 1 -- 172.21.15.31:0/1413923613 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8928017a80 con 0x7f893015dae0 2024-09-17T05:32:07.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.035+0000 7f8937400640 1 -- 172.21.15.31:0/1413923613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f89300acd40 con 0x7f893015dae0 2024-09-17T05:32:07.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.035+0000 7f892cc00640 1 -- 172.21.15.31:0/1413923613 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) ==== 80+0+0 (secure 0 0 0) 0x7f89280f9e60 con 0x7f893015dae0 2024-09-17T05:32:07.038 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:32:07.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.039+0000 7f8937400640 1 -- 172.21.15.31:0/1413923613 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8910073590 msgr2=0x7f8910075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:07.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.039+0000 7f8937400640 1 --2- 172.21.15.31:0/1413923613 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8910073590 0x7f8910075a50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8924001650 tx=0x7f8924009040 comp rx=0 tx=0).stop 2024-09-17T05:32:07.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.039+0000 7f8937400640 1 -- 172.21.15.31:0/1413923613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f893015dae0 msgr2=0x7f89301fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:07.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.039+0000 7f8937400640 1 --2- 172.21.15.31:0/1413923613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f893015dae0 0x7f89301fbd50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8928009bd0 tx=0x7f89280a6aa0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.039+0000 7f8937400640 1 -- 172.21.15.31:0/1413923613 shutdown_connections 2024-09-17T05:32:07.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.039+0000 7f8937400640 1 --2- 172.21.15.31:0/1413923613 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f8910073590 0x7f8910075a50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.039+0000 7f8937400640 1 --2- 172.21.15.31:0/1413923613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f893015dae0 0x7f89301fbd50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.039+0000 7f8937400640 1 --2- 172.21.15.31:0/1413923613 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89300cd100 0x7f89301fb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.039+0000 7f8937400640 1 --2- 172.21.15.31:0/1413923613 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89300b49e0 0x7f89300afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.039+0000 7f8937400640 1 -- 172.21.15.31:0/1413923613 >> 172.21.15.31:0/1413923613 conn(0x7f89300b18f0 msgr2=0x7f8930150740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:07.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.039+0000 7f8937400640 1 -- 172.21.15.31:0/1413923613 shutdown_connections 2024-09-17T05:32:07.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.039+0000 7f8937400640 1 -- 172.21.15.31:0/1413923613 wait complete. 2024-09-17T05:32:07.059 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:32:07.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:07.060 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:32:07.128 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:32:07.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:07.129 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:32:07.141 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:32:07.142 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:32:07.142 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:07.151 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:32:07.151 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:07.202 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:32:07.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2735400640 1 -- 172.21.15.31:0/1425561169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f273015f6e0 msgr2=0x7f27300d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:07.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2735400640 1 --2- 172.21.15.31:0/1425561169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f273015f6e0 0x7f27300d03b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2718009900 tx=0x7f271801f0d0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2735400640 1 -- 172.21.15.31:0/1425561169 shutdown_connections 2024-09-17T05:32:07.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2735400640 1 --2- 172.21.15.31:0/1425561169 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27300b2d60 0x7f27300af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2735400640 1 --2- 172.21.15.31:0/1425561169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f273015f6e0 0x7f27300d03b0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2735400640 1 -- 172.21.15.31:0/1425561169 >> 172.21.15.31:0/1425561169 conn(0x7f27300d1e30 msgr2=0x7f27300d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:07.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2735400640 1 -- 172.21.15.31:0/1425561169 shutdown_connections 2024-09-17T05:32:07.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2735400640 1 -- 172.21.15.31:0/1425561169 wait complete. 2024-09-17T05:32:07.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2735400640 1 Processor -- start 2024-09-17T05:32:07.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2735400640 1 -- start start 2024-09-17T05:32:07.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2735400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27300b2d60 0x7f27300b7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:07.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2735400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f273015f300 0x7f27300c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:07.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2735400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273015f6e0 0x7f273015a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:07.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2735400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f27300affe0 con 0x7f273015f300 2024-09-17T05:32:07.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2735400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f27300afe60 con 0x7f27300b2d60 2024-09-17T05:32:07.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2735400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f27300b0160 con 0x7f273015f6e0 2024-09-17T05:32:07.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2727e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f273015f300 0x7f27300c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:07.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2727e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f273015f300 0x7f27300c53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35192/0 (socket says 172.21.15.31:35192) 2024-09-17T05:32:07.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2727e00640 1 -- 172.21.15.31:0/1359242493 learned_addr learned my addr 172.21.15.31:0/1359242493 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:07.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f272e800640 1 --2- 172.21.15.31:0/1359242493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27300b2d60 0x7f27300b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f272f200640 1 --2- 172.21.15.31:0/1359242493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273015f6e0 0x7f273015a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2727e00640 1 -- 172.21.15.31:0/1359242493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273015f6e0 msgr2=0x7f273015a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2727e00640 1 --2- 172.21.15.31:0/1359242493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273015f6e0 0x7f273015a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2727e00640 1 -- 172.21.15.31:0/1359242493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27300b2d60 msgr2=0x7f27300b7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2727e00640 1 --2- 172.21.15.31:0/1359242493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27300b2d60 0x7f27300b7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f2727e00640 1 -- 172.21.15.31:0/1359242493 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27300ce160 con 0x7f273015f300 2024-09-17T05:32:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.351+0000 7f272e800640 1 --2- 172.21.15.31:0/1359242493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27300b2d60 0x7f27300b7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.355+0000 7f2727e00640 1 --2- 172.21.15.31:0/1359242493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f273015f300 0x7f27300c53e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2718009850 tx=0x7f27180a8ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.355+0000 7f2726a00640 1 -- 172.21.15.31:0/1359242493 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27180be070 con 0x7f273015f300 2024-09-17T05:32:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.355+0000 7f2726a00640 1 -- 172.21.15.31:0/1359242493 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2718003970 con 0x7f273015f300 2024-09-17T05:32:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.355+0000 7f2726a00640 1 -- 172.21.15.31:0/1359242493 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27180b5040 con 0x7f273015f300 2024-09-17T05:32:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.355+0000 7f2735400640 1 -- 172.21.15.31:0/1359242493 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27300b6430 con 0x7f273015f300 2024-09-17T05:32:07.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.355+0000 7f2735400640 1 -- 172.21.15.31:0/1359242493 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2730155fc0 con 0x7f273015f300 2024-09-17T05:32:07.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.355+0000 7f2735400640 1 -- 172.21.15.31:0/1359242493 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27300af710 con 0x7f273015f300 2024-09-17T05:32:07.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.355+0000 7f2726a00640 1 -- 172.21.15.31:0/1359242493 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f27180c1070 con 0x7f273015f300 2024-09-17T05:32:07.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.355+0000 7f2726a00640 1 --2- 172.21.15.31:0/1359242493 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f270c073560 0x7f270c075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:07.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.355+0000 7f2726a00640 1 -- 172.21.15.31:0/1359242493 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f2718131980 con 0x7f273015f300 2024-09-17T05:32:07.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.355+0000 7f272e800640 1 --2- 172.21.15.31:0/1359242493 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f270c073560 0x7f270c075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:07.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.359+0000 7f272e800640 1 --2- 172.21.15.31:0/1359242493 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f270c073560 0x7f270c075a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2720000f70 tx=0x7f2720009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:07.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.359+0000 7f2726a00640 1 -- 172.21.15.31:0/1359242493 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f27300b6430 con 0x7f273015f300 2024-09-17T05:32:07.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.547+0000 7f2735400640 1 -- 172.21.15.31:0/1359242493 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f273006aba0 con 0x7f273015f300 2024-09-17T05:32:07.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.547+0000 7f2726a00640 1 -- 172.21.15.31:0/1359242493 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) ==== 80+0+0 (secure 0 0 0) 0x7f2718018c30 con 0x7f273015f300 2024-09-17T05:32:07.550 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:32:07.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.551+0000 7f2735400640 1 -- 172.21.15.31:0/1359242493 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f270c073560 msgr2=0x7f270c075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:07.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.551+0000 7f2735400640 1 --2- 172.21.15.31:0/1359242493 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f270c073560 0x7f270c075a20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2720000f70 tx=0x7f2720009040 comp rx=0 tx=0).stop 2024-09-17T05:32:07.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.551+0000 7f2735400640 1 -- 172.21.15.31:0/1359242493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f273015f300 msgr2=0x7f27300c53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:07.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.551+0000 7f2735400640 1 --2- 172.21.15.31:0/1359242493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f273015f300 0x7f27300c53e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2718009850 tx=0x7f27180a8ce0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.551+0000 7f2735400640 1 -- 172.21.15.31:0/1359242493 shutdown_connections 2024-09-17T05:32:07.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.551+0000 7f2735400640 1 --2- 172.21.15.31:0/1359242493 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f270c073560 0x7f270c075a20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.551+0000 7f2735400640 1 --2- 172.21.15.31:0/1359242493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f273015f6e0 0x7f273015a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.551+0000 7f2735400640 1 --2- 172.21.15.31:0/1359242493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f273015f300 0x7f27300c53e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.551+0000 7f2735400640 1 --2- 172.21.15.31:0/1359242493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27300b2d60 0x7f27300b7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.551+0000 7f2735400640 1 -- 172.21.15.31:0/1359242493 >> 172.21.15.31:0/1359242493 conn(0x7f27300d1e30 msgr2=0x7f27300b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:07.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.551+0000 7f2735400640 1 -- 172.21.15.31:0/1359242493 shutdown_connections 2024-09-17T05:32:07.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.551+0000 7f2735400640 1 -- 172.21.15.31:0/1359242493 wait complete. 2024-09-17T05:32:07.573 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T05:32:07.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:07.573 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T05:32:07.602 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:32:07.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:07.602 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:32:07.655 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:32:07.655 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:32:07.655 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:07.664 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:32:07.664 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:32:07.664 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:32:07.665 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:07.706 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:32:07.707 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:32:07.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69a00640 1 -- 172.21.15.31:0/3570222699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b641613d0 msgr2=0x7f6b640d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:07.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69a00640 1 --2- 172.21.15.31:0/3570222699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b641613d0 0x7f6b640d0540 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6b640cae80 tx=0x7f6b5401c890 comp rx=0 tx=0).stop 2024-09-17T05:32:07.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69a00640 1 -- 172.21.15.31:0/3570222699 shutdown_connections 2024-09-17T05:32:07.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69a00640 1 --2- 172.21.15.31:0/3570222699 >> v2:172.21.15.155:3300/0 conn(0x7f6b640d0fc0 0x7f6b640d19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69a00640 1 --2- 172.21.15.31:0/3570222699 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b641617b0 0x7f6b640d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69a00640 1 --2- 172.21.15.31:0/3570222699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b641613d0 0x7f6b640d0540 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69a00640 1 -- 172.21.15.31:0/3570222699 >> 172.21.15.31:0/3570222699 conn(0x7f6b640d3e00 msgr2=0x7f6b640d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69a00640 1 -- 172.21.15.31:0/3570222699 shutdown_connections 2024-09-17T05:32:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69a00640 1 -- 172.21.15.31:0/3570222699 wait complete. 2024-09-17T05:32:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69a00640 1 Processor -- start 2024-09-17T05:32:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69a00640 1 -- start start 2024-09-17T05:32:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b640d0fc0 0x7f6b6414fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b641613d0 0x7f6b640cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b641617b0 0x7f6b640c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6b640b7100 con 0x7f6b641617b0 2024-09-17T05:32:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6b640b6f80 con 0x7f6b641613d0 2024-09-17T05:32:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6b640b7280 con 0x7f6b640d0fc0 2024-09-17T05:32:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b641617b0 0x7f6b640c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b641617b0 0x7f6b640c7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35200/0 (socket says 172.21.15.31:35200) 2024-09-17T05:32:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69000640 1 -- 172.21.15.31:0/970311066 learned_addr learned my addr 172.21.15.31:0/970311066 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b63e00640 1 --2- 172.21.15.31:0/970311066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b640d0fc0 0x7f6b6414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b5be00640 1 --2- 172.21.15.31:0/970311066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b641613d0 0x7f6b640cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:07.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69000640 1 -- 172.21.15.31:0/970311066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b640d0fc0 msgr2=0x7f6b6414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:07.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69000640 1 --2- 172.21.15.31:0/970311066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b640d0fc0 0x7f6b6414fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69000640 1 -- 172.21.15.31:0/970311066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b641613d0 msgr2=0x7f6b640cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:07.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69000640 1 --2- 172.21.15.31:0/970311066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b641613d0 0x7f6b640cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:07.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69000640 1 -- 172.21.15.31:0/970311066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b64159da0 con 0x7f6b641617b0 2024-09-17T05:32:07.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b69000640 1 --2- 172.21.15.31:0/970311066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b641617b0 0x7f6b640c7b00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00d9d0 tx=0x7f6b5c00de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:07.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b60c00640 1 -- 172.21.15.31:0/970311066 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c017070 con 0x7f6b641617b0 2024-09-17T05:32:07.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.855+0000 7f6b60c00640 1 -- 172.21.15.31:0/970311066 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b5c010460 con 0x7f6b641617b0 2024-09-17T05:32:07.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.859+0000 7f6b69a00640 1 -- 172.21.15.31:0/970311066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b6415a060 con 0x7f6b641617b0 2024-09-17T05:32:07.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.859+0000 7f6b60c00640 1 -- 172.21.15.31:0/970311066 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c00be60 con 0x7f6b641617b0 2024-09-17T05:32:07.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.859+0000 7f6b69a00640 1 -- 172.21.15.31:0/970311066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b64150a60 con 0x7f6b641617b0 2024-09-17T05:32:07.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.859+0000 7f6b69a00640 1 -- 172.21.15.31:0/970311066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b640d19d0 con 0x7f6b641617b0 2024-09-17T05:32:07.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.859+0000 7f6b60c00640 1 -- 172.21.15.31:0/970311066 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f6b5c0108b0 con 0x7f6b641617b0 2024-09-17T05:32:07.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.859+0000 7f6b60c00640 1 --2- 172.21.15.31:0/970311066 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6b40073590 0x7f6b40075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:07.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.859+0000 7f6b60c00640 1 -- 172.21.15.31:0/970311066 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f6b5c094f60 con 0x7f6b641617b0 2024-09-17T05:32:07.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.859+0000 7f6b63e00640 1 --2- 172.21.15.31:0/970311066 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6b40073590 0x7f6b40075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:07.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.863+0000 7f6b63e00640 1 --2- 172.21.15.31:0/970311066 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6b40073590 0x7f6b40075a50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6b540af000 tx=0x7f6b5401b0d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:07.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:07.863+0000 7f6b60c00640 1 -- 172.21.15.31:0/970311066 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6b5c05f360 con 0x7f6b641617b0 2024-09-17T05:32:08.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.075+0000 7f6b69a00640 1 -- 172.21.15.31:0/970311066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b640c72f0 con 0x7f6b641617b0 2024-09-17T05:32:08.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.075+0000 7f6b60c00640 1 -- 172.21.15.31:0/970311066 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5229 (secure 0 0 0) 0x7f6b5c063d90 con 0x7f6b641617b0 2024-09-17T05:32:08.078 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:08.078 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":39,"btime":"2024-09-17T05:31:49:752425+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/3185006969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3185006969},{"type":"v1","addr":"172.21.15.155:6836","nonce":3185006969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3957768567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3957768567},{"type":"v1","addr":"172.21.15.155:6837","nonce":3957768567}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5748,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3936847081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3936847081},{"type":"v1","addr":"172.21.15.31:6833","nonce":3936847081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:31:40.115955+0000","modified":"2024-09-17T05:31:43.131088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1272884249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1272884249},{"type":"v1","addr":"172.21.15.31:6835","nonce":1272884249}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5751,"qdb_cluster":[5751]},"id":4}]} 2024-09-17T05:32:08.079 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 39 2024-09-17T05:32:08.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.079+0000 7f6b69a00640 1 -- 172.21.15.31:0/970311066 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6b40073590 msgr2=0x7f6b40075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:08.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.079+0000 7f6b69a00640 1 --2- 172.21.15.31:0/970311066 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6b40073590 0x7f6b40075a50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6b540af000 tx=0x7f6b5401b0d0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.079+0000 7f6b69a00640 1 -- 172.21.15.31:0/970311066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b641617b0 msgr2=0x7f6b640c7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.079+0000 7f6b69a00640 1 --2- 172.21.15.31:0/970311066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b641617b0 0x7f6b640c7b00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00d9d0 tx=0x7f6b5c00de90 comp rx=0 tx=0).stop 2024-09-17T05:32:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.079+0000 7f6b69a00640 1 -- 172.21.15.31:0/970311066 shutdown_connections 2024-09-17T05:32:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.079+0000 7f6b69a00640 1 --2- 172.21.15.31:0/970311066 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f6b40073590 0x7f6b40075a50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.079+0000 7f6b69a00640 1 --2- 172.21.15.31:0/970311066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b641617b0 0x7f6b640c7b00 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.079+0000 7f6b69a00640 1 --2- 172.21.15.31:0/970311066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b641613d0 0x7f6b640cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.079+0000 7f6b69a00640 1 --2- 172.21.15.31:0/970311066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b640d0fc0 0x7f6b6414fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.079+0000 7f6b69a00640 1 -- 172.21.15.31:0/970311066 >> 172.21.15.31:0/970311066 conn(0x7f6b640d3e00 msgr2=0x7f6b640b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.079+0000 7f6b69a00640 1 -- 172.21.15.31:0/970311066 shutdown_connections 2024-09-17T05:32:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.079+0000 7f6b69a00640 1 -- 172.21.15.31:0/970311066 wait complete. 2024-09-17T05:32:08.101 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:32:08.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.247+0000 7f3543e00640 1 -- 172.21.15.31:0/963259412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35440b2ca0 msgr2=0x7f35440cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:08.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.247+0000 7f3543e00640 1 --2- 172.21.15.31:0/963259412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35440b2ca0 0x7f35440cefb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f353c009c80 tx=0x7f353c01cd10 comp rx=0 tx=0).stop 2024-09-17T05:32:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.247+0000 7f3543e00640 1 -- 172.21.15.31:0/963259412 shutdown_connections 2024-09-17T05:32:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.247+0000 7f3543e00640 1 --2- 172.21.15.31:0/963259412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35440b2ca0 0x7f35440cefb0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.247+0000 7f3543e00640 1 -- 172.21.15.31:0/963259412 >> 172.21.15.31:0/963259412 conn(0x7f354409aa10 msgr2=0x7f354409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.247+0000 7f3543e00640 1 -- 172.21.15.31:0/963259412 shutdown_connections 2024-09-17T05:32:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.247+0000 7f3543e00640 1 -- 172.21.15.31:0/963259412 wait complete. 2024-09-17T05:32:08.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.247+0000 7f3543e00640 1 Processor -- start 2024-09-17T05:32:08.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.247+0000 7f3543e00640 1 -- start start 2024-09-17T05:32:08.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3543e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35440b2ca0 0x7f3544157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:08.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3543e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35440d01b0 0x7f35440c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:08.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3543e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f354415f000 0x7f354415c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:08.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3543e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f354416a0f0 con 0x7f354415f000 2024-09-17T05:32:08.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3543e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3544169f70 con 0x7f35440d01b0 2024-09-17T05:32:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3543e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f354416a270 con 0x7f35440b2ca0 2024-09-17T05:32:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3543400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f354415f000 0x7f354415c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3543400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f354415f000 0x7f354415c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35220/0 (socket says 172.21.15.31:35220) 2024-09-17T05:32:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3543400640 1 -- 172.21.15.31:0/1668543372 learned_addr learned my addr 172.21.15.31:0/1668543372 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3542a00640 1 --2- 172.21.15.31:0/1668543372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35440b2ca0 0x7f3544157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f353be00640 1 --2- 172.21.15.31:0/1668543372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35440d01b0 0x7f35440c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3543400640 1 -- 172.21.15.31:0/1668543372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35440b2ca0 msgr2=0x7f3544157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3543400640 1 --2- 172.21.15.31:0/1668543372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35440b2ca0 0x7f3544157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3543400640 1 -- 172.21.15.31:0/1668543372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35440d01b0 msgr2=0x7f35440c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3543400640 1 --2- 172.21.15.31:0/1668543372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35440d01b0 0x7f35440c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3543400640 1 -- 172.21.15.31:0/1668543372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35440b0cb0 con 0x7f354415f000 2024-09-17T05:32:08.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f353be00640 1 --2- 172.21.15.31:0/1668543372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35440d01b0 0x7f35440c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3543400640 1 --2- 172.21.15.31:0/1668543372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f354415f000 0x7f354415c130 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f353c009bd0 tx=0x7f353c0a5a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f353aa00640 1 -- 172.21.15.31:0/1668543372 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353c0bb070 con 0x7f354415f000 2024-09-17T05:32:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f353aa00640 1 -- 172.21.15.31:0/1668543372 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f353c004d40 con 0x7f354415f000 2024-09-17T05:32:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f353aa00640 1 -- 172.21.15.31:0/1668543372 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353c0b2040 con 0x7f354415f000 2024-09-17T05:32:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3543e00640 1 -- 172.21.15.31:0/1668543372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35441585f0 con 0x7f354415f000 2024-09-17T05:32:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3543e00640 1 -- 172.21.15.31:0/1668543372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35440b5170 con 0x7f354415f000 2024-09-17T05:32:08.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f3543e00640 1 -- 172.21.15.31:0/1668543372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35440cefb0 con 0x7f354415f000 2024-09-17T05:32:08.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.251+0000 7f353aa00640 1 -- 172.21.15.31:0/1668543372 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f353c0a5b70 con 0x7f354415f000 2024-09-17T05:32:08.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.255+0000 7f353aa00640 1 --2- 172.21.15.31:0/1668543372 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3520073560 0x7f3520075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:08.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.255+0000 7f353aa00640 1 -- 172.21.15.31:0/1668543372 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f353c12e780 con 0x7f354415f000 2024-09-17T05:32:08.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.255+0000 7f3542a00640 1 --2- 172.21.15.31:0/1668543372 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3520073560 0x7f3520075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:08.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.255+0000 7f3542a00640 1 --2- 172.21.15.31:0/1668543372 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3520073560 0x7f3520075a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3534007fd0 tx=0x7f3534009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:08.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.259+0000 7f353aa00640 1 -- 172.21.15.31:0/1668543372 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f353c016990 con 0x7f354415f000 2024-09-17T05:32:08.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.471+0000 7f3543e00640 1 -- 172.21.15.31:0/1668543372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35440cdb40 con 0x7f354415f000 2024-09-17T05:32:08.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.471+0000 7f353aa00640 1 -- 172.21.15.31:0/1668543372 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5229 (secure 0 0 0) 0x7f353c0f8ca0 con 0x7f354415f000 2024-09-17T05:32:08.473 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:08.473 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":39,"btime":"2024-09-17T05:31:49:752425+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/3185006969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3185006969},{"type":"v1","addr":"172.21.15.155:6836","nonce":3185006969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3957768567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3957768567},{"type":"v1","addr":"172.21.15.155:6837","nonce":3957768567}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5748,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3936847081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3936847081},{"type":"v1","addr":"172.21.15.31:6833","nonce":3936847081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:31:40.115955+0000","modified":"2024-09-17T05:31:43.131088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1272884249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1272884249},{"type":"v1","addr":"172.21.15.31:6835","nonce":1272884249}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5751,"qdb_cluster":[5751]},"id":4}]} 2024-09-17T05:32:08.473 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 39 2024-09-17T05:32:08.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.471+0000 7f3543e00640 1 -- 172.21.15.31:0/1668543372 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3520073560 msgr2=0x7f3520075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:08.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.471+0000 7f3543e00640 1 --2- 172.21.15.31:0/1668543372 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3520073560 0x7f3520075a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3534007fd0 tx=0x7f3534009040 comp rx=0 tx=0).stop 2024-09-17T05:32:08.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.471+0000 7f3543e00640 1 -- 172.21.15.31:0/1668543372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f354415f000 msgr2=0x7f354415c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:08.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.471+0000 7f3543e00640 1 --2- 172.21.15.31:0/1668543372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f354415f000 0x7f354415c130 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f353c009bd0 tx=0x7f353c0a5a00 comp rx=0 tx=0).stop 2024-09-17T05:32:08.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.475+0000 7f3543e00640 1 -- 172.21.15.31:0/1668543372 shutdown_connections 2024-09-17T05:32:08.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.475+0000 7f3543e00640 1 --2- 172.21.15.31:0/1668543372 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3520073560 0x7f3520075a20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.475+0000 7f3543e00640 1 --2- 172.21.15.31:0/1668543372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f354415f000 0x7f354415c130 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.475+0000 7f3543e00640 1 --2- 172.21.15.31:0/1668543372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35440d01b0 0x7f35440c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.475+0000 7f3543e00640 1 --2- 172.21.15.31:0/1668543372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35440b2ca0 0x7f3544157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.475+0000 7f3543e00640 1 -- 172.21.15.31:0/1668543372 >> 172.21.15.31:0/1668543372 conn(0x7f354409aa10 msgr2=0x7f35440ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:08.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.475+0000 7f3543e00640 1 -- 172.21.15.31:0/1668543372 shutdown_connections 2024-09-17T05:32:08.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.475+0000 7f3543e00640 1 -- 172.21.15.31:0/1668543372 wait complete. 2024-09-17T05:32:08.495 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:32:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.639+0000 7f1d7fc00640 1 -- 172.21.15.31:0/1191093588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d7815c2d0 msgr2=0x7f1d78074060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.639+0000 7f1d7fc00640 1 --2- 172.21.15.31:0/1191093588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d7815c2d0 0x7f1d78074060 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1d780c47a0 tx=0x7f1d6401c890 comp rx=0 tx=0).stop 2024-09-17T05:32:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.639+0000 7f1d7fc00640 1 -- 172.21.15.31:0/1191093588 shutdown_connections 2024-09-17T05:32:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.639+0000 7f1d7fc00640 1 --2- 172.21.15.31:0/1191093588 >> v2:172.21.15.155:3300/0 conn(0x7f1d780745a0 0x7f1d7806cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.639+0000 7f1d7fc00640 1 --2- 172.21.15.31:0/1191093588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d7815c2d0 0x7f1d78074060 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.639+0000 7f1d7fc00640 1 --2- 172.21.15.31:0/1191093588 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d780b6350 0x7f1d7806fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.639+0000 7f1d7fc00640 1 -- 172.21.15.31:0/1191093588 >> 172.21.15.31:0/1191093588 conn(0x7f1d780d0cd0 msgr2=0x7f1d780d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:08.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.639+0000 7f1d7fc00640 1 -- 172.21.15.31:0/1191093588 shutdown_connections 2024-09-17T05:32:08.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.639+0000 7f1d7fc00640 1 -- 172.21.15.31:0/1191093588 wait complete. 2024-09-17T05:32:08.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7fc00640 1 Processor -- start 2024-09-17T05:32:08.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7fc00640 1 -- start start 2024-09-17T05:32:08.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7fc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d780b6350 0x7f1d780ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:08.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7fc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d7815c2d0 0x7f1d78154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:08.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7fc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d78155210 0x7f1d78157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:08.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7fc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7815ff10 con 0x7f1d780b6350 2024-09-17T05:32:08.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7fc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7815fd90 con 0x7f1d7815c2d0 2024-09-17T05:32:08.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7fc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1d78160090 con 0x7f1d78155210 2024-09-17T05:32:08.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7d200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d780b6350 0x7f1d780ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:08.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7d200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d780b6350 0x7f1d780ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41428/0 (socket says 172.21.15.31:41428) 2024-09-17T05:32:08.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7d200640 1 -- 172.21.15.31:0/29033173 learned_addr learned my addr 172.21.15.31:0/29033173 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:08.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d77e00640 1 --2- 172.21.15.31:0/29033173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d7815c2d0 0x7f1d78154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:08.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7dc00640 1 --2- 172.21.15.31:0/29033173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d78155210 0x7f1d78157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:08.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7d200640 1 -- 172.21.15.31:0/29033173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d78155210 msgr2=0x7f1d78157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:08.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7d200640 1 --2- 172.21.15.31:0/29033173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d78155210 0x7f1d78157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7d200640 1 -- 172.21.15.31:0/29033173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d7815c2d0 msgr2=0x7f1d78154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:08.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7d200640 1 --2- 172.21.15.31:0/29033173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d7815c2d0 0x7f1d78154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7d200640 1 -- 172.21.15.31:0/29033173 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d78155790 con 0x7f1d780b6350 2024-09-17T05:32:08.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7d200640 1 --2- 172.21.15.31:0/29033173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d780b6350 0x7f1d780ca4e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00d980 tx=0x7f1d6c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:08.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d74c00640 1 -- 172.21.15.31:0/29033173 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c017070 con 0x7f1d780b6350 2024-09-17T05:32:08.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d74c00640 1 -- 172.21.15.31:0/29033173 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d6c009d60 con 0x7f1d780b6350 2024-09-17T05:32:08.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d74c00640 1 -- 172.21.15.31:0/29033173 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c005280 con 0x7f1d780b6350 2024-09-17T05:32:08.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7fc00640 1 -- 172.21.15.31:0/29033173 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d78155a70 con 0x7f1d780b6350 2024-09-17T05:32:08.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.643+0000 7f1d7fc00640 1 -- 172.21.15.31:0/29033173 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d780c8730 con 0x7f1d780b6350 2024-09-17T05:32:08.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.647+0000 7f1d7fc00640 1 -- 172.21.15.31:0/29033173 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d781605b0 con 0x7f1d780b6350 2024-09-17T05:32:08.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.647+0000 7f1d74c00640 1 -- 172.21.15.31:0/29033173 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f1d6c005420 con 0x7f1d780b6350 2024-09-17T05:32:08.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.647+0000 7f1d74c00640 1 --2- 172.21.15.31:0/29033173 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1d58073560 0x7f1d58075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:08.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.647+0000 7f1d74c00640 1 -- 172.21.15.31:0/29033173 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f1d6c094a10 con 0x7f1d780b6350 2024-09-17T05:32:08.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.647+0000 7f1d77e00640 1 --2- 172.21.15.31:0/29033173 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1d58073560 0x7f1d58075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:08.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.647+0000 7f1d77e00640 1 --2- 172.21.15.31:0/29033173 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1d58073560 0x7f1d58075a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1d640af000 tx=0x7f1d640a7040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:08.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.651+0000 7f1d74c00640 1 -- 172.21.15.31:0/29033173 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f1d6c05ee10 con 0x7f1d780b6350 2024-09-17T05:32:08.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.831+0000 7f1d7fc00640 1 -- 172.21.15.31:0/29033173 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d780d1b00 con 0x7f1d780b6350 2024-09-17T05:32:08.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.831+0000 7f1d74c00640 1 -- 172.21.15.31:0/29033173 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16749 (secure 0 0 0) 0x7f1d6c063840 con 0x7f1d780b6350 2024-09-17T05:32:08.833 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:08.834 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":57,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:31:41.713876+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:31:37.829320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T05:31:39.086190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:32:08.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.835+0000 7f1d7fc00640 1 -- 172.21.15.31:0/29033173 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1d58073560 msgr2=0x7f1d58075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:08.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.835+0000 7f1d7fc00640 1 --2- 172.21.15.31:0/29033173 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1d58073560 0x7f1d58075a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1d640af000 tx=0x7f1d640a7040 comp rx=0 tx=0).stop 2024-09-17T05:32:08.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.835+0000 7f1d7fc00640 1 -- 172.21.15.31:0/29033173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d780b6350 msgr2=0x7f1d780ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:08.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.835+0000 7f1d7fc00640 1 --2- 172.21.15.31:0/29033173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d780b6350 0x7f1d780ca4e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00d980 tx=0x7f1d6c00de40 comp rx=0 tx=0).stop 2024-09-17T05:32:08.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.835+0000 7f1d7fc00640 1 -- 172.21.15.31:0/29033173 shutdown_connections 2024-09-17T05:32:08.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.835+0000 7f1d7fc00640 1 --2- 172.21.15.31:0/29033173 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1d58073560 0x7f1d58075a20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.835+0000 7f1d7fc00640 1 --2- 172.21.15.31:0/29033173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d78155210 0x7f1d78157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.835+0000 7f1d7fc00640 1 --2- 172.21.15.31:0/29033173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d7815c2d0 0x7f1d78154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.835+0000 7f1d7fc00640 1 --2- 172.21.15.31:0/29033173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d780b6350 0x7f1d780ca4e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.835+0000 7f1d7fc00640 1 -- 172.21.15.31:0/29033173 >> 172.21.15.31:0/29033173 conn(0x7f1d780d0cd0 msgr2=0x7f1d780b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.835+0000 7f1d7fc00640 1 -- 172.21.15.31:0/29033173 shutdown_connections 2024-09-17T05:32:08.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:08.835+0000 7f1d7fc00640 1 -- 172.21.15.31:0/29033173 wait complete. 2024-09-17T05:32:08.856 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:32:08.856 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:32:09.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3139600640 1 -- 172.21.15.31:0/435162942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31340d28c0 msgr2=0x7f31340cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:09.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3139600640 1 --2- 172.21.15.31:0/435162942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31340d28c0 0x7f31340cea20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f3134073d80 tx=0x7f311c01c8c0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3139600640 1 -- 172.21.15.31:0/435162942 shutdown_connections 2024-09-17T05:32:09.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3139600640 1 --2- 172.21.15.31:0/435162942 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31340b53f0 0x7f31340b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3139600640 1 --2- 172.21.15.31:0/435162942 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31340d28c0 0x7f31340cea20 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3139600640 1 --2- 172.21.15.31:0/435162942 >> v2:172.21.15.155:3300/0 conn(0x7f313415be80 0x7f31340ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3139600640 1 -- 172.21.15.31:0/435162942 >> 172.21.15.31:0/435162942 conn(0x7f31340d1da0 msgr2=0x7f31340d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:09.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3139600640 1 -- 172.21.15.31:0/435162942 shutdown_connections 2024-09-17T05:32:09.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3139600640 1 -- 172.21.15.31:0/435162942 wait complete. 2024-09-17T05:32:09.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3139600640 1 Processor -- start 2024-09-17T05:32:09.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3139600640 1 -- start start 2024-09-17T05:32:09.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3139600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31340b53f0 0x7f3134158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:09.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3139600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31340d28c0 0x7f31341fb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:09.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3139600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f313415be80 0x7f313415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:09.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3139600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f31340cd050 con 0x7f313415be80 2024-09-17T05:32:09.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3139600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f31340cced0 con 0x7f31340b53f0 2024-09-17T05:32:09.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3139600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f31340cd1d0 con 0x7f31340d28c0 2024-09-17T05:32:09.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3133400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f313415be80 0x7f313415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:09.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3133400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f313415be80 0x7f313415aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41442/0 (socket says 172.21.15.31:41442) 2024-09-17T05:32:09.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3133400640 1 -- 172.21.15.31:0/3143092767 learned_addr learned my addr 172.21.15.31:0/3143092767 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:09.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3132a00640 1 --2- 172.21.15.31:0/3143092767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31340b53f0 0x7f3134158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:09.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f312be00640 1 --2- 172.21.15.31:0/3143092767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31340d28c0 0x7f31341fb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:09.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3133400640 1 -- 172.21.15.31:0/3143092767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31340d28c0 msgr2=0x7f31341fb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:09.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3133400640 1 --2- 172.21.15.31:0/3143092767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31340d28c0 0x7f31341fb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3133400640 1 -- 172.21.15.31:0/3143092767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31340b53f0 msgr2=0x7f3134158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:09.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3133400640 1 --2- 172.21.15.31:0/3143092767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31340b53f0 0x7f3134158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.003+0000 7f3133400640 1 -- 172.21.15.31:0/3143092767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31340c8660 con 0x7f313415be80 2024-09-17T05:32:09.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.007+0000 7f3133400640 1 --2- 172.21.15.31:0/3143092767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f313415be80 0x7f313415aaa0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f312c00ea50 tx=0x7f312c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:09.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.007+0000 7f312aa00640 1 -- 172.21.15.31:0/3143092767 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c00cdc0 con 0x7f313415be80 2024-09-17T05:32:09.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.007+0000 7f312aa00640 1 -- 172.21.15.31:0/3143092767 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f312c004c40 con 0x7f313415be80 2024-09-17T05:32:09.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.007+0000 7f312aa00640 1 -- 172.21.15.31:0/3143092767 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c005280 con 0x7f313415be80 2024-09-17T05:32:09.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.007+0000 7f3139600640 1 -- 172.21.15.31:0/3143092767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31340c8940 con 0x7f313415be80 2024-09-17T05:32:09.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.007+0000 7f3139600640 1 -- 172.21.15.31:0/3143092767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31341fbbc0 con 0x7f313415be80 2024-09-17T05:32:09.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.007+0000 7f3139600640 1 -- 172.21.15.31:0/3143092767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31340b5800 con 0x7f313415be80 2024-09-17T05:32:09.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.007+0000 7f312aa00640 1 -- 172.21.15.31:0/3143092767 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f312c005420 con 0x7f313415be80 2024-09-17T05:32:09.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.007+0000 7f312aa00640 1 --2- 172.21.15.31:0/3143092767 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3110073560 0x7f3110075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:09.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.007+0000 7f312aa00640 1 -- 172.21.15.31:0/3143092767 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f312c0951e0 con 0x7f313415be80 2024-09-17T05:32:09.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.007+0000 7f3132a00640 1 --2- 172.21.15.31:0/3143092767 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3110073560 0x7f3110075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:09.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.011+0000 7f3132a00640 1 --2- 172.21.15.31:0/3143092767 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3110073560 0x7f3110075a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f312400aac0 tx=0x7f312400a250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:09.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.011+0000 7f312aa00640 1 -- 172.21.15.31:0/3143092767 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f312c016030 con 0x7f313415be80 2024-09-17T05:32:09.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.223+0000 7f3139600640 1 -- 172.21.15.31:0/3143092767 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3134071d10 con 0x7f313415be80 2024-09-17T05:32:09.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.227+0000 7f312aa00640 1 -- 172.21.15.31:0/3143092767 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5229 (secure 0 0 0) 0x7f312c05f670 con 0x7f313415be80 2024-09-17T05:32:09.227 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:09.227 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":39,"btime":"2024-09-17T05:31:49:752425+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/3185006969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3185006969},{"type":"v1","addr":"172.21.15.155:6836","nonce":3185006969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3957768567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3957768567},{"type":"v1","addr":"172.21.15.155:6837","nonce":3957768567}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5748,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3936847081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3936847081},{"type":"v1","addr":"172.21.15.31:6833","nonce":3936847081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:31:40.115955+0000","modified":"2024-09-17T05:31:43.131088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1272884249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1272884249},{"type":"v1","addr":"172.21.15.31:6835","nonce":1272884249}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5751,"qdb_cluster":[5751]},"id":4}]} 2024-09-17T05:32:09.227 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 39 2024-09-17T05:32:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.227+0000 7f3139600640 1 -- 172.21.15.31:0/3143092767 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3110073560 msgr2=0x7f3110075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.227+0000 7f3139600640 1 --2- 172.21.15.31:0/3143092767 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3110073560 0x7f3110075a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f312400aac0 tx=0x7f312400a250 comp rx=0 tx=0).stop 2024-09-17T05:32:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.227+0000 7f3139600640 1 -- 172.21.15.31:0/3143092767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f313415be80 msgr2=0x7f313415aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.227+0000 7f3139600640 1 --2- 172.21.15.31:0/3143092767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f313415be80 0x7f313415aaa0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f312c00ea50 tx=0x7f312c00ef10 comp rx=0 tx=0).stop 2024-09-17T05:32:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.227+0000 7f3139600640 1 -- 172.21.15.31:0/3143092767 shutdown_connections 2024-09-17T05:32:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.227+0000 7f3139600640 1 --2- 172.21.15.31:0/3143092767 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3110073560 0x7f3110075a20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.227+0000 7f3139600640 1 --2- 172.21.15.31:0/3143092767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f313415be80 0x7f313415aaa0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.227+0000 7f3139600640 1 --2- 172.21.15.31:0/3143092767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f31340d28c0 0x7f31341fb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.227+0000 7f3139600640 1 --2- 172.21.15.31:0/3143092767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f31340b53f0 0x7f3134158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.227+0000 7f3139600640 1 -- 172.21.15.31:0/3143092767 >> 172.21.15.31:0/3143092767 conn(0x7f31340d1da0 msgr2=0x7f31340d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:09.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.227+0000 7f3139600640 1 -- 172.21.15.31:0/3143092767 shutdown_connections 2024-09-17T05:32:09.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.227+0000 7f3139600640 1 -- 172.21.15.31:0/3143092767 wait complete. 2024-09-17T05:32:09.249 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:32:09.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.395+0000 7feba6c00640 1 -- 172.21.15.31:0/543199582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feba00cdb30 msgr2=0x7feba00af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:09.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.395+0000 7feba6c00640 1 --2- 172.21.15.31:0/543199582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feba00cdb30 0x7feba00af0c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7feb98009bc0 tx=0x7feb9801cba0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.395+0000 7feba6c00640 1 -- 172.21.15.31:0/543199582 shutdown_connections 2024-09-17T05:32:09.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.395+0000 7feba6c00640 1 --2- 172.21.15.31:0/543199582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feba00cdb30 0x7feba00af0c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.395+0000 7feba6c00640 1 -- 172.21.15.31:0/543199582 >> 172.21.15.31:0/543199582 conn(0x7feba00d1dc0 msgr2=0x7feba00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:09.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.395+0000 7feba6c00640 1 -- 172.21.15.31:0/543199582 shutdown_connections 2024-09-17T05:32:09.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.395+0000 7feba6c00640 1 -- 172.21.15.31:0/543199582 wait complete. 2024-09-17T05:32:09.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.395+0000 7feba6c00640 1 Processor -- start 2024-09-17T05:32:09.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.395+0000 7feba6c00640 1 -- start start 2024-09-17T05:32:09.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.395+0000 7feba6c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feba00cdb30 0x7feba00cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:09.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.395+0000 7feba6c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feba00ced80 0x7feba006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:09.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.395+0000 7feba6c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feba015bea0 0x7feba006f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.395+0000 7feba6c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7feba016a840 con 0x7feba00cdb30 2024-09-17T05:32:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.395+0000 7feba6c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feba016a6c0 con 0x7feba015bea0 2024-09-17T05:32:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.395+0000 7feba6c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feba016a9c0 con 0x7feba00ced80 2024-09-17T05:32:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.395+0000 7feb9fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feba00cdb30 0x7feba00cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.395+0000 7feb9fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feba00cdb30 0x7feba00cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41458/0 (socket says 172.21.15.31:41458) 2024-09-17T05:32:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.395+0000 7feb9fe00640 1 -- 172.21.15.31:0/1946696958 learned_addr learned my addr 172.21.15.31:0/1946696958 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.399+0000 7feba4c00640 1 --2- 172.21.15.31:0/1946696958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feba015bea0 0x7feba006f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.399+0000 7feb97e00640 1 --2- 172.21.15.31:0/1946696958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feba00ced80 0x7feba006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.399+0000 7feb9fe00640 1 -- 172.21.15.31:0/1946696958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feba00ced80 msgr2=0x7feba006ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.399+0000 7feb9fe00640 1 --2- 172.21.15.31:0/1946696958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feba00ced80 0x7feba006ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.399+0000 7feb9fe00640 1 -- 172.21.15.31:0/1946696958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feba015bea0 msgr2=0x7feba006f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.399+0000 7feb9fe00640 1 --2- 172.21.15.31:0/1946696958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feba015bea0 0x7feba006f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.399+0000 7feb9fe00640 1 -- 172.21.15.31:0/1946696958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba00cbd30 con 0x7feba00cdb30 2024-09-17T05:32:09.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.399+0000 7feba4c00640 1 --2- 172.21.15.31:0/1946696958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feba015bea0 0x7feba006f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:32:09.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.399+0000 7feb97e00640 1 --2- 172.21.15.31:0/1946696958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feba00ced80 0x7feba006ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:32:09.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.399+0000 7feb9fe00640 1 --2- 172.21.15.31:0/1946696958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feba00cdb30 0x7feba00cb7f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7feb9000b440 tx=0x7feb9000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:09.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.399+0000 7feb9cc00640 1 -- 172.21.15.31:0/1946696958 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90015020 con 0x7feba00cdb30 2024-09-17T05:32:09.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.399+0000 7feb9cc00640 1 -- 172.21.15.31:0/1946696958 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb90011980 con 0x7feba00cdb30 2024-09-17T05:32:09.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.399+0000 7feba6c00640 1 -- 172.21.15.31:0/1946696958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba00c9bc0 con 0x7feba00cdb30 2024-09-17T05:32:09.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.399+0000 7feb9cc00640 1 -- 172.21.15.31:0/1946696958 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90011dd0 con 0x7feba00cdb30 2024-09-17T05:32:09.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.399+0000 7feba6c00640 1 -- 172.21.15.31:0/1946696958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba00b5b80 con 0x7feba00cdb30 2024-09-17T05:32:09.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.399+0000 7feba6c00640 1 -- 172.21.15.31:0/1946696958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba00ce670 con 0x7feba00cdb30 2024-09-17T05:32:09.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.399+0000 7feb9cc00640 1 -- 172.21.15.31:0/1946696958 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7feb90018020 con 0x7feba00cdb30 2024-09-17T05:32:09.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.403+0000 7feb9cc00640 1 --2- 172.21.15.31:0/1946696958 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7feb7c073560 0x7feb7c075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:09.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.403+0000 7feb9cc00640 1 -- 172.21.15.31:0/1946696958 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7feb90094610 con 0x7feba00cdb30 2024-09-17T05:32:09.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.403+0000 7feb97e00640 1 --2- 172.21.15.31:0/1946696958 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7feb7c073560 0x7feb7c075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:09.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.403+0000 7feb97e00640 1 --2- 172.21.15.31:0/1946696958 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7feb7c073560 0x7feb7c075a20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feba00d2310 tx=0x7feb88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:09.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.407+0000 7feb9cc00640 1 -- 172.21.15.31:0/1946696958 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7feb9001f030 con 0x7feba00cdb30 2024-09-17T05:32:09.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.615+0000 7feba6c00640 1 -- 172.21.15.31:0/1946696958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feba00725b0 con 0x7feba00cdb30 2024-09-17T05:32:09.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.615+0000 7feb9cc00640 1 -- 172.21.15.31:0/1946696958 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5229 (secure 0 0 0) 0x7feb9000d040 con 0x7feba00cdb30 2024-09-17T05:32:09.618 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:09.619 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":39,"btime":"2024-09-17T05:31:49:752425+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/3185006969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3185006969},{"type":"v1","addr":"172.21.15.155:6836","nonce":3185006969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3957768567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3957768567},{"type":"v1","addr":"172.21.15.155:6837","nonce":3957768567}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5748,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3936847081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3936847081},{"type":"v1","addr":"172.21.15.31:6833","nonce":3936847081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:31:40.115955+0000","modified":"2024-09-17T05:31:43.131088+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5751":{"gid":5751,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1272884249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1272884249},{"type":"v1","addr":"172.21.15.31:6835","nonce":1272884249}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5751,"qdb_cluster":[5751]},"id":4}]} 2024-09-17T05:32:09.619 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 39 2024-09-17T05:32:09.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.619+0000 7feba6c00640 1 -- 172.21.15.31:0/1946696958 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7feb7c073560 msgr2=0x7feb7c075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:09.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.619+0000 7feba6c00640 1 --2- 172.21.15.31:0/1946696958 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7feb7c073560 0x7feb7c075a20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feba00d2310 tx=0x7feb88009040 comp rx=0 tx=0).stop 2024-09-17T05:32:09.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.619+0000 7feba6c00640 1 -- 172.21.15.31:0/1946696958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feba00cdb30 msgr2=0x7feba00cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:09.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.619+0000 7feba6c00640 1 --2- 172.21.15.31:0/1946696958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feba00cdb30 0x7feba00cb7f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7feb9000b440 tx=0x7feb9000b900 comp rx=0 tx=0).stop 2024-09-17T05:32:09.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.619+0000 7feba6c00640 1 -- 172.21.15.31:0/1946696958 shutdown_connections 2024-09-17T05:32:09.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.619+0000 7feba6c00640 1 --2- 172.21.15.31:0/1946696958 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7feb7c073560 0x7feb7c075a20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.619+0000 7feba6c00640 1 --2- 172.21.15.31:0/1946696958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feba015bea0 0x7feba006f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.619+0000 7feba6c00640 1 --2- 172.21.15.31:0/1946696958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feba00ced80 0x7feba006ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.619+0000 7feba6c00640 1 --2- 172.21.15.31:0/1946696958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feba00cdb30 0x7feba00cb7f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.619+0000 7feba6c00640 1 -- 172.21.15.31:0/1946696958 >> 172.21.15.31:0/1946696958 conn(0x7feba00d1dc0 msgr2=0x7feba006dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:09.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.619+0000 7feba6c00640 1 -- 172.21.15.31:0/1946696958 shutdown_connections 2024-09-17T05:32:09.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.619+0000 7feba6c00640 1 -- 172.21.15.31:0/1946696958 wait complete. 2024-09-17T05:32:09.641 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:32:09.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f9200640 1 -- 172.21.15.31:0/3600480579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26f415f000 msgr2=0x7f26f40d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:09.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f9200640 1 --2- 172.21.15.31:0/3600480579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26f415f000 0x7f26f40d01b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009870 tx=0x7f26e401c5a0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f9200640 1 -- 172.21.15.31:0/3600480579 shutdown_connections 2024-09-17T05:32:09.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f9200640 1 --2- 172.21.15.31:0/3600480579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26f415f000 0x7f26f40d01b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f9200640 1 -- 172.21.15.31:0/3600480579 >> 172.21.15.31:0/3600480579 conn(0x7f26f409aa10 msgr2=0x7f26f409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:09.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f9200640 1 -- 172.21.15.31:0/3600480579 shutdown_connections 2024-09-17T05:32:09.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f9200640 1 -- 172.21.15.31:0/3600480579 wait complete. 2024-09-17T05:32:09.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f9200640 1 Processor -- start 2024-09-17T05:32:09.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f9200640 1 -- start start 2024-09-17T05:32:09.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f9200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26f40b2590 0x7f26f4153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:09.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f9200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26f40cefb0 0x7f26f40c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:09.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f9200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26f415f000 0x7f26f41670e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:09.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f9200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f26f416a150 con 0x7f26f40b2590 2024-09-17T05:32:09.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f9200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f26f4169fd0 con 0x7f26f40cefb0 2024-09-17T05:32:09.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f9200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f26f416a2d0 con 0x7f26f415f000 2024-09-17T05:32:09.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26f40b2590 0x7f26f4153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:09.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26f40b2590 0x7f26f4153e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41466/0 (socket says 172.21.15.31:41466) 2024-09-17T05:32:09.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f3400640 1 -- 172.21.15.31:0/3094618737 learned_addr learned my addr 172.21.15.31:0/3094618737 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:09.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26f3e00640 1 --2- 172.21.15.31:0/3094618737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26f415f000 0x7f26f41670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:09.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.787+0000 7f26eaa00640 1 --2- 172.21.15.31:0/3094618737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26f40cefb0 0x7f26f40c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:09.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.791+0000 7f26f3400640 1 -- 172.21.15.31:0/3094618737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26f415f000 msgr2=0x7f26f41670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:09.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.791+0000 7f26f3400640 1 --2- 172.21.15.31:0/3094618737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26f415f000 0x7f26f41670e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.791+0000 7f26f3400640 1 -- 172.21.15.31:0/3094618737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26f40cefb0 msgr2=0x7f26f40c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:09.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.791+0000 7f26f3400640 1 --2- 172.21.15.31:0/3094618737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26f40cefb0 0x7f26f40c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.791+0000 7f26f3400640 1 -- 172.21.15.31:0/3094618737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f40aeec0 con 0x7f26f40b2590 2024-09-17T05:32:09.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.791+0000 7f26f3400640 1 --2- 172.21.15.31:0/3094618737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26f40b2590 0x7f26f4153e10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f26e401c3d0 tx=0x7f26e4005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:09.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.791+0000 7f26ebe00640 1 -- 172.21.15.31:0/3094618737 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4005030 con 0x7f26f40b2590 2024-09-17T05:32:09.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.791+0000 7f26ebe00640 1 -- 172.21.15.31:0/3094618737 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26e40b9070 con 0x7f26f40b2590 2024-09-17T05:32:09.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.791+0000 7f26f9200640 1 -- 172.21.15.31:0/3094618737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f41fafa0 con 0x7f26f40b2590 2024-09-17T05:32:09.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.791+0000 7f26ebe00640 1 -- 172.21.15.31:0/3094618737 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e40054e0 con 0x7f26f40b2590 2024-09-17T05:32:09.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.791+0000 7f26f9200640 1 -- 172.21.15.31:0/3094618737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f41fb560 con 0x7f26f40b2590 2024-09-17T05:32:09.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.791+0000 7f26f9200640 1 -- 172.21.15.31:0/3094618737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f41fbd30 con 0x7f26f40b2590 2024-09-17T05:32:09.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.791+0000 7f26ebe00640 1 -- 172.21.15.31:0/3094618737 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f26e4003780 con 0x7f26f40b2590 2024-09-17T05:32:09.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.791+0000 7f26ebe00640 1 --2- 172.21.15.31:0/3094618737 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f26d0073590 0x7f26d0075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:09.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.795+0000 7f26ebe00640 1 -- 172.21.15.31:0/3094618737 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f26e412ef70 con 0x7f26f40b2590 2024-09-17T05:32:09.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.795+0000 7f26eaa00640 1 --2- 172.21.15.31:0/3094618737 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f26d0073590 0x7f26d0075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:09.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.795+0000 7f26eaa00640 1 --2- 172.21.15.31:0/3094618737 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f26d0073590 0x7f26d0075a50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f26dc001ec0 tx=0x7f26dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:09.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.799+0000 7f26ebe00640 1 -- 172.21.15.31:0/3094618737 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f26e4016370 con 0x7f26f40b2590 2024-09-17T05:32:09.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.979+0000 7f26f9200640 1 -- 172.21.15.31:0/3094618737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f26f4070ff0 con 0x7f26f40b2590 2024-09-17T05:32:09.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.979+0000 7f26ebe00640 1 -- 172.21.15.31:0/3094618737 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16749 (secure 0 0 0) 0x7f26e40f9470 con 0x7f26f40b2590 2024-09-17T05:32:09.980 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:09.980 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":57,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:31:41.713876+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:31:37.829320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T05:31:39.086190+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:32:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.979+0000 7f26f9200640 1 -- 172.21.15.31:0/3094618737 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f26d0073590 msgr2=0x7f26d0075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.979+0000 7f26f9200640 1 --2- 172.21.15.31:0/3094618737 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f26d0073590 0x7f26d0075a50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f26dc001ec0 tx=0x7f26dc009040 comp rx=0 tx=0).stop 2024-09-17T05:32:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.979+0000 7f26f9200640 1 -- 172.21.15.31:0/3094618737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26f40b2590 msgr2=0x7f26f4153e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.979+0000 7f26f9200640 1 --2- 172.21.15.31:0/3094618737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26f40b2590 0x7f26f4153e10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f26e401c3d0 tx=0x7f26e4005db0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.983+0000 7f26f9200640 1 -- 172.21.15.31:0/3094618737 shutdown_connections 2024-09-17T05:32:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.983+0000 7f26f9200640 1 --2- 172.21.15.31:0/3094618737 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f26d0073590 0x7f26d0075a50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.983+0000 7f26f9200640 1 --2- 172.21.15.31:0/3094618737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26f415f000 0x7f26f41670e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.983+0000 7f26f9200640 1 --2- 172.21.15.31:0/3094618737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f26f40cefb0 0x7f26f40c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.983+0000 7f26f9200640 1 --2- 172.21.15.31:0/3094618737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f26f40b2590 0x7f26f4153e10 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.983+0000 7f26f9200640 1 -- 172.21.15.31:0/3094618737 >> 172.21.15.31:0/3094618737 conn(0x7f26f409aa10 msgr2=0x7f26f409adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.983+0000 7f26f9200640 1 -- 172.21.15.31:0/3094618737 shutdown_connections 2024-09-17T05:32:09.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:09.983+0000 7f26f9200640 1 -- 172.21.15.31:0/3094618737 wait complete. 2024-09-17T05:32:10.003 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:32:10.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.147+0000 7fe04d000640 1 -- 172.21.15.31:0/2580648064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0480cdb30 msgr2=0x7fe0480aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:10.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.147+0000 7fe04d000640 1 --2- 172.21.15.31:0/2580648064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0480cdb30 0x7fe0480aeef0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe040009c80 tx=0x7fe04001cda0 comp rx=0 tx=0).stop 2024-09-17T05:32:10.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.147+0000 7fe04d000640 1 -- 172.21.15.31:0/2580648064 shutdown_connections 2024-09-17T05:32:10.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.147+0000 7fe04d000640 1 --2- 172.21.15.31:0/2580648064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0480cdb30 0x7fe0480aeef0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:10.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.147+0000 7fe04d000640 1 --2- 172.21.15.31:0/2580648064 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0480ced80 0x7fe0480ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:10.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.147+0000 7fe04d000640 1 -- 172.21.15.31:0/2580648064 >> 172.21.15.31:0/2580648064 conn(0x7fe0480d1dc0 msgr2=0x7fe0480d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:10.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe04d000640 1 -- 172.21.15.31:0/2580648064 shutdown_connections 2024-09-17T05:32:10.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe04d000640 1 -- 172.21.15.31:0/2580648064 wait complete. 2024-09-17T05:32:10.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe04d000640 1 Processor -- start 2024-09-17T05:32:10.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe04d000640 1 -- start start 2024-09-17T05:32:10.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe04d000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0480cdb30 0x7fe048157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:10.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe04d000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0480ced80 0x7fe0481593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:10.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe04d000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe04815bea0 0x7fe0480b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:10.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe04d000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe048169340 con 0x7fe0480cdb30 2024-09-17T05:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe04d000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe0481691c0 con 0x7fe0480ced80 2024-09-17T05:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe04d000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe0481694c0 con 0x7fe04815bea0 2024-09-17T05:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe045e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0480cdb30 0x7fe048157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe045e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0480cdb30 0x7fe048157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41492/0 (socket says 172.21.15.31:41492) 2024-09-17T05:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe045e00640 1 -- 172.21.15.31:0/1296849844 learned_addr learned my addr 172.21.15.31:0/1296849844 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe03fe00640 1 --2- 172.21.15.31:0/1296849844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0480ced80 0x7fe0481593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe046800640 1 --2- 172.21.15.31:0/1296849844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe04815bea0 0x7fe0480b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe045e00640 1 -- 172.21.15.31:0/1296849844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe04815bea0 msgr2=0x7fe0480b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe045e00640 1 --2- 172.21.15.31:0/1296849844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe04815bea0 0x7fe0480b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe045e00640 1 -- 172.21.15.31:0/1296849844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0480ced80 msgr2=0x7fe0481593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe045e00640 1 --2- 172.21.15.31:0/1296849844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0480ced80 0x7fe0481593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe045e00640 1 -- 172.21.15.31:0/1296849844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe048158520 con 0x7fe0480cdb30 2024-09-17T05:32:10.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe045e00640 1 --2- 172.21.15.31:0/1296849844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0480cdb30 0x7fe048157e90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe03800c3c0 tx=0x7fe03800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:10.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe03e000640 1 -- 172.21.15.31:0/1296849844 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe038017070 con 0x7fe0480cdb30 2024-09-17T05:32:10.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe03e000640 1 -- 172.21.15.31:0/1296849844 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0380053c0 con 0x7fe0480cdb30 2024-09-17T05:32:10.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe03e000640 1 -- 172.21.15.31:0/1296849844 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe038003860 con 0x7fe0480cdb30 2024-09-17T05:32:10.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.151+0000 7fe04d000640 1 -- 172.21.15.31:0/1296849844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe048158800 con 0x7fe0480cdb30 2024-09-17T05:32:10.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.155+0000 7fe04d000640 1 -- 172.21.15.31:0/1296849844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe048158dc0 con 0x7fe0480cdb30 2024-09-17T05:32:10.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.155+0000 7fe04d000640 1 -- 172.21.15.31:0/1296849844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0480ce670 con 0x7fe0480cdb30 2024-09-17T05:32:10.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.155+0000 7fe03e000640 1 -- 172.21.15.31:0/1296849844 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7fe03801a070 con 0x7fe0480cdb30 2024-09-17T05:32:10.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.155+0000 7fe03e000640 1 --2- 172.21.15.31:0/1296849844 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe024073560 0x7fe024075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:10.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.155+0000 7fe03e000640 1 -- 172.21.15.31:0/1296849844 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fe038093a10 con 0x7fe0480cdb30 2024-09-17T05:32:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.155+0000 7fe03fe00640 1 --2- 172.21.15.31:0/1296849844 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe024073560 0x7fe024075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.159+0000 7fe03fe00640 1 --2- 172.21.15.31:0/1296849844 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe024073560 0x7fe024075a20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe048166b40 tx=0x7fe03000b390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:10.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.159+0000 7fe03e000640 1 -- 172.21.15.31:0/1296849844 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe03805dfa0 con 0x7fe0480cdb30 2024-09-17T05:32:10.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.371+0000 7fe04d000640 1 -- 172.21.15.31:0/1296849844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe048156c20 con 0x7fe0480cdb30 2024-09-17T05:32:10.373 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-09-17T05:32:10.371+0000 7f21d0200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:32:10.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.375+0000 7fe03e000640 1 -- 172.21.15.31:0/1296849844 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) ==== 161+0+0 (secure 0 0 0) 0x7fe0380629d0 con 0x7fe0480cdb30 2024-09-17T05:32:10.377 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:32:10.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.379+0000 7fe04d000640 1 -- 172.21.15.31:0/1296849844 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe024073560 msgr2=0x7fe024075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:10.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.379+0000 7fe04d000640 1 --2- 172.21.15.31:0/1296849844 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe024073560 0x7fe024075a20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe048166b40 tx=0x7fe03000b390 comp rx=0 tx=0).stop 2024-09-17T05:32:10.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.379+0000 7fe04d000640 1 -- 172.21.15.31:0/1296849844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0480cdb30 msgr2=0x7fe048157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:10.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.379+0000 7fe04d000640 1 --2- 172.21.15.31:0/1296849844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0480cdb30 0x7fe048157e90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe03800c3c0 tx=0x7fe03800c880 comp rx=0 tx=0).stop 2024-09-17T05:32:10.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.379+0000 7fe04d000640 1 -- 172.21.15.31:0/1296849844 shutdown_connections 2024-09-17T05:32:10.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.379+0000 7fe04d000640 1 --2- 172.21.15.31:0/1296849844 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe024073560 0x7fe024075a20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:10.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.379+0000 7fe04d000640 1 --2- 172.21.15.31:0/1296849844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe04815bea0 0x7fe0480b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:10.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.379+0000 7fe04d000640 1 --2- 172.21.15.31:0/1296849844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0480ced80 0x7fe0481593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:10.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.379+0000 7fe04d000640 1 --2- 172.21.15.31:0/1296849844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0480cdb30 0x7fe048157e90 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:10.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.379+0000 7fe04d000640 1 -- 172.21.15.31:0/1296849844 >> 172.21.15.31:0/1296849844 conn(0x7fe0480d1dc0 msgr2=0x7fe0480b5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:10.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.379+0000 7fe04d000640 1 -- 172.21.15.31:0/1296849844 shutdown_connections 2024-09-17T05:32:10.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.379+0000 7fe04d000640 1 -- 172.21.15.31:0/1296849844 wait complete. 2024-09-17T05:32:10.410 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:32:10.456 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-17T05:32:10.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.559+0000 7f8547000640 1 -- 172.21.15.31:0/2017430599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85400d00f0 msgr2=0x7f85400b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:10.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.559+0000 7f8547000640 1 --2- 172.21.15.31:0/2017430599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85400d00f0 0x7f85400b15e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8530009900 tx=0x7f853001f0d0 comp rx=0 tx=0).stop 2024-09-17T05:32:10.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.559+0000 7f8547000640 1 -- 172.21.15.31:0/2017430599 shutdown_connections 2024-09-17T05:32:10.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.559+0000 7f8547000640 1 --2- 172.21.15.31:0/2017430599 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85400d04d0 0x7f85400af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:10.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.559+0000 7f8547000640 1 --2- 172.21.15.31:0/2017430599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85400d00f0 0x7f85400b15e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:10.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.559+0000 7f8547000640 1 -- 172.21.15.31:0/2017430599 >> 172.21.15.31:0/2017430599 conn(0x7f85400d1e90 msgr2=0x7f85400d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:10.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.559+0000 7f8547000640 1 -- 172.21.15.31:0/2017430599 shutdown_connections 2024-09-17T05:32:10.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.559+0000 7f8547000640 1 -- 172.21.15.31:0/2017430599 wait complete. 2024-09-17T05:32:10.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f8547000640 1 Processor -- start 2024-09-17T05:32:10.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f8547000640 1 -- start start 2024-09-17T05:32:10.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f8547000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85400d00f0 0x7f85400c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:10.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f8547000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85400d04d0 0x7f854014f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:10.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f8547000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85400d29b0 0x7f85400cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:10.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f8547000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f85400b0d50 con 0x7f85400d29b0 2024-09-17T05:32:10.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f8547000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f85400b2470 con 0x7f85400d04d0 2024-09-17T05:32:10.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f8547000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f85400b0ed0 con 0x7f85400d00f0 2024-09-17T05:32:10.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f8545000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85400d29b0 0x7f85400cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:10.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f8545000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85400d29b0 0x7f85400cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41512/0 (socket says 172.21.15.31:41512) 2024-09-17T05:32:10.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f8545000640 1 -- 172.21.15.31:0/2544852665 learned_addr learned my addr 172.21.15.31:0/2544852665 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:10.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f853fe00640 1 --2- 172.21.15.31:0/2544852665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85400d00f0 0x7f85400c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:10.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f8537e00640 1 --2- 172.21.15.31:0/2544852665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85400d04d0 0x7f854014f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:10.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f8545000640 1 -- 172.21.15.31:0/2544852665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85400d00f0 msgr2=0x7f85400c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:10.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f8545000640 1 --2- 172.21.15.31:0/2544852665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85400d00f0 0x7f85400c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:10.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f8545000640 1 -- 172.21.15.31:0/2544852665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85400d04d0 msgr2=0x7f854014f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:10.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f8545000640 1 --2- 172.21.15.31:0/2544852665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85400d04d0 0x7f854014f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:10.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f8545000640 1 -- 172.21.15.31:0/2544852665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854015c0b0 con 0x7f85400d29b0 2024-09-17T05:32:10.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f8545000640 1 --2- 172.21.15.31:0/2544852665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85400d29b0 0x7f85400cc900 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f853800eb50 tx=0x7f853800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:10.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f853cc00640 1 -- 172.21.15.31:0/2544852665 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8538004d30 con 0x7f85400d29b0 2024-09-17T05:32:10.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f853cc00640 1 -- 172.21.15.31:0/2544852665 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f853800ee50 con 0x7f85400d29b0 2024-09-17T05:32:10.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.563+0000 7f853cc00640 1 -- 172.21.15.31:0/2544852665 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8538005280 con 0x7f85400d29b0 2024-09-17T05:32:10.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.567+0000 7f8547000640 1 -- 172.21.15.31:0/2544852665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854015c370 con 0x7f85400d29b0 2024-09-17T05:32:10.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.567+0000 7f8547000640 1 -- 172.21.15.31:0/2544852665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85400c8680 con 0x7f85400d29b0 2024-09-17T05:32:10.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.567+0000 7f8547000640 1 -- 172.21.15.31:0/2544852665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85400af200 con 0x7f85400d29b0 2024-09-17T05:32:10.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.567+0000 7f853cc00640 1 -- 172.21.15.31:0/2544852665 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f8538005420 con 0x7f85400d29b0 2024-09-17T05:32:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.567+0000 7f853cc00640 1 --2- 172.21.15.31:0/2544852665 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f851c073560 0x7f851c075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.567+0000 7f853cc00640 1 -- 172.21.15.31:0/2544852665 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5795+0+0 (secure 0 0 0) 0x7f8538095500 con 0x7f85400d29b0 2024-09-17T05:32:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.567+0000 7f853fe00640 1 --2- 172.21.15.31:0/2544852665 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f851c073560 0x7f851c075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:10.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.571+0000 7f853fe00640 1 --2- 172.21.15.31:0/2544852665 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f851c073560 0x7f851c075a20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f85300b2000 tx=0x7f853001d910 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:10.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.571+0000 7f853cc00640 1 -- 172.21.15.31:0/2544852665 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f853805f930 con 0x7f85400d29b0 2024-09-17T05:32:10.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:10.783+0000 7f8547000640 1 -- 172.21.15.31:0/2544852665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f854006faf0 con 0x7f85400d29b0 2024-09-17T05:32:11.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.379+0000 7f853cc00640 1 -- 172.21.15.31:0/2544852665 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) ==== 104+0+0 (secure 0 0 0) 0x7f8538064360 con 0x7f85400d29b0 2024-09-17T05:32:11.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.379+0000 7f8547000640 1 -- 172.21.15.31:0/2544852665 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f851c073560 msgr2=0x7f851c075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:11.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.379+0000 7f8547000640 1 --2- 172.21.15.31:0/2544852665 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f851c073560 0x7f851c075a20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f85300b2000 tx=0x7f853001d910 comp rx=0 tx=0).stop 2024-09-17T05:32:11.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.379+0000 7f8547000640 1 -- 172.21.15.31:0/2544852665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85400d29b0 msgr2=0x7f85400cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:11.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.379+0000 7f8547000640 1 --2- 172.21.15.31:0/2544852665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85400d29b0 0x7f85400cc900 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f853800eb50 tx=0x7f853800c6a0 comp rx=0 tx=0).stop 2024-09-17T05:32:11.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.379+0000 7f8547000640 1 -- 172.21.15.31:0/2544852665 shutdown_connections 2024-09-17T05:32:11.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.379+0000 7f8547000640 1 --2- 172.21.15.31:0/2544852665 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f851c073560 0x7f851c075a20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:11.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.379+0000 7f8547000640 1 --2- 172.21.15.31:0/2544852665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85400d29b0 0x7f85400cc900 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:11.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.379+0000 7f8547000640 1 --2- 172.21.15.31:0/2544852665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85400d04d0 0x7f854014f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:11.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.379+0000 7f8547000640 1 --2- 172.21.15.31:0/2544852665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85400d00f0 0x7f85400c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:11.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.379+0000 7f8547000640 1 -- 172.21.15.31:0/2544852665 >> 172.21.15.31:0/2544852665 conn(0x7f85400d1e90 msgr2=0x7f854006e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:11.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.379+0000 7f8547000640 1 -- 172.21.15.31:0/2544852665 shutdown_connections 2024-09-17T05:32:11.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.379+0000 7f8547000640 1 -- 172.21.15.31:0/2544852665 wait complete. 2024-09-17T05:32:11.407 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:32:11.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.607+0000 7ff999a00640 1 -- 172.21.15.31:0/4232543191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff99415be80 msgr2=0x7ff994073d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:11.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.607+0000 7ff999a00640 1 --2- 172.21.15.31:0/4232543191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff99415be80 0x7ff994073d20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff98c009bc0 tx=0x7ff98c01cae0 comp rx=0 tx=0).stop 2024-09-17T05:32:11.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.607+0000 7ff999a00640 1 -- 172.21.15.31:0/4232543191 shutdown_connections 2024-09-17T05:32:11.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.607+0000 7ff999a00640 1 --2- 172.21.15.31:0/4232543191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff99415be80 0x7ff994073d20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:11.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.607+0000 7ff999a00640 1 --2- 172.21.15.31:0/4232543191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff994070f40 0x7ff9940737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:11.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.607+0000 7ff999a00640 1 -- 172.21.15.31:0/4232543191 >> 172.21.15.31:0/4232543191 conn(0x7ff9940d0c70 msgr2=0x7ff9940d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:11.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.607+0000 7ff999a00640 1 -- 172.21.15.31:0/4232543191 shutdown_connections 2024-09-17T05:32:11.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.607+0000 7ff999a00640 1 -- 172.21.15.31:0/4232543191 wait complete. 2024-09-17T05:32:11.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff999a00640 1 Processor -- start 2024-09-17T05:32:11.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff999a00640 1 -- start start 2024-09-17T05:32:11.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff999a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff99415baa0 0x7ff99414a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:11.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff999a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff99415be80 0x7ff994165eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:11.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff999a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9941663f0 0x7ff99414f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:11.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff999a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff9940745f0 con 0x7ff99415baa0 2024-09-17T05:32:11.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff999a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff994074470 con 0x7ff9941663f0 2024-09-17T05:32:11.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff999a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff9941603b0 con 0x7ff99415be80 2024-09-17T05:32:11.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff993e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff99415baa0 0x7ff99414a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:11.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff993e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff99415baa0 0x7ff99414a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41518/0 (socket says 172.21.15.31:41518) 2024-09-17T05:32:11.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff993e00640 1 -- 172.21.15.31:0/1015083737 learned_addr learned my addr 172.21.15.31:0/1015083737 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:11.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff98be00640 1 --2- 172.21.15.31:0/1015083737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff99415be80 0x7ff994165eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:11.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff999000640 1 --2- 172.21.15.31:0/1015083737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9941663f0 0x7ff99414f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:11.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff993e00640 1 -- 172.21.15.31:0/1015083737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff99415be80 msgr2=0x7ff994165eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:11.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff993e00640 1 --2- 172.21.15.31:0/1015083737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff99415be80 0x7ff994165eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:11.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff993e00640 1 -- 172.21.15.31:0/1015083737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9941663f0 msgr2=0x7ff99414f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:11.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff993e00640 1 --2- 172.21.15.31:0/1015083737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9941663f0 0x7ff99414f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:11.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff993e00640 1 -- 172.21.15.31:0/1015083737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff994164e10 con 0x7ff99415baa0 2024-09-17T05:32:11.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff98be00640 1 --2- 172.21.15.31:0/1015083737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff99415be80 0x7ff994165eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:11.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff999000640 1 --2- 172.21.15.31:0/1015083737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9941663f0 0x7ff99414f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:11.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff993e00640 1 --2- 172.21.15.31:0/1015083737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff99415baa0 0x7ff99414a6e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff98400c4c0 tx=0x7ff98400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:11.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff990c00640 1 -- 172.21.15.31:0/1015083737 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff984016020 con 0x7ff99415baa0 2024-09-17T05:32:11.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff990c00640 1 -- 172.21.15.31:0/1015083737 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff984012940 con 0x7ff99415baa0 2024-09-17T05:32:11.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff990c00640 1 -- 172.21.15.31:0/1015083737 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff984012d90 con 0x7ff99415baa0 2024-09-17T05:32:11.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff999a00640 1 -- 172.21.15.31:0/1015083737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9941650f0 con 0x7ff99415baa0 2024-09-17T05:32:11.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff999a00640 1 -- 172.21.15.31:0/1015083737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9941656b0 con 0x7ff99415baa0 2024-09-17T05:32:11.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.611+0000 7ff999a00640 1 -- 172.21.15.31:0/1015083737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff99406ae20 con 0x7ff99415baa0 2024-09-17T05:32:11.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.615+0000 7ff990c00640 1 -- 172.21.15.31:0/1015083737 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7ff984019020 con 0x7ff99415baa0 2024-09-17T05:32:11.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.615+0000 7ff990c00640 1 --2- 172.21.15.31:0/1015083737 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff970073560 0x7ff970075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:11.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.615+0000 7ff990c00640 1 -- 172.21.15.31:0/1015083737 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5795+0+0 (secure 0 0 0) 0x7ff9840948c0 con 0x7ff99415baa0 2024-09-17T05:32:11.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.615+0000 7ff98be00640 1 --2- 172.21.15.31:0/1015083737 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff970073560 0x7ff970075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:11.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.615+0000 7ff98be00640 1 --2- 172.21.15.31:0/1015083737 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff970073560 0x7ff970075a20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff9940cea50 tx=0x7ff97c0091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:11.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.619+0000 7ff990c00640 1 -- 172.21.15.31:0/1015083737 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff984020020 con 0x7ff99415baa0 2024-09-17T05:32:11.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:11.803+0000 7ff999a00640 1 -- 172.21.15.31:0/1015083737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff9940b3190 con 0x7ff99415baa0 2024-09-17T05:32:12.119 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:32:12.123 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:32:12.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.379+0000 7ff990c00640 1 -- 172.21.15.31:0/1015083737 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v59) ==== 181+0+0 (secure 0 0 0) 0x7ff98405f480 con 0x7ff99415baa0 2024-09-17T05:32:12.381 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:32:12.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.383+0000 7ff999a00640 1 -- 172.21.15.31:0/1015083737 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff970073560 msgr2=0x7ff970075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:12.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.383+0000 7ff999a00640 1 --2- 172.21.15.31:0/1015083737 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff970073560 0x7ff970075a20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff9940cea50 tx=0x7ff97c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:32:12.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.383+0000 7ff999a00640 1 -- 172.21.15.31:0/1015083737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff99415baa0 msgr2=0x7ff99414a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:12.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.383+0000 7ff999a00640 1 --2- 172.21.15.31:0/1015083737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff99415baa0 0x7ff99414a6e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff98400c4c0 tx=0x7ff98400c980 comp rx=0 tx=0).stop 2024-09-17T05:32:12.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.383+0000 7ff999a00640 1 -- 172.21.15.31:0/1015083737 shutdown_connections 2024-09-17T05:32:12.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.383+0000 7ff999a00640 1 --2- 172.21.15.31:0/1015083737 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff970073560 0x7ff970075a20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:12.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.383+0000 7ff999a00640 1 --2- 172.21.15.31:0/1015083737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9941663f0 0x7ff99414f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:12.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.383+0000 7ff999a00640 1 --2- 172.21.15.31:0/1015083737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff99415be80 0x7ff994165eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:12.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.383+0000 7ff999a00640 1 --2- 172.21.15.31:0/1015083737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff99415baa0 0x7ff99414a6e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:12.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.383+0000 7ff999a00640 1 -- 172.21.15.31:0/1015083737 >> 172.21.15.31:0/1015083737 conn(0x7ff9940d0c70 msgr2=0x7ff9940b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:12.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.383+0000 7ff999a00640 1 -- 172.21.15.31:0/1015083737 shutdown_connections 2024-09-17T05:32:12.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.383+0000 7ff999a00640 1 -- 172.21.15.31:0/1015083737 wait complete. 2024-09-17T05:32:12.405 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:32:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f1257000640 1 -- 172.21.15.31:0/4258947267 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12500b3410 msgr2=0x7f12500cfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:12.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f1257000640 1 --2- 172.21.15.31:0/4258947267 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12500b3410 0x7f12500cfdf0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f123c009840 tx=0x7f123c01c7e0 comp rx=0 tx=0).stop 2024-09-17T05:32:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f1257000640 1 -- 172.21.15.31:0/4258947267 shutdown_connections 2024-09-17T05:32:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f1257000640 1 --2- 172.21.15.31:0/4258947267 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12500b3410 0x7f12500cfdf0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f1257000640 1 --2- 172.21.15.31:0/4258947267 >> v2:172.21.15.155:3300/0 conn(0x7f125015f600 0x7f12500b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f1257000640 1 -- 172.21.15.31:0/4258947267 >> 172.21.15.31:0/4258947267 conn(0x7f12500d1e80 msgr2=0x7f12500d2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f1257000640 1 -- 172.21.15.31:0/4258947267 shutdown_connections 2024-09-17T05:32:12.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f1257000640 1 -- 172.21.15.31:0/4258947267 wait complete. 2024-09-17T05:32:12.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f1257000640 1 Processor -- start 2024-09-17T05:32:12.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f1257000640 1 -- start start 2024-09-17T05:32:12.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f1257000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12500b3410 0x7f12501fad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:12.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f1257000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12500d0330 0x7f125014e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:12.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f1257000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f125015f600 0x7f12501575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:12.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f1257000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1250168dc0 con 0x7f12500d0330 2024-09-17T05:32:12.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f1257000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1250168c40 con 0x7f12500b3410 2024-09-17T05:32:12.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f1257000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1250168f40 con 0x7f125015f600 2024-09-17T05:32:12.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f124f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12500d0330 0x7f125014e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:12.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f124f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12500d0330 0x7f125014e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41524/0 (socket says 172.21.15.31:41524) 2024-09-17T05:32:12.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f124f400640 1 -- 172.21.15.31:0/1853833833 learned_addr learned my addr 172.21.15.31:0/1853833833 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:12.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f124f400640 1 -- 172.21.15.31:0/1853833833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f125015f600 msgr2=0x7f12501575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:12.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f124fe00640 1 --2- 172.21.15.31:0/1853833833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12500b3410 0x7f12501fad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:12.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f124f400640 1 --2- 172.21.15.31:0/1853833833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f125015f600 0x7f12501575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:12.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f124f400640 1 -- 172.21.15.31:0/1853833833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12500b3410 msgr2=0x7f12501fad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:12.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f124f400640 1 --2- 172.21.15.31:0/1853833833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12500b3410 0x7f12501fad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:12.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f124f400640 1 -- 172.21.15.31:0/1853833833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12501fbbc0 con 0x7f12500d0330 2024-09-17T05:32:12.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.559+0000 7f124fe00640 1 --2- 172.21.15.31:0/1853833833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12500b3410 0x7f12501fad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:32:12.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.563+0000 7f124f400640 1 --2- 172.21.15.31:0/1853833833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12500d0330 0x7f125014e7b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f123c01a410 tx=0x7f123c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:12.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.563+0000 7f1247e00640 1 -- 172.21.15.31:0/1853833833 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c0b2040 con 0x7f12500d0330 2024-09-17T05:32:12.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.563+0000 7f1247e00640 1 -- 172.21.15.31:0/1853833833 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f123c005020 con 0x7f12500d0330 2024-09-17T05:32:12.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.563+0000 7f1247e00640 1 -- 172.21.15.31:0/1853833833 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c005450 con 0x7f12500d0330 2024-09-17T05:32:12.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.563+0000 7f1257000640 1 -- 172.21.15.31:0/1853833833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12501fb320 con 0x7f12500d0330 2024-09-17T05:32:12.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.563+0000 7f1257000640 1 -- 172.21.15.31:0/1853833833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12501fb8e0 con 0x7f12500d0330 2024-09-17T05:32:12.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.563+0000 7f1257000640 1 -- 172.21.15.31:0/1853833833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12500cfdf0 con 0x7f12500d0330 2024-09-17T05:32:12.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.563+0000 7f1247e00640 1 -- 172.21.15.31:0/1853833833 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f123c0be060 con 0x7f12500d0330 2024-09-17T05:32:12.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.567+0000 7f1247e00640 1 --2- 172.21.15.31:0/1853833833 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1230073560 0x7f1230075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:12.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.567+0000 7f1247e00640 1 -- 172.21.15.31:0/1853833833 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5357+0+0 (secure 0 0 0) 0x7f123c12df30 con 0x7f12500d0330 2024-09-17T05:32:12.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.567+0000 7f124fe00640 1 --2- 172.21.15.31:0/1853833833 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1230073560 0x7f1230075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:12.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.567+0000 7f124fe00640 1 --2- 172.21.15.31:0/1853833833 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1230073560 0x7f1230075a20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1240009aa0 tx=0x7f1240005d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:12.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.571+0000 7f1247e00640 1 -- 172.21.15.31:0/1853833833 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f123c0163d0 con 0x7f12500d0330 2024-09-17T05:32:12.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:12.747+0000 7f1257000640 1 -- 172.21.15.31:0/1853833833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f12500ce230 con 0x7f12500d0330 2024-09-17T05:32:13.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.383+0000 7f1247e00640 1 -- 172.21.15.31:0/1853833833 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v60) ==== 169+0+0 (secure 0 0 0) 0x7f123c0f8c70 con 0x7f12500d0330 2024-09-17T05:32:13.383 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-09-17T05:32:13.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.387+0000 7f1257000640 1 -- 172.21.15.31:0/1853833833 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1230073560 msgr2=0x7f1230075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:13.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.387+0000 7f1257000640 1 --2- 172.21.15.31:0/1853833833 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1230073560 0x7f1230075a20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1240009aa0 tx=0x7f1240005d30 comp rx=0 tx=0).stop 2024-09-17T05:32:13.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.387+0000 7f1257000640 1 -- 172.21.15.31:0/1853833833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12500d0330 msgr2=0x7f125014e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:13.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.387+0000 7f1257000640 1 --2- 172.21.15.31:0/1853833833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12500d0330 0x7f125014e7b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f123c01a410 tx=0x7f123c004040 comp rx=0 tx=0).stop 2024-09-17T05:32:13.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.387+0000 7f1257000640 1 -- 172.21.15.31:0/1853833833 shutdown_connections 2024-09-17T05:32:13.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.387+0000 7f1257000640 1 --2- 172.21.15.31:0/1853833833 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1230073560 0x7f1230075a20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:13.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.387+0000 7f1257000640 1 --2- 172.21.15.31:0/1853833833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f125015f600 0x7f12501575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:13.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.387+0000 7f1257000640 1 --2- 172.21.15.31:0/1853833833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12500d0330 0x7f125014e7b0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:13.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.387+0000 7f1257000640 1 --2- 172.21.15.31:0/1853833833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12500b3410 0x7f12501fad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:13.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.387+0000 7f1257000640 1 -- 172.21.15.31:0/1853833833 >> 172.21.15.31:0/1853833833 conn(0x7f12500d1e80 msgr2=0x7f1250158580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:13.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.387+0000 7f1257000640 1 -- 172.21.15.31:0/1853833833 shutdown_connections 2024-09-17T05:32:13.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.387+0000 7f1257000640 1 -- 172.21.15.31:0/1853833833 wait complete. 2024-09-17T05:32:13.412 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:32:13.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.559+0000 7f0cf2c00640 1 -- 172.21.15.31:0/573863847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cec0cdb30 msgr2=0x7f0cec0aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:13.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.559+0000 7f0cf2c00640 1 --2- 172.21.15.31:0/573863847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cec0cdb30 0x7f0cec0aeef0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009c80 tx=0x7f0ce401cda0 comp rx=0 tx=0).stop 2024-09-17T05:32:13.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.559+0000 7f0cf2c00640 1 -- 172.21.15.31:0/573863847 shutdown_connections 2024-09-17T05:32:13.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.559+0000 7f0cf2c00640 1 --2- 172.21.15.31:0/573863847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cec0cdb30 0x7f0cec0aeef0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:13.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.559+0000 7f0cf2c00640 1 --2- 172.21.15.31:0/573863847 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cec0ced80 0x7f0cec0ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:13.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.559+0000 7f0cf2c00640 1 -- 172.21.15.31:0/573863847 >> 172.21.15.31:0/573863847 conn(0x7f0cec0d1dc0 msgr2=0x7f0cec0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:13.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.559+0000 7f0cf2c00640 1 -- 172.21.15.31:0/573863847 shutdown_connections 2024-09-17T05:32:13.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.559+0000 7f0cf2c00640 1 -- 172.21.15.31:0/573863847 wait complete. 2024-09-17T05:32:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf2c00640 1 Processor -- start 2024-09-17T05:32:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf2c00640 1 -- start start 2024-09-17T05:32:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf2c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cec0cdb30 0x7f0cec157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:13.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf2c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec0ced80 0x7f0cec1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:13.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf2c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cec15bea0 0x7f0cec0c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:13.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf2c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec169290 con 0x7f0cec15bea0 2024-09-17T05:32:13.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf2c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec169110 con 0x7f0cec0ced80 2024-09-17T05:32:13.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf2c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0cec169410 con 0x7f0cec0cdb30 2024-09-17T05:32:13.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf0c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cec15bea0 0x7f0cec0c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:13.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf0c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cec15bea0 0x7f0cec0c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41550/0 (socket says 172.21.15.31:41550) 2024-09-17T05:32:13.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf0c00640 1 -- 172.21.15.31:0/2594307033 learned_addr learned my addr 172.21.15.31:0/2594307033 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cebe00640 1 --2- 172.21.15.31:0/2594307033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cec0cdb30 0x7f0cec157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0ce3e00640 1 --2- 172.21.15.31:0/2594307033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec0ced80 0x7f0cec1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf0c00640 1 -- 172.21.15.31:0/2594307033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cec0cdb30 msgr2=0x7f0cec157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf0c00640 1 --2- 172.21.15.31:0/2594307033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cec0cdb30 0x7f0cec157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf0c00640 1 -- 172.21.15.31:0/2594307033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec0ced80 msgr2=0x7f0cec1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf0c00640 1 --2- 172.21.15.31:0/2594307033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec0ced80 0x7f0cec1568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf0c00640 1 -- 172.21.15.31:0/2594307033 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cec157230 con 0x7f0cec15bea0 2024-09-17T05:32:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf0c00640 1 --2- 172.21.15.31:0/2594307033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cec15bea0 0x7f0cec0c8170 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0ce401cbd0 tx=0x7f0ce40a5a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0ce8c00640 1 -- 172.21.15.31:0/2594307033 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40bb070 con 0x7f0cec15bea0 2024-09-17T05:32:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0ce8c00640 1 -- 172.21.15.31:0/2594307033 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ce4004d60 con 0x7f0cec15bea0 2024-09-17T05:32:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf2c00640 1 -- 172.21.15.31:0/2594307033 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cec157510 con 0x7f0cec15bea0 2024-09-17T05:32:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0ce8c00640 1 -- 172.21.15.31:0/2594307033 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40b2040 con 0x7f0cec15bea0 2024-09-17T05:32:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.563+0000 7f0cf2c00640 1 -- 172.21.15.31:0/2594307033 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cec157ad0 con 0x7f0cec15bea0 2024-09-17T05:32:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.567+0000 7f0cf2c00640 1 -- 172.21.15.31:0/2594307033 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cec0ce670 con 0x7f0cec15bea0 2024-09-17T05:32:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.567+0000 7f0ce8c00640 1 -- 172.21.15.31:0/2594307033 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f0ce40be070 con 0x7f0cec15bea0 2024-09-17T05:32:13.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.567+0000 7f0ce8c00640 1 --2- 172.21.15.31:0/2594307033 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0cc8073560 0x7f0cc8075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:13.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.567+0000 7f0ce8c00640 1 -- 172.21.15.31:0/2594307033 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f0ce412e580 con 0x7f0cec15bea0 2024-09-17T05:32:13.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.567+0000 7f0cebe00640 1 --2- 172.21.15.31:0/2594307033 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0cc8073560 0x7f0cc8075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:13.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.567+0000 7f0cebe00640 1 --2- 172.21.15.31:0/2594307033 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0cc8073560 0x7f0cc8075a20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0098e0 tx=0x7f0cdc009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:13.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.571+0000 7f0ce8c00640 1 -- 172.21.15.31:0/2594307033 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0ce4016990 con 0x7f0cec15bea0 2024-09-17T05:32:13.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.747+0000 7f0cf2c00640 1 -- 172.21.15.31:0/2594307033 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f0cec0b62c0 con 0x7f0cec15bea0 2024-09-17T05:32:13.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.751+0000 7f0ce8c00640 1 -- 172.21.15.31:0/2594307033 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v33) ==== 71+0+0 (secure 0 0 0) 0x7f0ce40f8d90 con 0x7f0cec15bea0 2024-09-17T05:32:13.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.755+0000 7f0cf2c00640 1 -- 172.21.15.31:0/2594307033 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0cc8073560 msgr2=0x7f0cc8075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:13.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.755+0000 7f0cf2c00640 1 --2- 172.21.15.31:0/2594307033 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0cc8073560 0x7f0cc8075a20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0098e0 tx=0x7f0cdc009060 comp rx=0 tx=0).stop 2024-09-17T05:32:13.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.755+0000 7f0cf2c00640 1 -- 172.21.15.31:0/2594307033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cec15bea0 msgr2=0x7f0cec0c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:13.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.755+0000 7f0cf2c00640 1 --2- 172.21.15.31:0/2594307033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cec15bea0 0x7f0cec0c8170 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0ce401cbd0 tx=0x7f0ce40a5a40 comp rx=0 tx=0).stop 2024-09-17T05:32:13.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.755+0000 7f0cf2c00640 1 -- 172.21.15.31:0/2594307033 shutdown_connections 2024-09-17T05:32:13.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.755+0000 7f0cf2c00640 1 --2- 172.21.15.31:0/2594307033 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0cc8073560 0x7f0cc8075a20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:13.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.755+0000 7f0cf2c00640 1 --2- 172.21.15.31:0/2594307033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cec15bea0 0x7f0cec0c8170 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:13.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.755+0000 7f0cf2c00640 1 --2- 172.21.15.31:0/2594307033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cec0ced80 0x7f0cec1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:13.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.755+0000 7f0cf2c00640 1 --2- 172.21.15.31:0/2594307033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cec0cdb30 0x7f0cec157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:13.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.755+0000 7f0cf2c00640 1 -- 172.21.15.31:0/2594307033 >> 172.21.15.31:0/2594307033 conn(0x7f0cec0d1dc0 msgr2=0x7f0cec0b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:13.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.755+0000 7f0cf2c00640 1 -- 172.21.15.31:0/2594307033 shutdown_connections 2024-09-17T05:32:13.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.755+0000 7f0cf2c00640 1 -- 172.21.15.31:0/2594307033 wait complete. 2024-09-17T05:32:13.776 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2024-09-17T05:32:13.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f4356400640 1 -- 172.21.15.31:0/4280459381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f435015bea0 msgr2=0x7f43500ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:13.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f4356400640 1 --2- 172.21.15.31:0/4280459381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f435015bea0 0x7f43500ce670 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f43500cc3a0 tx=0x7f434001c830 comp rx=0 tx=0).stop 2024-09-17T05:32:13.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f4356400640 1 -- 172.21.15.31:0/4280459381 shutdown_connections 2024-09-17T05:32:13.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f4356400640 1 --2- 172.21.15.31:0/4280459381 >> v2:172.21.15.155:3300/0 conn(0x7f43500d28e0 0x7f43500cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:13.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f4356400640 1 --2- 172.21.15.31:0/4280459381 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f435015bea0 0x7f43500ce670 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:13.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f4356400640 1 -- 172.21.15.31:0/4280459381 >> 172.21.15.31:0/4280459381 conn(0x7f43500d1dc0 msgr2=0x7f43500d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:13.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f4356400640 1 -- 172.21.15.31:0/4280459381 shutdown_connections 2024-09-17T05:32:13.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f4356400640 1 -- 172.21.15.31:0/4280459381 wait complete. 2024-09-17T05:32:13.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f4356400640 1 Processor -- start 2024-09-17T05:32:13.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f4356400640 1 -- start start 2024-09-17T05:32:13.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f4356400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43500cdb30 0x7f43501544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:13.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f4356400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43500d28e0 0x7f4350159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:13.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f4356400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f435015bea0 0x7f4350157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:13.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f4356400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4350168f10 con 0x7f435015bea0 2024-09-17T05:32:13.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f4356400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4350168d90 con 0x7f43500d28e0 2024-09-17T05:32:13.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f4356400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4350169090 con 0x7f43500cdb30 2024-09-17T05:32:13.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f434fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f435015bea0 0x7f4350157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:13.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f434fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f435015bea0 0x7f4350157420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41558/0 (socket says 172.21.15.31:41558) 2024-09-17T05:32:13.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f434fe00640 1 -- 172.21.15.31:0/299155124 learned_addr learned my addr 172.21.15.31:0/299155124 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:13.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f434f400640 1 --2- 172.21.15.31:0/299155124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43500cdb30 0x7f43501544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:13.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f4347e00640 1 --2- 172.21.15.31:0/299155124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43500d28e0 0x7f4350159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:13.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f434fe00640 1 -- 172.21.15.31:0/299155124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43500cdb30 msgr2=0x7f43501544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:13.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f434fe00640 1 --2- 172.21.15.31:0/299155124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43500cdb30 0x7f43501544b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:13.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f434fe00640 1 -- 172.21.15.31:0/299155124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43500d28e0 msgr2=0x7f4350159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:13.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f434fe00640 1 --2- 172.21.15.31:0/299155124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43500d28e0 0x7f4350159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:13.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f434fe00640 1 -- 172.21.15.31:0/299155124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43501faf00 con 0x7f435015bea0 2024-09-17T05:32:13.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.923+0000 7f434fe00640 1 --2- 172.21.15.31:0/299155124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f435015bea0 0x7f4350157420 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f434800b970 tx=0x7f434800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:13.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.927+0000 7f4347400640 1 -- 172.21.15.31:0/299155124 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4348019070 con 0x7f435015bea0 2024-09-17T05:32:13.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.927+0000 7f4347400640 1 -- 172.21.15.31:0/299155124 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f434800cc50 con 0x7f435015bea0 2024-09-17T05:32:13.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.927+0000 7f4347400640 1 -- 172.21.15.31:0/299155124 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43480146a0 con 0x7f435015bea0 2024-09-17T05:32:13.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.927+0000 7f4356400640 1 -- 172.21.15.31:0/299155124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43501fb1e0 con 0x7f435015bea0 2024-09-17T05:32:13.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.927+0000 7f4356400640 1 -- 172.21.15.31:0/299155124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43501fb7a0 con 0x7f435015bea0 2024-09-17T05:32:13.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.927+0000 7f4356400640 1 -- 172.21.15.31:0/299155124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43501fb9a0 con 0x7f435015bea0 2024-09-17T05:32:13.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.927+0000 7f4347400640 1 -- 172.21.15.31:0/299155124 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f434801c070 con 0x7f435015bea0 2024-09-17T05:32:13.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.927+0000 7f4347400640 1 --2- 172.21.15.31:0/299155124 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f432c073560 0x7f432c075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:13.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.927+0000 7f4347400640 1 -- 172.21.15.31:0/299155124 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f4348094170 con 0x7f435015bea0 2024-09-17T05:32:13.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.931+0000 7f434f400640 1 --2- 172.21.15.31:0/299155124 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f432c073560 0x7f432c075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:13.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.931+0000 7f434f400640 1 --2- 172.21.15.31:0/299155124 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f432c073560 0x7f432c075a20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f43400af000 tx=0x7f434001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:13.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:13.931+0000 7f4347400640 1 -- 172.21.15.31:0/299155124 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f43501fb9a0 con 0x7f435015bea0 2024-09-17T05:32:14.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.171+0000 7f4356400640 1 -- 172.21.15.31:0/299155124 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f43500cc9d0 con 0x7f435015bea0 2024-09-17T05:32:14.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.383+0000 7f4347400640 1 -- 172.21.15.31:0/299155124 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v196) ==== 161+0+0 (secure 0 0 0) 0x7f434805ea00 con 0x7f435015bea0 2024-09-17T05:32:14.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.387+0000 7f4356400640 1 -- 172.21.15.31:0/299155124 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f432c073560 msgr2=0x7f432c075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:14.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.387+0000 7f4356400640 1 --2- 172.21.15.31:0/299155124 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f432c073560 0x7f432c075a20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f43400af000 tx=0x7f434001b070 comp rx=0 tx=0).stop 2024-09-17T05:32:14.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.387+0000 7f4356400640 1 -- 172.21.15.31:0/299155124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f435015bea0 msgr2=0x7f4350157420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:14.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.387+0000 7f4356400640 1 --2- 172.21.15.31:0/299155124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f435015bea0 0x7f4350157420 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f434800b970 tx=0x7f434800be30 comp rx=0 tx=0).stop 2024-09-17T05:32:14.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.387+0000 7f4356400640 1 -- 172.21.15.31:0/299155124 shutdown_connections 2024-09-17T05:32:14.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.387+0000 7f4356400640 1 --2- 172.21.15.31:0/299155124 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f432c073560 0x7f432c075a20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:14.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.387+0000 7f4356400640 1 --2- 172.21.15.31:0/299155124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f435015bea0 0x7f4350157420 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:14.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.387+0000 7f4356400640 1 --2- 172.21.15.31:0/299155124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43500d28e0 0x7f4350159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:14.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.387+0000 7f4356400640 1 --2- 172.21.15.31:0/299155124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43500cdb30 0x7f43501544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:14.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.387+0000 7f4356400640 1 -- 172.21.15.31:0/299155124 >> 172.21.15.31:0/299155124 conn(0x7f43500d1dc0 msgr2=0x7f43500b6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:14.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.387+0000 7f4356400640 1 -- 172.21.15.31:0/299155124 shutdown_connections 2024-09-17T05:32:14.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.387+0000 7f4356400640 1 -- 172.21.15.31:0/299155124 wait complete. 2024-09-17T05:32:14.410 INFO:tasks.cephfs_test_runner:Validate handcrafted .meta file on legacy subvol root doesn't break the system ... ok 2024-09-17T05:32:14.410 INFO:tasks.cephfs_test_runner:Starting test: test_mgr_eviction (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:32:14.410 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:32:14.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.555+0000 7f0acf400640 1 -- 172.21.15.31:0/4082963905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ac815d1a0 msgr2=0x7f0ac80735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:14.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.555+0000 7f0acf400640 1 --2- 172.21.15.31:0/4082963905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ac815d1a0 0x7f0ac80735b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009900 tx=0x7f0ab401c850 comp rx=0 tx=0).stop 2024-09-17T05:32:14.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.555+0000 7f0acf400640 1 -- 172.21.15.31:0/4082963905 shutdown_connections 2024-09-17T05:32:14.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.555+0000 7f0acf400640 1 --2- 172.21.15.31:0/4082963905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ac815d1a0 0x7f0ac80735b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:14.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.555+0000 7f0acf400640 1 --2- 172.21.15.31:0/4082963905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ac80cc690 0x7f0ac8073070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:14.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.555+0000 7f0acf400640 1 -- 172.21.15.31:0/4082963905 >> 172.21.15.31:0/4082963905 conn(0x7f0ac80ccf10 msgr2=0x7f0ac80cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:14.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.555+0000 7f0acf400640 1 -- 172.21.15.31:0/4082963905 shutdown_connections 2024-09-17T05:32:14.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.555+0000 7f0acf400640 1 -- 172.21.15.31:0/4082963905 wait complete. 2024-09-17T05:32:14.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acf400640 1 Processor -- start 2024-09-17T05:32:14.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acf400640 1 -- start start 2024-09-17T05:32:14.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acf400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ac8073eb0 0x7f0ac80aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:14.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acf400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ac80cc690 0x7f0ac80c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:14.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acf400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac815d1a0 0x7f0ac81417d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:14.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acf400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac80cb150 con 0x7f0ac815d1a0 2024-09-17T05:32:14.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acf400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac80cafd0 con 0x7f0ac80cc690 2024-09-17T05:32:14.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acf400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0ac80cb2d0 con 0x7f0ac8073eb0 2024-09-17T05:32:14.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acd400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac815d1a0 0x7f0ac81417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:14.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acd400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac815d1a0 0x7f0ac81417d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41566/0 (socket says 172.21.15.31:41566) 2024-09-17T05:32:14.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acd400640 1 -- 172.21.15.31:0/4087463385 learned_addr learned my addr 172.21.15.31:0/4087463385 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:14.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0ac7e00640 1 --2- 172.21.15.31:0/4087463385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ac80cc690 0x7f0ac80c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:14.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acca00640 1 --2- 172.21.15.31:0/4087463385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ac8073eb0 0x7f0ac80aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:14.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acd400640 1 -- 172.21.15.31:0/4087463385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ac8073eb0 msgr2=0x7f0ac80aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:14.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acd400640 1 --2- 172.21.15.31:0/4087463385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ac8073eb0 0x7f0ac80aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:14.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acd400640 1 -- 172.21.15.31:0/4087463385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ac80cc690 msgr2=0x7f0ac80c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:14.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acd400640 1 --2- 172.21.15.31:0/4087463385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ac80cc690 0x7f0ac80c69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:14.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acd400640 1 -- 172.21.15.31:0/4087463385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac80b3740 con 0x7f0ac815d1a0 2024-09-17T05:32:14.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0ac7e00640 1 --2- 172.21.15.31:0/4087463385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ac80cc690 0x7f0ac80c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:32:14.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acca00640 1 --2- 172.21.15.31:0/4087463385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ac8073eb0 0x7f0ac80aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:32:14.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acd400640 1 --2- 172.21.15.31:0/4087463385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac815d1a0 0x7f0ac81417d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000c730 tx=0x7f0ac000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:14.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0ac4c00640 1 -- 172.21.15.31:0/4087463385 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0003b80 con 0x7f0ac815d1a0 2024-09-17T05:32:14.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0ac4c00640 1 -- 172.21.15.31:0/4087463385 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ac0003d20 con 0x7f0ac815d1a0 2024-09-17T05:32:14.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acf400640 1 -- 172.21.15.31:0/4087463385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ac80b3a20 con 0x7f0ac815d1a0 2024-09-17T05:32:14.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0ac4c00640 1 -- 172.21.15.31:0/4087463385 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac000aab0 con 0x7f0ac815d1a0 2024-09-17T05:32:14.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acf400640 1 -- 172.21.15.31:0/4087463385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ac80ae580 con 0x7f0ac815d1a0 2024-09-17T05:32:14.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.559+0000 7f0acf400640 1 -- 172.21.15.31:0/4087463385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ac80cb780 con 0x7f0ac815d1a0 2024-09-17T05:32:14.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.563+0000 7f0ac4c00640 1 -- 172.21.15.31:0/4087463385 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f0ac000ac50 con 0x7f0ac815d1a0 2024-09-17T05:32:14.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.563+0000 7f0ac4c00640 1 --2- 172.21.15.31:0/4087463385 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0aa8073560 0x7f0aa8075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:14.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.563+0000 7f0ac4c00640 1 -- 172.21.15.31:0/4087463385 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f0ac0094480 con 0x7f0ac815d1a0 2024-09-17T05:32:14.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.563+0000 7f0acca00640 1 --2- 172.21.15.31:0/4087463385 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0aa8073560 0x7f0aa8075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:14.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.563+0000 7f0acca00640 1 --2- 172.21.15.31:0/4087463385 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0aa8073560 0x7f0aa8075a20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80afdd0 tx=0x7f0abc0091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:14.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.567+0000 7f0ac4c00640 1 -- 172.21.15.31:0/4087463385 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0ac005f1f0 con 0x7f0ac815d1a0 2024-09-17T05:32:14.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.755+0000 7f0acf400640 1 -- 172.21.15.31:0/4087463385 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ac80b3bf0 con 0x7f0ac815d1a0 2024-09-17T05:32:14.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.755+0000 7f0ac4c00640 1 -- 172.21.15.31:0/4087463385 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+13056 (secure 0 0 0) 0x7f0ac005eaf0 con 0x7f0ac815d1a0 2024-09-17T05:32:14.757 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:14.757 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":60,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:32:13.381634+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6835/1272884249":"2024-09-18T05:32:10.374169+0000","172.21.15.31:6834/1272884249":"2024-09-18T05:32:10.374169+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:32:14.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.759+0000 7f0acf400640 1 -- 172.21.15.31:0/4087463385 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0aa8073560 msgr2=0x7f0aa8075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:14.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.759+0000 7f0acf400640 1 --2- 172.21.15.31:0/4087463385 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0aa8073560 0x7f0aa8075a20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80afdd0 tx=0x7f0abc0091e0 comp rx=0 tx=0).stop 2024-09-17T05:32:14.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.759+0000 7f0acf400640 1 -- 172.21.15.31:0/4087463385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac815d1a0 msgr2=0x7f0ac81417d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:14.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.759+0000 7f0acf400640 1 --2- 172.21.15.31:0/4087463385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac815d1a0 0x7f0ac81417d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000c730 tx=0x7f0ac000cbf0 comp rx=0 tx=0).stop 2024-09-17T05:32:14.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.759+0000 7f0acf400640 1 -- 172.21.15.31:0/4087463385 shutdown_connections 2024-09-17T05:32:14.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.759+0000 7f0acf400640 1 --2- 172.21.15.31:0/4087463385 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0aa8073560 0x7f0aa8075a20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:14.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.759+0000 7f0acf400640 1 --2- 172.21.15.31:0/4087463385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac815d1a0 0x7f0ac81417d0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:14.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.759+0000 7f0acf400640 1 --2- 172.21.15.31:0/4087463385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ac80cc690 0x7f0ac80c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:14.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.759+0000 7f0acf400640 1 --2- 172.21.15.31:0/4087463385 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ac8073eb0 0x7f0ac80aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:14.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.759+0000 7f0acf400640 1 -- 172.21.15.31:0/4087463385 >> 172.21.15.31:0/4087463385 conn(0x7f0ac80ccf10 msgr2=0x7f0ac80ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:14.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.759+0000 7f0acf400640 1 -- 172.21.15.31:0/4087463385 shutdown_connections 2024-09-17T05:32:14.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.759+0000 7f0acf400640 1 -- 172.21.15.31:0/4087463385 wait complete. 2024-09-17T05:32:14.779 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:28:33.209612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:32:14.779 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:32:14.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.927+0000 7f0be5400640 1 -- 172.21.15.31:0/3218621223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc4003b00 msgr2=0x7f0bc4003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:14.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.927+0000 7f0be5400640 1 --2- 172.21.15.31:0/3218621223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc4003b00 0x7f0bc4003f40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0bd000bbe0 tx=0x7f0bd001cdd0 comp rx=0 tx=0).stop 2024-09-17T05:32:14.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.927+0000 7f0be5400640 1 -- 172.21.15.31:0/3218621223 shutdown_connections 2024-09-17T05:32:14.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.927+0000 7f0be5400640 1 --2- 172.21.15.31:0/3218621223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc4003b00 0x7f0bc4003f40 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:14.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.927+0000 7f0be5400640 1 -- 172.21.15.31:0/3218621223 >> 172.21.15.31:0/3218621223 conn(0x7f0be00d1dd0 msgr2=0x7f0be00d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:14.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.927+0000 7f0be5400640 1 -- 172.21.15.31:0/3218621223 shutdown_connections 2024-09-17T05:32:14.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.927+0000 7f0be5400640 1 -- 172.21.15.31:0/3218621223 wait complete. 2024-09-17T05:32:14.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0be5400640 1 Processor -- start 2024-09-17T05:32:14.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0be5400640 1 -- start start 2024-09-17T05:32:14.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0be5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc4003b00 0x7f0be00b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:14.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0be5400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be0156980 0x7f0be01ebea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:14.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0be5400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0be00b4c20 0x7f0be00b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:14.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0be5400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0be006dd30 con 0x7f0bc4003b00 2024-09-17T05:32:14.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0be5400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0be0162a20 con 0x7f0be0156980 2024-09-17T05:32:14.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0be5400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0be006deb0 con 0x7f0be00b4c20 2024-09-17T05:32:14.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0bde800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc4003b00 0x7f0be00b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:14.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0bde800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc4003b00 0x7f0be00b76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41594/0 (socket says 172.21.15.31:41594) 2024-09-17T05:32:14.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0bde800640 1 -- 172.21.15.31:0/3714312751 learned_addr learned my addr 172.21.15.31:0/3714312751 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:14.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0bd7e00640 1 --2- 172.21.15.31:0/3714312751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be0156980 0x7f0be01ebea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:14.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0bdf200640 1 --2- 172.21.15.31:0/3714312751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0be00b4c20 0x7f0be00b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:14.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0bde800640 1 -- 172.21.15.31:0/3714312751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0be00b4c20 msgr2=0x7f0be00b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:14.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0bde800640 1 --2- 172.21.15.31:0/3714312751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0be00b4c20 0x7f0be00b50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:14.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0bde800640 1 -- 172.21.15.31:0/3714312751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be0156980 msgr2=0x7f0be01ebea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:14.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0bde800640 1 --2- 172.21.15.31:0/3714312751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be0156980 0x7f0be01ebea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:14.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0bde800640 1 -- 172.21.15.31:0/3714312751 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be00b7bf0 con 0x7f0bc4003b00 2024-09-17T05:32:14.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0bde800640 1 --2- 172.21.15.31:0/3714312751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc4003b00 0x7f0be00b76b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00b1040 tx=0x7f0bd0005650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:14.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0bd6a00640 1 -- 172.21.15.31:0/3714312751 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00be070 con 0x7f0bc4003b00 2024-09-17T05:32:14.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0bd6a00640 1 -- 172.21.15.31:0/3714312751 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bd00047c0 con 0x7f0bc4003b00 2024-09-17T05:32:14.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0bd6a00640 1 -- 172.21.15.31:0/3714312751 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00ab050 con 0x7f0bc4003b00 2024-09-17T05:32:14.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0be5400640 1 -- 172.21.15.31:0/3714312751 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be01eae00 con 0x7f0bc4003b00 2024-09-17T05:32:14.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.931+0000 7f0be5400640 1 -- 172.21.15.31:0/3714312751 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be01eb3c0 con 0x7f0bc4003b00 2024-09-17T05:32:14.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.935+0000 7f0be5400640 1 -- 172.21.15.31:0/3714312751 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0be006e3b0 con 0x7f0bc4003b00 2024-09-17T05:32:14.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.935+0000 7f0bd6a00640 1 -- 172.21.15.31:0/3714312751 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f0bd00c1070 con 0x7f0bc4003b00 2024-09-17T05:32:14.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.935+0000 7f0bd6a00640 1 --2- 172.21.15.31:0/3714312751 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0bbc073590 0x7f0bbc075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:14.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.935+0000 7f0bd6a00640 1 -- 172.21.15.31:0/3714312751 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f0bd012e9f0 con 0x7f0bc4003b00 2024-09-17T05:32:14.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.935+0000 7f0bd7e00640 1 --2- 172.21.15.31:0/3714312751 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0bbc073590 0x7f0bbc075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:14.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.939+0000 7f0bd7e00640 1 --2- 172.21.15.31:0/3714312751 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0bbc073590 0x7f0bbc075a50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8000fc0 tx=0x7f0bc8006730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:14.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:14.939+0000 7f0bd6a00640 1 -- 172.21.15.31:0/3714312751 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0bd0016b10 con 0x7f0bc4003b00 2024-09-17T05:32:15.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.115+0000 7f0be5400640 1 -- 172.21.15.31:0/3714312751 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0be0071320 con 0x7f0bc4003b00 2024-09-17T05:32:15.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.115+0000 7f0bd6a00640 1 -- 172.21.15.31:0/3714312751 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7f0bd00f9840 con 0x7f0bc4003b00 2024-09-17T05:32:15.116 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-09-17T05:32:15.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.115+0000 7f0be5400640 1 -- 172.21.15.31:0/3714312751 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0bbc073590 msgr2=0x7f0bbc075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:15.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.115+0000 7f0be5400640 1 --2- 172.21.15.31:0/3714312751 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0bbc073590 0x7f0bbc075a50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8000fc0 tx=0x7f0bc8006730 comp rx=0 tx=0).stop 2024-09-17T05:32:15.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.115+0000 7f0be5400640 1 -- 172.21.15.31:0/3714312751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc4003b00 msgr2=0x7f0be00b76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:15.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.115+0000 7f0be5400640 1 --2- 172.21.15.31:0/3714312751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc4003b00 0x7f0be00b76b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00b1040 tx=0x7f0bd0005650 comp rx=0 tx=0).stop 2024-09-17T05:32:15.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.115+0000 7f0be5400640 1 -- 172.21.15.31:0/3714312751 shutdown_connections 2024-09-17T05:32:15.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.115+0000 7f0be5400640 1 --2- 172.21.15.31:0/3714312751 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0bbc073590 0x7f0bbc075a50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:15.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.115+0000 7f0be5400640 1 --2- 172.21.15.31:0/3714312751 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0be00b4c20 0x7f0be00b50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:15.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.115+0000 7f0be5400640 1 --2- 172.21.15.31:0/3714312751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be0156980 0x7f0be01ebea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:15.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.115+0000 7f0be5400640 1 --2- 172.21.15.31:0/3714312751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bc4003b00 0x7f0be00b76b0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:15.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.115+0000 7f0be5400640 1 -- 172.21.15.31:0/3714312751 >> 172.21.15.31:0/3714312751 conn(0x7f0be00d1dd0 msgr2=0x7f0be00cff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:15.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.115+0000 7f0be5400640 1 -- 172.21.15.31:0/3714312751 shutdown_connections 2024-09-17T05:32:15.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.115+0000 7f0be5400640 1 -- 172.21.15.31:0/3714312751 wait complete. 2024-09-17T05:32:15.138 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction' 2024-09-17T05:32:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.283+0000 7fe395400640 1 -- 172.21.15.31:0/3033028446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe39015df50 msgr2=0x7fe39006e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.283+0000 7fe395400640 1 --2- 172.21.15.31:0/3033028446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe39015df50 0x7fe39006e740 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe380009840 tx=0x7fe38001c700 comp rx=0 tx=0).stop 2024-09-17T05:32:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.283+0000 7fe395400640 1 -- 172.21.15.31:0/3033028446 shutdown_connections 2024-09-17T05:32:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.283+0000 7fe395400640 1 --2- 172.21.15.31:0/3033028446 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe39015e330 0x7fe39006ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.283+0000 7fe395400640 1 --2- 172.21.15.31:0/3033028446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe39015df50 0x7fe39006e740 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:15.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.283+0000 7fe395400640 1 -- 172.21.15.31:0/3033028446 >> 172.21.15.31:0/3033028446 conn(0x7fe3900d1dc0 msgr2=0x7fe3900d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:15.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.283+0000 7fe395400640 1 -- 172.21.15.31:0/3033028446 shutdown_connections 2024-09-17T05:32:15.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.283+0000 7fe395400640 1 -- 172.21.15.31:0/3033028446 wait complete. 2024-09-17T05:32:15.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.283+0000 7fe395400640 1 Processor -- start 2024-09-17T05:32:15.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.283+0000 7fe395400640 1 -- start start 2024-09-17T05:32:15.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe395400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3900b11d0 0x7fe39014f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:15.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe395400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe39015df50 0x7fe39014bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:15.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe395400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe39015e330 0x7fe3900b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:15.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe395400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe3900d0790 con 0x7fe39015df50 2024-09-17T05:32:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe395400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe3900d0610 con 0x7fe3900b11d0 2024-09-17T05:32:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe395400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe3900d0910 con 0x7fe39015e330 2024-09-17T05:32:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe38de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe39015df50 0x7fe39014bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe38de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe39015df50 0x7fe39014bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41608/0 (socket says 172.21.15.31:41608) 2024-09-17T05:32:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe38de00640 1 -- 172.21.15.31:0/213174426 learned_addr learned my addr 172.21.15.31:0/213174426 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe38de00640 1 -- 172.21.15.31:0/213174426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe39015e330 msgr2=0x7fe3900b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe38de00640 1 --2- 172.21.15.31:0/213174426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe39015e330 0x7fe3900b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe38de00640 1 -- 172.21.15.31:0/213174426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3900b11d0 msgr2=0x7fe39014f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe38de00640 1 --2- 172.21.15.31:0/213174426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3900b11d0 0x7fe39014f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe38de00640 1 -- 172.21.15.31:0/213174426 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39015b110 con 0x7fe39015df50 2024-09-17T05:32:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe38de00640 1 --2- 172.21.15.31:0/213174426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe39015df50 0x7fe39014bb70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe37c0058d0 tx=0x7fe37c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe386a00640 1 -- 172.21.15.31:0/213174426 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37c017070 con 0x7fe39015df50 2024-09-17T05:32:15.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe386a00640 1 -- 172.21.15.31:0/213174426 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe37c009cc0 con 0x7fe39015df50 2024-09-17T05:32:15.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe395400640 1 -- 172.21.15.31:0/213174426 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe39015b3f0 con 0x7fe39015df50 2024-09-17T05:32:15.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe386a00640 1 -- 172.21.15.31:0/213174426 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37c0106c0 con 0x7fe39015df50 2024-09-17T05:32:15.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe395400640 1 -- 172.21.15.31:0/213174426 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe39014c0b0 con 0x7fe39015df50 2024-09-17T05:32:15.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe395400640 1 -- 172.21.15.31:0/213174426 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3900afcd0 con 0x7fe39015df50 2024-09-17T05:32:15.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.287+0000 7fe386a00640 1 -- 172.21.15.31:0/213174426 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7fe37c01a070 con 0x7fe39015df50 2024-09-17T05:32:15.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.291+0000 7fe386a00640 1 --2- 172.21.15.31:0/213174426 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe370073590 0x7fe370075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:15.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.291+0000 7fe386a00640 1 -- 172.21.15.31:0/213174426 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fe37c0947c0 con 0x7fe39015df50 2024-09-17T05:32:15.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.291+0000 7fe38e800640 1 --2- 172.21.15.31:0/213174426 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe370073590 0x7fe370075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:15.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.291+0000 7fe38e800640 1 --2- 172.21.15.31:0/213174426 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe370073590 0x7fe370075a50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe3800af000 tx=0x7fe3900b0bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:15.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.295+0000 7fe386a00640 1 -- 172.21.15.31:0/213174426 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe37c05f510 con 0x7fe39015df50 2024-09-17T05:32:15.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:15.535+0000 7fe395400640 1 -- 172.21.15.31:0/213174426 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]} v 0) -- 0x7fe3900b3110 con 0x7fe39015df50 2024-09-17T05:32:16.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.391+0000 7fe386a00640 1 -- 172.21.15.31:0/213174426 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]}]=0 v198) ==== 134+0+0 (secure 0 0 0) 0x7fe37c05ee10 con 0x7fe39015df50 2024-09-17T05:32:16.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.395+0000 7fe395400640 1 -- 172.21.15.31:0/213174426 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe370073590 msgr2=0x7fe370075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:16.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.395+0000 7fe395400640 1 --2- 172.21.15.31:0/213174426 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe370073590 0x7fe370075a50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe3800af000 tx=0x7fe3900b0bf0 comp rx=0 tx=0).stop 2024-09-17T05:32:16.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.395+0000 7fe395400640 1 -- 172.21.15.31:0/213174426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe39015df50 msgr2=0x7fe39014bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:16.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.395+0000 7fe395400640 1 --2- 172.21.15.31:0/213174426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe39015df50 0x7fe39014bb70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe37c0058d0 tx=0x7fe37c00dde0 comp rx=0 tx=0).stop 2024-09-17T05:32:16.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.395+0000 7fe395400640 1 -- 172.21.15.31:0/213174426 shutdown_connections 2024-09-17T05:32:16.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.395+0000 7fe395400640 1 --2- 172.21.15.31:0/213174426 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe370073590 0x7fe370075a50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:16.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.395+0000 7fe395400640 1 --2- 172.21.15.31:0/213174426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe39015e330 0x7fe3900b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:16.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.395+0000 7fe395400640 1 --2- 172.21.15.31:0/213174426 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe39015df50 0x7fe39014bb70 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:16.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.395+0000 7fe395400640 1 --2- 172.21.15.31:0/213174426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3900b11d0 0x7fe39014f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:16.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.395+0000 7fe395400640 1 -- 172.21.15.31:0/213174426 >> 172.21.15.31:0/213174426 conn(0x7fe3900d1dc0 msgr2=0x7fe3900b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:16.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.395+0000 7fe395400640 1 -- 172.21.15.31:0/213174426 shutdown_connections 2024-09-17T05:32:16.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.395+0000 7fe395400640 1 -- 172.21.15.31:0/213174426 wait complete. 2024-09-17T05:32:16.418 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:32:16.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.567+0000 7f544ac00640 1 -- 172.21.15.31:0/3170974853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5428004810 msgr2=0x7f5428004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:16.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.567+0000 7f544ac00640 1 --2- 172.21.15.31:0/3170974853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5428004810 0x7f5428004c90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f542c00bbe0 tx=0x7f542c01ce20 comp rx=0 tx=0).stop 2024-09-17T05:32:16.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.567+0000 7f5448c00640 1 -- 172.21.15.31:0/3170974853 reap_dead start 2024-09-17T05:32:16.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.567+0000 7f544ac00640 1 -- 172.21.15.31:0/3170974853 shutdown_connections 2024-09-17T05:32:16.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.567+0000 7f544ac00640 1 -- 172.21.15.31:0/3170974853 >> 172.21.15.31:0/3170974853 conn(0x7f54440d1dc0 msgr2=0x7f54440d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:16.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.567+0000 7f544ac00640 1 -- 172.21.15.31:0/3170974853 shutdown_connections 2024-09-17T05:32:16.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.567+0000 7f544ac00640 1 -- 172.21.15.31:0/3170974853 wait complete. 2024-09-17T05:32:16.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f544ac00640 1 Processor -- start 2024-09-17T05:32:16.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f544ac00640 1 -- start start 2024-09-17T05:32:16.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f544ac00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5428004810 0x7f54440b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:16.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f544ac00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54440cb720 0x7f54440cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:16.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f544ac00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54441f8330 0x7f54441f8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:16.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f544ac00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f54440cfb30 con 0x7f54441f8330 2024-09-17T05:32:16.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f544ac00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f544415c490 con 0x7f54440cb720 2024-09-17T05:32:16.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f544ac00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f54440ce670 con 0x7f5428004810 2024-09-17T05:32:16.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f5448c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54441f8330 0x7f54441f8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:16.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f5448c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54441f8330 0x7f54441f8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41622/0 (socket says 172.21.15.31:41622) 2024-09-17T05:32:16.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f5448c00640 1 -- 172.21.15.31:0/2542998318 learned_addr learned my addr 172.21.15.31:0/2542998318 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:16.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f543be00640 1 --2- 172.21.15.31:0/2542998318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54440cb720 0x7f54440cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:16.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f5443e00640 1 --2- 172.21.15.31:0/2542998318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5428004810 0x7f54440b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:16.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f5448c00640 1 -- 172.21.15.31:0/2542998318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5428004810 msgr2=0x7f54440b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:16.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f5448c00640 1 --2- 172.21.15.31:0/2542998318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5428004810 0x7f54440b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:16.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f5448c00640 1 -- 172.21.15.31:0/2542998318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54440cb720 msgr2=0x7f54440cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:16.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f5448c00640 1 --2- 172.21.15.31:0/2542998318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54440cb720 0x7f54440cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:16.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f5448c00640 1 -- 172.21.15.31:0/2542998318 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54440cc0e0 con 0x7f54441f8330 2024-09-17T05:32:16.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f5448c00640 1 --2- 172.21.15.31:0/2542998318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54441f8330 0x7f54441f8790 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f54440745d0 tx=0x7f543c0127b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:16.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f5440c00640 1 -- 172.21.15.31:0/2542998318 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543c013860 con 0x7f54441f8330 2024-09-17T05:32:16.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f5440c00640 1 -- 172.21.15.31:0/2542998318 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f543c013a00 con 0x7f54441f8330 2024-09-17T05:32:16.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f544ac00640 1 -- 172.21.15.31:0/2542998318 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54440b2c20 con 0x7f54441f8330 2024-09-17T05:32:16.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f5440c00640 1 -- 172.21.15.31:0/2542998318 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543c013e50 con 0x7f54441f8330 2024-09-17T05:32:16.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f544ac00640 1 -- 172.21.15.31:0/2542998318 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54440b31e0 con 0x7f54441f8330 2024-09-17T05:32:16.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.571+0000 7f544ac00640 1 -- 172.21.15.31:0/2542998318 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54440ceb90 con 0x7f54441f8330 2024-09-17T05:32:16.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.575+0000 7f5440c00640 1 -- 172.21.15.31:0/2542998318 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f543c01e480 con 0x7f54441f8330 2024-09-17T05:32:16.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.575+0000 7f5440c00640 1 --2- 172.21.15.31:0/2542998318 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5420073730 0x7f5420075bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:16.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.575+0000 7f5440c00640 1 -- 172.21.15.31:0/2542998318 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f543c0989f0 con 0x7f54441f8330 2024-09-17T05:32:16.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.575+0000 7f5443e00640 1 --2- 172.21.15.31:0/2542998318 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5420073730 0x7f5420075bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:16.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.575+0000 7f5443e00640 1 --2- 172.21.15.31:0/2542998318 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5420073730 0x7f5420075bf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5434009b00 tx=0x7f54340091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:16.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.579+0000 7f5440c00640 1 -- 172.21.15.31:0/2542998318 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f54440cc0e0 con 0x7f54441f8330 2024-09-17T05:32:16.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.759+0000 7f544ac00640 1 -- 172.21.15.31:0/2542998318 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f5444071af0 con 0x7f54441f8330 2024-09-17T05:32:16.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.759+0000 7f5440c00640 1 -- 172.21.15.31:0/2542998318 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+1998 (secure 0 0 0) 0x7f543c0637c0 con 0x7f54441f8330 2024-09-17T05:32:16.760 INFO:teuthology.orchestra.run.smithi031.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:32:16.760 INFO:teuthology.orchestra.run.smithi031.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:32:16.760 INFO:teuthology.orchestra.run.smithi031.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:32:16.760 INFO:teuthology.orchestra.run.smithi031.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:32:16.760 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6159.333103 2024-09-17T05:32:16.760 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4566.558105 2024-09-17T05:32:16.760 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4575.968427 2024-09-17T05:32:16.761 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4702.806393 2024-09-17T05:32:16.761 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4956.728274 2024-09-17T05:32:16.761 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 6604.257199 2024-09-17T05:32:16.761 INFO:teuthology.orchestra.run.smithi031.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4779.165073 2024-09-17T05:32:16.761 INFO:teuthology.orchestra.run.smithi031.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4673.795919 2024-09-17T05:32:16.761 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds 20/20 2024-09-17T05:32:16.761 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:32:16.761 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_ms 2/2 2024-09-17T05:32:16.761 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_frag true 2024-09-17T05:32:16.761 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:32:16.761 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:32:16.761 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_verify_scatter true 2024-09-17T05:32:16.762 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:32:16.762 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:32:16.762 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:32:16.762 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced client_mount_timeout 600 2024-09-17T05:32:16.762 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_client 20/20 2024-09-17T05:32:16.762 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_ms 1/1 2024-09-17T05:32:16.762 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:32:16.762 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:32:16.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.759+0000 7f544ac00640 1 -- 172.21.15.31:0/2542998318 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5420073730 msgr2=0x7f5420075bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:16.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.759+0000 7f544ac00640 1 --2- 172.21.15.31:0/2542998318 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5420073730 0x7f5420075bf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5434009b00 tx=0x7f54340091e0 comp rx=0 tx=0).stop 2024-09-17T05:32:16.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.759+0000 7f544ac00640 1 -- 172.21.15.31:0/2542998318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54441f8330 msgr2=0x7f54441f8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:16.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.759+0000 7f544ac00640 1 --2- 172.21.15.31:0/2542998318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54441f8330 0x7f54441f8790 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f54440745d0 tx=0x7f543c0127b0 comp rx=0 tx=0).stop 2024-09-17T05:32:16.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.759+0000 7f544ac00640 1 -- 172.21.15.31:0/2542998318 shutdown_connections 2024-09-17T05:32:16.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.759+0000 7f544ac00640 1 --2- 172.21.15.31:0/2542998318 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5420073730 0x7f5420075bf0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:16.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.759+0000 7f544ac00640 1 --2- 172.21.15.31:0/2542998318 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54441f8330 0x7f54441f8790 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:16.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.759+0000 7f544ac00640 1 --2- 172.21.15.31:0/2542998318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54440cb720 0x7f54440cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:16.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.759+0000 7f544ac00640 1 --2- 172.21.15.31:0/2542998318 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5428004810 0x7f54440b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:16.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.759+0000 7f544ac00640 1 -- 172.21.15.31:0/2542998318 >> 172.21.15.31:0/2542998318 conn(0x7f54440d1dc0 msgr2=0x7f5444072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:16.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.759+0000 7f544ac00640 1 -- 172.21.15.31:0/2542998318 shutdown_connections 2024-09-17T05:32:16.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.759+0000 7f544ac00640 1 -- 172.21.15.31:0/2542998318 wait complete. 2024-09-17T05:32:16.782 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:32:16.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.931+0000 7fddee000640 1 -- 172.21.15.31:0/3499146651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde80b3bb0 msgr2=0x7fdde80b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:16.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.931+0000 7fddee000640 1 --2- 172.21.15.31:0/3499146651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde80b3bb0 0x7fdde80b1320 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fdde80ce830 tx=0x7fddd001c890 comp rx=0 tx=0).stop 2024-09-17T05:32:16.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.931+0000 7fddee000640 1 -- 172.21.15.31:0/3499146651 shutdown_connections 2024-09-17T05:32:16.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.931+0000 7fddee000640 1 --2- 172.21.15.31:0/3499146651 >> v2:172.21.15.155:3300/0 conn(0x7fdde80cdf20 0x7fdde80b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:16.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.931+0000 7fddee000640 1 --2- 172.21.15.31:0/3499146651 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde80b3bb0 0x7fdde80b1320 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:16.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.931+0000 7fddee000640 1 -- 172.21.15.31:0/3499146651 >> 172.21.15.31:0/3499146651 conn(0x7fdde80d1e00 msgr2=0x7fdde80d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:16.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.931+0000 7fddee000640 1 -- 172.21.15.31:0/3499146651 shutdown_connections 2024-09-17T05:32:16.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.931+0000 7fddee000640 1 -- 172.21.15.31:0/3499146651 wait complete. 2024-09-17T05:32:16.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.931+0000 7fddee000640 1 Processor -- start 2024-09-17T05:32:16.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.931+0000 7fddee000640 1 -- start start 2024-09-17T05:32:16.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fddee000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde80b3bb0 0x7fdde814e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:16.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fddee000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdde80cdf20 0x7fdde815dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:16.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fddee000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdde815f340 0x7fdde815e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:16.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fddee000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdde8168ee0 con 0x7fdde80b3bb0 2024-09-17T05:32:16.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fddee000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdde8168d60 con 0x7fdde80cdf20 2024-09-17T05:32:16.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fddee000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdde8169060 con 0x7fdde815f340 2024-09-17T05:32:16.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fdde7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde80b3bb0 0x7fdde814e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:16.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fdde7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde80b3bb0 0x7fdde814e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41638/0 (socket says 172.21.15.31:41638) 2024-09-17T05:32:16.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fdde7400640 1 -- 172.21.15.31:0/1174332818 learned_addr learned my addr 172.21.15.31:0/1174332818 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:16.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fdde7e00640 1 --2- 172.21.15.31:0/1174332818 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdde815f340 0x7fdde815e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:16.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fdddfe00640 1 --2- 172.21.15.31:0/1174332818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdde80cdf20 0x7fdde815dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:16.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fdde7400640 1 -- 172.21.15.31:0/1174332818 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdde815f340 msgr2=0x7fdde815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:16.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fdde7400640 1 --2- 172.21.15.31:0/1174332818 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdde815f340 0x7fdde815e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:16.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fdde7400640 1 -- 172.21.15.31:0/1174332818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdde80cdf20 msgr2=0x7fdde815dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:16.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fdde7400640 1 --2- 172.21.15.31:0/1174332818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdde80cdf20 0x7fdde815dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:16.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fdde7400640 1 -- 172.21.15.31:0/1174332818 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde814d2b0 con 0x7fdde80b3bb0 2024-09-17T05:32:16.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fdde7400640 1 --2- 172.21.15.31:0/1174332818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde80b3bb0 0x7fdde814e070 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fddd8001ec0 tx=0x7fddd800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:16.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fdddf400640 1 -- 172.21.15.31:0/1174332818 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd8017070 con 0x7fdde80b3bb0 2024-09-17T05:32:16.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fdddf400640 1 -- 172.21.15.31:0/1174332818 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fddd8003600 con 0x7fdde80b3bb0 2024-09-17T05:32:16.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fddee000640 1 -- 172.21.15.31:0/1174332818 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde814d590 con 0x7fdde80b3bb0 2024-09-17T05:32:16.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fdddf400640 1 -- 172.21.15.31:0/1174332818 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd8003a50 con 0x7fdde80b3bb0 2024-09-17T05:32:16.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fddee000640 1 -- 172.21.15.31:0/1174332818 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde814db50 con 0x7fdde80b3bb0 2024-09-17T05:32:16.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fddee000640 1 -- 172.21.15.31:0/1174332818 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde80b34a0 con 0x7fdde80b3bb0 2024-09-17T05:32:16.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.935+0000 7fdddf400640 1 -- 172.21.15.31:0/1174332818 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7fddd801a070 con 0x7fdde80b3bb0 2024-09-17T05:32:16.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.939+0000 7fdddf400640 1 --2- 172.21.15.31:0/1174332818 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fddc4073560 0x7fddc4075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:16.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.939+0000 7fdddf400640 1 -- 172.21.15.31:0/1174332818 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fddd8093700 con 0x7fdde80b3bb0 2024-09-17T05:32:16.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.939+0000 7fdddfe00640 1 --2- 172.21.15.31:0/1174332818 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fddc4073560 0x7fddc4075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:16.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.939+0000 7fdddfe00640 1 --2- 172.21.15.31:0/1174332818 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fddc4073560 0x7fddc4075a20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fddd00af000 tx=0x7fddd001b0d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:16.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:16.943+0000 7fdddf400640 1 -- 172.21.15.31:0/1174332818 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fdde80d2c90 con 0x7fdde80b3bb0 2024-09-17T05:32:17.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.115+0000 7fddee000640 1 -- 172.21.15.31:0/1174332818 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fdde8152a60 con 0x7fdde80b3bb0 2024-09-17T05:32:17.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.119+0000 7fdddf400640 1 -- 172.21.15.31:0/1174332818 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7fddd805df90 con 0x7fdde80b3bb0 2024-09-17T05:32:17.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.123+0000 7fddee000640 1 -- 172.21.15.31:0/1174332818 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fddc4073560 msgr2=0x7fddc4075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.123+0000 7fddee000640 1 --2- 172.21.15.31:0/1174332818 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fddc4073560 0x7fddc4075a20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fddd00af000 tx=0x7fddd001b0d0 comp rx=0 tx=0).stop 2024-09-17T05:32:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.123+0000 7fddee000640 1 -- 172.21.15.31:0/1174332818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde80b3bb0 msgr2=0x7fdde814e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.123+0000 7fddee000640 1 --2- 172.21.15.31:0/1174332818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde80b3bb0 0x7fdde814e070 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fddd8001ec0 tx=0x7fddd800c890 comp rx=0 tx=0).stop 2024-09-17T05:32:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.123+0000 7fddee000640 1 -- 172.21.15.31:0/1174332818 shutdown_connections 2024-09-17T05:32:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.123+0000 7fddee000640 1 --2- 172.21.15.31:0/1174332818 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fddc4073560 0x7fddc4075a20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.123+0000 7fddee000640 1 --2- 172.21.15.31:0/1174332818 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdde815f340 0x7fdde815e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.123+0000 7fddee000640 1 --2- 172.21.15.31:0/1174332818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdde80cdf20 0x7fdde815dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.123+0000 7fddee000640 1 --2- 172.21.15.31:0/1174332818 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdde80b3bb0 0x7fdde814e070 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.123+0000 7fddee000640 1 -- 172.21.15.31:0/1174332818 >> 172.21.15.31:0/1174332818 conn(0x7fdde80d1e00 msgr2=0x7fdde80aec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:17.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.123+0000 7fddee000640 1 -- 172.21.15.31:0/1174332818 shutdown_connections 2024-09-17T05:32:17.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.123+0000 7fddee000640 1 -- 172.21.15.31:0/1174332818 wait complete. 2024-09-17T05:32:17.142 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:32:17.143 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:32:17.225 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:32:17.317 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:32:17.317 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:32:17.317 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:17.326 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:32:17.326 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:32:17.326 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:17.335 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:32:17.336 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:32:17.336 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:17.378 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:32:17.378 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:32:17.379 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:17.388 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:32:17.388 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:32:17.388 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:32:17.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.567+0000 7fa43e000640 1 -- 172.21.15.31:0/4004690119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa41c004810 msgr2=0x7fa41c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:17.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.567+0000 7fa43e000640 1 --2- 172.21.15.31:0/4004690119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa41c004810 0x7fa41c004c90 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa420009b30 tx=0x7fa42001cf30 comp rx=0 tx=0).stop 2024-09-17T05:32:17.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.567+0000 7fa437e00640 1 -- 172.21.15.31:0/4004690119 reap_dead start 2024-09-17T05:32:17.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.567+0000 7fa43e000640 1 -- 172.21.15.31:0/4004690119 shutdown_connections 2024-09-17T05:32:17.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.567+0000 7fa43e000640 1 -- 172.21.15.31:0/4004690119 >> 172.21.15.31:0/4004690119 conn(0x7fa4380d1ea0 msgr2=0x7fa4380d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:17.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.567+0000 7fa43e000640 1 -- 172.21.15.31:0/4004690119 shutdown_connections 2024-09-17T05:32:17.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.567+0000 7fa43e000640 1 -- 172.21.15.31:0/4004690119 wait complete. 2024-09-17T05:32:17.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa43e000640 1 Processor -- start 2024-09-17T05:32:17.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa43e000640 1 -- start start 2024-09-17T05:32:17.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa43e000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa41c004810 0x7fa438072070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:17.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa43e000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa438157d10 0x7fa438162850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:17.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa43e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4381595d0 0x7fa438159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:17.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa43e000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa438166cc0 con 0x7fa4381595d0 2024-09-17T05:32:17.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa43e000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa4380cdcb0 con 0x7fa438157d10 2024-09-17T05:32:17.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa43e000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa438166e40 con 0x7fa41c004810 2024-09-17T05:32:17.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa437e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4381595d0 0x7fa438159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:17.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa437e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4381595d0 0x7fa438159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41648/0 (socket says 172.21.15.31:41648) 2024-09-17T05:32:17.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa437e00640 1 -- 172.21.15.31:0/3464789594 learned_addr learned my addr 172.21.15.31:0/3464789594 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:17.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa437400640 1 --2- 172.21.15.31:0/3464789594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa41c004810 0x7fa438072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:17.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa42ea00640 1 --2- 172.21.15.31:0/3464789594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa438157d10 0x7fa438162850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:17.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa437e00640 1 -- 172.21.15.31:0/3464789594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa41c004810 msgr2=0x7fa438072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:17.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa437e00640 1 --2- 172.21.15.31:0/3464789594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa41c004810 0x7fa438072070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:17.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa437e00640 1 -- 172.21.15.31:0/3464789594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa438157d10 msgr2=0x7fa438162850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:17.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa437e00640 1 --2- 172.21.15.31:0/3464789594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa438157d10 0x7fa438162850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:17.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa437e00640 1 -- 172.21.15.31:0/3464789594 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4380725b0 con 0x7fa4381595d0 2024-09-17T05:32:17.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa42ea00640 1 --2- 172.21.15.31:0/3464789594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa438157d10 0x7fa438162850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:17.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa437e00640 1 --2- 172.21.15.31:0/3464789594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4381595d0 0x7fa438159a80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa4380d1470 tx=0x7fa430010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:17.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa42fe00640 1 -- 172.21.15.31:0/3464789594 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa430003980 con 0x7fa4381595d0 2024-09-17T05:32:17.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa42fe00640 1 -- 172.21.15.31:0/3464789594 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa430015070 con 0x7fa4381595d0 2024-09-17T05:32:17.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa42fe00640 1 -- 172.21.15.31:0/3464789594 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa430004030 con 0x7fa4381595d0 2024-09-17T05:32:17.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa43e000640 1 -- 172.21.15.31:0/3464789594 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4381f7b80 con 0x7fa4381595d0 2024-09-17T05:32:17.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa43e000640 1 -- 172.21.15.31:0/3464789594 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4381f8140 con 0x7fa4381595d0 2024-09-17T05:32:17.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.571+0000 7fa43e000640 1 -- 172.21.15.31:0/3464789594 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4380cc940 con 0x7fa4381595d0 2024-09-17T05:32:17.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.575+0000 7fa42fe00640 1 -- 172.21.15.31:0/3464789594 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7fa4300041d0 con 0x7fa4381595d0 2024-09-17T05:32:17.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.575+0000 7fa42fe00640 1 --2- 172.21.15.31:0/3464789594 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa414073590 0x7fa414075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:17.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.575+0000 7fa42fe00640 1 -- 172.21.15.31:0/3464789594 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fa430094b60 con 0x7fa4381595d0 2024-09-17T05:32:17.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.575+0000 7fa437400640 1 --2- 172.21.15.31:0/3464789594 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa414073590 0x7fa414075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:17.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.575+0000 7fa437400640 1 --2- 172.21.15.31:0/3464789594 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa414073590 0x7fa414075a50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa428001820 tx=0x7fa428006730 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:17.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.579+0000 7fa42fe00640 1 -- 172.21.15.31:0/3464789594 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa43005f2f0 con 0x7fa4381595d0 2024-09-17T05:32:17.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.791+0000 7fa43e000640 1 -- 172.21.15.31:0/3464789594 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa438076360 con 0x7fa4381595d0 2024-09-17T05:32:17.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.795+0000 7fa42fe00640 1 -- 172.21.15.31:0/3464789594 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+3917 (secure 0 0 0) 0x7fa430063d20 con 0x7fa4381595d0 2024-09-17T05:32:17.794 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:17.795 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":41,"btime":"2024-09-17T05:32:11:377654+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/3185006969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3185006969},{"type":"v1","addr":"172.21.15.155:6836","nonce":3185006969}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3957768567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3957768567},{"type":"v1","addr":"172.21.15.155:6837","nonce":3957768567}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33},{"gid":5748,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3936847081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3936847081},{"type":"v1","addr":"172.21.15.31:6833","nonce":3936847081}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6060,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3493844771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":3493844771},{"type":"v1","addr":"172.21.15.31:6835","nonce":3493844771}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[]} 2024-09-17T05:32:17.795 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 41 2024-09-17T05:32:17.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.795+0000 7fa43e000640 1 -- 172.21.15.31:0/3464789594 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa414073590 msgr2=0x7fa414075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:17.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.795+0000 7fa43e000640 1 --2- 172.21.15.31:0/3464789594 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa414073590 0x7fa414075a50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa428001820 tx=0x7fa428006730 comp rx=0 tx=0).stop 2024-09-17T05:32:17.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.795+0000 7fa43e000640 1 -- 172.21.15.31:0/3464789594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4381595d0 msgr2=0x7fa438159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:17.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.795+0000 7fa43e000640 1 --2- 172.21.15.31:0/3464789594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4381595d0 0x7fa438159a80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa4380d1470 tx=0x7fa430010f40 comp rx=0 tx=0).stop 2024-09-17T05:32:17.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.795+0000 7fa43e000640 1 -- 172.21.15.31:0/3464789594 shutdown_connections 2024-09-17T05:32:17.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.795+0000 7fa43e000640 1 --2- 172.21.15.31:0/3464789594 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa414073590 0x7fa414075a50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:17.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.795+0000 7fa43e000640 1 --2- 172.21.15.31:0/3464789594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4381595d0 0x7fa438159a80 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:17.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.795+0000 7fa43e000640 1 --2- 172.21.15.31:0/3464789594 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa438157d10 0x7fa438162850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:17.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.795+0000 7fa43e000640 1 --2- 172.21.15.31:0/3464789594 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa41c004810 0x7fa438072070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:17.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.795+0000 7fa43e000640 1 -- 172.21.15.31:0/3464789594 >> 172.21.15.31:0/3464789594 conn(0x7fa4380d1ea0 msgr2=0x7fa4380d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:17.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.795+0000 7fa43e000640 1 -- 172.21.15.31:0/3464789594 shutdown_connections 2024-09-17T05:32:17.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:17.795+0000 7fa43e000640 1 -- 172.21.15.31:0/3464789594 wait complete. 2024-09-17T05:32:17.817 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:32:17.817 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:32:17.818 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:32:17.818 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:32:17.818 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:32:17.818 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:32:17.818 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:32:17.818 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:32:17.819 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:32:17.819 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:32:17.819 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:32:17.819 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:32:17.819 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:32:17.819 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:32:17.820 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:32:17.820 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:32:17.833 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:32:17.833 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:32:17.834 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:32:17.834 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:32:17.836 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:32:17.836 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:32:17.837 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:32:17.837 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:32:17.877 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:32:17.877 DEBUG:teuthology.parallel:result is None 2024-09-17T05:32:17.879 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:32:17.879 DEBUG:teuthology.parallel:result is None 2024-09-17T05:32:17.880 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:32:17.881 DEBUG:teuthology.parallel:result is None 2024-09-17T05:32:17.882 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:32:17.882 DEBUG:teuthology.parallel:result is None 2024-09-17T05:32:17.883 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:32:17.968 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-17T05:32:17.969 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-17T05:32:17.969 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-17T05:32:17.971 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-17T05:32:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.035+0000 7fe32d800640 1 -- 172.21.15.31:0/690766169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3280b2e80 msgr2=0x7fe3280b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.035+0000 7fe32d800640 1 --2- 172.21.15.31:0/690766169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3280b2e80 0x7fe3280b1bd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe314009840 tx=0x7fe31401c760 comp rx=0 tx=0).stop 2024-09-17T05:32:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.035+0000 7fe32d800640 1 -- 172.21.15.31:0/690766169 shutdown_connections 2024-09-17T05:32:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.035+0000 7fe32d800640 1 --2- 172.21.15.31:0/690766169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3280b2e80 0x7fe3280b1bd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.035+0000 7fe32d800640 1 -- 172.21.15.31:0/690766169 >> 172.21.15.31:0/690766169 conn(0x7fe3280d1e30 msgr2=0x7fe3280d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.035+0000 7fe32d800640 1 -- 172.21.15.31:0/690766169 shutdown_connections 2024-09-17T05:32:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.035+0000 7fe32d800640 1 -- 172.21.15.31:0/690766169 wait complete. 2024-09-17T05:32:18.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.035+0000 7fe32d800640 1 Processor -- start 2024-09-17T05:32:18.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.035+0000 7fe32d800640 1 -- start start 2024-09-17T05:32:18.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe32d800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3280afca0 0x7fe328151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:18.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe32d800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3280b2e80 0x7fe32815e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:18.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe32d800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe32815f490 0x7fe3280b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:18.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe32d800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe3280b2290 con 0x7fe3280afca0 2024-09-17T05:32:18.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe32d800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe3280b2110 con 0x7fe32815f490 2024-09-17T05:32:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe32d800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe32816a4a0 con 0x7fe3280b2e80 2024-09-17T05:32:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe326a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3280afca0 0x7fe328151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe326a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3280afca0 0x7fe328151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41668/0 (socket says 172.21.15.31:41668) 2024-09-17T05:32:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe326a00640 1 -- 172.21.15.31:0/2432284115 learned_addr learned my addr 172.21.15.31:0/2432284115 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe326000640 1 --2- 172.21.15.31:0/2432284115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3280b2e80 0x7fe32815e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe327400640 1 --2- 172.21.15.31:0/2432284115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe32815f490 0x7fe3280b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe326a00640 1 -- 172.21.15.31:0/2432284115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3280b2e80 msgr2=0x7fe32815e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe326a00640 1 --2- 172.21.15.31:0/2432284115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3280b2e80 0x7fe32815e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe326a00640 1 -- 172.21.15.31:0/2432284115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe32815f490 msgr2=0x7fe3280b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe326a00640 1 --2- 172.21.15.31:0/2432284115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe32815f490 0x7fe3280b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe326a00640 1 -- 172.21.15.31:0/2432284115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3280ca0f0 con 0x7fe3280afca0 2024-09-17T05:32:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe326000640 1 --2- 172.21.15.31:0/2432284115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3280b2e80 0x7fe32815e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:32:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe326a00640 1 --2- 172.21.15.31:0/2432284115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3280afca0 0x7fe328151bb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe31800c430 tx=0x7fe31800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe31ea00640 1 -- 172.21.15.31:0/2432284115 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318017070 con 0x7fe3280afca0 2024-09-17T05:32:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe31ea00640 1 -- 172.21.15.31:0/2432284115 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3180053c0 con 0x7fe3280afca0 2024-09-17T05:32:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe31ea00640 1 -- 172.21.15.31:0/2432284115 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318003860 con 0x7fe3280afca0 2024-09-17T05:32:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe32d800640 1 -- 172.21.15.31:0/2432284115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3281fb820 con 0x7fe3280afca0 2024-09-17T05:32:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe32d800640 1 -- 172.21.15.31:0/2432284115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3280ca390 con 0x7fe3280afca0 2024-09-17T05:32:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.039+0000 7fe32d800640 1 -- 172.21.15.31:0/2432284115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3280b00d0 con 0x7fe3280afca0 2024-09-17T05:32:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.043+0000 7fe31ea00640 1 -- 172.21.15.31:0/2432284115 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7fe31801a070 con 0x7fe3280afca0 2024-09-17T05:32:18.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.043+0000 7fe31ea00640 1 --2- 172.21.15.31:0/2432284115 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe308073560 0x7fe308075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:18.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.043+0000 7fe31ea00640 1 -- 172.21.15.31:0/2432284115 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fe318093890 con 0x7fe3280afca0 2024-09-17T05:32:18.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.043+0000 7fe326000640 1 --2- 172.21.15.31:0/2432284115 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe308073560 0x7fe308075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:18.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.043+0000 7fe326000640 1 --2- 172.21.15.31:0/2432284115 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe308073560 0x7fe308075a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe3140af000 tx=0x7fe31401afa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:18.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.047+0000 7fe31ea00640 1 -- 172.21.15.31:0/2432284115 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe31805e090 con 0x7fe3280afca0 2024-09-17T05:32:18.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:18.239+0000 7fe32d800640 1 -- 172.21.15.31:0/2432284115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe328159a90 con 0x7fe3280afca0 2024-09-17T05:32:19.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.143+0000 7fe31ea00640 1 -- 172.21.15.31:0/2432284115 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v65) ==== 97+0+0 (secure 0 0 0) 0x7fe318062ac0 con 0x7fe3280afca0 2024-09-17T05:32:19.143 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2024-09-17T05:32:19.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.143+0000 7fe32d800640 1 -- 172.21.15.31:0/2432284115 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe308073560 msgr2=0x7fe308075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:19.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.143+0000 7fe32d800640 1 --2- 172.21.15.31:0/2432284115 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe308073560 0x7fe308075a20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe3140af000 tx=0x7fe31401afa0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.143+0000 7fe32d800640 1 -- 172.21.15.31:0/2432284115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3280afca0 msgr2=0x7fe328151bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:19.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.143+0000 7fe32d800640 1 --2- 172.21.15.31:0/2432284115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3280afca0 0x7fe328151bb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe31800c430 tx=0x7fe31800c8f0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.143+0000 7fe32d800640 1 -- 172.21.15.31:0/2432284115 shutdown_connections 2024-09-17T05:32:19.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.143+0000 7fe32d800640 1 --2- 172.21.15.31:0/2432284115 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe308073560 0x7fe308075a20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.143+0000 7fe32d800640 1 --2- 172.21.15.31:0/2432284115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe32815f490 0x7fe3280b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.143+0000 7fe32d800640 1 --2- 172.21.15.31:0/2432284115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe3280b2e80 0x7fe32815e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.143+0000 7fe32d800640 1 --2- 172.21.15.31:0/2432284115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe3280afca0 0x7fe328151bb0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.143+0000 7fe32d800640 1 -- 172.21.15.31:0/2432284115 >> 172.21.15.31:0/2432284115 conn(0x7fe3280d1e30 msgr2=0x7fe3280b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:19.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.143+0000 7fe32d800640 1 -- 172.21.15.31:0/2432284115 shutdown_connections 2024-09-17T05:32:19.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.143+0000 7fe32d800640 1 -- 172.21.15.31:0/2432284115 wait complete. 2024-09-17T05:32:19.172 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:32:19.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.323+0000 7f3913600640 1 -- 172.21.15.31:0/4237011720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f390c0b2e80 msgr2=0x7f390c0b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:19.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.323+0000 7f3913600640 1 --2- 172.21.15.31:0/4237011720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f390c0b2e80 0x7f390c0b1bd0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009840 tx=0x7f38f801c760 comp rx=0 tx=0).stop 2024-09-17T05:32:19.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.323+0000 7f3913600640 1 -- 172.21.15.31:0/4237011720 shutdown_connections 2024-09-17T05:32:19.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.323+0000 7f3913600640 1 --2- 172.21.15.31:0/4237011720 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f390c0b2e80 0x7f390c0b1bd0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.323+0000 7f3913600640 1 -- 172.21.15.31:0/4237011720 >> 172.21.15.31:0/4237011720 conn(0x7f390c0d1e30 msgr2=0x7f390c0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:19.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.323+0000 7f3913600640 1 -- 172.21.15.31:0/4237011720 shutdown_connections 2024-09-17T05:32:19.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.323+0000 7f3913600640 1 -- 172.21.15.31:0/4237011720 wait complete. 2024-09-17T05:32:19.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.323+0000 7f3913600640 1 Processor -- start 2024-09-17T05:32:19.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.323+0000 7f3913600640 1 -- start start 2024-09-17T05:32:19.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.323+0000 7f3913600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f390c0afca0 0x7f390c0d0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:19.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.323+0000 7f3913600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390c0b2e80 0x7f390c1fb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:19.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.323+0000 7f3913600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f390c15f490 0x7f390c1fb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:19.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.323+0000 7f3913600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f390c0b2290 con 0x7f390c15f490 2024-09-17T05:32:19.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.323+0000 7f3913600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f390c0b2110 con 0x7f390c0b2e80 2024-09-17T05:32:19.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.323+0000 7f3913600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f390c16a4a0 con 0x7f390c0afca0 2024-09-17T05:32:19.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.323+0000 7f3911600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f390c15f490 0x7f390c1fb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:19.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.323+0000 7f3911600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f390c15f490 0x7f390c1fb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52174/0 (socket says 172.21.15.31:52174) 2024-09-17T05:32:19.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.323+0000 7f3911600640 1 -- 172.21.15.31:0/3222625804 learned_addr learned my addr 172.21.15.31:0/3222625804 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:19.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.327+0000 7f390be00640 1 --2- 172.21.15.31:0/3222625804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390c0b2e80 0x7f390c1fb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:19.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.327+0000 7f3910c00640 1 --2- 172.21.15.31:0/3222625804 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f390c0afca0 0x7f390c0d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:19.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.327+0000 7f3911600640 1 -- 172.21.15.31:0/3222625804 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f390c0afca0 msgr2=0x7f390c0d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:19.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.327+0000 7f3911600640 1 --2- 172.21.15.31:0/3222625804 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f390c0afca0 0x7f390c0d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.327+0000 7f3911600640 1 -- 172.21.15.31:0/3222625804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390c0b2e80 msgr2=0x7f390c1fb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:19.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.327+0000 7f3911600640 1 --2- 172.21.15.31:0/3222625804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390c0b2e80 0x7f390c1fb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.327+0000 7f3911600640 1 -- 172.21.15.31:0/3222625804 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c156b20 con 0x7f390c15f490 2024-09-17T05:32:19.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.327+0000 7f390be00640 1 --2- 172.21.15.31:0/3222625804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390c0b2e80 0x7f390c1fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:19.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.327+0000 7f3911600640 1 --2- 172.21.15.31:0/3222625804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f390c15f490 0x7f390c1fb5f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f390400cbe0 tx=0x7f390400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:19.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.327+0000 7f3908c00640 1 -- 172.21.15.31:0/3222625804 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3904016020 con 0x7f390c15f490 2024-09-17T05:32:19.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.327+0000 7f3908c00640 1 -- 172.21.15.31:0/3222625804 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f390400ab40 con 0x7f390c15f490 2024-09-17T05:32:19.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.327+0000 7f3908c00640 1 -- 172.21.15.31:0/3222625804 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3904012420 con 0x7f390c15f490 2024-09-17T05:32:19.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.327+0000 7f3913600640 1 -- 172.21.15.31:0/3222625804 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390c06de60 con 0x7f390c15f490 2024-09-17T05:32:19.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.327+0000 7f3913600640 1 -- 172.21.15.31:0/3222625804 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f390c06e420 con 0x7f390c15f490 2024-09-17T05:32:19.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.327+0000 7f3913600640 1 -- 172.21.15.31:0/3222625804 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f390c0b00d0 con 0x7f390c15f490 2024-09-17T05:32:19.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.327+0000 7f3908c00640 1 -- 172.21.15.31:0/3222625804 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f3904019020 con 0x7f390c15f490 2024-09-17T05:32:19.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.331+0000 7f3908c00640 1 --2- 172.21.15.31:0/3222625804 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f38ec0734d0 0x7f38ec075990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:19.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.331+0000 7f3908c00640 1 -- 172.21.15.31:0/3222625804 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7f39040943f0 con 0x7f390c15f490 2024-09-17T05:32:19.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.331+0000 7f3910c00640 1 --2- 172.21.15.31:0/3222625804 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f38ec0734d0 0x7f38ec075990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:19.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.331+0000 7f3910c00640 1 --2- 172.21.15.31:0/3222625804 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f38ec0734d0 0x7f38ec075990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3900000c10 tx=0x7f3900009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:19.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.335+0000 7f3908c00640 1 -- 172.21.15.31:0/3222625804 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f3904020030 con 0x7f390c15f490 2024-09-17T05:32:19.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.575+0000 7f3913600640 1 -- 172.21.15.31:0/3222625804 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f390c157e50 con 0x7f390c15f490 2024-09-17T05:32:19.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.575+0000 7f3908c00640 1 -- 172.21.15.31:0/3222625804 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) ==== 80+0+5617 (secure 0 0 0) 0x7f390405f340 con 0x7f390c15f490 2024-09-17T05:32:19.578 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:19.578 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:32:19.578 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2024-09-17T05:32:19.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.578 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2024-09-17T05:32:19.578 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmoloQARAAbTcR/1F1qz7Crjdu1NPSgw==", 2024-09-17T05:32:19.578 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.578 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:32:19.579 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:32:19.579 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:32:19.579 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:19.579 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.579 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2024-09-17T05:32:19.579 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmYrdRDRAAkaDz03U3lMZlkLEVFYlTaw==", 2024-09-17T05:32:19.579 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.579 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:32:19.579 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:32:19.579 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:32:19.580 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:19.580 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.580 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2024-09-17T05:32:19.580 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmpFRCCBAAZRsuAVwSxuMGDeoYCwWFeg==", 2024-09-17T05:32:19.580 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.580 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:32:19.580 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:32:19.580 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:32:19.580 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:19.580 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.581 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2024-09-17T05:32:19.581 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lm23PSFBAAuO+k0kWY28PN7+pEtlUniQ==", 2024-09-17T05:32:19.581 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.581 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:32:19.581 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:32:19.581 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:32:19.581 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:19.581 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.582 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2024-09-17T05:32:19.582 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBTE+lm0miKHxAA2C1pfwBxJtKQhu4xuPumxg==", 2024-09-17T05:32:19.582 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.582 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:32:19.582 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:32:19.582 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:19.582 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.582 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2024-09-17T05:32:19.582 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBWE+lmdQi7NRAA2v4ETg4jynbPF0K4E73KAA==", 2024-09-17T05:32:19.582 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.583 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:32:19.583 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:32:19.583 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:19.583 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.583 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2024-09-17T05:32:19.583 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBaE+lm18eUEBAA8gAhUx9UNa2Lk4uyFBd7Nw==", 2024-09-17T05:32:19.583 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.584 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:32:19.584 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:32:19.584 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:19.584 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.585 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2024-09-17T05:32:19.585 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBdE+lm00moJBAAizrxOP4rI4fGR91dYzlEkw==", 2024-09-17T05:32:19.585 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.585 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:32:19.585 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:32:19.585 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:19.585 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.585 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2024-09-17T05:32:19.585 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBjE+lmhdtUJhAA7+KM8DwQriFwMbpqXAPTuA==", 2024-09-17T05:32:19.585 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.586 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:32:19.586 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:32:19.586 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:19.586 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.586 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2024-09-17T05:32:19.586 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBmE+lm5cByOhAAiMnQIv2O41am/3E+0dp4sg==", 2024-09-17T05:32:19.586 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.586 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:32:19.586 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:32:19.586 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:19.586 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.587 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2024-09-17T05:32:19.587 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBqE+lm19FhExAAo/Sfj2SX5+Y2/Fxz8mbiNQ==", 2024-09-17T05:32:19.587 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.587 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:32:19.587 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:32:19.587 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:19.587 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.587 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2024-09-17T05:32:19.588 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBtE+lmISDbKBAAapUBS+t+N1vUcCbdJic8Dw==", 2024-09-17T05:32:19.588 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.588 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:32:19.588 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:32:19.588 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:19.588 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.588 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2024-09-17T05:32:19.588 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw==", 2024-09-17T05:32:19.588 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.588 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:32:19.588 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2024-09-17T05:32:19.589 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:32:19.589 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.589 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2024-09-17T05:32:19.589 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmb2pmIhAA7p+G+WnB7ujZZdSlaossYg==", 2024-09-17T05:32:19.589 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.589 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:32:19.589 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:32:19.589 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:32:19.589 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:32:19.589 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.590 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2024-09-17T05:32:19.590 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmAPPaHhAAyz/gKunaNFyrdkAUy50qmQ==", 2024-09-17T05:32:19.590 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.590 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:32:19.590 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:32:19.590 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:32:19.590 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:32:19.590 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.590 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2024-09-17T05:32:19.591 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lml72BKBAAgAji5TWedU7azT5oQz3fYg==", 2024-09-17T05:32:19.591 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.591 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:32:19.591 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:32:19.591 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:32:19.591 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:32:19.591 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.591 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2024-09-17T05:32:19.591 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmtgltIRAAeTv/U/vZ9ZIuGN4JXTHD0A==", 2024-09-17T05:32:19.591 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.591 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:32:19.592 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:32:19.592 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:32:19.592 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:19.592 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.592 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.alice", 2024-09-17T05:32:19.592 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBMFOlmLDc2JxAANJIF8t+mZVbqi2S63EIK3g==", 2024-09-17T05:32:19.592 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.592 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow rw path=/volumes/_nogroup/subvol98920", 2024-09-17T05:32:19.592 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2024-09-17T05:32:19.592 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw pool=cephfs_data" 2024-09-17T05:32:19.593 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.593 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2024-09-17T05:32:19.593 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmTt2oOBAAmR5ykU4WbEzlKFiwI7sMdg==", 2024-09-17T05:32:19.593 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.593 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:32:19.593 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:32:19.593 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:19.593 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:19.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:19.593 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2024-09-17T05:32:19.594 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmKILYNBAAojM8RIq92dO2DQyXppReIw==", 2024-09-17T05:32:19.594 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:19.594 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:32:19.594 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:32:19.594 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:19.594 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.594 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:19.594 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:32:19.594 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:32:19.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.579+0000 7f3913600640 1 -- 172.21.15.31:0/3222625804 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f38ec0734d0 msgr2=0x7f38ec075990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:19.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.579+0000 7f3913600640 1 --2- 172.21.15.31:0/3222625804 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f38ec0734d0 0x7f38ec075990 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3900000c10 tx=0x7f3900009040 comp rx=0 tx=0).stop 2024-09-17T05:32:19.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.579+0000 7f3913600640 1 -- 172.21.15.31:0/3222625804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f390c15f490 msgr2=0x7f390c1fb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:19.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.579+0000 7f3913600640 1 --2- 172.21.15.31:0/3222625804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f390c15f490 0x7f390c1fb5f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f390400cbe0 tx=0x7f390400ccd0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.579+0000 7f3913600640 1 -- 172.21.15.31:0/3222625804 shutdown_connections 2024-09-17T05:32:19.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.579+0000 7f3913600640 1 --2- 172.21.15.31:0/3222625804 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f38ec0734d0 0x7f38ec075990 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.579+0000 7f3913600640 1 --2- 172.21.15.31:0/3222625804 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f390c15f490 0x7f390c1fb5f0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.579+0000 7f3913600640 1 --2- 172.21.15.31:0/3222625804 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f390c0b2e80 0x7f390c1fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.579+0000 7f3913600640 1 --2- 172.21.15.31:0/3222625804 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f390c0afca0 0x7f390c0d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.579+0000 7f3913600640 1 -- 172.21.15.31:0/3222625804 >> 172.21.15.31:0/3222625804 conn(0x7f390c0d1e30 msgr2=0x7f390c0d23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:19.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.579+0000 7f3913600640 1 -- 172.21.15.31:0/3222625804 shutdown_connections 2024-09-17T05:32:19.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.579+0000 7f3913600640 1 -- 172.21.15.31:0/3222625804 wait complete. 2024-09-17T05:32:19.600 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.alice 2024-09-17T05:32:19.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a4800640 1 -- 172.21.15.31:0/3917326132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f319c0ced80 msgr2=0x7f319c0ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:19.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a4800640 1 --2- 172.21.15.31:0/3917326132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f319c0ced80 0x7f319c0ae9b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f318c009900 tx=0x7f318c01c8e0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a4800640 1 -- 172.21.15.31:0/3917326132 shutdown_connections 2024-09-17T05:32:19.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a4800640 1 --2- 172.21.15.31:0/3917326132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f319c0cdb30 0x7f319c0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a4800640 1 --2- 172.21.15.31:0/3917326132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f319c0ced80 0x7f319c0ae9b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a4800640 1 -- 172.21.15.31:0/3917326132 >> 172.21.15.31:0/3917326132 conn(0x7f319c0d1dc0 msgr2=0x7f319c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:19.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a4800640 1 -- 172.21.15.31:0/3917326132 shutdown_connections 2024-09-17T05:32:19.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a4800640 1 -- 172.21.15.31:0/3917326132 wait complete. 2024-09-17T05:32:19.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a4800640 1 Processor -- start 2024-09-17T05:32:19.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a4800640 1 -- start start 2024-09-17T05:32:19.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a4800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f319c0cdb30 0x7f319c158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:19.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a4800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f319c0ced80 0x7f319c0b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a4800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f319c15bea0 0x7f319c0b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a4800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f319c169340 con 0x7f319c0ced80 2024-09-17T05:32:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a4800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f319c1691c0 con 0x7f319c15bea0 2024-09-17T05:32:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a4800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f319c1694c0 con 0x7f319c0cdb30 2024-09-17T05:32:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a1400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f319c0ced80 0x7f319c0b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a1400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f319c0ced80 0x7f319c0b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52178/0 (socket says 172.21.15.31:52178) 2024-09-17T05:32:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a1400640 1 -- 172.21.15.31:0/97966919 learned_addr learned my addr 172.21.15.31:0/97966919 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.747+0000 7f31a1e00640 1 --2- 172.21.15.31:0/97966919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f319c0cdb30 0x7f319c158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.751+0000 7f31a2800640 1 --2- 172.21.15.31:0/97966919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f319c15bea0 0x7f319c0b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.751+0000 7f31a1400640 1 -- 172.21.15.31:0/97966919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f319c0cdb30 msgr2=0x7f319c158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.751+0000 7f31a1400640 1 --2- 172.21.15.31:0/97966919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f319c0cdb30 0x7f319c158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.751+0000 7f31a1400640 1 -- 172.21.15.31:0/97966919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f319c15bea0 msgr2=0x7f319c0b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:19.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.751+0000 7f31a1400640 1 --2- 172.21.15.31:0/97966919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f319c15bea0 0x7f319c0b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:19.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.751+0000 7f31a1400640 1 -- 172.21.15.31:0/97966919 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319c0b24c0 con 0x7f319c0ced80 2024-09-17T05:32:19.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.751+0000 7f31a1400640 1 --2- 172.21.15.31:0/97966919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f319c0ced80 0x7f319c0b1f80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f318c009850 tx=0x7f318c0a5670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:19.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.751+0000 7f3196000640 1 -- 172.21.15.31:0/97966919 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c0b2040 con 0x7f319c0ced80 2024-09-17T05:32:19.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.751+0000 7f3196000640 1 -- 172.21.15.31:0/97966919 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f318c004380 con 0x7f319c0ced80 2024-09-17T05:32:19.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.751+0000 7f31a4800640 1 -- 172.21.15.31:0/97966919 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f319c1597f0 con 0x7f319c0ced80 2024-09-17T05:32:19.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.751+0000 7f3196000640 1 -- 172.21.15.31:0/97966919 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c0052d0 con 0x7f319c0ced80 2024-09-17T05:32:19.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.751+0000 7f31a4800640 1 -- 172.21.15.31:0/97966919 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f319c1fb2a0 con 0x7f319c0ced80 2024-09-17T05:32:19.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.751+0000 7f31a4800640 1 -- 172.21.15.31:0/97966919 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f319c0ce670 con 0x7f319c0ced80 2024-09-17T05:32:19.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.751+0000 7f3196000640 1 -- 172.21.15.31:0/97966919 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f318c005470 con 0x7f319c0ced80 2024-09-17T05:32:19.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.755+0000 7f3196000640 1 --2- 172.21.15.31:0/97966919 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3180073560 0x7f3180075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:19.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.755+0000 7f3196000640 1 -- 172.21.15.31:0/97966919 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7f318c12dfa0 con 0x7f319c0ced80 2024-09-17T05:32:19.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.755+0000 7f31a1e00640 1 --2- 172.21.15.31:0/97966919 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3180073560 0x7f3180075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:19.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.755+0000 7f31a1e00640 1 --2- 172.21.15.31:0/97966919 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3180073560 0x7f3180075a20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3190007fd0 tx=0x7f3190009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:19.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:19.759+0000 7f3196000640 1 -- 172.21.15.31:0/97966919 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f319c0b24c0 con 0x7f319c0ced80 2024-09-17T05:32:20.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.007+0000 7f31a4800640 1 -- 172.21.15.31:0/97966919 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.alice"} v 0) -- 0x7f319c0b5850 con 0x7f319c0ced80 2024-09-17T05:32:20.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.007+0000 7f3196000640 1 -- 172.21.15.31:0/97966919 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.alice"}]=0 v20) ==== 82+0+0 (secure 0 0 0) 0x7f318c0164d0 con 0x7f319c0ced80 2024-09-17T05:32:20.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.011+0000 7f31a4800640 1 -- 172.21.15.31:0/97966919 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3180073560 msgr2=0x7f3180075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:20.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.011+0000 7f31a4800640 1 --2- 172.21.15.31:0/97966919 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3180073560 0x7f3180075a20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3190007fd0 tx=0x7f3190009040 comp rx=0 tx=0).stop 2024-09-17T05:32:20.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.011+0000 7f31a4800640 1 -- 172.21.15.31:0/97966919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f319c0ced80 msgr2=0x7f319c0b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:20.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.011+0000 7f31a4800640 1 --2- 172.21.15.31:0/97966919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f319c0ced80 0x7f319c0b1f80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f318c009850 tx=0x7f318c0a5670 comp rx=0 tx=0).stop 2024-09-17T05:32:20.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.011+0000 7f31a4800640 1 -- 172.21.15.31:0/97966919 shutdown_connections 2024-09-17T05:32:20.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.011+0000 7f31a4800640 1 --2- 172.21.15.31:0/97966919 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3180073560 0x7f3180075a20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:20.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.011+0000 7f31a4800640 1 --2- 172.21.15.31:0/97966919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f319c15bea0 0x7f319c0b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:20.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.011+0000 7f31a4800640 1 --2- 172.21.15.31:0/97966919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f319c0ced80 0x7f319c0b1f80 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:20.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.011+0000 7f31a4800640 1 --2- 172.21.15.31:0/97966919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f319c0cdb30 0x7f319c158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:20.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.011+0000 7f31a4800640 1 -- 172.21.15.31:0/97966919 >> 172.21.15.31:0/97966919 conn(0x7f319c0d1dc0 msgr2=0x7f319c0d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:20.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.011+0000 7f31a4800640 1 -- 172.21.15.31:0/97966919 shutdown_connections 2024-09-17T05:32:20.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.011+0000 7f31a4800640 1 -- 172.21.15.31:0/97966919 wait complete. 2024-09-17T05:32:20.033 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:32:20.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.179+0000 7f2d90000640 1 -- 172.21.15.31:0/1984103814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d8806cc20 msgr2=0x7f2d880737c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:20.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.179+0000 7f2d90000640 1 --2- 172.21.15.31:0/1984103814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d8806cc20 0x7f2d880737c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c009870 tx=0x7f2d7c01c7f0 comp rx=0 tx=0).stop 2024-09-17T05:32:20.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.179+0000 7f2d90000640 1 -- 172.21.15.31:0/1984103814 shutdown_connections 2024-09-17T05:32:20.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.179+0000 7f2d90000640 1 --2- 172.21.15.31:0/1984103814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d8806cc20 0x7f2d880737c0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:20.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.179+0000 7f2d90000640 1 -- 172.21.15.31:0/1984103814 >> 172.21.15.31:0/1984103814 conn(0x7f2d880d0c90 msgr2=0x7f2d880d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:20.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.179+0000 7f2d90000640 1 -- 172.21.15.31:0/1984103814 shutdown_connections 2024-09-17T05:32:20.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.179+0000 7f2d90000640 1 -- 172.21.15.31:0/1984103814 wait complete. 2024-09-17T05:32:20.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.179+0000 7f2d90000640 1 Processor -- start 2024-09-17T05:32:20.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.179+0000 7f2d90000640 1 -- start start 2024-09-17T05:32:20.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d90000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d8806cc20 0x7f2d88153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:20.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d90000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d88071030 0x7f2d8809ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:20.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d90000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d8815c1c0 0x7f2d880c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:20.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d90000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8816a900 con 0x7f2d88071030 2024-09-17T05:32:20.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d90000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8816a780 con 0x7f2d8806cc20 2024-09-17T05:32:20.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d90000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2d8816aa80 con 0x7f2d8815c1c0 2024-09-17T05:32:20.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d8cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d88071030 0x7f2d8809ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:20.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d8cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d88071030 0x7f2d8809ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52204/0 (socket says 172.21.15.31:52204) 2024-09-17T05:32:20.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d8cc00640 1 -- 172.21.15.31:0/814000063 learned_addr learned my addr 172.21.15.31:0/814000063 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:20.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d8d600640 1 --2- 172.21.15.31:0/814000063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d8806cc20 0x7f2d88153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:20.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d8e000640 1 --2- 172.21.15.31:0/814000063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d8815c1c0 0x7f2d880c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:20.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d8cc00640 1 -- 172.21.15.31:0/814000063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d8815c1c0 msgr2=0x7f2d880c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:20.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d8cc00640 1 --2- 172.21.15.31:0/814000063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d8815c1c0 0x7f2d880c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:20.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d8cc00640 1 -- 172.21.15.31:0/814000063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d8806cc20 msgr2=0x7f2d88153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:20.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d8cc00640 1 --2- 172.21.15.31:0/814000063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d8806cc20 0x7f2d88153e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:20.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d8cc00640 1 -- 172.21.15.31:0/814000063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d880cecf0 con 0x7f2d88071030 2024-09-17T05:32:20.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d8e000640 1 --2- 172.21.15.31:0/814000063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d8815c1c0 0x7f2d880c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:20.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d8cc00640 1 --2- 172.21.15.31:0/814000063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d88071030 0x7f2d8809ee20 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400c450 tx=0x7f2d7400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:20.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d85600640 1 -- 172.21.15.31:0/814000063 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d740052d0 con 0x7f2d88071030 2024-09-17T05:32:20.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d85600640 1 -- 172.21.15.31:0/814000063 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d74005470 con 0x7f2d88071030 2024-09-17T05:32:20.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d90000640 1 -- 172.21.15.31:0/814000063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d880cefd0 con 0x7f2d88071030 2024-09-17T05:32:20.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d85600640 1 -- 172.21.15.31:0/814000063 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d74012870 con 0x7f2d88071030 2024-09-17T05:32:20.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d90000640 1 -- 172.21.15.31:0/814000063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d880cf590 con 0x7f2d88071030 2024-09-17T05:32:20.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d90000640 1 -- 172.21.15.31:0/814000063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d880737c0 con 0x7f2d88071030 2024-09-17T05:32:20.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.183+0000 7f2d85600640 1 -- 172.21.15.31:0/814000063 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f2d74003600 con 0x7f2d88071030 2024-09-17T05:32:20.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.187+0000 7f2d85600640 1 --2- 172.21.15.31:0/814000063 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2d68073560 0x7f2d68075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:20.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.187+0000 7f2d85600640 1 -- 172.21.15.31:0/814000063 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7f2d74094090 con 0x7f2d88071030 2024-09-17T05:32:20.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.187+0000 7f2d8d600640 1 --2- 172.21.15.31:0/814000063 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2d68073560 0x7f2d68075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:20.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.187+0000 7f2d8d600640 1 --2- 172.21.15.31:0/814000063 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2d68073560 0x7f2d68075a20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0af000 tx=0x7f2d7c01b030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:20.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.191+0000 7f2d85600640 1 -- 172.21.15.31:0/814000063 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2d7405ee30 con 0x7f2d88071030 2024-09-17T05:32:20.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.371+0000 7f2d90000640 1 -- 172.21.15.31:0/814000063 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2d880b6c10 con 0x7f2d88071030 2024-09-17T05:32:20.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.371+0000 7f2d85600640 1 -- 172.21.15.31:0/814000063 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v65) ==== 84+0+65 (secure 0 0 0) 0x7f2d7405e730 con 0x7f2d88071030 2024-09-17T05:32:20.374 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:20.375 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:32:20.375 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:20.375 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-09-17T05:32:20.375 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-09-17T05:32:20.375 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:20.375 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:32:20.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.375+0000 7f2d90000640 1 -- 172.21.15.31:0/814000063 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2d68073560 msgr2=0x7f2d68075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:20.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.375+0000 7f2d90000640 1 --2- 172.21.15.31:0/814000063 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2d68073560 0x7f2d68075a20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0af000 tx=0x7f2d7c01b030 comp rx=0 tx=0).stop 2024-09-17T05:32:20.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.375+0000 7f2d90000640 1 -- 172.21.15.31:0/814000063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d88071030 msgr2=0x7f2d8809ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:20.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.375+0000 7f2d90000640 1 --2- 172.21.15.31:0/814000063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d88071030 0x7f2d8809ee20 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400c450 tx=0x7f2d7400c910 comp rx=0 tx=0).stop 2024-09-17T05:32:20.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.375+0000 7f2d90000640 1 -- 172.21.15.31:0/814000063 shutdown_connections 2024-09-17T05:32:20.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.375+0000 7f2d90000640 1 --2- 172.21.15.31:0/814000063 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f2d68073560 0x7f2d68075a20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:20.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.375+0000 7f2d90000640 1 --2- 172.21.15.31:0/814000063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d8815c1c0 0x7f2d880c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:20.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.375+0000 7f2d90000640 1 --2- 172.21.15.31:0/814000063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d88071030 0x7f2d8809ee20 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:20.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.375+0000 7f2d90000640 1 --2- 172.21.15.31:0/814000063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d8806cc20 0x7f2d88153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:20.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.375+0000 7f2d90000640 1 -- 172.21.15.31:0/814000063 >> 172.21.15.31:0/814000063 conn(0x7f2d880d0c90 msgr2=0x7f2d880c04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:20.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.375+0000 7f2d90000640 1 -- 172.21.15.31:0/814000063 shutdown_connections 2024-09-17T05:32:20.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.375+0000 7f2d90000640 1 -- 172.21.15.31:0/814000063 wait complete. 2024-09-17T05:32:20.396 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:32:20.396 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:32:20.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.543+0000 7fb0f2000640 1 -- 172.21.15.31:0/1813693691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0ec15e360 msgr2=0x7fb0ec0adf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:20.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.543+0000 7fb0f2000640 1 --2- 172.21.15.31:0/1813693691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0ec15e360 0x7fb0ec0adf50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0708c0 tx=0x7fb0dc01c830 comp rx=0 tx=0).stop 2024-09-17T05:32:20.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.543+0000 7fb0f2000640 1 -- 172.21.15.31:0/1813693691 shutdown_connections 2024-09-17T05:32:20.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.543+0000 7fb0f2000640 1 --2- 172.21.15.31:0/1813693691 >> v2:172.21.15.155:3300/0 conn(0x7fb0ec15e740 0x7fb0ec15ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:20.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.543+0000 7fb0f2000640 1 --2- 172.21.15.31:0/1813693691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0ec15e360 0x7fb0ec0adf50 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:20.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.543+0000 7fb0f2000640 1 -- 172.21.15.31:0/1813693691 >> 172.21.15.31:0/1813693691 conn(0x7fb0ec0cfbc0 msgr2=0x7fb0ec0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:20.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0f2000640 1 -- 172.21.15.31:0/1813693691 shutdown_connections 2024-09-17T05:32:20.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0f2000640 1 -- 172.21.15.31:0/1813693691 wait complete. 2024-09-17T05:32:20.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0f2000640 1 Processor -- start 2024-09-17T05:32:20.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0f2000640 1 -- start start 2024-09-17T05:32:20.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0f2000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0ec0aef60 0x7fb0ec1546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:20.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0f2000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0ec15e360 0x7fb0ec14b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:20.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0f2000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0ec15e740 0x7fb0ec152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:20.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0f2000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec1680b0 con 0x7fb0ec15e740 2024-09-17T05:32:20.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0f2000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ec167f30 con 0x7fb0ec15e360 2024-09-17T05:32:20.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0f2000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb0ec168230 con 0x7fb0ec0aef60 2024-09-17T05:32:20.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0ebe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0ec15e740 0x7fb0ec152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:20.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0ebe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0ec15e740 0x7fb0ec152d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52234/0 (socket says 172.21.15.31:52234) 2024-09-17T05:32:20.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0ebe00640 1 -- 172.21.15.31:0/3187591745 learned_addr learned my addr 172.21.15.31:0/3187591745 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:20.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0e3e00640 1 --2- 172.21.15.31:0/3187591745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0ec15e360 0x7fb0ec14b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:20.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0eb400640 1 --2- 172.21.15.31:0/3187591745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0ec0aef60 0x7fb0ec1546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:20.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0ebe00640 1 -- 172.21.15.31:0/3187591745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0ec0aef60 msgr2=0x7fb0ec1546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:20.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0ebe00640 1 --2- 172.21.15.31:0/3187591745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0ec0aef60 0x7fb0ec1546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:20.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0ebe00640 1 -- 172.21.15.31:0/3187591745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0ec15e360 msgr2=0x7fb0ec14b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:20.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0ebe00640 1 --2- 172.21.15.31:0/3187591745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0ec15e360 0x7fb0ec14b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:20.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0ebe00640 1 -- 172.21.15.31:0/3187591745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ec153240 con 0x7fb0ec15e740 2024-09-17T05:32:20.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0e3e00640 1 --2- 172.21.15.31:0/3187591745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0ec15e360 0x7fb0ec14b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:20.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0ebe00640 1 --2- 172.21.15.31:0/3187591745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0ec15e740 0x7fb0ec152d00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400b9a0 tx=0x7fb0e400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:20.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.547+0000 7fb0e3400640 1 -- 172.21.15.31:0/3187591745 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4019070 con 0x7fb0ec15e740 2024-09-17T05:32:20.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.551+0000 7fb0e3400640 1 -- 172.21.15.31:0/3187591745 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0e400ccb0 con 0x7fb0ec15e740 2024-09-17T05:32:20.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.551+0000 7fb0e3400640 1 -- 172.21.15.31:0/3187591745 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40146a0 con 0x7fb0ec15e740 2024-09-17T05:32:20.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.551+0000 7fb0f2000640 1 -- 172.21.15.31:0/3187591745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0ec14a380 con 0x7fb0ec15e740 2024-09-17T05:32:20.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.551+0000 7fb0f2000640 1 -- 172.21.15.31:0/3187591745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0ec14a940 con 0x7fb0ec15e740 2024-09-17T05:32:20.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.551+0000 7fb0f2000640 1 -- 172.21.15.31:0/3187591745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0ec069410 con 0x7fb0ec15e740 2024-09-17T05:32:20.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.551+0000 7fb0e3400640 1 -- 172.21.15.31:0/3187591745 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7fb0e401c070 con 0x7fb0ec15e740 2024-09-17T05:32:20.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.551+0000 7fb0e3400640 1 --2- 172.21.15.31:0/3187591745 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb0c8073590 0x7fb0c8075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:20.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.551+0000 7fb0e3400640 1 -- 172.21.15.31:0/3187591745 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7fb0e4094150 con 0x7fb0ec15e740 2024-09-17T05:32:20.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.551+0000 7fb0eb400640 1 --2- 172.21.15.31:0/3187591745 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb0c8073590 0x7fb0c8075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:20.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.555+0000 7fb0eb400640 1 --2- 172.21.15.31:0/3187591745 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb0c8073590 0x7fb0c8075a50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0af000 tx=0x7fb0dc01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:20.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.555+0000 7fb0e3400640 1 -- 172.21.15.31:0/3187591745 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb0e405e9a0 con 0x7fb0ec15e740 2024-09-17T05:32:20.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:20.735+0000 7fb0f2000640 1 -- 172.21.15.31:0/3187591745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb0ec0d0850 con 0x7fb0ec15e740 2024-09-17T05:32:21.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.411+0000 7fb0e3400640 1 -- 172.21.15.31:0/3187591745 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v66) ==== 138+0+0 (secure 0 0 0) 0x7fb0e40633d0 con 0x7fb0ec15e740 2024-09-17T05:32:21.415 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-09-17T05:32:21.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.415+0000 7fb0f2000640 1 -- 172.21.15.31:0/3187591745 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb0c8073590 msgr2=0x7fb0c8075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:21.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.415+0000 7fb0f2000640 1 --2- 172.21.15.31:0/3187591745 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb0c8073590 0x7fb0c8075a50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0af000 tx=0x7fb0dc01b070 comp rx=0 tx=0).stop 2024-09-17T05:32:21.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.415+0000 7fb0f2000640 1 -- 172.21.15.31:0/3187591745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0ec15e740 msgr2=0x7fb0ec152d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:21.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.415+0000 7fb0f2000640 1 --2- 172.21.15.31:0/3187591745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0ec15e740 0x7fb0ec152d00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400b9a0 tx=0x7fb0e400be60 comp rx=0 tx=0).stop 2024-09-17T05:32:21.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.415+0000 7fb0f2000640 1 -- 172.21.15.31:0/3187591745 shutdown_connections 2024-09-17T05:32:21.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.415+0000 7fb0f2000640 1 --2- 172.21.15.31:0/3187591745 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb0c8073590 0x7fb0c8075a50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:21.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.415+0000 7fb0f2000640 1 --2- 172.21.15.31:0/3187591745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0ec15e740 0x7fb0ec152d00 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:21.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.415+0000 7fb0f2000640 1 --2- 172.21.15.31:0/3187591745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0ec15e360 0x7fb0ec14b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:21.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.415+0000 7fb0f2000640 1 --2- 172.21.15.31:0/3187591745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0ec0aef60 0x7fb0ec1546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:21.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.415+0000 7fb0f2000640 1 -- 172.21.15.31:0/3187591745 >> 172.21.15.31:0/3187591745 conn(0x7fb0ec0cfbc0 msgr2=0x7fb0ec159800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:21.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.415+0000 7fb0f2000640 1 -- 172.21.15.31:0/3187591745 shutdown_connections 2024-09-17T05:32:21.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.415+0000 7fb0f2000640 1 -- 172.21.15.31:0/3187591745 wait complete. 2024-09-17T05:32:21.448 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:32:21.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.607+0000 7f95e4600640 1 -- 172.21.15.31:0/1514486690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95dc1605d0 msgr2=0x7f95dc0d0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:21.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.607+0000 7f95e4600640 1 --2- 172.21.15.31:0/1514486690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95dc1605d0 0x7f95dc0d0690 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f95d0009840 tx=0x7f95d001c820 comp rx=0 tx=0).stop 2024-09-17T05:32:21.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.607+0000 7f95e4600640 1 -- 172.21.15.31:0/1514486690 shutdown_connections 2024-09-17T05:32:21.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.607+0000 7f95e4600640 1 --2- 172.21.15.31:0/1514486690 >> v2:172.21.15.155:3300/0 conn(0x7f95dc0afb10 0x7f95dc0affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:21.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.607+0000 7f95e4600640 1 --2- 172.21.15.31:0/1514486690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95dc1605d0 0x7f95dc0d0690 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:21.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.607+0000 7f95e4600640 1 -- 172.21.15.31:0/1514486690 >> 172.21.15.31:0/1514486690 conn(0x7f95dc0d1dd0 msgr2=0x7f95dc0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:21.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.607+0000 7f95e4600640 1 -- 172.21.15.31:0/1514486690 shutdown_connections 2024-09-17T05:32:21.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.607+0000 7f95e4600640 1 -- 172.21.15.31:0/1514486690 wait complete. 2024-09-17T05:32:21.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.607+0000 7f95e4600640 1 Processor -- start 2024-09-17T05:32:21.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.607+0000 7f95e4600640 1 -- start start 2024-09-17T05:32:21.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.607+0000 7f95e4600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95dc0afb10 0x7f95dc071350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:21.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.607+0000 7f95e4600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95dc0b1650 0x7f95dc0b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:21.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.607+0000 7f95e4600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95dc1605d0 0x7f95dc148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:21.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.607+0000 7f95e4600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc0b0e60 con 0x7f95dc0b1650 2024-09-17T05:32:21.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.607+0000 7f95e4600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc0b1430 con 0x7f95dc1605d0 2024-09-17T05:32:21.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.607+0000 7f95e4600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f95dc169540 con 0x7f95dc0afb10 2024-09-17T05:32:21.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95e1200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95dc0b1650 0x7f95dc0b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:21.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95e1c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95dc0afb10 0x7f95dc071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:21.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95e1200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95dc0b1650 0x7f95dc0b5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52242/0 (socket says 172.21.15.31:52242) 2024-09-17T05:32:21.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95e1200640 1 -- 172.21.15.31:0/3719864541 learned_addr learned my addr 172.21.15.31:0/3719864541 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:21.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95e2600640 1 --2- 172.21.15.31:0/3719864541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95dc1605d0 0x7f95dc148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:21.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95e1200640 1 -- 172.21.15.31:0/3719864541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95dc0afb10 msgr2=0x7f95dc071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:21.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95e1200640 1 --2- 172.21.15.31:0/3719864541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95dc0afb10 0x7f95dc071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:21.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95e1200640 1 -- 172.21.15.31:0/3719864541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95dc1605d0 msgr2=0x7f95dc148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:21.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95e1200640 1 --2- 172.21.15.31:0/3719864541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95dc1605d0 0x7f95dc148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:21.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95e1200640 1 -- 172.21.15.31:0/3719864541 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95dc0c63c0 con 0x7f95dc0b1650 2024-09-17T05:32:21.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95e1c00640 1 --2- 172.21.15.31:0/3719864541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95dc0afb10 0x7f95dc071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:32:21.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95e1200640 1 --2- 172.21.15.31:0/3719864541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95dc0b1650 0x7f95dc0b5630 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f95c800c450 tx=0x7f95c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:21.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95d9600640 1 -- 172.21.15.31:0/3719864541 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c8016020 con 0x7f95dc0b1650 2024-09-17T05:32:21.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95d9600640 1 -- 172.21.15.31:0/3719864541 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95c8012920 con 0x7f95dc0b1650 2024-09-17T05:32:21.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95e4600640 1 -- 172.21.15.31:0/3719864541 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95dc0b5b70 con 0x7f95dc0b1650 2024-09-17T05:32:21.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95d9600640 1 -- 172.21.15.31:0/3719864541 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c8012d70 con 0x7f95dc0b1650 2024-09-17T05:32:21.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95e4600640 1 -- 172.21.15.31:0/3719864541 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95dc0c6940 con 0x7f95dc0b1650 2024-09-17T05:32:21.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95e4600640 1 -- 172.21.15.31:0/3719864541 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95dc0affc0 con 0x7f95dc0b1650 2024-09-17T05:32:21.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.611+0000 7f95d9600640 1 -- 172.21.15.31:0/3719864541 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f95c8019020 con 0x7f95dc0b1650 2024-09-17T05:32:21.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.615+0000 7f95d9600640 1 --2- 172.21.15.31:0/3719864541 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f95bc073560 0x7f95bc075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:21.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.615+0000 7f95d9600640 1 -- 172.21.15.31:0/3719864541 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5227+0+0 (secure 0 0 0) 0x7f95c80947d0 con 0x7f95dc0b1650 2024-09-17T05:32:21.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.615+0000 7f95e1c00640 1 --2- 172.21.15.31:0/3719864541 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f95bc073560 0x7f95bc075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:21.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.615+0000 7f95e1c00640 1 --2- 172.21.15.31:0/3719864541 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f95bc073560 0x7f95bc075a20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f95d00af000 tx=0x7f95d001b060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:21.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.619+0000 7f95d9600640 1 -- 172.21.15.31:0/3719864541 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f95c8020030 con 0x7f95dc0b1650 2024-09-17T05:32:21.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:21.791+0000 7f95e4600640 1 -- 172.21.15.31:0/3719864541 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f95dc0b2500 con 0x7f95dc0b1650 2024-09-17T05:32:22.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.415+0000 7f95d9600640 1 -- 172.21.15.31:0/3719864541 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v67) ==== 170+0+0 (secure 0 0 0) 0x7f95c805eeb0 con 0x7f95dc0b1650 2024-09-17T05:32:22.417 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-09-17T05:32:22.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.419+0000 7f95e4600640 1 -- 172.21.15.31:0/3719864541 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f95bc073560 msgr2=0x7f95bc075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:22.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.419+0000 7f95e4600640 1 --2- 172.21.15.31:0/3719864541 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f95bc073560 0x7f95bc075a20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f95d00af000 tx=0x7f95d001b060 comp rx=0 tx=0).stop 2024-09-17T05:32:22.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.419+0000 7f95e4600640 1 -- 172.21.15.31:0/3719864541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95dc0b1650 msgr2=0x7f95dc0b5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:22.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.419+0000 7f95e4600640 1 --2- 172.21.15.31:0/3719864541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95dc0b1650 0x7f95dc0b5630 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f95c800c450 tx=0x7f95c800c910 comp rx=0 tx=0).stop 2024-09-17T05:32:22.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.419+0000 7f95e4600640 1 -- 172.21.15.31:0/3719864541 shutdown_connections 2024-09-17T05:32:22.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.419+0000 7f95e4600640 1 --2- 172.21.15.31:0/3719864541 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f95bc073560 0x7f95bc075a20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:22.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.419+0000 7f95e4600640 1 --2- 172.21.15.31:0/3719864541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95dc1605d0 0x7f95dc148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:22.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.419+0000 7f95e4600640 1 --2- 172.21.15.31:0/3719864541 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95dc0b1650 0x7f95dc0b5630 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:22.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.419+0000 7f95e4600640 1 --2- 172.21.15.31:0/3719864541 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95dc0afb10 0x7f95dc071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:22.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.419+0000 7f95e4600640 1 -- 172.21.15.31:0/3719864541 >> 172.21.15.31:0/3719864541 conn(0x7f95dc0d1dd0 msgr2=0x7f95dc15bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:22.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.419+0000 7f95e4600640 1 -- 172.21.15.31:0/3719864541 shutdown_connections 2024-09-17T05:32:22.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.419+0000 7f95e4600640 1 -- 172.21.15.31:0/3719864541 wait complete. 2024-09-17T05:32:22.454 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:32:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.607+0000 7f0eaf200640 1 -- 172.21.15.31:0/1026749283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e94003a90 msgr2=0x7f0e94003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.607+0000 7f0eaf200640 1 --2- 172.21.15.31:0/1026749283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e94003a90 0x7f0e94003eb0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0001690 tx=0x7f0ea001c770 comp rx=0 tx=0).stop 2024-09-17T05:32:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.607+0000 7f0eae800640 1 -- 172.21.15.31:0/1026749283 reap_dead start 2024-09-17T05:32:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.607+0000 7f0eaf200640 1 -- 172.21.15.31:0/1026749283 shutdown_connections 2024-09-17T05:32:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.607+0000 7f0eaf200640 1 -- 172.21.15.31:0/1026749283 >> 172.21.15.31:0/1026749283 conn(0x7f0eb009d0c0 msgr2=0x7f0eb00d3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.607+0000 7f0eaf200640 1 -- 172.21.15.31:0/1026749283 shutdown_connections 2024-09-17T05:32:22.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.607+0000 7f0eaf200640 1 -- 172.21.15.31:0/1026749283 wait complete. 2024-09-17T05:32:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.607+0000 7f0eaf200640 1 Processor -- start 2024-09-17T05:32:22.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.607+0000 7f0eaf200640 1 -- start start 2024-09-17T05:32:22.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eaf200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e94003a90 0x7f0eb0156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:22.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eaf200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb00c7c60 0x7f0eb00c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:22.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eaf200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0eb006db10 0x7f0eb006df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:22.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eaf200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb00d1660 con 0x7f0eb006db10 2024-09-17T05:32:22.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eaf200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb00d14e0 con 0x7f0e94003a90 2024-09-17T05:32:22.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eaf200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb00d17e0 con 0x7f0eb00c7c60 2024-09-17T05:32:22.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eae800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0eb006db10 0x7f0eb006df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:22.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eae800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0eb006db10 0x7f0eb006df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52258/0 (socket says 172.21.15.31:52258) 2024-09-17T05:32:22.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eae800640 1 -- 172.21.15.31:0/608862535 learned_addr learned my addr 172.21.15.31:0/608862535 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:22.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0ea7e00640 1 --2- 172.21.15.31:0/608862535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb00c7c60 0x7f0eb00c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:22.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eade00640 1 --2- 172.21.15.31:0/608862535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e94003a90 0x7f0eb0156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:22.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eae800640 1 -- 172.21.15.31:0/608862535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb00c7c60 msgr2=0x7f0eb00c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:22.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eae800640 1 --2- 172.21.15.31:0/608862535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb00c7c60 0x7f0eb00c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:22.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eae800640 1 -- 172.21.15.31:0/608862535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e94003a90 msgr2=0x7f0eb0156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:22.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eae800640 1 --2- 172.21.15.31:0/608862535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e94003a90 0x7f0eb0156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:22.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eae800640 1 -- 172.21.15.31:0/608862535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb01faed0 con 0x7f0eb006db10 2024-09-17T05:32:22.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eae800640 1 --2- 172.21.15.31:0/608862535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0eb006db10 0x7f0eb006df90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009fd0 tx=0x7f0ea8010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:22.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0ea6000640 1 -- 172.21.15.31:0/608862535 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea800ee20 con 0x7f0eb006db10 2024-09-17T05:32:22.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0ea6000640 1 -- 172.21.15.31:0/608862535 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ea8015070 con 0x7f0eb006db10 2024-09-17T05:32:22.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0ea6000640 1 -- 172.21.15.31:0/608862535 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8003d10 con 0x7f0eb006db10 2024-09-17T05:32:22.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eaf200640 1 -- 172.21.15.31:0/608862535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb01fb170 con 0x7f0eb006db10 2024-09-17T05:32:22.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eaf200640 1 -- 172.21.15.31:0/608862535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb01fb730 con 0x7f0eb006db10 2024-09-17T05:32:22.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.611+0000 7f0eaf200640 1 -- 172.21.15.31:0/608862535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eb00d2240 con 0x7f0eb006db10 2024-09-17T05:32:22.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.615+0000 7f0ea6000640 1 -- 172.21.15.31:0/608862535 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f0ea8017020 con 0x7f0eb006db10 2024-09-17T05:32:22.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.615+0000 7f0ea6000640 1 --2- 172.21.15.31:0/608862535 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0e8c073560 0x7f0e8c075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:22.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.615+0000 7f0ea6000640 1 -- 172.21.15.31:0/608862535 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5609+0+0 (secure 0 0 0) 0x7f0ea8094af0 con 0x7f0eb006db10 2024-09-17T05:32:22.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.615+0000 7f0eade00640 1 --2- 172.21.15.31:0/608862535 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0e8c073560 0x7f0e8c075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:22.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.615+0000 7f0eade00640 1 --2- 172.21.15.31:0/608862535 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0e8c073560 0x7f0e8c075a20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0001660 tx=0x7f0ea0019510 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:22.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.619+0000 7f0ea6000640 1 -- 172.21.15.31:0/608862535 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0ea8020030 con 0x7f0eb006db10 2024-09-17T05:32:22.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:22.831+0000 7f0eaf200640 1 -- 172.21.15.31:0/608862535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0eb008d540 con 0x7f0eb006db10 2024-09-17T05:32:23.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.451+0000 7f0ea6000640 1 -- 172.21.15.31:0/608862535 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v43) ==== 174+0+0 (secure 0 0 0) 0x7f0ea805f0d0 con 0x7f0eb006db10 2024-09-17T05:32:23.462 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 10 and data pool 11 2024-09-17T05:32:23.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.467+0000 7f0eaf200640 1 -- 172.21.15.31:0/608862535 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0e8c073560 msgr2=0x7f0e8c075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:23.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.467+0000 7f0eaf200640 1 --2- 172.21.15.31:0/608862535 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0e8c073560 0x7f0e8c075a20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0001660 tx=0x7f0ea0019510 comp rx=0 tx=0).stop 2024-09-17T05:32:23.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.467+0000 7f0eaf200640 1 -- 172.21.15.31:0/608862535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0eb006db10 msgr2=0x7f0eb006df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:23.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.467+0000 7f0eaf200640 1 --2- 172.21.15.31:0/608862535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0eb006db10 0x7f0eb006df90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009fd0 tx=0x7f0ea8010f40 comp rx=0 tx=0).stop 2024-09-17T05:32:23.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.467+0000 7f0eaf200640 1 -- 172.21.15.31:0/608862535 shutdown_connections 2024-09-17T05:32:23.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.467+0000 7f0eaf200640 1 --2- 172.21.15.31:0/608862535 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0e8c073560 0x7f0e8c075a20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:23.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.467+0000 7f0eaf200640 1 --2- 172.21.15.31:0/608862535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0eb006db10 0x7f0eb006df90 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:23.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.467+0000 7f0eaf200640 1 --2- 172.21.15.31:0/608862535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0eb00c7c60 0x7f0eb00c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:23.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.467+0000 7f0eaf200640 1 --2- 172.21.15.31:0/608862535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e94003a90 0x7f0eb0156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:23.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.467+0000 7f0eaf200640 1 -- 172.21.15.31:0/608862535 >> 172.21.15.31:0/608862535 conn(0x7f0eb009d0c0 msgr2=0x7f0eb00b5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:23.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.467+0000 7f0eaf200640 1 -- 172.21.15.31:0/608862535 shutdown_connections 2024-09-17T05:32:23.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.467+0000 7f0eaf200640 1 -- 172.21.15.31:0/608862535 wait complete. 2024-09-17T05:32:23.497 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:32:23.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.643+0000 7fb459e00640 1 -- 172.21.15.31:0/2444846751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb438004da0 msgr2=0x7fb438005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:23.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.643+0000 7fb459e00640 1 --2- 172.21.15.31:0/2444846751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb438004da0 0x7fb438005220 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb44c001ef0 tx=0x7fb44c01cc30 comp rx=0 tx=0).stop 2024-09-17T05:32:23.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.643+0000 7fb453400640 1 -- 172.21.15.31:0/2444846751 reap_dead start 2024-09-17T05:32:23.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.643+0000 7fb459e00640 1 -- 172.21.15.31:0/2444846751 shutdown_connections 2024-09-17T05:32:23.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.643+0000 7fb459e00640 1 -- 172.21.15.31:0/2444846751 >> 172.21.15.31:0/2444846751 conn(0x7fb4540d1d90 msgr2=0x7fb4540d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:23.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.643+0000 7fb459e00640 1 -- 172.21.15.31:0/2444846751 shutdown_connections 2024-09-17T05:32:23.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.643+0000 7fb459e00640 1 -- 172.21.15.31:0/2444846751 wait complete. 2024-09-17T05:32:23.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb459e00640 1 Processor -- start 2024-09-17T05:32:23.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb459e00640 1 -- start start 2024-09-17T05:32:23.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb459e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb438004da0 0x7fb45415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:23.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb459e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb454154040 0x7fb454156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:23.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb459e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb454071a20 0x7fb454071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:23.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb459e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb454160540 con 0x7fb438004da0 2024-09-17T05:32:23.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb459e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb4541603c0 con 0x7fb454071a20 2024-09-17T05:32:23.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb459e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb4541606c0 con 0x7fb454154040 2024-09-17T05:32:23.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb452a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb438004da0 0x7fb45415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:23.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb452a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb438004da0 0x7fb45415aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52272/0 (socket says 172.21.15.31:52272) 2024-09-17T05:32:23.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb452a00640 1 -- 172.21.15.31:0/3640364102 learned_addr learned my addr 172.21.15.31:0/3640364102 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:23.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb453400640 1 --2- 172.21.15.31:0/3640364102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb454071a20 0x7fb454071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:23.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb44a000640 1 --2- 172.21.15.31:0/3640364102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb454154040 0x7fb454156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:23.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb452a00640 1 -- 172.21.15.31:0/3640364102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb454154040 msgr2=0x7fb454156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:23.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb452a00640 1 --2- 172.21.15.31:0/3640364102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb454154040 0x7fb454156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:23.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb452a00640 1 -- 172.21.15.31:0/3640364102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb454071a20 msgr2=0x7fb454071ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:23.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb452a00640 1 --2- 172.21.15.31:0/3640364102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb454071a20 0x7fb454071ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:23.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb452a00640 1 -- 172.21.15.31:0/3640364102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4540c7740 con 0x7fb438004da0 2024-09-17T05:32:23.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb452a00640 1 --2- 172.21.15.31:0/3640364102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb438004da0 0x7fb45415aca0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb4440126a0 tx=0x7fb444012aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:23.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb44be00640 1 -- 172.21.15.31:0/3640364102 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444013980 con 0x7fb438004da0 2024-09-17T05:32:23.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb44be00640 1 -- 172.21.15.31:0/3640364102 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb444017030 con 0x7fb438004da0 2024-09-17T05:32:23.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb44be00640 1 -- 172.21.15.31:0/3640364102 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444013dc0 con 0x7fb438004da0 2024-09-17T05:32:23.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb459e00640 1 -- 172.21.15.31:0/3640364102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4540c79c0 con 0x7fb438004da0 2024-09-17T05:32:23.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb459e00640 1 -- 172.21.15.31:0/3640364102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4540c7f80 con 0x7fb438004da0 2024-09-17T05:32:23.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.647+0000 7fb459e00640 1 -- 172.21.15.31:0/3640364102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb45415b320 con 0x7fb438004da0 2024-09-17T05:32:23.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.651+0000 7fb44be00640 1 -- 172.21.15.31:0/3640364102 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7fb44401c3e0 con 0x7fb438004da0 2024-09-17T05:32:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.651+0000 7fb44be00640 1 --2- 172.21.15.31:0/3640364102 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb430073590 0x7fb430075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.651+0000 7fb44be00640 1 -- 172.21.15.31:0/3640364102 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fb444098420 con 0x7fb438004da0 2024-09-17T05:32:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.651+0000 7fb44a000640 1 --2- 172.21.15.31:0/3640364102 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb430073590 0x7fb430075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:23.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.651+0000 7fb44a000640 1 --2- 172.21.15.31:0/3640364102 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb430073590 0x7fb430075a50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb4541f82e0 tx=0x7fb43c0091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:23.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.655+0000 7fb44be00640 1 -- 172.21.15.31:0/3640364102 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb4540c7740 con 0x7fb438004da0 2024-09-17T05:32:23.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.831+0000 7fb459e00640 1 -- 172.21.15.31:0/3640364102 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb454070270 con 0x7fb438004da0 2024-09-17T05:32:23.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.831+0000 7fb44be00640 1 -- 172.21.15.31:0/3640364102 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16765 (secure 0 0 0) 0x7fb444062820 con 0x7fb438004da0 2024-09-17T05:32:23.833 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:23.834 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":68,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:32:22.832752+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:32:20.745608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T05:32:21.805091+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:32:23.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.835+0000 7fb459e00640 1 -- 172.21.15.31:0/3640364102 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb430073590 msgr2=0x7fb430075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:23.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.835+0000 7fb459e00640 1 --2- 172.21.15.31:0/3640364102 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb430073590 0x7fb430075a50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb4541f82e0 tx=0x7fb43c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:32:23.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.835+0000 7fb459e00640 1 -- 172.21.15.31:0/3640364102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb438004da0 msgr2=0x7fb45415aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:23.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.835+0000 7fb459e00640 1 --2- 172.21.15.31:0/3640364102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb438004da0 0x7fb45415aca0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb4440126a0 tx=0x7fb444012aa0 comp rx=0 tx=0).stop 2024-09-17T05:32:23.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.835+0000 7fb459e00640 1 -- 172.21.15.31:0/3640364102 shutdown_connections 2024-09-17T05:32:23.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.835+0000 7fb459e00640 1 --2- 172.21.15.31:0/3640364102 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fb430073590 0x7fb430075a50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:23.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.835+0000 7fb459e00640 1 --2- 172.21.15.31:0/3640364102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb454071a20 0x7fb454071ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:23.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.835+0000 7fb459e00640 1 --2- 172.21.15.31:0/3640364102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb454154040 0x7fb454156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:23.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.835+0000 7fb459e00640 1 --2- 172.21.15.31:0/3640364102 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb438004da0 0x7fb45415aca0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:23.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.835+0000 7fb459e00640 1 -- 172.21.15.31:0/3640364102 >> 172.21.15.31:0/3640364102 conn(0x7fb4540d1d90 msgr2=0x7fb454070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:23.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.835+0000 7fb459e00640 1 -- 172.21.15.31:0/3640364102 shutdown_connections 2024-09-17T05:32:23.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:23.835+0000 7fb459e00640 1 -- 172.21.15.31:0/3640364102 wait complete. 2024-09-17T05:32:23.855 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:32:24.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b9c00640 1 -- 172.21.15.31:0/2793573383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02980051d0 msgr2=0x7f029800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:24.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b9c00640 1 --2- 172.21.15.31:0/2793573383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02980051d0 0x7f029800b9d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00c5c0 tx=0x7f02ac01d2c0 comp rx=0 tx=0).stop 2024-09-17T05:32:24.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b9c00640 1 -- 172.21.15.31:0/2793573383 shutdown_connections 2024-09-17T05:32:24.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b9c00640 1 --2- 172.21.15.31:0/2793573383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02980051d0 0x7f029800b9d0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:24.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b9c00640 1 -- 172.21.15.31:0/2793573383 >> 172.21.15.31:0/2793573383 conn(0x7f02b40d0c90 msgr2=0x7f02b40d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:24.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b9c00640 1 -- 172.21.15.31:0/2793573383 shutdown_connections 2024-09-17T05:32:24.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b9c00640 1 -- 172.21.15.31:0/2793573383 wait complete. 2024-09-17T05:32:24.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b9c00640 1 Processor -- start 2024-09-17T05:32:24.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b9c00640 1 -- start start 2024-09-17T05:32:24.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b9c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02980051d0 0x7f02b41f3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:24.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b9c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02b40c7e80 0x7f02b40c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:24.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b9c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02b41f5b90 0x7f02b41f6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:24.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b9c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f02b40cbce0 con 0x7f02b41f5b90 2024-09-17T05:32:24.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b9c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f02b40cbb60 con 0x7f02b40c7e80 2024-09-17T05:32:24.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b9c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f02b40cbe60 con 0x7f02980051d0 2024-09-17T05:32:24.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02b41f5b90 0x7f02b41f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:24.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02b41f5b90 0x7f02b41f6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52292/0 (socket says 172.21.15.31:52292) 2024-09-17T05:32:24.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b3400640 1 -- 172.21.15.31:0/1724652979 learned_addr learned my addr 172.21.15.31:0/1724652979 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:24.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b2a00640 1 --2- 172.21.15.31:0/1724652979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02980051d0 0x7f02b41f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:24.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02abe00640 1 --2- 172.21.15.31:0/1724652979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02b40c7e80 0x7f02b40c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:24.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b3400640 1 -- 172.21.15.31:0/1724652979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02980051d0 msgr2=0x7f02b41f3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:24.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b3400640 1 --2- 172.21.15.31:0/1724652979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02980051d0 0x7f02b41f3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:24.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b3400640 1 -- 172.21.15.31:0/1724652979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02b40c7e80 msgr2=0x7f02b40c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:24.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b3400640 1 --2- 172.21.15.31:0/1724652979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02b40c7e80 0x7f02b40c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:24.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02b3400640 1 -- 172.21.15.31:0/1724652979 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b41f67a0 con 0x7f02b41f5b90 2024-09-17T05:32:24.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.003+0000 7f02abe00640 1 --2- 172.21.15.31:0/1724652979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02b40c7e80 0x7f02b40c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:24.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.007+0000 7f02b3400640 1 --2- 172.21.15.31:0/1724652979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02b41f5b90 0x7f02b41f6040 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f02ac01b9c0 tx=0x7f02ac002000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:24.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.007+0000 7f02aaa00640 1 -- 172.21.15.31:0/1724652979 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac003d90 con 0x7f02b41f5b90 2024-09-17T05:32:24.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.007+0000 7f02aaa00640 1 -- 172.21.15.31:0/1724652979 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02ac006070 con 0x7f02b41f5b90 2024-09-17T05:32:24.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.007+0000 7f02aaa00640 1 -- 172.21.15.31:0/1724652979 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0064c0 con 0x7f02b41f5b90 2024-09-17T05:32:24.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.007+0000 7f02b9c00640 1 -- 172.21.15.31:0/1724652979 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02b41f6a80 con 0x7f02b41f5b90 2024-09-17T05:32:24.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.007+0000 7f02b9c00640 1 -- 172.21.15.31:0/1724652979 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02b41f2990 con 0x7f02b41f5b90 2024-09-17T05:32:24.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.007+0000 7f02b9c00640 1 -- 172.21.15.31:0/1724652979 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02b415e9d0 con 0x7f02b41f5b90 2024-09-17T05:32:24.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.007+0000 7f02aaa00640 1 -- 172.21.15.31:0/1724652979 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f02ac006660 con 0x7f02b41f5b90 2024-09-17T05:32:24.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.007+0000 7f02aaa00640 1 --2- 172.21.15.31:0/1724652979 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0290073590 0x7f0290075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:24.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.007+0000 7f02aaa00640 1 -- 172.21.15.31:0/1724652979 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f02ac12e8f0 con 0x7f02b41f5b90 2024-09-17T05:32:24.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.011+0000 7f02b2a00640 1 --2- 172.21.15.31:0/1724652979 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0290073590 0x7f0290075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:24.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.011+0000 7f02b2a00640 1 --2- 172.21.15.31:0/1724652979 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0290073590 0x7f0290075a50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009be0 tx=0x7f02a40091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:24.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.011+0000 7f02aaa00640 1 -- 172.21.15.31:0/1724652979 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f02ac017070 con 0x7f02b41f5b90 2024-09-17T05:32:24.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.187+0000 7f02b9c00640 1 -- 172.21.15.31:0/1724652979 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02b40d1960 con 0x7f02b41f5b90 2024-09-17T05:32:24.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.187+0000 7f02aaa00640 1 -- 172.21.15.31:0/1724652979 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16765 (secure 0 0 0) 0x7f02ac0f9440 con 0x7f02b41f5b90 2024-09-17T05:32:24.190 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:24.190 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":68,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:32:22.832752+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:32:20.745608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T05:32:21.805091+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:32:24.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.191+0000 7f02b9c00640 1 -- 172.21.15.31:0/1724652979 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0290073590 msgr2=0x7f0290075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:24.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.191+0000 7f02b9c00640 1 --2- 172.21.15.31:0/1724652979 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0290073590 0x7f0290075a50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f02a4009be0 tx=0x7f02a40091e0 comp rx=0 tx=0).stop 2024-09-17T05:32:24.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.191+0000 7f02b9c00640 1 -- 172.21.15.31:0/1724652979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02b41f5b90 msgr2=0x7f02b41f6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:24.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.191+0000 7f02b9c00640 1 --2- 172.21.15.31:0/1724652979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02b41f5b90 0x7f02b41f6040 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f02ac01b9c0 tx=0x7f02ac002000 comp rx=0 tx=0).stop 2024-09-17T05:32:24.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.191+0000 7f02b9c00640 1 -- 172.21.15.31:0/1724652979 shutdown_connections 2024-09-17T05:32:24.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.191+0000 7f02b9c00640 1 --2- 172.21.15.31:0/1724652979 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0290073590 0x7f0290075a50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:24.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.191+0000 7f02b9c00640 1 --2- 172.21.15.31:0/1724652979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02b41f5b90 0x7f02b41f6040 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:24.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.191+0000 7f02b9c00640 1 --2- 172.21.15.31:0/1724652979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02b40c7e80 0x7f02b40c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:24.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.191+0000 7f02b9c00640 1 --2- 172.21.15.31:0/1724652979 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02980051d0 0x7f02b41f3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:24.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.191+0000 7f02b9c00640 1 -- 172.21.15.31:0/1724652979 >> 172.21.15.31:0/1724652979 conn(0x7f02b40d0c90 msgr2=0x7f02b40b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:24.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.191+0000 7f02b9c00640 1 -- 172.21.15.31:0/1724652979 shutdown_connections 2024-09-17T05:32:24.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.191+0000 7f02b9c00640 1 -- 172.21.15.31:0/1724652979 wait complete. 2024-09-17T05:32:24.211 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:32:24.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.359+0000 7fa43de00640 1 -- 172.21.15.31:0/3398305056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4380b2d80 msgr2=0x7fa43815fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:24.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.359+0000 7fa43de00640 1 --2- 172.21.15.31:0/3398305056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4380b2d80 0x7fa43815fd80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fa420009840 tx=0x7fa42001f010 comp rx=0 tx=0).stop 2024-09-17T05:32:24.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.359+0000 7fa43de00640 1 -- 172.21.15.31:0/3398305056 shutdown_connections 2024-09-17T05:32:24.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.359+0000 7fa43de00640 1 --2- 172.21.15.31:0/3398305056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4380b2d80 0x7fa43815fd80 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:24.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.359+0000 7fa43de00640 1 -- 172.21.15.31:0/3398305056 >> 172.21.15.31:0/3398305056 conn(0x7fa4380d1dc0 msgr2=0x7fa4380d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:24.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.359+0000 7fa43de00640 1 -- 172.21.15.31:0/3398305056 shutdown_connections 2024-09-17T05:32:24.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.359+0000 7fa43de00640 1 -- 172.21.15.31:0/3398305056 wait complete. 2024-09-17T05:32:24.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa43de00640 1 Processor -- start 2024-09-17T05:32:24.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa43de00640 1 -- start start 2024-09-17T05:32:24.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa43de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4380b2d80 0x7fa43815a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:24.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa43de00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4380cff20 0x7fa4380ce690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:24.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa43de00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4381602c0 0x7fa4380b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:24.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa43de00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa4380afb50 con 0x7fa4380b2d80 2024-09-17T05:32:24.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa43de00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa438160ad0 con 0x7fa4380cff20 2024-09-17T05:32:24.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa43de00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa4380afcd0 con 0x7fa4381602c0 2024-09-17T05:32:24.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa436a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4380b2d80 0x7fa43815a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:24.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa436a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4380b2d80 0x7fa43815a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52300/0 (socket says 172.21.15.31:52300) 2024-09-17T05:32:24.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa436a00640 1 -- 172.21.15.31:0/1050279428 learned_addr learned my addr 172.21.15.31:0/1050279428 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:24.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa42fe00640 1 --2- 172.21.15.31:0/1050279428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4380cff20 0x7fa4380ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:24.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa437400640 1 --2- 172.21.15.31:0/1050279428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4381602c0 0x7fa4380b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:24.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa436a00640 1 -- 172.21.15.31:0/1050279428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4381602c0 msgr2=0x7fa4380b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:24.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa436a00640 1 --2- 172.21.15.31:0/1050279428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4381602c0 0x7fa4380b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:24.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa436a00640 1 -- 172.21.15.31:0/1050279428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4380cff20 msgr2=0x7fa4380ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:24.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa436a00640 1 --2- 172.21.15.31:0/1050279428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4380cff20 0x7fa4380ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:24.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa436a00640 1 -- 172.21.15.31:0/1050279428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4381f5e70 con 0x7fa4380b2d80 2024-09-17T05:32:24.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa437400640 1 --2- 172.21.15.31:0/1050279428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4381602c0 0x7fa4380b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:32:24.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa436a00640 1 --2- 172.21.15.31:0/1050279428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4380b2d80 0x7fa43815a1d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa42800c4c0 tx=0x7fa42800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:24.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa42f400640 1 -- 172.21.15.31:0/1050279428 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428016020 con 0x7fa4380b2d80 2024-09-17T05:32:24.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa42f400640 1 -- 172.21.15.31:0/1050279428 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa428012940 con 0x7fa4380b2d80 2024-09-17T05:32:24.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa42f400640 1 -- 172.21.15.31:0/1050279428 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428012d90 con 0x7fa4380b2d80 2024-09-17T05:32:24.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa43de00640 1 -- 172.21.15.31:0/1050279428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4381f6150 con 0x7fa4380b2d80 2024-09-17T05:32:24.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.363+0000 7fa43de00640 1 -- 172.21.15.31:0/1050279428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4381f6710 con 0x7fa4380b2d80 2024-09-17T05:32:24.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.367+0000 7fa43de00640 1 -- 172.21.15.31:0/1050279428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa43815fd80 con 0x7fa4380b2d80 2024-09-17T05:32:24.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.367+0000 7fa42f400640 1 -- 172.21.15.31:0/1050279428 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7fa428019020 con 0x7fa4380b2d80 2024-09-17T05:32:24.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.367+0000 7fa42f400640 1 --2- 172.21.15.31:0/1050279428 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa414073590 0x7fa414075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:24.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.367+0000 7fa42f400640 1 -- 172.21.15.31:0/1050279428 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fa4280946f0 con 0x7fa4380b2d80 2024-09-17T05:32:24.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.367+0000 7fa42fe00640 1 --2- 172.21.15.31:0/1050279428 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa414073590 0x7fa414075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:24.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.367+0000 7fa42fe00640 1 --2- 172.21.15.31:0/1050279428 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa414073590 0x7fa414075a50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa4200b2000 tx=0x7fa42001d850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:24.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.371+0000 7fa42f400640 1 -- 172.21.15.31:0/1050279428 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa428020020 con 0x7fa4380b2d80 2024-09-17T05:32:24.588 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:24.587+0000 7fa43de00640 1 -- 172.21.15.31:0/1050279428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa438071120 con 0x7fa4380b2d80 2024-09-17T05:32:25.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.463+0000 7fa42f400640 1 -- 172.21.15.31:0/1050279428 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) ==== 118+0+0 (secure 0 0 0) 0x7fa42805f450 con 0x7fa4380b2d80 2024-09-17T05:32:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.467+0000 7fa43de00640 1 -- 172.21.15.31:0/1050279428 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa414073590 msgr2=0x7fa414075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.467+0000 7fa43de00640 1 --2- 172.21.15.31:0/1050279428 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa414073590 0x7fa414075a50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa4200b2000 tx=0x7fa42001d850 comp rx=0 tx=0).stop 2024-09-17T05:32:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.467+0000 7fa43de00640 1 -- 172.21.15.31:0/1050279428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4380b2d80 msgr2=0x7fa43815a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.467+0000 7fa43de00640 1 --2- 172.21.15.31:0/1050279428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4380b2d80 0x7fa43815a1d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa42800c4c0 tx=0x7fa42800c980 comp rx=0 tx=0).stop 2024-09-17T05:32:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.467+0000 7fa43de00640 1 -- 172.21.15.31:0/1050279428 shutdown_connections 2024-09-17T05:32:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.467+0000 7fa43de00640 1 --2- 172.21.15.31:0/1050279428 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa414073590 0x7fa414075a50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.467+0000 7fa43de00640 1 --2- 172.21.15.31:0/1050279428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4381602c0 0x7fa4380b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.467+0000 7fa43de00640 1 --2- 172.21.15.31:0/1050279428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4380cff20 0x7fa4380ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.467+0000 7fa43de00640 1 --2- 172.21.15.31:0/1050279428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4380b2d80 0x7fa43815a1d0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.467+0000 7fa43de00640 1 -- 172.21.15.31:0/1050279428 >> 172.21.15.31:0/1050279428 conn(0x7fa4380d1dc0 msgr2=0x7fa43815c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.467+0000 7fa43de00640 1 -- 172.21.15.31:0/1050279428 shutdown_connections 2024-09-17T05:32:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.467+0000 7fa43de00640 1 -- 172.21.15.31:0/1050279428 wait complete. 2024-09-17T05:32:25.491 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:32:25.492 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:32:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f370b800640 1 -- 172.21.15.31:0/2665633779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37040afb10 msgr2=0x7f37040affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f370b800640 1 --2- 172.21.15.31:0/2665633779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37040afb10 0x7f37040affc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009bc0 tx=0x7f36fc01cba0 comp rx=0 tx=0).stop 2024-09-17T05:32:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f370b800640 1 -- 172.21.15.31:0/2665633779 shutdown_connections 2024-09-17T05:32:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f370b800640 1 --2- 172.21.15.31:0/2665633779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37040afb10 0x7f37040affc0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f370b800640 1 -- 172.21.15.31:0/2665633779 >> 172.21.15.31:0/2665633779 conn(0x7f37040d1dd0 msgr2=0x7f37040d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:25.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f370b800640 1 -- 172.21.15.31:0/2665633779 shutdown_connections 2024-09-17T05:32:25.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f370b800640 1 -- 172.21.15.31:0/2665633779 wait complete. 2024-09-17T05:32:25.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f370b800640 1 Processor -- start 2024-09-17T05:32:25.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f370b800640 1 -- start start 2024-09-17T05:32:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f370b800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37040afb10 0x7f370415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f370b800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37040b1650 0x7f37041fbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f370b800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37041605d0 0x7f37040cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f370b800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f370416a6d0 con 0x7f37040b1650 2024-09-17T05:32:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f370b800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f370416a550 con 0x7f37040afb10 2024-09-17T05:32:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f370b800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f370416a850 con 0x7f37041605d0 2024-09-17T05:32:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f3703e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37040b1650 0x7f37041fbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f3703e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37040b1650 0x7f37041fbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52312/0 (socket says 172.21.15.31:52312) 2024-09-17T05:32:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f3703e00640 1 -- 172.21.15.31:0/2364764249 learned_addr learned my addr 172.21.15.31:0/2364764249 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f3708e00640 1 --2- 172.21.15.31:0/2364764249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37040afb10 0x7f370415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:25.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f3709800640 1 --2- 172.21.15.31:0/2364764249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37041605d0 0x7f37040cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:25.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f3703e00640 1 -- 172.21.15.31:0/2364764249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37041605d0 msgr2=0x7f37040cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:25.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f3703e00640 1 --2- 172.21.15.31:0/2364764249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37041605d0 0x7f37040cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:25.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f3703e00640 1 -- 172.21.15.31:0/2364764249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37040afb10 msgr2=0x7f370415ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:25.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.647+0000 7f3703e00640 1 --2- 172.21.15.31:0/2364764249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37040afb10 0x7f370415ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:25.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.651+0000 7f3703e00640 1 -- 172.21.15.31:0/2364764249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37041fc220 con 0x7f37040b1650 2024-09-17T05:32:25.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.651+0000 7f3703e00640 1 --2- 172.21.15.31:0/2364764249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37040b1650 0x7f37041fbce0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c420 tx=0x7f36f000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:25.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.651+0000 7f3700c00640 1 -- 172.21.15.31:0/2364764249 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0017070 con 0x7f37040b1650 2024-09-17T05:32:25.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.651+0000 7f3700c00640 1 -- 172.21.15.31:0/2364764249 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36f0003600 con 0x7f37040b1650 2024-09-17T05:32:25.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.651+0000 7f370b800640 1 -- 172.21.15.31:0/2364764249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3704165050 con 0x7f37040b1650 2024-09-17T05:32:25.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.651+0000 7f3700c00640 1 -- 172.21.15.31:0/2364764249 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0003a90 con 0x7f37040b1650 2024-09-17T05:32:25.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.651+0000 7f370b800640 1 -- 172.21.15.31:0/2364764249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37041655f0 con 0x7f37040b1650 2024-09-17T05:32:25.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.651+0000 7f370b800640 1 -- 172.21.15.31:0/2364764249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37040affc0 con 0x7f37040b1650 2024-09-17T05:32:25.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.651+0000 7f3700c00640 1 -- 172.21.15.31:0/2364764249 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f36f001a070 con 0x7f37040b1650 2024-09-17T05:32:25.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.651+0000 7f3700c00640 1 --2- 172.21.15.31:0/2364764249 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f36e4073560 0x7f36e4075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:25.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.651+0000 7f3700c00640 1 -- 172.21.15.31:0/2364764249 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f36f0093b10 con 0x7f37040b1650 2024-09-17T05:32:25.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.655+0000 7f3708e00640 1 --2- 172.21.15.31:0/2364764249 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f36e4073560 0x7f36e4075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:25.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.655+0000 7f3708e00640 1 --2- 172.21.15.31:0/2364764249 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f36e4073560 0x7f36e4075a20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f36f8007fd0 tx=0x7f36f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:25.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.659+0000 7f3700c00640 1 -- 172.21.15.31:0/2364764249 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f37041fc220 con 0x7f37040b1650 2024-09-17T05:32:25.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:25.867+0000 7f370b800640 1 -- 172.21.15.31:0/2364764249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f37040d1080 con 0x7f37040b1650 2024-09-17T05:32:26.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.467+0000 7f3700c00640 1 -- 172.21.15.31:0/2364764249 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) ==== 122+0+0 (secure 0 0 0) 0x7f36f005e050 con 0x7f37040b1650 2024-09-17T05:32:26.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.467+0000 7f370b800640 1 -- 172.21.15.31:0/2364764249 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f36e4073560 msgr2=0x7f36e4075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:26.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.467+0000 7f370b800640 1 --2- 172.21.15.31:0/2364764249 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f36e4073560 0x7f36e4075a20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f36f8007fd0 tx=0x7f36f8009040 comp rx=0 tx=0).stop 2024-09-17T05:32:26.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.467+0000 7f370b800640 1 -- 172.21.15.31:0/2364764249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37040b1650 msgr2=0x7f37041fbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:26.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.467+0000 7f370b800640 1 --2- 172.21.15.31:0/2364764249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37040b1650 0x7f37041fbce0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c420 tx=0x7f36f000c8e0 comp rx=0 tx=0).stop 2024-09-17T05:32:26.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.467+0000 7f370b800640 1 -- 172.21.15.31:0/2364764249 shutdown_connections 2024-09-17T05:32:26.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.467+0000 7f370b800640 1 --2- 172.21.15.31:0/2364764249 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f36e4073560 0x7f36e4075a20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:26.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.467+0000 7f370b800640 1 --2- 172.21.15.31:0/2364764249 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37041605d0 0x7f37040cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:26.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.467+0000 7f370b800640 1 --2- 172.21.15.31:0/2364764249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37040b1650 0x7f37041fbce0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:26.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.467+0000 7f370b800640 1 --2- 172.21.15.31:0/2364764249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37040afb10 0x7f370415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:26.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.467+0000 7f370b800640 1 -- 172.21.15.31:0/2364764249 >> 172.21.15.31:0/2364764249 conn(0x7f37040d1dd0 msgr2=0x7f37040719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:26.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.467+0000 7f370b800640 1 -- 172.21.15.31:0/2364764249 shutdown_connections 2024-09-17T05:32:26.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.467+0000 7f370b800640 1 -- 172.21.15.31:0/2364764249 wait complete. 2024-09-17T05:32:26.492 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:32:26.493 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:32:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.643+0000 7f43b8800640 1 -- 172.21.15.31:0/3266897996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b015e330 msgr2=0x7f43b00b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.643+0000 7f43b8800640 1 --2- 172.21.15.31:0/3266897996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b015e330 0x7f43b00b0210 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f43ac009c80 tx=0x7f43ac01cd10 comp rx=0 tx=0).stop 2024-09-17T05:32:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.643+0000 7f43b8800640 1 -- 172.21.15.31:0/3266897996 shutdown_connections 2024-09-17T05:32:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.643+0000 7f43b8800640 1 --2- 172.21.15.31:0/3266897996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b015e330 0x7f43b00b0210 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:26.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.643+0000 7f43b8800640 1 --2- 172.21.15.31:0/3266897996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43b006ee50 0x7f43b00afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:26.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.643+0000 7f43b8800640 1 -- 172.21.15.31:0/3266897996 >> 172.21.15.31:0/3266897996 conn(0x7f43b00d1dc0 msgr2=0x7f43b00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:26.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.643+0000 7f43b8800640 1 -- 172.21.15.31:0/3266897996 shutdown_connections 2024-09-17T05:32:26.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.643+0000 7f43b8800640 1 -- 172.21.15.31:0/3266897996 wait complete. 2024-09-17T05:32:26.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b8800640 1 Processor -- start 2024-09-17T05:32:26.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b8800640 1 -- start start 2024-09-17T05:32:26.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b8800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b006ee50 0x7f43b01fbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b8800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b015df50 0x7f43b01599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b8800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43b015e330 0x7f43b00b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b8800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f43b00d1030 con 0x7f43b006ee50 2024-09-17T05:32:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b8800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f43b00d0eb0 con 0x7f43b015df50 2024-09-17T05:32:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b8800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f43b00d11b0 con 0x7f43b015e330 2024-09-17T05:32:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b006ee50 0x7f43b01fbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b006ee50 0x7f43b01fbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52332/0 (socket says 172.21.15.31:52332) 2024-09-17T05:32:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b5e00640 1 -- 172.21.15.31:0/3342882826 learned_addr learned my addr 172.21.15.31:0/3342882826 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b5400640 1 --2- 172.21.15.31:0/3342882826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b015df50 0x7f43b01599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b6800640 1 --2- 172.21.15.31:0/3342882826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43b015e330 0x7f43b00b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b5e00640 1 -- 172.21.15.31:0/3342882826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43b015e330 msgr2=0x7f43b00b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b5e00640 1 --2- 172.21.15.31:0/3342882826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43b015e330 0x7f43b00b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b5e00640 1 -- 172.21.15.31:0/3342882826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b015df50 msgr2=0x7f43b01599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b5e00640 1 --2- 172.21.15.31:0/3342882826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b015df50 0x7f43b01599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b5e00640 1 -- 172.21.15.31:0/3342882826 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b009bed0 con 0x7f43b006ee50 2024-09-17T05:32:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b5e00640 1 --2- 172.21.15.31:0/3342882826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b006ee50 0x7f43b01fbd00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f43a400c500 tx=0x7f43a400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43aa000640 1 -- 172.21.15.31:0/3342882826 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4017070 con 0x7f43b006ee50 2024-09-17T05:32:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43aa000640 1 -- 172.21.15.31:0/3342882826 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43a40053c0 con 0x7f43b006ee50 2024-09-17T05:32:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43aa000640 1 -- 172.21.15.31:0/3342882826 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4012890 con 0x7f43b006ee50 2024-09-17T05:32:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b8800640 1 -- 172.21.15.31:0/3342882826 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b009c1b0 con 0x7f43b006ee50 2024-09-17T05:32:26.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b8800640 1 -- 172.21.15.31:0/3342882826 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b00b6600 con 0x7f43b006ee50 2024-09-17T05:32:26.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.647+0000 7f43b8800640 1 -- 172.21.15.31:0/3342882826 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b0161650 con 0x7f43b006ee50 2024-09-17T05:32:26.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.651+0000 7f43aa000640 1 -- 172.21.15.31:0/3342882826 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f43a401a070 con 0x7f43b006ee50 2024-09-17T05:32:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.651+0000 7f43aa000640 1 --2- 172.21.15.31:0/3342882826 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4394073560 0x7f4394075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.651+0000 7f43aa000640 1 -- 172.21.15.31:0/3342882826 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f43a4093ac0 con 0x7f43b006ee50 2024-09-17T05:32:26.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.651+0000 7f43b5400640 1 --2- 172.21.15.31:0/3342882826 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4394073560 0x7f4394075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:26.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.651+0000 7f43b5400640 1 --2- 172.21.15.31:0/3342882826 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4394073560 0x7f4394075a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f43b00b5430 tx=0x7f43a000b390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:26.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.655+0000 7f43aa000640 1 -- 172.21.15.31:0/3342882826 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f43a405dfd0 con 0x7f43b006ee50 2024-09-17T05:32:26.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.867+0000 7f43b8800640 1 -- 172.21.15.31:0/3342882826 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43b0070fe0 con 0x7f43b006ee50 2024-09-17T05:32:26.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.867+0000 7f43aa000640 1 -- 172.21.15.31:0/3342882826 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5231 (secure 0 0 0) 0x7f43a4062a00 con 0x7f43b006ee50 2024-09-17T05:32:26.868 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:26.868 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":47,"btime":"2024-09-17T05:32:26:465301+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/4172452504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":4172452504},{"type":"v1","addr":"172.21.15.155:6837","nonce":4172452504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2918874157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2918874157},{"type":"v1","addr":"172.21.15.155:6836","nonce":2918874157}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3987740697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3987740697},{"type":"v1","addr":"172.21.15.31:6833","nonce":3987740697}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:32:22.832719+0000","modified":"2024-09-17T05:32:25.871459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6153":{"gid":6153,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1598380263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1598380263},{"type":"v1","addr":"172.21.15.31:6835","nonce":1598380263}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6153,"qdb_cluster":[6153]},"id":5}]} 2024-09-17T05:32:26.869 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 47 2024-09-17T05:32:26.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.867+0000 7f43b8800640 1 -- 172.21.15.31:0/3342882826 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4394073560 msgr2=0x7f4394075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:26.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.867+0000 7f43b8800640 1 --2- 172.21.15.31:0/3342882826 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4394073560 0x7f4394075a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f43b00b5430 tx=0x7f43a000b390 comp rx=0 tx=0).stop 2024-09-17T05:32:26.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.867+0000 7f43b8800640 1 -- 172.21.15.31:0/3342882826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b006ee50 msgr2=0x7f43b01fbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:26.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.867+0000 7f43b8800640 1 --2- 172.21.15.31:0/3342882826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b006ee50 0x7f43b01fbd00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f43a400c500 tx=0x7f43a400c9c0 comp rx=0 tx=0).stop 2024-09-17T05:32:26.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.867+0000 7f43b8800640 1 -- 172.21.15.31:0/3342882826 shutdown_connections 2024-09-17T05:32:26.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.867+0000 7f43b8800640 1 --2- 172.21.15.31:0/3342882826 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4394073560 0x7f4394075a20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:26.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.867+0000 7f43b8800640 1 --2- 172.21.15.31:0/3342882826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43b015e330 0x7f43b00b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:26.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.867+0000 7f43b8800640 1 --2- 172.21.15.31:0/3342882826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b015df50 0x7f43b01599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:26.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.867+0000 7f43b8800640 1 --2- 172.21.15.31:0/3342882826 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f43b006ee50 0x7f43b01fbd00 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:26.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.867+0000 7f43b8800640 1 -- 172.21.15.31:0/3342882826 >> 172.21.15.31:0/3342882826 conn(0x7f43b00d1dc0 msgr2=0x7f43b00ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:26.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.867+0000 7f43b8800640 1 -- 172.21.15.31:0/3342882826 shutdown_connections 2024-09-17T05:32:26.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:26.867+0000 7f43b8800640 1 -- 172.21.15.31:0/3342882826 wait complete. 2024-09-17T05:32:26.890 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:32:27.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.035+0000 7fd83fa00640 1 -- 172.21.15.31:0/4037354119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd83815bea0 msgr2=0x7fd8380ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:27.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.035+0000 7fd83fa00640 1 --2- 172.21.15.31:0/4037354119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd83815bea0 0x7fd8380ce670 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009900 tx=0x7fd82c01c8e0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.035+0000 7fd83fa00640 1 -- 172.21.15.31:0/4037354119 shutdown_connections 2024-09-17T05:32:27.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.035+0000 7fd83fa00640 1 --2- 172.21.15.31:0/4037354119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8380d28e0 0x7fd8380cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.035+0000 7fd83fa00640 1 --2- 172.21.15.31:0/4037354119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd83815bea0 0x7fd8380ce670 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.035+0000 7fd83fa00640 1 -- 172.21.15.31:0/4037354119 >> 172.21.15.31:0/4037354119 conn(0x7fd8380d1dc0 msgr2=0x7fd8380d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:27.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.035+0000 7fd83fa00640 1 -- 172.21.15.31:0/4037354119 shutdown_connections 2024-09-17T05:32:27.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.035+0000 7fd83fa00640 1 -- 172.21.15.31:0/4037354119 wait complete. 2024-09-17T05:32:27.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd83fa00640 1 Processor -- start 2024-09-17T05:32:27.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd83fa00640 1 -- start start 2024-09-17T05:32:27.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd83fa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8380cdb30 0x7fd83815a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:27.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd83fa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8380d28e0 0x7fd838146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:27.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd83fa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd83815bea0 0x7fd8381487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:27.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd83fa00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd838168fc0 con 0x7fd8380d28e0 2024-09-17T05:32:27.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd83fa00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd838168e40 con 0x7fd8380cdb30 2024-09-17T05:32:27.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd83fa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd838169140 con 0x7fd83815bea0 2024-09-17T05:32:27.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd837e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8380d28e0 0x7fd838146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:27.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd837e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8380d28e0 0x7fd838146730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52356/0 (socket says 172.21.15.31:52356) 2024-09-17T05:32:27.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd837e00640 1 -- 172.21.15.31:0/1841675423 learned_addr learned my addr 172.21.15.31:0/1841675423 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:27.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd837e00640 1 -- 172.21.15.31:0/1841675423 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd83815bea0 msgr2=0x7fd8381487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:27.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd837e00640 1 --2- 172.21.15.31:0/1841675423 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd83815bea0 0x7fd8381487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd837e00640 1 -- 172.21.15.31:0/1841675423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8380cdb30 msgr2=0x7fd83815a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:27.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd837e00640 1 --2- 172.21.15.31:0/1841675423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8380cdb30 0x7fd83815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd837e00640 1 -- 172.21.15.31:0/1841675423 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd838149280 con 0x7fd8380d28e0 2024-09-17T05:32:27.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd837e00640 1 --2- 172.21.15.31:0/1841675423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8380d28e0 0x7fd838146730 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd82400c400 tx=0x7fd82400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:27.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd834c00640 1 -- 172.21.15.31:0/1841675423 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824017070 con 0x7fd8380d28e0 2024-09-17T05:32:27.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd834c00640 1 -- 172.21.15.31:0/1841675423 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8240053c0 con 0x7fd8380d28e0 2024-09-17T05:32:27.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd834c00640 1 -- 172.21.15.31:0/1841675423 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824003880 con 0x7fd8380d28e0 2024-09-17T05:32:27.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd83fa00640 1 -- 172.21.15.31:0/1841675423 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd838149560 con 0x7fd8380d28e0 2024-09-17T05:32:27.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd83fa00640 1 -- 172.21.15.31:0/1841675423 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8380c7710 con 0x7fd8380d28e0 2024-09-17T05:32:27.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.039+0000 7fd83fa00640 1 -- 172.21.15.31:0/1841675423 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8380cc9d0 con 0x7fd8380d28e0 2024-09-17T05:32:27.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.043+0000 7fd834c00640 1 -- 172.21.15.31:0/1841675423 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7fd82401a070 con 0x7fd8380d28e0 2024-09-17T05:32:27.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.043+0000 7fd834c00640 1 --2- 172.21.15.31:0/1841675423 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd8180735b0 0x7fd818075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:27.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.043+0000 7fd834c00640 1 -- 172.21.15.31:0/1841675423 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fd824093b30 con 0x7fd8380d28e0 2024-09-17T05:32:27.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.043+0000 7fd83d000640 1 --2- 172.21.15.31:0/1841675423 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd8180735b0 0x7fd818075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:27.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.043+0000 7fd83d000640 1 --2- 172.21.15.31:0/1841675423 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd8180735b0 0x7fd818075a70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0af000 tx=0x7fd82c019680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:27.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.047+0000 7fd834c00640 1 -- 172.21.15.31:0/1841675423 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd824001130 con 0x7fd8380d28e0 2024-09-17T05:32:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.223+0000 7fd83fa00640 1 -- 172.21.15.31:0/1841675423 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd83815b1a0 con 0x7fd8380d28e0 2024-09-17T05:32:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.227+0000 7fd834c00640 1 -- 172.21.15.31:0/1841675423 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+16752 (secure 0 0 0) 0x7fd82405e790 con 0x7fd8380d28e0 2024-09-17T05:32:27.226 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:27.227 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":69,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:32:24.449030+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:32:20.745608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T05:32:21.805091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:32:27.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.227+0000 7fd83fa00640 1 -- 172.21.15.31:0/1841675423 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd8180735b0 msgr2=0x7fd818075a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:27.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.227+0000 7fd83fa00640 1 --2- 172.21.15.31:0/1841675423 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd8180735b0 0x7fd818075a70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0af000 tx=0x7fd82c019680 comp rx=0 tx=0).stop 2024-09-17T05:32:27.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.227+0000 7fd83fa00640 1 -- 172.21.15.31:0/1841675423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8380d28e0 msgr2=0x7fd838146730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:27.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.227+0000 7fd83fa00640 1 --2- 172.21.15.31:0/1841675423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8380d28e0 0x7fd838146730 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd82400c400 tx=0x7fd82400c8c0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.227+0000 7fd83fa00640 1 -- 172.21.15.31:0/1841675423 shutdown_connections 2024-09-17T05:32:27.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.227+0000 7fd83fa00640 1 --2- 172.21.15.31:0/1841675423 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fd8180735b0 0x7fd818075a70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.227+0000 7fd83fa00640 1 --2- 172.21.15.31:0/1841675423 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd83815bea0 0x7fd8381487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.227+0000 7fd83fa00640 1 --2- 172.21.15.31:0/1841675423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8380d28e0 0x7fd838146730 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.227+0000 7fd83fa00640 1 --2- 172.21.15.31:0/1841675423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8380cdb30 0x7fd83815a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.227+0000 7fd83fa00640 1 -- 172.21.15.31:0/1841675423 >> 172.21.15.31:0/1841675423 conn(0x7fd8380d1dc0 msgr2=0x7fd8380b6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:27.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.227+0000 7fd83fa00640 1 -- 172.21.15.31:0/1841675423 shutdown_connections 2024-09-17T05:32:27.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.227+0000 7fd83fa00640 1 -- 172.21.15.31:0/1841675423 wait complete. 2024-09-17T05:32:27.249 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:32:27.249 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:32:27.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f501f000640 1 -- 172.21.15.31:0/2259191753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501815c130 msgr2=0x7f50180cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:27.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f501f000640 1 --2- 172.21.15.31:0/2259191753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501815c130 0x7f50180cd050 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f50180d0780 tx=0x7f501001ca80 comp rx=0 tx=0).stop 2024-09-17T05:32:27.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f501f000640 1 -- 172.21.15.31:0/2259191753 shutdown_connections 2024-09-17T05:32:27.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f501f000640 1 --2- 172.21.15.31:0/2259191753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501815c130 0x7f50180cd050 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f501f000640 1 -- 172.21.15.31:0/2259191753 >> 172.21.15.31:0/2259191753 conn(0x7f50180d1ea0 msgr2=0x7f50180d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:27.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f501f000640 1 -- 172.21.15.31:0/2259191753 shutdown_connections 2024-09-17T05:32:27.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f501f000640 1 -- 172.21.15.31:0/2259191753 wait complete. 2024-09-17T05:32:27.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f501f000640 1 Processor -- start 2024-09-17T05:32:27.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f501f000640 1 -- start start 2024-09-17T05:32:27.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f501f000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50180cecf0 0x7f50180cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:27.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f501f000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501815bd50 0x7f501814e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:27.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f501f000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f501815c130 0x7f50180c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:27.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f501f000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f501816a580 con 0x7f501815bd50 2024-09-17T05:32:27.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f501f000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f501816a400 con 0x7f50180cecf0 2024-09-17T05:32:27.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f501f000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f501816a700 con 0x7f501815c130 2024-09-17T05:32:27.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f500f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501815bd50 0x7f501814e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:27.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f500f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501815bd50 0x7f501814e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52378/0 (socket says 172.21.15.31:52378) 2024-09-17T05:32:27.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f500f400640 1 -- 172.21.15.31:0/1868039557 learned_addr learned my addr 172.21.15.31:0/1868039557 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f5017e00640 1 --2- 172.21.15.31:0/1868039557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50180cecf0 0x7f50180cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f501d000640 1 --2- 172.21.15.31:0/1868039557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f501815c130 0x7f50180c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f500f400640 1 -- 172.21.15.31:0/1868039557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f501815c130 msgr2=0x7f50180c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f500f400640 1 --2- 172.21.15.31:0/1868039557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f501815c130 0x7f50180c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f500f400640 1 -- 172.21.15.31:0/1868039557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50180cecf0 msgr2=0x7f50180cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f500f400640 1 --2- 172.21.15.31:0/1868039557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50180cecf0 0x7f50180cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f500f400640 1 -- 172.21.15.31:0/1868039557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5018159090 con 0x7f501815bd50 2024-09-17T05:32:27.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.395+0000 7f500f400640 1 --2- 172.21.15.31:0/1868039557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501815bd50 0x7f501814e480 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f500000c490 tx=0x7f500000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:27.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.399+0000 7f5014c00640 1 -- 172.21.15.31:0/1868039557 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5000016020 con 0x7f501815bd50 2024-09-17T05:32:27.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.399+0000 7f5014c00640 1 -- 172.21.15.31:0/1868039557 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5000012940 con 0x7f501815bd50 2024-09-17T05:32:27.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.399+0000 7f5014c00640 1 -- 172.21.15.31:0/1868039557 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5000012d90 con 0x7f501815bd50 2024-09-17T05:32:27.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.399+0000 7f501f000640 1 -- 172.21.15.31:0/1868039557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5018159370 con 0x7f501815bd50 2024-09-17T05:32:27.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.399+0000 7f501f000640 1 -- 172.21.15.31:0/1868039557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5018159930 con 0x7f501815bd50 2024-09-17T05:32:27.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.399+0000 7f501f000640 1 -- 172.21.15.31:0/1868039557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50180ce5e0 con 0x7f501815bd50 2024-09-17T05:32:27.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.399+0000 7f5014c00640 1 -- 172.21.15.31:0/1868039557 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f5000019020 con 0x7f501815bd50 2024-09-17T05:32:27.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.399+0000 7f5014c00640 1 --2- 172.21.15.31:0/1868039557 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4ff4073560 0x7f4ff4075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:27.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.399+0000 7f5014c00640 1 -- 172.21.15.31:0/1868039557 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f5000094850 con 0x7f501815bd50 2024-09-17T05:32:27.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.399+0000 7f5017e00640 1 --2- 172.21.15.31:0/1868039557 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4ff4073560 0x7f4ff4075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:27.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.403+0000 7f5017e00640 1 --2- 172.21.15.31:0/1868039557 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4ff4073560 0x7f4ff4075a20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5008000f70 tx=0x7f5008009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:27.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.403+0000 7f5014c00640 1 -- 172.21.15.31:0/1868039557 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5000020020 con 0x7f501815bd50 2024-09-17T05:32:27.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.579+0000 7f501f000640 1 -- 172.21.15.31:0/1868039557 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f501814e9c0 con 0x7f4ff4073560 2024-09-17T05:32:27.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.583+0000 7f5014c00640 1 -- 172.21.15.31:0/1868039557 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251685 (secure 0 0 0) 0x7f501814e9c0 con 0x7f4ff4073560 2024-09-17T05:32:27.588 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:27.589 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:32:27.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.587+0000 7f501f000640 1 -- 172.21.15.31:0/1868039557 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4ff4073560 msgr2=0x7f4ff4075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:27.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.587+0000 7f501f000640 1 --2- 172.21.15.31:0/1868039557 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4ff4073560 0x7f4ff4075a20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5008000f70 tx=0x7f5008009040 comp rx=0 tx=0).stop 2024-09-17T05:32:27.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.587+0000 7f501f000640 1 -- 172.21.15.31:0/1868039557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501815bd50 msgr2=0x7f501814e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:27.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.587+0000 7f501f000640 1 --2- 172.21.15.31:0/1868039557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501815bd50 0x7f501814e480 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f500000c490 tx=0x7f500000c950 comp rx=0 tx=0).stop 2024-09-17T05:32:27.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.587+0000 7f501f000640 1 -- 172.21.15.31:0/1868039557 shutdown_connections 2024-09-17T05:32:27.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.587+0000 7f501f000640 1 --2- 172.21.15.31:0/1868039557 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f4ff4073560 0x7f4ff4075a20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.587+0000 7f501f000640 1 --2- 172.21.15.31:0/1868039557 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f501815c130 0x7f50180c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.587+0000 7f501f000640 1 --2- 172.21.15.31:0/1868039557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f501815bd50 0x7f501814e480 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.587+0000 7f501f000640 1 --2- 172.21.15.31:0/1868039557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50180cecf0 0x7f50180cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.587+0000 7f501f000640 1 -- 172.21.15.31:0/1868039557 >> 172.21.15.31:0/1868039557 conn(0x7f50180d1ea0 msgr2=0x7f5018157d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:27.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.587+0000 7f501f000640 1 -- 172.21.15.31:0/1868039557 shutdown_connections 2024-09-17T05:32:27.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.587+0000 7f501f000640 1 -- 172.21.15.31:0/1868039557 wait complete. 2024-09-17T05:32:27.608 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-17T05:32:27.235119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257148,"kb_used_data":7596,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717572,"statfs":{"total":773094113280,"available":772830793728,"internally_reserved":0,"allocated":7778304,"data_stored":3903460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.811793"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.483669+0000","last_change":"2024-09-17T05:32:23.478099+0000","last_active":"2024-09-17T05:32:23.483669+0000","last_peered":"2024-09-17T05:32:23.483669+0000","last_clean":"2024-09-17T05:32:23.483669+0000","last_became_active":"2024-09-17T05:32:23.477783+0000","last_became_peered":"2024-09-17T05:32:23.477783+0000","last_unstale":"2024-09-17T05:32:23.483669+0000","last_undegraded":"2024-09-17T05:32:23.483669+0000","last_fullsized":"2024-09-17T05:32:23.483669+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:54.629625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.470848+0000","last_change":"2024-09-17T05:32:23.466050+0000","last_active":"2024-09-17T05:32:23.470848+0000","last_peered":"2024-09-17T05:32:23.470848+0000","last_clean":"2024-09-17T05:32:23.470848+0000","last_became_active":"2024-09-17T05:32:23.465791+0000","last_became_peered":"2024-09-17T05:32:23.465791+0000","last_unstale":"2024-09-17T05:32:23.470848+0000","last_undegraded":"2024-09-17T05:32:23.470848+0000","last_fullsized":"2024-09-17T05:32:23.470848+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:15.060077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.471942+0000","last_change":"2024-09-17T05:32:23.462418+0000","last_active":"2024-09-17T05:32:23.471942+0000","last_peered":"2024-09-17T05:32:23.471942+0000","last_clean":"2024-09-17T05:32:23.471942+0000","last_became_active":"2024-09-17T05:32:23.462073+0000","last_became_peered":"2024-09-17T05:32:23.462073+0000","last_unstale":"2024-09-17T05:32:23.471942+0000","last_undegraded":"2024-09-17T05:32:23.471942+0000","last_fullsized":"2024-09-17T05:32:23.471942+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:13.497447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480064+0000","last_change":"2024-09-17T05:32:23.472699+0000","last_active":"2024-09-17T05:32:23.480064+0000","last_peered":"2024-09-17T05:32:23.480064+0000","last_clean":"2024-09-17T05:32:23.480064+0000","last_became_active":"2024-09-17T05:32:23.472411+0000","last_became_peered":"2024-09-17T05:32:23.472411+0000","last_unstale":"2024-09-17T05:32:23.480064+0000","last_undegraded":"2024-09-17T05:32:23.480064+0000","last_fullsized":"2024-09-17T05:32:23.480064+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:09.476752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.467020+0000","last_change":"2024-09-17T05:32:23.464155+0000","last_active":"2024-09-17T05:32:23.467020+0000","last_peered":"2024-09-17T05:32:23.467020+0000","last_clean":"2024-09-17T05:32:23.467020+0000","last_became_active":"2024-09-17T05:32:23.463865+0000","last_became_peered":"2024-09-17T05:32:23.463865+0000","last_unstale":"2024-09-17T05:32:23.467020+0000","last_undegraded":"2024-09-17T05:32:23.467020+0000","last_fullsized":"2024-09-17T05:32:23.467020+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:58.569472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.470614+0000","last_change":"2024-09-17T05:32:23.464707+0000","last_active":"2024-09-17T05:32:23.470614+0000","last_peered":"2024-09-17T05:32:23.470614+0000","last_clean":"2024-09-17T05:32:23.470614+0000","last_became_active":"2024-09-17T05:32:23.463900+0000","last_became_peered":"2024-09-17T05:32:23.463900+0000","last_unstale":"2024-09-17T05:32:23.470614+0000","last_undegraded":"2024-09-17T05:32:23.470614+0000","last_fullsized":"2024-09-17T05:32:23.470614+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:56.865390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.449875+0000","last_change":"2024-09-17T05:32:23.449875+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.449875+0000","last_undegraded":"2024-09-17T05:32:23.449875+0000","last_fullsized":"2024-09-17T05:32:23.449875+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473975+0000","last_change":"2024-09-17T05:32:23.468848+0000","last_active":"2024-09-17T05:32:23.473975+0000","last_peered":"2024-09-17T05:32:23.473975+0000","last_clean":"2024-09-17T05:32:23.473975+0000","last_became_active":"2024-09-17T05:32:23.468572+0000","last_became_peered":"2024-09-17T05:32:23.468572+0000","last_unstale":"2024-09-17T05:32:23.473975+0000","last_undegraded":"2024-09-17T05:32:23.473975+0000","last_fullsized":"2024-09-17T05:32:23.473975+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:06.450308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.478480+0000","last_change":"2024-09-17T05:32:23.474102+0000","last_active":"2024-09-17T05:32:23.478480+0000","last_peered":"2024-09-17T05:32:23.478480+0000","last_clean":"2024-09-17T05:32:23.478480+0000","last_became_active":"2024-09-17T05:32:23.473811+0000","last_became_peered":"2024-09-17T05:32:23.473811+0000","last_unstale":"2024-09-17T05:32:23.478480+0000","last_undegraded":"2024-09-17T05:32:23.478480+0000","last_fullsized":"2024-09-17T05:32:23.478480+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:19.579976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.468934+0000","last_change":"2024-09-17T05:32:23.459987+0000","last_active":"2024-09-17T05:32:23.468934+0000","last_peered":"2024-09-17T05:32:23.468934+0000","last_clean":"2024-09-17T05:32:23.468934+0000","last_became_active":"2024-09-17T05:32:23.459724+0000","last_became_peered":"2024-09-17T05:32:23.459724+0000","last_unstale":"2024-09-17T05:32:23.468934+0000","last_undegraded":"2024-09-17T05:32:23.468934+0000","last_fullsized":"2024-09-17T05:32:23.468934+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:45.173792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.483633+0000","last_change":"2024-09-17T05:32:23.477839+0000","last_active":"2024-09-17T05:32:23.483633+0000","last_peered":"2024-09-17T05:32:23.483633+0000","last_clean":"2024-09-17T05:32:23.483633+0000","last_became_active":"2024-09-17T05:32:23.477026+0000","last_became_peered":"2024-09-17T05:32:23.477026+0000","last_unstale":"2024-09-17T05:32:23.483633+0000","last_undegraded":"2024-09-17T05:32:23.483633+0000","last_fullsized":"2024-09-17T05:32:23.483633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.059346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.479654+0000","last_change":"2024-09-17T05:32:23.468520+0000","last_active":"2024-09-17T05:32:23.479654+0000","last_peered":"2024-09-17T05:32:23.479654+0000","last_clean":"2024-09-17T05:32:23.479654+0000","last_became_active":"2024-09-17T05:32:23.467246+0000","last_became_peered":"2024-09-17T05:32:23.467246+0000","last_unstale":"2024-09-17T05:32:23.479654+0000","last_undegraded":"2024-09-17T05:32:23.479654+0000","last_fullsized":"2024-09-17T05:32:23.479654+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:18.486564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.445701+0000","last_change":"2024-09-17T05:32:23.445701+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.445701+0000","last_undegraded":"2024-09-17T05:32:23.445701+0000","last_fullsized":"2024-09-17T05:32:23.445701+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.457059+0000","last_change":"2024-09-17T05:32:23.452918+0000","last_active":"2024-09-17T05:32:23.457059+0000","last_peered":"2024-09-17T05:32:23.457059+0000","last_clean":"2024-09-17T05:32:23.457059+0000","last_became_active":"2024-09-17T05:32:23.452665+0000","last_became_peered":"2024-09-17T05:32:23.452665+0000","last_unstale":"2024-09-17T05:32:23.457059+0000","last_undegraded":"2024-09-17T05:32:23.457059+0000","last_fullsized":"2024-09-17T05:32:23.457059+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:23.842414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.455656+0000","last_change":"2024-09-17T05:32:23.455539+0000","last_active":"2024-09-17T05:32:23.455656+0000","last_peered":"2024-09-17T05:32:23.455656+0000","last_clean":"2024-09-17T05:32:23.455656+0000","last_became_active":"2024-09-17T05:32:23.455242+0000","last_became_peered":"2024-09-17T05:32:23.455242+0000","last_unstale":"2024-09-17T05:32:23.455656+0000","last_undegraded":"2024-09-17T05:32:23.455656+0000","last_fullsized":"2024-09-17T05:32:23.455656+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:39.377948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473890+0000","last_change":"2024-09-17T05:32:23.472186+0000","last_active":"2024-09-17T05:32:23.473890+0000","last_peered":"2024-09-17T05:32:23.473890+0000","last_clean":"2024-09-17T05:32:23.473890+0000","last_became_active":"2024-09-17T05:32:23.471921+0000","last_became_peered":"2024-09-17T05:32:23.471921+0000","last_unstale":"2024-09-17T05:32:23.473890+0000","last_undegraded":"2024-09-17T05:32:23.473890+0000","last_fullsized":"2024-09-17T05:32:23.473890+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:12.674920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.472813+0000","last_change":"2024-09-17T05:32:23.466234+0000","last_active":"2024-09-17T05:32:23.472813+0000","last_peered":"2024-09-17T05:32:23.472813+0000","last_clean":"2024-09-17T05:32:23.472813+0000","last_became_active":"2024-09-17T05:32:23.463638+0000","last_became_peered":"2024-09-17T05:32:23.463638+0000","last_unstale":"2024-09-17T05:32:23.472813+0000","last_undegraded":"2024-09-17T05:32:23.472813+0000","last_fullsized":"2024-09-17T05:32:23.472813+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:08.689729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.477018+0000","last_change":"2024-09-17T05:32:23.468316+0000","last_active":"2024-09-17T05:32:23.477018+0000","last_peered":"2024-09-17T05:32:23.477018+0000","last_clean":"2024-09-17T05:32:23.477018+0000","last_became_active":"2024-09-17T05:32:23.466433+0000","last_became_peered":"2024-09-17T05:32:23.466433+0000","last_unstale":"2024-09-17T05:32:23.477018+0000","last_undegraded":"2024-09-17T05:32:23.477018+0000","last_fullsized":"2024-09-17T05:32:23.477018+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:24.514866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473521+0000","last_change":"2024-09-17T05:32:23.468259+0000","last_active":"2024-09-17T05:32:23.473521+0000","last_peered":"2024-09-17T05:32:23.473521+0000","last_clean":"2024-09-17T05:32:23.473521+0000","last_became_active":"2024-09-17T05:32:23.467985+0000","last_became_peered":"2024-09-17T05:32:23.467985+0000","last_unstale":"2024-09-17T05:32:23.473521+0000","last_undegraded":"2024-09-17T05:32:23.473521+0000","last_fullsized":"2024-09-17T05:32:23.473521+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:12.029625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.459406+0000","last_change":"2024-09-17T05:32:23.452018+0000","last_active":"2024-09-17T05:32:23.459406+0000","last_peered":"2024-09-17T05:32:23.459406+0000","last_clean":"2024-09-17T05:32:23.459406+0000","last_became_active":"2024-09-17T05:32:23.451744+0000","last_became_peered":"2024-09-17T05:32:23.451744+0000","last_unstale":"2024-09-17T05:32:23.459406+0000","last_undegraded":"2024-09-17T05:32:23.459406+0000","last_fullsized":"2024-09-17T05:32:23.459406+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:17.778971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.468094+0000","last_change":"2024-09-17T05:32:23.457509+0000","last_active":"2024-09-17T05:32:23.468094+0000","last_peered":"2024-09-17T05:32:23.468094+0000","last_clean":"2024-09-17T05:32:23.468094+0000","last_became_active":"2024-09-17T05:32:23.457200+0000","last_became_peered":"2024-09-17T05:32:23.457200+0000","last_unstale":"2024-09-17T05:32:23.468094+0000","last_undegraded":"2024-09-17T05:32:23.468094+0000","last_fullsized":"2024-09-17T05:32:23.468094+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:41.594515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.471051+0000","last_change":"2024-09-17T05:32:23.460429+0000","last_active":"2024-09-17T05:32:23.471051+0000","last_peered":"2024-09-17T05:32:23.471051+0000","last_clean":"2024-09-17T05:32:23.471051+0000","last_became_active":"2024-09-17T05:32:23.460146+0000","last_became_peered":"2024-09-17T05:32:23.460146+0000","last_unstale":"2024-09-17T05:32:23.471051+0000","last_undegraded":"2024-09-17T05:32:23.471051+0000","last_fullsized":"2024-09-17T05:32:23.471051+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:34.057105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.482849+0000","last_change":"2024-09-17T05:32:23.475449+0000","last_active":"2024-09-17T05:32:23.482849+0000","last_peered":"2024-09-17T05:32:23.482849+0000","last_clean":"2024-09-17T05:32:23.482849+0000","last_became_active":"2024-09-17T05:32:23.473193+0000","last_became_peered":"2024-09-17T05:32:23.473193+0000","last_unstale":"2024-09-17T05:32:23.482849+0000","last_undegraded":"2024-09-17T05:32:23.482849+0000","last_fullsized":"2024-09-17T05:32:23.482849+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:54.940349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.477490+0000","last_change":"2024-09-17T05:32:23.472118+0000","last_active":"2024-09-17T05:32:23.477490+0000","last_peered":"2024-09-17T05:32:23.477490+0000","last_clean":"2024-09-17T05:32:23.477490+0000","last_became_active":"2024-09-17T05:32:23.469804+0000","last_became_peered":"2024-09-17T05:32:23.469804+0000","last_unstale":"2024-09-17T05:32:23.477490+0000","last_undegraded":"2024-09-17T05:32:23.477490+0000","last_fullsized":"2024-09-17T05:32:23.477490+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:19.190696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.474825+0000","last_change":"2024-09-17T05:32:23.465474+0000","last_active":"2024-09-17T05:32:23.474825+0000","last_peered":"2024-09-17T05:32:23.474825+0000","last_clean":"2024-09-17T05:32:23.474825+0000","last_became_active":"2024-09-17T05:32:23.465096+0000","last_became_peered":"2024-09-17T05:32:23.465096+0000","last_unstale":"2024-09-17T05:32:23.474825+0000","last_undegraded":"2024-09-17T05:32:23.474825+0000","last_fullsized":"2024-09-17T05:32:23.474825+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:03.166416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.448398+0000","last_change":"2024-09-17T05:32:23.448398+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.448398+0000","last_undegraded":"2024-09-17T05:32:23.448398+0000","last_fullsized":"2024-09-17T05:32:23.448398+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.471969+0000","last_change":"2024-09-17T05:32:23.464196+0000","last_active":"2024-09-17T05:32:23.471969+0000","last_peered":"2024-09-17T05:32:23.471969+0000","last_clean":"2024-09-17T05:32:23.471969+0000","last_became_active":"2024-09-17T05:32:23.463865+0000","last_became_peered":"2024-09-17T05:32:23.463865+0000","last_unstale":"2024-09-17T05:32:23.471969+0000","last_undegraded":"2024-09-17T05:32:23.471969+0000","last_fullsized":"2024-09-17T05:32:23.471969+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:58.324158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.469683+0000","last_change":"2024-09-17T05:32:23.461193+0000","last_active":"2024-09-17T05:32:23.469683+0000","last_peered":"2024-09-17T05:32:23.469683+0000","last_clean":"2024-09-17T05:32:23.469683+0000","last_became_active":"2024-09-17T05:32:23.460301+0000","last_became_peered":"2024-09-17T05:32:23.460301+0000","last_unstale":"2024-09-17T05:32:23.469683+0000","last_undegraded":"2024-09-17T05:32:23.469683+0000","last_fullsized":"2024-09-17T05:32:23.469683+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:11.922483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.475072+0000","last_change":"2024-09-17T05:32:23.465238+0000","last_active":"2024-09-17T05:32:23.475072+0000","last_peered":"2024-09-17T05:32:23.475072+0000","last_clean":"2024-09-17T05:32:23.475072+0000","last_became_active":"2024-09-17T05:32:23.464992+0000","last_became_peered":"2024-09-17T05:32:23.464992+0000","last_unstale":"2024-09-17T05:32:23.475072+0000","last_undegraded":"2024-09-17T05:32:23.475072+0000","last_fullsized":"2024-09-17T05:32:23.475072+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:59.312163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.466438+0000","last_change":"2024-09-17T05:32:23.466352+0000","last_active":"2024-09-17T05:32:23.466438+0000","last_peered":"2024-09-17T05:32:23.466438+0000","last_clean":"2024-09-17T05:32:23.466438+0000","last_became_active":"2024-09-17T05:32:23.466088+0000","last_became_peered":"2024-09-17T05:32:23.466088+0000","last_unstale":"2024-09-17T05:32:23.466438+0000","last_undegraded":"2024-09-17T05:32:23.466438+0000","last_fullsized":"2024-09-17T05:32:23.466438+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:19.710897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.460367+0000","last_change":"2024-09-17T05:32:23.460284+0000","last_active":"2024-09-17T05:32:23.460367+0000","last_peered":"2024-09-17T05:32:23.460367+0000","last_clean":"2024-09-17T05:32:23.460367+0000","last_became_active":"2024-09-17T05:32:23.460029+0000","last_became_peered":"2024-09-17T05:32:23.460029+0000","last_unstale":"2024-09-17T05:32:23.460367+0000","last_undegraded":"2024-09-17T05:32:23.460367+0000","last_fullsized":"2024-09-17T05:32:23.460367+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:56.581485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.474001+0000","last_change":"2024-09-17T05:32:23.468929+0000","last_active":"2024-09-17T05:32:23.474001+0000","last_peered":"2024-09-17T05:32:23.474001+0000","last_clean":"2024-09-17T05:32:23.474001+0000","last_became_active":"2024-09-17T05:32:23.468673+0000","last_became_peered":"2024-09-17T05:32:23.468673+0000","last_unstale":"2024-09-17T05:32:23.474001+0000","last_undegraded":"2024-09-17T05:32:23.474001+0000","last_fullsized":"2024-09-17T05:32:23.474001+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:18.518043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.483494+0000","last_change":"2024-09-17T05:32:23.475788+0000","last_active":"2024-09-17T05:32:23.483494+0000","last_peered":"2024-09-17T05:32:23.483494+0000","last_clean":"2024-09-17T05:32:23.483494+0000","last_became_active":"2024-09-17T05:32:23.472518+0000","last_became_peered":"2024-09-17T05:32:23.472518+0000","last_unstale":"2024-09-17T05:32:23.483494+0000","last_undegraded":"2024-09-17T05:32:23.483494+0000","last_fullsized":"2024-09-17T05:32:23.483494+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:39:54.219551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"68'4","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.484400+0000","last_change":"2024-09-17T05:32:22.449344+0000","last_active":"2024-09-17T05:32:23.484400+0000","last_peered":"2024-09-17T05:32:23.484400+0000","last_clean":"2024-09-17T05:32:23.484400+0000","last_became_active":"2024-09-17T05:32:22.449043+0000","last_became_peered":"2024-09-17T05:32:22.449043+0000","last_unstale":"2024-09-17T05:32:23.484400+0000","last_undegraded":"2024-09-17T05:32:23.484400+0000","last_fullsized":"2024-09-17T05:32:23.484400+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:33.407326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.478453+0000","last_change":"2024-09-17T05:32:23.472207+0000","last_active":"2024-09-17T05:32:23.478453+0000","last_peered":"2024-09-17T05:32:23.478453+0000","last_clean":"2024-09-17T05:32:23.478453+0000","last_became_active":"2024-09-17T05:32:23.468121+0000","last_became_peered":"2024-09-17T05:32:23.468121+0000","last_unstale":"2024-09-17T05:32:23.478453+0000","last_undegraded":"2024-09-17T05:32:23.478453+0000","last_fullsized":"2024-09-17T05:32:23.478453+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:15.616404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.448120+0000","last_change":"2024-09-17T05:32:22.441202+0000","last_active":"2024-09-17T05:32:23.448120+0000","last_peered":"2024-09-17T05:32:23.448120+0000","last_clean":"2024-09-17T05:32:23.448120+0000","last_became_active":"2024-09-17T05:32:22.440289+0000","last_became_peered":"2024-09-17T05:32:22.440289+0000","last_unstale":"2024-09-17T05:32:23.448120+0000","last_undegraded":"2024-09-17T05:32:23.448120+0000","last_fullsized":"2024-09-17T05:32:23.448120+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:02:57.086704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.474106+0000","last_change":"2024-09-17T05:32:23.467839+0000","last_active":"2024-09-17T05:32:23.474106+0000","last_peered":"2024-09-17T05:32:23.474106+0000","last_clean":"2024-09-17T05:32:23.474106+0000","last_became_active":"2024-09-17T05:32:23.466456+0000","last_became_peered":"2024-09-17T05:32:23.466456+0000","last_unstale":"2024-09-17T05:32:23.474106+0000","last_undegraded":"2024-09-17T05:32:23.474106+0000","last_fullsized":"2024-09-17T05:32:23.474106+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:42.687907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.484999+0000","last_change":"2024-09-17T05:32:22.448229+0000","last_active":"2024-09-17T05:32:23.484999+0000","last_peered":"2024-09-17T05:32:23.484999+0000","last_clean":"2024-09-17T05:32:23.484999+0000","last_became_active":"2024-09-17T05:32:22.447966+0000","last_became_peered":"2024-09-17T05:32:22.447966+0000","last_unstale":"2024-09-17T05:32:23.484999+0000","last_undegraded":"2024-09-17T05:32:23.484999+0000","last_fullsized":"2024-09-17T05:32:23.484999+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:10.281440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.479763+0000","last_change":"2024-09-17T05:32:23.471383+0000","last_active":"2024-09-17T05:32:23.479763+0000","last_peered":"2024-09-17T05:32:23.479763+0000","last_clean":"2024-09-17T05:32:23.479763+0000","last_became_active":"2024-09-17T05:32:23.471094+0000","last_became_peered":"2024-09-17T05:32:23.471094+0000","last_unstale":"2024-09-17T05:32:23.479763+0000","last_undegraded":"2024-09-17T05:32:23.479763+0000","last_fullsized":"2024-09-17T05:32:23.479763+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:29.296974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.485829+0000","last_change":"2024-09-17T05:32:22.447167+0000","last_active":"2024-09-17T05:32:23.485829+0000","last_peered":"2024-09-17T05:32:23.485829+0000","last_clean":"2024-09-17T05:32:23.485829+0000","last_became_active":"2024-09-17T05:32:22.446419+0000","last_became_peered":"2024-09-17T05:32:22.446419+0000","last_unstale":"2024-09-17T05:32:23.485829+0000","last_undegraded":"2024-09-17T05:32:23.485829+0000","last_fullsized":"2024-09-17T05:32:23.485829+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:25.949036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.463055+0000","last_change":"2024-09-17T05:32:23.462966+0000","last_active":"2024-09-17T05:32:23.463055+0000","last_peered":"2024-09-17T05:32:23.463055+0000","last_clean":"2024-09-17T05:32:23.463055+0000","last_became_active":"2024-09-17T05:32:23.462122+0000","last_became_peered":"2024-09-17T05:32:23.462122+0000","last_unstale":"2024-09-17T05:32:23.463055+0000","last_undegraded":"2024-09-17T05:32:23.463055+0000","last_fullsized":"2024-09-17T05:32:23.463055+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:31.757931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.481776+0000","last_change":"2024-09-17T05:32:22.442701+0000","last_active":"2024-09-17T05:32:23.481776+0000","last_peered":"2024-09-17T05:32:23.481776+0000","last_clean":"2024-09-17T05:32:23.481776+0000","last_became_active":"2024-09-17T05:32:22.442400+0000","last_became_peered":"2024-09-17T05:32:22.442400+0000","last_unstale":"2024-09-17T05:32:23.481776+0000","last_undegraded":"2024-09-17T05:32:23.481776+0000","last_fullsized":"2024-09-17T05:32:23.481776+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:53.105004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473924+0000","last_change":"2024-09-17T05:32:23.467226+0000","last_active":"2024-09-17T05:32:23.473924+0000","last_peered":"2024-09-17T05:32:23.473924+0000","last_clean":"2024-09-17T05:32:23.473924+0000","last_became_active":"2024-09-17T05:32:23.466942+0000","last_became_peered":"2024-09-17T05:32:23.466942+0000","last_unstale":"2024-09-17T05:32:23.473924+0000","last_undegraded":"2024-09-17T05:32:23.473924+0000","last_fullsized":"2024-09-17T05:32:23.473924+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:23.653085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480082+0000","last_change":"2024-09-17T05:32:22.442678+0000","last_active":"2024-09-17T05:32:23.480082+0000","last_peered":"2024-09-17T05:32:23.480082+0000","last_clean":"2024-09-17T05:32:23.480082+0000","last_became_active":"2024-09-17T05:32:22.442378+0000","last_became_peered":"2024-09-17T05:32:22.442378+0000","last_unstale":"2024-09-17T05:32:23.480082+0000","last_undegraded":"2024-09-17T05:32:23.480082+0000","last_fullsized":"2024-09-17T05:32:23.480082+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:06.575195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.453952+0000","last_change":"2024-09-17T05:32:23.451743+0000","last_active":"2024-09-17T05:32:23.453952+0000","last_peered":"2024-09-17T05:32:23.453952+0000","last_clean":"2024-09-17T05:32:23.453952+0000","last_became_active":"2024-09-17T05:32:23.449774+0000","last_became_peered":"2024-09-17T05:32:23.449774+0000","last_unstale":"2024-09-17T05:32:23.453952+0000","last_undegraded":"2024-09-17T05:32:23.453952+0000","last_fullsized":"2024-09-17T05:32:23.453952+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:07.226176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.450557+0000","last_change":"2024-09-17T05:32:22.442622+0000","last_active":"2024-09-17T05:32:23.450557+0000","last_peered":"2024-09-17T05:32:23.450557+0000","last_clean":"2024-09-17T05:32:23.450557+0000","last_became_active":"2024-09-17T05:32:22.442317+0000","last_became_peered":"2024-09-17T05:32:22.442317+0000","last_unstale":"2024-09-17T05:32:23.450557+0000","last_undegraded":"2024-09-17T05:32:23.450557+0000","last_fullsized":"2024-09-17T05:32:23.450557+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:52.807454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.446007+0000","last_change":"2024-09-17T05:32:23.446007+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.446007+0000","last_undegraded":"2024-09-17T05:32:23.446007+0000","last_fullsized":"2024-09-17T05:32:23.446007+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.442387+0000","last_change":"2024-09-17T05:32:22.442544+0000","last_active":"2024-09-17T05:32:23.442387+0000","last_peered":"2024-09-17T05:32:23.442387+0000","last_clean":"2024-09-17T05:32:23.442387+0000","last_became_active":"2024-09-17T05:32:22.442203+0000","last_became_peered":"2024-09-17T05:32:22.442203+0000","last_unstale":"2024-09-17T05:32:23.442387+0000","last_undegraded":"2024-09-17T05:32:23.442387+0000","last_fullsized":"2024-09-17T05:32:23.442387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:26.276161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.465351+0000","last_change":"2024-09-17T05:32:23.465208+0000","last_active":"2024-09-17T05:32:23.465351+0000","last_peered":"2024-09-17T05:32:23.465351+0000","last_clean":"2024-09-17T05:32:23.465351+0000","last_became_active":"2024-09-17T05:32:23.464130+0000","last_became_peered":"2024-09-17T05:32:23.464130+0000","last_unstale":"2024-09-17T05:32:23.465351+0000","last_undegraded":"2024-09-17T05:32:23.465351+0000","last_fullsized":"2024-09-17T05:32:23.465351+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:34.358635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.451960+0000","last_change":"2024-09-17T05:32:22.444219+0000","last_active":"2024-09-17T05:32:23.451960+0000","last_peered":"2024-09-17T05:32:23.451960+0000","last_clean":"2024-09-17T05:32:23.451960+0000","last_became_active":"2024-09-17T05:32:22.443959+0000","last_became_peered":"2024-09-17T05:32:22.443959+0000","last_unstale":"2024-09-17T05:32:23.451960+0000","last_undegraded":"2024-09-17T05:32:23.451960+0000","last_fullsized":"2024-09-17T05:32:23.451960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:26.409388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.478213+0000","last_change":"2024-09-17T05:32:23.471900+0000","last_active":"2024-09-17T05:32:23.478213+0000","last_peered":"2024-09-17T05:32:23.478213+0000","last_clean":"2024-09-17T05:32:23.478213+0000","last_became_active":"2024-09-17T05:32:23.471558+0000","last_became_peered":"2024-09-17T05:32:23.471558+0000","last_unstale":"2024-09-17T05:32:23.478213+0000","last_undegraded":"2024-09-17T05:32:23.478213+0000","last_fullsized":"2024-09-17T05:32:23.478213+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:40.127810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.465589+0000","last_change":"2024-09-17T05:32:22.439312+0000","last_active":"2024-09-17T05:32:23.465589+0000","last_peered":"2024-09-17T05:32:23.465589+0000","last_clean":"2024-09-17T05:32:23.465589+0000","last_became_active":"2024-09-17T05:32:22.439065+0000","last_became_peered":"2024-09-17T05:32:22.439065+0000","last_unstale":"2024-09-17T05:32:23.465589+0000","last_undegraded":"2024-09-17T05:32:23.465589+0000","last_fullsized":"2024-09-17T05:32:23.465589+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:12.256435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.470920+0000","last_change":"2024-09-17T05:32:23.466273+0000","last_active":"2024-09-17T05:32:23.470920+0000","last_peered":"2024-09-17T05:32:23.470920+0000","last_clean":"2024-09-17T05:32:23.470920+0000","last_became_active":"2024-09-17T05:32:23.466013+0000","last_became_peered":"2024-09-17T05:32:23.466013+0000","last_unstale":"2024-09-17T05:32:23.470920+0000","last_undegraded":"2024-09-17T05:32:23.470920+0000","last_fullsized":"2024-09-17T05:32:23.470920+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:19.045892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.482953+0000","last_change":"2024-09-17T05:32:22.447454+0000","last_active":"2024-09-17T05:32:23.482953+0000","last_peered":"2024-09-17T05:32:23.482953+0000","last_clean":"2024-09-17T05:32:23.482953+0000","last_became_active":"2024-09-17T05:32:22.447114+0000","last_became_peered":"2024-09-17T05:32:22.447114+0000","last_unstale":"2024-09-17T05:32:23.482953+0000","last_undegraded":"2024-09-17T05:32:23.482953+0000","last_fullsized":"2024-09-17T05:32:23.482953+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:18.910750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.464493+0000","last_change":"2024-09-17T05:32:23.461195+0000","last_active":"2024-09-17T05:32:23.464493+0000","last_peered":"2024-09-17T05:32:23.464493+0000","last_clean":"2024-09-17T05:32:23.464493+0000","last_became_active":"2024-09-17T05:32:23.460907+0000","last_became_peered":"2024-09-17T05:32:23.460907+0000","last_unstale":"2024-09-17T05:32:23.464493+0000","last_undegraded":"2024-09-17T05:32:23.464493+0000","last_fullsized":"2024-09-17T05:32:23.464493+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:03.960942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"68'6","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.484750+0000","last_change":"2024-09-17T05:32:22.445768+0000","last_active":"2024-09-17T05:32:23.484750+0000","last_peered":"2024-09-17T05:32:23.484750+0000","last_clean":"2024-09-17T05:32:23.484750+0000","last_became_active":"2024-09-17T05:32:22.445436+0000","last_became_peered":"2024-09-17T05:32:22.445436+0000","last_unstale":"2024-09-17T05:32:23.484750+0000","last_undegraded":"2024-09-17T05:32:23.484750+0000","last_fullsized":"2024-09-17T05:32:23.484750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:42.876685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.477765+0000","last_change":"2024-09-17T05:32:23.472031+0000","last_active":"2024-09-17T05:32:23.477765+0000","last_peered":"2024-09-17T05:32:23.477765+0000","last_clean":"2024-09-17T05:32:23.477765+0000","last_became_active":"2024-09-17T05:32:23.471718+0000","last_became_peered":"2024-09-17T05:32:23.471718+0000","last_unstale":"2024-09-17T05:32:23.477765+0000","last_undegraded":"2024-09-17T05:32:23.477765+0000","last_fullsized":"2024-09-17T05:32:23.477765+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:55.379210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.481442+0000","last_change":"2024-09-17T05:32:22.444315+0000","last_active":"2024-09-17T05:32:23.481442+0000","last_peered":"2024-09-17T05:32:23.481442+0000","last_clean":"2024-09-17T05:32:23.481442+0000","last_became_active":"2024-09-17T05:32:22.443941+0000","last_became_peered":"2024-09-17T05:32:22.443941+0000","last_unstale":"2024-09-17T05:32:23.481442+0000","last_undegraded":"2024-09-17T05:32:23.481442+0000","last_fullsized":"2024-09-17T05:32:23.481442+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:42.729448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.463785+0000","last_change":"2024-09-17T05:32:23.463690+0000","last_active":"2024-09-17T05:32:23.463785+0000","last_peered":"2024-09-17T05:32:23.463785+0000","last_clean":"2024-09-17T05:32:23.463785+0000","last_became_active":"2024-09-17T05:32:23.463366+0000","last_became_peered":"2024-09-17T05:32:23.463366+0000","last_unstale":"2024-09-17T05:32:23.463785+0000","last_undegraded":"2024-09-17T05:32:23.463785+0000","last_fullsized":"2024-09-17T05:32:23.463785+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:55.837427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.458658+0000","last_change":"2024-09-17T05:32:22.443885+0000","last_active":"2024-09-17T05:32:23.458658+0000","last_peered":"2024-09-17T05:32:23.458658+0000","last_clean":"2024-09-17T05:32:23.458658+0000","last_became_active":"2024-09-17T05:32:22.443550+0000","last_became_peered":"2024-09-17T05:32:22.443550+0000","last_unstale":"2024-09-17T05:32:23.458658+0000","last_undegraded":"2024-09-17T05:32:23.458658+0000","last_fullsized":"2024-09-17T05:32:23.458658+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:30.306584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.445579+0000","last_change":"2024-09-17T05:32:23.445579+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.445579+0000","last_undegraded":"2024-09-17T05:32:23.445579+0000","last_fullsized":"2024-09-17T05:32:23.445579+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.451891+0000","last_change":"2024-09-17T05:32:22.437803+0000","last_active":"2024-09-17T05:32:23.451891+0000","last_peered":"2024-09-17T05:32:23.451891+0000","last_clean":"2024-09-17T05:32:23.451891+0000","last_became_active":"2024-09-17T05:32:22.437197+0000","last_became_peered":"2024-09-17T05:32:22.437197+0000","last_unstale":"2024-09-17T05:32:23.451891+0000","last_undegraded":"2024-09-17T05:32:23.451891+0000","last_fullsized":"2024-09-17T05:32:23.451891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:56.664716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.466991+0000","last_change":"2024-09-17T05:32:23.463878+0000","last_active":"2024-09-17T05:32:23.466991+0000","last_peered":"2024-09-17T05:32:23.466991+0000","last_clean":"2024-09-17T05:32:23.466991+0000","last_became_active":"2024-09-17T05:32:23.463607+0000","last_became_peered":"2024-09-17T05:32:23.463607+0000","last_unstale":"2024-09-17T05:32:23.466991+0000","last_undegraded":"2024-09-17T05:32:23.466991+0000","last_fullsized":"2024-09-17T05:32:23.466991+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:49:48.653310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"68'8","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.485818+0000","last_change":"2024-09-17T05:32:22.445043+0000","last_active":"2024-09-17T05:32:23.485818+0000","last_peered":"2024-09-17T05:32:23.485818+0000","last_clean":"2024-09-17T05:32:23.485818+0000","last_became_active":"2024-09-17T05:32:22.444699+0000","last_became_peered":"2024-09-17T05:32:22.444699+0000","last_unstale":"2024-09-17T05:32:23.485818+0000","last_undegraded":"2024-09-17T05:32:23.485818+0000","last_fullsized":"2024-09-17T05:32:23.485818+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:43.974609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473854+0000","last_change":"2024-09-17T05:32:23.466477+0000","last_active":"2024-09-17T05:32:23.473854+0000","last_peered":"2024-09-17T05:32:23.473854+0000","last_clean":"2024-09-17T05:32:23.473854+0000","last_became_active":"2024-09-17T05:32:23.465510+0000","last_became_peered":"2024-09-17T05:32:23.465510+0000","last_unstale":"2024-09-17T05:32:23.473854+0000","last_undegraded":"2024-09-17T05:32:23.473854+0000","last_fullsized":"2024-09-17T05:32:23.473854+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:55.568809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.486404+0000","last_change":"2024-09-17T05:32:22.444888+0000","last_active":"2024-09-17T05:32:23.486404+0000","last_peered":"2024-09-17T05:32:23.486404+0000","last_clean":"2024-09-17T05:32:23.486404+0000","last_became_active":"2024-09-17T05:32:22.444638+0000","last_became_peered":"2024-09-17T05:32:22.444638+0000","last_unstale":"2024-09-17T05:32:23.486404+0000","last_undegraded":"2024-09-17T05:32:23.486404+0000","last_fullsized":"2024-09-17T05:32:23.486404+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:21.945708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.482877+0000","last_change":"2024-09-17T05:32:23.475204+0000","last_active":"2024-09-17T05:32:23.482877+0000","last_peered":"2024-09-17T05:32:23.482877+0000","last_clean":"2024-09-17T05:32:23.482877+0000","last_became_active":"2024-09-17T05:32:23.474906+0000","last_became_peered":"2024-09-17T05:32:23.474906+0000","last_unstale":"2024-09-17T05:32:23.482877+0000","last_undegraded":"2024-09-17T05:32:23.482877+0000","last_fullsized":"2024-09-17T05:32:23.482877+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:36.033925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.485053+0000","last_change":"2024-09-17T05:32:22.440244+0000","last_active":"2024-09-17T05:32:23.485053+0000","last_peered":"2024-09-17T05:32:23.485053+0000","last_clean":"2024-09-17T05:32:23.485053+0000","last_became_active":"2024-09-17T05:32:22.439691+0000","last_became_peered":"2024-09-17T05:32:22.439691+0000","last_unstale":"2024-09-17T05:32:23.485053+0000","last_undegraded":"2024-09-17T05:32:23.485053+0000","last_fullsized":"2024-09-17T05:32:23.485053+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:09.787784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.479806+0000","last_change":"2024-09-17T05:32:23.471381+0000","last_active":"2024-09-17T05:32:23.479806+0000","last_peered":"2024-09-17T05:32:23.479806+0000","last_clean":"2024-09-17T05:32:23.479806+0000","last_became_active":"2024-09-17T05:32:23.467992+0000","last_became_peered":"2024-09-17T05:32:23.467992+0000","last_unstale":"2024-09-17T05:32:23.479806+0000","last_undegraded":"2024-09-17T05:32:23.479806+0000","last_fullsized":"2024-09-17T05:32:23.479806+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:39.870236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.482302+0000","last_change":"2024-09-17T05:32:22.448369+0000","last_active":"2024-09-17T05:32:23.482302+0000","last_peered":"2024-09-17T05:32:23.482302+0000","last_clean":"2024-09-17T05:32:23.482302+0000","last_became_active":"2024-09-17T05:32:22.448107+0000","last_became_peered":"2024-09-17T05:32:22.448107+0000","last_unstale":"2024-09-17T05:32:23.482302+0000","last_undegraded":"2024-09-17T05:32:23.482302+0000","last_fullsized":"2024-09-17T05:32:23.482302+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:05.167911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.454017+0000","last_change":"2024-09-17T05:32:23.451083+0000","last_active":"2024-09-17T05:32:23.454017+0000","last_peered":"2024-09-17T05:32:23.454017+0000","last_clean":"2024-09-17T05:32:23.454017+0000","last_became_active":"2024-09-17T05:32:23.450733+0000","last_became_peered":"2024-09-17T05:32:23.450733+0000","last_unstale":"2024-09-17T05:32:23.454017+0000","last_undegraded":"2024-09-17T05:32:23.454017+0000","last_fullsized":"2024-09-17T05:32:23.454017+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:39.590687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.458497+0000","last_change":"2024-09-17T05:32:22.446119+0000","last_active":"2024-09-17T05:32:23.458497+0000","last_peered":"2024-09-17T05:32:23.458497+0000","last_clean":"2024-09-17T05:32:23.458497+0000","last_became_active":"2024-09-17T05:32:22.445820+0000","last_became_peered":"2024-09-17T05:32:22.445820+0000","last_unstale":"2024-09-17T05:32:23.458497+0000","last_undegraded":"2024-09-17T05:32:23.458497+0000","last_fullsized":"2024-09-17T05:32:23.458497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:34.362788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.475040+0000","last_change":"2024-09-17T05:32:23.464537+0000","last_active":"2024-09-17T05:32:23.475040+0000","last_peered":"2024-09-17T05:32:23.475040+0000","last_clean":"2024-09-17T05:32:23.475040+0000","last_became_active":"2024-09-17T05:32:23.464309+0000","last_became_peered":"2024-09-17T05:32:23.464309+0000","last_unstale":"2024-09-17T05:32:23.475040+0000","last_undegraded":"2024-09-17T05:32:23.475040+0000","last_fullsized":"2024-09-17T05:32:23.475040+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:08.458240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.457213+0000","last_change":"2024-09-17T05:32:22.440316+0000","last_active":"2024-09-17T05:32:23.457213+0000","last_peered":"2024-09-17T05:32:23.457213+0000","last_clean":"2024-09-17T05:32:23.457213+0000","last_became_active":"2024-09-17T05:32:22.440046+0000","last_became_peered":"2024-09-17T05:32:22.440046+0000","last_unstale":"2024-09-17T05:32:23.457213+0000","last_undegraded":"2024-09-17T05:32:23.457213+0000","last_fullsized":"2024-09-17T05:32:23.457213+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:25.752696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480492+0000","last_change":"2024-09-17T05:32:23.470385+0000","last_active":"2024-09-17T05:32:23.480492+0000","last_peered":"2024-09-17T05:32:23.480492+0000","last_clean":"2024-09-17T05:32:23.480492+0000","last_became_active":"2024-09-17T05:32:23.469912+0000","last_became_peered":"2024-09-17T05:32:23.469912+0000","last_unstale":"2024-09-17T05:32:23.480492+0000","last_undegraded":"2024-09-17T05:32:23.480492+0000","last_fullsized":"2024-09-17T05:32:23.480492+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:12.115473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.452105+0000","last_change":"2024-09-17T05:32:22.437497+0000","last_active":"2024-09-17T05:32:23.452105+0000","last_peered":"2024-09-17T05:32:23.452105+0000","last_clean":"2024-09-17T05:32:23.452105+0000","last_became_active":"2024-09-17T05:32:22.436783+0000","last_became_peered":"2024-09-17T05:32:22.436783+0000","last_unstale":"2024-09-17T05:32:23.452105+0000","last_undegraded":"2024-09-17T05:32:23.452105+0000","last_fullsized":"2024-09-17T05:32:23.452105+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:04.046487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480895+0000","last_change":"2024-09-17T05:32:23.470425+0000","last_active":"2024-09-17T05:32:23.480895+0000","last_peered":"2024-09-17T05:32:23.480895+0000","last_clean":"2024-09-17T05:32:23.480895+0000","last_became_active":"2024-09-17T05:32:23.469891+0000","last_became_peered":"2024-09-17T05:32:23.469891+0000","last_unstale":"2024-09-17T05:32:23.480895+0000","last_undegraded":"2024-09-17T05:32:23.480895+0000","last_fullsized":"2024-09-17T05:32:23.480895+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:45.916717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.447169+0000","last_change":"2024-09-17T05:32:22.434037+0000","last_active":"2024-09-17T05:32:23.447169+0000","last_peered":"2024-09-17T05:32:23.447169+0000","last_clean":"2024-09-17T05:32:23.447169+0000","last_became_active":"2024-09-17T05:32:22.433767+0000","last_became_peered":"2024-09-17T05:32:22.433767+0000","last_unstale":"2024-09-17T05:32:23.447169+0000","last_undegraded":"2024-09-17T05:32:23.447169+0000","last_fullsized":"2024-09-17T05:32:23.447169+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:24.523856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.455666+0000","last_change":"2024-09-17T05:32:23.455529+0000","last_active":"2024-09-17T05:32:23.455666+0000","last_peered":"2024-09-17T05:32:23.455666+0000","last_clean":"2024-09-17T05:32:23.455666+0000","last_became_active":"2024-09-17T05:32:23.455038+0000","last_became_peered":"2024-09-17T05:32:23.455038+0000","last_unstale":"2024-09-17T05:32:23.455666+0000","last_undegraded":"2024-09-17T05:32:23.455666+0000","last_fullsized":"2024-09-17T05:32:23.455666+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:55.837427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.486063+0000","last_change":"2024-09-17T05:32:22.445506+0000","last_active":"2024-09-17T05:32:23.486063+0000","last_peered":"2024-09-17T05:32:23.486063+0000","last_clean":"2024-09-17T05:32:23.486063+0000","last_became_active":"2024-09-17T05:32:22.445248+0000","last_became_peered":"2024-09-17T05:32:22.445248+0000","last_unstale":"2024-09-17T05:32:23.486063+0000","last_undegraded":"2024-09-17T05:32:23.486063+0000","last_fullsized":"2024-09-17T05:32:23.486063+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:55.664704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.463751+0000","last_change":"2024-09-17T05:32:23.463645+0000","last_active":"2024-09-17T05:32:23.463751+0000","last_peered":"2024-09-17T05:32:23.463751+0000","last_clean":"2024-09-17T05:32:23.463751+0000","last_became_active":"2024-09-17T05:32:23.463264+0000","last_became_peered":"2024-09-17T05:32:23.463264+0000","last_unstale":"2024-09-17T05:32:23.463751+0000","last_undegraded":"2024-09-17T05:32:23.463751+0000","last_fullsized":"2024-09-17T05:32:23.463751+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:35.460618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.449981+0000","last_change":"2024-09-17T05:32:22.439185+0000","last_active":"2024-09-17T05:32:23.449981+0000","last_peered":"2024-09-17T05:32:23.449981+0000","last_clean":"2024-09-17T05:32:23.449981+0000","last_became_active":"2024-09-17T05:32:22.438609+0000","last_became_peered":"2024-09-17T05:32:22.438609+0000","last_unstale":"2024-09-17T05:32:23.449981+0000","last_undegraded":"2024-09-17T05:32:23.449981+0000","last_fullsized":"2024-09-17T05:32:23.449981+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:37.675974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.476082+0000","last_change":"2024-09-17T05:32:23.470673+0000","last_active":"2024-09-17T05:32:23.476082+0000","last_peered":"2024-09-17T05:32:23.476082+0000","last_clean":"2024-09-17T05:32:23.476082+0000","last_became_active":"2024-09-17T05:32:23.470407+0000","last_became_peered":"2024-09-17T05:32:23.470407+0000","last_unstale":"2024-09-17T05:32:23.476082+0000","last_undegraded":"2024-09-17T05:32:23.476082+0000","last_fullsized":"2024-09-17T05:32:23.476082+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:47.333726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.442942+0000","last_change":"2024-09-17T05:32:22.439130+0000","last_active":"2024-09-17T05:32:23.442942+0000","last_peered":"2024-09-17T05:32:23.442942+0000","last_clean":"2024-09-17T05:32:23.442942+0000","last_became_active":"2024-09-17T05:32:22.438837+0000","last_became_peered":"2024-09-17T05:32:22.438837+0000","last_unstale":"2024-09-17T05:32:23.442942+0000","last_undegraded":"2024-09-17T05:32:23.442942+0000","last_fullsized":"2024-09-17T05:32:23.442942+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:40.863254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.479737+0000","last_change":"2024-09-17T05:32:23.474389+0000","last_active":"2024-09-17T05:32:23.479737+0000","last_peered":"2024-09-17T05:32:23.479737+0000","last_clean":"2024-09-17T05:32:23.479737+0000","last_became_active":"2024-09-17T05:32:23.474144+0000","last_became_peered":"2024-09-17T05:32:23.474144+0000","last_unstale":"2024-09-17T05:32:23.479737+0000","last_undegraded":"2024-09-17T05:32:23.479737+0000","last_fullsized":"2024-09-17T05:32:23.479737+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:51.755210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.447521+0000","last_change":"2024-09-17T05:32:22.435023+0000","last_active":"2024-09-17T05:32:23.447521+0000","last_peered":"2024-09-17T05:32:23.447521+0000","last_clean":"2024-09-17T05:32:23.447521+0000","last_became_active":"2024-09-17T05:32:22.434768+0000","last_became_peered":"2024-09-17T05:32:22.434768+0000","last_unstale":"2024-09-17T05:32:23.447521+0000","last_undegraded":"2024-09-17T05:32:23.447521+0000","last_fullsized":"2024-09-17T05:32:23.447521+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:08.940581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.468965+0000","last_change":"2024-09-17T05:32:23.464311+0000","last_active":"2024-09-17T05:32:23.468965+0000","last_peered":"2024-09-17T05:32:23.468965+0000","last_clean":"2024-09-17T05:32:23.468965+0000","last_became_active":"2024-09-17T05:32:23.464023+0000","last_became_peered":"2024-09-17T05:32:23.464023+0000","last_unstale":"2024-09-17T05:32:23.468965+0000","last_undegraded":"2024-09-17T05:32:23.468965+0000","last_fullsized":"2024-09-17T05:32:23.468965+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:05.174497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.442715+0000","last_change":"2024-09-17T05:32:22.436649+0000","last_active":"2024-09-17T05:32:23.442715+0000","last_peered":"2024-09-17T05:32:23.442715+0000","last_clean":"2024-09-17T05:32:23.442715+0000","last_became_active":"2024-09-17T05:32:22.436340+0000","last_became_peered":"2024-09-17T05:32:22.436340+0000","last_unstale":"2024-09-17T05:32:23.442715+0000","last_undegraded":"2024-09-17T05:32:23.442715+0000","last_fullsized":"2024-09-17T05:32:23.442715+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:04.748458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473684+0000","last_change":"2024-09-17T05:32:23.467088+0000","last_active":"2024-09-17T05:32:23.473684+0000","last_peered":"2024-09-17T05:32:23.473684+0000","last_clean":"2024-09-17T05:32:23.473684+0000","last_became_active":"2024-09-17T05:32:23.466798+0000","last_became_peered":"2024-09-17T05:32:23.466798+0000","last_unstale":"2024-09-17T05:32:23.473684+0000","last_undegraded":"2024-09-17T05:32:23.473684+0000","last_fullsized":"2024-09-17T05:32:23.473684+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:49.751254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.451783+0000","last_change":"2024-09-17T05:32:22.442505+0000","last_active":"2024-09-17T05:32:23.451783+0000","last_peered":"2024-09-17T05:32:23.451783+0000","last_clean":"2024-09-17T05:32:23.451783+0000","last_became_active":"2024-09-17T05:32:22.442240+0000","last_became_peered":"2024-09-17T05:32:22.442240+0000","last_unstale":"2024-09-17T05:32:23.451783+0000","last_undegraded":"2024-09-17T05:32:23.451783+0000","last_fullsized":"2024-09-17T05:32:23.451783+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:12.027206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480173+0000","last_change":"2024-09-17T05:32:23.478309+0000","last_active":"2024-09-17T05:32:23.480173+0000","last_peered":"2024-09-17T05:32:23.480173+0000","last_clean":"2024-09-17T05:32:23.480173+0000","last_became_active":"2024-09-17T05:32:23.477989+0000","last_became_peered":"2024-09-17T05:32:23.477989+0000","last_unstale":"2024-09-17T05:32:23.480173+0000","last_undegraded":"2024-09-17T05:32:23.480173+0000","last_fullsized":"2024-09-17T05:32:23.480173+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:43.297508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.450565+0000","last_change":"2024-09-17T05:32:22.442119+0000","last_active":"2024-09-17T05:32:23.450565+0000","last_peered":"2024-09-17T05:32:23.450565+0000","last_clean":"2024-09-17T05:32:23.450565+0000","last_became_active":"2024-09-17T05:32:22.441840+0000","last_became_peered":"2024-09-17T05:32:22.441840+0000","last_unstale":"2024-09-17T05:32:23.450565+0000","last_undegraded":"2024-09-17T05:32:23.450565+0000","last_fullsized":"2024-09-17T05:32:23.450565+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:56.189581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473956+0000","last_change":"2024-09-17T05:32:23.468778+0000","last_active":"2024-09-17T05:32:23.473956+0000","last_peered":"2024-09-17T05:32:23.473956+0000","last_clean":"2024-09-17T05:32:23.473956+0000","last_became_active":"2024-09-17T05:32:23.468482+0000","last_became_peered":"2024-09-17T05:32:23.468482+0000","last_unstale":"2024-09-17T05:32:23.473956+0000","last_undegraded":"2024-09-17T05:32:23.473956+0000","last_fullsized":"2024-09-17T05:32:23.473956+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:22.648504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.457134+0000","last_change":"2024-09-17T05:32:22.446841+0000","last_active":"2024-09-17T05:32:23.457134+0000","last_peered":"2024-09-17T05:32:23.457134+0000","last_clean":"2024-09-17T05:32:23.457134+0000","last_became_active":"2024-09-17T05:32:22.446488+0000","last_became_peered":"2024-09-17T05:32:22.446488+0000","last_unstale":"2024-09-17T05:32:23.457134+0000","last_undegraded":"2024-09-17T05:32:23.457134+0000","last_fullsized":"2024-09-17T05:32:23.457134+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:10.048155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480463+0000","last_change":"2024-09-17T05:32:23.469967+0000","last_active":"2024-09-17T05:32:23.480463+0000","last_peered":"2024-09-17T05:32:23.480463+0000","last_clean":"2024-09-17T05:32:23.480463+0000","last_became_active":"2024-09-17T05:32:23.469655+0000","last_became_peered":"2024-09-17T05:32:23.469655+0000","last_unstale":"2024-09-17T05:32:23.480463+0000","last_undegraded":"2024-09-17T05:32:23.480463+0000","last_fullsized":"2024-09-17T05:32:23.480463+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:01.866983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.485605+0000","last_change":"2024-09-17T05:32:22.446879+0000","last_active":"2024-09-17T05:32:23.485605+0000","last_peered":"2024-09-17T05:32:23.485605+0000","last_clean":"2024-09-17T05:32:23.485605+0000","last_became_active":"2024-09-17T05:32:22.446442+0000","last_became_peered":"2024-09-17T05:32:22.446442+0000","last_unstale":"2024-09-17T05:32:23.485605+0000","last_undegraded":"2024-09-17T05:32:23.485605+0000","last_fullsized":"2024-09-17T05:32:23.485605+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:20.314711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":198,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.460171+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:32:23.460171+0000","last_peered":"2024-09-17T05:32:23.460171+0000","last_clean":"2024-09-17T05:32:23.460171+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:32:23.460171+0000","last_undegraded":"2024-09-17T05:32:23.460171+0000","last_fullsized":"2024-09-17T05:32:23.460171+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1421312,"data_stored":932427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":827392,"data_stored":341535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":823296,"data_stored":341513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":827392,"data_stored":341555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":831488,"data_stored":343055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":839680,"data_stored":343671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":806912,"data_stored":334668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542192,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1400832,"data_stored":925036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:32:27.613 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:32:27.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.799+0000 7fda7ae00640 1 -- 172.21.15.31:0/2207484756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda740cd100 msgr2=0x7fda7415a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:27.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.799+0000 7fda7ae00640 1 --2- 172.21.15.31:0/2207484756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda740cd100 0x7fda7415a5d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00a950 tx=0x7fda5c01db40 comp rx=0 tx=0).stop 2024-09-17T05:32:27.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.799+0000 7fda7ae00640 1 -- 172.21.15.31:0/2207484756 shutdown_connections 2024-09-17T05:32:27.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.799+0000 7fda7ae00640 1 --2- 172.21.15.31:0/2207484756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740b2bf0 0x7fda7415ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.799+0000 7fda7ae00640 1 --2- 172.21.15.31:0/2207484756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda740cd100 0x7fda7415a5d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.799+0000 7fda7ae00640 1 -- 172.21.15.31:0/2207484756 >> 172.21.15.31:0/2207484756 conn(0x7fda740b18f0 msgr2=0x7fda740b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:27.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.799+0000 7fda7ae00640 1 -- 172.21.15.31:0/2207484756 shutdown_connections 2024-09-17T05:32:27.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.799+0000 7fda7ae00640 1 -- 172.21.15.31:0/2207484756 wait complete. 2024-09-17T05:32:27.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.799+0000 7fda7ae00640 1 Processor -- start 2024-09-17T05:32:27.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.799+0000 7fda7ae00640 1 -- start start 2024-09-17T05:32:27.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda7ae00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740b2bf0 0x7fda74158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:27.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda7ae00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda740b43d0 0x7fda7409b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:27.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda7ae00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda740cd100 0x7fda7409b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:27.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda7ae00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fda741670b0 con 0x7fda740cd100 2024-09-17T05:32:27.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda7ae00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fda7415b7f0 con 0x7fda740b43d0 2024-09-17T05:32:27.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda7ae00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fda74167230 con 0x7fda740b2bf0 2024-09-17T05:32:27.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda73e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740b2bf0 0x7fda74158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:27.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda78e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda740cd100 0x7fda7409b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:27.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda73e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740b2bf0 0x7fda74158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:60478/0 (socket says 172.21.15.31:60478) 2024-09-17T05:32:27.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda73e00640 1 -- 172.21.15.31:0/2118161401 learned_addr learned my addr 172.21.15.31:0/2118161401 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:27.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda6b400640 1 --2- 172.21.15.31:0/2118161401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda740b43d0 0x7fda7409b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:27.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda78e00640 1 -- 172.21.15.31:0/2118161401 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740b2bf0 msgr2=0x7fda74158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:27.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda78e00640 1 --2- 172.21.15.31:0/2118161401 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740b2bf0 0x7fda74158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda78e00640 1 -- 172.21.15.31:0/2118161401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda740b43d0 msgr2=0x7fda7409b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:27.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda78e00640 1 --2- 172.21.15.31:0/2118161401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda740b43d0 0x7fda7409b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:27.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda78e00640 1 -- 172.21.15.31:0/2118161401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7409aa10 con 0x7fda740cd100 2024-09-17T05:32:27.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda78e00640 1 --2- 172.21.15.31:0/2118161401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda740cd100 0x7fda7409b840 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00ec80 tx=0x7fda6c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:27.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda70c00640 1 -- 172.21.15.31:0/2118161401 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c003b80 con 0x7fda740cd100 2024-09-17T05:32:27.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda70c00640 1 -- 172.21.15.31:0/2118161401 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda6c00ee90 con 0x7fda740cd100 2024-09-17T05:32:27.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda70c00640 1 -- 172.21.15.31:0/2118161401 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c004020 con 0x7fda740cd100 2024-09-17T05:32:27.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda7ae00640 1 -- 172.21.15.31:0/2118161401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda7409d620 con 0x7fda740cd100 2024-09-17T05:32:27.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda7ae00640 1 -- 172.21.15.31:0/2118161401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda7409acd0 con 0x7fda740cd100 2024-09-17T05:32:27.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.803+0000 7fda7ae00640 1 -- 172.21.15.31:0/2118161401 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda7409b000 con 0x7fda740cd100 2024-09-17T05:32:27.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.807+0000 7fda70c00640 1 -- 172.21.15.31:0/2118161401 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7fda6c0041c0 con 0x7fda740cd100 2024-09-17T05:32:27.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.807+0000 7fda70c00640 1 --2- 172.21.15.31:0/2118161401 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fda50073590 0x7fda50075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:27.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.807+0000 7fda70c00640 1 -- 172.21.15.31:0/2118161401 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fda6c095480 con 0x7fda740cd100 2024-09-17T05:32:27.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.807+0000 7fda73e00640 1 --2- 172.21.15.31:0/2118161401 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fda50073590 0x7fda50075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:27.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.807+0000 7fda73e00640 1 --2- 172.21.15.31:0/2118161401 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fda50073590 0x7fda50075a50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fda640019d0 tx=0x7fda640014e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:27.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.811+0000 7fda70c00640 1 -- 172.21.15.31:0/2118161401 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fda6c05f880 con 0x7fda740cd100 2024-09-17T05:32:27.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.991+0000 7fda7ae00640 1 -- 172.21.15.31:0/2118161401 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda7409d3d0 con 0x7fda50073590 2024-09-17T05:32:27.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.995+0000 7fda70c00640 1 -- 172.21.15.31:0/2118161401 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251685 (secure 0 0 0) 0x7fda7409d3d0 con 0x7fda50073590 2024-09-17T05:32:28.007 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:28.009 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:32:28.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.999+0000 7fda7ae00640 1 -- 172.21.15.31:0/2118161401 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fda50073590 msgr2=0x7fda50075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:28.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.999+0000 7fda7ae00640 1 --2- 172.21.15.31:0/2118161401 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fda50073590 0x7fda50075a50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fda640019d0 tx=0x7fda640014e0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.999+0000 7fda7ae00640 1 -- 172.21.15.31:0/2118161401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda740cd100 msgr2=0x7fda7409b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:28.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.999+0000 7fda7ae00640 1 --2- 172.21.15.31:0/2118161401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda740cd100 0x7fda7409b840 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00ec80 tx=0x7fda6c00c6a0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.999+0000 7fda7ae00640 1 -- 172.21.15.31:0/2118161401 shutdown_connections 2024-09-17T05:32:28.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.999+0000 7fda7ae00640 1 --2- 172.21.15.31:0/2118161401 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fda50073590 0x7fda50075a50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.999+0000 7fda7ae00640 1 --2- 172.21.15.31:0/2118161401 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda740cd100 0x7fda7409b840 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.999+0000 7fda7ae00640 1 --2- 172.21.15.31:0/2118161401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda740b43d0 0x7fda7409b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.999+0000 7fda7ae00640 1 --2- 172.21.15.31:0/2118161401 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fda740b2bf0 0x7fda74158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.999+0000 7fda7ae00640 1 -- 172.21.15.31:0/2118161401 >> 172.21.15.31:0/2118161401 conn(0x7fda740b18f0 msgr2=0x7fda7406f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:28.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.999+0000 7fda7ae00640 1 -- 172.21.15.31:0/2118161401 shutdown_connections 2024-09-17T05:32:28.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:27.999+0000 7fda7ae00640 1 -- 172.21.15.31:0/2118161401 wait complete. 2024-09-17T05:32:28.020 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-17T05:32:27.235119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257148,"kb_used_data":7596,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717572,"statfs":{"total":773094113280,"available":772830793728,"internally_reserved":0,"allocated":7778304,"data_stored":3903460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.811793"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.483669+0000","last_change":"2024-09-17T05:32:23.478099+0000","last_active":"2024-09-17T05:32:23.483669+0000","last_peered":"2024-09-17T05:32:23.483669+0000","last_clean":"2024-09-17T05:32:23.483669+0000","last_became_active":"2024-09-17T05:32:23.477783+0000","last_became_peered":"2024-09-17T05:32:23.477783+0000","last_unstale":"2024-09-17T05:32:23.483669+0000","last_undegraded":"2024-09-17T05:32:23.483669+0000","last_fullsized":"2024-09-17T05:32:23.483669+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:54.629625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.470848+0000","last_change":"2024-09-17T05:32:23.466050+0000","last_active":"2024-09-17T05:32:23.470848+0000","last_peered":"2024-09-17T05:32:23.470848+0000","last_clean":"2024-09-17T05:32:23.470848+0000","last_became_active":"2024-09-17T05:32:23.465791+0000","last_became_peered":"2024-09-17T05:32:23.465791+0000","last_unstale":"2024-09-17T05:32:23.470848+0000","last_undegraded":"2024-09-17T05:32:23.470848+0000","last_fullsized":"2024-09-17T05:32:23.470848+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:15.060077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.471942+0000","last_change":"2024-09-17T05:32:23.462418+0000","last_active":"2024-09-17T05:32:23.471942+0000","last_peered":"2024-09-17T05:32:23.471942+0000","last_clean":"2024-09-17T05:32:23.471942+0000","last_became_active":"2024-09-17T05:32:23.462073+0000","last_became_peered":"2024-09-17T05:32:23.462073+0000","last_unstale":"2024-09-17T05:32:23.471942+0000","last_undegraded":"2024-09-17T05:32:23.471942+0000","last_fullsized":"2024-09-17T05:32:23.471942+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:13.497447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480064+0000","last_change":"2024-09-17T05:32:23.472699+0000","last_active":"2024-09-17T05:32:23.480064+0000","last_peered":"2024-09-17T05:32:23.480064+0000","last_clean":"2024-09-17T05:32:23.480064+0000","last_became_active":"2024-09-17T05:32:23.472411+0000","last_became_peered":"2024-09-17T05:32:23.472411+0000","last_unstale":"2024-09-17T05:32:23.480064+0000","last_undegraded":"2024-09-17T05:32:23.480064+0000","last_fullsized":"2024-09-17T05:32:23.480064+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:09.476752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.467020+0000","last_change":"2024-09-17T05:32:23.464155+0000","last_active":"2024-09-17T05:32:23.467020+0000","last_peered":"2024-09-17T05:32:23.467020+0000","last_clean":"2024-09-17T05:32:23.467020+0000","last_became_active":"2024-09-17T05:32:23.463865+0000","last_became_peered":"2024-09-17T05:32:23.463865+0000","last_unstale":"2024-09-17T05:32:23.467020+0000","last_undegraded":"2024-09-17T05:32:23.467020+0000","last_fullsized":"2024-09-17T05:32:23.467020+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:58.569472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.470614+0000","last_change":"2024-09-17T05:32:23.464707+0000","last_active":"2024-09-17T05:32:23.470614+0000","last_peered":"2024-09-17T05:32:23.470614+0000","last_clean":"2024-09-17T05:32:23.470614+0000","last_became_active":"2024-09-17T05:32:23.463900+0000","last_became_peered":"2024-09-17T05:32:23.463900+0000","last_unstale":"2024-09-17T05:32:23.470614+0000","last_undegraded":"2024-09-17T05:32:23.470614+0000","last_fullsized":"2024-09-17T05:32:23.470614+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:56.865390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.449875+0000","last_change":"2024-09-17T05:32:23.449875+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.449875+0000","last_undegraded":"2024-09-17T05:32:23.449875+0000","last_fullsized":"2024-09-17T05:32:23.449875+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473975+0000","last_change":"2024-09-17T05:32:23.468848+0000","last_active":"2024-09-17T05:32:23.473975+0000","last_peered":"2024-09-17T05:32:23.473975+0000","last_clean":"2024-09-17T05:32:23.473975+0000","last_became_active":"2024-09-17T05:32:23.468572+0000","last_became_peered":"2024-09-17T05:32:23.468572+0000","last_unstale":"2024-09-17T05:32:23.473975+0000","last_undegraded":"2024-09-17T05:32:23.473975+0000","last_fullsized":"2024-09-17T05:32:23.473975+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:06.450308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.478480+0000","last_change":"2024-09-17T05:32:23.474102+0000","last_active":"2024-09-17T05:32:23.478480+0000","last_peered":"2024-09-17T05:32:23.478480+0000","last_clean":"2024-09-17T05:32:23.478480+0000","last_became_active":"2024-09-17T05:32:23.473811+0000","last_became_peered":"2024-09-17T05:32:23.473811+0000","last_unstale":"2024-09-17T05:32:23.478480+0000","last_undegraded":"2024-09-17T05:32:23.478480+0000","last_fullsized":"2024-09-17T05:32:23.478480+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:19.579976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.468934+0000","last_change":"2024-09-17T05:32:23.459987+0000","last_active":"2024-09-17T05:32:23.468934+0000","last_peered":"2024-09-17T05:32:23.468934+0000","last_clean":"2024-09-17T05:32:23.468934+0000","last_became_active":"2024-09-17T05:32:23.459724+0000","last_became_peered":"2024-09-17T05:32:23.459724+0000","last_unstale":"2024-09-17T05:32:23.468934+0000","last_undegraded":"2024-09-17T05:32:23.468934+0000","last_fullsized":"2024-09-17T05:32:23.468934+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:45.173792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.483633+0000","last_change":"2024-09-17T05:32:23.477839+0000","last_active":"2024-09-17T05:32:23.483633+0000","last_peered":"2024-09-17T05:32:23.483633+0000","last_clean":"2024-09-17T05:32:23.483633+0000","last_became_active":"2024-09-17T05:32:23.477026+0000","last_became_peered":"2024-09-17T05:32:23.477026+0000","last_unstale":"2024-09-17T05:32:23.483633+0000","last_undegraded":"2024-09-17T05:32:23.483633+0000","last_fullsized":"2024-09-17T05:32:23.483633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.059346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.479654+0000","last_change":"2024-09-17T05:32:23.468520+0000","last_active":"2024-09-17T05:32:23.479654+0000","last_peered":"2024-09-17T05:32:23.479654+0000","last_clean":"2024-09-17T05:32:23.479654+0000","last_became_active":"2024-09-17T05:32:23.467246+0000","last_became_peered":"2024-09-17T05:32:23.467246+0000","last_unstale":"2024-09-17T05:32:23.479654+0000","last_undegraded":"2024-09-17T05:32:23.479654+0000","last_fullsized":"2024-09-17T05:32:23.479654+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:18.486564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.445701+0000","last_change":"2024-09-17T05:32:23.445701+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.445701+0000","last_undegraded":"2024-09-17T05:32:23.445701+0000","last_fullsized":"2024-09-17T05:32:23.445701+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.457059+0000","last_change":"2024-09-17T05:32:23.452918+0000","last_active":"2024-09-17T05:32:23.457059+0000","last_peered":"2024-09-17T05:32:23.457059+0000","last_clean":"2024-09-17T05:32:23.457059+0000","last_became_active":"2024-09-17T05:32:23.452665+0000","last_became_peered":"2024-09-17T05:32:23.452665+0000","last_unstale":"2024-09-17T05:32:23.457059+0000","last_undegraded":"2024-09-17T05:32:23.457059+0000","last_fullsized":"2024-09-17T05:32:23.457059+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:23.842414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.455656+0000","last_change":"2024-09-17T05:32:23.455539+0000","last_active":"2024-09-17T05:32:23.455656+0000","last_peered":"2024-09-17T05:32:23.455656+0000","last_clean":"2024-09-17T05:32:23.455656+0000","last_became_active":"2024-09-17T05:32:23.455242+0000","last_became_peered":"2024-09-17T05:32:23.455242+0000","last_unstale":"2024-09-17T05:32:23.455656+0000","last_undegraded":"2024-09-17T05:32:23.455656+0000","last_fullsized":"2024-09-17T05:32:23.455656+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:39.377948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473890+0000","last_change":"2024-09-17T05:32:23.472186+0000","last_active":"2024-09-17T05:32:23.473890+0000","last_peered":"2024-09-17T05:32:23.473890+0000","last_clean":"2024-09-17T05:32:23.473890+0000","last_became_active":"2024-09-17T05:32:23.471921+0000","last_became_peered":"2024-09-17T05:32:23.471921+0000","last_unstale":"2024-09-17T05:32:23.473890+0000","last_undegraded":"2024-09-17T05:32:23.473890+0000","last_fullsized":"2024-09-17T05:32:23.473890+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:12.674920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.472813+0000","last_change":"2024-09-17T05:32:23.466234+0000","last_active":"2024-09-17T05:32:23.472813+0000","last_peered":"2024-09-17T05:32:23.472813+0000","last_clean":"2024-09-17T05:32:23.472813+0000","last_became_active":"2024-09-17T05:32:23.463638+0000","last_became_peered":"2024-09-17T05:32:23.463638+0000","last_unstale":"2024-09-17T05:32:23.472813+0000","last_undegraded":"2024-09-17T05:32:23.472813+0000","last_fullsized":"2024-09-17T05:32:23.472813+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:08.689729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.477018+0000","last_change":"2024-09-17T05:32:23.468316+0000","last_active":"2024-09-17T05:32:23.477018+0000","last_peered":"2024-09-17T05:32:23.477018+0000","last_clean":"2024-09-17T05:32:23.477018+0000","last_became_active":"2024-09-17T05:32:23.466433+0000","last_became_peered":"2024-09-17T05:32:23.466433+0000","last_unstale":"2024-09-17T05:32:23.477018+0000","last_undegraded":"2024-09-17T05:32:23.477018+0000","last_fullsized":"2024-09-17T05:32:23.477018+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:24.514866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473521+0000","last_change":"2024-09-17T05:32:23.468259+0000","last_active":"2024-09-17T05:32:23.473521+0000","last_peered":"2024-09-17T05:32:23.473521+0000","last_clean":"2024-09-17T05:32:23.473521+0000","last_became_active":"2024-09-17T05:32:23.467985+0000","last_became_peered":"2024-09-17T05:32:23.467985+0000","last_unstale":"2024-09-17T05:32:23.473521+0000","last_undegraded":"2024-09-17T05:32:23.473521+0000","last_fullsized":"2024-09-17T05:32:23.473521+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:12.029625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.459406+0000","last_change":"2024-09-17T05:32:23.452018+0000","last_active":"2024-09-17T05:32:23.459406+0000","last_peered":"2024-09-17T05:32:23.459406+0000","last_clean":"2024-09-17T05:32:23.459406+0000","last_became_active":"2024-09-17T05:32:23.451744+0000","last_became_peered":"2024-09-17T05:32:23.451744+0000","last_unstale":"2024-09-17T05:32:23.459406+0000","last_undegraded":"2024-09-17T05:32:23.459406+0000","last_fullsized":"2024-09-17T05:32:23.459406+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:17.778971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.468094+0000","last_change":"2024-09-17T05:32:23.457509+0000","last_active":"2024-09-17T05:32:23.468094+0000","last_peered":"2024-09-17T05:32:23.468094+0000","last_clean":"2024-09-17T05:32:23.468094+0000","last_became_active":"2024-09-17T05:32:23.457200+0000","last_became_peered":"2024-09-17T05:32:23.457200+0000","last_unstale":"2024-09-17T05:32:23.468094+0000","last_undegraded":"2024-09-17T05:32:23.468094+0000","last_fullsized":"2024-09-17T05:32:23.468094+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:41.594515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.471051+0000","last_change":"2024-09-17T05:32:23.460429+0000","last_active":"2024-09-17T05:32:23.471051+0000","last_peered":"2024-09-17T05:32:23.471051+0000","last_clean":"2024-09-17T05:32:23.471051+0000","last_became_active":"2024-09-17T05:32:23.460146+0000","last_became_peered":"2024-09-17T05:32:23.460146+0000","last_unstale":"2024-09-17T05:32:23.471051+0000","last_undegraded":"2024-09-17T05:32:23.471051+0000","last_fullsized":"2024-09-17T05:32:23.471051+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:34.057105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.482849+0000","last_change":"2024-09-17T05:32:23.475449+0000","last_active":"2024-09-17T05:32:23.482849+0000","last_peered":"2024-09-17T05:32:23.482849+0000","last_clean":"2024-09-17T05:32:23.482849+0000","last_became_active":"2024-09-17T05:32:23.473193+0000","last_became_peered":"2024-09-17T05:32:23.473193+0000","last_unstale":"2024-09-17T05:32:23.482849+0000","last_undegraded":"2024-09-17T05:32:23.482849+0000","last_fullsized":"2024-09-17T05:32:23.482849+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:54.940349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.477490+0000","last_change":"2024-09-17T05:32:23.472118+0000","last_active":"2024-09-17T05:32:23.477490+0000","last_peered":"2024-09-17T05:32:23.477490+0000","last_clean":"2024-09-17T05:32:23.477490+0000","last_became_active":"2024-09-17T05:32:23.469804+0000","last_became_peered":"2024-09-17T05:32:23.469804+0000","last_unstale":"2024-09-17T05:32:23.477490+0000","last_undegraded":"2024-09-17T05:32:23.477490+0000","last_fullsized":"2024-09-17T05:32:23.477490+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:19.190696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.474825+0000","last_change":"2024-09-17T05:32:23.465474+0000","last_active":"2024-09-17T05:32:23.474825+0000","last_peered":"2024-09-17T05:32:23.474825+0000","last_clean":"2024-09-17T05:32:23.474825+0000","last_became_active":"2024-09-17T05:32:23.465096+0000","last_became_peered":"2024-09-17T05:32:23.465096+0000","last_unstale":"2024-09-17T05:32:23.474825+0000","last_undegraded":"2024-09-17T05:32:23.474825+0000","last_fullsized":"2024-09-17T05:32:23.474825+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:03.166416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.448398+0000","last_change":"2024-09-17T05:32:23.448398+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.448398+0000","last_undegraded":"2024-09-17T05:32:23.448398+0000","last_fullsized":"2024-09-17T05:32:23.448398+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.471969+0000","last_change":"2024-09-17T05:32:23.464196+0000","last_active":"2024-09-17T05:32:23.471969+0000","last_peered":"2024-09-17T05:32:23.471969+0000","last_clean":"2024-09-17T05:32:23.471969+0000","last_became_active":"2024-09-17T05:32:23.463865+0000","last_became_peered":"2024-09-17T05:32:23.463865+0000","last_unstale":"2024-09-17T05:32:23.471969+0000","last_undegraded":"2024-09-17T05:32:23.471969+0000","last_fullsized":"2024-09-17T05:32:23.471969+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:58.324158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.469683+0000","last_change":"2024-09-17T05:32:23.461193+0000","last_active":"2024-09-17T05:32:23.469683+0000","last_peered":"2024-09-17T05:32:23.469683+0000","last_clean":"2024-09-17T05:32:23.469683+0000","last_became_active":"2024-09-17T05:32:23.460301+0000","last_became_peered":"2024-09-17T05:32:23.460301+0000","last_unstale":"2024-09-17T05:32:23.469683+0000","last_undegraded":"2024-09-17T05:32:23.469683+0000","last_fullsized":"2024-09-17T05:32:23.469683+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:11.922483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.475072+0000","last_change":"2024-09-17T05:32:23.465238+0000","last_active":"2024-09-17T05:32:23.475072+0000","last_peered":"2024-09-17T05:32:23.475072+0000","last_clean":"2024-09-17T05:32:23.475072+0000","last_became_active":"2024-09-17T05:32:23.464992+0000","last_became_peered":"2024-09-17T05:32:23.464992+0000","last_unstale":"2024-09-17T05:32:23.475072+0000","last_undegraded":"2024-09-17T05:32:23.475072+0000","last_fullsized":"2024-09-17T05:32:23.475072+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:59.312163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.466438+0000","last_change":"2024-09-17T05:32:23.466352+0000","last_active":"2024-09-17T05:32:23.466438+0000","last_peered":"2024-09-17T05:32:23.466438+0000","last_clean":"2024-09-17T05:32:23.466438+0000","last_became_active":"2024-09-17T05:32:23.466088+0000","last_became_peered":"2024-09-17T05:32:23.466088+0000","last_unstale":"2024-09-17T05:32:23.466438+0000","last_undegraded":"2024-09-17T05:32:23.466438+0000","last_fullsized":"2024-09-17T05:32:23.466438+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:19.710897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.460367+0000","last_change":"2024-09-17T05:32:23.460284+0000","last_active":"2024-09-17T05:32:23.460367+0000","last_peered":"2024-09-17T05:32:23.460367+0000","last_clean":"2024-09-17T05:32:23.460367+0000","last_became_active":"2024-09-17T05:32:23.460029+0000","last_became_peered":"2024-09-17T05:32:23.460029+0000","last_unstale":"2024-09-17T05:32:23.460367+0000","last_undegraded":"2024-09-17T05:32:23.460367+0000","last_fullsized":"2024-09-17T05:32:23.460367+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:56.581485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.474001+0000","last_change":"2024-09-17T05:32:23.468929+0000","last_active":"2024-09-17T05:32:23.474001+0000","last_peered":"2024-09-17T05:32:23.474001+0000","last_clean":"2024-09-17T05:32:23.474001+0000","last_became_active":"2024-09-17T05:32:23.468673+0000","last_became_peered":"2024-09-17T05:32:23.468673+0000","last_unstale":"2024-09-17T05:32:23.474001+0000","last_undegraded":"2024-09-17T05:32:23.474001+0000","last_fullsized":"2024-09-17T05:32:23.474001+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:18.518043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.483494+0000","last_change":"2024-09-17T05:32:23.475788+0000","last_active":"2024-09-17T05:32:23.483494+0000","last_peered":"2024-09-17T05:32:23.483494+0000","last_clean":"2024-09-17T05:32:23.483494+0000","last_became_active":"2024-09-17T05:32:23.472518+0000","last_became_peered":"2024-09-17T05:32:23.472518+0000","last_unstale":"2024-09-17T05:32:23.483494+0000","last_undegraded":"2024-09-17T05:32:23.483494+0000","last_fullsized":"2024-09-17T05:32:23.483494+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:39:54.219551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"68'4","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.484400+0000","last_change":"2024-09-17T05:32:22.449344+0000","last_active":"2024-09-17T05:32:23.484400+0000","last_peered":"2024-09-17T05:32:23.484400+0000","last_clean":"2024-09-17T05:32:23.484400+0000","last_became_active":"2024-09-17T05:32:22.449043+0000","last_became_peered":"2024-09-17T05:32:22.449043+0000","last_unstale":"2024-09-17T05:32:23.484400+0000","last_undegraded":"2024-09-17T05:32:23.484400+0000","last_fullsized":"2024-09-17T05:32:23.484400+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:33.407326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.478453+0000","last_change":"2024-09-17T05:32:23.472207+0000","last_active":"2024-09-17T05:32:23.478453+0000","last_peered":"2024-09-17T05:32:23.478453+0000","last_clean":"2024-09-17T05:32:23.478453+0000","last_became_active":"2024-09-17T05:32:23.468121+0000","last_became_peered":"2024-09-17T05:32:23.468121+0000","last_unstale":"2024-09-17T05:32:23.478453+0000","last_undegraded":"2024-09-17T05:32:23.478453+0000","last_fullsized":"2024-09-17T05:32:23.478453+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:15.616404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.448120+0000","last_change":"2024-09-17T05:32:22.441202+0000","last_active":"2024-09-17T05:32:23.448120+0000","last_peered":"2024-09-17T05:32:23.448120+0000","last_clean":"2024-09-17T05:32:23.448120+0000","last_became_active":"2024-09-17T05:32:22.440289+0000","last_became_peered":"2024-09-17T05:32:22.440289+0000","last_unstale":"2024-09-17T05:32:23.448120+0000","last_undegraded":"2024-09-17T05:32:23.448120+0000","last_fullsized":"2024-09-17T05:32:23.448120+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:02:57.086704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.474106+0000","last_change":"2024-09-17T05:32:23.467839+0000","last_active":"2024-09-17T05:32:23.474106+0000","last_peered":"2024-09-17T05:32:23.474106+0000","last_clean":"2024-09-17T05:32:23.474106+0000","last_became_active":"2024-09-17T05:32:23.466456+0000","last_became_peered":"2024-09-17T05:32:23.466456+0000","last_unstale":"2024-09-17T05:32:23.474106+0000","last_undegraded":"2024-09-17T05:32:23.474106+0000","last_fullsized":"2024-09-17T05:32:23.474106+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:42.687907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.484999+0000","last_change":"2024-09-17T05:32:22.448229+0000","last_active":"2024-09-17T05:32:23.484999+0000","last_peered":"2024-09-17T05:32:23.484999+0000","last_clean":"2024-09-17T05:32:23.484999+0000","last_became_active":"2024-09-17T05:32:22.447966+0000","last_became_peered":"2024-09-17T05:32:22.447966+0000","last_unstale":"2024-09-17T05:32:23.484999+0000","last_undegraded":"2024-09-17T05:32:23.484999+0000","last_fullsized":"2024-09-17T05:32:23.484999+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:10.281440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.479763+0000","last_change":"2024-09-17T05:32:23.471383+0000","last_active":"2024-09-17T05:32:23.479763+0000","last_peered":"2024-09-17T05:32:23.479763+0000","last_clean":"2024-09-17T05:32:23.479763+0000","last_became_active":"2024-09-17T05:32:23.471094+0000","last_became_peered":"2024-09-17T05:32:23.471094+0000","last_unstale":"2024-09-17T05:32:23.479763+0000","last_undegraded":"2024-09-17T05:32:23.479763+0000","last_fullsized":"2024-09-17T05:32:23.479763+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:29.296974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.485829+0000","last_change":"2024-09-17T05:32:22.447167+0000","last_active":"2024-09-17T05:32:23.485829+0000","last_peered":"2024-09-17T05:32:23.485829+0000","last_clean":"2024-09-17T05:32:23.485829+0000","last_became_active":"2024-09-17T05:32:22.446419+0000","last_became_peered":"2024-09-17T05:32:22.446419+0000","last_unstale":"2024-09-17T05:32:23.485829+0000","last_undegraded":"2024-09-17T05:32:23.485829+0000","last_fullsized":"2024-09-17T05:32:23.485829+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:25.949036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.463055+0000","last_change":"2024-09-17T05:32:23.462966+0000","last_active":"2024-09-17T05:32:23.463055+0000","last_peered":"2024-09-17T05:32:23.463055+0000","last_clean":"2024-09-17T05:32:23.463055+0000","last_became_active":"2024-09-17T05:32:23.462122+0000","last_became_peered":"2024-09-17T05:32:23.462122+0000","last_unstale":"2024-09-17T05:32:23.463055+0000","last_undegraded":"2024-09-17T05:32:23.463055+0000","last_fullsized":"2024-09-17T05:32:23.463055+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:31.757931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.481776+0000","last_change":"2024-09-17T05:32:22.442701+0000","last_active":"2024-09-17T05:32:23.481776+0000","last_peered":"2024-09-17T05:32:23.481776+0000","last_clean":"2024-09-17T05:32:23.481776+0000","last_became_active":"2024-09-17T05:32:22.442400+0000","last_became_peered":"2024-09-17T05:32:22.442400+0000","last_unstale":"2024-09-17T05:32:23.481776+0000","last_undegraded":"2024-09-17T05:32:23.481776+0000","last_fullsized":"2024-09-17T05:32:23.481776+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:53.105004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473924+0000","last_change":"2024-09-17T05:32:23.467226+0000","last_active":"2024-09-17T05:32:23.473924+0000","last_peered":"2024-09-17T05:32:23.473924+0000","last_clean":"2024-09-17T05:32:23.473924+0000","last_became_active":"2024-09-17T05:32:23.466942+0000","last_became_peered":"2024-09-17T05:32:23.466942+0000","last_unstale":"2024-09-17T05:32:23.473924+0000","last_undegraded":"2024-09-17T05:32:23.473924+0000","last_fullsized":"2024-09-17T05:32:23.473924+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:23.653085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480082+0000","last_change":"2024-09-17T05:32:22.442678+0000","last_active":"2024-09-17T05:32:23.480082+0000","last_peered":"2024-09-17T05:32:23.480082+0000","last_clean":"2024-09-17T05:32:23.480082+0000","last_became_active":"2024-09-17T05:32:22.442378+0000","last_became_peered":"2024-09-17T05:32:22.442378+0000","last_unstale":"2024-09-17T05:32:23.480082+0000","last_undegraded":"2024-09-17T05:32:23.480082+0000","last_fullsized":"2024-09-17T05:32:23.480082+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:06.575195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.453952+0000","last_change":"2024-09-17T05:32:23.451743+0000","last_active":"2024-09-17T05:32:23.453952+0000","last_peered":"2024-09-17T05:32:23.453952+0000","last_clean":"2024-09-17T05:32:23.453952+0000","last_became_active":"2024-09-17T05:32:23.449774+0000","last_became_peered":"2024-09-17T05:32:23.449774+0000","last_unstale":"2024-09-17T05:32:23.453952+0000","last_undegraded":"2024-09-17T05:32:23.453952+0000","last_fullsized":"2024-09-17T05:32:23.453952+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:07.226176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.450557+0000","last_change":"2024-09-17T05:32:22.442622+0000","last_active":"2024-09-17T05:32:23.450557+0000","last_peered":"2024-09-17T05:32:23.450557+0000","last_clean":"2024-09-17T05:32:23.450557+0000","last_became_active":"2024-09-17T05:32:22.442317+0000","last_became_peered":"2024-09-17T05:32:22.442317+0000","last_unstale":"2024-09-17T05:32:23.450557+0000","last_undegraded":"2024-09-17T05:32:23.450557+0000","last_fullsized":"2024-09-17T05:32:23.450557+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:52.807454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.446007+0000","last_change":"2024-09-17T05:32:23.446007+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.446007+0000","last_undegraded":"2024-09-17T05:32:23.446007+0000","last_fullsized":"2024-09-17T05:32:23.446007+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.442387+0000","last_change":"2024-09-17T05:32:22.442544+0000","last_active":"2024-09-17T05:32:23.442387+0000","last_peered":"2024-09-17T05:32:23.442387+0000","last_clean":"2024-09-17T05:32:23.442387+0000","last_became_active":"2024-09-17T05:32:22.442203+0000","last_became_peered":"2024-09-17T05:32:22.442203+0000","last_unstale":"2024-09-17T05:32:23.442387+0000","last_undegraded":"2024-09-17T05:32:23.442387+0000","last_fullsized":"2024-09-17T05:32:23.442387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:26.276161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.465351+0000","last_change":"2024-09-17T05:32:23.465208+0000","last_active":"2024-09-17T05:32:23.465351+0000","last_peered":"2024-09-17T05:32:23.465351+0000","last_clean":"2024-09-17T05:32:23.465351+0000","last_became_active":"2024-09-17T05:32:23.464130+0000","last_became_peered":"2024-09-17T05:32:23.464130+0000","last_unstale":"2024-09-17T05:32:23.465351+0000","last_undegraded":"2024-09-17T05:32:23.465351+0000","last_fullsized":"2024-09-17T05:32:23.465351+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:34.358635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.451960+0000","last_change":"2024-09-17T05:32:22.444219+0000","last_active":"2024-09-17T05:32:23.451960+0000","last_peered":"2024-09-17T05:32:23.451960+0000","last_clean":"2024-09-17T05:32:23.451960+0000","last_became_active":"2024-09-17T05:32:22.443959+0000","last_became_peered":"2024-09-17T05:32:22.443959+0000","last_unstale":"2024-09-17T05:32:23.451960+0000","last_undegraded":"2024-09-17T05:32:23.451960+0000","last_fullsized":"2024-09-17T05:32:23.451960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:26.409388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.478213+0000","last_change":"2024-09-17T05:32:23.471900+0000","last_active":"2024-09-17T05:32:23.478213+0000","last_peered":"2024-09-17T05:32:23.478213+0000","last_clean":"2024-09-17T05:32:23.478213+0000","last_became_active":"2024-09-17T05:32:23.471558+0000","last_became_peered":"2024-09-17T05:32:23.471558+0000","last_unstale":"2024-09-17T05:32:23.478213+0000","last_undegraded":"2024-09-17T05:32:23.478213+0000","last_fullsized":"2024-09-17T05:32:23.478213+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:40.127810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.465589+0000","last_change":"2024-09-17T05:32:22.439312+0000","last_active":"2024-09-17T05:32:23.465589+0000","last_peered":"2024-09-17T05:32:23.465589+0000","last_clean":"2024-09-17T05:32:23.465589+0000","last_became_active":"2024-09-17T05:32:22.439065+0000","last_became_peered":"2024-09-17T05:32:22.439065+0000","last_unstale":"2024-09-17T05:32:23.465589+0000","last_undegraded":"2024-09-17T05:32:23.465589+0000","last_fullsized":"2024-09-17T05:32:23.465589+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:12.256435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.470920+0000","last_change":"2024-09-17T05:32:23.466273+0000","last_active":"2024-09-17T05:32:23.470920+0000","last_peered":"2024-09-17T05:32:23.470920+0000","last_clean":"2024-09-17T05:32:23.470920+0000","last_became_active":"2024-09-17T05:32:23.466013+0000","last_became_peered":"2024-09-17T05:32:23.466013+0000","last_unstale":"2024-09-17T05:32:23.470920+0000","last_undegraded":"2024-09-17T05:32:23.470920+0000","last_fullsized":"2024-09-17T05:32:23.470920+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:19.045892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.482953+0000","last_change":"2024-09-17T05:32:22.447454+0000","last_active":"2024-09-17T05:32:23.482953+0000","last_peered":"2024-09-17T05:32:23.482953+0000","last_clean":"2024-09-17T05:32:23.482953+0000","last_became_active":"2024-09-17T05:32:22.447114+0000","last_became_peered":"2024-09-17T05:32:22.447114+0000","last_unstale":"2024-09-17T05:32:23.482953+0000","last_undegraded":"2024-09-17T05:32:23.482953+0000","last_fullsized":"2024-09-17T05:32:23.482953+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:18.910750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.464493+0000","last_change":"2024-09-17T05:32:23.461195+0000","last_active":"2024-09-17T05:32:23.464493+0000","last_peered":"2024-09-17T05:32:23.464493+0000","last_clean":"2024-09-17T05:32:23.464493+0000","last_became_active":"2024-09-17T05:32:23.460907+0000","last_became_peered":"2024-09-17T05:32:23.460907+0000","last_unstale":"2024-09-17T05:32:23.464493+0000","last_undegraded":"2024-09-17T05:32:23.464493+0000","last_fullsized":"2024-09-17T05:32:23.464493+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:03.960942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"68'6","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.484750+0000","last_change":"2024-09-17T05:32:22.445768+0000","last_active":"2024-09-17T05:32:23.484750+0000","last_peered":"2024-09-17T05:32:23.484750+0000","last_clean":"2024-09-17T05:32:23.484750+0000","last_became_active":"2024-09-17T05:32:22.445436+0000","last_became_peered":"2024-09-17T05:32:22.445436+0000","last_unstale":"2024-09-17T05:32:23.484750+0000","last_undegraded":"2024-09-17T05:32:23.484750+0000","last_fullsized":"2024-09-17T05:32:23.484750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:42.876685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.477765+0000","last_change":"2024-09-17T05:32:23.472031+0000","last_active":"2024-09-17T05:32:23.477765+0000","last_peered":"2024-09-17T05:32:23.477765+0000","last_clean":"2024-09-17T05:32:23.477765+0000","last_became_active":"2024-09-17T05:32:23.471718+0000","last_became_peered":"2024-09-17T05:32:23.471718+0000","last_unstale":"2024-09-17T05:32:23.477765+0000","last_undegraded":"2024-09-17T05:32:23.477765+0000","last_fullsized":"2024-09-17T05:32:23.477765+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:55.379210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.481442+0000","last_change":"2024-09-17T05:32:22.444315+0000","last_active":"2024-09-17T05:32:23.481442+0000","last_peered":"2024-09-17T05:32:23.481442+0000","last_clean":"2024-09-17T05:32:23.481442+0000","last_became_active":"2024-09-17T05:32:22.443941+0000","last_became_peered":"2024-09-17T05:32:22.443941+0000","last_unstale":"2024-09-17T05:32:23.481442+0000","last_undegraded":"2024-09-17T05:32:23.481442+0000","last_fullsized":"2024-09-17T05:32:23.481442+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:42.729448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.463785+0000","last_change":"2024-09-17T05:32:23.463690+0000","last_active":"2024-09-17T05:32:23.463785+0000","last_peered":"2024-09-17T05:32:23.463785+0000","last_clean":"2024-09-17T05:32:23.463785+0000","last_became_active":"2024-09-17T05:32:23.463366+0000","last_became_peered":"2024-09-17T05:32:23.463366+0000","last_unstale":"2024-09-17T05:32:23.463785+0000","last_undegraded":"2024-09-17T05:32:23.463785+0000","last_fullsized":"2024-09-17T05:32:23.463785+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:55.837427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.458658+0000","last_change":"2024-09-17T05:32:22.443885+0000","last_active":"2024-09-17T05:32:23.458658+0000","last_peered":"2024-09-17T05:32:23.458658+0000","last_clean":"2024-09-17T05:32:23.458658+0000","last_became_active":"2024-09-17T05:32:22.443550+0000","last_became_peered":"2024-09-17T05:32:22.443550+0000","last_unstale":"2024-09-17T05:32:23.458658+0000","last_undegraded":"2024-09-17T05:32:23.458658+0000","last_fullsized":"2024-09-17T05:32:23.458658+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:30.306584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.445579+0000","last_change":"2024-09-17T05:32:23.445579+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.445579+0000","last_undegraded":"2024-09-17T05:32:23.445579+0000","last_fullsized":"2024-09-17T05:32:23.445579+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.451891+0000","last_change":"2024-09-17T05:32:22.437803+0000","last_active":"2024-09-17T05:32:23.451891+0000","last_peered":"2024-09-17T05:32:23.451891+0000","last_clean":"2024-09-17T05:32:23.451891+0000","last_became_active":"2024-09-17T05:32:22.437197+0000","last_became_peered":"2024-09-17T05:32:22.437197+0000","last_unstale":"2024-09-17T05:32:23.451891+0000","last_undegraded":"2024-09-17T05:32:23.451891+0000","last_fullsized":"2024-09-17T05:32:23.451891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:56.664716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.466991+0000","last_change":"2024-09-17T05:32:23.463878+0000","last_active":"2024-09-17T05:32:23.466991+0000","last_peered":"2024-09-17T05:32:23.466991+0000","last_clean":"2024-09-17T05:32:23.466991+0000","last_became_active":"2024-09-17T05:32:23.463607+0000","last_became_peered":"2024-09-17T05:32:23.463607+0000","last_unstale":"2024-09-17T05:32:23.466991+0000","last_undegraded":"2024-09-17T05:32:23.466991+0000","last_fullsized":"2024-09-17T05:32:23.466991+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:49:48.653310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"68'8","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.485818+0000","last_change":"2024-09-17T05:32:22.445043+0000","last_active":"2024-09-17T05:32:23.485818+0000","last_peered":"2024-09-17T05:32:23.485818+0000","last_clean":"2024-09-17T05:32:23.485818+0000","last_became_active":"2024-09-17T05:32:22.444699+0000","last_became_peered":"2024-09-17T05:32:22.444699+0000","last_unstale":"2024-09-17T05:32:23.485818+0000","last_undegraded":"2024-09-17T05:32:23.485818+0000","last_fullsized":"2024-09-17T05:32:23.485818+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:43.974609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473854+0000","last_change":"2024-09-17T05:32:23.466477+0000","last_active":"2024-09-17T05:32:23.473854+0000","last_peered":"2024-09-17T05:32:23.473854+0000","last_clean":"2024-09-17T05:32:23.473854+0000","last_became_active":"2024-09-17T05:32:23.465510+0000","last_became_peered":"2024-09-17T05:32:23.465510+0000","last_unstale":"2024-09-17T05:32:23.473854+0000","last_undegraded":"2024-09-17T05:32:23.473854+0000","last_fullsized":"2024-09-17T05:32:23.473854+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:55.568809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.486404+0000","last_change":"2024-09-17T05:32:22.444888+0000","last_active":"2024-09-17T05:32:23.486404+0000","last_peered":"2024-09-17T05:32:23.486404+0000","last_clean":"2024-09-17T05:32:23.486404+0000","last_became_active":"2024-09-17T05:32:22.444638+0000","last_became_peered":"2024-09-17T05:32:22.444638+0000","last_unstale":"2024-09-17T05:32:23.486404+0000","last_undegraded":"2024-09-17T05:32:23.486404+0000","last_fullsized":"2024-09-17T05:32:23.486404+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:21.945708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.482877+0000","last_change":"2024-09-17T05:32:23.475204+0000","last_active":"2024-09-17T05:32:23.482877+0000","last_peered":"2024-09-17T05:32:23.482877+0000","last_clean":"2024-09-17T05:32:23.482877+0000","last_became_active":"2024-09-17T05:32:23.474906+0000","last_became_peered":"2024-09-17T05:32:23.474906+0000","last_unstale":"2024-09-17T05:32:23.482877+0000","last_undegraded":"2024-09-17T05:32:23.482877+0000","last_fullsized":"2024-09-17T05:32:23.482877+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:36.033925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.485053+0000","last_change":"2024-09-17T05:32:22.440244+0000","last_active":"2024-09-17T05:32:23.485053+0000","last_peered":"2024-09-17T05:32:23.485053+0000","last_clean":"2024-09-17T05:32:23.485053+0000","last_became_active":"2024-09-17T05:32:22.439691+0000","last_became_peered":"2024-09-17T05:32:22.439691+0000","last_unstale":"2024-09-17T05:32:23.485053+0000","last_undegraded":"2024-09-17T05:32:23.485053+0000","last_fullsized":"2024-09-17T05:32:23.485053+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:09.787784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.479806+0000","last_change":"2024-09-17T05:32:23.471381+0000","last_active":"2024-09-17T05:32:23.479806+0000","last_peered":"2024-09-17T05:32:23.479806+0000","last_clean":"2024-09-17T05:32:23.479806+0000","last_became_active":"2024-09-17T05:32:23.467992+0000","last_became_peered":"2024-09-17T05:32:23.467992+0000","last_unstale":"2024-09-17T05:32:23.479806+0000","last_undegraded":"2024-09-17T05:32:23.479806+0000","last_fullsized":"2024-09-17T05:32:23.479806+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:39.870236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.482302+0000","last_change":"2024-09-17T05:32:22.448369+0000","last_active":"2024-09-17T05:32:23.482302+0000","last_peered":"2024-09-17T05:32:23.482302+0000","last_clean":"2024-09-17T05:32:23.482302+0000","last_became_active":"2024-09-17T05:32:22.448107+0000","last_became_peered":"2024-09-17T05:32:22.448107+0000","last_unstale":"2024-09-17T05:32:23.482302+0000","last_undegraded":"2024-09-17T05:32:23.482302+0000","last_fullsized":"2024-09-17T05:32:23.482302+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:05.167911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.454017+0000","last_change":"2024-09-17T05:32:23.451083+0000","last_active":"2024-09-17T05:32:23.454017+0000","last_peered":"2024-09-17T05:32:23.454017+0000","last_clean":"2024-09-17T05:32:23.454017+0000","last_became_active":"2024-09-17T05:32:23.450733+0000","last_became_peered":"2024-09-17T05:32:23.450733+0000","last_unstale":"2024-09-17T05:32:23.454017+0000","last_undegraded":"2024-09-17T05:32:23.454017+0000","last_fullsized":"2024-09-17T05:32:23.454017+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:39.590687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.458497+0000","last_change":"2024-09-17T05:32:22.446119+0000","last_active":"2024-09-17T05:32:23.458497+0000","last_peered":"2024-09-17T05:32:23.458497+0000","last_clean":"2024-09-17T05:32:23.458497+0000","last_became_active":"2024-09-17T05:32:22.445820+0000","last_became_peered":"2024-09-17T05:32:22.445820+0000","last_unstale":"2024-09-17T05:32:23.458497+0000","last_undegraded":"2024-09-17T05:32:23.458497+0000","last_fullsized":"2024-09-17T05:32:23.458497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:34.362788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.475040+0000","last_change":"2024-09-17T05:32:23.464537+0000","last_active":"2024-09-17T05:32:23.475040+0000","last_peered":"2024-09-17T05:32:23.475040+0000","last_clean":"2024-09-17T05:32:23.475040+0000","last_became_active":"2024-09-17T05:32:23.464309+0000","last_became_peered":"2024-09-17T05:32:23.464309+0000","last_unstale":"2024-09-17T05:32:23.475040+0000","last_undegraded":"2024-09-17T05:32:23.475040+0000","last_fullsized":"2024-09-17T05:32:23.475040+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:08.458240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.457213+0000","last_change":"2024-09-17T05:32:22.440316+0000","last_active":"2024-09-17T05:32:23.457213+0000","last_peered":"2024-09-17T05:32:23.457213+0000","last_clean":"2024-09-17T05:32:23.457213+0000","last_became_active":"2024-09-17T05:32:22.440046+0000","last_became_peered":"2024-09-17T05:32:22.440046+0000","last_unstale":"2024-09-17T05:32:23.457213+0000","last_undegraded":"2024-09-17T05:32:23.457213+0000","last_fullsized":"2024-09-17T05:32:23.457213+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:25.752696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480492+0000","last_change":"2024-09-17T05:32:23.470385+0000","last_active":"2024-09-17T05:32:23.480492+0000","last_peered":"2024-09-17T05:32:23.480492+0000","last_clean":"2024-09-17T05:32:23.480492+0000","last_became_active":"2024-09-17T05:32:23.469912+0000","last_became_peered":"2024-09-17T05:32:23.469912+0000","last_unstale":"2024-09-17T05:32:23.480492+0000","last_undegraded":"2024-09-17T05:32:23.480492+0000","last_fullsized":"2024-09-17T05:32:23.480492+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:12.115473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.452105+0000","last_change":"2024-09-17T05:32:22.437497+0000","last_active":"2024-09-17T05:32:23.452105+0000","last_peered":"2024-09-17T05:32:23.452105+0000","last_clean":"2024-09-17T05:32:23.452105+0000","last_became_active":"2024-09-17T05:32:22.436783+0000","last_became_peered":"2024-09-17T05:32:22.436783+0000","last_unstale":"2024-09-17T05:32:23.452105+0000","last_undegraded":"2024-09-17T05:32:23.452105+0000","last_fullsized":"2024-09-17T05:32:23.452105+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:04.046487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480895+0000","last_change":"2024-09-17T05:32:23.470425+0000","last_active":"2024-09-17T05:32:23.480895+0000","last_peered":"2024-09-17T05:32:23.480895+0000","last_clean":"2024-09-17T05:32:23.480895+0000","last_became_active":"2024-09-17T05:32:23.469891+0000","last_became_peered":"2024-09-17T05:32:23.469891+0000","last_unstale":"2024-09-17T05:32:23.480895+0000","last_undegraded":"2024-09-17T05:32:23.480895+0000","last_fullsized":"2024-09-17T05:32:23.480895+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:45.916717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.447169+0000","last_change":"2024-09-17T05:32:22.434037+0000","last_active":"2024-09-17T05:32:23.447169+0000","last_peered":"2024-09-17T05:32:23.447169+0000","last_clean":"2024-09-17T05:32:23.447169+0000","last_became_active":"2024-09-17T05:32:22.433767+0000","last_became_peered":"2024-09-17T05:32:22.433767+0000","last_unstale":"2024-09-17T05:32:23.447169+0000","last_undegraded":"2024-09-17T05:32:23.447169+0000","last_fullsized":"2024-09-17T05:32:23.447169+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:24.523856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.455666+0000","last_change":"2024-09-17T05:32:23.455529+0000","last_active":"2024-09-17T05:32:23.455666+0000","last_peered":"2024-09-17T05:32:23.455666+0000","last_clean":"2024-09-17T05:32:23.455666+0000","last_became_active":"2024-09-17T05:32:23.455038+0000","last_became_peered":"2024-09-17T05:32:23.455038+0000","last_unstale":"2024-09-17T05:32:23.455666+0000","last_undegraded":"2024-09-17T05:32:23.455666+0000","last_fullsized":"2024-09-17T05:32:23.455666+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:55.837427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.486063+0000","last_change":"2024-09-17T05:32:22.445506+0000","last_active":"2024-09-17T05:32:23.486063+0000","last_peered":"2024-09-17T05:32:23.486063+0000","last_clean":"2024-09-17T05:32:23.486063+0000","last_became_active":"2024-09-17T05:32:22.445248+0000","last_became_peered":"2024-09-17T05:32:22.445248+0000","last_unstale":"2024-09-17T05:32:23.486063+0000","last_undegraded":"2024-09-17T05:32:23.486063+0000","last_fullsized":"2024-09-17T05:32:23.486063+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:55.664704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.463751+0000","last_change":"2024-09-17T05:32:23.463645+0000","last_active":"2024-09-17T05:32:23.463751+0000","last_peered":"2024-09-17T05:32:23.463751+0000","last_clean":"2024-09-17T05:32:23.463751+0000","last_became_active":"2024-09-17T05:32:23.463264+0000","last_became_peered":"2024-09-17T05:32:23.463264+0000","last_unstale":"2024-09-17T05:32:23.463751+0000","last_undegraded":"2024-09-17T05:32:23.463751+0000","last_fullsized":"2024-09-17T05:32:23.463751+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:35.460618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.449981+0000","last_change":"2024-09-17T05:32:22.439185+0000","last_active":"2024-09-17T05:32:23.449981+0000","last_peered":"2024-09-17T05:32:23.449981+0000","last_clean":"2024-09-17T05:32:23.449981+0000","last_became_active":"2024-09-17T05:32:22.438609+0000","last_became_peered":"2024-09-17T05:32:22.438609+0000","last_unstale":"2024-09-17T05:32:23.449981+0000","last_undegraded":"2024-09-17T05:32:23.449981+0000","last_fullsized":"2024-09-17T05:32:23.449981+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:37.675974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.476082+0000","last_change":"2024-09-17T05:32:23.470673+0000","last_active":"2024-09-17T05:32:23.476082+0000","last_peered":"2024-09-17T05:32:23.476082+0000","last_clean":"2024-09-17T05:32:23.476082+0000","last_became_active":"2024-09-17T05:32:23.470407+0000","last_became_peered":"2024-09-17T05:32:23.470407+0000","last_unstale":"2024-09-17T05:32:23.476082+0000","last_undegraded":"2024-09-17T05:32:23.476082+0000","last_fullsized":"2024-09-17T05:32:23.476082+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:47.333726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.442942+0000","last_change":"2024-09-17T05:32:22.439130+0000","last_active":"2024-09-17T05:32:23.442942+0000","last_peered":"2024-09-17T05:32:23.442942+0000","last_clean":"2024-09-17T05:32:23.442942+0000","last_became_active":"2024-09-17T05:32:22.438837+0000","last_became_peered":"2024-09-17T05:32:22.438837+0000","last_unstale":"2024-09-17T05:32:23.442942+0000","last_undegraded":"2024-09-17T05:32:23.442942+0000","last_fullsized":"2024-09-17T05:32:23.442942+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:40.863254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.479737+0000","last_change":"2024-09-17T05:32:23.474389+0000","last_active":"2024-09-17T05:32:23.479737+0000","last_peered":"2024-09-17T05:32:23.479737+0000","last_clean":"2024-09-17T05:32:23.479737+0000","last_became_active":"2024-09-17T05:32:23.474144+0000","last_became_peered":"2024-09-17T05:32:23.474144+0000","last_unstale":"2024-09-17T05:32:23.479737+0000","last_undegraded":"2024-09-17T05:32:23.479737+0000","last_fullsized":"2024-09-17T05:32:23.479737+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:51.755210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.447521+0000","last_change":"2024-09-17T05:32:22.435023+0000","last_active":"2024-09-17T05:32:23.447521+0000","last_peered":"2024-09-17T05:32:23.447521+0000","last_clean":"2024-09-17T05:32:23.447521+0000","last_became_active":"2024-09-17T05:32:22.434768+0000","last_became_peered":"2024-09-17T05:32:22.434768+0000","last_unstale":"2024-09-17T05:32:23.447521+0000","last_undegraded":"2024-09-17T05:32:23.447521+0000","last_fullsized":"2024-09-17T05:32:23.447521+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:08.940581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.468965+0000","last_change":"2024-09-17T05:32:23.464311+0000","last_active":"2024-09-17T05:32:23.468965+0000","last_peered":"2024-09-17T05:32:23.468965+0000","last_clean":"2024-09-17T05:32:23.468965+0000","last_became_active":"2024-09-17T05:32:23.464023+0000","last_became_peered":"2024-09-17T05:32:23.464023+0000","last_unstale":"2024-09-17T05:32:23.468965+0000","last_undegraded":"2024-09-17T05:32:23.468965+0000","last_fullsized":"2024-09-17T05:32:23.468965+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:05.174497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.442715+0000","last_change":"2024-09-17T05:32:22.436649+0000","last_active":"2024-09-17T05:32:23.442715+0000","last_peered":"2024-09-17T05:32:23.442715+0000","last_clean":"2024-09-17T05:32:23.442715+0000","last_became_active":"2024-09-17T05:32:22.436340+0000","last_became_peered":"2024-09-17T05:32:22.436340+0000","last_unstale":"2024-09-17T05:32:23.442715+0000","last_undegraded":"2024-09-17T05:32:23.442715+0000","last_fullsized":"2024-09-17T05:32:23.442715+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:04.748458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473684+0000","last_change":"2024-09-17T05:32:23.467088+0000","last_active":"2024-09-17T05:32:23.473684+0000","last_peered":"2024-09-17T05:32:23.473684+0000","last_clean":"2024-09-17T05:32:23.473684+0000","last_became_active":"2024-09-17T05:32:23.466798+0000","last_became_peered":"2024-09-17T05:32:23.466798+0000","last_unstale":"2024-09-17T05:32:23.473684+0000","last_undegraded":"2024-09-17T05:32:23.473684+0000","last_fullsized":"2024-09-17T05:32:23.473684+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:49.751254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.451783+0000","last_change":"2024-09-17T05:32:22.442505+0000","last_active":"2024-09-17T05:32:23.451783+0000","last_peered":"2024-09-17T05:32:23.451783+0000","last_clean":"2024-09-17T05:32:23.451783+0000","last_became_active":"2024-09-17T05:32:22.442240+0000","last_became_peered":"2024-09-17T05:32:22.442240+0000","last_unstale":"2024-09-17T05:32:23.451783+0000","last_undegraded":"2024-09-17T05:32:23.451783+0000","last_fullsized":"2024-09-17T05:32:23.451783+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:12.027206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480173+0000","last_change":"2024-09-17T05:32:23.478309+0000","last_active":"2024-09-17T05:32:23.480173+0000","last_peered":"2024-09-17T05:32:23.480173+0000","last_clean":"2024-09-17T05:32:23.480173+0000","last_became_active":"2024-09-17T05:32:23.477989+0000","last_became_peered":"2024-09-17T05:32:23.477989+0000","last_unstale":"2024-09-17T05:32:23.480173+0000","last_undegraded":"2024-09-17T05:32:23.480173+0000","last_fullsized":"2024-09-17T05:32:23.480173+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:43.297508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.450565+0000","last_change":"2024-09-17T05:32:22.442119+0000","last_active":"2024-09-17T05:32:23.450565+0000","last_peered":"2024-09-17T05:32:23.450565+0000","last_clean":"2024-09-17T05:32:23.450565+0000","last_became_active":"2024-09-17T05:32:22.441840+0000","last_became_peered":"2024-09-17T05:32:22.441840+0000","last_unstale":"2024-09-17T05:32:23.450565+0000","last_undegraded":"2024-09-17T05:32:23.450565+0000","last_fullsized":"2024-09-17T05:32:23.450565+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:56.189581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473956+0000","last_change":"2024-09-17T05:32:23.468778+0000","last_active":"2024-09-17T05:32:23.473956+0000","last_peered":"2024-09-17T05:32:23.473956+0000","last_clean":"2024-09-17T05:32:23.473956+0000","last_became_active":"2024-09-17T05:32:23.468482+0000","last_became_peered":"2024-09-17T05:32:23.468482+0000","last_unstale":"2024-09-17T05:32:23.473956+0000","last_undegraded":"2024-09-17T05:32:23.473956+0000","last_fullsized":"2024-09-17T05:32:23.473956+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:22.648504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.457134+0000","last_change":"2024-09-17T05:32:22.446841+0000","last_active":"2024-09-17T05:32:23.457134+0000","last_peered":"2024-09-17T05:32:23.457134+0000","last_clean":"2024-09-17T05:32:23.457134+0000","last_became_active":"2024-09-17T05:32:22.446488+0000","last_became_peered":"2024-09-17T05:32:22.446488+0000","last_unstale":"2024-09-17T05:32:23.457134+0000","last_undegraded":"2024-09-17T05:32:23.457134+0000","last_fullsized":"2024-09-17T05:32:23.457134+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:10.048155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480463+0000","last_change":"2024-09-17T05:32:23.469967+0000","last_active":"2024-09-17T05:32:23.480463+0000","last_peered":"2024-09-17T05:32:23.480463+0000","last_clean":"2024-09-17T05:32:23.480463+0000","last_became_active":"2024-09-17T05:32:23.469655+0000","last_became_peered":"2024-09-17T05:32:23.469655+0000","last_unstale":"2024-09-17T05:32:23.480463+0000","last_undegraded":"2024-09-17T05:32:23.480463+0000","last_fullsized":"2024-09-17T05:32:23.480463+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:01.866983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.485605+0000","last_change":"2024-09-17T05:32:22.446879+0000","last_active":"2024-09-17T05:32:23.485605+0000","last_peered":"2024-09-17T05:32:23.485605+0000","last_clean":"2024-09-17T05:32:23.485605+0000","last_became_active":"2024-09-17T05:32:22.446442+0000","last_became_peered":"2024-09-17T05:32:22.446442+0000","last_unstale":"2024-09-17T05:32:23.485605+0000","last_undegraded":"2024-09-17T05:32:23.485605+0000","last_fullsized":"2024-09-17T05:32:23.485605+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:20.314711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":198,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.460171+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:32:23.460171+0000","last_peered":"2024-09-17T05:32:23.460171+0000","last_clean":"2024-09-17T05:32:23.460171+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:32:23.460171+0000","last_undegraded":"2024-09-17T05:32:23.460171+0000","last_fullsized":"2024-09-17T05:32:23.460171+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1421312,"data_stored":932427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":827392,"data_stored":341535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":823296,"data_stored":341513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":827392,"data_stored":341555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":831488,"data_stored":343055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":839680,"data_stored":343671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":806912,"data_stored":334668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542192,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1400832,"data_stored":925036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:32:28.024 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:32:28.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.207+0000 7f023a800640 1 -- 172.21.15.31:0/3142495514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f023415bd50 msgr2=0x7f02340ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:28.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.207+0000 7f023a800640 1 --2- 172.21.15.31:0/3142495514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f023415bd50 0x7f02340ce5e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0224009840 tx=0x7f022401c700 comp rx=0 tx=0).stop 2024-09-17T05:32:28.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.207+0000 7f023a800640 1 -- 172.21.15.31:0/3142495514 shutdown_connections 2024-09-17T05:32:28.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.207+0000 7f023a800640 1 --2- 172.21.15.31:0/3142495514 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f023415c130 0x7f02340ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.207+0000 7f023a800640 1 --2- 172.21.15.31:0/3142495514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f023415bd50 0x7f02340ce5e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.207+0000 7f023a800640 1 -- 172.21.15.31:0/3142495514 >> 172.21.15.31:0/3142495514 conn(0x7f02340d1ea0 msgr2=0x7f02340d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:28.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.207+0000 7f023a800640 1 -- 172.21.15.31:0/3142495514 shutdown_connections 2024-09-17T05:32:28.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.207+0000 7f023a800640 1 -- 172.21.15.31:0/3142495514 wait complete. 2024-09-17T05:32:28.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.207+0000 7f023a800640 1 Processor -- start 2024-09-17T05:32:28.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.207+0000 7f023a800640 1 -- start start 2024-09-17T05:32:28.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.207+0000 7f023a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02340cf4e0 0x7f0234156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:28.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.207+0000 7f023a800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f023415bd50 0x7f0234154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:28.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.207+0000 7f023a800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f023415c130 0x7f0234154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:28.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.207+0000 7f023a800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0234168e50 con 0x7f02340cf4e0 2024-09-17T05:32:28.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.207+0000 7f023a800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0234168cd0 con 0x7f023415bd50 2024-09-17T05:32:28.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.207+0000 7f023a800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0234168fd0 con 0x7f023415c130 2024-09-17T05:32:28.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f0233400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02340cf4e0 0x7f0234156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:28.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f0233400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02340cf4e0 0x7f0234156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52400/0 (socket says 172.21.15.31:52400) 2024-09-17T05:32:28.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f0233400640 1 -- 172.21.15.31:0/2186861461 learned_addr learned my addr 172.21.15.31:0/2186861461 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:28.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f0233e00640 1 --2- 172.21.15.31:0/2186861461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f023415c130 0x7f0234154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:28.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f022be00640 1 --2- 172.21.15.31:0/2186861461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f023415bd50 0x7f0234154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:28.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f0233400640 1 -- 172.21.15.31:0/2186861461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f023415c130 msgr2=0x7f0234154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:28.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f0233400640 1 --2- 172.21.15.31:0/2186861461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f023415c130 0x7f0234154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f0233400640 1 -- 172.21.15.31:0/2186861461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f023415bd50 msgr2=0x7f0234154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:28.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f0233400640 1 --2- 172.21.15.31:0/2186861461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f023415bd50 0x7f0234154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f0233400640 1 -- 172.21.15.31:0/2186861461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02340cb170 con 0x7f02340cf4e0 2024-09-17T05:32:28.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f022be00640 1 --2- 172.21.15.31:0/2186861461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f023415bd50 0x7f0234154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:28.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f0233400640 1 --2- 172.21.15.31:0/2186861461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02340cf4e0 0x7f0234156a10 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f02240b0040 tx=0x7f02240a66e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:28.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f022b400640 1 -- 172.21.15.31:0/2186861461 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02240be020 con 0x7f02340cf4e0 2024-09-17T05:32:28.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f022b400640 1 -- 172.21.15.31:0/2186861461 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0224003600 con 0x7f02340cf4e0 2024-09-17T05:32:28.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f022b400640 1 -- 172.21.15.31:0/2186861461 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0224003a30 con 0x7f02340cf4e0 2024-09-17T05:32:28.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f023a800640 1 -- 172.21.15.31:0/2186861461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0234159850 con 0x7f02340cf4e0 2024-09-17T05:32:28.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f023a800640 1 -- 172.21.15.31:0/2186861461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02340cb6f0 con 0x7f02340cf4e0 2024-09-17T05:32:28.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f023a800640 1 -- 172.21.15.31:0/2186861461 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02340c5dd0 con 0x7f02340cf4e0 2024-09-17T05:32:28.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.211+0000 7f022b400640 1 -- 172.21.15.31:0/2186861461 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f02240c1020 con 0x7f02340cf4e0 2024-09-17T05:32:28.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.215+0000 7f022b400640 1 --2- 172.21.15.31:0/2186861461 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0210073590 0x7f0210075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:28.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.215+0000 7f022b400640 1 -- 172.21.15.31:0/2186861461 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f022412fc00 con 0x7f02340cf4e0 2024-09-17T05:32:28.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.215+0000 7f022be00640 1 --2- 172.21.15.31:0/2186861461 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0210073590 0x7f0210075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:28.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.215+0000 7f022be00640 1 --2- 172.21.15.31:0/2186861461 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0210073590 0x7f0210075a50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f023409fcb0 tx=0x7f021c00b5b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:28.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.219+0000 7f022b400640 1 -- 172.21.15.31:0/2186861461 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f02240c8030 con 0x7f02340cf4e0 2024-09-17T05:32:28.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.391+0000 7f023a800640 1 -- 172.21.15.31:0/2186861461 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f02340cfca0 con 0x7f0210073590 2024-09-17T05:32:28.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.395+0000 7f022b400640 1 -- 172.21.15.31:0/2186861461 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251685 (secure 0 0 0) 0x7f02340cfca0 con 0x7f0210073590 2024-09-17T05:32:28.399 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:28.400 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:32:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.399+0000 7f023a800640 1 -- 172.21.15.31:0/2186861461 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0210073590 msgr2=0x7f0210075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.399+0000 7f023a800640 1 --2- 172.21.15.31:0/2186861461 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0210073590 0x7f0210075a50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f023409fcb0 tx=0x7f021c00b5b0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.399+0000 7f023a800640 1 -- 172.21.15.31:0/2186861461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02340cf4e0 msgr2=0x7f0234156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.399+0000 7f023a800640 1 --2- 172.21.15.31:0/2186861461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02340cf4e0 0x7f0234156a10 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f02240b0040 tx=0x7f02240a66e0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.399+0000 7f023a800640 1 -- 172.21.15.31:0/2186861461 shutdown_connections 2024-09-17T05:32:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.399+0000 7f023a800640 1 --2- 172.21.15.31:0/2186861461 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f0210073590 0x7f0210075a50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.399+0000 7f023a800640 1 --2- 172.21.15.31:0/2186861461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f023415c130 0x7f0234154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.399+0000 7f023a800640 1 --2- 172.21.15.31:0/2186861461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f023415bd50 0x7f0234154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.399+0000 7f023a800640 1 --2- 172.21.15.31:0/2186861461 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02340cf4e0 0x7f0234156a10 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.399+0000 7f023a800640 1 -- 172.21.15.31:0/2186861461 >> 172.21.15.31:0/2186861461 conn(0x7f02340d1ea0 msgr2=0x7f02340b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.399+0000 7f023a800640 1 -- 172.21.15.31:0/2186861461 shutdown_connections 2024-09-17T05:32:28.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.399+0000 7f023a800640 1 -- 172.21.15.31:0/2186861461 wait complete. 2024-09-17T05:32:28.410 INFO:tasks.ceph.mds.c.smithi031.stderr:2024-09-17T05:32:28.407+0000 7fd18f800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:32:28.419 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-17T05:32:27.235119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257148,"kb_used_data":7596,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717572,"statfs":{"total":773094113280,"available":772830793728,"internally_reserved":0,"allocated":7778304,"data_stored":3903460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.811793"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.483669+0000","last_change":"2024-09-17T05:32:23.478099+0000","last_active":"2024-09-17T05:32:23.483669+0000","last_peered":"2024-09-17T05:32:23.483669+0000","last_clean":"2024-09-17T05:32:23.483669+0000","last_became_active":"2024-09-17T05:32:23.477783+0000","last_became_peered":"2024-09-17T05:32:23.477783+0000","last_unstale":"2024-09-17T05:32:23.483669+0000","last_undegraded":"2024-09-17T05:32:23.483669+0000","last_fullsized":"2024-09-17T05:32:23.483669+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:54.629625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.470848+0000","last_change":"2024-09-17T05:32:23.466050+0000","last_active":"2024-09-17T05:32:23.470848+0000","last_peered":"2024-09-17T05:32:23.470848+0000","last_clean":"2024-09-17T05:32:23.470848+0000","last_became_active":"2024-09-17T05:32:23.465791+0000","last_became_peered":"2024-09-17T05:32:23.465791+0000","last_unstale":"2024-09-17T05:32:23.470848+0000","last_undegraded":"2024-09-17T05:32:23.470848+0000","last_fullsized":"2024-09-17T05:32:23.470848+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:15.060077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.471942+0000","last_change":"2024-09-17T05:32:23.462418+0000","last_active":"2024-09-17T05:32:23.471942+0000","last_peered":"2024-09-17T05:32:23.471942+0000","last_clean":"2024-09-17T05:32:23.471942+0000","last_became_active":"2024-09-17T05:32:23.462073+0000","last_became_peered":"2024-09-17T05:32:23.462073+0000","last_unstale":"2024-09-17T05:32:23.471942+0000","last_undegraded":"2024-09-17T05:32:23.471942+0000","last_fullsized":"2024-09-17T05:32:23.471942+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:13.497447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480064+0000","last_change":"2024-09-17T05:32:23.472699+0000","last_active":"2024-09-17T05:32:23.480064+0000","last_peered":"2024-09-17T05:32:23.480064+0000","last_clean":"2024-09-17T05:32:23.480064+0000","last_became_active":"2024-09-17T05:32:23.472411+0000","last_became_peered":"2024-09-17T05:32:23.472411+0000","last_unstale":"2024-09-17T05:32:23.480064+0000","last_undegraded":"2024-09-17T05:32:23.480064+0000","last_fullsized":"2024-09-17T05:32:23.480064+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:09.476752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.467020+0000","last_change":"2024-09-17T05:32:23.464155+0000","last_active":"2024-09-17T05:32:23.467020+0000","last_peered":"2024-09-17T05:32:23.467020+0000","last_clean":"2024-09-17T05:32:23.467020+0000","last_became_active":"2024-09-17T05:32:23.463865+0000","last_became_peered":"2024-09-17T05:32:23.463865+0000","last_unstale":"2024-09-17T05:32:23.467020+0000","last_undegraded":"2024-09-17T05:32:23.467020+0000","last_fullsized":"2024-09-17T05:32:23.467020+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:58.569472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.470614+0000","last_change":"2024-09-17T05:32:23.464707+0000","last_active":"2024-09-17T05:32:23.470614+0000","last_peered":"2024-09-17T05:32:23.470614+0000","last_clean":"2024-09-17T05:32:23.470614+0000","last_became_active":"2024-09-17T05:32:23.463900+0000","last_became_peered":"2024-09-17T05:32:23.463900+0000","last_unstale":"2024-09-17T05:32:23.470614+0000","last_undegraded":"2024-09-17T05:32:23.470614+0000","last_fullsized":"2024-09-17T05:32:23.470614+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:56.865390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.449875+0000","last_change":"2024-09-17T05:32:23.449875+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.449875+0000","last_undegraded":"2024-09-17T05:32:23.449875+0000","last_fullsized":"2024-09-17T05:32:23.449875+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473975+0000","last_change":"2024-09-17T05:32:23.468848+0000","last_active":"2024-09-17T05:32:23.473975+0000","last_peered":"2024-09-17T05:32:23.473975+0000","last_clean":"2024-09-17T05:32:23.473975+0000","last_became_active":"2024-09-17T05:32:23.468572+0000","last_became_peered":"2024-09-17T05:32:23.468572+0000","last_unstale":"2024-09-17T05:32:23.473975+0000","last_undegraded":"2024-09-17T05:32:23.473975+0000","last_fullsized":"2024-09-17T05:32:23.473975+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:06.450308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.478480+0000","last_change":"2024-09-17T05:32:23.474102+0000","last_active":"2024-09-17T05:32:23.478480+0000","last_peered":"2024-09-17T05:32:23.478480+0000","last_clean":"2024-09-17T05:32:23.478480+0000","last_became_active":"2024-09-17T05:32:23.473811+0000","last_became_peered":"2024-09-17T05:32:23.473811+0000","last_unstale":"2024-09-17T05:32:23.478480+0000","last_undegraded":"2024-09-17T05:32:23.478480+0000","last_fullsized":"2024-09-17T05:32:23.478480+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:19.579976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.468934+0000","last_change":"2024-09-17T05:32:23.459987+0000","last_active":"2024-09-17T05:32:23.468934+0000","last_peered":"2024-09-17T05:32:23.468934+0000","last_clean":"2024-09-17T05:32:23.468934+0000","last_became_active":"2024-09-17T05:32:23.459724+0000","last_became_peered":"2024-09-17T05:32:23.459724+0000","last_unstale":"2024-09-17T05:32:23.468934+0000","last_undegraded":"2024-09-17T05:32:23.468934+0000","last_fullsized":"2024-09-17T05:32:23.468934+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:45.173792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.483633+0000","last_change":"2024-09-17T05:32:23.477839+0000","last_active":"2024-09-17T05:32:23.483633+0000","last_peered":"2024-09-17T05:32:23.483633+0000","last_clean":"2024-09-17T05:32:23.483633+0000","last_became_active":"2024-09-17T05:32:23.477026+0000","last_became_peered":"2024-09-17T05:32:23.477026+0000","last_unstale":"2024-09-17T05:32:23.483633+0000","last_undegraded":"2024-09-17T05:32:23.483633+0000","last_fullsized":"2024-09-17T05:32:23.483633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.059346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.479654+0000","last_change":"2024-09-17T05:32:23.468520+0000","last_active":"2024-09-17T05:32:23.479654+0000","last_peered":"2024-09-17T05:32:23.479654+0000","last_clean":"2024-09-17T05:32:23.479654+0000","last_became_active":"2024-09-17T05:32:23.467246+0000","last_became_peered":"2024-09-17T05:32:23.467246+0000","last_unstale":"2024-09-17T05:32:23.479654+0000","last_undegraded":"2024-09-17T05:32:23.479654+0000","last_fullsized":"2024-09-17T05:32:23.479654+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:18.486564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.445701+0000","last_change":"2024-09-17T05:32:23.445701+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.445701+0000","last_undegraded":"2024-09-17T05:32:23.445701+0000","last_fullsized":"2024-09-17T05:32:23.445701+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.457059+0000","last_change":"2024-09-17T05:32:23.452918+0000","last_active":"2024-09-17T05:32:23.457059+0000","last_peered":"2024-09-17T05:32:23.457059+0000","last_clean":"2024-09-17T05:32:23.457059+0000","last_became_active":"2024-09-17T05:32:23.452665+0000","last_became_peered":"2024-09-17T05:32:23.452665+0000","last_unstale":"2024-09-17T05:32:23.457059+0000","last_undegraded":"2024-09-17T05:32:23.457059+0000","last_fullsized":"2024-09-17T05:32:23.457059+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:23.842414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.455656+0000","last_change":"2024-09-17T05:32:23.455539+0000","last_active":"2024-09-17T05:32:23.455656+0000","last_peered":"2024-09-17T05:32:23.455656+0000","last_clean":"2024-09-17T05:32:23.455656+0000","last_became_active":"2024-09-17T05:32:23.455242+0000","last_became_peered":"2024-09-17T05:32:23.455242+0000","last_unstale":"2024-09-17T05:32:23.455656+0000","last_undegraded":"2024-09-17T05:32:23.455656+0000","last_fullsized":"2024-09-17T05:32:23.455656+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:39.377948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473890+0000","last_change":"2024-09-17T05:32:23.472186+0000","last_active":"2024-09-17T05:32:23.473890+0000","last_peered":"2024-09-17T05:32:23.473890+0000","last_clean":"2024-09-17T05:32:23.473890+0000","last_became_active":"2024-09-17T05:32:23.471921+0000","last_became_peered":"2024-09-17T05:32:23.471921+0000","last_unstale":"2024-09-17T05:32:23.473890+0000","last_undegraded":"2024-09-17T05:32:23.473890+0000","last_fullsized":"2024-09-17T05:32:23.473890+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:12.674920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.472813+0000","last_change":"2024-09-17T05:32:23.466234+0000","last_active":"2024-09-17T05:32:23.472813+0000","last_peered":"2024-09-17T05:32:23.472813+0000","last_clean":"2024-09-17T05:32:23.472813+0000","last_became_active":"2024-09-17T05:32:23.463638+0000","last_became_peered":"2024-09-17T05:32:23.463638+0000","last_unstale":"2024-09-17T05:32:23.472813+0000","last_undegraded":"2024-09-17T05:32:23.472813+0000","last_fullsized":"2024-09-17T05:32:23.472813+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:08.689729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.477018+0000","last_change":"2024-09-17T05:32:23.468316+0000","last_active":"2024-09-17T05:32:23.477018+0000","last_peered":"2024-09-17T05:32:23.477018+0000","last_clean":"2024-09-17T05:32:23.477018+0000","last_became_active":"2024-09-17T05:32:23.466433+0000","last_became_peered":"2024-09-17T05:32:23.466433+0000","last_unstale":"2024-09-17T05:32:23.477018+0000","last_undegraded":"2024-09-17T05:32:23.477018+0000","last_fullsized":"2024-09-17T05:32:23.477018+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:24.514866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473521+0000","last_change":"2024-09-17T05:32:23.468259+0000","last_active":"2024-09-17T05:32:23.473521+0000","last_peered":"2024-09-17T05:32:23.473521+0000","last_clean":"2024-09-17T05:32:23.473521+0000","last_became_active":"2024-09-17T05:32:23.467985+0000","last_became_peered":"2024-09-17T05:32:23.467985+0000","last_unstale":"2024-09-17T05:32:23.473521+0000","last_undegraded":"2024-09-17T05:32:23.473521+0000","last_fullsized":"2024-09-17T05:32:23.473521+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:12.029625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.459406+0000","last_change":"2024-09-17T05:32:23.452018+0000","last_active":"2024-09-17T05:32:23.459406+0000","last_peered":"2024-09-17T05:32:23.459406+0000","last_clean":"2024-09-17T05:32:23.459406+0000","last_became_active":"2024-09-17T05:32:23.451744+0000","last_became_peered":"2024-09-17T05:32:23.451744+0000","last_unstale":"2024-09-17T05:32:23.459406+0000","last_undegraded":"2024-09-17T05:32:23.459406+0000","last_fullsized":"2024-09-17T05:32:23.459406+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:17.778971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.468094+0000","last_change":"2024-09-17T05:32:23.457509+0000","last_active":"2024-09-17T05:32:23.468094+0000","last_peered":"2024-09-17T05:32:23.468094+0000","last_clean":"2024-09-17T05:32:23.468094+0000","last_became_active":"2024-09-17T05:32:23.457200+0000","last_became_peered":"2024-09-17T05:32:23.457200+0000","last_unstale":"2024-09-17T05:32:23.468094+0000","last_undegraded":"2024-09-17T05:32:23.468094+0000","last_fullsized":"2024-09-17T05:32:23.468094+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:41.594515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.471051+0000","last_change":"2024-09-17T05:32:23.460429+0000","last_active":"2024-09-17T05:32:23.471051+0000","last_peered":"2024-09-17T05:32:23.471051+0000","last_clean":"2024-09-17T05:32:23.471051+0000","last_became_active":"2024-09-17T05:32:23.460146+0000","last_became_peered":"2024-09-17T05:32:23.460146+0000","last_unstale":"2024-09-17T05:32:23.471051+0000","last_undegraded":"2024-09-17T05:32:23.471051+0000","last_fullsized":"2024-09-17T05:32:23.471051+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:34.057105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.482849+0000","last_change":"2024-09-17T05:32:23.475449+0000","last_active":"2024-09-17T05:32:23.482849+0000","last_peered":"2024-09-17T05:32:23.482849+0000","last_clean":"2024-09-17T05:32:23.482849+0000","last_became_active":"2024-09-17T05:32:23.473193+0000","last_became_peered":"2024-09-17T05:32:23.473193+0000","last_unstale":"2024-09-17T05:32:23.482849+0000","last_undegraded":"2024-09-17T05:32:23.482849+0000","last_fullsized":"2024-09-17T05:32:23.482849+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:54.940349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.477490+0000","last_change":"2024-09-17T05:32:23.472118+0000","last_active":"2024-09-17T05:32:23.477490+0000","last_peered":"2024-09-17T05:32:23.477490+0000","last_clean":"2024-09-17T05:32:23.477490+0000","last_became_active":"2024-09-17T05:32:23.469804+0000","last_became_peered":"2024-09-17T05:32:23.469804+0000","last_unstale":"2024-09-17T05:32:23.477490+0000","last_undegraded":"2024-09-17T05:32:23.477490+0000","last_fullsized":"2024-09-17T05:32:23.477490+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:19.190696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.474825+0000","last_change":"2024-09-17T05:32:23.465474+0000","last_active":"2024-09-17T05:32:23.474825+0000","last_peered":"2024-09-17T05:32:23.474825+0000","last_clean":"2024-09-17T05:32:23.474825+0000","last_became_active":"2024-09-17T05:32:23.465096+0000","last_became_peered":"2024-09-17T05:32:23.465096+0000","last_unstale":"2024-09-17T05:32:23.474825+0000","last_undegraded":"2024-09-17T05:32:23.474825+0000","last_fullsized":"2024-09-17T05:32:23.474825+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:03.166416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.448398+0000","last_change":"2024-09-17T05:32:23.448398+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.448398+0000","last_undegraded":"2024-09-17T05:32:23.448398+0000","last_fullsized":"2024-09-17T05:32:23.448398+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.471969+0000","last_change":"2024-09-17T05:32:23.464196+0000","last_active":"2024-09-17T05:32:23.471969+0000","last_peered":"2024-09-17T05:32:23.471969+0000","last_clean":"2024-09-17T05:32:23.471969+0000","last_became_active":"2024-09-17T05:32:23.463865+0000","last_became_peered":"2024-09-17T05:32:23.463865+0000","last_unstale":"2024-09-17T05:32:23.471969+0000","last_undegraded":"2024-09-17T05:32:23.471969+0000","last_fullsized":"2024-09-17T05:32:23.471969+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:58.324158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.469683+0000","last_change":"2024-09-17T05:32:23.461193+0000","last_active":"2024-09-17T05:32:23.469683+0000","last_peered":"2024-09-17T05:32:23.469683+0000","last_clean":"2024-09-17T05:32:23.469683+0000","last_became_active":"2024-09-17T05:32:23.460301+0000","last_became_peered":"2024-09-17T05:32:23.460301+0000","last_unstale":"2024-09-17T05:32:23.469683+0000","last_undegraded":"2024-09-17T05:32:23.469683+0000","last_fullsized":"2024-09-17T05:32:23.469683+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:11.922483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.475072+0000","last_change":"2024-09-17T05:32:23.465238+0000","last_active":"2024-09-17T05:32:23.475072+0000","last_peered":"2024-09-17T05:32:23.475072+0000","last_clean":"2024-09-17T05:32:23.475072+0000","last_became_active":"2024-09-17T05:32:23.464992+0000","last_became_peered":"2024-09-17T05:32:23.464992+0000","last_unstale":"2024-09-17T05:32:23.475072+0000","last_undegraded":"2024-09-17T05:32:23.475072+0000","last_fullsized":"2024-09-17T05:32:23.475072+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:59.312163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.466438+0000","last_change":"2024-09-17T05:32:23.466352+0000","last_active":"2024-09-17T05:32:23.466438+0000","last_peered":"2024-09-17T05:32:23.466438+0000","last_clean":"2024-09-17T05:32:23.466438+0000","last_became_active":"2024-09-17T05:32:23.466088+0000","last_became_peered":"2024-09-17T05:32:23.466088+0000","last_unstale":"2024-09-17T05:32:23.466438+0000","last_undegraded":"2024-09-17T05:32:23.466438+0000","last_fullsized":"2024-09-17T05:32:23.466438+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:19.710897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.460367+0000","last_change":"2024-09-17T05:32:23.460284+0000","last_active":"2024-09-17T05:32:23.460367+0000","last_peered":"2024-09-17T05:32:23.460367+0000","last_clean":"2024-09-17T05:32:23.460367+0000","last_became_active":"2024-09-17T05:32:23.460029+0000","last_became_peered":"2024-09-17T05:32:23.460029+0000","last_unstale":"2024-09-17T05:32:23.460367+0000","last_undegraded":"2024-09-17T05:32:23.460367+0000","last_fullsized":"2024-09-17T05:32:23.460367+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:56.581485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.474001+0000","last_change":"2024-09-17T05:32:23.468929+0000","last_active":"2024-09-17T05:32:23.474001+0000","last_peered":"2024-09-17T05:32:23.474001+0000","last_clean":"2024-09-17T05:32:23.474001+0000","last_became_active":"2024-09-17T05:32:23.468673+0000","last_became_peered":"2024-09-17T05:32:23.468673+0000","last_unstale":"2024-09-17T05:32:23.474001+0000","last_undegraded":"2024-09-17T05:32:23.474001+0000","last_fullsized":"2024-09-17T05:32:23.474001+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:18.518043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.483494+0000","last_change":"2024-09-17T05:32:23.475788+0000","last_active":"2024-09-17T05:32:23.483494+0000","last_peered":"2024-09-17T05:32:23.483494+0000","last_clean":"2024-09-17T05:32:23.483494+0000","last_became_active":"2024-09-17T05:32:23.472518+0000","last_became_peered":"2024-09-17T05:32:23.472518+0000","last_unstale":"2024-09-17T05:32:23.483494+0000","last_undegraded":"2024-09-17T05:32:23.483494+0000","last_fullsized":"2024-09-17T05:32:23.483494+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:39:54.219551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"68'4","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.484400+0000","last_change":"2024-09-17T05:32:22.449344+0000","last_active":"2024-09-17T05:32:23.484400+0000","last_peered":"2024-09-17T05:32:23.484400+0000","last_clean":"2024-09-17T05:32:23.484400+0000","last_became_active":"2024-09-17T05:32:22.449043+0000","last_became_peered":"2024-09-17T05:32:22.449043+0000","last_unstale":"2024-09-17T05:32:23.484400+0000","last_undegraded":"2024-09-17T05:32:23.484400+0000","last_fullsized":"2024-09-17T05:32:23.484400+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:33.407326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.478453+0000","last_change":"2024-09-17T05:32:23.472207+0000","last_active":"2024-09-17T05:32:23.478453+0000","last_peered":"2024-09-17T05:32:23.478453+0000","last_clean":"2024-09-17T05:32:23.478453+0000","last_became_active":"2024-09-17T05:32:23.468121+0000","last_became_peered":"2024-09-17T05:32:23.468121+0000","last_unstale":"2024-09-17T05:32:23.478453+0000","last_undegraded":"2024-09-17T05:32:23.478453+0000","last_fullsized":"2024-09-17T05:32:23.478453+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:15.616404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.448120+0000","last_change":"2024-09-17T05:32:22.441202+0000","last_active":"2024-09-17T05:32:23.448120+0000","last_peered":"2024-09-17T05:32:23.448120+0000","last_clean":"2024-09-17T05:32:23.448120+0000","last_became_active":"2024-09-17T05:32:22.440289+0000","last_became_peered":"2024-09-17T05:32:22.440289+0000","last_unstale":"2024-09-17T05:32:23.448120+0000","last_undegraded":"2024-09-17T05:32:23.448120+0000","last_fullsized":"2024-09-17T05:32:23.448120+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:02:57.086704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.474106+0000","last_change":"2024-09-17T05:32:23.467839+0000","last_active":"2024-09-17T05:32:23.474106+0000","last_peered":"2024-09-17T05:32:23.474106+0000","last_clean":"2024-09-17T05:32:23.474106+0000","last_became_active":"2024-09-17T05:32:23.466456+0000","last_became_peered":"2024-09-17T05:32:23.466456+0000","last_unstale":"2024-09-17T05:32:23.474106+0000","last_undegraded":"2024-09-17T05:32:23.474106+0000","last_fullsized":"2024-09-17T05:32:23.474106+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:42.687907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.484999+0000","last_change":"2024-09-17T05:32:22.448229+0000","last_active":"2024-09-17T05:32:23.484999+0000","last_peered":"2024-09-17T05:32:23.484999+0000","last_clean":"2024-09-17T05:32:23.484999+0000","last_became_active":"2024-09-17T05:32:22.447966+0000","last_became_peered":"2024-09-17T05:32:22.447966+0000","last_unstale":"2024-09-17T05:32:23.484999+0000","last_undegraded":"2024-09-17T05:32:23.484999+0000","last_fullsized":"2024-09-17T05:32:23.484999+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:10.281440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.479763+0000","last_change":"2024-09-17T05:32:23.471383+0000","last_active":"2024-09-17T05:32:23.479763+0000","last_peered":"2024-09-17T05:32:23.479763+0000","last_clean":"2024-09-17T05:32:23.479763+0000","last_became_active":"2024-09-17T05:32:23.471094+0000","last_became_peered":"2024-09-17T05:32:23.471094+0000","last_unstale":"2024-09-17T05:32:23.479763+0000","last_undegraded":"2024-09-17T05:32:23.479763+0000","last_fullsized":"2024-09-17T05:32:23.479763+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:29.296974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.485829+0000","last_change":"2024-09-17T05:32:22.447167+0000","last_active":"2024-09-17T05:32:23.485829+0000","last_peered":"2024-09-17T05:32:23.485829+0000","last_clean":"2024-09-17T05:32:23.485829+0000","last_became_active":"2024-09-17T05:32:22.446419+0000","last_became_peered":"2024-09-17T05:32:22.446419+0000","last_unstale":"2024-09-17T05:32:23.485829+0000","last_undegraded":"2024-09-17T05:32:23.485829+0000","last_fullsized":"2024-09-17T05:32:23.485829+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:25.949036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.463055+0000","last_change":"2024-09-17T05:32:23.462966+0000","last_active":"2024-09-17T05:32:23.463055+0000","last_peered":"2024-09-17T05:32:23.463055+0000","last_clean":"2024-09-17T05:32:23.463055+0000","last_became_active":"2024-09-17T05:32:23.462122+0000","last_became_peered":"2024-09-17T05:32:23.462122+0000","last_unstale":"2024-09-17T05:32:23.463055+0000","last_undegraded":"2024-09-17T05:32:23.463055+0000","last_fullsized":"2024-09-17T05:32:23.463055+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:31.757931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.481776+0000","last_change":"2024-09-17T05:32:22.442701+0000","last_active":"2024-09-17T05:32:23.481776+0000","last_peered":"2024-09-17T05:32:23.481776+0000","last_clean":"2024-09-17T05:32:23.481776+0000","last_became_active":"2024-09-17T05:32:22.442400+0000","last_became_peered":"2024-09-17T05:32:22.442400+0000","last_unstale":"2024-09-17T05:32:23.481776+0000","last_undegraded":"2024-09-17T05:32:23.481776+0000","last_fullsized":"2024-09-17T05:32:23.481776+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:53.105004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473924+0000","last_change":"2024-09-17T05:32:23.467226+0000","last_active":"2024-09-17T05:32:23.473924+0000","last_peered":"2024-09-17T05:32:23.473924+0000","last_clean":"2024-09-17T05:32:23.473924+0000","last_became_active":"2024-09-17T05:32:23.466942+0000","last_became_peered":"2024-09-17T05:32:23.466942+0000","last_unstale":"2024-09-17T05:32:23.473924+0000","last_undegraded":"2024-09-17T05:32:23.473924+0000","last_fullsized":"2024-09-17T05:32:23.473924+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:23.653085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480082+0000","last_change":"2024-09-17T05:32:22.442678+0000","last_active":"2024-09-17T05:32:23.480082+0000","last_peered":"2024-09-17T05:32:23.480082+0000","last_clean":"2024-09-17T05:32:23.480082+0000","last_became_active":"2024-09-17T05:32:22.442378+0000","last_became_peered":"2024-09-17T05:32:22.442378+0000","last_unstale":"2024-09-17T05:32:23.480082+0000","last_undegraded":"2024-09-17T05:32:23.480082+0000","last_fullsized":"2024-09-17T05:32:23.480082+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:06.575195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.453952+0000","last_change":"2024-09-17T05:32:23.451743+0000","last_active":"2024-09-17T05:32:23.453952+0000","last_peered":"2024-09-17T05:32:23.453952+0000","last_clean":"2024-09-17T05:32:23.453952+0000","last_became_active":"2024-09-17T05:32:23.449774+0000","last_became_peered":"2024-09-17T05:32:23.449774+0000","last_unstale":"2024-09-17T05:32:23.453952+0000","last_undegraded":"2024-09-17T05:32:23.453952+0000","last_fullsized":"2024-09-17T05:32:23.453952+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:07.226176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.450557+0000","last_change":"2024-09-17T05:32:22.442622+0000","last_active":"2024-09-17T05:32:23.450557+0000","last_peered":"2024-09-17T05:32:23.450557+0000","last_clean":"2024-09-17T05:32:23.450557+0000","last_became_active":"2024-09-17T05:32:22.442317+0000","last_became_peered":"2024-09-17T05:32:22.442317+0000","last_unstale":"2024-09-17T05:32:23.450557+0000","last_undegraded":"2024-09-17T05:32:23.450557+0000","last_fullsized":"2024-09-17T05:32:23.450557+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:52.807454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.446007+0000","last_change":"2024-09-17T05:32:23.446007+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.446007+0000","last_undegraded":"2024-09-17T05:32:23.446007+0000","last_fullsized":"2024-09-17T05:32:23.446007+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.442387+0000","last_change":"2024-09-17T05:32:22.442544+0000","last_active":"2024-09-17T05:32:23.442387+0000","last_peered":"2024-09-17T05:32:23.442387+0000","last_clean":"2024-09-17T05:32:23.442387+0000","last_became_active":"2024-09-17T05:32:22.442203+0000","last_became_peered":"2024-09-17T05:32:22.442203+0000","last_unstale":"2024-09-17T05:32:23.442387+0000","last_undegraded":"2024-09-17T05:32:23.442387+0000","last_fullsized":"2024-09-17T05:32:23.442387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:26.276161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.465351+0000","last_change":"2024-09-17T05:32:23.465208+0000","last_active":"2024-09-17T05:32:23.465351+0000","last_peered":"2024-09-17T05:32:23.465351+0000","last_clean":"2024-09-17T05:32:23.465351+0000","last_became_active":"2024-09-17T05:32:23.464130+0000","last_became_peered":"2024-09-17T05:32:23.464130+0000","last_unstale":"2024-09-17T05:32:23.465351+0000","last_undegraded":"2024-09-17T05:32:23.465351+0000","last_fullsized":"2024-09-17T05:32:23.465351+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:34.358635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.451960+0000","last_change":"2024-09-17T05:32:22.444219+0000","last_active":"2024-09-17T05:32:23.451960+0000","last_peered":"2024-09-17T05:32:23.451960+0000","last_clean":"2024-09-17T05:32:23.451960+0000","last_became_active":"2024-09-17T05:32:22.443959+0000","last_became_peered":"2024-09-17T05:32:22.443959+0000","last_unstale":"2024-09-17T05:32:23.451960+0000","last_undegraded":"2024-09-17T05:32:23.451960+0000","last_fullsized":"2024-09-17T05:32:23.451960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:26.409388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.478213+0000","last_change":"2024-09-17T05:32:23.471900+0000","last_active":"2024-09-17T05:32:23.478213+0000","last_peered":"2024-09-17T05:32:23.478213+0000","last_clean":"2024-09-17T05:32:23.478213+0000","last_became_active":"2024-09-17T05:32:23.471558+0000","last_became_peered":"2024-09-17T05:32:23.471558+0000","last_unstale":"2024-09-17T05:32:23.478213+0000","last_undegraded":"2024-09-17T05:32:23.478213+0000","last_fullsized":"2024-09-17T05:32:23.478213+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:40.127810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.465589+0000","last_change":"2024-09-17T05:32:22.439312+0000","last_active":"2024-09-17T05:32:23.465589+0000","last_peered":"2024-09-17T05:32:23.465589+0000","last_clean":"2024-09-17T05:32:23.465589+0000","last_became_active":"2024-09-17T05:32:22.439065+0000","last_became_peered":"2024-09-17T05:32:22.439065+0000","last_unstale":"2024-09-17T05:32:23.465589+0000","last_undegraded":"2024-09-17T05:32:23.465589+0000","last_fullsized":"2024-09-17T05:32:23.465589+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:12.256435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.470920+0000","last_change":"2024-09-17T05:32:23.466273+0000","last_active":"2024-09-17T05:32:23.470920+0000","last_peered":"2024-09-17T05:32:23.470920+0000","last_clean":"2024-09-17T05:32:23.470920+0000","last_became_active":"2024-09-17T05:32:23.466013+0000","last_became_peered":"2024-09-17T05:32:23.466013+0000","last_unstale":"2024-09-17T05:32:23.470920+0000","last_undegraded":"2024-09-17T05:32:23.470920+0000","last_fullsized":"2024-09-17T05:32:23.470920+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:19.045892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.482953+0000","last_change":"2024-09-17T05:32:22.447454+0000","last_active":"2024-09-17T05:32:23.482953+0000","last_peered":"2024-09-17T05:32:23.482953+0000","last_clean":"2024-09-17T05:32:23.482953+0000","last_became_active":"2024-09-17T05:32:22.447114+0000","last_became_peered":"2024-09-17T05:32:22.447114+0000","last_unstale":"2024-09-17T05:32:23.482953+0000","last_undegraded":"2024-09-17T05:32:23.482953+0000","last_fullsized":"2024-09-17T05:32:23.482953+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:18.910750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.464493+0000","last_change":"2024-09-17T05:32:23.461195+0000","last_active":"2024-09-17T05:32:23.464493+0000","last_peered":"2024-09-17T05:32:23.464493+0000","last_clean":"2024-09-17T05:32:23.464493+0000","last_became_active":"2024-09-17T05:32:23.460907+0000","last_became_peered":"2024-09-17T05:32:23.460907+0000","last_unstale":"2024-09-17T05:32:23.464493+0000","last_undegraded":"2024-09-17T05:32:23.464493+0000","last_fullsized":"2024-09-17T05:32:23.464493+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:03.960942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"68'6","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.484750+0000","last_change":"2024-09-17T05:32:22.445768+0000","last_active":"2024-09-17T05:32:23.484750+0000","last_peered":"2024-09-17T05:32:23.484750+0000","last_clean":"2024-09-17T05:32:23.484750+0000","last_became_active":"2024-09-17T05:32:22.445436+0000","last_became_peered":"2024-09-17T05:32:22.445436+0000","last_unstale":"2024-09-17T05:32:23.484750+0000","last_undegraded":"2024-09-17T05:32:23.484750+0000","last_fullsized":"2024-09-17T05:32:23.484750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:42.876685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.477765+0000","last_change":"2024-09-17T05:32:23.472031+0000","last_active":"2024-09-17T05:32:23.477765+0000","last_peered":"2024-09-17T05:32:23.477765+0000","last_clean":"2024-09-17T05:32:23.477765+0000","last_became_active":"2024-09-17T05:32:23.471718+0000","last_became_peered":"2024-09-17T05:32:23.471718+0000","last_unstale":"2024-09-17T05:32:23.477765+0000","last_undegraded":"2024-09-17T05:32:23.477765+0000","last_fullsized":"2024-09-17T05:32:23.477765+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:55.379210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.481442+0000","last_change":"2024-09-17T05:32:22.444315+0000","last_active":"2024-09-17T05:32:23.481442+0000","last_peered":"2024-09-17T05:32:23.481442+0000","last_clean":"2024-09-17T05:32:23.481442+0000","last_became_active":"2024-09-17T05:32:22.443941+0000","last_became_peered":"2024-09-17T05:32:22.443941+0000","last_unstale":"2024-09-17T05:32:23.481442+0000","last_undegraded":"2024-09-17T05:32:23.481442+0000","last_fullsized":"2024-09-17T05:32:23.481442+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:42.729448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.463785+0000","last_change":"2024-09-17T05:32:23.463690+0000","last_active":"2024-09-17T05:32:23.463785+0000","last_peered":"2024-09-17T05:32:23.463785+0000","last_clean":"2024-09-17T05:32:23.463785+0000","last_became_active":"2024-09-17T05:32:23.463366+0000","last_became_peered":"2024-09-17T05:32:23.463366+0000","last_unstale":"2024-09-17T05:32:23.463785+0000","last_undegraded":"2024-09-17T05:32:23.463785+0000","last_fullsized":"2024-09-17T05:32:23.463785+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:55.837427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.458658+0000","last_change":"2024-09-17T05:32:22.443885+0000","last_active":"2024-09-17T05:32:23.458658+0000","last_peered":"2024-09-17T05:32:23.458658+0000","last_clean":"2024-09-17T05:32:23.458658+0000","last_became_active":"2024-09-17T05:32:22.443550+0000","last_became_peered":"2024-09-17T05:32:22.443550+0000","last_unstale":"2024-09-17T05:32:23.458658+0000","last_undegraded":"2024-09-17T05:32:23.458658+0000","last_fullsized":"2024-09-17T05:32:23.458658+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:30.306584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.445579+0000","last_change":"2024-09-17T05:32:23.445579+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.445579+0000","last_undegraded":"2024-09-17T05:32:23.445579+0000","last_fullsized":"2024-09-17T05:32:23.445579+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.451891+0000","last_change":"2024-09-17T05:32:22.437803+0000","last_active":"2024-09-17T05:32:23.451891+0000","last_peered":"2024-09-17T05:32:23.451891+0000","last_clean":"2024-09-17T05:32:23.451891+0000","last_became_active":"2024-09-17T05:32:22.437197+0000","last_became_peered":"2024-09-17T05:32:22.437197+0000","last_unstale":"2024-09-17T05:32:23.451891+0000","last_undegraded":"2024-09-17T05:32:23.451891+0000","last_fullsized":"2024-09-17T05:32:23.451891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:56.664716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.466991+0000","last_change":"2024-09-17T05:32:23.463878+0000","last_active":"2024-09-17T05:32:23.466991+0000","last_peered":"2024-09-17T05:32:23.466991+0000","last_clean":"2024-09-17T05:32:23.466991+0000","last_became_active":"2024-09-17T05:32:23.463607+0000","last_became_peered":"2024-09-17T05:32:23.463607+0000","last_unstale":"2024-09-17T05:32:23.466991+0000","last_undegraded":"2024-09-17T05:32:23.466991+0000","last_fullsized":"2024-09-17T05:32:23.466991+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:49:48.653310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"68'8","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.485818+0000","last_change":"2024-09-17T05:32:22.445043+0000","last_active":"2024-09-17T05:32:23.485818+0000","last_peered":"2024-09-17T05:32:23.485818+0000","last_clean":"2024-09-17T05:32:23.485818+0000","last_became_active":"2024-09-17T05:32:22.444699+0000","last_became_peered":"2024-09-17T05:32:22.444699+0000","last_unstale":"2024-09-17T05:32:23.485818+0000","last_undegraded":"2024-09-17T05:32:23.485818+0000","last_fullsized":"2024-09-17T05:32:23.485818+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:43.974609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473854+0000","last_change":"2024-09-17T05:32:23.466477+0000","last_active":"2024-09-17T05:32:23.473854+0000","last_peered":"2024-09-17T05:32:23.473854+0000","last_clean":"2024-09-17T05:32:23.473854+0000","last_became_active":"2024-09-17T05:32:23.465510+0000","last_became_peered":"2024-09-17T05:32:23.465510+0000","last_unstale":"2024-09-17T05:32:23.473854+0000","last_undegraded":"2024-09-17T05:32:23.473854+0000","last_fullsized":"2024-09-17T05:32:23.473854+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:55.568809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.486404+0000","last_change":"2024-09-17T05:32:22.444888+0000","last_active":"2024-09-17T05:32:23.486404+0000","last_peered":"2024-09-17T05:32:23.486404+0000","last_clean":"2024-09-17T05:32:23.486404+0000","last_became_active":"2024-09-17T05:32:22.444638+0000","last_became_peered":"2024-09-17T05:32:22.444638+0000","last_unstale":"2024-09-17T05:32:23.486404+0000","last_undegraded":"2024-09-17T05:32:23.486404+0000","last_fullsized":"2024-09-17T05:32:23.486404+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:21.945708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.482877+0000","last_change":"2024-09-17T05:32:23.475204+0000","last_active":"2024-09-17T05:32:23.482877+0000","last_peered":"2024-09-17T05:32:23.482877+0000","last_clean":"2024-09-17T05:32:23.482877+0000","last_became_active":"2024-09-17T05:32:23.474906+0000","last_became_peered":"2024-09-17T05:32:23.474906+0000","last_unstale":"2024-09-17T05:32:23.482877+0000","last_undegraded":"2024-09-17T05:32:23.482877+0000","last_fullsized":"2024-09-17T05:32:23.482877+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:36.033925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.485053+0000","last_change":"2024-09-17T05:32:22.440244+0000","last_active":"2024-09-17T05:32:23.485053+0000","last_peered":"2024-09-17T05:32:23.485053+0000","last_clean":"2024-09-17T05:32:23.485053+0000","last_became_active":"2024-09-17T05:32:22.439691+0000","last_became_peered":"2024-09-17T05:32:22.439691+0000","last_unstale":"2024-09-17T05:32:23.485053+0000","last_undegraded":"2024-09-17T05:32:23.485053+0000","last_fullsized":"2024-09-17T05:32:23.485053+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:09.787784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.479806+0000","last_change":"2024-09-17T05:32:23.471381+0000","last_active":"2024-09-17T05:32:23.479806+0000","last_peered":"2024-09-17T05:32:23.479806+0000","last_clean":"2024-09-17T05:32:23.479806+0000","last_became_active":"2024-09-17T05:32:23.467992+0000","last_became_peered":"2024-09-17T05:32:23.467992+0000","last_unstale":"2024-09-17T05:32:23.479806+0000","last_undegraded":"2024-09-17T05:32:23.479806+0000","last_fullsized":"2024-09-17T05:32:23.479806+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:39.870236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.482302+0000","last_change":"2024-09-17T05:32:22.448369+0000","last_active":"2024-09-17T05:32:23.482302+0000","last_peered":"2024-09-17T05:32:23.482302+0000","last_clean":"2024-09-17T05:32:23.482302+0000","last_became_active":"2024-09-17T05:32:22.448107+0000","last_became_peered":"2024-09-17T05:32:22.448107+0000","last_unstale":"2024-09-17T05:32:23.482302+0000","last_undegraded":"2024-09-17T05:32:23.482302+0000","last_fullsized":"2024-09-17T05:32:23.482302+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:05.167911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.454017+0000","last_change":"2024-09-17T05:32:23.451083+0000","last_active":"2024-09-17T05:32:23.454017+0000","last_peered":"2024-09-17T05:32:23.454017+0000","last_clean":"2024-09-17T05:32:23.454017+0000","last_became_active":"2024-09-17T05:32:23.450733+0000","last_became_peered":"2024-09-17T05:32:23.450733+0000","last_unstale":"2024-09-17T05:32:23.454017+0000","last_undegraded":"2024-09-17T05:32:23.454017+0000","last_fullsized":"2024-09-17T05:32:23.454017+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:39.590687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.458497+0000","last_change":"2024-09-17T05:32:22.446119+0000","last_active":"2024-09-17T05:32:23.458497+0000","last_peered":"2024-09-17T05:32:23.458497+0000","last_clean":"2024-09-17T05:32:23.458497+0000","last_became_active":"2024-09-17T05:32:22.445820+0000","last_became_peered":"2024-09-17T05:32:22.445820+0000","last_unstale":"2024-09-17T05:32:23.458497+0000","last_undegraded":"2024-09-17T05:32:23.458497+0000","last_fullsized":"2024-09-17T05:32:23.458497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:34.362788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.475040+0000","last_change":"2024-09-17T05:32:23.464537+0000","last_active":"2024-09-17T05:32:23.475040+0000","last_peered":"2024-09-17T05:32:23.475040+0000","last_clean":"2024-09-17T05:32:23.475040+0000","last_became_active":"2024-09-17T05:32:23.464309+0000","last_became_peered":"2024-09-17T05:32:23.464309+0000","last_unstale":"2024-09-17T05:32:23.475040+0000","last_undegraded":"2024-09-17T05:32:23.475040+0000","last_fullsized":"2024-09-17T05:32:23.475040+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:08.458240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.457213+0000","last_change":"2024-09-17T05:32:22.440316+0000","last_active":"2024-09-17T05:32:23.457213+0000","last_peered":"2024-09-17T05:32:23.457213+0000","last_clean":"2024-09-17T05:32:23.457213+0000","last_became_active":"2024-09-17T05:32:22.440046+0000","last_became_peered":"2024-09-17T05:32:22.440046+0000","last_unstale":"2024-09-17T05:32:23.457213+0000","last_undegraded":"2024-09-17T05:32:23.457213+0000","last_fullsized":"2024-09-17T05:32:23.457213+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:25.752696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480492+0000","last_change":"2024-09-17T05:32:23.470385+0000","last_active":"2024-09-17T05:32:23.480492+0000","last_peered":"2024-09-17T05:32:23.480492+0000","last_clean":"2024-09-17T05:32:23.480492+0000","last_became_active":"2024-09-17T05:32:23.469912+0000","last_became_peered":"2024-09-17T05:32:23.469912+0000","last_unstale":"2024-09-17T05:32:23.480492+0000","last_undegraded":"2024-09-17T05:32:23.480492+0000","last_fullsized":"2024-09-17T05:32:23.480492+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:12.115473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.452105+0000","last_change":"2024-09-17T05:32:22.437497+0000","last_active":"2024-09-17T05:32:23.452105+0000","last_peered":"2024-09-17T05:32:23.452105+0000","last_clean":"2024-09-17T05:32:23.452105+0000","last_became_active":"2024-09-17T05:32:22.436783+0000","last_became_peered":"2024-09-17T05:32:22.436783+0000","last_unstale":"2024-09-17T05:32:23.452105+0000","last_undegraded":"2024-09-17T05:32:23.452105+0000","last_fullsized":"2024-09-17T05:32:23.452105+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:04.046487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480895+0000","last_change":"2024-09-17T05:32:23.470425+0000","last_active":"2024-09-17T05:32:23.480895+0000","last_peered":"2024-09-17T05:32:23.480895+0000","last_clean":"2024-09-17T05:32:23.480895+0000","last_became_active":"2024-09-17T05:32:23.469891+0000","last_became_peered":"2024-09-17T05:32:23.469891+0000","last_unstale":"2024-09-17T05:32:23.480895+0000","last_undegraded":"2024-09-17T05:32:23.480895+0000","last_fullsized":"2024-09-17T05:32:23.480895+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:45.916717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.447169+0000","last_change":"2024-09-17T05:32:22.434037+0000","last_active":"2024-09-17T05:32:23.447169+0000","last_peered":"2024-09-17T05:32:23.447169+0000","last_clean":"2024-09-17T05:32:23.447169+0000","last_became_active":"2024-09-17T05:32:22.433767+0000","last_became_peered":"2024-09-17T05:32:22.433767+0000","last_unstale":"2024-09-17T05:32:23.447169+0000","last_undegraded":"2024-09-17T05:32:23.447169+0000","last_fullsized":"2024-09-17T05:32:23.447169+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:24.523856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.455666+0000","last_change":"2024-09-17T05:32:23.455529+0000","last_active":"2024-09-17T05:32:23.455666+0000","last_peered":"2024-09-17T05:32:23.455666+0000","last_clean":"2024-09-17T05:32:23.455666+0000","last_became_active":"2024-09-17T05:32:23.455038+0000","last_became_peered":"2024-09-17T05:32:23.455038+0000","last_unstale":"2024-09-17T05:32:23.455666+0000","last_undegraded":"2024-09-17T05:32:23.455666+0000","last_fullsized":"2024-09-17T05:32:23.455666+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:55.837427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.486063+0000","last_change":"2024-09-17T05:32:22.445506+0000","last_active":"2024-09-17T05:32:23.486063+0000","last_peered":"2024-09-17T05:32:23.486063+0000","last_clean":"2024-09-17T05:32:23.486063+0000","last_became_active":"2024-09-17T05:32:22.445248+0000","last_became_peered":"2024-09-17T05:32:22.445248+0000","last_unstale":"2024-09-17T05:32:23.486063+0000","last_undegraded":"2024-09-17T05:32:23.486063+0000","last_fullsized":"2024-09-17T05:32:23.486063+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:55.664704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.463751+0000","last_change":"2024-09-17T05:32:23.463645+0000","last_active":"2024-09-17T05:32:23.463751+0000","last_peered":"2024-09-17T05:32:23.463751+0000","last_clean":"2024-09-17T05:32:23.463751+0000","last_became_active":"2024-09-17T05:32:23.463264+0000","last_became_peered":"2024-09-17T05:32:23.463264+0000","last_unstale":"2024-09-17T05:32:23.463751+0000","last_undegraded":"2024-09-17T05:32:23.463751+0000","last_fullsized":"2024-09-17T05:32:23.463751+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:35.460618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.449981+0000","last_change":"2024-09-17T05:32:22.439185+0000","last_active":"2024-09-17T05:32:23.449981+0000","last_peered":"2024-09-17T05:32:23.449981+0000","last_clean":"2024-09-17T05:32:23.449981+0000","last_became_active":"2024-09-17T05:32:22.438609+0000","last_became_peered":"2024-09-17T05:32:22.438609+0000","last_unstale":"2024-09-17T05:32:23.449981+0000","last_undegraded":"2024-09-17T05:32:23.449981+0000","last_fullsized":"2024-09-17T05:32:23.449981+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:37.675974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.476082+0000","last_change":"2024-09-17T05:32:23.470673+0000","last_active":"2024-09-17T05:32:23.476082+0000","last_peered":"2024-09-17T05:32:23.476082+0000","last_clean":"2024-09-17T05:32:23.476082+0000","last_became_active":"2024-09-17T05:32:23.470407+0000","last_became_peered":"2024-09-17T05:32:23.470407+0000","last_unstale":"2024-09-17T05:32:23.476082+0000","last_undegraded":"2024-09-17T05:32:23.476082+0000","last_fullsized":"2024-09-17T05:32:23.476082+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:47.333726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.442942+0000","last_change":"2024-09-17T05:32:22.439130+0000","last_active":"2024-09-17T05:32:23.442942+0000","last_peered":"2024-09-17T05:32:23.442942+0000","last_clean":"2024-09-17T05:32:23.442942+0000","last_became_active":"2024-09-17T05:32:22.438837+0000","last_became_peered":"2024-09-17T05:32:22.438837+0000","last_unstale":"2024-09-17T05:32:23.442942+0000","last_undegraded":"2024-09-17T05:32:23.442942+0000","last_fullsized":"2024-09-17T05:32:23.442942+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:40.863254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.479737+0000","last_change":"2024-09-17T05:32:23.474389+0000","last_active":"2024-09-17T05:32:23.479737+0000","last_peered":"2024-09-17T05:32:23.479737+0000","last_clean":"2024-09-17T05:32:23.479737+0000","last_became_active":"2024-09-17T05:32:23.474144+0000","last_became_peered":"2024-09-17T05:32:23.474144+0000","last_unstale":"2024-09-17T05:32:23.479737+0000","last_undegraded":"2024-09-17T05:32:23.479737+0000","last_fullsized":"2024-09-17T05:32:23.479737+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:51.755210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.447521+0000","last_change":"2024-09-17T05:32:22.435023+0000","last_active":"2024-09-17T05:32:23.447521+0000","last_peered":"2024-09-17T05:32:23.447521+0000","last_clean":"2024-09-17T05:32:23.447521+0000","last_became_active":"2024-09-17T05:32:22.434768+0000","last_became_peered":"2024-09-17T05:32:22.434768+0000","last_unstale":"2024-09-17T05:32:23.447521+0000","last_undegraded":"2024-09-17T05:32:23.447521+0000","last_fullsized":"2024-09-17T05:32:23.447521+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:08.940581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.468965+0000","last_change":"2024-09-17T05:32:23.464311+0000","last_active":"2024-09-17T05:32:23.468965+0000","last_peered":"2024-09-17T05:32:23.468965+0000","last_clean":"2024-09-17T05:32:23.468965+0000","last_became_active":"2024-09-17T05:32:23.464023+0000","last_became_peered":"2024-09-17T05:32:23.464023+0000","last_unstale":"2024-09-17T05:32:23.468965+0000","last_undegraded":"2024-09-17T05:32:23.468965+0000","last_fullsized":"2024-09-17T05:32:23.468965+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:05.174497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.442715+0000","last_change":"2024-09-17T05:32:22.436649+0000","last_active":"2024-09-17T05:32:23.442715+0000","last_peered":"2024-09-17T05:32:23.442715+0000","last_clean":"2024-09-17T05:32:23.442715+0000","last_became_active":"2024-09-17T05:32:22.436340+0000","last_became_peered":"2024-09-17T05:32:22.436340+0000","last_unstale":"2024-09-17T05:32:23.442715+0000","last_undegraded":"2024-09-17T05:32:23.442715+0000","last_fullsized":"2024-09-17T05:32:23.442715+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:04.748458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473684+0000","last_change":"2024-09-17T05:32:23.467088+0000","last_active":"2024-09-17T05:32:23.473684+0000","last_peered":"2024-09-17T05:32:23.473684+0000","last_clean":"2024-09-17T05:32:23.473684+0000","last_became_active":"2024-09-17T05:32:23.466798+0000","last_became_peered":"2024-09-17T05:32:23.466798+0000","last_unstale":"2024-09-17T05:32:23.473684+0000","last_undegraded":"2024-09-17T05:32:23.473684+0000","last_fullsized":"2024-09-17T05:32:23.473684+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:49.751254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.451783+0000","last_change":"2024-09-17T05:32:22.442505+0000","last_active":"2024-09-17T05:32:23.451783+0000","last_peered":"2024-09-17T05:32:23.451783+0000","last_clean":"2024-09-17T05:32:23.451783+0000","last_became_active":"2024-09-17T05:32:22.442240+0000","last_became_peered":"2024-09-17T05:32:22.442240+0000","last_unstale":"2024-09-17T05:32:23.451783+0000","last_undegraded":"2024-09-17T05:32:23.451783+0000","last_fullsized":"2024-09-17T05:32:23.451783+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:12.027206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480173+0000","last_change":"2024-09-17T05:32:23.478309+0000","last_active":"2024-09-17T05:32:23.480173+0000","last_peered":"2024-09-17T05:32:23.480173+0000","last_clean":"2024-09-17T05:32:23.480173+0000","last_became_active":"2024-09-17T05:32:23.477989+0000","last_became_peered":"2024-09-17T05:32:23.477989+0000","last_unstale":"2024-09-17T05:32:23.480173+0000","last_undegraded":"2024-09-17T05:32:23.480173+0000","last_fullsized":"2024-09-17T05:32:23.480173+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:43.297508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.450565+0000","last_change":"2024-09-17T05:32:22.442119+0000","last_active":"2024-09-17T05:32:23.450565+0000","last_peered":"2024-09-17T05:32:23.450565+0000","last_clean":"2024-09-17T05:32:23.450565+0000","last_became_active":"2024-09-17T05:32:22.441840+0000","last_became_peered":"2024-09-17T05:32:22.441840+0000","last_unstale":"2024-09-17T05:32:23.450565+0000","last_undegraded":"2024-09-17T05:32:23.450565+0000","last_fullsized":"2024-09-17T05:32:23.450565+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:56.189581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473956+0000","last_change":"2024-09-17T05:32:23.468778+0000","last_active":"2024-09-17T05:32:23.473956+0000","last_peered":"2024-09-17T05:32:23.473956+0000","last_clean":"2024-09-17T05:32:23.473956+0000","last_became_active":"2024-09-17T05:32:23.468482+0000","last_became_peered":"2024-09-17T05:32:23.468482+0000","last_unstale":"2024-09-17T05:32:23.473956+0000","last_undegraded":"2024-09-17T05:32:23.473956+0000","last_fullsized":"2024-09-17T05:32:23.473956+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:22.648504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.457134+0000","last_change":"2024-09-17T05:32:22.446841+0000","last_active":"2024-09-17T05:32:23.457134+0000","last_peered":"2024-09-17T05:32:23.457134+0000","last_clean":"2024-09-17T05:32:23.457134+0000","last_became_active":"2024-09-17T05:32:22.446488+0000","last_became_peered":"2024-09-17T05:32:22.446488+0000","last_unstale":"2024-09-17T05:32:23.457134+0000","last_undegraded":"2024-09-17T05:32:23.457134+0000","last_fullsized":"2024-09-17T05:32:23.457134+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:10.048155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480463+0000","last_change":"2024-09-17T05:32:23.469967+0000","last_active":"2024-09-17T05:32:23.480463+0000","last_peered":"2024-09-17T05:32:23.480463+0000","last_clean":"2024-09-17T05:32:23.480463+0000","last_became_active":"2024-09-17T05:32:23.469655+0000","last_became_peered":"2024-09-17T05:32:23.469655+0000","last_unstale":"2024-09-17T05:32:23.480463+0000","last_undegraded":"2024-09-17T05:32:23.480463+0000","last_fullsized":"2024-09-17T05:32:23.480463+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:01.866983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.485605+0000","last_change":"2024-09-17T05:32:22.446879+0000","last_active":"2024-09-17T05:32:23.485605+0000","last_peered":"2024-09-17T05:32:23.485605+0000","last_clean":"2024-09-17T05:32:23.485605+0000","last_became_active":"2024-09-17T05:32:22.446442+0000","last_became_peered":"2024-09-17T05:32:22.446442+0000","last_unstale":"2024-09-17T05:32:23.485605+0000","last_undegraded":"2024-09-17T05:32:23.485605+0000","last_fullsized":"2024-09-17T05:32:23.485605+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:20.314711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":198,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.460171+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:32:23.460171+0000","last_peered":"2024-09-17T05:32:23.460171+0000","last_clean":"2024-09-17T05:32:23.460171+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:32:23.460171+0000","last_undegraded":"2024-09-17T05:32:23.460171+0000","last_fullsized":"2024-09-17T05:32:23.460171+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1421312,"data_stored":932427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":827392,"data_stored":341535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":823296,"data_stored":341513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":827392,"data_stored":341555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":831488,"data_stored":343055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":839680,"data_stored":343671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":806912,"data_stored":334668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542192,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1400832,"data_stored":925036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:32:28.423 INFO:tasks.ceph.ceph_manager.ceph:PG 11.39 is not active+clean 2024-09-17T05:32:28.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 68, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:32:23.449875+0000', 'last_change': '2024-09-17T05:32:23.449875+0000', 'last_active': '2024-09-17T05:32:22.415219+0000', 'last_peered': '2024-09-17T05:32:22.415219+0000', 'last_clean': '2024-09-17T05:32:22.415219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:23.449875+0000', 'last_undegraded': '2024-09-17T05:32:23.449875+0000', 'last_fullsized': '2024-09-17T05:32:23.449875+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:22.415219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:22.415219+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:22.415219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': ['5', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:32:28.423 INFO:tasks.ceph.ceph_manager.ceph:PG 11.33 is not active+clean 2024-09-17T05:32:28.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 68, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:32:23.445701+0000', 'last_change': '2024-09-17T05:32:23.445701+0000', 'last_active': '2024-09-17T05:32:22.415219+0000', 'last_peered': '2024-09-17T05:32:22.415219+0000', 'last_clean': '2024-09-17T05:32:22.415219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:23.445701+0000', 'last_undegraded': '2024-09-17T05:32:23.445701+0000', 'last_fullsized': '2024-09-17T05:32:23.445701+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:22.415219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:22.415219+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:22.415219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': ['0', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:32:28.423 INFO:tasks.ceph.ceph_manager.ceph:PG 11.26 is not active+clean 2024-09-17T05:32:28.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 68, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:32:23.448398+0000', 'last_change': '2024-09-17T05:32:23.448398+0000', 'last_active': '2024-09-17T05:32:22.415219+0000', 'last_peered': '2024-09-17T05:32:22.415219+0000', 'last_clean': '2024-09-17T05:32:22.415219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:23.448398+0000', 'last_undegraded': '2024-09-17T05:32:23.448398+0000', 'last_fullsized': '2024-09-17T05:32:23.448398+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:22.415219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:22.415219+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:22.415219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': ['5', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:32:28.423 INFO:tasks.ceph.ceph_manager.ceph:PG 11.19 is not active+clean 2024-09-17T05:32:28.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 68, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:32:23.446007+0000', 'last_change': '2024-09-17T05:32:23.446007+0000', 'last_active': '2024-09-17T05:32:22.415219+0000', 'last_peered': '2024-09-17T05:32:22.415219+0000', 'last_clean': '2024-09-17T05:32:22.415219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:23.446007+0000', 'last_undegraded': '2024-09-17T05:32:23.446007+0000', 'last_fullsized': '2024-09-17T05:32:23.446007+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:22.415219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:22.415219+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:22.415219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': ['0', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:32:28.424 INFO:tasks.ceph.ceph_manager.ceph:PG 11.10 is not active+clean 2024-09-17T05:32:28.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 68, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:32:23.445579+0000', 'last_change': '2024-09-17T05:32:23.445579+0000', 'last_active': '2024-09-17T05:32:22.415219+0000', 'last_peered': '2024-09-17T05:32:22.415219+0000', 'last_clean': '2024-09-17T05:32:22.415219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:23.445579+0000', 'last_undegraded': '2024-09-17T05:32:23.445579+0000', 'last_fullsized': '2024-09-17T05:32:23.445579+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:22.415219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:22.415219+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:22.415219+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': ['0', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:32:28.424 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:32:28.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.607+0000 7ff023a00640 1 -- 172.21.15.31:0/3218218376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff01c0b2d00 msgr2=0x7ff01c1605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:28.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.607+0000 7ff023a00640 1 --2- 172.21.15.31:0/3218218376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff01c0b2d00 0x7ff01c1605d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0c5910 tx=0x7ff01401caf0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.607+0000 7ff023a00640 1 -- 172.21.15.31:0/3218218376 shutdown_connections 2024-09-17T05:32:28.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.607+0000 7ff023a00640 1 --2- 172.21.15.31:0/3218218376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff01c0b2d00 0x7ff01c1605d0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.607+0000 7ff023a00640 1 --2- 172.21.15.31:0/3218218376 >> v2:172.21.15.155:3300/0 conn(0x7ff01c0b2760 0x7ff01c0d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.607+0000 7ff023a00640 1 -- 172.21.15.31:0/3218218376 >> 172.21.15.31:0/3218218376 conn(0x7ff01c0d1e40 msgr2=0x7ff01c0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:28.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.607+0000 7ff023a00640 1 -- 172.21.15.31:0/3218218376 shutdown_connections 2024-09-17T05:32:28.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.607+0000 7ff023a00640 1 -- 172.21.15.31:0/3218218376 wait complete. 2024-09-17T05:32:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.607+0000 7ff023a00640 1 Processor -- start 2024-09-17T05:32:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.607+0000 7ff023a00640 1 -- start start 2024-09-17T05:32:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff023a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff01c0b2760 0x7ff01c0b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff023a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff01c0b2d00 0x7ff01c1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff023a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff01c0cfe80 0x7ff01c0c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff023a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c0b0990 con 0x7ff01c0cfe80 2024-09-17T05:32:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff023a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c0b0810 con 0x7ff01c0b2760 2024-09-17T05:32:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff023a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff01c0b0b10 con 0x7ff01c0b2d00 2024-09-17T05:32:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff021a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff01c0cfe80 0x7ff01c0c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff021a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff01c0cfe80 0x7ff01c0c5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43012/0 (socket says 172.21.15.31:43012) 2024-09-17T05:32:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff021a00640 1 -- 172.21.15.31:0/1341405526 learned_addr learned my addr 172.21.15.31:0/1341405526 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff021000640 1 --2- 172.21.15.31:0/1341405526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff01c0b2760 0x7ff01c0b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff01be00640 1 --2- 172.21.15.31:0/1341405526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff01c0b2d00 0x7ff01c1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff021a00640 1 -- 172.21.15.31:0/1341405526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff01c0b2d00 msgr2=0x7ff01c1531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff021a00640 1 --2- 172.21.15.31:0/1341405526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff01c0b2d00 0x7ff01c1531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff021a00640 1 -- 172.21.15.31:0/1341405526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff01c0b2760 msgr2=0x7ff01c0b72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff021a00640 1 --2- 172.21.15.31:0/1341405526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff01c0b2760 0x7ff01c0b72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff021a00640 1 -- 172.21.15.31:0/1341405526 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff01c0b6800 con 0x7ff01c0cfe80 2024-09-17T05:32:28.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff021000640 1 --2- 172.21.15.31:0/1341405526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff01c0b2760 0x7ff01c0b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:32:28.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff01be00640 1 --2- 172.21.15.31:0/1341405526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff01c0b2d00 0x7ff01c1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:32:28.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff021a00640 1 --2- 172.21.15.31:0/1341405526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff01c0cfe80 0x7ff01c0c5e70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff01401a720 tx=0x7ff0140a58b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:28.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff018c00640 1 -- 172.21.15.31:0/1341405526 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0140bb070 con 0x7ff01c0cfe80 2024-09-17T05:32:28.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff018c00640 1 -- 172.21.15.31:0/1341405526 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff014004e00 con 0x7ff01c0cfe80 2024-09-17T05:32:28.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff018c00640 1 -- 172.21.15.31:0/1341405526 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0140b2040 con 0x7ff01c0cfe80 2024-09-17T05:32:28.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff023a00640 1 -- 172.21.15.31:0/1341405526 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff01c0c6d60 con 0x7ff01c0cfe80 2024-09-17T05:32:28.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff023a00640 1 -- 172.21.15.31:0/1341405526 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff01c0b6ac0 con 0x7ff01c0cfe80 2024-09-17T05:32:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff023a00640 1 -- 172.21.15.31:0/1341405526 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff01c0d0260 con 0x7ff01c0cfe80 2024-09-17T05:32:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.611+0000 7ff018c00640 1 -- 172.21.15.31:0/1341405526 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7ff0140043a0 con 0x7ff01c0cfe80 2024-09-17T05:32:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.615+0000 7ff018c00640 1 --2- 172.21.15.31:0/1341405526 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7feffc073560 0x7feffc075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.615+0000 7ff018c00640 1 -- 172.21.15.31:0/1341405526 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7ff01412e850 con 0x7ff01c0cfe80 2024-09-17T05:32:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.615+0000 7ff021000640 1 --2- 172.21.15.31:0/1341405526 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7feffc073560 0x7feffc075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.615+0000 7ff021000640 1 --2- 172.21.15.31:0/1341405526 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7feffc073560 0x7feffc075a20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff010000f70 tx=0x7ff010009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.619+0000 7ff018c00640 1 -- 172.21.15.31:0/1341405526 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff014016770 con 0x7ff01c0cfe80 2024-09-17T05:32:28.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.855+0000 7ff023a00640 1 -- 172.21.15.31:0/1341405526 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff01c072640 con 0x7ff01c0cfe80 2024-09-17T05:32:28.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.855+0000 7ff018c00640 1 -- 172.21.15.31:0/1341405526 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1564 (secure 0 0 0) 0x7ff0140f93e0 con 0x7ff01c0cfe80 2024-09-17T05:32:28.856 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:28.856 INFO:teuthology.orchestra.run.smithi031.stdout:{"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":248,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":69,"num_osds":8,"num_up_osds":8,"osd_up_since":1726550913,"num_in_osds":8,"osd_in_since":1726550903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":92},{"state_name":"creating+activating","count":5}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":263319552,"bytes_avail":772830793728,"bytes_total":773094113280,"inactive_pgs_ratio":0.051546391099691391,"write_bytes_sec":2466,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":47,"btime":"2024-09-17T05:32:26:465301+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6153}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-09-17T05:32:11.231876+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T05:32:28.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.855+0000 7ff023a00640 1 -- 172.21.15.31:0/1341405526 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7feffc073560 msgr2=0x7feffc075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:28.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.855+0000 7ff023a00640 1 --2- 172.21.15.31:0/1341405526 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7feffc073560 0x7feffc075a20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff010000f70 tx=0x7ff010009040 comp rx=0 tx=0).stop 2024-09-17T05:32:28.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.855+0000 7ff023a00640 1 -- 172.21.15.31:0/1341405526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff01c0cfe80 msgr2=0x7ff01c0c5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:28.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.855+0000 7ff023a00640 1 --2- 172.21.15.31:0/1341405526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff01c0cfe80 0x7ff01c0c5e70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff01401a720 tx=0x7ff0140a58b0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.855+0000 7ff023a00640 1 -- 172.21.15.31:0/1341405526 shutdown_connections 2024-09-17T05:32:28.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.855+0000 7ff023a00640 1 --2- 172.21.15.31:0/1341405526 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7feffc073560 0x7feffc075a20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.855+0000 7ff023a00640 1 --2- 172.21.15.31:0/1341405526 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff01c0cfe80 0x7ff01c0c5e70 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.855+0000 7ff023a00640 1 --2- 172.21.15.31:0/1341405526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff01c0b2d00 0x7ff01c1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.855+0000 7ff023a00640 1 --2- 172.21.15.31:0/1341405526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff01c0b2760 0x7ff01c0b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:28.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.855+0000 7ff023a00640 1 -- 172.21.15.31:0/1341405526 >> 172.21.15.31:0/1341405526 conn(0x7ff01c0d1e40 msgr2=0x7ff01c15fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:28.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.855+0000 7ff023a00640 1 -- 172.21.15.31:0/1341405526 shutdown_connections 2024-09-17T05:32:28.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:28.855+0000 7ff023a00640 1 -- 172.21.15.31:0/1341405526 wait complete. 2024-09-17T05:32:28.878 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:32:28.878 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:32:29.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.023+0000 7f583de00640 1 -- 172.21.15.31:0/3923877130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5820004d50 msgr2=0x7f58200051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:29.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.023+0000 7f583de00640 1 --2- 172.21.15.31:0/3923877130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5820004d50 0x7f58200051d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5830001e60 tx=0x7f583001cbe0 comp rx=0 tx=0).stop 2024-09-17T05:32:29.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.023+0000 7f583d400640 1 -- 172.21.15.31:0/3923877130 reap_dead start 2024-09-17T05:32:29.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.023+0000 7f583de00640 1 -- 172.21.15.31:0/3923877130 shutdown_connections 2024-09-17T05:32:29.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.023+0000 7f583de00640 1 -- 172.21.15.31:0/3923877130 >> 172.21.15.31:0/3923877130 conn(0x7f583809aa10 msgr2=0x7f583809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:29.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.023+0000 7f583de00640 1 -- 172.21.15.31:0/3923877130 shutdown_connections 2024-09-17T05:32:29.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.023+0000 7f583de00640 1 -- 172.21.15.31:0/3923877130 wait complete. 2024-09-17T05:32:29.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583de00640 1 Processor -- start 2024-09-17T05:32:29.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583de00640 1 -- start start 2024-09-17T05:32:29.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583de00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5820004d50 0x7f583814abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:29.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583de00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f583815a370 0x7f583814b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:29.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58381fb2e0 0x7f58381fb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:29.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583de00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5838167f60 con 0x7f58381fb2e0 2024-09-17T05:32:29.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583de00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5838167de0 con 0x7f5820004d50 2024-09-17T05:32:29.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583de00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f58381680e0 con 0x7f583815a370 2024-09-17T05:32:29.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58381fb2e0 0x7f58381fb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:29.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58381fb2e0 0x7f58381fb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43038/0 (socket says 172.21.15.31:43038) 2024-09-17T05:32:29.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583d400640 1 -- 172.21.15.31:0/1098049329 learned_addr learned my addr 172.21.15.31:0/1098049329 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:29.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583ca00640 1 --2- 172.21.15.31:0/1098049329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5820004d50 0x7f583814abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:29.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f5837e00640 1 --2- 172.21.15.31:0/1098049329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f583815a370 0x7f583814b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:29.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583d400640 1 -- 172.21.15.31:0/1098049329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f583815a370 msgr2=0x7f583814b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:29.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583d400640 1 --2- 172.21.15.31:0/1098049329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f583815a370 0x7f583814b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:29.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583d400640 1 -- 172.21.15.31:0/1098049329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5820004d50 msgr2=0x7f583814abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:29.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583d400640 1 --2- 172.21.15.31:0/1098049329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5820004d50 0x7f583814abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:29.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583d400640 1 -- 172.21.15.31:0/1098049329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58380c7bc0 con 0x7f58381fb2e0 2024-09-17T05:32:29.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583d400640 1 --2- 172.21.15.31:0/1098049329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58381fb2e0 0x7f58381fb790 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f583001ca10 tx=0x7f5830004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:29.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f5834c00640 1 -- 172.21.15.31:0/1098049329 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5830001ab0 con 0x7f58381fb2e0 2024-09-17T05:32:29.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f5834c00640 1 -- 172.21.15.31:0/1098049329 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58300a58c0 con 0x7f58381fb2e0 2024-09-17T05:32:29.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f5834c00640 1 -- 172.21.15.31:0/1098049329 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5830006c50 con 0x7f58381fb2e0 2024-09-17T05:32:29.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583de00640 1 -- 172.21.15.31:0/1098049329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58380c7ea0 con 0x7f58381fb2e0 2024-09-17T05:32:29.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.027+0000 7f583de00640 1 -- 172.21.15.31:0/1098049329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58380c8460 con 0x7f58381fb2e0 2024-09-17T05:32:29.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.031+0000 7f583de00640 1 -- 172.21.15.31:0/1098049329 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58380b29e0 con 0x7f58381fb2e0 2024-09-17T05:32:29.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.031+0000 7f5834c00640 1 -- 172.21.15.31:0/1098049329 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f5830006090 con 0x7f58381fb2e0 2024-09-17T05:32:29.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.031+0000 7f5834c00640 1 --2- 172.21.15.31:0/1098049329 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5818073590 0x7f5818075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:29.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.031+0000 7f5834c00640 1 -- 172.21.15.31:0/1098049329 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f583012e280 con 0x7f58381fb2e0 2024-09-17T05:32:29.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.031+0000 7f583ca00640 1 --2- 172.21.15.31:0/1098049329 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5818073590 0x7f5818075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:29.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.031+0000 7f583ca00640 1 --2- 172.21.15.31:0/1098049329 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5818073590 0x7f5818075a50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f582c009c60 tx=0x7f582c0091e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:29.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.035+0000 7f5834c00640 1 -- 172.21.15.31:0/1098049329 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f58300168f0 con 0x7f58381fb2e0 2024-09-17T05:32:29.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.207+0000 7f583de00640 1 -- 172.21.15.31:0/1098049329 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f58380ce560 con 0x7f5818073590 2024-09-17T05:32:29.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.211+0000 7f5834c00640 1 -- 172.21.15.31:0/1098049329 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251685 (secure 0 0 0) 0x7f582c05e740 con 0x7f5818073590 2024-09-17T05:32:29.216 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:29.217 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:32:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.215+0000 7f583de00640 1 -- 172.21.15.31:0/1098049329 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5818073590 msgr2=0x7f5818075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.215+0000 7f583de00640 1 --2- 172.21.15.31:0/1098049329 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5818073590 0x7f5818075a50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f582c009c60 tx=0x7f582c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:32:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.215+0000 7f583de00640 1 -- 172.21.15.31:0/1098049329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58381fb2e0 msgr2=0x7f58381fb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.215+0000 7f583de00640 1 --2- 172.21.15.31:0/1098049329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58381fb2e0 0x7f58381fb790 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f583001ca10 tx=0x7f5830004ee0 comp rx=0 tx=0).stop 2024-09-17T05:32:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.215+0000 7f583de00640 1 -- 172.21.15.31:0/1098049329 shutdown_connections 2024-09-17T05:32:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.215+0000 7f583de00640 1 --2- 172.21.15.31:0/1098049329 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5818073590 0x7f5818075a50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.215+0000 7f583de00640 1 --2- 172.21.15.31:0/1098049329 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58381fb2e0 0x7f58381fb790 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.215+0000 7f583de00640 1 --2- 172.21.15.31:0/1098049329 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f583815a370 0x7f583814b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:29.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.215+0000 7f583de00640 1 --2- 172.21.15.31:0/1098049329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5820004d50 0x7f583814abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:29.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.215+0000 7f583de00640 1 -- 172.21.15.31:0/1098049329 >> 172.21.15.31:0/1098049329 conn(0x7f583809aa10 msgr2=0x7f583815e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:29.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.215+0000 7f583de00640 1 -- 172.21.15.31:0/1098049329 shutdown_connections 2024-09-17T05:32:29.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:29.215+0000 7f583de00640 1 -- 172.21.15.31:0/1098049329 wait complete. 2024-09-17T05:32:29.236 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-17T05:32:27.235119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":145,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257148,"kb_used_data":7596,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717572,"statfs":{"total":773094113280,"available":772830793728,"internally_reserved":0,"allocated":7778304,"data_stored":3903460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.811793"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.483669+0000","last_change":"2024-09-17T05:32:23.478099+0000","last_active":"2024-09-17T05:32:23.483669+0000","last_peered":"2024-09-17T05:32:23.483669+0000","last_clean":"2024-09-17T05:32:23.483669+0000","last_became_active":"2024-09-17T05:32:23.477783+0000","last_became_peered":"2024-09-17T05:32:23.477783+0000","last_unstale":"2024-09-17T05:32:23.483669+0000","last_undegraded":"2024-09-17T05:32:23.483669+0000","last_fullsized":"2024-09-17T05:32:23.483669+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:54.629625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.470848+0000","last_change":"2024-09-17T05:32:23.466050+0000","last_active":"2024-09-17T05:32:23.470848+0000","last_peered":"2024-09-17T05:32:23.470848+0000","last_clean":"2024-09-17T05:32:23.470848+0000","last_became_active":"2024-09-17T05:32:23.465791+0000","last_became_peered":"2024-09-17T05:32:23.465791+0000","last_unstale":"2024-09-17T05:32:23.470848+0000","last_undegraded":"2024-09-17T05:32:23.470848+0000","last_fullsized":"2024-09-17T05:32:23.470848+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:15.060077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.471942+0000","last_change":"2024-09-17T05:32:23.462418+0000","last_active":"2024-09-17T05:32:23.471942+0000","last_peered":"2024-09-17T05:32:23.471942+0000","last_clean":"2024-09-17T05:32:23.471942+0000","last_became_active":"2024-09-17T05:32:23.462073+0000","last_became_peered":"2024-09-17T05:32:23.462073+0000","last_unstale":"2024-09-17T05:32:23.471942+0000","last_undegraded":"2024-09-17T05:32:23.471942+0000","last_fullsized":"2024-09-17T05:32:23.471942+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:13.497447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480064+0000","last_change":"2024-09-17T05:32:23.472699+0000","last_active":"2024-09-17T05:32:23.480064+0000","last_peered":"2024-09-17T05:32:23.480064+0000","last_clean":"2024-09-17T05:32:23.480064+0000","last_became_active":"2024-09-17T05:32:23.472411+0000","last_became_peered":"2024-09-17T05:32:23.472411+0000","last_unstale":"2024-09-17T05:32:23.480064+0000","last_undegraded":"2024-09-17T05:32:23.480064+0000","last_fullsized":"2024-09-17T05:32:23.480064+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:09.476752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.467020+0000","last_change":"2024-09-17T05:32:23.464155+0000","last_active":"2024-09-17T05:32:23.467020+0000","last_peered":"2024-09-17T05:32:23.467020+0000","last_clean":"2024-09-17T05:32:23.467020+0000","last_became_active":"2024-09-17T05:32:23.463865+0000","last_became_peered":"2024-09-17T05:32:23.463865+0000","last_unstale":"2024-09-17T05:32:23.467020+0000","last_undegraded":"2024-09-17T05:32:23.467020+0000","last_fullsized":"2024-09-17T05:32:23.467020+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:58.569472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.470614+0000","last_change":"2024-09-17T05:32:23.464707+0000","last_active":"2024-09-17T05:32:23.470614+0000","last_peered":"2024-09-17T05:32:23.470614+0000","last_clean":"2024-09-17T05:32:23.470614+0000","last_became_active":"2024-09-17T05:32:23.463900+0000","last_became_peered":"2024-09-17T05:32:23.463900+0000","last_unstale":"2024-09-17T05:32:23.470614+0000","last_undegraded":"2024-09-17T05:32:23.470614+0000","last_fullsized":"2024-09-17T05:32:23.470614+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:56.865390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.449875+0000","last_change":"2024-09-17T05:32:23.449875+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.449875+0000","last_undegraded":"2024-09-17T05:32:23.449875+0000","last_fullsized":"2024-09-17T05:32:23.449875+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473975+0000","last_change":"2024-09-17T05:32:23.468848+0000","last_active":"2024-09-17T05:32:23.473975+0000","last_peered":"2024-09-17T05:32:23.473975+0000","last_clean":"2024-09-17T05:32:23.473975+0000","last_became_active":"2024-09-17T05:32:23.468572+0000","last_became_peered":"2024-09-17T05:32:23.468572+0000","last_unstale":"2024-09-17T05:32:23.473975+0000","last_undegraded":"2024-09-17T05:32:23.473975+0000","last_fullsized":"2024-09-17T05:32:23.473975+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:06.450308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.478480+0000","last_change":"2024-09-17T05:32:23.474102+0000","last_active":"2024-09-17T05:32:23.478480+0000","last_peered":"2024-09-17T05:32:23.478480+0000","last_clean":"2024-09-17T05:32:23.478480+0000","last_became_active":"2024-09-17T05:32:23.473811+0000","last_became_peered":"2024-09-17T05:32:23.473811+0000","last_unstale":"2024-09-17T05:32:23.478480+0000","last_undegraded":"2024-09-17T05:32:23.478480+0000","last_fullsized":"2024-09-17T05:32:23.478480+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:19.579976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.468934+0000","last_change":"2024-09-17T05:32:23.459987+0000","last_active":"2024-09-17T05:32:23.468934+0000","last_peered":"2024-09-17T05:32:23.468934+0000","last_clean":"2024-09-17T05:32:23.468934+0000","last_became_active":"2024-09-17T05:32:23.459724+0000","last_became_peered":"2024-09-17T05:32:23.459724+0000","last_unstale":"2024-09-17T05:32:23.468934+0000","last_undegraded":"2024-09-17T05:32:23.468934+0000","last_fullsized":"2024-09-17T05:32:23.468934+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:45.173792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.483633+0000","last_change":"2024-09-17T05:32:23.477839+0000","last_active":"2024-09-17T05:32:23.483633+0000","last_peered":"2024-09-17T05:32:23.483633+0000","last_clean":"2024-09-17T05:32:23.483633+0000","last_became_active":"2024-09-17T05:32:23.477026+0000","last_became_peered":"2024-09-17T05:32:23.477026+0000","last_unstale":"2024-09-17T05:32:23.483633+0000","last_undegraded":"2024-09-17T05:32:23.483633+0000","last_fullsized":"2024-09-17T05:32:23.483633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:05.059346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.479654+0000","last_change":"2024-09-17T05:32:23.468520+0000","last_active":"2024-09-17T05:32:23.479654+0000","last_peered":"2024-09-17T05:32:23.479654+0000","last_clean":"2024-09-17T05:32:23.479654+0000","last_became_active":"2024-09-17T05:32:23.467246+0000","last_became_peered":"2024-09-17T05:32:23.467246+0000","last_unstale":"2024-09-17T05:32:23.479654+0000","last_undegraded":"2024-09-17T05:32:23.479654+0000","last_fullsized":"2024-09-17T05:32:23.479654+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:18.486564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.445701+0000","last_change":"2024-09-17T05:32:23.445701+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.445701+0000","last_undegraded":"2024-09-17T05:32:23.445701+0000","last_fullsized":"2024-09-17T05:32:23.445701+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.457059+0000","last_change":"2024-09-17T05:32:23.452918+0000","last_active":"2024-09-17T05:32:23.457059+0000","last_peered":"2024-09-17T05:32:23.457059+0000","last_clean":"2024-09-17T05:32:23.457059+0000","last_became_active":"2024-09-17T05:32:23.452665+0000","last_became_peered":"2024-09-17T05:32:23.452665+0000","last_unstale":"2024-09-17T05:32:23.457059+0000","last_undegraded":"2024-09-17T05:32:23.457059+0000","last_fullsized":"2024-09-17T05:32:23.457059+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:23.842414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.455656+0000","last_change":"2024-09-17T05:32:23.455539+0000","last_active":"2024-09-17T05:32:23.455656+0000","last_peered":"2024-09-17T05:32:23.455656+0000","last_clean":"2024-09-17T05:32:23.455656+0000","last_became_active":"2024-09-17T05:32:23.455242+0000","last_became_peered":"2024-09-17T05:32:23.455242+0000","last_unstale":"2024-09-17T05:32:23.455656+0000","last_undegraded":"2024-09-17T05:32:23.455656+0000","last_fullsized":"2024-09-17T05:32:23.455656+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:39.377948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473890+0000","last_change":"2024-09-17T05:32:23.472186+0000","last_active":"2024-09-17T05:32:23.473890+0000","last_peered":"2024-09-17T05:32:23.473890+0000","last_clean":"2024-09-17T05:32:23.473890+0000","last_became_active":"2024-09-17T05:32:23.471921+0000","last_became_peered":"2024-09-17T05:32:23.471921+0000","last_unstale":"2024-09-17T05:32:23.473890+0000","last_undegraded":"2024-09-17T05:32:23.473890+0000","last_fullsized":"2024-09-17T05:32:23.473890+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:12.674920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.472813+0000","last_change":"2024-09-17T05:32:23.466234+0000","last_active":"2024-09-17T05:32:23.472813+0000","last_peered":"2024-09-17T05:32:23.472813+0000","last_clean":"2024-09-17T05:32:23.472813+0000","last_became_active":"2024-09-17T05:32:23.463638+0000","last_became_peered":"2024-09-17T05:32:23.463638+0000","last_unstale":"2024-09-17T05:32:23.472813+0000","last_undegraded":"2024-09-17T05:32:23.472813+0000","last_fullsized":"2024-09-17T05:32:23.472813+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:08.689729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.477018+0000","last_change":"2024-09-17T05:32:23.468316+0000","last_active":"2024-09-17T05:32:23.477018+0000","last_peered":"2024-09-17T05:32:23.477018+0000","last_clean":"2024-09-17T05:32:23.477018+0000","last_became_active":"2024-09-17T05:32:23.466433+0000","last_became_peered":"2024-09-17T05:32:23.466433+0000","last_unstale":"2024-09-17T05:32:23.477018+0000","last_undegraded":"2024-09-17T05:32:23.477018+0000","last_fullsized":"2024-09-17T05:32:23.477018+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:24.514866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473521+0000","last_change":"2024-09-17T05:32:23.468259+0000","last_active":"2024-09-17T05:32:23.473521+0000","last_peered":"2024-09-17T05:32:23.473521+0000","last_clean":"2024-09-17T05:32:23.473521+0000","last_became_active":"2024-09-17T05:32:23.467985+0000","last_became_peered":"2024-09-17T05:32:23.467985+0000","last_unstale":"2024-09-17T05:32:23.473521+0000","last_undegraded":"2024-09-17T05:32:23.473521+0000","last_fullsized":"2024-09-17T05:32:23.473521+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:12.029625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.459406+0000","last_change":"2024-09-17T05:32:23.452018+0000","last_active":"2024-09-17T05:32:23.459406+0000","last_peered":"2024-09-17T05:32:23.459406+0000","last_clean":"2024-09-17T05:32:23.459406+0000","last_became_active":"2024-09-17T05:32:23.451744+0000","last_became_peered":"2024-09-17T05:32:23.451744+0000","last_unstale":"2024-09-17T05:32:23.459406+0000","last_undegraded":"2024-09-17T05:32:23.459406+0000","last_fullsized":"2024-09-17T05:32:23.459406+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:17.778971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.468094+0000","last_change":"2024-09-17T05:32:23.457509+0000","last_active":"2024-09-17T05:32:23.468094+0000","last_peered":"2024-09-17T05:32:23.468094+0000","last_clean":"2024-09-17T05:32:23.468094+0000","last_became_active":"2024-09-17T05:32:23.457200+0000","last_became_peered":"2024-09-17T05:32:23.457200+0000","last_unstale":"2024-09-17T05:32:23.468094+0000","last_undegraded":"2024-09-17T05:32:23.468094+0000","last_fullsized":"2024-09-17T05:32:23.468094+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:41.594515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.471051+0000","last_change":"2024-09-17T05:32:23.460429+0000","last_active":"2024-09-17T05:32:23.471051+0000","last_peered":"2024-09-17T05:32:23.471051+0000","last_clean":"2024-09-17T05:32:23.471051+0000","last_became_active":"2024-09-17T05:32:23.460146+0000","last_became_peered":"2024-09-17T05:32:23.460146+0000","last_unstale":"2024-09-17T05:32:23.471051+0000","last_undegraded":"2024-09-17T05:32:23.471051+0000","last_fullsized":"2024-09-17T05:32:23.471051+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:34.057105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.482849+0000","last_change":"2024-09-17T05:32:23.475449+0000","last_active":"2024-09-17T05:32:23.482849+0000","last_peered":"2024-09-17T05:32:23.482849+0000","last_clean":"2024-09-17T05:32:23.482849+0000","last_became_active":"2024-09-17T05:32:23.473193+0000","last_became_peered":"2024-09-17T05:32:23.473193+0000","last_unstale":"2024-09-17T05:32:23.482849+0000","last_undegraded":"2024-09-17T05:32:23.482849+0000","last_fullsized":"2024-09-17T05:32:23.482849+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:54.940349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.477490+0000","last_change":"2024-09-17T05:32:23.472118+0000","last_active":"2024-09-17T05:32:23.477490+0000","last_peered":"2024-09-17T05:32:23.477490+0000","last_clean":"2024-09-17T05:32:23.477490+0000","last_became_active":"2024-09-17T05:32:23.469804+0000","last_became_peered":"2024-09-17T05:32:23.469804+0000","last_unstale":"2024-09-17T05:32:23.477490+0000","last_undegraded":"2024-09-17T05:32:23.477490+0000","last_fullsized":"2024-09-17T05:32:23.477490+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:19.190696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.474825+0000","last_change":"2024-09-17T05:32:23.465474+0000","last_active":"2024-09-17T05:32:23.474825+0000","last_peered":"2024-09-17T05:32:23.474825+0000","last_clean":"2024-09-17T05:32:23.474825+0000","last_became_active":"2024-09-17T05:32:23.465096+0000","last_became_peered":"2024-09-17T05:32:23.465096+0000","last_unstale":"2024-09-17T05:32:23.474825+0000","last_undegraded":"2024-09-17T05:32:23.474825+0000","last_fullsized":"2024-09-17T05:32:23.474825+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:03.166416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.448398+0000","last_change":"2024-09-17T05:32:23.448398+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.448398+0000","last_undegraded":"2024-09-17T05:32:23.448398+0000","last_fullsized":"2024-09-17T05:32:23.448398+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.471969+0000","last_change":"2024-09-17T05:32:23.464196+0000","last_active":"2024-09-17T05:32:23.471969+0000","last_peered":"2024-09-17T05:32:23.471969+0000","last_clean":"2024-09-17T05:32:23.471969+0000","last_became_active":"2024-09-17T05:32:23.463865+0000","last_became_peered":"2024-09-17T05:32:23.463865+0000","last_unstale":"2024-09-17T05:32:23.471969+0000","last_undegraded":"2024-09-17T05:32:23.471969+0000","last_fullsized":"2024-09-17T05:32:23.471969+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:58.324158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.469683+0000","last_change":"2024-09-17T05:32:23.461193+0000","last_active":"2024-09-17T05:32:23.469683+0000","last_peered":"2024-09-17T05:32:23.469683+0000","last_clean":"2024-09-17T05:32:23.469683+0000","last_became_active":"2024-09-17T05:32:23.460301+0000","last_became_peered":"2024-09-17T05:32:23.460301+0000","last_unstale":"2024-09-17T05:32:23.469683+0000","last_undegraded":"2024-09-17T05:32:23.469683+0000","last_fullsized":"2024-09-17T05:32:23.469683+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:11.922483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.475072+0000","last_change":"2024-09-17T05:32:23.465238+0000","last_active":"2024-09-17T05:32:23.475072+0000","last_peered":"2024-09-17T05:32:23.475072+0000","last_clean":"2024-09-17T05:32:23.475072+0000","last_became_active":"2024-09-17T05:32:23.464992+0000","last_became_peered":"2024-09-17T05:32:23.464992+0000","last_unstale":"2024-09-17T05:32:23.475072+0000","last_undegraded":"2024-09-17T05:32:23.475072+0000","last_fullsized":"2024-09-17T05:32:23.475072+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:59.312163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.466438+0000","last_change":"2024-09-17T05:32:23.466352+0000","last_active":"2024-09-17T05:32:23.466438+0000","last_peered":"2024-09-17T05:32:23.466438+0000","last_clean":"2024-09-17T05:32:23.466438+0000","last_became_active":"2024-09-17T05:32:23.466088+0000","last_became_peered":"2024-09-17T05:32:23.466088+0000","last_unstale":"2024-09-17T05:32:23.466438+0000","last_undegraded":"2024-09-17T05:32:23.466438+0000","last_fullsized":"2024-09-17T05:32:23.466438+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:19.710897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.460367+0000","last_change":"2024-09-17T05:32:23.460284+0000","last_active":"2024-09-17T05:32:23.460367+0000","last_peered":"2024-09-17T05:32:23.460367+0000","last_clean":"2024-09-17T05:32:23.460367+0000","last_became_active":"2024-09-17T05:32:23.460029+0000","last_became_peered":"2024-09-17T05:32:23.460029+0000","last_unstale":"2024-09-17T05:32:23.460367+0000","last_undegraded":"2024-09-17T05:32:23.460367+0000","last_fullsized":"2024-09-17T05:32:23.460367+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:56.581485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.474001+0000","last_change":"2024-09-17T05:32:23.468929+0000","last_active":"2024-09-17T05:32:23.474001+0000","last_peered":"2024-09-17T05:32:23.474001+0000","last_clean":"2024-09-17T05:32:23.474001+0000","last_became_active":"2024-09-17T05:32:23.468673+0000","last_became_peered":"2024-09-17T05:32:23.468673+0000","last_unstale":"2024-09-17T05:32:23.474001+0000","last_undegraded":"2024-09-17T05:32:23.474001+0000","last_fullsized":"2024-09-17T05:32:23.474001+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:18.518043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.483494+0000","last_change":"2024-09-17T05:32:23.475788+0000","last_active":"2024-09-17T05:32:23.483494+0000","last_peered":"2024-09-17T05:32:23.483494+0000","last_clean":"2024-09-17T05:32:23.483494+0000","last_became_active":"2024-09-17T05:32:23.472518+0000","last_became_peered":"2024-09-17T05:32:23.472518+0000","last_unstale":"2024-09-17T05:32:23.483494+0000","last_undegraded":"2024-09-17T05:32:23.483494+0000","last_fullsized":"2024-09-17T05:32:23.483494+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:39:54.219551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"68'4","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.484400+0000","last_change":"2024-09-17T05:32:22.449344+0000","last_active":"2024-09-17T05:32:23.484400+0000","last_peered":"2024-09-17T05:32:23.484400+0000","last_clean":"2024-09-17T05:32:23.484400+0000","last_became_active":"2024-09-17T05:32:22.449043+0000","last_became_peered":"2024-09-17T05:32:22.449043+0000","last_unstale":"2024-09-17T05:32:23.484400+0000","last_undegraded":"2024-09-17T05:32:23.484400+0000","last_fullsized":"2024-09-17T05:32:23.484400+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:33.407326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.478453+0000","last_change":"2024-09-17T05:32:23.472207+0000","last_active":"2024-09-17T05:32:23.478453+0000","last_peered":"2024-09-17T05:32:23.478453+0000","last_clean":"2024-09-17T05:32:23.478453+0000","last_became_active":"2024-09-17T05:32:23.468121+0000","last_became_peered":"2024-09-17T05:32:23.468121+0000","last_unstale":"2024-09-17T05:32:23.478453+0000","last_undegraded":"2024-09-17T05:32:23.478453+0000","last_fullsized":"2024-09-17T05:32:23.478453+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:15.616404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.448120+0000","last_change":"2024-09-17T05:32:22.441202+0000","last_active":"2024-09-17T05:32:23.448120+0000","last_peered":"2024-09-17T05:32:23.448120+0000","last_clean":"2024-09-17T05:32:23.448120+0000","last_became_active":"2024-09-17T05:32:22.440289+0000","last_became_peered":"2024-09-17T05:32:22.440289+0000","last_unstale":"2024-09-17T05:32:23.448120+0000","last_undegraded":"2024-09-17T05:32:23.448120+0000","last_fullsized":"2024-09-17T05:32:23.448120+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:02:57.086704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.474106+0000","last_change":"2024-09-17T05:32:23.467839+0000","last_active":"2024-09-17T05:32:23.474106+0000","last_peered":"2024-09-17T05:32:23.474106+0000","last_clean":"2024-09-17T05:32:23.474106+0000","last_became_active":"2024-09-17T05:32:23.466456+0000","last_became_peered":"2024-09-17T05:32:23.466456+0000","last_unstale":"2024-09-17T05:32:23.474106+0000","last_undegraded":"2024-09-17T05:32:23.474106+0000","last_fullsized":"2024-09-17T05:32:23.474106+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:42.687907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.484999+0000","last_change":"2024-09-17T05:32:22.448229+0000","last_active":"2024-09-17T05:32:23.484999+0000","last_peered":"2024-09-17T05:32:23.484999+0000","last_clean":"2024-09-17T05:32:23.484999+0000","last_became_active":"2024-09-17T05:32:22.447966+0000","last_became_peered":"2024-09-17T05:32:22.447966+0000","last_unstale":"2024-09-17T05:32:23.484999+0000","last_undegraded":"2024-09-17T05:32:23.484999+0000","last_fullsized":"2024-09-17T05:32:23.484999+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:10.281440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.479763+0000","last_change":"2024-09-17T05:32:23.471383+0000","last_active":"2024-09-17T05:32:23.479763+0000","last_peered":"2024-09-17T05:32:23.479763+0000","last_clean":"2024-09-17T05:32:23.479763+0000","last_became_active":"2024-09-17T05:32:23.471094+0000","last_became_peered":"2024-09-17T05:32:23.471094+0000","last_unstale":"2024-09-17T05:32:23.479763+0000","last_undegraded":"2024-09-17T05:32:23.479763+0000","last_fullsized":"2024-09-17T05:32:23.479763+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:29.296974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.485829+0000","last_change":"2024-09-17T05:32:22.447167+0000","last_active":"2024-09-17T05:32:23.485829+0000","last_peered":"2024-09-17T05:32:23.485829+0000","last_clean":"2024-09-17T05:32:23.485829+0000","last_became_active":"2024-09-17T05:32:22.446419+0000","last_became_peered":"2024-09-17T05:32:22.446419+0000","last_unstale":"2024-09-17T05:32:23.485829+0000","last_undegraded":"2024-09-17T05:32:23.485829+0000","last_fullsized":"2024-09-17T05:32:23.485829+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:25.949036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.463055+0000","last_change":"2024-09-17T05:32:23.462966+0000","last_active":"2024-09-17T05:32:23.463055+0000","last_peered":"2024-09-17T05:32:23.463055+0000","last_clean":"2024-09-17T05:32:23.463055+0000","last_became_active":"2024-09-17T05:32:23.462122+0000","last_became_peered":"2024-09-17T05:32:23.462122+0000","last_unstale":"2024-09-17T05:32:23.463055+0000","last_undegraded":"2024-09-17T05:32:23.463055+0000","last_fullsized":"2024-09-17T05:32:23.463055+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:31.757931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.481776+0000","last_change":"2024-09-17T05:32:22.442701+0000","last_active":"2024-09-17T05:32:23.481776+0000","last_peered":"2024-09-17T05:32:23.481776+0000","last_clean":"2024-09-17T05:32:23.481776+0000","last_became_active":"2024-09-17T05:32:22.442400+0000","last_became_peered":"2024-09-17T05:32:22.442400+0000","last_unstale":"2024-09-17T05:32:23.481776+0000","last_undegraded":"2024-09-17T05:32:23.481776+0000","last_fullsized":"2024-09-17T05:32:23.481776+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:53.105004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473924+0000","last_change":"2024-09-17T05:32:23.467226+0000","last_active":"2024-09-17T05:32:23.473924+0000","last_peered":"2024-09-17T05:32:23.473924+0000","last_clean":"2024-09-17T05:32:23.473924+0000","last_became_active":"2024-09-17T05:32:23.466942+0000","last_became_peered":"2024-09-17T05:32:23.466942+0000","last_unstale":"2024-09-17T05:32:23.473924+0000","last_undegraded":"2024-09-17T05:32:23.473924+0000","last_fullsized":"2024-09-17T05:32:23.473924+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:23.653085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480082+0000","last_change":"2024-09-17T05:32:22.442678+0000","last_active":"2024-09-17T05:32:23.480082+0000","last_peered":"2024-09-17T05:32:23.480082+0000","last_clean":"2024-09-17T05:32:23.480082+0000","last_became_active":"2024-09-17T05:32:22.442378+0000","last_became_peered":"2024-09-17T05:32:22.442378+0000","last_unstale":"2024-09-17T05:32:23.480082+0000","last_undegraded":"2024-09-17T05:32:23.480082+0000","last_fullsized":"2024-09-17T05:32:23.480082+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:06.575195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.453952+0000","last_change":"2024-09-17T05:32:23.451743+0000","last_active":"2024-09-17T05:32:23.453952+0000","last_peered":"2024-09-17T05:32:23.453952+0000","last_clean":"2024-09-17T05:32:23.453952+0000","last_became_active":"2024-09-17T05:32:23.449774+0000","last_became_peered":"2024-09-17T05:32:23.449774+0000","last_unstale":"2024-09-17T05:32:23.453952+0000","last_undegraded":"2024-09-17T05:32:23.453952+0000","last_fullsized":"2024-09-17T05:32:23.453952+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:07.226176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.450557+0000","last_change":"2024-09-17T05:32:22.442622+0000","last_active":"2024-09-17T05:32:23.450557+0000","last_peered":"2024-09-17T05:32:23.450557+0000","last_clean":"2024-09-17T05:32:23.450557+0000","last_became_active":"2024-09-17T05:32:22.442317+0000","last_became_peered":"2024-09-17T05:32:22.442317+0000","last_unstale":"2024-09-17T05:32:23.450557+0000","last_undegraded":"2024-09-17T05:32:23.450557+0000","last_fullsized":"2024-09-17T05:32:23.450557+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:52.807454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.446007+0000","last_change":"2024-09-17T05:32:23.446007+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.446007+0000","last_undegraded":"2024-09-17T05:32:23.446007+0000","last_fullsized":"2024-09-17T05:32:23.446007+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":["0","7"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.442387+0000","last_change":"2024-09-17T05:32:22.442544+0000","last_active":"2024-09-17T05:32:23.442387+0000","last_peered":"2024-09-17T05:32:23.442387+0000","last_clean":"2024-09-17T05:32:23.442387+0000","last_became_active":"2024-09-17T05:32:22.442203+0000","last_became_peered":"2024-09-17T05:32:22.442203+0000","last_unstale":"2024-09-17T05:32:23.442387+0000","last_undegraded":"2024-09-17T05:32:23.442387+0000","last_fullsized":"2024-09-17T05:32:23.442387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:26.276161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.465351+0000","last_change":"2024-09-17T05:32:23.465208+0000","last_active":"2024-09-17T05:32:23.465351+0000","last_peered":"2024-09-17T05:32:23.465351+0000","last_clean":"2024-09-17T05:32:23.465351+0000","last_became_active":"2024-09-17T05:32:23.464130+0000","last_became_peered":"2024-09-17T05:32:23.464130+0000","last_unstale":"2024-09-17T05:32:23.465351+0000","last_undegraded":"2024-09-17T05:32:23.465351+0000","last_fullsized":"2024-09-17T05:32:23.465351+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:34.358635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.451960+0000","last_change":"2024-09-17T05:32:22.444219+0000","last_active":"2024-09-17T05:32:23.451960+0000","last_peered":"2024-09-17T05:32:23.451960+0000","last_clean":"2024-09-17T05:32:23.451960+0000","last_became_active":"2024-09-17T05:32:22.443959+0000","last_became_peered":"2024-09-17T05:32:22.443959+0000","last_unstale":"2024-09-17T05:32:23.451960+0000","last_undegraded":"2024-09-17T05:32:23.451960+0000","last_fullsized":"2024-09-17T05:32:23.451960+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:26.409388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.478213+0000","last_change":"2024-09-17T05:32:23.471900+0000","last_active":"2024-09-17T05:32:23.478213+0000","last_peered":"2024-09-17T05:32:23.478213+0000","last_clean":"2024-09-17T05:32:23.478213+0000","last_became_active":"2024-09-17T05:32:23.471558+0000","last_became_peered":"2024-09-17T05:32:23.471558+0000","last_unstale":"2024-09-17T05:32:23.478213+0000","last_undegraded":"2024-09-17T05:32:23.478213+0000","last_fullsized":"2024-09-17T05:32:23.478213+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:40.127810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.465589+0000","last_change":"2024-09-17T05:32:22.439312+0000","last_active":"2024-09-17T05:32:23.465589+0000","last_peered":"2024-09-17T05:32:23.465589+0000","last_clean":"2024-09-17T05:32:23.465589+0000","last_became_active":"2024-09-17T05:32:22.439065+0000","last_became_peered":"2024-09-17T05:32:22.439065+0000","last_unstale":"2024-09-17T05:32:23.465589+0000","last_undegraded":"2024-09-17T05:32:23.465589+0000","last_fullsized":"2024-09-17T05:32:23.465589+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:12.256435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.470920+0000","last_change":"2024-09-17T05:32:23.466273+0000","last_active":"2024-09-17T05:32:23.470920+0000","last_peered":"2024-09-17T05:32:23.470920+0000","last_clean":"2024-09-17T05:32:23.470920+0000","last_became_active":"2024-09-17T05:32:23.466013+0000","last_became_peered":"2024-09-17T05:32:23.466013+0000","last_unstale":"2024-09-17T05:32:23.470920+0000","last_undegraded":"2024-09-17T05:32:23.470920+0000","last_fullsized":"2024-09-17T05:32:23.470920+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:19.045892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.482953+0000","last_change":"2024-09-17T05:32:22.447454+0000","last_active":"2024-09-17T05:32:23.482953+0000","last_peered":"2024-09-17T05:32:23.482953+0000","last_clean":"2024-09-17T05:32:23.482953+0000","last_became_active":"2024-09-17T05:32:22.447114+0000","last_became_peered":"2024-09-17T05:32:22.447114+0000","last_unstale":"2024-09-17T05:32:23.482953+0000","last_undegraded":"2024-09-17T05:32:23.482953+0000","last_fullsized":"2024-09-17T05:32:23.482953+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:18.910750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.464493+0000","last_change":"2024-09-17T05:32:23.461195+0000","last_active":"2024-09-17T05:32:23.464493+0000","last_peered":"2024-09-17T05:32:23.464493+0000","last_clean":"2024-09-17T05:32:23.464493+0000","last_became_active":"2024-09-17T05:32:23.460907+0000","last_became_peered":"2024-09-17T05:32:23.460907+0000","last_unstale":"2024-09-17T05:32:23.464493+0000","last_undegraded":"2024-09-17T05:32:23.464493+0000","last_fullsized":"2024-09-17T05:32:23.464493+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:03.960942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"68'6","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.484750+0000","last_change":"2024-09-17T05:32:22.445768+0000","last_active":"2024-09-17T05:32:23.484750+0000","last_peered":"2024-09-17T05:32:23.484750+0000","last_clean":"2024-09-17T05:32:23.484750+0000","last_became_active":"2024-09-17T05:32:22.445436+0000","last_became_peered":"2024-09-17T05:32:22.445436+0000","last_unstale":"2024-09-17T05:32:23.484750+0000","last_undegraded":"2024-09-17T05:32:23.484750+0000","last_fullsized":"2024-09-17T05:32:23.484750+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:42.876685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.477765+0000","last_change":"2024-09-17T05:32:23.472031+0000","last_active":"2024-09-17T05:32:23.477765+0000","last_peered":"2024-09-17T05:32:23.477765+0000","last_clean":"2024-09-17T05:32:23.477765+0000","last_became_active":"2024-09-17T05:32:23.471718+0000","last_became_peered":"2024-09-17T05:32:23.471718+0000","last_unstale":"2024-09-17T05:32:23.477765+0000","last_undegraded":"2024-09-17T05:32:23.477765+0000","last_fullsized":"2024-09-17T05:32:23.477765+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:55.379210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.481442+0000","last_change":"2024-09-17T05:32:22.444315+0000","last_active":"2024-09-17T05:32:23.481442+0000","last_peered":"2024-09-17T05:32:23.481442+0000","last_clean":"2024-09-17T05:32:23.481442+0000","last_became_active":"2024-09-17T05:32:22.443941+0000","last_became_peered":"2024-09-17T05:32:22.443941+0000","last_unstale":"2024-09-17T05:32:23.481442+0000","last_undegraded":"2024-09-17T05:32:23.481442+0000","last_fullsized":"2024-09-17T05:32:23.481442+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:42.729448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.463785+0000","last_change":"2024-09-17T05:32:23.463690+0000","last_active":"2024-09-17T05:32:23.463785+0000","last_peered":"2024-09-17T05:32:23.463785+0000","last_clean":"2024-09-17T05:32:23.463785+0000","last_became_active":"2024-09-17T05:32:23.463366+0000","last_became_peered":"2024-09-17T05:32:23.463366+0000","last_unstale":"2024-09-17T05:32:23.463785+0000","last_undegraded":"2024-09-17T05:32:23.463785+0000","last_fullsized":"2024-09-17T05:32:23.463785+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:55.837427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.458658+0000","last_change":"2024-09-17T05:32:22.443885+0000","last_active":"2024-09-17T05:32:23.458658+0000","last_peered":"2024-09-17T05:32:23.458658+0000","last_clean":"2024-09-17T05:32:23.458658+0000","last_became_active":"2024-09-17T05:32:22.443550+0000","last_became_peered":"2024-09-17T05:32:22.443550+0000","last_unstale":"2024-09-17T05:32:23.458658+0000","last_undegraded":"2024-09-17T05:32:23.458658+0000","last_fullsized":"2024-09-17T05:32:23.458658+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:30.306584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":3,"reported_epoch":68,"state":"creating+activating","last_fresh":"2024-09-17T05:32:23.445579+0000","last_change":"2024-09-17T05:32:23.445579+0000","last_active":"2024-09-17T05:32:22.415219+0000","last_peered":"2024-09-17T05:32:22.415219+0000","last_clean":"2024-09-17T05:32:22.415219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:23.445579+0000","last_undegraded":"2024-09-17T05:32:23.445579+0000","last_fullsized":"2024-09-17T05:32:23.445579+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.451891+0000","last_change":"2024-09-17T05:32:22.437803+0000","last_active":"2024-09-17T05:32:23.451891+0000","last_peered":"2024-09-17T05:32:23.451891+0000","last_clean":"2024-09-17T05:32:23.451891+0000","last_became_active":"2024-09-17T05:32:22.437197+0000","last_became_peered":"2024-09-17T05:32:22.437197+0000","last_unstale":"2024-09-17T05:32:23.451891+0000","last_undegraded":"2024-09-17T05:32:23.451891+0000","last_fullsized":"2024-09-17T05:32:23.451891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:56.664716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.466991+0000","last_change":"2024-09-17T05:32:23.463878+0000","last_active":"2024-09-17T05:32:23.466991+0000","last_peered":"2024-09-17T05:32:23.466991+0000","last_clean":"2024-09-17T05:32:23.466991+0000","last_became_active":"2024-09-17T05:32:23.463607+0000","last_became_peered":"2024-09-17T05:32:23.463607+0000","last_unstale":"2024-09-17T05:32:23.466991+0000","last_undegraded":"2024-09-17T05:32:23.466991+0000","last_fullsized":"2024-09-17T05:32:23.466991+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:49:48.653310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"68'8","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.485818+0000","last_change":"2024-09-17T05:32:22.445043+0000","last_active":"2024-09-17T05:32:23.485818+0000","last_peered":"2024-09-17T05:32:23.485818+0000","last_clean":"2024-09-17T05:32:23.485818+0000","last_became_active":"2024-09-17T05:32:22.444699+0000","last_became_peered":"2024-09-17T05:32:22.444699+0000","last_unstale":"2024-09-17T05:32:23.485818+0000","last_undegraded":"2024-09-17T05:32:23.485818+0000","last_fullsized":"2024-09-17T05:32:23.485818+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:43.974609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473854+0000","last_change":"2024-09-17T05:32:23.466477+0000","last_active":"2024-09-17T05:32:23.473854+0000","last_peered":"2024-09-17T05:32:23.473854+0000","last_clean":"2024-09-17T05:32:23.473854+0000","last_became_active":"2024-09-17T05:32:23.465510+0000","last_became_peered":"2024-09-17T05:32:23.465510+0000","last_unstale":"2024-09-17T05:32:23.473854+0000","last_undegraded":"2024-09-17T05:32:23.473854+0000","last_fullsized":"2024-09-17T05:32:23.473854+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:55.568809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.486404+0000","last_change":"2024-09-17T05:32:22.444888+0000","last_active":"2024-09-17T05:32:23.486404+0000","last_peered":"2024-09-17T05:32:23.486404+0000","last_clean":"2024-09-17T05:32:23.486404+0000","last_became_active":"2024-09-17T05:32:22.444638+0000","last_became_peered":"2024-09-17T05:32:22.444638+0000","last_unstale":"2024-09-17T05:32:23.486404+0000","last_undegraded":"2024-09-17T05:32:23.486404+0000","last_fullsized":"2024-09-17T05:32:23.486404+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:21.945708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.482877+0000","last_change":"2024-09-17T05:32:23.475204+0000","last_active":"2024-09-17T05:32:23.482877+0000","last_peered":"2024-09-17T05:32:23.482877+0000","last_clean":"2024-09-17T05:32:23.482877+0000","last_became_active":"2024-09-17T05:32:23.474906+0000","last_became_peered":"2024-09-17T05:32:23.474906+0000","last_unstale":"2024-09-17T05:32:23.482877+0000","last_undegraded":"2024-09-17T05:32:23.482877+0000","last_fullsized":"2024-09-17T05:32:23.482877+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:00:36.033925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.485053+0000","last_change":"2024-09-17T05:32:22.440244+0000","last_active":"2024-09-17T05:32:23.485053+0000","last_peered":"2024-09-17T05:32:23.485053+0000","last_clean":"2024-09-17T05:32:23.485053+0000","last_became_active":"2024-09-17T05:32:22.439691+0000","last_became_peered":"2024-09-17T05:32:22.439691+0000","last_unstale":"2024-09-17T05:32:23.485053+0000","last_undegraded":"2024-09-17T05:32:23.485053+0000","last_fullsized":"2024-09-17T05:32:23.485053+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:09.787784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.479806+0000","last_change":"2024-09-17T05:32:23.471381+0000","last_active":"2024-09-17T05:32:23.479806+0000","last_peered":"2024-09-17T05:32:23.479806+0000","last_clean":"2024-09-17T05:32:23.479806+0000","last_became_active":"2024-09-17T05:32:23.467992+0000","last_became_peered":"2024-09-17T05:32:23.467992+0000","last_unstale":"2024-09-17T05:32:23.479806+0000","last_undegraded":"2024-09-17T05:32:23.479806+0000","last_fullsized":"2024-09-17T05:32:23.479806+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:39.870236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.482302+0000","last_change":"2024-09-17T05:32:22.448369+0000","last_active":"2024-09-17T05:32:23.482302+0000","last_peered":"2024-09-17T05:32:23.482302+0000","last_clean":"2024-09-17T05:32:23.482302+0000","last_became_active":"2024-09-17T05:32:22.448107+0000","last_became_peered":"2024-09-17T05:32:22.448107+0000","last_unstale":"2024-09-17T05:32:23.482302+0000","last_undegraded":"2024-09-17T05:32:23.482302+0000","last_fullsized":"2024-09-17T05:32:23.482302+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:05.167911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.454017+0000","last_change":"2024-09-17T05:32:23.451083+0000","last_active":"2024-09-17T05:32:23.454017+0000","last_peered":"2024-09-17T05:32:23.454017+0000","last_clean":"2024-09-17T05:32:23.454017+0000","last_became_active":"2024-09-17T05:32:23.450733+0000","last_became_peered":"2024-09-17T05:32:23.450733+0000","last_unstale":"2024-09-17T05:32:23.454017+0000","last_undegraded":"2024-09-17T05:32:23.454017+0000","last_fullsized":"2024-09-17T05:32:23.454017+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:39.590687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.458497+0000","last_change":"2024-09-17T05:32:22.446119+0000","last_active":"2024-09-17T05:32:23.458497+0000","last_peered":"2024-09-17T05:32:23.458497+0000","last_clean":"2024-09-17T05:32:23.458497+0000","last_became_active":"2024-09-17T05:32:22.445820+0000","last_became_peered":"2024-09-17T05:32:22.445820+0000","last_unstale":"2024-09-17T05:32:23.458497+0000","last_undegraded":"2024-09-17T05:32:23.458497+0000","last_fullsized":"2024-09-17T05:32:23.458497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:34.362788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.475040+0000","last_change":"2024-09-17T05:32:23.464537+0000","last_active":"2024-09-17T05:32:23.475040+0000","last_peered":"2024-09-17T05:32:23.475040+0000","last_clean":"2024-09-17T05:32:23.475040+0000","last_became_active":"2024-09-17T05:32:23.464309+0000","last_became_peered":"2024-09-17T05:32:23.464309+0000","last_unstale":"2024-09-17T05:32:23.475040+0000","last_undegraded":"2024-09-17T05:32:23.475040+0000","last_fullsized":"2024-09-17T05:32:23.475040+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:08.458240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.457213+0000","last_change":"2024-09-17T05:32:22.440316+0000","last_active":"2024-09-17T05:32:23.457213+0000","last_peered":"2024-09-17T05:32:23.457213+0000","last_clean":"2024-09-17T05:32:23.457213+0000","last_became_active":"2024-09-17T05:32:22.440046+0000","last_became_peered":"2024-09-17T05:32:22.440046+0000","last_unstale":"2024-09-17T05:32:23.457213+0000","last_undegraded":"2024-09-17T05:32:23.457213+0000","last_fullsized":"2024-09-17T05:32:23.457213+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:25.752696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480492+0000","last_change":"2024-09-17T05:32:23.470385+0000","last_active":"2024-09-17T05:32:23.480492+0000","last_peered":"2024-09-17T05:32:23.480492+0000","last_clean":"2024-09-17T05:32:23.480492+0000","last_became_active":"2024-09-17T05:32:23.469912+0000","last_became_peered":"2024-09-17T05:32:23.469912+0000","last_unstale":"2024-09-17T05:32:23.480492+0000","last_undegraded":"2024-09-17T05:32:23.480492+0000","last_fullsized":"2024-09-17T05:32:23.480492+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:12.115473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.452105+0000","last_change":"2024-09-17T05:32:22.437497+0000","last_active":"2024-09-17T05:32:23.452105+0000","last_peered":"2024-09-17T05:32:23.452105+0000","last_clean":"2024-09-17T05:32:23.452105+0000","last_became_active":"2024-09-17T05:32:22.436783+0000","last_became_peered":"2024-09-17T05:32:22.436783+0000","last_unstale":"2024-09-17T05:32:23.452105+0000","last_undegraded":"2024-09-17T05:32:23.452105+0000","last_fullsized":"2024-09-17T05:32:23.452105+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:04.046487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480895+0000","last_change":"2024-09-17T05:32:23.470425+0000","last_active":"2024-09-17T05:32:23.480895+0000","last_peered":"2024-09-17T05:32:23.480895+0000","last_clean":"2024-09-17T05:32:23.480895+0000","last_became_active":"2024-09-17T05:32:23.469891+0000","last_became_peered":"2024-09-17T05:32:23.469891+0000","last_unstale":"2024-09-17T05:32:23.480895+0000","last_undegraded":"2024-09-17T05:32:23.480895+0000","last_fullsized":"2024-09-17T05:32:23.480895+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:45.916717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.447169+0000","last_change":"2024-09-17T05:32:22.434037+0000","last_active":"2024-09-17T05:32:23.447169+0000","last_peered":"2024-09-17T05:32:23.447169+0000","last_clean":"2024-09-17T05:32:23.447169+0000","last_became_active":"2024-09-17T05:32:22.433767+0000","last_became_peered":"2024-09-17T05:32:22.433767+0000","last_unstale":"2024-09-17T05:32:23.447169+0000","last_undegraded":"2024-09-17T05:32:23.447169+0000","last_fullsized":"2024-09-17T05:32:23.447169+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:24.523856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.455666+0000","last_change":"2024-09-17T05:32:23.455529+0000","last_active":"2024-09-17T05:32:23.455666+0000","last_peered":"2024-09-17T05:32:23.455666+0000","last_clean":"2024-09-17T05:32:23.455666+0000","last_became_active":"2024-09-17T05:32:23.455038+0000","last_became_peered":"2024-09-17T05:32:23.455038+0000","last_unstale":"2024-09-17T05:32:23.455666+0000","last_undegraded":"2024-09-17T05:32:23.455666+0000","last_fullsized":"2024-09-17T05:32:23.455666+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:58:55.837427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.486063+0000","last_change":"2024-09-17T05:32:22.445506+0000","last_active":"2024-09-17T05:32:23.486063+0000","last_peered":"2024-09-17T05:32:23.486063+0000","last_clean":"2024-09-17T05:32:23.486063+0000","last_became_active":"2024-09-17T05:32:22.445248+0000","last_became_peered":"2024-09-17T05:32:22.445248+0000","last_unstale":"2024-09-17T05:32:23.486063+0000","last_undegraded":"2024-09-17T05:32:23.486063+0000","last_fullsized":"2024-09-17T05:32:23.486063+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:55.664704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.463751+0000","last_change":"2024-09-17T05:32:23.463645+0000","last_active":"2024-09-17T05:32:23.463751+0000","last_peered":"2024-09-17T05:32:23.463751+0000","last_clean":"2024-09-17T05:32:23.463751+0000","last_became_active":"2024-09-17T05:32:23.463264+0000","last_became_peered":"2024-09-17T05:32:23.463264+0000","last_unstale":"2024-09-17T05:32:23.463751+0000","last_undegraded":"2024-09-17T05:32:23.463751+0000","last_fullsized":"2024-09-17T05:32:23.463751+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:35.460618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.449981+0000","last_change":"2024-09-17T05:32:22.439185+0000","last_active":"2024-09-17T05:32:23.449981+0000","last_peered":"2024-09-17T05:32:23.449981+0000","last_clean":"2024-09-17T05:32:23.449981+0000","last_became_active":"2024-09-17T05:32:22.438609+0000","last_became_peered":"2024-09-17T05:32:22.438609+0000","last_unstale":"2024-09-17T05:32:23.449981+0000","last_undegraded":"2024-09-17T05:32:23.449981+0000","last_fullsized":"2024-09-17T05:32:23.449981+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:37.675974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.476082+0000","last_change":"2024-09-17T05:32:23.470673+0000","last_active":"2024-09-17T05:32:23.476082+0000","last_peered":"2024-09-17T05:32:23.476082+0000","last_clean":"2024-09-17T05:32:23.476082+0000","last_became_active":"2024-09-17T05:32:23.470407+0000","last_became_peered":"2024-09-17T05:32:23.470407+0000","last_unstale":"2024-09-17T05:32:23.476082+0000","last_undegraded":"2024-09-17T05:32:23.476082+0000","last_fullsized":"2024-09-17T05:32:23.476082+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:47.333726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.442942+0000","last_change":"2024-09-17T05:32:22.439130+0000","last_active":"2024-09-17T05:32:23.442942+0000","last_peered":"2024-09-17T05:32:23.442942+0000","last_clean":"2024-09-17T05:32:23.442942+0000","last_became_active":"2024-09-17T05:32:22.438837+0000","last_became_peered":"2024-09-17T05:32:22.438837+0000","last_unstale":"2024-09-17T05:32:23.442942+0000","last_undegraded":"2024-09-17T05:32:23.442942+0000","last_fullsized":"2024-09-17T05:32:23.442942+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:40.863254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.479737+0000","last_change":"2024-09-17T05:32:23.474389+0000","last_active":"2024-09-17T05:32:23.479737+0000","last_peered":"2024-09-17T05:32:23.479737+0000","last_clean":"2024-09-17T05:32:23.479737+0000","last_became_active":"2024-09-17T05:32:23.474144+0000","last_became_peered":"2024-09-17T05:32:23.474144+0000","last_unstale":"2024-09-17T05:32:23.479737+0000","last_undegraded":"2024-09-17T05:32:23.479737+0000","last_fullsized":"2024-09-17T05:32:23.479737+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:51.755210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.447521+0000","last_change":"2024-09-17T05:32:22.435023+0000","last_active":"2024-09-17T05:32:23.447521+0000","last_peered":"2024-09-17T05:32:23.447521+0000","last_clean":"2024-09-17T05:32:23.447521+0000","last_became_active":"2024-09-17T05:32:22.434768+0000","last_became_peered":"2024-09-17T05:32:22.434768+0000","last_unstale":"2024-09-17T05:32:23.447521+0000","last_undegraded":"2024-09-17T05:32:23.447521+0000","last_fullsized":"2024-09-17T05:32:23.447521+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:08.940581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.468965+0000","last_change":"2024-09-17T05:32:23.464311+0000","last_active":"2024-09-17T05:32:23.468965+0000","last_peered":"2024-09-17T05:32:23.468965+0000","last_clean":"2024-09-17T05:32:23.468965+0000","last_became_active":"2024-09-17T05:32:23.464023+0000","last_became_peered":"2024-09-17T05:32:23.464023+0000","last_unstale":"2024-09-17T05:32:23.468965+0000","last_undegraded":"2024-09-17T05:32:23.468965+0000","last_fullsized":"2024-09-17T05:32:23.468965+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:05.174497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.442715+0000","last_change":"2024-09-17T05:32:22.436649+0000","last_active":"2024-09-17T05:32:23.442715+0000","last_peered":"2024-09-17T05:32:23.442715+0000","last_clean":"2024-09-17T05:32:23.442715+0000","last_became_active":"2024-09-17T05:32:22.436340+0000","last_became_peered":"2024-09-17T05:32:22.436340+0000","last_unstale":"2024-09-17T05:32:23.442715+0000","last_undegraded":"2024-09-17T05:32:23.442715+0000","last_fullsized":"2024-09-17T05:32:23.442715+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:04.748458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473684+0000","last_change":"2024-09-17T05:32:23.467088+0000","last_active":"2024-09-17T05:32:23.473684+0000","last_peered":"2024-09-17T05:32:23.473684+0000","last_clean":"2024-09-17T05:32:23.473684+0000","last_became_active":"2024-09-17T05:32:23.466798+0000","last_became_peered":"2024-09-17T05:32:23.466798+0000","last_unstale":"2024-09-17T05:32:23.473684+0000","last_undegraded":"2024-09-17T05:32:23.473684+0000","last_fullsized":"2024-09-17T05:32:23.473684+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:49.751254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.451783+0000","last_change":"2024-09-17T05:32:22.442505+0000","last_active":"2024-09-17T05:32:23.451783+0000","last_peered":"2024-09-17T05:32:23.451783+0000","last_clean":"2024-09-17T05:32:23.451783+0000","last_became_active":"2024-09-17T05:32:22.442240+0000","last_became_peered":"2024-09-17T05:32:22.442240+0000","last_unstale":"2024-09-17T05:32:23.451783+0000","last_undegraded":"2024-09-17T05:32:23.451783+0000","last_fullsized":"2024-09-17T05:32:23.451783+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:12.027206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480173+0000","last_change":"2024-09-17T05:32:23.478309+0000","last_active":"2024-09-17T05:32:23.480173+0000","last_peered":"2024-09-17T05:32:23.480173+0000","last_clean":"2024-09-17T05:32:23.480173+0000","last_became_active":"2024-09-17T05:32:23.477989+0000","last_became_peered":"2024-09-17T05:32:23.477989+0000","last_unstale":"2024-09-17T05:32:23.480173+0000","last_undegraded":"2024-09-17T05:32:23.480173+0000","last_fullsized":"2024-09-17T05:32:23.480173+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:43.297508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.450565+0000","last_change":"2024-09-17T05:32:22.442119+0000","last_active":"2024-09-17T05:32:23.450565+0000","last_peered":"2024-09-17T05:32:23.450565+0000","last_clean":"2024-09-17T05:32:23.450565+0000","last_became_active":"2024-09-17T05:32:22.441840+0000","last_became_peered":"2024-09-17T05:32:22.441840+0000","last_unstale":"2024-09-17T05:32:23.450565+0000","last_undegraded":"2024-09-17T05:32:23.450565+0000","last_fullsized":"2024-09-17T05:32:23.450565+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:56.189581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.473956+0000","last_change":"2024-09-17T05:32:23.468778+0000","last_active":"2024-09-17T05:32:23.473956+0000","last_peered":"2024-09-17T05:32:23.473956+0000","last_clean":"2024-09-17T05:32:23.473956+0000","last_became_active":"2024-09-17T05:32:23.468482+0000","last_became_peered":"2024-09-17T05:32:23.468482+0000","last_unstale":"2024-09-17T05:32:23.473956+0000","last_undegraded":"2024-09-17T05:32:23.473956+0000","last_fullsized":"2024-09-17T05:32:23.473956+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:22.648504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.457134+0000","last_change":"2024-09-17T05:32:22.446841+0000","last_active":"2024-09-17T05:32:23.457134+0000","last_peered":"2024-09-17T05:32:23.457134+0000","last_clean":"2024-09-17T05:32:23.457134+0000","last_became_active":"2024-09-17T05:32:22.446488+0000","last_became_peered":"2024-09-17T05:32:22.446488+0000","last_unstale":"2024-09-17T05:32:23.457134+0000","last_undegraded":"2024-09-17T05:32:23.457134+0000","last_fullsized":"2024-09-17T05:32:23.457134+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:10.048155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.480463+0000","last_change":"2024-09-17T05:32:23.469967+0000","last_active":"2024-09-17T05:32:23.480463+0000","last_peered":"2024-09-17T05:32:23.480463+0000","last_clean":"2024-09-17T05:32:23.480463+0000","last_became_active":"2024-09-17T05:32:23.469655+0000","last_became_peered":"2024-09-17T05:32:23.469655+0000","last_unstale":"2024-09-17T05:32:23.480463+0000","last_undegraded":"2024-09-17T05:32:23.480463+0000","last_fullsized":"2024-09-17T05:32:23.480463+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:01.866983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"68'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.485605+0000","last_change":"2024-09-17T05:32:22.446879+0000","last_active":"2024-09-17T05:32:23.485605+0000","last_peered":"2024-09-17T05:32:23.485605+0000","last_clean":"2024-09-17T05:32:23.485605+0000","last_became_active":"2024-09-17T05:32:22.446442+0000","last_became_peered":"2024-09-17T05:32:22.446442+0000","last_unstale":"2024-09-17T05:32:23.485605+0000","last_undegraded":"2024-09-17T05:32:23.485605+0000","last_fullsized":"2024-09-17T05:32:23.485605+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:20.314711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":198,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T05:32:23.460171+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:32:23.460171+0000","last_peered":"2024-09-17T05:32:23.460171+0000","last_clean":"2024-09-17T05:32:23.460171+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:32:23.460171+0000","last_undegraded":"2024-09-17T05:32:23.460171+0000","last_fullsized":"2024-09-17T05:32:23.460171+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1421312,"data_stored":932427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":827392,"data_stored":341535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":823296,"data_stored":341513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":827392,"data_stored":341555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":831488,"data_stored":343055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":839680,"data_stored":343671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542193,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":806912,"data_stored":334668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542192,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1400832,"data_stored":925036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:32:32.242 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:32:32.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.399+0000 7fe9c8200640 1 -- 172.21.15.31:0/3306188518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c0073f20 msgr2=0x7fe9c006cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:32.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.399+0000 7fe9c8200640 1 --2- 172.21.15.31:0/3306188518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c0073f20 0x7fe9c006cc20 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac009840 tx=0x7fe9ac01c760 comp rx=0 tx=0).stop 2024-09-17T05:32:32.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.399+0000 7fe9c8200640 1 -- 172.21.15.31:0/3306188518 shutdown_connections 2024-09-17T05:32:32.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.399+0000 7fe9c8200640 1 --2- 172.21.15.31:0/3306188518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c0073f20 0x7fe9c006cc20 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:32.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.399+0000 7fe9c8200640 1 -- 172.21.15.31:0/3306188518 >> 172.21.15.31:0/3306188518 conn(0x7fe9c006dd30 msgr2=0x7fe9c006e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:32.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.399+0000 7fe9c8200640 1 -- 172.21.15.31:0/3306188518 shutdown_connections 2024-09-17T05:32:32.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.399+0000 7fe9c8200640 1 -- 172.21.15.31:0/3306188518 wait complete. 2024-09-17T05:32:32.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.399+0000 7fe9c8200640 1 Processor -- start 2024-09-17T05:32:32.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.399+0000 7fe9c8200640 1 -- start start 2024-09-17T05:32:32.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c8200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c006d160 0x7fe9c0153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:32.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c8200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c0073f20 0x7fe9c009aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:32.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c8200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c015bd40 0x7fe9c009af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:32.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c8200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c016a720 con 0x7fe9c0073f20 2024-09-17T05:32:32.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c8200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c016a5a0 con 0x7fe9c015bd40 2024-09-17T05:32:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c8200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c016a8a0 con 0x7fe9c006d160 2024-09-17T05:32:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c4e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c0073f20 0x7fe9c009aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c4e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c0073f20 0x7fe9c009aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43056/0 (socket says 172.21.15.31:43056) 2024-09-17T05:32:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c4e00640 1 -- 172.21.15.31:0/1723215843 learned_addr learned my addr 172.21.15.31:0/1723215843 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c5800640 1 --2- 172.21.15.31:0/1723215843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c006d160 0x7fe9c0153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c6200640 1 --2- 172.21.15.31:0/1723215843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c015bd40 0x7fe9c009af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c4e00640 1 -- 172.21.15.31:0/1723215843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c006d160 msgr2=0x7fe9c0153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c4e00640 1 --2- 172.21.15.31:0/1723215843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c006d160 0x7fe9c0153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c4e00640 1 -- 172.21.15.31:0/1723215843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c015bd40 msgr2=0x7fe9c009af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c4e00640 1 --2- 172.21.15.31:0/1723215843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c015bd40 0x7fe9c009af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c4e00640 1 -- 172.21.15.31:0/1723215843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c009b900 con 0x7fe9c0073f20 2024-09-17T05:32:32.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c5800640 1 --2- 172.21.15.31:0/1723215843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c006d160 0x7fe9c0153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:32.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c4e00640 1 --2- 172.21.15.31:0/1723215843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c0073f20 0x7fe9c009aa10 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac009790 tx=0x7fe9ac0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:32.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9bd600640 1 -- 172.21.15.31:0/1723215843 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0b2040 con 0x7fe9c0073f20 2024-09-17T05:32:32.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9bd600640 1 -- 172.21.15.31:0/1723215843 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9ac005020 con 0x7fe9c0073f20 2024-09-17T05:32:32.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9bd600640 1 -- 172.21.15.31:0/1723215843 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac005450 con 0x7fe9c0073f20 2024-09-17T05:32:32.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c8200640 1 -- 172.21.15.31:0/1723215843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c01544a0 con 0x7fe9c0073f20 2024-09-17T05:32:32.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c8200640 1 -- 172.21.15.31:0/1723215843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c0154a60 con 0x7fe9c0073f20 2024-09-17T05:32:32.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9c8200640 1 -- 172.21.15.31:0/1723215843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c006cc20 con 0x7fe9c0073f20 2024-09-17T05:32:32.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.403+0000 7fe9bd600640 1 -- 172.21.15.31:0/1723215843 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7fe9ac0046d0 con 0x7fe9c0073f20 2024-09-17T05:32:32.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.407+0000 7fe9bd600640 1 --2- 172.21.15.31:0/1723215843 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe9a0073560 0x7fe9a0075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:32.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.407+0000 7fe9bd600640 1 -- 172.21.15.31:0/1723215843 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fe9ac12e250 con 0x7fe9c0073f20 2024-09-17T05:32:32.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.407+0000 7fe9c5800640 1 --2- 172.21.15.31:0/1723215843 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe9a0073560 0x7fe9a0075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:32.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.407+0000 7fe9c5800640 1 --2- 172.21.15.31:0/1723215843 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe9a0073560 0x7fe9a0075a20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40046c0 tx=0x7fe9b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:32.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.411+0000 7fe9bd600640 1 -- 172.21.15.31:0/1723215843 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe9ac016410 con 0x7fe9c0073f20 2024-09-17T05:32:32.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.583+0000 7fe9c8200640 1 -- 172.21.15.31:0/1723215843 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe9c015e1e0 con 0x7fe9a0073560 2024-09-17T05:32:32.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.587+0000 7fe9bd600640 1 -- 172.21.15.31:0/1723215843 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252058 (secure 0 0 0) 0x7fe9c015e1e0 con 0x7fe9a0073560 2024-09-17T05:32:32.592 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:32.594 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:32:32.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.591+0000 7fe9c8200640 1 -- 172.21.15.31:0/1723215843 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe9a0073560 msgr2=0x7fe9a0075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:32.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.591+0000 7fe9c8200640 1 --2- 172.21.15.31:0/1723215843 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe9a0073560 0x7fe9a0075a20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe9b40046c0 tx=0x7fe9b4009040 comp rx=0 tx=0).stop 2024-09-17T05:32:32.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.591+0000 7fe9c8200640 1 -- 172.21.15.31:0/1723215843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c0073f20 msgr2=0x7fe9c009aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:32.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.591+0000 7fe9c8200640 1 --2- 172.21.15.31:0/1723215843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c0073f20 0x7fe9c009aa10 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac009790 tx=0x7fe9ac0040e0 comp rx=0 tx=0).stop 2024-09-17T05:32:32.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.591+0000 7fe9c8200640 1 -- 172.21.15.31:0/1723215843 shutdown_connections 2024-09-17T05:32:32.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.591+0000 7fe9c8200640 1 --2- 172.21.15.31:0/1723215843 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fe9a0073560 0x7fe9a0075a20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:32.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.591+0000 7fe9c8200640 1 --2- 172.21.15.31:0/1723215843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9c015bd40 0x7fe9c009af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:32.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.591+0000 7fe9c8200640 1 --2- 172.21.15.31:0/1723215843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe9c0073f20 0x7fe9c009aa10 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:32.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.591+0000 7fe9c8200640 1 --2- 172.21.15.31:0/1723215843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9c006d160 0x7fe9c0153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:32.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.591+0000 7fe9c8200640 1 -- 172.21.15.31:0/1723215843 >> 172.21.15.31:0/1723215843 conn(0x7fe9c006dd30 msgr2=0x7fe9c015abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:32.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.591+0000 7fe9c8200640 1 -- 172.21.15.31:0/1723215843 shutdown_connections 2024-09-17T05:32:32.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.591+0000 7fe9c8200640 1 -- 172.21.15.31:0/1723215843 wait complete. 2024-09-17T05:32:32.613 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-17T05:32:31.235999+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257232,"kb_used_data":7720,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754717488,"statfs":{"total":773094113280,"available":772830707712,"internally_reserved":0,"allocated":7905280,"data_stored":3967500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001790"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.054445+0000","last_change":"2024-09-17T05:32:23.478099+0000","last_active":"2024-09-17T05:32:25.054445+0000","last_peered":"2024-09-17T05:32:25.054445+0000","last_clean":"2024-09-17T05:32:25.054445+0000","last_became_active":"2024-09-17T05:32:23.477783+0000","last_became_peered":"2024-09-17T05:32:23.477783+0000","last_unstale":"2024-09-17T05:32:25.054445+0000","last_undegraded":"2024-09-17T05:32:25.054445+0000","last_fullsized":"2024-09-17T05:32:25.054445+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:13.497447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468311+0000","last_change":"2024-09-17T05:32:23.466050+0000","last_active":"2024-09-17T05:32:24.468311+0000","last_peered":"2024-09-17T05:32:24.468311+0000","last_clean":"2024-09-17T05:32:24.468311+0000","last_became_active":"2024-09-17T05:32:23.465791+0000","last_became_peered":"2024-09-17T05:32:23.465791+0000","last_unstale":"2024-09-17T05:32:24.468311+0000","last_undegraded":"2024-09-17T05:32:24.468311+0000","last_fullsized":"2024-09-17T05:32:24.468311+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:10.339791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.051171+0000","last_change":"2024-09-17T05:32:23.462418+0000","last_active":"2024-09-17T05:32:25.051171+0000","last_peered":"2024-09-17T05:32:25.051171+0000","last_clean":"2024-09-17T05:32:25.051171+0000","last_became_active":"2024-09-17T05:32:23.462073+0000","last_became_peered":"2024-09-17T05:32:23.462073+0000","last_unstale":"2024-09-17T05:32:25.051171+0000","last_undegraded":"2024-09-17T05:32:25.051171+0000","last_fullsized":"2024-09-17T05:32:25.051171+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:43.464709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.051543+0000","last_change":"2024-09-17T05:32:23.472699+0000","last_active":"2024-09-17T05:32:25.051543+0000","last_peered":"2024-09-17T05:32:25.051543+0000","last_clean":"2024-09-17T05:32:25.051543+0000","last_became_active":"2024-09-17T05:32:23.472411+0000","last_became_peered":"2024-09-17T05:32:23.472411+0000","last_unstale":"2024-09-17T05:32:25.051543+0000","last_undegraded":"2024-09-17T05:32:25.051543+0000","last_fullsized":"2024-09-17T05:32:25.051543+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:09.101924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.461227+0000","last_change":"2024-09-17T05:32:23.464155+0000","last_active":"2024-09-17T05:32:24.461227+0000","last_peered":"2024-09-17T05:32:24.461227+0000","last_clean":"2024-09-17T05:32:24.461227+0000","last_became_active":"2024-09-17T05:32:23.463865+0000","last_became_peered":"2024-09-17T05:32:23.463865+0000","last_unstale":"2024-09-17T05:32:24.461227+0000","last_undegraded":"2024-09-17T05:32:24.461227+0000","last_fullsized":"2024-09-17T05:32:24.461227+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:09.803877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.467519+0000","last_change":"2024-09-17T05:32:23.464707+0000","last_active":"2024-09-17T05:32:24.467519+0000","last_peered":"2024-09-17T05:32:24.467519+0000","last_clean":"2024-09-17T05:32:24.467519+0000","last_became_active":"2024-09-17T05:32:23.463900+0000","last_became_peered":"2024-09-17T05:32:23.463900+0000","last_unstale":"2024-09-17T05:32:24.467519+0000","last_undegraded":"2024-09-17T05:32:24.467519+0000","last_fullsized":"2024-09-17T05:32:24.467519+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:21.118618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468854+0000","last_change":"2024-09-17T05:32:23.468056+0000","last_active":"2024-09-17T05:32:24.468854+0000","last_peered":"2024-09-17T05:32:24.468854+0000","last_clean":"2024-09-17T05:32:24.468854+0000","last_became_active":"2024-09-17T05:32:23.467791+0000","last_became_peered":"2024-09-17T05:32:23.467791+0000","last_unstale":"2024-09-17T05:32:24.468854+0000","last_undegraded":"2024-09-17T05:32:24.468854+0000","last_fullsized":"2024-09-17T05:32:24.468854+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:48.388169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.467393+0000","last_change":"2024-09-17T05:32:23.468848+0000","last_active":"2024-09-17T05:32:24.467393+0000","last_peered":"2024-09-17T05:32:24.467393+0000","last_clean":"2024-09-17T05:32:24.467393+0000","last_became_active":"2024-09-17T05:32:23.468572+0000","last_became_peered":"2024-09-17T05:32:23.468572+0000","last_unstale":"2024-09-17T05:32:24.467393+0000","last_undegraded":"2024-09-17T05:32:24.467393+0000","last_fullsized":"2024-09-17T05:32:24.467393+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:29.516151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.461737+0000","last_change":"2024-09-17T05:32:23.474102+0000","last_active":"2024-09-17T05:32:24.461737+0000","last_peered":"2024-09-17T05:32:24.461737+0000","last_clean":"2024-09-17T05:32:24.461737+0000","last_became_active":"2024-09-17T05:32:23.473811+0000","last_became_peered":"2024-09-17T05:32:23.473811+0000","last_unstale":"2024-09-17T05:32:24.461737+0000","last_undegraded":"2024-09-17T05:32:24.461737+0000","last_fullsized":"2024-09-17T05:32:24.461737+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:21.613590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.055334+0000","last_change":"2024-09-17T05:32:23.459987+0000","last_active":"2024-09-17T05:32:25.055334+0000","last_peered":"2024-09-17T05:32:25.055334+0000","last_clean":"2024-09-17T05:32:25.055334+0000","last_became_active":"2024-09-17T05:32:23.459724+0000","last_became_peered":"2024-09-17T05:32:23.459724+0000","last_unstale":"2024-09-17T05:32:25.055334+0000","last_undegraded":"2024-09-17T05:32:25.055334+0000","last_fullsized":"2024-09-17T05:32:25.055334+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:16.190607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.054589+0000","last_change":"2024-09-17T05:32:23.477839+0000","last_active":"2024-09-17T05:32:25.054589+0000","last_peered":"2024-09-17T05:32:25.054589+0000","last_clean":"2024-09-17T05:32:25.054589+0000","last_became_active":"2024-09-17T05:32:23.477026+0000","last_became_peered":"2024-09-17T05:32:23.477026+0000","last_unstale":"2024-09-17T05:32:25.054589+0000","last_undegraded":"2024-09-17T05:32:25.054589+0000","last_fullsized":"2024-09-17T05:32:25.054589+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:51:59.312163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.051669+0000","last_change":"2024-09-17T05:32:23.468520+0000","last_active":"2024-09-17T05:32:25.051669+0000","last_peered":"2024-09-17T05:32:25.051669+0000","last_clean":"2024-09-17T05:32:25.051669+0000","last_became_active":"2024-09-17T05:32:23.467246+0000","last_became_peered":"2024-09-17T05:32:23.467246+0000","last_unstale":"2024-09-17T05:32:25.051669+0000","last_undegraded":"2024-09-17T05:32:25.051669+0000","last_fullsized":"2024-09-17T05:32:25.051669+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:12.831253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468580+0000","last_change":"2024-09-17T05:32:23.463486+0000","last_active":"2024-09-17T05:32:24.468580+0000","last_peered":"2024-09-17T05:32:24.468580+0000","last_clean":"2024-09-17T05:32:24.468580+0000","last_became_active":"2024-09-17T05:32:23.463101+0000","last_became_peered":"2024-09-17T05:32:23.463101+0000","last_unstale":"2024-09-17T05:32:24.468580+0000","last_undegraded":"2024-09-17T05:32:24.468580+0000","last_fullsized":"2024-09-17T05:32:24.468580+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:10.415940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.461222+0000","last_change":"2024-09-17T05:32:23.452918+0000","last_active":"2024-09-17T05:32:24.461222+0000","last_peered":"2024-09-17T05:32:24.461222+0000","last_clean":"2024-09-17T05:32:24.461222+0000","last_became_active":"2024-09-17T05:32:23.452665+0000","last_became_peered":"2024-09-17T05:32:23.452665+0000","last_unstale":"2024-09-17T05:32:24.461222+0000","last_undegraded":"2024-09-17T05:32:24.461222+0000","last_fullsized":"2024-09-17T05:32:24.461222+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:38.741279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468409+0000","last_change":"2024-09-17T05:32:23.455539+0000","last_active":"2024-09-17T05:32:24.468409+0000","last_peered":"2024-09-17T05:32:24.468409+0000","last_clean":"2024-09-17T05:32:24.468409+0000","last_became_active":"2024-09-17T05:32:23.455242+0000","last_became_peered":"2024-09-17T05:32:23.455242+0000","last_unstale":"2024-09-17T05:32:24.468409+0000","last_undegraded":"2024-09-17T05:32:24.468409+0000","last_fullsized":"2024-09-17T05:32:24.468409+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:19.431864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.054232+0000","last_change":"2024-09-17T05:32:23.472186+0000","last_active":"2024-09-17T05:32:25.054232+0000","last_peered":"2024-09-17T05:32:25.054232+0000","last_clean":"2024-09-17T05:32:25.054232+0000","last_became_active":"2024-09-17T05:32:23.471921+0000","last_became_peered":"2024-09-17T05:32:23.471921+0000","last_unstale":"2024-09-17T05:32:25.054232+0000","last_undegraded":"2024-09-17T05:32:25.054232+0000","last_fullsized":"2024-09-17T05:32:25.054232+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:29.152190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.461758+0000","last_change":"2024-09-17T05:32:23.466234+0000","last_active":"2024-09-17T05:32:24.461758+0000","last_peered":"2024-09-17T05:32:24.461758+0000","last_clean":"2024-09-17T05:32:24.461758+0000","last_became_active":"2024-09-17T05:32:23.463638+0000","last_became_peered":"2024-09-17T05:32:23.463638+0000","last_unstale":"2024-09-17T05:32:24.461758+0000","last_undegraded":"2024-09-17T05:32:24.461758+0000","last_fullsized":"2024-09-17T05:32:24.461758+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:44.989396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.051419+0000","last_change":"2024-09-17T05:32:23.468316+0000","last_active":"2024-09-17T05:32:25.051419+0000","last_peered":"2024-09-17T05:32:25.051419+0000","last_clean":"2024-09-17T05:32:25.051419+0000","last_became_active":"2024-09-17T05:32:23.466433+0000","last_became_peered":"2024-09-17T05:32:23.466433+0000","last_unstale":"2024-09-17T05:32:25.051419+0000","last_undegraded":"2024-09-17T05:32:25.051419+0000","last_fullsized":"2024-09-17T05:32:25.051419+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:59.367906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.467517+0000","last_change":"2024-09-17T05:32:23.468259+0000","last_active":"2024-09-17T05:32:24.467517+0000","last_peered":"2024-09-17T05:32:24.467517+0000","last_clean":"2024-09-17T05:32:24.467517+0000","last_became_active":"2024-09-17T05:32:23.467985+0000","last_became_peered":"2024-09-17T05:32:23.467985+0000","last_unstale":"2024-09-17T05:32:24.467517+0000","last_undegraded":"2024-09-17T05:32:24.467517+0000","last_fullsized":"2024-09-17T05:32:24.467517+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:02.628830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468595+0000","last_change":"2024-09-17T05:32:23.452018+0000","last_active":"2024-09-17T05:32:24.468595+0000","last_peered":"2024-09-17T05:32:24.468595+0000","last_clean":"2024-09-17T05:32:24.468595+0000","last_became_active":"2024-09-17T05:32:23.451744+0000","last_became_peered":"2024-09-17T05:32:23.451744+0000","last_unstale":"2024-09-17T05:32:24.468595+0000","last_undegraded":"2024-09-17T05:32:24.468595+0000","last_fullsized":"2024-09-17T05:32:24.468595+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:11:48.388169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.055158+0000","last_change":"2024-09-17T05:32:23.457509+0000","last_active":"2024-09-17T05:32:25.055158+0000","last_peered":"2024-09-17T05:32:25.055158+0000","last_clean":"2024-09-17T05:32:25.055158+0000","last_became_active":"2024-09-17T05:32:23.457200+0000","last_became_peered":"2024-09-17T05:32:23.457200+0000","last_unstale":"2024-09-17T05:32:25.055158+0000","last_undegraded":"2024-09-17T05:32:25.055158+0000","last_fullsized":"2024-09-17T05:32:25.055158+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:07.044582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.054672+0000","last_change":"2024-09-17T05:32:23.460429+0000","last_active":"2024-09-17T05:32:25.054672+0000","last_peered":"2024-09-17T05:32:25.054672+0000","last_clean":"2024-09-17T05:32:25.054672+0000","last_became_active":"2024-09-17T05:32:23.460146+0000","last_became_peered":"2024-09-17T05:32:23.460146+0000","last_unstale":"2024-09-17T05:32:25.054672+0000","last_undegraded":"2024-09-17T05:32:25.054672+0000","last_fullsized":"2024-09-17T05:32:25.054672+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:37.675806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.053889+0000","last_change":"2024-09-17T05:32:23.475449+0000","last_active":"2024-09-17T05:32:25.053889+0000","last_peered":"2024-09-17T05:32:25.053889+0000","last_clean":"2024-09-17T05:32:25.053889+0000","last_became_active":"2024-09-17T05:32:23.473193+0000","last_became_peered":"2024-09-17T05:32:23.473193+0000","last_unstale":"2024-09-17T05:32:25.053889+0000","last_undegraded":"2024-09-17T05:32:25.053889+0000","last_fullsized":"2024-09-17T05:32:25.053889+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:32.337435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.053762+0000","last_change":"2024-09-17T05:32:23.472118+0000","last_active":"2024-09-17T05:32:25.053762+0000","last_peered":"2024-09-17T05:32:25.053762+0000","last_clean":"2024-09-17T05:32:25.053762+0000","last_became_active":"2024-09-17T05:32:23.469804+0000","last_became_peered":"2024-09-17T05:32:23.469804+0000","last_unstale":"2024-09-17T05:32:25.053762+0000","last_undegraded":"2024-09-17T05:32:25.053762+0000","last_fullsized":"2024-09-17T05:32:25.053762+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:00.465515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.055237+0000","last_change":"2024-09-17T05:32:23.465474+0000","last_active":"2024-09-17T05:32:25.055237+0000","last_peered":"2024-09-17T05:32:25.055237+0000","last_clean":"2024-09-17T05:32:25.055237+0000","last_became_active":"2024-09-17T05:32:23.465096+0000","last_became_peered":"2024-09-17T05:32:23.465096+0000","last_unstale":"2024-09-17T05:32:25.055237+0000","last_undegraded":"2024-09-17T05:32:25.055237+0000","last_fullsized":"2024-09-17T05:32:25.055237+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:55.917919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.469228+0000","last_change":"2024-09-17T05:32:23.468518+0000","last_active":"2024-09-17T05:32:24.469228+0000","last_peered":"2024-09-17T05:32:24.469228+0000","last_clean":"2024-09-17T05:32:24.469228+0000","last_became_active":"2024-09-17T05:32:23.468251+0000","last_became_peered":"2024-09-17T05:32:23.468251+0000","last_unstale":"2024-09-17T05:32:24.469228+0000","last_undegraded":"2024-09-17T05:32:24.469228+0000","last_fullsized":"2024-09-17T05:32:24.469228+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:38.321016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.051268+0000","last_change":"2024-09-17T05:32:23.464196+0000","last_active":"2024-09-17T05:32:25.051268+0000","last_peered":"2024-09-17T05:32:25.051268+0000","last_clean":"2024-09-17T05:32:25.051268+0000","last_became_active":"2024-09-17T05:32:23.463865+0000","last_became_peered":"2024-09-17T05:32:23.463865+0000","last_unstale":"2024-09-17T05:32:25.051268+0000","last_undegraded":"2024-09-17T05:32:25.051268+0000","last_fullsized":"2024-09-17T05:32:25.051268+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:55.176215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.054895+0000","last_change":"2024-09-17T05:32:23.461193+0000","last_active":"2024-09-17T05:32:25.054895+0000","last_peered":"2024-09-17T05:32:25.054895+0000","last_clean":"2024-09-17T05:32:25.054895+0000","last_became_active":"2024-09-17T05:32:23.460301+0000","last_became_peered":"2024-09-17T05:32:23.460301+0000","last_unstale":"2024-09-17T05:32:25.054895+0000","last_undegraded":"2024-09-17T05:32:25.054895+0000","last_fullsized":"2024-09-17T05:32:25.054895+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:52.705320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.050798+0000","last_change":"2024-09-17T05:32:23.465238+0000","last_active":"2024-09-17T05:32:25.050798+0000","last_peered":"2024-09-17T05:32:25.050798+0000","last_clean":"2024-09-17T05:32:25.050798+0000","last_became_active":"2024-09-17T05:32:23.464992+0000","last_became_peered":"2024-09-17T05:32:23.464992+0000","last_unstale":"2024-09-17T05:32:25.050798+0000","last_undegraded":"2024-09-17T05:32:25.050798+0000","last_fullsized":"2024-09-17T05:32:25.050798+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:56.024021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468824+0000","last_change":"2024-09-17T05:32:23.466352+0000","last_active":"2024-09-17T05:32:24.468824+0000","last_peered":"2024-09-17T05:32:24.468824+0000","last_clean":"2024-09-17T05:32:24.468824+0000","last_became_active":"2024-09-17T05:32:23.466088+0000","last_became_peered":"2024-09-17T05:32:23.466088+0000","last_unstale":"2024-09-17T05:32:24.468824+0000","last_undegraded":"2024-09-17T05:32:24.468824+0000","last_fullsized":"2024-09-17T05:32:24.468824+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:19.425004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468747+0000","last_change":"2024-09-17T05:32:23.460284+0000","last_active":"2024-09-17T05:32:24.468747+0000","last_peered":"2024-09-17T05:32:24.468747+0000","last_clean":"2024-09-17T05:32:24.468747+0000","last_became_active":"2024-09-17T05:32:23.460029+0000","last_became_peered":"2024-09-17T05:32:23.460029+0000","last_unstale":"2024-09-17T05:32:24.468747+0000","last_undegraded":"2024-09-17T05:32:24.468747+0000","last_fullsized":"2024-09-17T05:32:24.468747+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:52.614122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468160+0000","last_change":"2024-09-17T05:32:23.468929+0000","last_active":"2024-09-17T05:32:24.468160+0000","last_peered":"2024-09-17T05:32:24.468160+0000","last_clean":"2024-09-17T05:32:24.468160+0000","last_became_active":"2024-09-17T05:32:23.468673+0000","last_became_peered":"2024-09-17T05:32:23.468673+0000","last_unstale":"2024-09-17T05:32:24.468160+0000","last_undegraded":"2024-09-17T05:32:24.468160+0000","last_fullsized":"2024-09-17T05:32:24.468160+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:32.521497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.054485+0000","last_change":"2024-09-17T05:32:23.475788+0000","last_active":"2024-09-17T05:32:25.054485+0000","last_peered":"2024-09-17T05:32:25.054485+0000","last_clean":"2024-09-17T05:32:25.054485+0000","last_became_active":"2024-09-17T05:32:23.472518+0000","last_became_peered":"2024-09-17T05:32:23.472518+0000","last_unstale":"2024-09-17T05:32:25.054485+0000","last_undegraded":"2024-09-17T05:32:25.054485+0000","last_fullsized":"2024-09-17T05:32:25.054485+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:58.324158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"68'4","reported_seq":19,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.054755+0000","last_change":"2024-09-17T05:32:22.449344+0000","last_active":"2024-09-17T05:32:25.054755+0000","last_peered":"2024-09-17T05:32:25.054755+0000","last_clean":"2024-09-17T05:32:25.054755+0000","last_became_active":"2024-09-17T05:32:22.449043+0000","last_became_peered":"2024-09-17T05:32:22.449043+0000","last_unstale":"2024-09-17T05:32:25.054755+0000","last_undegraded":"2024-09-17T05:32:25.054755+0000","last_fullsized":"2024-09-17T05:32:25.054755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:33.407326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.461853+0000","last_change":"2024-09-17T05:32:23.472207+0000","last_active":"2024-09-17T05:32:24.461853+0000","last_peered":"2024-09-17T05:32:24.461853+0000","last_clean":"2024-09-17T05:32:24.461853+0000","last_became_active":"2024-09-17T05:32:23.468121+0000","last_became_peered":"2024-09-17T05:32:23.468121+0000","last_unstale":"2024-09-17T05:32:24.461853+0000","last_undegraded":"2024-09-17T05:32:24.461853+0000","last_fullsized":"2024-09-17T05:32:24.461853+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:43.883801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468764+0000","last_change":"2024-09-17T05:32:22.441202+0000","last_active":"2024-09-17T05:32:24.468764+0000","last_peered":"2024-09-17T05:32:24.468764+0000","last_clean":"2024-09-17T05:32:24.468764+0000","last_became_active":"2024-09-17T05:32:22.440289+0000","last_became_peered":"2024-09-17T05:32:22.440289+0000","last_unstale":"2024-09-17T05:32:24.468764+0000","last_undegraded":"2024-09-17T05:32:24.468764+0000","last_fullsized":"2024-09-17T05:32:24.468764+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:02:57.086704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.467391+0000","last_change":"2024-09-17T05:32:23.467839+0000","last_active":"2024-09-17T05:32:24.467391+0000","last_peered":"2024-09-17T05:32:24.467391+0000","last_clean":"2024-09-17T05:32:24.467391+0000","last_became_active":"2024-09-17T05:32:23.466456+0000","last_became_peered":"2024-09-17T05:32:23.466456+0000","last_unstale":"2024-09-17T05:32:24.467391+0000","last_undegraded":"2024-09-17T05:32:24.467391+0000","last_fullsized":"2024-09-17T05:32:24.467391+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:45.173792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.055192+0000","last_change":"2024-09-17T05:32:22.448229+0000","last_active":"2024-09-17T05:32:25.055192+0000","last_peered":"2024-09-17T05:32:25.055192+0000","last_clean":"2024-09-17T05:32:25.055192+0000","last_became_active":"2024-09-17T05:32:22.447966+0000","last_became_peered":"2024-09-17T05:32:22.447966+0000","last_unstale":"2024-09-17T05:32:25.055192+0000","last_undegraded":"2024-09-17T05:32:25.055192+0000","last_fullsized":"2024-09-17T05:32:25.055192+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:10.281440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.054812+0000","last_change":"2024-09-17T05:32:23.471383+0000","last_active":"2024-09-17T05:32:25.054812+0000","last_peered":"2024-09-17T05:32:25.054812+0000","last_clean":"2024-09-17T05:32:25.054812+0000","last_became_active":"2024-09-17T05:32:23.471094+0000","last_became_peered":"2024-09-17T05:32:23.471094+0000","last_unstale":"2024-09-17T05:32:25.054812+0000","last_undegraded":"2024-09-17T05:32:25.054812+0000","last_fullsized":"2024-09-17T05:32:25.054812+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:12.115473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.467609+0000","last_change":"2024-09-17T05:32:22.447167+0000","last_active":"2024-09-17T05:32:24.467609+0000","last_peered":"2024-09-17T05:32:24.467609+0000","last_clean":"2024-09-17T05:32:24.467609+0000","last_became_active":"2024-09-17T05:32:22.446419+0000","last_became_peered":"2024-09-17T05:32:22.446419+0000","last_unstale":"2024-09-17T05:32:24.467609+0000","last_undegraded":"2024-09-17T05:32:24.467609+0000","last_fullsized":"2024-09-17T05:32:24.467609+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:25.949036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468694+0000","last_change":"2024-09-17T05:32:23.462966+0000","last_active":"2024-09-17T05:32:24.468694+0000","last_peered":"2024-09-17T05:32:24.468694+0000","last_clean":"2024-09-17T05:32:24.468694+0000","last_became_active":"2024-09-17T05:32:23.462122+0000","last_became_peered":"2024-09-17T05:32:23.462122+0000","last_unstale":"2024-09-17T05:32:24.468694+0000","last_undegraded":"2024-09-17T05:32:24.468694+0000","last_fullsized":"2024-09-17T05:32:24.468694+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:11.710431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.051026+0000","last_change":"2024-09-17T05:32:22.442701+0000","last_active":"2024-09-17T05:32:25.051026+0000","last_peered":"2024-09-17T05:32:25.051026+0000","last_clean":"2024-09-17T05:32:25.051026+0000","last_became_active":"2024-09-17T05:32:22.442400+0000","last_became_peered":"2024-09-17T05:32:22.442400+0000","last_unstale":"2024-09-17T05:32:25.051026+0000","last_undegraded":"2024-09-17T05:32:25.051026+0000","last_fullsized":"2024-09-17T05:32:25.051026+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:53.105004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.055222+0000","last_change":"2024-09-17T05:32:23.467226+0000","last_active":"2024-09-17T05:32:25.055222+0000","last_peered":"2024-09-17T05:32:25.055222+0000","last_clean":"2024-09-17T05:32:25.055222+0000","last_became_active":"2024-09-17T05:32:23.466942+0000","last_became_peered":"2024-09-17T05:32:23.466942+0000","last_unstale":"2024-09-17T05:32:25.055222+0000","last_undegraded":"2024-09-17T05:32:25.055222+0000","last_fullsized":"2024-09-17T05:32:25.055222+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:44.277401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.467713+0000","last_change":"2024-09-17T05:32:22.442678+0000","last_active":"2024-09-17T05:32:24.467713+0000","last_peered":"2024-09-17T05:32:24.467713+0000","last_clean":"2024-09-17T05:32:24.467713+0000","last_became_active":"2024-09-17T05:32:22.442378+0000","last_became_peered":"2024-09-17T05:32:22.442378+0000","last_unstale":"2024-09-17T05:32:24.467713+0000","last_undegraded":"2024-09-17T05:32:24.467713+0000","last_fullsized":"2024-09-17T05:32:24.467713+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:06.575195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.460922+0000","last_change":"2024-09-17T05:32:23.451743+0000","last_active":"2024-09-17T05:32:24.460922+0000","last_peered":"2024-09-17T05:32:24.460922+0000","last_clean":"2024-09-17T05:32:24.460922+0000","last_became_active":"2024-09-17T05:32:23.449774+0000","last_became_peered":"2024-09-17T05:32:23.449774+0000","last_unstale":"2024-09-17T05:32:24.460922+0000","last_undegraded":"2024-09-17T05:32:24.460922+0000","last_fullsized":"2024-09-17T05:32:24.460922+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:00.600475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.050998+0000","last_change":"2024-09-17T05:32:22.442622+0000","last_active":"2024-09-17T05:32:25.050998+0000","last_peered":"2024-09-17T05:32:25.050998+0000","last_clean":"2024-09-17T05:32:25.050998+0000","last_became_active":"2024-09-17T05:32:22.442317+0000","last_became_peered":"2024-09-17T05:32:22.442317+0000","last_unstale":"2024-09-17T05:32:25.050998+0000","last_undegraded":"2024-09-17T05:32:25.050998+0000","last_fullsized":"2024-09-17T05:32:25.050998+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:52.807454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468437+0000","last_change":"2024-09-17T05:32:23.463214+0000","last_active":"2024-09-17T05:32:24.468437+0000","last_peered":"2024-09-17T05:32:24.468437+0000","last_clean":"2024-09-17T05:32:24.468437+0000","last_became_active":"2024-09-17T05:32:23.462925+0000","last_became_peered":"2024-09-17T05:32:23.462925+0000","last_unstale":"2024-09-17T05:32:24.468437+0000","last_undegraded":"2024-09-17T05:32:24.468437+0000","last_fullsized":"2024-09-17T05:32:24.468437+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:43.813389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.460937+0000","last_change":"2024-09-17T05:32:22.442544+0000","last_active":"2024-09-17T05:32:24.460937+0000","last_peered":"2024-09-17T05:32:24.460937+0000","last_clean":"2024-09-17T05:32:24.460937+0000","last_became_active":"2024-09-17T05:32:22.442203+0000","last_became_peered":"2024-09-17T05:32:22.442203+0000","last_unstale":"2024-09-17T05:32:24.460937+0000","last_undegraded":"2024-09-17T05:32:24.460937+0000","last_fullsized":"2024-09-17T05:32:24.460937+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:26.276161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.469164+0000","last_change":"2024-09-17T05:32:23.465208+0000","last_active":"2024-09-17T05:32:24.469164+0000","last_peered":"2024-09-17T05:32:24.469164+0000","last_clean":"2024-09-17T05:32:24.469164+0000","last_became_active":"2024-09-17T05:32:23.464130+0000","last_became_peered":"2024-09-17T05:32:23.464130+0000","last_unstale":"2024-09-17T05:32:24.469164+0000","last_undegraded":"2024-09-17T05:32:24.469164+0000","last_fullsized":"2024-09-17T05:32:24.469164+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:07.771773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.055665+0000","last_change":"2024-09-17T05:32:22.444219+0000","last_active":"2024-09-17T05:32:25.055665+0000","last_peered":"2024-09-17T05:32:25.055665+0000","last_clean":"2024-09-17T05:32:25.055665+0000","last_became_active":"2024-09-17T05:32:22.443959+0000","last_became_peered":"2024-09-17T05:32:22.443959+0000","last_unstale":"2024-09-17T05:32:25.055665+0000","last_undegraded":"2024-09-17T05:32:25.055665+0000","last_fullsized":"2024-09-17T05:32:25.055665+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:26.409388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.054548+0000","last_change":"2024-09-17T05:32:23.471900+0000","last_active":"2024-09-17T05:32:25.054548+0000","last_peered":"2024-09-17T05:32:25.054548+0000","last_clean":"2024-09-17T05:32:25.054548+0000","last_became_active":"2024-09-17T05:32:23.471558+0000","last_became_peered":"2024-09-17T05:32:23.471558+0000","last_unstale":"2024-09-17T05:32:25.054548+0000","last_undegraded":"2024-09-17T05:32:25.054548+0000","last_fullsized":"2024-09-17T05:32:25.054548+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:08.458240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468367+0000","last_change":"2024-09-17T05:32:22.439312+0000","last_active":"2024-09-17T05:32:24.468367+0000","last_peered":"2024-09-17T05:32:24.468367+0000","last_clean":"2024-09-17T05:32:24.468367+0000","last_became_active":"2024-09-17T05:32:22.439065+0000","last_became_peered":"2024-09-17T05:32:22.439065+0000","last_unstale":"2024-09-17T05:32:24.468367+0000","last_undegraded":"2024-09-17T05:32:24.468367+0000","last_fullsized":"2024-09-17T05:32:24.468367+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:12.256435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.467417+0000","last_change":"2024-09-17T05:32:23.466273+0000","last_active":"2024-09-17T05:32:24.467417+0000","last_peered":"2024-09-17T05:32:24.467417+0000","last_clean":"2024-09-17T05:32:24.467417+0000","last_became_active":"2024-09-17T05:32:23.466013+0000","last_became_peered":"2024-09-17T05:32:23.466013+0000","last_unstale":"2024-09-17T05:32:24.467417+0000","last_undegraded":"2024-09-17T05:32:24.467417+0000","last_fullsized":"2024-09-17T05:32:24.467417+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:32.804772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.051359+0000","last_change":"2024-09-17T05:32:22.447454+0000","last_active":"2024-09-17T05:32:25.051359+0000","last_peered":"2024-09-17T05:32:25.051359+0000","last_clean":"2024-09-17T05:32:25.051359+0000","last_became_active":"2024-09-17T05:32:22.447114+0000","last_became_peered":"2024-09-17T05:32:22.447114+0000","last_unstale":"2024-09-17T05:32:25.051359+0000","last_undegraded":"2024-09-17T05:32:25.051359+0000","last_fullsized":"2024-09-17T05:32:25.051359+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:18.910750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.461364+0000","last_change":"2024-09-17T05:32:23.461195+0000","last_active":"2024-09-17T05:32:24.461364+0000","last_peered":"2024-09-17T05:32:24.461364+0000","last_clean":"2024-09-17T05:32:24.461364+0000","last_became_active":"2024-09-17T05:32:23.460907+0000","last_became_peered":"2024-09-17T05:32:23.460907+0000","last_unstale":"2024-09-17T05:32:24.461364+0000","last_undegraded":"2024-09-17T05:32:24.461364+0000","last_fullsized":"2024-09-17T05:32:24.461364+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:42.093204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"68'6","reported_seq":21,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.051770+0000","last_change":"2024-09-17T05:32:22.445768+0000","last_active":"2024-09-17T05:32:25.051770+0000","last_peered":"2024-09-17T05:32:25.051770+0000","last_clean":"2024-09-17T05:32:25.051770+0000","last_became_active":"2024-09-17T05:32:22.445436+0000","last_became_peered":"2024-09-17T05:32:22.445436+0000","last_unstale":"2024-09-17T05:32:25.051770+0000","last_undegraded":"2024-09-17T05:32:25.051770+0000","last_fullsized":"2024-09-17T05:32:25.051770+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:42.876685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.054044+0000","last_change":"2024-09-17T05:32:23.472031+0000","last_active":"2024-09-17T05:32:25.054044+0000","last_peered":"2024-09-17T05:32:25.054044+0000","last_clean":"2024-09-17T05:32:25.054044+0000","last_became_active":"2024-09-17T05:32:23.471718+0000","last_became_peered":"2024-09-17T05:32:23.471718+0000","last_unstale":"2024-09-17T05:32:25.054044+0000","last_undegraded":"2024-09-17T05:32:25.054044+0000","last_fullsized":"2024-09-17T05:32:25.054044+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:54.112120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.051640+0000","last_change":"2024-09-17T05:32:22.444315+0000","last_active":"2024-09-17T05:32:25.051640+0000","last_peered":"2024-09-17T05:32:25.051640+0000","last_clean":"2024-09-17T05:32:25.051640+0000","last_became_active":"2024-09-17T05:32:22.443941+0000","last_became_peered":"2024-09-17T05:32:22.443941+0000","last_unstale":"2024-09-17T05:32:25.051640+0000","last_undegraded":"2024-09-17T05:32:25.051640+0000","last_fullsized":"2024-09-17T05:32:25.051640+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:42.729448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468872+0000","last_change":"2024-09-17T05:32:23.463690+0000","last_active":"2024-09-17T05:32:24.468872+0000","last_peered":"2024-09-17T05:32:24.468872+0000","last_clean":"2024-09-17T05:32:24.468872+0000","last_became_active":"2024-09-17T05:32:23.463366+0000","last_became_peered":"2024-09-17T05:32:23.463366+0000","last_unstale":"2024-09-17T05:32:24.468872+0000","last_undegraded":"2024-09-17T05:32:24.468872+0000","last_fullsized":"2024-09-17T05:32:24.468872+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:15.531905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.467812+0000","last_change":"2024-09-17T05:32:22.443885+0000","last_active":"2024-09-17T05:32:24.467812+0000","last_peered":"2024-09-17T05:32:24.467812+0000","last_clean":"2024-09-17T05:32:24.467812+0000","last_became_active":"2024-09-17T05:32:22.443550+0000","last_became_peered":"2024-09-17T05:32:22.443550+0000","last_unstale":"2024-09-17T05:32:24.467812+0000","last_undegraded":"2024-09-17T05:32:24.467812+0000","last_fullsized":"2024-09-17T05:32:24.467812+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:30.306584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468320+0000","last_change":"2024-09-17T05:32:23.465173+0000","last_active":"2024-09-17T05:32:24.468320+0000","last_peered":"2024-09-17T05:32:24.468320+0000","last_clean":"2024-09-17T05:32:24.468320+0000","last_became_active":"2024-09-17T05:32:23.464885+0000","last_became_peered":"2024-09-17T05:32:23.464885+0000","last_unstale":"2024-09-17T05:32:24.468320+0000","last_undegraded":"2024-09-17T05:32:24.468320+0000","last_fullsized":"2024-09-17T05:32:24.468320+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:59.418896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468519+0000","last_change":"2024-09-17T05:32:22.437803+0000","last_active":"2024-09-17T05:32:24.468519+0000","last_peered":"2024-09-17T05:32:24.468519+0000","last_clean":"2024-09-17T05:32:24.468519+0000","last_became_active":"2024-09-17T05:32:22.437197+0000","last_became_peered":"2024-09-17T05:32:22.437197+0000","last_unstale":"2024-09-17T05:32:24.468519+0000","last_undegraded":"2024-09-17T05:32:24.468519+0000","last_fullsized":"2024-09-17T05:32:24.468519+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:56.664716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.460945+0000","last_change":"2024-09-17T05:32:23.463878+0000","last_active":"2024-09-17T05:32:24.460945+0000","last_peered":"2024-09-17T05:32:24.460945+0000","last_clean":"2024-09-17T05:32:24.460945+0000","last_became_active":"2024-09-17T05:32:23.463607+0000","last_became_peered":"2024-09-17T05:32:23.463607+0000","last_unstale":"2024-09-17T05:32:24.460945+0000","last_undegraded":"2024-09-17T05:32:24.460945+0000","last_fullsized":"2024-09-17T05:32:24.460945+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:05.497787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"68'8","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.054198+0000","last_change":"2024-09-17T05:32:22.445043+0000","last_active":"2024-09-17T05:32:25.054198+0000","last_peered":"2024-09-17T05:32:25.054198+0000","last_clean":"2024-09-17T05:32:25.054198+0000","last_became_active":"2024-09-17T05:32:22.444699+0000","last_became_peered":"2024-09-17T05:32:22.444699+0000","last_unstale":"2024-09-17T05:32:25.054198+0000","last_undegraded":"2024-09-17T05:32:25.054198+0000","last_fullsized":"2024-09-17T05:32:25.054198+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:43.974609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.055491+0000","last_change":"2024-09-17T05:32:23.466477+0000","last_active":"2024-09-17T05:32:25.055491+0000","last_peered":"2024-09-17T05:32:25.055491+0000","last_clean":"2024-09-17T05:32:25.055491+0000","last_became_active":"2024-09-17T05:32:23.465510+0000","last_became_peered":"2024-09-17T05:32:23.465510+0000","last_unstale":"2024-09-17T05:32:25.055491+0000","last_undegraded":"2024-09-17T05:32:25.055491+0000","last_fullsized":"2024-09-17T05:32:25.055491+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:11.655868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.467938+0000","last_change":"2024-09-17T05:32:22.444888+0000","last_active":"2024-09-17T05:32:24.467938+0000","last_peered":"2024-09-17T05:32:24.467938+0000","last_clean":"2024-09-17T05:32:24.467938+0000","last_became_active":"2024-09-17T05:32:22.444638+0000","last_became_peered":"2024-09-17T05:32:22.444638+0000","last_unstale":"2024-09-17T05:32:24.467938+0000","last_undegraded":"2024-09-17T05:32:24.467938+0000","last_fullsized":"2024-09-17T05:32:24.467938+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:21.945708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.054644+0000","last_change":"2024-09-17T05:32:23.475204+0000","last_active":"2024-09-17T05:32:25.054644+0000","last_peered":"2024-09-17T05:32:25.054644+0000","last_clean":"2024-09-17T05:32:25.054644+0000","last_became_active":"2024-09-17T05:32:23.474906+0000","last_became_peered":"2024-09-17T05:32:23.474906+0000","last_unstale":"2024-09-17T05:32:25.054644+0000","last_undegraded":"2024-09-17T05:32:25.054644+0000","last_fullsized":"2024-09-17T05:32:25.054644+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:01.866983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.055568+0000","last_change":"2024-09-17T05:32:22.440244+0000","last_active":"2024-09-17T05:32:25.055568+0000","last_peered":"2024-09-17T05:32:25.055568+0000","last_clean":"2024-09-17T05:32:25.055568+0000","last_became_active":"2024-09-17T05:32:22.439691+0000","last_became_peered":"2024-09-17T05:32:22.439691+0000","last_unstale":"2024-09-17T05:32:25.055568+0000","last_undegraded":"2024-09-17T05:32:25.055568+0000","last_fullsized":"2024-09-17T05:32:25.055568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:09.787784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.051703+0000","last_change":"2024-09-17T05:32:23.471381+0000","last_active":"2024-09-17T05:32:25.051703+0000","last_peered":"2024-09-17T05:32:25.051703+0000","last_clean":"2024-09-17T05:32:25.051703+0000","last_became_active":"2024-09-17T05:32:23.467992+0000","last_became_peered":"2024-09-17T05:32:23.467992+0000","last_unstale":"2024-09-17T05:32:25.051703+0000","last_undegraded":"2024-09-17T05:32:25.051703+0000","last_fullsized":"2024-09-17T05:32:25.051703+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:00.074346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.467424+0000","last_change":"2024-09-17T05:32:22.448369+0000","last_active":"2024-09-17T05:32:24.467424+0000","last_peered":"2024-09-17T05:32:24.467424+0000","last_clean":"2024-09-17T05:32:24.467424+0000","last_became_active":"2024-09-17T05:32:22.448107+0000","last_became_peered":"2024-09-17T05:32:22.448107+0000","last_unstale":"2024-09-17T05:32:24.467424+0000","last_undegraded":"2024-09-17T05:32:24.467424+0000","last_fullsized":"2024-09-17T05:32:24.467424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:05.167911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.461588+0000","last_change":"2024-09-17T05:32:23.451083+0000","last_active":"2024-09-17T05:32:24.461588+0000","last_peered":"2024-09-17T05:32:24.461588+0000","last_clean":"2024-09-17T05:32:24.461588+0000","last_became_active":"2024-09-17T05:32:23.450733+0000","last_became_peered":"2024-09-17T05:32:23.450733+0000","last_unstale":"2024-09-17T05:32:24.461588+0000","last_undegraded":"2024-09-17T05:32:24.461588+0000","last_fullsized":"2024-09-17T05:32:24.461588+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:03.064549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.054309+0000","last_change":"2024-09-17T05:32:22.446119+0000","last_active":"2024-09-17T05:32:25.054309+0000","last_peered":"2024-09-17T05:32:25.054309+0000","last_clean":"2024-09-17T05:32:25.054309+0000","last_became_active":"2024-09-17T05:32:22.445820+0000","last_became_peered":"2024-09-17T05:32:22.445820+0000","last_unstale":"2024-09-17T05:32:25.054309+0000","last_undegraded":"2024-09-17T05:32:25.054309+0000","last_fullsized":"2024-09-17T05:32:25.054309+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:34.362788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.051058+0000","last_change":"2024-09-17T05:32:23.464537+0000","last_active":"2024-09-17T05:32:25.051058+0000","last_peered":"2024-09-17T05:32:25.051058+0000","last_clean":"2024-09-17T05:32:25.051058+0000","last_became_active":"2024-09-17T05:32:23.464309+0000","last_became_peered":"2024-09-17T05:32:23.464309+0000","last_unstale":"2024-09-17T05:32:25.051058+0000","last_undegraded":"2024-09-17T05:32:25.051058+0000","last_fullsized":"2024-09-17T05:32:25.051058+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:22.539879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.467834+0000","last_change":"2024-09-17T05:32:22.440316+0000","last_active":"2024-09-17T05:32:24.467834+0000","last_peered":"2024-09-17T05:32:24.467834+0000","last_clean":"2024-09-17T05:32:24.467834+0000","last_became_active":"2024-09-17T05:32:22.440046+0000","last_became_peered":"2024-09-17T05:32:22.440046+0000","last_unstale":"2024-09-17T05:32:24.467834+0000","last_undegraded":"2024-09-17T05:32:24.467834+0000","last_fullsized":"2024-09-17T05:32:24.467834+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:25.752696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.050790+0000","last_change":"2024-09-17T05:32:23.470385+0000","last_active":"2024-09-17T05:32:25.050790+0000","last_peered":"2024-09-17T05:32:25.050790+0000","last_clean":"2024-09-17T05:32:25.050790+0000","last_became_active":"2024-09-17T05:32:23.469912+0000","last_became_peered":"2024-09-17T05:32:23.469912+0000","last_unstale":"2024-09-17T05:32:25.050790+0000","last_undegraded":"2024-09-17T05:32:25.050790+0000","last_fullsized":"2024-09-17T05:32:25.050790+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:28.794051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468926+0000","last_change":"2024-09-17T05:32:22.437497+0000","last_active":"2024-09-17T05:32:24.468926+0000","last_peered":"2024-09-17T05:32:24.468926+0000","last_clean":"2024-09-17T05:32:24.468926+0000","last_became_active":"2024-09-17T05:32:22.436783+0000","last_became_peered":"2024-09-17T05:32:22.436783+0000","last_unstale":"2024-09-17T05:32:24.468926+0000","last_undegraded":"2024-09-17T05:32:24.468926+0000","last_fullsized":"2024-09-17T05:32:24.468926+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:04.046487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.050684+0000","last_change":"2024-09-17T05:32:23.470425+0000","last_active":"2024-09-17T05:32:25.050684+0000","last_peered":"2024-09-17T05:32:25.050684+0000","last_clean":"2024-09-17T05:32:25.050684+0000","last_became_active":"2024-09-17T05:32:23.469891+0000","last_became_peered":"2024-09-17T05:32:23.469891+0000","last_unstale":"2024-09-17T05:32:25.050684+0000","last_undegraded":"2024-09-17T05:32:25.050684+0000","last_fullsized":"2024-09-17T05:32:25.050684+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:28:24.219709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468253+0000","last_change":"2024-09-17T05:32:22.434037+0000","last_active":"2024-09-17T05:32:24.468253+0000","last_peered":"2024-09-17T05:32:24.468253+0000","last_clean":"2024-09-17T05:32:24.468253+0000","last_became_active":"2024-09-17T05:32:22.433767+0000","last_became_peered":"2024-09-17T05:32:22.433767+0000","last_unstale":"2024-09-17T05:32:24.468253+0000","last_undegraded":"2024-09-17T05:32:24.468253+0000","last_fullsized":"2024-09-17T05:32:24.468253+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:24.523856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468766+0000","last_change":"2024-09-17T05:32:23.455529+0000","last_active":"2024-09-17T05:32:24.468766+0000","last_peered":"2024-09-17T05:32:24.468766+0000","last_clean":"2024-09-17T05:32:24.468766+0000","last_became_active":"2024-09-17T05:32:23.455038+0000","last_became_peered":"2024-09-17T05:32:23.455038+0000","last_unstale":"2024-09-17T05:32:24.468766+0000","last_undegraded":"2024-09-17T05:32:24.468766+0000","last_fullsized":"2024-09-17T05:32:24.468766+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:04.656041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468038+0000","last_change":"2024-09-17T05:32:22.445506+0000","last_active":"2024-09-17T05:32:24.468038+0000","last_peered":"2024-09-17T05:32:24.468038+0000","last_clean":"2024-09-17T05:32:24.468038+0000","last_became_active":"2024-09-17T05:32:22.445248+0000","last_became_peered":"2024-09-17T05:32:22.445248+0000","last_unstale":"2024-09-17T05:32:24.468038+0000","last_undegraded":"2024-09-17T05:32:24.468038+0000","last_fullsized":"2024-09-17T05:32:24.468038+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:33:55.664704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.469016+0000","last_change":"2024-09-17T05:32:23.463645+0000","last_active":"2024-09-17T05:32:24.469016+0000","last_peered":"2024-09-17T05:32:24.469016+0000","last_clean":"2024-09-17T05:32:24.469016+0000","last_became_active":"2024-09-17T05:32:23.463264+0000","last_became_peered":"2024-09-17T05:32:23.463264+0000","last_unstale":"2024-09-17T05:32:24.469016+0000","last_undegraded":"2024-09-17T05:32:24.469016+0000","last_fullsized":"2024-09-17T05:32:24.469016+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:12:31.459105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"69'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.469340+0000","last_change":"2024-09-17T05:32:22.439185+0000","last_active":"2024-09-17T05:32:24.469340+0000","last_peered":"2024-09-17T05:32:24.469340+0000","last_clean":"2024-09-17T05:32:24.469340+0000","last_became_active":"2024-09-17T05:32:22.438609+0000","last_became_peered":"2024-09-17T05:32:22.438609+0000","last_unstale":"2024-09-17T05:32:24.469340+0000","last_undegraded":"2024-09-17T05:32:24.469340+0000","last_fullsized":"2024-09-17T05:32:24.469340+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:37.675974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.054187+0000","last_change":"2024-09-17T05:32:23.470673+0000","last_active":"2024-09-17T05:32:25.054187+0000","last_peered":"2024-09-17T05:32:25.054187+0000","last_clean":"2024-09-17T05:32:25.054187+0000","last_became_active":"2024-09-17T05:32:23.470407+0000","last_became_peered":"2024-09-17T05:32:23.470407+0000","last_unstale":"2024-09-17T05:32:25.054187+0000","last_undegraded":"2024-09-17T05:32:25.054187+0000","last_fullsized":"2024-09-17T05:32:25.054187+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:19.917866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.461533+0000","last_change":"2024-09-17T05:32:22.439130+0000","last_active":"2024-09-17T05:32:24.461533+0000","last_peered":"2024-09-17T05:32:24.461533+0000","last_clean":"2024-09-17T05:32:24.461533+0000","last_became_active":"2024-09-17T05:32:22.438837+0000","last_became_peered":"2024-09-17T05:32:22.438837+0000","last_unstale":"2024-09-17T05:32:24.461533+0000","last_undegraded":"2024-09-17T05:32:24.461533+0000","last_fullsized":"2024-09-17T05:32:24.461533+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:40.863254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.054855+0000","last_change":"2024-09-17T05:32:23.474389+0000","last_active":"2024-09-17T05:32:25.054855+0000","last_peered":"2024-09-17T05:32:25.054855+0000","last_clean":"2024-09-17T05:32:25.054855+0000","last_became_active":"2024-09-17T05:32:23.474144+0000","last_became_peered":"2024-09-17T05:32:23.474144+0000","last_unstale":"2024-09-17T05:32:25.054855+0000","last_undegraded":"2024-09-17T05:32:25.054855+0000","last_fullsized":"2024-09-17T05:32:25.054855+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:45.916717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468605+0000","last_change":"2024-09-17T05:32:22.435023+0000","last_active":"2024-09-17T05:32:24.468605+0000","last_peered":"2024-09-17T05:32:24.468605+0000","last_clean":"2024-09-17T05:32:24.468605+0000","last_became_active":"2024-09-17T05:32:22.434768+0000","last_became_peered":"2024-09-17T05:32:22.434768+0000","last_unstale":"2024-09-17T05:32:24.468605+0000","last_undegraded":"2024-09-17T05:32:24.468605+0000","last_fullsized":"2024-09-17T05:32:24.468605+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:08.940581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.461249+0000","last_change":"2024-09-17T05:32:23.464311+0000","last_active":"2024-09-17T05:32:24.461249+0000","last_peered":"2024-09-17T05:32:24.461249+0000","last_clean":"2024-09-17T05:32:24.461249+0000","last_became_active":"2024-09-17T05:32:23.464023+0000","last_became_peered":"2024-09-17T05:32:23.464023+0000","last_unstale":"2024-09-17T05:32:24.461249+0000","last_undegraded":"2024-09-17T05:32:24.461249+0000","last_fullsized":"2024-09-17T05:32:24.461249+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:55:58.196451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.461179+0000","last_change":"2024-09-17T05:32:22.436649+0000","last_active":"2024-09-17T05:32:24.461179+0000","last_peered":"2024-09-17T05:32:24.461179+0000","last_clean":"2024-09-17T05:32:24.461179+0000","last_became_active":"2024-09-17T05:32:22.436340+0000","last_became_peered":"2024-09-17T05:32:22.436340+0000","last_unstale":"2024-09-17T05:32:24.461179+0000","last_undegraded":"2024-09-17T05:32:24.461179+0000","last_fullsized":"2024-09-17T05:32:24.461179+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:04.748458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.467371+0000","last_change":"2024-09-17T05:32:23.467088+0000","last_active":"2024-09-17T05:32:24.467371+0000","last_peered":"2024-09-17T05:32:24.467371+0000","last_clean":"2024-09-17T05:32:24.467371+0000","last_became_active":"2024-09-17T05:32:23.466798+0000","last_became_peered":"2024-09-17T05:32:23.466798+0000","last_unstale":"2024-09-17T05:32:24.467371+0000","last_undegraded":"2024-09-17T05:32:24.467371+0000","last_fullsized":"2024-09-17T05:32:24.467371+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:20.030042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.051784+0000","last_change":"2024-09-17T05:32:22.442505+0000","last_active":"2024-09-17T05:32:25.051784+0000","last_peered":"2024-09-17T05:32:25.051784+0000","last_clean":"2024-09-17T05:32:25.051784+0000","last_became_active":"2024-09-17T05:32:22.442240+0000","last_became_peered":"2024-09-17T05:32:22.442240+0000","last_unstale":"2024-09-17T05:32:25.051784+0000","last_undegraded":"2024-09-17T05:32:25.051784+0000","last_fullsized":"2024-09-17T05:32:25.051784+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:12.027206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.050887+0000","last_change":"2024-09-17T05:32:23.478309+0000","last_active":"2024-09-17T05:32:25.050887+0000","last_peered":"2024-09-17T05:32:25.050887+0000","last_clean":"2024-09-17T05:32:25.050887+0000","last_became_active":"2024-09-17T05:32:23.477989+0000","last_became_peered":"2024-09-17T05:32:23.477989+0000","last_unstale":"2024-09-17T05:32:25.050887+0000","last_undegraded":"2024-09-17T05:32:25.050887+0000","last_fullsized":"2024-09-17T05:32:25.050887+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:39.278865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.054308+0000","last_change":"2024-09-17T05:32:22.442119+0000","last_active":"2024-09-17T05:32:25.054308+0000","last_peered":"2024-09-17T05:32:25.054308+0000","last_clean":"2024-09-17T05:32:25.054308+0000","last_became_active":"2024-09-17T05:32:22.441840+0000","last_became_peered":"2024-09-17T05:32:22.441840+0000","last_unstale":"2024-09-17T05:32:25.054308+0000","last_undegraded":"2024-09-17T05:32:25.054308+0000","last_fullsized":"2024-09-17T05:32:25.054308+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:56.189581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.467014+0000","last_change":"2024-09-17T05:32:23.468778+0000","last_active":"2024-09-17T05:32:24.467014+0000","last_peered":"2024-09-17T05:32:24.467014+0000","last_clean":"2024-09-17T05:32:24.467014+0000","last_became_active":"2024-09-17T05:32:23.468482+0000","last_became_peered":"2024-09-17T05:32:23.468482+0000","last_unstale":"2024-09-17T05:32:24.467014+0000","last_undegraded":"2024-09-17T05:32:24.467014+0000","last_fullsized":"2024-09-17T05:32:24.467014+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:47:01.414004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.468030+0000","last_change":"2024-09-17T05:32:22.446841+0000","last_active":"2024-09-17T05:32:24.468030+0000","last_peered":"2024-09-17T05:32:24.468030+0000","last_clean":"2024-09-17T05:32:24.468030+0000","last_became_active":"2024-09-17T05:32:22.446488+0000","last_became_peered":"2024-09-17T05:32:22.446488+0000","last_unstale":"2024-09-17T05:32:24.468030+0000","last_undegraded":"2024-09-17T05:32:24.468030+0000","last_fullsized":"2024-09-17T05:32:24.468030+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:10.048155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.050780+0000","last_change":"2024-09-17T05:32:23.469967+0000","last_active":"2024-09-17T05:32:25.050780+0000","last_peered":"2024-09-17T05:32:25.050780+0000","last_clean":"2024-09-17T05:32:25.050780+0000","last_became_active":"2024-09-17T05:32:23.469655+0000","last_became_peered":"2024-09-17T05:32:23.469655+0000","last_unstale":"2024-09-17T05:32:25.050780+0000","last_undegraded":"2024-09-17T05:32:25.050780+0000","last_fullsized":"2024-09-17T05:32:25.050780+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:22.415219+0000","last_clean_scrub_stamp":"2024-09-17T05:32:22.415219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:07:23.748924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:24.467650+0000","last_change":"2024-09-17T05:32:22.446879+0000","last_active":"2024-09-17T05:32:24.467650+0000","last_peered":"2024-09-17T05:32:24.467650+0000","last_clean":"2024-09-17T05:32:24.467650+0000","last_became_active":"2024-09-17T05:32:22.446442+0000","last_became_peered":"2024-09-17T05:32:22.446442+0000","last_unstale":"2024-09-17T05:32:24.467650+0000","last_undegraded":"2024-09-17T05:32:24.467650+0000","last_fullsized":"2024-09-17T05:32:24.467650+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:21.408103+0000","last_clean_scrub_stamp":"2024-09-17T05:32:21.408103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:20.314711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":200,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:32:25.053830+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:32:25.053830+0000","last_peered":"2024-09-17T05:32:25.053830+0000","last_clean":"2024-09-17T05:32:25.053830+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:32:25.053830+0000","last_undegraded":"2024-09-17T05:32:25.053830+0000","last_fullsized":"2024-09-17T05:32:25.053830+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1433600,"data_stored":938727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509491,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":839680,"data_stored":347835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509491,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":835584,"data_stored":347813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509491,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":839680,"data_stored":347855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509491,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":843776,"data_stored":349355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509489,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":851968,"data_stored":349971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542194,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":835584,"data_stored":347833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542193,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1425408,"data_stored":938111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:32:32.617 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:32:32.617 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:32:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.811+0000 7f5be8200640 1 -- 172.21.15.31:0/4188116650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5be015be10 msgr2=0x7f5be01602f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.811+0000 7f5be8200640 1 --2- 172.21.15.31:0/4188116650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5be015be10 0x7f5be01602f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009840 tx=0x7f5bd401c820 comp rx=0 tx=0).stop 2024-09-17T05:32:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.811+0000 7f5be8200640 1 -- 172.21.15.31:0/4188116650 shutdown_connections 2024-09-17T05:32:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.811+0000 7f5be8200640 1 --2- 172.21.15.31:0/4188116650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5be006cc20 0x7f5be006d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.811+0000 7f5be8200640 1 --2- 172.21.15.31:0/4188116650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5be015be10 0x7f5be01602f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:32.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.811+0000 7f5be8200640 1 -- 172.21.15.31:0/4188116650 >> 172.21.15.31:0/4188116650 conn(0x7f5be00cd740 msgr2=0x7f5be00cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:32.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.811+0000 7f5be8200640 1 -- 172.21.15.31:0/4188116650 shutdown_connections 2024-09-17T05:32:32.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.811+0000 7f5be8200640 1 -- 172.21.15.31:0/4188116650 wait complete. 2024-09-17T05:32:32.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be8200640 1 Processor -- start 2024-09-17T05:32:32.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be8200640 1 -- start start 2024-09-17T05:32:32.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be8200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5be006cc20 0x7f5be01fbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:32.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be8200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5be00cbeb0 0x7f5be015c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:32.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be8200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5be015be10 0x7f5be015c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:32.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be8200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5be0168dc0 con 0x7f5be015be10 2024-09-17T05:32:32.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be8200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5be00cd0a0 con 0x7f5be006cc20 2024-09-17T05:32:32.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be8200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5be0168f40 con 0x7f5be00cbeb0 2024-09-17T05:32:32.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be6200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5be015be10 0x7f5be015c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:32.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be6200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5be015be10 0x7f5be015c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43074/0 (socket says 172.21.15.31:43074) 2024-09-17T05:32:32.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be6200640 1 -- 172.21.15.31:0/3583700597 learned_addr learned my addr 172.21.15.31:0/3583700597 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:32.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be5800640 1 --2- 172.21.15.31:0/3583700597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5be006cc20 0x7f5be01fbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:32.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be4e00640 1 --2- 172.21.15.31:0/3583700597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5be00cbeb0 0x7f5be015c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:32.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be6200640 1 -- 172.21.15.31:0/3583700597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5be00cbeb0 msgr2=0x7f5be015c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:32.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be6200640 1 --2- 172.21.15.31:0/3583700597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5be00cbeb0 0x7f5be015c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:32.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be6200640 1 -- 172.21.15.31:0/3583700597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5be006cc20 msgr2=0x7f5be01fbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:32.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be6200640 1 --2- 172.21.15.31:0/3583700597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5be006cc20 0x7f5be01fbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:32.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be6200640 1 -- 172.21.15.31:0/3583700597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be01fc180 con 0x7f5be015be10 2024-09-17T05:32:32.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be6200640 1 --2- 172.21.15.31:0/3583700597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5be015be10 0x7f5be015c7d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800cad0 tx=0x7f5bd800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:32.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5bdd600640 1 -- 172.21.15.31:0/3583700597 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800ae20 con 0x7f5be015be10 2024-09-17T05:32:32.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5bdd600640 1 -- 172.21.15.31:0/3583700597 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bd800f450 con 0x7f5be015be10 2024-09-17T05:32:32.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5bdd600640 1 -- 172.21.15.31:0/3583700597 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800f8a0 con 0x7f5be015be10 2024-09-17T05:32:32.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be8200640 1 -- 172.21.15.31:0/3583700597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be01f7ea0 con 0x7f5be015be10 2024-09-17T05:32:32.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be8200640 1 -- 172.21.15.31:0/3583700597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be01f8460 con 0x7f5be015be10 2024-09-17T05:32:32.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.815+0000 7f5be8200640 1 -- 172.21.15.31:0/3583700597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5be006d0b0 con 0x7f5be015be10 2024-09-17T05:32:32.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.819+0000 7f5bdd600640 1 -- 172.21.15.31:0/3583700597 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f5bd800fa60 con 0x7f5be015be10 2024-09-17T05:32:32.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.819+0000 7f5bdd600640 1 --2- 172.21.15.31:0/3583700597 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5bc0073560 0x7f5bc0075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:32.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.819+0000 7f5bdd600640 1 -- 172.21.15.31:0/3583700597 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f5bd8095330 con 0x7f5be015be10 2024-09-17T05:32:32.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.819+0000 7f5be5800640 1 --2- 172.21.15.31:0/3583700597 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5bc0073560 0x7f5bc0075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:32.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.819+0000 7f5be5800640 1 --2- 172.21.15.31:0/3583700597 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5bc0073560 0x7f5bc0075a20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40af000 tx=0x7f5bd401b060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:32.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:32.823+0000 7f5bdd600640 1 -- 172.21.15.31:0/3583700597 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5bd8014030 con 0x7f5be015be10 2024-09-17T05:32:33.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.063+0000 7f5be8200640 1 -- 172.21.15.31:0/3583700597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f5be00d0860 con 0x7f5be015be10 2024-09-17T05:32:33.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.063+0000 7f5bdd600640 1 -- 172.21.15.31:0/3583700597 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) ==== 190+0+147 (secure 0 0 0) 0x7f5bd805fe00 con 0x7f5be015be10 2024-09-17T05:32:33.066 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-09-17T05:32:33.066 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw== 2024-09-17T05:32:33.066 INFO:teuthology.orchestra.run.smithi031.stdout: caps mds = "allow" 2024-09-17T05:32:33.066 INFO:teuthology.orchestra.run.smithi031.stdout: caps mon = "allow r" 2024-09-17T05:32:33.067 INFO:teuthology.orchestra.run.smithi031.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:32:33.067 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2024-09-17T05:32:33.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.067+0000 7f5be8200640 1 -- 172.21.15.31:0/3583700597 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5bc0073560 msgr2=0x7f5bc0075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:33.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.067+0000 7f5be8200640 1 --2- 172.21.15.31:0/3583700597 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5bc0073560 0x7f5bc0075a20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40af000 tx=0x7f5bd401b060 comp rx=0 tx=0).stop 2024-09-17T05:32:33.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.067+0000 7f5be8200640 1 -- 172.21.15.31:0/3583700597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5be015be10 msgr2=0x7f5be015c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:33.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.067+0000 7f5be8200640 1 --2- 172.21.15.31:0/3583700597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5be015be10 0x7f5be015c7d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800cad0 tx=0x7f5bd800cf90 comp rx=0 tx=0).stop 2024-09-17T05:32:33.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.067+0000 7f5be8200640 1 -- 172.21.15.31:0/3583700597 shutdown_connections 2024-09-17T05:32:33.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.067+0000 7f5be8200640 1 --2- 172.21.15.31:0/3583700597 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5bc0073560 0x7f5bc0075a20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:33.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.067+0000 7f5be8200640 1 --2- 172.21.15.31:0/3583700597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5be015be10 0x7f5be015c7d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:33.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.067+0000 7f5be8200640 1 --2- 172.21.15.31:0/3583700597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5be00cbeb0 0x7f5be015c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:33.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.067+0000 7f5be8200640 1 --2- 172.21.15.31:0/3583700597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5be006cc20 0x7f5be01fbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:33.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.067+0000 7f5be8200640 1 -- 172.21.15.31:0/3583700597 >> 172.21.15.31:0/3583700597 conn(0x7f5be00cd740 msgr2=0x7f5be014b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:33.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.067+0000 7f5be8200640 1 -- 172.21.15.31:0/3583700597 shutdown_connections 2024-09-17T05:32:33.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.067+0000 7f5be8200640 1 -- 172.21.15.31:0/3583700597 wait complete. 2024-09-17T05:32:33.088 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:32:33.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.235+0000 7ffb91c00640 1 -- 172.21.15.31:0/428430631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb70004810 msgr2=0x7ffb70004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:33.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.235+0000 7ffb91c00640 1 --2- 172.21.15.31:0/428430631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb70004810 0x7ffb70004c90 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009b30 tx=0x7ffb7401d1e0 comp rx=0 tx=0).stop 2024-09-17T05:32:33.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.235+0000 7ffb91c00640 1 -- 172.21.15.31:0/428430631 shutdown_connections 2024-09-17T05:32:33.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.235+0000 7ffb91c00640 1 --2- 172.21.15.31:0/428430631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb70004810 0x7ffb70004c90 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:33.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.235+0000 7ffb91c00640 1 -- 172.21.15.31:0/428430631 >> 172.21.15.31:0/428430631 conn(0x7ffb8c06dd30 msgr2=0x7ffb8c06e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:33.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.235+0000 7ffb91c00640 1 -- 172.21.15.31:0/428430631 shutdown_connections 2024-09-17T05:32:33.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.235+0000 7ffb91c00640 1 -- 172.21.15.31:0/428430631 wait complete. 2024-09-17T05:32:33.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.235+0000 7ffb91c00640 1 Processor -- start 2024-09-17T05:32:33.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.235+0000 7ffb91c00640 1 -- start start 2024-09-17T05:32:33.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb91c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb70004810 0x7ffb8c151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:33.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb91c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb8c0cad30 0x7ffb8c0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:33.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb91c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb8c0cc950 0x7ffb8c15dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:33.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb91c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c160130 con 0x7ffb8c0cc950 2024-09-17T05:32:33.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb91c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8c15ffb0 con 0x7ffb8c0cad30 2024-09-17T05:32:33.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb91c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffb8c1602b0 con 0x7ffb70004810 2024-09-17T05:32:33.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb8b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb8c0cc950 0x7ffb8c15dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:33.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb8b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb8c0cc950 0x7ffb8c15dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43088/0 (socket says 172.21.15.31:43088) 2024-09-17T05:32:33.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb8b400640 1 -- 172.21.15.31:0/1363841091 learned_addr learned my addr 172.21.15.31:0/1363841091 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:33.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb83e00640 1 --2- 172.21.15.31:0/1363841091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb8c0cad30 0x7ffb8c0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:33.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb8aa00640 1 --2- 172.21.15.31:0/1363841091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb70004810 0x7ffb8c151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:33.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb8b400640 1 -- 172.21.15.31:0/1363841091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb70004810 msgr2=0x7ffb8c151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:33.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb8b400640 1 --2- 172.21.15.31:0/1363841091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb70004810 0x7ffb8c151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:33.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb8b400640 1 -- 172.21.15.31:0/1363841091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb8c0cad30 msgr2=0x7ffb8c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:33.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb8b400640 1 --2- 172.21.15.31:0/1363841091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb8c0cad30 0x7ffb8c0cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:33.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb8b400640 1 -- 172.21.15.31:0/1363841091 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8c0ccef0 con 0x7ffb8c0cc950 2024-09-17T05:32:33.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb8b400640 1 --2- 172.21.15.31:0/1363841091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb8c0cc950 0x7ffb8c15dd00 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ffb84000f90 tx=0x7ffb840019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:33.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb82a00640 1 -- 172.21.15.31:0/1363841091 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb84011660 con 0x7ffb8c0cc950 2024-09-17T05:32:33.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb82a00640 1 -- 172.21.15.31:0/1363841091 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb84017070 con 0x7ffb8c0cc950 2024-09-17T05:32:33.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb82a00640 1 -- 172.21.15.31:0/1363841091 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb84011bb0 con 0x7ffb8c0cc950 2024-09-17T05:32:33.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb91c00640 1 -- 172.21.15.31:0/1363841091 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb8c1f9450 con 0x7ffb8c0cc950 2024-09-17T05:32:33.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb91c00640 1 -- 172.21.15.31:0/1363841091 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb8c1f9a10 con 0x7ffb8c0cc950 2024-09-17T05:32:33.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.239+0000 7ffb91c00640 1 -- 172.21.15.31:0/1363841091 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb8c0b3c00 con 0x7ffb8c0cc950 2024-09-17T05:32:33.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.243+0000 7ffb82a00640 1 -- 172.21.15.31:0/1363841091 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7ffb8401c460 con 0x7ffb8c0cc950 2024-09-17T05:32:33.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.243+0000 7ffb82a00640 1 --2- 172.21.15.31:0/1363841091 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffb680735c0 0x7ffb68075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:33.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.243+0000 7ffb82a00640 1 -- 172.21.15.31:0/1363841091 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7ffb84094d40 con 0x7ffb8c0cc950 2024-09-17T05:32:33.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.243+0000 7ffb8aa00640 1 --2- 172.21.15.31:0/1363841091 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffb680735c0 0x7ffb68075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:33.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.243+0000 7ffb8aa00640 1 --2- 172.21.15.31:0/1363841091 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffb680735c0 0x7ffb68075a80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c15f4f0 tx=0x7ffb7c001cc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:33.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.247+0000 7ffb82a00640 1 -- 172.21.15.31:0/1363841091 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ffb8c074390 con 0x7ffb8c0cc950 2024-09-17T05:32:33.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.459+0000 7ffb91c00640 1 -- 172.21.15.31:0/1363841091 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb8c158f40 con 0x7ffb8c0cc950 2024-09-17T05:32:33.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.459+0000 7ffb82a00640 1 -- 172.21.15.31:0/1363841091 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5231 (secure 0 0 0) 0x7ffb8405f240 con 0x7ffb8c0cc950 2024-09-17T05:32:33.460 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:33.460 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":47,"btime":"2024-09-17T05:32:26:465301+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/4172452504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":4172452504},{"type":"v1","addr":"172.21.15.155:6837","nonce":4172452504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2918874157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2918874157},{"type":"v1","addr":"172.21.15.155:6836","nonce":2918874157}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3987740697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3987740697},{"type":"v1","addr":"172.21.15.31:6833","nonce":3987740697}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:32:22.832719+0000","modified":"2024-09-17T05:32:25.871459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6153":{"gid":6153,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1598380263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1598380263},{"type":"v1","addr":"172.21.15.31:6835","nonce":1598380263}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6153,"qdb_cluster":[6153]},"id":5}]} 2024-09-17T05:32:33.460 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 47 2024-09-17T05:32:33.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.459+0000 7ffb91c00640 1 -- 172.21.15.31:0/1363841091 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffb680735c0 msgr2=0x7ffb68075a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:33.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.459+0000 7ffb91c00640 1 --2- 172.21.15.31:0/1363841091 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffb680735c0 0x7ffb68075a80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c15f4f0 tx=0x7ffb7c001cc0 comp rx=0 tx=0).stop 2024-09-17T05:32:33.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.459+0000 7ffb91c00640 1 -- 172.21.15.31:0/1363841091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb8c0cc950 msgr2=0x7ffb8c15dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:33.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.459+0000 7ffb91c00640 1 --2- 172.21.15.31:0/1363841091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb8c0cc950 0x7ffb8c15dd00 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ffb84000f90 tx=0x7ffb840019c0 comp rx=0 tx=0).stop 2024-09-17T05:32:33.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.459+0000 7ffb91c00640 1 -- 172.21.15.31:0/1363841091 shutdown_connections 2024-09-17T05:32:33.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.459+0000 7ffb91c00640 1 --2- 172.21.15.31:0/1363841091 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ffb680735c0 0x7ffb68075a80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:33.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.459+0000 7ffb91c00640 1 --2- 172.21.15.31:0/1363841091 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb8c0cc950 0x7ffb8c15dd00 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:33.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.459+0000 7ffb91c00640 1 --2- 172.21.15.31:0/1363841091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb8c0cad30 0x7ffb8c0cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:33.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.459+0000 7ffb91c00640 1 --2- 172.21.15.31:0/1363841091 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb70004810 0x7ffb8c151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:33.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.459+0000 7ffb91c00640 1 -- 172.21.15.31:0/1363841091 >> 172.21.15.31:0/1363841091 conn(0x7ffb8c06dd30 msgr2=0x7ffb8c154af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:33.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.459+0000 7ffb91c00640 1 -- 172.21.15.31:0/1363841091 shutdown_connections 2024-09-17T05:32:33.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:33.459+0000 7ffb91c00640 1 -- 172.21.15.31:0/1363841091 wait complete. 2024-09-17T05:32:33.884 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:32:22.832719+0000', 'modified': '2024-09-17T05:32:25.871459+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6153}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6153': {'gid': 6153, 'name': 'c', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/1598380263', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 1598380263}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 1598380263}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6153, 'qdb_cluster': [6153]} 2024-09-17T05:32:33.884 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:32:33.885 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:32:34.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f25800640 1 -- 172.21.15.31:0/2033518365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f20073170 msgr2=0x7f3f2006f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:34.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f25800640 1 --2- 172.21.15.31:0/2033518365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f20073170 0x7f3f2006f520 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3f20069190 tx=0x7f3f0801c8a0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f25800640 1 -- 172.21.15.31:0/2033518365 shutdown_connections 2024-09-17T05:32:34.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f25800640 1 --2- 172.21.15.31:0/2033518365 >> v2:172.21.15.155:3300/0 conn(0x7f3f2006d330 0x7f3f2006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f25800640 1 --2- 172.21.15.31:0/2033518365 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f20073170 0x7f3f2006f520 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f25800640 1 -- 172.21.15.31:0/2033518365 >> 172.21.15.31:0/2033518365 conn(0x7f3f200b2240 msgr2=0x7f3f200b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:34.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f25800640 1 -- 172.21.15.31:0/2033518365 shutdown_connections 2024-09-17T05:32:34.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f25800640 1 -- 172.21.15.31:0/2033518365 wait complete. 2024-09-17T05:32:34.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f25800640 1 Processor -- start 2024-09-17T05:32:34.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f25800640 1 -- start start 2024-09-17T05:32:34.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f25800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f2006d330 0x7f3f2015a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f25800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f20073170 0x7f3f200b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f25800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f200ce800 0x7f3f2013edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f25800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3f20168390 con 0x7f3f200ce800 2024-09-17T05:32:34.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f25800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3f20168210 con 0x7f3f2006d330 2024-09-17T05:32:34.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f25800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3f20168510 con 0x7f3f20073170 2024-09-17T05:32:34.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f1f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f200ce800 0x7f3f2013edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f1f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f200ce800 0x7f3f2013edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43114/0 (socket says 172.21.15.31:43114) 2024-09-17T05:32:34.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.035+0000 7f3f1f400640 1 -- 172.21.15.31:0/1807558995 learned_addr learned my addr 172.21.15.31:0/1807558995 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:34.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.039+0000 7f3f17e00640 1 --2- 172.21.15.31:0/1807558995 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f20073170 0x7f3f200b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.039+0000 7f3f1ea00640 1 --2- 172.21.15.31:0/1807558995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f2006d330 0x7f3f2015a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.039+0000 7f3f1f400640 1 -- 172.21.15.31:0/1807558995 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f20073170 msgr2=0x7f3f200b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:34.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.039+0000 7f3f1f400640 1 --2- 172.21.15.31:0/1807558995 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f20073170 0x7f3f200b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.039+0000 7f3f1f400640 1 -- 172.21.15.31:0/1807558995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f2006d330 msgr2=0x7f3f2015a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:34.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.039+0000 7f3f1f400640 1 --2- 172.21.15.31:0/1807558995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f2006d330 0x7f3f2015a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.039+0000 7f3f1f400640 1 -- 172.21.15.31:0/1807558995 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f201f8ae0 con 0x7f3f200ce800 2024-09-17T05:32:34.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.039+0000 7f3f1f400640 1 --2- 172.21.15.31:0/1807558995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f200ce800 0x7f3f2013edf0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800e9e0 tx=0x7f3f1800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:34.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.039+0000 7f3f16a00640 1 -- 172.21.15.31:0/1807558995 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1800cd50 con 0x7f3f200ce800 2024-09-17T05:32:34.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.039+0000 7f3f16a00640 1 -- 172.21.15.31:0/1807558995 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f18004b30 con 0x7f3f200ce800 2024-09-17T05:32:34.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.039+0000 7f3f16a00640 1 -- 172.21.15.31:0/1807558995 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18005020 con 0x7f3f200ce800 2024-09-17T05:32:34.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.039+0000 7f3f25800640 1 -- 172.21.15.31:0/1807558995 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f201f7d20 con 0x7f3f200ce800 2024-09-17T05:32:34.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.039+0000 7f3f25800640 1 -- 172.21.15.31:0/1807558995 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f201f82e0 con 0x7f3f200ce800 2024-09-17T05:32:34.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.039+0000 7f3f16a00640 1 -- 172.21.15.31:0/1807558995 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f3f180051c0 con 0x7f3f200ce800 2024-09-17T05:32:34.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f16a00640 1 --2- 172.21.15.31:0/1807558995 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3efc073590 0x7f3efc075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f28bdf000 1 Processor -- start 2024-09-17T05:32:34.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f16a00640 1 -- 172.21.15.31:0/1807558995 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f3f18095100 con 0x7f3f200ce800 2024-09-17T05:32:34.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f28bdf000 1 -- start start 2024-09-17T05:32:34.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f1ea00640 1 --2- 172.21.15.31:0/1807558995 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3efc073590 0x7f3efc075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f28bdf000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6eee9d0 0x55b5b6eeedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f28bdf000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6eef2f0 0x55b5b6ea28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f28bdf000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6ea2e10 0x55b5b6ea31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f28bdf000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b5b6dc33f0 con 0x55b5b6ea2e10 2024-09-17T05:32:34.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f28bdf000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b5b6d00b20 con 0x55b5b6eef2f0 2024-09-17T05:32:34.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f28bdf000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55b5b6ceff50 con 0x55b5b6eee9d0 2024-09-17T05:32:34.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f1ea00640 1 --2- 172.21.15.31:0/1807558995 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3efc073590 0x7f3efc075a50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3f100098e0 tx=0x7f3f10009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:34.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f1f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6ea2e10 0x55b5b6ea31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f1ea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6eee9d0 0x55b5b6eeedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f17e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6eef2f0 0x55b5b6ea28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f1f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6ea2e10 0x55b5b6ea31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43116/0 (socket says 172.21.15.31:43116) 2024-09-17T05:32:34.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f1f400640 1 -- 172.21.15.31:0/1724875260 learned_addr learned my addr 172.21.15.31:0/1724875260 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:34.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f1f400640 1 -- 172.21.15.31:0/1724875260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6eee9d0 msgr2=0x55b5b6eeedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:32:34.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f1f400640 1 --2- 172.21.15.31:0/1724875260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6eee9d0 0x55b5b6eeedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f1f400640 1 -- 172.21.15.31:0/1724875260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6eef2f0 msgr2=0x55b5b6ea28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:32:34.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f1f400640 1 --2- 172.21.15.31:0/1724875260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6eef2f0 0x55b5b6ea28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f1f400640 1 -- 172.21.15.31:0/1724875260 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b6cb7590 con 0x55b5b6ea2e10 2024-09-17T05:32:34.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f1f400640 1 --2- 172.21.15.31:0/1724875260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6ea2e10 0x55b5b6ea31f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800efd0 tx=0x7f3f1805f0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db75a8b225598cb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:34.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f0f400640 1 -- 172.21.15.31:0/1724875260 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1801f040 con 0x55b5b6ea2e10 2024-09-17T05:32:34.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f0f400640 1 -- 172.21.15.31:0/1724875260 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f1805e960 con 0x55b5b6ea2e10 2024-09-17T05:32:34.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f0f400640 1 -- 172.21.15.31:0/1724875260 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18066360 con 0x55b5b6ea2e10 2024-09-17T05:32:34.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1724875260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6ea2e10 msgr2=0x55b5b6ea31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:34.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/1724875260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6ea2e10 0x55b5b6ea31f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800efd0 tx=0x7f3f1805f0d0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1724875260 shutdown_connections 2024-09-17T05:32:34.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/1724875260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6ea2e10 0x55b5b6ea31f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/1724875260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6eef2f0 0x55b5b6ea28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/1724875260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6eee9d0 0x55b5b6eeedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1724875260 >> 172.21.15.31:0/1724875260 conn(0x55b5b6d8c130 msgr2=0x55b5b6ed1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:34.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1724875260 shutdown_connections 2024-09-17T05:32:34.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.043+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1724875260 wait complete. 2024-09-17T05:32:34.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f28bdf000 1 -- start start 2024-09-17T05:32:34.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f28bdf000 1 Processor -- start 2024-09-17T05:32:34.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f28bdf000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6ea2e10 0x55b5b6ea4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f28bdf000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6eee9d0 0x55b5b6ea4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f28bdf000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6eef2f0 0x55b5b6ea4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f28bdf000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b5b6c8a5d0 con 0x55b5b6eee9d0 2024-09-17T05:32:34.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f28bdf000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b5b6cf3d60 con 0x55b5b6eef2f0 2024-09-17T05:32:34.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f28bdf000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55b5b6c96500 con 0x55b5b6ea2e10 2024-09-17T05:32:34.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f28bdf000 10 client.0 _ll_register_callbacks cb 0x55b5b6c9a810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:32:34.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f17e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6eee9d0 0x55b5b6ea4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f1ea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6ea2e10 0x55b5b6ea4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f17e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6eee9d0 0x55b5b6ea4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43126/0 (socket says 172.21.15.31:43126) 2024-09-17T05:32:34.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f17e00640 1 -- 172.21.15.31:0/1833644654 learned_addr learned my addr 172.21.15.31:0/1833644654 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:34.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f1f400640 1 --2- 172.21.15.31:0/1833644654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6eef2f0 0x55b5b6ea4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f17e00640 1 -- 172.21.15.31:0/1833644654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6ea2e10 msgr2=0x55b5b6ea4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:32:34.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f17e00640 1 --2- 172.21.15.31:0/1833644654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6ea2e10 0x55b5b6ea4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f17e00640 1 -- 172.21.15.31:0/1833644654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6eef2f0 msgr2=0x55b5b6ea4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:32:34.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f17e00640 1 --2- 172.21.15.31:0/1833644654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6eef2f0 0x55b5b6ea4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f17e00640 1 -- 172.21.15.31:0/1833644654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5b6c8e170 con 0x55b5b6eee9d0 2024-09-17T05:32:34.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f17e00640 1 --2- 172.21.15.31:0/1833644654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6eee9d0 0x55b5b6ea4780 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3f08000c10 tx=0x7f3f08004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69b11b562e66b96 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:34.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f03e00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:32:34.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f03e00640 1 -- 172.21.15.31:0/1833644654 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f080bf060 con 0x55b5b6eee9d0 2024-09-17T05:32:34.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f03e00640 1 -- 172.21.15.31:0/1833644654 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f3f080052f0 con 0x55b5b6eee9d0 2024-09-17T05:32:34.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1833644654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b5b6c880f0 con 0x55b5b6eee9d0 2024-09-17T05:32:34.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f03e00640 1 -- 172.21.15.31:0/1833644654 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f3f080c5050 con 0x55b5b6eee9d0 2024-09-17T05:32:34.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f28bdf000 10 client.6309 fetch_fsmap learned FSMap version 47 2024-09-17T05:32:34.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1833644654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x55b5b6d74ef0 con 0x55b5b6eee9d0 2024-09-17T05:32:34.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f03e00640 1 -- 172.21.15.31:0/1833644654 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b5b6c880f0 con 0x55b5b6eee9d0 2024-09-17T05:32:34.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f03e00640 1 -- 172.21.15.31:0/1833644654 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7f3f080046d0 con 0x55b5b6eee9d0 2024-09-17T05:32:34.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f28bdf000 10 client.6309 fetch_fsmap finished waiting for FSMap version 47 2024-09-17T05:32:34.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f28bdf000 10 client.6309 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:32:34.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f28bdf000 20 client.6309 populate_metadata read hostname 'smithi031' 2024-09-17T05:32:34.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/1833644654 >> [v2:172.21.15.31:6834/1598380263,v1:172.21.15.31:6835/1598380263] conn(0x55b5b6efdc70 0x55b5b6f00060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f28bdf000 4 client.6309 mds_command: new command op to 6153 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:32:34.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1833644654 --> [v2:172.21.15.31:6834/1598380263,v1:172.21.15.31:6835/1598380263] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5b6d02a70 con 0x55b5b6efdc70 2024-09-17T05:32:34.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.047+0000 7f3f1ea00640 1 --2- 172.21.15.31:0/1833644654 >> [v2:172.21.15.31:6834/1598380263,v1:172.21.15.31:6835/1598380263] conn(0x55b5b6efdc70 0x55b5b6f00060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.051+0000 7f3f1ea00640 1 --2- 172.21.15.31:0/1833644654 >> [v2:172.21.15.31:6834/1598380263,v1:172.21.15.31:6835/1598380263] conn(0x55b5b6efdc70 0x55b5b6f00060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3c6ac7cc1b4eacb server_cookie=2e462ea4ca289d76 in_seq=0 out_seq=0 2024-09-17T05:32:34.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.051+0000 7f3f03e00640 10 client.6309 ms_handle_connect on v2:172.21.15.31:6834/1598380263 2024-09-17T05:32:34.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.051+0000 7f3f03e00640 1 -- 172.21.15.31:0/1833644654 <== mds.0 v2:172.21.15.31:6834/1598380263 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b5b6d02a70 con 0x55b5b6efdc70 2024-09-17T05:32:34.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.051+0000 7f3f03e00640 10 client.6309 handle_command_reply: tid=0 2024-09-17T05:32:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.051+0000 7f3f28bdf000 1 client.6309 shutdown 2024-09-17T05:32:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.051+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1833644654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6eee9d0 msgr2=0x55b5b6ea4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.051+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/1833644654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6eee9d0 0x55b5b6ea4780 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3f08000c10 tx=0x7f3f08004610 comp rx=0 tx=0).stop 2024-09-17T05:32:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.051+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1833644654 shutdown_connections 2024-09-17T05:32:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.051+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/1833644654 >> [v2:172.21.15.31:6834/1598380263,v1:172.21.15.31:6835/1598380263] conn(0x55b5b6efdc70 0x55b5b6f00060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.051+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/1833644654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6eef2f0 0x55b5b6ea4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.051+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/1833644654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6eee9d0 0x55b5b6ea4780 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.051+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/1833644654 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6ea2e10 0x55b5b6ea4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.051+0000 7f3f03e00640 0 client.6309 ms_handle_reset on v2:172.21.15.31:6834/1598380263 2024-09-17T05:32:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.051+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1833644654 >> 172.21.15.31:0/1833644654 conn(0x55b5b6d8c130 msgr2=0x55b5b6ea1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.051+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1833644654 shutdown_connections 2024-09-17T05:32:34.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.051+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1833644654 wait complete. 2024-09-17T05:32:34.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.051+0000 7f3f28bdf000 20 client.6309 trim_cache size 0 max 16384 2024-09-17T05:32:34.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f28bdf000 1 Processor -- start 2024-09-17T05:32:34.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f28bdf000 1 -- start start 2024-09-17T05:32:34.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f28bdf000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6ea2e10 0x55b5b6f603c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f28bdf000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6eee9d0 0x55b5b6f60900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f28bdf000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6eef2f0 0x55b5b6f60e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f28bdf000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3f20203660 con 0x55b5b6eef2f0 2024-09-17T05:32:34.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f28bdf000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3f201fbeb0 con 0x55b5b6ea2e10 2024-09-17T05:32:34.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f28bdf000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3f200b4160 con 0x55b5b6eee9d0 2024-09-17T05:32:34.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f1f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6eef2f0 0x55b5b6f60e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f1f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6eef2f0 0x55b5b6f60e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43138/0 (socket says 172.21.15.31:43138) 2024-09-17T05:32:34.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f1f400640 1 -- 172.21.15.31:0/2288486520 learned_addr learned my addr 172.21.15.31:0/2288486520 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:34.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f1ea00640 1 --2- 172.21.15.31:0/2288486520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6ea2e10 0x55b5b6f603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f17e00640 1 --2- 172.21.15.31:0/2288486520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6eee9d0 0x55b5b6f60900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f1f400640 1 -- 172.21.15.31:0/2288486520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6eee9d0 msgr2=0x55b5b6f60900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:32:34.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f1f400640 1 --2- 172.21.15.31:0/2288486520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6eee9d0 0x55b5b6f60900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f1f400640 1 -- 172.21.15.31:0/2288486520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6ea2e10 msgr2=0x55b5b6f603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:32:34.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f1f400640 1 --2- 172.21.15.31:0/2288486520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6ea2e10 0x55b5b6f603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f1f400640 1 -- 172.21.15.31:0/2288486520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b6d4bd90 con 0x55b5b6eef2f0 2024-09-17T05:32:34.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f1ea00640 1 --2- 172.21.15.31:0/2288486520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6ea2e10 0x55b5b6f603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:32:34.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f1f400640 1 --2- 172.21.15.31:0/2288486520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6eef2f0 0x55b5b6f60e40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3f18004ff0 tx=0x7f3f18004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a075847e84d0b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:34.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f0ea00640 1 -- 172.21.15.31:0/2288486520 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1801f040 con 0x55b5b6eef2f0 2024-09-17T05:32:34.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f0ea00640 1 -- 172.21.15.31:0/2288486520 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f1805e9a0 con 0x55b5b6eef2f0 2024-09-17T05:32:34.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f0ea00640 1 -- 172.21.15.31:0/2288486520 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f180663a0 con 0x55b5b6eef2f0 2024-09-17T05:32:34.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f28bdf000 1 -- 172.21.15.31:0/2288486520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6eef2f0 msgr2=0x55b5b6f60e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:34.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/2288486520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6eef2f0 0x55b5b6f60e40 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f3f18004ff0 tx=0x7f3f18004f80 comp rx=0 tx=0).stop 2024-09-17T05:32:34.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f28bdf000 1 -- 172.21.15.31:0/2288486520 shutdown_connections 2024-09-17T05:32:34.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/2288486520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6eef2f0 0x55b5b6f60e40 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/2288486520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6eee9d0 0x55b5b6f60900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/2288486520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6ea2e10 0x55b5b6f603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f28bdf000 1 -- 172.21.15.31:0/2288486520 >> 172.21.15.31:0/2288486520 conn(0x55b5b6d8c130 msgr2=0x55b5b6ea2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:34.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f28bdf000 1 -- 172.21.15.31:0/2288486520 shutdown_connections 2024-09-17T05:32:34.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.071+0000 7f3f28bdf000 1 -- 172.21.15.31:0/2288486520 wait complete. 2024-09-17T05:32:34.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f28bdf000 1 -- start start 2024-09-17T05:32:34.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f28bdf000 1 Processor -- start 2024-09-17T05:32:34.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f28bdf000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6ea2e10 0x55b5b6f04c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f28bdf000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6eee9d0 0x55b5b6f20580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f28bdf000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6eef2f0 0x55b5b6f20ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f28bdf000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b5b6d74a60 con 0x55b5b6ea2e10 2024-09-17T05:32:34.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f28bdf000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b5b6cbbec0 con 0x55b5b6eee9d0 2024-09-17T05:32:34.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f28bdf000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55b5b6cf8390 con 0x55b5b6eef2f0 2024-09-17T05:32:34.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f28bdf000 10 client.0 _ll_register_callbacks cb 0x7f3f08009500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:32:34.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f1ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6ea2e10 0x55b5b6f04c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f1ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6ea2e10 0x55b5b6f04c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43150/0 (socket says 172.21.15.31:43150) 2024-09-17T05:32:34.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f1ea00640 1 -- 172.21.15.31:0/1110436391 learned_addr learned my addr 172.21.15.31:0/1110436391 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:34.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f17e00640 1 --2- 172.21.15.31:0/1110436391 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6eee9d0 0x55b5b6f20580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f1f400640 1 --2- 172.21.15.31:0/1110436391 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6eef2f0 0x55b5b6f20ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f1ea00640 1 -- 172.21.15.31:0/1110436391 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6eef2f0 msgr2=0x55b5b6f20ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:32:34.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f1ea00640 1 --2- 172.21.15.31:0/1110436391 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6eef2f0 0x55b5b6f20ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f1ea00640 1 -- 172.21.15.31:0/1110436391 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6eee9d0 msgr2=0x55b5b6f20580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:32:34.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f1ea00640 1 --2- 172.21.15.31:0/1110436391 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6eee9d0 0x55b5b6f20580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f1ea00640 1 -- 172.21.15.31:0/1110436391 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5b6cb6a90 con 0x55b5b6ea2e10 2024-09-17T05:32:34.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f1f400640 1 --2- 172.21.15.31:0/1110436391 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6eef2f0 0x55b5b6f20ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:34.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f1ea00640 1 --2- 172.21.15.31:0/1110436391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6ea2e10 0x55b5b6f04c50 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000e5a0 tx=0x7f3f10011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc18ee71613c7390 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:34.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f03e00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:32:34.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f03e00640 1 -- 172.21.15.31:0/1110436391 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1001b040 con 0x55b5b6ea2e10 2024-09-17T05:32:34.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f03e00640 1 -- 172.21.15.31:0/1110436391 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f3f10022430 con 0x55b5b6ea2e10 2024-09-17T05:32:34.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1110436391 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f1805e9a0 con 0x55b5b6ea2e10 2024-09-17T05:32:34.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f03e00640 1 -- 172.21.15.31:0/1110436391 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f3f10039050 con 0x55b5b6ea2e10 2024-09-17T05:32:34.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f28bdf000 10 client.6315 fetch_fsmap learned FSMap version 47 2024-09-17T05:32:34.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1110436391 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x55b5b6c95050 con 0x55b5b6ea2e10 2024-09-17T05:32:34.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f03e00640 1 -- 172.21.15.31:0/1110436391 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f1805e9a0 con 0x55b5b6ea2e10 2024-09-17T05:32:34.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f03e00640 1 -- 172.21.15.31:0/1110436391 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 47) ==== 3502+0+0 (secure 0 0 0) 0x7f3f1003c020 con 0x55b5b6ea2e10 2024-09-17T05:32:34.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f28bdf000 10 client.6315 fetch_fsmap finished waiting for FSMap version 47 2024-09-17T05:32:34.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f28bdf000 10 client.6315 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:32:34.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f28bdf000 20 client.6315 populate_metadata read hostname 'smithi031' 2024-09-17T05:32:34.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/1110436391 >> [v2:172.21.15.31:6834/1598380263,v1:172.21.15.31:6835/1598380263] conn(0x55b5b6f21000 0x55b5b6f6c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f28bdf000 4 client.6315 mds_command: new command op to 6153 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:32:34.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1110436391 --> [v2:172.21.15.31:6834/1598380263,v1:172.21.15.31:6835/1598380263] -- command(tid 0: {"prefix": "status"}) -- 0x55b5b6cfe520 con 0x55b5b6f21000 2024-09-17T05:32:34.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.075+0000 7f3f17e00640 1 --2- 172.21.15.31:0/1110436391 >> [v2:172.21.15.31:6834/1598380263,v1:172.21.15.31:6835/1598380263] conn(0x55b5b6f21000 0x55b5b6f6c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f17e00640 1 --2- 172.21.15.31:0/1110436391 >> [v2:172.21.15.31:6834/1598380263,v1:172.21.15.31:6835/1598380263] conn(0x55b5b6f21000 0x55b5b6f6c440 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=496d8201c32faad9 server_cookie=9c761c812abcedf8 in_seq=0 out_seq=0 2024-09-17T05:32:34.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f03e00640 10 client.6315 ms_handle_connect on v2:172.21.15.31:6834/1598380263 2024-09-17T05:32:34.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f03e00640 1 -- 172.21.15.31:0/1110436391 <== mds.0 v2:172.21.15.31:6834/1598380263 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55b5b6cfe520 con 0x55b5b6f21000 2024-09-17T05:32:34.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f03e00640 10 client.6315 handle_command_reply: tid=0 2024-09-17T05:32:34.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f28bdf000 1 client.6315 shutdown 2024-09-17T05:32:34.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1110436391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6ea2e10 msgr2=0x55b5b6f04c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:34.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/1110436391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6ea2e10 0x55b5b6f04c50 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000e5a0 tx=0x7f3f10011000 comp rx=0 tx=0).stop 2024-09-17T05:32:34.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1110436391 shutdown_connections 2024-09-17T05:32:34.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/1110436391 >> [v2:172.21.15.31:6834/1598380263,v1:172.21.15.31:6835/1598380263] conn(0x55b5b6f21000 0x55b5b6f6c440 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/1110436391 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b5b6eef2f0 0x55b5b6f20ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/1110436391 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b6eee9d0 0x55b5b6f20580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f28bdf000 1 --2- 172.21.15.31:0/1110436391 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b5b6ea2e10 0x55b5b6f04c50 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f03e00640 0 client.6315 ms_handle_reset on v2:172.21.15.31:6834/1598380263 2024-09-17T05:32:34.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1110436391 >> 172.21.15.31:0/1110436391 conn(0x55b5b6d8c130 msgr2=0x55b5b6f00060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:34.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1110436391 shutdown_connections 2024-09-17T05:32:34.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f28bdf000 1 -- 172.21.15.31:0/1110436391 wait complete. 2024-09-17T05:32:34.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f28bdf000 20 client.6315 trim_cache size 0 max 16384 2024-09-17T05:32:34.085 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:32:34.085 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "b668cd1d-3036-4a29-9e5a-69d0df5776a8", 2024-09-17T05:32:34.085 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-17T05:32:34.085 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 6153, 2024-09-17T05:32:34.085 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-09-17T05:32:34.085 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-09-17T05:32:34.085 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-17T05:32:34.085 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 10.629179153999999, 2024-09-17T05:32:34.085 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 47, 2024-09-17T05:32:34.085 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 69, 2024-09-17T05:32:34.086 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 69, 2024-09-17T05:32:34.086 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 16.101948529000001 2024-09-17T05:32:34.086 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:32:34.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f25800640 1 -- 172.21.15.31:0/1807558995 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3efc073590 msgr2=0x7f3efc075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:34.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f25800640 1 --2- 172.21.15.31:0/1807558995 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3efc073590 0x7f3efc075a50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3f100098e0 tx=0x7f3f10009060 comp rx=0 tx=0).stop 2024-09-17T05:32:34.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f25800640 1 -- 172.21.15.31:0/1807558995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f200ce800 msgr2=0x7f3f2013edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:34.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f25800640 1 --2- 172.21.15.31:0/1807558995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f200ce800 0x7f3f2013edf0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800e9e0 tx=0x7f3f1800eea0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f25800640 1 -- 172.21.15.31:0/1807558995 shutdown_connections 2024-09-17T05:32:34.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f25800640 1 --2- 172.21.15.31:0/1807558995 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f3efc073590 0x7f3efc075a50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f25800640 1 --2- 172.21.15.31:0/1807558995 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f200ce800 0x7f3f2013edf0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f25800640 1 --2- 172.21.15.31:0/1807558995 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f20073170 0x7f3f200b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f25800640 1 --2- 172.21.15.31:0/1807558995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f2006d330 0x7f3f2015a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f25800640 1 -- 172.21.15.31:0/1807558995 >> 172.21.15.31:0/1807558995 conn(0x7f3f200b2240 msgr2=0x7f3f2006f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:34.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f25800640 1 -- 172.21.15.31:0/1807558995 shutdown_connections 2024-09-17T05:32:34.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.079+0000 7f3f25800640 1 -- 172.21.15.31:0/1807558995 wait complete. 2024-09-17T05:32:34.100 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:32:34.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f997f200640 1 -- 172.21.15.31:0/895462345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f997815bea0 msgr2=0x7f99780ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:34.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f997f200640 1 --2- 172.21.15.31:0/895462345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f997815bea0 0x7f99780ce670 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9968009840 tx=0x7f996801c790 comp rx=0 tx=0).stop 2024-09-17T05:32:34.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f997f200640 1 -- 172.21.15.31:0/895462345 shutdown_connections 2024-09-17T05:32:34.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f997f200640 1 --2- 172.21.15.31:0/895462345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f997815bea0 0x7f99780ce670 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f997f200640 1 -- 172.21.15.31:0/895462345 >> 172.21.15.31:0/895462345 conn(0x7f99780d1dc0 msgr2=0x7f99780d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:34.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f997f200640 1 -- 172.21.15.31:0/895462345 shutdown_connections 2024-09-17T05:32:34.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f997f200640 1 -- 172.21.15.31:0/895462345 wait complete. 2024-09-17T05:32:34.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f997f200640 1 Processor -- start 2024-09-17T05:32:34.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f997f200640 1 -- start start 2024-09-17T05:32:34.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f997f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99780cdb30 0x7f9978167230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f997f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99780d28e0 0x7f99781530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f997f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f997815bea0 0x7f9978151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f997f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f997816a930 con 0x7f99780d28e0 2024-09-17T05:32:34.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f997f200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f997816a7b0 con 0x7f997815bea0 2024-09-17T05:32:34.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f997f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f997816aab0 con 0x7f99780cdb30 2024-09-17T05:32:34.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f9977400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99780d28e0 0x7f99781530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f9977400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99780d28e0 0x7f99781530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43172/0 (socket says 172.21.15.31:43172) 2024-09-17T05:32:34.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f9977400640 1 -- 172.21.15.31:0/2043630650 learned_addr learned my addr 172.21.15.31:0/2043630650 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:34.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f997d200640 1 --2- 172.21.15.31:0/2043630650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f997815bea0 0x7f9978151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f9977e00640 1 --2- 172.21.15.31:0/2043630650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99780cdb30 0x7f9978167230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f9977400640 1 -- 172.21.15.31:0/2043630650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99780cdb30 msgr2=0x7f9978167230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:34.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f9977400640 1 --2- 172.21.15.31:0/2043630650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99780cdb30 0x7f9978167230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f9977400640 1 -- 172.21.15.31:0/2043630650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f997815bea0 msgr2=0x7f9978151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:34.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f9977400640 1 --2- 172.21.15.31:0/2043630650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f997815bea0 0x7f9978151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f9977400640 1 -- 172.21.15.31:0/2043630650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9978158930 con 0x7f99780d28e0 2024-09-17T05:32:34.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f997d200640 1 --2- 172.21.15.31:0/2043630650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f997815bea0 0x7f9978151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:34.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.247+0000 7f9977400640 1 --2- 172.21.15.31:0/2043630650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99780d28e0 0x7f99781530e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f996400c500 tx=0x7f996400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:34.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.251+0000 7f996fe00640 1 -- 172.21.15.31:0/2043630650 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964017070 con 0x7f99780d28e0 2024-09-17T05:32:34.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.251+0000 7f996fe00640 1 -- 172.21.15.31:0/2043630650 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99640053c0 con 0x7f99780d28e0 2024-09-17T05:32:34.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.251+0000 7f996fe00640 1 -- 172.21.15.31:0/2043630650 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964012890 con 0x7f99780d28e0 2024-09-17T05:32:34.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.251+0000 7f997f200640 1 -- 172.21.15.31:0/2043630650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9978158bf0 con 0x7f99780d28e0 2024-09-17T05:32:34.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.251+0000 7f997f200640 1 -- 172.21.15.31:0/2043630650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99781591b0 con 0x7f99780d28e0 2024-09-17T05:32:34.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.251+0000 7f997f200640 1 -- 172.21.15.31:0/2043630650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99780ce670 con 0x7f99780d28e0 2024-09-17T05:32:34.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.251+0000 7f996fe00640 1 -- 172.21.15.31:0/2043630650 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f996401a070 con 0x7f99780d28e0 2024-09-17T05:32:34.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.251+0000 7f996fe00640 1 --2- 172.21.15.31:0/2043630650 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9958073560 0x7f9958075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:34.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.251+0000 7f996fe00640 1 -- 172.21.15.31:0/2043630650 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f9964093b00 con 0x7f99780d28e0 2024-09-17T05:32:34.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.251+0000 7f9977e00640 1 --2- 172.21.15.31:0/2043630650 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9958073560 0x7f9958075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:34.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.255+0000 7f9977e00640 1 --2- 172.21.15.31:0/2043630650 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9958073560 0x7f9958075a20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f99680af000 tx=0x7f996801afd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:34.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.255+0000 7f996fe00640 1 -- 172.21.15.31:0/2043630650 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f996405e6a0 con 0x7f99780d28e0 2024-09-17T05:32:34.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.467+0000 7f997f200640 1 -- 172.21.15.31:0/2043630650 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f99780d2480 con 0x7f99780d28e0 2024-09-17T05:32:34.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.467+0000 7f996fe00640 1 -- 172.21.15.31:0/2043630650 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) ==== 53+0+73 (secure 0 0 0) 0x7f996405dfa0 con 0x7f99780d28e0 2024-09-17T05:32:34.471 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:32:34.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.471+0000 7f997f200640 1 -- 172.21.15.31:0/2043630650 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9958073560 msgr2=0x7f9958075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:34.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.471+0000 7f997f200640 1 --2- 172.21.15.31:0/2043630650 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9958073560 0x7f9958075a20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f99680af000 tx=0x7f996801afd0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.471+0000 7f997f200640 1 -- 172.21.15.31:0/2043630650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99780d28e0 msgr2=0x7f99781530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:34.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.471+0000 7f997f200640 1 --2- 172.21.15.31:0/2043630650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99780d28e0 0x7f99781530e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f996400c500 tx=0x7f996400c9c0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.471+0000 7f997f200640 1 -- 172.21.15.31:0/2043630650 shutdown_connections 2024-09-17T05:32:34.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.471+0000 7f997f200640 1 --2- 172.21.15.31:0/2043630650 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f9958073560 0x7f9958075a20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.471+0000 7f997f200640 1 --2- 172.21.15.31:0/2043630650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f997815bea0 0x7f9978151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.471+0000 7f997f200640 1 --2- 172.21.15.31:0/2043630650 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99780d28e0 0x7f99781530e0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.471+0000 7f997f200640 1 --2- 172.21.15.31:0/2043630650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99780cdb30 0x7f9978167230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:34.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.471+0000 7f997f200640 1 -- 172.21.15.31:0/2043630650 >> 172.21.15.31:0/2043630650 conn(0x7f99780d1dc0 msgr2=0x7f99780b5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:34.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.471+0000 7f997f200640 1 -- 172.21.15.31:0/2043630650 shutdown_connections 2024-09-17T05:32:34.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34.471+0000 7f997f200640 1 -- 172.21.15.31:0/2043630650 wait complete. 2024-09-17T05:32:34.493 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:32:34.493 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:32:34.493 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-17T05:32:34.493 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:32:34.493 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:32:34.493 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:32:34.493 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:32:34.493 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:32:34.494 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:32:34.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:34.494 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-17T05:32:34.504 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:32:34.504 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:32:34.504 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:32:34.504 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:32:34.504 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-17T05:32:34.504 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:32:34.504 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:32:34.504 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:32:34.504 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-17T05:32:34.504 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:32:34.504 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:32:34.504 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-17T05:32:34.505 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:32:34.505 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-17T05:32:34.505 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-17T05:32:34.505 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:32:34.505 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42198sec preferred_lft 42198sec 2024-09-17T05:32:34.505 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-17T05:32:34.505 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:32:34.505 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:32:34.505 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:32:34.505 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-17T05:32:34.505 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:32:34.505 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:fe:f3:3e:aa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:32:34.505 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:32:34.505 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:32:34.506 INFO:teuthology.orchestra.run.smithi031.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:32:34.506 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:32:34.506 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:32:34.506 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:32:34.506 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:32:34.506 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:32:34.506 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:32:34.506 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:32:34.506 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:32:34.506 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:32:34.506 INFO:teuthology.orchestra.run.smithi031.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:32:34.506 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:32:34.506 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:32:34.507 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:32:34.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:34.507 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:32:34.564 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-17T05:32:34.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:34.567 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-17T05:32:34.619 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-17T05:32:34.619 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:32:34.619 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:32:34.619 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:32:34.619 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:32:34.620 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:32:34.620 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:32:34.620 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:32:34.620 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:32:34.620 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:32:34.620 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:32:34.620 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:32:34.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:32:34.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:32:34.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:34.757 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T05:32:34.806 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:32:34.806 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:32:34.807 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:32:34.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:34.807 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-09-17T05:32:34.870 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:32:34.870 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:32:34.922 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:32:34.922 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:32:34.922 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:32:34.973 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-17T05:32:34.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:34.974 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:32:35.063 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:32:35.063 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:32:35.076 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:32:35.076 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:32:35.076 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:32:35.076 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:32:35.076 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:32:35.080 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:32:35.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:35.080 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:32:35.100 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:32:35.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:32:35.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:32:35.207 INFO:teuthology.orchestra.run.smithi031.stdout:client5585 2024-09-17T05:32:35.207 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:32:35.207 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:35.216 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:32:35.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.403+0000 7f5d3ac00640 1 -- 172.21.15.31:0/140591240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d1c003f80 msgr2=0x7f5d1c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:35.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.403+0000 7f5d3ac00640 1 --2- 172.21.15.31:0/140591240 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d1c003f80 0x7f5d1c004810 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009b60 tx=0x7f5d2001d270 comp rx=0 tx=0).stop 2024-09-17T05:32:35.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.403+0000 7f5d3a200640 1 -- 172.21.15.31:0/140591240 reap_dead start 2024-09-17T05:32:35.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.403+0000 7f5d3ac00640 1 -- 172.21.15.31:0/140591240 shutdown_connections 2024-09-17T05:32:35.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.403+0000 7f5d3ac00640 1 -- 172.21.15.31:0/140591240 >> 172.21.15.31:0/140591240 conn(0x7f5d3409aa10 msgr2=0x7f5d3409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:35.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.403+0000 7f5d3ac00640 1 -- 172.21.15.31:0/140591240 shutdown_connections 2024-09-17T05:32:35.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.403+0000 7f5d3ac00640 1 -- 172.21.15.31:0/140591240 wait complete. 2024-09-17T05:32:35.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.403+0000 7f5d3ac00640 1 Processor -- start 2024-09-17T05:32:35.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.403+0000 7f5d3ac00640 1 -- start start 2024-09-17T05:32:35.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d3ac00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d1c003f80 0x7f5d3414f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:35.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d3ac00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d341533b0 0x7f5d341f8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:35.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d3ac00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d340c8ca0 0x7f5d341f9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:35.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d3ac00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5d34167ea0 con 0x7f5d1c003f80 2024-09-17T05:32:35.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d3ac00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5d34167d20 con 0x7f5d340c8ca0 2024-09-17T05:32:35.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d3ac00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5d34168020 con 0x7f5d341533b0 2024-09-17T05:32:35.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d39800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d1c003f80 0x7f5d3414f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:35.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d39800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d1c003f80 0x7f5d3414f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43184/0 (socket says 172.21.15.31:43184) 2024-09-17T05:32:35.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d39800640 1 -- 172.21.15.31:0/3526052246 learned_addr learned my addr 172.21.15.31:0/3526052246 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:35.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d38e00640 1 --2- 172.21.15.31:0/3526052246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d341533b0 0x7f5d341f8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:35.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d3a200640 1 --2- 172.21.15.31:0/3526052246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d340c8ca0 0x7f5d341f9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:35.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d39800640 1 -- 172.21.15.31:0/3526052246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d341533b0 msgr2=0x7f5d341f8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:35.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d39800640 1 --2- 172.21.15.31:0/3526052246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d341533b0 0x7f5d341f8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:35.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d39800640 1 -- 172.21.15.31:0/3526052246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d340c8ca0 msgr2=0x7f5d341f9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:35.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d39800640 1 --2- 172.21.15.31:0/3526052246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d340c8ca0 0x7f5d341f9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:35.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d39800640 1 -- 172.21.15.31:0/3526052246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3414f710 con 0x7f5d1c003f80 2024-09-17T05:32:35.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d3a200640 1 --2- 172.21.15.31:0/3526052246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d340c8ca0 0x7f5d341f9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:35.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d38e00640 1 --2- 172.21.15.31:0/3526052246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d341533b0 0x7f5d341f8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:35.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d39800640 1 --2- 172.21.15.31:0/3526052246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d1c003f80 0x7f5d3414f1d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800e590 tx=0x7f5d2800ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:35.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d31600640 1 -- 172.21.15.31:0/3526052246 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28015020 con 0x7f5d1c003f80 2024-09-17T05:32:35.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d31600640 1 -- 172.21.15.31:0/3526052246 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d28010980 con 0x7f5d1c003f80 2024-09-17T05:32:35.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d31600640 1 -- 172.21.15.31:0/3526052246 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28010dd0 con 0x7f5d1c003f80 2024-09-17T05:32:35.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d3ac00640 1 -- 172.21.15.31:0/3526052246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d341530b0 con 0x7f5d1c003f80 2024-09-17T05:32:35.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d3ac00640 1 -- 172.21.15.31:0/3526052246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d341f9b70 con 0x7f5d1c003f80 2024-09-17T05:32:35.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.407+0000 7f5d3ac00640 1 -- 172.21.15.31:0/3526052246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d340b2a00 con 0x7f5d1c003f80 2024-09-17T05:32:35.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.411+0000 7f5d31600640 1 -- 172.21.15.31:0/3526052246 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f5d28018020 con 0x7f5d1c003f80 2024-09-17T05:32:35.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.411+0000 7f5d31600640 1 --2- 172.21.15.31:0/3526052246 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5d14073590 0x7f5d14075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:35.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.411+0000 7f5d31600640 1 -- 172.21.15.31:0/3526052246 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f5d28094c80 con 0x7f5d1c003f80 2024-09-17T05:32:35.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.411+0000 7f5d38e00640 1 --2- 172.21.15.31:0/3526052246 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5d14073590 0x7f5d14075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:35.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.411+0000 7f5d38e00640 1 --2- 172.21.15.31:0/3526052246 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5d14073590 0x7f5d14075a50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5d200ae000 tx=0x7f5d2001a010 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:35.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.415+0000 7f5d31600640 1 -- 172.21.15.31:0/3526052246 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5d2801f020 con 0x7f5d1c003f80 2024-09-17T05:32:35.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.631+0000 7f5d3ac00640 1 -- 172.21.15.31:0/3526052246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5d3415a200 con 0x7f5d1c003f80 2024-09-17T05:32:35.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.631+0000 7f5d31600640 1 -- 172.21.15.31:0/3526052246 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) ==== 53+0+73 (secure 0 0 0) 0x7f5d2805f7d0 con 0x7f5d1c003f80 2024-09-17T05:32:35.633 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:32:35.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.635+0000 7f5d3ac00640 1 -- 172.21.15.31:0/3526052246 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5d14073590 msgr2=0x7f5d14075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:35.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.635+0000 7f5d3ac00640 1 --2- 172.21.15.31:0/3526052246 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5d14073590 0x7f5d14075a50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5d200ae000 tx=0x7f5d2001a010 comp rx=0 tx=0).stop 2024-09-17T05:32:35.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.635+0000 7f5d3ac00640 1 -- 172.21.15.31:0/3526052246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d1c003f80 msgr2=0x7f5d3414f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:35.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.635+0000 7f5d3ac00640 1 --2- 172.21.15.31:0/3526052246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d1c003f80 0x7f5d3414f1d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800e590 tx=0x7f5d2800ea50 comp rx=0 tx=0).stop 2024-09-17T05:32:35.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.635+0000 7f5d3ac00640 1 -- 172.21.15.31:0/3526052246 shutdown_connections 2024-09-17T05:32:35.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.635+0000 7f5d3ac00640 1 --2- 172.21.15.31:0/3526052246 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f5d14073590 0x7f5d14075a50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:35.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.635+0000 7f5d3ac00640 1 --2- 172.21.15.31:0/3526052246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d340c8ca0 0x7f5d341f9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:35.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.635+0000 7f5d3ac00640 1 --2- 172.21.15.31:0/3526052246 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5d341533b0 0x7f5d341f8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:35.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.635+0000 7f5d3ac00640 1 --2- 172.21.15.31:0/3526052246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d1c003f80 0x7f5d3414f1d0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:35.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.635+0000 7f5d3ac00640 1 -- 172.21.15.31:0/3526052246 >> 172.21.15.31:0/3526052246 conn(0x7f5d3409aa10 msgr2=0x7f5d34166d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:35.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.635+0000 7f5d3ac00640 1 -- 172.21.15.31:0/3526052246 shutdown_connections 2024-09-17T05:32:35.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:35.635+0000 7f5d3ac00640 1 -- 172.21.15.31:0/3526052246 wait complete. 2024-09-17T05:32:35.654 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:32:35.654 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:32:35.654 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-09-17T05:32:35.654 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:32:35.654 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:32:35.654 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:32:35.655 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:32:35.655 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:32:35.655 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:32:35.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:35.655 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-09-17T05:32:35.665 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:32:35.666 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:32:35.666 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:32:35.666 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:32:35.666 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-17T05:32:35.666 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:32:35.666 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:32:35.666 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:32:35.666 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-09-17T05:32:35.666 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:32:35.666 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:32:35.666 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-09-17T05:32:35.667 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:32:35.667 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-09-17T05:32:35.667 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:32:35.667 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-09-17T05:32:35.667 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-17T05:32:35.667 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42200sec preferred_lft 42200sec 2024-09-17T05:32:35.667 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-09-17T05:32:35.667 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:32:35.667 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:32:35.667 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:84:cd:fc:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:32:35.667 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:32:35.667 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:32:35.668 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:32:35.668 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:32:35.668 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:32:35.668 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:32:35.668 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:32:35.668 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:32:35.668 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:32:35.668 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:32:35.668 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:32:35.668 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:32:35.668 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:32:35.668 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:32:35.669 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:32:35.669 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:32:35.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:35.670 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:32:35.737 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-17T05:32:35.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:35.740 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-09-17T05:32:35.794 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-09-17T05:32:35.794 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:32:35.795 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-17T05:32:35.795 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:32:35.795 INFO:teuthology.orchestra.run.smithi155.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-17T05:32:35.795 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:32:35.795 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:32:35.795 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:32:35.795 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:32:35.795 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:32:35.795 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:32:35.795 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:32:35.796 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:32:35.796 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:32:35.796 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:32:35.796 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:32:35.796 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:32:35.894 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:32:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:32:35.938 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:32:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:32:35.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:35.945 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-17T05:32:35.954 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:32:35.954 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:32:35.954 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:32:35.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:35.954 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-09-17T05:32:36.017 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:32:36.018 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:32:36.066 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:32:36.066 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:32:36.066 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:32:36.121 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-17T05:32:36.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:36.121 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:32:36.210 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:32:36.211 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:32:36.223 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:32:36.223 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:32:36.223 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:32:36.223 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:32:36.223 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:32:36.227 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:32:36.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:36.227 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:32:36.246 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:32:36.336 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:32:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:32:36.340 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:32:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:32:36.346 INFO:teuthology.orchestra.run.smithi155.stdout:client6049 2024-09-17T05:32:36.346 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:32:36.346 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:36.356 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:32:36.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f174fc00640 1 -- 172.21.15.31:0/1293572475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17480ce050 msgr2=0x7f174815e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:36.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f174fc00640 1 --2- 172.21.15.31:0/1293572475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17480ce050 0x7f174815e6d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f173400a980 tx=0x7f173401db90 comp rx=0 tx=0).stop 2024-09-17T05:32:36.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f174fc00640 1 -- 172.21.15.31:0/1293572475 shutdown_connections 2024-09-17T05:32:36.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f174fc00640 1 --2- 172.21.15.31:0/1293572475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17480ce050 0x7f174815e6d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:36.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f174fc00640 1 -- 172.21.15.31:0/1293572475 >> 172.21.15.31:0/1293572475 conn(0x7f17480b2060 msgr2=0x7f17480b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:36.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f174fc00640 1 -- 172.21.15.31:0/1293572475 shutdown_connections 2024-09-17T05:32:36.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f174fc00640 1 -- 172.21.15.31:0/1293572475 wait complete. 2024-09-17T05:32:36.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f174fc00640 1 Processor -- start 2024-09-17T05:32:36.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f174fc00640 1 -- start start 2024-09-17T05:32:36.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f174fc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17480cbcc0 0x7f1748159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:36.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f174fc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17480ce050 0x7f174814f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:36.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f174fc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f174815d960 0x7f17480c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:36.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f174fc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1748168580 con 0x7f17480ce050 2024-09-17T05:32:36.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f174fc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f174815ee50 con 0x7f174815d960 2024-09-17T05:32:36.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f174fc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1748168700 con 0x7f17480cbcc0 2024-09-17T05:32:36.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f1747e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17480ce050 0x7f174814f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:36.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f1747e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17480ce050 0x7f174814f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43190/0 (socket says 172.21.15.31:43190) 2024-09-17T05:32:36.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f1747e00640 1 -- 172.21.15.31:0/1947045628 learned_addr learned my addr 172.21.15.31:0/1947045628 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:36.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f174dc00640 1 --2- 172.21.15.31:0/1947045628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f174815d960 0x7f17480c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:36.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f174d200640 1 --2- 172.21.15.31:0/1947045628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17480cbcc0 0x7f1748159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:36.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f1747e00640 1 -- 172.21.15.31:0/1947045628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17480cbcc0 msgr2=0x7f1748159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:36.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f1747e00640 1 --2- 172.21.15.31:0/1947045628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17480cbcc0 0x7f1748159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:36.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f1747e00640 1 -- 172.21.15.31:0/1947045628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f174815d960 msgr2=0x7f17480c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:36.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f1747e00640 1 --2- 172.21.15.31:0/1947045628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f174815d960 0x7f17480c9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:36.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.511+0000 7f1747e00640 1 -- 172.21.15.31:0/1947045628 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174815c630 con 0x7f17480ce050 2024-09-17T05:32:36.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.515+0000 7f1747e00640 1 --2- 172.21.15.31:0/1947045628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17480ce050 0x7f174814f8a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f173401a7a0 tx=0x7f1734005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:36.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.515+0000 7f1744c00640 1 -- 172.21.15.31:0/1947045628 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17340be070 con 0x7f17480ce050 2024-09-17T05:32:36.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.515+0000 7f1744c00640 1 -- 172.21.15.31:0/1947045628 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17340038f0 con 0x7f17480ce050 2024-09-17T05:32:36.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.515+0000 7f174fc00640 1 -- 172.21.15.31:0/1947045628 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174815c910 con 0x7f17480ce050 2024-09-17T05:32:36.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.515+0000 7f1744c00640 1 -- 172.21.15.31:0/1947045628 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17340b3040 con 0x7f17480ce050 2024-09-17T05:32:36.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.515+0000 7f174fc00640 1 -- 172.21.15.31:0/1947045628 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174814fde0 con 0x7f17480ce050 2024-09-17T05:32:36.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.515+0000 7f174fc00640 1 -- 172.21.15.31:0/1947045628 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f174815dd40 con 0x7f17480ce050 2024-09-17T05:32:36.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.515+0000 7f1744c00640 1 -- 172.21.15.31:0/1947045628 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f17340c1070 con 0x7f17480ce050 2024-09-17T05:32:36.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.519+0000 7f1744c00640 1 --2- 172.21.15.31:0/1947045628 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1728073560 0x7f1728075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:36.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.519+0000 7f1744c00640 1 -- 172.21.15.31:0/1947045628 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f173412ee20 con 0x7f17480ce050 2024-09-17T05:32:36.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.519+0000 7f174d200640 1 --2- 172.21.15.31:0/1947045628 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1728073560 0x7f1728075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:36.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.519+0000 7f174d200640 1 --2- 172.21.15.31:0/1947045628 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1728073560 0x7f1728075a20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f173c001870 tx=0x7f173c001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:36.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.523+0000 7f1744c00640 1 -- 172.21.15.31:0/1947045628 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f1734017780 con 0x7f17480ce050 2024-09-17T05:32:36.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:36.735+0000 7f174fc00640 1 -- 172.21.15.31:0/1947045628 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f174806f5b0 con 0x7f17480ce050 2024-09-17T05:32:37.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.507+0000 7f1744c00640 1 -- 172.21.15.31:0/1947045628 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v48) ==== 136+0+0 (secure 0 0 0) 0x7f17340f93b0 con 0x7f17480ce050 2024-09-17T05:32:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.511+0000 7f174fc00640 1 -- 172.21.15.31:0/1947045628 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1728073560 msgr2=0x7f1728075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.511+0000 7f174fc00640 1 --2- 172.21.15.31:0/1947045628 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1728073560 0x7f1728075a20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f173c001870 tx=0x7f173c001380 comp rx=0 tx=0).stop 2024-09-17T05:32:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.511+0000 7f174fc00640 1 -- 172.21.15.31:0/1947045628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17480ce050 msgr2=0x7f174814f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.511+0000 7f174fc00640 1 --2- 172.21.15.31:0/1947045628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17480ce050 0x7f174814f8a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f173401a7a0 tx=0x7f1734005ca0 comp rx=0 tx=0).stop 2024-09-17T05:32:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.511+0000 7f174fc00640 1 -- 172.21.15.31:0/1947045628 shutdown_connections 2024-09-17T05:32:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.511+0000 7f174fc00640 1 --2- 172.21.15.31:0/1947045628 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1728073560 0x7f1728075a20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.511+0000 7f174fc00640 1 --2- 172.21.15.31:0/1947045628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f174815d960 0x7f17480c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.511+0000 7f174fc00640 1 --2- 172.21.15.31:0/1947045628 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17480ce050 0x7f174814f8a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.511+0000 7f174fc00640 1 --2- 172.21.15.31:0/1947045628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17480cbcc0 0x7f1748159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.511+0000 7f174fc00640 1 -- 172.21.15.31:0/1947045628 >> 172.21.15.31:0/1947045628 conn(0x7f17480b2060 msgr2=0x7f174815a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:37.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.511+0000 7f174fc00640 1 -- 172.21.15.31:0/1947045628 shutdown_connections 2024-09-17T05:32:37.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.511+0000 7f174fc00640 1 -- 172.21.15.31:0/1947045628 wait complete. 2024-09-17T05:32:37.533 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:32:37.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.683+0000 7f1608400640 1 -- 172.21.15.31:0/2412183367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f160015f490 msgr2=0x7f16000b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:37.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.683+0000 7f1608400640 1 --2- 172.21.15.31:0/2412183367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f160015f490 0x7f16000b14c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009840 tx=0x7f15f401c760 comp rx=0 tx=0).stop 2024-09-17T05:32:37.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1608400640 1 -- 172.21.15.31:0/2412183367 shutdown_connections 2024-09-17T05:32:37.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1608400640 1 --2- 172.21.15.31:0/2412183367 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f160015f490 0x7f16000b14c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:37.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1608400640 1 -- 172.21.15.31:0/2412183367 >> 172.21.15.31:0/2412183367 conn(0x7f16000d1e30 msgr2=0x7f16000d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:37.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1608400640 1 -- 172.21.15.31:0/2412183367 shutdown_connections 2024-09-17T05:32:37.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1608400640 1 -- 172.21.15.31:0/2412183367 wait complete. 2024-09-17T05:32:37.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1608400640 1 Processor -- start 2024-09-17T05:32:37.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1608400640 1 -- start start 2024-09-17T05:32:37.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1608400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16000afca0 0x7f1600150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:37.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1608400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16000b2e80 0x7f160015bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:37.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1608400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f160015f490 0x7f160015c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:37.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1608400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f16000b2290 con 0x7f16000afca0 2024-09-17T05:32:37.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1608400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f16000b2110 con 0x7f160015f490 2024-09-17T05:32:37.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1608400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f160016a4a0 con 0x7f16000b2e80 2024-09-17T05:32:37.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1605a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16000afca0 0x7f1600150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:37.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1605a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16000afca0 0x7f1600150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43212/0 (socket says 172.21.15.31:43212) 2024-09-17T05:32:37.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1605a00640 1 -- 172.21.15.31:0/3660008859 learned_addr learned my addr 172.21.15.31:0/3660008859 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:37.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1606400640 1 --2- 172.21.15.31:0/3660008859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f160015f490 0x7f160015c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:37.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1605a00640 1 -- 172.21.15.31:0/3660008859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16000b2e80 msgr2=0x7f160015bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:37.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1605a00640 1 --2- 172.21.15.31:0/3660008859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16000b2e80 0x7f160015bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:37.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1605a00640 1 -- 172.21.15.31:0/3660008859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f160015f490 msgr2=0x7f160015c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:37.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1605a00640 1 --2- 172.21.15.31:0/3660008859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f160015f490 0x7f160015c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:37.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1605a00640 1 -- 172.21.15.31:0/3660008859 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16000b55a0 con 0x7f16000afca0 2024-09-17T05:32:37.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1606400640 1 --2- 172.21.15.31:0/3660008859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f160015f490 0x7f160015c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:32:37.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f1605a00640 1 --2- 172.21.15.31:0/3660008859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16000afca0 0x7f1600150280 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009790 tx=0x7f15f40a5750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:37.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.687+0000 7f15fd600640 1 -- 172.21.15.31:0/3660008859 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f40ba020 con 0x7f16000afca0 2024-09-17T05:32:37.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.691+0000 7f15fd600640 1 -- 172.21.15.31:0/3660008859 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15f4004430 con 0x7f16000afca0 2024-09-17T05:32:37.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.691+0000 7f15fd600640 1 -- 172.21.15.31:0/3660008859 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f40b2040 con 0x7f16000afca0 2024-09-17T05:32:37.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.691+0000 7f1608400640 1 -- 172.21.15.31:0/3660008859 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16000b4d00 con 0x7f16000afca0 2024-09-17T05:32:37.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.691+0000 7f1608400640 1 -- 172.21.15.31:0/3660008859 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16000b52c0 con 0x7f16000afca0 2024-09-17T05:32:37.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.691+0000 7f1608400640 1 -- 172.21.15.31:0/3660008859 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16000b00d0 con 0x7f16000afca0 2024-09-17T05:32:37.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.691+0000 7f15fd600640 1 -- 172.21.15.31:0/3660008859 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f15f40bd070 con 0x7f16000afca0 2024-09-17T05:32:37.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.691+0000 7f15fd600640 1 --2- 172.21.15.31:0/3660008859 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f15e0073560 0x7f15e0075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:37.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.691+0000 7f15fd600640 1 -- 172.21.15.31:0/3660008859 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f15f412e1c0 con 0x7f16000afca0 2024-09-17T05:32:37.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.695+0000 7f1605000640 1 --2- 172.21.15.31:0/3660008859 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f15e0073560 0x7f15e0075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:37.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.695+0000 7f1605000640 1 --2- 172.21.15.31:0/3660008859 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f15e0073560 0x7f15e0075a20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f15ec007fd0 tx=0x7f15ec007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:37.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.695+0000 7f15fd600640 1 -- 172.21.15.31:0/3660008859 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f15f4016410 con 0x7f16000afca0 2024-09-17T05:32:37.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.895+0000 7f1608400640 1 -- 172.21.15.31:0/3660008859 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f16000b1ef0 con 0x7f15e0073560 2024-09-17T05:32:37.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.895+0000 7f15fd600640 1 -- 172.21.15.31:0/3660008859 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f16000b1ef0 con 0x7f15e0073560 2024-09-17T05:32:37.898 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:32:37.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:37.898 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephfs" 2024-09-17T05:32:37.898 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:37.898 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:32:37.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.899+0000 7f1608400640 1 -- 172.21.15.31:0/3660008859 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f15e0073560 msgr2=0x7f15e0075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:37.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.899+0000 7f1608400640 1 --2- 172.21.15.31:0/3660008859 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f15e0073560 0x7f15e0075a20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f15ec007fd0 tx=0x7f15ec007980 comp rx=0 tx=0).stop 2024-09-17T05:32:37.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.899+0000 7f1608400640 1 -- 172.21.15.31:0/3660008859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16000afca0 msgr2=0x7f1600150280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:37.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.899+0000 7f1608400640 1 --2- 172.21.15.31:0/3660008859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16000afca0 0x7f1600150280 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009790 tx=0x7f15f40a5750 comp rx=0 tx=0).stop 2024-09-17T05:32:37.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.899+0000 7f1608400640 1 -- 172.21.15.31:0/3660008859 shutdown_connections 2024-09-17T05:32:37.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.899+0000 7f1608400640 1 --2- 172.21.15.31:0/3660008859 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f15e0073560 0x7f15e0075a20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:37.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.899+0000 7f1608400640 1 --2- 172.21.15.31:0/3660008859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f160015f490 0x7f160015c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:37.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.899+0000 7f1608400640 1 --2- 172.21.15.31:0/3660008859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16000b2e80 0x7f160015bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:37.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.899+0000 7f1608400640 1 --2- 172.21.15.31:0/3660008859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16000afca0 0x7f1600150280 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:37.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.899+0000 7f1608400640 1 -- 172.21.15.31:0/3660008859 >> 172.21.15.31:0/3660008859 conn(0x7f16000d1e30 msgr2=0x7f1600159d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:37.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.899+0000 7f1608400640 1 -- 172.21.15.31:0/3660008859 shutdown_connections 2024-09-17T05:32:37.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:37.899+0000 7f1608400640 1 -- 172.21.15.31:0/3660008859 wait complete. 2024-09-17T05:32:37.919 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:32:38.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa15b600640 1 -- 172.21.15.31:0/940742799 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1540b49e0 msgr2=0x7fa1540acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:38.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa15b600640 1 --2- 172.21.15.31:0/940742799 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1540b49e0 0x7fa1540acd40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009c80 tx=0x7fa14c01cd10 comp rx=0 tx=0).stop 2024-09-17T05:32:38.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa15b600640 1 -- 172.21.15.31:0/940742799 shutdown_connections 2024-09-17T05:32:38.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa15b600640 1 --2- 172.21.15.31:0/940742799 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1540b49e0 0x7fa1540acd40 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:38.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa15b600640 1 --2- 172.21.15.31:0/940742799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1540cd100 0x7fa15406f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:38.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa15b600640 1 -- 172.21.15.31:0/940742799 >> 172.21.15.31:0/940742799 conn(0x7fa1540b18f0 msgr2=0x7fa1540b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:38.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa15b600640 1 -- 172.21.15.31:0/940742799 shutdown_connections 2024-09-17T05:32:38.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa15b600640 1 -- 172.21.15.31:0/940742799 wait complete. 2024-09-17T05:32:38.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa15b600640 1 Processor -- start 2024-09-17T05:32:38.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa15b600640 1 -- start start 2024-09-17T05:32:38.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa15b600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1540b49e0 0x7fa15409ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:38.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa15b600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1540cd100 0x7fa15409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:38.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa15b600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa15415dae0 0x7fa15415a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:38.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa15b600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa1540cf1a0 con 0x7fa15415dae0 2024-09-17T05:32:38.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa15b600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa1540cf020 con 0x7fa1540cd100 2024-09-17T05:32:38.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa15b600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa1540cf320 con 0x7fa1540b49e0 2024-09-17T05:32:38.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa159600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa15415dae0 0x7fa15415a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:38.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa159600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa15415dae0 0x7fa15415a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43230/0 (socket says 172.21.15.31:43230) 2024-09-17T05:32:38.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa159600640 1 -- 172.21.15.31:0/3021450548 learned_addr learned my addr 172.21.15.31:0/3021450548 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:38.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa153e00640 1 --2- 172.21.15.31:0/3021450548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1540cd100 0x7fa15409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:38.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa158c00640 1 --2- 172.21.15.31:0/3021450548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1540b49e0 0x7fa15409ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:38.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa159600640 1 -- 172.21.15.31:0/3021450548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1540b49e0 msgr2=0x7fa15409ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:38.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa159600640 1 --2- 172.21.15.31:0/3021450548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1540b49e0 0x7fa15409ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:38.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa159600640 1 -- 172.21.15.31:0/3021450548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1540cd100 msgr2=0x7fa15409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:38.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa159600640 1 --2- 172.21.15.31:0/3021450548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1540cd100 0x7fa15409d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:38.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa159600640 1 -- 172.21.15.31:0/3021450548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1541f7830 con 0x7fa15415dae0 2024-09-17T05:32:38.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.071+0000 7fa159600640 1 --2- 172.21.15.31:0/3021450548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa15415dae0 0x7fa15415a560 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009bd0 tx=0x7fa14c0a59f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:38.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.075+0000 7fa150c00640 1 -- 172.21.15.31:0/3021450548 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14c0bb070 con 0x7fa15415dae0 2024-09-17T05:32:38.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.075+0000 7fa150c00640 1 -- 172.21.15.31:0/3021450548 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa14c004d40 con 0x7fa15415dae0 2024-09-17T05:32:38.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.075+0000 7fa15b600640 1 -- 172.21.15.31:0/3021450548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa15409dc30 con 0x7fa15415dae0 2024-09-17T05:32:38.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.075+0000 7fa150c00640 1 -- 172.21.15.31:0/3021450548 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14c0b2040 con 0x7fa15415dae0 2024-09-17T05:32:38.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.075+0000 7fa15b600640 1 -- 172.21.15.31:0/3021450548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1541f7dd0 con 0x7fa15415dae0 2024-09-17T05:32:38.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.075+0000 7fa15b600640 1 -- 172.21.15.31:0/3021450548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1540acd40 con 0x7fa15415dae0 2024-09-17T05:32:38.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.075+0000 7fa150c00640 1 -- 172.21.15.31:0/3021450548 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7fa14c0be070 con 0x7fa15415dae0 2024-09-17T05:32:38.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.075+0000 7fa150c00640 1 --2- 172.21.15.31:0/3021450548 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa134073560 0x7fa134075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:38.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.075+0000 7fa150c00640 1 -- 172.21.15.31:0/3021450548 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fa14c12ef10 con 0x7fa15415dae0 2024-09-17T05:32:38.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.075+0000 7fa158c00640 1 --2- 172.21.15.31:0/3021450548 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa134073560 0x7fa134075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:38.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.079+0000 7fa158c00640 1 --2- 172.21.15.31:0/3021450548 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa134073560 0x7fa134075a20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa1540af650 tx=0x7fa148008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:38.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.079+0000 7fa150c00640 1 -- 172.21.15.31:0/3021450548 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa14c016990 con 0x7fa15415dae0 2024-09-17T05:32:38.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.255+0000 7fa15b600640 1 -- 172.21.15.31:0/3021450548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa1540ad330 con 0x7fa15415dae0 2024-09-17T05:32:38.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.259+0000 7fa150c00640 1 -- 172.21.15.31:0/3021450548 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7fa14c0f9a70 con 0x7fa15415dae0 2024-09-17T05:32:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.259+0000 7fa15b600640 1 -- 172.21.15.31:0/3021450548 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa134073560 msgr2=0x7fa134075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.259+0000 7fa15b600640 1 --2- 172.21.15.31:0/3021450548 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa134073560 0x7fa134075a20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa1540af650 tx=0x7fa148008040 comp rx=0 tx=0).stop 2024-09-17T05:32:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.259+0000 7fa15b600640 1 -- 172.21.15.31:0/3021450548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa15415dae0 msgr2=0x7fa15415a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.259+0000 7fa15b600640 1 --2- 172.21.15.31:0/3021450548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa15415dae0 0x7fa15415a560 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009bd0 tx=0x7fa14c0a59f0 comp rx=0 tx=0).stop 2024-09-17T05:32:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.259+0000 7fa15b600640 1 -- 172.21.15.31:0/3021450548 shutdown_connections 2024-09-17T05:32:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.259+0000 7fa15b600640 1 --2- 172.21.15.31:0/3021450548 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fa134073560 0x7fa134075a20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.259+0000 7fa15b600640 1 --2- 172.21.15.31:0/3021450548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa15415dae0 0x7fa15415a560 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.259+0000 7fa15b600640 1 --2- 172.21.15.31:0/3021450548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1540cd100 0x7fa15409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.259+0000 7fa15b600640 1 --2- 172.21.15.31:0/3021450548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1540b49e0 0x7fa15409ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.259+0000 7fa15b600640 1 -- 172.21.15.31:0/3021450548 >> 172.21.15.31:0/3021450548 conn(0x7fa1540b18f0 msgr2=0x7fa154166120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.259+0000 7fa15b600640 1 -- 172.21.15.31:0/3021450548 shutdown_connections 2024-09-17T05:32:38.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.259+0000 7fa15b600640 1 -- 172.21.15.31:0/3021450548 wait complete. 2024-09-17T05:32:38.280 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:32:38.280 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:38.289 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:32:38.289 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:38.338 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:32:38.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f8135200640 1 -- 172.21.15.31:0/3720786745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f813015bf70 msgr2=0x7f81300b53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:38.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f8135200640 1 --2- 172.21.15.31:0/3720786745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f813015bf70 0x7f81300b53e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8128009c80 tx=0x7f812801cda0 comp rx=0 tx=0).stop 2024-09-17T05:32:38.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f8135200640 1 -- 172.21.15.31:0/3720786745 shutdown_connections 2024-09-17T05:32:38.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f8135200640 1 --2- 172.21.15.31:0/3720786745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f813015bf70 0x7f81300b53e0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:38.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f8135200640 1 --2- 172.21.15.31:0/3720786745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81300d2940 0x7f8130160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:38.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f8135200640 1 -- 172.21.15.31:0/3720786745 >> 172.21.15.31:0/3720786745 conn(0x7f81300d1d90 msgr2=0x7f81300d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:38.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f8135200640 1 -- 172.21.15.31:0/3720786745 shutdown_connections 2024-09-17T05:32:38.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f8135200640 1 -- 172.21.15.31:0/3720786745 wait complete. 2024-09-17T05:32:38.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f8135200640 1 Processor -- start 2024-09-17T05:32:38.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f8135200640 1 -- start start 2024-09-17T05:32:38.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f8135200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81300d2940 0x7f8130151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:38.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f8135200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813015bb90 0x7f813006dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:38.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f8135200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f813015bf70 0x7f813014f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:38.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f8135200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8130168ca0 con 0x7f813015bf70 2024-09-17T05:32:38.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f8135200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f81300b65e0 con 0x7f813015bb90 2024-09-17T05:32:38.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f8135200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8130168e20 con 0x7f81300d2940 2024-09-17T05:32:38.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f812e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f813015bf70 0x7f813014f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:38.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f812e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f813015bf70 0x7f813014f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45642/0 (socket says 172.21.15.31:45642) 2024-09-17T05:32:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f812e800640 1 -- 172.21.15.31:0/3787137434 learned_addr learned my addr 172.21.15.31:0/3787137434 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f812de00640 1 --2- 172.21.15.31:0/3787137434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81300d2940 0x7f8130151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.535+0000 7f8125400640 1 --2- 172.21.15.31:0/3787137434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813015bb90 0x7f813006dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.539+0000 7f812e800640 1 -- 172.21.15.31:0/3787137434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81300d2940 msgr2=0x7f8130151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.539+0000 7f812e800640 1 --2- 172.21.15.31:0/3787137434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81300d2940 0x7f8130151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.539+0000 7f812e800640 1 -- 172.21.15.31:0/3787137434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813015bb90 msgr2=0x7f813006dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.539+0000 7f812e800640 1 --2- 172.21.15.31:0/3787137434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813015bb90 0x7f813006dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.539+0000 7f812e800640 1 -- 172.21.15.31:0/3787137434 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813014fe20 con 0x7f813015bf70 2024-09-17T05:32:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.539+0000 7f8125400640 1 --2- 172.21.15.31:0/3787137434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813015bb90 0x7f813006dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.539+0000 7f812e800640 1 --2- 172.21.15.31:0/3787137434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f813015bf70 0x7f813014f320 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f812801d640 tx=0x7f8128005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.539+0000 7f8126a00640 1 -- 172.21.15.31:0/3787137434 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81280bb070 con 0x7f813015bf70 2024-09-17T05:32:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.539+0000 7f8126a00640 1 -- 172.21.15.31:0/3787137434 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8128004b40 con 0x7f813015bf70 2024-09-17T05:32:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.539+0000 7f8126a00640 1 -- 172.21.15.31:0/3787137434 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81280b2040 con 0x7f813015bf70 2024-09-17T05:32:38.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.539+0000 7f8135200640 1 -- 172.21.15.31:0/3787137434 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8130150100 con 0x7f813015bf70 2024-09-17T05:32:38.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.539+0000 7f8135200640 1 -- 172.21.15.31:0/3787137434 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81300c7060 con 0x7f813015bf70 2024-09-17T05:32:38.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.539+0000 7f8135200640 1 -- 172.21.15.31:0/3787137434 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81300b53e0 con 0x7f813015bf70 2024-09-17T05:32:38.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.539+0000 7f8126a00640 1 -- 172.21.15.31:0/3787137434 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f8128004000 con 0x7f813015bf70 2024-09-17T05:32:38.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.539+0000 7f8126a00640 1 --2- 172.21.15.31:0/3787137434 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f810c073560 0x7f810c075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:38.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.539+0000 7f8126a00640 1 -- 172.21.15.31:0/3787137434 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f812812e4f0 con 0x7f813015bf70 2024-09-17T05:32:38.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.543+0000 7f812de00640 1 --2- 172.21.15.31:0/3787137434 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f810c073560 0x7f810c075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:38.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.543+0000 7f812de00640 1 --2- 172.21.15.31:0/3787137434 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f810c073560 0x7f810c075a20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f81200016f0 tx=0x7f8120009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:38.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.547+0000 7f8126a00640 1 -- 172.21.15.31:0/3787137434 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8128016990 con 0x7f813015bf70 2024-09-17T05:32:38.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.731+0000 7f8135200640 1 -- 172.21.15.31:0/3787137434 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f813015b350 con 0x7f813015bf70 2024-09-17T05:32:38.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.731+0000 7f8126a00640 1 -- 172.21.15.31:0/3787137434 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) ==== 80+0+0 (secure 0 0 0) 0x7f81280f9080 con 0x7f813015bf70 2024-09-17T05:32:38.734 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:32:38.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.735+0000 7f8135200640 1 -- 172.21.15.31:0/3787137434 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f810c073560 msgr2=0x7f810c075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:38.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.735+0000 7f8135200640 1 --2- 172.21.15.31:0/3787137434 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f810c073560 0x7f810c075a20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f81200016f0 tx=0x7f8120009040 comp rx=0 tx=0).stop 2024-09-17T05:32:38.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.735+0000 7f8135200640 1 -- 172.21.15.31:0/3787137434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f813015bf70 msgr2=0x7f813014f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:38.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.735+0000 7f8135200640 1 --2- 172.21.15.31:0/3787137434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f813015bf70 0x7f813014f320 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f812801d640 tx=0x7f8128005b00 comp rx=0 tx=0).stop 2024-09-17T05:32:38.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.735+0000 7f8135200640 1 -- 172.21.15.31:0/3787137434 shutdown_connections 2024-09-17T05:32:38.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.735+0000 7f8135200640 1 --2- 172.21.15.31:0/3787137434 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f810c073560 0x7f810c075a20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:38.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.735+0000 7f8135200640 1 --2- 172.21.15.31:0/3787137434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f813015bf70 0x7f813014f320 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:38.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.735+0000 7f8135200640 1 --2- 172.21.15.31:0/3787137434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813015bb90 0x7f813006dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:38.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.735+0000 7f8135200640 1 --2- 172.21.15.31:0/3787137434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81300d2940 0x7f8130151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:38.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.735+0000 7f8135200640 1 -- 172.21.15.31:0/3787137434 >> 172.21.15.31:0/3787137434 conn(0x7f81300d1d90 msgr2=0x7f813015f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:38.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.735+0000 7f8135200640 1 -- 172.21.15.31:0/3787137434 shutdown_connections 2024-09-17T05:32:38.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:38.735+0000 7f8135200640 1 -- 172.21.15.31:0/3787137434 wait complete. 2024-09-17T05:32:38.755 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:32:38.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:38.755 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:32:38.781 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:32:38.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:38.782 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:32:38.833 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:32:38.833 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:38.843 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:32:38.843 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:38.898 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:32:39.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.043+0000 7fc015a00640 1 -- 172.21.15.31:0/704435784 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc01006f8c0 msgr2=0x7fc01006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:39.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.043+0000 7fc015a00640 1 --2- 172.21.15.31:0/704435784 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc01006f8c0 0x7fc01006fca0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc010069700 tx=0x7fc00001c830 comp rx=0 tx=0).stop 2024-09-17T05:32:39.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.043+0000 7fc015a00640 1 -- 172.21.15.31:0/704435784 shutdown_connections 2024-09-17T05:32:39.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.043+0000 7fc015a00640 1 --2- 172.21.15.31:0/704435784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc01006e7a0 0x7fc01006ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:39.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.043+0000 7fc015a00640 1 --2- 172.21.15.31:0/704435784 >> v2:172.21.15.155:3300/0 conn(0x7fc0100cc740 0x7fc0100ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:39.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.043+0000 7fc015a00640 1 --2- 172.21.15.31:0/704435784 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc01006f8c0 0x7fc01006fca0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:39.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.043+0000 7fc015a00640 1 -- 172.21.15.31:0/704435784 >> 172.21.15.31:0/704435784 conn(0x7fc0100b18f0 msgr2=0x7fc0100b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:39.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.043+0000 7fc015a00640 1 -- 172.21.15.31:0/704435784 shutdown_connections 2024-09-17T05:32:39.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.043+0000 7fc015a00640 1 -- 172.21.15.31:0/704435784 wait complete. 2024-09-17T05:32:39.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc015a00640 1 Processor -- start 2024-09-17T05:32:39.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc015a00640 1 -- start start 2024-09-17T05:32:39.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc015a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc01006e7a0 0x7fc0101334f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:39.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc015a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc01006f8c0 0x7fc0100b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:39.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc015a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0100cc740 0x7fc01015cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:39.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc015a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc0100b46c0 con 0x7fc01006f8c0 2024-09-17T05:32:39.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc015a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc0100b4540 con 0x7fc01006e7a0 2024-09-17T05:32:39.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc015a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc0100b4840 con 0x7fc0100cc740 2024-09-17T05:32:39.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc007e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc01006f8c0 0x7fc0100b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc007e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc01006f8c0 0x7fc0100b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45672/0 (socket says 172.21.15.31:45672) 2024-09-17T05:32:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc007e00640 1 -- 172.21.15.31:0/2054189072 learned_addr learned my addr 172.21.15.31:0/2054189072 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc00ea00640 1 --2- 172.21.15.31:0/2054189072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc01006e7a0 0x7fc0101334f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc00f400640 1 --2- 172.21.15.31:0/2054189072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0100cc740 0x7fc01015cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc007e00640 1 -- 172.21.15.31:0/2054189072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0100cc740 msgr2=0x7fc01015cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc007e00640 1 --2- 172.21.15.31:0/2054189072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0100cc740 0x7fc01015cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc007e00640 1 -- 172.21.15.31:0/2054189072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc01006e7a0 msgr2=0x7fc0101334f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc007e00640 1 --2- 172.21.15.31:0/2054189072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc01006e7a0 0x7fc0101334f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc007e00640 1 -- 172.21.15.31:0/2054189072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0101f9cd0 con 0x7fc01006f8c0 2024-09-17T05:32:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc007e00640 1 --2- 172.21.15.31:0/2054189072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc01006f8c0 0x7fc0100b06f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbff80058d0 tx=0x7fbff800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc006a00640 1 -- 172.21.15.31:0/2054189072 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8017070 con 0x7fc01006f8c0 2024-09-17T05:32:39.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc006a00640 1 -- 172.21.15.31:0/2054189072 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbff8009d20 con 0x7fc01006f8c0 2024-09-17T05:32:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc006a00640 1 -- 172.21.15.31:0/2054189072 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff80106c0 con 0x7fc01006f8c0 2024-09-17T05:32:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc015a00640 1 -- 172.21.15.31:0/2054189072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0101f9fb0 con 0x7fc01006f8c0 2024-09-17T05:32:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.047+0000 7fc015a00640 1 -- 172.21.15.31:0/2054189072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0101fa570 con 0x7fc01006f8c0 2024-09-17T05:32:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.051+0000 7fc015a00640 1 -- 172.21.15.31:0/2054189072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc010069410 con 0x7fc01006f8c0 2024-09-17T05:32:39.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.051+0000 7fc006a00640 1 -- 172.21.15.31:0/2054189072 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7fbff801a070 con 0x7fc01006f8c0 2024-09-17T05:32:39.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.051+0000 7fc006a00640 1 --2- 172.21.15.31:0/2054189072 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbfec073590 0x7fbfec075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:39.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.051+0000 7fc006a00640 1 -- 172.21.15.31:0/2054189072 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fbff8094a20 con 0x7fc01006f8c0 2024-09-17T05:32:39.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.051+0000 7fc00ea00640 1 --2- 172.21.15.31:0/2054189072 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbfec073590 0x7fbfec075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:39.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.055+0000 7fc00ea00640 1 --2- 172.21.15.31:0/2054189072 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbfec073590 0x7fbfec075a50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc0000af000 tx=0x7fc00001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:39.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.055+0000 7fc006a00640 1 -- 172.21.15.31:0/2054189072 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fbff805ee20 con 0x7fc01006f8c0 2024-09-17T05:32:39.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.243+0000 7fc015a00640 1 -- 172.21.15.31:0/2054189072 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc01006fca0 con 0x7fc01006f8c0 2024-09-17T05:32:39.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.243+0000 7fc006a00640 1 -- 172.21.15.31:0/2054189072 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) ==== 80+0+0 (secure 0 0 0) 0x7fbff8063850 con 0x7fc01006f8c0 2024-09-17T05:32:39.245 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:32:39.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.247+0000 7fc015a00640 1 -- 172.21.15.31:0/2054189072 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbfec073590 msgr2=0x7fbfec075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:39.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.247+0000 7fc015a00640 1 --2- 172.21.15.31:0/2054189072 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbfec073590 0x7fbfec075a50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc0000af000 tx=0x7fc00001b070 comp rx=0 tx=0).stop 2024-09-17T05:32:39.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.247+0000 7fc015a00640 1 -- 172.21.15.31:0/2054189072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc01006f8c0 msgr2=0x7fc0100b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:39.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.247+0000 7fc015a00640 1 --2- 172.21.15.31:0/2054189072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc01006f8c0 0x7fc0100b06f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbff80058d0 tx=0x7fbff800dde0 comp rx=0 tx=0).stop 2024-09-17T05:32:39.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.247+0000 7fc015a00640 1 -- 172.21.15.31:0/2054189072 shutdown_connections 2024-09-17T05:32:39.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.247+0000 7fc015a00640 1 --2- 172.21.15.31:0/2054189072 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7fbfec073590 0x7fbfec075a50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:39.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.247+0000 7fc015a00640 1 --2- 172.21.15.31:0/2054189072 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc0100cc740 0x7fc01015cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:39.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.247+0000 7fc015a00640 1 --2- 172.21.15.31:0/2054189072 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc01006f8c0 0x7fc0100b06f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:39.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.247+0000 7fc015a00640 1 --2- 172.21.15.31:0/2054189072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc01006e7a0 0x7fc0101334f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:39.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.247+0000 7fc015a00640 1 -- 172.21.15.31:0/2054189072 >> 172.21.15.31:0/2054189072 conn(0x7fc0100b18f0 msgr2=0x7fc01015b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:39.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.247+0000 7fc015a00640 1 -- 172.21.15.31:0/2054189072 shutdown_connections 2024-09-17T05:32:39.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.247+0000 7fc015a00640 1 -- 172.21.15.31:0/2054189072 wait complete. 2024-09-17T05:32:39.267 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T05:32:39.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:39.267 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T05:32:39.295 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:32:39.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:32:39.295 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:32:39.351 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:32:39.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.499+0000 7efe1ea00640 1 -- 172.21.15.31:0/536263797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdfc005220 msgr2=0x7efdfc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:39.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.499+0000 7efe1ea00640 1 --2- 172.21.15.31:0/536263797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdfc005220 0x7efdfc00b9d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7efe10001f50 tx=0x7efe1001cc40 comp rx=0 tx=0).stop 2024-09-17T05:32:39.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.499+0000 7efe1ea00640 1 -- 172.21.15.31:0/536263797 shutdown_connections 2024-09-17T05:32:39.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.499+0000 7efe1ea00640 1 --2- 172.21.15.31:0/536263797 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdfc005220 0x7efdfc00b9d0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:39.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.499+0000 7efe1ea00640 1 -- 172.21.15.31:0/536263797 >> 172.21.15.31:0/536263797 conn(0x7efe180d1dc0 msgr2=0x7efe180d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:39.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.499+0000 7efe1ea00640 1 -- 172.21.15.31:0/536263797 shutdown_connections 2024-09-17T05:32:39.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.499+0000 7efe1ea00640 1 -- 172.21.15.31:0/536263797 wait complete. 2024-09-17T05:32:39.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe1ea00640 1 Processor -- start 2024-09-17T05:32:39.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe1ea00640 1 -- start start 2024-09-17T05:32:39.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe1ea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdfc005220 0x7efe180b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:39.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe1ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe180b3ea0 0x7efe181f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:39.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe1ea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe1815a870 0x7efe1815acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:39.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe1ea00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efe180d2a60 con 0x7efe180b3ea0 2024-09-17T05:32:39.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe1ea00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efe180d28e0 con 0x7efe1815a870 2024-09-17T05:32:39.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe1ea00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efe180d2be0 con 0x7efdfc005220 2024-09-17T05:32:39.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe0fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe180b3ea0 0x7efe181f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:39.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe0fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe180b3ea0 0x7efe181f48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45694/0 (socket says 172.21.15.31:45694) 2024-09-17T05:32:39.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe0fe00640 1 -- 172.21.15.31:0/3406587345 learned_addr learned my addr 172.21.15.31:0/3406587345 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:39.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe17e00640 1 --2- 172.21.15.31:0/3406587345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdfc005220 0x7efe180b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:39.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe1ca00640 1 --2- 172.21.15.31:0/3406587345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe1815a870 0x7efe1815acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe0fe00640 1 -- 172.21.15.31:0/3406587345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdfc005220 msgr2=0x7efe180b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe0fe00640 1 --2- 172.21.15.31:0/3406587345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdfc005220 0x7efe180b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe0fe00640 1 -- 172.21.15.31:0/3406587345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe1815a870 msgr2=0x7efe1815acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe0fe00640 1 --2- 172.21.15.31:0/3406587345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe1815a870 0x7efe1815acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe0fe00640 1 -- 172.21.15.31:0/3406587345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe180b2470 con 0x7efe180b3ea0 2024-09-17T05:32:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe17e00640 1 --2- 172.21.15.31:0/3406587345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdfc005220 0x7efe180b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe0fe00640 1 --2- 172.21.15.31:0/3406587345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe180b3ea0 0x7efe181f48b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7efe00010ab0 tx=0x7efe00010f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe14c00640 1 -- 172.21.15.31:0/3406587345 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0000ee60 con 0x7efe180b3ea0 2024-09-17T05:32:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe14c00640 1 -- 172.21.15.31:0/3406587345 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe00005020 con 0x7efe180b3ea0 2024-09-17T05:32:39.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe14c00640 1 -- 172.21.15.31:0/3406587345 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe00005450 con 0x7efe180b3ea0 2024-09-17T05:32:39.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe1ea00640 1 -- 172.21.15.31:0/3406587345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe180b2750 con 0x7efe180b3ea0 2024-09-17T05:32:39.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe1ea00640 1 -- 172.21.15.31:0/3406587345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe180b2d10 con 0x7efe180b3ea0 2024-09-17T05:32:39.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.503+0000 7efe1ea00640 1 -- 172.21.15.31:0/3406587345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe180ce910 con 0x7efe180b3ea0 2024-09-17T05:32:39.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.507+0000 7efe14c00640 1 -- 172.21.15.31:0/3406587345 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7efe000047b0 con 0x7efe180b3ea0 2024-09-17T05:32:39.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.507+0000 7efe14c00640 1 --2- 172.21.15.31:0/3406587345 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efdf4073590 0x7efdf4075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:39.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.507+0000 7efe14c00640 1 -- 172.21.15.31:0/3406587345 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7efe00095890 con 0x7efe180b3ea0 2024-09-17T05:32:39.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.507+0000 7efe17e00640 1 --2- 172.21.15.31:0/3406587345 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efdf4073590 0x7efdf4075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:39.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.507+0000 7efe17e00640 1 --2- 172.21.15.31:0/3406587345 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efdf4073590 0x7efdf4075a50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7efe08006bb0 tx=0x7efe08006ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:39.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.511+0000 7efe14c00640 1 -- 172.21.15.31:0/3406587345 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7efe00060320 con 0x7efe180b3ea0 2024-09-17T05:32:39.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.719+0000 7efe1ea00640 1 -- 172.21.15.31:0/3406587345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe180721f0 con 0x7efe180b3ea0 2024-09-17T05:32:39.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.719+0000 7efe14c00640 1 -- 172.21.15.31:0/3406587345 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7efe0005fc20 con 0x7efe180b3ea0 2024-09-17T05:32:39.722 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:39.722 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":48,"btime":"2024-09-17T05:32:37:503295+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/4172452504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":4172452504},{"type":"v1","addr":"172.21.15.155:6837","nonce":4172452504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2918874157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2918874157},{"type":"v1","addr":"172.21.15.155:6836","nonce":2918874157}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3987740697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3987740697},{"type":"v1","addr":"172.21.15.31:6833","nonce":3987740697}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:32:22.832719+0000","modified":"2024-09-17T05:32:25.871459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6153":{"gid":6153,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1598380263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1598380263},{"type":"v1","addr":"172.21.15.31:6835","nonce":1598380263}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6153,"qdb_cluster":[6153]},"id":5}]} 2024-09-17T05:32:39.722 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 48 2024-09-17T05:32:39.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.723+0000 7efe1ea00640 1 -- 172.21.15.31:0/3406587345 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efdf4073590 msgr2=0x7efdf4075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:39.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.723+0000 7efe1ea00640 1 --2- 172.21.15.31:0/3406587345 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efdf4073590 0x7efdf4075a50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7efe08006bb0 tx=0x7efe08006ac0 comp rx=0 tx=0).stop 2024-09-17T05:32:39.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.723+0000 7efe1ea00640 1 -- 172.21.15.31:0/3406587345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe180b3ea0 msgr2=0x7efe181f48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:39.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.723+0000 7efe1ea00640 1 --2- 172.21.15.31:0/3406587345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe180b3ea0 0x7efe181f48b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7efe00010ab0 tx=0x7efe00010f70 comp rx=0 tx=0).stop 2024-09-17T05:32:39.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.723+0000 7efe1ea00640 1 -- 172.21.15.31:0/3406587345 shutdown_connections 2024-09-17T05:32:39.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.723+0000 7efe1ea00640 1 --2- 172.21.15.31:0/3406587345 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7efdf4073590 0x7efdf4075a50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:39.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.723+0000 7efe1ea00640 1 --2- 172.21.15.31:0/3406587345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe1815a870 0x7efe1815acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:39.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.723+0000 7efe1ea00640 1 --2- 172.21.15.31:0/3406587345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe180b3ea0 0x7efe181f48b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:39.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.723+0000 7efe1ea00640 1 --2- 172.21.15.31:0/3406587345 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efdfc005220 0x7efe180b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:39.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.723+0000 7efe1ea00640 1 -- 172.21.15.31:0/3406587345 >> 172.21.15.31:0/3406587345 conn(0x7efe180d1dc0 msgr2=0x7efe1806ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:39.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.723+0000 7efe1ea00640 1 -- 172.21.15.31:0/3406587345 shutdown_connections 2024-09-17T05:32:39.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:39.723+0000 7efe1ea00640 1 -- 172.21.15.31:0/3406587345 wait complete. 2024-09-17T05:32:39.744 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-09-17T05:32:39.908 INFO:teuthology.orchestra.run.smithi031.stdout:[] 2024-09-17T05:32:39.909 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-17T05:32:39.909 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol67900 2024-09-17T05:32:40.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.055+0000 7f774b400640 1 -- 172.21.15.31:0/4014946963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77440cff20 msgr2=0x7f77440d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:40.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.055+0000 7f774b400640 1 --2- 172.21.15.31:0/4014946963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77440cff20 0x7f77440d0300 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7738009900 tx=0x7f773801f0d0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.055+0000 7f774b400640 1 -- 172.21.15.31:0/4014946963 shutdown_connections 2024-09-17T05:32:40.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.055+0000 7f774b400640 1 --2- 172.21.15.31:0/4014946963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77440b2d80 0x7f77440d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.055+0000 7f774b400640 1 --2- 172.21.15.31:0/4014946963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77440cff20 0x7f77440d0300 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.055+0000 7f774b400640 1 -- 172.21.15.31:0/4014946963 >> 172.21.15.31:0/4014946963 conn(0x7f77440d1dc0 msgr2=0x7f77440d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:40.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.055+0000 7f774b400640 1 -- 172.21.15.31:0/4014946963 shutdown_connections 2024-09-17T05:32:40.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.055+0000 7f774b400640 1 -- 172.21.15.31:0/4014946963 wait complete. 2024-09-17T05:32:40.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f774b400640 1 Processor -- start 2024-09-17T05:32:40.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f774b400640 1 -- start start 2024-09-17T05:32:40.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f774b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77440b14c0 0x7f7744153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f774b400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77440b2d80 0x7f774415d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f774b400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77440cff20 0x7f77441f8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f774b400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f77440af880 con 0x7f77440b14c0 2024-09-17T05:32:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f774b400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f77440af700 con 0x7f77440b2d80 2024-09-17T05:32:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f774b400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f77440afa00 con 0x7f77440cff20 2024-09-17T05:32:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f7748a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77440b14c0 0x7f7744153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f7748a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77440b14c0 0x7f7744153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45716/0 (socket says 172.21.15.31:45716) 2024-09-17T05:32:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f7748a00640 1 -- 172.21.15.31:0/2371934632 learned_addr learned my addr 172.21.15.31:0/2371934632 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f7748a00640 1 -- 172.21.15.31:0/2371934632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77440cff20 msgr2=0x7f77441f8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f7748a00640 1 --2- 172.21.15.31:0/2371934632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77440cff20 0x7f77441f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f7748a00640 1 -- 172.21.15.31:0/2371934632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77440b2d80 msgr2=0x7f774415d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f7743e00640 1 --2- 172.21.15.31:0/2371934632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77440b2d80 0x7f774415d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f7748a00640 1 --2- 172.21.15.31:0/2371934632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77440b2d80 0x7f774415d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f7748a00640 1 -- 172.21.15.31:0/2371934632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f774415d890 con 0x7f77440b14c0 2024-09-17T05:32:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f7743e00640 1 --2- 172.21.15.31:0/2371934632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77440b2d80 0x7f774415d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:32:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f7748a00640 1 --2- 172.21.15.31:0/2371934632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77440b14c0 0x7f7744153e20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f77380b3040 tx=0x7f77380a8ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f7740c00640 1 -- 172.21.15.31:0/2371934632 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77380b5040 con 0x7f77440b14c0 2024-09-17T05:32:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f7740c00640 1 -- 172.21.15.31:0/2371934632 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7738003970 con 0x7f77440b14c0 2024-09-17T05:32:40.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f7740c00640 1 -- 172.21.15.31:0/2371934632 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7738003d80 con 0x7f77440b14c0 2024-09-17T05:32:40.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f774b400640 1 -- 172.21.15.31:0/2371934632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f774415db70 con 0x7f77440b14c0 2024-09-17T05:32:40.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.059+0000 7f774b400640 1 -- 172.21.15.31:0/2371934632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77441f7d20 con 0x7f77440b14c0 2024-09-17T05:32:40.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.063+0000 7f774b400640 1 -- 172.21.15.31:0/2371934632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77440b1940 con 0x7f77440b14c0 2024-09-17T05:32:40.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.063+0000 7f7740c00640 1 -- 172.21.15.31:0/2371934632 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f77380c2060 con 0x7f77440b14c0 2024-09-17T05:32:40.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.063+0000 7f7740c00640 1 --2- 172.21.15.31:0/2371934632 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7724073560 0x7f7724075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:40.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.063+0000 7f7740c00640 1 -- 172.21.15.31:0/2371934632 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f7738131e60 con 0x7f77440b14c0 2024-09-17T05:32:40.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.063+0000 7f7743e00640 1 --2- 172.21.15.31:0/2371934632 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7724073560 0x7f7724075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:40.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.067+0000 7f7743e00640 1 --2- 172.21.15.31:0/2371934632 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7724073560 0x7f7724075a20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f77440cf890 tx=0x7f7730008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:40.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.067+0000 7f7740c00640 1 -- 172.21.15.31:0/2371934632 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7738018c30 con 0x7f77440b14c0 2024-09-17T05:32:40.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.271+0000 7f774b400640 1 -- 172.21.15.31:0/2371934632 --> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol67900", "target": ["mon-mgr", ""]}) -- 0x7f7744154620 con 0x7f7724073560 2024-09-17T05:32:40.283 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:32:40.285+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:32:40.283 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:32:40.285+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:32:40.283 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:32:40.285+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:32:40.284 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:32:40.285+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:32:40.284 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:32:40.285+0000 7faafa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:32:40.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.319+0000 7f7740c00640 1 -- 172.21.15.31:0/2371934632 <== mgr.4100 v2:172.21.15.155:6808/1222054038 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7744154620 con 0x7f7724073560 2024-09-17T05:32:40.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.323+0000 7f774b400640 1 -- 172.21.15.31:0/2371934632 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7724073560 msgr2=0x7f7724075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:40.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.323+0000 7f774b400640 1 --2- 172.21.15.31:0/2371934632 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7724073560 0x7f7724075a20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f77440cf890 tx=0x7f7730008040 comp rx=0 tx=0).stop 2024-09-17T05:32:40.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.323+0000 7f774b400640 1 -- 172.21.15.31:0/2371934632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77440b14c0 msgr2=0x7f7744153e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:40.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.323+0000 7f774b400640 1 --2- 172.21.15.31:0/2371934632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77440b14c0 0x7f7744153e20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f77380b3040 tx=0x7f77380a8ce0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.323+0000 7f774b400640 1 -- 172.21.15.31:0/2371934632 shutdown_connections 2024-09-17T05:32:40.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.323+0000 7f774b400640 1 --2- 172.21.15.31:0/2371934632 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f7724073560 0x7f7724075a20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.323+0000 7f774b400640 1 --2- 172.21.15.31:0/2371934632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77440cff20 0x7f77441f8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.323+0000 7f774b400640 1 --2- 172.21.15.31:0/2371934632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77440b2d80 0x7f774415d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.323+0000 7f774b400640 1 --2- 172.21.15.31:0/2371934632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77440b14c0 0x7f7744153e20 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.323+0000 7f774b400640 1 -- 172.21.15.31:0/2371934632 >> 172.21.15.31:0/2371934632 conn(0x7f77440d1dc0 msgr2=0x7f7744071f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:40.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.323+0000 7f774b400640 1 -- 172.21.15.31:0/2371934632 shutdown_connections 2024-09-17T05:32:40.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.323+0000 7f774b400640 1 -- 172.21.15.31:0/2371934632 wait complete. 2024-09-17T05:32:40.342 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:32:40.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.487+0000 7f1651e00640 1 -- 172.21.15.31:0/2641738758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f164c15dae0 msgr2=0x7f164c0acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:40.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.487+0000 7f1651e00640 1 --2- 172.21.15.31:0/2641738758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f164c15dae0 0x7f164c0acd40 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f164c070d30 tx=0x7f163c01c830 comp rx=0 tx=0).stop 2024-09-17T05:32:40.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f1651e00640 1 -- 172.21.15.31:0/2641738758 shutdown_connections 2024-09-17T05:32:40.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f1651e00640 1 --2- 172.21.15.31:0/2641738758 >> v2:172.21.15.155:3300/0 conn(0x7f164c0b4810 0x7f164c0ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f1651e00640 1 --2- 172.21.15.31:0/2641738758 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f164c0cd100 0x7f164c0b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f1651e00640 1 --2- 172.21.15.31:0/2641738758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f164c15dae0 0x7f164c0acd40 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f1651e00640 1 -- 172.21.15.31:0/2641738758 >> 172.21.15.31:0/2641738758 conn(0x7f164c0b18f0 msgr2=0x7f164c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:40.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f1651e00640 1 -- 172.21.15.31:0/2641738758 shutdown_connections 2024-09-17T05:32:40.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f1651e00640 1 -- 172.21.15.31:0/2641738758 wait complete. 2024-09-17T05:32:40.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f1651e00640 1 Processor -- start 2024-09-17T05:32:40.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f1651e00640 1 -- start start 2024-09-17T05:32:40.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f1651e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f164c0b4810 0x7f164c1649e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:40.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f1651e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f164c0cd100 0x7f164c1506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:40.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f1651e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f164c15dae0 0x7f164c1f85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:40.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f1651e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f164c0cf420 con 0x7f164c0b4810 2024-09-17T05:32:40.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f1651e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f164c0cf2a0 con 0x7f164c15dae0 2024-09-17T05:32:40.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f1651e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f164c06e7a0 con 0x7f164c0cd100 2024-09-17T05:32:40.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f164aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f164c0b4810 0x7f164c1649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:40.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f164aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f164c0b4810 0x7f164c1649e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45734/0 (socket says 172.21.15.31:45734) 2024-09-17T05:32:40.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f164aa00640 1 -- 172.21.15.31:0/3994459131 learned_addr learned my addr 172.21.15.31:0/3994459131 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:40.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f164b400640 1 --2- 172.21.15.31:0/3994459131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f164c15dae0 0x7f164c1f85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:40.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f1642000640 1 --2- 172.21.15.31:0/3994459131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f164c0cd100 0x7f164c1506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:40.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f164aa00640 1 -- 172.21.15.31:0/3994459131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f164c0cd100 msgr2=0x7f164c1506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:40.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f164aa00640 1 --2- 172.21.15.31:0/3994459131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f164c0cd100 0x7f164c1506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f164aa00640 1 -- 172.21.15.31:0/3994459131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f164c15dae0 msgr2=0x7f164c1f85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:40.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f164aa00640 1 --2- 172.21.15.31:0/3994459131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f164c15dae0 0x7f164c1f85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f164aa00640 1 -- 172.21.15.31:0/3994459131 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164c15b0f0 con 0x7f164c0b4810 2024-09-17T05:32:40.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f164aa00640 1 --2- 172.21.15.31:0/3994459131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f164c0b4810 0x7f164c1649e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f163c01aee0 tx=0x7f163c005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:40.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.491+0000 7f1643e00640 1 -- 172.21.15.31:0/3994459131 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c0b2040 con 0x7f164c0b4810 2024-09-17T05:32:40.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.495+0000 7f1643e00640 1 -- 172.21.15.31:0/3994459131 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f163c004320 con 0x7f164c0b4810 2024-09-17T05:32:40.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.495+0000 7f1651e00640 1 -- 172.21.15.31:0/3994459131 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f164c15b3d0 con 0x7f164c0b4810 2024-09-17T05:32:40.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.495+0000 7f1643e00640 1 -- 172.21.15.31:0/3994459131 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c0052d0 con 0x7f164c0b4810 2024-09-17T05:32:40.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.495+0000 7f1651e00640 1 -- 172.21.15.31:0/3994459131 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f164c15b990 con 0x7f164c0b4810 2024-09-17T05:32:40.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.495+0000 7f1651e00640 1 -- 172.21.15.31:0/3994459131 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f164c069410 con 0x7f164c0b4810 2024-09-17T05:32:40.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.495+0000 7f1643e00640 1 -- 172.21.15.31:0/3994459131 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7f163c0bd060 con 0x7f164c0b4810 2024-09-17T05:32:40.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.495+0000 7f1643e00640 1 --2- 172.21.15.31:0/3994459131 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1628073560 0x7f1628075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:40.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.495+0000 7f1643e00640 1 -- 172.21.15.31:0/3994459131 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f163c12d920 con 0x7f164c0b4810 2024-09-17T05:32:40.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.495+0000 7f1642000640 1 --2- 172.21.15.31:0/3994459131 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1628073560 0x7f1628075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:40.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.499+0000 7f1642000640 1 --2- 172.21.15.31:0/3994459131 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1628073560 0x7f1628075a20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f164c0b12d0 tx=0x7f163400b390 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:40.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.499+0000 7f1643e00640 1 -- 172.21.15.31:0/3994459131 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f163c0164b0 con 0x7f164c0b4810 2024-09-17T05:32:40.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.715+0000 7f1651e00640 1 -- 172.21.15.31:0/3994459131 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f164c0736a0 con 0x7f164c0b4810 2024-09-17T05:32:40.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.715+0000 7f1643e00640 1 -- 172.21.15.31:0/3994459131 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7f163c0f7eb0 con 0x7f164c0b4810 2024-09-17T05:32:40.715 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:40.715 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":48,"btime":"2024-09-17T05:32:37:503295+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/4172452504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":4172452504},{"type":"v1","addr":"172.21.15.155:6837","nonce":4172452504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2918874157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2918874157},{"type":"v1","addr":"172.21.15.155:6836","nonce":2918874157}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3987740697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3987740697},{"type":"v1","addr":"172.21.15.31:6833","nonce":3987740697}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:32:22.832719+0000","modified":"2024-09-17T05:32:25.871459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6153":{"gid":6153,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1598380263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1598380263},{"type":"v1","addr":"172.21.15.31:6835","nonce":1598380263}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6153,"qdb_cluster":[6153]},"id":5}]} 2024-09-17T05:32:40.716 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 48 2024-09-17T05:32:40.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.715+0000 7f1651e00640 1 -- 172.21.15.31:0/3994459131 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1628073560 msgr2=0x7f1628075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:40.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.715+0000 7f1651e00640 1 --2- 172.21.15.31:0/3994459131 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1628073560 0x7f1628075a20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f164c0b12d0 tx=0x7f163400b390 comp rx=0 tx=0).stop 2024-09-17T05:32:40.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.715+0000 7f1651e00640 1 -- 172.21.15.31:0/3994459131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f164c0b4810 msgr2=0x7f164c1649e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.715+0000 7f1651e00640 1 --2- 172.21.15.31:0/3994459131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f164c0b4810 0x7f164c1649e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f163c01aee0 tx=0x7f163c005e50 comp rx=0 tx=0).stop 2024-09-17T05:32:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.715+0000 7f1651e00640 1 -- 172.21.15.31:0/3994459131 shutdown_connections 2024-09-17T05:32:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.715+0000 7f1651e00640 1 --2- 172.21.15.31:0/3994459131 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f1628073560 0x7f1628075a20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.715+0000 7f1651e00640 1 --2- 172.21.15.31:0/3994459131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f164c15dae0 0x7f164c1f85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.715+0000 7f1651e00640 1 --2- 172.21.15.31:0/3994459131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f164c0cd100 0x7f164c1506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.715+0000 7f1651e00640 1 --2- 172.21.15.31:0/3994459131 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f164c0b4810 0x7f164c1649e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.715+0000 7f1651e00640 1 -- 172.21.15.31:0/3994459131 >> 172.21.15.31:0/3994459131 conn(0x7f164c0b18f0 msgr2=0x7f164c15a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.715+0000 7f1651e00640 1 -- 172.21.15.31:0/3994459131 shutdown_connections 2024-09-17T05:32:40.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:40.715+0000 7f1651e00640 1 -- 172.21.15.31:0/3994459131 wait complete. 2024-09-17T05:32:40.737 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-09-17T05:32:40.901 INFO:teuthology.orchestra.run.smithi031.stdout:[{"id":5621,"entity":{"name":{"type":"client","num":5621},"addr":{"type":"any","addr":"172.21.15.155:0","nonce":913411077}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":15,"uptime":0.595994048,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.970325906530714,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5621 172.21.15.155:0/913411077","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi155","pid":"28855","root":"/"}}] 2024-09-17T05:32:40.901 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi155", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28855", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.155:0", "nonce": 913411077, "type": "any" }, "name": { "num": 5621, "type": "client" } }, "id": 5621, "inst": "client.5621 172.21.15.155:0/913411077", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 15, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.970325906530714 }, "state": "open", "uptime": 0.595994048 } ] 2024-09-17T05:32:40.902 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-17T05:32:41.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.047+0000 7ff233e00640 1 -- 172.21.15.31:0/601748872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff234155080 msgr2=0x7ff2340cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:41.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.047+0000 7ff233e00640 1 --2- 172.21.15.31:0/601748872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff234155080 0x7ff2340cd510 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff224009840 tx=0x7ff22401c820 comp rx=0 tx=0).stop 2024-09-17T05:32:41.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.047+0000 7ff233e00640 1 -- 172.21.15.31:0/601748872 shutdown_connections 2024-09-17T05:32:41.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.047+0000 7ff233e00640 1 --2- 172.21.15.31:0/601748872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff234155080 0x7ff2340cd510 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:41.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.047+0000 7ff233e00640 1 -- 172.21.15.31:0/601748872 >> 172.21.15.31:0/601748872 conn(0x7ff23406dd30 msgr2=0x7ff23406e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:41.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.047+0000 7ff233e00640 1 -- 172.21.15.31:0/601748872 shutdown_connections 2024-09-17T05:32:41.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.047+0000 7ff233e00640 1 -- 172.21.15.31:0/601748872 wait complete. 2024-09-17T05:32:41.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.047+0000 7ff233e00640 1 Processor -- start 2024-09-17T05:32:41.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.047+0000 7ff233e00640 1 -- start start 2024-09-17T05:32:41.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff233e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2340cba70 0x7ff2341fb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:41.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff233e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2340cda50 0x7ff2341fb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:41.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff233e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff234155080 0x7ff2341f7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:41.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff233e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff234168fd0 con 0x7ff2340cda50 2024-09-17T05:32:41.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff233e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff234168e50 con 0x7ff234155080 2024-09-17T05:32:41.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff233e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff234169150 con 0x7ff2340cba70 2024-09-17T05:32:41.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff232000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2340cda50 0x7ff2341fb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:41.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff232000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2340cda50 0x7ff2341fb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45764/0 (socket says 172.21.15.31:45764) 2024-09-17T05:32:41.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff232000640 1 -- 172.21.15.31:0/3858699917 learned_addr learned my addr 172.21.15.31:0/3858699917 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:41.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff232a00640 1 --2- 172.21.15.31:0/3858699917 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2340cba70 0x7ff2341fb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:41.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff232000640 1 -- 172.21.15.31:0/3858699917 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2340cba70 msgr2=0x7ff2341fb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:41.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff232000640 1 --2- 172.21.15.31:0/3858699917 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2340cba70 0x7ff2341fb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:41.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff233400640 1 --2- 172.21.15.31:0/3858699917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff234155080 0x7ff2341f7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:41.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff232000640 1 -- 172.21.15.31:0/3858699917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff234155080 msgr2=0x7ff2341f7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:41.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff232000640 1 --2- 172.21.15.31:0/3858699917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff234155080 0x7ff2341f7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:41.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff232000640 1 -- 172.21.15.31:0/3858699917 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff234071d40 con 0x7ff2340cda50 2024-09-17T05:32:41.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff232a00640 1 --2- 172.21.15.31:0/3858699917 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2340cba70 0x7ff2341fb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:32:41.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff233400640 1 --2- 172.21.15.31:0/3858699917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff234155080 0x7ff2341f7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:32:41.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff232000640 1 --2- 172.21.15.31:0/3858699917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2340cda50 0x7ff2341fb980 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff22000c730 tx=0x7ff22000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:41.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff22aa00640 1 -- 172.21.15.31:0/3858699917 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff220017070 con 0x7ff2340cda50 2024-09-17T05:32:41.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff22aa00640 1 -- 172.21.15.31:0/3858699917 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff220005380 con 0x7ff2340cda50 2024-09-17T05:32:41.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff22aa00640 1 -- 172.21.15.31:0/3858699917 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22000a8a0 con 0x7ff2340cda50 2024-09-17T05:32:41.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff233e00640 1 -- 172.21.15.31:0/3858699917 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff234070bf0 con 0x7ff2340cda50 2024-09-17T05:32:41.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff233e00640 1 -- 172.21.15.31:0/3858699917 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff234071490 con 0x7ff2340cda50 2024-09-17T05:32:41.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.051+0000 7ff233e00640 1 -- 172.21.15.31:0/3858699917 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2340cb610 con 0x7ff2340cda50 2024-09-17T05:32:41.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.055+0000 7ff22aa00640 1 -- 172.21.15.31:0/3858699917 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 10) ==== 97540+0+0 (secure 0 0 0) 0x7ff22001a070 con 0x7ff2340cda50 2024-09-17T05:32:41.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.055+0000 7ff22aa00640 1 --2- 172.21.15.31:0/3858699917 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff214073560 0x7ff214075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:41.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.055+0000 7ff22aa00640 1 -- 172.21.15.31:0/3858699917 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7ff220093ac0 con 0x7ff2340cda50 2024-09-17T05:32:41.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.055+0000 7ff232a00640 1 --2- 172.21.15.31:0/3858699917 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff214073560 0x7ff214075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:41.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.055+0000 7ff232a00640 1 --2- 172.21.15.31:0/3858699917 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff214073560 0x7ff214075a20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff2240af000 tx=0x7ff22401b060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:41.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.059+0000 7ff22aa00640 1 -- 172.21.15.31:0/3858699917 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff22005e6e0 con 0x7ff2340cda50 2024-09-17T05:32:41.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.275+0000 7ff233e00640 1 -- 172.21.15.31:0/3858699917 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7ff2340c4410 con 0x7ff2340cda50 2024-09-17T05:32:41.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.283+0000 7ff22aa00640 1 -- 172.21.15.31:0/3858699917 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v10) ==== 81+0+506844 (secure 0 0 0) 0x7ff220093e20 con 0x7ff2340cda50 2024-09-17T05:32:41.291 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:41.291 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:32:41.291 INFO:teuthology.orchestra.run.smithi031.stdout: "epoch": 10, 2024-09-17T05:32:41.291 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.291 INFO:teuthology.orchestra.run.smithi031.stdout: "active_gid": 4100, 2024-09-17T05:32:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: "active_name": "x", 2024-09-17T05:32:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: "active_addrs": { 2024-09-17T05:32:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-09-17T05:32:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-09-17T05:32:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.155:6808", 2024-09-17T05:32:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1222054038 2024-09-17T05:32:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-09-17T05:32:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.155:6809", 2024-09-17T05:32:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1222054038 2024-09-17T05:32:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:32:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: "active_addr": "172.21.15.155:6809/1222054038", 2024-09-17T05:32:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: "active_change": "2024-09-17T05:28:25.169123+0000", 2024-09-17T05:32:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: "active_mgr_features": 4540719139924082687, 2024-09-17T05:32:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: "available": true, 2024-09-17T05:32:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: "standbys": [ 2024-09-17T05:32:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: "gid": 4106, 2024-09-17T05:32:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "y", 2024-09-17T05:32:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr_features": 4540719139924082687, 2024-09-17T05:32:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: "available_modules": [ 2024-09-17T05:32:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "alerts", 2024-09-17T05:32:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-09-17T05:32:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-09-17T05:32:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-09-17T05:32:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How frequently to reexamine health status", 2024-09-17T05:32:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_destination": { 2024-09-17T05:32:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_destination", 2024-09-17T05:32:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-17T05:32:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_from_name": { 2024-09-17T05:32:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_from_name", 2024-09-17T05:32:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "Ceph", 2024-09-17T05:32:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Email From: name", 2024-09-17T05:32:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_host": { 2024-09-17T05:32:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_host", 2024-09-17T05:32:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP server", 2024-09-17T05:32:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_password": { 2024-09-17T05:32:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_password", 2024-09-17T05:32:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Password to authenticate with", 2024-09-17T05:32:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_port": { 2024-09-17T05:32:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_port", 2024-09-17T05:32:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "465", 2024-09-17T05:32:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP port", 2024-09-17T05:32:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_sender": { 2024-09-17T05:32:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_sender", 2024-09-17T05:32:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP envelope sender", 2024-09-17T05:32:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_ssl": { 2024-09-17T05:32:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_ssl", 2024-09-17T05:32:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-17T05:32:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_user": { 2024-09-17T05:32:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_user", 2024-09-17T05:32:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "User to authenticate as", 2024-09-17T05:32:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "balancer", 2024-09-17T05:32:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "active": { 2024-09-17T05:32:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "active", 2024-09-17T05:32:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "automatically balance PGs across cluster", 2024-09-17T05:32:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "begin_time": { 2024-09-17T05:32:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "begin_time", 2024-09-17T05:32:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0000", 2024-09-17T05:32:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "beginning time of day to automatically balance", 2024-09-17T05:32:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-17T05:32:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "begin_weekday": { 2024-09-17T05:32:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "begin_weekday", 2024-09-17T05:32:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-09-17T05:32:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0", 2024-09-17T05:32:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "6", 2024-09-17T05:32:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-17T05:32:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-17T05:32:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_max_iterations": { 2024-09-17T05:32:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_max_iterations", 2024-09-17T05:32:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-09-17T05:32:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "25", 2024-09-17T05:32:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-09-17T05:32:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "250", 2024-09-17T05:32:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-17T05:32:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_metrics": { 2024-09-17T05:32:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_metrics", 2024-09-17T05:32:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "pgs,objects,bytes", 2024-09-17T05:32:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-17T05:32:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-17T05:32:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_step": { 2024-09-17T05:32:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_step", 2024-09-17T05:32:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-09-17T05:32:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0.5", 2024-09-17T05:32:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0.001", 2024-09-17T05:32:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "0.999", 2024-09-17T05:32:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "aggressiveness of optimization", 2024-09-17T05:32:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-17T05:32:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "end_time": { 2024-09-17T05:32:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "end_time", 2024-09-17T05:32:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "2359", 2024-09-17T05:32:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "ending time of day to automatically balance", 2024-09-17T05:32:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-17T05:32:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "end_weekday": { 2024-09-17T05:32:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "end_weekday", 2024-09-17T05:32:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-09-17T05:32:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0", 2024-09-17T05:32:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "6", 2024-09-17T05:32:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-17T05:32:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-17T05:32:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "min_score": { 2024-09-17T05:32:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "min_score", 2024-09-17T05:32:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-09-17T05:32:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-17T05:32:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "mode": { 2024-09-17T05:32:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mode", 2024-09-17T05:32:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "upmap", 2024-09-17T05:32:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-compat", 2024-09-17T05:32:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "none", 2024-09-17T05:32:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "read", 2024-09-17T05:32:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap", 2024-09-17T05:32:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap-read" 2024-09-17T05:32:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Balancer mode", 2024-09-17T05:32:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_ids": { 2024-09-17T05:32:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pool_ids", 2024-09-17T05:32:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-17T05:32:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-09-17T05:32:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-09-17T05:32:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-09-17T05:32:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-17T05:32:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap_max_deviation": { 2024-09-17T05:32:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "upmap_max_deviation", 2024-09-17T05:32:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-09-17T05:32:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-09-17T05:32:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-17T05:32:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-17T05:32:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap_max_optimizations": { 2024-09-17T05:32:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "upmap_max_optimizations", 2024-09-17T05:32:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-09-17T05:32:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-09-17T05:32:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-17T05:32:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephadm", 2024-09-17T05:32:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_down_multiplier": { 2024-09-17T05:32:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_down_multiplier", 2024-09-17T05:32:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-09-17T05:32:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3.0", 2024-09-17T05:32:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-17T05:32:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_refresh_rate": { 2024-09-17T05:32:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_refresh_rate", 2024-09-17T05:32:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "20", 2024-09-17T05:32:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-17T05:32:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_starting_port": { 2024-09-17T05:32:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_starting_port", 2024-09-17T05:32:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "4721", 2024-09-17T05:32:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-17T05:32:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_ptrace": { 2024-09-17T05:32:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_ptrace", 2024-09-17T05:32:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-17T05:32:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-17T05:32:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "autotune_interval": { 2024-09-17T05:32:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "autotune_interval", 2024-09-17T05:32:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-09-17T05:32:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-17T05:32:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "autotune_memory_target_ratio": { 2024-09-17T05:32:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "autotune_memory_target_ratio", 2024-09-17T05:32:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-09-17T05:32:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0.7", 2024-09-17T05:32:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-17T05:32:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm_log_destination": { 2024-09-17T05:32:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephadm_log_destination", 2024-09-17T05:32:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "file", 2024-09-17T05:32:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "file,syslog", 2024-09-17T05:32:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "syslog" 2024-09-17T05:32:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-17T05:32:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "cgroups_split": { 2024-09-17T05:32:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cgroups_split", 2024-09-17T05:32:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-17T05:32:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: "config_checks_enabled": { 2024-09-17T05:32:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "config_checks_enabled", 2024-09-17T05:32:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-17T05:32:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "config_dashboard": { 2024-09-17T05:32:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "config_dashboard", 2024-09-17T05:32:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-17T05:32:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_alertmanager": { 2024-09-17T05:32:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_alertmanager", 2024-09-17T05:32:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-17T05:32:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-09-17T05:32:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_base": { 2024-09-17T05:32:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_base", 2024-09-17T05:32:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-17T05:32:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Container image name, without the tag", 2024-09-17T05:32:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_elasticsearch": { 2024-09-17T05:32:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_elasticsearch", 2024-09-17T05:32:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-17T05:32:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "elasticsearch container image", 2024-09-17T05:32:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_grafana": { 2024-09-17T05:32:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_grafana", 2024-09-17T05:32:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-17T05:32:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-09-17T05:32:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_haproxy": { 2024-09-17T05:32:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_haproxy", 2024-09-17T05:32:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-17T05:32:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "HAproxy container image", 2024-09-17T05:32:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_agent": { 2024-09-17T05:32:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_agent", 2024-09-17T05:32:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-17T05:32:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger agent container image", 2024-09-17T05:32:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_collector": { 2024-09-17T05:32:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_collector", 2024-09-17T05:32:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-17T05:32:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger collector container image", 2024-09-17T05:32:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_query": { 2024-09-17T05:32:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_query", 2024-09-17T05:32:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-17T05:32:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger query container image", 2024-09-17T05:32:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_keepalived": { 2024-09-17T05:32:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_keepalived", 2024-09-17T05:32:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-17T05:32:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Keepalived container image", 2024-09-17T05:32:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_loki": { 2024-09-17T05:32:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_loki", 2024-09-17T05:32:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-17T05:32:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Loki container image", 2024-09-17T05:32:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_nginx": { 2024-09-17T05:32:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_nginx", 2024-09-17T05:32:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-17T05:32:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Nginx container image", 2024-09-17T05:32:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_node_exporter": { 2024-09-17T05:32:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_node_exporter", 2024-09-17T05:32:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-17T05:32:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-09-17T05:32:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_nvmeof": { 2024-09-17T05:32:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_nvmeof", 2024-09-17T05:32:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-17T05:32:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Nvme-of container image", 2024-09-17T05:32:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_oauth2_proxy": { 2024-09-17T05:32:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_oauth2_proxy", 2024-09-17T05:32:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-17T05:32:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "oauth2-proxy container image", 2024-09-17T05:32:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_prometheus": { 2024-09-17T05:32:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_prometheus", 2024-09-17T05:32:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-17T05:32:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-09-17T05:32:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_promtail": { 2024-09-17T05:32:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_promtail", 2024-09-17T05:32:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-17T05:32:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Promtail container image", 2024-09-17T05:32:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_samba": { 2024-09-17T05:32:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_samba", 2024-09-17T05:32:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-17T05:32:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Samba/SMB container image", 2024-09-17T05:32:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_samba_metrics": { 2024-09-17T05:32:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_samba_metrics", 2024-09-17T05:32:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-17T05:32:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-17T05:32:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_snmp_gateway": { 2024-09-17T05:32:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_snmp_gateway", 2024-09-17T05:32:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-17T05:32:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SNMP Gateway container image", 2024-09-17T05:32:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "container_init": { 2024-09-17T05:32:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_init", 2024-09-17T05:32:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Run podman/docker with `--init`", 2024-09-17T05:32:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: "daemon_cache_timeout": { 2024-09-17T05:32:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "daemon_cache_timeout", 2024-09-17T05:32:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-09-17T05:32:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-17T05:32:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: "default_cephadm_command_timeout": { 2024-09-17T05:32:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "default_cephadm_command_timeout", 2024-09-17T05:32:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "900", 2024-09-17T05:32:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-17T05:32:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: "default_registry": { 2024-09-17T05:32:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "default_registry", 2024-09-17T05:32:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io", 2024-09-17T05:32:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-17T05:32:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: "device_cache_timeout": { 2024-09-17T05:32:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_cache_timeout", 2024-09-17T05:32:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1800", 2024-09-17T05:32:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache device inventory", 2024-09-17T05:32:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "device_enhanced_scan": { 2024-09-17T05:32:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_enhanced_scan", 2024-09-17T05:32:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-17T05:32:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "facts_cache_timeout": { 2024-09-17T05:32:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "facts_cache_timeout", 2024-09-17T05:32:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-09-17T05:32:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache host facts data", 2024-09-17T05:32:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "grafana_dashboards_path": { 2024-09-17T05:32:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "grafana_dashboards_path", 2024-09-17T05:32:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-17T05:32:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-17T05:32:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "host_check_interval": { 2024-09-17T05:32:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "host_check_interval", 2024-09-17T05:32:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-09-17T05:32:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to perform a host check", 2024-09-17T05:32:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "hw_monitoring": { 2024-09-17T05:32:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "hw_monitoring", 2024-09-17T05:32:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-17T05:32:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "inventory_list_all": { 2024-09-17T05:32:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "inventory_list_all", 2024-09-17T05:32:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-17T05:32:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: "log_refresh_metadata": { 2024-09-17T05:32:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_refresh_metadata", 2024-09-17T05:32:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-17T05:32:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-17T05:32:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-17T05:32:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-17T05:32:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-17T05:32:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-17T05:32:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-17T05:32:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "*", 2024-09-17T05:32:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-17T05:32:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: "max_count_per_host": { 2024-09-17T05:32:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_count_per_host", 2024-09-17T05:32:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-09-17T05:32:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "max number of daemons per service per host", 2024-09-17T05:32:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd_draining_count": { 2024-09-17T05:32:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_osd_draining_count", 2024-09-17T05:32:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-09-17T05:32:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-17T05:32:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "migration_current": { 2024-09-17T05:32:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "migration_current", 2024-09-17T05:32:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "internal - do not modify", 2024-09-17T05:32:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: "mode": { 2024-09-17T05:32:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mode", 2024-09-17T05:32:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "root", 2024-09-17T05:32:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm-package", 2024-09-17T05:32:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: "root" 2024-09-17T05:32:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "mode for remote execution of cephadm", 2024-09-17T05:32:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: "oob_default_addr": { 2024-09-17T05:32:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "oob_default_addr", 2024-09-17T05:32:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "169.254.1.1", 2024-09-17T05:32:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-17T05:32:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: "prometheus_alerts_path": { 2024-09-17T05:32:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prometheus_alerts_path", 2024-09-17T05:32:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-17T05:32:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-17T05:32:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_insecure": { 2024-09-17T05:32:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_insecure", 2024-09-17T05:32:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-17T05:32:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_password": { 2024-09-17T05:32:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_password", 2024-09-17T05:32:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-17T05:32:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_url": { 2024-09-17T05:32:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_url", 2024-09-17T05:32:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-17T05:32:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_username": { 2024-09-17T05:32:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_username", 2024-09-17T05:32:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-17T05:32:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "secure_monitoring_stack": { 2024-09-17T05:32:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "secure_monitoring_stack", 2024-09-17T05:32:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-17T05:32:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: "service_discovery_port": { 2024-09-17T05:32:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "service_discovery_port", 2024-09-17T05:32:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8765", 2024-09-17T05:32:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "cephadm service discovery port", 2024-09-17T05:32:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: "ssh_config_file": { 2024-09-17T05:32:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssh_config_file", 2024-09-17T05:32:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-17T05:32:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: "ssh_keepalive_count_max": { 2024-09-17T05:32:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssh_keepalive_count_max", 2024-09-17T05:32:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3", 2024-09-17T05:32:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-17T05:32:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "ssh_keepalive_interval": { 2024-09-17T05:32:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssh_keepalive_interval", 2024-09-17T05:32:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "7", 2024-09-17T05:32:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-17T05:32:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: "use_agent": { 2024-09-17T05:32:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "use_agent", 2024-09-17T05:32:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-17T05:32:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: "use_repo_digest": { 2024-09-17T05:32:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "use_repo_digest", 2024-09-17T05:32:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-17T05:32:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_failed_host_check": { 2024-09-17T05:32:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_failed_host_check", 2024-09-17T05:32:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if the host check fails", 2024-09-17T05:32:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_stray_daemons": { 2024-09-17T05:32:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_stray_daemons", 2024-09-17T05:32:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-17T05:32:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_stray_hosts": { 2024-09-17T05:32:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_stray_hosts", 2024-09-17T05:32:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-17T05:32:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crash", 2024-09-17T05:32:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "retain_interval": { 2024-09-17T05:32:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "retain_interval", 2024-09-17T05:32:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "31536000", 2024-09-17T05:32:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-17T05:32:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_recent_interval": { 2024-09-17T05:32:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_recent_interval", 2024-09-17T05:32:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1209600", 2024-09-17T05:32:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-17T05:32:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "dashboard", 2024-09-17T05:32:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-17T05:32:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-17T05:32:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-09-17T05:32:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "ALERTMANAGER_API_HOST": { 2024-09-17T05:32:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-17T05:32:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-17T05:32:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-17T05:32:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "AUDIT_API_ENABLED": { 2024-09-17T05:32:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "AUDIT_API_ENABLED", 2024-09-17T05:32:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-17T05:32:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-17T05:32:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: "ENABLE_BROWSABLE_API": { 2024-09-17T05:32:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-17T05:32:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.424 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.424 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.424 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.424 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.424 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.424 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.424 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.424 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.424 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.424 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.424 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-17T05:32:41.424 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-17T05:32:41.424 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.424 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.425 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.425 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.425 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.425 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.425 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.425 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.425 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.425 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.425 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.425 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-17T05:32:41.425 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-17T05:32:41.425 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.426 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.426 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.426 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.426 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.426 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.426 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.426 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.426 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.426 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.426 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.426 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.426 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-17T05:32:41.426 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-17T05:32:41.427 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.427 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.427 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.427 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.427 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.427 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.427 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.427 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.427 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.427 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.427 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.427 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-17T05:32:41.427 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-17T05:32:41.427 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.428 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.428 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.428 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.428 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.428 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.428 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.428 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.428 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.428 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.428 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.428 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.428 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-17T05:32:41.429 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-17T05:32:41.429 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.429 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.429 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.429 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.429 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.429 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.429 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.429 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.429 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.429 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.429 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.430 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.430 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-17T05:32:41.430 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-17T05:32:41.430 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.430 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.430 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.430 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.430 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.430 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.430 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.430 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.430 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.430 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.430 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.431 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-17T05:32:41.431 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-17T05:32:41.431 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.431 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.431 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.431 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.431 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.431 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.431 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.431 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.431 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.431 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.432 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.432 INFO:teuthology.orchestra.run.smithi031.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-17T05:32:41.432 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-17T05:32:41.432 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.432 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.432 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.432 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.432 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.432 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.432 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.432 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.432 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.433 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.433 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.433 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_PASSWORD": { 2024-09-17T05:32:41.433 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-17T05:32:41.433 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.433 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.433 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.433 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-09-17T05:32:41.433 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.433 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.433 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.433 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.434 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.434 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.434 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.434 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-17T05:32:41.434 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-17T05:32:41.434 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.434 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.434 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.434 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.434 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.434 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.434 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.435 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.435 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.435 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.435 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.435 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_URL": { 2024-09-17T05:32:41.435 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_URL", 2024-09-17T05:32:41.435 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.435 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.435 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.435 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.435 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.435 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.436 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.436 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.436 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.436 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.436 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.436 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_USERNAME": { 2024-09-17T05:32:41.436 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-17T05:32:41.436 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.436 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.436 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.436 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-09-17T05:32:41.436 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.437 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.437 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.437 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.437 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.437 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.437 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.437 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.437 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-17T05:32:41.437 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-17T05:32:41.437 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.437 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.437 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.437 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.438 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.438 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.438 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.438 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.438 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.438 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.438 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.438 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-17T05:32:41.438 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-17T05:32:41.438 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.438 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.438 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.438 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.439 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.439 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.439 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.439 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.439 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.439 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.439 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.439 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.439 INFO:teuthology.orchestra.run.smithi031.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-17T05:32:41.439 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-17T05:32:41.439 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.439 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.439 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.440 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.440 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.440 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.440 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.440 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.440 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.440 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.440 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.440 INFO:teuthology.orchestra.run.smithi031.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-17T05:32:41.440 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-17T05:32:41.440 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.440 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.440 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.441 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.441 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.441 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.441 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.441 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.441 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.441 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.441 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.441 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.441 INFO:teuthology.orchestra.run.smithi031.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-17T05:32:41.441 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-17T05:32:41.441 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.441 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.441 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.442 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "[]", 2024-09-17T05:32:41.442 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.442 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.442 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.442 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.442 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.442 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.442 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.442 INFO:teuthology.orchestra.run.smithi031.stdout: "MULTICLUSTER_CONFIG": { 2024-09-17T05:32:41.442 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-17T05:32:41.442 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.442 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.443 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.443 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "{}", 2024-09-17T05:32:41.443 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.443 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.443 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.443 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.443 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.443 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.443 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.443 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.443 INFO:teuthology.orchestra.run.smithi031.stdout: "PROMETHEUS_API_HOST": { 2024-09-17T05:32:41.443 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-17T05:32:41.443 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.443 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.444 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.444 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.444 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.444 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.444 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.444 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.444 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.444 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.444 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.444 INFO:teuthology.orchestra.run.smithi031.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-17T05:32:41.444 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-17T05:32:41.444 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.444 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.445 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.445 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.445 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.445 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.445 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.445 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.445 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.445 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.445 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.445 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-17T05:32:41.445 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-17T05:32:41.445 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.446 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.446 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.446 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.446 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.446 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.446 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.446 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.446 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.446 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.446 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.446 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.446 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-17T05:32:41.446 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-17T05:32:41.446 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.446 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.447 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.447 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.447 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.447 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.447 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.447 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.447 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.447 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.447 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.447 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-17T05:32:41.447 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-17T05:32:41.447 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.447 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.448 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.448 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.448 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.448 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.448 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.448 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.448 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.448 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.448 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.448 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.448 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-17T05:32:41.449 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-17T05:32:41.449 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.449 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.449 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.449 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.449 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.449 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.449 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.449 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.449 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.449 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.449 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.449 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-17T05:32:41.450 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-17T05:32:41.450 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.450 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.450 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.450 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.450 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.450 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.450 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.450 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.450 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.450 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.450 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.450 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-17T05:32:41.451 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-17T05:32:41.451 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.451 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.451 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.451 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.451 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.451 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.451 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.451 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.451 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.451 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.451 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.451 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-17T05:32:41.452 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-17T05:32:41.452 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.452 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.452 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.452 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.452 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.452 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.452 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.452 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.452 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.452 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.452 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.453 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_ENABLED": { 2024-09-17T05:32:41.453 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-17T05:32:41.453 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.453 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.453 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.453 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.453 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.453 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.453 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.453 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.453 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.453 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.454 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.454 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-17T05:32:41.454 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-17T05:32:41.454 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.454 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.454 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.454 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-17T05:32:41.454 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.454 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.454 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.454 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.454 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.455 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.455 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.455 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-17T05:32:41.455 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-17T05:32:41.455 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.455 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.455 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.455 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-09-17T05:32:41.455 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.455 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.455 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.455 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.455 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.456 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.456 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.456 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-17T05:32:41.456 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-17T05:32:41.456 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.456 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.456 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.456 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8", 2024-09-17T05:32:41.456 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.456 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.456 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.456 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.456 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.457 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.457 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.457 INFO:teuthology.orchestra.run.smithi031.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-17T05:32:41.457 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-17T05:32:41.457 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.457 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.457 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.457 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "45", 2024-09-17T05:32:41.457 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.457 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.457 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.457 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.458 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.458 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.458 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.458 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_ACCESS_KEY": { 2024-09-17T05:32:41.458 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-17T05:32:41.458 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.458 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.458 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.458 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.458 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.458 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.458 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.458 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.459 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.459 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.459 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.459 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-17T05:32:41.459 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-17T05:32:41.459 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.459 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.459 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.459 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-09-17T05:32:41.459 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.459 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.459 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.459 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.460 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.460 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.460 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.460 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_SECRET_KEY": { 2024-09-17T05:32:41.460 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-17T05:32:41.460 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.460 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.460 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.460 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.460 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.460 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.460 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.460 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.461 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.461 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.461 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.461 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_SSL_VERIFY": { 2024-09-17T05:32:41.461 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-17T05:32:41.461 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.461 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.461 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.461 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.461 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.461 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.461 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.462 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.462 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.462 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.462 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.462 INFO:teuthology.orchestra.run.smithi031.stdout: "UNSAFE_TLS_v1_2": { 2024-09-17T05:32:41.462 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-17T05:32:41.462 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.462 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.462 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.462 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.462 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.463 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.463 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.463 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.463 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.463 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.463 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.463 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-17T05:32:41.463 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-17T05:32:41.463 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.463 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.463 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.463 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.464 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.464 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.464 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.464 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.464 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.464 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.464 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.464 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-17T05:32:41.464 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-17T05:32:41.464 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.464 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.464 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.464 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-09-17T05:32:41.464 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.465 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.465 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.465 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.465 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.465 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.465 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.465 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-17T05:32:41.465 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-17T05:32:41.465 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.465 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.465 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.466 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-09-17T05:32:41.466 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.466 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.466 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.466 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.466 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.466 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.466 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.466 INFO:teuthology.orchestra.run.smithi031.stdout: "cross_origin_url": { 2024-09-17T05:32:41.466 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cross_origin_url", 2024-09-17T05:32:41.466 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.466 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.466 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.467 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.467 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.467 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.467 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.467 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.467 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.467 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.467 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.467 INFO:teuthology.orchestra.run.smithi031.stdout: "crt_file": { 2024-09-17T05:32:41.467 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crt_file", 2024-09-17T05:32:41.467 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.467 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.468 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.468 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.468 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.468 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.468 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.468 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.468 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.468 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.468 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.468 INFO:teuthology.orchestra.run.smithi031.stdout: "debug": { 2024-09-17T05:32:41.468 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "debug", 2024-09-17T05:32:41.468 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.468 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable/disable debug options", 2024-09-17T05:32:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: "jwt_token_ttl": { 2024-09-17T05:32:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "jwt_token_ttl", 2024-09-17T05:32:41.469 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "28800", 2024-09-17T05:32:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: "key_file": { 2024-09-17T05:32:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "key_file", 2024-09-17T05:32:41.470 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.471 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.472 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.473 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.473 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.473 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.473 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.473 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.473 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.473 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.473 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.473 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.473 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.473 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.473 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.474 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.474 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.474 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.474 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.474 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.474 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.474 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.474 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.474 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.474 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.474 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.474 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.474 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.475 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.475 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.475 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.475 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.475 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.475 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.475 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.475 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.475 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.475 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.475 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.475 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.475 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.476 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.476 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.476 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.476 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.476 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.476 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.476 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.476 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.476 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.476 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.476 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.476 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.476 INFO:teuthology.orchestra.run.smithi031.stdout: "motd": { 2024-09-17T05:32:41.477 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "motd", 2024-09-17T05:32:41.477 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.477 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.477 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.477 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.477 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.477 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.477 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.477 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "The message of the day", 2024-09-17T05:32:41.477 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.477 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.477 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.477 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.478 INFO:teuthology.orchestra.run.smithi031.stdout: "redirect_resolve_ip_addr": { 2024-09-17T05:32:41.478 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "redirect_resolve_ip_addr", 2024-09-17T05:32:41.478 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.478 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.478 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.478 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.478 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.478 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.478 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.478 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.478 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.478 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.479 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.479 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-09-17T05:32:41.479 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-09-17T05:32:41.479 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.479 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.479 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.479 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "::", 2024-09-17T05:32:41.479 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.479 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.479 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.479 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.479 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.479 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.480 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.480 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-09-17T05:32:41.480 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-09-17T05:32:41.480 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.480 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.480 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.480 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8080", 2024-09-17T05:32:41.480 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.480 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.480 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.480 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.480 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.481 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.481 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.481 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.481 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.481 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.481 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.481 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.481 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.481 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.481 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.481 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.481 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.482 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.482 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.482 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.482 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.482 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl": { 2024-09-17T05:32:41.482 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl", 2024-09-17T05:32:41.482 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.482 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.482 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.482 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.482 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.482 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.482 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.482 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.482 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.483 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.483 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.483 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl_server_port": { 2024-09-17T05:32:41.483 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl_server_port", 2024-09-17T05:32:41.483 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.483 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.483 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.483 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8443", 2024-09-17T05:32:41.483 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.483 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.483 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.483 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.483 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.484 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.484 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.484 INFO:teuthology.orchestra.run.smithi031.stdout: "sso_oauth2": { 2024-09-17T05:32:41.484 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sso_oauth2", 2024-09-17T05:32:41.484 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.484 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.484 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.484 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.484 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.484 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.484 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.484 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.485 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.485 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.485 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.485 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_behaviour": { 2024-09-17T05:32:41.485 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_behaviour", 2024-09-17T05:32:41.485 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.485 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.485 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.485 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "redirect", 2024-09-17T05:32:41.485 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.485 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.486 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.486 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.486 INFO:teuthology.orchestra.run.smithi031.stdout: "redirect" 2024-09-17T05:32:41.486 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.486 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.486 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.486 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.486 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.486 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_error_status_code": { 2024-09-17T05:32:41.486 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_error_status_code", 2024-09-17T05:32:41.486 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.486 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.486 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.487 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "500", 2024-09-17T05:32:41.487 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "400", 2024-09-17T05:32:41.487 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "599", 2024-09-17T05:32:41.487 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.487 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.487 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.487 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.487 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.487 INFO:teuthology.orchestra.run.smithi031.stdout: "url_prefix": { 2024-09-17T05:32:41.487 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "url_prefix", 2024-09-17T05:32:41.487 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.487 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.487 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.487 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.488 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.488 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.488 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.488 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.488 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.488 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.488 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.488 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.488 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.488 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "devicehealth", 2024-09-17T05:32:41.488 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.489 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.489 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.489 INFO:teuthology.orchestra.run.smithi031.stdout: "enable_monitoring": { 2024-09-17T05:32:41.489 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enable_monitoring", 2024-09-17T05:32:41.489 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.489 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.489 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.489 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.489 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.489 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.489 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.489 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "monitor device health metrics", 2024-09-17T05:32:41.489 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.490 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.490 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.490 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.490 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.490 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.490 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.490 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.490 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.490 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.490 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.490 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.490 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.491 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.491 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.491 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.491 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.491 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.491 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.491 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.491 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.491 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.491 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.491 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.491 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.492 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.492 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.492 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.492 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.492 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.492 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.492 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.492 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.492 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.492 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.492 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.493 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.493 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.493 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.493 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.493 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.493 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.493 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.493 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.493 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.493 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.493 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.493 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.494 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.494 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.494 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.494 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.494 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.494 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.494 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.494 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.494 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.494 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.494 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.494 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.494 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.495 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.495 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.495 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.495 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.495 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.495 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.495 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.495 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.495 INFO:teuthology.orchestra.run.smithi031.stdout: "mark_out_threshold": { 2024-09-17T05:32:41.495 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mark_out_threshold", 2024-09-17T05:32:41.495 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.495 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.495 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.496 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "2419200", 2024-09-17T05:32:41.496 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.496 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.496 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.496 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-17T05:32:41.496 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.496 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.496 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.496 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": { 2024-09-17T05:32:41.496 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pool_name", 2024-09-17T05:32:41.496 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.496 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.496 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.497 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "device_health_metrics", 2024-09-17T05:32:41.497 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.497 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.497 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.497 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-17T05:32:41.497 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.497 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.497 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.497 INFO:teuthology.orchestra.run.smithi031.stdout: "retention_period": { 2024-09-17T05:32:41.497 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "retention_period", 2024-09-17T05:32:41.497 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.497 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.498 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.498 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15552000", 2024-09-17T05:32:41.498 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.498 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.498 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.498 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long to retain device health metrics", 2024-09-17T05:32:41.498 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.498 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.498 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.498 INFO:teuthology.orchestra.run.smithi031.stdout: "scrape_frequency": { 2024-09-17T05:32:41.498 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "scrape_frequency", 2024-09-17T05:32:41.498 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.498 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.499 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.499 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "86400", 2024-09-17T05:32:41.499 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.499 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.499 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.499 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-17T05:32:41.499 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.499 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.499 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.499 INFO:teuthology.orchestra.run.smithi031.stdout: "self_heal": { 2024-09-17T05:32:41.499 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "self_heal", 2024-09-17T05:32:41.499 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.500 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.500 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.500 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.500 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.500 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.500 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.500 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-17T05:32:41.500 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.500 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.500 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.500 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-09-17T05:32:41.501 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-09-17T05:32:41.501 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.501 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.501 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.501 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-09-17T05:32:41.501 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.501 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.501 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.501 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to wake up and check device health", 2024-09-17T05:32:41.501 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.501 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.501 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.502 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.502 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.502 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.502 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.502 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.502 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.502 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.502 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.502 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.502 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.502 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.502 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.503 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.503 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_threshold": { 2024-09-17T05:32:41.503 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_threshold", 2024-09-17T05:32:41.503 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.503 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.503 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.503 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "7257600", 2024-09-17T05:32:41.503 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.503 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.503 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.503 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-17T05:32:41.503 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.503 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.504 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.504 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.504 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.504 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "diskprediction_local", 2024-09-17T05:32:41.504 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.504 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.504 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.504 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.504 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.504 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.504 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.505 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.505 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.505 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.505 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.505 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.505 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.505 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.505 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.505 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.505 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.505 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.505 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.505 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.506 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.506 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.506 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.506 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.506 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.506 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.506 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.506 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.506 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.506 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.506 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.506 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.507 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.507 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.507 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.507 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.507 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.507 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.507 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.507 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.507 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.507 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.507 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.507 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.508 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.508 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.508 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.508 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.508 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.508 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.508 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.508 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.508 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.508 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.508 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.508 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.509 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.509 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.509 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.509 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.509 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.509 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.509 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.509 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.509 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.509 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.509 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.509 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.510 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.510 INFO:teuthology.orchestra.run.smithi031.stdout: "predict_interval": { 2024-09-17T05:32:41.510 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "predict_interval", 2024-09-17T05:32:41.510 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.510 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.510 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.510 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "86400", 2024-09-17T05:32:41.510 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.510 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.510 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.510 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.510 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.511 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.511 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.511 INFO:teuthology.orchestra.run.smithi031.stdout: "predictor_model": { 2024-09-17T05:32:41.511 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "predictor_model", 2024-09-17T05:32:41.511 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.511 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.511 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.511 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "prophetstor", 2024-09-17T05:32:41.511 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.511 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.511 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.511 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.512 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.512 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.512 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.512 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-09-17T05:32:41.512 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-09-17T05:32:41.512 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.512 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.512 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.512 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-09-17T05:32:41.512 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.512 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.512 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.513 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.513 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.513 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.513 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.513 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.513 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.513 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.513 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.513 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.513 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.513 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.513 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.514 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.514 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.514 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.514 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.514 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.514 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.514 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.514 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "influx", 2024-09-17T05:32:41.514 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": false, 2024-09-17T05:32:41.514 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "influxdb python module not found", 2024-09-17T05:32:41.514 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.514 INFO:teuthology.orchestra.run.smithi031.stdout: "batch_size": { 2024-09-17T05:32:41.515 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "batch_size", 2024-09-17T05:32:41.515 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.515 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.515 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.515 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5000", 2024-09-17T05:32:41.515 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.515 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.515 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.515 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-17T05:32:41.515 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.515 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.515 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.515 INFO:teuthology.orchestra.run.smithi031.stdout: "database": { 2024-09-17T05:32:41.515 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "database", 2024-09-17T05:32:41.516 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.516 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.516 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.516 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "ceph", 2024-09-17T05:32:41.516 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.516 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.516 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.516 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-17T05:32:41.516 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.516 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.516 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.516 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": { 2024-09-17T05:32:41.516 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "hostname", 2024-09-17T05:32:41.517 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.517 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.517 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.517 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.517 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.517 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.517 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.517 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB server hostname", 2024-09-17T05:32:41.517 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.517 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.517 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.517 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-09-17T05:32:41.517 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-09-17T05:32:41.517 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.518 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.518 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.518 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "30", 2024-09-17T05:32:41.518 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "5", 2024-09-17T05:32:41.518 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.518 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.518 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-17T05:32:41.518 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.518 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.518 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.518 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.518 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.518 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.519 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.519 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.519 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.519 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.519 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.519 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.519 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.519 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.519 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.519 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.519 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.519 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.519 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.519 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.519 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.520 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.520 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.520 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.520 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.520 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.520 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.520 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.520 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.520 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.520 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.520 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.521 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.521 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.521 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.521 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.521 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.521 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.521 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.521 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.521 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.521 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.521 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.521 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.522 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.522 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.522 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.522 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.522 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.522 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.522 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.522 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.522 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.522 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.522 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.522 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.523 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.523 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.523 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.523 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.523 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.523 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.523 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.523 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.523 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.523 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.523 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.523 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.523 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.524 INFO:teuthology.orchestra.run.smithi031.stdout: "password": { 2024-09-17T05:32:41.524 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "password", 2024-09-17T05:32:41.524 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.524 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.524 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.524 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.524 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.524 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.524 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.524 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "password of InfluxDB server user", 2024-09-17T05:32:41.524 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.524 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.525 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.525 INFO:teuthology.orchestra.run.smithi031.stdout: "port": { 2024-09-17T05:32:41.525 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "port", 2024-09-17T05:32:41.525 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.525 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.525 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.525 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8086", 2024-09-17T05:32:41.525 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.525 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.525 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.525 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB server port", 2024-09-17T05:32:41.525 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.525 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.526 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.526 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.526 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.526 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.526 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.526 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.526 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.526 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.526 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.526 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.527 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.527 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.527 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.527 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.527 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl": { 2024-09-17T05:32:41.527 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl", 2024-09-17T05:32:41.527 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.527 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.527 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.527 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "false", 2024-09-17T05:32:41.527 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.527 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.528 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.528 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-17T05:32:41.528 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.528 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.528 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.528 INFO:teuthology.orchestra.run.smithi031.stdout: "threads": { 2024-09-17T05:32:41.528 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "threads", 2024-09-17T05:32:41.528 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.528 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.528 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.528 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-09-17T05:32:41.529 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-09-17T05:32:41.529 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "32", 2024-09-17T05:32:41.529 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.529 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-17T05:32:41.529 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.529 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.529 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.529 INFO:teuthology.orchestra.run.smithi031.stdout: "username": { 2024-09-17T05:32:41.529 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "username", 2024-09-17T05:32:41.529 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.529 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.530 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.530 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.530 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.530 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.530 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.530 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "username of InfluxDB server user", 2024-09-17T05:32:41.530 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.530 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.530 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.530 INFO:teuthology.orchestra.run.smithi031.stdout: "verify_ssl": { 2024-09-17T05:32:41.530 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "verify_ssl", 2024-09-17T05:32:41.530 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.530 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.531 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.531 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "true", 2024-09-17T05:32:41.531 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.531 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.531 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.531 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-17T05:32:41.531 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.531 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.531 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.531 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.531 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.532 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "insights", 2024-09-17T05:32:41.532 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.532 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.532 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.532 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.532 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.532 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.532 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.532 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.532 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.532 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.532 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.532 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.533 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.533 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.533 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.533 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.533 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.533 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.533 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.533 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.533 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.533 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.533 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.533 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.534 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.534 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.534 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.534 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.534 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.534 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.534 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.534 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.534 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.534 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.534 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.534 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.535 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.535 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.535 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.535 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.535 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.535 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.535 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.535 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.535 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.535 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.535 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.535 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.535 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.536 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.536 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.536 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.536 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.536 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.536 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.536 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.536 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.536 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.536 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.536 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.536 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.537 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.537 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.537 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.537 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.537 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.537 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.537 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.537 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.537 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.537 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.537 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.537 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.538 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.538 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.538 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.538 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.538 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.538 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.538 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.538 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.538 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.538 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.538 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.539 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "iostat", 2024-09-17T05:32:41.539 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.539 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.539 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.539 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.539 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.539 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.539 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.539 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.539 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.539 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.539 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.540 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.540 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.540 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.540 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.540 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.540 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.540 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.540 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.540 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.540 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.540 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.540 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.540 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.541 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.541 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.541 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.541 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.541 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.541 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.541 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.541 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.541 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.541 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.541 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.541 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.542 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.542 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.542 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.542 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.542 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.542 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.542 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.542 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.542 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.542 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.542 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.542 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.542 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.542 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.543 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.543 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.543 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.543 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.543 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.543 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.543 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.543 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.543 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.543 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.543 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.543 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.543 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.544 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.544 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.544 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.544 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.544 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.544 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.544 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.544 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.544 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.544 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.544 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.544 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.544 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.545 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.545 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.545 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.545 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.545 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.545 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.545 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.545 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.545 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "localpool", 2024-09-17T05:32:41.545 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.545 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.545 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.546 INFO:teuthology.orchestra.run.smithi031.stdout: "failure_domain": { 2024-09-17T05:32:41.546 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "failure_domain", 2024-09-17T05:32:41.546 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.546 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.546 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.546 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "host", 2024-09-17T05:32:41.546 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.546 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.546 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.546 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "failure domain for any created local pool", 2024-09-17T05:32:41.546 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-17T05:32:41.546 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.546 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.547 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.547 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.547 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.547 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.547 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.547 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.547 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.547 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.547 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.547 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.547 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.547 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.547 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.547 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.548 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.548 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.548 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.548 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.548 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.548 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.548 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.548 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.548 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.549 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.549 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.549 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.549 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.549 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.549 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.549 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.549 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.549 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.549 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.549 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.549 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.549 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.550 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.550 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.550 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.550 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.550 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.550 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.550 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.550 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.550 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.550 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.550 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.550 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.551 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.551 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.551 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.551 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.551 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.551 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.551 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.551 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.551 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.551 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.551 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.551 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.552 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.552 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.552 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.552 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.552 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.552 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.552 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": { 2024-09-17T05:32:41.552 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "min_size", 2024-09-17T05:32:41.552 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.552 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.552 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.552 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.552 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.553 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.553 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.553 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default min_size for any created local pool", 2024-09-17T05:32:41.553 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-17T05:32:41.553 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.553 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.553 INFO:teuthology.orchestra.run.smithi031.stdout: "num_rep": { 2024-09-17T05:32:41.553 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "num_rep", 2024-09-17T05:32:41.553 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.553 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.553 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.553 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3", 2024-09-17T05:32:41.554 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.554 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.554 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.554 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default replica count for any created local pool", 2024-09-17T05:32:41.554 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.554 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.554 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.554 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": { 2024-09-17T05:32:41.554 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pg_num", 2024-09-17T05:32:41.554 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.554 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.554 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.555 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "128", 2024-09-17T05:32:41.555 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.555 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.555 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.555 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default pg_num for any created local pool", 2024-09-17T05:32:41.555 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.555 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.555 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.555 INFO:teuthology.orchestra.run.smithi031.stdout: "prefix": { 2024-09-17T05:32:41.555 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prefix", 2024-09-17T05:32:41.555 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.556 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.556 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.556 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.556 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.556 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.556 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.556 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "name prefix for any created local pool", 2024-09-17T05:32:41.556 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.556 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.556 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.556 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.556 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.557 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.557 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.557 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.557 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.557 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.557 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.557 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.557 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.557 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.557 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.557 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.557 INFO:teuthology.orchestra.run.smithi031.stdout: "subtree": { 2024-09-17T05:32:41.558 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "subtree", 2024-09-17T05:32:41.558 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.558 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.558 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.558 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "rack", 2024-09-17T05:32:41.558 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.558 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.558 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.558 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-17T05:32:41.558 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-17T05:32:41.558 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.558 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.558 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.559 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.559 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mirroring", 2024-09-17T05:32:41.559 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.559 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.559 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.559 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.559 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.559 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.559 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.559 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.559 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.560 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.560 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.560 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.560 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.560 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.560 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.560 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.560 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.560 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.560 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.560 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.560 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.560 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.561 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.561 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.561 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.561 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.561 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.561 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.561 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.561 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.561 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.561 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.561 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.561 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.562 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.562 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.562 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.562 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.562 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.562 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.562 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.562 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.562 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.562 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.562 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.562 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.562 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.563 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.563 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.563 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.563 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.563 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.563 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.563 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.563 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.563 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.563 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.563 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.563 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.564 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.564 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.564 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.564 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.564 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.564 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.564 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.564 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.564 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.564 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.564 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.564 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.565 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.565 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.565 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.565 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.565 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.565 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.565 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.565 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.565 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.565 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.565 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.565 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.565 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.566 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "nfs", 2024-09-17T05:32:41.566 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.566 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.566 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.566 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.566 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.566 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.566 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.566 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.566 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.566 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.567 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.567 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.567 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.567 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.567 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.567 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.567 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.567 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.567 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.567 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.567 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.567 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.567 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.568 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.568 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.568 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.568 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.568 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.568 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.568 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.568 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.568 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.568 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.568 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.568 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.568 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.569 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.569 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.569 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.569 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.569 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.569 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.569 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.569 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.569 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.569 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.569 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.570 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.570 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.570 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.570 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.570 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.570 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.570 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.570 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.570 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.570 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.570 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.571 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.571 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.571 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.571 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.571 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.571 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.571 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.571 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.571 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.571 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.571 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.571 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.571 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.572 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.572 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.572 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.572 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.572 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.572 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.572 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.572 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.572 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.572 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.572 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.572 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.573 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.573 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "orchestrator", 2024-09-17T05:32:41.573 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.573 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.573 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.573 INFO:teuthology.orchestra.run.smithi031.stdout: "fail_fs": { 2024-09-17T05:32:41.573 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "fail_fs", 2024-09-17T05:32:41.573 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.573 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.573 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.573 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.574 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.574 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.574 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.574 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-17T05:32:41.574 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.574 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.574 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.574 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.574 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.574 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.574 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.574 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.574 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.575 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.575 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.575 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.575 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.575 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.575 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.575 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.575 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.575 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.575 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.575 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.575 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.575 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.576 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.576 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.576 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.576 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.576 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.576 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.576 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.576 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.576 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.576 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.576 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.576 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.576 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.577 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.577 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.577 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.577 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.577 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.577 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.577 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.577 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.577 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.577 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.577 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.577 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.578 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.578 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.578 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.578 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.578 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.578 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.578 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.578 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.578 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.578 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.578 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.578 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.579 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.579 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.579 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.579 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.579 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.579 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.579 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.579 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.579 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.579 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.579 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator": { 2024-09-17T05:32:41.579 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "orchestrator", 2024-09-17T05:32:41.580 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.580 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.580 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.580 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.580 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.580 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.580 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.580 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm", 2024-09-17T05:32:41.580 INFO:teuthology.orchestra.run.smithi031.stdout: "rook", 2024-09-17T05:32:41.580 INFO:teuthology.orchestra.run.smithi031.stdout: "test_orchestrator" 2024-09-17T05:32:41.580 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.580 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Orchestrator backend", 2024-09-17T05:32:41.580 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.580 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.581 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.581 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.581 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.581 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.581 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.581 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.581 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.581 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.581 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.581 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.581 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.581 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.581 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.582 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.582 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.582 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.582 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "osd_perf_query", 2024-09-17T05:32:41.582 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.582 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.582 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.582 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.582 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.582 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.582 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.582 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.583 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.583 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.583 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.583 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.583 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.583 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.583 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.583 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.583 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.583 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.583 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.583 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.583 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.583 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.584 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.584 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.584 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.584 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.584 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.584 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.584 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.584 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.584 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.584 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.584 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.584 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.585 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.585 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.585 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.585 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.585 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.585 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.585 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.585 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.585 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.585 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.585 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.586 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.586 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.586 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.586 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.586 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.586 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.586 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.586 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.586 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.586 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.586 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.586 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.587 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.587 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.587 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.587 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.587 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.587 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.587 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.587 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.587 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.587 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.587 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.587 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.587 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.588 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.588 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.588 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.588 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.588 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.588 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.588 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.588 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.588 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.588 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.588 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.588 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.588 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.588 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.589 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "osd_support", 2024-09-17T05:32:41.589 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.589 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.589 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.589 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.589 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.589 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.589 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.589 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.589 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.590 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.590 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.590 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.590 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.590 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.590 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.590 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.590 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.590 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.590 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.590 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.590 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.590 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.590 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.591 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.591 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.591 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.591 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.591 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.591 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.591 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.591 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.591 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.591 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.591 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.591 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.591 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.592 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.592 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.592 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.592 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.592 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.592 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.592 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.592 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.592 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.592 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.592 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.593 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.593 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.593 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.593 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.593 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.593 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.593 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.593 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.593 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.593 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.593 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.593 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.594 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.594 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.594 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.594 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.594 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.594 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.594 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.594 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.594 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.594 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.594 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.594 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.595 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.595 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.595 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.595 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.595 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.595 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.595 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.595 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.595 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.595 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.595 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.595 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.595 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.596 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pg_autoscaler", 2024-09-17T05:32:41.596 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.596 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.596 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.596 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.596 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.596 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.596 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.596 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.596 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.597 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.597 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.597 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.597 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.597 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.597 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.597 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.597 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.597 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.597 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.597 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.597 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.597 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.598 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.598 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.598 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.598 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.598 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.598 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.598 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.598 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.598 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.598 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.598 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.598 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.599 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.599 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.599 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.599 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.599 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.599 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.599 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.599 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.599 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.599 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.599 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.599 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.600 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.600 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.600 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.600 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.600 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.600 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.600 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.600 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.600 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.600 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.600 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.601 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.601 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.601 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.601 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.601 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.601 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.601 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.601 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.601 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.601 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.601 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.601 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.602 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-09-17T05:32:41.602 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-09-17T05:32:41.602 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.602 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.602 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.602 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-09-17T05:32:41.602 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.602 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.602 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.602 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.602 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.602 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.603 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.603 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.603 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.603 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.603 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.603 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.603 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.603 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.603 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.603 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.603 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.603 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.604 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.604 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.604 INFO:teuthology.orchestra.run.smithi031.stdout: "threshold": { 2024-09-17T05:32:41.604 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "threshold", 2024-09-17T05:32:41.604 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-09-17T05:32:41.604 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.604 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.604 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3.0", 2024-09-17T05:32:41.604 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1.0", 2024-09-17T05:32:41.604 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.604 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.604 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "scaling threshold", 2024-09-17T05:32:41.605 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-17T05:32:41.605 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.605 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.605 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.605 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.605 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.605 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "progress", 2024-09-17T05:32:41.605 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.605 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.605 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.605 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_pg_recovery_event": { 2024-09-17T05:32:41.605 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_pg_recovery_event", 2024-09-17T05:32:41.606 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.606 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.606 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.606 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.606 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.606 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.606 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.606 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-17T05:32:41.606 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.606 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.606 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.606 INFO:teuthology.orchestra.run.smithi031.stdout: "enabled": { 2024-09-17T05:32:41.607 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enabled", 2024-09-17T05:32:41.607 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.607 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.607 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.607 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.607 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.607 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.607 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.607 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.607 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.607 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.607 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.607 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.607 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.608 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.608 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.608 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.608 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.608 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.608 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.608 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.608 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.608 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.608 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.608 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.608 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.608 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.609 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.609 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.609 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.609 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.609 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.609 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.609 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.609 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.609 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.609 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.609 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.609 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.610 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.610 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.610 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.610 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.610 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.610 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.610 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.610 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.610 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.610 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.610 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.610 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.610 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.611 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.611 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.611 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.611 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.611 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.611 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.611 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.611 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.611 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.611 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.611 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.611 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.612 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.612 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.612 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.612 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.612 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.612 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.612 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.612 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.612 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.612 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.612 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.612 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.613 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.613 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.613 INFO:teuthology.orchestra.run.smithi031.stdout: "max_completed_events": { 2024-09-17T05:32:41.613 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_completed_events", 2024-09-17T05:32:41.613 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.613 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.613 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.613 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "50", 2024-09-17T05:32:41.613 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.613 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.613 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.613 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "number of past completed events to remember", 2024-09-17T05:32:41.613 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.614 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.614 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.614 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-09-17T05:32:41.614 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-09-17T05:32:41.614 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.614 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.614 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.614 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-09-17T05:32:41.614 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.614 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.614 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.614 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long the module is going to sleep", 2024-09-17T05:32:41.614 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.615 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.615 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.615 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.615 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.615 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.615 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.615 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.615 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.615 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.615 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.615 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.615 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.616 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.616 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.616 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.616 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.616 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.616 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prometheus", 2024-09-17T05:32:41.616 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.616 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.616 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.616 INFO:teuthology.orchestra.run.smithi031.stdout: "cache": { 2024-09-17T05:32:41.616 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cache", 2024-09-17T05:32:41.617 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.617 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.617 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.617 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.617 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.617 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.617 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.617 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.617 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.617 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.617 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.618 INFO:teuthology.orchestra.run.smithi031.stdout: "exclude_perf_counters": { 2024-09-17T05:32:41.618 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "exclude_perf_counters", 2024-09-17T05:32:41.618 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.618 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.618 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.618 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.618 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.618 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.618 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.618 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-17T05:32:41.618 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-17T05:32:41.618 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.619 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.619 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.619 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.619 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.619 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.619 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.619 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.619 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.619 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.619 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.619 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.619 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.620 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.620 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.620 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.620 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.620 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.620 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.620 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.620 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.620 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.620 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.620 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.620 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.620 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.621 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.621 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.621 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.621 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.621 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.621 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.621 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.621 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.621 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.621 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.621 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.621 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.622 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.622 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.622 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.622 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.622 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.622 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.622 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.622 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.622 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.622 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.622 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.622 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.622 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.622 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.622 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.623 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.623 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.623 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.623 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.623 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.623 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.623 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.623 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.623 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.623 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.623 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.623 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.623 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.624 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.624 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.624 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_stats_pools": { 2024-09-17T05:32:41.624 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_stats_pools", 2024-09-17T05:32:41.624 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.624 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.624 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.624 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.624 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.624 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.624 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.624 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.625 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.625 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.625 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.625 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-17T05:32:41.625 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-17T05:32:41.625 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.625 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.625 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.625 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "300", 2024-09-17T05:32:41.625 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.625 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.625 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.626 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.626 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.626 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.626 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.626 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.626 INFO:teuthology.orchestra.run.smithi031.stdout: "scrape_interval": { 2024-09-17T05:32:41.626 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "scrape_interval", 2024-09-17T05:32:41.626 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-09-17T05:32:41.626 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.626 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.626 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15.0", 2024-09-17T05:32:41.626 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.626 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.626 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.627 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.627 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.627 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.627 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.627 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-09-17T05:32:41.627 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-09-17T05:32:41.627 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.627 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.627 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.627 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "::", 2024-09-17T05:32:41.627 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.627 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.628 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.628 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-17T05:32:41.628 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.628 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.628 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.628 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-09-17T05:32:41.628 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-09-17T05:32:41.628 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.628 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.629 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.629 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "9283", 2024-09-17T05:32:41.629 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.629 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.629 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.629 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-17T05:32:41.629 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.629 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.629 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.629 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.629 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.630 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.630 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.630 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.630 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.630 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.630 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.630 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.630 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.630 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.630 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.630 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.630 INFO:teuthology.orchestra.run.smithi031.stdout: "stale_cache_strategy": { 2024-09-17T05:32:41.630 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "stale_cache_strategy", 2024-09-17T05:32:41.631 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.631 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.631 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.631 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "log", 2024-09-17T05:32:41.631 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.631 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.631 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.631 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.631 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.631 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.631 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.631 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_behaviour": { 2024-09-17T05:32:41.632 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_behaviour", 2024-09-17T05:32:41.632 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.632 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.632 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.632 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "default", 2024-09-17T05:32:41.632 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.632 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.632 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.632 INFO:teuthology.orchestra.run.smithi031.stdout: "default", 2024-09-17T05:32:41.632 INFO:teuthology.orchestra.run.smithi031.stdout: "error" 2024-09-17T05:32:41.632 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.632 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.632 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.633 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.633 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.633 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_error_status_code": { 2024-09-17T05:32:41.633 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_error_status_code", 2024-09-17T05:32:41.633 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.633 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.633 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.633 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "500", 2024-09-17T05:32:41.633 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "400", 2024-09-17T05:32:41.633 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "599", 2024-09-17T05:32:41.633 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.633 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.634 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.634 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.634 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.634 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.634 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.634 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_support", 2024-09-17T05:32:41.634 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.634 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.634 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.634 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.635 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.635 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.635 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.635 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.635 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.635 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.635 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.635 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.635 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.635 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.635 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.635 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.635 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.636 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.636 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.636 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.636 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.636 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.636 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.636 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.636 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.636 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.636 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.636 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.637 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.637 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.637 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.637 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.637 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.637 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.637 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.637 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.637 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.637 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.637 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.638 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.638 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.638 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.638 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.638 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.638 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.638 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.638 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.638 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.638 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.638 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.638 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.638 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.639 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.639 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.639 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.639 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.639 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.639 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.639 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.639 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.639 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.639 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.639 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.639 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.640 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.640 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.640 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.640 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.640 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.640 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.640 INFO:teuthology.orchestra.run.smithi031.stdout: "max_concurrent_snap_create": { 2024-09-17T05:32:41.640 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_concurrent_snap_create", 2024-09-17T05:32:41.640 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.640 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.640 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.640 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-09-17T05:32:41.641 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.641 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.641 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.641 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.641 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.641 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.641 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.641 INFO:teuthology.orchestra.run.smithi031.stdout: "mirror_snapshot_schedule": { 2024-09-17T05:32:41.641 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mirror_snapshot_schedule", 2024-09-17T05:32:41.641 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.641 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.641 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.641 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.642 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.642 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.642 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.642 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.642 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.642 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.642 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.642 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.642 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.642 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.642 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.643 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.643 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.643 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.643 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.643 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.643 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.643 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.643 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.643 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.643 INFO:teuthology.orchestra.run.smithi031.stdout: "trash_purge_schedule": { 2024-09-17T05:32:41.643 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "trash_purge_schedule", 2024-09-17T05:32:41.644 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.644 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.644 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.644 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.644 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.644 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.644 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.644 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.644 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.644 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.644 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.644 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.644 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.645 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "restful", 2024-09-17T05:32:41.645 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.645 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.645 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.645 INFO:teuthology.orchestra.run.smithi031.stdout: "enable_auth": { 2024-09-17T05:32:41.645 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enable_auth", 2024-09-17T05:32:41.645 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.645 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.645 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.645 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.646 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.646 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.646 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.646 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.646 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.646 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.646 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.646 INFO:teuthology.orchestra.run.smithi031.stdout: "key_file": { 2024-09-17T05:32:41.646 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "key_file", 2024-09-17T05:32:41.646 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.647 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.647 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.647 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.647 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.647 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.647 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.647 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.647 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.647 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.647 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.647 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.647 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.647 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.648 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.648 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.648 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.648 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.648 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.648 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.648 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.648 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.648 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.648 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.648 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.648 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.649 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.649 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.649 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.649 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.649 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.649 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.649 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.649 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.649 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.649 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.649 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.649 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.650 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.650 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.650 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.650 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.650 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.650 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.650 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.650 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.650 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.650 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.650 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.651 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.651 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.651 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.651 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.651 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.651 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.651 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.651 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.651 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.651 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.651 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.651 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.651 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.652 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.652 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.652 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.652 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.652 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.652 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.652 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.652 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.652 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.652 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.652 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.653 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.653 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.653 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.653 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.653 INFO:teuthology.orchestra.run.smithi031.stdout: "max_requests": { 2024-09-17T05:32:41.653 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_requests", 2024-09-17T05:32:41.653 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.653 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.653 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.653 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "500", 2024-09-17T05:32:41.653 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.653 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.654 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.654 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-17T05:32:41.654 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.654 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.654 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.654 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-09-17T05:32:41.654 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-09-17T05:32:41.654 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.654 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.654 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.654 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.655 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.655 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.655 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.655 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.655 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.655 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.655 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.655 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-09-17T05:32:41.655 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-09-17T05:32:41.655 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.655 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.655 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.656 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.656 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.656 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.656 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.656 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.656 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.656 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.656 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.656 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.656 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.656 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.656 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.657 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.657 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.657 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.657 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.657 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.657 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.657 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.657 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.657 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.657 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.657 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.658 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rgw", 2024-09-17T05:32:41.658 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.658 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.658 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.658 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.658 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.658 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.658 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.658 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.658 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.658 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.658 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.659 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.659 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.659 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.659 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.659 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.659 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.659 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.659 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.659 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.659 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.659 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.659 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.660 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.660 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.660 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.660 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.660 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.660 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.660 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.660 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.660 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.660 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.660 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.660 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.661 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.661 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.661 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.661 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.661 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.661 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.661 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.661 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.661 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.661 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.661 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.661 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.662 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.662 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.662 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.662 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.662 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.662 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.662 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.662 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.662 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.662 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.662 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.662 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "secondary_zone_period_retry_limit": { 2024-09-17T05:32:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-17T05:32:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.664 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.664 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.664 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-09-17T05:32:41.664 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.664 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.664 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.664 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-17T05:32:41.664 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.664 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.664 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.664 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.664 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.665 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.665 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.665 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.665 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.665 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.665 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.665 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.665 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.665 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.665 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.665 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.665 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.665 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.666 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "selftest", 2024-09-17T05:32:41.666 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.666 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.666 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.666 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.666 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.666 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.666 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.666 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.666 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.666 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.667 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.667 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.667 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.667 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.667 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.667 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.667 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.667 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.667 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.667 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.667 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.667 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.667 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.668 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.668 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.668 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.668 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.668 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.668 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.668 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.668 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.668 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.668 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.668 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.668 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.669 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.669 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.669 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.669 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.669 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.669 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.669 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.669 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.669 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.669 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.669 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.669 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.670 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.670 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.670 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.670 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.670 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.670 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.670 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.670 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.670 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.670 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.670 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.670 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.670 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.671 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.671 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.671 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.671 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.671 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.671 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.671 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.671 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.671 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.671 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.671 INFO:teuthology.orchestra.run.smithi031.stdout: "roption1": { 2024-09-17T05:32:41.671 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "roption1", 2024-09-17T05:32:41.671 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.672 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.672 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.672 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.672 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.672 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.672 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.672 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.672 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.672 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.672 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.672 INFO:teuthology.orchestra.run.smithi031.stdout: "roption2": { 2024-09-17T05:32:41.672 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "roption2", 2024-09-17T05:32:41.673 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.673 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.673 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.673 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "xyz", 2024-09-17T05:32:41.673 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.673 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.673 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.673 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.673 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.673 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.673 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.674 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption1": { 2024-09-17T05:32:41.674 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption1", 2024-09-17T05:32:41.674 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.674 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.674 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.674 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.674 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.674 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.674 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.674 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.674 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.674 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.674 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.675 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption2": { 2024-09-17T05:32:41.675 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption2", 2024-09-17T05:32:41.675 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.675 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.675 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.675 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.675 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.675 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.675 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.675 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.675 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.675 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.675 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.676 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.676 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption3": { 2024-09-17T05:32:41.676 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption3", 2024-09-17T05:32:41.676 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-09-17T05:32:41.676 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.676 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.676 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.676 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.676 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.676 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.676 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.676 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.677 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.677 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.677 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption4": { 2024-09-17T05:32:41.677 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption4", 2024-09-17T05:32:41.677 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.677 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.677 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.677 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.677 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.677 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.677 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.677 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.678 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.678 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.678 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.678 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption5": { 2024-09-17T05:32:41.678 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption5", 2024-09-17T05:32:41.678 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.678 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.678 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.678 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.678 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.678 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.678 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.678 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.679 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.679 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.679 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.679 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption6": { 2024-09-17T05:32:41.679 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption6", 2024-09-17T05:32:41.679 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.679 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.679 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.679 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.679 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.679 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.679 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.680 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.680 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.680 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.680 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.680 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption7": { 2024-09-17T05:32:41.680 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption7", 2024-09-17T05:32:41.680 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.680 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.680 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.680 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.680 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-09-17T05:32:41.680 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "42", 2024-09-17T05:32:41.681 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.681 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.681 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.681 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.681 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.681 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.681 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.681 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.681 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.681 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.681 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.682 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.682 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.682 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.682 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.682 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.682 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.682 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.682 INFO:teuthology.orchestra.run.smithi031.stdout: "testkey": { 2024-09-17T05:32:41.682 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testkey", 2024-09-17T05:32:41.682 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.682 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.682 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.683 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.683 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.683 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.683 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.683 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.683 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.683 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.683 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.683 INFO:teuthology.orchestra.run.smithi031.stdout: "testlkey": { 2024-09-17T05:32:41.683 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testlkey", 2024-09-17T05:32:41.683 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.683 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: "testnewline": { 2024-09-17T05:32:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testnewline", 2024-09-17T05:32:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snap_schedule", 2024-09-17T05:32:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_m_granularity": { 2024-09-17T05:32:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_m_granularity", 2024-09-17T05:32:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow minute scheduled snapshots", 2024-09-17T05:32:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "dump_on_update": { 2024-09-17T05:32:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "dump_on_update", 2024-09-17T05:32:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "dump database to debug log on update", 2024-09-17T05:32:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.692 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.692 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.692 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.692 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.692 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.692 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.692 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.692 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.692 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.692 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.692 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.692 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.692 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "stats", 2024-09-17T05:32:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.701 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.701 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.701 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.701 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.701 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.701 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.701 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.701 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.701 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.701 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.701 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.701 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.702 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.702 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "status", 2024-09-17T05:32:41.702 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.702 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.702 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.702 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.702 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.702 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.702 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.702 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.702 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.702 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.702 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.703 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.703 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.703 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.703 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.703 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.703 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.703 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.703 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.703 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.703 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.703 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.703 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.704 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.704 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.704 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.704 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.704 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.704 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.704 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.704 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.704 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.704 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.704 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.704 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.704 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.705 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.705 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.705 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.705 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.705 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.705 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.705 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.705 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.705 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.705 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.705 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.706 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.706 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.706 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.706 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.706 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.706 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.706 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.706 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.706 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.706 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.706 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.706 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.706 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.706 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.707 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.707 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.707 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.707 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.707 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.707 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.707 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.707 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.707 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.707 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.707 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.707 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.707 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.707 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.708 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.708 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.708 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.708 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.708 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.708 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.708 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.708 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.708 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.708 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.708 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.708 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.709 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "telegraf", 2024-09-17T05:32:41.709 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.709 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.709 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.709 INFO:teuthology.orchestra.run.smithi031.stdout: "address": { 2024-09-17T05:32:41.709 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "address", 2024-09-17T05:32:41.709 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.709 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.709 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.709 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-17T05:32:41.709 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.709 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.709 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.710 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.710 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.710 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.710 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.710 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.710 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-09-17T05:32:41.710 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-09-17T05:32:41.710 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.710 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.710 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.710 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15", 2024-09-17T05:32:41.710 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.710 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.711 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.711 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.711 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.711 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.711 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.711 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.711 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.711 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.711 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.711 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.711 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.712 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.712 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.712 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.712 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.712 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.712 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.712 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.712 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.712 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.712 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.712 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.712 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.712 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.713 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.713 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.713 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.713 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.713 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.713 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.713 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.713 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.713 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.713 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.713 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.713 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.714 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.714 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.714 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.714 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.714 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.714 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.714 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.714 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.714 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.714 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.714 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.714 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.715 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.715 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.715 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.715 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.715 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.715 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.715 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.715 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.715 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.715 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.715 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.715 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.716 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.716 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.716 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.716 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.716 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.716 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.716 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.716 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.716 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.716 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.716 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.717 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.717 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.717 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.717 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.717 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.717 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.717 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.717 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.717 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.717 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.717 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.717 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.717 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.718 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.718 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.718 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "telemetry", 2024-09-17T05:32:41.718 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.718 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.718 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.718 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_basic": { 2024-09-17T05:32:41.718 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_basic", 2024-09-17T05:32:41.718 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.718 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.718 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.718 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.719 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.719 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.719 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.719 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-17T05:32:41.719 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.719 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.719 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.719 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_crash": { 2024-09-17T05:32:41.719 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_crash", 2024-09-17T05:32:41.719 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.719 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.719 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.719 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.720 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.720 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.720 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.720 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-17T05:32:41.720 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.720 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.720 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.720 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.720 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_device": { 2024-09-17T05:32:41.720 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_device", 2024-09-17T05:32:41.720 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.720 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.720 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.721 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.721 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.721 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.721 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.721 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-17T05:32:41.721 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.721 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.721 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.721 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.721 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_ident": { 2024-09-17T05:32:41.721 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_ident", 2024-09-17T05:32:41.721 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.721 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.721 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.722 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.722 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.722 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.722 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.722 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-17T05:32:41.722 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.722 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.722 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.722 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_perf": { 2024-09-17T05:32:41.722 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_perf", 2024-09-17T05:32:41.722 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.722 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.722 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.723 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.723 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.723 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.723 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.723 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-17T05:32:41.723 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.723 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.723 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.723 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.723 INFO:teuthology.orchestra.run.smithi031.stdout: "contact": { 2024-09-17T05:32:41.723 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "contact", 2024-09-17T05:32:41.723 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.723 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.723 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.724 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.724 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.724 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.724 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.724 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.724 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.724 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.724 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.724 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.724 INFO:teuthology.orchestra.run.smithi031.stdout: "description": { 2024-09-17T05:32:41.724 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "description", 2024-09-17T05:32:41.724 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.724 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.724 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.725 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.725 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.725 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.725 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.725 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.725 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.725 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.725 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.725 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.725 INFO:teuthology.orchestra.run.smithi031.stdout: "device_url": { 2024-09-17T05:32:41.725 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_url", 2024-09-17T05:32:41.725 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.725 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.726 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.726 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-17T05:32:41.726 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.726 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.726 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.726 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.726 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.726 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.726 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.726 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.726 INFO:teuthology.orchestra.run.smithi031.stdout: "enabled": { 2024-09-17T05:32:41.726 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enabled", 2024-09-17T05:32:41.726 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.726 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.727 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.727 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.727 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.727 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.727 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.727 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.727 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.727 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.727 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.727 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.727 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-09-17T05:32:41.727 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-09-17T05:32:41.727 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.728 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.728 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.728 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "24", 2024-09-17T05:32:41.728 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "8", 2024-09-17T05:32:41.728 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.728 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.728 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.728 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.728 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.728 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.728 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.728 INFO:teuthology.orchestra.run.smithi031.stdout: "last_opt_revision": { 2024-09-17T05:32:41.728 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "last_opt_revision", 2024-09-17T05:32:41.729 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.729 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.729 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.729 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1", 2024-09-17T05:32:41.729 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.729 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.729 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.729 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.729 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.729 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.729 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.729 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.729 INFO:teuthology.orchestra.run.smithi031.stdout: "leaderboard": { 2024-09-17T05:32:41.729 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "leaderboard", 2024-09-17T05:32:41.730 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.730 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.730 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.730 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.730 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.730 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.730 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.730 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.730 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.730 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.730 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.730 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.730 INFO:teuthology.orchestra.run.smithi031.stdout: "leaderboard_description": { 2024-09-17T05:32:41.731 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "leaderboard_description", 2024-09-17T05:32:41.731 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.731 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.731 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.731 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.731 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.731 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.731 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.731 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.731 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.731 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.731 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.731 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.732 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.732 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.732 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.732 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.732 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.732 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.732 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.732 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.732 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.732 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.732 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.732 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.733 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.733 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.733 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.733 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.733 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.733 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.733 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.733 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.733 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.733 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.733 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.733 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.733 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.734 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.734 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.734 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.734 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.734 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.734 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.734 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.734 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.734 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.734 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.734 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.734 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.735 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.735 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.735 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.735 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.735 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.735 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.735 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.735 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.735 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.735 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.735 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.735 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.735 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.736 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.736 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.736 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.736 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.736 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.736 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.736 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.736 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.736 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.736 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.736 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.737 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.737 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.737 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.737 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.737 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.737 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.737 INFO:teuthology.orchestra.run.smithi031.stdout: "organization": { 2024-09-17T05:32:41.737 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "organization", 2024-09-17T05:32:41.737 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.737 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.737 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.737 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.738 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.738 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.738 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.738 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.738 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.738 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.738 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.738 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.738 INFO:teuthology.orchestra.run.smithi031.stdout: "proxy": { 2024-09-17T05:32:41.738 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "proxy", 2024-09-17T05:32:41.738 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.738 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.738 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.739 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.739 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.739 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.739 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.739 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.739 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.739 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.739 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.739 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.739 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.739 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.739 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.739 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.740 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.740 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.740 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.740 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.740 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.740 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.740 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.740 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.740 INFO:teuthology.orchestra.run.smithi031.stdout: "url": { 2024-09-17T05:32:41.740 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "url", 2024-09-17T05:32:41.740 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.740 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.741 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.741 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-17T05:32:41.741 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.741 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.741 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.741 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.741 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.741 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.741 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.741 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.741 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.741 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.742 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "test_orchestrator", 2024-09-17T05:32:41.742 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.742 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.742 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.742 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.742 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.742 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.742 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.742 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.742 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.742 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.742 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.742 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.743 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.743 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.743 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.743 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.743 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.743 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.743 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.743 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.743 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.743 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.743 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.743 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.744 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.744 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.744 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.744 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.744 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.744 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.744 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.744 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.744 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.744 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.744 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.744 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.745 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.745 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.745 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.745 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.745 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.745 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.745 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.745 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.745 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.745 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.745 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.745 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.745 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.745 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.746 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.746 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.746 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.746 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.746 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.746 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.746 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.746 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.746 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.746 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.746 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.746 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.746 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.747 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.747 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.747 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.747 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.747 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.747 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.747 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.747 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.747 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.747 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.747 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.747 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.748 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.748 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.748 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.748 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.748 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.748 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.748 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.748 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.748 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.748 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.748 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.749 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "volumes", 2024-09-17T05:32:41.749 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.749 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.749 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.749 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.749 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.749 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.749 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.749 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.749 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.749 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.749 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.749 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.750 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.750 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.750 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.750 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.750 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.750 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.750 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.750 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.750 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.750 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.750 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.750 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.750 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.751 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.751 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.751 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.751 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.751 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.751 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.751 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.751 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.751 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.751 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.751 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.751 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.751 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.752 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.752 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.752 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.752 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.752 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.752 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.752 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.752 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.752 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.752 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.752 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.752 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.752 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.753 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.753 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.753 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.753 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.753 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.753 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.753 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.753 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.753 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.753 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.753 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.753 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.753 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.754 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.754 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.754 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.754 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.754 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.754 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.754 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.754 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.754 INFO:teuthology.orchestra.run.smithi031.stdout: "max_concurrent_clones": { 2024-09-17T05:32:41.754 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_concurrent_clones", 2024-09-17T05:32:41.754 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.754 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.754 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.755 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "4", 2024-09-17T05:32:41.755 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.755 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.755 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.755 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-17T05:32:41.755 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.755 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.755 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.755 INFO:teuthology.orchestra.run.smithi031.stdout: "periodic_async_work": { 2024-09-17T05:32:41.755 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "periodic_async_work", 2024-09-17T05:32:41.755 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.755 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.756 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.756 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.756 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.756 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.756 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.756 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Periodically check for async work", 2024-09-17T05:32:41.756 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.756 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.756 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.756 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot_clone_delay": { 2024-09-17T05:32:41.756 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snapshot_clone_delay", 2024-09-17T05:32:41.756 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.757 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.757 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.757 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.757 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.757 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.757 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.757 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-17T05:32:41.757 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.757 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.757 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.757 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot_clone_no_wait": { 2024-09-17T05:32:41.757 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snapshot_clone_no_wait", 2024-09-17T05:32:41.758 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.758 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.758 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.758 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.758 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.758 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.758 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.758 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-17T05:32:41.758 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.758 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.758 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.758 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.758 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.759 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.759 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.759 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.759 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.759 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.759 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.759 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.759 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.759 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.759 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.759 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.759 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.759 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.760 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix", 2024-09-17T05:32:41.760 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.760 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.760 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.760 INFO:teuthology.orchestra.run.smithi031.stdout: "discovery_interval": { 2024-09-17T05:32:41.760 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "discovery_interval", 2024-09-17T05:32:41.760 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-09-17T05:32:41.760 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.760 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.760 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "100", 2024-09-17T05:32:41.761 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.761 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.761 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.761 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.761 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.761 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.761 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.761 INFO:teuthology.orchestra.run.smithi031.stdout: "identifier": { 2024-09-17T05:32:41.761 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "identifier", 2024-09-17T05:32:41.761 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.761 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.762 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.762 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.762 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.762 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.762 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.762 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.762 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.762 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.762 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.762 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-09-17T05:32:41.762 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-09-17T05:32:41.762 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.763 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.763 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.763 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-09-17T05:32:41.763 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.763 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.763 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.763 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.763 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.763 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.763 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.763 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.764 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.764 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.764 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.764 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.764 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.764 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.764 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.764 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.764 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.764 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.764 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.764 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.764 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.765 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.765 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.765 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.765 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.765 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.765 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.765 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.765 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.765 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.765 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.765 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.765 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.766 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.766 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.766 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.766 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.766 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.766 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.766 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.766 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.766 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.766 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.766 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.766 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.767 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.767 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.767 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.767 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.767 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.767 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.767 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.767 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.767 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.767 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.767 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.767 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.767 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.768 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.768 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.768 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.768 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.768 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.768 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.768 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.768 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.768 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.768 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.768 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.768 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.769 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.769 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.769 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.769 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.769 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.769 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.769 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.769 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.769 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.769 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.769 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.769 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.770 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.770 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.770 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.770 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.770 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_host": { 2024-09-17T05:32:41.770 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_host", 2024-09-17T05:32:41.770 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.770 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.770 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.770 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.770 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.770 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.771 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.771 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.771 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.771 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.771 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.771 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_port": { 2024-09-17T05:32:41.771 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_port", 2024-09-17T05:32:41.771 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.771 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.771 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.771 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10051", 2024-09-17T05:32:41.771 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.771 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.772 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.772 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.772 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.772 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.772 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.772 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_sender": { 2024-09-17T05:32:41.772 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_sender", 2024-09-17T05:32:41.772 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.772 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.772 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.772 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-17T05:32:41.772 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.772 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.773 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.773 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.773 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.773 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.773 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.773 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.773 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.773 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.773 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:32:41.773 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.773 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.773 INFO:teuthology.orchestra.run.smithi031.stdout: "modules": [ 2024-09-17T05:32:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: "iostat", 2024-09-17T05:32:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: "nfs", 2024-09-17T05:32:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: "restful" 2024-09-17T05:32:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: "available_modules": [ 2024-09-17T05:32:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "alerts", 2024-09-17T05:32:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-09-17T05:32:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-09-17T05:32:41.774 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-09-17T05:32:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How frequently to reexamine health status", 2024-09-17T05:32:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.775 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.776 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.777 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.778 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.779 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.780 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_destination": { 2024-09-17T05:32:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_destination", 2024-09-17T05:32:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.781 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-17T05:32:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_from_name": { 2024-09-17T05:32:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_from_name", 2024-09-17T05:32:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.782 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "Ceph", 2024-09-17T05:32:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Email From: name", 2024-09-17T05:32:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_host": { 2024-09-17T05:32:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_host", 2024-09-17T05:32:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.783 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP server", 2024-09-17T05:32:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_password": { 2024-09-17T05:32:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_password", 2024-09-17T05:32:41.784 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Password to authenticate with", 2024-09-17T05:32:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_port": { 2024-09-17T05:32:41.785 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_port", 2024-09-17T05:32:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "465", 2024-09-17T05:32:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP port", 2024-09-17T05:32:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.786 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_sender": { 2024-09-17T05:32:41.787 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_sender", 2024-09-17T05:32:41.787 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.787 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.787 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.787 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.787 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.787 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.787 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.787 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SMTP envelope sender", 2024-09-17T05:32:41.787 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.787 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.787 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.788 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_ssl": { 2024-09-17T05:32:41.788 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_ssl", 2024-09-17T05:32:41.788 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.788 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.788 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.788 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.788 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.788 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.788 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.788 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-17T05:32:41.788 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.788 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.789 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.789 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.789 INFO:teuthology.orchestra.run.smithi031.stdout: "smtp_user": { 2024-09-17T05:32:41.789 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "smtp_user", 2024-09-17T05:32:41.789 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.789 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.789 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.789 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.789 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.789 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.789 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.789 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "User to authenticate as", 2024-09-17T05:32:41.789 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.790 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.790 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.790 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.790 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.790 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.790 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.790 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.790 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.790 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.790 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.790 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.790 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.790 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.790 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.791 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.791 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.791 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.791 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.791 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.791 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.791 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "balancer", 2024-09-17T05:32:41.791 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.791 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.791 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.791 INFO:teuthology.orchestra.run.smithi031.stdout: "active": { 2024-09-17T05:32:41.791 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "active", 2024-09-17T05:32:41.791 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.792 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.792 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.792 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.792 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.792 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.792 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.792 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "automatically balance PGs across cluster", 2024-09-17T05:32:41.792 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.792 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.792 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.792 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.792 INFO:teuthology.orchestra.run.smithi031.stdout: "begin_time": { 2024-09-17T05:32:41.792 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "begin_time", 2024-09-17T05:32:41.793 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.793 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.793 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.793 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0000", 2024-09-17T05:32:41.793 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.793 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.793 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.793 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "beginning time of day to automatically balance", 2024-09-17T05:32:41.793 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-17T05:32:41.793 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.793 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.793 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.794 INFO:teuthology.orchestra.run.smithi031.stdout: "begin_weekday": { 2024-09-17T05:32:41.794 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "begin_weekday", 2024-09-17T05:32:41.794 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-09-17T05:32:41.794 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.794 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.794 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.794 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0", 2024-09-17T05:32:41.794 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "6", 2024-09-17T05:32:41.794 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.794 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-17T05:32:41.794 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-17T05:32:41.794 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.794 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.795 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.795 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_max_iterations": { 2024-09-17T05:32:41.795 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_max_iterations", 2024-09-17T05:32:41.795 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-09-17T05:32:41.795 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.795 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.795 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "25", 2024-09-17T05:32:41.795 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-09-17T05:32:41.795 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "250", 2024-09-17T05:32:41.795 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.795 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-17T05:32:41.795 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.796 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.796 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.796 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_metrics": { 2024-09-17T05:32:41.796 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_metrics", 2024-09-17T05:32:41.796 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.796 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.796 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.796 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "pgs,objects,bytes", 2024-09-17T05:32:41.796 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.796 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.796 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.796 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-17T05:32:41.797 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-17T05:32:41.797 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.797 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.797 INFO:teuthology.orchestra.run.smithi031.stdout: "crush_compat_step": { 2024-09-17T05:32:41.797 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crush_compat_step", 2024-09-17T05:32:41.797 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-09-17T05:32:41.797 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.797 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.797 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0.5", 2024-09-17T05:32:41.797 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0.001", 2024-09-17T05:32:41.797 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "0.999", 2024-09-17T05:32:41.797 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.798 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "aggressiveness of optimization", 2024-09-17T05:32:41.798 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-17T05:32:41.798 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.798 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.798 INFO:teuthology.orchestra.run.smithi031.stdout: "end_time": { 2024-09-17T05:32:41.798 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "end_time", 2024-09-17T05:32:41.798 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.798 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.798 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.798 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "2359", 2024-09-17T05:32:41.798 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.799 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.799 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.799 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "ending time of day to automatically balance", 2024-09-17T05:32:41.799 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-17T05:32:41.799 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.799 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.799 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.799 INFO:teuthology.orchestra.run.smithi031.stdout: "end_weekday": { 2024-09-17T05:32:41.799 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "end_weekday", 2024-09-17T05:32:41.799 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-09-17T05:32:41.799 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.799 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.799 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.800 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "0", 2024-09-17T05:32:41.800 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "6", 2024-09-17T05:32:41.800 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.800 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-17T05:32:41.800 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-17T05:32:41.800 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.800 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.800 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.800 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.800 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.800 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.801 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.801 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.801 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.801 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.801 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.801 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.801 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.801 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.801 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.801 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.801 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.801 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.801 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.801 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.802 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.802 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.802 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.802 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.802 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.802 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.802 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.802 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.802 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.802 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.802 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.802 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.802 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.803 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.803 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.803 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.803 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.803 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.803 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.803 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.803 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.803 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.803 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.803 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.803 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.803 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.804 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.804 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.804 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.804 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.804 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.804 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.804 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.804 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.804 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.804 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.804 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.804 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.804 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.805 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.805 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.805 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.805 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.805 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.805 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.805 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.805 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.805 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.805 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.805 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.805 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.806 INFO:teuthology.orchestra.run.smithi031.stdout: "min_score": { 2024-09-17T05:32:41.806 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "min_score", 2024-09-17T05:32:41.806 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-09-17T05:32:41.806 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.806 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.806 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.806 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.806 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.806 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.806 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-17T05:32:41.806 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.806 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.807 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.807 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.807 INFO:teuthology.orchestra.run.smithi031.stdout: "mode": { 2024-09-17T05:32:41.807 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mode", 2024-09-17T05:32:41.807 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.807 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.807 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.807 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "upmap", 2024-09-17T05:32:41.807 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.807 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.807 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.807 INFO:teuthology.orchestra.run.smithi031.stdout: "crush-compat", 2024-09-17T05:32:41.807 INFO:teuthology.orchestra.run.smithi031.stdout: "none", 2024-09-17T05:32:41.807 INFO:teuthology.orchestra.run.smithi031.stdout: "read", 2024-09-17T05:32:41.808 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap", 2024-09-17T05:32:41.808 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap-read" 2024-09-17T05:32:41.808 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.808 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Balancer mode", 2024-09-17T05:32:41.808 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.808 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.808 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.808 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_ids": { 2024-09-17T05:32:41.808 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pool_ids", 2024-09-17T05:32:41.808 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.808 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.809 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.809 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.809 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.809 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.809 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.809 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-17T05:32:41.809 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.809 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.809 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.809 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-09-17T05:32:41.809 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-09-17T05:32:41.809 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.810 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.810 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.810 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-09-17T05:32:41.810 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.810 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.810 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.810 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-17T05:32:41.810 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.810 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.810 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.810 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.811 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.811 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.811 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.811 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.811 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.811 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.811 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.811 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.811 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.811 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.811 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.811 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.811 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap_max_deviation": { 2024-09-17T05:32:41.812 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "upmap_max_deviation", 2024-09-17T05:32:41.812 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.812 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.812 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.812 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-09-17T05:32:41.812 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-09-17T05:32:41.812 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.812 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.812 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-17T05:32:41.812 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-17T05:32:41.812 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.812 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.813 INFO:teuthology.orchestra.run.smithi031.stdout: "upmap_max_optimizations": { 2024-09-17T05:32:41.813 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "upmap_max_optimizations", 2024-09-17T05:32:41.813 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-09-17T05:32:41.813 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.813 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.813 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-09-17T05:32:41.813 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.813 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.813 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.813 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-17T05:32:41.813 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.814 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.814 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.814 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.814 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.814 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephadm", 2024-09-17T05:32:41.814 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.814 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.814 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.814 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_down_multiplier": { 2024-09-17T05:32:41.814 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_down_multiplier", 2024-09-17T05:32:41.814 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-09-17T05:32:41.815 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.815 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.815 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3.0", 2024-09-17T05:32:41.815 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.815 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.815 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.815 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-17T05:32:41.815 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.815 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.815 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.815 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_refresh_rate": { 2024-09-17T05:32:41.815 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_refresh_rate", 2024-09-17T05:32:41.815 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.816 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.816 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.816 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "20", 2024-09-17T05:32:41.816 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.816 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.816 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.816 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-17T05:32:41.816 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.816 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.816 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.816 INFO:teuthology.orchestra.run.smithi031.stdout: "agent_starting_port": { 2024-09-17T05:32:41.816 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "agent_starting_port", 2024-09-17T05:32:41.817 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.817 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.817 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.817 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "4721", 2024-09-17T05:32:41.817 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.817 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.817 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.817 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-17T05:32:41.817 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.817 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.817 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.817 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_ptrace": { 2024-09-17T05:32:41.818 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_ptrace", 2024-09-17T05:32:41.818 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.818 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.818 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.818 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.818 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.818 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.818 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.818 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-17T05:32:41.818 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-17T05:32:41.818 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.818 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.819 INFO:teuthology.orchestra.run.smithi031.stdout: "autotune_interval": { 2024-09-17T05:32:41.819 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "autotune_interval", 2024-09-17T05:32:41.819 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.819 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.819 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.819 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-09-17T05:32:41.819 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.819 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.819 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.819 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-17T05:32:41.819 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.819 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.820 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.820 INFO:teuthology.orchestra.run.smithi031.stdout: "autotune_memory_target_ratio": { 2024-09-17T05:32:41.820 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "autotune_memory_target_ratio", 2024-09-17T05:32:41.820 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-09-17T05:32:41.820 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.820 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.820 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0.7", 2024-09-17T05:32:41.820 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.820 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.820 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.820 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-17T05:32:41.820 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.821 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.821 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.821 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm_log_destination": { 2024-09-17T05:32:41.821 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephadm_log_destination", 2024-09-17T05:32:41.821 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.821 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.821 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.821 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.821 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.821 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.821 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.821 INFO:teuthology.orchestra.run.smithi031.stdout: "file", 2024-09-17T05:32:41.822 INFO:teuthology.orchestra.run.smithi031.stdout: "file,syslog", 2024-09-17T05:32:41.822 INFO:teuthology.orchestra.run.smithi031.stdout: "syslog" 2024-09-17T05:32:41.822 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.822 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-17T05:32:41.822 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.822 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.822 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.822 INFO:teuthology.orchestra.run.smithi031.stdout: "cgroups_split": { 2024-09-17T05:32:41.822 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cgroups_split", 2024-09-17T05:32:41.822 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.822 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.822 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.823 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.823 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.823 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.823 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.823 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-17T05:32:41.823 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.823 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.823 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.823 INFO:teuthology.orchestra.run.smithi031.stdout: "config_checks_enabled": { 2024-09-17T05:32:41.823 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "config_checks_enabled", 2024-09-17T05:32:41.823 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.823 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.824 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.824 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.824 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.824 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.824 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.824 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-17T05:32:41.824 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.824 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.824 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.824 INFO:teuthology.orchestra.run.smithi031.stdout: "config_dashboard": { 2024-09-17T05:32:41.824 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "config_dashboard", 2024-09-17T05:32:41.824 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.825 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.825 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.825 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.825 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.825 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.825 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.825 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-17T05:32:41.825 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.825 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.825 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.825 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_alertmanager": { 2024-09-17T05:32:41.826 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_alertmanager", 2024-09-17T05:32:41.826 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.826 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.826 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.826 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-17T05:32:41.826 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.826 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.826 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.826 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-09-17T05:32:41.826 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.826 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.826 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.826 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_base": { 2024-09-17T05:32:41.827 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_base", 2024-09-17T05:32:41.827 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.827 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.827 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.827 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-17T05:32:41.827 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.827 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.827 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.827 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Container image name, without the tag", 2024-09-17T05:32:41.827 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.827 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.827 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.828 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_elasticsearch": { 2024-09-17T05:32:41.828 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_elasticsearch", 2024-09-17T05:32:41.828 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.828 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.828 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.828 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-17T05:32:41.828 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.828 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.828 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.828 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "elasticsearch container image", 2024-09-17T05:32:41.828 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.828 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.829 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.829 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_grafana": { 2024-09-17T05:32:41.829 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_grafana", 2024-09-17T05:32:41.829 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.829 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.829 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.829 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-17T05:32:41.829 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.829 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.829 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.829 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-09-17T05:32:41.829 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.830 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.830 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.830 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.830 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_haproxy": { 2024-09-17T05:32:41.830 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_haproxy", 2024-09-17T05:32:41.830 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.830 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.830 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.830 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-17T05:32:41.830 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.830 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.830 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "HAproxy container image", 2024-09-17T05:32:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_agent": { 2024-09-17T05:32:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_agent", 2024-09-17T05:32:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-17T05:32:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.831 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.832 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger agent container image", 2024-09-17T05:32:41.832 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.832 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.832 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.832 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_collector": { 2024-09-17T05:32:41.832 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_collector", 2024-09-17T05:32:41.832 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.832 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.832 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.832 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-17T05:32:41.832 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger collector container image", 2024-09-17T05:32:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_jaeger_query": { 2024-09-17T05:32:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_jaeger_query", 2024-09-17T05:32:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-17T05:32:41.833 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Jaeger query container image", 2024-09-17T05:32:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_keepalived": { 2024-09-17T05:32:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_keepalived", 2024-09-17T05:32:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-17T05:32:41.834 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Keepalived container image", 2024-09-17T05:32:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_loki": { 2024-09-17T05:32:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_loki", 2024-09-17T05:32:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.835 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-17T05:32:41.836 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.836 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.836 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.836 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Loki container image", 2024-09-17T05:32:41.836 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.836 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.836 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.836 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_nginx": { 2024-09-17T05:32:41.836 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_nginx", 2024-09-17T05:32:41.836 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.836 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.836 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-17T05:32:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Nginx container image", 2024-09-17T05:32:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_node_exporter": { 2024-09-17T05:32:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_node_exporter", 2024-09-17T05:32:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.837 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-17T05:32:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-09-17T05:32:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_nvmeof": { 2024-09-17T05:32:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_nvmeof", 2024-09-17T05:32:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.838 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-17T05:32:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Nvme-of container image", 2024-09-17T05:32:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_oauth2_proxy": { 2024-09-17T05:32:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_oauth2_proxy", 2024-09-17T05:32:41.839 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.840 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.840 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.840 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-17T05:32:41.840 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.840 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.840 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.840 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "oauth2-proxy container image", 2024-09-17T05:32:41.840 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.840 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.840 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.840 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_prometheus": { 2024-09-17T05:32:41.840 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_prometheus", 2024-09-17T05:32:41.841 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.841 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.841 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.841 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-17T05:32:41.841 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.841 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.841 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.841 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Prometheus container image", 2024-09-17T05:32:41.841 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.841 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.841 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.841 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_promtail": { 2024-09-17T05:32:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_promtail", 2024-09-17T05:32:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-17T05:32:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Promtail container image", 2024-09-17T05:32:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_samba": { 2024-09-17T05:32:41.842 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_samba", 2024-09-17T05:32:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-17T05:32:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Samba/SMB container image", 2024-09-17T05:32:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.843 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_samba_metrics": { 2024-09-17T05:32:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_samba_metrics", 2024-09-17T05:32:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-17T05:32:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-17T05:32:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.844 INFO:teuthology.orchestra.run.smithi031.stdout: "container_image_snmp_gateway": { 2024-09-17T05:32:41.845 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_image_snmp_gateway", 2024-09-17T05:32:41.845 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.845 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.845 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.845 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-17T05:32:41.845 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.845 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.845 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.845 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "SNMP Gateway container image", 2024-09-17T05:32:41.845 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.845 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.845 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: "container_init": { 2024-09-17T05:32:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "container_init", 2024-09-17T05:32:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Run podman/docker with `--init`", 2024-09-17T05:32:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.847 INFO:teuthology.orchestra.run.smithi031.stdout: "daemon_cache_timeout": { 2024-09-17T05:32:41.847 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "daemon_cache_timeout", 2024-09-17T05:32:41.847 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.847 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.847 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.847 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-09-17T05:32:41.847 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.847 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.847 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.847 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-17T05:32:41.847 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.847 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.847 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.848 INFO:teuthology.orchestra.run.smithi031.stdout: "default_cephadm_command_timeout": { 2024-09-17T05:32:41.848 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "default_cephadm_command_timeout", 2024-09-17T05:32:41.848 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.848 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.848 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.848 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "900", 2024-09-17T05:32:41.848 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.848 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.848 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.848 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-17T05:32:41.848 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.849 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.849 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.849 INFO:teuthology.orchestra.run.smithi031.stdout: "default_registry": { 2024-09-17T05:32:41.849 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "default_registry", 2024-09-17T05:32:41.849 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.849 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.849 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.849 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "docker.io", 2024-09-17T05:32:41.849 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.849 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.849 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-17T05:32:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: "device_cache_timeout": { 2024-09-17T05:32:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_cache_timeout", 2024-09-17T05:32:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1800", 2024-09-17T05:32:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.850 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.851 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.851 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache device inventory", 2024-09-17T05:32:41.851 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.851 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.851 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.851 INFO:teuthology.orchestra.run.smithi031.stdout: "device_enhanced_scan": { 2024-09-17T05:32:41.851 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_enhanced_scan", 2024-09-17T05:32:41.851 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.851 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.851 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.851 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.852 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.852 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.852 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.852 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-17T05:32:41.852 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.852 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.852 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.852 INFO:teuthology.orchestra.run.smithi031.stdout: "facts_cache_timeout": { 2024-09-17T05:32:41.852 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "facts_cache_timeout", 2024-09-17T05:32:41.852 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.852 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.853 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.853 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-09-17T05:32:41.853 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.853 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.853 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.853 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "seconds to cache host facts data", 2024-09-17T05:32:41.853 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.853 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.853 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.853 INFO:teuthology.orchestra.run.smithi031.stdout: "grafana_dashboards_path": { 2024-09-17T05:32:41.853 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "grafana_dashboards_path", 2024-09-17T05:32:41.853 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.854 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.854 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.854 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-17T05:32:41.854 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.854 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.854 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.854 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-17T05:32:41.854 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.854 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.854 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.854 INFO:teuthology.orchestra.run.smithi031.stdout: "host_check_interval": { 2024-09-17T05:32:41.854 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "host_check_interval", 2024-09-17T05:32:41.855 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.855 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.855 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.855 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-09-17T05:32:41.855 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.855 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.855 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.855 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to perform a host check", 2024-09-17T05:32:41.855 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.855 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.855 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.856 INFO:teuthology.orchestra.run.smithi031.stdout: "hw_monitoring": { 2024-09-17T05:32:41.856 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "hw_monitoring", 2024-09-17T05:32:41.856 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.856 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.856 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.856 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.856 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.856 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.856 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.856 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-17T05:32:41.856 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.856 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.856 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.857 INFO:teuthology.orchestra.run.smithi031.stdout: "inventory_list_all": { 2024-09-17T05:32:41.857 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "inventory_list_all", 2024-09-17T05:32:41.857 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.857 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.857 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.857 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.857 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.857 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.857 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.857 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-17T05:32:41.857 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.857 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.857 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.858 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.858 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.858 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.858 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.858 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.858 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.858 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.858 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.858 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.858 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.858 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.859 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.859 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.859 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.859 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.859 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.859 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.859 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.859 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.859 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.859 INFO:teuthology.orchestra.run.smithi031.stdout: "log_refresh_metadata": { 2024-09-17T05:32:41.859 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_refresh_metadata", 2024-09-17T05:32:41.860 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.860 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.860 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.860 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.860 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.860 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.860 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.860 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-17T05:32:41.860 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.860 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.860 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.860 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.861 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.861 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.861 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.861 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.861 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.861 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.861 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.861 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.861 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-17T05:32:41.861 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.861 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.861 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.862 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.862 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.862 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.862 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.862 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.862 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.862 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.862 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.862 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.862 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.862 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.862 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.863 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.863 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.863 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.863 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.863 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.863 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.863 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.863 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.863 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.863 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.863 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.863 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.864 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.864 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.864 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.864 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.864 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.864 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.864 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.864 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.864 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.864 INFO:teuthology.orchestra.run.smithi031.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-17T05:32:41.864 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-17T05:32:41.865 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.865 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.865 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.865 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.865 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.865 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.865 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.865 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-17T05:32:41.865 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.865 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.865 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.866 INFO:teuthology.orchestra.run.smithi031.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-17T05:32:41.866 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-17T05:32:41.866 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.866 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.866 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.866 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "*", 2024-09-17T05:32:41.866 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.866 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.866 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.866 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-17T05:32:41.866 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.866 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.867 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.867 INFO:teuthology.orchestra.run.smithi031.stdout: "max_count_per_host": { 2024-09-17T05:32:41.867 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_count_per_host", 2024-09-17T05:32:41.867 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.867 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.867 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.867 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-09-17T05:32:41.867 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.867 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.867 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.867 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "max number of daemons per service per host", 2024-09-17T05:32:41.867 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.868 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.868 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.868 INFO:teuthology.orchestra.run.smithi031.stdout: "max_osd_draining_count": { 2024-09-17T05:32:41.868 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_osd_draining_count", 2024-09-17T05:32:41.868 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.868 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.868 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.868 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-09-17T05:32:41.868 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.868 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.868 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.868 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-17T05:32:41.869 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.869 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.869 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.869 INFO:teuthology.orchestra.run.smithi031.stdout: "migration_current": { 2024-09-17T05:32:41.869 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "migration_current", 2024-09-17T05:32:41.869 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.869 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.869 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.869 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.869 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.869 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.869 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.870 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "internal - do not modify", 2024-09-17T05:32:41.870 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.870 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.870 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.870 INFO:teuthology.orchestra.run.smithi031.stdout: "mode": { 2024-09-17T05:32:41.870 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mode", 2024-09-17T05:32:41.870 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.870 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.870 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.870 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "root", 2024-09-17T05:32:41.870 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.870 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.871 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.871 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm-package", 2024-09-17T05:32:41.871 INFO:teuthology.orchestra.run.smithi031.stdout: "root" 2024-09-17T05:32:41.871 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.871 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "mode for remote execution of cephadm", 2024-09-17T05:32:41.871 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.871 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.871 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.871 INFO:teuthology.orchestra.run.smithi031.stdout: "oob_default_addr": { 2024-09-17T05:32:41.871 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "oob_default_addr", 2024-09-17T05:32:41.871 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.871 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.872 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.872 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "169.254.1.1", 2024-09-17T05:32:41.872 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.872 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.872 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.872 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-17T05:32:41.872 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.872 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.872 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.872 INFO:teuthology.orchestra.run.smithi031.stdout: "prometheus_alerts_path": { 2024-09-17T05:32:41.872 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prometheus_alerts_path", 2024-09-17T05:32:41.873 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.873 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.873 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.873 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-17T05:32:41.873 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.873 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.873 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.873 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-17T05:32:41.873 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.873 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.873 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.873 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_insecure": { 2024-09-17T05:32:41.874 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_insecure", 2024-09-17T05:32:41.874 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.874 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.874 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.874 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.874 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.874 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.874 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.874 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-17T05:32:41.874 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.874 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.874 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.875 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_password": { 2024-09-17T05:32:41.875 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_password", 2024-09-17T05:32:41.875 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.875 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.875 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.875 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.875 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.875 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.875 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.875 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-17T05:32:41.875 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.875 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.875 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.876 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_url": { 2024-09-17T05:32:41.876 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_url", 2024-09-17T05:32:41.876 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.876 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.876 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.876 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.876 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.876 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.876 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.876 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-17T05:32:41.876 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.876 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.877 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.877 INFO:teuthology.orchestra.run.smithi031.stdout: "registry_username": { 2024-09-17T05:32:41.877 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "registry_username", 2024-09-17T05:32:41.877 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.877 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.877 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.877 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.877 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.877 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.877 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.877 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-17T05:32:41.878 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.878 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.878 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.878 INFO:teuthology.orchestra.run.smithi031.stdout: "secure_monitoring_stack": { 2024-09-17T05:32:41.878 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "secure_monitoring_stack", 2024-09-17T05:32:41.878 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.878 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.878 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.878 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.878 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.878 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.878 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.879 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-17T05:32:41.879 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.879 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.879 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.879 INFO:teuthology.orchestra.run.smithi031.stdout: "service_discovery_port": { 2024-09-17T05:32:41.879 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "service_discovery_port", 2024-09-17T05:32:41.879 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.879 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.879 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.879 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8765", 2024-09-17T05:32:41.879 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.879 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.880 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.880 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "cephadm service discovery port", 2024-09-17T05:32:41.880 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.880 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.880 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.880 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.880 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.880 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.880 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.880 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.880 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.880 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.881 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.881 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.881 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.881 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.881 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.881 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.881 INFO:teuthology.orchestra.run.smithi031.stdout: "ssh_config_file": { 2024-09-17T05:32:41.881 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssh_config_file", 2024-09-17T05:32:41.881 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.881 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.881 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.881 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.882 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.882 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.882 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.882 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-17T05:32:41.882 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.882 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.882 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.882 INFO:teuthology.orchestra.run.smithi031.stdout: "ssh_keepalive_count_max": { 2024-09-17T05:32:41.882 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssh_keepalive_count_max", 2024-09-17T05:32:41.882 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.882 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.882 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.883 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3", 2024-09-17T05:32:41.883 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.883 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.883 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.883 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-17T05:32:41.883 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.883 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.883 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.883 INFO:teuthology.orchestra.run.smithi031.stdout: "ssh_keepalive_interval": { 2024-09-17T05:32:41.883 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssh_keepalive_interval", 2024-09-17T05:32:41.883 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.883 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.884 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.884 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "7", 2024-09-17T05:32:41.884 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.884 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.884 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.884 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-17T05:32:41.884 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.884 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.884 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.884 INFO:teuthology.orchestra.run.smithi031.stdout: "use_agent": { 2024-09-17T05:32:41.884 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "use_agent", 2024-09-17T05:32:41.884 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.885 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.885 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.885 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.885 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.885 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.885 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.885 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-17T05:32:41.885 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.885 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.885 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.885 INFO:teuthology.orchestra.run.smithi031.stdout: "use_repo_digest": { 2024-09-17T05:32:41.885 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "use_repo_digest", 2024-09-17T05:32:41.886 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.886 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.886 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.886 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.886 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.886 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.886 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.886 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-17T05:32:41.886 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.886 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.886 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.886 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_failed_host_check": { 2024-09-17T05:32:41.887 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_failed_host_check", 2024-09-17T05:32:41.887 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.887 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.887 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.887 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.887 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.887 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.887 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.887 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if the host check fails", 2024-09-17T05:32:41.887 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.887 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.887 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.888 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_stray_daemons": { 2024-09-17T05:32:41.888 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_stray_daemons", 2024-09-17T05:32:41.888 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.888 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.888 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.888 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.888 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.888 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.888 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.888 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-17T05:32:41.888 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.888 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.889 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.889 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_on_stray_hosts": { 2024-09-17T05:32:41.889 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_on_stray_hosts", 2024-09-17T05:32:41.889 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.889 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.889 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.889 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.889 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.889 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.889 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.889 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-17T05:32:41.889 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.890 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.890 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.890 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.890 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.890 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crash", 2024-09-17T05:32:41.890 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.890 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.890 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.890 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.890 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.891 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.891 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.891 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.891 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.891 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.891 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.891 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.891 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.891 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.891 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.891 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.891 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.891 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.892 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.892 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.892 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.892 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.892 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.892 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.892 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.892 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.892 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.892 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.892 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.893 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.893 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.893 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.893 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.893 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.893 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.893 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.893 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.893 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.893 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.893 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.894 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.894 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.894 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.894 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.894 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.894 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.894 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.894 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.894 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.894 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.894 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.894 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.894 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.895 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.895 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.895 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.895 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.895 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.895 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.895 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.895 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.895 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.895 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.895 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.895 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.896 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.896 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.896 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.896 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.896 INFO:teuthology.orchestra.run.smithi031.stdout: "retain_interval": { 2024-09-17T05:32:41.896 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "retain_interval", 2024-09-17T05:32:41.896 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.896 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.896 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.896 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "31536000", 2024-09-17T05:32:41.896 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.896 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.896 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.897 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-17T05:32:41.897 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.897 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.897 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.897 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.897 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.897 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.897 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.897 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.897 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.897 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.897 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.898 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.898 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.898 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.898 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.898 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.898 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_recent_interval": { 2024-09-17T05:32:41.898 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_recent_interval", 2024-09-17T05:32:41.898 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.898 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.898 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.898 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1209600", 2024-09-17T05:32:41.899 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.899 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.899 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.899 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-17T05:32:41.899 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.899 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.899 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.899 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.899 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.899 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "dashboard", 2024-09-17T05:32:41.899 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.900 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.900 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.900 INFO:teuthology.orchestra.run.smithi031.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-17T05:32:41.900 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-17T05:32:41.900 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.900 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.900 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.900 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-09-17T05:32:41.900 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.900 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.900 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.900 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.901 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.901 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.901 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.901 INFO:teuthology.orchestra.run.smithi031.stdout: "ALERTMANAGER_API_HOST": { 2024-09-17T05:32:41.901 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-17T05:32:41.901 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.901 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.901 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.901 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.901 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.901 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.902 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.902 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.902 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.902 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.902 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.902 INFO:teuthology.orchestra.run.smithi031.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-17T05:32:41.902 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-17T05:32:41.902 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.902 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.902 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.902 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.902 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.903 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.903 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.903 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.903 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.903 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.903 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.903 INFO:teuthology.orchestra.run.smithi031.stdout: "AUDIT_API_ENABLED": { 2024-09-17T05:32:41.903 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "AUDIT_API_ENABLED", 2024-09-17T05:32:41.903 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.903 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.903 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.903 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.904 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.904 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.904 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.904 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.904 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.904 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.904 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.904 INFO:teuthology.orchestra.run.smithi031.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-17T05:32:41.904 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-17T05:32:41.904 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.904 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.905 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.905 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.905 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.905 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.905 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.905 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.905 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.905 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.905 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.905 INFO:teuthology.orchestra.run.smithi031.stdout: "ENABLE_BROWSABLE_API": { 2024-09-17T05:32:41.905 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-17T05:32:41.906 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.906 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.906 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.906 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.906 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.906 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.906 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.906 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.906 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.906 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.906 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.906 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-17T05:32:41.907 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-17T05:32:41.907 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.907 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.907 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.907 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.907 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.907 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.907 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.907 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.907 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.907 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.907 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.908 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-17T05:32:41.908 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-17T05:32:41.908 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.908 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.908 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.908 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.908 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.908 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.908 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.908 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.908 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.908 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.909 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.909 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-17T05:32:41.909 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-17T05:32:41.909 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.909 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.909 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.909 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.909 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.909 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.909 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.909 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.910 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.910 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.910 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.910 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-17T05:32:41.910 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-17T05:32:41.910 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.910 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.910 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.910 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.910 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.910 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.911 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.911 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.911 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.911 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.911 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.911 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-17T05:32:41.911 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-17T05:32:41.911 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.911 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.911 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.911 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.912 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.912 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.912 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.912 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.912 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.912 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.912 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.912 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-17T05:32:41.912 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-17T05:32:41.912 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.912 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.913 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.913 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.913 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.913 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.913 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.913 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.913 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.913 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.913 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.913 INFO:teuthology.orchestra.run.smithi031.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-17T05:32:41.913 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-17T05:32:41.913 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.914 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.914 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.914 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.914 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.914 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.914 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.914 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.914 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.914 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.914 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.914 INFO:teuthology.orchestra.run.smithi031.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-17T05:32:41.915 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-17T05:32:41.915 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.915 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.915 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.915 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.915 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.915 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.915 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.915 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.915 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.915 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.915 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.916 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_PASSWORD": { 2024-09-17T05:32:41.916 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-17T05:32:41.916 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.916 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.916 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.916 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-09-17T05:32:41.916 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.916 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.916 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.916 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.916 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.916 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.917 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.917 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-17T05:32:41.917 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-17T05:32:41.917 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.917 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.917 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.917 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.917 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.917 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.917 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.917 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.918 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.918 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.918 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.918 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_URL": { 2024-09-17T05:32:41.918 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_URL", 2024-09-17T05:32:41.918 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.918 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.918 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.918 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.918 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.918 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.918 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.919 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.919 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.919 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.919 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.919 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_API_USERNAME": { 2024-09-17T05:32:41.919 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-17T05:32:41.919 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.919 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.919 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.919 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-09-17T05:32:41.919 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.920 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.920 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.920 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.920 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.920 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.920 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.920 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-17T05:32:41.920 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-17T05:32:41.920 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.920 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.920 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.920 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.921 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.921 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.921 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.921 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.921 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.921 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.921 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.921 INFO:teuthology.orchestra.run.smithi031.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-17T05:32:41.921 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-17T05:32:41.921 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.921 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.921 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.922 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.922 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.922 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.922 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.922 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.922 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.922 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.922 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.922 INFO:teuthology.orchestra.run.smithi031.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-17T05:32:41.922 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-17T05:32:41.922 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.922 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.923 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.923 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.923 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.923 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.923 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.923 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.923 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.923 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.923 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.923 INFO:teuthology.orchestra.run.smithi031.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-17T05:32:41.923 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-17T05:32:41.923 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.924 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.924 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.924 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.924 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.924 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.924 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.924 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.924 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.924 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.924 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.924 INFO:teuthology.orchestra.run.smithi031.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-17T05:32:41.925 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-17T05:32:41.925 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.925 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.925 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.925 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "[]", 2024-09-17T05:32:41.925 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.925 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.925 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.925 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.925 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.925 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.925 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.926 INFO:teuthology.orchestra.run.smithi031.stdout: "MULTICLUSTER_CONFIG": { 2024-09-17T05:32:41.926 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-17T05:32:41.926 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.926 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.926 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.926 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "{}", 2024-09-17T05:32:41.926 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.926 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.926 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.926 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.926 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.926 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.926 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.927 INFO:teuthology.orchestra.run.smithi031.stdout: "PROMETHEUS_API_HOST": { 2024-09-17T05:32:41.927 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-17T05:32:41.927 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.927 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.927 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.927 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.927 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.927 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.927 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.927 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.927 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.927 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.927 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.928 INFO:teuthology.orchestra.run.smithi031.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-17T05:32:41.928 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-17T05:32:41.928 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.928 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.928 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.928 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.928 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.928 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.928 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.928 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.928 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.929 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.929 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.929 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-17T05:32:41.929 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-17T05:32:41.929 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.929 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.929 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.929 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.929 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.929 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.929 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.929 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.930 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.930 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.930 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.930 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-17T05:32:41.930 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-17T05:32:41.930 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.930 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.930 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.930 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.930 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.930 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.931 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.931 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.931 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.931 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.931 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.931 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-17T05:32:41.931 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-17T05:32:41.931 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.931 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.931 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.931 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.931 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.932 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.932 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.932 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.932 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.932 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.932 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.932 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-17T05:32:41.932 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-17T05:32:41.932 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.932 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.932 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.932 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.932 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.933 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.933 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.933 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.933 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.933 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.933 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.933 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-17T05:32:41.933 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-17T05:32:41.933 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.933 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.933 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.933 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.934 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.934 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.934 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.934 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.934 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.934 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.934 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.934 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-17T05:32:41.934 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-17T05:32:41.934 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.934 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.934 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.935 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.935 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.935 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.935 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.935 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.935 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.935 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.935 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.935 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-17T05:32:41.935 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-17T05:32:41.935 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.935 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.935 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.935 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.936 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.936 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.936 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.936 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.936 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.936 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.936 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.936 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_ENABLED": { 2024-09-17T05:32:41.936 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-17T05:32:41.936 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.936 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.937 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.937 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.937 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.937 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.937 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.937 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.937 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.937 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.937 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.937 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-17T05:32:41.937 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-17T05:32:41.938 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.938 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.938 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.938 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-17T05:32:41.938 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.938 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.938 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.938 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.938 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.938 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.938 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.938 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-17T05:32:41.938 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-17T05:32:41.939 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.939 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.939 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.939 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-09-17T05:32:41.939 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.939 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.939 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.939 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.939 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.939 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.939 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.939 INFO:teuthology.orchestra.run.smithi031.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-17T05:32:41.940 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-17T05:32:41.940 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.940 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.940 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.940 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8", 2024-09-17T05:32:41.940 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.940 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.940 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.940 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.940 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.940 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.940 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.941 INFO:teuthology.orchestra.run.smithi031.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-17T05:32:41.941 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-17T05:32:41.941 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.941 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.941 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.941 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "45", 2024-09-17T05:32:41.941 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.941 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.941 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.941 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.941 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.941 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.942 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.942 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_ACCESS_KEY": { 2024-09-17T05:32:41.942 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-17T05:32:41.942 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.942 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.942 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.942 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.942 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.942 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.942 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.942 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.942 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.943 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.943 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.943 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.943 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-17T05:32:41.943 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-17T05:32:41.943 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.943 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.943 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.943 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "admin", 2024-09-17T05:32:41.943 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.943 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.943 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.943 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.943 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.944 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.944 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.944 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_SECRET_KEY": { 2024-09-17T05:32:41.944 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-17T05:32:41.944 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.944 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.944 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.944 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.944 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.944 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.944 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.945 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.945 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.945 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.945 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.945 INFO:teuthology.orchestra.run.smithi031.stdout: "RGW_API_SSL_VERIFY": { 2024-09-17T05:32:41.945 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-17T05:32:41.945 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.945 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.945 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.945 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.945 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.945 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.946 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.946 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.946 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.946 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.946 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.946 INFO:teuthology.orchestra.run.smithi031.stdout: "UNSAFE_TLS_v1_2": { 2024-09-17T05:32:41.946 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-17T05:32:41.946 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.946 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.946 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.946 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.947 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.947 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.947 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.947 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.947 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.947 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.947 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.947 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-17T05:32:41.947 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-17T05:32:41.947 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.947 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.947 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.948 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.948 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.948 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.948 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.948 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.948 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.948 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.948 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.948 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-17T05:32:41.948 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-17T05:32:41.948 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.949 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.949 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.949 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-09-17T05:32:41.949 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.949 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.949 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.949 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.949 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.949 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.949 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.949 INFO:teuthology.orchestra.run.smithi031.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-17T05:32:41.949 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-17T05:32:41.950 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.950 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.950 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.950 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-09-17T05:32:41.950 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.950 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.950 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.950 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.950 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.950 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.950 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.950 INFO:teuthology.orchestra.run.smithi031.stdout: "cross_origin_url": { 2024-09-17T05:32:41.950 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cross_origin_url", 2024-09-17T05:32:41.951 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.951 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.951 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.951 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.951 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.951 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.951 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.951 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.951 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.951 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.951 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.951 INFO:teuthology.orchestra.run.smithi031.stdout: "crt_file": { 2024-09-17T05:32:41.952 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "crt_file", 2024-09-17T05:32:41.952 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.952 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.952 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.952 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.952 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.952 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.952 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.952 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.952 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.952 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.952 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.953 INFO:teuthology.orchestra.run.smithi031.stdout: "debug": { 2024-09-17T05:32:41.953 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "debug", 2024-09-17T05:32:41.953 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.953 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.953 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.953 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.953 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.953 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.953 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.953 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Enable/disable debug options", 2024-09-17T05:32:41.953 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.953 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.953 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.954 INFO:teuthology.orchestra.run.smithi031.stdout: "jwt_token_ttl": { 2024-09-17T05:32:41.954 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "jwt_token_ttl", 2024-09-17T05:32:41.954 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.954 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.954 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.954 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "28800", 2024-09-17T05:32:41.954 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.954 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.954 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.954 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.954 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.954 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.955 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.955 INFO:teuthology.orchestra.run.smithi031.stdout: "key_file": { 2024-09-17T05:32:41.955 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "key_file", 2024-09-17T05:32:41.955 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.955 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.955 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.955 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.955 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.955 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.955 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.955 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.956 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.956 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.956 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.956 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.956 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.956 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.956 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.956 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.956 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.956 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.956 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.956 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.957 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.957 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.957 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.957 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.957 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.957 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.957 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.957 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.957 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.957 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.957 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.957 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.958 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.958 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.958 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.958 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.958 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.958 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.958 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.958 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.958 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.958 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.958 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.958 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.959 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.959 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.959 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.959 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.959 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.959 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.959 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.959 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.959 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.959 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.959 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.959 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.959 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.960 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.960 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.960 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.960 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.960 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.960 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.960 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.960 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.960 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.960 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.960 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.960 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.960 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.961 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.961 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.961 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.961 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.961 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.961 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.961 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.961 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.961 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.961 INFO:teuthology.orchestra.run.smithi031.stdout: "motd": { 2024-09-17T05:32:41.961 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "motd", 2024-09-17T05:32:41.961 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.962 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.962 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.962 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.962 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.962 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.962 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.962 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "The message of the day", 2024-09-17T05:32:41.962 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.962 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.962 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.962 INFO:teuthology.orchestra.run.smithi031.stdout: "redirect_resolve_ip_addr": { 2024-09-17T05:32:41.962 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "redirect_resolve_ip_addr", 2024-09-17T05:32:41.963 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.963 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.963 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.963 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.963 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.963 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.963 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.963 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.963 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.963 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.963 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.963 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-09-17T05:32:41.964 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-09-17T05:32:41.964 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.964 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.964 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.964 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "::", 2024-09-17T05:32:41.964 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.964 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.964 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.964 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.964 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.964 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.964 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.965 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-09-17T05:32:41.965 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-09-17T05:32:41.965 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.965 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.965 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.965 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8080", 2024-09-17T05:32:41.965 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.965 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.965 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.965 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.965 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.965 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.965 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.966 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.966 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.966 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.966 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.966 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.966 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.966 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.966 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.966 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.966 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.966 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.966 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.967 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.967 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl": { 2024-09-17T05:32:41.967 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl", 2024-09-17T05:32:41.967 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.967 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.967 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.967 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.967 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.967 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.967 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.967 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.967 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.968 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.968 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.968 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.968 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl_server_port": { 2024-09-17T05:32:41.968 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl_server_port", 2024-09-17T05:32:41.968 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.968 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.968 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.968 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8443", 2024-09-17T05:32:41.968 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.968 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.968 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.968 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.968 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.969 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.969 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.969 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.969 INFO:teuthology.orchestra.run.smithi031.stdout: "sso_oauth2": { 2024-09-17T05:32:41.969 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sso_oauth2", 2024-09-17T05:32:41.969 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.969 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.969 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.969 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.969 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.969 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.969 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.969 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.970 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.970 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.970 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.970 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_behaviour": { 2024-09-17T05:32:41.970 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_behaviour", 2024-09-17T05:32:41.970 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.970 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.970 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.970 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "redirect", 2024-09-17T05:32:41.970 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.970 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.970 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.970 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.971 INFO:teuthology.orchestra.run.smithi031.stdout: "redirect" 2024-09-17T05:32:41.971 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.971 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.971 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.971 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.971 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.971 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.971 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_error_status_code": { 2024-09-17T05:32:41.971 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_error_status_code", 2024-09-17T05:32:41.971 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.971 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.971 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.971 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "500", 2024-09-17T05:32:41.971 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "400", 2024-09-17T05:32:41.972 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "599", 2024-09-17T05:32:41.972 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.972 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.972 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.972 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.972 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.972 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.972 INFO:teuthology.orchestra.run.smithi031.stdout: "url_prefix": { 2024-09-17T05:32:41.972 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "url_prefix", 2024-09-17T05:32:41.972 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.972 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.972 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.972 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.973 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.973 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.973 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.973 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.973 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.973 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.973 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.973 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.973 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.973 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.973 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "devicehealth", 2024-09-17T05:32:41.973 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.974 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.974 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.974 INFO:teuthology.orchestra.run.smithi031.stdout: "enable_monitoring": { 2024-09-17T05:32:41.974 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enable_monitoring", 2024-09-17T05:32:41.974 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.974 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.974 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.974 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.974 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.974 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.974 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.974 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "monitor device health metrics", 2024-09-17T05:32:41.974 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.975 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.975 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.975 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.975 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.975 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.975 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.975 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.975 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.975 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.975 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.975 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.975 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.976 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.976 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.976 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.976 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.976 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.976 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.976 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.976 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.976 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.976 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.976 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.976 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.976 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.977 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.977 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.977 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.977 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.977 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.977 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.977 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.977 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.977 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.977 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.977 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.977 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.978 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.978 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.978 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.978 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.978 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.978 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.978 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.978 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.978 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.978 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.978 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.978 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.978 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.979 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.979 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.979 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.979 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.979 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.979 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.979 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.979 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.979 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.979 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.979 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.979 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.979 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.980 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.980 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.980 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.980 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.980 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.980 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.980 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.980 INFO:teuthology.orchestra.run.smithi031.stdout: "mark_out_threshold": { 2024-09-17T05:32:41.980 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mark_out_threshold", 2024-09-17T05:32:41.980 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.980 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.980 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.980 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "2419200", 2024-09-17T05:32:41.981 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.981 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.981 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.981 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-17T05:32:41.981 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.981 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.981 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.981 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.981 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_name": { 2024-09-17T05:32:41.981 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pool_name", 2024-09-17T05:32:41.981 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.981 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.982 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.982 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "device_health_metrics", 2024-09-17T05:32:41.982 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.982 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.982 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.982 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-17T05:32:41.982 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.982 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.982 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.982 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.982 INFO:teuthology.orchestra.run.smithi031.stdout: "retention_period": { 2024-09-17T05:32:41.982 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "retention_period", 2024-09-17T05:32:41.983 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.983 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.983 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.983 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15552000", 2024-09-17T05:32:41.983 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.983 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.983 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.983 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long to retain device health metrics", 2024-09-17T05:32:41.983 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.983 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.983 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.983 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.984 INFO:teuthology.orchestra.run.smithi031.stdout: "scrape_frequency": { 2024-09-17T05:32:41.984 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "scrape_frequency", 2024-09-17T05:32:41.984 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.984 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.984 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.984 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "86400", 2024-09-17T05:32:41.984 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.984 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.984 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.984 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-17T05:32:41.984 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.984 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.984 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.985 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.985 INFO:teuthology.orchestra.run.smithi031.stdout: "self_heal": { 2024-09-17T05:32:41.985 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "self_heal", 2024-09-17T05:32:41.985 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.985 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.985 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.985 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:41.985 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.985 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.985 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.985 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-17T05:32:41.985 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.986 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.986 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.986 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.986 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-09-17T05:32:41.986 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-09-17T05:32:41.986 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.986 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.986 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.986 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-09-17T05:32:41.986 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.986 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.986 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.986 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how frequently to wake up and check device health", 2024-09-17T05:32:41.987 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.987 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.987 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.987 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.987 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.987 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.987 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.987 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.987 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.987 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.987 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.987 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.987 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.988 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.988 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.988 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.988 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.988 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.988 INFO:teuthology.orchestra.run.smithi031.stdout: "warn_threshold": { 2024-09-17T05:32:41.988 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "warn_threshold", 2024-09-17T05:32:41.988 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:41.988 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.988 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.988 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "7257600", 2024-09-17T05:32:41.988 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.988 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.989 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.989 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-17T05:32:41.989 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.989 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.989 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.989 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.989 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:41.989 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.989 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:41.989 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "diskprediction_local", 2024-09-17T05:32:41.989 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:41.989 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:41.989 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:41.990 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:41.990 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:41.990 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.990 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.990 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.990 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:41.990 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.990 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.990 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.990 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.990 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.990 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.990 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.991 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.991 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.991 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.991 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.991 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.991 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.991 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.991 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.991 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:41.991 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:41.991 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.991 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.991 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.992 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.992 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.992 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.992 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.992 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.992 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.992 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.992 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.992 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.992 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:41.992 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:41.992 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.993 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.993 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.993 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:41.993 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.993 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.993 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:41.993 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:41.993 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:41.993 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:41.993 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:41.993 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:41.993 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:41.993 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:41.994 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.994 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.994 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.994 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.994 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:41.994 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:41.994 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:41.994 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.994 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.994 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:41.994 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.994 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.995 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.995 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.995 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.995 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.995 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.995 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.995 INFO:teuthology.orchestra.run.smithi031.stdout: "predict_interval": { 2024-09-17T05:32:41.995 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "predict_interval", 2024-09-17T05:32:41.995 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.995 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.995 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.995 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "86400", 2024-09-17T05:32:41.995 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.996 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.996 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.996 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.996 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.996 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.996 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.996 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.996 INFO:teuthology.orchestra.run.smithi031.stdout: "predictor_model": { 2024-09-17T05:32:41.996 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "predictor_model", 2024-09-17T05:32:41.996 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.996 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.997 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.997 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "prophetstor", 2024-09-17T05:32:41.997 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.997 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.997 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.997 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.997 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.997 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.997 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.997 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.997 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-09-17T05:32:41.997 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-09-17T05:32:41.997 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:41.998 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:41.998 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:41.998 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "600", 2024-09-17T05:32:41.998 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.998 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.998 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.998 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.998 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.998 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.998 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.998 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:41.998 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:41.998 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:41.999 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:41.999 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:41.999 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:41.999 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:41.999 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:41.999 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:41.999 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:41.999 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:41.999 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:41.999 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:41.999 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:41.999 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.000 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.000 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.000 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.000 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "influx", 2024-09-17T05:32:42.000 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": false, 2024-09-17T05:32:42.000 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "influxdb python module not found", 2024-09-17T05:32:42.000 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.000 INFO:teuthology.orchestra.run.smithi031.stdout: "batch_size": { 2024-09-17T05:32:42.000 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "batch_size", 2024-09-17T05:32:42.000 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.000 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.000 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.000 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5000", 2024-09-17T05:32:42.001 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.001 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.001 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.001 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-17T05:32:42.001 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.001 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.001 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.001 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.001 INFO:teuthology.orchestra.run.smithi031.stdout: "database": { 2024-09-17T05:32:42.001 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "database", 2024-09-17T05:32:42.001 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.001 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.001 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.002 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "ceph", 2024-09-17T05:32:42.002 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.002 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.002 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.002 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-17T05:32:42.002 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.002 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.002 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.002 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.002 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": { 2024-09-17T05:32:42.002 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "hostname", 2024-09-17T05:32:42.002 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.002 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.003 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.003 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.003 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.003 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.003 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.003 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB server hostname", 2024-09-17T05:32:42.003 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.003 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.003 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.003 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.003 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-09-17T05:32:42.003 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-09-17T05:32:42.003 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:42.004 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.004 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.004 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "30", 2024-09-17T05:32:42.004 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "5", 2024-09-17T05:32:42.004 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.004 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.004 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-17T05:32:42.004 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.004 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.004 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.004 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.004 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.004 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.005 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.005 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.005 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.005 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.005 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.005 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.005 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.005 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.005 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.005 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.005 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.005 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.005 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.006 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.006 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.006 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.006 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.006 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.006 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.006 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.006 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.006 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.006 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.006 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.006 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.007 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.007 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.007 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.007 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.007 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.007 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.007 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.007 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.007 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.007 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.007 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.007 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.007 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.007 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.008 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.008 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.008 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.008 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.008 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.008 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.008 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.008 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.008 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.008 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.008 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.008 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.009 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.009 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.009 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.009 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.009 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.009 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.009 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.009 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.009 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.009 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.009 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.009 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.010 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.010 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.010 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.010 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.010 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.010 INFO:teuthology.orchestra.run.smithi031.stdout: "password": { 2024-09-17T05:32:42.010 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "password", 2024-09-17T05:32:42.010 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.010 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.010 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.010 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.010 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.010 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.010 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.011 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "password of InfluxDB server user", 2024-09-17T05:32:42.011 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.011 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.011 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.011 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.011 INFO:teuthology.orchestra.run.smithi031.stdout: "port": { 2024-09-17T05:32:42.011 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "port", 2024-09-17T05:32:42.011 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.011 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.011 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.011 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "8086", 2024-09-17T05:32:42.011 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.011 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.012 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.012 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "InfluxDB server port", 2024-09-17T05:32:42.012 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.012 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.012 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.012 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.012 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.012 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.012 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.012 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.012 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.012 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.013 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.013 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.013 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.013 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.013 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.013 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.013 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.013 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.013 INFO:teuthology.orchestra.run.smithi031.stdout: "ssl": { 2024-09-17T05:32:42.013 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "ssl", 2024-09-17T05:32:42.013 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.013 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.013 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.014 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "false", 2024-09-17T05:32:42.014 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.014 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.014 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.014 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-17T05:32:42.014 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.014 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.014 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.014 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.014 INFO:teuthology.orchestra.run.smithi031.stdout: "threads": { 2024-09-17T05:32:42.014 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "threads", 2024-09-17T05:32:42.014 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.014 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.015 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.015 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-09-17T05:32:42.015 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-09-17T05:32:42.015 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "32", 2024-09-17T05:32:42.015 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.015 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-17T05:32:42.015 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.015 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.015 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.015 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.015 INFO:teuthology.orchestra.run.smithi031.stdout: "username": { 2024-09-17T05:32:42.015 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "username", 2024-09-17T05:32:42.015 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.015 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.015 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.016 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.016 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.016 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.016 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.016 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "username of InfluxDB server user", 2024-09-17T05:32:42.016 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.016 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.016 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.016 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.016 INFO:teuthology.orchestra.run.smithi031.stdout: "verify_ssl": { 2024-09-17T05:32:42.016 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "verify_ssl", 2024-09-17T05:32:42.016 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.016 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.017 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.017 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "true", 2024-09-17T05:32:42.017 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.017 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.017 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.017 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-17T05:32:42.017 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.017 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.017 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.017 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.017 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.018 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.018 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "insights", 2024-09-17T05:32:42.018 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.018 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.018 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.018 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.018 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.018 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.018 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.018 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.018 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.018 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.019 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.019 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.019 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.019 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.019 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.019 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.019 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.019 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.019 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.019 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.019 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.019 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.020 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.020 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.020 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.020 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.020 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.020 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.020 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.020 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.020 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.020 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.020 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.020 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.020 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.021 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.021 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.021 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.021 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.021 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.021 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.021 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.021 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.021 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.021 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.021 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.021 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.022 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.022 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.022 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.022 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.022 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.022 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.022 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.022 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.022 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.022 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.022 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.022 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.022 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.023 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.023 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.023 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.023 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.023 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.023 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.023 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.023 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.023 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.023 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.023 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.023 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.024 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.024 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.024 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.024 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.024 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.024 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.024 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.024 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.024 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.024 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.024 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.024 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.025 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.025 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.025 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.025 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.025 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.025 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "iostat", 2024-09-17T05:32:42.025 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.025 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.025 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.025 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.025 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.025 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.025 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.025 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.026 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.026 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.026 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.026 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.026 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.026 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.026 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.026 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.026 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.026 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.026 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.026 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.027 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.027 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.027 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.027 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.027 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.027 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.027 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.027 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.027 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.027 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.027 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.027 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.028 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.028 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.028 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.028 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.028 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.028 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.028 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.028 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.028 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.028 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.028 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.028 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.028 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.029 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.029 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.029 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.029 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.029 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.029 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.029 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.029 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.029 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.029 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.029 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.029 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.029 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.030 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.030 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.030 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.030 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.030 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.030 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.030 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.030 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.030 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.030 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.030 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.030 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.031 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.031 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.031 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.031 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.031 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.031 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.031 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.031 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.031 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.031 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.031 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.031 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.032 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.032 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.032 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.032 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.032 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.032 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "localpool", 2024-09-17T05:32:42.032 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.032 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.032 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.032 INFO:teuthology.orchestra.run.smithi031.stdout: "failure_domain": { 2024-09-17T05:32:42.032 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "failure_domain", 2024-09-17T05:32:42.032 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.033 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.033 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.033 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "host", 2024-09-17T05:32:42.033 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.033 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.033 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.033 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "failure domain for any created local pool", 2024-09-17T05:32:42.033 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-17T05:32:42.033 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.033 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.033 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.034 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.034 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.034 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.034 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.034 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.034 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.034 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.034 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.034 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.034 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.034 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.034 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.034 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.035 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.035 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.035 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.035 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.035 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.035 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.035 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.035 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.035 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.035 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.035 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.035 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.036 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.036 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.036 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.036 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.036 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.036 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.036 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.036 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.036 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.036 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.036 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.036 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.037 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.037 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.037 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.037 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.037 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.037 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.037 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.037 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.037 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.037 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.037 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.037 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.037 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.038 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.038 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.038 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.038 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.038 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.038 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.038 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.038 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.038 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.038 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.038 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.039 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.039 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.039 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.039 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.039 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.039 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.039 INFO:teuthology.orchestra.run.smithi031.stdout: "min_size": { 2024-09-17T05:32:42.039 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "min_size", 2024-09-17T05:32:42.039 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.039 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.039 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.039 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.040 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.040 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.040 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.040 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default min_size for any created local pool", 2024-09-17T05:32:42.040 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-17T05:32:42.040 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.040 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.040 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.040 INFO:teuthology.orchestra.run.smithi031.stdout: "num_rep": { 2024-09-17T05:32:42.040 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "num_rep", 2024-09-17T05:32:42.040 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.040 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.040 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.041 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3", 2024-09-17T05:32:42.041 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.041 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.041 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.041 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default replica count for any created local pool", 2024-09-17T05:32:42.041 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.041 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.041 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.041 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.041 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_num": { 2024-09-17T05:32:42.041 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pg_num", 2024-09-17T05:32:42.041 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.042 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.042 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.042 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "128", 2024-09-17T05:32:42.042 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.042 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.042 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.042 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "default pg_num for any created local pool", 2024-09-17T05:32:42.042 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.042 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.042 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.042 INFO:teuthology.orchestra.run.smithi031.stdout: "prefix": { 2024-09-17T05:32:42.042 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prefix", 2024-09-17T05:32:42.043 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.043 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.043 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.043 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.043 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.043 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.043 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.043 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "name prefix for any created local pool", 2024-09-17T05:32:42.043 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.043 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.043 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.043 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.043 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.043 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.044 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.044 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.044 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.044 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.044 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.044 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.044 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.044 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.044 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.044 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.044 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.044 INFO:teuthology.orchestra.run.smithi031.stdout: "subtree": { 2024-09-17T05:32:42.044 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "subtree", 2024-09-17T05:32:42.044 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.045 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.045 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.045 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "rack", 2024-09-17T05:32:42.045 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.045 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.045 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.045 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-17T05:32:42.045 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-17T05:32:42.045 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.045 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.045 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.045 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.045 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.046 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mirroring", 2024-09-17T05:32:42.046 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.046 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.046 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.046 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.046 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.046 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.046 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.046 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.046 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.046 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.046 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.046 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.047 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.047 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.047 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.047 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.047 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.047 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.047 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.047 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.047 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.047 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.047 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.047 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.047 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.048 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.048 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.048 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.048 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.048 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.048 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.048 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.048 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.048 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.048 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.048 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.048 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.048 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.049 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.049 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.049 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.049 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.049 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.049 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.049 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.049 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.049 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.049 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.049 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.049 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.050 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.050 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.050 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.050 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.050 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.050 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.050 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.050 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.050 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.050 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.050 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.050 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.051 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.051 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.051 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.051 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.051 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.051 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.051 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.051 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.051 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.051 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.051 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.051 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.051 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.052 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.052 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.052 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.052 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.052 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.052 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.052 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.052 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.052 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.052 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.052 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "nfs", 2024-09-17T05:32:42.053 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.053 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.053 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.053 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.053 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.053 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.053 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.053 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.053 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.053 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.053 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.053 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.054 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.054 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.054 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.054 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.054 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.054 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.054 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.054 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.054 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.054 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.054 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.055 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.055 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.055 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.055 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.055 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.055 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.055 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.055 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.055 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.055 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.055 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.055 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.056 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.056 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.056 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.056 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.056 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.056 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.056 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.056 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.056 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.056 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.056 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.057 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.057 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.057 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.057 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.057 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.057 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.057 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.057 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.057 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.057 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.057 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.057 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.057 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.058 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.058 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.058 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.058 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.058 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.058 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.058 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.058 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.058 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.058 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.059 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.059 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.059 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.059 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.059 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.059 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.059 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.059 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.059 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.059 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.059 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.059 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.059 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.060 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.060 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.060 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "orchestrator", 2024-09-17T05:32:42.060 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.060 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.060 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.060 INFO:teuthology.orchestra.run.smithi031.stdout: "fail_fs": { 2024-09-17T05:32:42.060 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "fail_fs", 2024-09-17T05:32:42.060 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.060 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.060 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.061 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.061 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.061 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.061 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.061 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-17T05:32:42.061 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.061 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.061 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.061 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.061 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.061 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.062 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.062 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.062 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.062 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.062 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.062 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.062 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.062 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.062 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.062 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.062 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.062 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.062 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.063 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.063 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.063 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.063 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.063 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.063 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.063 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.063 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.063 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.063 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.063 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.063 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.064 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.064 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.064 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.064 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.064 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.064 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.064 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.064 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.064 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.064 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.064 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.064 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.064 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.065 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.065 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.065 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.065 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.065 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.065 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.065 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.065 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.065 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.065 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.065 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.065 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.066 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.066 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.066 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.066 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.066 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.066 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.066 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.066 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.066 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.066 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.066 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.067 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.067 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.067 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator": { 2024-09-17T05:32:42.067 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "orchestrator", 2024-09-17T05:32:42.067 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.067 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.067 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.067 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.067 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.067 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.067 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.067 INFO:teuthology.orchestra.run.smithi031.stdout: "cephadm", 2024-09-17T05:32:42.068 INFO:teuthology.orchestra.run.smithi031.stdout: "rook", 2024-09-17T05:32:42.068 INFO:teuthology.orchestra.run.smithi031.stdout: "test_orchestrator" 2024-09-17T05:32:42.068 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.068 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Orchestrator backend", 2024-09-17T05:32:42.068 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.068 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.068 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.068 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.068 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.068 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.068 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.068 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.068 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.069 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.069 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.069 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.069 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.069 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.069 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.069 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.069 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.069 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.069 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "osd_perf_query", 2024-09-17T05:32:42.070 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.070 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.070 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.070 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.070 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.070 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.070 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.070 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.070 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.070 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.070 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.070 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.070 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.071 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.071 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.071 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.071 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.071 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.071 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.071 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.071 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.071 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.071 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.071 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.071 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.071 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.072 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.072 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.072 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.072 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.072 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.072 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.072 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.072 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.072 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.072 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.072 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.073 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.073 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.073 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.073 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.073 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.073 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.073 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.073 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.073 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.073 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.073 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.073 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.073 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.074 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.074 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.074 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.074 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.074 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.074 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.074 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.074 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.074 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.074 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.074 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.074 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.075 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.075 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.075 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.075 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.075 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.075 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.075 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.075 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.075 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.075 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.075 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.075 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.076 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.076 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.076 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.076 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.076 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.076 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.076 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.076 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.076 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.076 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.076 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "osd_support", 2024-09-17T05:32:42.077 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.077 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.077 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.077 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.077 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.077 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.077 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.077 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.077 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.077 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.077 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.077 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.077 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.078 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.078 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.078 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.078 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.078 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.078 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.078 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.078 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.078 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.078 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.078 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.078 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.079 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.079 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.079 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.079 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.079 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.079 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.079 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.079 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.079 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.079 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.079 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.079 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.080 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.080 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.080 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.080 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.080 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.080 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.080 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.080 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.080 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.080 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.080 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.080 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.080 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.081 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.081 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.081 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.081 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.081 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.081 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.081 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.081 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.081 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.081 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.081 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.082 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.083 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.083 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.083 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.083 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.083 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.083 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.083 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.083 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.083 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.083 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.083 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.084 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "pg_autoscaler", 2024-09-17T05:32:42.084 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.084 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.084 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.084 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.084 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.084 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.084 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.084 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.084 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.084 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.084 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.085 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.085 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.085 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.085 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.085 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.085 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.085 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.085 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.085 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.085 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.085 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.085 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.086 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.086 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.086 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.086 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.086 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.086 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.086 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.086 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.086 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.086 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.086 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.086 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.086 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.087 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.087 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.087 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.087 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.087 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.087 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.087 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.087 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.087 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.087 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.087 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.087 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.088 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.088 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.088 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.088 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.088 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.088 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.088 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.088 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.088 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.088 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.088 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.088 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.089 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.089 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.089 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.089 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.089 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.089 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.089 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.089 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.089 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.089 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-09-17T05:32:42.089 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-09-17T05:32:42.090 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:42.090 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.090 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.090 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-09-17T05:32:42.090 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.090 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.090 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.090 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.090 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.090 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.090 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.091 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.091 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.091 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.091 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.091 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.091 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.091 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.091 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.091 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.091 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.091 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.091 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.091 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.092 INFO:teuthology.orchestra.run.smithi031.stdout: "threshold": { 2024-09-17T05:32:42.092 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "threshold", 2024-09-17T05:32:42.092 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-09-17T05:32:42.092 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.092 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.092 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "3.0", 2024-09-17T05:32:42.092 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1.0", 2024-09-17T05:32:42.092 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.092 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.092 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "scaling threshold", 2024-09-17T05:32:42.092 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-17T05:32:42.093 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.093 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.093 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.093 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.093 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "progress", 2024-09-17T05:32:42.093 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.093 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.093 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.093 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_pg_recovery_event": { 2024-09-17T05:32:42.093 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_pg_recovery_event", 2024-09-17T05:32:42.094 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.094 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.094 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.094 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.094 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.094 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.094 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.094 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-17T05:32:42.094 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.094 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.094 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.094 INFO:teuthology.orchestra.run.smithi031.stdout: "enabled": { 2024-09-17T05:32:42.095 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enabled", 2024-09-17T05:32:42.095 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.095 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.095 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.095 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:42.095 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.095 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.095 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.095 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.095 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.095 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.095 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.096 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.096 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.096 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.096 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.096 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.096 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.096 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.096 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.096 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.096 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.096 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.096 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.097 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.097 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.097 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.097 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.097 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.097 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.097 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.097 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.097 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.097 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.097 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.097 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.098 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.098 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.098 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.098 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.098 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.098 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.098 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.098 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.098 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.098 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.098 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.098 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.099 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.099 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.099 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.099 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.099 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.099 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.099 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.099 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.099 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.099 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.099 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.099 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.099 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.100 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.100 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.100 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.100 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.100 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.100 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.100 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.100 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.100 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.100 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.100 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.100 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.101 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.101 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.101 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.101 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.101 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.101 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.101 INFO:teuthology.orchestra.run.smithi031.stdout: "max_completed_events": { 2024-09-17T05:32:42.101 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_completed_events", 2024-09-17T05:32:42.101 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.101 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.101 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.101 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "50", 2024-09-17T05:32:42.102 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.102 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.102 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.102 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "number of past completed events to remember", 2024-09-17T05:32:42.102 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.102 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.102 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.102 INFO:teuthology.orchestra.run.smithi031.stdout: "sleep_interval": { 2024-09-17T05:32:42.102 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sleep_interval", 2024-09-17T05:32:42.102 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:42.102 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.102 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.103 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-09-17T05:32:42.103 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.103 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.103 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.103 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "how long the module is going to sleep", 2024-09-17T05:32:42.103 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.103 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.103 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.103 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.103 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.103 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.103 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.104 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.104 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.104 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.104 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.104 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.104 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.104 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.104 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.104 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.104 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.104 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.104 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "prometheus", 2024-09-17T05:32:42.105 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.105 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.105 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.105 INFO:teuthology.orchestra.run.smithi031.stdout: "cache": { 2024-09-17T05:32:42.105 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cache", 2024-09-17T05:32:42.105 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.105 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.105 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.105 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:42.105 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.105 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.105 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.105 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.106 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.106 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.106 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.106 INFO:teuthology.orchestra.run.smithi031.stdout: "exclude_perf_counters": { 2024-09-17T05:32:42.106 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "exclude_perf_counters", 2024-09-17T05:32:42.106 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.106 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.106 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.106 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:42.106 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.106 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.106 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.106 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-17T05:32:42.106 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-17T05:32:42.107 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.107 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.107 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.107 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.107 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.107 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.107 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.107 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.107 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.107 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.107 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.107 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.107 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.107 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.108 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.108 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.108 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.108 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.108 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.108 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.108 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.108 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.108 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.108 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.108 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.108 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.108 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.109 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.109 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.109 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.109 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.109 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.109 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.109 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.109 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.109 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.109 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.109 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.109 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.110 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.110 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.110 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.110 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.110 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.110 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.110 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.110 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.110 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.110 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.110 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.110 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.110 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.110 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.110 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.111 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.111 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.111 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.111 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.111 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.111 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.111 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.111 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.111 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.111 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.111 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.111 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.111 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.112 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.112 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_stats_pools": { 2024-09-17T05:32:42.112 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_stats_pools", 2024-09-17T05:32:42.112 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.112 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.112 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.112 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.112 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.112 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.112 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.112 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.113 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.113 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.113 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.113 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-17T05:32:42.113 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-17T05:32:42.113 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.113 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.113 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.113 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "300", 2024-09-17T05:32:42.113 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.113 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.114 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.114 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.114 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.114 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.114 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.114 INFO:teuthology.orchestra.run.smithi031.stdout: "scrape_interval": { 2024-09-17T05:32:42.114 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "scrape_interval", 2024-09-17T05:32:42.114 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-09-17T05:32:42.114 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.114 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.114 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15.0", 2024-09-17T05:32:42.114 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.115 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.115 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.115 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.115 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.115 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.115 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.115 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-09-17T05:32:42.115 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-09-17T05:32:42.115 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.115 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.115 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.115 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "::", 2024-09-17T05:32:42.116 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.116 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.116 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.116 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-17T05:32:42.116 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.116 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.116 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.116 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-09-17T05:32:42.116 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-09-17T05:32:42.116 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.116 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.117 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.117 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "9283", 2024-09-17T05:32:42.117 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.117 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.117 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.117 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-17T05:32:42.117 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.117 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.117 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.117 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.117 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.117 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.118 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.118 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.118 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.118 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.118 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.118 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.118 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.118 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.118 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.118 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.118 INFO:teuthology.orchestra.run.smithi031.stdout: "stale_cache_strategy": { 2024-09-17T05:32:42.118 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "stale_cache_strategy", 2024-09-17T05:32:42.119 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.119 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.119 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.119 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "log", 2024-09-17T05:32:42.119 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.119 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.119 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.119 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.119 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.119 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.119 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.119 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_behaviour": { 2024-09-17T05:32:42.120 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_behaviour", 2024-09-17T05:32:42.120 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.120 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.120 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.120 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "default", 2024-09-17T05:32:42.120 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.120 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.120 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.120 INFO:teuthology.orchestra.run.smithi031.stdout: "default", 2024-09-17T05:32:42.120 INFO:teuthology.orchestra.run.smithi031.stdout: "error" 2024-09-17T05:32:42.120 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.120 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.121 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.121 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.121 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.121 INFO:teuthology.orchestra.run.smithi031.stdout: "standby_error_status_code": { 2024-09-17T05:32:42.121 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "standby_error_status_code", 2024-09-17T05:32:42.121 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.121 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.121 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.121 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "500", 2024-09-17T05:32:42.121 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "400", 2024-09-17T05:32:42.121 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "599", 2024-09-17T05:32:42.121 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.122 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.122 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.122 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.122 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.122 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.122 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.122 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.122 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_support", 2024-09-17T05:32:42.122 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.122 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.122 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.122 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.122 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.123 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.123 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.123 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.123 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.123 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.123 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.123 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.123 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.123 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.123 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.123 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.123 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.123 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.124 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.124 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.124 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.124 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.124 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.124 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.124 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.124 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.124 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.124 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.124 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.124 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.125 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.125 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.125 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.125 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.125 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.125 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.125 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.125 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.125 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.125 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.125 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.125 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.125 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.126 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.126 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.126 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.126 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.126 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.126 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.126 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.126 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.126 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.126 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.126 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.126 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.126 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.126 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.126 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.127 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.127 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.127 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.127 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.127 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.127 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.127 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.127 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.127 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.127 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.127 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.127 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.127 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.128 INFO:teuthology.orchestra.run.smithi031.stdout: "max_concurrent_snap_create": { 2024-09-17T05:32:42.128 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_concurrent_snap_create", 2024-09-17T05:32:42.128 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.128 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.128 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.128 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10", 2024-09-17T05:32:42.128 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.128 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.128 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.128 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.128 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.128 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.129 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.129 INFO:teuthology.orchestra.run.smithi031.stdout: "mirror_snapshot_schedule": { 2024-09-17T05:32:42.129 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "mirror_snapshot_schedule", 2024-09-17T05:32:42.129 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.129 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.129 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.129 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.129 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.129 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.129 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.129 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.129 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.130 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.130 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.130 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.130 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.130 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.130 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.130 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.130 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.130 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.130 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.130 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.130 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.131 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.131 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.131 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.131 INFO:teuthology.orchestra.run.smithi031.stdout: "trash_purge_schedule": { 2024-09-17T05:32:42.131 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "trash_purge_schedule", 2024-09-17T05:32:42.131 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.131 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.131 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.131 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.131 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.131 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.132 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.132 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.132 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.132 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.132 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.132 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.132 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.132 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.132 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.132 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "restful", 2024-09-17T05:32:42.132 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.133 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.133 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.133 INFO:teuthology.orchestra.run.smithi031.stdout: "enable_auth": { 2024-09-17T05:32:42.133 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enable_auth", 2024-09-17T05:32:42.133 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.133 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.133 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.133 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:42.133 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.133 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.133 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.133 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.133 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.134 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.134 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.134 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.134 INFO:teuthology.orchestra.run.smithi031.stdout: "key_file": { 2024-09-17T05:32:42.134 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "key_file", 2024-09-17T05:32:42.134 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.134 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.134 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.134 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.134 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.134 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.134 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.134 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.135 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.135 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.135 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.135 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.135 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.135 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.135 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.135 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.135 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.135 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.135 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.135 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.136 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.136 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.136 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.136 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.136 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.136 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.136 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.136 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.136 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.136 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.136 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.136 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.137 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.137 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.137 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.137 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.137 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.137 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.137 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.137 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.137 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.137 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.137 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.137 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.138 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.138 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.138 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.138 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.138 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.138 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.138 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.138 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.138 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.138 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.138 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.138 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.139 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.139 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.139 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.139 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.139 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.139 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.139 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.139 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.139 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.139 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.139 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.139 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.140 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.140 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.140 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.140 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.140 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.140 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.140 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.140 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.140 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.140 INFO:teuthology.orchestra.run.smithi031.stdout: "max_requests": { 2024-09-17T05:32:42.140 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_requests", 2024-09-17T05:32:42.140 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.141 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.141 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.141 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "500", 2024-09-17T05:32:42.141 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.141 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.141 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.141 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-17T05:32:42.141 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.141 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.141 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.141 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.141 INFO:teuthology.orchestra.run.smithi031.stdout: "server_addr": { 2024-09-17T05:32:42.141 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_addr", 2024-09-17T05:32:42.142 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.142 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.142 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.142 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.142 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.142 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.142 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.142 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.142 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.142 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.142 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.143 INFO:teuthology.orchestra.run.smithi031.stdout: "server_port": { 2024-09-17T05:32:42.143 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "server_port", 2024-09-17T05:32:42.143 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.143 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.143 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.143 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.143 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.143 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.143 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.143 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.143 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.143 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.143 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.144 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.144 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.144 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.144 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.144 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.144 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.144 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.144 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.144 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.144 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.144 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.144 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.144 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.145 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.145 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.145 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.145 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.145 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rgw", 2024-09-17T05:32:42.145 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.145 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.145 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.145 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.145 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.145 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.146 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.146 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.146 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.146 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.146 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.146 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.146 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.146 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.146 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.146 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.146 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.146 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.146 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.146 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.147 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.147 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.147 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.147 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.147 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.147 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.147 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.147 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.147 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.147 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.147 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.148 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.148 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.148 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.148 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.148 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.148 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.148 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.148 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.148 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.148 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.148 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.148 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.148 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.149 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.149 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.149 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.149 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.149 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.149 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.149 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.149 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.149 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.149 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.149 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.149 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.149 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.150 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.150 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.150 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.150 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.150 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.150 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.150 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.150 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.150 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.150 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.150 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.150 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.150 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.150 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.151 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.151 INFO:teuthology.orchestra.run.smithi031.stdout: "secondary_zone_period_retry_limit": { 2024-09-17T05:32:42.151 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-17T05:32:42.151 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.151 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.151 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.151 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "5", 2024-09-17T05:32:42.151 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.151 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.151 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.151 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-17T05:32:42.151 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.151 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.152 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.152 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.152 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.152 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.152 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.152 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.152 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.152 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.152 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.152 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.152 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.152 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.153 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.153 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.153 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.153 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.153 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "selftest", 2024-09-17T05:32:42.153 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.153 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.153 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.153 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.153 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.153 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.154 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.154 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.154 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.154 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.154 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.154 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.154 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.154 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.154 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.154 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.154 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.154 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.154 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.154 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.155 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.155 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.155 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.155 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.155 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.155 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.155 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.155 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.155 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.155 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.155 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.155 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.156 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.156 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.156 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.156 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.156 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.156 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.156 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.156 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.156 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.156 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.156 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.156 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.157 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.157 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.157 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.157 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.157 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.157 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.157 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.157 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.157 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.157 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.157 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.157 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.158 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.158 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.158 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.158 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.158 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.158 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.158 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.158 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.158 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.158 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.158 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.158 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.159 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.159 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.159 INFO:teuthology.orchestra.run.smithi031.stdout: "roption1": { 2024-09-17T05:32:42.159 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "roption1", 2024-09-17T05:32:42.159 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.159 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.159 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.159 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.159 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.159 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.159 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.159 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.159 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.160 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.160 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.160 INFO:teuthology.orchestra.run.smithi031.stdout: "roption2": { 2024-09-17T05:32:42.160 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "roption2", 2024-09-17T05:32:42.160 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.160 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.160 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.160 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "xyz", 2024-09-17T05:32:42.160 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.160 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.160 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.160 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.161 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.161 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.161 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.161 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption1": { 2024-09-17T05:32:42.161 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption1", 2024-09-17T05:32:42.161 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.161 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.161 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.161 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.161 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.161 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.161 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.162 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.162 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.162 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.162 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.162 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption2": { 2024-09-17T05:32:42.162 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption2", 2024-09-17T05:32:42.162 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.162 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.162 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.162 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.162 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.162 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.162 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.163 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.163 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.163 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.163 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.163 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption3": { 2024-09-17T05:32:42.163 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption3", 2024-09-17T05:32:42.163 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "float", 2024-09-17T05:32:42.163 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.163 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.163 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.163 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.163 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.163 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.164 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.164 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.164 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.164 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.164 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption4": { 2024-09-17T05:32:42.164 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption4", 2024-09-17T05:32:42.164 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.164 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.164 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.164 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.164 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.164 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.164 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.165 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.165 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.165 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.165 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.165 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption5": { 2024-09-17T05:32:42.165 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption5", 2024-09-17T05:32:42.165 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.165 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.165 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.165 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.165 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.165 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.166 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.166 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.166 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.166 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.166 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.166 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption6": { 2024-09-17T05:32:42.166 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption6", 2024-09-17T05:32:42.166 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.166 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.166 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.166 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:42.166 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.166 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.167 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.167 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.167 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.167 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.167 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.167 INFO:teuthology.orchestra.run.smithi031.stdout: "rwoption7": { 2024-09-17T05:32:42.167 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rwoption7", 2024-09-17T05:32:42.167 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.167 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.167 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.167 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.167 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "1", 2024-09-17T05:32:42.168 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "42", 2024-09-17T05:32:42.168 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.168 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.168 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.168 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.168 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.168 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.168 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.168 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.168 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.168 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.168 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.169 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.169 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.169 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.169 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.169 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.169 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.169 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.169 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.169 INFO:teuthology.orchestra.run.smithi031.stdout: "testkey": { 2024-09-17T05:32:42.169 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testkey", 2024-09-17T05:32:42.169 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.169 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.169 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.169 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.170 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.170 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.170 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.170 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.170 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.170 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.170 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.170 INFO:teuthology.orchestra.run.smithi031.stdout: "testlkey": { 2024-09-17T05:32:42.170 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testlkey", 2024-09-17T05:32:42.170 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.170 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.170 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.171 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.171 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.171 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.171 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.171 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.171 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.171 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.171 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.171 INFO:teuthology.orchestra.run.smithi031.stdout: "testnewline": { 2024-09-17T05:32:42.171 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "testnewline", 2024-09-17T05:32:42.171 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.171 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.171 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.172 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.172 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.172 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.172 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.172 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.172 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.172 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.172 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.172 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.172 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.172 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.172 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snap_schedule", 2024-09-17T05:32:42.173 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.173 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.173 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.173 INFO:teuthology.orchestra.run.smithi031.stdout: "allow_m_granularity": { 2024-09-17T05:32:42.173 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "allow_m_granularity", 2024-09-17T05:32:42.173 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.173 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.173 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.173 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.173 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.173 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.173 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.173 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "allow minute scheduled snapshots", 2024-09-17T05:32:42.174 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.174 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.174 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.174 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.174 INFO:teuthology.orchestra.run.smithi031.stdout: "dump_on_update": { 2024-09-17T05:32:42.174 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "dump_on_update", 2024-09-17T05:32:42.174 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.174 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.174 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.174 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.174 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.174 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.174 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.175 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "dump database to debug log on update", 2024-09-17T05:32:42.175 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.175 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.175 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.175 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.175 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.175 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.175 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.175 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.175 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.175 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.175 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.176 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.176 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.176 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.176 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.176 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.176 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.176 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.176 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.176 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.176 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.176 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.176 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.177 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.177 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.177 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.177 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.177 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.177 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.177 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.177 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.177 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.177 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.177 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.177 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.178 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.178 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.178 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.178 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.178 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.178 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.178 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.178 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.178 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.178 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.178 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.178 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.178 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.179 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.179 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.179 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.179 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.179 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.179 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.179 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.179 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.179 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.179 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.179 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.180 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.180 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.180 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.180 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.180 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.180 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.180 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.180 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.180 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.180 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.180 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.180 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.181 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.181 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.181 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.181 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.181 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.181 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.181 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.181 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.181 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.181 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.181 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.181 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.182 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.182 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.182 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.182 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "stats", 2024-09-17T05:32:42.182 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.182 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.182 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.182 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.182 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.182 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.182 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.183 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.183 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.183 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.183 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.183 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.183 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.183 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.183 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.183 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.183 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.183 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.183 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.184 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.184 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.184 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.184 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.184 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.184 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.184 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.184 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.184 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.184 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.184 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.184 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.185 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.185 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.185 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.185 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.185 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.185 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.185 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.185 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.185 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.185 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.185 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.185 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.185 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.185 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.186 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.186 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.186 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.186 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.186 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.186 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.186 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.186 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.186 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.186 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.186 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.186 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.187 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.187 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.187 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.187 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.187 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.187 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.187 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.187 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.187 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.187 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.187 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.187 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.187 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.188 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.188 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.188 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.188 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.188 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.188 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.188 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.188 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.188 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.188 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.188 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.188 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.189 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.189 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.189 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.189 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "status", 2024-09-17T05:32:42.189 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.189 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.189 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.189 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.189 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.189 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.189 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.190 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.190 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.190 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.190 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.190 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.190 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.190 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.190 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.190 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.190 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.190 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.190 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.190 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.191 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.191 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.191 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.191 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.191 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.191 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.191 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.191 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.191 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.191 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.191 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.191 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.191 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.192 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.192 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.192 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.192 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.192 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.192 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.192 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.192 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.192 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.192 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.192 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.192 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.193 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.193 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.193 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.193 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.193 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.193 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.193 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.193 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.193 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.193 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.193 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.193 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.193 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.194 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.194 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.194 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.194 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.194 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.194 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.194 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.194 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.194 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.194 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.194 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.195 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.195 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.195 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.195 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.195 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.195 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.195 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.195 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.195 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.195 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.195 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.195 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.195 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.196 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.196 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.196 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.196 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.196 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "telegraf", 2024-09-17T05:32:42.196 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.196 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.196 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.196 INFO:teuthology.orchestra.run.smithi031.stdout: "address": { 2024-09-17T05:32:42.196 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "address", 2024-09-17T05:32:42.196 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.197 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.197 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.197 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-17T05:32:42.197 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.197 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.197 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.197 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.197 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.197 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.197 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.197 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-09-17T05:32:42.197 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-09-17T05:32:42.198 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:42.198 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.198 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.198 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "15", 2024-09-17T05:32:42.198 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.198 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.198 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.198 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.198 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.198 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.198 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.198 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.198 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.198 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.199 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.199 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.199 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.199 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.199 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.199 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.199 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.199 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.199 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.199 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.199 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.199 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.199 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.199 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.200 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.200 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.200 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.200 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.200 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.200 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.200 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.200 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.200 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.200 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.200 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.201 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.201 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.201 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.201 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.201 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.201 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.201 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.201 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.201 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.201 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.201 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.201 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.202 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.202 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.202 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.202 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.202 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.202 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.202 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.202 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.202 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.202 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.202 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.202 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.202 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.202 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.203 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.203 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.203 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.203 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.203 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.203 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.203 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.203 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.203 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.203 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.203 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.203 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.204 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.204 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.204 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.204 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.204 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.204 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.204 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.204 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.204 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.204 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.204 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.205 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.205 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.205 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.205 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.205 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.205 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.205 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "telemetry", 2024-09-17T05:32:42.205 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.205 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.205 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.205 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_basic": { 2024-09-17T05:32:42.205 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_basic", 2024-09-17T05:32:42.205 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.206 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.206 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.206 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:42.206 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.206 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.206 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.206 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-17T05:32:42.206 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.206 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.206 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.206 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.206 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_crash": { 2024-09-17T05:32:42.206 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_crash", 2024-09-17T05:32:42.206 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.206 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.207 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.207 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:42.207 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.207 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.207 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.207 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-17T05:32:42.207 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.207 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.207 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.207 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_device": { 2024-09-17T05:32:42.207 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_device", 2024-09-17T05:32:42.207 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.207 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.208 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.208 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:42.208 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.208 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.208 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.208 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-17T05:32:42.208 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.208 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.208 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.208 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_ident": { 2024-09-17T05:32:42.208 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_ident", 2024-09-17T05:32:42.208 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.209 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.209 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.209 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.209 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.209 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.209 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.209 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-17T05:32:42.209 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.209 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.209 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.209 INFO:teuthology.orchestra.run.smithi031.stdout: "channel_perf": { 2024-09-17T05:32:42.209 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "channel_perf", 2024-09-17T05:32:42.210 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.210 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.210 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.210 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.210 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.210 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.210 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.210 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-17T05:32:42.210 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.210 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.210 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.210 INFO:teuthology.orchestra.run.smithi031.stdout: "contact": { 2024-09-17T05:32:42.210 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "contact", 2024-09-17T05:32:42.210 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.211 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.211 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.211 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.211 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.211 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.211 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.211 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.211 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.211 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.211 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.211 INFO:teuthology.orchestra.run.smithi031.stdout: "description": { 2024-09-17T05:32:42.211 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "description", 2024-09-17T05:32:42.211 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.211 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.212 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.212 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.212 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.212 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.212 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.212 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.212 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.212 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.212 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.212 INFO:teuthology.orchestra.run.smithi031.stdout: "device_url": { 2024-09-17T05:32:42.212 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "device_url", 2024-09-17T05:32:42.212 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.212 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.213 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.213 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-17T05:32:42.213 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.213 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.213 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.213 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.213 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.213 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.213 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.213 INFO:teuthology.orchestra.run.smithi031.stdout: "enabled": { 2024-09-17T05:32:42.213 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "enabled", 2024-09-17T05:32:42.213 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.214 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.214 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.214 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.214 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.214 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.214 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.214 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.214 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.214 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.214 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.214 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-09-17T05:32:42.214 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-09-17T05:32:42.215 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.215 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.215 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.215 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "24", 2024-09-17T05:32:42.215 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "8", 2024-09-17T05:32:42.215 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.215 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.215 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.215 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.215 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.215 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.215 INFO:teuthology.orchestra.run.smithi031.stdout: "last_opt_revision": { 2024-09-17T05:32:42.216 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "last_opt_revision", 2024-09-17T05:32:42.216 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.216 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.216 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.216 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "1", 2024-09-17T05:32:42.216 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.216 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.216 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.216 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.216 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.216 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.216 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.216 INFO:teuthology.orchestra.run.smithi031.stdout: "leaderboard": { 2024-09-17T05:32:42.217 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "leaderboard", 2024-09-17T05:32:42.217 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.217 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.217 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.217 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.217 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.217 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.217 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.217 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.217 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.217 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.217 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.218 INFO:teuthology.orchestra.run.smithi031.stdout: "leaderboard_description": { 2024-09-17T05:32:42.218 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "leaderboard_description", 2024-09-17T05:32:42.218 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.218 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.218 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.218 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.218 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.218 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.218 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.218 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.218 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.218 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.218 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.219 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.219 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.219 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.219 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.219 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.219 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.219 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.219 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.219 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.219 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.219 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.219 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.219 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.220 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.220 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.220 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.220 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.220 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.220 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.220 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.220 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.220 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.220 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.220 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.220 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.220 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.220 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.221 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.221 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.221 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.221 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.221 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.221 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.221 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.221 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.221 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.221 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.221 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.221 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.221 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.221 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.222 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.222 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.222 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.222 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.222 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.222 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.222 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.222 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.222 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.222 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.222 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.222 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.222 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.223 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.223 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.223 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.223 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.223 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.223 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.223 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.223 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.223 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.223 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.223 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.223 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.223 INFO:teuthology.orchestra.run.smithi031.stdout: "organization": { 2024-09-17T05:32:42.224 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "organization", 2024-09-17T05:32:42.224 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.224 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.224 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.224 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.224 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.224 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.224 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.224 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.224 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.224 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.224 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.224 INFO:teuthology.orchestra.run.smithi031.stdout: "proxy": { 2024-09-17T05:32:42.225 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "proxy", 2024-09-17T05:32:42.225 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.225 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.225 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.225 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.225 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.225 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.225 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.225 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.225 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.225 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.225 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.225 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.226 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.226 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.226 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.226 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.226 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.226 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.226 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.226 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.226 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.226 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.226 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.226 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.226 INFO:teuthology.orchestra.run.smithi031.stdout: "url": { 2024-09-17T05:32:42.227 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "url", 2024-09-17T05:32:42.227 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.227 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.227 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.227 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-17T05:32:42.227 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.227 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.227 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.227 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.227 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.227 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.227 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.227 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.227 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.228 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "test_orchestrator", 2024-09-17T05:32:42.228 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.228 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.228 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.228 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.228 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.228 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.228 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.228 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.228 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.228 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.228 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.228 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.229 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.229 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.229 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.229 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.229 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.229 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.229 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.229 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.229 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.229 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.229 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.229 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.230 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.230 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.230 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.230 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.230 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.230 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.230 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.230 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.230 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.230 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.230 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.230 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.230 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.230 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.231 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.231 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.231 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.231 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.231 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.231 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.231 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.231 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.231 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.231 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.231 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.231 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.232 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.232 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.232 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.232 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.232 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.232 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.232 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.232 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.232 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.232 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.232 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.232 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.232 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.233 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.233 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.233 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.233 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.233 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.233 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.233 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.233 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.233 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.233 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.233 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.233 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.234 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.234 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.234 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.234 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.234 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.234 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.287+0000 7ff233e00640 1 -- 172.21.15.31:0/3858699917 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff214073560 msgr2=0x7ff214075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:42.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.287+0000 7ff233e00640 1 --2- 172.21.15.31:0/3858699917 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff214073560 0x7ff214075a20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff2240af000 tx=0x7ff22401b060 comp rx=0 tx=0).stop 2024-09-17T05:32:42.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.287+0000 7ff233e00640 1 -- 172.21.15.31:0/3858699917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2340cda50 msgr2=0x7ff2341fb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:42.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.287+0000 7ff233e00640 1 --2- 172.21.15.31:0/3858699917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2340cda50 0x7ff2341fb980 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff22000c730 tx=0x7ff22000cbf0 comp rx=0 tx=0).stop 2024-09-17T05:32:42.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.287+0000 7ff233e00640 1 -- 172.21.15.31:0/3858699917 shutdown_connections 2024-09-17T05:32:42.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.287+0000 7ff233e00640 1 --2- 172.21.15.31:0/3858699917 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7ff214073560 0x7ff214075a20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:42.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.287+0000 7ff233e00640 1 --2- 172.21.15.31:0/3858699917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff234155080 0x7ff2341f7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:42.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.287+0000 7ff233e00640 1 --2- 172.21.15.31:0/3858699917 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2340cda50 0x7ff2341fb980 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:42.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.287+0000 7ff233e00640 1 --2- 172.21.15.31:0/3858699917 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2340cba70 0x7ff2341fb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:42.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.287+0000 7ff233e00640 1 -- 172.21.15.31:0/3858699917 >> 172.21.15.31:0/3858699917 conn(0x7ff23406dd30 msgr2=0x7ff2340b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:42.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.287+0000 7ff233e00640 1 -- 172.21.15.31:0/3858699917 shutdown_connections 2024-09-17T05:32:42.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:41.287+0000 7ff233e00640 1 -- 172.21.15.31:0/3858699917 wait complete. 2024-09-17T05:32:42.236 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.236 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.236 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.237 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "volumes", 2024-09-17T05:32:42.237 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.237 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.237 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.237 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.237 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.237 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.237 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.237 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.237 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.237 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.238 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.238 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.238 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.238 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.238 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.238 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.238 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.238 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.238 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.238 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.238 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.238 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.238 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.239 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.239 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.239 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.239 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.239 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.239 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.239 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.239 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.239 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.239 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.239 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.239 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.239 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.240 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.240 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.240 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.240 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.240 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.240 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.240 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.240 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.240 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.240 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.240 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.240 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.241 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.241 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.241 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.241 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.241 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.241 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.241 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.241 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.241 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.241 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.241 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.241 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.242 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.242 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.242 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.242 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.242 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.242 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.242 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.242 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.242 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.242 INFO:teuthology.orchestra.run.smithi031.stdout: "max_concurrent_clones": { 2024-09-17T05:32:42.242 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "max_concurrent_clones", 2024-09-17T05:32:42.242 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.242 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.243 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.243 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "4", 2024-09-17T05:32:42.243 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.243 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.243 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.243 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-17T05:32:42.243 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.243 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.243 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.243 INFO:teuthology.orchestra.run.smithi031.stdout: "periodic_async_work": { 2024-09-17T05:32:42.243 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "periodic_async_work", 2024-09-17T05:32:42.243 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.243 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.244 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.244 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.244 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.244 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.244 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.244 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Periodically check for async work", 2024-09-17T05:32:42.244 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.244 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.244 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.244 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot_clone_delay": { 2024-09-17T05:32:42.244 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snapshot_clone_delay", 2024-09-17T05:32:42.244 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.245 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.245 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.245 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.245 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.245 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.245 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.245 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-17T05:32:42.245 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.245 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.245 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.245 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot_clone_no_wait": { 2024-09-17T05:32:42.245 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "snapshot_clone_no_wait", 2024-09-17T05:32:42.246 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.246 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.246 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.246 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "True", 2024-09-17T05:32:42.246 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.246 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.246 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.246 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-17T05:32:42.246 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.246 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.246 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.246 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.247 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.247 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.247 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.247 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.247 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.247 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.247 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.247 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.247 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.247 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.247 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.247 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.247 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.248 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.248 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix", 2024-09-17T05:32:42.248 INFO:teuthology.orchestra.run.smithi031.stdout: "can_run": true, 2024-09-17T05:32:42.248 INFO:teuthology.orchestra.run.smithi031.stdout: "error_string": "", 2024-09-17T05:32:42.248 INFO:teuthology.orchestra.run.smithi031.stdout: "module_options": { 2024-09-17T05:32:42.248 INFO:teuthology.orchestra.run.smithi031.stdout: "discovery_interval": { 2024-09-17T05:32:42.248 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "discovery_interval", 2024-09-17T05:32:42.248 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "uint", 2024-09-17T05:32:42.248 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.248 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.248 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "100", 2024-09-17T05:32:42.249 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.249 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.249 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.249 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.249 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.249 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.249 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.249 INFO:teuthology.orchestra.run.smithi031.stdout: "identifier": { 2024-09-17T05:32:42.249 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "identifier", 2024-09-17T05:32:42.249 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.250 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.250 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.250 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.250 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.250 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.250 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.250 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.250 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.250 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.250 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.250 INFO:teuthology.orchestra.run.smithi031.stdout: "interval": { 2024-09-17T05:32:42.250 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "interval", 2024-09-17T05:32:42.251 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "secs", 2024-09-17T05:32:42.251 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.251 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.251 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "60", 2024-09-17T05:32:42.251 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.251 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.251 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.251 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.251 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.251 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.251 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.251 INFO:teuthology.orchestra.run.smithi031.stdout: "log_level": { 2024-09-17T05:32:42.252 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_level", 2024-09-17T05:32:42.252 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.252 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.252 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.252 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.252 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.252 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.252 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.252 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.252 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.252 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.252 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.252 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.253 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.253 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.253 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.253 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.253 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.253 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.253 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster": { 2024-09-17T05:32:42.253 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster", 2024-09-17T05:32:42.253 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.253 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.253 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.253 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.253 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.254 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.254 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.254 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.254 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.254 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.254 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.254 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_cluster_level": { 2024-09-17T05:32:42.254 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_cluster_level", 2024-09-17T05:32:42.254 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.254 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.254 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.254 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "info", 2024-09-17T05:32:42.255 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.255 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.255 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [ 2024-09-17T05:32:42.255 INFO:teuthology.orchestra.run.smithi031.stdout: "", 2024-09-17T05:32:42.255 INFO:teuthology.orchestra.run.smithi031.stdout: "critical", 2024-09-17T05:32:42.255 INFO:teuthology.orchestra.run.smithi031.stdout: "debug", 2024-09-17T05:32:42.255 INFO:teuthology.orchestra.run.smithi031.stdout: "error", 2024-09-17T05:32:42.255 INFO:teuthology.orchestra.run.smithi031.stdout: "info", 2024-09-17T05:32:42.255 INFO:teuthology.orchestra.run.smithi031.stdout: "warning" 2024-09-17T05:32:42.255 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.255 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.255 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.255 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.256 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.256 INFO:teuthology.orchestra.run.smithi031.stdout: "log_to_file": { 2024-09-17T05:32:42.256 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "log_to_file", 2024-09-17T05:32:42.256 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "bool", 2024-09-17T05:32:42.256 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.256 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.256 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "False", 2024-09-17T05:32:42.256 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.256 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.256 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.256 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.256 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.257 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.257 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.257 INFO:teuthology.orchestra.run.smithi031.stdout: "sqlite3_killpoint": { 2024-09-17T05:32:42.257 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:32:42.257 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.257 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "dev", 2024-09-17T05:32:42.257 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 1, 2024-09-17T05:32:42.257 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "0", 2024-09-17T05:32:42.257 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.257 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.257 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.257 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.257 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.258 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.258 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.258 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_host": { 2024-09-17T05:32:42.258 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_host", 2024-09-17T05:32:42.258 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.258 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.258 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.258 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "", 2024-09-17T05:32:42.258 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.258 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.258 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.259 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.259 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.259 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.259 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.259 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_port": { 2024-09-17T05:32:42.259 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_port", 2024-09-17T05:32:42.259 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "int", 2024-09-17T05:32:42.259 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.259 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.259 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "10051", 2024-09-17T05:32:42.259 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.260 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.260 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.260 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.260 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.260 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.260 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.260 INFO:teuthology.orchestra.run.smithi031.stdout: "zabbix_sender": { 2024-09-17T05:32:42.260 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "zabbix_sender", 2024-09-17T05:32:42.260 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "str", 2024-09-17T05:32:42.260 INFO:teuthology.orchestra.run.smithi031.stdout: "level": "advanced", 2024-09-17T05:32:42.260 INFO:teuthology.orchestra.run.smithi031.stdout: "flags": 0, 2024-09-17T05:32:42.261 INFO:teuthology.orchestra.run.smithi031.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-17T05:32:42.261 INFO:teuthology.orchestra.run.smithi031.stdout: "min": "", 2024-09-17T05:32:42.261 INFO:teuthology.orchestra.run.smithi031.stdout: "max": "", 2024-09-17T05:32:42.261 INFO:teuthology.orchestra.run.smithi031.stdout: "enum_allowed": [], 2024-09-17T05:32:42.261 INFO:teuthology.orchestra.run.smithi031.stdout: "desc": "", 2024-09-17T05:32:42.261 INFO:teuthology.orchestra.run.smithi031.stdout: "long_desc": "", 2024-09-17T05:32:42.261 INFO:teuthology.orchestra.run.smithi031.stdout: "tags": [], 2024-09-17T05:32:42.261 INFO:teuthology.orchestra.run.smithi031.stdout: "see_also": [] 2024-09-17T05:32:42.261 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.261 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.261 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.261 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.261 INFO:teuthology.orchestra.run.smithi031.stdout: "services": {}, 2024-09-17T05:32:42.262 INFO:teuthology.orchestra.run.smithi031.stdout: "always_on_modules": { 2024-09-17T05:32:42.262 INFO:teuthology.orchestra.run.smithi031.stdout: "octopus": [ 2024-09-17T05:32:42.262 INFO:teuthology.orchestra.run.smithi031.stdout: "balancer", 2024-09-17T05:32:42.262 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-09-17T05:32:42.262 INFO:teuthology.orchestra.run.smithi031.stdout: "devicehealth", 2024-09-17T05:32:42.262 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator", 2024-09-17T05:32:42.262 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscaler", 2024-09-17T05:32:42.262 INFO:teuthology.orchestra.run.smithi031.stdout: "progress", 2024-09-17T05:32:42.262 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_support", 2024-09-17T05:32:42.262 INFO:teuthology.orchestra.run.smithi031.stdout: "status", 2024-09-17T05:32:42.262 INFO:teuthology.orchestra.run.smithi031.stdout: "telemetry", 2024-09-17T05:32:42.262 INFO:teuthology.orchestra.run.smithi031.stdout: "volumes" 2024-09-17T05:32:42.262 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.263 INFO:teuthology.orchestra.run.smithi031.stdout: "pacific": [ 2024-09-17T05:32:42.263 INFO:teuthology.orchestra.run.smithi031.stdout: "balancer", 2024-09-17T05:32:42.263 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-09-17T05:32:42.263 INFO:teuthology.orchestra.run.smithi031.stdout: "devicehealth", 2024-09-17T05:32:42.263 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator", 2024-09-17T05:32:42.263 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscaler", 2024-09-17T05:32:42.263 INFO:teuthology.orchestra.run.smithi031.stdout: "progress", 2024-09-17T05:32:42.263 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_support", 2024-09-17T05:32:42.263 INFO:teuthology.orchestra.run.smithi031.stdout: "status", 2024-09-17T05:32:42.263 INFO:teuthology.orchestra.run.smithi031.stdout: "telemetry", 2024-09-17T05:32:42.263 INFO:teuthology.orchestra.run.smithi031.stdout: "volumes" 2024-09-17T05:32:42.263 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.263 INFO:teuthology.orchestra.run.smithi031.stdout: "quincy": [ 2024-09-17T05:32:42.264 INFO:teuthology.orchestra.run.smithi031.stdout: "balancer", 2024-09-17T05:32:42.264 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-09-17T05:32:42.264 INFO:teuthology.orchestra.run.smithi031.stdout: "devicehealth", 2024-09-17T05:32:42.264 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator", 2024-09-17T05:32:42.264 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscaler", 2024-09-17T05:32:42.264 INFO:teuthology.orchestra.run.smithi031.stdout: "progress", 2024-09-17T05:32:42.264 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_support", 2024-09-17T05:32:42.264 INFO:teuthology.orchestra.run.smithi031.stdout: "status", 2024-09-17T05:32:42.264 INFO:teuthology.orchestra.run.smithi031.stdout: "telemetry", 2024-09-17T05:32:42.264 INFO:teuthology.orchestra.run.smithi031.stdout: "volumes" 2024-09-17T05:32:42.264 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.264 INFO:teuthology.orchestra.run.smithi031.stdout: "reef": [ 2024-09-17T05:32:42.265 INFO:teuthology.orchestra.run.smithi031.stdout: "balancer", 2024-09-17T05:32:42.265 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-09-17T05:32:42.265 INFO:teuthology.orchestra.run.smithi031.stdout: "devicehealth", 2024-09-17T05:32:42.265 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator", 2024-09-17T05:32:42.265 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscaler", 2024-09-17T05:32:42.265 INFO:teuthology.orchestra.run.smithi031.stdout: "progress", 2024-09-17T05:32:42.265 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_support", 2024-09-17T05:32:42.265 INFO:teuthology.orchestra.run.smithi031.stdout: "status", 2024-09-17T05:32:42.265 INFO:teuthology.orchestra.run.smithi031.stdout: "telemetry", 2024-09-17T05:32:42.265 INFO:teuthology.orchestra.run.smithi031.stdout: "volumes" 2024-09-17T05:32:42.265 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:32:42.265 INFO:teuthology.orchestra.run.smithi031.stdout: "squid": [ 2024-09-17T05:32:42.265 INFO:teuthology.orchestra.run.smithi031.stdout: "balancer", 2024-09-17T05:32:42.266 INFO:teuthology.orchestra.run.smithi031.stdout: "crash", 2024-09-17T05:32:42.266 INFO:teuthology.orchestra.run.smithi031.stdout: "devicehealth", 2024-09-17T05:32:42.266 INFO:teuthology.orchestra.run.smithi031.stdout: "orchestrator", 2024-09-17T05:32:42.266 INFO:teuthology.orchestra.run.smithi031.stdout: "pg_autoscaler", 2024-09-17T05:32:42.266 INFO:teuthology.orchestra.run.smithi031.stdout: "progress", 2024-09-17T05:32:42.266 INFO:teuthology.orchestra.run.smithi031.stdout: "rbd_support", 2024-09-17T05:32:42.266 INFO:teuthology.orchestra.run.smithi031.stdout: "status", 2024-09-17T05:32:42.266 INFO:teuthology.orchestra.run.smithi031.stdout: "telemetry", 2024-09-17T05:32:42.266 INFO:teuthology.orchestra.run.smithi031.stdout: "volumes" 2024-09-17T05:32:42.266 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:32:42.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.266 INFO:teuthology.orchestra.run.smithi031.stdout: "last_failure_osd_epoch": 0, 2024-09-17T05:32:42.266 INFO:teuthology.orchestra.run.smithi031.stdout: "active_clients": [ 2024-09-17T05:32:42.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.267 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "devicehealth", 2024-09-17T05:32:42.267 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-09-17T05:32:42.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.267 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-09-17T05:32:42.267 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.155:0", 2024-09-17T05:32:42.267 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 3294325931 2024-09-17T05:32:42.267 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.267 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:32:42.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.267 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "libcephsqlite", 2024-09-17T05:32:42.267 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-09-17T05:32:42.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.267 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-09-17T05:32:42.268 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.155:0", 2024-09-17T05:32:42.268 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 3008380108 2024-09-17T05:32:42.268 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.268 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:32:42.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.268 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "rbd_support", 2024-09-17T05:32:42.268 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-09-17T05:32:42.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.268 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-09-17T05:32:42.268 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.155:0", 2024-09-17T05:32:42.268 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 376613225 2024-09-17T05:32:42.269 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.269 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:32:42.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.269 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "volumes", 2024-09-17T05:32:42.269 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-09-17T05:32:42.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.269 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-09-17T05:32:42.269 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.155:0", 2024-09-17T05:32:42.269 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 987689145 2024-09-17T05:32:42.269 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.269 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:32:42.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.270 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "volumes", 2024-09-17T05:32:42.270 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-09-17T05:32:42.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.270 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-09-17T05:32:42.270 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.155:0", 2024-09-17T05:32:42.270 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1377928572 2024-09-17T05:32:42.270 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.270 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:32:42.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.270 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "volumes", 2024-09-17T05:32:42.270 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-09-17T05:32:42.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.270 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-09-17T05:32:42.270 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.155:0", 2024-09-17T05:32:42.271 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 3022973997 2024-09-17T05:32:42.271 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.271 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:32:42.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.271 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "volumes", 2024-09-17T05:32:42.271 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-09-17T05:32:42.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.271 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-09-17T05:32:42.271 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.155:0", 2024-09-17T05:32:42.271 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1032210633 2024-09-17T05:32:42.271 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.271 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:32:42.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.272 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "volumes", 2024-09-17T05:32:42.272 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-09-17T05:32:42.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.272 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-09-17T05:32:42.272 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.155:0", 2024-09-17T05:32:42.272 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 1391840738 2024-09-17T05:32:42.272 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.272 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:32:42.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.272 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "volumes", 2024-09-17T05:32:42.272 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-09-17T05:32:42.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.273 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-09-17T05:32:42.273 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.155:0", 2024-09-17T05:32:42.273 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 752157024 2024-09-17T05:32:42.273 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.273 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:32:42.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:42.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.273 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "volumes", 2024-09-17T05:32:42.273 INFO:teuthology.orchestra.run.smithi031.stdout: "addrvec": [ 2024-09-17T05:32:42.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:42.273 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v2", 2024-09-17T05:32:42.273 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.155:0", 2024-09-17T05:32:42.273 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 2541203397 2024-09-17T05:32:42.274 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.274 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:32:42.274 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:42.274 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:32:42.274 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:32:42.278 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr fail x 2024-09-17T05:32:42.279 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:32:42.284 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:32:42.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.439+0000 7f518b800640 1 -- 172.21.15.31:0/3967804334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f516c003a10 msgr2=0x7f516c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:42.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.439+0000 7f518b800640 1 --2- 172.21.15.31:0/3967804334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f516c003a10 0x7f516c003e30 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f5178009b60 tx=0x7f517801d2b0 comp rx=0 tx=0).stop 2024-09-17T05:32:42.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.439+0000 7f5189800640 1 -- 172.21.15.31:0/3967804334 reap_dead start 2024-09-17T05:32:42.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.439+0000 7f518b800640 1 -- 172.21.15.31:0/3967804334 shutdown_connections 2024-09-17T05:32:42.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.439+0000 7f518b800640 1 -- 172.21.15.31:0/3967804334 >> 172.21.15.31:0/3967804334 conn(0x7f51840b2240 msgr2=0x7f51840b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:42.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.439+0000 7f518b800640 1 -- 172.21.15.31:0/3967804334 shutdown_connections 2024-09-17T05:32:42.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.439+0000 7f518b800640 1 -- 172.21.15.31:0/3967804334 wait complete. 2024-09-17T05:32:42.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.439+0000 7f518b800640 1 Processor -- start 2024-09-17T05:32:42.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.439+0000 7f518b800640 1 -- start start 2024-09-17T05:32:42.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f518b800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f516c003a10 0x7f5184152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:42.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f518b800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f518415a600 0x7f518415aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:42.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f518b800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51841545c0 0x7f5184154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:42.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f518b800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5184166fc0 con 0x7f51841545c0 2024-09-17T05:32:42.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f518b800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5184166e40 con 0x7f518415a600 2024-09-17T05:32:42.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f518b800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5184167140 con 0x7f516c003a10 2024-09-17T05:32:42.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f5189800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51841545c0 0x7f5184154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:42.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f5189800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51841545c0 0x7f5184154a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45784/0 (socket says 172.21.15.31:45784) 2024-09-17T05:32:42.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f5188e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f516c003a10 0x7f5184152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:42.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f5189800640 1 -- 172.21.15.31:0/4004712121 learned_addr learned my addr 172.21.15.31:0/4004712121 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:42.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f5183e00640 1 --2- 172.21.15.31:0/4004712121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f518415a600 0x7f518415aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:42.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f5189800640 1 -- 172.21.15.31:0/4004712121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f516c003a10 msgr2=0x7f5184152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:42.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f5189800640 1 --2- 172.21.15.31:0/4004712121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f516c003a10 0x7f5184152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:42.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f5189800640 1 -- 172.21.15.31:0/4004712121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f518415a600 msgr2=0x7f518415aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:42.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f5189800640 1 --2- 172.21.15.31:0/4004712121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f518415a600 0x7f518415aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:42.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f5189800640 1 -- 172.21.15.31:0/4004712121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51841f8440 con 0x7f51841545c0 2024-09-17T05:32:42.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f5189800640 1 --2- 172.21.15.31:0/4004712121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51841545c0 0x7f5184154a50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f517c002240 tx=0x7f517c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:42.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f5180c00640 1 -- 172.21.15.31:0/4004712121 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c015070 con 0x7f51841545c0 2024-09-17T05:32:42.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f5180c00640 1 -- 172.21.15.31:0/4004712121 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f517c00cb00 con 0x7f51841545c0 2024-09-17T05:32:42.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f518b800640 1 -- 172.21.15.31:0/4004712121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51841f8720 con 0x7f51841545c0 2024-09-17T05:32:42.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f5180c00640 1 -- 172.21.15.31:0/4004712121 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c011460 con 0x7f51841545c0 2024-09-17T05:32:42.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f518b800640 1 -- 172.21.15.31:0/4004712121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51841f8ce0 con 0x7f51841545c0 2024-09-17T05:32:42.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.443+0000 7f518b800640 1 -- 172.21.15.31:0/4004712121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51840d0420 con 0x7f51841545c0 2024-09-17T05:32:42.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.447+0000 7f5180c00640 1 -- 172.21.15.31:0/4004712121 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 11) ==== 97591+0+0 (secure 0 0 0) 0x7f517c018070 con 0x7f51841545c0 2024-09-17T05:32:42.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.447+0000 7f5180c00640 1 --2- 172.21.15.31:0/4004712121 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f51640735f0 0x7f5164075ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:42.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.447+0000 7f5180c00640 1 -- 172.21.15.31:0/4004712121 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f517c094fe0 con 0x7f51841545c0 2024-09-17T05:32:42.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.447+0000 7f5188e00640 1 --2- 172.21.15.31:0/4004712121 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f51640735f0 0x7f5164075ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:42.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.447+0000 7f5188e00640 1 --2- 172.21.15.31:0/4004712121 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f51640735f0 0x7f5164075ab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f51780ae000 tx=0x7f517801a050 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:42.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.451+0000 7f5180c00640 1 -- 172.21.15.31:0/4004712121 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f517c05f3a0 con 0x7f51841545c0 2024-09-17T05:32:42.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.671+0000 7f518b800640 1 -- 172.21.15.31:0/4004712121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr fail", "who": "x"} v 0) -- 0x7f5184068a80 con 0x7f51841545c0 2024-09-17T05:32:42.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.675+0000 7f5180c00640 1 -- 172.21.15.31:0/4004712121 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr fail", "who": "x"}]=0 v12) ==== 68+0+0 (secure 0 0 0) 0x7f517c063dd0 con 0x7f51841545c0 2024-09-17T05:32:42.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.675+0000 7f5180c00640 1 -- 172.21.15.31:0/4004712121 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mgrmap(e 12) ==== 48655+0+0 (secure 0 0 0) 0x7f517c05b610 con 0x7f51841545c0 2024-09-17T05:32:42.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.675+0000 7f5180c00640 1 -- 172.21.15.31:0/4004712121 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f51640735f0 msgr2=0x7f5164075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:42.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.675+0000 7f5180c00640 1 --2- 172.21.15.31:0/4004712121 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f51640735f0 0x7f5164075ab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f51780ae000 tx=0x7f517801a050 comp rx=0 tx=0).stop 2024-09-17T05:32:42.679 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-17T05:32:42.681+0000 7fab7b600640 -1 mgr handle_mgr_map I was active but no longer am 2024-09-17T05:32:42.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.679+0000 7f518b800640 1 -- 172.21.15.31:0/4004712121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51841545c0 msgr2=0x7f5184154a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:42.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.679+0000 7f518b800640 1 --2- 172.21.15.31:0/4004712121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51841545c0 0x7f5184154a50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f517c002240 tx=0x7f517c00ec30 comp rx=0 tx=0).stop 2024-09-17T05:32:42.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.679+0000 7f518b800640 1 -- 172.21.15.31:0/4004712121 shutdown_connections 2024-09-17T05:32:42.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.679+0000 7f518b800640 1 --2- 172.21.15.31:0/4004712121 >> [v2:172.21.15.155:6808/1222054038,v1:172.21.15.155:6809/1222054038] conn(0x7f51640735f0 0x7f5164075ab0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:42.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.679+0000 7f518b800640 1 --2- 172.21.15.31:0/4004712121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51841545c0 0x7f5184154a50 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:42.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.679+0000 7f518b800640 1 --2- 172.21.15.31:0/4004712121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f518415a600 0x7f518415aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:42.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.679+0000 7f518b800640 1 --2- 172.21.15.31:0/4004712121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f516c003a10 0x7f5184152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:42.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.679+0000 7f518b800640 1 -- 172.21.15.31:0/4004712121 >> 172.21.15.31:0/4004712121 conn(0x7f51840b2240 msgr2=0x7f518406cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:42.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.679+0000 7f518b800640 1 -- 172.21.15.31:0/4004712121 shutdown_connections 2024-09-17T05:32:42.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.679+0000 7f518b800640 1 -- 172.21.15.31:0/4004712121 wait complete. 2024-09-17T05:32:42.736 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:32:42.795 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:32:42.795+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:32:42.795 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:32:42.795+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:32:42.795 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:32:42.795+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:32:42.795 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:32:42.795+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:32:42.795 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:32:42.795+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:32:42.796 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:32:42.795+0000 7f46fe600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:32:42.796 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:32:42.795+0000 7f46fe600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:32:42.796 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:32:42.795+0000 7f46fe600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:32:42.796 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:32:42.795+0000 7f46fe600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:32:42.796 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:32:42.795+0000 7f46fe600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:32:42.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.895+0000 7f4ab7200640 1 -- 172.21.15.31:0/2842812065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ab80b2ca0 msgr2=0x7f4ab80cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:42.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.895+0000 7f4ab7200640 1 --2- 172.21.15.31:0/2842812065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ab80b2ca0 0x7f4ab80cefb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009bc0 tx=0x7f4ab001cb10 comp rx=0 tx=0).stop 2024-09-17T05:32:42.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.895+0000 7f4ab7200640 1 -- 172.21.15.31:0/2842812065 shutdown_connections 2024-09-17T05:32:42.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.895+0000 7f4ab7200640 1 --2- 172.21.15.31:0/2842812065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ab80b2ca0 0x7f4ab80cefb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:42.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.895+0000 7f4ab7200640 1 -- 172.21.15.31:0/2842812065 >> 172.21.15.31:0/2842812065 conn(0x7f4ab809aa10 msgr2=0x7f4ab809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:42.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.895+0000 7f4ab7200640 1 -- 172.21.15.31:0/2842812065 shutdown_connections 2024-09-17T05:32:42.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.895+0000 7f4ab7200640 1 -- 172.21.15.31:0/2842812065 wait complete. 2024-09-17T05:32:42.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.895+0000 7f4ab7200640 1 Processor -- start 2024-09-17T05:32:42.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab7200640 1 -- start start 2024-09-17T05:32:42.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab7200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ab80b2ca0 0x7f4ab80714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:42.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab7200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ab80d01b0 0x7f4ab8159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:42.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab7200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ab815f000 0x7f4ab80b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:42.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab7200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab816a0f0 con 0x7f4ab80d01b0 2024-09-17T05:32:42.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab7200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab8169f70 con 0x7f4ab815f000 2024-09-17T05:32:42.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab7200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4ab816a270 con 0x7f4ab80b2ca0 2024-09-17T05:32:42.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ab80d01b0 0x7f4ab8159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:42.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ab80d01b0 0x7f4ab8159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45904/0 (socket says 172.21.15.31:45904) 2024-09-17T05:32:42.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab5e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ab80b2ca0 0x7f4ab80714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:42.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab5400640 1 -- 172.21.15.31:0/2153054649 learned_addr learned my addr 172.21.15.31:0/2153054649 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:42.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab6800640 1 --2- 172.21.15.31:0/2153054649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ab815f000 0x7f4ab80b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:42.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab5400640 1 -- 172.21.15.31:0/2153054649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ab80b2ca0 msgr2=0x7f4ab80714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:42.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab5400640 1 --2- 172.21.15.31:0/2153054649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ab80b2ca0 0x7f4ab80714d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:42.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab5400640 1 -- 172.21.15.31:0/2153054649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ab815f000 msgr2=0x7f4ab80b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:42.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab5400640 1 --2- 172.21.15.31:0/2153054649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ab815f000 0x7f4ab80b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:42.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab5400640 1 -- 172.21.15.31:0/2153054649 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab80b7730 con 0x7f4ab80d01b0 2024-09-17T05:32:42.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab5400640 1 --2- 172.21.15.31:0/2153054649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ab80d01b0 0x7f4ab8159550 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400c500 tx=0x7f4aa400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:42.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4aae000640 1 -- 172.21.15.31:0/2153054649 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4016020 con 0x7f4ab80d01b0 2024-09-17T05:32:42.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4aae000640 1 -- 172.21.15.31:0/2153054649 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4aa4012940 con 0x7f4ab80d01b0 2024-09-17T05:32:42.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4aae000640 1 -- 172.21.15.31:0/2153054649 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4012d90 con 0x7f4ab80d01b0 2024-09-17T05:32:42.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab7200640 1 -- 172.21.15.31:0/2153054649 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab81584b0 con 0x7f4ab80d01b0 2024-09-17T05:32:42.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab7200640 1 -- 172.21.15.31:0/2153054649 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab8158a70 con 0x7f4ab80d01b0 2024-09-17T05:32:42.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4ab7200640 1 -- 172.21.15.31:0/2153054649 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ab8159240 con 0x7f4ab80d01b0 2024-09-17T05:32:42.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.899+0000 7f4aae000640 1 -- 172.21.15.31:0/2153054649 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 12) ==== 48655+0+0 (secure 0 0 0) 0x7f4aa4019020 con 0x7f4ab80d01b0 2024-09-17T05:32:42.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.903+0000 7f4aae000640 1 -- 172.21.15.31:0/2153054649 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6268+0+0 (secure 0 0 0) 0x7f4aa404ffe0 con 0x7f4ab80d01b0 2024-09-17T05:32:42.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:42.907+0000 7f4aae000640 1 -- 172.21.15.31:0/2153054649 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4aa4020020 con 0x7f4ab80d01b0 2024-09-17T05:32:43.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.119+0000 7f4ab7200640 1 -- 172.21.15.31:0/2153054649 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ab80cf250 con 0x7f4ab80d01b0 2024-09-17T05:32:43.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.119+0000 7f4aae000640 1 -- 172.21.15.31:0/2153054649 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7f4aa400a0e0 con 0x7f4ab80d01b0 2024-09-17T05:32:43.121 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:43.121 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":48,"btime":"2024-09-17T05:32:37:503295+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/4172452504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":4172452504},{"type":"v1","addr":"172.21.15.155:6837","nonce":4172452504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2918874157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2918874157},{"type":"v1","addr":"172.21.15.155:6836","nonce":2918874157}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3987740697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3987740697},{"type":"v1","addr":"172.21.15.31:6833","nonce":3987740697}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:32:22.832719+0000","modified":"2024-09-17T05:32:25.871459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6153":{"gid":6153,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1598380263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1598380263},{"type":"v1","addr":"172.21.15.31:6835","nonce":1598380263}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6153,"qdb_cluster":[6153]},"id":5}]} 2024-09-17T05:32:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 48 2024-09-17T05:32:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.123+0000 7f4ab7200640 1 -- 172.21.15.31:0/2153054649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ab80d01b0 msgr2=0x7f4ab8159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.123+0000 7f4ab7200640 1 --2- 172.21.15.31:0/2153054649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ab80d01b0 0x7f4ab8159550 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400c500 tx=0x7f4aa400c9c0 comp rx=0 tx=0).stop 2024-09-17T05:32:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.123+0000 7f4ab7200640 1 -- 172.21.15.31:0/2153054649 shutdown_connections 2024-09-17T05:32:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.123+0000 7f4ab7200640 1 --2- 172.21.15.31:0/2153054649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ab815f000 0x7f4ab80b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.123+0000 7f4ab7200640 1 --2- 172.21.15.31:0/2153054649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ab80d01b0 0x7f4ab8159550 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.123+0000 7f4ab7200640 1 --2- 172.21.15.31:0/2153054649 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4ab80b2ca0 0x7f4ab80714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:43.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.123+0000 7f4ab7200640 1 -- 172.21.15.31:0/2153054649 >> 172.21.15.31:0/2153054649 conn(0x7f4ab809aa10 msgr2=0x7f4ab8075940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:43.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.123+0000 7f4ab7200640 1 -- 172.21.15.31:0/2153054649 shutdown_connections 2024-09-17T05:32:43.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.123+0000 7f4ab7200640 1 -- 172.21.15.31:0/2153054649 wait complete. 2024-09-17T05:32:43.143 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-09-17T05:32:43.308 INFO:teuthology.orchestra.run.smithi031.stdout:[{"id":6423,"entity":{"name":{"type":"client","num":6423},"addr":{"type":"any","addr":"172.21.15.31:0","nonce":2018769340}},"state":"open","num_leases":0,"num_caps":2,"request_load_avg":2,"uptime":0.491995091,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":1.9977462544737552,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":2,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6423 172.21.15.31:0/2018769340","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"y","hostname":"smithi031","pid":"28783","root":"/"}},{"id":5660,"entity":{"name":{"type":"client","num":5660},"addr":{"type":"any","addr":"172.21.15.31:0","nonce":679125183}},"state":"open","num_leases":0,"num_caps":2,"request_load_avg":2,"uptime":0.491995091,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":1.9977462544737552,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":2,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5660 172.21.15.31:0/679125183","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"y","hostname":"smithi031","pid":"28783","root":"/"}}] 2024-09-17T05:32:43.309 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi031", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28783", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.31:0", "nonce": 2018769340, "type": "any" }, "name": { "num": 6423, "type": "client" } }, "id": 6423, "inst": "client.6423 172.21.15.31:0/2018769340", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 2, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1.9977462544737552 }, "state": "open", "uptime": 0.491995091 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi031", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "28783", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.31:0", "nonce": 679125183, "type": "any" }, "name": { "num": 5660, "type": "client" } }, "id": 5660, "inst": "client.5660 172.21.15.31:0/679125183", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 2, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1.9977462544737552 }, "state": "open", "uptime": 0.491995091 } ] 2024-09-17T05:32:43.309 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T05:32:43.309 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:32:43.309 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:32:43.409 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:32:43.481 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:32:43.481 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:32:43.481 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:32:43.481 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:43.490 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:32:43.490 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:32:43.490 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:32:43.490 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:43.500 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:32:43.500 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:32:43.500 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:32:43.500 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:43.546 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:32:43.546 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:32:43.546 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:32:43.546 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:43.556 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:32:43.556 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:32:43.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.743+0000 7f7110000640 1 -- 172.21.15.31:0/1072696631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f710815bfa0 msgr2=0x7f71080cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:43.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.743+0000 7f7110000640 1 --2- 172.21.15.31:0/1072696631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f710815bfa0 0x7f71080cd000 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f70f4009900 tx=0x7f70f401f0d0 comp rx=0 tx=0).stop 2024-09-17T05:32:43.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.743+0000 7f7110000640 1 -- 172.21.15.31:0/1072696631 shutdown_connections 2024-09-17T05:32:43.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.743+0000 7f7110000640 1 --2- 172.21.15.31:0/1072696631 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f710815bfa0 0x7f71080cd000 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:43.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.743+0000 7f7110000640 1 -- 172.21.15.31:0/1072696631 >> 172.21.15.31:0/1072696631 conn(0x7f71080b18f0 msgr2=0x7f71080b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:43.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.743+0000 7f7110000640 1 -- 172.21.15.31:0/1072696631 shutdown_connections 2024-09-17T05:32:43.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f7110000640 1 -- 172.21.15.31:0/1072696631 wait complete. 2024-09-17T05:32:43.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f7110000640 1 Processor -- start 2024-09-17T05:32:43.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f7110000640 1 -- start start 2024-09-17T05:32:43.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f7110000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71080cd540 0x7f7108147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:43.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f7110000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f710815bfa0 0x7f710815ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:43.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f7110000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f710815c3e0 0x7f71080ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:43.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f7110000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f710806f240 con 0x7f71080cd540 2024-09-17T05:32:43.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f7110000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f710806f0c0 con 0x7f710815c3e0 2024-09-17T05:32:43.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f7110000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f710806f3c0 con 0x7f710815bfa0 2024-09-17T05:32:43.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f710d600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71080cd540 0x7f7108147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:43.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f710d600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71080cd540 0x7f7108147660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45922/0 (socket says 172.21.15.31:45922) 2024-09-17T05:32:43.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f710d600640 1 -- 172.21.15.31:0/4188988413 learned_addr learned my addr 172.21.15.31:0/4188988413 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:43.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f710cc00640 1 --2- 172.21.15.31:0/4188988413 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f710815bfa0 0x7f710815ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:43.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f710e000640 1 --2- 172.21.15.31:0/4188988413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f710815c3e0 0x7f71080ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:43.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f710d600640 1 -- 172.21.15.31:0/4188988413 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f710815bfa0 msgr2=0x7f710815ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:43.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f710d600640 1 --2- 172.21.15.31:0/4188988413 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f710815bfa0 0x7f710815ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:43.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f710d600640 1 -- 172.21.15.31:0/4188988413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f710815c3e0 msgr2=0x7f71080ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:43.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f710d600640 1 --2- 172.21.15.31:0/4188988413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f710815c3e0 0x7f71080ae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:43.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f710d600640 1 -- 172.21.15.31:0/4188988413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71080ad7f0 con 0x7f71080cd540 2024-09-17T05:32:43.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f710d600640 1 --2- 172.21.15.31:0/4188988413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71080cd540 0x7f7108147660 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00c420 tx=0x7f70fc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:43.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f7105600640 1 -- 172.21.15.31:0/4188988413 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc017070 con 0x7f71080cd540 2024-09-17T05:32:43.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f7105600640 1 -- 172.21.15.31:0/4188988413 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70fc0053c0 con 0x7f71080cd540 2024-09-17T05:32:43.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f7110000640 1 -- 172.21.15.31:0/4188988413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710815a5a0 con 0x7f71080cd540 2024-09-17T05:32:43.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.747+0000 7f7105600640 1 -- 172.21.15.31:0/4188988413 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc003860 con 0x7f71080cd540 2024-09-17T05:32:43.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.751+0000 7f7110000640 1 -- 172.21.15.31:0/4188988413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f710815a880 con 0x7f71080cd540 2024-09-17T05:32:43.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.751+0000 7f7110000640 1 -- 172.21.15.31:0/4188988413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f710806a460 con 0x7f71080cd540 2024-09-17T05:32:43.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.751+0000 7f7105600640 1 -- 172.21.15.31:0/4188988413 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) ==== 48782+0+0 (secure 0 0 0) 0x7f70fc01a070 con 0x7f71080cd540 2024-09-17T05:32:43.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.751+0000 7f7105600640 1 --2- 172.21.15.31:0/4188988413 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f70e803b9b0 0x7f70e803de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:43.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.751+0000 7f7105600640 1 -- 172.21.15.31:0/4188988413 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6268+0+0 (secure 0 0 0) 0x7f70fc04f5b0 con 0x7f71080cd540 2024-09-17T05:32:43.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.751+0000 7f710cc00640 1 --2- 172.21.15.31:0/4188988413 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f70e803b9b0 0x7f70e803de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:43.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.751+0000 7f710cc00640 1 --2- 172.21.15.31:0/4188988413 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f70e803b9b0 0x7f70e803de70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f70f40b2000 tx=0x7f70f401d910 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:43.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.755+0000 7f7105600640 1 -- 172.21.15.31:0/4188988413 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f70fc0102e0 con 0x7f71080cd540 2024-09-17T05:32:43.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.971+0000 7f7110000640 1 -- 172.21.15.31:0/4188988413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71080cbf00 con 0x7f71080cd540 2024-09-17T05:32:43.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.971+0000 7f7105600640 1 -- 172.21.15.31:0/4188988413 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7f70fc01bdf0 con 0x7f71080cd540 2024-09-17T05:32:43.972 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:43.972 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":48,"btime":"2024-09-17T05:32:37:503295+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/4172452504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":4172452504},{"type":"v1","addr":"172.21.15.155:6837","nonce":4172452504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2918874157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2918874157},{"type":"v1","addr":"172.21.15.155:6836","nonce":2918874157}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3987740697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3987740697},{"type":"v1","addr":"172.21.15.31:6833","nonce":3987740697}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:32:22.832719+0000","modified":"2024-09-17T05:32:25.871459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6153":{"gid":6153,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1598380263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1598380263},{"type":"v1","addr":"172.21.15.31:6835","nonce":1598380263}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6153,"qdb_cluster":[6153]},"id":5}]} 2024-09-17T05:32:43.972 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 48 2024-09-17T05:32:43.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.971+0000 7f7110000640 1 -- 172.21.15.31:0/4188988413 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f70e803b9b0 msgr2=0x7f70e803de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:43.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.971+0000 7f7110000640 1 --2- 172.21.15.31:0/4188988413 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f70e803b9b0 0x7f70e803de70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f70f40b2000 tx=0x7f70f401d910 comp rx=0 tx=0).stop 2024-09-17T05:32:43.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.971+0000 7f7110000640 1 -- 172.21.15.31:0/4188988413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71080cd540 msgr2=0x7f7108147660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:43.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.971+0000 7f7110000640 1 --2- 172.21.15.31:0/4188988413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71080cd540 0x7f7108147660 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00c420 tx=0x7f70fc00c8e0 comp rx=0 tx=0).stop 2024-09-17T05:32:43.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.971+0000 7f7110000640 1 -- 172.21.15.31:0/4188988413 shutdown_connections 2024-09-17T05:32:43.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.971+0000 7f7110000640 1 --2- 172.21.15.31:0/4188988413 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f70e803b9b0 0x7f70e803de70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:43.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.971+0000 7f7110000640 1 --2- 172.21.15.31:0/4188988413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f710815c3e0 0x7f71080ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:43.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.971+0000 7f7110000640 1 --2- 172.21.15.31:0/4188988413 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f710815bfa0 0x7f710815ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:43.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.971+0000 7f7110000640 1 --2- 172.21.15.31:0/4188988413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71080cd540 0x7f7108147660 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:43.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.971+0000 7f7110000640 1 -- 172.21.15.31:0/4188988413 >> 172.21.15.31:0/4188988413 conn(0x7f71080b18f0 msgr2=0x7f710815d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:43.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.971+0000 7f7110000640 1 -- 172.21.15.31:0/4188988413 shutdown_connections 2024-09-17T05:32:43.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:43.971+0000 7f7110000640 1 -- 172.21.15.31:0/4188988413 wait complete. 2024-09-17T05:32:43.994 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:32:44.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.139+0000 7f0a21000640 1 -- 172.21.15.31:0/3625561996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a1c0cdb30 msgr2=0x7f0a1c0aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:44.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.139+0000 7f0a21000640 1 --2- 172.21.15.31:0/3625561996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a1c0cdb30 0x7f0a1c0aeef0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0cc3a0 tx=0x7f0a1401cb80 comp rx=0 tx=0).stop 2024-09-17T05:32:44.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.139+0000 7f0a21000640 1 -- 172.21.15.31:0/3625561996 shutdown_connections 2024-09-17T05:32:44.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.139+0000 7f0a21000640 1 --2- 172.21.15.31:0/3625561996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a1c0cdb30 0x7f0a1c0aeef0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.139+0000 7f0a21000640 1 --2- 172.21.15.31:0/3625561996 >> v2:172.21.15.155:3300/0 conn(0x7f0a1c0ced80 0x7f0a1c0ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.139+0000 7f0a21000640 1 -- 172.21.15.31:0/3625561996 >> 172.21.15.31:0/3625561996 conn(0x7f0a1c0d1dc0 msgr2=0x7f0a1c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:44.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.139+0000 7f0a21000640 1 -- 172.21.15.31:0/3625561996 shutdown_connections 2024-09-17T05:32:44.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.139+0000 7f0a21000640 1 -- 172.21.15.31:0/3625561996 wait complete. 2024-09-17T05:32:44.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.139+0000 7f0a21000640 1 Processor -- start 2024-09-17T05:32:44.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.139+0000 7f0a21000640 1 -- start start 2024-09-17T05:32:44.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a21000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a1c0cdb30 0x7f0a1c157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:44.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a21000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a1c0ced80 0x7f0a1c09f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:44.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a21000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a1c15bea0 0x7f0a1c157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:44.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a21000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1c169240 con 0x7f0a1c0ced80 2024-09-17T05:32:44.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a21000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1c1690c0 con 0x7f0a1c15bea0 2024-09-17T05:32:44.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a21000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0a1c1693c0 con 0x7f0a1c0cdb30 2024-09-17T05:32:44.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a13e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a1c0ced80 0x7f0a1c09f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:44.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a13e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a1c0ced80 0x7f0a1c09f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45942/0 (socket says 172.21.15.31:45942) 2024-09-17T05:32:44.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a13e00640 1 -- 172.21.15.31:0/3991810908 learned_addr learned my addr 172.21.15.31:0/3991810908 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:44.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a19e00640 1 --2- 172.21.15.31:0/3991810908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a1c0cdb30 0x7f0a1c157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:44.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a1a800640 1 --2- 172.21.15.31:0/3991810908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a1c15bea0 0x7f0a1c157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:44.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a13e00640 1 -- 172.21.15.31:0/3991810908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a1c0cdb30 msgr2=0x7f0a1c157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:44.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a13e00640 1 --2- 172.21.15.31:0/3991810908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a1c0cdb30 0x7f0a1c157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a13e00640 1 -- 172.21.15.31:0/3991810908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a1c15bea0 msgr2=0x7f0a1c157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:44.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a13e00640 1 --2- 172.21.15.31:0/3991810908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a1c15bea0 0x7f0a1c157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a13e00640 1 -- 172.21.15.31:0/3991810908 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1c1fb730 con 0x7f0a1c0ced80 2024-09-17T05:32:44.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a13e00640 1 --2- 172.21.15.31:0/3991810908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a1c0ced80 0x7f0a1c09f680 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400d950 tx=0x7f0a0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:44.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a12000640 1 -- 172.21.15.31:0/3991810908 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a04017070 con 0x7f0a1c0ced80 2024-09-17T05:32:44.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a12000640 1 -- 172.21.15.31:0/3991810908 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a04009d20 con 0x7f0a1c0ced80 2024-09-17T05:32:44.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a12000640 1 -- 172.21.15.31:0/3991810908 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a040106c0 con 0x7f0a1c0ced80 2024-09-17T05:32:44.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a21000640 1 -- 172.21.15.31:0/3991810908 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a1c1fb9d0 con 0x7f0a1c0ced80 2024-09-17T05:32:44.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a21000640 1 -- 172.21.15.31:0/3991810908 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a1c0cab50 con 0x7f0a1c0ced80 2024-09-17T05:32:44.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a21000640 1 -- 172.21.15.31:0/3991810908 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a1c0ce670 con 0x7f0a1c0ced80 2024-09-17T05:32:44.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a12000640 1 -- 172.21.15.31:0/3991810908 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) ==== 48782+0+0 (secure 0 0 0) 0x7f0a04010860 con 0x7f0a1c0ced80 2024-09-17T05:32:44.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a12000640 1 --2- 172.21.15.31:0/3991810908 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f09f803b9b0 0x7f09f803de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:44.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a12000640 1 -- 172.21.15.31:0/3991810908 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6268+0+0 (secure 0 0 0) 0x7f0a04050690 con 0x7f0a1c0ced80 2024-09-17T05:32:44.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.143+0000 7f0a19e00640 1 --2- 172.21.15.31:0/3991810908 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f09f803b9b0 0x7f09f803de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:44.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.147+0000 7f0a19e00640 1 --2- 172.21.15.31:0/3991810908 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f09f803b9b0 0x7f09f803de70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c007fd0 tx=0x7f0a0c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:44.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.151+0000 7f0a12000640 1 -- 172.21.15.31:0/3991810908 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0a0400f3c0 con 0x7f0a1c0ced80 2024-09-17T05:32:44.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.363+0000 7f0a21000640 1 -- 172.21.15.31:0/3991810908 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a1c0aff10 con 0x7f0a1c0ced80 2024-09-17T05:32:44.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.363+0000 7f0a12000640 1 -- 172.21.15.31:0/3991810908 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7f0a0400f740 con 0x7f0a1c0ced80 2024-09-17T05:32:44.363 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:44.363 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":48,"btime":"2024-09-17T05:32:37:503295+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/4172452504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":4172452504},{"type":"v1","addr":"172.21.15.155:6837","nonce":4172452504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2918874157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2918874157},{"type":"v1","addr":"172.21.15.155:6836","nonce":2918874157}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3987740697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3987740697},{"type":"v1","addr":"172.21.15.31:6833","nonce":3987740697}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:32:22.832719+0000","modified":"2024-09-17T05:32:25.871459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6153":{"gid":6153,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1598380263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1598380263},{"type":"v1","addr":"172.21.15.31:6835","nonce":1598380263}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6153,"qdb_cluster":[6153]},"id":5}]} 2024-09-17T05:32:44.363 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 48 2024-09-17T05:32:44.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.363+0000 7f0a21000640 1 -- 172.21.15.31:0/3991810908 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f09f803b9b0 msgr2=0x7f09f803de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:44.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.363+0000 7f0a21000640 1 --2- 172.21.15.31:0/3991810908 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f09f803b9b0 0x7f09f803de70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c007fd0 tx=0x7f0a0c009040 comp rx=0 tx=0).stop 2024-09-17T05:32:44.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.363+0000 7f0a21000640 1 -- 172.21.15.31:0/3991810908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a1c0ced80 msgr2=0x7f0a1c09f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:44.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.363+0000 7f0a21000640 1 --2- 172.21.15.31:0/3991810908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a1c0ced80 0x7f0a1c09f680 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0a0400d950 tx=0x7f0a0400de10 comp rx=0 tx=0).stop 2024-09-17T05:32:44.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.363+0000 7f0a21000640 1 -- 172.21.15.31:0/3991810908 shutdown_connections 2024-09-17T05:32:44.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.363+0000 7f0a21000640 1 --2- 172.21.15.31:0/3991810908 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f09f803b9b0 0x7f09f803de70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.363+0000 7f0a21000640 1 --2- 172.21.15.31:0/3991810908 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a1c15bea0 0x7f0a1c157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.363+0000 7f0a21000640 1 --2- 172.21.15.31:0/3991810908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a1c0ced80 0x7f0a1c09f680 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.363+0000 7f0a21000640 1 --2- 172.21.15.31:0/3991810908 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a1c0cdb30 0x7f0a1c157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.363+0000 7f0a21000640 1 -- 172.21.15.31:0/3991810908 >> 172.21.15.31:0/3991810908 conn(0x7f0a1c0d1dc0 msgr2=0x7f0a1c15af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:44.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.363+0000 7f0a21000640 1 -- 172.21.15.31:0/3991810908 shutdown_connections 2024-09-17T05:32:44.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.363+0000 7f0a21000640 1 -- 172.21.15.31:0/3991810908 wait complete. 2024-09-17T05:32:44.384 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:32:44.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.531+0000 7f0de6c00640 1 -- 172.21.15.31:0/4279356784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0de00b3300 msgr2=0x7f0de00cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:44.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.531+0000 7f0de6c00640 1 --2- 172.21.15.31:0/4279356784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0de00b3300 0x7f0de00cc550 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009bc0 tx=0x7f0dd801cba0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.531+0000 7f0de6c00640 1 -- 172.21.15.31:0/4279356784 shutdown_connections 2024-09-17T05:32:44.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.531+0000 7f0de6c00640 1 --2- 172.21.15.31:0/4279356784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0de00b3300 0x7f0de00cc550 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.531+0000 7f0de6c00640 1 --2- 172.21.15.31:0/4279356784 >> v2:172.21.15.155:3300/0 conn(0x7f0de015b580 0x7f0de015b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.531+0000 7f0de6c00640 1 -- 172.21.15.31:0/4279356784 >> 172.21.15.31:0/4279356784 conn(0x7f0de00b18f0 msgr2=0x7f0de00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:44.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.531+0000 7f0de6c00640 1 -- 172.21.15.31:0/4279356784 shutdown_connections 2024-09-17T05:32:44.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.531+0000 7f0de6c00640 1 -- 172.21.15.31:0/4279356784 wait complete. 2024-09-17T05:32:44.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.531+0000 7f0de6c00640 1 Processor -- start 2024-09-17T05:32:44.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.531+0000 7f0de6c00640 1 -- start start 2024-09-17T05:32:44.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.531+0000 7f0de6c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0de00b3300 0x7f0de014f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:44.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.531+0000 7f0de6c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0de00b4bd0 0x7f0de0154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:44.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.531+0000 7f0de6c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0de015b580 0x7f0de0147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:44.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.531+0000 7f0de6c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0de0167ee0 con 0x7f0de00b4bd0 2024-09-17T05:32:44.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.531+0000 7f0de6c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0de0167d60 con 0x7f0de00b3300 2024-09-17T05:32:44.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.531+0000 7f0de6c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0de0168060 con 0x7f0de015b580 2024-09-17T05:32:44.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.531+0000 7f0dd7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0de00b4bd0 0x7f0de0154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:44.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0dd7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0de00b4bd0 0x7f0de0154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45952/0 (socket says 172.21.15.31:45952) 2024-09-17T05:32:44.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0dd7e00640 1 -- 172.21.15.31:0/3161388120 learned_addr learned my addr 172.21.15.31:0/3161388120 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:44.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0ddfe00640 1 --2- 172.21.15.31:0/3161388120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0de00b3300 0x7f0de014f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:44.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0de4c00640 1 --2- 172.21.15.31:0/3161388120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0de015b580 0x7f0de0147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:44.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0dd7e00640 1 -- 172.21.15.31:0/3161388120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0de015b580 msgr2=0x7f0de0147f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:44.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0dd7e00640 1 --2- 172.21.15.31:0/3161388120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0de015b580 0x7f0de0147f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0dd7e00640 1 -- 172.21.15.31:0/3161388120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0de00b3300 msgr2=0x7f0de014f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:44.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0dd7e00640 1 --2- 172.21.15.31:0/3161388120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0de00b3300 0x7f0de014f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0dd7e00640 1 -- 172.21.15.31:0/3161388120 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de0145f90 con 0x7f0de00b4bd0 2024-09-17T05:32:44.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0de4c00640 1 --2- 172.21.15.31:0/3161388120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0de015b580 0x7f0de0147f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:32:44.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0dd7e00640 1 --2- 172.21.15.31:0/3161388120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0de00b4bd0 0x7f0de0154a40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800c490 tx=0x7f0dc800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:44.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0ddcc00640 1 -- 172.21.15.31:0/3161388120 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8016020 con 0x7f0de00b4bd0 2024-09-17T05:32:44.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0de6c00640 1 -- 172.21.15.31:0/3161388120 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0de014ff20 con 0x7f0de00b4bd0 2024-09-17T05:32:44.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0ddcc00640 1 -- 172.21.15.31:0/3161388120 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0dc8012940 con 0x7f0de00b4bd0 2024-09-17T05:32:44.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0ddcc00640 1 -- 172.21.15.31:0/3161388120 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8012d90 con 0x7f0de00b4bd0 2024-09-17T05:32:44.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0de6c00640 1 -- 172.21.15.31:0/3161388120 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0de01f8c80 con 0x7f0de00b4bd0 2024-09-17T05:32:44.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0de6c00640 1 -- 172.21.15.31:0/3161388120 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0de0069410 con 0x7f0de00b4bd0 2024-09-17T05:32:44.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0ddcc00640 1 -- 172.21.15.31:0/3161388120 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 13) ==== 48782+0+0 (secure 0 0 0) 0x7f0dc8019020 con 0x7f0de00b4bd0 2024-09-17T05:32:44.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0ddcc00640 1 --2- 172.21.15.31:0/3161388120 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0dbc03b9b0 0x7f0dbc03de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:44.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0ddcc00640 1 -- 172.21.15.31:0/3161388120 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6268+0+0 (secure 0 0 0) 0x7f0dc804ff40 con 0x7f0de00b4bd0 2024-09-17T05:32:44.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0ddfe00640 1 --2- 172.21.15.31:0/3161388120 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0dbc03b9b0 0x7f0dbc03de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:44.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.535+0000 7f0ddfe00640 1 --2- 172.21.15.31:0/3161388120 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0dbc03b9b0 0x7f0dbc03de70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0009b40 tx=0x7f0dd00091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:44.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.539+0000 7f0ddcc00640 1 -- 172.21.15.31:0/3161388120 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0dc8020030 con 0x7f0de00b4bd0 2024-09-17T05:32:44.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.687+0000 7f0ddcc00640 1 -- 172.21.15.31:0/3161388120 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 14) ==== 48990+0+0 (secure 0 0 0) 0x7f0dc801fd10 con 0x7f0de00b4bd0 2024-09-17T05:32:44.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.719+0000 7f0de6c00640 1 -- 172.21.15.31:0/3161388120 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0de00cc550 con 0x7f0de00b4bd0 2024-09-17T05:32:44.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.719+0000 7f0ddcc00640 1 -- 172.21.15.31:0/3161388120 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+17572 (secure 0 0 0) 0x7f0de0145f90 con 0x7f0de00b4bd0 2024-09-17T05:32:44.722 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:44.722 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":70,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:32:42.673343+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:32:20.745608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T05:32:21.805091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:0/987689145":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/1391840738":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/3008380108":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/3294325931":"2024-09-18T05:32:42.673305+0000","172.21.15.155:6809/1222054038":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/1377928572":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/1032210633":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/2541203397":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/376613225":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/752157024":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/3022973997":"2024-09-18T05:32:42.673305+0000","172.21.15.155:6808/1222054038":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/913411077":"2024-09-18T05:32:42.673305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:32:44.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.723+0000 7f0de6c00640 1 -- 172.21.15.31:0/3161388120 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0dbc03b9b0 msgr2=0x7f0dbc03de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:44.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.723+0000 7f0de6c00640 1 --2- 172.21.15.31:0/3161388120 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0dbc03b9b0 0x7f0dbc03de70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0009b40 tx=0x7f0dd00091e0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.723+0000 7f0de6c00640 1 -- 172.21.15.31:0/3161388120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0de00b4bd0 msgr2=0x7f0de0154a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:44.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.723+0000 7f0de6c00640 1 --2- 172.21.15.31:0/3161388120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0de00b4bd0 0x7f0de0154a40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800c490 tx=0x7f0dc800c950 comp rx=0 tx=0).stop 2024-09-17T05:32:44.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.723+0000 7f0de6c00640 1 -- 172.21.15.31:0/3161388120 shutdown_connections 2024-09-17T05:32:44.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.723+0000 7f0de6c00640 1 --2- 172.21.15.31:0/3161388120 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0dbc03b9b0 0x7f0dbc03de70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.723+0000 7f0de6c00640 1 --2- 172.21.15.31:0/3161388120 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0de015b580 0x7f0de0147f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.723+0000 7f0de6c00640 1 --2- 172.21.15.31:0/3161388120 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0de00b4bd0 0x7f0de0154a40 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.723+0000 7f0de6c00640 1 --2- 172.21.15.31:0/3161388120 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0de00b3300 0x7f0de014f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.723+0000 7f0de6c00640 1 -- 172.21.15.31:0/3161388120 >> 172.21.15.31:0/3161388120 conn(0x7f0de00b18f0 msgr2=0x7f0de006fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:44.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.723+0000 7f0de6c00640 1 -- 172.21.15.31:0/3161388120 shutdown_connections 2024-09-17T05:32:44.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.723+0000 7f0de6c00640 1 -- 172.21.15.31:0/3161388120 wait complete. 2024-09-17T05:32:44.744 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:32:44.745 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:32:44.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.903+0000 7f95fa200640 1 -- 172.21.15.31:0/4053754587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f4071030 msgr2=0x7f95f40714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:44.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.903+0000 7f95fa200640 1 --2- 172.21.15.31:0/4053754587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f4071030 0x7f95f40714c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009bc0 tx=0x7f95ec01cb70 comp rx=0 tx=0).stop 2024-09-17T05:32:44.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.903+0000 7f95fa200640 1 -- 172.21.15.31:0/4053754587 shutdown_connections 2024-09-17T05:32:44.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.903+0000 7f95fa200640 1 --2- 172.21.15.31:0/4053754587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f4071030 0x7f95f40714c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.903+0000 7f95fa200640 1 --2- 172.21.15.31:0/4053754587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95f406cc20 0x7f95f40737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.903+0000 7f95fa200640 1 -- 172.21.15.31:0/4053754587 >> 172.21.15.31:0/4053754587 conn(0x7f95f40d0c90 msgr2=0x7f95f40d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:44.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.903+0000 7f95fa200640 1 -- 172.21.15.31:0/4053754587 shutdown_connections 2024-09-17T05:32:44.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.903+0000 7f95fa200640 1 -- 172.21.15.31:0/4053754587 wait complete. 2024-09-17T05:32:44.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.903+0000 7f95fa200640 1 Processor -- start 2024-09-17T05:32:44.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.903+0000 7f95fa200640 1 -- start start 2024-09-17T05:32:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95fa200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f406cc20 0x7f95f4164cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95fa200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f4071030 0x7f95f40c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95fa200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95f415c1c0 0x7f95f41536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95fa200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f95f4169020 con 0x7f95f406cc20 2024-09-17T05:32:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95fa200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f95f4168ea0 con 0x7f95f4071030 2024-09-17T05:32:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95fa200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f95f41691a0 con 0x7f95f415c1c0 2024-09-17T05:32:44.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95f3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f406cc20 0x7f95f4164cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:44.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95f3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f406cc20 0x7f95f4164cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45968/0 (socket says 172.21.15.31:45968) 2024-09-17T05:32:44.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95f3400640 1 -- 172.21.15.31:0/3217081502 learned_addr learned my addr 172.21.15.31:0/3217081502 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:44.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95f2a00640 1 --2- 172.21.15.31:0/3217081502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f4071030 0x7f95f40c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:44.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95f3e00640 1 --2- 172.21.15.31:0/3217081502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95f415c1c0 0x7f95f41536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:44.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95f3400640 1 -- 172.21.15.31:0/3217081502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95f415c1c0 msgr2=0x7f95f41536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:44.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95f3400640 1 --2- 172.21.15.31:0/3217081502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95f415c1c0 0x7f95f41536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95f3400640 1 -- 172.21.15.31:0/3217081502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f4071030 msgr2=0x7f95f40c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:44.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95f3400640 1 --2- 172.21.15.31:0/3217081502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f4071030 0x7f95f40c2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:44.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95f3400640 1 -- 172.21.15.31:0/3217081502 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f4165210 con 0x7f95f406cc20 2024-09-17T05:32:44.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95f3400640 1 --2- 172.21.15.31:0/3217081502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f406cc20 0x7f95f4164cd0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f95e400b580 tx=0x7f95e400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:44.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95eb400640 1 -- 172.21.15.31:0/3217081502 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4014070 con 0x7f95f406cc20 2024-09-17T05:32:44.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95eb400640 1 -- 172.21.15.31:0/3217081502 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95e4010980 con 0x7f95f406cc20 2024-09-17T05:32:44.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95fa200640 1 -- 172.21.15.31:0/3217081502 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f40b14d0 con 0x7f95f406cc20 2024-09-17T05:32:44.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95eb400640 1 -- 172.21.15.31:0/3217081502 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4010dd0 con 0x7f95f406cc20 2024-09-17T05:32:44.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95fa200640 1 -- 172.21.15.31:0/3217081502 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f40cebe0 con 0x7f95f406cc20 2024-09-17T05:32:44.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95fa200640 1 -- 172.21.15.31:0/3217081502 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95f40cede0 con 0x7f95f406cc20 2024-09-17T05:32:44.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95eb400640 1 -- 172.21.15.31:0/3217081502 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 14) ==== 48990+0+0 (secure 0 0 0) 0x7f95e4017070 con 0x7f95f406cc20 2024-09-17T05:32:44.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95eb400640 1 --2- 172.21.15.31:0/3217081502 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95d403bbf0 0x7f95d403e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:44.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95eb400640 1 -- 172.21.15.31:0/3217081502 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6268+0+0 (secure 0 0 0) 0x7f95e40505c0 con 0x7f95f406cc20 2024-09-17T05:32:44.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.907+0000 7f95f2a00640 1 --2- 172.21.15.31:0/3217081502 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95d403bbf0 0x7f95d403e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:44.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.911+0000 7f95f2a00640 1 --2- 172.21.15.31:0/3217081502 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95d403bbf0 0x7f95d403e0b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f95f40b6be0 tx=0x7f95e0001380 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:44.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:44.915+0000 7f95eb400640 1 -- 172.21.15.31:0/3217081502 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f95f40cede0 con 0x7f95f406cc20 2024-09-17T05:32:44.958 INFO:tasks.ceph.mgr.x.smithi155.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-17T05:32:44.958 INFO:tasks.ceph.mgr.x.smithi155.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-17T05:32:44.958 INFO:tasks.ceph.mgr.x.smithi155.stderr: from numpy import show_config as show_numpy_config 2024-09-17T05:32:45.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.123+0000 7f95fa200640 1 -- 172.21.15.31:0/3217081502 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95f40b6c10 con 0x7f95f406cc20 2024-09-17T05:32:45.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.127+0000 7f95eb400640 1 -- 172.21.15.31:0/3217081502 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7f95e400fc10 con 0x7f95f406cc20 2024-09-17T05:32:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:45.127 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":48,"btime":"2024-09-17T05:32:37:503295+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/4172452504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":4172452504},{"type":"v1","addr":"172.21.15.155:6837","nonce":4172452504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2918874157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2918874157},{"type":"v1","addr":"172.21.15.155:6836","nonce":2918874157}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3987740697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3987740697},{"type":"v1","addr":"172.21.15.31:6833","nonce":3987740697}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:32:22.832719+0000","modified":"2024-09-17T05:32:25.871459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6153":{"gid":6153,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1598380263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1598380263},{"type":"v1","addr":"172.21.15.31:6835","nonce":1598380263}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6153,"qdb_cluster":[6153]},"id":5}]} 2024-09-17T05:32:45.127 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 48 2024-09-17T05:32:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.127+0000 7f95fa200640 1 -- 172.21.15.31:0/3217081502 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95d403bbf0 msgr2=0x7f95d403e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.127+0000 7f95fa200640 1 --2- 172.21.15.31:0/3217081502 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95d403bbf0 0x7f95d403e0b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f95f40b6be0 tx=0x7f95e0001380 comp rx=0 tx=0).stop 2024-09-17T05:32:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.127+0000 7f95fa200640 1 -- 172.21.15.31:0/3217081502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f406cc20 msgr2=0x7f95f4164cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.127+0000 7f95fa200640 1 --2- 172.21.15.31:0/3217081502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f406cc20 0x7f95f4164cd0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f95e400b580 tx=0x7f95e400ba40 comp rx=0 tx=0).stop 2024-09-17T05:32:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.127+0000 7f95fa200640 1 -- 172.21.15.31:0/3217081502 shutdown_connections 2024-09-17T05:32:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.127+0000 7f95fa200640 1 --2- 172.21.15.31:0/3217081502 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95d403bbf0 0x7f95d403e0b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.127+0000 7f95fa200640 1 --2- 172.21.15.31:0/3217081502 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95f415c1c0 0x7f95f41536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.127+0000 7f95fa200640 1 --2- 172.21.15.31:0/3217081502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f4071030 0x7f95f40c2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.127+0000 7f95fa200640 1 --2- 172.21.15.31:0/3217081502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f406cc20 0x7f95f4164cd0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.127+0000 7f95fa200640 1 -- 172.21.15.31:0/3217081502 >> 172.21.15.31:0/3217081502 conn(0x7f95f40d0c90 msgr2=0x7f95f40b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:45.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.127+0000 7f95fa200640 1 -- 172.21.15.31:0/3217081502 shutdown_connections 2024-09-17T05:32:45.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.127+0000 7f95fa200640 1 -- 172.21.15.31:0/3217081502 wait complete. 2024-09-17T05:32:45.149 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:32:45.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.295+0000 7f0d9ec00640 1 -- 172.21.15.31:0/1466415152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d980cdb30 msgr2=0x7f0d980cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:45.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.295+0000 7f0d9ec00640 1 --2- 172.21.15.31:0/1466415152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d980cdb30 0x7f0d980cebb0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0d980cdf50 tx=0x7f0d8001c8c0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.295+0000 7f0d9ec00640 1 -- 172.21.15.31:0/1466415152 shutdown_connections 2024-09-17T05:32:45.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.295+0000 7f0d9ec00640 1 --2- 172.21.15.31:0/1466415152 >> v2:172.21.15.155:3300/0 conn(0x7f0d980d28e0 0x7f0d980cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.295+0000 7f0d9ec00640 1 --2- 172.21.15.31:0/1466415152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d980cdb30 0x7f0d980cebb0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.295+0000 7f0d9ec00640 1 --2- 172.21.15.31:0/1466415152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d9815bea0 0x7f0d980ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.295+0000 7f0d9ec00640 1 -- 172.21.15.31:0/1466415152 >> 172.21.15.31:0/1466415152 conn(0x7f0d980d1dc0 msgr2=0x7f0d980d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:45.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.295+0000 7f0d9ec00640 1 -- 172.21.15.31:0/1466415152 shutdown_connections 2024-09-17T05:32:45.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.295+0000 7f0d9ec00640 1 -- 172.21.15.31:0/1466415152 wait complete. 2024-09-17T05:32:45.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d9ec00640 1 Processor -- start 2024-09-17T05:32:45.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d9ec00640 1 -- start start 2024-09-17T05:32:45.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d9ec00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d980cdb30 0x7f0d980c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:45.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d9ec00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d980d28e0 0x7f0d980c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:45.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d9ec00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d9815bea0 0x7f0d98071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:45.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d9ec00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0d980af0a0 con 0x7f0d980d28e0 2024-09-17T05:32:45.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d9ec00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0d980aef20 con 0x7f0d980cdb30 2024-09-17T05:32:45.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d9ec00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0d980af220 con 0x7f0d9815bea0 2024-09-17T05:32:45.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d8f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d980d28e0 0x7f0d980c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:45.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d97e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d980cdb30 0x7f0d980c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:45.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d97e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d980cdb30 0x7f0d980c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:47702/0 (socket says 172.21.15.31:47702) 2024-09-17T05:32:45.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d97e00640 1 -- 172.21.15.31:0/2430570662 learned_addr learned my addr 172.21.15.31:0/2430570662 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:45.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d9cc00640 1 --2- 172.21.15.31:0/2430570662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d9815bea0 0x7f0d98071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:45.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d8f400640 1 -- 172.21.15.31:0/2430570662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d9815bea0 msgr2=0x7f0d98071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:45.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d8f400640 1 --2- 172.21.15.31:0/2430570662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d9815bea0 0x7f0d98071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d8f400640 1 -- 172.21.15.31:0/2430570662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d980cdb30 msgr2=0x7f0d980c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:45.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d8f400640 1 --2- 172.21.15.31:0/2430570662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d980cdb30 0x7f0d980c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d8f400640 1 -- 172.21.15.31:0/2430570662 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d980cb620 con 0x7f0d980d28e0 2024-09-17T05:32:45.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d97e00640 1 --2- 172.21.15.31:0/2430570662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d980cdb30 0x7f0d980c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:32:45.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d8f400640 1 --2- 172.21.15.31:0/2430570662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d980d28e0 0x7f0d980c84d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0d800ac000 tx=0x7f0d80004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:45.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d94c00640 1 -- 172.21.15.31:0/2430570662 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d800b2040 con 0x7f0d980d28e0 2024-09-17T05:32:45.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d94c00640 1 -- 172.21.15.31:0/2430570662 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d80004430 con 0x7f0d980d28e0 2024-09-17T05:32:45.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d94c00640 1 -- 172.21.15.31:0/2430570662 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80005290 con 0x7f0d980d28e0 2024-09-17T05:32:45.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d9ec00640 1 -- 172.21.15.31:0/2430570662 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d980cb900 con 0x7f0d980d28e0 2024-09-17T05:32:45.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d9ec00640 1 -- 172.21.15.31:0/2430570662 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d980cbec0 con 0x7f0d980d28e0 2024-09-17T05:32:45.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d9ec00640 1 -- 172.21.15.31:0/2430570662 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d980cc9d0 con 0x7f0d980d28e0 2024-09-17T05:32:45.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.299+0000 7f0d94c00640 1 -- 172.21.15.31:0/2430570662 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 14) ==== 48990+0+0 (secure 0 0 0) 0x7f0d80005430 con 0x7f0d980d28e0 2024-09-17T05:32:45.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.303+0000 7f0d94c00640 1 --2- 172.21.15.31:0/2430570662 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d7403bbf0 0x7f0d7403e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:45.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.303+0000 7f0d94c00640 1 -- 172.21.15.31:0/2430570662 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6268+0+0 (secure 0 0 0) 0x7f0d800ea1c0 con 0x7f0d980d28e0 2024-09-17T05:32:45.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.303+0000 7f0d97e00640 1 --2- 172.21.15.31:0/2430570662 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d7403bbf0 0x7f0d7403e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:45.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.303+0000 7f0d97e00640 1 --2- 172.21.15.31:0/2430570662 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d7403bbf0 0x7f0d7403e0b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0d98155df0 tx=0x7f0d8800b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:45.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.307+0000 7f0d94c00640 1 -- 172.21.15.31:0/2430570662 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0d800164b0 con 0x7f0d980d28e0 2024-09-17T05:32:45.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.523+0000 7f0d9ec00640 1 -- 172.21.15.31:0/2430570662 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d9806ed60 con 0x7f0d980d28e0 2024-09-17T05:32:45.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.523+0000 7f0d94c00640 1 -- 172.21.15.31:0/2430570662 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7f0d800be3e0 con 0x7f0d980d28e0 2024-09-17T05:32:45.524 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:45.524 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":48,"btime":"2024-09-17T05:32:37:503295+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/4172452504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":4172452504},{"type":"v1","addr":"172.21.15.155:6837","nonce":4172452504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2918874157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2918874157},{"type":"v1","addr":"172.21.15.155:6836","nonce":2918874157}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3987740697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3987740697},{"type":"v1","addr":"172.21.15.31:6833","nonce":3987740697}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:32:22.832719+0000","modified":"2024-09-17T05:32:25.871459+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6153":{"gid":6153,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1598380263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1598380263},{"type":"v1","addr":"172.21.15.31:6835","nonce":1598380263}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6153,"qdb_cluster":[6153]},"id":5}]} 2024-09-17T05:32:45.524 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 48 2024-09-17T05:32:45.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.523+0000 7f0d9ec00640 1 -- 172.21.15.31:0/2430570662 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d7403bbf0 msgr2=0x7f0d7403e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:45.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.523+0000 7f0d9ec00640 1 --2- 172.21.15.31:0/2430570662 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d7403bbf0 0x7f0d7403e0b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0d98155df0 tx=0x7f0d8800b390 comp rx=0 tx=0).stop 2024-09-17T05:32:45.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.523+0000 7f0d9ec00640 1 -- 172.21.15.31:0/2430570662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d980d28e0 msgr2=0x7f0d980c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:45.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.523+0000 7f0d9ec00640 1 --2- 172.21.15.31:0/2430570662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d980d28e0 0x7f0d980c84d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0d800ac000 tx=0x7f0d80004040 comp rx=0 tx=0).stop 2024-09-17T05:32:45.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.523+0000 7f0d9ec00640 1 -- 172.21.15.31:0/2430570662 shutdown_connections 2024-09-17T05:32:45.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.523+0000 7f0d9ec00640 1 --2- 172.21.15.31:0/2430570662 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d7403bbf0 0x7f0d7403e0b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.523+0000 7f0d9ec00640 1 --2- 172.21.15.31:0/2430570662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d9815bea0 0x7f0d98071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.523+0000 7f0d9ec00640 1 --2- 172.21.15.31:0/2430570662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d980d28e0 0x7f0d980c84d0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.523+0000 7f0d9ec00640 1 --2- 172.21.15.31:0/2430570662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d980cdb30 0x7f0d980c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.523+0000 7f0d9ec00640 1 -- 172.21.15.31:0/2430570662 >> 172.21.15.31:0/2430570662 conn(0x7f0d980d1dc0 msgr2=0x7f0d9806f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:45.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.523+0000 7f0d9ec00640 1 -- 172.21.15.31:0/2430570662 shutdown_connections 2024-09-17T05:32:45.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.527+0000 7f0d9ec00640 1 -- 172.21.15.31:0/2430570662 wait complete. 2024-09-17T05:32:45.547 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:32:45.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a4a400640 1 -- 172.21.15.31:0/248276275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a4415df50 msgr2=0x7f7a4406e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:45.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a4a400640 1 --2- 172.21.15.31:0/248276275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a4415df50 0x7f7a4406e740 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009840 tx=0x7f7a3401c790 comp rx=0 tx=0).stop 2024-09-17T05:32:45.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a4a400640 1 -- 172.21.15.31:0/248276275 shutdown_connections 2024-09-17T05:32:45.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a4a400640 1 --2- 172.21.15.31:0/248276275 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a440b11d0 0x7f7a4406ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a4a400640 1 --2- 172.21.15.31:0/248276275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a4415df50 0x7f7a4406e740 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a4a400640 1 -- 172.21.15.31:0/248276275 >> 172.21.15.31:0/248276275 conn(0x7f7a440d1dc0 msgr2=0x7f7a440d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:45.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a4a400640 1 -- 172.21.15.31:0/248276275 shutdown_connections 2024-09-17T05:32:45.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a4a400640 1 -- 172.21.15.31:0/248276275 wait complete. 2024-09-17T05:32:45.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a4a400640 1 Processor -- start 2024-09-17T05:32:45.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a4a400640 1 -- start start 2024-09-17T05:32:45.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a4a400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a440b11d0 0x7f7a4415c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:45.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a4a400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a4415df50 0x7f7a4415e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:45.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a4a400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4415e330 0x7f7a440b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:45.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a4a400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7a440d0870 con 0x7f7a4415e330 2024-09-17T05:32:45.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a4a400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7a440d06f0 con 0x7f7a440b11d0 2024-09-17T05:32:45.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a4a400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7a440d09f0 con 0x7f7a4415df50 2024-09-17T05:32:45.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a43e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4415e330 0x7f7a440b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:45.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a43e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4415e330 0x7f7a440b60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46014/0 (socket says 172.21.15.31:46014) 2024-09-17T05:32:45.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a43e00640 1 -- 172.21.15.31:0/174374696 learned_addr learned my addr 172.21.15.31:0/174374696 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:45.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a43400640 1 --2- 172.21.15.31:0/174374696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a440b11d0 0x7f7a4415c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:45.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a42a00640 1 --2- 172.21.15.31:0/174374696 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a4415df50 0x7f7a4415e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:45.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a43e00640 1 -- 172.21.15.31:0/174374696 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a4415df50 msgr2=0x7f7a4415e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:45.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a43e00640 1 --2- 172.21.15.31:0/174374696 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a4415df50 0x7f7a4415e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a43e00640 1 -- 172.21.15.31:0/174374696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a440b11d0 msgr2=0x7f7a4415c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:45.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a43e00640 1 --2- 172.21.15.31:0/174374696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a440b11d0 0x7f7a4415c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a43e00640 1 -- 172.21.15.31:0/174374696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4415ac70 con 0x7f7a4415e330 2024-09-17T05:32:45.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.695+0000 7f7a43400640 1 --2- 172.21.15.31:0/174374696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a440b11d0 0x7f7a4415c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:32:45.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.699+0000 7f7a43e00640 1 --2- 172.21.15.31:0/174374696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4415e330 0x7f7a440b60d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009fb0 tx=0x7f7a3c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:45.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.699+0000 7f7a3b400640 1 -- 172.21.15.31:0/174374696 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c003980 con 0x7f7a4415e330 2024-09-17T05:32:45.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.699+0000 7f7a3b400640 1 -- 172.21.15.31:0/174374696 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a3c003c30 con 0x7f7a4415e330 2024-09-17T05:32:45.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.699+0000 7f7a3b400640 1 -- 172.21.15.31:0/174374696 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c004280 con 0x7f7a4415e330 2024-09-17T05:32:45.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.699+0000 7f7a4a400640 1 -- 172.21.15.31:0/174374696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a4415af50 con 0x7f7a4415e330 2024-09-17T05:32:45.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.699+0000 7f7a4a400640 1 -- 172.21.15.31:0/174374696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a440ce850 con 0x7f7a4415e330 2024-09-17T05:32:45.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.699+0000 7f7a4a400640 1 -- 172.21.15.31:0/174374696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a440afcd0 con 0x7f7a4415e330 2024-09-17T05:32:45.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.699+0000 7f7a3b400640 1 -- 172.21.15.31:0/174374696 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 14) ==== 48990+0+0 (secure 0 0 0) 0x7f7a3c004420 con 0x7f7a4415e330 2024-09-17T05:32:45.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.699+0000 7f7a3b400640 1 --2- 172.21.15.31:0/174374696 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7a2403bbf0 0x7f7a2403e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:45.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.699+0000 7f7a3b400640 1 -- 172.21.15.31:0/174374696 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6268+0+0 (secure 0 0 0) 0x7f7a3c051100 con 0x7f7a4415e330 2024-09-17T05:32:45.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.699+0000 7f7a43400640 1 --2- 172.21.15.31:0/174374696 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7a2403bbf0 0x7f7a2403e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:45.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.699+0000 7f7a43400640 1 --2- 172.21.15.31:0/174374696 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7a2403bbf0 0x7f7a2403e0b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7a340af000 tx=0x7f7a34019530 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:45.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.703+0000 7f7a3b400640 1 -- 172.21.15.31:0/174374696 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7a3c004710 con 0x7f7a4415e330 2024-09-17T05:32:45.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.879+0000 7f7a4a400640 1 -- 172.21.15.31:0/174374696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a4406eeb0 con 0x7f7a4415e330 2024-09-17T05:32:45.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.883+0000 7f7a3b400640 1 -- 172.21.15.31:0/174374696 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+17572 (secure 0 0 0) 0x7f7a3c00bb00 con 0x7f7a4415e330 2024-09-17T05:32:45.882 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:45.883 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":70,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:32:42.673343+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:32:20.745608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T05:32:21.805091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:0/987689145":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/1391840738":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/3008380108":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/3294325931":"2024-09-18T05:32:42.673305+0000","172.21.15.155:6809/1222054038":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/1377928572":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/1032210633":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/2541203397":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/376613225":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/752157024":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/3022973997":"2024-09-18T05:32:42.673305+0000","172.21.15.155:6808/1222054038":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/913411077":"2024-09-18T05:32:42.673305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:32:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.883+0000 7f7a4a400640 1 -- 172.21.15.31:0/174374696 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7a2403bbf0 msgr2=0x7f7a2403e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.883+0000 7f7a4a400640 1 --2- 172.21.15.31:0/174374696 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7a2403bbf0 0x7f7a2403e0b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7a340af000 tx=0x7f7a34019530 comp rx=0 tx=0).stop 2024-09-17T05:32:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.883+0000 7f7a4a400640 1 -- 172.21.15.31:0/174374696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4415e330 msgr2=0x7f7a440b60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.883+0000 7f7a4a400640 1 --2- 172.21.15.31:0/174374696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4415e330 0x7f7a440b60d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009fb0 tx=0x7f7a3c00c800 comp rx=0 tx=0).stop 2024-09-17T05:32:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.883+0000 7f7a4a400640 1 -- 172.21.15.31:0/174374696 shutdown_connections 2024-09-17T05:32:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.883+0000 7f7a4a400640 1 --2- 172.21.15.31:0/174374696 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7a2403bbf0 0x7f7a2403e0b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.883+0000 7f7a4a400640 1 --2- 172.21.15.31:0/174374696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a4415e330 0x7f7a440b60d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.883+0000 7f7a4a400640 1 --2- 172.21.15.31:0/174374696 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a4415df50 0x7f7a4415e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.883+0000 7f7a4a400640 1 --2- 172.21.15.31:0/174374696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a440b11d0 0x7f7a4415c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:45.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.883+0000 7f7a4a400640 1 -- 172.21.15.31:0/174374696 >> 172.21.15.31:0/174374696 conn(0x7f7a440d1dc0 msgr2=0x7f7a440d0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:45.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.883+0000 7f7a4a400640 1 -- 172.21.15.31:0/174374696 shutdown_connections 2024-09-17T05:32:45.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:45.883+0000 7f7a4a400640 1 -- 172.21.15.31:0/174374696 wait complete. 2024-09-17T05:32:45.904 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:32:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.051+0000 7ff73f200640 1 -- 172.21.15.31:0/1422709621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7400b4d80 msgr2=0x7ff7400b11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.051+0000 7ff73f200640 1 --2- 172.21.15.31:0/1422709621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7400b4d80 0x7ff7400b11a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff730009840 tx=0x7ff73001c820 comp rx=0 tx=0).stop 2024-09-17T05:32:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.051+0000 7ff73f200640 1 -- 172.21.15.31:0/1422709621 shutdown_connections 2024-09-17T05:32:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.051+0000 7ff73f200640 1 --2- 172.21.15.31:0/1422709621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7400b4d80 0x7ff7400b11a0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.051+0000 7ff73f200640 1 -- 172.21.15.31:0/1422709621 >> 172.21.15.31:0/1422709621 conn(0x7ff74009aa10 msgr2=0x7ff74009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.051+0000 7ff73f200640 1 -- 172.21.15.31:0/1422709621 shutdown_connections 2024-09-17T05:32:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.051+0000 7ff73f200640 1 -- 172.21.15.31:0/1422709621 wait complete. 2024-09-17T05:32:46.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73f200640 1 Processor -- start 2024-09-17T05:32:46.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73f200640 1 -- start start 2024-09-17T05:32:46.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7400b0ce0 0x7ff74013c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7400b4d80 0x7ff740158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7400b5870 0x7ff74006ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff740169c00 con 0x7ff7400b0ce0 2024-09-17T05:32:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73f200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff740169a80 con 0x7ff7400b5870 2024-09-17T05:32:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff740169d80 con 0x7ff7400b4d80 2024-09-17T05:32:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7400b0ce0 0x7ff74013c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7400b0ce0 0x7ff74013c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46042/0 (socket says 172.21.15.31:46042) 2024-09-17T05:32:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73de00640 1 -- 172.21.15.31:0/3067413533 learned_addr learned my addr 172.21.15.31:0/3067413533 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff737e00640 1 --2- 172.21.15.31:0/3067413533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7400b4d80 0x7ff740158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:46.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73e800640 1 --2- 172.21.15.31:0/3067413533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7400b5870 0x7ff74006ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73de00640 1 -- 172.21.15.31:0/3067413533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7400b4d80 msgr2=0x7ff740158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73de00640 1 --2- 172.21.15.31:0/3067413533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7400b4d80 0x7ff740158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73de00640 1 -- 172.21.15.31:0/3067413533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7400b5870 msgr2=0x7ff74006ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73de00640 1 --2- 172.21.15.31:0/3067413533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7400b5870 0x7ff74006ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73de00640 1 -- 172.21.15.31:0/3067413533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff740158f70 con 0x7ff7400b0ce0 2024-09-17T05:32:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73e800640 1 --2- 172.21.15.31:0/3067413533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7400b5870 0x7ff74006ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff737e00640 1 --2- 172.21.15.31:0/3067413533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7400b4d80 0x7ff740158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73de00640 1 --2- 172.21.15.31:0/3067413533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7400b0ce0 0x7ff74013c200 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff730009790 tx=0x7ff7300a6650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff736000640 1 -- 172.21.15.31:0/3067413533 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730004100 con 0x7ff7400b0ce0 2024-09-17T05:32:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff736000640 1 -- 172.21.15.31:0/3067413533 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff730004390 con 0x7ff7400b0ce0 2024-09-17T05:32:46.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff736000640 1 -- 172.21.15.31:0/3067413533 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730005250 con 0x7ff7400b0ce0 2024-09-17T05:32:46.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73f200640 1 -- 172.21.15.31:0/3067413533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74013c740 con 0x7ff7400b0ce0 2024-09-17T05:32:46.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.055+0000 7ff73f200640 1 -- 172.21.15.31:0/3067413533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7401f7ed0 con 0x7ff7400b0ce0 2024-09-17T05:32:46.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.059+0000 7ff73f200640 1 -- 172.21.15.31:0/3067413533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7400b11a0 con 0x7ff7400b0ce0 2024-09-17T05:32:46.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.059+0000 7ff736000640 1 -- 172.21.15.31:0/3067413533 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 14) ==== 48990+0+0 (secure 0 0 0) 0x7ff7300c1020 con 0x7ff7400b0ce0 2024-09-17T05:32:46.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.059+0000 7ff736000640 1 --2- 172.21.15.31:0/3067413533 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff71c03bbf0 0x7ff71c03e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:46.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.059+0000 7ff736000640 1 -- 172.21.15.31:0/3067413533 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6268+0+0 (secure 0 0 0) 0x7ff7300eb090 con 0x7ff7400b0ce0 2024-09-17T05:32:46.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.059+0000 7ff737e00640 1 --2- 172.21.15.31:0/3067413533 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff71c03bbf0 0x7ff71c03e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:46.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.059+0000 7ff737e00640 1 --2- 172.21.15.31:0/3067413533 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff71c03bbf0 0x7ff71c03e0b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff7401529d0 tx=0x7ff728009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:46.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.063+0000 7ff736000640 1 -- 172.21.15.31:0/3067413533 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff730016410 con 0x7ff7400b0ce0 2024-09-17T05:32:46.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.275+0000 7ff73f200640 1 -- 172.21.15.31:0/3067413533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff7400ce0c0 con 0x7ff7400b0ce0 2024-09-17T05:32:46.277 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-09-17T05:32:46.275+0000 7f21d0200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:32:46.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.279+0000 7ff736000640 1 -- 172.21.15.31:0/3067413533 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v49) ==== 161+0+0 (secure 0 0 0) 0x7ff7300046d0 con 0x7ff7400b0ce0 2024-09-17T05:32:46.279 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:32:46.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.279+0000 7ff73f200640 1 -- 172.21.15.31:0/3067413533 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff71c03bbf0 msgr2=0x7ff71c03e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:46.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.279+0000 7ff73f200640 1 --2- 172.21.15.31:0/3067413533 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff71c03bbf0 0x7ff71c03e0b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff7401529d0 tx=0x7ff728009040 comp rx=0 tx=0).stop 2024-09-17T05:32:46.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.279+0000 7ff73f200640 1 -- 172.21.15.31:0/3067413533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7400b0ce0 msgr2=0x7ff74013c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:46.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.279+0000 7ff73f200640 1 --2- 172.21.15.31:0/3067413533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7400b0ce0 0x7ff74013c200 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff730009790 tx=0x7ff7300a6650 comp rx=0 tx=0).stop 2024-09-17T05:32:46.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.279+0000 7ff73f200640 1 -- 172.21.15.31:0/3067413533 shutdown_connections 2024-09-17T05:32:46.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.279+0000 7ff73f200640 1 --2- 172.21.15.31:0/3067413533 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff71c03bbf0 0x7ff71c03e0b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:46.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.279+0000 7ff73f200640 1 --2- 172.21.15.31:0/3067413533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7400b5870 0x7ff74006ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:46.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.279+0000 7ff73f200640 1 --2- 172.21.15.31:0/3067413533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff7400b4d80 0x7ff740158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:46.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.279+0000 7ff73f200640 1 --2- 172.21.15.31:0/3067413533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff7400b0ce0 0x7ff74013c200 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:46.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.279+0000 7ff73f200640 1 -- 172.21.15.31:0/3067413533 >> 172.21.15.31:0/3067413533 conn(0x7ff74009aa10 msgr2=0x7ff740166440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:46.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.279+0000 7ff73f200640 1 -- 172.21.15.31:0/3067413533 shutdown_connections 2024-09-17T05:32:46.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.279+0000 7ff73f200640 1 -- 172.21.15.31:0/3067413533 wait complete. 2024-09-17T05:32:46.294 INFO:tasks.ceph.mds.c.smithi031.stderr: -8420> 2024-09-17T05:32:28.407+0000 7fd18f800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:32:46.303 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:32:46.350 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-17T05:32:46.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.459+0000 7fe5e6400640 1 -- 172.21.15.31:0/2579661523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e0151410 msgr2=0x7fe5e00cf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:46.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.459+0000 7fe5e6400640 1 --2- 172.21.15.31:0/2579661523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e0151410 0x7fe5e00cf1d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0069980 tx=0x7fe5d001c830 comp rx=0 tx=0).stop 2024-09-17T05:32:46.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.459+0000 7fe5e6400640 1 -- 172.21.15.31:0/2579661523 shutdown_connections 2024-09-17T05:32:46.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.459+0000 7fe5e6400640 1 --2- 172.21.15.31:0/2579661523 >> v2:172.21.15.155:3300/0 conn(0x7fe5e00cf710 0x7fe5e00ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:46.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.459+0000 7fe5e6400640 1 --2- 172.21.15.31:0/2579661523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e0151410 0x7fe5e00cf1d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:46.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.459+0000 7fe5e6400640 1 -- 172.21.15.31:0/2579661523 >> 172.21.15.31:0/2579661523 conn(0x7fe5e00cfc20 msgr2=0x7fe5e00d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:46.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.459+0000 7fe5e6400640 1 -- 172.21.15.31:0/2579661523 shutdown_connections 2024-09-17T05:32:46.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.459+0000 7fe5e6400640 1 -- 172.21.15.31:0/2579661523 wait complete. 2024-09-17T05:32:46.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.459+0000 7fe5e6400640 1 Processor -- start 2024-09-17T05:32:46.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.459+0000 7fe5e6400640 1 -- start start 2024-09-17T05:32:46.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.459+0000 7fe5e6400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5e00ce8f0 0x7fe5e014c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:46.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.459+0000 7fe5e6400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5e00cf710 0x7fe5e01f64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:46.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5e6400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e0151410 0x7fe5e009b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:46.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5e6400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e00ad500 con 0x7fe5e0151410 2024-09-17T05:32:46.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5e6400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e00ad380 con 0x7fe5e00ce8f0 2024-09-17T05:32:46.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5e6400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe5e00ad680 con 0x7fe5e00cf710 2024-09-17T05:32:46.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5dfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e0151410 0x7fe5e009b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:46.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5df400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5e00ce8f0 0x7fe5e014c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:46.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5d7e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5e00cf710 0x7fe5e01f64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:46.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5dfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e0151410 0x7fe5e009b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46064/0 (socket says 172.21.15.31:46064) 2024-09-17T05:32:46.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5dfe00640 1 -- 172.21.15.31:0/1518084511 learned_addr learned my addr 172.21.15.31:0/1518084511 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:46.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5df400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5e00ce8f0 0x7fe5e014c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:47760/0 (socket says 172.21.15.31:47760) 2024-09-17T05:32:46.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5dfe00640 1 -- 172.21.15.31:0/1518084511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5e00cf710 msgr2=0x7fe5e01f64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:46.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5dfe00640 1 --2- 172.21.15.31:0/1518084511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5e00cf710 0x7fe5e01f64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:46.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5dfe00640 1 -- 172.21.15.31:0/1518084511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5e00ce8f0 msgr2=0x7fe5e014c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:46.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5dfe00640 1 --2- 172.21.15.31:0/1518084511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5e00ce8f0 0x7fe5e014c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:46.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5dfe00640 1 -- 172.21.15.31:0/1518084511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e01f6a30 con 0x7fe5e0151410 2024-09-17T05:32:46.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5dfe00640 1 --2- 172.21.15.31:0/1518084511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e0151410 0x7fe5e009b670 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800c7a0 tx=0x7fe5d800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:46.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5d7400640 1 -- 172.21.15.31:0/1518084511 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8003b80 con 0x7fe5e0151410 2024-09-17T05:32:46.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5d7400640 1 -- 172.21.15.31:0/1518084511 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5d8003d40 con 0x7fe5e0151410 2024-09-17T05:32:46.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5d7400640 1 -- 172.21.15.31:0/1518084511 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d800aab0 con 0x7fe5e0151410 2024-09-17T05:32:46.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5e6400640 1 -- 172.21.15.31:0/1518084511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e014d080 con 0x7fe5e0151410 2024-09-17T05:32:46.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5e6400640 1 -- 172.21.15.31:0/1518084511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e009ae70 con 0x7fe5e0151410 2024-09-17T05:32:46.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5e6400640 1 -- 172.21.15.31:0/1518084511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5e00ce3b0 con 0x7fe5e0151410 2024-09-17T05:32:46.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5d7400640 1 -- 172.21.15.31:0/1518084511 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 14) ==== 48990+0+0 (secure 0 0 0) 0x7fe5d800ac50 con 0x7fe5e0151410 2024-09-17T05:32:46.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5d7400640 1 --2- 172.21.15.31:0/1518084511 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe5bc03bbf0 0x7fe5bc03e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:46.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5d7400640 1 -- 172.21.15.31:0/1518084511 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6354+0+0 (secure 0 0 0) 0x7fe5d8050510 con 0x7fe5e0151410 2024-09-17T05:32:46.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.463+0000 7fe5df400640 1 --2- 172.21.15.31:0/1518084511 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe5bc03bbf0 0x7fe5bc03e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:46.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.467+0000 7fe5df400640 1 --2- 172.21.15.31:0/1518084511 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe5bc03bbf0 0x7fe5bc03e0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00af000 tx=0x7fe5d001b070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:46.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.467+0000 7fe5d7400640 1 -- 172.21.15.31:0/1518084511 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe5e01f6a30 con 0x7fe5e0151410 2024-09-17T05:32:46.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.679+0000 7fe5e6400640 1 -- 172.21.15.31:0/1518084511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe5e00d0810 con 0x7fe5e0151410 2024-09-17T05:32:46.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:46.699+0000 7fe5d7400640 1 -- 172.21.15.31:0/1518084511 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 15) ==== 49046+0+0 (secure 0 0 0) 0x7fe5d801b400 con 0x7fe5e0151410 2024-09-17T05:32:47.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.279+0000 7fe5d7400640 1 -- 172.21.15.31:0/1518084511 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v50) ==== 104+0+0 (secure 0 0 0) 0x7fe5d804e320 con 0x7fe5e0151410 2024-09-17T05:32:47.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.283+0000 7fe5e6400640 1 -- 172.21.15.31:0/1518084511 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe5bc03bbf0 msgr2=0x7fe5bc03e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:47.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.283+0000 7fe5e6400640 1 --2- 172.21.15.31:0/1518084511 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe5bc03bbf0 0x7fe5bc03e0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00af000 tx=0x7fe5d001b070 comp rx=0 tx=0).stop 2024-09-17T05:32:47.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.283+0000 7fe5e6400640 1 -- 172.21.15.31:0/1518084511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e0151410 msgr2=0x7fe5e009b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:47.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.283+0000 7fe5e6400640 1 --2- 172.21.15.31:0/1518084511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e0151410 0x7fe5e009b670 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800c7a0 tx=0x7fe5d800cc60 comp rx=0 tx=0).stop 2024-09-17T05:32:47.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.283+0000 7fe5e6400640 1 -- 172.21.15.31:0/1518084511 shutdown_connections 2024-09-17T05:32:47.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.283+0000 7fe5e6400640 1 --2- 172.21.15.31:0/1518084511 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe5bc03bbf0 0x7fe5bc03e0b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:47.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.283+0000 7fe5e6400640 1 --2- 172.21.15.31:0/1518084511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5e0151410 0x7fe5e009b670 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:47.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.283+0000 7fe5e6400640 1 --2- 172.21.15.31:0/1518084511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5e00cf710 0x7fe5e01f64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:47.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.283+0000 7fe5e6400640 1 --2- 172.21.15.31:0/1518084511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5e00ce8f0 0x7fe5e014c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:47.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.283+0000 7fe5e6400640 1 -- 172.21.15.31:0/1518084511 >> 172.21.15.31:0/1518084511 conn(0x7fe5e00cfc20 msgr2=0x7fe5e0073dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:47.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.283+0000 7fe5e6400640 1 -- 172.21.15.31:0/1518084511 shutdown_connections 2024-09-17T05:32:47.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.283+0000 7fe5e6400640 1 -- 172.21.15.31:0/1518084511 wait complete. 2024-09-17T05:32:47.307 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:32:47.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82c5800640 1 -- 172.21.15.31:0/1959266385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82c00ce890 msgr2=0x7f82c006eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:47.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82c5800640 1 --2- 172.21.15.31:0/1959266385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82c00ce890 0x7f82c006eb40 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f82c00767a0 tx=0x7f82b801cd80 comp rx=0 tx=0).stop 2024-09-17T05:32:47.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82c5800640 1 -- 172.21.15.31:0/1959266385 shutdown_connections 2024-09-17T05:32:47.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82c5800640 1 --2- 172.21.15.31:0/1959266385 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82c00ce890 0x7f82c006eb40 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:47.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82c5800640 1 --2- 172.21.15.31:0/1959266385 >> v2:172.21.15.155:3300/0 conn(0x7f82c015a9d0 0x7f82c00ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:47.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82c5800640 1 -- 172.21.15.31:0/1959266385 >> 172.21.15.31:0/1959266385 conn(0x7f82c00cfbc0 msgr2=0x7f82c00cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:47.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82c5800640 1 -- 172.21.15.31:0/1959266385 shutdown_connections 2024-09-17T05:32:47.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82c5800640 1 -- 172.21.15.31:0/1959266385 wait complete. 2024-09-17T05:32:47.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82c5800640 1 Processor -- start 2024-09-17T05:32:47.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82c5800640 1 -- start start 2024-09-17T05:32:47.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82c5800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82c00734f0 0x7f82c0146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:47.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82c5800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c00ce890 0x7f82c00ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:47.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82c5800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82c015a9d0 0x7f82c00ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:47.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82c5800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f82c00cde50 con 0x7f82c015a9d0 2024-09-17T05:32:47.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82c5800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f82c00cdcd0 con 0x7f82c00ce890 2024-09-17T05:32:47.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82c5800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f82c00cdfd0 con 0x7f82c00734f0 2024-09-17T05:32:47.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82bf400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82c015a9d0 0x7f82c00ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:47.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82bf400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82c015a9d0 0x7f82c00ae860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46092/0 (socket says 172.21.15.31:46092) 2024-09-17T05:32:47.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82bf400640 1 -- 172.21.15.31:0/3800494552 learned_addr learned my addr 172.21.15.31:0/3800494552 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:47.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82b7e00640 1 --2- 172.21.15.31:0/3800494552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c00ce890 0x7f82c00ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:47.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.511+0000 7f82bea00640 1 --2- 172.21.15.31:0/3800494552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82c00734f0 0x7f82c0146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:47.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.515+0000 7f82bf400640 1 -- 172.21.15.31:0/3800494552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82c00734f0 msgr2=0x7f82c0146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:47.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.515+0000 7f82bf400640 1 --2- 172.21.15.31:0/3800494552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82c00734f0 0x7f82c0146f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:47.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.515+0000 7f82bf400640 1 -- 172.21.15.31:0/3800494552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c00ce890 msgr2=0x7f82c00ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:47.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.515+0000 7f82bf400640 1 --2- 172.21.15.31:0/3800494552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c00ce890 0x7f82c00ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:47.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.515+0000 7f82bf400640 1 -- 172.21.15.31:0/3800494552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c00ace70 con 0x7f82c015a9d0 2024-09-17T05:32:47.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.515+0000 7f82bf400640 1 --2- 172.21.15.31:0/3800494552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82c015a9d0 0x7f82c00ae860 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009bd0 tx=0x7f82b80a5c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:47.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.515+0000 7f82b6a00640 1 -- 172.21.15.31:0/3800494552 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b80bb070 con 0x7f82c015a9d0 2024-09-17T05:32:47.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.515+0000 7f82b6a00640 1 -- 172.21.15.31:0/3800494552 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82b8004d40 con 0x7f82c015a9d0 2024-09-17T05:32:47.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.515+0000 7f82b6a00640 1 -- 172.21.15.31:0/3800494552 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b80b2040 con 0x7f82c015a9d0 2024-09-17T05:32:47.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.515+0000 7f82c5800640 1 -- 172.21.15.31:0/3800494552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c00ad150 con 0x7f82c015a9d0 2024-09-17T05:32:47.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.515+0000 7f82c5800640 1 -- 172.21.15.31:0/3800494552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c01474d0 con 0x7f82c015a9d0 2024-09-17T05:32:47.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.515+0000 7f82c5800640 1 -- 172.21.15.31:0/3800494552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c0069410 con 0x7f82c015a9d0 2024-09-17T05:32:47.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.515+0000 7f82b6a00640 1 -- 172.21.15.31:0/3800494552 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 15) ==== 49046+0+0 (secure 0 0 0) 0x7f82b80be070 con 0x7f82c015a9d0 2024-09-17T05:32:47.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.515+0000 7f82b6a00640 1 --2- 172.21.15.31:0/3800494552 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f829c03bcb0 0x7f829c03e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:47.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.515+0000 7f82b6a00640 1 -- 172.21.15.31:0/3800494552 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6354+0+0 (secure 0 0 0) 0x7f82b80ea790 con 0x7f82c015a9d0 2024-09-17T05:32:47.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.515+0000 7f82bea00640 1 --2- 172.21.15.31:0/3800494552 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f829c03bcb0 0x7f829c03e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:47.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.515+0000 7f82bea00640 1 --2- 172.21.15.31:0/3800494552 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f829c03bcb0 0x7f829c03e170 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f82b00016f0 tx=0x7f82b0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:47.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.519+0000 7f82b6a00640 1 -- 172.21.15.31:0/3800494552 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f82b8016970 con 0x7f82c015a9d0 2024-09-17T05:32:47.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.695+0000 7f82c5800640 1 -- 172.21.15.31:0/3800494552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f82c006eb40 con 0x7f82c015a9d0 2024-09-17T05:32:47.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:47.707+0000 7f82b6a00640 1 -- 172.21.15.31:0/3800494552 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f82b8005030 con 0x7f82c015a9d0 2024-09-17T05:32:48.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.283+0000 7f82b6a00640 1 -- 172.21.15.31:0/3800494552 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v72) ==== 181+0+0 (secure 0 0 0) 0x7f82b80ec0d0 con 0x7f82c015a9d0 2024-09-17T05:32:48.283 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:32:48.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.287+0000 7f82c5800640 1 -- 172.21.15.31:0/3800494552 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f829c03bcb0 msgr2=0x7f829c03e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:48.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.287+0000 7f82c5800640 1 --2- 172.21.15.31:0/3800494552 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f829c03bcb0 0x7f829c03e170 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f82b00016f0 tx=0x7f82b0009040 comp rx=0 tx=0).stop 2024-09-17T05:32:48.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.287+0000 7f82c5800640 1 -- 172.21.15.31:0/3800494552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82c015a9d0 msgr2=0x7f82c00ae860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.287+0000 7f82c5800640 1 --2- 172.21.15.31:0/3800494552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82c015a9d0 0x7f82c00ae860 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009bd0 tx=0x7f82b80a5c00 comp rx=0 tx=0).stop 2024-09-17T05:32:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.287+0000 7f82c5800640 1 -- 172.21.15.31:0/3800494552 shutdown_connections 2024-09-17T05:32:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.287+0000 7f82c5800640 1 --2- 172.21.15.31:0/3800494552 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f829c03bcb0 0x7f829c03e170 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.287+0000 7f82c5800640 1 --2- 172.21.15.31:0/3800494552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f82c015a9d0 0x7f82c00ae860 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.287+0000 7f82c5800640 1 --2- 172.21.15.31:0/3800494552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c00ce890 0x7f82c00ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.287+0000 7f82c5800640 1 --2- 172.21.15.31:0/3800494552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82c00734f0 0x7f82c0146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.287+0000 7f82c5800640 1 -- 172.21.15.31:0/3800494552 >> 172.21.15.31:0/3800494552 conn(0x7f82c00cfbc0 msgr2=0x7f82c00af860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.287+0000 7f82c5800640 1 -- 172.21.15.31:0/3800494552 shutdown_connections 2024-09-17T05:32:48.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.287+0000 7f82c5800640 1 -- 172.21.15.31:0/3800494552 wait complete. 2024-09-17T05:32:48.313 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:32:48.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.463+0000 7fcdc9400640 1 -- 172.21.15.31:0/3901643036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcda8005e60 msgr2=0x7fcda80062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:48.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.463+0000 7fcdc9400640 1 --2- 172.21.15.31:0/3901643036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcda8005e60 0x7fcda80062e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009ee0 tx=0x7fcdbc01d5f0 comp rx=0 tx=0).stop 2024-09-17T05:32:48.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.463+0000 7fcdc3200640 1 -- 172.21.15.31:0/3901643036 reap_dead start 2024-09-17T05:32:48.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.463+0000 7fcdc9400640 1 -- 172.21.15.31:0/3901643036 shutdown_connections 2024-09-17T05:32:48.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.463+0000 7fcdc9400640 1 -- 172.21.15.31:0/3901643036 >> 172.21.15.31:0/3901643036 conn(0x7fcdc40cfbc0 msgr2=0x7fcdc40cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:48.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.463+0000 7fcdc9400640 1 -- 172.21.15.31:0/3901643036 shutdown_connections 2024-09-17T05:32:48.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.463+0000 7fcdc9400640 1 -- 172.21.15.31:0/3901643036 wait complete. 2024-09-17T05:32:48.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc9400640 1 Processor -- start 2024-09-17T05:32:48.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc9400640 1 -- start start 2024-09-17T05:32:48.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc9400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcda8005e60 0x7fcdc41f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:48.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc9400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdc41504a0 0x7fcdc4150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:48.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc9400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdc40c9880 0x7fcdc40c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:48.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc9400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc415e910 con 0x7fcda8005e60 2024-09-17T05:32:48.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc9400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc415e790 con 0x7fcdc41504a0 2024-09-17T05:32:48.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc9400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcdc415b4d0 con 0x7fcdc40c9880 2024-09-17T05:32:48.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc2800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcda8005e60 0x7fcdc41f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:48.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc2800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcda8005e60 0x7fcdc41f40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46112/0 (socket says 172.21.15.31:46112) 2024-09-17T05:32:48.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc2800640 1 -- 172.21.15.31:0/2997910374 learned_addr learned my addr 172.21.15.31:0/2997910374 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:48.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdbbe00640 1 --2- 172.21.15.31:0/2997910374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdc41504a0 0x7fcdc4150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:48.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc3200640 1 --2- 172.21.15.31:0/2997910374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdc40c9880 0x7fcdc40c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:48.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc2800640 1 -- 172.21.15.31:0/2997910374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdc40c9880 msgr2=0x7fcdc40c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:48.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc2800640 1 --2- 172.21.15.31:0/2997910374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdc40c9880 0x7fcdc40c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:48.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc2800640 1 -- 172.21.15.31:0/2997910374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdc41504a0 msgr2=0x7fcdc4150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:48.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc2800640 1 --2- 172.21.15.31:0/2997910374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdc41504a0 0x7fcdc4150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:48.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc2800640 1 -- 172.21.15.31:0/2997910374 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc40b4650 con 0x7fcda8005e60 2024-09-17T05:32:48.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc2800640 1 --2- 172.21.15.31:0/2997910374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcda8005e60 0x7fcdc41f40f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4006e50 tx=0x7fcdb40049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdbaa00640 1 -- 172.21.15.31:0/2997910374 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4015020 con 0x7fcda8005e60 2024-09-17T05:32:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdbaa00640 1 -- 172.21.15.31:0/2997910374 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdb4011960 con 0x7fcda8005e60 2024-09-17T05:32:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc9400640 1 -- 172.21.15.31:0/2997910374 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc40b4930 con 0x7fcda8005e60 2024-09-17T05:32:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdbaa00640 1 -- 172.21.15.31:0/2997910374 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4011db0 con 0x7fcda8005e60 2024-09-17T05:32:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.467+0000 7fcdc9400640 1 -- 172.21.15.31:0/2997910374 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdc40b4ef0 con 0x7fcda8005e60 2024-09-17T05:32:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.471+0000 7fcdc9400640 1 -- 172.21.15.31:0/2997910374 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdc4069410 con 0x7fcda8005e60 2024-09-17T05:32:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.471+0000 7fcdbaa00640 1 -- 172.21.15.31:0/2997910374 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fcdb4018020 con 0x7fcda8005e60 2024-09-17T05:32:48.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.471+0000 7fcdbaa00640 1 --2- 172.21.15.31:0/2997910374 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcda0073350 0x7fcda0075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:48.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.471+0000 7fcdbaa00640 1 -- 172.21.15.31:0/2997910374 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5916+0+0 (secure 0 0 0) 0x7fcdb4095070 con 0x7fcda8005e60 2024-09-17T05:32:48.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.471+0000 7fcdbbe00640 1 --2- 172.21.15.31:0/2997910374 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcda0073350 0x7fcda0075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:48.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.471+0000 7fcdbbe00640 1 --2- 172.21.15.31:0/2997910374 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcda0073350 0x7fcda0075810 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40712c0 tx=0x7fcdac0091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:48.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.475+0000 7fcdbaa00640 1 -- 172.21.15.31:0/2997910374 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fcdb401f020 con 0x7fcda8005e60 2024-09-17T05:32:48.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:48.655+0000 7fcdc9400640 1 -- 172.21.15.31:0/2997910374 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcdc40ce4e0 con 0x7fcda8005e60 2024-09-17T05:32:49.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.291+0000 7fcdbaa00640 1 -- 172.21.15.31:0/2997910374 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v73) ==== 169+0+0 (secure 0 0 0) 0x7fcdc415a580 con 0x7fcda8005e60 2024-09-17T05:32:49.292 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-09-17T05:32:49.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.295+0000 7fcdc9400640 1 -- 172.21.15.31:0/2997910374 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcda0073350 msgr2=0x7fcda0075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:49.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.295+0000 7fcdc9400640 1 --2- 172.21.15.31:0/2997910374 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcda0073350 0x7fcda0075810 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40712c0 tx=0x7fcdac0091e0 comp rx=0 tx=0).stop 2024-09-17T05:32:49.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.295+0000 7fcdc9400640 1 -- 172.21.15.31:0/2997910374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcda8005e60 msgr2=0x7fcdc41f40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:49.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.295+0000 7fcdc9400640 1 --2- 172.21.15.31:0/2997910374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcda8005e60 0x7fcdc41f40f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4006e50 tx=0x7fcdb40049e0 comp rx=0 tx=0).stop 2024-09-17T05:32:49.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.295+0000 7fcdc9400640 1 -- 172.21.15.31:0/2997910374 shutdown_connections 2024-09-17T05:32:49.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.295+0000 7fcdc9400640 1 --2- 172.21.15.31:0/2997910374 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcda0073350 0x7fcda0075810 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:49.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.295+0000 7fcdc9400640 1 --2- 172.21.15.31:0/2997910374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdc40c9880 0x7fcdc40c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:49.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.295+0000 7fcdc9400640 1 --2- 172.21.15.31:0/2997910374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdc41504a0 0x7fcdc4150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:49.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.295+0000 7fcdc9400640 1 --2- 172.21.15.31:0/2997910374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcda8005e60 0x7fcdc41f40f0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:49.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.295+0000 7fcdc9400640 1 -- 172.21.15.31:0/2997910374 >> 172.21.15.31:0/2997910374 conn(0x7fcdc40cfbc0 msgr2=0x7fcdc40cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:49.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.295+0000 7fcdc9400640 1 -- 172.21.15.31:0/2997910374 shutdown_connections 2024-09-17T05:32:49.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.295+0000 7fcdc9400640 1 -- 172.21.15.31:0/2997910374 wait complete. 2024-09-17T05:32:49.322 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:32:49.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a4f200640 1 -- 172.21.15.31:0/1217201912 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a2c004030 msgr2=0x7f2a2c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:49.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a4f200640 1 --2- 172.21.15.31:0/1217201912 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a2c004030 0x7f2a2c004810 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009b60 tx=0x7f2a3001d270 comp rx=0 tx=0).stop 2024-09-17T05:32:49.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a4d200640 1 -- 172.21.15.31:0/1217201912 reap_dead start 2024-09-17T05:32:49.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a4f200640 1 -- 172.21.15.31:0/1217201912 shutdown_connections 2024-09-17T05:32:49.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a4f200640 1 -- 172.21.15.31:0/1217201912 >> 172.21.15.31:0/1217201912 conn(0x7f2a480d1dc0 msgr2=0x7f2a480d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:49.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a4f200640 1 -- 172.21.15.31:0/1217201912 shutdown_connections 2024-09-17T05:32:49.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a4f200640 1 -- 172.21.15.31:0/1217201912 wait complete. 2024-09-17T05:32:49.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a4f200640 1 Processor -- start 2024-09-17T05:32:49.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a4f200640 1 -- start start 2024-09-17T05:32:49.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a4f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a2c004030 0x7f2a48146b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:49.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a4f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a4815e7c0 0x7f2a48168ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:49.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a4f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a480c78e0 0x7f2a480c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:49.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a4f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2a480d1550 con 0x7f2a4815e7c0 2024-09-17T05:32:49.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a4f200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2a480d13d0 con 0x7f2a480c78e0 2024-09-17T05:32:49.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a4f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2a4816a520 con 0x7f2a2c004030 2024-09-17T05:32:49.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a3fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a4815e7c0 0x7f2a48168ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:49.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a3fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a4815e7c0 0x7f2a48168ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40776/0 (socket says 172.21.15.31:40776) 2024-09-17T05:32:49.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a3fe00640 1 -- 172.21.15.31:0/3444420379 learned_addr learned my addr 172.21.15.31:0/3444420379 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:49.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a47e00640 1 --2- 172.21.15.31:0/3444420379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a2c004030 0x7f2a48146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:49.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a4d200640 1 --2- 172.21.15.31:0/3444420379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a480c78e0 0x7f2a480c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:49.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a3fe00640 1 -- 172.21.15.31:0/3444420379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a2c004030 msgr2=0x7f2a48146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:49.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a3fe00640 1 --2- 172.21.15.31:0/3444420379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a2c004030 0x7f2a48146b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:49.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a3fe00640 1 -- 172.21.15.31:0/3444420379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a480c78e0 msgr2=0x7f2a480c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:49.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a3fe00640 1 --2- 172.21.15.31:0/3444420379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a480c78e0 0x7f2a480c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:49.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a3fe00640 1 -- 172.21.15.31:0/3444420379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4815efd0 con 0x7f2a4815e7c0 2024-09-17T05:32:49.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.475+0000 7f2a3fe00640 1 --2- 172.21.15.31:0/3444420379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a4815e7c0 0x7f2a48168ac0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2a3001cce0 tx=0x7f2a30005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.479+0000 7f2a44c00640 1 -- 172.21.15.31:0/3444420379 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a300bd070 con 0x7f2a4815e7c0 2024-09-17T05:32:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.479+0000 7f2a44c00640 1 -- 172.21.15.31:0/3444420379 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2a30004320 con 0x7f2a4815e7c0 2024-09-17T05:32:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.479+0000 7f2a44c00640 1 -- 172.21.15.31:0/3444420379 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a300b1040 con 0x7f2a4815e7c0 2024-09-17T05:32:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.479+0000 7f2a4f200640 1 -- 172.21.15.31:0/3444420379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a4815b5e0 con 0x7f2a4815e7c0 2024-09-17T05:32:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.479+0000 7f2a4f200640 1 -- 172.21.15.31:0/3444420379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a481610e0 con 0x7f2a4815e7c0 2024-09-17T05:32:49.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.479+0000 7f2a4f200640 1 -- 172.21.15.31:0/3444420379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a48160f10 con 0x7f2a4815e7c0 2024-09-17T05:32:49.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.479+0000 7f2a44c00640 1 -- 172.21.15.31:0/3444420379 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f2a300c0070 con 0x7f2a4815e7c0 2024-09-17T05:32:49.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.479+0000 7f2a44c00640 1 --2- 172.21.15.31:0/3444420379 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2a24073350 0x7f2a24075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:49.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.479+0000 7f2a44c00640 1 -- 172.21.15.31:0/3444420379 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5502+0+0 (secure 0 0 0) 0x7f2a3012e630 con 0x7f2a4815e7c0 2024-09-17T05:32:49.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.479+0000 7f2a47e00640 1 --2- 172.21.15.31:0/3444420379 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2a24073350 0x7f2a24075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:49.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.483+0000 7f2a47e00640 1 --2- 172.21.15.31:0/3444420379 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2a24073350 0x7f2a24075810 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2a38000c10 tx=0x7f2a38006b80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:49.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.483+0000 7f2a44c00640 1 -- 172.21.15.31:0/3444420379 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2a4815efd0 con 0x7f2a4815e7c0 2024-09-17T05:32:49.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.667+0000 7f2a4f200640 1 -- 172.21.15.31:0/3444420379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f2a48167da0 con 0x7f2a4815e7c0 2024-09-17T05:32:49.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.671+0000 7f2a44c00640 1 -- 172.21.15.31:0/3444420379 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v35) ==== 71+0+0 (secure 0 0 0) 0x7f2a30016f80 con 0x7f2a4815e7c0 2024-09-17T05:32:49.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.671+0000 7f2a4f200640 1 -- 172.21.15.31:0/3444420379 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2a24073350 msgr2=0x7f2a24075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:49.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.671+0000 7f2a4f200640 1 --2- 172.21.15.31:0/3444420379 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2a24073350 0x7f2a24075810 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2a38000c10 tx=0x7f2a38006b80 comp rx=0 tx=0).stop 2024-09-17T05:32:49.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.671+0000 7f2a4f200640 1 -- 172.21.15.31:0/3444420379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a4815e7c0 msgr2=0x7f2a48168ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:49.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.671+0000 7f2a4f200640 1 --2- 172.21.15.31:0/3444420379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a4815e7c0 0x7f2a48168ac0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2a3001cce0 tx=0x7f2a30005520 comp rx=0 tx=0).stop 2024-09-17T05:32:49.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.671+0000 7f2a4f200640 1 -- 172.21.15.31:0/3444420379 shutdown_connections 2024-09-17T05:32:49.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.671+0000 7f2a4f200640 1 --2- 172.21.15.31:0/3444420379 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2a24073350 0x7f2a24075810 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:49.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.671+0000 7f2a4f200640 1 --2- 172.21.15.31:0/3444420379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a480c78e0 0x7f2a480c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:49.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.671+0000 7f2a4f200640 1 --2- 172.21.15.31:0/3444420379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2a4815e7c0 0x7f2a48168ac0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:49.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.671+0000 7f2a4f200640 1 --2- 172.21.15.31:0/3444420379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2a2c004030 0x7f2a48146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:49.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.671+0000 7f2a4f200640 1 -- 172.21.15.31:0/3444420379 >> 172.21.15.31:0/3444420379 conn(0x7f2a480d1dc0 msgr2=0x7f2a48071fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:49.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.671+0000 7f2a4f200640 1 -- 172.21.15.31:0/3444420379 shutdown_connections 2024-09-17T05:32:49.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.671+0000 7f2a4f200640 1 -- 172.21.15.31:0/3444420379 wait complete. 2024-09-17T05:32:49.692 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction' 2024-09-17T05:32:49.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.847+0000 7efc3b200640 1 -- 172.21.15.31:0/33213158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc20003c90 msgr2=0x7efc20004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:49.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.847+0000 7efc3b200640 1 --2- 172.21.15.31:0/33213158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc20003c90 0x7efc20004090 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efc2c001860 tx=0x7efc2c01eff0 comp rx=0 tx=0).stop 2024-09-17T05:32:49.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.847+0000 7efc3b200640 1 -- 172.21.15.31:0/33213158 shutdown_connections 2024-09-17T05:32:49.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.847+0000 7efc3b200640 1 --2- 172.21.15.31:0/33213158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc20003c90 0x7efc20004090 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:49.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.847+0000 7efc3b200640 1 -- 172.21.15.31:0/33213158 >> 172.21.15.31:0/33213158 conn(0x7efc3c09aa10 msgr2=0x7efc3c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:49.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.847+0000 7efc3b200640 1 -- 172.21.15.31:0/33213158 shutdown_connections 2024-09-17T05:32:49.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc3b200640 1 -- 172.21.15.31:0/33213158 wait complete. 2024-09-17T05:32:49.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc3b200640 1 Processor -- start 2024-09-17T05:32:49.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc3b200640 1 -- start start 2024-09-17T05:32:49.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc3b200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc20003c90 0x7efc3c14b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:49.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc3b200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c1f8b50 0x7efc3c154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:49.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc3b200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc3c154c80 0x7efc3c0719f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:49.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc3b200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c0b5160 con 0x7efc3c1f8b50 2024-09-17T05:32:49.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc3b200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c0b1400 con 0x7efc20003c90 2024-09-17T05:32:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc3b200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efc3c0b52e0 con 0x7efc3c154c80 2024-09-17T05:32:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc31400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c1f8b50 0x7efc3c154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc31400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c1f8b50 0x7efc3c154740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40794/0 (socket says 172.21.15.31:40794) 2024-09-17T05:32:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc31400640 1 -- 172.21.15.31:0/372970534 learned_addr learned my addr 172.21.15.31:0/372970534 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc39e00640 1 --2- 172.21.15.31:0/372970534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc20003c90 0x7efc3c14b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc3a800640 1 --2- 172.21.15.31:0/372970534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc3c154c80 0x7efc3c0719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc31400640 1 -- 172.21.15.31:0/372970534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc3c154c80 msgr2=0x7efc3c0719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc31400640 1 --2- 172.21.15.31:0/372970534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc3c154c80 0x7efc3c0719f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc31400640 1 -- 172.21.15.31:0/372970534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc20003c90 msgr2=0x7efc3c14b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc31400640 1 --2- 172.21.15.31:0/372970534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc20003c90 0x7efc3c14b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc31400640 1 -- 172.21.15.31:0/372970534 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3c14bbf0 con 0x7efc3c1f8b50 2024-09-17T05:32:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc39e00640 1 --2- 172.21.15.31:0/372970534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc20003c90 0x7efc3c14b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:49.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc31400640 1 --2- 172.21.15.31:0/372970534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c1f8b50 0x7efc3c154740 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7efc24001760 tx=0x7efc24001210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc32a00640 1 -- 172.21.15.31:0/372970534 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc24015070 con 0x7efc3c1f8b50 2024-09-17T05:32:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc32a00640 1 -- 172.21.15.31:0/372970534 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc24011900 con 0x7efc3c1f8b50 2024-09-17T05:32:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.851+0000 7efc3b200640 1 -- 172.21.15.31:0/372970534 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc3c155190 con 0x7efc3c1f8b50 2024-09-17T05:32:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.855+0000 7efc32a00640 1 -- 172.21.15.31:0/372970534 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc24006b30 con 0x7efc3c1f8b50 2024-09-17T05:32:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.855+0000 7efc3b200640 1 -- 172.21.15.31:0/372970534 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc3c1f8070 con 0x7efc3c1f8b50 2024-09-17T05:32:49.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.855+0000 7efc3b200640 1 -- 172.21.15.31:0/372970534 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc3c070950 con 0x7efc3c1f8b50 2024-09-17T05:32:49.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.855+0000 7efc32a00640 1 -- 172.21.15.31:0/372970534 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7efc2400f430 con 0x7efc3c1f8b50 2024-09-17T05:32:49.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.855+0000 7efc32a00640 1 --2- 172.21.15.31:0/372970534 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efc18073350 0x7efc18075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:49.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.855+0000 7efc32a00640 1 -- 172.21.15.31:0/372970534 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5502+0+0 (secure 0 0 0) 0x7efc24094db0 con 0x7efc3c1f8b50 2024-09-17T05:32:49.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.855+0000 7efc39e00640 1 --2- 172.21.15.31:0/372970534 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efc18073350 0x7efc18075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:49.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.859+0000 7efc39e00640 1 --2- 172.21.15.31:0/372970534 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efc18073350 0x7efc18075810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efc2c001830 tx=0x7efc2c01be30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:49.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:49.859+0000 7efc32a00640 1 -- 172.21.15.31:0/372970534 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7efc2405f6c0 con 0x7efc3c1f8b50 2024-09-17T05:32:50.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.099+0000 7efc3b200640 1 -- 172.21.15.31:0/372970534 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]} v 0) -- 0x7efc3c0b2510 con 0x7efc3c1f8b50 2024-09-17T05:32:50.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.706+0000 7efc32a00640 1 -- 172.21.15.31:0/372970534 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]}]=0 v230) ==== 131+0+0 (secure 0 0 0) 0x7efc240640f0 con 0x7efc3c1f8b50 2024-09-17T05:32:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.710+0000 7efc3b200640 1 -- 172.21.15.31:0/372970534 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efc18073350 msgr2=0x7efc18075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.710+0000 7efc3b200640 1 --2- 172.21.15.31:0/372970534 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efc18073350 0x7efc18075810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efc2c001830 tx=0x7efc2c01be30 comp rx=0 tx=0).stop 2024-09-17T05:32:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.710+0000 7efc3b200640 1 -- 172.21.15.31:0/372970534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c1f8b50 msgr2=0x7efc3c154740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.710+0000 7efc3b200640 1 --2- 172.21.15.31:0/372970534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c1f8b50 0x7efc3c154740 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7efc24001760 tx=0x7efc24001210 comp rx=0 tx=0).stop 2024-09-17T05:32:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.710+0000 7efc3b200640 1 -- 172.21.15.31:0/372970534 shutdown_connections 2024-09-17T05:32:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.710+0000 7efc3b200640 1 --2- 172.21.15.31:0/372970534 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efc18073350 0x7efc18075810 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.710+0000 7efc3b200640 1 --2- 172.21.15.31:0/372970534 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc3c154c80 0x7efc3c0719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.710+0000 7efc3b200640 1 --2- 172.21.15.31:0/372970534 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c1f8b50 0x7efc3c154740 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.710+0000 7efc3b200640 1 --2- 172.21.15.31:0/372970534 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc20003c90 0x7efc3c14b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.710+0000 7efc3b200640 1 -- 172.21.15.31:0/372970534 >> 172.21.15.31:0/372970534 conn(0x7efc3c09aa10 msgr2=0x7efc3c15e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:50.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.710+0000 7efc3b200640 1 -- 172.21.15.31:0/372970534 shutdown_connections 2024-09-17T05:32:50.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.710+0000 7efc3b200640 1 -- 172.21.15.31:0/372970534 wait complete. 2024-09-17T05:32:50.733 INFO:tasks.cephfs_test_runner:test_mgr_eviction (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-09-17T05:32:50.733 INFO:tasks.cephfs_test_runner:Starting test: test_names_can_only_be_goodchars (tasks.cephfs.test_volumes.TestMisc) Test the creating vols, subvols subvolgroups fails when their names uses 2024-09-17T05:32:50.733 INFO:tasks.cephfs_test_runner:test_names_can_only_be_goodchars (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:32:50.734 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:32:50.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.878+0000 7f7243200640 1 -- 172.21.15.31:0/4157342351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f723c0cd100 msgr2=0x7f723c06f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.878+0000 7f7243200640 1 --2- 172.21.15.31:0/4157342351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f723c0cd100 0x7f723c06f7b0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f723c0af830 tx=0x7f722401c7a0 comp rx=0 tx=0).stop 2024-09-17T05:32:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7243200640 1 -- 172.21.15.31:0/4157342351 shutdown_connections 2024-09-17T05:32:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7243200640 1 --2- 172.21.15.31:0/4157342351 >> v2:172.21.15.155:3300/0 conn(0x7f723c0b49e0 0x7f723c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7243200640 1 --2- 172.21.15.31:0/4157342351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f723c0cd100 0x7f723c06f7b0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7243200640 1 -- 172.21.15.31:0/4157342351 >> 172.21.15.31:0/4157342351 conn(0x7f723c0b18f0 msgr2=0x7f723c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7243200640 1 -- 172.21.15.31:0/4157342351 shutdown_connections 2024-09-17T05:32:50.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7243200640 1 -- 172.21.15.31:0/4157342351 wait complete. 2024-09-17T05:32:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7243200640 1 Processor -- start 2024-09-17T05:32:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7243200640 1 -- start start 2024-09-17T05:32:50.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7243200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f723c0b49e0 0x7f723c14aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:50.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7243200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f723c0cd100 0x7f723c14af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:50.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7243200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f723c15dae0 0x7f723c0cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7243200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f723c0cf0c0 con 0x7f723c0cd100 2024-09-17T05:32:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7243200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f723c0cef40 con 0x7f723c0b49e0 2024-09-17T05:32:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7243200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f723c0cf240 con 0x7f723c15dae0 2024-09-17T05:32:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7233e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f723c0cd100 0x7f723c14af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7233e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f723c0cd100 0x7f723c14af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40824/0 (socket says 172.21.15.31:40824) 2024-09-17T05:32:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7233e00640 1 -- 172.21.15.31:0/3296705342 learned_addr learned my addr 172.21.15.31:0/3296705342 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f723be00640 1 --2- 172.21.15.31:0/3296705342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f723c0b49e0 0x7f723c14aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7241200640 1 --2- 172.21.15.31:0/3296705342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f723c15dae0 0x7f723c0cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7233e00640 1 -- 172.21.15.31:0/3296705342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f723c15dae0 msgr2=0x7f723c0cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7233e00640 1 --2- 172.21.15.31:0/3296705342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f723c15dae0 0x7f723c0cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7233e00640 1 -- 172.21.15.31:0/3296705342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f723c0b49e0 msgr2=0x7f723c14aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7233e00640 1 --2- 172.21.15.31:0/3296705342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f723c0b49e0 0x7f723c14aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:50.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7233e00640 1 -- 172.21.15.31:0/3296705342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723c09b990 con 0x7f723c0cd100 2024-09-17T05:32:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f723be00640 1 --2- 172.21.15.31:0/3296705342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f723c0b49e0 0x7f723c14aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7233e00640 1 --2- 172.21.15.31:0/3296705342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f723c0cd100 0x7f723c14af80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7224009850 tx=0x7f72240a6520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7238c00640 1 -- 172.21.15.31:0/3296705342 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72240ac070 con 0x7f723c0cd100 2024-09-17T05:32:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7238c00640 1 -- 172.21.15.31:0/3296705342 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7224004340 con 0x7f723c0cd100 2024-09-17T05:32:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.882+0000 7f7238c00640 1 -- 172.21.15.31:0/3296705342 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7224005320 con 0x7f723c0cd100 2024-09-17T05:32:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.886+0000 7f7243200640 1 -- 172.21.15.31:0/3296705342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723c074020 con 0x7f723c0cd100 2024-09-17T05:32:50.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.886+0000 7f7243200640 1 -- 172.21.15.31:0/3296705342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f723c06ff30 con 0x7f723c0cd100 2024-09-17T05:32:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.886+0000 7f7243200640 1 -- 172.21.15.31:0/3296705342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f723c069410 con 0x7f723c0cd100 2024-09-17T05:32:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.886+0000 7f7238c00640 1 -- 172.21.15.31:0/3296705342 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f72240af070 con 0x7f723c0cd100 2024-09-17T05:32:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.886+0000 7f7238c00640 1 --2- 172.21.15.31:0/3296705342 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7218073320 0x7f72180757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:50.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.886+0000 7f7238c00640 1 -- 172.21.15.31:0/3296705342 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5502+0+0 (secure 0 0 0) 0x7f722412e9a0 con 0x7f723c0cd100 2024-09-17T05:32:50.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.886+0000 7f723be00640 1 --2- 172.21.15.31:0/3296705342 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7218073320 0x7f72180757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:50.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.890+0000 7f723be00640 1 --2- 172.21.15.31:0/3296705342 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7218073320 0x7f72180757e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f723c15af20 tx=0x7f722c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:50.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:50.890+0000 7f7238c00640 1 -- 172.21.15.31:0/3296705342 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f723c09b990 con 0x7f723c0cd100 2024-09-17T05:32:51.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.066+0000 7f7243200640 1 -- 172.21.15.31:0/3296705342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f723c06fd20 con 0x7f723c0cd100 2024-09-17T05:32:51.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.070+0000 7f7238c00640 1 -- 172.21.15.31:0/3296705342 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+13878 (secure 0 0 0) 0x7f72240164b0 con 0x7f723c0cd100 2024-09-17T05:32:51.071 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:51.071 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":73,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:32:49.284690+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6834/1598380263":"2024-09-18T05:32:46.278717+0000","172.21.15.155:0/913411077":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/3022973997":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/376613225":"2024-09-18T05:32:42.673305+0000","172.21.15.155:6808/1222054038":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/2541203397":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/752157024":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/1032210633":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/1377928572":"2024-09-18T05:32:42.673305+0000","172.21.15.155:6809/1222054038":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/3294325931":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/3008380108":"2024-09-18T05:32:42.673305+0000","172.21.15.31:6835/1598380263":"2024-09-18T05:32:46.278717+0000","172.21.15.155:0/1391840738":"2024-09-18T05:32:42.673305+0000","172.21.15.155:0/987689145":"2024-09-18T05:32:42.673305+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:32:51.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.070+0000 7f7243200640 1 -- 172.21.15.31:0/3296705342 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7218073320 msgr2=0x7f72180757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:51.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.070+0000 7f7243200640 1 --2- 172.21.15.31:0/3296705342 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7218073320 0x7f72180757e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f723c15af20 tx=0x7f722c009040 comp rx=0 tx=0).stop 2024-09-17T05:32:51.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.070+0000 7f7243200640 1 -- 172.21.15.31:0/3296705342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f723c0cd100 msgr2=0x7f723c14af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:51.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.070+0000 7f7243200640 1 --2- 172.21.15.31:0/3296705342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f723c0cd100 0x7f723c14af80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7224009850 tx=0x7f72240a6520 comp rx=0 tx=0).stop 2024-09-17T05:32:51.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.070+0000 7f7243200640 1 -- 172.21.15.31:0/3296705342 shutdown_connections 2024-09-17T05:32:51.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.070+0000 7f7243200640 1 --2- 172.21.15.31:0/3296705342 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7218073320 0x7f72180757e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:51.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.070+0000 7f7243200640 1 --2- 172.21.15.31:0/3296705342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f723c15dae0 0x7f723c0cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:51.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.070+0000 7f7243200640 1 --2- 172.21.15.31:0/3296705342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f723c0cd100 0x7f723c14af80 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:51.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.070+0000 7f7243200640 1 --2- 172.21.15.31:0/3296705342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f723c0b49e0 0x7f723c14aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:51.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.070+0000 7f7243200640 1 -- 172.21.15.31:0/3296705342 >> 172.21.15.31:0/3296705342 conn(0x7f723c0b18f0 msgr2=0x7f723c154c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:51.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.070+0000 7f7243200640 1 -- 172.21.15.31:0/3296705342 shutdown_connections 2024-09-17T05:32:51.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.070+0000 7f7243200640 1 -- 172.21.15.31:0/3296705342 wait complete. 2024-09-17T05:32:51.092 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:28:33.209612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:32:51.093 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:32:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f4a07000640 1 -- 172.21.15.31:0/2177568686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a000ce620 msgr2=0x7f4a000cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f4a07000640 1 --2- 172.21.15.31:0/2177568686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a000ce620 0x7f4a000cfd30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009c80 tx=0x7f49f801cc80 comp rx=0 tx=0).stop 2024-09-17T05:32:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f4a07000640 1 -- 172.21.15.31:0/2177568686 shutdown_connections 2024-09-17T05:32:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f4a07000640 1 --2- 172.21.15.31:0/2177568686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a000ce620 0x7f4a000cfd30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f4a07000640 1 --2- 172.21.15.31:0/2177568686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a000b27a0 0x7f4a000ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f4a07000640 1 -- 172.21.15.31:0/2177568686 >> 172.21.15.31:0/2177568686 conn(0x7f4a000d1e30 msgr2=0x7f4a000d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f4a07000640 1 -- 172.21.15.31:0/2177568686 shutdown_connections 2024-09-17T05:32:51.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f4a07000640 1 -- 172.21.15.31:0/2177568686 wait complete. 2024-09-17T05:32:51.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f4a07000640 1 Processor -- start 2024-09-17T05:32:51.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f4a07000640 1 -- start start 2024-09-17T05:32:51.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f4a07000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a000b27a0 0x7f4a000aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:51.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f4a07000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a000ce620 0x7f4a000af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:51.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f4a07000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a0015f640 0x7f4a000af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:51.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f4a07000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4a000b1010 con 0x7f4a000ce620 2024-09-17T05:32:51.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f4a07000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a000b0e90 con 0x7f4a000b27a0 2024-09-17T05:32:51.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f4a07000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4a00169390 con 0x7f4a0015f640 2024-09-17T05:32:51.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f49f7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a000ce620 0x7f4a000af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:51.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f49f7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a000ce620 0x7f4a000af410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40832/0 (socket says 172.21.15.31:40832) 2024-09-17T05:32:51.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f49f7e00640 1 -- 172.21.15.31:0/829136370 learned_addr learned my addr 172.21.15.31:0/829136370 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:51.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f49ffe00640 1 --2- 172.21.15.31:0/829136370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a000b27a0 0x7f4a000aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:51.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f4a05000640 1 --2- 172.21.15.31:0/829136370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a0015f640 0x7f4a000af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:51.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f49f7e00640 1 -- 172.21.15.31:0/829136370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a0015f640 msgr2=0x7f4a000af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:51.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f49f7e00640 1 --2- 172.21.15.31:0/829136370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a0015f640 0x7f4a000af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:51.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f49f7e00640 1 -- 172.21.15.31:0/829136370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a000b27a0 msgr2=0x7f4a000aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:51.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f49f7e00640 1 --2- 172.21.15.31:0/829136370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a000b27a0 0x7f4a000aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:51.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.242+0000 7f49f7e00640 1 -- 172.21.15.31:0/829136370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a00154a50 con 0x7f4a000ce620 2024-09-17T05:32:51.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.246+0000 7f49f7e00640 1 --2- 172.21.15.31:0/829136370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a000ce620 0x7f4a000af410 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f49e800e9c0 tx=0x7f49e800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:51.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.246+0000 7f49fcc00640 1 -- 172.21.15.31:0/829136370 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e800cde0 con 0x7f4a000ce620 2024-09-17T05:32:51.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.246+0000 7f49fcc00640 1 -- 172.21.15.31:0/829136370 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49e8010520 con 0x7f4a000ce620 2024-09-17T05:32:51.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.246+0000 7f49fcc00640 1 -- 172.21.15.31:0/829136370 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8010970 con 0x7f4a000ce620 2024-09-17T05:32:51.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.246+0000 7f4a07000640 1 -- 172.21.15.31:0/829136370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a00154cf0 con 0x7f4a000ce620 2024-09-17T05:32:51.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.246+0000 7f4a07000640 1 -- 172.21.15.31:0/829136370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a001552b0 con 0x7f4a000ce620 2024-09-17T05:32:51.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.246+0000 7f4a07000640 1 -- 172.21.15.31:0/829136370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a000ce0e0 con 0x7f4a000ce620 2024-09-17T05:32:51.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.246+0000 7f49fcc00640 1 -- 172.21.15.31:0/829136370 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f49e8010b10 con 0x7f4a000ce620 2024-09-17T05:32:51.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.246+0000 7f49fcc00640 1 --2- 172.21.15.31:0/829136370 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f49dc073320 0x7f49dc0757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:51.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.246+0000 7f49fcc00640 1 -- 172.21.15.31:0/829136370 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5502+0+0 (secure 0 0 0) 0x7f49e8094ea0 con 0x7f4a000ce620 2024-09-17T05:32:51.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.246+0000 7f49ffe00640 1 --2- 172.21.15.31:0/829136370 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f49dc073320 0x7f49dc0757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:51.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.250+0000 7f49ffe00640 1 --2- 172.21.15.31:0/829136370 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f49dc073320 0x7f49dc0757e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a0015c9f0 tx=0x7f49f0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:51.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.250+0000 7f49fcc00640 1 -- 172.21.15.31:0/829136370 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f49e805f730 con 0x7f4a000ce620 2024-09-17T05:32:51.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.426+0000 7f4a07000640 1 -- 172.21.15.31:0/829136370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4a0015dfd0 con 0x7f4a000ce620 2024-09-17T05:32:51.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.426+0000 7f49fcc00640 1 -- 172.21.15.31:0/829136370 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f49e8064160 con 0x7f4a000ce620 2024-09-17T05:32:51.429 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-09-17T05:32:51.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.430+0000 7f4a07000640 1 -- 172.21.15.31:0/829136370 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f49dc073320 msgr2=0x7f49dc0757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:51.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.430+0000 7f4a07000640 1 --2- 172.21.15.31:0/829136370 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f49dc073320 0x7f49dc0757e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a0015c9f0 tx=0x7f49f0009040 comp rx=0 tx=0).stop 2024-09-17T05:32:51.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.430+0000 7f4a07000640 1 -- 172.21.15.31:0/829136370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a000ce620 msgr2=0x7f4a000af410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:51.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.430+0000 7f4a07000640 1 --2- 172.21.15.31:0/829136370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a000ce620 0x7f4a000af410 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f49e800e9c0 tx=0x7f49e800ee80 comp rx=0 tx=0).stop 2024-09-17T05:32:51.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.430+0000 7f4a07000640 1 -- 172.21.15.31:0/829136370 shutdown_connections 2024-09-17T05:32:51.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.430+0000 7f4a07000640 1 --2- 172.21.15.31:0/829136370 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f49dc073320 0x7f49dc0757e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:51.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.430+0000 7f4a07000640 1 --2- 172.21.15.31:0/829136370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a0015f640 0x7f4a000af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:51.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.430+0000 7f4a07000640 1 --2- 172.21.15.31:0/829136370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a000ce620 0x7f4a000af410 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:51.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.430+0000 7f4a07000640 1 --2- 172.21.15.31:0/829136370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a000b27a0 0x7f4a000aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:51.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.430+0000 7f4a07000640 1 -- 172.21.15.31:0/829136370 >> 172.21.15.31:0/829136370 conn(0x7f4a000d1e30 msgr2=0x7f4a00070970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:51.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.430+0000 7f4a07000640 1 -- 172.21.15.31:0/829136370 shutdown_connections 2024-09-17T05:32:51.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.430+0000 7f4a07000640 1 -- 172.21.15.31:0/829136370 wait complete. 2024-09-17T05:32:51.450 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars' 2024-09-17T05:32:51.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.594+0000 7f49d5000640 1 -- 172.21.15.31:0/3954136921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49d015f6e0 msgr2=0x7f49d00d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:51.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.594+0000 7f49d5000640 1 --2- 172.21.15.31:0/3954136921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49d015f6e0 0x7f49d00d03b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f49d00746e0 tx=0x7f49b801f0b0 comp rx=0 tx=0).stop 2024-09-17T05:32:51.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.594+0000 7f49d5000640 1 -- 172.21.15.31:0/3954136921 shutdown_connections 2024-09-17T05:32:51.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.594+0000 7f49d5000640 1 --2- 172.21.15.31:0/3954136921 >> v2:172.21.15.155:3300/0 conn(0x7f49d00b2d60 0x7f49d00af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:51.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.594+0000 7f49d5000640 1 --2- 172.21.15.31:0/3954136921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49d015f6e0 0x7f49d00d03b0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:51.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.594+0000 7f49d5000640 1 -- 172.21.15.31:0/3954136921 >> 172.21.15.31:0/3954136921 conn(0x7f49d00d1e30 msgr2=0x7f49d00d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:51.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.594+0000 7f49d5000640 1 -- 172.21.15.31:0/3954136921 shutdown_connections 2024-09-17T05:32:51.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.594+0000 7f49d5000640 1 -- 172.21.15.31:0/3954136921 wait complete. 2024-09-17T05:32:51.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.594+0000 7f49d5000640 1 Processor -- start 2024-09-17T05:32:51.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.594+0000 7f49d5000640 1 -- start start 2024-09-17T05:32:51.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49d5000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d00b2d60 0x7f49d0148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:51.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49d5000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49d015f300 0x7f49d00ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:51.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49d5000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49d015f6e0 0x7f49d0071c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:51.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49d5000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f49d00affe0 con 0x7f49d015f300 2024-09-17T05:32:51.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49d5000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f49d00afe60 con 0x7f49d00b2d60 2024-09-17T05:32:51.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49d5000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f49d00b0160 con 0x7f49d015f6e0 2024-09-17T05:32:51.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49c7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49d015f300 0x7f49d00ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:51.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49c7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49d015f300 0x7f49d00ca3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40838/0 (socket says 172.21.15.31:40838) 2024-09-17T05:32:51.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49c7e00640 1 -- 172.21.15.31:0/1994294376 learned_addr learned my addr 172.21.15.31:0/1994294376 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:51.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49ce800640 1 --2- 172.21.15.31:0/1994294376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49d015f6e0 0x7f49d0071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:51.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49c7e00640 1 -- 172.21.15.31:0/1994294376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49d015f6e0 msgr2=0x7f49d0071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:51.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49c7e00640 1 --2- 172.21.15.31:0/1994294376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49d015f6e0 0x7f49d0071c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:51.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49cde00640 1 --2- 172.21.15.31:0/1994294376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d00b2d60 0x7f49d0148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:51.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49c7e00640 1 -- 172.21.15.31:0/1994294376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d00b2d60 msgr2=0x7f49d0148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:51.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49c7e00640 1 --2- 172.21.15.31:0/1994294376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d00b2d60 0x7f49d0148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:51.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49c7e00640 1 -- 172.21.15.31:0/1994294376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d00cac90 con 0x7f49d015f300 2024-09-17T05:32:51.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49cde00640 1 --2- 172.21.15.31:0/1994294376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d00b2d60 0x7f49d0148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:32:51.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49c7e00640 1 --2- 172.21.15.31:0/1994294376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49d015f300 0x7f49d00ca3d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f49b80b3040 tx=0x7f49b8005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:51.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49c6000640 1 -- 172.21.15.31:0/1994294376 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b80b5040 con 0x7f49d015f300 2024-09-17T05:32:51.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49c6000640 1 -- 172.21.15.31:0/1994294376 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49b8003600 con 0x7f49d015f300 2024-09-17T05:32:51.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49d5000640 1 -- 172.21.15.31:0/1994294376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d00caf70 con 0x7f49d015f300 2024-09-17T05:32:51.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49c6000640 1 -- 172.21.15.31:0/1994294376 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b80039f0 con 0x7f49d015f300 2024-09-17T05:32:51.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49d5000640 1 -- 172.21.15.31:0/1994294376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d00cb530 con 0x7f49d015f300 2024-09-17T05:32:51.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49d5000640 1 -- 172.21.15.31:0/1994294376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d00af710 con 0x7f49d015f300 2024-09-17T05:32:51.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.598+0000 7f49c6000640 1 -- 172.21.15.31:0/1994294376 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f49b80c1020 con 0x7f49d015f300 2024-09-17T05:32:51.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.602+0000 7f49c6000640 1 --2- 172.21.15.31:0/1994294376 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f49ac073320 0x7f49ac0757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:51.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.602+0000 7f49c6000640 1 -- 172.21.15.31:0/1994294376 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5502+0+0 (secure 0 0 0) 0x7f49b8131820 con 0x7f49d015f300 2024-09-17T05:32:51.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.602+0000 7f49cde00640 1 --2- 172.21.15.31:0/1994294376 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f49ac073320 0x7f49ac0757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:51.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.602+0000 7f49cde00640 1 --2- 172.21.15.31:0/1994294376 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f49ac073320 0x7f49ac0757e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f49c0000f70 tx=0x7f49c0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:51.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.606+0000 7f49c6000640 1 -- 172.21.15.31:0/1994294376 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f49b8018c10 con 0x7f49d015f300 2024-09-17T05:32:51.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:51.842+0000 7f49d5000640 1 -- 172.21.15.31:0/1994294376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]} v 0) -- 0x7f49d015c550 con 0x7f49d015f300 2024-09-17T05:32:52.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.714+0000 7f49c6000640 1 -- 172.21.15.31:0/1994294376 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]}]=0 v232) ==== 149+0+0 (secure 0 0 0) 0x7f49b80fc6f0 con 0x7f49d015f300 2024-09-17T05:32:52.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.718+0000 7f49d5000640 1 -- 172.21.15.31:0/1994294376 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f49ac073320 msgr2=0x7f49ac0757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:52.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.718+0000 7f49d5000640 1 --2- 172.21.15.31:0/1994294376 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f49ac073320 0x7f49ac0757e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f49c0000f70 tx=0x7f49c0009040 comp rx=0 tx=0).stop 2024-09-17T05:32:52.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.718+0000 7f49d5000640 1 -- 172.21.15.31:0/1994294376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49d015f300 msgr2=0x7f49d00ca3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:52.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.718+0000 7f49d5000640 1 --2- 172.21.15.31:0/1994294376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49d015f300 0x7f49d00ca3d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f49b80b3040 tx=0x7f49b8005760 comp rx=0 tx=0).stop 2024-09-17T05:32:52.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.718+0000 7f49d5000640 1 -- 172.21.15.31:0/1994294376 shutdown_connections 2024-09-17T05:32:52.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.718+0000 7f49d5000640 1 --2- 172.21.15.31:0/1994294376 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f49ac073320 0x7f49ac0757e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:52.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.718+0000 7f49d5000640 1 --2- 172.21.15.31:0/1994294376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49d015f6e0 0x7f49d0071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:52.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.718+0000 7f49d5000640 1 --2- 172.21.15.31:0/1994294376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f49d015f300 0x7f49d00ca3d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:52.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.718+0000 7f49d5000640 1 --2- 172.21.15.31:0/1994294376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49d00b2d60 0x7f49d0148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:52.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.718+0000 7f49d5000640 1 -- 172.21.15.31:0/1994294376 >> 172.21.15.31:0/1994294376 conn(0x7f49d00d1e30 msgr2=0x7f49d00cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:52.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.718+0000 7f49d5000640 1 -- 172.21.15.31:0/1994294376 shutdown_connections 2024-09-17T05:32:52.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.718+0000 7f49d5000640 1 -- 172.21.15.31:0/1994294376 wait complete. 2024-09-17T05:32:52.742 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:32:52.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.890+0000 7fe69a600640 1 -- 172.21.15.31:0/752847592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6940d28e0 msgr2=0x7fe6940cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:52.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.890+0000 7fe69a600640 1 --2- 172.21.15.31:0/752847592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6940d28e0 0x7fe6940cebb0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe6940745d0 tx=0x7fe68c01ccf0 comp rx=0 tx=0).stop 2024-09-17T05:32:52.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.890+0000 7fe69a600640 1 -- 172.21.15.31:0/752847592 shutdown_connections 2024-09-17T05:32:52.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.890+0000 7fe69a600640 1 --2- 172.21.15.31:0/752847592 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6940d28e0 0x7fe6940cebb0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:52.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.890+0000 7fe69a600640 1 --2- 172.21.15.31:0/752847592 >> v2:172.21.15.155:3300/0 conn(0x7fe69415bea0 0x7fe6940ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:52.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.890+0000 7fe69a600640 1 -- 172.21.15.31:0/752847592 >> 172.21.15.31:0/752847592 conn(0x7fe6940d1dc0 msgr2=0x7fe6940d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:52.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.890+0000 7fe69a600640 1 -- 172.21.15.31:0/752847592 shutdown_connections 2024-09-17T05:32:52.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.890+0000 7fe69a600640 1 -- 172.21.15.31:0/752847592 wait complete. 2024-09-17T05:32:52.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe69a600640 1 Processor -- start 2024-09-17T05:32:52.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe69a600640 1 -- start start 2024-09-17T05:32:52.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe69a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6940cdb30 0x7fe694159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:52.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe69a600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6940d28e0 0x7fe6941f8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:52.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe69a600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe69415bea0 0x7fe6940c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:52.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe69a600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe694168fc0 con 0x7fe6940cdb30 2024-09-17T05:32:52.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe69a600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe694168e40 con 0x7fe69415bea0 2024-09-17T05:32:52.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe69a600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe694169140 con 0x7fe6940d28e0 2024-09-17T05:32:52.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe693400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6940cdb30 0x7fe694159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:52.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe693400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6940cdb30 0x7fe694159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40862/0 (socket says 172.21.15.31:40862) 2024-09-17T05:32:52.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe693400640 1 -- 172.21.15.31:0/1682087406 learned_addr learned my addr 172.21.15.31:0/1682087406 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:52.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe692a00640 1 --2- 172.21.15.31:0/1682087406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6940d28e0 0x7fe6941f8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:52.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe693e00640 1 --2- 172.21.15.31:0/1682087406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe69415bea0 0x7fe6940c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:52.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe693400640 1 -- 172.21.15.31:0/1682087406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6940d28e0 msgr2=0x7fe6941f8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:52.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe693400640 1 --2- 172.21.15.31:0/1682087406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6940d28e0 0x7fe6941f8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:52.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe693400640 1 -- 172.21.15.31:0/1682087406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe69415bea0 msgr2=0x7fe6940c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:52.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe693400640 1 --2- 172.21.15.31:0/1682087406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe69415bea0 0x7fe6940c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:52.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe693400640 1 -- 172.21.15.31:0/1682087406 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6941f9630 con 0x7fe6940cdb30 2024-09-17T05:32:52.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe693e00640 1 --2- 172.21.15.31:0/1682087406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe69415bea0 0x7fe6940c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:52.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe693400640 1 --2- 172.21.15.31:0/1682087406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6940cdb30 0x7fe694159180 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe68400d720 tx=0x7fe68400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:52.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe68b400640 1 -- 172.21.15.31:0/1682087406 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe684017070 con 0x7fe6940cdb30 2024-09-17T05:32:52.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe68b400640 1 -- 172.21.15.31:0/1682087406 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe684009d20 con 0x7fe6940cdb30 2024-09-17T05:32:52.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe68b400640 1 -- 172.21.15.31:0/1682087406 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe684005280 con 0x7fe6940cdb30 2024-09-17T05:32:52.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe69a600640 1 -- 172.21.15.31:0/1682087406 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6941f9910 con 0x7fe6940cdb30 2024-09-17T05:32:52.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe69a600640 1 -- 172.21.15.31:0/1682087406 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6940c8290 con 0x7fe6940cdb30 2024-09-17T05:32:52.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.894+0000 7fe69a600640 1 -- 172.21.15.31:0/1682087406 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6941f9e30 con 0x7fe6940cdb30 2024-09-17T05:32:52.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.898+0000 7fe68b400640 1 -- 172.21.15.31:0/1682087406 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fe684005420 con 0x7fe6940cdb30 2024-09-17T05:32:52.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.898+0000 7fe68b400640 1 --2- 172.21.15.31:0/1682087406 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe674073320 0x7fe6740757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:52.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.898+0000 7fe68b400640 1 -- 172.21.15.31:0/1682087406 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5502+0+0 (secure 0 0 0) 0x7fe684094460 con 0x7fe6940cdb30 2024-09-17T05:32:52.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.898+0000 7fe692a00640 1 --2- 172.21.15.31:0/1682087406 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe674073320 0x7fe6740757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:52.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.898+0000 7fe692a00640 1 --2- 172.21.15.31:0/1682087406 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe674073320 0x7fe6740757e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe6940cb490 tx=0x7fe680007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:52.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:52.902+0000 7fe68b400640 1 -- 172.21.15.31:0/1682087406 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe6941f9e30 con 0x7fe6940cdb30 2024-09-17T05:32:53.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.078+0000 7fe69a600640 1 -- 172.21.15.31:0/1682087406 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fe6941f5940 con 0x7fe6940cdb30 2024-09-17T05:32:53.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.078+0000 7fe68b400640 1 -- 172.21.15.31:0/1682087406 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v35) ==== 59+0+1998 (secure 0 0 0) 0x7fe68405ed60 con 0x7fe6940cdb30 2024-09-17T05:32:53.080 INFO:teuthology.orchestra.run.smithi031.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:32:53.080 INFO:teuthology.orchestra.run.smithi031.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:32:53.080 INFO:teuthology.orchestra.run.smithi031.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:32:53.081 INFO:teuthology.orchestra.run.smithi031.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:32:53.081 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6159.333103 2024-09-17T05:32:53.081 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4566.558105 2024-09-17T05:32:53.081 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4575.968427 2024-09-17T05:32:53.081 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4702.806393 2024-09-17T05:32:53.081 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4956.728274 2024-09-17T05:32:53.081 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 6604.257199 2024-09-17T05:32:53.081 INFO:teuthology.orchestra.run.smithi031.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4779.165073 2024-09-17T05:32:53.081 INFO:teuthology.orchestra.run.smithi031.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4673.795919 2024-09-17T05:32:53.081 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds 20/20 2024-09-17T05:32:53.081 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:32:53.081 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_ms 2/2 2024-09-17T05:32:53.082 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_frag true 2024-09-17T05:32:53.082 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:32:53.082 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:32:53.082 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_verify_scatter true 2024-09-17T05:32:53.082 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:32:53.082 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:32:53.082 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:32:53.082 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced client_mount_timeout 600 2024-09-17T05:32:53.082 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_client 20/20 2024-09-17T05:32:53.082 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_ms 1/1 2024-09-17T05:32:53.082 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:32:53.082 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:32:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.078+0000 7fe69a600640 1 -- 172.21.15.31:0/1682087406 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe674073320 msgr2=0x7fe6740757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.078+0000 7fe69a600640 1 --2- 172.21.15.31:0/1682087406 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe674073320 0x7fe6740757e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe6940cb490 tx=0x7fe680007e40 comp rx=0 tx=0).stop 2024-09-17T05:32:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.078+0000 7fe69a600640 1 -- 172.21.15.31:0/1682087406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6940cdb30 msgr2=0x7fe694159180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.078+0000 7fe69a600640 1 --2- 172.21.15.31:0/1682087406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6940cdb30 0x7fe694159180 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe68400d720 tx=0x7fe68400dbe0 comp rx=0 tx=0).stop 2024-09-17T05:32:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.082+0000 7fe69a600640 1 -- 172.21.15.31:0/1682087406 shutdown_connections 2024-09-17T05:32:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.082+0000 7fe69a600640 1 --2- 172.21.15.31:0/1682087406 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe674073320 0x7fe6740757e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.082+0000 7fe69a600640 1 --2- 172.21.15.31:0/1682087406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe69415bea0 0x7fe6940c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.082+0000 7fe69a600640 1 --2- 172.21.15.31:0/1682087406 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6940d28e0 0x7fe6941f8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.082+0000 7fe69a600640 1 --2- 172.21.15.31:0/1682087406 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6940cdb30 0x7fe694159180 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.082+0000 7fe69a600640 1 -- 172.21.15.31:0/1682087406 >> 172.21.15.31:0/1682087406 conn(0x7fe6940d1dc0 msgr2=0x7fe6940d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.082+0000 7fe69a600640 1 -- 172.21.15.31:0/1682087406 shutdown_connections 2024-09-17T05:32:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.082+0000 7fe69a600640 1 -- 172.21.15.31:0/1682087406 wait complete. 2024-09-17T05:32:53.102 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:32:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.250+0000 7f5dd5c00640 1 -- 172.21.15.31:0/665898869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5db4004810 msgr2=0x7f5db4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.250+0000 7f5dd5c00640 1 --2- 172.21.15.31:0/665898869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5db4004810 0x7f5db4004c90 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5db8006fc0 tx=0x7f5db801cf00 comp rx=0 tx=0).stop 2024-09-17T05:32:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.250+0000 7f5dd5200640 1 -- 172.21.15.31:0/665898869 reap_dead start 2024-09-17T05:32:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.250+0000 7f5dd5c00640 1 -- 172.21.15.31:0/665898869 shutdown_connections 2024-09-17T05:32:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.250+0000 7f5dd5c00640 1 -- 172.21.15.31:0/665898869 >> 172.21.15.31:0/665898869 conn(0x7f5dd009aa10 msgr2=0x7f5dd009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.250+0000 7f5dd5c00640 1 -- 172.21.15.31:0/665898869 shutdown_connections 2024-09-17T05:32:53.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.250+0000 7f5dd5c00640 1 -- 172.21.15.31:0/665898869 wait complete. 2024-09-17T05:32:53.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.250+0000 7f5dd5c00640 1 Processor -- start 2024-09-17T05:32:53.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dd5c00640 1 -- start start 2024-09-17T05:32:53.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dd5c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5db4004810 0x7f5dd01f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:53.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dd5c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dd0149ea0 0x7f5dd014a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:53.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dd5c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dd015cee0 0x7f5dd015d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:53.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dd5c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd00ccd30 con 0x7f5dd0149ea0 2024-09-17T05:32:53.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dd5c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd00d08e0 con 0x7f5dd015cee0 2024-09-17T05:32:53.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dd5c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd00cceb0 con 0x7f5db4004810 2024-09-17T05:32:53.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dc7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dd0149ea0 0x7f5dd014a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:53.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dc7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dd0149ea0 0x7f5dd014a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40874/0 (socket says 172.21.15.31:40874) 2024-09-17T05:32:53.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dc7e00640 1 -- 172.21.15.31:0/1893175876 learned_addr learned my addr 172.21.15.31:0/1893175876 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:53.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dd5200640 1 --2- 172.21.15.31:0/1893175876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dd015cee0 0x7f5dd015d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:53.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dcfe00640 1 --2- 172.21.15.31:0/1893175876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5db4004810 0x7f5dd01f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:53.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dc7e00640 1 -- 172.21.15.31:0/1893175876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5db4004810 msgr2=0x7f5dd01f5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:53.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dc7e00640 1 --2- 172.21.15.31:0/1893175876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5db4004810 0x7f5dd01f5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:53.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dc7e00640 1 -- 172.21.15.31:0/1893175876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dd015cee0 msgr2=0x7f5dd015d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:53.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dc7e00640 1 --2- 172.21.15.31:0/1893175876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dd015cee0 0x7f5dd015d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:53.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dc7e00640 1 -- 172.21.15.31:0/1893175876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd015dc10 con 0x7f5dd0149ea0 2024-09-17T05:32:53.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dcfe00640 1 --2- 172.21.15.31:0/1893175876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5db4004810 0x7f5dd01f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:53.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dd5200640 1 --2- 172.21.15.31:0/1893175876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dd015cee0 0x7f5dd015d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:53.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dc7e00640 1 --2- 172.21.15.31:0/1893175876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dd0149ea0 0x7f5dd014a300 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5db801d3e0 tx=0x7f5db80011b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:53.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dccc00640 1 -- 172.21.15.31:0/1893175876 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db8006440 con 0x7f5dd0149ea0 2024-09-17T05:32:53.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dd5c00640 1 -- 172.21.15.31:0/1893175876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd015def0 con 0x7f5dd0149ea0 2024-09-17T05:32:53.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dccc00640 1 -- 172.21.15.31:0/1893175876 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5db8003600 con 0x7f5dd0149ea0 2024-09-17T05:32:53.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dccc00640 1 -- 172.21.15.31:0/1893175876 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db8003a10 con 0x7f5dd0149ea0 2024-09-17T05:32:53.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dd5c00640 1 -- 172.21.15.31:0/1893175876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd01f3ae0 con 0x7f5dd0149ea0 2024-09-17T05:32:53.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.254+0000 7f5dd5c00640 1 -- 172.21.15.31:0/1893175876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd00cd440 con 0x7f5dd0149ea0 2024-09-17T05:32:53.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.258+0000 7f5dccc00640 1 -- 172.21.15.31:0/1893175876 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f5db8003bb0 con 0x7f5dd0149ea0 2024-09-17T05:32:53.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.258+0000 7f5dccc00640 1 --2- 172.21.15.31:0/1893175876 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5dac073350 0x7f5dac075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:53.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.258+0000 7f5dccc00640 1 -- 172.21.15.31:0/1893175876 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5502+0+0 (secure 0 0 0) 0x7f5db812ea80 con 0x7f5dd0149ea0 2024-09-17T05:32:53.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.258+0000 7f5dcfe00640 1 --2- 172.21.15.31:0/1893175876 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5dac073350 0x7f5dac075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:53.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.258+0000 7f5dcfe00640 1 --2- 172.21.15.31:0/1893175876 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5dac073350 0x7f5dac075810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00cf780 tx=0x7f5dc00091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:53.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.262+0000 7f5dccc00640 1 -- 172.21.15.31:0/1893175876 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5db8016cb0 con 0x7f5dd0149ea0 2024-09-17T05:32:53.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.438+0000 7f5dd5c00640 1 -- 172.21.15.31:0/1893175876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5dd00759e0 con 0x7f5dd0149ea0 2024-09-17T05:32:53.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.442+0000 7f5dccc00640 1 -- 172.21.15.31:0/1893175876 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f5db80f98d0 con 0x7f5dd0149ea0 2024-09-17T05:32:53.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.442+0000 7f5dd5c00640 1 -- 172.21.15.31:0/1893175876 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5dac073350 msgr2=0x7f5dac075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:53.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.442+0000 7f5dd5c00640 1 --2- 172.21.15.31:0/1893175876 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5dac073350 0x7f5dac075810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00cf780 tx=0x7f5dc00091e0 comp rx=0 tx=0).stop 2024-09-17T05:32:53.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.442+0000 7f5dd5c00640 1 -- 172.21.15.31:0/1893175876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dd0149ea0 msgr2=0x7f5dd014a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:53.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.442+0000 7f5dd5c00640 1 --2- 172.21.15.31:0/1893175876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dd0149ea0 0x7f5dd014a300 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5db801d3e0 tx=0x7f5db80011b0 comp rx=0 tx=0).stop 2024-09-17T05:32:53.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.442+0000 7f5dd5c00640 1 -- 172.21.15.31:0/1893175876 shutdown_connections 2024-09-17T05:32:53.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.442+0000 7f5dd5c00640 1 --2- 172.21.15.31:0/1893175876 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5dac073350 0x7f5dac075810 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:53.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.442+0000 7f5dd5c00640 1 --2- 172.21.15.31:0/1893175876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dd015cee0 0x7f5dd015d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:53.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.442+0000 7f5dd5c00640 1 --2- 172.21.15.31:0/1893175876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dd0149ea0 0x7f5dd014a300 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:53.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.442+0000 7f5dd5c00640 1 --2- 172.21.15.31:0/1893175876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5db4004810 0x7f5dd01f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:53.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.442+0000 7f5dd5c00640 1 -- 172.21.15.31:0/1893175876 >> 172.21.15.31:0/1893175876 conn(0x7f5dd009aa10 msgr2=0x7f5dd00aeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:53.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.442+0000 7f5dd5c00640 1 -- 172.21.15.31:0/1893175876 shutdown_connections 2024-09-17T05:32:53.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.442+0000 7f5dd5c00640 1 -- 172.21.15.31:0/1893175876 wait complete. 2024-09-17T05:32:53.465 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:32:53.465 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:32:53.569 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:32:53.649 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:32:53.649 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:32:53.649 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:53.658 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:32:53.658 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:32:53.658 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:53.668 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:32:53.668 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:32:53.668 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:53.714 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:32:53.714 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:32:53.714 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:32:53.724 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:32:53.724 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:32:53.724 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:32:53.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.902+0000 7f0061800640 1 -- 172.21.15.31:0/1236680909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f005c0cdb30 msgr2=0x7f005c0aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:53.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.902+0000 7f0061800640 1 --2- 172.21.15.31:0/1236680909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f005c0cdb30 0x7f005c0aeef0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f005c0cc3a0 tx=0x7f005401cd80 comp rx=0 tx=0).stop 2024-09-17T05:32:53.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.902+0000 7f0061800640 1 -- 172.21.15.31:0/1236680909 shutdown_connections 2024-09-17T05:32:53.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.902+0000 7f0061800640 1 --2- 172.21.15.31:0/1236680909 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f005c0cdb30 0x7f005c0aeef0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:53.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.902+0000 7f0061800640 1 --2- 172.21.15.31:0/1236680909 >> v2:172.21.15.155:3300/0 conn(0x7f005c0ced80 0x7f005c0ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:53.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.902+0000 7f0061800640 1 -- 172.21.15.31:0/1236680909 >> 172.21.15.31:0/1236680909 conn(0x7f005c0d1dc0 msgr2=0x7f005c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:53.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.902+0000 7f0061800640 1 -- 172.21.15.31:0/1236680909 shutdown_connections 2024-09-17T05:32:53.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.902+0000 7f0061800640 1 -- 172.21.15.31:0/1236680909 wait complete. 2024-09-17T05:32:53.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.902+0000 7f0061800640 1 Processor -- start 2024-09-17T05:32:53.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.902+0000 7f0061800640 1 -- start start 2024-09-17T05:32:53.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f0061800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f005c0cdb30 0x7f005c1567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:53.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f0061800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005c0ced80 0x7f005c15ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:53.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f0061800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f005c15bea0 0x7f005c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:53.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f0061800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f005c1692f0 con 0x7f005c0cdb30 2024-09-17T05:32:53.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f0061800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f005c169170 con 0x7f005c0ced80 2024-09-17T05:32:53.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f0061800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f005c169470 con 0x7f005c15bea0 2024-09-17T05:32:53.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f005a000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005c0ced80 0x7f005c15ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:53.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f005a000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005c0ced80 0x7f005c15ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:33358/0 (socket says 172.21.15.31:33358) 2024-09-17T05:32:53.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f005a000640 1 -- 172.21.15.31:0/2975839007 learned_addr learned my addr 172.21.15.31:0/2975839007 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:53.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f005b400640 1 --2- 172.21.15.31:0/2975839007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f005c15bea0 0x7f005c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:53.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f005aa00640 1 --2- 172.21.15.31:0/2975839007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f005c0cdb30 0x7f005c1567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:53.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f005a000640 1 -- 172.21.15.31:0/2975839007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f005c15bea0 msgr2=0x7f005c15b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:53.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f005a000640 1 --2- 172.21.15.31:0/2975839007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f005c15bea0 0x7f005c15b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:53.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f005a000640 1 -- 172.21.15.31:0/2975839007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f005c0cdb30 msgr2=0x7f005c1567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:53.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f005a000640 1 --2- 172.21.15.31:0/2975839007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f005c0cdb30 0x7f005c1567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:53.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f005a000640 1 -- 172.21.15.31:0/2975839007 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005c1582d0 con 0x7f005c0ced80 2024-09-17T05:32:53.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f005b400640 1 --2- 172.21.15.31:0/2975839007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f005c15bea0 0x7f005c15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:32:53.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f005aa00640 1 --2- 172.21.15.31:0/2975839007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f005c0cdb30 0x7f005c1567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:32:53.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f005a000640 1 --2- 172.21.15.31:0/2975839007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005c0ced80 0x7f005c15ab60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f004800d950 tx=0x7f004800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:53.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f0052a00640 1 -- 172.21.15.31:0/2975839007 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0048017070 con 0x7f005c0ced80 2024-09-17T05:32:53.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f0052a00640 1 -- 172.21.15.31:0/2975839007 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0048009d20 con 0x7f005c0ced80 2024-09-17T05:32:53.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f0061800640 1 -- 172.21.15.31:0/2975839007 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f005c09c630 con 0x7f005c0ced80 2024-09-17T05:32:53.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f0052a00640 1 -- 172.21.15.31:0/2975839007 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00480106c0 con 0x7f005c0ced80 2024-09-17T05:32:53.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f0061800640 1 -- 172.21.15.31:0/2975839007 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f005c157ad0 con 0x7f005c0ced80 2024-09-17T05:32:53.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.906+0000 7f0061800640 1 -- 172.21.15.31:0/2975839007 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f005c0ce670 con 0x7f005c0ced80 2024-09-17T05:32:53.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.910+0000 7f0052a00640 1 -- 172.21.15.31:0/2975839007 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f0048010860 con 0x7f005c0ced80 2024-09-17T05:32:53.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.910+0000 7f0052a00640 1 --2- 172.21.15.31:0/2975839007 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f003c073320 0x7f003c0757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:53.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.910+0000 7f0052a00640 1 -- 172.21.15.31:0/2975839007 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5502+0+0 (secure 0 0 0) 0x7f0048094a60 con 0x7f005c0ced80 2024-09-17T05:32:53.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.910+0000 7f005aa00640 1 --2- 172.21.15.31:0/2975839007 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f003c073320 0x7f003c0757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:53.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.910+0000 7f005aa00640 1 --2- 172.21.15.31:0/2975839007 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f003c073320 0x7f003c0757e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f004c009cd0 tx=0x7f004c009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:53.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:53.914+0000 7f0052a00640 1 -- 172.21.15.31:0/2975839007 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f004805f2d0 con 0x7f005c0ced80 2024-09-17T05:32:54.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.122+0000 7f0061800640 1 -- 172.21.15.31:0/2975839007 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f005c0b41e0 con 0x7f005c0ced80 2024-09-17T05:32:54.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.126+0000 7f0052a00640 1 -- 172.21.15.31:0/2975839007 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+3914 (secure 0 0 0) 0x7f0048063d00 con 0x7f005c0ced80 2024-09-17T05:32:54.127 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:54.127 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":50,"btime":"2024-09-17T05:32:47:280596+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5477,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/4172452504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":4172452504},{"type":"v1","addr":"172.21.15.155:6837","nonce":4172452504}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2918874157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2918874157},{"type":"v1","addr":"172.21.15.155:6836","nonce":2918874157}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/3987740697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3987740697},{"type":"v1","addr":"172.21.15.31:6833","nonce":3987740697}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":6205,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/222307817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":222307817},{"type":"v1","addr":"172.21.15.31:6835","nonce":222307817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[]} 2024-09-17T05:32:54.128 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 50 2024-09-17T05:32:54.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.126+0000 7f0061800640 1 -- 172.21.15.31:0/2975839007 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f003c073320 msgr2=0x7f003c0757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:54.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.126+0000 7f0061800640 1 --2- 172.21.15.31:0/2975839007 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f003c073320 0x7f003c0757e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f004c009cd0 tx=0x7f004c009060 comp rx=0 tx=0).stop 2024-09-17T05:32:54.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.126+0000 7f0061800640 1 -- 172.21.15.31:0/2975839007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005c0ced80 msgr2=0x7f005c15ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:54.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.126+0000 7f0061800640 1 --2- 172.21.15.31:0/2975839007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005c0ced80 0x7f005c15ab60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f004800d950 tx=0x7f004800de10 comp rx=0 tx=0).stop 2024-09-17T05:32:54.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.126+0000 7f0061800640 1 -- 172.21.15.31:0/2975839007 shutdown_connections 2024-09-17T05:32:54.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.126+0000 7f0061800640 1 --2- 172.21.15.31:0/2975839007 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f003c073320 0x7f003c0757e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:54.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.126+0000 7f0061800640 1 --2- 172.21.15.31:0/2975839007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f005c15bea0 0x7f005c15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:54.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.126+0000 7f0061800640 1 --2- 172.21.15.31:0/2975839007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f005c0ced80 0x7f005c15ab60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:54.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.126+0000 7f0061800640 1 --2- 172.21.15.31:0/2975839007 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f005c0cdb30 0x7f005c1567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:54.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.126+0000 7f0061800640 1 -- 172.21.15.31:0/2975839007 >> 172.21.15.31:0/2975839007 conn(0x7f005c0d1dc0 msgr2=0x7f005c158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:54.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.126+0000 7f0061800640 1 -- 172.21.15.31:0/2975839007 shutdown_connections 2024-09-17T05:32:54.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.126+0000 7f0061800640 1 -- 172.21.15.31:0/2975839007 wait complete. 2024-09-17T05:32:54.150 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:32:54.150 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:32:54.150 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:32:54.150 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:32:54.151 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:32:54.151 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:32:54.151 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:32:54.151 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:32:54.151 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:32:54.151 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:32:54.151 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:32:54.152 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:32:54.152 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:32:54.152 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:32:54.152 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:32:54.152 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:32:54.163 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:32:54.163 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:32:54.164 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:32:54.164 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:32:54.167 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:32:54.168 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:32:54.169 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:32:54.169 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:32:54.208 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:32:54.209 DEBUG:teuthology.parallel:result is None 2024-09-17T05:32:54.210 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:32:54.210 DEBUG:teuthology.parallel:result is None 2024-09-17T05:32:54.213 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:32:54.213 DEBUG:teuthology.parallel:result is None 2024-09-17T05:32:54.215 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:32:54.215 DEBUG:teuthology.parallel:result is None 2024-09-17T05:32:54.215 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:32:54.296 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-17T05:32:54.296 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-17T05:32:54.305 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-17T05:32:54.306 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-17T05:32:54.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.366+0000 7f1fc8400640 1 -- 172.21.15.31:0/1140141284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc015bea0 msgr2=0x7f1fc00ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:54.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.366+0000 7f1fc8400640 1 --2- 172.21.15.31:0/1140141284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc015bea0 0x7f1fc00ce670 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009840 tx=0x7f1fb401c790 comp rx=0 tx=0).stop 2024-09-17T05:32:54.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.366+0000 7f1fc8400640 1 -- 172.21.15.31:0/1140141284 shutdown_connections 2024-09-17T05:32:54.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.366+0000 7f1fc8400640 1 --2- 172.21.15.31:0/1140141284 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc015bea0 0x7f1fc00ce670 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:54.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.366+0000 7f1fc8400640 1 -- 172.21.15.31:0/1140141284 >> 172.21.15.31:0/1140141284 conn(0x7f1fc00d1dc0 msgr2=0x7f1fc00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:54.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.366+0000 7f1fc8400640 1 -- 172.21.15.31:0/1140141284 shutdown_connections 2024-09-17T05:32:54.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.366+0000 7f1fc8400640 1 -- 172.21.15.31:0/1140141284 wait complete. 2024-09-17T05:32:54.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.366+0000 7f1fc8400640 1 Processor -- start 2024-09-17T05:32:54.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.366+0000 7f1fc8400640 1 -- start start 2024-09-17T05:32:54.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.366+0000 7f1fc8400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fc00cdb30 0x7f1fc013d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:54.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.366+0000 7f1fc8400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc00d28e0 0x7f1fc0150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:54.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.366+0000 7f1fc8400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fc015bea0 0x7f1fc00c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:54.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.366+0000 7f1fc8400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc016a930 con 0x7f1fc015bea0 2024-09-17T05:32:54.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.366+0000 7f1fc8400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc016a7b0 con 0x7f1fc00d28e0 2024-09-17T05:32:54.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.366+0000 7f1fc8400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1fc016aab0 con 0x7f1fc00cdb30 2024-09-17T05:32:54.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.366+0000 7f1fc6400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fc015bea0 0x7f1fc00c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:54.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.366+0000 7f1fc6400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fc015bea0 0x7f1fc00c6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40914/0 (socket says 172.21.15.31:40914) 2024-09-17T05:32:54.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.366+0000 7f1fc6400640 1 -- 172.21.15.31:0/4199278920 learned_addr learned my addr 172.21.15.31:0/4199278920 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:54.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fc5a00640 1 --2- 172.21.15.31:0/4199278920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fc00cdb30 0x7f1fc013d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:54.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fc5000640 1 --2- 172.21.15.31:0/4199278920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc00d28e0 0x7f1fc0150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:54.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fc6400640 1 -- 172.21.15.31:0/4199278920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fc00cdb30 msgr2=0x7f1fc013d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:54.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fc6400640 1 --2- 172.21.15.31:0/4199278920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fc00cdb30 0x7f1fc013d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:54.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fc6400640 1 -- 172.21.15.31:0/4199278920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc00d28e0 msgr2=0x7f1fc0150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:54.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fc6400640 1 --2- 172.21.15.31:0/4199278920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc00d28e0 0x7f1fc0150900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:54.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fc6400640 1 -- 172.21.15.31:0/4199278920 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc013da10 con 0x7f1fc015bea0 2024-09-17T05:32:54.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fc5a00640 1 --2- 172.21.15.31:0/4199278920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fc00cdb30 0x7f1fc013d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:54.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fc5000640 1 --2- 172.21.15.31:0/4199278920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc00d28e0 0x7f1fc0150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:54.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fc6400640 1 --2- 172.21.15.31:0/4199278920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fc015bea0 0x7f1fc00c6010 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800c730 tx=0x7f1fb800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:54.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fbd600640 1 -- 172.21.15.31:0/4199278920 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8003db0 con 0x7f1fc015bea0 2024-09-17T05:32:54.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fbd600640 1 -- 172.21.15.31:0/4199278920 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fb800ce40 con 0x7f1fc015bea0 2024-09-17T05:32:54.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fc8400640 1 -- 172.21.15.31:0/4199278920 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc015a410 con 0x7f1fc015bea0 2024-09-17T05:32:54.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fbd600640 1 -- 172.21.15.31:0/4199278920 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb80052d0 con 0x7f1fc015bea0 2024-09-17T05:32:54.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fc8400640 1 -- 172.21.15.31:0/4199278920 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc0158a10 con 0x7f1fc015bea0 2024-09-17T05:32:54.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fc8400640 1 -- 172.21.15.31:0/4199278920 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc00b7a90 con 0x7f1fc015bea0 2024-09-17T05:32:54.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fbd600640 1 -- 172.21.15.31:0/4199278920 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f1fb8005470 con 0x7f1fc015bea0 2024-09-17T05:32:54.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fbd600640 1 --2- 172.21.15.31:0/4199278920 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1fa0073320 0x7f1fa00757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:54.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.370+0000 7f1fbd600640 1 -- 172.21.15.31:0/4199278920 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5502+0+0 (secure 0 0 0) 0x7f1fb8094250 con 0x7f1fc015bea0 2024-09-17T05:32:54.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.374+0000 7f1fc5a00640 1 --2- 172.21.15.31:0/4199278920 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1fa0073320 0x7f1fa00757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:54.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.374+0000 7f1fc5a00640 1 --2- 172.21.15.31:0/4199278920 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1fa0073320 0x7f1fa00757e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1fb40af000 tx=0x7f1fb401afd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:54.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.374+0000 7f1fbd600640 1 -- 172.21.15.31:0/4199278920 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f1fc013da10 con 0x7f1fc015bea0 2024-09-17T05:32:54.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.562+0000 7f1fc8400640 1 -- 172.21.15.31:0/4199278920 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f1fc00b77b0 con 0x7f1fc015bea0 2024-09-17T05:32:54.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.730+0000 7f1fbd600640 1 -- 172.21.15.31:0/4199278920 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v75) ==== 97+0+0 (secure 0 0 0) 0x7f1fb805f1a0 con 0x7f1fc015bea0 2024-09-17T05:32:54.731 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2024-09-17T05:32:54.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.730+0000 7f1fc8400640 1 -- 172.21.15.31:0/4199278920 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1fa0073320 msgr2=0x7f1fa00757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:54.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.730+0000 7f1fc8400640 1 --2- 172.21.15.31:0/4199278920 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1fa0073320 0x7f1fa00757e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1fb40af000 tx=0x7f1fb401afd0 comp rx=0 tx=0).stop 2024-09-17T05:32:54.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.730+0000 7f1fc8400640 1 -- 172.21.15.31:0/4199278920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fc015bea0 msgr2=0x7f1fc00c6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:54.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.730+0000 7f1fc8400640 1 --2- 172.21.15.31:0/4199278920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fc015bea0 0x7f1fc00c6010 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800c730 tx=0x7f1fb800cbf0 comp rx=0 tx=0).stop 2024-09-17T05:32:54.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.734+0000 7f1fc8400640 1 -- 172.21.15.31:0/4199278920 shutdown_connections 2024-09-17T05:32:54.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.734+0000 7f1fc8400640 1 --2- 172.21.15.31:0/4199278920 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1fa0073320 0x7f1fa00757e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:54.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.734+0000 7f1fc8400640 1 --2- 172.21.15.31:0/4199278920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1fc015bea0 0x7f1fc00c6010 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:54.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.734+0000 7f1fc8400640 1 --2- 172.21.15.31:0/4199278920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1fc00d28e0 0x7f1fc0150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:54.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.734+0000 7f1fc8400640 1 --2- 172.21.15.31:0/4199278920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1fc00cdb30 0x7f1fc013d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:54.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.734+0000 7f1fc8400640 1 -- 172.21.15.31:0/4199278920 >> 172.21.15.31:0/4199278920 conn(0x7f1fc00d1dc0 msgr2=0x7f1fc00b6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:54.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.734+0000 7f1fc8400640 1 -- 172.21.15.31:0/4199278920 shutdown_connections 2024-09-17T05:32:54.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.734+0000 7f1fc8400640 1 -- 172.21.15.31:0/4199278920 wait complete. 2024-09-17T05:32:54.758 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:32:54.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.902+0000 7f9f54400640 1 -- 172.21.15.31:0/2248212121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f4c0ced80 msgr2=0x7f9f4c0ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:54.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.902+0000 7f9f54400640 1 --2- 172.21.15.31:0/2248212121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f4c0ced80 0x7f9f4c0ae9b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009840 tx=0x7f9f3801c820 comp rx=0 tx=0).stop 2024-09-17T05:32:54.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.902+0000 7f9f54400640 1 -- 172.21.15.31:0/2248212121 shutdown_connections 2024-09-17T05:32:54.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.902+0000 7f9f54400640 1 --2- 172.21.15.31:0/2248212121 >> v2:172.21.15.155:3300/0 conn(0x7f9f4c0cdb30 0x7f9f4c0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:54.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.902+0000 7f9f54400640 1 --2- 172.21.15.31:0/2248212121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f4c0ced80 0x7f9f4c0ae9b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:54.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.902+0000 7f9f54400640 1 -- 172.21.15.31:0/2248212121 >> 172.21.15.31:0/2248212121 conn(0x7f9f4c0d1dc0 msgr2=0x7f9f4c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:54.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.902+0000 7f9f54400640 1 -- 172.21.15.31:0/2248212121 shutdown_connections 2024-09-17T05:32:54.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.902+0000 7f9f54400640 1 -- 172.21.15.31:0/2248212121 wait complete. 2024-09-17T05:32:54.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f54400640 1 Processor -- start 2024-09-17T05:32:54.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f54400640 1 -- start start 2024-09-17T05:32:54.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f54400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4c0cdb30 0x7f9f4c0c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f54400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f4c0ced80 0x7f9f4c14a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f54400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f4c15bea0 0x7f9f4c1fb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f54400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c1692f0 con 0x7f9f4c0cdb30 2024-09-17T05:32:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f54400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c169170 con 0x7f9f4c15bea0 2024-09-17T05:32:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f54400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9f4c169470 con 0x7f9f4c0ced80 2024-09-17T05:32:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f51a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4c0cdb30 0x7f9f4c0c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f51a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4c0cdb30 0x7f9f4c0c8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40916/0 (socket says 172.21.15.31:40916) 2024-09-17T05:32:54.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f51a00640 1 -- 172.21.15.31:0/3783322387 learned_addr learned my addr 172.21.15.31:0/3783322387 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:54.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f51000640 1 --2- 172.21.15.31:0/3783322387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f4c0ced80 0x7f9f4c14a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f52400640 1 --2- 172.21.15.31:0/3783322387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f4c15bea0 0x7f9f4c1fb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f51a00640 1 -- 172.21.15.31:0/3783322387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f4c0ced80 msgr2=0x7f9f4c14a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f51a00640 1 --2- 172.21.15.31:0/3783322387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f4c0ced80 0x7f9f4c14a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f51a00640 1 -- 172.21.15.31:0/3783322387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f4c15bea0 msgr2=0x7f9f4c1fb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f51a00640 1 --2- 172.21.15.31:0/3783322387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f4c15bea0 0x7f9f4c1fb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f51a00640 1 -- 172.21.15.31:0/3783322387 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4c0b1680 con 0x7f9f4c0cdb30 2024-09-17T05:32:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f51000640 1 --2- 172.21.15.31:0/3783322387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f4c0ced80 0x7f9f4c14a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:32:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f52400640 1 --2- 172.21.15.31:0/3783322387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f4c15bea0 0x7f9f4c1fb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:32:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f51a00640 1 --2- 172.21.15.31:0/3783322387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4c0cdb30 0x7f9f4c0c8e90 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9f4000c400 tx=0x7f9f4000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f49600640 1 -- 172.21.15.31:0/3783322387 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f40011790 con 0x7f9f4c0cdb30 2024-09-17T05:32:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f49600640 1 -- 172.21.15.31:0/3783322387 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f40017070 con 0x7f9f4c0cdb30 2024-09-17T05:32:54.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f54400640 1 -- 172.21.15.31:0/3783322387 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f4c0b1960 con 0x7f9f4c0cdb30 2024-09-17T05:32:54.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f49600640 1 -- 172.21.15.31:0/3783322387 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f40011cc0 con 0x7f9f4c0cdb30 2024-09-17T05:32:54.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f54400640 1 -- 172.21.15.31:0/3783322387 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f4c0b1f20 con 0x7f9f4c0cdb30 2024-09-17T05:32:54.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.906+0000 7f9f54400640 1 -- 172.21.15.31:0/3783322387 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f4c0d2420 con 0x7f9f4c0cdb30 2024-09-17T05:32:54.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.910+0000 7f9f49600640 1 -- 172.21.15.31:0/3783322387 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f9f4001c460 con 0x7f9f4c0cdb30 2024-09-17T05:32:54.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.910+0000 7f9f49600640 1 --2- 172.21.15.31:0/3783322387 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9f2c073320 0x7f9f2c0757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:54.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.910+0000 7f9f49600640 1 -- 172.21.15.31:0/3783322387 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 4857+0+0 (secure 0 0 0) 0x7f9f40093ee0 con 0x7f9f4c0cdb30 2024-09-17T05:32:54.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.910+0000 7f9f51000640 1 --2- 172.21.15.31:0/3783322387 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9f2c073320 0x7f9f2c0757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:54.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.910+0000 7f9f51000640 1 --2- 172.21.15.31:0/3783322387 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9f2c073320 0x7f9f2c0757e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9f380af000 tx=0x7f9f3801b060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:54.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:54.914+0000 7f9f49600640 1 -- 172.21.15.31:0/3783322387 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9f4005f0c0 con 0x7f9f4c0cdb30 2024-09-17T05:32:55.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.146+0000 7f9f54400640 1 -- 172.21.15.31:0/3783322387 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9f4c0ce620 con 0x7f9f4c0cdb30 2024-09-17T05:32:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.146+0000 7f9f49600640 1 -- 172.21.15.31:0/3783322387 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) ==== 80+0+5304 (secure 0 0 0) 0x7f9f4005e9c0 con 0x7f9f4c0cdb30 2024-09-17T05:32:55.150 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:55.150 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:32:55.150 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2024-09-17T05:32:55.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.150 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2024-09-17T05:32:55.151 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmoloQARAAbTcR/1F1qz7Crjdu1NPSgw==", 2024-09-17T05:32:55.151 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.151 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:32:55.151 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:32:55.151 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:32:55.151 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:55.151 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.151 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:55.151 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.151 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2024-09-17T05:32:55.151 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmYrdRDRAAkaDz03U3lMZlkLEVFYlTaw==", 2024-09-17T05:32:55.151 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.151 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:32:55.152 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:32:55.152 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:32:55.152 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:55.152 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:55.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.152 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2024-09-17T05:32:55.152 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmpFRCCBAAZRsuAVwSxuMGDeoYCwWFeg==", 2024-09-17T05:32:55.152 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.153 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:32:55.153 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:32:55.153 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:32:55.153 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:55.153 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:55.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.153 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2024-09-17T05:32:55.153 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lm23PSFBAAuO+k0kWY28PN7+pEtlUniQ==", 2024-09-17T05:32:55.153 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.153 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:32:55.153 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:32:55.153 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:32:55.154 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:55.154 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.154 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:55.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.154 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2024-09-17T05:32:55.154 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBTE+lm0miKHxAA2C1pfwBxJtKQhu4xuPumxg==", 2024-09-17T05:32:55.154 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.154 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:32:55.154 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:32:55.154 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:55.154 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.154 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:55.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.155 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2024-09-17T05:32:55.155 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBWE+lmdQi7NRAA2v4ETg4jynbPF0K4E73KAA==", 2024-09-17T05:32:55.155 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.155 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:32:55.155 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:32:55.155 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:55.155 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:55.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.155 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2024-09-17T05:32:55.155 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBaE+lm18eUEBAA8gAhUx9UNa2Lk4uyFBd7Nw==", 2024-09-17T05:32:55.155 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.155 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:32:55.155 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:32:55.156 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:55.156 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:55.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.156 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2024-09-17T05:32:55.156 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBdE+lm00moJBAAizrxOP4rI4fGR91dYzlEkw==", 2024-09-17T05:32:55.156 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.156 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:32:55.156 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:32:55.156 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:55.156 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:55.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.157 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2024-09-17T05:32:55.157 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBjE+lmhdtUJhAA7+KM8DwQriFwMbpqXAPTuA==", 2024-09-17T05:32:55.157 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.157 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:32:55.157 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:32:55.157 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:55.157 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:55.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.157 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2024-09-17T05:32:55.157 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBmE+lm5cByOhAAiMnQIv2O41am/3E+0dp4sg==", 2024-09-17T05:32:55.157 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.158 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:32:55.158 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:32:55.158 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:55.158 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:55.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.158 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2024-09-17T05:32:55.158 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBqE+lm19FhExAAo/Sfj2SX5+Y2/Fxz8mbiNQ==", 2024-09-17T05:32:55.158 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.158 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:32:55.158 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:32:55.158 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:55.158 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:55.159 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.159 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2024-09-17T05:32:55.159 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBtE+lmISDbKBAAapUBS+t+N1vUcCbdJic8Dw==", 2024-09-17T05:32:55.159 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.159 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:32:55.159 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:32:55.159 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:55.159 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.159 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:55.159 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.159 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2024-09-17T05:32:55.159 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw==", 2024-09-17T05:32:55.159 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.160 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:32:55.160 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2024-09-17T05:32:55.160 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:32:55.160 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:55.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.160 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2024-09-17T05:32:55.160 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmb2pmIhAA7p+G+WnB7ujZZdSlaossYg==", 2024-09-17T05:32:55.160 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.160 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:32:55.160 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:32:55.160 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:32:55.160 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:32:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2024-09-17T05:32:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmAPPaHhAAyz/gKunaNFyrdkAUy50qmQ==", 2024-09-17T05:32:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:32:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:32:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:32:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:32:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:55.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.162 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2024-09-17T05:32:55.162 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lml72BKBAAgAji5TWedU7azT5oQz3fYg==", 2024-09-17T05:32:55.162 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.162 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:32:55.162 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:32:55.162 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:32:55.162 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:32:55.162 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:55.162 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.162 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2024-09-17T05:32:55.162 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmtgltIRAAeTv/U/vZ9ZIuGN4JXTHD0A==", 2024-09-17T05:32:55.163 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.163 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:32:55.163 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:32:55.163 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:32:55.163 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:55.163 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:55.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.163 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2024-09-17T05:32:55.163 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmTt2oOBAAmR5ykU4WbEzlKFiwI7sMdg==", 2024-09-17T05:32:55.163 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.163 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:32:55.163 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:32:55.163 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:55.164 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:32:55.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.164 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2024-09-17T05:32:55.164 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmKILYNBAAojM8RIq92dO2DQyXppReIw==", 2024-09-17T05:32:55.164 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:32:55.164 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:32:55.164 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:32:55.164 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:32:55.164 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.164 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.164 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:32:55.164 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:32:55.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.150+0000 7f9f54400640 1 -- 172.21.15.31:0/3783322387 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9f2c073320 msgr2=0x7f9f2c0757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:55.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.150+0000 7f9f54400640 1 --2- 172.21.15.31:0/3783322387 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9f2c073320 0x7f9f2c0757e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9f380af000 tx=0x7f9f3801b060 comp rx=0 tx=0).stop 2024-09-17T05:32:55.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.150+0000 7f9f54400640 1 -- 172.21.15.31:0/3783322387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4c0cdb30 msgr2=0x7f9f4c0c8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:55.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.150+0000 7f9f54400640 1 --2- 172.21.15.31:0/3783322387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4c0cdb30 0x7f9f4c0c8e90 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9f4000c400 tx=0x7f9f4000c8c0 comp rx=0 tx=0).stop 2024-09-17T05:32:55.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.150+0000 7f9f54400640 1 -- 172.21.15.31:0/3783322387 shutdown_connections 2024-09-17T05:32:55.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.150+0000 7f9f54400640 1 --2- 172.21.15.31:0/3783322387 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9f2c073320 0x7f9f2c0757e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:55.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.150+0000 7f9f54400640 1 --2- 172.21.15.31:0/3783322387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f4c15bea0 0x7f9f4c1fb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:55.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.150+0000 7f9f54400640 1 --2- 172.21.15.31:0/3783322387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f4c0ced80 0x7f9f4c14a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:55.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.150+0000 7f9f54400640 1 --2- 172.21.15.31:0/3783322387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f4c0cdb30 0x7f9f4c0c8e90 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:55.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.150+0000 7f9f54400640 1 -- 172.21.15.31:0/3783322387 >> 172.21.15.31:0/3783322387 conn(0x7f9f4c0d1dc0 msgr2=0x7f9f4c15a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:55.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.150+0000 7f9f54400640 1 -- 172.21.15.31:0/3783322387 shutdown_connections 2024-09-17T05:32:55.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.150+0000 7f9f54400640 1 -- 172.21.15.31:0/3783322387 wait complete. 2024-09-17T05:32:55.172 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:32:55.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8ec400640 1 -- 172.21.15.31:0/2977374009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e415f490 msgr2=0x7fe8e40b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:55.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8ec400640 1 --2- 172.21.15.31:0/2977374009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e415f490 0x7fe8e40b14c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009840 tx=0x7fe8d801c6d0 comp rx=0 tx=0).stop 2024-09-17T05:32:55.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8ec400640 1 -- 172.21.15.31:0/2977374009 shutdown_connections 2024-09-17T05:32:55.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8ec400640 1 --2- 172.21.15.31:0/2977374009 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8e40b2e80 0x7fe8e40b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:55.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8ec400640 1 --2- 172.21.15.31:0/2977374009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e415f490 0x7fe8e40b14c0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:55.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8ec400640 1 -- 172.21.15.31:0/2977374009 >> 172.21.15.31:0/2977374009 conn(0x7fe8e40d1e30 msgr2=0x7fe8e40d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:55.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8ec400640 1 -- 172.21.15.31:0/2977374009 shutdown_connections 2024-09-17T05:32:55.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8ec400640 1 -- 172.21.15.31:0/2977374009 wait complete. 2024-09-17T05:32:55.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8ec400640 1 Processor -- start 2024-09-17T05:32:55.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8ec400640 1 -- start start 2024-09-17T05:32:55.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8ec400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8e40b1f40 0x7fe8e41532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:55.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8ec400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e40b2e80 0x7fe8e40b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:55.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8ec400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8e415f490 0x7fe8e4152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:55.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8ec400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e4168e00 con 0x7fe8e40b2e80 2024-09-17T05:32:55.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8ec400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e4168c80 con 0x7fe8e40b1f40 2024-09-17T05:32:55.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8ec400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e4168f80 con 0x7fe8e415f490 2024-09-17T05:32:55.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8e9000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e40b2e80 0x7fe8e40b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:55.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8e9000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e40b2e80 0x7fe8e40b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40928/0 (socket says 172.21.15.31:40928) 2024-09-17T05:32:55.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8e9000640 1 -- 172.21.15.31:0/1690259154 learned_addr learned my addr 172.21.15.31:0/1690259154 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:55.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8e9a00640 1 --2- 172.21.15.31:0/1690259154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8e40b1f40 0x7fe8e41532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:55.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8ea400640 1 --2- 172.21.15.31:0/1690259154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8e415f490 0x7fe8e4152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:55.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8e9000640 1 -- 172.21.15.31:0/1690259154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8e415f490 msgr2=0x7fe8e4152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:55.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8e9000640 1 --2- 172.21.15.31:0/1690259154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8e415f490 0x7fe8e4152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:55.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8e9000640 1 -- 172.21.15.31:0/1690259154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8e40b1f40 msgr2=0x7fe8e41532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:55.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8e9000640 1 --2- 172.21.15.31:0/1690259154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8e40b1f40 0x7fe8e41532f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:55.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.318+0000 7fe8e9000640 1 -- 172.21.15.31:0/1690259154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e4153980 con 0x7fe8e40b2e80 2024-09-17T05:32:55.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.322+0000 7fe8e9000640 1 --2- 172.21.15.31:0/1690259154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e40b2e80 0x7fe8e40b70f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000e9f0 tx=0x7fe8d000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:55.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.322+0000 7fe8e1600640 1 -- 172.21.15.31:0/1690259154 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d000cd80 con 0x7fe8e40b2e80 2024-09-17T05:32:55.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.322+0000 7fe8e1600640 1 -- 172.21.15.31:0/1690259154 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8d0010430 con 0x7fe8e40b2e80 2024-09-17T05:32:55.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.322+0000 7fe8ec400640 1 -- 172.21.15.31:0/1690259154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e414ebd0 con 0x7fe8e40b2e80 2024-09-17T05:32:55.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.322+0000 7fe8e1600640 1 -- 172.21.15.31:0/1690259154 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0010860 con 0x7fe8e40b2e80 2024-09-17T05:32:55.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.322+0000 7fe8ec400640 1 -- 172.21.15.31:0/1690259154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e414f190 con 0x7fe8e40b2e80 2024-09-17T05:32:55.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.322+0000 7fe8ec400640 1 -- 172.21.15.31:0/1690259154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e40cfda0 con 0x7fe8e40b2e80 2024-09-17T05:32:55.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.322+0000 7fe8e1600640 1 -- 172.21.15.31:0/1690259154 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fe8d0010a00 con 0x7fe8e40b2e80 2024-09-17T05:32:55.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.322+0000 7fe8e1600640 1 --2- 172.21.15.31:0/1690259154 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe8c4073320 0x7fe8c40757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:55.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.322+0000 7fe8e1600640 1 -- 172.21.15.31:0/1690259154 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 4857+0+0 (secure 0 0 0) 0x7fe8d0094c80 con 0x7fe8e40b2e80 2024-09-17T05:32:55.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.322+0000 7fe8e9a00640 1 --2- 172.21.15.31:0/1690259154 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe8c4073320 0x7fe8c40757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:55.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.326+0000 7fe8e9a00640 1 --2- 172.21.15.31:0/1690259154 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe8c4073320 0x7fe8c40757e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80af000 tx=0x7fe8d801af10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:55.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.326+0000 7fe8e1600640 1 -- 172.21.15.31:0/1690259154 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe8d005f830 con 0x7fe8e40b2e80 2024-09-17T05:32:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.506+0000 7fe8ec400640 1 -- 172.21.15.31:0/1690259154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe8e40ce260 con 0x7fe8e40b2e80 2024-09-17T05:32:55.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.506+0000 7fe8e1600640 1 -- 172.21.15.31:0/1690259154 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) ==== 84+0+65 (secure 0 0 0) 0x7fe8d0064260 con 0x7fe8e40b2e80 2024-09-17T05:32:55.508 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:55.508 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:32:55.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:32:55.508 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-09-17T05:32:55.509 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-09-17T05:32:55.509 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:32:55.509 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:32:55.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.506+0000 7fe8ec400640 1 -- 172.21.15.31:0/1690259154 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe8c4073320 msgr2=0x7fe8c40757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:55.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.506+0000 7fe8ec400640 1 --2- 172.21.15.31:0/1690259154 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe8c4073320 0x7fe8c40757e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80af000 tx=0x7fe8d801af10 comp rx=0 tx=0).stop 2024-09-17T05:32:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.506+0000 7fe8ec400640 1 -- 172.21.15.31:0/1690259154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e40b2e80 msgr2=0x7fe8e40b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.506+0000 7fe8ec400640 1 --2- 172.21.15.31:0/1690259154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e40b2e80 0x7fe8e40b70f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000e9f0 tx=0x7fe8d000eeb0 comp rx=0 tx=0).stop 2024-09-17T05:32:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.506+0000 7fe8ec400640 1 -- 172.21.15.31:0/1690259154 shutdown_connections 2024-09-17T05:32:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.506+0000 7fe8ec400640 1 --2- 172.21.15.31:0/1690259154 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe8c4073320 0x7fe8c40757e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.506+0000 7fe8ec400640 1 --2- 172.21.15.31:0/1690259154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8e415f490 0x7fe8e4152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.506+0000 7fe8ec400640 1 --2- 172.21.15.31:0/1690259154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8e40b2e80 0x7fe8e40b70f0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.506+0000 7fe8ec400640 1 --2- 172.21.15.31:0/1690259154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8e40b1f40 0x7fe8e41532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.506+0000 7fe8ec400640 1 -- 172.21.15.31:0/1690259154 >> 172.21.15.31:0/1690259154 conn(0x7fe8e40d1e30 msgr2=0x7fe8e41556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.506+0000 7fe8ec400640 1 -- 172.21.15.31:0/1690259154 shutdown_connections 2024-09-17T05:32:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.506+0000 7fe8ec400640 1 -- 172.21.15.31:0/1690259154 wait complete. 2024-09-17T05:32:55.528 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:32:55.529 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:32:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.678+0000 7f28bfc00640 1 -- 172.21.15.31:0/1924767757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b815be10 msgr2=0x7f28b80ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.678+0000 7f28bfc00640 1 --2- 172.21.15.31:0/1924767757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b815be10 0x7f28b80ce700 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009840 tx=0x7f28ac01f010 comp rx=0 tx=0).stop 2024-09-17T05:32:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.678+0000 7f28bfc00640 1 -- 172.21.15.31:0/1924767757 shutdown_connections 2024-09-17T05:32:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.678+0000 7f28bfc00640 1 --2- 172.21.15.31:0/1924767757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b815be10 0x7f28b80ce700 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.678+0000 7f28bfc00640 1 -- 172.21.15.31:0/1924767757 >> 172.21.15.31:0/1924767757 conn(0x7f28b80d1da0 msgr2=0x7f28b80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.678+0000 7f28bfc00640 1 -- 172.21.15.31:0/1924767757 shutdown_connections 2024-09-17T05:32:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.678+0000 7f28bfc00640 1 -- 172.21.15.31:0/1924767757 wait complete. 2024-09-17T05:32:55.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28bfc00640 1 Processor -- start 2024-09-17T05:32:55.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28bfc00640 1 -- start start 2024-09-17T05:32:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28bfc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28b80b0b60 0x7f28b815a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28bfc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b815be10 0x7f28b8158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28bfc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28b815c1f0 0x7f28b8158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28bfc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f28b80cd670 con 0x7f28b815be10 2024-09-17T05:32:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28bfc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f28b80cd4f0 con 0x7f28b815c1f0 2024-09-17T05:32:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28bfc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f28b80cd7f0 con 0x7f28b80b0b60 2024-09-17T05:32:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28b7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b815be10 0x7f28b8158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28b7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b815be10 0x7f28b8158340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40946/0 (socket says 172.21.15.31:40946) 2024-09-17T05:32:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28b7e00640 1 -- 172.21.15.31:0/1336901347 learned_addr learned my addr 172.21.15.31:0/1336901347 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28bd200640 1 --2- 172.21.15.31:0/1336901347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28b80b0b60 0x7f28b815a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28bdc00640 1 --2- 172.21.15.31:0/1336901347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28b815c1f0 0x7f28b8158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28b7e00640 1 -- 172.21.15.31:0/1336901347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28b80b0b60 msgr2=0x7f28b815a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28b7e00640 1 --2- 172.21.15.31:0/1336901347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28b80b0b60 0x7f28b815a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28b7e00640 1 -- 172.21.15.31:0/1336901347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28b815c1f0 msgr2=0x7f28b8158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28b7e00640 1 --2- 172.21.15.31:0/1336901347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28b815c1f0 0x7f28b8158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28b7e00640 1 -- 172.21.15.31:0/1336901347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b815a9f0 con 0x7f28b815be10 2024-09-17T05:32:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28bdc00640 1 --2- 172.21.15.31:0/1336901347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28b815c1f0 0x7f28b8158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28b7e00640 1 --2- 172.21.15.31:0/1336901347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b815be10 0x7f28b8158340 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f28a400c400 tx=0x7f28a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28b4c00640 1 -- 172.21.15.31:0/1336901347 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a4011790 con 0x7f28b815be10 2024-09-17T05:32:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28b4c00640 1 -- 172.21.15.31:0/1336901347 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28a4017070 con 0x7f28b815be10 2024-09-17T05:32:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28bfc00640 1 -- 172.21.15.31:0/1336901347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b815acd0 con 0x7f28b815be10 2024-09-17T05:32:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28b4c00640 1 -- 172.21.15.31:0/1336901347 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a4011cc0 con 0x7f28b815be10 2024-09-17T05:32:55.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28bfc00640 1 -- 172.21.15.31:0/1336901347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b815b290 con 0x7f28b815be10 2024-09-17T05:32:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.682+0000 7f28bfc00640 1 -- 172.21.15.31:0/1336901347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28b80ce460 con 0x7f28b815be10 2024-09-17T05:32:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.686+0000 7f28b4c00640 1 -- 172.21.15.31:0/1336901347 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f28a401c460 con 0x7f28b815be10 2024-09-17T05:32:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.686+0000 7f28b4c00640 1 --2- 172.21.15.31:0/1336901347 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2898073320 0x7f28980757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.686+0000 7f28b4c00640 1 -- 172.21.15.31:0/1336901347 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 4857+0+0 (secure 0 0 0) 0x7f28a4093ea0 con 0x7f28b815be10 2024-09-17T05:32:55.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.686+0000 7f28bd200640 1 --2- 172.21.15.31:0/1336901347 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2898073320 0x7f28980757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:55.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.686+0000 7f28bd200640 1 --2- 172.21.15.31:0/1336901347 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2898073320 0x7f28980757e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f28ac0b2000 tx=0x7f28ac01d850 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:55.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.690+0000 7f28b4c00640 1 -- 172.21.15.31:0/1336901347 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f28a405eff0 con 0x7f28b815be10 2024-09-17T05:32:55.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:55.870+0000 7f28bfc00640 1 -- 172.21.15.31:0/1336901347 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f28b8070350 con 0x7f28b815be10 2024-09-17T05:32:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.738+0000 7f28b4c00640 1 -- 172.21.15.31:0/1336901347 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) ==== 138+0+0 (secure 0 0 0) 0x7f28a405e8f0 con 0x7f28b815be10 2024-09-17T05:32:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-09-17T05:32:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.742+0000 7f28bfc00640 1 -- 172.21.15.31:0/1336901347 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2898073320 msgr2=0x7f28980757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.742+0000 7f28bfc00640 1 --2- 172.21.15.31:0/1336901347 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2898073320 0x7f28980757e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f28ac0b2000 tx=0x7f28ac01d850 comp rx=0 tx=0).stop 2024-09-17T05:32:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.742+0000 7f28bfc00640 1 -- 172.21.15.31:0/1336901347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b815be10 msgr2=0x7f28b8158340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.742+0000 7f28bfc00640 1 --2- 172.21.15.31:0/1336901347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b815be10 0x7f28b8158340 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f28a400c400 tx=0x7f28a400c8c0 comp rx=0 tx=0).stop 2024-09-17T05:32:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.742+0000 7f28bfc00640 1 -- 172.21.15.31:0/1336901347 shutdown_connections 2024-09-17T05:32:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.742+0000 7f28bfc00640 1 --2- 172.21.15.31:0/1336901347 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2898073320 0x7f28980757e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.742+0000 7f28bfc00640 1 --2- 172.21.15.31:0/1336901347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28b815c1f0 0x7f28b8158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.742+0000 7f28bfc00640 1 --2- 172.21.15.31:0/1336901347 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b815be10 0x7f28b8158340 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.742+0000 7f28bfc00640 1 --2- 172.21.15.31:0/1336901347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28b80b0b60 0x7f28b815a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.742+0000 7f28bfc00640 1 -- 172.21.15.31:0/1336901347 >> 172.21.15.31:0/1336901347 conn(0x7f28b80d1da0 msgr2=0x7f28b80c78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.742+0000 7f28bfc00640 1 -- 172.21.15.31:0/1336901347 shutdown_connections 2024-09-17T05:32:56.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.742+0000 7f28bfc00640 1 -- 172.21.15.31:0/1336901347 wait complete. 2024-09-17T05:32:56.774 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:32:56.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.930+0000 7fcf76400640 1 -- 172.21.15.31:0/3338316853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf700d2810 msgr2=0x7fcf70160350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:56.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.930+0000 7fcf76400640 1 --2- 172.21.15.31:0/3338316853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf700d2810 0x7fcf70160350 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009840 tx=0x7fcf5801c7f0 comp rx=0 tx=0).stop 2024-09-17T05:32:56.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.930+0000 7fcf76400640 1 -- 172.21.15.31:0/3338316853 shutdown_connections 2024-09-17T05:32:56.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.930+0000 7fcf76400640 1 --2- 172.21.15.31:0/3338316853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf700b25e0 0x7fcf700af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:56.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.930+0000 7fcf76400640 1 --2- 172.21.15.31:0/3338316853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf700d2810 0x7fcf70160350 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:56.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.930+0000 7fcf76400640 1 -- 172.21.15.31:0/3338316853 >> 172.21.15.31:0/3338316853 conn(0x7fcf700d1cf0 msgr2=0x7fcf700d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:56.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.930+0000 7fcf76400640 1 -- 172.21.15.31:0/3338316853 shutdown_connections 2024-09-17T05:32:56.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.930+0000 7fcf76400640 1 -- 172.21.15.31:0/3338316853 wait complete. 2024-09-17T05:32:56.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.930+0000 7fcf76400640 1 Processor -- start 2024-09-17T05:32:56.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.930+0000 7fcf76400640 1 -- start start 2024-09-17T05:32:56.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf76400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf700b25e0 0x7fcf701fb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:56.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf76400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf700cfd30 0x7fcf7015b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:56.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf76400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf700d2810 0x7fcf701574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:56.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf76400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcf700b0890 con 0x7fcf700cfd30 2024-09-17T05:32:56.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf76400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcf700b0710 con 0x7fcf700d2810 2024-09-17T05:32:56.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf76400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcf70168f10 con 0x7fcf700b25e0 2024-09-17T05:32:56.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf67e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf700cfd30 0x7fcf7015b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:56.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf67e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf700cfd30 0x7fcf7015b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40966/0 (socket says 172.21.15.31:40966) 2024-09-17T05:32:56.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf67e00640 1 -- 172.21.15.31:0/3824657447 learned_addr learned my addr 172.21.15.31:0/3824657447 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:56.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf75000640 1 --2- 172.21.15.31:0/3824657447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf700b25e0 0x7fcf701fb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:56.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf75a00640 1 --2- 172.21.15.31:0/3824657447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf700d2810 0x7fcf701574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:56.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf67e00640 1 -- 172.21.15.31:0/3824657447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf700b25e0 msgr2=0x7fcf701fb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:56.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf67e00640 1 --2- 172.21.15.31:0/3824657447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf700b25e0 0x7fcf701fb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:56.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf67e00640 1 -- 172.21.15.31:0/3824657447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf700d2810 msgr2=0x7fcf701574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:56.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf67e00640 1 --2- 172.21.15.31:0/3824657447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf700d2810 0x7fcf701574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:56.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf67e00640 1 -- 172.21.15.31:0/3824657447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf7015e170 con 0x7fcf700cfd30 2024-09-17T05:32:56.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf75a00640 1 --2- 172.21.15.31:0/3824657447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf700d2810 0x7fcf701574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:32:56.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf67e00640 1 --2- 172.21.15.31:0/3824657447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf700cfd30 0x7fcf7015b280 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009790 tx=0x7fcf580040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:56.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf6d600640 1 -- 172.21.15.31:0/3824657447 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf580b2040 con 0x7fcf700cfd30 2024-09-17T05:32:56.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf6d600640 1 -- 172.21.15.31:0/3824657447 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf58005020 con 0x7fcf700cfd30 2024-09-17T05:32:56.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf6d600640 1 -- 172.21.15.31:0/3824657447 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58005450 con 0x7fcf700cfd30 2024-09-17T05:32:56.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf76400640 1 -- 172.21.15.31:0/3824657447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf7015cdf0 con 0x7fcf700cfd30 2024-09-17T05:32:56.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf76400640 1 -- 172.21.15.31:0/3824657447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf7015de00 con 0x7fcf700cfd30 2024-09-17T05:32:56.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.934+0000 7fcf76400640 1 -- 172.21.15.31:0/3824657447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf700af540 con 0x7fcf700cfd30 2024-09-17T05:32:56.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.938+0000 7fcf6d600640 1 -- 172.21.15.31:0/3824657447 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fcf580be060 con 0x7fcf700cfd30 2024-09-17T05:32:56.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.938+0000 7fcf6d600640 1 --2- 172.21.15.31:0/3824657447 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcf4c073320 0x7fcf4c0757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:56.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.938+0000 7fcf6d600640 1 -- 172.21.15.31:0/3824657447 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5227+0+0 (secure 0 0 0) 0x7fcf5812dfb0 con 0x7fcf700cfd30 2024-09-17T05:32:56.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.938+0000 7fcf75000640 1 --2- 172.21.15.31:0/3824657447 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcf4c073320 0x7fcf4c0757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:56.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.938+0000 7fcf75000640 1 --2- 172.21.15.31:0/3824657447 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcf4c073320 0x7fcf4c0757e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcf60007fd0 tx=0x7fcf60007ea0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:56.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:56.942+0000 7fcf6d600640 1 -- 172.21.15.31:0/3824657447 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fcf58016410 con 0x7fcf700cfd30 2024-09-17T05:32:57.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.122+0000 7fcf76400640 1 -- 172.21.15.31:0/3824657447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcf7015c110 con 0x7fcf700cfd30 2024-09-17T05:32:57.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.742+0000 7fcf6d600640 1 -- 172.21.15.31:0/3824657447 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) ==== 170+0+0 (secure 0 0 0) 0x7fcf580f9090 con 0x7fcf700cfd30 2024-09-17T05:32:57.744 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-09-17T05:32:57.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.746+0000 7fcf76400640 1 -- 172.21.15.31:0/3824657447 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcf4c073320 msgr2=0x7fcf4c0757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:57.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.746+0000 7fcf76400640 1 --2- 172.21.15.31:0/3824657447 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcf4c073320 0x7fcf4c0757e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcf60007fd0 tx=0x7fcf60007ea0 comp rx=0 tx=0).stop 2024-09-17T05:32:57.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.746+0000 7fcf76400640 1 -- 172.21.15.31:0/3824657447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf700cfd30 msgr2=0x7fcf7015b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:57.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.746+0000 7fcf76400640 1 --2- 172.21.15.31:0/3824657447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf700cfd30 0x7fcf7015b280 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009790 tx=0x7fcf580040c0 comp rx=0 tx=0).stop 2024-09-17T05:32:57.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.746+0000 7fcf76400640 1 -- 172.21.15.31:0/3824657447 shutdown_connections 2024-09-17T05:32:57.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.746+0000 7fcf76400640 1 --2- 172.21.15.31:0/3824657447 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcf4c073320 0x7fcf4c0757e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:57.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.746+0000 7fcf76400640 1 --2- 172.21.15.31:0/3824657447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcf700d2810 0x7fcf701574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:57.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.746+0000 7fcf76400640 1 --2- 172.21.15.31:0/3824657447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf700cfd30 0x7fcf7015b280 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:57.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.746+0000 7fcf76400640 1 --2- 172.21.15.31:0/3824657447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcf700b25e0 0x7fcf701fb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:57.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.746+0000 7fcf76400640 1 -- 172.21.15.31:0/3824657447 >> 172.21.15.31:0/3824657447 conn(0x7fcf700d1cf0 msgr2=0x7fcf7015fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:57.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.746+0000 7fcf76400640 1 -- 172.21.15.31:0/3824657447 shutdown_connections 2024-09-17T05:32:57.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.746+0000 7fcf76400640 1 -- 172.21.15.31:0/3824657447 wait complete. 2024-09-17T05:32:57.788 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:32:57.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.942+0000 7f3343400640 1 -- 172.21.15.31:0/2313123873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3324005380 msgr2=0x7f332400b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:57.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.942+0000 7f3343400640 1 --2- 172.21.15.31:0/2313123873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3324005380 0x7f332400b9f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f333400afc0 tx=0x7f333401e430 comp rx=0 tx=0).stop 2024-09-17T05:32:57.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.942+0000 7f3343400640 1 -- 172.21.15.31:0/2313123873 shutdown_connections 2024-09-17T05:32:57.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.942+0000 7f3343400640 1 --2- 172.21.15.31:0/2313123873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3324005380 0x7f332400b9f0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:57.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.942+0000 7f3343400640 1 -- 172.21.15.31:0/2313123873 >> 172.21.15.31:0/2313123873 conn(0x7f333c0b18f0 msgr2=0x7f333c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:57.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.942+0000 7f3343400640 1 -- 172.21.15.31:0/2313123873 shutdown_connections 2024-09-17T05:32:57.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.942+0000 7f3343400640 1 -- 172.21.15.31:0/2313123873 wait complete. 2024-09-17T05:32:57.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.942+0000 7f3343400640 1 Processor -- start 2024-09-17T05:32:57.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.942+0000 7f3343400640 1 -- start start 2024-09-17T05:32:57.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.942+0000 7f3343400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3324005380 0x7f333c1535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:57.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.942+0000 7f3343400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333c1563c0 0x7f333c1f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:57.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.942+0000 7f3343400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c1f5f80 0x7f333c154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:57.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.942+0000 7f3343400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f333c0ceba0 con 0x7f333c1f5f80 2024-09-17T05:32:57.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.942+0000 7f3343400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f333c0cea20 con 0x7f3324005380 2024-09-17T05:32:57.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.942+0000 7f3343400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f333c0ced20 con 0x7f333c1563c0 2024-09-17T05:32:57.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f3341400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c1f5f80 0x7f333c154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:57.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f3340a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3324005380 0x7f333c1535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:57.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f3341400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c1f5f80 0x7f333c154f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40992/0 (socket says 172.21.15.31:40992) 2024-09-17T05:32:57.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f3341400640 1 -- 172.21.15.31:0/1891883065 learned_addr learned my addr 172.21.15.31:0/1891883065 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:57.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f3340a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3324005380 0x7f333c1535f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:33486/0 (socket says 172.21.15.31:33486) 2024-09-17T05:32:57.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f333be00640 1 --2- 172.21.15.31:0/1891883065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333c1563c0 0x7f333c1f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:57.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f3341400640 1 -- 172.21.15.31:0/1891883065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333c1563c0 msgr2=0x7f333c1f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:57.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f3341400640 1 --2- 172.21.15.31:0/1891883065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333c1563c0 0x7f333c1f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:57.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f3341400640 1 -- 172.21.15.31:0/1891883065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3324005380 msgr2=0x7f333c1535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:57.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f3341400640 1 --2- 172.21.15.31:0/1891883065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3324005380 0x7f333c1535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:57.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f3341400640 1 -- 172.21.15.31:0/1891883065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333c153b30 con 0x7f333c1f5f80 2024-09-17T05:32:57.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f3340a00640 1 --2- 172.21.15.31:0/1891883065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3324005380 0x7f333c1535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:32:57.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f3341400640 1 --2- 172.21.15.31:0/1891883065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c1f5f80 0x7f333c154f30 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3334099d30 tx=0x7f33340ad930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:57.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f3338c00640 1 -- 172.21.15.31:0/1891883065 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333400abc0 con 0x7f333c1f5f80 2024-09-17T05:32:57.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f3338c00640 1 -- 172.21.15.31:0/1891883065 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33340be070 con 0x7f333c1f5f80 2024-09-17T05:32:57.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f3343400640 1 -- 172.21.15.31:0/1891883065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333c1f9b20 con 0x7f333c1f5f80 2024-09-17T05:32:57.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f3338c00640 1 -- 172.21.15.31:0/1891883065 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333400a310 con 0x7f333c1f5f80 2024-09-17T05:32:57.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f3343400640 1 -- 172.21.15.31:0/1891883065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f333c09bf60 con 0x7f333c1f5f80 2024-09-17T05:32:57.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.946+0000 7f3343400640 1 -- 172.21.15.31:0/1891883065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f333c069410 con 0x7f333c1f5f80 2024-09-17T05:32:57.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.950+0000 7f3338c00640 1 -- 172.21.15.31:0/1891883065 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f33340c3460 con 0x7f333c1f5f80 2024-09-17T05:32:57.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.950+0000 7f3338c00640 1 --2- 172.21.15.31:0/1891883065 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f331c073350 0x7f331c075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:57.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.950+0000 7f3338c00640 1 -- 172.21.15.31:0/1891883065 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5609+0+0 (secure 0 0 0) 0x7f333412ff80 con 0x7f333c1f5f80 2024-09-17T05:32:57.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.950+0000 7f3340a00640 1 --2- 172.21.15.31:0/1891883065 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f331c073350 0x7f331c075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:57.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.950+0000 7f3340a00640 1 --2- 172.21.15.31:0/1891883065 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f331c073350 0x7f331c075810 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3330006fd0 tx=0x7f3330006b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:57.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:57.954+0000 7f3338c00640 1 -- 172.21.15.31:0/1891883065 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f333c153b30 con 0x7f333c1f5f80 2024-09-17T05:32:58.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.162+0000 7f3343400640 1 -- 172.21.15.31:0/1891883065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f333c156f50 con 0x7f333c1f5f80 2024-09-17T05:32:58.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.758+0000 7f3338c00640 1 -- 172.21.15.31:0/1891883065 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v53) ==== 174+0+0 (secure 0 0 0) 0x7f3334018140 con 0x7f333c1f5f80 2024-09-17T05:32:58.760 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 12 and data pool 13 2024-09-17T05:32:58.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.762+0000 7f3343400640 1 -- 172.21.15.31:0/1891883065 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f331c073350 msgr2=0x7f331c075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:58.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.762+0000 7f3343400640 1 --2- 172.21.15.31:0/1891883065 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f331c073350 0x7f331c075810 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3330006fd0 tx=0x7f3330006b20 comp rx=0 tx=0).stop 2024-09-17T05:32:58.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.762+0000 7f3343400640 1 -- 172.21.15.31:0/1891883065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c1f5f80 msgr2=0x7f333c154f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:58.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.762+0000 7f3343400640 1 --2- 172.21.15.31:0/1891883065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c1f5f80 0x7f333c154f30 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3334099d30 tx=0x7f33340ad930 comp rx=0 tx=0).stop 2024-09-17T05:32:58.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.766+0000 7f3343400640 1 -- 172.21.15.31:0/1891883065 shutdown_connections 2024-09-17T05:32:58.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.766+0000 7f3343400640 1 --2- 172.21.15.31:0/1891883065 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f331c073350 0x7f331c075810 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:58.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.766+0000 7f3343400640 1 --2- 172.21.15.31:0/1891883065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f333c1f5f80 0x7f333c154f30 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:58.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.766+0000 7f3343400640 1 --2- 172.21.15.31:0/1891883065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f333c1563c0 0x7f333c1f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:58.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.766+0000 7f3343400640 1 --2- 172.21.15.31:0/1891883065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3324005380 0x7f333c1535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:58.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.766+0000 7f3343400640 1 -- 172.21.15.31:0/1891883065 >> 172.21.15.31:0/1891883065 conn(0x7f333c0b18f0 msgr2=0x7f333c0ad310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:58.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.766+0000 7f3343400640 1 -- 172.21.15.31:0/1891883065 shutdown_connections 2024-09-17T05:32:58.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.766+0000 7f3343400640 1 -- 172.21.15.31:0/1891883065 wait complete. 2024-09-17T05:32:58.814 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:32:58.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.962+0000 7f46d8400640 1 -- 172.21.15.31:0/2990167054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46d00b11d0 msgr2=0x7f46d006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.962+0000 7f46d8400640 1 --2- 172.21.15.31:0/2990167054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46d00b11d0 0x7f46d006ec80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f46d0073f90 tx=0x7f46c801ccf0 comp rx=0 tx=0).stop 2024-09-17T05:32:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.962+0000 7f46d8400640 1 -- 172.21.15.31:0/2990167054 shutdown_connections 2024-09-17T05:32:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.962+0000 7f46d8400640 1 --2- 172.21.15.31:0/2990167054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46d00b11d0 0x7f46d006ec80 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.962+0000 7f46d8400640 1 --2- 172.21.15.31:0/2990167054 >> v2:172.21.15.155:3300/0 conn(0x7f46d015df50 0x7f46d006e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.962+0000 7f46d8400640 1 -- 172.21.15.31:0/2990167054 >> 172.21.15.31:0/2990167054 conn(0x7f46d00d1dc0 msgr2=0x7f46d00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.962+0000 7f46d8400640 1 -- 172.21.15.31:0/2990167054 shutdown_connections 2024-09-17T05:32:58.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.962+0000 7f46d8400640 1 -- 172.21.15.31:0/2990167054 wait complete. 2024-09-17T05:32:58.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.962+0000 7f46d8400640 1 Processor -- start 2024-09-17T05:32:58.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.962+0000 7f46d8400640 1 -- start start 2024-09-17T05:32:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d8400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d00b11d0 0x7f46d0155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d8400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d015df50 0x7f46d01541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d8400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46d015e330 0x7f46d00b2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d8400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f46d00d0860 con 0x7f46d015e330 2024-09-17T05:32:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d8400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f46d00d06e0 con 0x7f46d015df50 2024-09-17T05:32:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d8400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f46d00d09e0 con 0x7f46d00b11d0 2024-09-17T05:32:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d6400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46d015e330 0x7f46d00b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d6400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46d015e330 0x7f46d00b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41272/0 (socket says 172.21.15.31:41272) 2024-09-17T05:32:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d6400640 1 -- 172.21.15.31:0/1976895034 learned_addr learned my addr 172.21.15.31:0/1976895034 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d5a00640 1 --2- 172.21.15.31:0/1976895034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d00b11d0 0x7f46d0155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d5000640 1 --2- 172.21.15.31:0/1976895034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d015df50 0x7f46d01541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d6400640 1 -- 172.21.15.31:0/1976895034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d00b11d0 msgr2=0x7f46d0155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:58.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d6400640 1 --2- 172.21.15.31:0/1976895034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d00b11d0 0x7f46d0155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:58.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d6400640 1 -- 172.21.15.31:0/1976895034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d015df50 msgr2=0x7f46d01541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:58.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d6400640 1 --2- 172.21.15.31:0/1976895034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d015df50 0x7f46d01541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:58.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d6400640 1 -- 172.21.15.31:0/1976895034 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d00b4fb0 con 0x7f46d015e330 2024-09-17T05:32:58.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d6400640 1 --2- 172.21.15.31:0/1976895034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46d015e330 0x7f46d00b2810 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f46c801b570 tx=0x7f46c80a5b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:58.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46cd600640 1 -- 172.21.15.31:0/1976895034 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c80bc070 con 0x7f46d015e330 2024-09-17T05:32:58.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46cd600640 1 -- 172.21.15.31:0/1976895034 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46c80043b0 con 0x7f46d015e330 2024-09-17T05:32:58.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d8400640 1 -- 172.21.15.31:0/1976895034 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d00c8860 con 0x7f46d015e330 2024-09-17T05:32:58.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46cd600640 1 -- 172.21.15.31:0/1976895034 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c80b2040 con 0x7f46d015e330 2024-09-17T05:32:58.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d8400640 1 -- 172.21.15.31:0/1976895034 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d00b55b0 con 0x7f46d015e330 2024-09-17T05:32:58.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.966+0000 7f46d8400640 1 -- 172.21.15.31:0/1976895034 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d00afcd0 con 0x7f46d015e330 2024-09-17T05:32:58.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.970+0000 7f46cd600640 1 -- 172.21.15.31:0/1976895034 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f46c80bf070 con 0x7f46d015e330 2024-09-17T05:32:58.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.970+0000 7f46cd600640 1 --2- 172.21.15.31:0/1976895034 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f46b0073320 0x7f46b00757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:58.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.970+0000 7f46cd600640 1 -- 172.21.15.31:0/1976895034 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f46c812e320 con 0x7f46d015e330 2024-09-17T05:32:58.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.970+0000 7f46d5a00640 1 --2- 172.21.15.31:0/1976895034 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f46b0073320 0x7f46b00757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:58.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.970+0000 7f46d5a00640 1 --2- 172.21.15.31:0/1976895034 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f46b0073320 0x7f46b00757e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f46c4006fd0 tx=0x7f46c4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:58.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:58.974+0000 7f46cd600640 1 -- 172.21.15.31:0/1976895034 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f46c8016970 con 0x7f46d015e330 2024-09-17T05:32:59.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.150+0000 7f46d8400640 1 -- 172.21.15.31:0/1976895034 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46d006eb10 con 0x7f46d015e330 2024-09-17T05:32:59.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.150+0000 7f46cd600640 1 -- 172.21.15.31:0/1976895034 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+16757 (secure 0 0 0) 0x7f46c80f9240 con 0x7f46d015e330 2024-09-17T05:32:59.154 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:59.155 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":80,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:32:58.167048+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:32:55.883070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T05:32:57.135509+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:32:59.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.154+0000 7f46d8400640 1 -- 172.21.15.31:0/1976895034 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f46b0073320 msgr2=0x7f46b00757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:59.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.154+0000 7f46d8400640 1 --2- 172.21.15.31:0/1976895034 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f46b0073320 0x7f46b00757e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f46c4006fd0 tx=0x7f46c4008040 comp rx=0 tx=0).stop 2024-09-17T05:32:59.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.154+0000 7f46d8400640 1 -- 172.21.15.31:0/1976895034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46d015e330 msgr2=0x7f46d00b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:59.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.154+0000 7f46d8400640 1 --2- 172.21.15.31:0/1976895034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46d015e330 0x7f46d00b2810 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f46c801b570 tx=0x7f46c80a5b80 comp rx=0 tx=0).stop 2024-09-17T05:32:59.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.154+0000 7f46d8400640 1 -- 172.21.15.31:0/1976895034 shutdown_connections 2024-09-17T05:32:59.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.154+0000 7f46d8400640 1 --2- 172.21.15.31:0/1976895034 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f46b0073320 0x7f46b00757e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:59.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.154+0000 7f46d8400640 1 --2- 172.21.15.31:0/1976895034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46d015e330 0x7f46d00b2810 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:59.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.154+0000 7f46d8400640 1 --2- 172.21.15.31:0/1976895034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46d015df50 0x7f46d01541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:59.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.154+0000 7f46d8400640 1 --2- 172.21.15.31:0/1976895034 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46d00b11d0 0x7f46d0155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:59.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.154+0000 7f46d8400640 1 -- 172.21.15.31:0/1976895034 >> 172.21.15.31:0/1976895034 conn(0x7f46d00d1dc0 msgr2=0x7f46d00d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:59.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.154+0000 7f46d8400640 1 -- 172.21.15.31:0/1976895034 shutdown_connections 2024-09-17T05:32:59.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.154+0000 7f46d8400640 1 -- 172.21.15.31:0/1976895034 wait complete. 2024-09-17T05:32:59.176 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:32:59.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.322+0000 7f8200000640 1 -- 172.21.15.31:0/1736563169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f80b6400 msgr2=0x7f81f80ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:59.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.322+0000 7f8200000640 1 --2- 172.21.15.31:0/1736563169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f80b6400 0x7f81f80ccfc0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009bc0 tx=0x7f81f001cba0 comp rx=0 tx=0).stop 2024-09-17T05:32:59.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.322+0000 7f8200000640 1 -- 172.21.15.31:0/1736563169 shutdown_connections 2024-09-17T05:32:59.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.322+0000 7f8200000640 1 --2- 172.21.15.31:0/1736563169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f80b6400 0x7f81f80ccfc0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:59.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.322+0000 7f8200000640 1 -- 172.21.15.31:0/1736563169 >> 172.21.15.31:0/1736563169 conn(0x7f81f80d1da0 msgr2=0x7f81f80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:59.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.322+0000 7f8200000640 1 -- 172.21.15.31:0/1736563169 shutdown_connections 2024-09-17T05:32:59.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.322+0000 7f8200000640 1 -- 172.21.15.31:0/1736563169 wait complete. 2024-09-17T05:32:59.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.322+0000 7f8200000640 1 Processor -- start 2024-09-17T05:32:59.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.322+0000 7f8200000640 1 -- start start 2024-09-17T05:32:59.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f8200000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81f80b6400 0x7f81f81fb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:59.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f8200000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81f80cebf0 0x7f81f815a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:59.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f8200000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f815be80 0x7f81f8153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:59.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f8200000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f81f816a2c0 con 0x7f81f815be80 2024-09-17T05:32:59.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f8200000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f81f816a140 con 0x7f81f80b6400 2024-09-17T05:32:59.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f8200000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f81f816a440 con 0x7f81f80cebf0 2024-09-17T05:32:59.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f81fe000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f815be80 0x7f81f8153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:59.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f81fe000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f815be80 0x7f81f8153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41286/0 (socket says 172.21.15.31:41286) 2024-09-17T05:32:59.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f81fe000640 1 -- 172.21.15.31:0/3344613390 learned_addr learned my addr 172.21.15.31:0/3344613390 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:59.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f81fe000640 1 -- 172.21.15.31:0/3344613390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81f80cebf0 msgr2=0x7f81f815a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:59.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f81fe000640 1 --2- 172.21.15.31:0/3344613390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81f80cebf0 0x7f81f815a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:59.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f81fe000640 1 -- 172.21.15.31:0/3344613390 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81f80b6400 msgr2=0x7f81f81fb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:59.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f81fe000640 1 --2- 172.21.15.31:0/3344613390 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81f80b6400 0x7f81f81fb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:59.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f81fe000640 1 -- 172.21.15.31:0/3344613390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f815a750 con 0x7f81f815be80 2024-09-17T05:32:59.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f81fe000640 1 --2- 172.21.15.31:0/3344613390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f815be80 0x7f81f8153010 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f81f001c610 tx=0x7f81f00a5980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:59.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f81f5600640 1 -- 172.21.15.31:0/3344613390 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f00b2040 con 0x7f81f815be80 2024-09-17T05:32:59.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f81f5600640 1 -- 172.21.15.31:0/3344613390 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81f00bb070 con 0x7f81f815be80 2024-09-17T05:32:59.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f81f5600640 1 -- 172.21.15.31:0/3344613390 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f0004710 con 0x7f81f815be80 2024-09-17T05:32:59.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f8200000640 1 -- 172.21.15.31:0/3344613390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f8156f50 con 0x7f81f815be80 2024-09-17T05:32:59.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f8200000640 1 -- 172.21.15.31:0/3344613390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f81f7dd0 con 0x7f81f815be80 2024-09-17T05:32:59.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.326+0000 7f8200000640 1 -- 172.21.15.31:0/3344613390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f80ce4e0 con 0x7f81f815be80 2024-09-17T05:32:59.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.330+0000 7f81f5600640 1 -- 172.21.15.31:0/3344613390 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f81f00c0460 con 0x7f81f815be80 2024-09-17T05:32:59.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.330+0000 7f81f5600640 1 --2- 172.21.15.31:0/3344613390 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f81d8073320 0x7f81d80757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:59.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.330+0000 7f81f5600640 1 -- 172.21.15.31:0/3344613390 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f81f012efe0 con 0x7f81f815be80 2024-09-17T05:32:59.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.330+0000 7f81fd600640 1 --2- 172.21.15.31:0/3344613390 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f81d8073320 0x7f81d80757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:59.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.330+0000 7f81fd600640 1 --2- 172.21.15.31:0/3344613390 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f81d8073320 0x7f81d80757e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f81ec007fd0 tx=0x7f81ec007980 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:59.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.334+0000 7f81f5600640 1 -- 172.21.15.31:0/3344613390 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f81f00a5e20 con 0x7f81f815be80 2024-09-17T05:32:59.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.514+0000 7f8200000640 1 -- 172.21.15.31:0/3344613390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81f8070b40 con 0x7f81f815be80 2024-09-17T05:32:59.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.514+0000 7f81f5600640 1 -- 172.21.15.31:0/3344613390 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+16757 (secure 0 0 0) 0x7f81f0016790 con 0x7f81f815be80 2024-09-17T05:32:59.517 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:32:59.517 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":80,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:32:58.167048+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:32:55.883070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T05:32:57.135509+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:32:59.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.518+0000 7f8200000640 1 -- 172.21.15.31:0/3344613390 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f81d8073320 msgr2=0x7f81d80757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:59.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.518+0000 7f8200000640 1 --2- 172.21.15.31:0/3344613390 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f81d8073320 0x7f81d80757e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f81ec007fd0 tx=0x7f81ec007980 comp rx=0 tx=0).stop 2024-09-17T05:32:59.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.518+0000 7f8200000640 1 -- 172.21.15.31:0/3344613390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f815be80 msgr2=0x7f81f8153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:59.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.518+0000 7f8200000640 1 --2- 172.21.15.31:0/3344613390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f815be80 0x7f81f8153010 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f81f001c610 tx=0x7f81f00a5980 comp rx=0 tx=0).stop 2024-09-17T05:32:59.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.518+0000 7f8200000640 1 -- 172.21.15.31:0/3344613390 shutdown_connections 2024-09-17T05:32:59.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.518+0000 7f8200000640 1 --2- 172.21.15.31:0/3344613390 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f81d8073320 0x7f81d80757e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:59.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.518+0000 7f8200000640 1 --2- 172.21.15.31:0/3344613390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f815be80 0x7f81f8153010 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:59.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.518+0000 7f8200000640 1 --2- 172.21.15.31:0/3344613390 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81f80cebf0 0x7f81f815a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:59.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.518+0000 7f8200000640 1 --2- 172.21.15.31:0/3344613390 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81f80b6400 0x7f81f81fb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:59.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.518+0000 7f8200000640 1 -- 172.21.15.31:0/3344613390 >> 172.21.15.31:0/3344613390 conn(0x7f81f80d1da0 msgr2=0x7f81f80b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:59.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.518+0000 7f8200000640 1 -- 172.21.15.31:0/3344613390 shutdown_connections 2024-09-17T05:32:59.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.518+0000 7f8200000640 1 -- 172.21.15.31:0/3344613390 wait complete. 2024-09-17T05:32:59.539 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:32:59.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.686+0000 7f07dfa00640 1 -- 172.21.15.31:0/2479426869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07d80c6b00 msgr2=0x7f07d806f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:59.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.686+0000 7f07dfa00640 1 --2- 172.21.15.31:0/2479426869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07d80c6b00 0x7f07d806f090 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009bc0 tx=0x7f07d001cba0 comp rx=0 tx=0).stop 2024-09-17T05:32:59.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.686+0000 7f07dfa00640 1 -- 172.21.15.31:0/2479426869 shutdown_connections 2024-09-17T05:32:59.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.686+0000 7f07dfa00640 1 --2- 172.21.15.31:0/2479426869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07d80c6b00 0x7f07d806f090 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:59.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.686+0000 7f07dfa00640 1 -- 172.21.15.31:0/2479426869 >> 172.21.15.31:0/2479426869 conn(0x7f07d80cce90 msgr2=0x7f07d80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:32:59.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.686+0000 7f07dfa00640 1 -- 172.21.15.31:0/2479426869 shutdown_connections 2024-09-17T05:32:59.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.686+0000 7f07dfa00640 1 -- 172.21.15.31:0/2479426869 wait complete. 2024-09-17T05:32:59.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dfa00640 1 Processor -- start 2024-09-17T05:32:59.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dfa00640 1 -- start start 2024-09-17T05:32:59.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dfa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07d80c6b00 0x7f07d81309a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:59.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dfa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07d8152b90 0x7f07d80c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:59.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dfa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07d815ff50 0x7f07d81fb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:59.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dfa00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f07d816a560 con 0x7f07d815ff50 2024-09-17T05:32:59.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dfa00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f07d816a3e0 con 0x7f07d80c6b00 2024-09-17T05:32:59.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dfa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f07d816a6e0 con 0x7f07d8152b90 2024-09-17T05:32:59.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dda00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07d815ff50 0x7f07d81fb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:59.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dda00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07d815ff50 0x7f07d81fb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41298/0 (socket says 172.21.15.31:41298) 2024-09-17T05:32:59.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dda00640 1 -- 172.21.15.31:0/1500139310 learned_addr learned my addr 172.21.15.31:0/1500139310 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:32:59.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dda00640 1 -- 172.21.15.31:0/1500139310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07d8152b90 msgr2=0x7f07d80c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:59.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dda00640 1 --2- 172.21.15.31:0/1500139310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07d8152b90 0x7f07d80c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:59.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dd000640 1 --2- 172.21.15.31:0/1500139310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07d80c6b00 0x7f07d81309a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:59.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dda00640 1 -- 172.21.15.31:0/1500139310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07d80c6b00 msgr2=0x7f07d81309a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:32:59.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dda00640 1 --2- 172.21.15.31:0/1500139310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07d80c6b00 0x7f07d81309a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:32:59.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dda00640 1 -- 172.21.15.31:0/1500139310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d80ca080 con 0x7f07d815ff50 2024-09-17T05:32:59.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dd000640 1 --2- 172.21.15.31:0/1500139310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07d80c6b00 0x7f07d81309a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:32:59.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dda00640 1 --2- 172.21.15.31:0/1500139310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07d815ff50 0x7f07d81fb750 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f07d00b0040 tx=0x7f07d0005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:59.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07d5600640 1 -- 172.21.15.31:0/1500139310 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d00b2040 con 0x7f07d815ff50 2024-09-17T05:32:59.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07d5600640 1 -- 172.21.15.31:0/1500139310 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07d0004130 con 0x7f07d815ff50 2024-09-17T05:32:59.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07d5600640 1 -- 172.21.15.31:0/1500139310 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d0004560 con 0x7f07d815ff50 2024-09-17T05:32:59.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dfa00640 1 -- 172.21.15.31:0/1500139310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07d8148970 con 0x7f07d815ff50 2024-09-17T05:32:59.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dfa00640 1 -- 172.21.15.31:0/1500139310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07d8148f30 con 0x7f07d815ff50 2024-09-17T05:32:59.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.690+0000 7f07dfa00640 1 -- 172.21.15.31:0/1500139310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07d806f090 con 0x7f07d815ff50 2024-09-17T05:32:59.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.694+0000 7f07d5600640 1 -- 172.21.15.31:0/1500139310 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f07d00bd030 con 0x7f07d815ff50 2024-09-17T05:32:59.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.694+0000 7f07d5600640 1 --2- 172.21.15.31:0/1500139310 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f07b4073320 0x7f07b40757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:32:59.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.694+0000 7f07d5600640 1 -- 172.21.15.31:0/1500139310 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f07d012e550 con 0x7f07d815ff50 2024-09-17T05:32:59.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.694+0000 7f07dd000640 1 --2- 172.21.15.31:0/1500139310 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f07b4073320 0x7f07b40757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:32:59.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.694+0000 7f07dd000640 1 --2- 172.21.15.31:0/1500139310 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f07b4073320 0x7f07b40757e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f07c8000f70 tx=0x7f07c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:32:59.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.698+0000 7f07d5600640 1 -- 172.21.15.31:0/1500139310 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f07d00c4060 con 0x7f07d815ff50 2024-09-17T05:32:59.736 INFO:tasks.ceph.mds.c.smithi031.stderr:2024-09-17T05:32:59.734+0000 7fb607400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:32:59.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:32:59.914+0000 7f07dfa00640 1 -- 172.21.15.31:0/1500139310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f07d814b8a0 con 0x7f07d815ff50 2024-09-17T05:33:00.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.786+0000 7f07d5600640 1 -- 172.21.15.31:0/1500139310 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v55) ==== 118+0+0 (secure 0 0 0) 0x7f07d00a5e20 con 0x7f07d815ff50 2024-09-17T05:33:00.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.790+0000 7f07dfa00640 1 -- 172.21.15.31:0/1500139310 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f07b4073320 msgr2=0x7f07b40757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:00.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.790+0000 7f07dfa00640 1 --2- 172.21.15.31:0/1500139310 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f07b4073320 0x7f07b40757e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f07c8000f70 tx=0x7f07c8009040 comp rx=0 tx=0).stop 2024-09-17T05:33:00.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.790+0000 7f07dfa00640 1 -- 172.21.15.31:0/1500139310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07d815ff50 msgr2=0x7f07d81fb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:00.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.790+0000 7f07dfa00640 1 --2- 172.21.15.31:0/1500139310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07d815ff50 0x7f07d81fb750 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f07d00b0040 tx=0x7f07d0005b00 comp rx=0 tx=0).stop 2024-09-17T05:33:00.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.790+0000 7f07dfa00640 1 -- 172.21.15.31:0/1500139310 shutdown_connections 2024-09-17T05:33:00.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.790+0000 7f07dfa00640 1 --2- 172.21.15.31:0/1500139310 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f07b4073320 0x7f07b40757e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:00.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.790+0000 7f07dfa00640 1 --2- 172.21.15.31:0/1500139310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07d815ff50 0x7f07d81fb750 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:00.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.790+0000 7f07dfa00640 1 --2- 172.21.15.31:0/1500139310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07d8152b90 0x7f07d80c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:00.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.790+0000 7f07dfa00640 1 --2- 172.21.15.31:0/1500139310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07d80c6b00 0x7f07d81309a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:00.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.790+0000 7f07dfa00640 1 -- 172.21.15.31:0/1500139310 >> 172.21.15.31:0/1500139310 conn(0x7f07d80cce90 msgr2=0x7f07d815d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:00.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.790+0000 7f07dfa00640 1 -- 172.21.15.31:0/1500139310 shutdown_connections 2024-09-17T05:33:00.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.790+0000 7f07dfa00640 1 -- 172.21.15.31:0/1500139310 wait complete. 2024-09-17T05:33:00.815 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:33:00.815 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:33:00.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.962+0000 7f7a7a200640 1 -- 172.21.15.31:0/2345972370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a740cfb20 msgr2=0x7f7a740ceea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:00.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.962+0000 7f7a7a200640 1 --2- 172.21.15.31:0/2345972370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a740cfb20 0x7f7a740ceea0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f7a740737b0 tx=0x7f7a5c01c830 comp rx=0 tx=0).stop 2024-09-17T05:33:00.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.962+0000 7f7a7a200640 1 -- 172.21.15.31:0/2345972370 shutdown_connections 2024-09-17T05:33:00.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.962+0000 7f7a7a200640 1 --2- 172.21.15.31:0/2345972370 >> v2:172.21.15.155:3300/0 conn(0x7f7a740cb2e0 0x7f7a740cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:00.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.962+0000 7f7a7a200640 1 --2- 172.21.15.31:0/2345972370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a740cfb20 0x7f7a740ceea0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:00.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.962+0000 7f7a7a200640 1 --2- 172.21.15.31:0/2345972370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a740ceac0 0x7f7a740d05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:00.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.962+0000 7f7a7a200640 1 -- 172.21.15.31:0/2345972370 >> 172.21.15.31:0/2345972370 conn(0x7f7a740d0c90 msgr2=0x7f7a740d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:00.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.962+0000 7f7a7a200640 1 -- 172.21.15.31:0/2345972370 shutdown_connections 2024-09-17T05:33:00.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.962+0000 7f7a7a200640 1 -- 172.21.15.31:0/2345972370 wait complete. 2024-09-17T05:33:00.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a7a200640 1 Processor -- start 2024-09-17T05:33:00.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a7a200640 1 -- start start 2024-09-17T05:33:00.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a7a200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a740cb2e0 0x7f7a740b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:00.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a7a200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a740ceac0 0x7f7a740b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:00.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a7a200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a740cfb20 0x7f7a740b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:00.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a7a200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7406fc60 con 0x7f7a740cfb20 2024-09-17T05:33:00.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a7a200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7406fae0 con 0x7f7a740cb2e0 2024-09-17T05:33:00.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a7a200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7a7406fde0 con 0x7f7a740ceac0 2024-09-17T05:33:00.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a73e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a740cfb20 0x7f7a740b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:00.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a73e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a740cfb20 0x7f7a740b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41320/0 (socket says 172.21.15.31:41320) 2024-09-17T05:33:00.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a73e00640 1 -- 172.21.15.31:0/2540123456 learned_addr learned my addr 172.21.15.31:0/2540123456 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:00.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a73400640 1 --2- 172.21.15.31:0/2540123456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a740cb2e0 0x7f7a740b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:00.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a6be00640 1 --2- 172.21.15.31:0/2540123456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a740ceac0 0x7f7a740b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:00.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a73e00640 1 -- 172.21.15.31:0/2540123456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a740ceac0 msgr2=0x7f7a740b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:00.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a73e00640 1 --2- 172.21.15.31:0/2540123456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a740ceac0 0x7f7a740b2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:00.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a73e00640 1 -- 172.21.15.31:0/2540123456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a740cb2e0 msgr2=0x7f7a740b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:00.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a73e00640 1 --2- 172.21.15.31:0/2540123456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a740cb2e0 0x7f7a740b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:00.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a73e00640 1 -- 172.21.15.31:0/2540123456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a740b5c90 con 0x7f7a740cfb20 2024-09-17T05:33:00.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a73e00640 1 --2- 172.21.15.31:0/2540123456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a740cfb20 0x7f7a740b2c50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00e990 tx=0x7f7a6c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:00.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a6b400640 1 -- 172.21.15.31:0/2540123456 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c004d30 con 0x7f7a740cfb20 2024-09-17T05:33:00.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a6b400640 1 -- 172.21.15.31:0/2540123456 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a6c00cb00 con 0x7f7a740cfb20 2024-09-17T05:33:00.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a6b400640 1 -- 172.21.15.31:0/2540123456 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c005020 con 0x7f7a740cfb20 2024-09-17T05:33:00.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.966+0000 7f7a7a200640 1 -- 172.21.15.31:0/2540123456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a740b5f70 con 0x7f7a740cfb20 2024-09-17T05:33:00.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.970+0000 7f7a7a200640 1 -- 172.21.15.31:0/2540123456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a740b6530 con 0x7f7a740cfb20 2024-09-17T05:33:00.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.970+0000 7f7a7a200640 1 -- 172.21.15.31:0/2540123456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a74164e30 con 0x7f7a740cfb20 2024-09-17T05:33:00.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.970+0000 7f7a6b400640 1 -- 172.21.15.31:0/2540123456 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f7a6c0051c0 con 0x7f7a740cfb20 2024-09-17T05:33:00.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.970+0000 7f7a6b400640 1 --2- 172.21.15.31:0/2540123456 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7a50073320 0x7f7a500757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:00.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.970+0000 7f7a6b400640 1 -- 172.21.15.31:0/2540123456 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f7a6c094da0 con 0x7f7a740cfb20 2024-09-17T05:33:00.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.970+0000 7f7a73400640 1 --2- 172.21.15.31:0/2540123456 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7a50073320 0x7f7a500757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:00.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.974+0000 7f7a73400640 1 --2- 172.21.15.31:0/2540123456 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7a50073320 0x7f7a500757e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7a64004630 tx=0x7f7a6400b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:00.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:00.978+0000 7f7a6b400640 1 -- 172.21.15.31:0/2540123456 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7a6c016030 con 0x7f7a740cfb20 2024-09-17T05:33:01.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.190+0000 7f7a7a200640 1 -- 172.21.15.31:0/2540123456 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7a740d05c0 con 0x7f7a740cfb20 2024-09-17T05:33:01.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.798+0000 7f7a6b400640 1 -- 172.21.15.31:0/2540123456 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v56) ==== 122+0+0 (secure 0 0 0) 0x7f7a6c05f540 con 0x7f7a740cfb20 2024-09-17T05:33:01.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.802+0000 7f7a7a200640 1 -- 172.21.15.31:0/2540123456 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7a50073320 msgr2=0x7f7a500757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:01.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.802+0000 7f7a7a200640 1 --2- 172.21.15.31:0/2540123456 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7a50073320 0x7f7a500757e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7a64004630 tx=0x7f7a6400b390 comp rx=0 tx=0).stop 2024-09-17T05:33:01.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.802+0000 7f7a7a200640 1 -- 172.21.15.31:0/2540123456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a740cfb20 msgr2=0x7f7a740b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:01.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.802+0000 7f7a7a200640 1 --2- 172.21.15.31:0/2540123456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a740cfb20 0x7f7a740b2c50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00e990 tx=0x7f7a6c00ee50 comp rx=0 tx=0).stop 2024-09-17T05:33:01.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.802+0000 7f7a7a200640 1 -- 172.21.15.31:0/2540123456 shutdown_connections 2024-09-17T05:33:01.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.802+0000 7f7a7a200640 1 --2- 172.21.15.31:0/2540123456 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7a50073320 0x7f7a500757e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:01.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.802+0000 7f7a7a200640 1 --2- 172.21.15.31:0/2540123456 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a740cfb20 0x7f7a740b2c50 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:01.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.802+0000 7f7a7a200640 1 --2- 172.21.15.31:0/2540123456 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a740ceac0 0x7f7a740b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:01.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.802+0000 7f7a7a200640 1 --2- 172.21.15.31:0/2540123456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a740cb2e0 0x7f7a740b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:01.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.802+0000 7f7a7a200640 1 -- 172.21.15.31:0/2540123456 >> 172.21.15.31:0/2540123456 conn(0x7f7a740d0c90 msgr2=0x7f7a740d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:01.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.802+0000 7f7a7a200640 1 -- 172.21.15.31:0/2540123456 shutdown_connections 2024-09-17T05:33:01.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.802+0000 7f7a7a200640 1 -- 172.21.15.31:0/2540123456 wait complete. 2024-09-17T05:33:01.826 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:33:01.827 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:33:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f447e800640 1 -- 172.21.15.31:0/3034019679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f447815dae0 msgr2=0x7f44780acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f447e800640 1 --2- 172.21.15.31:0/3034019679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f447815dae0 0x7f44780acd40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f446800aa10 tx=0x7f446801dba0 comp rx=0 tx=0).stop 2024-09-17T05:33:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f447e800640 1 -- 172.21.15.31:0/3034019679 shutdown_connections 2024-09-17T05:33:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f447e800640 1 --2- 172.21.15.31:0/3034019679 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44780cd100 0x7f44780b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f447e800640 1 --2- 172.21.15.31:0/3034019679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f447815dae0 0x7f44780acd40 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f447e800640 1 -- 172.21.15.31:0/3034019679 >> 172.21.15.31:0/3034019679 conn(0x7f44780b18f0 msgr2=0x7f44780b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f447e800640 1 -- 172.21.15.31:0/3034019679 shutdown_connections 2024-09-17T05:33:01.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f447e800640 1 -- 172.21.15.31:0/3034019679 wait complete. 2024-09-17T05:33:01.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f447e800640 1 Processor -- start 2024-09-17T05:33:01.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f447e800640 1 -- start start 2024-09-17T05:33:01.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f447e800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44780b4810 0x7f44781f90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:01.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f447e800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44780cd100 0x7f44781484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:01.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f447e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f447815dae0 0x7f44781634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:01.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f447e800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f44781674b0 con 0x7f447815dae0 2024-09-17T05:33:01.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f447e800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4478167330 con 0x7f44780cd100 2024-09-17T05:33:01.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f447e800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4478167630 con 0x7f44780b4810 2024-09-17T05:33:01.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f4477e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f447815dae0 0x7f44781634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:01.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f4477e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f447815dae0 0x7f44781634c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41338/0 (socket says 172.21.15.31:41338) 2024-09-17T05:33:01.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f4477e00640 1 -- 172.21.15.31:0/1663326669 learned_addr learned my addr 172.21.15.31:0/1663326669 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:01.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f446fe00640 1 --2- 172.21.15.31:0/1663326669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44780cd100 0x7f44781484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:01.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f4477400640 1 --2- 172.21.15.31:0/1663326669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44780b4810 0x7f44781f90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:01.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f4477e00640 1 -- 172.21.15.31:0/1663326669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44780b4810 msgr2=0x7f44781f90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:01.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f4477e00640 1 --2- 172.21.15.31:0/1663326669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44780b4810 0x7f44781f90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:01.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f4477e00640 1 -- 172.21.15.31:0/1663326669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44780cd100 msgr2=0x7f44781484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:01.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f4477e00640 1 --2- 172.21.15.31:0/1663326669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44780cd100 0x7f44781484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:01.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f4477e00640 1 -- 172.21.15.31:0/1663326669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4478164780 con 0x7f447815dae0 2024-09-17T05:33:01.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f4477400640 1 --2- 172.21.15.31:0/1663326669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44780b4810 0x7f44781f90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:01.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.978+0000 7f4477e00640 1 --2- 172.21.15.31:0/1663326669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f447815dae0 0x7f44781634c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f447000c780 tx=0x7f447000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:01.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.982+0000 7f446f400640 1 -- 172.21.15.31:0/1663326669 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4470004b70 con 0x7f447815dae0 2024-09-17T05:33:01.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.982+0000 7f446f400640 1 -- 172.21.15.31:0/1663326669 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4470004e00 con 0x7f447815dae0 2024-09-17T05:33:01.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.982+0000 7f447e800640 1 -- 172.21.15.31:0/1663326669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44781489f0 con 0x7f447815dae0 2024-09-17T05:33:01.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.982+0000 7f446f400640 1 -- 172.21.15.31:0/1663326669 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447000aa90 con 0x7f447815dae0 2024-09-17T05:33:01.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.982+0000 7f447e800640 1 -- 172.21.15.31:0/1663326669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44781fc9b0 con 0x7f447815dae0 2024-09-17T05:33:01.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.982+0000 7f447e800640 1 -- 172.21.15.31:0/1663326669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44780b42d0 con 0x7f447815dae0 2024-09-17T05:33:01.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.982+0000 7f446f400640 1 -- 172.21.15.31:0/1663326669 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f447000ac30 con 0x7f447815dae0 2024-09-17T05:33:01.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.982+0000 7f446f400640 1 --2- 172.21.15.31:0/1663326669 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4454073320 0x7f44540757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:01.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.982+0000 7f446f400640 1 -- 172.21.15.31:0/1663326669 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f44700947d0 con 0x7f447815dae0 2024-09-17T05:33:01.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.982+0000 7f4477400640 1 --2- 172.21.15.31:0/1663326669 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4454073320 0x7f44540757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:01.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.986+0000 7f4477400640 1 --2- 172.21.15.31:0/1663326669 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4454073320 0x7f44540757e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f44680b0000 tx=0x7f446801c3e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:01.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:01.986+0000 7f446f400640 1 -- 172.21.15.31:0/1663326669 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4470020070 con 0x7f447815dae0 2024-09-17T05:33:02.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.198+0000 7f447e800640 1 -- 172.21.15.31:0/1663326669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44780b21a0 con 0x7f447815dae0 2024-09-17T05:33:02.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.198+0000 7f446f400640 1 -- 172.21.15.31:0/1663326669 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5231 (secure 0 0 0) 0x7f447005f5c0 con 0x7f447815dae0 2024-09-17T05:33:02.202 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:02.202 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":56,"btime":"2024-09-17T05:33:01:791448+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2757206675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2757206675},{"type":"v1","addr":"172.21.15.31:6835","nonce":2757206675}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3287361734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3287361734},{"type":"v1","addr":"172.21.15.155:6809","nonce":3287361734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6295,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2426776304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2426776304},{"type":"v1","addr":"172.21.15.155:6835","nonce":2426776304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:32:58.167014+0000","modified":"2024-09-17T05:33:01.193375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6570},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6570":{"gid":6570,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/1737412276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1737412276},{"type":"v1","addr":"172.21.15.31:6834","nonce":1737412276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6570,"qdb_cluster":[6570]},"id":6}]} 2024-09-17T05:33:02.202 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 56 2024-09-17T05:33:02.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.202+0000 7f447e800640 1 -- 172.21.15.31:0/1663326669 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4454073320 msgr2=0x7f44540757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:02.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.202+0000 7f447e800640 1 --2- 172.21.15.31:0/1663326669 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4454073320 0x7f44540757e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f44680b0000 tx=0x7f446801c3e0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.202+0000 7f447e800640 1 -- 172.21.15.31:0/1663326669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f447815dae0 msgr2=0x7f44781634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:02.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.202+0000 7f447e800640 1 --2- 172.21.15.31:0/1663326669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f447815dae0 0x7f44781634c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f447000c780 tx=0x7f447000cc40 comp rx=0 tx=0).stop 2024-09-17T05:33:02.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.202+0000 7f447e800640 1 -- 172.21.15.31:0/1663326669 shutdown_connections 2024-09-17T05:33:02.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.202+0000 7f447e800640 1 --2- 172.21.15.31:0/1663326669 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4454073320 0x7f44540757e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.202+0000 7f447e800640 1 --2- 172.21.15.31:0/1663326669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f447815dae0 0x7f44781634c0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.202+0000 7f447e800640 1 --2- 172.21.15.31:0/1663326669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44780cd100 0x7f44781484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.202+0000 7f447e800640 1 --2- 172.21.15.31:0/1663326669 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44780b4810 0x7f44781f90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.202+0000 7f447e800640 1 -- 172.21.15.31:0/1663326669 >> 172.21.15.31:0/1663326669 conn(0x7f44780b18f0 msgr2=0x7f44780adef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:02.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.202+0000 7f447e800640 1 -- 172.21.15.31:0/1663326669 shutdown_connections 2024-09-17T05:33:02.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.202+0000 7f447e800640 1 -- 172.21.15.31:0/1663326669 wait complete. 2024-09-17T05:33:02.224 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:33:02.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.366+0000 7f2db5000640 1 -- 172.21.15.31:0/1203724242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2db015bb90 msgr2=0x7f2db015f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:02.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.366+0000 7f2db5000640 1 --2- 172.21.15.31:0/1203724242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2db015bb90 0x7f2db015f960 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f2db00c5640 tx=0x7f2da001c8c0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2db5000640 1 -- 172.21.15.31:0/1203724242 shutdown_connections 2024-09-17T05:33:02.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2db5000640 1 --2- 172.21.15.31:0/1203724242 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2db015bf70 0x7f2db01603e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2db5000640 1 --2- 172.21.15.31:0/1203724242 >> v2:172.21.15.155:3300/0 conn(0x7f2db00d2940 0x7f2db015fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2db5000640 1 --2- 172.21.15.31:0/1203724242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2db015bb90 0x7f2db015f960 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2db5000640 1 -- 172.21.15.31:0/1203724242 >> 172.21.15.31:0/1203724242 conn(0x7f2db00d1d90 msgr2=0x7f2db00d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:02.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2db5000640 1 -- 172.21.15.31:0/1203724242 shutdown_connections 2024-09-17T05:33:02.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2db5000640 1 -- 172.21.15.31:0/1203724242 wait complete. 2024-09-17T05:33:02.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2db5000640 1 Processor -- start 2024-09-17T05:33:02.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2db5000640 1 -- start start 2024-09-17T05:33:02.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2db5000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2db00d2940 0x7f2db00c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:02.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2db5000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2db015bb90 0x7f2db01f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:02.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2db5000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2db015bf70 0x7f2db0157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:02.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2db5000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2db00b5770 con 0x7f2db015bb90 2024-09-17T05:33:02.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2db5000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2db00b55f0 con 0x7f2db00d2940 2024-09-17T05:33:02.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2db5000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2db00b58f0 con 0x7f2db015bf70 2024-09-17T05:33:02.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2da7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2db015bb90 0x7f2db01f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:02.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2dade00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2db00d2940 0x7f2db00c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:02.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2da7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2db015bb90 0x7f2db01f7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41360/0 (socket says 172.21.15.31:41360) 2024-09-17T05:33:02.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2da7e00640 1 -- 172.21.15.31:0/808103074 learned_addr learned my addr 172.21.15.31:0/808103074 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:02.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2dae800640 1 --2- 172.21.15.31:0/808103074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2db015bf70 0x7f2db0157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:02.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2da7e00640 1 -- 172.21.15.31:0/808103074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2db015bf70 msgr2=0x7f2db0157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:02.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2da7e00640 1 --2- 172.21.15.31:0/808103074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2db015bf70 0x7f2db0157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2da7e00640 1 -- 172.21.15.31:0/808103074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2db00d2940 msgr2=0x7f2db00c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:02.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2da7e00640 1 --2- 172.21.15.31:0/808103074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2db00d2940 0x7f2db00c6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2da7e00640 1 -- 172.21.15.31:0/808103074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db0157740 con 0x7f2db015bb90 2024-09-17T05:33:02.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2dade00640 1 --2- 172.21.15.31:0/808103074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2db00d2940 0x7f2db00c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:33:02.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.370+0000 7f2da7e00640 1 --2- 172.21.15.31:0/808103074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2db015bb90 0x7f2db01f7e60 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800d980 tx=0x7f2d9800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:02.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.374+0000 7f2da6000640 1 -- 172.21.15.31:0/808103074 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d98017030 con 0x7f2db015bb90 2024-09-17T05:33:02.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.374+0000 7f2da6000640 1 -- 172.21.15.31:0/808103074 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d98009b20 con 0x7f2db015bb90 2024-09-17T05:33:02.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.374+0000 7f2da6000640 1 -- 172.21.15.31:0/808103074 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d98004020 con 0x7f2db015bb90 2024-09-17T05:33:02.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.374+0000 7f2db5000640 1 -- 172.21.15.31:0/808103074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db00c8470 con 0x7f2db015bb90 2024-09-17T05:33:02.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.374+0000 7f2db5000640 1 -- 172.21.15.31:0/808103074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db00c5990 con 0x7f2db015bb90 2024-09-17T05:33:02.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.374+0000 7f2db5000640 1 -- 172.21.15.31:0/808103074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db00b5e80 con 0x7f2db015bb90 2024-09-17T05:33:02.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.374+0000 7f2da6000640 1 -- 172.21.15.31:0/808103074 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f2d9801a070 con 0x7f2db015bb90 2024-09-17T05:33:02.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.374+0000 7f2da6000640 1 --2- 172.21.15.31:0/808103074 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2d8c073350 0x7f2d8c075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:02.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.374+0000 7f2da6000640 1 -- 172.21.15.31:0/808103074 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f2d980945e0 con 0x7f2db015bb90 2024-09-17T05:33:02.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.374+0000 7f2dade00640 1 --2- 172.21.15.31:0/808103074 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2d8c073350 0x7f2d8c075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:02.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.378+0000 7f2dade00640 1 --2- 172.21.15.31:0/808103074 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2d8c073350 0x7f2d8c075810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2da00af000 tx=0x7f2da001b100 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:02.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.378+0000 7f2da6000640 1 -- 172.21.15.31:0/808103074 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2d9805ee10 con 0x7f2db015bb90 2024-09-17T05:33:02.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.554+0000 7f2db5000640 1 -- 172.21.15.31:0/808103074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2db0070270 con 0x7f2db015bb90 2024-09-17T05:33:02.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.558+0000 7f2da6000640 1 -- 172.21.15.31:0/808103074 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+16744 (secure 0 0 0) 0x7f2d98063840 con 0x7f2db015bb90 2024-09-17T05:33:02.559 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:02.559 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":81,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:32:59.774937+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:32:55.883070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T05:32:57.135509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:33:02.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.558+0000 7f2db5000640 1 -- 172.21.15.31:0/808103074 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2d8c073350 msgr2=0x7f2d8c075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:02.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.558+0000 7f2db5000640 1 --2- 172.21.15.31:0/808103074 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2d8c073350 0x7f2d8c075810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2da00af000 tx=0x7f2da001b100 comp rx=0 tx=0).stop 2024-09-17T05:33:02.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.558+0000 7f2db5000640 1 -- 172.21.15.31:0/808103074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2db015bb90 msgr2=0x7f2db01f7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:02.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.558+0000 7f2db5000640 1 --2- 172.21.15.31:0/808103074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2db015bb90 0x7f2db01f7e60 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800d980 tx=0x7f2d9800de40 comp rx=0 tx=0).stop 2024-09-17T05:33:02.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.558+0000 7f2db5000640 1 -- 172.21.15.31:0/808103074 shutdown_connections 2024-09-17T05:33:02.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.558+0000 7f2db5000640 1 --2- 172.21.15.31:0/808103074 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2d8c073350 0x7f2d8c075810 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.558+0000 7f2db5000640 1 --2- 172.21.15.31:0/808103074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2db015bf70 0x7f2db0157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.558+0000 7f2db5000640 1 --2- 172.21.15.31:0/808103074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2db015bb90 0x7f2db01f7e60 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.558+0000 7f2db5000640 1 --2- 172.21.15.31:0/808103074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2db00d2940 0x7f2db00c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.558+0000 7f2db5000640 1 -- 172.21.15.31:0/808103074 >> 172.21.15.31:0/808103074 conn(0x7f2db00d1d90 msgr2=0x7f2db00709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:02.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.558+0000 7f2db5000640 1 -- 172.21.15.31:0/808103074 shutdown_connections 2024-09-17T05:33:02.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.558+0000 7f2db5000640 1 -- 172.21.15.31:0/808103074 wait complete. 2024-09-17T05:33:02.581 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:33:02.581 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:33:02.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.726+0000 7fc5a5800640 1 -- 172.21.15.31:0/1977093941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a015bea0 msgr2=0x7fc5a00ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:02.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.726+0000 7fc5a5800640 1 --2- 172.21.15.31:0/1977093941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a015bea0 0x7fc5a00ce670 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc590009900 tx=0x7fc59001c8e0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.726+0000 7fc5a5800640 1 -- 172.21.15.31:0/1977093941 shutdown_connections 2024-09-17T05:33:02.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.726+0000 7fc5a5800640 1 --2- 172.21.15.31:0/1977093941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5a00cdb30 0x7fc5a00cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.726+0000 7fc5a5800640 1 --2- 172.21.15.31:0/1977093941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a015bea0 0x7fc5a00ce670 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.726+0000 7fc5a5800640 1 -- 172.21.15.31:0/1977093941 >> 172.21.15.31:0/1977093941 conn(0x7fc5a00d1dc0 msgr2=0x7fc5a00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:02.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.726+0000 7fc5a5800640 1 -- 172.21.15.31:0/1977093941 shutdown_connections 2024-09-17T05:33:02.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.726+0000 7fc5a5800640 1 -- 172.21.15.31:0/1977093941 wait complete. 2024-09-17T05:33:02.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.726+0000 7fc5a5800640 1 Processor -- start 2024-09-17T05:33:02.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.726+0000 7fc5a5800640 1 -- start start 2024-09-17T05:33:02.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc5a5800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5a00cdb30 0x7fc5a00c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:02.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc5a5800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5a00d28e0 0x7fc5a0158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:02.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc5a5800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a015bea0 0x7fc5a009e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:02.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc5a5800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a0168f60 con 0x7fc5a015bea0 2024-09-17T05:33:02.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc5a5800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a0168de0 con 0x7fc5a00cdb30 2024-09-17T05:33:02.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc5a5800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a01690e0 con 0x7fc5a00d28e0 2024-09-17T05:33:02.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc59f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a015bea0 0x7fc5a009e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:02.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc59f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a015bea0 0x7fc5a009e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41376/0 (socket says 172.21.15.31:41376) 2024-09-17T05:33:02.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc59f400640 1 -- 172.21.15.31:0/1692093364 learned_addr learned my addr 172.21.15.31:0/1692093364 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:02.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc59e000640 1 --2- 172.21.15.31:0/1692093364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5a00d28e0 0x7fc5a0158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:02.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc59ea00640 1 --2- 172.21.15.31:0/1692093364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5a00cdb30 0x7fc5a00c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:02.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc59f400640 1 -- 172.21.15.31:0/1692093364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5a00d28e0 msgr2=0x7fc5a0158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:02.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc59f400640 1 --2- 172.21.15.31:0/1692093364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5a00d28e0 0x7fc5a0158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc59f400640 1 -- 172.21.15.31:0/1692093364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5a00cdb30 msgr2=0x7fc5a00c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:02.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc59f400640 1 --2- 172.21.15.31:0/1692093364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5a00cdb30 0x7fc5a00c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc59f400640 1 -- 172.21.15.31:0/1692093364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a0158d40 con 0x7fc5a015bea0 2024-09-17T05:33:02.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc59f400640 1 --2- 172.21.15.31:0/1692093364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a015bea0 0x7fc5a009e490 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc59800c7a0 tx=0x7fc59800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:02.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc596a00640 1 -- 172.21.15.31:0/1692093364 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598017070 con 0x7fc5a015bea0 2024-09-17T05:33:02.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc596a00640 1 -- 172.21.15.31:0/1692093364 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc598005070 con 0x7fc5a015bea0 2024-09-17T05:33:02.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc596a00640 1 -- 172.21.15.31:0/1692093364 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5980054c0 con 0x7fc5a015bea0 2024-09-17T05:33:02.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc5a5800640 1 -- 172.21.15.31:0/1692093364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a009ed90 con 0x7fc5a015bea0 2024-09-17T05:33:02.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc5a5800640 1 -- 172.21.15.31:0/1692093364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5a00b2a20 con 0x7fc5a015bea0 2024-09-17T05:33:02.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc5a5800640 1 -- 172.21.15.31:0/1692093364 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5a00cc9d0 con 0x7fc5a015bea0 2024-09-17T05:33:02.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.730+0000 7fc596a00640 1 -- 172.21.15.31:0/1692093364 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fc59801a070 con 0x7fc5a015bea0 2024-09-17T05:33:02.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.734+0000 7fc596a00640 1 --2- 172.21.15.31:0/1692093364 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc580073320 0x7fc5800757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:02.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.734+0000 7fc596a00640 1 -- 172.21.15.31:0/1692093364 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fc598093ac0 con 0x7fc5a015bea0 2024-09-17T05:33:02.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.734+0000 7fc59ea00640 1 --2- 172.21.15.31:0/1692093364 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc580073320 0x7fc5800757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:02.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.734+0000 7fc59ea00640 1 --2- 172.21.15.31:0/1692093364 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc580073320 0x7fc5800757e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc5900af000 tx=0x7fc59001b120 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:02.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.738+0000 7fc596a00640 1 -- 172.21.15.31:0/1692093364 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc59805e940 con 0x7fc5a015bea0 2024-09-17T05:33:02.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.910+0000 7fc5a5800640 1 -- 172.21.15.31:0/1692093364 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc5a00aff10 con 0x7fc580073320 2024-09-17T05:33:02.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.914+0000 7fc596a00640 1 -- 172.21.15.31:0/1692093364 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246778 (secure 0 0 0) 0x7fc5a00aff10 con 0x7fc580073320 2024-09-17T05:33:02.919 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:02.920 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:33:02.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.918+0000 7fc5a5800640 1 -- 172.21.15.31:0/1692093364 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc580073320 msgr2=0x7fc5800757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:02.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.918+0000 7fc5a5800640 1 --2- 172.21.15.31:0/1692093364 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc580073320 0x7fc5800757e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc5900af000 tx=0x7fc59001b120 comp rx=0 tx=0).stop 2024-09-17T05:33:02.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.918+0000 7fc5a5800640 1 -- 172.21.15.31:0/1692093364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a015bea0 msgr2=0x7fc5a009e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:02.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.918+0000 7fc5a5800640 1 --2- 172.21.15.31:0/1692093364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a015bea0 0x7fc5a009e490 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc59800c7a0 tx=0x7fc59800cc60 comp rx=0 tx=0).stop 2024-09-17T05:33:02.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.918+0000 7fc5a5800640 1 -- 172.21.15.31:0/1692093364 shutdown_connections 2024-09-17T05:33:02.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.918+0000 7fc5a5800640 1 --2- 172.21.15.31:0/1692093364 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc580073320 0x7fc5800757e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.918+0000 7fc5a5800640 1 --2- 172.21.15.31:0/1692093364 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5a015bea0 0x7fc5a009e490 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.918+0000 7fc5a5800640 1 --2- 172.21.15.31:0/1692093364 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5a00d28e0 0x7fc5a0158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.918+0000 7fc5a5800640 1 --2- 172.21.15.31:0/1692093364 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5a00cdb30 0x7fc5a00c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:02.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.918+0000 7fc5a5800640 1 -- 172.21.15.31:0/1692093364 >> 172.21.15.31:0/1692093364 conn(0x7fc5a00d1dc0 msgr2=0x7fc5a00ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:02.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.918+0000 7fc5a5800640 1 -- 172.21.15.31:0/1692093364 shutdown_connections 2024-09-17T05:33:02.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:02.918+0000 7fc5a5800640 1 -- 172.21.15.31:0/1692093364 wait complete. 2024-09-17T05:33:02.939 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T05:33:02.703040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258200,"kb_used_data":8680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716520,"statfs":{"total":773094113280,"available":772829716480,"internally_reserved":0,"allocated":8888320,"data_stored":4441424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.960464"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755959+0000","last_change":"2024-09-17T05:32:57.755959+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755959+0000","last_undegraded":"2024-09-17T05:32:57.755959+0000","last_fullsized":"2024-09-17T05:32:57.755959+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.764081+0000","last_change":"2024-09-17T05:32:57.764081+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.764081+0000","last_undegraded":"2024-09-17T05:32:57.764081+0000","last_fullsized":"2024-09-17T05:32:57.764081+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762055+0000","last_change":"2024-09-17T05:32:57.762055+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762055+0000","last_undegraded":"2024-09-17T05:32:57.762055+0000","last_fullsized":"2024-09-17T05:32:57.762055+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754455+0000","last_change":"2024-09-17T05:32:57.754455+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754455+0000","last_undegraded":"2024-09-17T05:32:57.754455+0000","last_fullsized":"2024-09-17T05:32:57.754455+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761721+0000","last_change":"2024-09-17T05:32:57.761721+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761721+0000","last_undegraded":"2024-09-17T05:32:57.761721+0000","last_fullsized":"2024-09-17T05:32:57.761721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.758601+0000","last_change":"2024-09-17T05:32:57.758601+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.758601+0000","last_undegraded":"2024-09-17T05:32:57.758601+0000","last_fullsized":"2024-09-17T05:32:57.758601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753567+0000","last_change":"2024-09-17T05:32:57.753567+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753567+0000","last_undegraded":"2024-09-17T05:32:57.753567+0000","last_fullsized":"2024-09-17T05:32:57.753567+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757889+0000","last_change":"2024-09-17T05:32:57.757889+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757889+0000","last_undegraded":"2024-09-17T05:32:57.757889+0000","last_fullsized":"2024-09-17T05:32:57.757889+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.758125+0000","last_change":"2024-09-17T05:32:57.758125+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.758125+0000","last_undegraded":"2024-09-17T05:32:57.758125+0000","last_fullsized":"2024-09-17T05:32:57.758125+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754177+0000","last_change":"2024-09-17T05:32:57.754177+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754177+0000","last_undegraded":"2024-09-17T05:32:57.754177+0000","last_fullsized":"2024-09-17T05:32:57.754177+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762797+0000","last_change":"2024-09-17T05:32:57.762797+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762797+0000","last_undegraded":"2024-09-17T05:32:57.762797+0000","last_fullsized":"2024-09-17T05:32:57.762797+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.756963+0000","last_change":"2024-09-17T05:32:57.756963+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.756963+0000","last_undegraded":"2024-09-17T05:32:57.756963+0000","last_fullsized":"2024-09-17T05:32:57.756963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762382+0000","last_change":"2024-09-17T05:32:57.762382+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762382+0000","last_undegraded":"2024-09-17T05:32:57.762382+0000","last_fullsized":"2024-09-17T05:32:57.762382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753519+0000","last_change":"2024-09-17T05:32:57.753519+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753519+0000","last_undegraded":"2024-09-17T05:32:57.753519+0000","last_fullsized":"2024-09-17T05:32:57.753519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757928+0000","last_change":"2024-09-17T05:32:57.757928+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757928+0000","last_undegraded":"2024-09-17T05:32:57.757928+0000","last_fullsized":"2024-09-17T05:32:57.757928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763037+0000","last_change":"2024-09-17T05:32:57.763037+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763037+0000","last_undegraded":"2024-09-17T05:32:57.763037+0000","last_fullsized":"2024-09-17T05:32:57.763037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.759822+0000","last_change":"2024-09-17T05:32:57.759822+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.759822+0000","last_undegraded":"2024-09-17T05:32:57.759822+0000","last_fullsized":"2024-09-17T05:32:57.759822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753309+0000","last_change":"2024-09-17T05:32:57.753309+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753309+0000","last_undegraded":"2024-09-17T05:32:57.753309+0000","last_fullsized":"2024-09-17T05:32:57.753309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754516+0000","last_change":"2024-09-17T05:32:57.754516+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754516+0000","last_undegraded":"2024-09-17T05:32:57.754516+0000","last_fullsized":"2024-09-17T05:32:57.754516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753049+0000","last_change":"2024-09-17T05:32:57.753049+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753049+0000","last_undegraded":"2024-09-17T05:32:57.753049+0000","last_fullsized":"2024-09-17T05:32:57.753049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.752625+0000","last_change":"2024-09-17T05:32:57.752625+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.752625+0000","last_undegraded":"2024-09-17T05:32:57.752625+0000","last_fullsized":"2024-09-17T05:32:57.752625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.767347+0000","last_change":"2024-09-17T05:32:57.767347+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.767347+0000","last_undegraded":"2024-09-17T05:32:57.767347+0000","last_fullsized":"2024-09-17T05:32:57.767347+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.756506+0000","last_change":"2024-09-17T05:32:57.756506+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.756506+0000","last_undegraded":"2024-09-17T05:32:57.756506+0000","last_fullsized":"2024-09-17T05:32:57.756506+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753352+0000","last_change":"2024-09-17T05:32:57.753352+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753352+0000","last_undegraded":"2024-09-17T05:32:57.753352+0000","last_fullsized":"2024-09-17T05:32:57.753352+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763700+0000","last_change":"2024-09-17T05:32:57.763700+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763700+0000","last_undegraded":"2024-09-17T05:32:57.763700+0000","last_fullsized":"2024-09-17T05:32:57.763700+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760679+0000","last_change":"2024-09-17T05:32:57.760679+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760679+0000","last_undegraded":"2024-09-17T05:32:57.760679+0000","last_fullsized":"2024-09-17T05:32:57.760679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761813+0000","last_change":"2024-09-17T05:32:57.761813+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761813+0000","last_undegraded":"2024-09-17T05:32:57.761813+0000","last_fullsized":"2024-09-17T05:32:57.761813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755954+0000","last_change":"2024-09-17T05:32:57.755954+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755954+0000","last_undegraded":"2024-09-17T05:32:57.755954+0000","last_fullsized":"2024-09-17T05:32:57.755954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763285+0000","last_change":"2024-09-17T05:32:57.763285+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763285+0000","last_undegraded":"2024-09-17T05:32:57.763285+0000","last_fullsized":"2024-09-17T05:32:57.763285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.766238+0000","last_change":"2024-09-17T05:32:57.766238+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.766238+0000","last_undegraded":"2024-09-17T05:32:57.766238+0000","last_fullsized":"2024-09-17T05:32:57.766238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763288+0000","last_change":"2024-09-17T05:32:57.763288+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763288+0000","last_undegraded":"2024-09-17T05:32:57.763288+0000","last_fullsized":"2024-09-17T05:32:57.763288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754918+0000","last_change":"2024-09-17T05:32:57.754918+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754918+0000","last_undegraded":"2024-09-17T05:32:57.754918+0000","last_fullsized":"2024-09-17T05:32:57.754918+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763926+0000","last_change":"2024-09-17T05:32:57.763926+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763926+0000","last_undegraded":"2024-09-17T05:32:57.763926+0000","last_fullsized":"2024-09-17T05:32:57.763926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.766615+0000","last_change":"2024-09-17T05:32:57.760900+0000","last_active":"2024-09-17T05:32:57.766615+0000","last_peered":"2024-09-17T05:32:57.766615+0000","last_clean":"2024-09-17T05:32:57.766615+0000","last_became_active":"2024-09-17T05:32:57.760587+0000","last_became_peered":"2024-09-17T05:32:57.760587+0000","last_unstale":"2024-09-17T05:32:57.766615+0000","last_undegraded":"2024-09-17T05:32:57.766615+0000","last_fullsized":"2024-09-17T05:32:57.766615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:06.976886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755426+0000","last_change":"2024-09-17T05:32:57.755426+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755426+0000","last_undegraded":"2024-09-17T05:32:57.755426+0000","last_fullsized":"2024-09-17T05:32:57.755426+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.781622+0000","last_change":"2024-09-17T05:32:57.778135+0000","last_active":"2024-09-17T05:32:57.781622+0000","last_peered":"2024-09-17T05:32:57.781622+0000","last_clean":"2024-09-17T05:32:57.781622+0000","last_became_active":"2024-09-17T05:32:57.777834+0000","last_became_peered":"2024-09-17T05:32:57.777834+0000","last_unstale":"2024-09-17T05:32:57.781622+0000","last_undegraded":"2024-09-17T05:32:57.781622+0000","last_fullsized":"2024-09-17T05:32:57.781622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:58.249252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754943+0000","last_change":"2024-09-17T05:32:57.754943+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754943+0000","last_undegraded":"2024-09-17T05:32:57.754943+0000","last_fullsized":"2024-09-17T05:32:57.754943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.766132+0000","last_change":"2024-09-17T05:32:57.761438+0000","last_active":"2024-09-17T05:32:57.766132+0000","last_peered":"2024-09-17T05:32:57.766132+0000","last_clean":"2024-09-17T05:32:57.766132+0000","last_became_active":"2024-09-17T05:32:57.761180+0000","last_became_peered":"2024-09-17T05:32:57.761180+0000","last_unstale":"2024-09-17T05:32:57.766132+0000","last_undegraded":"2024-09-17T05:32:57.766132+0000","last_fullsized":"2024-09-17T05:32:57.766132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:38.946220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760016+0000","last_change":"2024-09-17T05:32:57.760016+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760016+0000","last_undegraded":"2024-09-17T05:32:57.760016+0000","last_fullsized":"2024-09-17T05:32:57.760016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.766461+0000","last_change":"2024-09-17T05:32:57.762038+0000","last_active":"2024-09-17T05:32:57.766461+0000","last_peered":"2024-09-17T05:32:57.766461+0000","last_clean":"2024-09-17T05:32:57.766461+0000","last_became_active":"2024-09-17T05:32:57.761027+0000","last_became_peered":"2024-09-17T05:32:57.761027+0000","last_unstale":"2024-09-17T05:32:57.766461+0000","last_undegraded":"2024-09-17T05:32:57.766461+0000","last_fullsized":"2024-09-17T05:32:57.766461+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:19.005013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.764452+0000","last_change":"2024-09-17T05:32:57.764452+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.764452+0000","last_undegraded":"2024-09-17T05:32:57.764452+0000","last_fullsized":"2024-09-17T05:32:57.764452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779784+0000","last_change":"2024-09-17T05:32:57.777503+0000","last_active":"2024-09-17T05:32:57.779784+0000","last_peered":"2024-09-17T05:32:57.779784+0000","last_clean":"2024-09-17T05:32:57.779784+0000","last_became_active":"2024-09-17T05:32:57.777284+0000","last_became_peered":"2024-09-17T05:32:57.777284+0000","last_unstale":"2024-09-17T05:32:57.779784+0000","last_undegraded":"2024-09-17T05:32:57.779784+0000","last_fullsized":"2024-09-17T05:32:57.779784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:13.999564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761289+0000","last_change":"2024-09-17T05:32:57.761289+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761289+0000","last_undegraded":"2024-09-17T05:32:57.761289+0000","last_fullsized":"2024-09-17T05:32:57.761289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.781701+0000","last_change":"2024-09-17T05:32:57.778177+0000","last_active":"2024-09-17T05:32:57.781701+0000","last_peered":"2024-09-17T05:32:57.781701+0000","last_clean":"2024-09-17T05:32:57.781701+0000","last_became_active":"2024-09-17T05:32:57.777881+0000","last_became_peered":"2024-09-17T05:32:57.777881+0000","last_unstale":"2024-09-17T05:32:57.781701+0000","last_undegraded":"2024-09-17T05:32:57.781701+0000","last_fullsized":"2024-09-17T05:32:57.781701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:54.749806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761539+0000","last_change":"2024-09-17T05:32:57.761539+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761539+0000","last_undegraded":"2024-09-17T05:32:57.761539+0000","last_fullsized":"2024-09-17T05:32:57.761539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.771268+0000","last_change":"2024-09-17T05:32:57.765590+0000","last_active":"2024-09-17T05:32:57.771268+0000","last_peered":"2024-09-17T05:32:57.771268+0000","last_clean":"2024-09-17T05:32:57.771268+0000","last_became_active":"2024-09-17T05:32:57.765285+0000","last_became_peered":"2024-09-17T05:32:57.765285+0000","last_unstale":"2024-09-17T05:32:57.771268+0000","last_undegraded":"2024-09-17T05:32:57.771268+0000","last_fullsized":"2024-09-17T05:32:57.771268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.940055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757453+0000","last_change":"2024-09-17T05:32:57.757453+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757453+0000","last_undegraded":"2024-09-17T05:32:57.757453+0000","last_fullsized":"2024-09-17T05:32:57.757453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779745+0000","last_change":"2024-09-17T05:32:57.771325+0000","last_active":"2024-09-17T05:32:57.779745+0000","last_peered":"2024-09-17T05:32:57.779745+0000","last_clean":"2024-09-17T05:32:57.779745+0000","last_became_active":"2024-09-17T05:32:57.771046+0000","last_became_peered":"2024-09-17T05:32:57.771046+0000","last_unstale":"2024-09-17T05:32:57.779745+0000","last_undegraded":"2024-09-17T05:32:57.779745+0000","last_fullsized":"2024-09-17T05:32:57.779745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:01.736307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.758937+0000","last_change":"2024-09-17T05:32:57.758937+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.758937+0000","last_undegraded":"2024-09-17T05:32:57.758937+0000","last_fullsized":"2024-09-17T05:32:57.758937+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779585+0000","last_change":"2024-09-17T05:32:57.775051+0000","last_active":"2024-09-17T05:32:57.779585+0000","last_peered":"2024-09-17T05:32:57.779585+0000","last_clean":"2024-09-17T05:32:57.779585+0000","last_became_active":"2024-09-17T05:32:57.774665+0000","last_became_peered":"2024-09-17T05:32:57.774665+0000","last_unstale":"2024-09-17T05:32:57.779585+0000","last_undegraded":"2024-09-17T05:32:57.779585+0000","last_fullsized":"2024-09-17T05:32:57.779585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:53.510499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757590+0000","last_change":"2024-09-17T05:32:57.757590+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757590+0000","last_undegraded":"2024-09-17T05:32:57.757590+0000","last_fullsized":"2024-09-17T05:32:57.757590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.777934+0000","last_change":"2024-09-17T05:32:57.771838+0000","last_active":"2024-09-17T05:32:57.777934+0000","last_peered":"2024-09-17T05:32:57.777934+0000","last_clean":"2024-09-17T05:32:57.777934+0000","last_became_active":"2024-09-17T05:32:57.771585+0000","last_became_peered":"2024-09-17T05:32:57.771585+0000","last_unstale":"2024-09-17T05:32:57.777934+0000","last_undegraded":"2024-09-17T05:32:57.777934+0000","last_fullsized":"2024-09-17T05:32:57.777934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:21.653529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755598+0000","last_change":"2024-09-17T05:32:57.755598+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755598+0000","last_undegraded":"2024-09-17T05:32:57.755598+0000","last_fullsized":"2024-09-17T05:32:57.755598+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779493+0000","last_change":"2024-09-17T05:32:57.774796+0000","last_active":"2024-09-17T05:32:57.779493+0000","last_peered":"2024-09-17T05:32:57.779493+0000","last_clean":"2024-09-17T05:32:57.779493+0000","last_became_active":"2024-09-17T05:32:57.774446+0000","last_became_peered":"2024-09-17T05:32:57.774446+0000","last_unstale":"2024-09-17T05:32:57.779493+0000","last_undegraded":"2024-09-17T05:32:57.779493+0000","last_fullsized":"2024-09-17T05:32:57.779493+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:29.699013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761416+0000","last_change":"2024-09-17T05:32:57.761416+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761416+0000","last_undegraded":"2024-09-17T05:32:57.761416+0000","last_fullsized":"2024-09-17T05:32:57.761416+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.778451+0000","last_change":"2024-09-17T05:32:57.772140+0000","last_active":"2024-09-17T05:32:57.778451+0000","last_peered":"2024-09-17T05:32:57.778451+0000","last_clean":"2024-09-17T05:32:57.778451+0000","last_became_active":"2024-09-17T05:32:57.771854+0000","last_became_peered":"2024-09-17T05:32:57.771854+0000","last_unstale":"2024-09-17T05:32:57.778451+0000","last_undegraded":"2024-09-17T05:32:57.778451+0000","last_fullsized":"2024-09-17T05:32:57.778451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:28.491950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757067+0000","last_change":"2024-09-17T05:32:57.757067+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757067+0000","last_undegraded":"2024-09-17T05:32:57.757067+0000","last_fullsized":"2024-09-17T05:32:57.757067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.780784+0000","last_change":"2024-09-17T05:32:57.776757+0000","last_active":"2024-09-17T05:32:57.780784+0000","last_peered":"2024-09-17T05:32:57.780784+0000","last_clean":"2024-09-17T05:32:57.780784+0000","last_became_active":"2024-09-17T05:32:57.776494+0000","last_became_peered":"2024-09-17T05:32:57.776494+0000","last_unstale":"2024-09-17T05:32:57.780784+0000","last_undegraded":"2024-09-17T05:32:57.780784+0000","last_fullsized":"2024-09-17T05:32:57.780784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:19.493595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761967+0000","last_change":"2024-09-17T05:32:57.761967+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761967+0000","last_undegraded":"2024-09-17T05:32:57.761967+0000","last_fullsized":"2024-09-17T05:32:57.761967+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779356+0000","last_change":"2024-09-17T05:32:57.778389+0000","last_active":"2024-09-17T05:32:57.779356+0000","last_peered":"2024-09-17T05:32:57.779356+0000","last_clean":"2024-09-17T05:32:57.779356+0000","last_became_active":"2024-09-17T05:32:57.778131+0000","last_became_peered":"2024-09-17T05:32:57.778131+0000","last_unstale":"2024-09-17T05:32:57.779356+0000","last_undegraded":"2024-09-17T05:32:57.779356+0000","last_fullsized":"2024-09-17T05:32:57.779356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:36.171166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762526+0000","last_change":"2024-09-17T05:32:57.762526+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762526+0000","last_undegraded":"2024-09-17T05:32:57.762526+0000","last_fullsized":"2024-09-17T05:32:57.762526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.778648+0000","last_change":"2024-09-17T05:32:57.773894+0000","last_active":"2024-09-17T05:32:57.778648+0000","last_peered":"2024-09-17T05:32:57.778648+0000","last_clean":"2024-09-17T05:32:57.778648+0000","last_became_active":"2024-09-17T05:32:57.772427+0000","last_became_peered":"2024-09-17T05:32:57.772427+0000","last_unstale":"2024-09-17T05:32:57.778648+0000","last_undegraded":"2024-09-17T05:32:57.778648+0000","last_fullsized":"2024-09-17T05:32:57.778648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:04.368779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762540+0000","last_change":"2024-09-17T05:32:57.762540+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762540+0000","last_undegraded":"2024-09-17T05:32:57.762540+0000","last_fullsized":"2024-09-17T05:32:57.762540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.775369+0000","last_change":"2024-09-17T05:32:57.772094+0000","last_active":"2024-09-17T05:32:57.775369+0000","last_peered":"2024-09-17T05:32:57.775369+0000","last_clean":"2024-09-17T05:32:57.775369+0000","last_became_active":"2024-09-17T05:32:57.771783+0000","last_became_peered":"2024-09-17T05:32:57.771783+0000","last_unstale":"2024-09-17T05:32:57.775369+0000","last_undegraded":"2024-09-17T05:32:57.775369+0000","last_fullsized":"2024-09-17T05:32:57.775369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:59.096504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760159+0000","last_change":"2024-09-17T05:32:57.760159+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760159+0000","last_undegraded":"2024-09-17T05:32:57.760159+0000","last_fullsized":"2024-09-17T05:32:57.760159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.773750+0000","last_change":"2024-09-17T05:32:57.768304+0000","last_active":"2024-09-17T05:32:57.773750+0000","last_peered":"2024-09-17T05:32:57.773750+0000","last_clean":"2024-09-17T05:32:57.773750+0000","last_became_active":"2024-09-17T05:32:57.767994+0000","last_became_peered":"2024-09-17T05:32:57.767994+0000","last_unstale":"2024-09-17T05:32:57.773750+0000","last_undegraded":"2024-09-17T05:32:57.773750+0000","last_fullsized":"2024-09-17T05:32:57.773750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:02.910711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754847+0000","last_change":"2024-09-17T05:32:57.754847+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754847+0000","last_undegraded":"2024-09-17T05:32:57.754847+0000","last_fullsized":"2024-09-17T05:32:57.754847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.775322+0000","last_change":"2024-09-17T05:32:57.771902+0000","last_active":"2024-09-17T05:32:57.775322+0000","last_peered":"2024-09-17T05:32:57.775322+0000","last_clean":"2024-09-17T05:32:57.775322+0000","last_became_active":"2024-09-17T05:32:57.770752+0000","last_became_peered":"2024-09-17T05:32:57.770752+0000","last_unstale":"2024-09-17T05:32:57.775322+0000","last_undegraded":"2024-09-17T05:32:57.775322+0000","last_fullsized":"2024-09-17T05:32:57.775322+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:25.208627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760971+0000","last_change":"2024-09-17T05:32:57.760971+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760971+0000","last_undegraded":"2024-09-17T05:32:57.760971+0000","last_fullsized":"2024-09-17T05:32:57.760971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.769125+0000","last_change":"2024-09-17T05:32:57.766899+0000","last_active":"2024-09-17T05:32:57.769125+0000","last_peered":"2024-09-17T05:32:57.769125+0000","last_clean":"2024-09-17T05:32:57.769125+0000","last_became_active":"2024-09-17T05:32:57.766580+0000","last_became_peered":"2024-09-17T05:32:57.766580+0000","last_unstale":"2024-09-17T05:32:57.769125+0000","last_undegraded":"2024-09-17T05:32:57.769125+0000","last_fullsized":"2024-09-17T05:32:57.769125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:28.491950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753009+0000","last_change":"2024-09-17T05:32:57.753009+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753009+0000","last_undegraded":"2024-09-17T05:32:57.753009+0000","last_fullsized":"2024-09-17T05:32:57.753009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.777774+0000","last_change":"2024-09-17T05:32:57.773771+0000","last_active":"2024-09-17T05:32:57.777774+0000","last_peered":"2024-09-17T05:32:57.777774+0000","last_clean":"2024-09-17T05:32:57.777774+0000","last_became_active":"2024-09-17T05:32:57.773415+0000","last_became_peered":"2024-09-17T05:32:57.773415+0000","last_unstale":"2024-09-17T05:32:57.777774+0000","last_undegraded":"2024-09-17T05:32:57.777774+0000","last_fullsized":"2024-09-17T05:32:57.777774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:57.411171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.759045+0000","last_change":"2024-09-17T05:32:57.759045+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.759045+0000","last_undegraded":"2024-09-17T05:32:57.759045+0000","last_fullsized":"2024-09-17T05:32:57.759045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.763776+0000","last_change":"2024-09-17T05:32:57.761461+0000","last_active":"2024-09-17T05:32:57.763776+0000","last_peered":"2024-09-17T05:32:57.763776+0000","last_clean":"2024-09-17T05:32:57.763776+0000","last_became_active":"2024-09-17T05:32:57.760904+0000","last_became_peered":"2024-09-17T05:32:57.760904+0000","last_unstale":"2024-09-17T05:32:57.763776+0000","last_undegraded":"2024-09-17T05:32:57.763776+0000","last_fullsized":"2024-09-17T05:32:57.763776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:52.806367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.752757+0000","last_change":"2024-09-17T05:32:57.752757+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.752757+0000","last_undegraded":"2024-09-17T05:32:57.752757+0000","last_fullsized":"2024-09-17T05:32:57.752757+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.772460+0000","last_change":"2024-09-17T05:32:57.763654+0000","last_active":"2024-09-17T05:32:57.772460+0000","last_peered":"2024-09-17T05:32:57.772460+0000","last_clean":"2024-09-17T05:32:57.772460+0000","last_became_active":"2024-09-17T05:32:57.763354+0000","last_became_peered":"2024-09-17T05:32:57.763354+0000","last_unstale":"2024-09-17T05:32:57.772460+0000","last_undegraded":"2024-09-17T05:32:57.772460+0000","last_fullsized":"2024-09-17T05:32:57.772460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:14.190039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757396+0000","last_change":"2024-09-17T05:32:57.757396+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757396+0000","last_undegraded":"2024-09-17T05:32:57.757396+0000","last_fullsized":"2024-09-17T05:32:57.757396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.777802+0000","last_change":"2024-09-17T05:32:57.773774+0000","last_active":"2024-09-17T05:32:57.777802+0000","last_peered":"2024-09-17T05:32:57.777802+0000","last_clean":"2024-09-17T05:32:57.777802+0000","last_became_active":"2024-09-17T05:32:57.773506+0000","last_became_peered":"2024-09-17T05:32:57.773506+0000","last_unstale":"2024-09-17T05:32:57.777802+0000","last_undegraded":"2024-09-17T05:32:57.777802+0000","last_fullsized":"2024-09-17T05:32:57.777802+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:12.669688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763511+0000","last_change":"2024-09-17T05:32:57.763511+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763511+0000","last_undegraded":"2024-09-17T05:32:57.763511+0000","last_fullsized":"2024-09-17T05:32:57.763511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.780826+0000","last_change":"2024-09-17T05:32:57.777118+0000","last_active":"2024-09-17T05:32:57.780826+0000","last_peered":"2024-09-17T05:32:57.780826+0000","last_clean":"2024-09-17T05:32:57.780826+0000","last_became_active":"2024-09-17T05:32:57.776868+0000","last_became_peered":"2024-09-17T05:32:57.776868+0000","last_unstale":"2024-09-17T05:32:57.780826+0000","last_undegraded":"2024-09-17T05:32:57.780826+0000","last_fullsized":"2024-09-17T05:32:57.780826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:08.376907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760675+0000","last_change":"2024-09-17T05:32:57.760675+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760675+0000","last_undegraded":"2024-09-17T05:32:57.760675+0000","last_fullsized":"2024-09-17T05:32:57.760675+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.780764+0000","last_change":"2024-09-17T05:32:57.776327+0000","last_active":"2024-09-17T05:32:57.780764+0000","last_peered":"2024-09-17T05:32:57.780764+0000","last_clean":"2024-09-17T05:32:57.780764+0000","last_became_active":"2024-09-17T05:32:57.776010+0000","last_became_peered":"2024-09-17T05:32:57.776010+0000","last_unstale":"2024-09-17T05:32:57.780764+0000","last_undegraded":"2024-09-17T05:32:57.780764+0000","last_fullsized":"2024-09-17T05:32:57.780764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:15.914318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754058+0000","last_change":"2024-09-17T05:32:57.754058+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754058+0000","last_undegraded":"2024-09-17T05:32:57.754058+0000","last_fullsized":"2024-09-17T05:32:57.754058+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.774319+0000","last_change":"2024-09-17T05:32:57.768914+0000","last_active":"2024-09-17T05:32:57.774319+0000","last_peered":"2024-09-17T05:32:57.774319+0000","last_clean":"2024-09-17T05:32:57.774319+0000","last_became_active":"2024-09-17T05:32:57.768542+0000","last_became_peered":"2024-09-17T05:32:57.768542+0000","last_unstale":"2024-09-17T05:32:57.774319+0000","last_undegraded":"2024-09-17T05:32:57.774319+0000","last_fullsized":"2024-09-17T05:32:57.774319+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:09.689707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760460+0000","last_change":"2024-09-17T05:32:57.760460+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760460+0000","last_undegraded":"2024-09-17T05:32:57.760460+0000","last_fullsized":"2024-09-17T05:32:57.760460+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.778204+0000","last_change":"2024-09-17T05:32:57.771755+0000","last_active":"2024-09-17T05:32:57.778204+0000","last_peered":"2024-09-17T05:32:57.778204+0000","last_clean":"2024-09-17T05:32:57.778204+0000","last_became_active":"2024-09-17T05:32:57.771463+0000","last_became_peered":"2024-09-17T05:32:57.771463+0000","last_unstale":"2024-09-17T05:32:57.778204+0000","last_undegraded":"2024-09-17T05:32:57.778204+0000","last_fullsized":"2024-09-17T05:32:57.778204+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:08.734245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.758158+0000","last_change":"2024-09-17T05:32:57.758158+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.758158+0000","last_undegraded":"2024-09-17T05:32:57.758158+0000","last_fullsized":"2024-09-17T05:32:57.758158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.773094+0000","last_change":"2024-09-17T05:32:57.768309+0000","last_active":"2024-09-17T05:32:57.773094+0000","last_peered":"2024-09-17T05:32:57.773094+0000","last_clean":"2024-09-17T05:32:57.773094+0000","last_became_active":"2024-09-17T05:32:57.767986+0000","last_became_peered":"2024-09-17T05:32:57.767986+0000","last_unstale":"2024-09-17T05:32:57.773094+0000","last_undegraded":"2024-09-17T05:32:57.773094+0000","last_fullsized":"2024-09-17T05:32:57.773094+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:04.368779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.756482+0000","last_change":"2024-09-17T05:32:57.756482+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.756482+0000","last_undegraded":"2024-09-17T05:32:57.756482+0000","last_fullsized":"2024-09-17T05:32:57.756482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.781719+0000","last_change":"2024-09-17T05:32:57.778896+0000","last_active":"2024-09-17T05:32:57.781719+0000","last_peered":"2024-09-17T05:32:57.781719+0000","last_clean":"2024-09-17T05:32:57.781719+0000","last_became_active":"2024-09-17T05:32:57.778580+0000","last_became_peered":"2024-09-17T05:32:57.778580+0000","last_unstale":"2024-09-17T05:32:57.781719+0000","last_undegraded":"2024-09-17T05:32:57.781719+0000","last_fullsized":"2024-09-17T05:32:57.781719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:07.087245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761077+0000","last_change":"2024-09-17T05:32:57.761077+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761077+0000","last_undegraded":"2024-09-17T05:32:57.761077+0000","last_fullsized":"2024-09-17T05:32:57.761077+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.778924+0000","last_change":"2024-09-17T05:32:57.772499+0000","last_active":"2024-09-17T05:32:57.778924+0000","last_peered":"2024-09-17T05:32:57.778924+0000","last_clean":"2024-09-17T05:32:57.778924+0000","last_became_active":"2024-09-17T05:32:57.771365+0000","last_became_peered":"2024-09-17T05:32:57.771365+0000","last_unstale":"2024-09-17T05:32:57.778924+0000","last_undegraded":"2024-09-17T05:32:57.778924+0000","last_fullsized":"2024-09-17T05:32:57.778924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:14.447613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755969+0000","last_change":"2024-09-17T05:32:57.755969+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755969+0000","last_undegraded":"2024-09-17T05:32:57.755969+0000","last_fullsized":"2024-09-17T05:32:57.755969+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.773897+0000","last_change":"2024-09-17T05:32:57.771832+0000","last_active":"2024-09-17T05:32:57.773897+0000","last_peered":"2024-09-17T05:32:57.773897+0000","last_clean":"2024-09-17T05:32:57.773897+0000","last_became_active":"2024-09-17T05:32:57.771626+0000","last_became_peered":"2024-09-17T05:32:57.771626+0000","last_unstale":"2024-09-17T05:32:57.773897+0000","last_undegraded":"2024-09-17T05:32:57.773897+0000","last_fullsized":"2024-09-17T05:32:57.773897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:03.616777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.759581+0000","last_change":"2024-09-17T05:32:57.759581+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.759581+0000","last_undegraded":"2024-09-17T05:32:57.759581+0000","last_fullsized":"2024-09-17T05:32:57.759581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779846+0000","last_change":"2024-09-17T05:32:57.776993+0000","last_active":"2024-09-17T05:32:57.779846+0000","last_peered":"2024-09-17T05:32:57.779846+0000","last_clean":"2024-09-17T05:32:57.779846+0000","last_became_active":"2024-09-17T05:32:57.776706+0000","last_became_peered":"2024-09-17T05:32:57.776706+0000","last_unstale":"2024-09-17T05:32:57.779846+0000","last_undegraded":"2024-09-17T05:32:57.779846+0000","last_fullsized":"2024-09-17T05:32:57.779846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:56.859681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":244,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.764715+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:32:57.764715+0000","last_peered":"2024-09-17T05:32:57.764715+0000","last_clean":"2024-09-17T05:32:57.764715+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:32:57.764715+0000","last_undegraded":"2024-09-17T05:32:57.764715+0000","last_fullsized":"2024-09-17T05:32:57.764715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1556480,"data_stored":997954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542200,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509497,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509497,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542199,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1556480,"data_stored":997954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:33:02.943 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:33:03.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.130+0000 7f4dd7800640 1 -- 172.21.15.31:0/283496315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4dd006e810 msgr2=0x7f4dd00cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:03.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.130+0000 7f4dd7800640 1 --2- 172.21.15.31:0/283496315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4dd006e810 0x7f4dd00cf130 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009900 tx=0x7f4db801c8e0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.130+0000 7f4dd7800640 1 -- 172.21.15.31:0/283496315 shutdown_connections 2024-09-17T05:33:03.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.130+0000 7f4dd7800640 1 --2- 172.21.15.31:0/283496315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4dd006e810 0x7f4dd00cf130 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.130+0000 7f4dd7800640 1 --2- 172.21.15.31:0/283496315 >> v2:172.21.15.155:3300/0 conn(0x7f4dd015ade0 0x7f4dd00cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.130+0000 7f4dd7800640 1 -- 172.21.15.31:0/283496315 >> 172.21.15.31:0/283496315 conn(0x7f4dd00b18f0 msgr2=0x7f4dd00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:03.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.130+0000 7f4dd7800640 1 -- 172.21.15.31:0/283496315 shutdown_connections 2024-09-17T05:33:03.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.130+0000 7f4dd7800640 1 -- 172.21.15.31:0/283496315 wait complete. 2024-09-17T05:33:03.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dd7800640 1 Processor -- start 2024-09-17T05:33:03.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dd7800640 1 -- start start 2024-09-17T05:33:03.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dd7800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dd006e810 0x7f4dd015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:03.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dd7800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dd00b4bd0 0x7f4dd009aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:03.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dd7800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4dd015ade0 0x7f4dd009b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:03.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dd7800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd0168140 con 0x7f4dd00b4bd0 2024-09-17T05:33:03.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dd7800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd0167fc0 con 0x7f4dd006e810 2024-09-17T05:33:03.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dd7800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd01682c0 con 0x7f4dd015ade0 2024-09-17T05:33:03.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dc7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dd00b4bd0 0x7f4dd009aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:03.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dc7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dd00b4bd0 0x7f4dd009aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41388/0 (socket says 172.21.15.31:41388) 2024-09-17T05:33:03.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dc7e00640 1 -- 172.21.15.31:0/4038614475 learned_addr learned my addr 172.21.15.31:0/4038614475 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:03.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dd4e00640 1 --2- 172.21.15.31:0/4038614475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dd006e810 0x7f4dd015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:03.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dd5800640 1 --2- 172.21.15.31:0/4038614475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4dd015ade0 0x7f4dd009b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:03.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dc7e00640 1 -- 172.21.15.31:0/4038614475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4dd015ade0 msgr2=0x7f4dd009b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:03.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dc7e00640 1 --2- 172.21.15.31:0/4038614475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4dd015ade0 0x7f4dd009b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dc7e00640 1 -- 172.21.15.31:0/4038614475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dd006e810 msgr2=0x7f4dd015a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:03.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dc7e00640 1 --2- 172.21.15.31:0/4038614475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dd006e810 0x7f4dd015a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dc7e00640 1 -- 172.21.15.31:0/4038614475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd0158dc0 con 0x7f4dd00b4bd0 2024-09-17T05:33:03.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dd5800640 1 --2- 172.21.15.31:0/4038614475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4dd015ade0 0x7f4dd009b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:03.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dc7e00640 1 --2- 172.21.15.31:0/4038614475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dd00b4bd0 0x7f4dd009aa10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009850 tx=0x7f4db80a65e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:03.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dcd600640 1 -- 172.21.15.31:0/4038614475 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db8004300 con 0x7f4dd00b4bd0 2024-09-17T05:33:03.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dcd600640 1 -- 172.21.15.31:0/4038614475 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4db8005070 con 0x7f4dd00b4bd0 2024-09-17T05:33:03.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dcd600640 1 -- 172.21.15.31:0/4038614475 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db80054a0 con 0x7f4dd00b4bd0 2024-09-17T05:33:03.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dd7800640 1 -- 172.21.15.31:0/4038614475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd0159040 con 0x7f4dd00b4bd0 2024-09-17T05:33:03.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dd7800640 1 -- 172.21.15.31:0/4038614475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd0159600 con 0x7f4dd00b4bd0 2024-09-17T05:33:03.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.134+0000 7f4dd7800640 1 -- 172.21.15.31:0/4038614475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dd0069410 con 0x7f4dd00b4bd0 2024-09-17T05:33:03.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.138+0000 7f4dcd600640 1 -- 172.21.15.31:0/4038614475 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f4db80bf060 con 0x7f4dd00b4bd0 2024-09-17T05:33:03.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.138+0000 7f4dcd600640 1 --2- 172.21.15.31:0/4038614475 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4dac073320 0x7f4dac0757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:03.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.138+0000 7f4dcd600640 1 -- 172.21.15.31:0/4038614475 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f4db812df60 con 0x7f4dd00b4bd0 2024-09-17T05:33:03.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.138+0000 7f4dd4e00640 1 --2- 172.21.15.31:0/4038614475 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4dac073320 0x7f4dac0757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:03.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.138+0000 7f4dd4e00640 1 --2- 172.21.15.31:0/4038614475 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4dac073320 0x7f4dac0757e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00ce830 tx=0x7f4dc00091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:03.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.142+0000 7f4dcd600640 1 -- 172.21.15.31:0/4038614475 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4dd0158dc0 con 0x7f4dd00b4bd0 2024-09-17T05:33:03.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.314+0000 7f4dd7800640 1 -- 172.21.15.31:0/4038614475 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4dd015e900 con 0x7f4dac073320 2024-09-17T05:33:03.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.318+0000 7f4dcd600640 1 -- 172.21.15.31:0/4038614475 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246778 (secure 0 0 0) 0x7f4dd015e900 con 0x7f4dac073320 2024-09-17T05:33:03.324 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:03.325 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:33:03.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.322+0000 7f4dd7800640 1 -- 172.21.15.31:0/4038614475 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4dac073320 msgr2=0x7f4dac0757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:03.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.322+0000 7f4dd7800640 1 --2- 172.21.15.31:0/4038614475 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4dac073320 0x7f4dac0757e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00ce830 tx=0x7f4dc00091e0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.322+0000 7f4dd7800640 1 -- 172.21.15.31:0/4038614475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dd00b4bd0 msgr2=0x7f4dd009aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:03.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.322+0000 7f4dd7800640 1 --2- 172.21.15.31:0/4038614475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dd00b4bd0 0x7f4dd009aa10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009850 tx=0x7f4db80a65e0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.322+0000 7f4dd7800640 1 -- 172.21.15.31:0/4038614475 shutdown_connections 2024-09-17T05:33:03.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.322+0000 7f4dd7800640 1 --2- 172.21.15.31:0/4038614475 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4dac073320 0x7f4dac0757e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.322+0000 7f4dd7800640 1 --2- 172.21.15.31:0/4038614475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4dd015ade0 0x7f4dd009b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.322+0000 7f4dd7800640 1 --2- 172.21.15.31:0/4038614475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dd00b4bd0 0x7f4dd009aa10 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.322+0000 7f4dd7800640 1 --2- 172.21.15.31:0/4038614475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dd006e810 0x7f4dd015a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.322+0000 7f4dd7800640 1 -- 172.21.15.31:0/4038614475 >> 172.21.15.31:0/4038614475 conn(0x7f4dd00b18f0 msgr2=0x7f4dd006ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:03.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.322+0000 7f4dd7800640 1 -- 172.21.15.31:0/4038614475 shutdown_connections 2024-09-17T05:33:03.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.322+0000 7f4dd7800640 1 -- 172.21.15.31:0/4038614475 wait complete. 2024-09-17T05:33:03.345 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T05:33:02.703040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258200,"kb_used_data":8680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716520,"statfs":{"total":773094113280,"available":772829716480,"internally_reserved":0,"allocated":8888320,"data_stored":4441424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.960464"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755959+0000","last_change":"2024-09-17T05:32:57.755959+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755959+0000","last_undegraded":"2024-09-17T05:32:57.755959+0000","last_fullsized":"2024-09-17T05:32:57.755959+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.764081+0000","last_change":"2024-09-17T05:32:57.764081+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.764081+0000","last_undegraded":"2024-09-17T05:32:57.764081+0000","last_fullsized":"2024-09-17T05:32:57.764081+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762055+0000","last_change":"2024-09-17T05:32:57.762055+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762055+0000","last_undegraded":"2024-09-17T05:32:57.762055+0000","last_fullsized":"2024-09-17T05:32:57.762055+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754455+0000","last_change":"2024-09-17T05:32:57.754455+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754455+0000","last_undegraded":"2024-09-17T05:32:57.754455+0000","last_fullsized":"2024-09-17T05:32:57.754455+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761721+0000","last_change":"2024-09-17T05:32:57.761721+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761721+0000","last_undegraded":"2024-09-17T05:32:57.761721+0000","last_fullsized":"2024-09-17T05:32:57.761721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.758601+0000","last_change":"2024-09-17T05:32:57.758601+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.758601+0000","last_undegraded":"2024-09-17T05:32:57.758601+0000","last_fullsized":"2024-09-17T05:32:57.758601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753567+0000","last_change":"2024-09-17T05:32:57.753567+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753567+0000","last_undegraded":"2024-09-17T05:32:57.753567+0000","last_fullsized":"2024-09-17T05:32:57.753567+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757889+0000","last_change":"2024-09-17T05:32:57.757889+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757889+0000","last_undegraded":"2024-09-17T05:32:57.757889+0000","last_fullsized":"2024-09-17T05:32:57.757889+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.758125+0000","last_change":"2024-09-17T05:32:57.758125+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.758125+0000","last_undegraded":"2024-09-17T05:32:57.758125+0000","last_fullsized":"2024-09-17T05:32:57.758125+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754177+0000","last_change":"2024-09-17T05:32:57.754177+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754177+0000","last_undegraded":"2024-09-17T05:32:57.754177+0000","last_fullsized":"2024-09-17T05:32:57.754177+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762797+0000","last_change":"2024-09-17T05:32:57.762797+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762797+0000","last_undegraded":"2024-09-17T05:32:57.762797+0000","last_fullsized":"2024-09-17T05:32:57.762797+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.756963+0000","last_change":"2024-09-17T05:32:57.756963+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.756963+0000","last_undegraded":"2024-09-17T05:32:57.756963+0000","last_fullsized":"2024-09-17T05:32:57.756963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762382+0000","last_change":"2024-09-17T05:32:57.762382+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762382+0000","last_undegraded":"2024-09-17T05:32:57.762382+0000","last_fullsized":"2024-09-17T05:32:57.762382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753519+0000","last_change":"2024-09-17T05:32:57.753519+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753519+0000","last_undegraded":"2024-09-17T05:32:57.753519+0000","last_fullsized":"2024-09-17T05:32:57.753519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757928+0000","last_change":"2024-09-17T05:32:57.757928+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757928+0000","last_undegraded":"2024-09-17T05:32:57.757928+0000","last_fullsized":"2024-09-17T05:32:57.757928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763037+0000","last_change":"2024-09-17T05:32:57.763037+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763037+0000","last_undegraded":"2024-09-17T05:32:57.763037+0000","last_fullsized":"2024-09-17T05:32:57.763037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.759822+0000","last_change":"2024-09-17T05:32:57.759822+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.759822+0000","last_undegraded":"2024-09-17T05:32:57.759822+0000","last_fullsized":"2024-09-17T05:32:57.759822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753309+0000","last_change":"2024-09-17T05:32:57.753309+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753309+0000","last_undegraded":"2024-09-17T05:32:57.753309+0000","last_fullsized":"2024-09-17T05:32:57.753309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754516+0000","last_change":"2024-09-17T05:32:57.754516+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754516+0000","last_undegraded":"2024-09-17T05:32:57.754516+0000","last_fullsized":"2024-09-17T05:32:57.754516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753049+0000","last_change":"2024-09-17T05:32:57.753049+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753049+0000","last_undegraded":"2024-09-17T05:32:57.753049+0000","last_fullsized":"2024-09-17T05:32:57.753049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.752625+0000","last_change":"2024-09-17T05:32:57.752625+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.752625+0000","last_undegraded":"2024-09-17T05:32:57.752625+0000","last_fullsized":"2024-09-17T05:32:57.752625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.767347+0000","last_change":"2024-09-17T05:32:57.767347+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.767347+0000","last_undegraded":"2024-09-17T05:32:57.767347+0000","last_fullsized":"2024-09-17T05:32:57.767347+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.756506+0000","last_change":"2024-09-17T05:32:57.756506+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.756506+0000","last_undegraded":"2024-09-17T05:32:57.756506+0000","last_fullsized":"2024-09-17T05:32:57.756506+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753352+0000","last_change":"2024-09-17T05:32:57.753352+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753352+0000","last_undegraded":"2024-09-17T05:32:57.753352+0000","last_fullsized":"2024-09-17T05:32:57.753352+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763700+0000","last_change":"2024-09-17T05:32:57.763700+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763700+0000","last_undegraded":"2024-09-17T05:32:57.763700+0000","last_fullsized":"2024-09-17T05:32:57.763700+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760679+0000","last_change":"2024-09-17T05:32:57.760679+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760679+0000","last_undegraded":"2024-09-17T05:32:57.760679+0000","last_fullsized":"2024-09-17T05:32:57.760679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761813+0000","last_change":"2024-09-17T05:32:57.761813+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761813+0000","last_undegraded":"2024-09-17T05:32:57.761813+0000","last_fullsized":"2024-09-17T05:32:57.761813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755954+0000","last_change":"2024-09-17T05:32:57.755954+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755954+0000","last_undegraded":"2024-09-17T05:32:57.755954+0000","last_fullsized":"2024-09-17T05:32:57.755954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763285+0000","last_change":"2024-09-17T05:32:57.763285+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763285+0000","last_undegraded":"2024-09-17T05:32:57.763285+0000","last_fullsized":"2024-09-17T05:32:57.763285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.766238+0000","last_change":"2024-09-17T05:32:57.766238+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.766238+0000","last_undegraded":"2024-09-17T05:32:57.766238+0000","last_fullsized":"2024-09-17T05:32:57.766238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763288+0000","last_change":"2024-09-17T05:32:57.763288+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763288+0000","last_undegraded":"2024-09-17T05:32:57.763288+0000","last_fullsized":"2024-09-17T05:32:57.763288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754918+0000","last_change":"2024-09-17T05:32:57.754918+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754918+0000","last_undegraded":"2024-09-17T05:32:57.754918+0000","last_fullsized":"2024-09-17T05:32:57.754918+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763926+0000","last_change":"2024-09-17T05:32:57.763926+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763926+0000","last_undegraded":"2024-09-17T05:32:57.763926+0000","last_fullsized":"2024-09-17T05:32:57.763926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.766615+0000","last_change":"2024-09-17T05:32:57.760900+0000","last_active":"2024-09-17T05:32:57.766615+0000","last_peered":"2024-09-17T05:32:57.766615+0000","last_clean":"2024-09-17T05:32:57.766615+0000","last_became_active":"2024-09-17T05:32:57.760587+0000","last_became_peered":"2024-09-17T05:32:57.760587+0000","last_unstale":"2024-09-17T05:32:57.766615+0000","last_undegraded":"2024-09-17T05:32:57.766615+0000","last_fullsized":"2024-09-17T05:32:57.766615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:06.976886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755426+0000","last_change":"2024-09-17T05:32:57.755426+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755426+0000","last_undegraded":"2024-09-17T05:32:57.755426+0000","last_fullsized":"2024-09-17T05:32:57.755426+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.781622+0000","last_change":"2024-09-17T05:32:57.778135+0000","last_active":"2024-09-17T05:32:57.781622+0000","last_peered":"2024-09-17T05:32:57.781622+0000","last_clean":"2024-09-17T05:32:57.781622+0000","last_became_active":"2024-09-17T05:32:57.777834+0000","last_became_peered":"2024-09-17T05:32:57.777834+0000","last_unstale":"2024-09-17T05:32:57.781622+0000","last_undegraded":"2024-09-17T05:32:57.781622+0000","last_fullsized":"2024-09-17T05:32:57.781622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:58.249252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754943+0000","last_change":"2024-09-17T05:32:57.754943+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754943+0000","last_undegraded":"2024-09-17T05:32:57.754943+0000","last_fullsized":"2024-09-17T05:32:57.754943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.766132+0000","last_change":"2024-09-17T05:32:57.761438+0000","last_active":"2024-09-17T05:32:57.766132+0000","last_peered":"2024-09-17T05:32:57.766132+0000","last_clean":"2024-09-17T05:32:57.766132+0000","last_became_active":"2024-09-17T05:32:57.761180+0000","last_became_peered":"2024-09-17T05:32:57.761180+0000","last_unstale":"2024-09-17T05:32:57.766132+0000","last_undegraded":"2024-09-17T05:32:57.766132+0000","last_fullsized":"2024-09-17T05:32:57.766132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:38.946220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760016+0000","last_change":"2024-09-17T05:32:57.760016+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760016+0000","last_undegraded":"2024-09-17T05:32:57.760016+0000","last_fullsized":"2024-09-17T05:32:57.760016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.766461+0000","last_change":"2024-09-17T05:32:57.762038+0000","last_active":"2024-09-17T05:32:57.766461+0000","last_peered":"2024-09-17T05:32:57.766461+0000","last_clean":"2024-09-17T05:32:57.766461+0000","last_became_active":"2024-09-17T05:32:57.761027+0000","last_became_peered":"2024-09-17T05:32:57.761027+0000","last_unstale":"2024-09-17T05:32:57.766461+0000","last_undegraded":"2024-09-17T05:32:57.766461+0000","last_fullsized":"2024-09-17T05:32:57.766461+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:19.005013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.764452+0000","last_change":"2024-09-17T05:32:57.764452+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.764452+0000","last_undegraded":"2024-09-17T05:32:57.764452+0000","last_fullsized":"2024-09-17T05:32:57.764452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779784+0000","last_change":"2024-09-17T05:32:57.777503+0000","last_active":"2024-09-17T05:32:57.779784+0000","last_peered":"2024-09-17T05:32:57.779784+0000","last_clean":"2024-09-17T05:32:57.779784+0000","last_became_active":"2024-09-17T05:32:57.777284+0000","last_became_peered":"2024-09-17T05:32:57.777284+0000","last_unstale":"2024-09-17T05:32:57.779784+0000","last_undegraded":"2024-09-17T05:32:57.779784+0000","last_fullsized":"2024-09-17T05:32:57.779784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:13.999564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761289+0000","last_change":"2024-09-17T05:32:57.761289+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761289+0000","last_undegraded":"2024-09-17T05:32:57.761289+0000","last_fullsized":"2024-09-17T05:32:57.761289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.781701+0000","last_change":"2024-09-17T05:32:57.778177+0000","last_active":"2024-09-17T05:32:57.781701+0000","last_peered":"2024-09-17T05:32:57.781701+0000","last_clean":"2024-09-17T05:32:57.781701+0000","last_became_active":"2024-09-17T05:32:57.777881+0000","last_became_peered":"2024-09-17T05:32:57.777881+0000","last_unstale":"2024-09-17T05:32:57.781701+0000","last_undegraded":"2024-09-17T05:32:57.781701+0000","last_fullsized":"2024-09-17T05:32:57.781701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:54.749806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761539+0000","last_change":"2024-09-17T05:32:57.761539+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761539+0000","last_undegraded":"2024-09-17T05:32:57.761539+0000","last_fullsized":"2024-09-17T05:32:57.761539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.771268+0000","last_change":"2024-09-17T05:32:57.765590+0000","last_active":"2024-09-17T05:32:57.771268+0000","last_peered":"2024-09-17T05:32:57.771268+0000","last_clean":"2024-09-17T05:32:57.771268+0000","last_became_active":"2024-09-17T05:32:57.765285+0000","last_became_peered":"2024-09-17T05:32:57.765285+0000","last_unstale":"2024-09-17T05:32:57.771268+0000","last_undegraded":"2024-09-17T05:32:57.771268+0000","last_fullsized":"2024-09-17T05:32:57.771268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.940055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757453+0000","last_change":"2024-09-17T05:32:57.757453+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757453+0000","last_undegraded":"2024-09-17T05:32:57.757453+0000","last_fullsized":"2024-09-17T05:32:57.757453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779745+0000","last_change":"2024-09-17T05:32:57.771325+0000","last_active":"2024-09-17T05:32:57.779745+0000","last_peered":"2024-09-17T05:32:57.779745+0000","last_clean":"2024-09-17T05:32:57.779745+0000","last_became_active":"2024-09-17T05:32:57.771046+0000","last_became_peered":"2024-09-17T05:32:57.771046+0000","last_unstale":"2024-09-17T05:32:57.779745+0000","last_undegraded":"2024-09-17T05:32:57.779745+0000","last_fullsized":"2024-09-17T05:32:57.779745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:01.736307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.758937+0000","last_change":"2024-09-17T05:32:57.758937+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.758937+0000","last_undegraded":"2024-09-17T05:32:57.758937+0000","last_fullsized":"2024-09-17T05:32:57.758937+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779585+0000","last_change":"2024-09-17T05:32:57.775051+0000","last_active":"2024-09-17T05:32:57.779585+0000","last_peered":"2024-09-17T05:32:57.779585+0000","last_clean":"2024-09-17T05:32:57.779585+0000","last_became_active":"2024-09-17T05:32:57.774665+0000","last_became_peered":"2024-09-17T05:32:57.774665+0000","last_unstale":"2024-09-17T05:32:57.779585+0000","last_undegraded":"2024-09-17T05:32:57.779585+0000","last_fullsized":"2024-09-17T05:32:57.779585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:53.510499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757590+0000","last_change":"2024-09-17T05:32:57.757590+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757590+0000","last_undegraded":"2024-09-17T05:32:57.757590+0000","last_fullsized":"2024-09-17T05:32:57.757590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.777934+0000","last_change":"2024-09-17T05:32:57.771838+0000","last_active":"2024-09-17T05:32:57.777934+0000","last_peered":"2024-09-17T05:32:57.777934+0000","last_clean":"2024-09-17T05:32:57.777934+0000","last_became_active":"2024-09-17T05:32:57.771585+0000","last_became_peered":"2024-09-17T05:32:57.771585+0000","last_unstale":"2024-09-17T05:32:57.777934+0000","last_undegraded":"2024-09-17T05:32:57.777934+0000","last_fullsized":"2024-09-17T05:32:57.777934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:21.653529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755598+0000","last_change":"2024-09-17T05:32:57.755598+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755598+0000","last_undegraded":"2024-09-17T05:32:57.755598+0000","last_fullsized":"2024-09-17T05:32:57.755598+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779493+0000","last_change":"2024-09-17T05:32:57.774796+0000","last_active":"2024-09-17T05:32:57.779493+0000","last_peered":"2024-09-17T05:32:57.779493+0000","last_clean":"2024-09-17T05:32:57.779493+0000","last_became_active":"2024-09-17T05:32:57.774446+0000","last_became_peered":"2024-09-17T05:32:57.774446+0000","last_unstale":"2024-09-17T05:32:57.779493+0000","last_undegraded":"2024-09-17T05:32:57.779493+0000","last_fullsized":"2024-09-17T05:32:57.779493+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:29.699013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761416+0000","last_change":"2024-09-17T05:32:57.761416+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761416+0000","last_undegraded":"2024-09-17T05:32:57.761416+0000","last_fullsized":"2024-09-17T05:32:57.761416+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.778451+0000","last_change":"2024-09-17T05:32:57.772140+0000","last_active":"2024-09-17T05:32:57.778451+0000","last_peered":"2024-09-17T05:32:57.778451+0000","last_clean":"2024-09-17T05:32:57.778451+0000","last_became_active":"2024-09-17T05:32:57.771854+0000","last_became_peered":"2024-09-17T05:32:57.771854+0000","last_unstale":"2024-09-17T05:32:57.778451+0000","last_undegraded":"2024-09-17T05:32:57.778451+0000","last_fullsized":"2024-09-17T05:32:57.778451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:28.491950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757067+0000","last_change":"2024-09-17T05:32:57.757067+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757067+0000","last_undegraded":"2024-09-17T05:32:57.757067+0000","last_fullsized":"2024-09-17T05:32:57.757067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.780784+0000","last_change":"2024-09-17T05:32:57.776757+0000","last_active":"2024-09-17T05:32:57.780784+0000","last_peered":"2024-09-17T05:32:57.780784+0000","last_clean":"2024-09-17T05:32:57.780784+0000","last_became_active":"2024-09-17T05:32:57.776494+0000","last_became_peered":"2024-09-17T05:32:57.776494+0000","last_unstale":"2024-09-17T05:32:57.780784+0000","last_undegraded":"2024-09-17T05:32:57.780784+0000","last_fullsized":"2024-09-17T05:32:57.780784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:19.493595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761967+0000","last_change":"2024-09-17T05:32:57.761967+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761967+0000","last_undegraded":"2024-09-17T05:32:57.761967+0000","last_fullsized":"2024-09-17T05:32:57.761967+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779356+0000","last_change":"2024-09-17T05:32:57.778389+0000","last_active":"2024-09-17T05:32:57.779356+0000","last_peered":"2024-09-17T05:32:57.779356+0000","last_clean":"2024-09-17T05:32:57.779356+0000","last_became_active":"2024-09-17T05:32:57.778131+0000","last_became_peered":"2024-09-17T05:32:57.778131+0000","last_unstale":"2024-09-17T05:32:57.779356+0000","last_undegraded":"2024-09-17T05:32:57.779356+0000","last_fullsized":"2024-09-17T05:32:57.779356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:36.171166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762526+0000","last_change":"2024-09-17T05:32:57.762526+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762526+0000","last_undegraded":"2024-09-17T05:32:57.762526+0000","last_fullsized":"2024-09-17T05:32:57.762526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.778648+0000","last_change":"2024-09-17T05:32:57.773894+0000","last_active":"2024-09-17T05:32:57.778648+0000","last_peered":"2024-09-17T05:32:57.778648+0000","last_clean":"2024-09-17T05:32:57.778648+0000","last_became_active":"2024-09-17T05:32:57.772427+0000","last_became_peered":"2024-09-17T05:32:57.772427+0000","last_unstale":"2024-09-17T05:32:57.778648+0000","last_undegraded":"2024-09-17T05:32:57.778648+0000","last_fullsized":"2024-09-17T05:32:57.778648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:04.368779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762540+0000","last_change":"2024-09-17T05:32:57.762540+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762540+0000","last_undegraded":"2024-09-17T05:32:57.762540+0000","last_fullsized":"2024-09-17T05:32:57.762540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.775369+0000","last_change":"2024-09-17T05:32:57.772094+0000","last_active":"2024-09-17T05:32:57.775369+0000","last_peered":"2024-09-17T05:32:57.775369+0000","last_clean":"2024-09-17T05:32:57.775369+0000","last_became_active":"2024-09-17T05:32:57.771783+0000","last_became_peered":"2024-09-17T05:32:57.771783+0000","last_unstale":"2024-09-17T05:32:57.775369+0000","last_undegraded":"2024-09-17T05:32:57.775369+0000","last_fullsized":"2024-09-17T05:32:57.775369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:59.096504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760159+0000","last_change":"2024-09-17T05:32:57.760159+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760159+0000","last_undegraded":"2024-09-17T05:32:57.760159+0000","last_fullsized":"2024-09-17T05:32:57.760159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.773750+0000","last_change":"2024-09-17T05:32:57.768304+0000","last_active":"2024-09-17T05:32:57.773750+0000","last_peered":"2024-09-17T05:32:57.773750+0000","last_clean":"2024-09-17T05:32:57.773750+0000","last_became_active":"2024-09-17T05:32:57.767994+0000","last_became_peered":"2024-09-17T05:32:57.767994+0000","last_unstale":"2024-09-17T05:32:57.773750+0000","last_undegraded":"2024-09-17T05:32:57.773750+0000","last_fullsized":"2024-09-17T05:32:57.773750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:02.910711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754847+0000","last_change":"2024-09-17T05:32:57.754847+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754847+0000","last_undegraded":"2024-09-17T05:32:57.754847+0000","last_fullsized":"2024-09-17T05:32:57.754847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.775322+0000","last_change":"2024-09-17T05:32:57.771902+0000","last_active":"2024-09-17T05:32:57.775322+0000","last_peered":"2024-09-17T05:32:57.775322+0000","last_clean":"2024-09-17T05:32:57.775322+0000","last_became_active":"2024-09-17T05:32:57.770752+0000","last_became_peered":"2024-09-17T05:32:57.770752+0000","last_unstale":"2024-09-17T05:32:57.775322+0000","last_undegraded":"2024-09-17T05:32:57.775322+0000","last_fullsized":"2024-09-17T05:32:57.775322+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:25.208627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760971+0000","last_change":"2024-09-17T05:32:57.760971+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760971+0000","last_undegraded":"2024-09-17T05:32:57.760971+0000","last_fullsized":"2024-09-17T05:32:57.760971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.769125+0000","last_change":"2024-09-17T05:32:57.766899+0000","last_active":"2024-09-17T05:32:57.769125+0000","last_peered":"2024-09-17T05:32:57.769125+0000","last_clean":"2024-09-17T05:32:57.769125+0000","last_became_active":"2024-09-17T05:32:57.766580+0000","last_became_peered":"2024-09-17T05:32:57.766580+0000","last_unstale":"2024-09-17T05:32:57.769125+0000","last_undegraded":"2024-09-17T05:32:57.769125+0000","last_fullsized":"2024-09-17T05:32:57.769125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:28.491950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753009+0000","last_change":"2024-09-17T05:32:57.753009+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753009+0000","last_undegraded":"2024-09-17T05:32:57.753009+0000","last_fullsized":"2024-09-17T05:32:57.753009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.777774+0000","last_change":"2024-09-17T05:32:57.773771+0000","last_active":"2024-09-17T05:32:57.777774+0000","last_peered":"2024-09-17T05:32:57.777774+0000","last_clean":"2024-09-17T05:32:57.777774+0000","last_became_active":"2024-09-17T05:32:57.773415+0000","last_became_peered":"2024-09-17T05:32:57.773415+0000","last_unstale":"2024-09-17T05:32:57.777774+0000","last_undegraded":"2024-09-17T05:32:57.777774+0000","last_fullsized":"2024-09-17T05:32:57.777774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:57.411171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.759045+0000","last_change":"2024-09-17T05:32:57.759045+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.759045+0000","last_undegraded":"2024-09-17T05:32:57.759045+0000","last_fullsized":"2024-09-17T05:32:57.759045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.763776+0000","last_change":"2024-09-17T05:32:57.761461+0000","last_active":"2024-09-17T05:32:57.763776+0000","last_peered":"2024-09-17T05:32:57.763776+0000","last_clean":"2024-09-17T05:32:57.763776+0000","last_became_active":"2024-09-17T05:32:57.760904+0000","last_became_peered":"2024-09-17T05:32:57.760904+0000","last_unstale":"2024-09-17T05:32:57.763776+0000","last_undegraded":"2024-09-17T05:32:57.763776+0000","last_fullsized":"2024-09-17T05:32:57.763776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:52.806367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.752757+0000","last_change":"2024-09-17T05:32:57.752757+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.752757+0000","last_undegraded":"2024-09-17T05:32:57.752757+0000","last_fullsized":"2024-09-17T05:32:57.752757+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.772460+0000","last_change":"2024-09-17T05:32:57.763654+0000","last_active":"2024-09-17T05:32:57.772460+0000","last_peered":"2024-09-17T05:32:57.772460+0000","last_clean":"2024-09-17T05:32:57.772460+0000","last_became_active":"2024-09-17T05:32:57.763354+0000","last_became_peered":"2024-09-17T05:32:57.763354+0000","last_unstale":"2024-09-17T05:32:57.772460+0000","last_undegraded":"2024-09-17T05:32:57.772460+0000","last_fullsized":"2024-09-17T05:32:57.772460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:14.190039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757396+0000","last_change":"2024-09-17T05:32:57.757396+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757396+0000","last_undegraded":"2024-09-17T05:32:57.757396+0000","last_fullsized":"2024-09-17T05:32:57.757396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.777802+0000","last_change":"2024-09-17T05:32:57.773774+0000","last_active":"2024-09-17T05:32:57.777802+0000","last_peered":"2024-09-17T05:32:57.777802+0000","last_clean":"2024-09-17T05:32:57.777802+0000","last_became_active":"2024-09-17T05:32:57.773506+0000","last_became_peered":"2024-09-17T05:32:57.773506+0000","last_unstale":"2024-09-17T05:32:57.777802+0000","last_undegraded":"2024-09-17T05:32:57.777802+0000","last_fullsized":"2024-09-17T05:32:57.777802+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:12.669688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763511+0000","last_change":"2024-09-17T05:32:57.763511+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763511+0000","last_undegraded":"2024-09-17T05:32:57.763511+0000","last_fullsized":"2024-09-17T05:32:57.763511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.780826+0000","last_change":"2024-09-17T05:32:57.777118+0000","last_active":"2024-09-17T05:32:57.780826+0000","last_peered":"2024-09-17T05:32:57.780826+0000","last_clean":"2024-09-17T05:32:57.780826+0000","last_became_active":"2024-09-17T05:32:57.776868+0000","last_became_peered":"2024-09-17T05:32:57.776868+0000","last_unstale":"2024-09-17T05:32:57.780826+0000","last_undegraded":"2024-09-17T05:32:57.780826+0000","last_fullsized":"2024-09-17T05:32:57.780826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:08.376907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760675+0000","last_change":"2024-09-17T05:32:57.760675+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760675+0000","last_undegraded":"2024-09-17T05:32:57.760675+0000","last_fullsized":"2024-09-17T05:32:57.760675+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.780764+0000","last_change":"2024-09-17T05:32:57.776327+0000","last_active":"2024-09-17T05:32:57.780764+0000","last_peered":"2024-09-17T05:32:57.780764+0000","last_clean":"2024-09-17T05:32:57.780764+0000","last_became_active":"2024-09-17T05:32:57.776010+0000","last_became_peered":"2024-09-17T05:32:57.776010+0000","last_unstale":"2024-09-17T05:32:57.780764+0000","last_undegraded":"2024-09-17T05:32:57.780764+0000","last_fullsized":"2024-09-17T05:32:57.780764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:15.914318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754058+0000","last_change":"2024-09-17T05:32:57.754058+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754058+0000","last_undegraded":"2024-09-17T05:32:57.754058+0000","last_fullsized":"2024-09-17T05:32:57.754058+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.774319+0000","last_change":"2024-09-17T05:32:57.768914+0000","last_active":"2024-09-17T05:32:57.774319+0000","last_peered":"2024-09-17T05:32:57.774319+0000","last_clean":"2024-09-17T05:32:57.774319+0000","last_became_active":"2024-09-17T05:32:57.768542+0000","last_became_peered":"2024-09-17T05:32:57.768542+0000","last_unstale":"2024-09-17T05:32:57.774319+0000","last_undegraded":"2024-09-17T05:32:57.774319+0000","last_fullsized":"2024-09-17T05:32:57.774319+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:09.689707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760460+0000","last_change":"2024-09-17T05:32:57.760460+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760460+0000","last_undegraded":"2024-09-17T05:32:57.760460+0000","last_fullsized":"2024-09-17T05:32:57.760460+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.778204+0000","last_change":"2024-09-17T05:32:57.771755+0000","last_active":"2024-09-17T05:32:57.778204+0000","last_peered":"2024-09-17T05:32:57.778204+0000","last_clean":"2024-09-17T05:32:57.778204+0000","last_became_active":"2024-09-17T05:32:57.771463+0000","last_became_peered":"2024-09-17T05:32:57.771463+0000","last_unstale":"2024-09-17T05:32:57.778204+0000","last_undegraded":"2024-09-17T05:32:57.778204+0000","last_fullsized":"2024-09-17T05:32:57.778204+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:08.734245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.758158+0000","last_change":"2024-09-17T05:32:57.758158+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.758158+0000","last_undegraded":"2024-09-17T05:32:57.758158+0000","last_fullsized":"2024-09-17T05:32:57.758158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.773094+0000","last_change":"2024-09-17T05:32:57.768309+0000","last_active":"2024-09-17T05:32:57.773094+0000","last_peered":"2024-09-17T05:32:57.773094+0000","last_clean":"2024-09-17T05:32:57.773094+0000","last_became_active":"2024-09-17T05:32:57.767986+0000","last_became_peered":"2024-09-17T05:32:57.767986+0000","last_unstale":"2024-09-17T05:32:57.773094+0000","last_undegraded":"2024-09-17T05:32:57.773094+0000","last_fullsized":"2024-09-17T05:32:57.773094+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:04.368779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.756482+0000","last_change":"2024-09-17T05:32:57.756482+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.756482+0000","last_undegraded":"2024-09-17T05:32:57.756482+0000","last_fullsized":"2024-09-17T05:32:57.756482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.781719+0000","last_change":"2024-09-17T05:32:57.778896+0000","last_active":"2024-09-17T05:32:57.781719+0000","last_peered":"2024-09-17T05:32:57.781719+0000","last_clean":"2024-09-17T05:32:57.781719+0000","last_became_active":"2024-09-17T05:32:57.778580+0000","last_became_peered":"2024-09-17T05:32:57.778580+0000","last_unstale":"2024-09-17T05:32:57.781719+0000","last_undegraded":"2024-09-17T05:32:57.781719+0000","last_fullsized":"2024-09-17T05:32:57.781719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:07.087245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761077+0000","last_change":"2024-09-17T05:32:57.761077+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761077+0000","last_undegraded":"2024-09-17T05:32:57.761077+0000","last_fullsized":"2024-09-17T05:32:57.761077+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.778924+0000","last_change":"2024-09-17T05:32:57.772499+0000","last_active":"2024-09-17T05:32:57.778924+0000","last_peered":"2024-09-17T05:32:57.778924+0000","last_clean":"2024-09-17T05:32:57.778924+0000","last_became_active":"2024-09-17T05:32:57.771365+0000","last_became_peered":"2024-09-17T05:32:57.771365+0000","last_unstale":"2024-09-17T05:32:57.778924+0000","last_undegraded":"2024-09-17T05:32:57.778924+0000","last_fullsized":"2024-09-17T05:32:57.778924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:14.447613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755969+0000","last_change":"2024-09-17T05:32:57.755969+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755969+0000","last_undegraded":"2024-09-17T05:32:57.755969+0000","last_fullsized":"2024-09-17T05:32:57.755969+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.773897+0000","last_change":"2024-09-17T05:32:57.771832+0000","last_active":"2024-09-17T05:32:57.773897+0000","last_peered":"2024-09-17T05:32:57.773897+0000","last_clean":"2024-09-17T05:32:57.773897+0000","last_became_active":"2024-09-17T05:32:57.771626+0000","last_became_peered":"2024-09-17T05:32:57.771626+0000","last_unstale":"2024-09-17T05:32:57.773897+0000","last_undegraded":"2024-09-17T05:32:57.773897+0000","last_fullsized":"2024-09-17T05:32:57.773897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:03.616777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.759581+0000","last_change":"2024-09-17T05:32:57.759581+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.759581+0000","last_undegraded":"2024-09-17T05:32:57.759581+0000","last_fullsized":"2024-09-17T05:32:57.759581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779846+0000","last_change":"2024-09-17T05:32:57.776993+0000","last_active":"2024-09-17T05:32:57.779846+0000","last_peered":"2024-09-17T05:32:57.779846+0000","last_clean":"2024-09-17T05:32:57.779846+0000","last_became_active":"2024-09-17T05:32:57.776706+0000","last_became_peered":"2024-09-17T05:32:57.776706+0000","last_unstale":"2024-09-17T05:32:57.779846+0000","last_undegraded":"2024-09-17T05:32:57.779846+0000","last_fullsized":"2024-09-17T05:32:57.779846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:56.859681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":244,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.764715+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:32:57.764715+0000","last_peered":"2024-09-17T05:32:57.764715+0000","last_clean":"2024-09-17T05:32:57.764715+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:32:57.764715+0000","last_undegraded":"2024-09-17T05:32:57.764715+0000","last_fullsized":"2024-09-17T05:32:57.764715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1556480,"data_stored":997954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542200,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509497,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509497,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542199,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1556480,"data_stored":997954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:33:03.349 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:33:03.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.538+0000 7fd60c800640 1 -- 172.21.15.31:0/1695536683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6040cdb30 msgr2=0x7fd6040aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:03.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.538+0000 7fd60c800640 1 --2- 172.21.15.31:0/1695536683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6040cdb30 0x7fd6040aeef0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd600009bc0 tx=0x7fd60001cba0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.538+0000 7fd60c800640 1 -- 172.21.15.31:0/1695536683 shutdown_connections 2024-09-17T05:33:03.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.538+0000 7fd60c800640 1 --2- 172.21.15.31:0/1695536683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6040cdb30 0x7fd6040aeef0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.538+0000 7fd60c800640 1 --2- 172.21.15.31:0/1695536683 >> v2:172.21.15.155:3300/0 conn(0x7fd6040ced80 0x7fd6040ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.538+0000 7fd60c800640 1 -- 172.21.15.31:0/1695536683 >> 172.21.15.31:0/1695536683 conn(0x7fd6040d1dc0 msgr2=0x7fd6040d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:03.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.538+0000 7fd60c800640 1 -- 172.21.15.31:0/1695536683 shutdown_connections 2024-09-17T05:33:03.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.538+0000 7fd60c800640 1 -- 172.21.15.31:0/1695536683 wait complete. 2024-09-17T05:33:03.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd60c800640 1 Processor -- start 2024-09-17T05:33:03.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd60c800640 1 -- start start 2024-09-17T05:33:03.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd60c800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6040cdb30 0x7fd6041562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:03.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd60c800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6040ced80 0x7fd604154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:03.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd60c800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd60415bea0 0x7fd60414e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:03.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd60c800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd6041692f0 con 0x7fd6040cdb30 2024-09-17T05:33:03.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd60c800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd604169170 con 0x7fd60415bea0 2024-09-17T05:33:03.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd60c800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd604169470 con 0x7fd6040ced80 2024-09-17T05:33:03.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd609e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6040cdb30 0x7fd6041562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:03.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd609e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6040cdb30 0x7fd6041562f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41396/0 (socket says 172.21.15.31:41396) 2024-09-17T05:33:03.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd609e00640 1 -- 172.21.15.31:0/2925894205 learned_addr learned my addr 172.21.15.31:0/2925894205 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:03.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd609400640 1 --2- 172.21.15.31:0/2925894205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6040ced80 0x7fd604154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:03.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd60a800640 1 --2- 172.21.15.31:0/2925894205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd60415bea0 0x7fd60414e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:03.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd609e00640 1 -- 172.21.15.31:0/2925894205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6040ced80 msgr2=0x7fd604154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:03.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd609e00640 1 --2- 172.21.15.31:0/2925894205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6040ced80 0x7fd604154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd609e00640 1 -- 172.21.15.31:0/2925894205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd60415bea0 msgr2=0x7fd60414e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:03.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd609e00640 1 --2- 172.21.15.31:0/2925894205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd60415bea0 0x7fd60414e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd609e00640 1 -- 172.21.15.31:0/2925894205 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd604150720 con 0x7fd6040cdb30 2024-09-17T05:33:03.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd609e00640 1 --2- 172.21.15.31:0/2925894205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6040cdb30 0x7fd6041562f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800c3c0 tx=0x7fd5f800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:03.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd5fe000640 1 -- 172.21.15.31:0/2925894205 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8017070 con 0x7fd6040cdb30 2024-09-17T05:33:03.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd5fe000640 1 -- 172.21.15.31:0/2925894205 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5f8003600 con 0x7fd6040cdb30 2024-09-17T05:33:03.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd60c800640 1 -- 172.21.15.31:0/2925894205 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6041f8d00 con 0x7fd6040cdb30 2024-09-17T05:33:03.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd5fe000640 1 -- 172.21.15.31:0/2925894205 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8003a50 con 0x7fd6040cdb30 2024-09-17T05:33:03.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd60c800640 1 -- 172.21.15.31:0/2925894205 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd604154d60 con 0x7fd6040cdb30 2024-09-17T05:33:03.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.542+0000 7fd60c800640 1 -- 172.21.15.31:0/2925894205 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6040ce670 con 0x7fd6040cdb30 2024-09-17T05:33:03.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.546+0000 7fd5fe000640 1 -- 172.21.15.31:0/2925894205 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fd5f801a070 con 0x7fd6040cdb30 2024-09-17T05:33:03.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.546+0000 7fd5fe000640 1 --2- 172.21.15.31:0/2925894205 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd5e8073320 0x7fd5e80757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:03.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.546+0000 7fd5fe000640 1 -- 172.21.15.31:0/2925894205 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fd5f8093730 con 0x7fd6040cdb30 2024-09-17T05:33:03.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.546+0000 7fd609400640 1 --2- 172.21.15.31:0/2925894205 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd5e8073320 0x7fd5e80757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:03.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.546+0000 7fd609400640 1 --2- 172.21.15.31:0/2925894205 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd5e8073320 0x7fd5e80757e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd6040cc150 tx=0x7fd5f40091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:03.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.550+0000 7fd5fe000640 1 -- 172.21.15.31:0/2925894205 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd604150720 con 0x7fd6040cdb30 2024-09-17T05:33:03.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.722+0000 7fd60c800640 1 -- 172.21.15.31:0/2925894205 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd6040b7880 con 0x7fd5e8073320 2024-09-17T05:33:03.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.726+0000 7fd5fe000640 1 -- 172.21.15.31:0/2925894205 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246778 (secure 0 0 0) 0x7fd6040b7880 con 0x7fd5e8073320 2024-09-17T05:33:03.732 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:03.733 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:33:03.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.730+0000 7fd60c800640 1 -- 172.21.15.31:0/2925894205 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd5e8073320 msgr2=0x7fd5e80757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:03.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.730+0000 7fd60c800640 1 --2- 172.21.15.31:0/2925894205 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd5e8073320 0x7fd5e80757e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd6040cc150 tx=0x7fd5f40091e0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.730+0000 7fd60c800640 1 -- 172.21.15.31:0/2925894205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6040cdb30 msgr2=0x7fd6041562f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:03.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.730+0000 7fd60c800640 1 --2- 172.21.15.31:0/2925894205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6040cdb30 0x7fd6041562f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800c3c0 tx=0x7fd5f800c880 comp rx=0 tx=0).stop 2024-09-17T05:33:03.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.730+0000 7fd60c800640 1 -- 172.21.15.31:0/2925894205 shutdown_connections 2024-09-17T05:33:03.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.730+0000 7fd60c800640 1 --2- 172.21.15.31:0/2925894205 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd5e8073320 0x7fd5e80757e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.730+0000 7fd60c800640 1 --2- 172.21.15.31:0/2925894205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd60415bea0 0x7fd60414e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.730+0000 7fd60c800640 1 --2- 172.21.15.31:0/2925894205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6040ced80 0x7fd604154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.730+0000 7fd60c800640 1 --2- 172.21.15.31:0/2925894205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6040cdb30 0x7fd6041562f0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.730+0000 7fd60c800640 1 -- 172.21.15.31:0/2925894205 >> 172.21.15.31:0/2925894205 conn(0x7fd6040d1dc0 msgr2=0x7fd6040d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:03.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.730+0000 7fd60c800640 1 -- 172.21.15.31:0/2925894205 shutdown_connections 2024-09-17T05:33:03.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.730+0000 7fd60c800640 1 -- 172.21.15.31:0/2925894205 wait complete. 2024-09-17T05:33:03.751 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T05:33:02.703040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258200,"kb_used_data":8680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716520,"statfs":{"total":773094113280,"available":772829716480,"internally_reserved":0,"allocated":8888320,"data_stored":4441424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.960464"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755959+0000","last_change":"2024-09-17T05:32:57.755959+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755959+0000","last_undegraded":"2024-09-17T05:32:57.755959+0000","last_fullsized":"2024-09-17T05:32:57.755959+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.764081+0000","last_change":"2024-09-17T05:32:57.764081+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.764081+0000","last_undegraded":"2024-09-17T05:32:57.764081+0000","last_fullsized":"2024-09-17T05:32:57.764081+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762055+0000","last_change":"2024-09-17T05:32:57.762055+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762055+0000","last_undegraded":"2024-09-17T05:32:57.762055+0000","last_fullsized":"2024-09-17T05:32:57.762055+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754455+0000","last_change":"2024-09-17T05:32:57.754455+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754455+0000","last_undegraded":"2024-09-17T05:32:57.754455+0000","last_fullsized":"2024-09-17T05:32:57.754455+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761721+0000","last_change":"2024-09-17T05:32:57.761721+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761721+0000","last_undegraded":"2024-09-17T05:32:57.761721+0000","last_fullsized":"2024-09-17T05:32:57.761721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.758601+0000","last_change":"2024-09-17T05:32:57.758601+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.758601+0000","last_undegraded":"2024-09-17T05:32:57.758601+0000","last_fullsized":"2024-09-17T05:32:57.758601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753567+0000","last_change":"2024-09-17T05:32:57.753567+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753567+0000","last_undegraded":"2024-09-17T05:32:57.753567+0000","last_fullsized":"2024-09-17T05:32:57.753567+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757889+0000","last_change":"2024-09-17T05:32:57.757889+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757889+0000","last_undegraded":"2024-09-17T05:32:57.757889+0000","last_fullsized":"2024-09-17T05:32:57.757889+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.758125+0000","last_change":"2024-09-17T05:32:57.758125+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.758125+0000","last_undegraded":"2024-09-17T05:32:57.758125+0000","last_fullsized":"2024-09-17T05:32:57.758125+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754177+0000","last_change":"2024-09-17T05:32:57.754177+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754177+0000","last_undegraded":"2024-09-17T05:32:57.754177+0000","last_fullsized":"2024-09-17T05:32:57.754177+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762797+0000","last_change":"2024-09-17T05:32:57.762797+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762797+0000","last_undegraded":"2024-09-17T05:32:57.762797+0000","last_fullsized":"2024-09-17T05:32:57.762797+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.756963+0000","last_change":"2024-09-17T05:32:57.756963+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.756963+0000","last_undegraded":"2024-09-17T05:32:57.756963+0000","last_fullsized":"2024-09-17T05:32:57.756963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762382+0000","last_change":"2024-09-17T05:32:57.762382+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762382+0000","last_undegraded":"2024-09-17T05:32:57.762382+0000","last_fullsized":"2024-09-17T05:32:57.762382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753519+0000","last_change":"2024-09-17T05:32:57.753519+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753519+0000","last_undegraded":"2024-09-17T05:32:57.753519+0000","last_fullsized":"2024-09-17T05:32:57.753519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757928+0000","last_change":"2024-09-17T05:32:57.757928+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757928+0000","last_undegraded":"2024-09-17T05:32:57.757928+0000","last_fullsized":"2024-09-17T05:32:57.757928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763037+0000","last_change":"2024-09-17T05:32:57.763037+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763037+0000","last_undegraded":"2024-09-17T05:32:57.763037+0000","last_fullsized":"2024-09-17T05:32:57.763037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.759822+0000","last_change":"2024-09-17T05:32:57.759822+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.759822+0000","last_undegraded":"2024-09-17T05:32:57.759822+0000","last_fullsized":"2024-09-17T05:32:57.759822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753309+0000","last_change":"2024-09-17T05:32:57.753309+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753309+0000","last_undegraded":"2024-09-17T05:32:57.753309+0000","last_fullsized":"2024-09-17T05:32:57.753309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754516+0000","last_change":"2024-09-17T05:32:57.754516+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754516+0000","last_undegraded":"2024-09-17T05:32:57.754516+0000","last_fullsized":"2024-09-17T05:32:57.754516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753049+0000","last_change":"2024-09-17T05:32:57.753049+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753049+0000","last_undegraded":"2024-09-17T05:32:57.753049+0000","last_fullsized":"2024-09-17T05:32:57.753049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.752625+0000","last_change":"2024-09-17T05:32:57.752625+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.752625+0000","last_undegraded":"2024-09-17T05:32:57.752625+0000","last_fullsized":"2024-09-17T05:32:57.752625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.767347+0000","last_change":"2024-09-17T05:32:57.767347+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.767347+0000","last_undegraded":"2024-09-17T05:32:57.767347+0000","last_fullsized":"2024-09-17T05:32:57.767347+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.756506+0000","last_change":"2024-09-17T05:32:57.756506+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.756506+0000","last_undegraded":"2024-09-17T05:32:57.756506+0000","last_fullsized":"2024-09-17T05:32:57.756506+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753352+0000","last_change":"2024-09-17T05:32:57.753352+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753352+0000","last_undegraded":"2024-09-17T05:32:57.753352+0000","last_fullsized":"2024-09-17T05:32:57.753352+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763700+0000","last_change":"2024-09-17T05:32:57.763700+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763700+0000","last_undegraded":"2024-09-17T05:32:57.763700+0000","last_fullsized":"2024-09-17T05:32:57.763700+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760679+0000","last_change":"2024-09-17T05:32:57.760679+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760679+0000","last_undegraded":"2024-09-17T05:32:57.760679+0000","last_fullsized":"2024-09-17T05:32:57.760679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761813+0000","last_change":"2024-09-17T05:32:57.761813+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761813+0000","last_undegraded":"2024-09-17T05:32:57.761813+0000","last_fullsized":"2024-09-17T05:32:57.761813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755954+0000","last_change":"2024-09-17T05:32:57.755954+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755954+0000","last_undegraded":"2024-09-17T05:32:57.755954+0000","last_fullsized":"2024-09-17T05:32:57.755954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763285+0000","last_change":"2024-09-17T05:32:57.763285+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763285+0000","last_undegraded":"2024-09-17T05:32:57.763285+0000","last_fullsized":"2024-09-17T05:32:57.763285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.766238+0000","last_change":"2024-09-17T05:32:57.766238+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.766238+0000","last_undegraded":"2024-09-17T05:32:57.766238+0000","last_fullsized":"2024-09-17T05:32:57.766238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763288+0000","last_change":"2024-09-17T05:32:57.763288+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763288+0000","last_undegraded":"2024-09-17T05:32:57.763288+0000","last_fullsized":"2024-09-17T05:32:57.763288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754918+0000","last_change":"2024-09-17T05:32:57.754918+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754918+0000","last_undegraded":"2024-09-17T05:32:57.754918+0000","last_fullsized":"2024-09-17T05:32:57.754918+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763926+0000","last_change":"2024-09-17T05:32:57.763926+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763926+0000","last_undegraded":"2024-09-17T05:32:57.763926+0000","last_fullsized":"2024-09-17T05:32:57.763926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.766615+0000","last_change":"2024-09-17T05:32:57.760900+0000","last_active":"2024-09-17T05:32:57.766615+0000","last_peered":"2024-09-17T05:32:57.766615+0000","last_clean":"2024-09-17T05:32:57.766615+0000","last_became_active":"2024-09-17T05:32:57.760587+0000","last_became_peered":"2024-09-17T05:32:57.760587+0000","last_unstale":"2024-09-17T05:32:57.766615+0000","last_undegraded":"2024-09-17T05:32:57.766615+0000","last_fullsized":"2024-09-17T05:32:57.766615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:06.976886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755426+0000","last_change":"2024-09-17T05:32:57.755426+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755426+0000","last_undegraded":"2024-09-17T05:32:57.755426+0000","last_fullsized":"2024-09-17T05:32:57.755426+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.781622+0000","last_change":"2024-09-17T05:32:57.778135+0000","last_active":"2024-09-17T05:32:57.781622+0000","last_peered":"2024-09-17T05:32:57.781622+0000","last_clean":"2024-09-17T05:32:57.781622+0000","last_became_active":"2024-09-17T05:32:57.777834+0000","last_became_peered":"2024-09-17T05:32:57.777834+0000","last_unstale":"2024-09-17T05:32:57.781622+0000","last_undegraded":"2024-09-17T05:32:57.781622+0000","last_fullsized":"2024-09-17T05:32:57.781622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:58.249252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754943+0000","last_change":"2024-09-17T05:32:57.754943+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754943+0000","last_undegraded":"2024-09-17T05:32:57.754943+0000","last_fullsized":"2024-09-17T05:32:57.754943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.766132+0000","last_change":"2024-09-17T05:32:57.761438+0000","last_active":"2024-09-17T05:32:57.766132+0000","last_peered":"2024-09-17T05:32:57.766132+0000","last_clean":"2024-09-17T05:32:57.766132+0000","last_became_active":"2024-09-17T05:32:57.761180+0000","last_became_peered":"2024-09-17T05:32:57.761180+0000","last_unstale":"2024-09-17T05:32:57.766132+0000","last_undegraded":"2024-09-17T05:32:57.766132+0000","last_fullsized":"2024-09-17T05:32:57.766132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:38.946220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760016+0000","last_change":"2024-09-17T05:32:57.760016+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760016+0000","last_undegraded":"2024-09-17T05:32:57.760016+0000","last_fullsized":"2024-09-17T05:32:57.760016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.766461+0000","last_change":"2024-09-17T05:32:57.762038+0000","last_active":"2024-09-17T05:32:57.766461+0000","last_peered":"2024-09-17T05:32:57.766461+0000","last_clean":"2024-09-17T05:32:57.766461+0000","last_became_active":"2024-09-17T05:32:57.761027+0000","last_became_peered":"2024-09-17T05:32:57.761027+0000","last_unstale":"2024-09-17T05:32:57.766461+0000","last_undegraded":"2024-09-17T05:32:57.766461+0000","last_fullsized":"2024-09-17T05:32:57.766461+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:19.005013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.764452+0000","last_change":"2024-09-17T05:32:57.764452+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.764452+0000","last_undegraded":"2024-09-17T05:32:57.764452+0000","last_fullsized":"2024-09-17T05:32:57.764452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779784+0000","last_change":"2024-09-17T05:32:57.777503+0000","last_active":"2024-09-17T05:32:57.779784+0000","last_peered":"2024-09-17T05:32:57.779784+0000","last_clean":"2024-09-17T05:32:57.779784+0000","last_became_active":"2024-09-17T05:32:57.777284+0000","last_became_peered":"2024-09-17T05:32:57.777284+0000","last_unstale":"2024-09-17T05:32:57.779784+0000","last_undegraded":"2024-09-17T05:32:57.779784+0000","last_fullsized":"2024-09-17T05:32:57.779784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:13.999564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761289+0000","last_change":"2024-09-17T05:32:57.761289+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761289+0000","last_undegraded":"2024-09-17T05:32:57.761289+0000","last_fullsized":"2024-09-17T05:32:57.761289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.781701+0000","last_change":"2024-09-17T05:32:57.778177+0000","last_active":"2024-09-17T05:32:57.781701+0000","last_peered":"2024-09-17T05:32:57.781701+0000","last_clean":"2024-09-17T05:32:57.781701+0000","last_became_active":"2024-09-17T05:32:57.777881+0000","last_became_peered":"2024-09-17T05:32:57.777881+0000","last_unstale":"2024-09-17T05:32:57.781701+0000","last_undegraded":"2024-09-17T05:32:57.781701+0000","last_fullsized":"2024-09-17T05:32:57.781701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:54.749806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761539+0000","last_change":"2024-09-17T05:32:57.761539+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761539+0000","last_undegraded":"2024-09-17T05:32:57.761539+0000","last_fullsized":"2024-09-17T05:32:57.761539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.771268+0000","last_change":"2024-09-17T05:32:57.765590+0000","last_active":"2024-09-17T05:32:57.771268+0000","last_peered":"2024-09-17T05:32:57.771268+0000","last_clean":"2024-09-17T05:32:57.771268+0000","last_became_active":"2024-09-17T05:32:57.765285+0000","last_became_peered":"2024-09-17T05:32:57.765285+0000","last_unstale":"2024-09-17T05:32:57.771268+0000","last_undegraded":"2024-09-17T05:32:57.771268+0000","last_fullsized":"2024-09-17T05:32:57.771268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.940055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757453+0000","last_change":"2024-09-17T05:32:57.757453+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757453+0000","last_undegraded":"2024-09-17T05:32:57.757453+0000","last_fullsized":"2024-09-17T05:32:57.757453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779745+0000","last_change":"2024-09-17T05:32:57.771325+0000","last_active":"2024-09-17T05:32:57.779745+0000","last_peered":"2024-09-17T05:32:57.779745+0000","last_clean":"2024-09-17T05:32:57.779745+0000","last_became_active":"2024-09-17T05:32:57.771046+0000","last_became_peered":"2024-09-17T05:32:57.771046+0000","last_unstale":"2024-09-17T05:32:57.779745+0000","last_undegraded":"2024-09-17T05:32:57.779745+0000","last_fullsized":"2024-09-17T05:32:57.779745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:01.736307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.758937+0000","last_change":"2024-09-17T05:32:57.758937+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.758937+0000","last_undegraded":"2024-09-17T05:32:57.758937+0000","last_fullsized":"2024-09-17T05:32:57.758937+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779585+0000","last_change":"2024-09-17T05:32:57.775051+0000","last_active":"2024-09-17T05:32:57.779585+0000","last_peered":"2024-09-17T05:32:57.779585+0000","last_clean":"2024-09-17T05:32:57.779585+0000","last_became_active":"2024-09-17T05:32:57.774665+0000","last_became_peered":"2024-09-17T05:32:57.774665+0000","last_unstale":"2024-09-17T05:32:57.779585+0000","last_undegraded":"2024-09-17T05:32:57.779585+0000","last_fullsized":"2024-09-17T05:32:57.779585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:53.510499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757590+0000","last_change":"2024-09-17T05:32:57.757590+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757590+0000","last_undegraded":"2024-09-17T05:32:57.757590+0000","last_fullsized":"2024-09-17T05:32:57.757590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.777934+0000","last_change":"2024-09-17T05:32:57.771838+0000","last_active":"2024-09-17T05:32:57.777934+0000","last_peered":"2024-09-17T05:32:57.777934+0000","last_clean":"2024-09-17T05:32:57.777934+0000","last_became_active":"2024-09-17T05:32:57.771585+0000","last_became_peered":"2024-09-17T05:32:57.771585+0000","last_unstale":"2024-09-17T05:32:57.777934+0000","last_undegraded":"2024-09-17T05:32:57.777934+0000","last_fullsized":"2024-09-17T05:32:57.777934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:21.653529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755598+0000","last_change":"2024-09-17T05:32:57.755598+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755598+0000","last_undegraded":"2024-09-17T05:32:57.755598+0000","last_fullsized":"2024-09-17T05:32:57.755598+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779493+0000","last_change":"2024-09-17T05:32:57.774796+0000","last_active":"2024-09-17T05:32:57.779493+0000","last_peered":"2024-09-17T05:32:57.779493+0000","last_clean":"2024-09-17T05:32:57.779493+0000","last_became_active":"2024-09-17T05:32:57.774446+0000","last_became_peered":"2024-09-17T05:32:57.774446+0000","last_unstale":"2024-09-17T05:32:57.779493+0000","last_undegraded":"2024-09-17T05:32:57.779493+0000","last_fullsized":"2024-09-17T05:32:57.779493+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:29.699013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761416+0000","last_change":"2024-09-17T05:32:57.761416+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761416+0000","last_undegraded":"2024-09-17T05:32:57.761416+0000","last_fullsized":"2024-09-17T05:32:57.761416+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.778451+0000","last_change":"2024-09-17T05:32:57.772140+0000","last_active":"2024-09-17T05:32:57.778451+0000","last_peered":"2024-09-17T05:32:57.778451+0000","last_clean":"2024-09-17T05:32:57.778451+0000","last_became_active":"2024-09-17T05:32:57.771854+0000","last_became_peered":"2024-09-17T05:32:57.771854+0000","last_unstale":"2024-09-17T05:32:57.778451+0000","last_undegraded":"2024-09-17T05:32:57.778451+0000","last_fullsized":"2024-09-17T05:32:57.778451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:28.491950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757067+0000","last_change":"2024-09-17T05:32:57.757067+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757067+0000","last_undegraded":"2024-09-17T05:32:57.757067+0000","last_fullsized":"2024-09-17T05:32:57.757067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.780784+0000","last_change":"2024-09-17T05:32:57.776757+0000","last_active":"2024-09-17T05:32:57.780784+0000","last_peered":"2024-09-17T05:32:57.780784+0000","last_clean":"2024-09-17T05:32:57.780784+0000","last_became_active":"2024-09-17T05:32:57.776494+0000","last_became_peered":"2024-09-17T05:32:57.776494+0000","last_unstale":"2024-09-17T05:32:57.780784+0000","last_undegraded":"2024-09-17T05:32:57.780784+0000","last_fullsized":"2024-09-17T05:32:57.780784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:19.493595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761967+0000","last_change":"2024-09-17T05:32:57.761967+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761967+0000","last_undegraded":"2024-09-17T05:32:57.761967+0000","last_fullsized":"2024-09-17T05:32:57.761967+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779356+0000","last_change":"2024-09-17T05:32:57.778389+0000","last_active":"2024-09-17T05:32:57.779356+0000","last_peered":"2024-09-17T05:32:57.779356+0000","last_clean":"2024-09-17T05:32:57.779356+0000","last_became_active":"2024-09-17T05:32:57.778131+0000","last_became_peered":"2024-09-17T05:32:57.778131+0000","last_unstale":"2024-09-17T05:32:57.779356+0000","last_undegraded":"2024-09-17T05:32:57.779356+0000","last_fullsized":"2024-09-17T05:32:57.779356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:36.171166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762526+0000","last_change":"2024-09-17T05:32:57.762526+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762526+0000","last_undegraded":"2024-09-17T05:32:57.762526+0000","last_fullsized":"2024-09-17T05:32:57.762526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.778648+0000","last_change":"2024-09-17T05:32:57.773894+0000","last_active":"2024-09-17T05:32:57.778648+0000","last_peered":"2024-09-17T05:32:57.778648+0000","last_clean":"2024-09-17T05:32:57.778648+0000","last_became_active":"2024-09-17T05:32:57.772427+0000","last_became_peered":"2024-09-17T05:32:57.772427+0000","last_unstale":"2024-09-17T05:32:57.778648+0000","last_undegraded":"2024-09-17T05:32:57.778648+0000","last_fullsized":"2024-09-17T05:32:57.778648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:04.368779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762540+0000","last_change":"2024-09-17T05:32:57.762540+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762540+0000","last_undegraded":"2024-09-17T05:32:57.762540+0000","last_fullsized":"2024-09-17T05:32:57.762540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.775369+0000","last_change":"2024-09-17T05:32:57.772094+0000","last_active":"2024-09-17T05:32:57.775369+0000","last_peered":"2024-09-17T05:32:57.775369+0000","last_clean":"2024-09-17T05:32:57.775369+0000","last_became_active":"2024-09-17T05:32:57.771783+0000","last_became_peered":"2024-09-17T05:32:57.771783+0000","last_unstale":"2024-09-17T05:32:57.775369+0000","last_undegraded":"2024-09-17T05:32:57.775369+0000","last_fullsized":"2024-09-17T05:32:57.775369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:59.096504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760159+0000","last_change":"2024-09-17T05:32:57.760159+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760159+0000","last_undegraded":"2024-09-17T05:32:57.760159+0000","last_fullsized":"2024-09-17T05:32:57.760159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.773750+0000","last_change":"2024-09-17T05:32:57.768304+0000","last_active":"2024-09-17T05:32:57.773750+0000","last_peered":"2024-09-17T05:32:57.773750+0000","last_clean":"2024-09-17T05:32:57.773750+0000","last_became_active":"2024-09-17T05:32:57.767994+0000","last_became_peered":"2024-09-17T05:32:57.767994+0000","last_unstale":"2024-09-17T05:32:57.773750+0000","last_undegraded":"2024-09-17T05:32:57.773750+0000","last_fullsized":"2024-09-17T05:32:57.773750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:02.910711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754847+0000","last_change":"2024-09-17T05:32:57.754847+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754847+0000","last_undegraded":"2024-09-17T05:32:57.754847+0000","last_fullsized":"2024-09-17T05:32:57.754847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.775322+0000","last_change":"2024-09-17T05:32:57.771902+0000","last_active":"2024-09-17T05:32:57.775322+0000","last_peered":"2024-09-17T05:32:57.775322+0000","last_clean":"2024-09-17T05:32:57.775322+0000","last_became_active":"2024-09-17T05:32:57.770752+0000","last_became_peered":"2024-09-17T05:32:57.770752+0000","last_unstale":"2024-09-17T05:32:57.775322+0000","last_undegraded":"2024-09-17T05:32:57.775322+0000","last_fullsized":"2024-09-17T05:32:57.775322+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:25.208627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760971+0000","last_change":"2024-09-17T05:32:57.760971+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760971+0000","last_undegraded":"2024-09-17T05:32:57.760971+0000","last_fullsized":"2024-09-17T05:32:57.760971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.769125+0000","last_change":"2024-09-17T05:32:57.766899+0000","last_active":"2024-09-17T05:32:57.769125+0000","last_peered":"2024-09-17T05:32:57.769125+0000","last_clean":"2024-09-17T05:32:57.769125+0000","last_became_active":"2024-09-17T05:32:57.766580+0000","last_became_peered":"2024-09-17T05:32:57.766580+0000","last_unstale":"2024-09-17T05:32:57.769125+0000","last_undegraded":"2024-09-17T05:32:57.769125+0000","last_fullsized":"2024-09-17T05:32:57.769125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:28.491950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753009+0000","last_change":"2024-09-17T05:32:57.753009+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753009+0000","last_undegraded":"2024-09-17T05:32:57.753009+0000","last_fullsized":"2024-09-17T05:32:57.753009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.777774+0000","last_change":"2024-09-17T05:32:57.773771+0000","last_active":"2024-09-17T05:32:57.777774+0000","last_peered":"2024-09-17T05:32:57.777774+0000","last_clean":"2024-09-17T05:32:57.777774+0000","last_became_active":"2024-09-17T05:32:57.773415+0000","last_became_peered":"2024-09-17T05:32:57.773415+0000","last_unstale":"2024-09-17T05:32:57.777774+0000","last_undegraded":"2024-09-17T05:32:57.777774+0000","last_fullsized":"2024-09-17T05:32:57.777774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:57.411171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.759045+0000","last_change":"2024-09-17T05:32:57.759045+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.759045+0000","last_undegraded":"2024-09-17T05:32:57.759045+0000","last_fullsized":"2024-09-17T05:32:57.759045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.763776+0000","last_change":"2024-09-17T05:32:57.761461+0000","last_active":"2024-09-17T05:32:57.763776+0000","last_peered":"2024-09-17T05:32:57.763776+0000","last_clean":"2024-09-17T05:32:57.763776+0000","last_became_active":"2024-09-17T05:32:57.760904+0000","last_became_peered":"2024-09-17T05:32:57.760904+0000","last_unstale":"2024-09-17T05:32:57.763776+0000","last_undegraded":"2024-09-17T05:32:57.763776+0000","last_fullsized":"2024-09-17T05:32:57.763776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:52.806367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.752757+0000","last_change":"2024-09-17T05:32:57.752757+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.752757+0000","last_undegraded":"2024-09-17T05:32:57.752757+0000","last_fullsized":"2024-09-17T05:32:57.752757+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.772460+0000","last_change":"2024-09-17T05:32:57.763654+0000","last_active":"2024-09-17T05:32:57.772460+0000","last_peered":"2024-09-17T05:32:57.772460+0000","last_clean":"2024-09-17T05:32:57.772460+0000","last_became_active":"2024-09-17T05:32:57.763354+0000","last_became_peered":"2024-09-17T05:32:57.763354+0000","last_unstale":"2024-09-17T05:32:57.772460+0000","last_undegraded":"2024-09-17T05:32:57.772460+0000","last_fullsized":"2024-09-17T05:32:57.772460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:14.190039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757396+0000","last_change":"2024-09-17T05:32:57.757396+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757396+0000","last_undegraded":"2024-09-17T05:32:57.757396+0000","last_fullsized":"2024-09-17T05:32:57.757396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.777802+0000","last_change":"2024-09-17T05:32:57.773774+0000","last_active":"2024-09-17T05:32:57.777802+0000","last_peered":"2024-09-17T05:32:57.777802+0000","last_clean":"2024-09-17T05:32:57.777802+0000","last_became_active":"2024-09-17T05:32:57.773506+0000","last_became_peered":"2024-09-17T05:32:57.773506+0000","last_unstale":"2024-09-17T05:32:57.777802+0000","last_undegraded":"2024-09-17T05:32:57.777802+0000","last_fullsized":"2024-09-17T05:32:57.777802+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:12.669688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763511+0000","last_change":"2024-09-17T05:32:57.763511+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763511+0000","last_undegraded":"2024-09-17T05:32:57.763511+0000","last_fullsized":"2024-09-17T05:32:57.763511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.780826+0000","last_change":"2024-09-17T05:32:57.777118+0000","last_active":"2024-09-17T05:32:57.780826+0000","last_peered":"2024-09-17T05:32:57.780826+0000","last_clean":"2024-09-17T05:32:57.780826+0000","last_became_active":"2024-09-17T05:32:57.776868+0000","last_became_peered":"2024-09-17T05:32:57.776868+0000","last_unstale":"2024-09-17T05:32:57.780826+0000","last_undegraded":"2024-09-17T05:32:57.780826+0000","last_fullsized":"2024-09-17T05:32:57.780826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:08.376907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760675+0000","last_change":"2024-09-17T05:32:57.760675+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760675+0000","last_undegraded":"2024-09-17T05:32:57.760675+0000","last_fullsized":"2024-09-17T05:32:57.760675+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.780764+0000","last_change":"2024-09-17T05:32:57.776327+0000","last_active":"2024-09-17T05:32:57.780764+0000","last_peered":"2024-09-17T05:32:57.780764+0000","last_clean":"2024-09-17T05:32:57.780764+0000","last_became_active":"2024-09-17T05:32:57.776010+0000","last_became_peered":"2024-09-17T05:32:57.776010+0000","last_unstale":"2024-09-17T05:32:57.780764+0000","last_undegraded":"2024-09-17T05:32:57.780764+0000","last_fullsized":"2024-09-17T05:32:57.780764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:15.914318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754058+0000","last_change":"2024-09-17T05:32:57.754058+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754058+0000","last_undegraded":"2024-09-17T05:32:57.754058+0000","last_fullsized":"2024-09-17T05:32:57.754058+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.774319+0000","last_change":"2024-09-17T05:32:57.768914+0000","last_active":"2024-09-17T05:32:57.774319+0000","last_peered":"2024-09-17T05:32:57.774319+0000","last_clean":"2024-09-17T05:32:57.774319+0000","last_became_active":"2024-09-17T05:32:57.768542+0000","last_became_peered":"2024-09-17T05:32:57.768542+0000","last_unstale":"2024-09-17T05:32:57.774319+0000","last_undegraded":"2024-09-17T05:32:57.774319+0000","last_fullsized":"2024-09-17T05:32:57.774319+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:09.689707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760460+0000","last_change":"2024-09-17T05:32:57.760460+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760460+0000","last_undegraded":"2024-09-17T05:32:57.760460+0000","last_fullsized":"2024-09-17T05:32:57.760460+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.778204+0000","last_change":"2024-09-17T05:32:57.771755+0000","last_active":"2024-09-17T05:32:57.778204+0000","last_peered":"2024-09-17T05:32:57.778204+0000","last_clean":"2024-09-17T05:32:57.778204+0000","last_became_active":"2024-09-17T05:32:57.771463+0000","last_became_peered":"2024-09-17T05:32:57.771463+0000","last_unstale":"2024-09-17T05:32:57.778204+0000","last_undegraded":"2024-09-17T05:32:57.778204+0000","last_fullsized":"2024-09-17T05:32:57.778204+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:08.734245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.758158+0000","last_change":"2024-09-17T05:32:57.758158+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.758158+0000","last_undegraded":"2024-09-17T05:32:57.758158+0000","last_fullsized":"2024-09-17T05:32:57.758158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.773094+0000","last_change":"2024-09-17T05:32:57.768309+0000","last_active":"2024-09-17T05:32:57.773094+0000","last_peered":"2024-09-17T05:32:57.773094+0000","last_clean":"2024-09-17T05:32:57.773094+0000","last_became_active":"2024-09-17T05:32:57.767986+0000","last_became_peered":"2024-09-17T05:32:57.767986+0000","last_unstale":"2024-09-17T05:32:57.773094+0000","last_undegraded":"2024-09-17T05:32:57.773094+0000","last_fullsized":"2024-09-17T05:32:57.773094+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:04.368779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.756482+0000","last_change":"2024-09-17T05:32:57.756482+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.756482+0000","last_undegraded":"2024-09-17T05:32:57.756482+0000","last_fullsized":"2024-09-17T05:32:57.756482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.781719+0000","last_change":"2024-09-17T05:32:57.778896+0000","last_active":"2024-09-17T05:32:57.781719+0000","last_peered":"2024-09-17T05:32:57.781719+0000","last_clean":"2024-09-17T05:32:57.781719+0000","last_became_active":"2024-09-17T05:32:57.778580+0000","last_became_peered":"2024-09-17T05:32:57.778580+0000","last_unstale":"2024-09-17T05:32:57.781719+0000","last_undegraded":"2024-09-17T05:32:57.781719+0000","last_fullsized":"2024-09-17T05:32:57.781719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:07.087245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761077+0000","last_change":"2024-09-17T05:32:57.761077+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761077+0000","last_undegraded":"2024-09-17T05:32:57.761077+0000","last_fullsized":"2024-09-17T05:32:57.761077+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.778924+0000","last_change":"2024-09-17T05:32:57.772499+0000","last_active":"2024-09-17T05:32:57.778924+0000","last_peered":"2024-09-17T05:32:57.778924+0000","last_clean":"2024-09-17T05:32:57.778924+0000","last_became_active":"2024-09-17T05:32:57.771365+0000","last_became_peered":"2024-09-17T05:32:57.771365+0000","last_unstale":"2024-09-17T05:32:57.778924+0000","last_undegraded":"2024-09-17T05:32:57.778924+0000","last_fullsized":"2024-09-17T05:32:57.778924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:14.447613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755969+0000","last_change":"2024-09-17T05:32:57.755969+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755969+0000","last_undegraded":"2024-09-17T05:32:57.755969+0000","last_fullsized":"2024-09-17T05:32:57.755969+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.773897+0000","last_change":"2024-09-17T05:32:57.771832+0000","last_active":"2024-09-17T05:32:57.773897+0000","last_peered":"2024-09-17T05:32:57.773897+0000","last_clean":"2024-09-17T05:32:57.773897+0000","last_became_active":"2024-09-17T05:32:57.771626+0000","last_became_peered":"2024-09-17T05:32:57.771626+0000","last_unstale":"2024-09-17T05:32:57.773897+0000","last_undegraded":"2024-09-17T05:32:57.773897+0000","last_fullsized":"2024-09-17T05:32:57.773897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:03.616777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.759581+0000","last_change":"2024-09-17T05:32:57.759581+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.759581+0000","last_undegraded":"2024-09-17T05:32:57.759581+0000","last_fullsized":"2024-09-17T05:32:57.759581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779846+0000","last_change":"2024-09-17T05:32:57.776993+0000","last_active":"2024-09-17T05:32:57.779846+0000","last_peered":"2024-09-17T05:32:57.779846+0000","last_clean":"2024-09-17T05:32:57.779846+0000","last_became_active":"2024-09-17T05:32:57.776706+0000","last_became_peered":"2024-09-17T05:32:57.776706+0000","last_unstale":"2024-09-17T05:32:57.779846+0000","last_undegraded":"2024-09-17T05:32:57.779846+0000","last_fullsized":"2024-09-17T05:32:57.779846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:56.859681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":244,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.764715+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:32:57.764715+0000","last_peered":"2024-09-17T05:32:57.764715+0000","last_clean":"2024-09-17T05:32:57.764715+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:32:57.764715+0000","last_undegraded":"2024-09-17T05:32:57.764715+0000","last_fullsized":"2024-09-17T05:32:57.764715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1556480,"data_stored":997954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542200,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509497,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509497,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542199,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1556480,"data_stored":997954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:33:03.755 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3f is not active+clean 2024-09-17T05:33:03.755 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.755959+0000', 'last_change': '2024-09-17T05:32:57.755959+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.755959+0000', 'last_undegraded': '2024-09-17T05:32:57.755959+0000', 'last_fullsized': '2024-09-17T05:32:57.755959+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:33:03.755 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3e is not active+clean 2024-09-17T05:33:03.755 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.764081+0000', 'last_change': '2024-09-17T05:32:57.764081+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.764081+0000', 'last_undegraded': '2024-09-17T05:32:57.764081+0000', 'last_fullsized': '2024-09-17T05:32:57.764081+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:33:03.755 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3d is not active+clean 2024-09-17T05:33:03.755 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.762055+0000', 'last_change': '2024-09-17T05:32:57.762055+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.762055+0000', 'last_undegraded': '2024-09-17T05:32:57.762055+0000', 'last_fullsized': '2024-09-17T05:32:57.762055+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:33:03.755 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3c is not active+clean 2024-09-17T05:33:03.755 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.754455+0000', 'last_change': '2024-09-17T05:32:57.754455+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.754455+0000', 'last_undegraded': '2024-09-17T05:32:57.754455+0000', 'last_fullsized': '2024-09-17T05:32:57.754455+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:33:03.756 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3b is not active+clean 2024-09-17T05:33:03.756 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.761721+0000', 'last_change': '2024-09-17T05:32:57.761721+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.761721+0000', 'last_undegraded': '2024-09-17T05:32:57.761721+0000', 'last_fullsized': '2024-09-17T05:32:57.761721+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:33:03.756 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3a is not active+clean 2024-09-17T05:33:03.756 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.758601+0000', 'last_change': '2024-09-17T05:32:57.758601+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.758601+0000', 'last_undegraded': '2024-09-17T05:32:57.758601+0000', 'last_fullsized': '2024-09-17T05:32:57.758601+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:33:03.756 INFO:tasks.ceph.ceph_manager.ceph:PG 13.39 is not active+clean 2024-09-17T05:33:03.756 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.753567+0000', 'last_change': '2024-09-17T05:32:57.753567+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.753567+0000', 'last_undegraded': '2024-09-17T05:32:57.753567+0000', 'last_fullsized': '2024-09-17T05:32:57.753567+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:33:03.756 INFO:tasks.ceph.ceph_manager.ceph:PG 13.38 is not active+clean 2024-09-17T05:33:03.756 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.757889+0000', 'last_change': '2024-09-17T05:32:57.757889+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.757889+0000', 'last_undegraded': '2024-09-17T05:32:57.757889+0000', 'last_fullsized': '2024-09-17T05:32:57.757889+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:33:03.756 INFO:tasks.ceph.ceph_manager.ceph:PG 13.37 is not active+clean 2024-09-17T05:33:03.756 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.758125+0000', 'last_change': '2024-09-17T05:32:57.758125+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.758125+0000', 'last_undegraded': '2024-09-17T05:32:57.758125+0000', 'last_fullsized': '2024-09-17T05:32:57.758125+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:33:03.756 INFO:tasks.ceph.ceph_manager.ceph:PG 13.36 is not active+clean 2024-09-17T05:33:03.756 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.754177+0000', 'last_change': '2024-09-17T05:32:57.754177+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.754177+0000', 'last_undegraded': '2024-09-17T05:32:57.754177+0000', 'last_fullsized': '2024-09-17T05:32:57.754177+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:33:03.757 INFO:tasks.ceph.ceph_manager.ceph:PG 13.35 is not active+clean 2024-09-17T05:33:03.757 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.762797+0000', 'last_change': '2024-09-17T05:32:57.762797+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.762797+0000', 'last_undegraded': '2024-09-17T05:32:57.762797+0000', 'last_fullsized': '2024-09-17T05:32:57.762797+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:33:03.757 INFO:tasks.ceph.ceph_manager.ceph:PG 13.34 is not active+clean 2024-09-17T05:33:03.757 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.756963+0000', 'last_change': '2024-09-17T05:32:57.756963+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.756963+0000', 'last_undegraded': '2024-09-17T05:32:57.756963+0000', 'last_fullsized': '2024-09-17T05:32:57.756963+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:33:03.757 INFO:tasks.ceph.ceph_manager.ceph:PG 13.33 is not active+clean 2024-09-17T05:33:03.757 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.762382+0000', 'last_change': '2024-09-17T05:32:57.762382+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.762382+0000', 'last_undegraded': '2024-09-17T05:32:57.762382+0000', 'last_fullsized': '2024-09-17T05:32:57.762382+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:33:03.757 INFO:tasks.ceph.ceph_manager.ceph:PG 13.32 is not active+clean 2024-09-17T05:33:03.757 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.753519+0000', 'last_change': '2024-09-17T05:32:57.753519+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.753519+0000', 'last_undegraded': '2024-09-17T05:32:57.753519+0000', 'last_fullsized': '2024-09-17T05:32:57.753519+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:33:03.757 INFO:tasks.ceph.ceph_manager.ceph:PG 13.31 is not active+clean 2024-09-17T05:33:03.757 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.757928+0000', 'last_change': '2024-09-17T05:32:57.757928+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.757928+0000', 'last_undegraded': '2024-09-17T05:32:57.757928+0000', 'last_fullsized': '2024-09-17T05:32:57.757928+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:33:03.757 INFO:tasks.ceph.ceph_manager.ceph:PG 13.30 is not active+clean 2024-09-17T05:33:03.758 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.763037+0000', 'last_change': '2024-09-17T05:32:57.763037+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.763037+0000', 'last_undegraded': '2024-09-17T05:32:57.763037+0000', 'last_fullsized': '2024-09-17T05:32:57.763037+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:33:03.758 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2f is not active+clean 2024-09-17T05:33:03.758 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.759822+0000', 'last_change': '2024-09-17T05:32:57.759822+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.759822+0000', 'last_undegraded': '2024-09-17T05:32:57.759822+0000', 'last_fullsized': '2024-09-17T05:32:57.759822+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:33:03.758 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2e is not active+clean 2024-09-17T05:33:03.758 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.753309+0000', 'last_change': '2024-09-17T05:32:57.753309+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.753309+0000', 'last_undegraded': '2024-09-17T05:32:57.753309+0000', 'last_fullsized': '2024-09-17T05:32:57.753309+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:33:03.758 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2d is not active+clean 2024-09-17T05:33:03.758 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.754516+0000', 'last_change': '2024-09-17T05:32:57.754516+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.754516+0000', 'last_undegraded': '2024-09-17T05:32:57.754516+0000', 'last_fullsized': '2024-09-17T05:32:57.754516+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:33:03.758 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2c is not active+clean 2024-09-17T05:33:03.758 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.753049+0000', 'last_change': '2024-09-17T05:32:57.753049+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.753049+0000', 'last_undegraded': '2024-09-17T05:32:57.753049+0000', 'last_fullsized': '2024-09-17T05:32:57.753049+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:33:03.758 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2b is not active+clean 2024-09-17T05:33:03.758 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.752625+0000', 'last_change': '2024-09-17T05:32:57.752625+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.752625+0000', 'last_undegraded': '2024-09-17T05:32:57.752625+0000', 'last_fullsized': '2024-09-17T05:32:57.752625+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:33:03.758 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2a is not active+clean 2024-09-17T05:33:03.759 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.767347+0000', 'last_change': '2024-09-17T05:32:57.767347+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.767347+0000', 'last_undegraded': '2024-09-17T05:32:57.767347+0000', 'last_fullsized': '2024-09-17T05:32:57.767347+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:33:03.759 INFO:tasks.ceph.ceph_manager.ceph:PG 13.29 is not active+clean 2024-09-17T05:33:03.759 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.756506+0000', 'last_change': '2024-09-17T05:32:57.756506+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.756506+0000', 'last_undegraded': '2024-09-17T05:32:57.756506+0000', 'last_fullsized': '2024-09-17T05:32:57.756506+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:33:03.759 INFO:tasks.ceph.ceph_manager.ceph:PG 13.28 is not active+clean 2024-09-17T05:33:03.759 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.753352+0000', 'last_change': '2024-09-17T05:32:57.753352+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.753352+0000', 'last_undegraded': '2024-09-17T05:32:57.753352+0000', 'last_fullsized': '2024-09-17T05:32:57.753352+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:33:03.759 INFO:tasks.ceph.ceph_manager.ceph:PG 13.27 is not active+clean 2024-09-17T05:33:03.759 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.763700+0000', 'last_change': '2024-09-17T05:32:57.763700+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.763700+0000', 'last_undegraded': '2024-09-17T05:32:57.763700+0000', 'last_fullsized': '2024-09-17T05:32:57.763700+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:33:03.759 INFO:tasks.ceph.ceph_manager.ceph:PG 13.26 is not active+clean 2024-09-17T05:33:03.759 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.760679+0000', 'last_change': '2024-09-17T05:32:57.760679+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.760679+0000', 'last_undegraded': '2024-09-17T05:32:57.760679+0000', 'last_fullsized': '2024-09-17T05:32:57.760679+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:33:03.759 INFO:tasks.ceph.ceph_manager.ceph:PG 13.25 is not active+clean 2024-09-17T05:33:03.759 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.761813+0000', 'last_change': '2024-09-17T05:32:57.761813+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.761813+0000', 'last_undegraded': '2024-09-17T05:32:57.761813+0000', 'last_fullsized': '2024-09-17T05:32:57.761813+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:33:03.759 INFO:tasks.ceph.ceph_manager.ceph:PG 13.24 is not active+clean 2024-09-17T05:33:03.760 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.755954+0000', 'last_change': '2024-09-17T05:32:57.755954+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.755954+0000', 'last_undegraded': '2024-09-17T05:32:57.755954+0000', 'last_fullsized': '2024-09-17T05:32:57.755954+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:33:03.760 INFO:tasks.ceph.ceph_manager.ceph:PG 13.23 is not active+clean 2024-09-17T05:33:03.760 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.763285+0000', 'last_change': '2024-09-17T05:32:57.763285+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.763285+0000', 'last_undegraded': '2024-09-17T05:32:57.763285+0000', 'last_fullsized': '2024-09-17T05:32:57.763285+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:33:03.760 INFO:tasks.ceph.ceph_manager.ceph:PG 13.22 is not active+clean 2024-09-17T05:33:03.760 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.766238+0000', 'last_change': '2024-09-17T05:32:57.766238+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.766238+0000', 'last_undegraded': '2024-09-17T05:32:57.766238+0000', 'last_fullsized': '2024-09-17T05:32:57.766238+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:33:03.760 INFO:tasks.ceph.ceph_manager.ceph:PG 13.21 is not active+clean 2024-09-17T05:33:03.760 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.763288+0000', 'last_change': '2024-09-17T05:32:57.763288+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.763288+0000', 'last_undegraded': '2024-09-17T05:32:57.763288+0000', 'last_fullsized': '2024-09-17T05:32:57.763288+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:33:03.761 INFO:tasks.ceph.ceph_manager.ceph:PG 13.20 is not active+clean 2024-09-17T05:33:03.761 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.754918+0000', 'last_change': '2024-09-17T05:32:57.754918+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.754918+0000', 'last_undegraded': '2024-09-17T05:32:57.754918+0000', 'last_fullsized': '2024-09-17T05:32:57.754918+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:33:03.761 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1e is not active+clean 2024-09-17T05:33:03.761 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.763926+0000', 'last_change': '2024-09-17T05:32:57.763926+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.763926+0000', 'last_undegraded': '2024-09-17T05:32:57.763926+0000', 'last_fullsized': '2024-09-17T05:32:57.763926+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:33:03.761 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1f is not active+clean 2024-09-17T05:33:03.761 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.755426+0000', 'last_change': '2024-09-17T05:32:57.755426+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.755426+0000', 'last_undegraded': '2024-09-17T05:32:57.755426+0000', 'last_fullsized': '2024-09-17T05:32:57.755426+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:33:03.761 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1c is not active+clean 2024-09-17T05:33:03.761 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.754943+0000', 'last_change': '2024-09-17T05:32:57.754943+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.754943+0000', 'last_undegraded': '2024-09-17T05:32:57.754943+0000', 'last_fullsized': '2024-09-17T05:32:57.754943+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:33:03.761 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1d is not active+clean 2024-09-17T05:33:03.761 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.760016+0000', 'last_change': '2024-09-17T05:32:57.760016+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.760016+0000', 'last_undegraded': '2024-09-17T05:32:57.760016+0000', 'last_fullsized': '2024-09-17T05:32:57.760016+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:33:03.761 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1a is not active+clean 2024-09-17T05:33:03.762 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.764452+0000', 'last_change': '2024-09-17T05:32:57.764452+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.764452+0000', 'last_undegraded': '2024-09-17T05:32:57.764452+0000', 'last_fullsized': '2024-09-17T05:32:57.764452+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:33:03.762 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1b is not active+clean 2024-09-17T05:33:03.762 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.761289+0000', 'last_change': '2024-09-17T05:32:57.761289+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.761289+0000', 'last_undegraded': '2024-09-17T05:32:57.761289+0000', 'last_fullsized': '2024-09-17T05:32:57.761289+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:33:03.762 INFO:tasks.ceph.ceph_manager.ceph:PG 13.18 is not active+clean 2024-09-17T05:33:03.762 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.761539+0000', 'last_change': '2024-09-17T05:32:57.761539+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.761539+0000', 'last_undegraded': '2024-09-17T05:32:57.761539+0000', 'last_fullsized': '2024-09-17T05:32:57.761539+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:33:03.762 INFO:tasks.ceph.ceph_manager.ceph:PG 13.19 is not active+clean 2024-09-17T05:33:03.762 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.757453+0000', 'last_change': '2024-09-17T05:32:57.757453+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.757453+0000', 'last_undegraded': '2024-09-17T05:32:57.757453+0000', 'last_fullsized': '2024-09-17T05:32:57.757453+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:33:03.762 INFO:tasks.ceph.ceph_manager.ceph:PG 13.16 is not active+clean 2024-09-17T05:33:03.762 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.758937+0000', 'last_change': '2024-09-17T05:32:57.758937+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.758937+0000', 'last_undegraded': '2024-09-17T05:32:57.758937+0000', 'last_fullsized': '2024-09-17T05:32:57.758937+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:33:03.762 INFO:tasks.ceph.ceph_manager.ceph:PG 13.17 is not active+clean 2024-09-17T05:33:03.762 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.757590+0000', 'last_change': '2024-09-17T05:32:57.757590+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.757590+0000', 'last_undegraded': '2024-09-17T05:32:57.757590+0000', 'last_fullsized': '2024-09-17T05:32:57.757590+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:33:03.763 INFO:tasks.ceph.ceph_manager.ceph:PG 13.14 is not active+clean 2024-09-17T05:33:03.763 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.755598+0000', 'last_change': '2024-09-17T05:32:57.755598+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.755598+0000', 'last_undegraded': '2024-09-17T05:32:57.755598+0000', 'last_fullsized': '2024-09-17T05:32:57.755598+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:33:03.763 INFO:tasks.ceph.ceph_manager.ceph:PG 13.15 is not active+clean 2024-09-17T05:33:03.763 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.761416+0000', 'last_change': '2024-09-17T05:32:57.761416+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.761416+0000', 'last_undegraded': '2024-09-17T05:32:57.761416+0000', 'last_fullsized': '2024-09-17T05:32:57.761416+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:33:03.763 INFO:tasks.ceph.ceph_manager.ceph:PG 13.12 is not active+clean 2024-09-17T05:33:03.763 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.757067+0000', 'last_change': '2024-09-17T05:32:57.757067+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.757067+0000', 'last_undegraded': '2024-09-17T05:32:57.757067+0000', 'last_fullsized': '2024-09-17T05:32:57.757067+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:33:03.763 INFO:tasks.ceph.ceph_manager.ceph:PG 13.13 is not active+clean 2024-09-17T05:33:03.763 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.761967+0000', 'last_change': '2024-09-17T05:32:57.761967+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.761967+0000', 'last_undegraded': '2024-09-17T05:32:57.761967+0000', 'last_fullsized': '2024-09-17T05:32:57.761967+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:33:03.763 INFO:tasks.ceph.ceph_manager.ceph:PG 13.10 is not active+clean 2024-09-17T05:33:03.763 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.762526+0000', 'last_change': '2024-09-17T05:32:57.762526+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.762526+0000', 'last_undegraded': '2024-09-17T05:32:57.762526+0000', 'last_fullsized': '2024-09-17T05:32:57.762526+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:33:03.763 INFO:tasks.ceph.ceph_manager.ceph:PG 13.11 is not active+clean 2024-09-17T05:33:03.764 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.762540+0000', 'last_change': '2024-09-17T05:32:57.762540+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.762540+0000', 'last_undegraded': '2024-09-17T05:32:57.762540+0000', 'last_fullsized': '2024-09-17T05:32:57.762540+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:33:03.764 INFO:tasks.ceph.ceph_manager.ceph:PG 13.e is not active+clean 2024-09-17T05:33:03.764 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.760159+0000', 'last_change': '2024-09-17T05:32:57.760159+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.760159+0000', 'last_undegraded': '2024-09-17T05:32:57.760159+0000', 'last_fullsized': '2024-09-17T05:32:57.760159+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:33:03.764 INFO:tasks.ceph.ceph_manager.ceph:PG 13.f is not active+clean 2024-09-17T05:33:03.764 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.754847+0000', 'last_change': '2024-09-17T05:32:57.754847+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.754847+0000', 'last_undegraded': '2024-09-17T05:32:57.754847+0000', 'last_fullsized': '2024-09-17T05:32:57.754847+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:33:03.764 INFO:tasks.ceph.ceph_manager.ceph:PG 13.d is not active+clean 2024-09-17T05:33:03.764 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.760971+0000', 'last_change': '2024-09-17T05:32:57.760971+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.760971+0000', 'last_undegraded': '2024-09-17T05:32:57.760971+0000', 'last_fullsized': '2024-09-17T05:32:57.760971+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:33:03.765 INFO:tasks.ceph.ceph_manager.ceph:PG 13.a is not active+clean 2024-09-17T05:33:03.765 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.753009+0000', 'last_change': '2024-09-17T05:32:57.753009+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.753009+0000', 'last_undegraded': '2024-09-17T05:32:57.753009+0000', 'last_fullsized': '2024-09-17T05:32:57.753009+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:33:03.765 INFO:tasks.ceph.ceph_manager.ceph:PG 13.b is not active+clean 2024-09-17T05:33:03.765 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.759045+0000', 'last_change': '2024-09-17T05:32:57.759045+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.759045+0000', 'last_undegraded': '2024-09-17T05:32:57.759045+0000', 'last_fullsized': '2024-09-17T05:32:57.759045+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:33:03.765 INFO:tasks.ceph.ceph_manager.ceph:PG 13.8 is not active+clean 2024-09-17T05:33:03.765 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.752757+0000', 'last_change': '2024-09-17T05:32:57.752757+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.752757+0000', 'last_undegraded': '2024-09-17T05:32:57.752757+0000', 'last_fullsized': '2024-09-17T05:32:57.752757+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:33:03.765 INFO:tasks.ceph.ceph_manager.ceph:PG 13.9 is not active+clean 2024-09-17T05:33:03.765 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.757396+0000', 'last_change': '2024-09-17T05:32:57.757396+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.757396+0000', 'last_undegraded': '2024-09-17T05:32:57.757396+0000', 'last_fullsized': '2024-09-17T05:32:57.757396+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:33:03.765 INFO:tasks.ceph.ceph_manager.ceph:PG 13.6 is not active+clean 2024-09-17T05:33:03.765 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.763511+0000', 'last_change': '2024-09-17T05:32:57.763511+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.763511+0000', 'last_undegraded': '2024-09-17T05:32:57.763511+0000', 'last_fullsized': '2024-09-17T05:32:57.763511+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:33:03.765 INFO:tasks.ceph.ceph_manager.ceph:PG 13.7 is not active+clean 2024-09-17T05:33:03.765 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.760675+0000', 'last_change': '2024-09-17T05:32:57.760675+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.760675+0000', 'last_undegraded': '2024-09-17T05:32:57.760675+0000', 'last_fullsized': '2024-09-17T05:32:57.760675+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:33:03.766 INFO:tasks.ceph.ceph_manager.ceph:PG 13.4 is not active+clean 2024-09-17T05:33:03.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.754058+0000', 'last_change': '2024-09-17T05:32:57.754058+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.754058+0000', 'last_undegraded': '2024-09-17T05:32:57.754058+0000', 'last_fullsized': '2024-09-17T05:32:57.754058+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:33:03.766 INFO:tasks.ceph.ceph_manager.ceph:PG 13.5 is not active+clean 2024-09-17T05:33:03.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.760460+0000', 'last_change': '2024-09-17T05:32:57.760460+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.760460+0000', 'last_undegraded': '2024-09-17T05:32:57.760460+0000', 'last_fullsized': '2024-09-17T05:32:57.760460+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:33:03.766 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2 is not active+clean 2024-09-17T05:33:03.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.758158+0000', 'last_change': '2024-09-17T05:32:57.758158+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.758158+0000', 'last_undegraded': '2024-09-17T05:32:57.758158+0000', 'last_fullsized': '2024-09-17T05:32:57.758158+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:33:03.766 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3 is not active+clean 2024-09-17T05:33:03.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.756482+0000', 'last_change': '2024-09-17T05:32:57.756482+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.756482+0000', 'last_undegraded': '2024-09-17T05:32:57.756482+0000', 'last_fullsized': '2024-09-17T05:32:57.756482+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:33:03.766 INFO:tasks.ceph.ceph_manager.ceph:PG 13.0 is not active+clean 2024-09-17T05:33:03.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.761077+0000', 'last_change': '2024-09-17T05:32:57.761077+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.761077+0000', 'last_undegraded': '2024-09-17T05:32:57.761077+0000', 'last_fullsized': '2024-09-17T05:32:57.761077+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:33:03.766 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1 is not active+clean 2024-09-17T05:33:03.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.755969+0000', 'last_change': '2024-09-17T05:32:57.755969+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.755969+0000', 'last_undegraded': '2024-09-17T05:32:57.755969+0000', 'last_fullsized': '2024-09-17T05:32:57.755969+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:33:03.767 INFO:tasks.ceph.ceph_manager.ceph:PG 13.c is not active+clean 2024-09-17T05:33:03.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:32:57.759581+0000', 'last_change': '2024-09-17T05:32:57.759581+0000', 'last_active': '2024-09-17T05:32:57.741848+0000', 'last_peered': '2024-09-17T05:32:57.741848+0000', 'last_clean': '2024-09-17T05:32:57.741848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:32:57.759581+0000', 'last_undegraded': '2024-09-17T05:32:57.759581+0000', 'last_fullsized': '2024-09-17T05:32:57.759581+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'last_clean_scrub_stamp': '2024-09-17T05:32:57.741848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:33:03.767 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:33:03.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.938+0000 7f57be600640 1 -- 172.21.15.31:0/2714962206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57b8160400 msgr2=0x7f57b8160850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.938+0000 7f57be600640 1 --2- 172.21.15.31:0/2714962206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57b8160400 0x7f57b8160850 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f57b8073a90 tx=0x7f57b001cc90 comp rx=0 tx=0).stop 2024-09-17T05:33:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.938+0000 7f57be600640 1 -- 172.21.15.31:0/2714962206 shutdown_connections 2024-09-17T05:33:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.938+0000 7f57be600640 1 --2- 172.21.15.31:0/2714962206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57b8160400 0x7f57b8160850 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.938+0000 7f57be600640 1 --2- 172.21.15.31:0/2714962206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57b80b2d00 0x7f57b815fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.938+0000 7f57be600640 1 --2- 172.21.15.31:0/2714962206 >> v2:172.21.15.155:3300/0 conn(0x7f57b80cfe80 0x7f57b80d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.938+0000 7f57be600640 1 -- 172.21.15.31:0/2714962206 >> 172.21.15.31:0/2714962206 conn(0x7f57b80d1e40 msgr2=0x7f57b80d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.938+0000 7f57be600640 1 -- 172.21.15.31:0/2714962206 shutdown_connections 2024-09-17T05:33:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.938+0000 7f57be600640 1 -- 172.21.15.31:0/2714962206 wait complete. 2024-09-17T05:33:03.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57be600640 1 Processor -- start 2024-09-17T05:33:03.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57be600640 1 -- start start 2024-09-17T05:33:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57be600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57b80b2d00 0x7f57b8153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57be600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57b80cfe80 0x7f57b81545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57be600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57b8160400 0x7f57b80c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57be600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f57b80b2820 con 0x7f57b8160400 2024-09-17T05:33:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57be600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f57b80b26a0 con 0x7f57b80b2d00 2024-09-17T05:33:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57be600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f57b80b29a0 con 0x7f57b80cfe80 2024-09-17T05:33:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57b7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57b8160400 0x7f57b80c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57b7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57b8160400 0x7f57b80c5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41418/0 (socket says 172.21.15.31:41418) 2024-09-17T05:33:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57b7e00640 1 -- 172.21.15.31:0/1479170224 learned_addr learned my addr 172.21.15.31:0/1479170224 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57b7400640 1 --2- 172.21.15.31:0/1479170224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57b80b2d00 0x7f57b8153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57afe00640 1 --2- 172.21.15.31:0/1479170224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57b80cfe80 0x7f57b81545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57b7e00640 1 -- 172.21.15.31:0/1479170224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57b80cfe80 msgr2=0x7f57b81545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57b7e00640 1 --2- 172.21.15.31:0/1479170224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57b80cfe80 0x7f57b81545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57b7e00640 1 -- 172.21.15.31:0/1479170224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57b80b2d00 msgr2=0x7f57b8153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57b7e00640 1 --2- 172.21.15.31:0/1479170224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57b80b2d00 0x7f57b8153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57b7e00640 1 -- 172.21.15.31:0/1479170224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b80c6050 con 0x7f57b8160400 2024-09-17T05:33:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57b7e00640 1 --2- 172.21.15.31:0/1479170224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57b8160400 0x7f57b80c5970 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f57b001a920 tx=0x7f57b0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57af400640 1 -- 172.21.15.31:0/1479170224 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b00b2040 con 0x7f57b8160400 2024-09-17T05:33:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57af400640 1 -- 172.21.15.31:0/1479170224 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57b00a5960 con 0x7f57b8160400 2024-09-17T05:33:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57af400640 1 -- 172.21.15.31:0/1479170224 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b00046c0 con 0x7f57b8160400 2024-09-17T05:33:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57be600640 1 -- 172.21.15.31:0/1479170224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b80c6330 con 0x7f57b8160400 2024-09-17T05:33:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.942+0000 7f57be600640 1 -- 172.21.15.31:0/1479170224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b80c68f0 con 0x7f57b8160400 2024-09-17T05:33:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.946+0000 7f57be600640 1 -- 172.21.15.31:0/1479170224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b80d0260 con 0x7f57b8160400 2024-09-17T05:33:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.946+0000 7f57af400640 1 -- 172.21.15.31:0/1479170224 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f57b00a5b10 con 0x7f57b8160400 2024-09-17T05:33:03.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.946+0000 7f57af400640 1 --2- 172.21.15.31:0/1479170224 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5794073320 0x7f57940757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.946+0000 7f57af400640 1 -- 172.21.15.31:0/1479170224 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f57b012eb00 con 0x7f57b8160400 2024-09-17T05:33:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.946+0000 7f57b7400640 1 --2- 172.21.15.31:0/1479170224 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5794073320 0x7f57940757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.946+0000 7f57b7400640 1 --2- 172.21.15.31:0/1479170224 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5794073320 0x7f57940757e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f57b815f190 tx=0x7f57a800a2d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:03.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:03.950+0000 7f57af400640 1 -- 172.21.15.31:0/1479170224 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f57b0016970 con 0x7f57b8160400 2024-09-17T05:33:04.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.194+0000 7f57be600640 1 -- 172.21.15.31:0/1479170224 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f57b809fe00 con 0x7f57b8160400 2024-09-17T05:33:04.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.194+0000 7f57af400640 1 -- 172.21.15.31:0/1479170224 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+3143 (secure 0 0 0) 0x7f57b00f92b0 con 0x7f57b8160400 2024-09-17T05:33:04.197 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:04.198 INFO:teuthology.orchestra.run.smithi031.stdout:{"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":284,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":81,"num_osds":8,"num_up_osds":8,"osd_up_since":1726550913,"num_in_osds":8,"osd_in_since":1726550903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":264396800,"bytes_avail":772829716480,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":56,"btime":"2024-09-17T05:33:01:791448+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":6570}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-09-17T05:32:46.699196+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T05:33:04.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.198+0000 7f57be600640 1 -- 172.21.15.31:0/1479170224 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5794073320 msgr2=0x7f57940757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:04.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.198+0000 7f57be600640 1 --2- 172.21.15.31:0/1479170224 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5794073320 0x7f57940757e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f57b815f190 tx=0x7f57a800a2d0 comp rx=0 tx=0).stop 2024-09-17T05:33:04.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.198+0000 7f57be600640 1 -- 172.21.15.31:0/1479170224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57b8160400 msgr2=0x7f57b80c5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:04.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.198+0000 7f57be600640 1 --2- 172.21.15.31:0/1479170224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57b8160400 0x7f57b80c5970 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f57b001a920 tx=0x7f57b0004270 comp rx=0 tx=0).stop 2024-09-17T05:33:04.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.198+0000 7f57be600640 1 -- 172.21.15.31:0/1479170224 shutdown_connections 2024-09-17T05:33:04.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.198+0000 7f57be600640 1 --2- 172.21.15.31:0/1479170224 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5794073320 0x7f57940757e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:04.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.198+0000 7f57be600640 1 --2- 172.21.15.31:0/1479170224 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57b8160400 0x7f57b80c5970 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:04.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.198+0000 7f57be600640 1 --2- 172.21.15.31:0/1479170224 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57b80cfe80 0x7f57b81545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:04.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.198+0000 7f57be600640 1 --2- 172.21.15.31:0/1479170224 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57b80b2d00 0x7f57b8153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:04.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.198+0000 7f57be600640 1 -- 172.21.15.31:0/1479170224 >> 172.21.15.31:0/1479170224 conn(0x7f57b80d1e40 msgr2=0x7f57b80cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:04.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.198+0000 7f57be600640 1 -- 172.21.15.31:0/1479170224 shutdown_connections 2024-09-17T05:33:04.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.198+0000 7f57be600640 1 -- 172.21.15.31:0/1479170224 wait complete. 2024-09-17T05:33:04.218 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:33:04.219 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:33:04.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.362+0000 7f77a1000640 1 -- 172.21.15.31:0/3154737243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f779c0b3130 msgr2=0x7f779c0cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:04.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.362+0000 7f77a1000640 1 --2- 172.21.15.31:0/3154737243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f779c0b3130 0x7f779c0cc550 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f7794009c80 tx=0x7f779401cda0 comp rx=0 tx=0).stop 2024-09-17T05:33:04.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.362+0000 7f77a1000640 1 -- 172.21.15.31:0/3154737243 shutdown_connections 2024-09-17T05:33:04.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.362+0000 7f77a1000640 1 --2- 172.21.15.31:0/3154737243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f779c0b3130 0x7f779c0cc550 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:04.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.362+0000 7f77a1000640 1 --2- 172.21.15.31:0/3154737243 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f779c0b4bd0 0x7f779c0b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:04.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.362+0000 7f77a1000640 1 -- 172.21.15.31:0/3154737243 >> 172.21.15.31:0/3154737243 conn(0x7f779c0b18f0 msgr2=0x7f779c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:04.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f77a1000640 1 -- 172.21.15.31:0/3154737243 shutdown_connections 2024-09-17T05:33:04.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f77a1000640 1 -- 172.21.15.31:0/3154737243 wait complete. 2024-09-17T05:33:04.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f77a1000640 1 Processor -- start 2024-09-17T05:33:04.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f77a1000640 1 -- start start 2024-09-17T05:33:04.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f77a1000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f779c0b3130 0x7f779c146200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:04.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f77a1000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f779c0b4bd0 0x7f779c0cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:04.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f77a1000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f779c15b580 0x7f779c0ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:04.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f77a1000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f779c167b70 con 0x7f779c0b3130 2024-09-17T05:33:04.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f77a1000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f779c0cd570 con 0x7f779c15b580 2024-09-17T05:33:04.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f77a1000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f779c167cf0 con 0x7f779c0b4bd0 2024-09-17T05:33:04.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f7799e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f779c0b3130 0x7f779c146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:04.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f7799e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f779c0b3130 0x7f779c146200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41422/0 (socket says 172.21.15.31:41422) 2024-09-17T05:33:04.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f7799e00640 1 -- 172.21.15.31:0/4112999291 learned_addr learned my addr 172.21.15.31:0/4112999291 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:04.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f779a800640 1 --2- 172.21.15.31:0/4112999291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f779c15b580 0x7f779c0ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:04.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f7793e00640 1 --2- 172.21.15.31:0/4112999291 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f779c0b4bd0 0x7f779c0cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:04.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f7799e00640 1 -- 172.21.15.31:0/4112999291 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f779c0b4bd0 msgr2=0x7f779c0cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:04.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f7799e00640 1 --2- 172.21.15.31:0/4112999291 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f779c0b4bd0 0x7f779c0cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:04.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f7799e00640 1 -- 172.21.15.31:0/4112999291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f779c15b580 msgr2=0x7f779c0ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:04.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f7799e00640 1 --2- 172.21.15.31:0/4112999291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f779c15b580 0x7f779c0ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:04.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f7799e00640 1 -- 172.21.15.31:0/4112999291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779c0cb8f0 con 0x7f779c0b3130 2024-09-17T05:33:04.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f7799e00640 1 --2- 172.21.15.31:0/4112999291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f779c0b3130 0x7f779c146200 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f778c00c3c0 tx=0x7f778c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:04.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f7792000640 1 -- 172.21.15.31:0/4112999291 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c017070 con 0x7f779c0b3130 2024-09-17T05:33:04.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f7792000640 1 -- 172.21.15.31:0/4112999291 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f778c0053c0 con 0x7f779c0b3130 2024-09-17T05:33:04.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f77a1000640 1 -- 172.21.15.31:0/4112999291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f779c1fae80 con 0x7f779c0b3130 2024-09-17T05:33:04.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.366+0000 7f7792000640 1 -- 172.21.15.31:0/4112999291 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c003860 con 0x7f779c0b3130 2024-09-17T05:33:04.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.370+0000 7f77a1000640 1 -- 172.21.15.31:0/4112999291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f779c1fb440 con 0x7f779c0b3130 2024-09-17T05:33:04.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.370+0000 7f77a1000640 1 -- 172.21.15.31:0/4112999291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f779c069410 con 0x7f779c0b3130 2024-09-17T05:33:04.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.370+0000 7f7792000640 1 -- 172.21.15.31:0/4112999291 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f778c01a070 con 0x7f779c0b3130 2024-09-17T05:33:04.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.370+0000 7f7792000640 1 --2- 172.21.15.31:0/4112999291 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7778073320 0x7f77780757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:04.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.370+0000 7f7792000640 1 -- 172.21.15.31:0/4112999291 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f778c0936c0 con 0x7f779c0b3130 2024-09-17T05:33:04.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.370+0000 7f7793e00640 1 --2- 172.21.15.31:0/4112999291 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7778073320 0x7f77780757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:04.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.374+0000 7f7793e00640 1 --2- 172.21.15.31:0/4112999291 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7778073320 0x7f77780757e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f779c14a080 tx=0x7f77840091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:04.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.374+0000 7f7792000640 1 -- 172.21.15.31:0/4112999291 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f778c05df00 con 0x7f779c0b3130 2024-09-17T05:33:04.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.550+0000 7f77a1000640 1 -- 172.21.15.31:0/4112999291 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f779c1fb680 con 0x7f7778073320 2024-09-17T05:33:04.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.554+0000 7f7792000640 1 -- 172.21.15.31:0/4112999291 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246778 (secure 0 0 0) 0x7f779c1fb680 con 0x7f7778073320 2024-09-17T05:33:04.558 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:04.560 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:33:04.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.558+0000 7f77a1000640 1 -- 172.21.15.31:0/4112999291 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7778073320 msgr2=0x7f77780757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:04.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.558+0000 7f77a1000640 1 --2- 172.21.15.31:0/4112999291 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7778073320 0x7f77780757e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f779c14a080 tx=0x7f77840091e0 comp rx=0 tx=0).stop 2024-09-17T05:33:04.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.558+0000 7f77a1000640 1 -- 172.21.15.31:0/4112999291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f779c0b3130 msgr2=0x7f779c146200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:04.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.558+0000 7f77a1000640 1 --2- 172.21.15.31:0/4112999291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f779c0b3130 0x7f779c146200 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f778c00c3c0 tx=0x7f778c00c880 comp rx=0 tx=0).stop 2024-09-17T05:33:04.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.558+0000 7f77a1000640 1 -- 172.21.15.31:0/4112999291 shutdown_connections 2024-09-17T05:33:04.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.558+0000 7f77a1000640 1 --2- 172.21.15.31:0/4112999291 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7778073320 0x7f77780757e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:04.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.558+0000 7f77a1000640 1 --2- 172.21.15.31:0/4112999291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f779c15b580 0x7f779c0ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:04.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.558+0000 7f77a1000640 1 --2- 172.21.15.31:0/4112999291 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f779c0b4bd0 0x7f779c0cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:04.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.558+0000 7f77a1000640 1 --2- 172.21.15.31:0/4112999291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f779c0b3130 0x7f779c146200 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:04.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.558+0000 7f77a1000640 1 -- 172.21.15.31:0/4112999291 >> 172.21.15.31:0/4112999291 conn(0x7f779c0b18f0 msgr2=0x7f779c0af470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:04.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.558+0000 7f77a1000640 1 -- 172.21.15.31:0/4112999291 shutdown_connections 2024-09-17T05:33:04.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:04.558+0000 7f77a1000640 1 -- 172.21.15.31:0/4112999291 wait complete. 2024-09-17T05:33:04.579 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T05:33:02.703040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258200,"kb_used_data":8680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716520,"statfs":{"total":773094113280,"available":772829716480,"internally_reserved":0,"allocated":8888320,"data_stored":4441424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.960464"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755959+0000","last_change":"2024-09-17T05:32:57.755959+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755959+0000","last_undegraded":"2024-09-17T05:32:57.755959+0000","last_fullsized":"2024-09-17T05:32:57.755959+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.764081+0000","last_change":"2024-09-17T05:32:57.764081+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.764081+0000","last_undegraded":"2024-09-17T05:32:57.764081+0000","last_fullsized":"2024-09-17T05:32:57.764081+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762055+0000","last_change":"2024-09-17T05:32:57.762055+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762055+0000","last_undegraded":"2024-09-17T05:32:57.762055+0000","last_fullsized":"2024-09-17T05:32:57.762055+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754455+0000","last_change":"2024-09-17T05:32:57.754455+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754455+0000","last_undegraded":"2024-09-17T05:32:57.754455+0000","last_fullsized":"2024-09-17T05:32:57.754455+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761721+0000","last_change":"2024-09-17T05:32:57.761721+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761721+0000","last_undegraded":"2024-09-17T05:32:57.761721+0000","last_fullsized":"2024-09-17T05:32:57.761721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.758601+0000","last_change":"2024-09-17T05:32:57.758601+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.758601+0000","last_undegraded":"2024-09-17T05:32:57.758601+0000","last_fullsized":"2024-09-17T05:32:57.758601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753567+0000","last_change":"2024-09-17T05:32:57.753567+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753567+0000","last_undegraded":"2024-09-17T05:32:57.753567+0000","last_fullsized":"2024-09-17T05:32:57.753567+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757889+0000","last_change":"2024-09-17T05:32:57.757889+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757889+0000","last_undegraded":"2024-09-17T05:32:57.757889+0000","last_fullsized":"2024-09-17T05:32:57.757889+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.758125+0000","last_change":"2024-09-17T05:32:57.758125+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.758125+0000","last_undegraded":"2024-09-17T05:32:57.758125+0000","last_fullsized":"2024-09-17T05:32:57.758125+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754177+0000","last_change":"2024-09-17T05:32:57.754177+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754177+0000","last_undegraded":"2024-09-17T05:32:57.754177+0000","last_fullsized":"2024-09-17T05:32:57.754177+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762797+0000","last_change":"2024-09-17T05:32:57.762797+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762797+0000","last_undegraded":"2024-09-17T05:32:57.762797+0000","last_fullsized":"2024-09-17T05:32:57.762797+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.756963+0000","last_change":"2024-09-17T05:32:57.756963+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.756963+0000","last_undegraded":"2024-09-17T05:32:57.756963+0000","last_fullsized":"2024-09-17T05:32:57.756963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762382+0000","last_change":"2024-09-17T05:32:57.762382+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762382+0000","last_undegraded":"2024-09-17T05:32:57.762382+0000","last_fullsized":"2024-09-17T05:32:57.762382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753519+0000","last_change":"2024-09-17T05:32:57.753519+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753519+0000","last_undegraded":"2024-09-17T05:32:57.753519+0000","last_fullsized":"2024-09-17T05:32:57.753519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757928+0000","last_change":"2024-09-17T05:32:57.757928+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757928+0000","last_undegraded":"2024-09-17T05:32:57.757928+0000","last_fullsized":"2024-09-17T05:32:57.757928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763037+0000","last_change":"2024-09-17T05:32:57.763037+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763037+0000","last_undegraded":"2024-09-17T05:32:57.763037+0000","last_fullsized":"2024-09-17T05:32:57.763037+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.759822+0000","last_change":"2024-09-17T05:32:57.759822+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.759822+0000","last_undegraded":"2024-09-17T05:32:57.759822+0000","last_fullsized":"2024-09-17T05:32:57.759822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753309+0000","last_change":"2024-09-17T05:32:57.753309+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753309+0000","last_undegraded":"2024-09-17T05:32:57.753309+0000","last_fullsized":"2024-09-17T05:32:57.753309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754516+0000","last_change":"2024-09-17T05:32:57.754516+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754516+0000","last_undegraded":"2024-09-17T05:32:57.754516+0000","last_fullsized":"2024-09-17T05:32:57.754516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753049+0000","last_change":"2024-09-17T05:32:57.753049+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753049+0000","last_undegraded":"2024-09-17T05:32:57.753049+0000","last_fullsized":"2024-09-17T05:32:57.753049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.752625+0000","last_change":"2024-09-17T05:32:57.752625+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.752625+0000","last_undegraded":"2024-09-17T05:32:57.752625+0000","last_fullsized":"2024-09-17T05:32:57.752625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.767347+0000","last_change":"2024-09-17T05:32:57.767347+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.767347+0000","last_undegraded":"2024-09-17T05:32:57.767347+0000","last_fullsized":"2024-09-17T05:32:57.767347+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.756506+0000","last_change":"2024-09-17T05:32:57.756506+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.756506+0000","last_undegraded":"2024-09-17T05:32:57.756506+0000","last_fullsized":"2024-09-17T05:32:57.756506+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753352+0000","last_change":"2024-09-17T05:32:57.753352+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753352+0000","last_undegraded":"2024-09-17T05:32:57.753352+0000","last_fullsized":"2024-09-17T05:32:57.753352+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763700+0000","last_change":"2024-09-17T05:32:57.763700+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763700+0000","last_undegraded":"2024-09-17T05:32:57.763700+0000","last_fullsized":"2024-09-17T05:32:57.763700+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760679+0000","last_change":"2024-09-17T05:32:57.760679+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760679+0000","last_undegraded":"2024-09-17T05:32:57.760679+0000","last_fullsized":"2024-09-17T05:32:57.760679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761813+0000","last_change":"2024-09-17T05:32:57.761813+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761813+0000","last_undegraded":"2024-09-17T05:32:57.761813+0000","last_fullsized":"2024-09-17T05:32:57.761813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755954+0000","last_change":"2024-09-17T05:32:57.755954+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755954+0000","last_undegraded":"2024-09-17T05:32:57.755954+0000","last_fullsized":"2024-09-17T05:32:57.755954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763285+0000","last_change":"2024-09-17T05:32:57.763285+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763285+0000","last_undegraded":"2024-09-17T05:32:57.763285+0000","last_fullsized":"2024-09-17T05:32:57.763285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.766238+0000","last_change":"2024-09-17T05:32:57.766238+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.766238+0000","last_undegraded":"2024-09-17T05:32:57.766238+0000","last_fullsized":"2024-09-17T05:32:57.766238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763288+0000","last_change":"2024-09-17T05:32:57.763288+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763288+0000","last_undegraded":"2024-09-17T05:32:57.763288+0000","last_fullsized":"2024-09-17T05:32:57.763288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754918+0000","last_change":"2024-09-17T05:32:57.754918+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754918+0000","last_undegraded":"2024-09-17T05:32:57.754918+0000","last_fullsized":"2024-09-17T05:32:57.754918+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763926+0000","last_change":"2024-09-17T05:32:57.763926+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763926+0000","last_undegraded":"2024-09-17T05:32:57.763926+0000","last_fullsized":"2024-09-17T05:32:57.763926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.766615+0000","last_change":"2024-09-17T05:32:57.760900+0000","last_active":"2024-09-17T05:32:57.766615+0000","last_peered":"2024-09-17T05:32:57.766615+0000","last_clean":"2024-09-17T05:32:57.766615+0000","last_became_active":"2024-09-17T05:32:57.760587+0000","last_became_peered":"2024-09-17T05:32:57.760587+0000","last_unstale":"2024-09-17T05:32:57.766615+0000","last_undegraded":"2024-09-17T05:32:57.766615+0000","last_fullsized":"2024-09-17T05:32:57.766615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:06.976886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755426+0000","last_change":"2024-09-17T05:32:57.755426+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755426+0000","last_undegraded":"2024-09-17T05:32:57.755426+0000","last_fullsized":"2024-09-17T05:32:57.755426+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.781622+0000","last_change":"2024-09-17T05:32:57.778135+0000","last_active":"2024-09-17T05:32:57.781622+0000","last_peered":"2024-09-17T05:32:57.781622+0000","last_clean":"2024-09-17T05:32:57.781622+0000","last_became_active":"2024-09-17T05:32:57.777834+0000","last_became_peered":"2024-09-17T05:32:57.777834+0000","last_unstale":"2024-09-17T05:32:57.781622+0000","last_undegraded":"2024-09-17T05:32:57.781622+0000","last_fullsized":"2024-09-17T05:32:57.781622+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:58.249252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754943+0000","last_change":"2024-09-17T05:32:57.754943+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754943+0000","last_undegraded":"2024-09-17T05:32:57.754943+0000","last_fullsized":"2024-09-17T05:32:57.754943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.766132+0000","last_change":"2024-09-17T05:32:57.761438+0000","last_active":"2024-09-17T05:32:57.766132+0000","last_peered":"2024-09-17T05:32:57.766132+0000","last_clean":"2024-09-17T05:32:57.766132+0000","last_became_active":"2024-09-17T05:32:57.761180+0000","last_became_peered":"2024-09-17T05:32:57.761180+0000","last_unstale":"2024-09-17T05:32:57.766132+0000","last_undegraded":"2024-09-17T05:32:57.766132+0000","last_fullsized":"2024-09-17T05:32:57.766132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:38.946220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760016+0000","last_change":"2024-09-17T05:32:57.760016+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760016+0000","last_undegraded":"2024-09-17T05:32:57.760016+0000","last_fullsized":"2024-09-17T05:32:57.760016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.766461+0000","last_change":"2024-09-17T05:32:57.762038+0000","last_active":"2024-09-17T05:32:57.766461+0000","last_peered":"2024-09-17T05:32:57.766461+0000","last_clean":"2024-09-17T05:32:57.766461+0000","last_became_active":"2024-09-17T05:32:57.761027+0000","last_became_peered":"2024-09-17T05:32:57.761027+0000","last_unstale":"2024-09-17T05:32:57.766461+0000","last_undegraded":"2024-09-17T05:32:57.766461+0000","last_fullsized":"2024-09-17T05:32:57.766461+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:19.005013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.764452+0000","last_change":"2024-09-17T05:32:57.764452+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.764452+0000","last_undegraded":"2024-09-17T05:32:57.764452+0000","last_fullsized":"2024-09-17T05:32:57.764452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779784+0000","last_change":"2024-09-17T05:32:57.777503+0000","last_active":"2024-09-17T05:32:57.779784+0000","last_peered":"2024-09-17T05:32:57.779784+0000","last_clean":"2024-09-17T05:32:57.779784+0000","last_became_active":"2024-09-17T05:32:57.777284+0000","last_became_peered":"2024-09-17T05:32:57.777284+0000","last_unstale":"2024-09-17T05:32:57.779784+0000","last_undegraded":"2024-09-17T05:32:57.779784+0000","last_fullsized":"2024-09-17T05:32:57.779784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:13.999564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761289+0000","last_change":"2024-09-17T05:32:57.761289+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761289+0000","last_undegraded":"2024-09-17T05:32:57.761289+0000","last_fullsized":"2024-09-17T05:32:57.761289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.781701+0000","last_change":"2024-09-17T05:32:57.778177+0000","last_active":"2024-09-17T05:32:57.781701+0000","last_peered":"2024-09-17T05:32:57.781701+0000","last_clean":"2024-09-17T05:32:57.781701+0000","last_became_active":"2024-09-17T05:32:57.777881+0000","last_became_peered":"2024-09-17T05:32:57.777881+0000","last_unstale":"2024-09-17T05:32:57.781701+0000","last_undegraded":"2024-09-17T05:32:57.781701+0000","last_fullsized":"2024-09-17T05:32:57.781701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:54.749806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761539+0000","last_change":"2024-09-17T05:32:57.761539+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761539+0000","last_undegraded":"2024-09-17T05:32:57.761539+0000","last_fullsized":"2024-09-17T05:32:57.761539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.771268+0000","last_change":"2024-09-17T05:32:57.765590+0000","last_active":"2024-09-17T05:32:57.771268+0000","last_peered":"2024-09-17T05:32:57.771268+0000","last_clean":"2024-09-17T05:32:57.771268+0000","last_became_active":"2024-09-17T05:32:57.765285+0000","last_became_peered":"2024-09-17T05:32:57.765285+0000","last_unstale":"2024-09-17T05:32:57.771268+0000","last_undegraded":"2024-09-17T05:32:57.771268+0000","last_fullsized":"2024-09-17T05:32:57.771268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:02.940055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757453+0000","last_change":"2024-09-17T05:32:57.757453+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757453+0000","last_undegraded":"2024-09-17T05:32:57.757453+0000","last_fullsized":"2024-09-17T05:32:57.757453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779745+0000","last_change":"2024-09-17T05:32:57.771325+0000","last_active":"2024-09-17T05:32:57.779745+0000","last_peered":"2024-09-17T05:32:57.779745+0000","last_clean":"2024-09-17T05:32:57.779745+0000","last_became_active":"2024-09-17T05:32:57.771046+0000","last_became_peered":"2024-09-17T05:32:57.771046+0000","last_unstale":"2024-09-17T05:32:57.779745+0000","last_undegraded":"2024-09-17T05:32:57.779745+0000","last_fullsized":"2024-09-17T05:32:57.779745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:01.736307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.758937+0000","last_change":"2024-09-17T05:32:57.758937+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.758937+0000","last_undegraded":"2024-09-17T05:32:57.758937+0000","last_fullsized":"2024-09-17T05:32:57.758937+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779585+0000","last_change":"2024-09-17T05:32:57.775051+0000","last_active":"2024-09-17T05:32:57.779585+0000","last_peered":"2024-09-17T05:32:57.779585+0000","last_clean":"2024-09-17T05:32:57.779585+0000","last_became_active":"2024-09-17T05:32:57.774665+0000","last_became_peered":"2024-09-17T05:32:57.774665+0000","last_unstale":"2024-09-17T05:32:57.779585+0000","last_undegraded":"2024-09-17T05:32:57.779585+0000","last_fullsized":"2024-09-17T05:32:57.779585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:21:53.510499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757590+0000","last_change":"2024-09-17T05:32:57.757590+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757590+0000","last_undegraded":"2024-09-17T05:32:57.757590+0000","last_fullsized":"2024-09-17T05:32:57.757590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.777934+0000","last_change":"2024-09-17T05:32:57.771838+0000","last_active":"2024-09-17T05:32:57.777934+0000","last_peered":"2024-09-17T05:32:57.777934+0000","last_clean":"2024-09-17T05:32:57.777934+0000","last_became_active":"2024-09-17T05:32:57.771585+0000","last_became_peered":"2024-09-17T05:32:57.771585+0000","last_unstale":"2024-09-17T05:32:57.777934+0000","last_undegraded":"2024-09-17T05:32:57.777934+0000","last_fullsized":"2024-09-17T05:32:57.777934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:21.653529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755598+0000","last_change":"2024-09-17T05:32:57.755598+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755598+0000","last_undegraded":"2024-09-17T05:32:57.755598+0000","last_fullsized":"2024-09-17T05:32:57.755598+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779493+0000","last_change":"2024-09-17T05:32:57.774796+0000","last_active":"2024-09-17T05:32:57.779493+0000","last_peered":"2024-09-17T05:32:57.779493+0000","last_clean":"2024-09-17T05:32:57.779493+0000","last_became_active":"2024-09-17T05:32:57.774446+0000","last_became_peered":"2024-09-17T05:32:57.774446+0000","last_unstale":"2024-09-17T05:32:57.779493+0000","last_undegraded":"2024-09-17T05:32:57.779493+0000","last_fullsized":"2024-09-17T05:32:57.779493+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:29.699013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761416+0000","last_change":"2024-09-17T05:32:57.761416+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761416+0000","last_undegraded":"2024-09-17T05:32:57.761416+0000","last_fullsized":"2024-09-17T05:32:57.761416+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.778451+0000","last_change":"2024-09-17T05:32:57.772140+0000","last_active":"2024-09-17T05:32:57.778451+0000","last_peered":"2024-09-17T05:32:57.778451+0000","last_clean":"2024-09-17T05:32:57.778451+0000","last_became_active":"2024-09-17T05:32:57.771854+0000","last_became_peered":"2024-09-17T05:32:57.771854+0000","last_unstale":"2024-09-17T05:32:57.778451+0000","last_undegraded":"2024-09-17T05:32:57.778451+0000","last_fullsized":"2024-09-17T05:32:57.778451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:28.491950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757067+0000","last_change":"2024-09-17T05:32:57.757067+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757067+0000","last_undegraded":"2024-09-17T05:32:57.757067+0000","last_fullsized":"2024-09-17T05:32:57.757067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.780784+0000","last_change":"2024-09-17T05:32:57.776757+0000","last_active":"2024-09-17T05:32:57.780784+0000","last_peered":"2024-09-17T05:32:57.780784+0000","last_clean":"2024-09-17T05:32:57.780784+0000","last_became_active":"2024-09-17T05:32:57.776494+0000","last_became_peered":"2024-09-17T05:32:57.776494+0000","last_unstale":"2024-09-17T05:32:57.780784+0000","last_undegraded":"2024-09-17T05:32:57.780784+0000","last_fullsized":"2024-09-17T05:32:57.780784+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:19.493595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761967+0000","last_change":"2024-09-17T05:32:57.761967+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761967+0000","last_undegraded":"2024-09-17T05:32:57.761967+0000","last_fullsized":"2024-09-17T05:32:57.761967+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779356+0000","last_change":"2024-09-17T05:32:57.778389+0000","last_active":"2024-09-17T05:32:57.779356+0000","last_peered":"2024-09-17T05:32:57.779356+0000","last_clean":"2024-09-17T05:32:57.779356+0000","last_became_active":"2024-09-17T05:32:57.778131+0000","last_became_peered":"2024-09-17T05:32:57.778131+0000","last_unstale":"2024-09-17T05:32:57.779356+0000","last_undegraded":"2024-09-17T05:32:57.779356+0000","last_fullsized":"2024-09-17T05:32:57.779356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:36.171166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762526+0000","last_change":"2024-09-17T05:32:57.762526+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762526+0000","last_undegraded":"2024-09-17T05:32:57.762526+0000","last_fullsized":"2024-09-17T05:32:57.762526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.778648+0000","last_change":"2024-09-17T05:32:57.773894+0000","last_active":"2024-09-17T05:32:57.778648+0000","last_peered":"2024-09-17T05:32:57.778648+0000","last_clean":"2024-09-17T05:32:57.778648+0000","last_became_active":"2024-09-17T05:32:57.772427+0000","last_became_peered":"2024-09-17T05:32:57.772427+0000","last_unstale":"2024-09-17T05:32:57.778648+0000","last_undegraded":"2024-09-17T05:32:57.778648+0000","last_fullsized":"2024-09-17T05:32:57.778648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:04.368779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.762540+0000","last_change":"2024-09-17T05:32:57.762540+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.762540+0000","last_undegraded":"2024-09-17T05:32:57.762540+0000","last_fullsized":"2024-09-17T05:32:57.762540+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.775369+0000","last_change":"2024-09-17T05:32:57.772094+0000","last_active":"2024-09-17T05:32:57.775369+0000","last_peered":"2024-09-17T05:32:57.775369+0000","last_clean":"2024-09-17T05:32:57.775369+0000","last_became_active":"2024-09-17T05:32:57.771783+0000","last_became_peered":"2024-09-17T05:32:57.771783+0000","last_unstale":"2024-09-17T05:32:57.775369+0000","last_undegraded":"2024-09-17T05:32:57.775369+0000","last_fullsized":"2024-09-17T05:32:57.775369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:59.096504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760159+0000","last_change":"2024-09-17T05:32:57.760159+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760159+0000","last_undegraded":"2024-09-17T05:32:57.760159+0000","last_fullsized":"2024-09-17T05:32:57.760159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.773750+0000","last_change":"2024-09-17T05:32:57.768304+0000","last_active":"2024-09-17T05:32:57.773750+0000","last_peered":"2024-09-17T05:32:57.773750+0000","last_clean":"2024-09-17T05:32:57.773750+0000","last_became_active":"2024-09-17T05:32:57.767994+0000","last_became_peered":"2024-09-17T05:32:57.767994+0000","last_unstale":"2024-09-17T05:32:57.773750+0000","last_undegraded":"2024-09-17T05:32:57.773750+0000","last_fullsized":"2024-09-17T05:32:57.773750+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:02.910711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754847+0000","last_change":"2024-09-17T05:32:57.754847+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754847+0000","last_undegraded":"2024-09-17T05:32:57.754847+0000","last_fullsized":"2024-09-17T05:32:57.754847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.775322+0000","last_change":"2024-09-17T05:32:57.771902+0000","last_active":"2024-09-17T05:32:57.775322+0000","last_peered":"2024-09-17T05:32:57.775322+0000","last_clean":"2024-09-17T05:32:57.775322+0000","last_became_active":"2024-09-17T05:32:57.770752+0000","last_became_peered":"2024-09-17T05:32:57.770752+0000","last_unstale":"2024-09-17T05:32:57.775322+0000","last_undegraded":"2024-09-17T05:32:57.775322+0000","last_fullsized":"2024-09-17T05:32:57.775322+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:25.208627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760971+0000","last_change":"2024-09-17T05:32:57.760971+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760971+0000","last_undegraded":"2024-09-17T05:32:57.760971+0000","last_fullsized":"2024-09-17T05:32:57.760971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.769125+0000","last_change":"2024-09-17T05:32:57.766899+0000","last_active":"2024-09-17T05:32:57.769125+0000","last_peered":"2024-09-17T05:32:57.769125+0000","last_clean":"2024-09-17T05:32:57.769125+0000","last_became_active":"2024-09-17T05:32:57.766580+0000","last_became_peered":"2024-09-17T05:32:57.766580+0000","last_unstale":"2024-09-17T05:32:57.769125+0000","last_undegraded":"2024-09-17T05:32:57.769125+0000","last_fullsized":"2024-09-17T05:32:57.769125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:28.491950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.753009+0000","last_change":"2024-09-17T05:32:57.753009+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.753009+0000","last_undegraded":"2024-09-17T05:32:57.753009+0000","last_fullsized":"2024-09-17T05:32:57.753009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.777774+0000","last_change":"2024-09-17T05:32:57.773771+0000","last_active":"2024-09-17T05:32:57.777774+0000","last_peered":"2024-09-17T05:32:57.777774+0000","last_clean":"2024-09-17T05:32:57.777774+0000","last_became_active":"2024-09-17T05:32:57.773415+0000","last_became_peered":"2024-09-17T05:32:57.773415+0000","last_unstale":"2024-09-17T05:32:57.777774+0000","last_undegraded":"2024-09-17T05:32:57.777774+0000","last_fullsized":"2024-09-17T05:32:57.777774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:57.411171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.759045+0000","last_change":"2024-09-17T05:32:57.759045+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.759045+0000","last_undegraded":"2024-09-17T05:32:57.759045+0000","last_fullsized":"2024-09-17T05:32:57.759045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.763776+0000","last_change":"2024-09-17T05:32:57.761461+0000","last_active":"2024-09-17T05:32:57.763776+0000","last_peered":"2024-09-17T05:32:57.763776+0000","last_clean":"2024-09-17T05:32:57.763776+0000","last_became_active":"2024-09-17T05:32:57.760904+0000","last_became_peered":"2024-09-17T05:32:57.760904+0000","last_unstale":"2024-09-17T05:32:57.763776+0000","last_undegraded":"2024-09-17T05:32:57.763776+0000","last_fullsized":"2024-09-17T05:32:57.763776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:52.806367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.752757+0000","last_change":"2024-09-17T05:32:57.752757+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.752757+0000","last_undegraded":"2024-09-17T05:32:57.752757+0000","last_fullsized":"2024-09-17T05:32:57.752757+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.772460+0000","last_change":"2024-09-17T05:32:57.763654+0000","last_active":"2024-09-17T05:32:57.772460+0000","last_peered":"2024-09-17T05:32:57.772460+0000","last_clean":"2024-09-17T05:32:57.772460+0000","last_became_active":"2024-09-17T05:32:57.763354+0000","last_became_peered":"2024-09-17T05:32:57.763354+0000","last_unstale":"2024-09-17T05:32:57.772460+0000","last_undegraded":"2024-09-17T05:32:57.772460+0000","last_fullsized":"2024-09-17T05:32:57.772460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:14.190039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.757396+0000","last_change":"2024-09-17T05:32:57.757396+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.757396+0000","last_undegraded":"2024-09-17T05:32:57.757396+0000","last_fullsized":"2024-09-17T05:32:57.757396+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.777802+0000","last_change":"2024-09-17T05:32:57.773774+0000","last_active":"2024-09-17T05:32:57.777802+0000","last_peered":"2024-09-17T05:32:57.777802+0000","last_clean":"2024-09-17T05:32:57.777802+0000","last_became_active":"2024-09-17T05:32:57.773506+0000","last_became_peered":"2024-09-17T05:32:57.773506+0000","last_unstale":"2024-09-17T05:32:57.777802+0000","last_undegraded":"2024-09-17T05:32:57.777802+0000","last_fullsized":"2024-09-17T05:32:57.777802+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:12.669688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.763511+0000","last_change":"2024-09-17T05:32:57.763511+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.763511+0000","last_undegraded":"2024-09-17T05:32:57.763511+0000","last_fullsized":"2024-09-17T05:32:57.763511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.780826+0000","last_change":"2024-09-17T05:32:57.777118+0000","last_active":"2024-09-17T05:32:57.780826+0000","last_peered":"2024-09-17T05:32:57.780826+0000","last_clean":"2024-09-17T05:32:57.780826+0000","last_became_active":"2024-09-17T05:32:57.776868+0000","last_became_peered":"2024-09-17T05:32:57.776868+0000","last_unstale":"2024-09-17T05:32:57.780826+0000","last_undegraded":"2024-09-17T05:32:57.780826+0000","last_fullsized":"2024-09-17T05:32:57.780826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:08.376907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760675+0000","last_change":"2024-09-17T05:32:57.760675+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760675+0000","last_undegraded":"2024-09-17T05:32:57.760675+0000","last_fullsized":"2024-09-17T05:32:57.760675+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.780764+0000","last_change":"2024-09-17T05:32:57.776327+0000","last_active":"2024-09-17T05:32:57.780764+0000","last_peered":"2024-09-17T05:32:57.780764+0000","last_clean":"2024-09-17T05:32:57.780764+0000","last_became_active":"2024-09-17T05:32:57.776010+0000","last_became_peered":"2024-09-17T05:32:57.776010+0000","last_unstale":"2024-09-17T05:32:57.780764+0000","last_undegraded":"2024-09-17T05:32:57.780764+0000","last_fullsized":"2024-09-17T05:32:57.780764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:15.914318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.754058+0000","last_change":"2024-09-17T05:32:57.754058+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.754058+0000","last_undegraded":"2024-09-17T05:32:57.754058+0000","last_fullsized":"2024-09-17T05:32:57.754058+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.774319+0000","last_change":"2024-09-17T05:32:57.768914+0000","last_active":"2024-09-17T05:32:57.774319+0000","last_peered":"2024-09-17T05:32:57.774319+0000","last_clean":"2024-09-17T05:32:57.774319+0000","last_became_active":"2024-09-17T05:32:57.768542+0000","last_became_peered":"2024-09-17T05:32:57.768542+0000","last_unstale":"2024-09-17T05:32:57.774319+0000","last_undegraded":"2024-09-17T05:32:57.774319+0000","last_fullsized":"2024-09-17T05:32:57.774319+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:09.689707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.760460+0000","last_change":"2024-09-17T05:32:57.760460+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.760460+0000","last_undegraded":"2024-09-17T05:32:57.760460+0000","last_fullsized":"2024-09-17T05:32:57.760460+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.778204+0000","last_change":"2024-09-17T05:32:57.771755+0000","last_active":"2024-09-17T05:32:57.778204+0000","last_peered":"2024-09-17T05:32:57.778204+0000","last_clean":"2024-09-17T05:32:57.778204+0000","last_became_active":"2024-09-17T05:32:57.771463+0000","last_became_peered":"2024-09-17T05:32:57.771463+0000","last_unstale":"2024-09-17T05:32:57.778204+0000","last_undegraded":"2024-09-17T05:32:57.778204+0000","last_fullsized":"2024-09-17T05:32:57.778204+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:08.734245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.758158+0000","last_change":"2024-09-17T05:32:57.758158+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.758158+0000","last_undegraded":"2024-09-17T05:32:57.758158+0000","last_fullsized":"2024-09-17T05:32:57.758158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.773094+0000","last_change":"2024-09-17T05:32:57.768309+0000","last_active":"2024-09-17T05:32:57.773094+0000","last_peered":"2024-09-17T05:32:57.773094+0000","last_clean":"2024-09-17T05:32:57.773094+0000","last_became_active":"2024-09-17T05:32:57.767986+0000","last_became_peered":"2024-09-17T05:32:57.767986+0000","last_unstale":"2024-09-17T05:32:57.773094+0000","last_undegraded":"2024-09-17T05:32:57.773094+0000","last_fullsized":"2024-09-17T05:32:57.773094+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:53:04.368779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.756482+0000","last_change":"2024-09-17T05:32:57.756482+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.756482+0000","last_undegraded":"2024-09-17T05:32:57.756482+0000","last_fullsized":"2024-09-17T05:32:57.756482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.781719+0000","last_change":"2024-09-17T05:32:57.778896+0000","last_active":"2024-09-17T05:32:57.781719+0000","last_peered":"2024-09-17T05:32:57.781719+0000","last_clean":"2024-09-17T05:32:57.781719+0000","last_became_active":"2024-09-17T05:32:57.778580+0000","last_became_peered":"2024-09-17T05:32:57.778580+0000","last_unstale":"2024-09-17T05:32:57.781719+0000","last_undegraded":"2024-09-17T05:32:57.781719+0000","last_fullsized":"2024-09-17T05:32:57.781719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:07.087245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.761077+0000","last_change":"2024-09-17T05:32:57.761077+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.761077+0000","last_undegraded":"2024-09-17T05:32:57.761077+0000","last_fullsized":"2024-09-17T05:32:57.761077+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.778924+0000","last_change":"2024-09-17T05:32:57.772499+0000","last_active":"2024-09-17T05:32:57.778924+0000","last_peered":"2024-09-17T05:32:57.778924+0000","last_clean":"2024-09-17T05:32:57.778924+0000","last_became_active":"2024-09-17T05:32:57.771365+0000","last_became_peered":"2024-09-17T05:32:57.771365+0000","last_unstale":"2024-09-17T05:32:57.778924+0000","last_undegraded":"2024-09-17T05:32:57.778924+0000","last_fullsized":"2024-09-17T05:32:57.778924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:14.447613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.755969+0000","last_change":"2024-09-17T05:32:57.755969+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.755969+0000","last_undegraded":"2024-09-17T05:32:57.755969+0000","last_fullsized":"2024-09-17T05:32:57.755969+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.773897+0000","last_change":"2024-09-17T05:32:57.771832+0000","last_active":"2024-09-17T05:32:57.773897+0000","last_peered":"2024-09-17T05:32:57.773897+0000","last_clean":"2024-09-17T05:32:57.773897+0000","last_became_active":"2024-09-17T05:32:57.771626+0000","last_became_peered":"2024-09-17T05:32:57.771626+0000","last_unstale":"2024-09-17T05:32:57.773897+0000","last_undegraded":"2024-09-17T05:32:57.773897+0000","last_fullsized":"2024-09-17T05:32:57.773897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:03.616777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-17T05:32:57.759581+0000","last_change":"2024-09-17T05:32:57.759581+0000","last_active":"2024-09-17T05:32:57.741848+0000","last_peered":"2024-09-17T05:32:57.741848+0000","last_clean":"2024-09-17T05:32:57.741848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:32:57.759581+0000","last_undegraded":"2024-09-17T05:32:57.759581+0000","last_fullsized":"2024-09-17T05:32:57.759581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.779846+0000","last_change":"2024-09-17T05:32:57.776993+0000","last_active":"2024-09-17T05:32:57.779846+0000","last_peered":"2024-09-17T05:32:57.779846+0000","last_clean":"2024-09-17T05:32:57.779846+0000","last_became_active":"2024-09-17T05:32:57.776706+0000","last_became_peered":"2024-09-17T05:32:57.776706+0000","last_unstale":"2024-09-17T05:32:57.779846+0000","last_undegraded":"2024-09-17T05:32:57.779846+0000","last_fullsized":"2024-09-17T05:32:57.779846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:56.859681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":244,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-17T05:32:57.764715+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:32:57.764715+0000","last_peered":"2024-09-17T05:32:57.764715+0000","last_clean":"2024-09-17T05:32:57.764715+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:32:57.764715+0000","last_undegraded":"2024-09-17T05:32:57.764715+0000","last_fullsized":"2024-09-17T05:32:57.764715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1556480,"data_stored":997954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542200,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509497,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509497,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509495,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":962560,"data_stored":407586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542199,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1556480,"data_stored":997954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:33:07.584 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:33:07.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.734+0000 7f19e7200640 1 -- 172.21.15.31:0/2449331844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e00b5870 msgr2=0x7f19e0165670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:07.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.734+0000 7f19e7200640 1 --2- 172.21.15.31:0/2449331844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e00b5870 0x7f19e0165670 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f19dc009c80 tx=0x7f19dc01cc30 comp rx=0 tx=0).stop 2024-09-17T05:33:07.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.734+0000 7f19e7200640 1 -- 172.21.15.31:0/2449331844 shutdown_connections 2024-09-17T05:33:07.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.734+0000 7f19e7200640 1 --2- 172.21.15.31:0/2449331844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e00b5870 0x7f19e0165670 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:07.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.734+0000 7f19e7200640 1 --2- 172.21.15.31:0/2449331844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19e00b4d80 0x7f19e00b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:07.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.734+0000 7f19e7200640 1 -- 172.21.15.31:0/2449331844 >> 172.21.15.31:0/2449331844 conn(0x7f19e009aa10 msgr2=0x7f19e009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:07.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.734+0000 7f19e7200640 1 -- 172.21.15.31:0/2449331844 shutdown_connections 2024-09-17T05:33:07.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.734+0000 7f19e7200640 1 -- 172.21.15.31:0/2449331844 wait complete. 2024-09-17T05:33:07.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.734+0000 7f19e7200640 1 Processor -- start 2024-09-17T05:33:07.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.734+0000 7f19e7200640 1 -- start start 2024-09-17T05:33:07.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e7200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e00b0ce0 0x7f19e0150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e7200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e00b4d80 0x7f19e0154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e7200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19e00b5870 0x7f19e0147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e7200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f19e0165dc0 con 0x7f19e00b0ce0 2024-09-17T05:33:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e7200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f19e0071b50 con 0x7f19e00b4d80 2024-09-17T05:33:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e7200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f19e0165f40 con 0x7f19e00b5870 2024-09-17T05:33:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e00b0ce0 0x7f19e0150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e00b0ce0 0x7f19e0150e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41436/0 (socket says 172.21.15.31:41436) 2024-09-17T05:33:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e5e00640 1 -- 172.21.15.31:0/1319720905 learned_addr learned my addr 172.21.15.31:0/1319720905 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e5e00640 1 -- 172.21.15.31:0/1319720905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19e00b5870 msgr2=0x7f19e0147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e5e00640 1 --2- 172.21.15.31:0/1319720905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19e00b5870 0x7f19e0147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e5e00640 1 -- 172.21.15.31:0/1319720905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e00b4d80 msgr2=0x7f19e0154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:07.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e5400640 1 --2- 172.21.15.31:0/1319720905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e00b4d80 0x7f19e0154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:07.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e5e00640 1 --2- 172.21.15.31:0/1319720905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e00b4d80 0x7f19e0154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:07.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e5e00640 1 -- 172.21.15.31:0/1319720905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e01f8520 con 0x7f19e00b0ce0 2024-09-17T05:33:07.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e5400640 1 --2- 172.21.15.31:0/1319720905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e00b4d80 0x7f19e0154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:33:07.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e5e00640 1 --2- 172.21.15.31:0/1319720905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e00b0ce0 0x7f19e0150e60 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f19d400d950 tx=0x7f19d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:07.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19da000640 1 -- 172.21.15.31:0/1319720905 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d4017070 con 0x7f19e00b0ce0 2024-09-17T05:33:07.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19da000640 1 -- 172.21.15.31:0/1319720905 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19d4009d20 con 0x7f19e00b0ce0 2024-09-17T05:33:07.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e7200640 1 -- 172.21.15.31:0/1319720905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e01f8800 con 0x7f19e00b0ce0 2024-09-17T05:33:07.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19da000640 1 -- 172.21.15.31:0/1319720905 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d40106c0 con 0x7f19e00b0ce0 2024-09-17T05:33:07.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e7200640 1 -- 172.21.15.31:0/1319720905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e01f8dc0 con 0x7f19e00b0ce0 2024-09-17T05:33:07.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.738+0000 7f19e7200640 1 -- 172.21.15.31:0/1319720905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e00b11a0 con 0x7f19e00b0ce0 2024-09-17T05:33:07.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.742+0000 7f19da000640 1 -- 172.21.15.31:0/1319720905 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f19d4010860 con 0x7f19e00b0ce0 2024-09-17T05:33:07.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.742+0000 7f19da000640 1 --2- 172.21.15.31:0/1319720905 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f19c4073320 0x7f19c40757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:07.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.742+0000 7f19da000640 1 -- 172.21.15.31:0/1319720905 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f19d40948f0 con 0x7f19e00b0ce0 2024-09-17T05:33:07.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.742+0000 7f19e5400640 1 --2- 172.21.15.31:0/1319720905 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f19c4073320 0x7f19c40757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:07.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.742+0000 7f19e5400640 1 --2- 172.21.15.31:0/1319720905 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f19c4073320 0x7f19c40757e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f19d0004620 tx=0x7f19d000c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:07.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.746+0000 7f19da000640 1 -- 172.21.15.31:0/1319720905 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f19d405f6e0 con 0x7f19e00b0ce0 2024-09-17T05:33:07.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.918+0000 7f19e7200640 1 -- 172.21.15.31:0/1319720905 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19e00ce0c0 con 0x7f19c4073320 2024-09-17T05:33:07.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.922+0000 7f19da000640 1 -- 172.21.15.31:0/1319720905 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252069 (secure 0 0 0) 0x7f19e00ce0c0 con 0x7f19c4073320 2024-09-17T05:33:07.928 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:07.930 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:33:07.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.926+0000 7f19e7200640 1 -- 172.21.15.31:0/1319720905 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f19c4073320 msgr2=0x7f19c40757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:07.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.926+0000 7f19e7200640 1 --2- 172.21.15.31:0/1319720905 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f19c4073320 0x7f19c40757e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f19d0004620 tx=0x7f19d000c040 comp rx=0 tx=0).stop 2024-09-17T05:33:07.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.926+0000 7f19e7200640 1 -- 172.21.15.31:0/1319720905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e00b0ce0 msgr2=0x7f19e0150e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:07.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.926+0000 7f19e7200640 1 --2- 172.21.15.31:0/1319720905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e00b0ce0 0x7f19e0150e60 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f19d400d950 tx=0x7f19d400de10 comp rx=0 tx=0).stop 2024-09-17T05:33:07.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.926+0000 7f19e7200640 1 -- 172.21.15.31:0/1319720905 shutdown_connections 2024-09-17T05:33:07.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.926+0000 7f19e7200640 1 --2- 172.21.15.31:0/1319720905 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f19c4073320 0x7f19c40757e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:07.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.926+0000 7f19e7200640 1 --2- 172.21.15.31:0/1319720905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19e00b5870 0x7f19e0147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:07.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.926+0000 7f19e7200640 1 --2- 172.21.15.31:0/1319720905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e00b4d80 0x7f19e0154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:07.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.926+0000 7f19e7200640 1 --2- 172.21.15.31:0/1319720905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19e00b0ce0 0x7f19e0150e60 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:07.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.926+0000 7f19e7200640 1 -- 172.21.15.31:0/1319720905 >> 172.21.15.31:0/1319720905 conn(0x7f19e009aa10 msgr2=0x7f19e0159c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:07.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.930+0000 7f19e7200640 1 -- 172.21.15.31:0/1319720905 shutdown_connections 2024-09-17T05:33:07.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:07.930+0000 7f19e7200640 1 -- 172.21.15.31:0/1319720905 wait complete. 2024-09-17T05:33:07.951 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-17T05:33:06.704115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258456,"kb_used_data":8936,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716264,"statfs":{"total":773094113280,"available":772829454336,"internally_reserved":0,"allocated":9150464,"data_stored":4550844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002080"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.798372+0000","last_change":"2024-09-17T05:32:58.788676+0000","last_active":"2024-09-17T05:33:00.798372+0000","last_peered":"2024-09-17T05:33:00.798372+0000","last_clean":"2024-09-17T05:33:00.798372+0000","last_became_active":"2024-09-17T05:32:58.784831+0000","last_became_peered":"2024-09-17T05:32:58.784831+0000","last_unstale":"2024-09-17T05:33:00.798372+0000","last_undegraded":"2024-09-17T05:33:00.798372+0000","last_fullsized":"2024-09-17T05:33:00.798372+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:28.005492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.787637+0000","last_change":"2024-09-17T05:32:58.800282+0000","last_active":"2024-09-17T05:32:59.787637+0000","last_peered":"2024-09-17T05:32:59.787637+0000","last_clean":"2024-09-17T05:32:59.787637+0000","last_became_active":"2024-09-17T05:32:58.799852+0000","last_became_peered":"2024-09-17T05:32:58.799852+0000","last_unstale":"2024-09-17T05:32:59.787637+0000","last_undegraded":"2024-09-17T05:32:59.787637+0000","last_fullsized":"2024-09-17T05:32:59.787637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:34.617740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.797599+0000","last_change":"2024-09-17T05:32:58.795181+0000","last_active":"2024-09-17T05:33:00.797599+0000","last_peered":"2024-09-17T05:33:00.797599+0000","last_clean":"2024-09-17T05:33:00.797599+0000","last_became_active":"2024-09-17T05:32:58.794569+0000","last_became_peered":"2024-09-17T05:32:58.794569+0000","last_unstale":"2024-09-17T05:33:00.797599+0000","last_undegraded":"2024-09-17T05:33:00.797599+0000","last_fullsized":"2024-09-17T05:33:00.797599+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:15:57.618839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.789640+0000","last_change":"2024-09-17T05:32:58.798556+0000","last_active":"2024-09-17T05:32:59.789640+0000","last_peered":"2024-09-17T05:32:59.789640+0000","last_clean":"2024-09-17T05:32:59.789640+0000","last_became_active":"2024-09-17T05:32:58.798305+0000","last_became_peered":"2024-09-17T05:32:58.798305+0000","last_unstale":"2024-09-17T05:32:59.789640+0000","last_undegraded":"2024-09-17T05:32:59.789640+0000","last_fullsized":"2024-09-17T05:32:59.789640+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:58.979714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.791370+0000","last_change":"2024-09-17T05:32:58.792391+0000","last_active":"2024-09-17T05:32:59.791370+0000","last_peered":"2024-09-17T05:32:59.791370+0000","last_clean":"2024-09-17T05:32:59.791370+0000","last_became_active":"2024-09-17T05:32:58.792107+0000","last_became_peered":"2024-09-17T05:32:58.792107+0000","last_unstale":"2024-09-17T05:32:59.791370+0000","last_undegraded":"2024-09-17T05:32:59.791370+0000","last_fullsized":"2024-09-17T05:32:59.791370+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:36.469628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.658759+0000","last_change":"2024-09-17T05:32:58.797125+0000","last_active":"2024-09-17T05:33:00.658759+0000","last_peered":"2024-09-17T05:33:00.658759+0000","last_clean":"2024-09-17T05:33:00.658759+0000","last_became_active":"2024-09-17T05:32:58.794658+0000","last_became_peered":"2024-09-17T05:32:58.794658+0000","last_unstale":"2024-09-17T05:33:00.658759+0000","last_undegraded":"2024-09-17T05:33:00.658759+0000","last_fullsized":"2024-09-17T05:33:00.658759+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:38.562385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.789149+0000","last_change":"2024-09-17T05:32:58.781493+0000","last_active":"2024-09-17T05:32:59.789149+0000","last_peered":"2024-09-17T05:32:59.789149+0000","last_clean":"2024-09-17T05:32:59.789149+0000","last_became_active":"2024-09-17T05:32:58.781092+0000","last_became_peered":"2024-09-17T05:32:58.781092+0000","last_unstale":"2024-09-17T05:32:59.789149+0000","last_undegraded":"2024-09-17T05:32:59.789149+0000","last_fullsized":"2024-09-17T05:32:59.789149+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:20.500422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.658723+0000","last_change":"2024-09-17T05:32:58.796802+0000","last_active":"2024-09-17T05:33:00.658723+0000","last_peered":"2024-09-17T05:33:00.658723+0000","last_clean":"2024-09-17T05:33:00.658723+0000","last_became_active":"2024-09-17T05:32:58.793919+0000","last_became_peered":"2024-09-17T05:32:58.793919+0000","last_unstale":"2024-09-17T05:33:00.658723+0000","last_undegraded":"2024-09-17T05:33:00.658723+0000","last_fullsized":"2024-09-17T05:33:00.658723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:29.270469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.658988+0000","last_change":"2024-09-17T05:32:58.788190+0000","last_active":"2024-09-17T05:33:00.658988+0000","last_peered":"2024-09-17T05:33:00.658988+0000","last_clean":"2024-09-17T05:33:00.658988+0000","last_became_active":"2024-09-17T05:32:58.787864+0000","last_became_peered":"2024-09-17T05:32:58.787864+0000","last_unstale":"2024-09-17T05:33:00.658988+0000","last_undegraded":"2024-09-17T05:33:00.658988+0000","last_fullsized":"2024-09-17T05:33:00.658988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:38.770248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.798568+0000","last_change":"2024-09-17T05:32:58.800339+0000","last_active":"2024-09-17T05:33:00.798568+0000","last_peered":"2024-09-17T05:33:00.798568+0000","last_clean":"2024-09-17T05:33:00.798568+0000","last_became_active":"2024-09-17T05:32:58.800077+0000","last_became_peered":"2024-09-17T05:32:58.800077+0000","last_unstale":"2024-09-17T05:33:00.798568+0000","last_undegraded":"2024-09-17T05:33:00.798568+0000","last_fullsized":"2024-09-17T05:33:00.798568+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:21.747835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.787590+0000","last_change":"2024-09-17T05:32:58.802865+0000","last_active":"2024-09-17T05:32:59.787590+0000","last_peered":"2024-09-17T05:32:59.787590+0000","last_clean":"2024-09-17T05:32:59.787590+0000","last_became_active":"2024-09-17T05:32:58.802590+0000","last_became_peered":"2024-09-17T05:32:58.802590+0000","last_unstale":"2024-09-17T05:32:59.787590+0000","last_undegraded":"2024-09-17T05:32:59.787590+0000","last_fullsized":"2024-09-17T05:32:59.787590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:55.756633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.797732+0000","last_change":"2024-09-17T05:32:58.803236+0000","last_active":"2024-09-17T05:33:00.797732+0000","last_peered":"2024-09-17T05:33:00.797732+0000","last_clean":"2024-09-17T05:33:00.797732+0000","last_became_active":"2024-09-17T05:32:58.802937+0000","last_became_peered":"2024-09-17T05:32:58.802937+0000","last_unstale":"2024-09-17T05:33:00.797732+0000","last_undegraded":"2024-09-17T05:33:00.797732+0000","last_fullsized":"2024-09-17T05:33:00.797732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:36.335067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.797944+0000","last_change":"2024-09-17T05:32:58.794103+0000","last_active":"2024-09-17T05:33:00.797944+0000","last_peered":"2024-09-17T05:33:00.797944+0000","last_clean":"2024-09-17T05:33:00.797944+0000","last_became_active":"2024-09-17T05:32:58.791529+0000","last_became_peered":"2024-09-17T05:32:58.791529+0000","last_unstale":"2024-09-17T05:33:00.797944+0000","last_undegraded":"2024-09-17T05:33:00.797944+0000","last_fullsized":"2024-09-17T05:33:00.797944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:31.972532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.789219+0000","last_change":"2024-09-17T05:32:58.793632+0000","last_active":"2024-09-17T05:32:59.789219+0000","last_peered":"2024-09-17T05:32:59.789219+0000","last_clean":"2024-09-17T05:32:59.789219+0000","last_became_active":"2024-09-17T05:32:58.792977+0000","last_became_peered":"2024-09-17T05:32:58.792977+0000","last_unstale":"2024-09-17T05:32:59.789219+0000","last_undegraded":"2024-09-17T05:32:59.789219+0000","last_fullsized":"2024-09-17T05:32:59.789219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:09.383734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.793488+0000","last_change":"2024-09-17T05:32:58.783056+0000","last_active":"2024-09-17T05:33:00.793488+0000","last_peered":"2024-09-17T05:33:00.793488+0000","last_clean":"2024-09-17T05:33:00.793488+0000","last_became_active":"2024-09-17T05:32:58.782421+0000","last_became_peered":"2024-09-17T05:32:58.782421+0000","last_unstale":"2024-09-17T05:33:00.793488+0000","last_undegraded":"2024-09-17T05:33:00.793488+0000","last_fullsized":"2024-09-17T05:33:00.793488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:05.902152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.791418+0000","last_change":"2024-09-17T05:32:58.797138+0000","last_active":"2024-09-17T05:32:59.791418+0000","last_peered":"2024-09-17T05:32:59.791418+0000","last_clean":"2024-09-17T05:32:59.791418+0000","last_became_active":"2024-09-17T05:32:58.796864+0000","last_became_peered":"2024-09-17T05:32:58.796864+0000","last_unstale":"2024-09-17T05:32:59.791418+0000","last_undegraded":"2024-09-17T05:32:59.791418+0000","last_fullsized":"2024-09-17T05:32:59.791418+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:19.288127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.791221+0000","last_change":"2024-09-17T05:32:58.789009+0000","last_active":"2024-09-17T05:32:59.791221+0000","last_peered":"2024-09-17T05:32:59.791221+0000","last_clean":"2024-09-17T05:32:59.791221+0000","last_became_active":"2024-09-17T05:32:58.788689+0000","last_became_peered":"2024-09-17T05:32:58.788689+0000","last_unstale":"2024-09-17T05:32:59.791221+0000","last_undegraded":"2024-09-17T05:32:59.791221+0000","last_fullsized":"2024-09-17T05:32:59.791221+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:10.093303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.789664+0000","last_change":"2024-09-17T05:32:58.796848+0000","last_active":"2024-09-17T05:32:59.789664+0000","last_peered":"2024-09-17T05:32:59.789664+0000","last_clean":"2024-09-17T05:32:59.789664+0000","last_became_active":"2024-09-17T05:32:58.796560+0000","last_became_peered":"2024-09-17T05:32:58.796560+0000","last_unstale":"2024-09-17T05:32:59.789664+0000","last_undegraded":"2024-09-17T05:32:59.789664+0000","last_fullsized":"2024-09-17T05:32:59.789664+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:48.001549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.507815+0000","last_change":"2024-09-17T05:32:58.781644+0000","last_active":"2024-09-17T05:33:00.507815+0000","last_peered":"2024-09-17T05:33:00.507815+0000","last_clean":"2024-09-17T05:33:00.507815+0000","last_became_active":"2024-09-17T05:32:58.781316+0000","last_became_peered":"2024-09-17T05:32:58.781316+0000","last_unstale":"2024-09-17T05:33:00.507815+0000","last_undegraded":"2024-09-17T05:33:00.507815+0000","last_fullsized":"2024-09-17T05:33:00.507815+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:02.888331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.789642+0000","last_change":"2024-09-17T05:32:58.782888+0000","last_active":"2024-09-17T05:32:59.789642+0000","last_peered":"2024-09-17T05:32:59.789642+0000","last_clean":"2024-09-17T05:32:59.789642+0000","last_became_active":"2024-09-17T05:32:58.782581+0000","last_became_peered":"2024-09-17T05:32:58.782581+0000","last_unstale":"2024-09-17T05:32:59.789642+0000","last_undegraded":"2024-09-17T05:32:59.789642+0000","last_fullsized":"2024-09-17T05:32:59.789642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:30.895439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.789511+0000","last_change":"2024-09-17T05:32:58.784479+0000","last_active":"2024-09-17T05:32:59.789511+0000","last_peered":"2024-09-17T05:32:59.789511+0000","last_clean":"2024-09-17T05:32:59.789511+0000","last_became_active":"2024-09-17T05:32:58.784174+0000","last_became_peered":"2024-09-17T05:32:58.784174+0000","last_unstale":"2024-09-17T05:32:59.789511+0000","last_undegraded":"2024-09-17T05:32:59.789511+0000","last_fullsized":"2024-09-17T05:32:59.789511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:38.493045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.787117+0000","last_change":"2024-09-17T05:32:58.804532+0000","last_active":"2024-09-17T05:32:59.787117+0000","last_peered":"2024-09-17T05:32:59.787117+0000","last_clean":"2024-09-17T05:32:59.787117+0000","last_became_active":"2024-09-17T05:32:58.804189+0000","last_became_peered":"2024-09-17T05:32:58.804189+0000","last_unstale":"2024-09-17T05:32:59.787117+0000","last_undegraded":"2024-09-17T05:32:59.787117+0000","last_fullsized":"2024-09-17T05:32:59.787117+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:25.843973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.797525+0000","last_change":"2024-09-17T05:32:58.790833+0000","last_active":"2024-09-17T05:33:00.797525+0000","last_peered":"2024-09-17T05:33:00.797525+0000","last_clean":"2024-09-17T05:33:00.797525+0000","last_became_active":"2024-09-17T05:32:58.790525+0000","last_became_peered":"2024-09-17T05:32:58.790525+0000","last_unstale":"2024-09-17T05:33:00.797525+0000","last_undegraded":"2024-09-17T05:33:00.797525+0000","last_fullsized":"2024-09-17T05:33:00.797525+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:31.350651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.789060+0000","last_change":"2024-09-17T05:32:58.783791+0000","last_active":"2024-09-17T05:32:59.789060+0000","last_peered":"2024-09-17T05:32:59.789060+0000","last_clean":"2024-09-17T05:32:59.789060+0000","last_became_active":"2024-09-17T05:32:58.783524+0000","last_became_peered":"2024-09-17T05:32:58.783524+0000","last_unstale":"2024-09-17T05:32:59.789060+0000","last_undegraded":"2024-09-17T05:32:59.789060+0000","last_fullsized":"2024-09-17T05:32:59.789060+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:02.743134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.787622+0000","last_change":"2024-09-17T05:32:58.800261+0000","last_active":"2024-09-17T05:32:59.787622+0000","last_peered":"2024-09-17T05:32:59.787622+0000","last_clean":"2024-09-17T05:32:59.787622+0000","last_became_active":"2024-09-17T05:32:58.799956+0000","last_became_peered":"2024-09-17T05:32:58.799956+0000","last_unstale":"2024-09-17T05:32:59.787622+0000","last_undegraded":"2024-09-17T05:32:59.787622+0000","last_fullsized":"2024-09-17T05:32:59.787622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:08.094072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.797616+0000","last_change":"2024-09-17T05:32:58.799631+0000","last_active":"2024-09-17T05:33:00.797616+0000","last_peered":"2024-09-17T05:33:00.797616+0000","last_clean":"2024-09-17T05:33:00.797616+0000","last_became_active":"2024-09-17T05:32:58.799099+0000","last_became_peered":"2024-09-17T05:32:58.799099+0000","last_unstale":"2024-09-17T05:33:00.797616+0000","last_undegraded":"2024-09-17T05:33:00.797616+0000","last_fullsized":"2024-09-17T05:33:00.797616+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:18.176671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.791167+0000","last_change":"2024-09-17T05:32:58.796342+0000","last_active":"2024-09-17T05:32:59.791167+0000","last_peered":"2024-09-17T05:32:59.791167+0000","last_clean":"2024-09-17T05:32:59.791167+0000","last_became_active":"2024-09-17T05:32:58.796097+0000","last_became_peered":"2024-09-17T05:32:58.796097+0000","last_unstale":"2024-09-17T05:32:59.791167+0000","last_undegraded":"2024-09-17T05:32:59.791167+0000","last_fullsized":"2024-09-17T05:32:59.791167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:30.665606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.797932+0000","last_change":"2024-09-17T05:32:58.793852+0000","last_active":"2024-09-17T05:33:00.797932+0000","last_peered":"2024-09-17T05:33:00.797932+0000","last_clean":"2024-09-17T05:33:00.797932+0000","last_became_active":"2024-09-17T05:32:58.793512+0000","last_became_peered":"2024-09-17T05:32:58.793512+0000","last_unstale":"2024-09-17T05:33:00.797932+0000","last_undegraded":"2024-09-17T05:33:00.797932+0000","last_fullsized":"2024-09-17T05:33:00.797932+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:46.276839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.787263+0000","last_change":"2024-09-17T05:32:58.805019+0000","last_active":"2024-09-17T05:32:59.787263+0000","last_peered":"2024-09-17T05:32:59.787263+0000","last_clean":"2024-09-17T05:32:59.787263+0000","last_became_active":"2024-09-17T05:32:58.804714+0000","last_became_peered":"2024-09-17T05:32:58.804714+0000","last_unstale":"2024-09-17T05:32:59.787263+0000","last_undegraded":"2024-09-17T05:32:59.787263+0000","last_fullsized":"2024-09-17T05:32:59.787263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:04.623604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.787289+0000","last_change":"2024-09-17T05:32:58.810447+0000","last_active":"2024-09-17T05:32:59.787289+0000","last_peered":"2024-09-17T05:32:59.787289+0000","last_clean":"2024-09-17T05:32:59.787289+0000","last_became_active":"2024-09-17T05:32:58.810098+0000","last_became_peered":"2024-09-17T05:32:58.810098+0000","last_unstale":"2024-09-17T05:32:59.787289+0000","last_undegraded":"2024-09-17T05:32:59.787289+0000","last_fullsized":"2024-09-17T05:32:59.787289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:14:28.320683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.790854+0000","last_change":"2024-09-17T05:32:58.785251+0000","last_active":"2024-09-17T05:32:59.790854+0000","last_peered":"2024-09-17T05:32:59.790854+0000","last_clean":"2024-09-17T05:32:59.790854+0000","last_became_active":"2024-09-17T05:32:58.784985+0000","last_became_peered":"2024-09-17T05:32:58.784985+0000","last_unstale":"2024-09-17T05:32:59.790854+0000","last_undegraded":"2024-09-17T05:32:59.790854+0000","last_fullsized":"2024-09-17T05:32:59.790854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:46.276839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.799070+0000","last_change":"2024-09-17T05:32:58.800326+0000","last_active":"2024-09-17T05:33:00.799070+0000","last_peered":"2024-09-17T05:33:00.799070+0000","last_clean":"2024-09-17T05:33:00.799070+0000","last_became_active":"2024-09-17T05:32:58.799985+0000","last_became_peered":"2024-09-17T05:32:58.799985+0000","last_unstale":"2024-09-17T05:33:00.799070+0000","last_undegraded":"2024-09-17T05:33:00.799070+0000","last_fullsized":"2024-09-17T05:33:00.799070+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:09:07.439599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.791085+0000","last_change":"2024-09-17T05:32:58.796650+0000","last_active":"2024-09-17T05:32:59.791085+0000","last_peered":"2024-09-17T05:32:59.791085+0000","last_clean":"2024-09-17T05:32:59.791085+0000","last_became_active":"2024-09-17T05:32:58.796375+0000","last_became_peered":"2024-09-17T05:32:58.796375+0000","last_unstale":"2024-09-17T05:32:59.791085+0000","last_undegraded":"2024-09-17T05:32:59.791085+0000","last_fullsized":"2024-09-17T05:32:59.791085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:07.788725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"80'4","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.798826+0000","last_change":"2024-09-17T05:32:57.760900+0000","last_active":"2024-09-17T05:33:00.798826+0000","last_peered":"2024-09-17T05:33:00.798826+0000","last_clean":"2024-09-17T05:33:00.798826+0000","last_became_active":"2024-09-17T05:32:57.760587+0000","last_became_peered":"2024-09-17T05:32:57.760587+0000","last_unstale":"2024-09-17T05:33:00.798826+0000","last_undegraded":"2024-09-17T05:33:00.798826+0000","last_fullsized":"2024-09-17T05:33:00.798826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:46:17.573537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.798646+0000","last_change":"2024-09-17T05:32:58.789357+0000","last_active":"2024-09-17T05:33:00.798646+0000","last_peered":"2024-09-17T05:33:00.798646+0000","last_clean":"2024-09-17T05:33:00.798646+0000","last_became_active":"2024-09-17T05:32:58.789083+0000","last_became_peered":"2024-09-17T05:32:58.789083+0000","last_unstale":"2024-09-17T05:33:00.798646+0000","last_undegraded":"2024-09-17T05:33:00.798646+0000","last_fullsized":"2024-09-17T05:33:00.798646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:10.093303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.791301+0000","last_change":"2024-09-17T05:32:57.778135+0000","last_active":"2024-09-17T05:32:59.791301+0000","last_peered":"2024-09-17T05:32:59.791301+0000","last_clean":"2024-09-17T05:32:59.791301+0000","last_became_active":"2024-09-17T05:32:57.777834+0000","last_became_peered":"2024-09-17T05:32:57.777834+0000","last_unstale":"2024-09-17T05:32:59.791301+0000","last_undegraded":"2024-09-17T05:32:59.791301+0000","last_fullsized":"2024-09-17T05:32:59.791301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:54.237669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.798116+0000","last_change":"2024-09-17T05:32:58.802462+0000","last_active":"2024-09-17T05:33:00.798116+0000","last_peered":"2024-09-17T05:33:00.798116+0000","last_clean":"2024-09-17T05:33:00.798116+0000","last_became_active":"2024-09-17T05:32:58.802088+0000","last_became_peered":"2024-09-17T05:32:58.802088+0000","last_unstale":"2024-09-17T05:33:00.798116+0000","last_undegraded":"2024-09-17T05:33:00.798116+0000","last_fullsized":"2024-09-17T05:33:00.798116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:07.788725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.507868+0000","last_change":"2024-09-17T05:32:57.761438+0000","last_active":"2024-09-17T05:33:00.507868+0000","last_peered":"2024-09-17T05:33:00.507868+0000","last_clean":"2024-09-17T05:33:00.507868+0000","last_became_active":"2024-09-17T05:32:57.761180+0000","last_became_peered":"2024-09-17T05:32:57.761180+0000","last_unstale":"2024-09-17T05:33:00.507868+0000","last_undegraded":"2024-09-17T05:33:00.507868+0000","last_fullsized":"2024-09-17T05:33:00.507868+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:44:23.275893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.797813+0000","last_change":"2024-09-17T05:32:58.794876+0000","last_active":"2024-09-17T05:33:00.797813+0000","last_peered":"2024-09-17T05:33:00.797813+0000","last_clean":"2024-09-17T05:33:00.797813+0000","last_became_active":"2024-09-17T05:32:58.794237+0000","last_became_peered":"2024-09-17T05:32:58.794237+0000","last_unstale":"2024-09-17T05:33:00.797813+0000","last_undegraded":"2024-09-17T05:33:00.797813+0000","last_fullsized":"2024-09-17T05:33:00.797813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:33.141176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.507668+0000","last_change":"2024-09-17T05:32:57.762038+0000","last_active":"2024-09-17T05:33:00.507668+0000","last_peered":"2024-09-17T05:33:00.507668+0000","last_clean":"2024-09-17T05:33:00.507668+0000","last_became_active":"2024-09-17T05:32:57.761027+0000","last_became_peered":"2024-09-17T05:32:57.761027+0000","last_unstale":"2024-09-17T05:33:00.507668+0000","last_undegraded":"2024-09-17T05:33:00.507668+0000","last_fullsized":"2024-09-17T05:33:00.507668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:01:04.898217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.787402+0000","last_change":"2024-09-17T05:32:58.804062+0000","last_active":"2024-09-17T05:32:59.787402+0000","last_peered":"2024-09-17T05:32:59.787402+0000","last_clean":"2024-09-17T05:32:59.787402+0000","last_became_active":"2024-09-17T05:32:58.803742+0000","last_became_peered":"2024-09-17T05:32:58.803742+0000","last_unstale":"2024-09-17T05:32:59.787402+0000","last_undegraded":"2024-09-17T05:32:59.787402+0000","last_fullsized":"2024-09-17T05:32:59.787402+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:59.256079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.791633+0000","last_change":"2024-09-17T05:32:57.777503+0000","last_active":"2024-09-17T05:32:59.791633+0000","last_peered":"2024-09-17T05:32:59.791633+0000","last_clean":"2024-09-17T05:32:59.791633+0000","last_became_active":"2024-09-17T05:32:57.777284+0000","last_became_peered":"2024-09-17T05:32:57.777284+0000","last_unstale":"2024-09-17T05:32:59.791633+0000","last_undegraded":"2024-09-17T05:32:59.791633+0000","last_fullsized":"2024-09-17T05:32:59.791633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:06.657238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.791399+0000","last_change":"2024-09-17T05:32:58.790979+0000","last_active":"2024-09-17T05:32:59.791399+0000","last_peered":"2024-09-17T05:32:59.791399+0000","last_clean":"2024-09-17T05:32:59.791399+0000","last_became_active":"2024-09-17T05:32:58.790631+0000","last_became_peered":"2024-09-17T05:32:58.790631+0000","last_unstale":"2024-09-17T05:32:59.791399+0000","last_undegraded":"2024-09-17T05:32:59.791399+0000","last_fullsized":"2024-09-17T05:32:59.791399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:08.988361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.790800+0000","last_change":"2024-09-17T05:32:57.778177+0000","last_active":"2024-09-17T05:32:59.790800+0000","last_peered":"2024-09-17T05:32:59.790800+0000","last_clean":"2024-09-17T05:32:59.790800+0000","last_became_active":"2024-09-17T05:32:57.777881+0000","last_became_peered":"2024-09-17T05:32:57.777881+0000","last_unstale":"2024-09-17T05:32:59.790800+0000","last_undegraded":"2024-09-17T05:32:59.790800+0000","last_fullsized":"2024-09-17T05:32:59.790800+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:34.785317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.797179+0000","last_change":"2024-09-17T05:32:58.790305+0000","last_active":"2024-09-17T05:33:00.797179+0000","last_peered":"2024-09-17T05:33:00.797179+0000","last_clean":"2024-09-17T05:33:00.797179+0000","last_became_active":"2024-09-17T05:32:58.789987+0000","last_became_peered":"2024-09-17T05:32:58.789987+0000","last_unstale":"2024-09-17T05:33:00.797179+0000","last_undegraded":"2024-09-17T05:33:00.797179+0000","last_fullsized":"2024-09-17T05:33:00.797179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:33.204621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.507395+0000","last_change":"2024-09-17T05:32:57.765590+0000","last_active":"2024-09-17T05:33:00.507395+0000","last_peered":"2024-09-17T05:33:00.507395+0000","last_clean":"2024-09-17T05:33:00.507395+0000","last_became_active":"2024-09-17T05:32:57.765285+0000","last_became_peered":"2024-09-17T05:32:57.765285+0000","last_unstale":"2024-09-17T05:33:00.507395+0000","last_undegraded":"2024-09-17T05:33:00.507395+0000","last_fullsized":"2024-09-17T05:33:00.507395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:39.800763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.793521+0000","last_change":"2024-09-17T05:32:58.782711+0000","last_active":"2024-09-17T05:33:00.793521+0000","last_peered":"2024-09-17T05:33:00.793521+0000","last_clean":"2024-09-17T05:33:00.793521+0000","last_became_active":"2024-09-17T05:32:58.782086+0000","last_became_peered":"2024-09-17T05:32:58.782086+0000","last_unstale":"2024-09-17T05:33:00.793521+0000","last_undegraded":"2024-09-17T05:33:00.793521+0000","last_fullsized":"2024-09-17T05:33:00.793521+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:40.714092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.787147+0000","last_change":"2024-09-17T05:32:57.771325+0000","last_active":"2024-09-17T05:32:59.787147+0000","last_peered":"2024-09-17T05:32:59.787147+0000","last_clean":"2024-09-17T05:32:59.787147+0000","last_became_active":"2024-09-17T05:32:57.771046+0000","last_became_peered":"2024-09-17T05:32:57.771046+0000","last_unstale":"2024-09-17T05:32:59.787147+0000","last_undegraded":"2024-09-17T05:32:59.787147+0000","last_fullsized":"2024-09-17T05:32:59.787147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:07.124575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.794054+0000","last_change":"2024-09-17T05:32:58.796022+0000","last_active":"2024-09-17T05:33:00.794054+0000","last_peered":"2024-09-17T05:33:00.794054+0000","last_clean":"2024-09-17T05:33:00.794054+0000","last_became_active":"2024-09-17T05:32:58.795745+0000","last_became_peered":"2024-09-17T05:32:58.795745+0000","last_unstale":"2024-09-17T05:33:00.794054+0000","last_undegraded":"2024-09-17T05:33:00.794054+0000","last_fullsized":"2024-09-17T05:33:00.794054+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:08.415068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.798953+0000","last_change":"2024-09-17T05:32:57.775051+0000","last_active":"2024-09-17T05:33:00.798953+0000","last_peered":"2024-09-17T05:33:00.798953+0000","last_clean":"2024-09-17T05:33:00.798953+0000","last_became_active":"2024-09-17T05:32:57.774665+0000","last_became_peered":"2024-09-17T05:32:57.774665+0000","last_unstale":"2024-09-17T05:33:00.798953+0000","last_undegraded":"2024-09-17T05:33:00.798953+0000","last_fullsized":"2024-09-17T05:33:00.798953+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:29.260151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.659008+0000","last_change":"2024-09-17T05:32:58.794918+0000","last_active":"2024-09-17T05:33:00.659008+0000","last_peered":"2024-09-17T05:33:00.659008+0000","last_clean":"2024-09-17T05:33:00.659008+0000","last_became_active":"2024-09-17T05:32:58.794564+0000","last_became_peered":"2024-09-17T05:32:58.794564+0000","last_unstale":"2024-09-17T05:33:00.659008+0000","last_undegraded":"2024-09-17T05:33:00.659008+0000","last_fullsized":"2024-09-17T05:33:00.659008+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:46:58.505958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.798590+0000","last_change":"2024-09-17T05:32:57.771838+0000","last_active":"2024-09-17T05:33:00.798590+0000","last_peered":"2024-09-17T05:33:00.798590+0000","last_clean":"2024-09-17T05:33:00.798590+0000","last_became_active":"2024-09-17T05:32:57.771585+0000","last_became_peered":"2024-09-17T05:32:57.771585+0000","last_unstale":"2024-09-17T05:33:00.798590+0000","last_undegraded":"2024-09-17T05:33:00.798590+0000","last_fullsized":"2024-09-17T05:33:00.798590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:28.949428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.507640+0000","last_change":"2024-09-17T05:32:58.794780+0000","last_active":"2024-09-17T05:33:00.507640+0000","last_peered":"2024-09-17T05:33:00.507640+0000","last_clean":"2024-09-17T05:33:00.507640+0000","last_became_active":"2024-09-17T05:32:58.794514+0000","last_became_peered":"2024-09-17T05:32:58.794514+0000","last_unstale":"2024-09-17T05:33:00.507640+0000","last_undegraded":"2024-09-17T05:33:00.507640+0000","last_fullsized":"2024-09-17T05:33:00.507640+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:46:58.505958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"80'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.798267+0000","last_change":"2024-09-17T05:32:57.774796+0000","last_active":"2024-09-17T05:33:00.798267+0000","last_peered":"2024-09-17T05:33:00.798267+0000","last_clean":"2024-09-17T05:33:00.798267+0000","last_became_active":"2024-09-17T05:32:57.774446+0000","last_became_peered":"2024-09-17T05:32:57.774446+0000","last_unstale":"2024-09-17T05:33:00.798267+0000","last_undegraded":"2024-09-17T05:33:00.798267+0000","last_fullsized":"2024-09-17T05:33:00.798267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:39.379149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.791153+0000","last_change":"2024-09-17T05:32:58.786655+0000","last_active":"2024-09-17T05:32:59.791153+0000","last_peered":"2024-09-17T05:32:59.791153+0000","last_clean":"2024-09-17T05:32:59.791153+0000","last_became_active":"2024-09-17T05:32:58.785979+0000","last_became_peered":"2024-09-17T05:32:58.785979+0000","last_unstale":"2024-09-17T05:32:59.791153+0000","last_undegraded":"2024-09-17T05:32:59.791153+0000","last_fullsized":"2024-09-17T05:32:59.791153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:28.005492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"80'6","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.658788+0000","last_change":"2024-09-17T05:32:57.772140+0000","last_active":"2024-09-17T05:33:00.658788+0000","last_peered":"2024-09-17T05:33:00.658788+0000","last_clean":"2024-09-17T05:33:00.658788+0000","last_became_active":"2024-09-17T05:32:57.771854+0000","last_became_peered":"2024-09-17T05:32:57.771854+0000","last_unstale":"2024-09-17T05:33:00.658788+0000","last_undegraded":"2024-09-17T05:33:00.658788+0000","last_fullsized":"2024-09-17T05:33:00.658788+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:59.096504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.507355+0000","last_change":"2024-09-17T05:32:58.781887+0000","last_active":"2024-09-17T05:33:00.507355+0000","last_peered":"2024-09-17T05:33:00.507355+0000","last_clean":"2024-09-17T05:33:00.507355+0000","last_became_active":"2024-09-17T05:32:58.781620+0000","last_became_peered":"2024-09-17T05:32:58.781620+0000","last_unstale":"2024-09-17T05:33:00.507355+0000","last_undegraded":"2024-09-17T05:33:00.507355+0000","last_fullsized":"2024-09-17T05:33:00.507355+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:55.182012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.787266+0000","last_change":"2024-09-17T05:32:57.776757+0000","last_active":"2024-09-17T05:32:59.787266+0000","last_peered":"2024-09-17T05:32:59.787266+0000","last_clean":"2024-09-17T05:32:59.787266+0000","last_became_active":"2024-09-17T05:32:57.776494+0000","last_became_peered":"2024-09-17T05:32:57.776494+0000","last_unstale":"2024-09-17T05:32:59.787266+0000","last_undegraded":"2024-09-17T05:32:59.787266+0000","last_fullsized":"2024-09-17T05:32:59.787266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:54.349844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.798082+0000","last_change":"2024-09-17T05:32:58.798149+0000","last_active":"2024-09-17T05:33:00.798082+0000","last_peered":"2024-09-17T05:33:00.798082+0000","last_clean":"2024-09-17T05:33:00.798082+0000","last_became_active":"2024-09-17T05:32:58.797890+0000","last_became_peered":"2024-09-17T05:32:58.797890+0000","last_unstale":"2024-09-17T05:33:00.798082+0000","last_undegraded":"2024-09-17T05:33:00.798082+0000","last_fullsized":"2024-09-17T05:33:00.798082+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:06:36.165795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.793612+0000","last_change":"2024-09-17T05:32:57.778389+0000","last_active":"2024-09-17T05:33:00.793612+0000","last_peered":"2024-09-17T05:33:00.793612+0000","last_clean":"2024-09-17T05:33:00.793612+0000","last_became_active":"2024-09-17T05:32:57.778131+0000","last_became_peered":"2024-09-17T05:32:57.778131+0000","last_unstale":"2024-09-17T05:33:00.793612+0000","last_undegraded":"2024-09-17T05:33:00.793612+0000","last_fullsized":"2024-09-17T05:33:00.793612+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:38.576606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.786980+0000","last_change":"2024-09-17T05:32:58.797048+0000","last_active":"2024-09-17T05:32:59.786980+0000","last_peered":"2024-09-17T05:32:59.786980+0000","last_clean":"2024-09-17T05:32:59.786980+0000","last_became_active":"2024-09-17T05:32:58.796720+0000","last_became_peered":"2024-09-17T05:32:58.796720+0000","last_unstale":"2024-09-17T05:32:59.786980+0000","last_undegraded":"2024-09-17T05:32:59.786980+0000","last_fullsized":"2024-09-17T05:32:59.786980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:21.363735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.658648+0000","last_change":"2024-09-17T05:32:57.773894+0000","last_active":"2024-09-17T05:33:00.658648+0000","last_peered":"2024-09-17T05:33:00.658648+0000","last_clean":"2024-09-17T05:33:00.658648+0000","last_became_active":"2024-09-17T05:32:57.772427+0000","last_became_peered":"2024-09-17T05:32:57.772427+0000","last_unstale":"2024-09-17T05:33:00.658648+0000","last_undegraded":"2024-09-17T05:33:00.658648+0000","last_fullsized":"2024-09-17T05:33:00.658648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:25.208627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.786940+0000","last_change":"2024-09-17T05:32:58.800189+0000","last_active":"2024-09-17T05:32:59.786940+0000","last_peered":"2024-09-17T05:32:59.786940+0000","last_clean":"2024-09-17T05:32:59.786940+0000","last_became_active":"2024-09-17T05:32:58.799867+0000","last_became_peered":"2024-09-17T05:32:58.799867+0000","last_unstale":"2024-09-17T05:32:59.786940+0000","last_undegraded":"2024-09-17T05:32:59.786940+0000","last_fullsized":"2024-09-17T05:32:59.786940+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:49.954663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"80'8","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.507335+0000","last_change":"2024-09-17T05:32:57.772094+0000","last_active":"2024-09-17T05:33:00.507335+0000","last_peered":"2024-09-17T05:33:00.507335+0000","last_clean":"2024-09-17T05:33:00.507335+0000","last_became_active":"2024-09-17T05:32:57.771783+0000","last_became_peered":"2024-09-17T05:32:57.771783+0000","last_unstale":"2024-09-17T05:33:00.507335+0000","last_undegraded":"2024-09-17T05:33:00.507335+0000","last_fullsized":"2024-09-17T05:33:00.507335+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:15.062161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.797835+0000","last_change":"2024-09-17T05:32:58.786475+0000","last_active":"2024-09-17T05:33:00.797835+0000","last_peered":"2024-09-17T05:33:00.797835+0000","last_clean":"2024-09-17T05:33:00.797835+0000","last_became_active":"2024-09-17T05:32:58.784906+0000","last_became_peered":"2024-09-17T05:32:58.784906+0000","last_unstale":"2024-09-17T05:33:00.797835+0000","last_undegraded":"2024-09-17T05:33:00.797835+0000","last_fullsized":"2024-09-17T05:33:00.797835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:07.790355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.799132+0000","last_change":"2024-09-17T05:32:57.768304+0000","last_active":"2024-09-17T05:33:00.799132+0000","last_peered":"2024-09-17T05:33:00.799132+0000","last_clean":"2024-09-17T05:33:00.799132+0000","last_became_active":"2024-09-17T05:32:57.767994+0000","last_became_peered":"2024-09-17T05:32:57.767994+0000","last_unstale":"2024-09-17T05:33:00.799132+0000","last_undegraded":"2024-09-17T05:33:00.799132+0000","last_fullsized":"2024-09-17T05:33:00.799132+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:28.539354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.798725+0000","last_change":"2024-09-17T05:32:58.785100+0000","last_active":"2024-09-17T05:33:00.798725+0000","last_peered":"2024-09-17T05:33:00.798725+0000","last_clean":"2024-09-17T05:33:00.798725+0000","last_became_active":"2024-09-17T05:32:58.784474+0000","last_became_peered":"2024-09-17T05:32:58.784474+0000","last_unstale":"2024-09-17T05:33:00.798725+0000","last_undegraded":"2024-09-17T05:33:00.798725+0000","last_fullsized":"2024-09-17T05:33:00.798725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:36.469628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.507819+0000","last_change":"2024-09-17T05:32:57.771902+0000","last_active":"2024-09-17T05:33:00.507819+0000","last_peered":"2024-09-17T05:33:00.507819+0000","last_clean":"2024-09-17T05:33:00.507819+0000","last_became_active":"2024-09-17T05:32:57.770752+0000","last_became_peered":"2024-09-17T05:32:57.770752+0000","last_unstale":"2024-09-17T05:33:00.507819+0000","last_undegraded":"2024-09-17T05:33:00.507819+0000","last_fullsized":"2024-09-17T05:33:00.507819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:28.155269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.791437+0000","last_change":"2024-09-17T05:32:58.792211+0000","last_active":"2024-09-17T05:32:59.791437+0000","last_peered":"2024-09-17T05:32:59.791437+0000","last_clean":"2024-09-17T05:32:59.791437+0000","last_became_active":"2024-09-17T05:32:58.791583+0000","last_became_peered":"2024-09-17T05:32:58.791583+0000","last_unstale":"2024-09-17T05:32:59.791437+0000","last_undegraded":"2024-09-17T05:32:59.791437+0000","last_fullsized":"2024-09-17T05:32:59.791437+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:09:07.439599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.507774+0000","last_change":"2024-09-17T05:32:57.766899+0000","last_active":"2024-09-17T05:33:00.507774+0000","last_peered":"2024-09-17T05:33:00.507774+0000","last_clean":"2024-09-17T05:33:00.507774+0000","last_became_active":"2024-09-17T05:32:57.766580+0000","last_became_peered":"2024-09-17T05:32:57.766580+0000","last_unstale":"2024-09-17T05:33:00.507774+0000","last_undegraded":"2024-09-17T05:33:00.507774+0000","last_fullsized":"2024-09-17T05:33:00.507774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:40.526900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.789255+0000","last_change":"2024-09-17T05:32:58.793293+0000","last_active":"2024-09-17T05:32:59.789255+0000","last_peered":"2024-09-17T05:32:59.789255+0000","last_clean":"2024-09-17T05:32:59.789255+0000","last_became_active":"2024-09-17T05:32:58.792540+0000","last_became_peered":"2024-09-17T05:32:58.792540+0000","last_unstale":"2024-09-17T05:32:59.789255+0000","last_undegraded":"2024-09-17T05:32:59.789255+0000","last_fullsized":"2024-09-17T05:32:59.789255+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:47.249112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.793759+0000","last_change":"2024-09-17T05:32:57.773771+0000","last_active":"2024-09-17T05:33:00.793759+0000","last_peered":"2024-09-17T05:33:00.793759+0000","last_clean":"2024-09-17T05:33:00.793759+0000","last_became_active":"2024-09-17T05:32:57.773415+0000","last_became_peered":"2024-09-17T05:32:57.773415+0000","last_unstale":"2024-09-17T05:33:00.793759+0000","last_undegraded":"2024-09-17T05:33:00.793759+0000","last_fullsized":"2024-09-17T05:33:00.793759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:12.634180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.658654+0000","last_change":"2024-09-17T05:32:58.789266+0000","last_active":"2024-09-17T05:33:00.658654+0000","last_peered":"2024-09-17T05:33:00.658654+0000","last_clean":"2024-09-17T05:33:00.658654+0000","last_became_active":"2024-09-17T05:32:58.788941+0000","last_became_peered":"2024-09-17T05:32:58.788941+0000","last_unstale":"2024-09-17T05:33:00.658654+0000","last_undegraded":"2024-09-17T05:33:00.658654+0000","last_fullsized":"2024-09-17T05:33:00.658654+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:26:44.048629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.789335+0000","last_change":"2024-09-17T05:32:57.761461+0000","last_active":"2024-09-17T05:32:59.789335+0000","last_peered":"2024-09-17T05:32:59.789335+0000","last_clean":"2024-09-17T05:32:59.789335+0000","last_became_active":"2024-09-17T05:32:57.760904+0000","last_became_peered":"2024-09-17T05:32:57.760904+0000","last_unstale":"2024-09-17T05:32:59.789335+0000","last_undegraded":"2024-09-17T05:32:59.789335+0000","last_fullsized":"2024-09-17T05:32:59.789335+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:43.796555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.789109+0000","last_change":"2024-09-17T05:32:58.774937+0000","last_active":"2024-09-17T05:32:59.789109+0000","last_peered":"2024-09-17T05:32:59.789109+0000","last_clean":"2024-09-17T05:32:59.789109+0000","last_became_active":"2024-09-17T05:32:58.774626+0000","last_became_peered":"2024-09-17T05:32:58.774626+0000","last_unstale":"2024-09-17T05:32:59.789109+0000","last_undegraded":"2024-09-17T05:32:59.789109+0000","last_fullsized":"2024-09-17T05:32:59.789109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:16.921145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.789305+0000","last_change":"2024-09-17T05:32:57.763654+0000","last_active":"2024-09-17T05:32:59.789305+0000","last_peered":"2024-09-17T05:32:59.789305+0000","last_clean":"2024-09-17T05:32:59.789305+0000","last_became_active":"2024-09-17T05:32:57.763354+0000","last_became_peered":"2024-09-17T05:32:57.763354+0000","last_unstale":"2024-09-17T05:32:59.789305+0000","last_undegraded":"2024-09-17T05:32:59.789305+0000","last_fullsized":"2024-09-17T05:32:59.789305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:17.617311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.658640+0000","last_change":"2024-09-17T05:32:58.788086+0000","last_active":"2024-09-17T05:33:00.658640+0000","last_peered":"2024-09-17T05:33:00.658640+0000","last_clean":"2024-09-17T05:33:00.658640+0000","last_became_active":"2024-09-17T05:32:58.787779+0000","last_became_peered":"2024-09-17T05:32:58.787779+0000","last_unstale":"2024-09-17T05:33:00.658640+0000","last_undegraded":"2024-09-17T05:33:00.658640+0000","last_fullsized":"2024-09-17T05:33:00.658640+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:55.182012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.793416+0000","last_change":"2024-09-17T05:32:57.773774+0000","last_active":"2024-09-17T05:33:00.793416+0000","last_peered":"2024-09-17T05:33:00.793416+0000","last_clean":"2024-09-17T05:33:00.793416+0000","last_became_active":"2024-09-17T05:32:57.773506+0000","last_became_peered":"2024-09-17T05:32:57.773506+0000","last_unstale":"2024-09-17T05:33:00.793416+0000","last_undegraded":"2024-09-17T05:33:00.793416+0000","last_fullsized":"2024-09-17T05:33:00.793416+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:59.505881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.791148+0000","last_change":"2024-09-17T05:32:58.782138+0000","last_active":"2024-09-17T05:32:59.791148+0000","last_peered":"2024-09-17T05:32:59.791148+0000","last_clean":"2024-09-17T05:32:59.791148+0000","last_became_active":"2024-09-17T05:32:58.781837+0000","last_became_peered":"2024-09-17T05:32:58.781837+0000","last_unstale":"2024-09-17T05:32:59.791148+0000","last_undegraded":"2024-09-17T05:32:59.791148+0000","last_fullsized":"2024-09-17T05:32:59.791148+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:50.488239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"80'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.787775+0000","last_change":"2024-09-17T05:32:57.777118+0000","last_active":"2024-09-17T05:32:59.787775+0000","last_peered":"2024-09-17T05:32:59.787775+0000","last_clean":"2024-09-17T05:32:59.787775+0000","last_became_active":"2024-09-17T05:32:57.776868+0000","last_became_peered":"2024-09-17T05:32:57.776868+0000","last_unstale":"2024-09-17T05:32:59.787775+0000","last_undegraded":"2024-09-17T05:32:59.787775+0000","last_fullsized":"2024-09-17T05:32:59.787775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:55.438421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.798641+0000","last_change":"2024-09-17T05:32:58.802581+0000","last_active":"2024-09-17T05:33:00.798641+0000","last_peered":"2024-09-17T05:33:00.798641+0000","last_clean":"2024-09-17T05:33:00.798641+0000","last_became_active":"2024-09-17T05:32:58.802251+0000","last_became_peered":"2024-09-17T05:32:58.802251+0000","last_unstale":"2024-09-17T05:33:00.798641+0000","last_undegraded":"2024-09-17T05:33:00.798641+0000","last_fullsized":"2024-09-17T05:33:00.798641+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:04.720079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.787802+0000","last_change":"2024-09-17T05:32:57.776327+0000","last_active":"2024-09-17T05:32:59.787802+0000","last_peered":"2024-09-17T05:32:59.787802+0000","last_clean":"2024-09-17T05:32:59.787802+0000","last_became_active":"2024-09-17T05:32:57.776010+0000","last_became_peered":"2024-09-17T05:32:57.776010+0000","last_unstale":"2024-09-17T05:32:59.787802+0000","last_undegraded":"2024-09-17T05:32:59.787802+0000","last_fullsized":"2024-09-17T05:32:59.787802+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:06.841300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.798354+0000","last_change":"2024-09-17T05:32:58.793412+0000","last_active":"2024-09-17T05:33:00.798354+0000","last_peered":"2024-09-17T05:33:00.798354+0000","last_clean":"2024-09-17T05:33:00.798354+0000","last_became_active":"2024-09-17T05:32:58.793056+0000","last_became_peered":"2024-09-17T05:32:58.793056+0000","last_unstale":"2024-09-17T05:33:00.798354+0000","last_undegraded":"2024-09-17T05:33:00.798354+0000","last_fullsized":"2024-09-17T05:33:00.798354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:50.488239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.798138+0000","last_change":"2024-09-17T05:32:57.768914+0000","last_active":"2024-09-17T05:33:00.798138+0000","last_peered":"2024-09-17T05:33:00.798138+0000","last_clean":"2024-09-17T05:33:00.798138+0000","last_became_active":"2024-09-17T05:32:57.768542+0000","last_became_peered":"2024-09-17T05:32:57.768542+0000","last_unstale":"2024-09-17T05:33:00.798138+0000","last_undegraded":"2024-09-17T05:33:00.798138+0000","last_fullsized":"2024-09-17T05:33:00.798138+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:10.353728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.791452+0000","last_change":"2024-09-17T05:32:58.786246+0000","last_active":"2024-09-17T05:32:59.791452+0000","last_peered":"2024-09-17T05:32:59.791452+0000","last_clean":"2024-09-17T05:32:59.791452+0000","last_became_active":"2024-09-17T05:32:58.785636+0000","last_became_peered":"2024-09-17T05:32:58.785636+0000","last_unstale":"2024-09-17T05:32:59.791452+0000","last_undegraded":"2024-09-17T05:32:59.791452+0000","last_fullsized":"2024-09-17T05:32:59.791452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:13.676515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.798464+0000","last_change":"2024-09-17T05:32:57.771755+0000","last_active":"2024-09-17T05:33:00.798464+0000","last_peered":"2024-09-17T05:33:00.798464+0000","last_clean":"2024-09-17T05:33:00.798464+0000","last_became_active":"2024-09-17T05:32:57.771463+0000","last_became_peered":"2024-09-17T05:32:57.771463+0000","last_unstale":"2024-09-17T05:33:00.798464+0000","last_undegraded":"2024-09-17T05:33:00.798464+0000","last_fullsized":"2024-09-17T05:33:00.798464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:34.785317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.658729+0000","last_change":"2024-09-17T05:32:58.785315+0000","last_active":"2024-09-17T05:33:00.658729+0000","last_peered":"2024-09-17T05:33:00.658729+0000","last_clean":"2024-09-17T05:33:00.658729+0000","last_became_active":"2024-09-17T05:32:58.785041+0000","last_became_peered":"2024-09-17T05:32:58.785041+0000","last_unstale":"2024-09-17T05:33:00.658729+0000","last_undegraded":"2024-09-17T05:33:00.658729+0000","last_fullsized":"2024-09-17T05:33:00.658729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:32.357371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.507619+0000","last_change":"2024-09-17T05:32:57.768309+0000","last_active":"2024-09-17T05:33:00.507619+0000","last_peered":"2024-09-17T05:33:00.507619+0000","last_clean":"2024-09-17T05:33:00.507619+0000","last_became_active":"2024-09-17T05:32:57.767986+0000","last_became_peered":"2024-09-17T05:32:57.767986+0000","last_unstale":"2024-09-17T05:33:00.507619+0000","last_undegraded":"2024-09-17T05:33:00.507619+0000","last_fullsized":"2024-09-17T05:33:00.507619+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:43.408232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.507626+0000","last_change":"2024-09-17T05:32:58.782885+0000","last_active":"2024-09-17T05:33:00.507626+0000","last_peered":"2024-09-17T05:33:00.507626+0000","last_clean":"2024-09-17T05:33:00.507626+0000","last_became_active":"2024-09-17T05:32:58.782259+0000","last_became_peered":"2024-09-17T05:32:58.782259+0000","last_unstale":"2024-09-17T05:33:00.507626+0000","last_undegraded":"2024-09-17T05:33:00.507626+0000","last_fullsized":"2024-09-17T05:33:00.507626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:38.770248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.790966+0000","last_change":"2024-09-17T05:32:57.778896+0000","last_active":"2024-09-17T05:32:59.790966+0000","last_peered":"2024-09-17T05:32:59.790966+0000","last_clean":"2024-09-17T05:32:59.790966+0000","last_became_active":"2024-09-17T05:32:57.778580+0000","last_became_peered":"2024-09-17T05:32:57.778580+0000","last_unstale":"2024-09-17T05:32:59.790966+0000","last_undegraded":"2024-09-17T05:32:59.790966+0000","last_fullsized":"2024-09-17T05:32:59.790966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:40.961027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.797216+0000","last_change":"2024-09-17T05:32:58.801039+0000","last_active":"2024-09-17T05:33:00.797216+0000","last_peered":"2024-09-17T05:33:00.797216+0000","last_clean":"2024-09-17T05:33:00.797216+0000","last_became_active":"2024-09-17T05:32:58.800704+0000","last_became_peered":"2024-09-17T05:32:58.800704+0000","last_unstale":"2024-09-17T05:33:00.797216+0000","last_undegraded":"2024-09-17T05:33:00.797216+0000","last_fullsized":"2024-09-17T05:33:00.797216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:34.121510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.797813+0000","last_change":"2024-09-17T05:32:57.772499+0000","last_active":"2024-09-17T05:33:00.797813+0000","last_peered":"2024-09-17T05:33:00.797813+0000","last_clean":"2024-09-17T05:33:00.797813+0000","last_became_active":"2024-09-17T05:32:57.771365+0000","last_became_peered":"2024-09-17T05:32:57.771365+0000","last_unstale":"2024-09-17T05:33:00.797813+0000","last_undegraded":"2024-09-17T05:33:00.797813+0000","last_fullsized":"2024-09-17T05:33:00.797813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:26.075012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.797682+0000","last_change":"2024-09-17T05:32:58.793515+0000","last_active":"2024-09-17T05:33:00.797682+0000","last_peered":"2024-09-17T05:33:00.797682+0000","last_clean":"2024-09-17T05:33:00.797682+0000","last_became_active":"2024-09-17T05:32:58.793180+0000","last_became_peered":"2024-09-17T05:32:58.793180+0000","last_unstale":"2024-09-17T05:33:00.797682+0000","last_undegraded":"2024-09-17T05:33:00.797682+0000","last_fullsized":"2024-09-17T05:33:00.797682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:41.719680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.790819+0000","last_change":"2024-09-17T05:32:57.771832+0000","last_active":"2024-09-17T05:32:59.790819+0000","last_peered":"2024-09-17T05:32:59.790819+0000","last_clean":"2024-09-17T05:32:59.790819+0000","last_became_active":"2024-09-17T05:32:57.771626+0000","last_became_peered":"2024-09-17T05:32:57.771626+0000","last_unstale":"2024-09-17T05:32:59.790819+0000","last_undegraded":"2024-09-17T05:32:59.790819+0000","last_fullsized":"2024-09-17T05:32:59.790819+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:28.949428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:32:59.787327+0000","last_change":"2024-09-17T05:32:58.796268+0000","last_active":"2024-09-17T05:32:59.787327+0000","last_peered":"2024-09-17T05:32:59.787327+0000","last_clean":"2024-09-17T05:32:59.787327+0000","last_became_active":"2024-09-17T05:32:58.796005+0000","last_became_peered":"2024-09-17T05:32:58.796005+0000","last_unstale":"2024-09-17T05:32:59.787327+0000","last_undegraded":"2024-09-17T05:32:59.787327+0000","last_fullsized":"2024-09-17T05:32:59.787327+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:57.741848+0000","last_clean_scrub_stamp":"2024-09-17T05:32:57.741848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:15.006391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"80'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.797962+0000","last_change":"2024-09-17T05:32:57.776993+0000","last_active":"2024-09-17T05:33:00.797962+0000","last_peered":"2024-09-17T05:33:00.797962+0000","last_clean":"2024-09-17T05:33:00.797962+0000","last_became_active":"2024-09-17T05:32:57.776706+0000","last_became_peered":"2024-09-17T05:32:57.776706+0000","last_unstale":"2024-09-17T05:33:00.797962+0000","last_undegraded":"2024-09-17T05:33:00.797962+0000","last_fullsized":"2024-09-17T05:33:00.797962+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:32:56.735021+0000","last_clean_scrub_stamp":"2024-09-17T05:32:56.735021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:06.781898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":248,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T05:33:00.797378+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:33:00.797378+0000","last_peered":"2024-09-17T05:33:00.797378+0000","last_clean":"2024-09-17T05:33:00.797378+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:33:00.797378+0000","last_undegraded":"2024-09-17T05:33:00.797378+0000","last_fullsized":"2024-09-17T05:33:00.797378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509497,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1585152,"data_stored":1011099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509498,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":999424,"data_stored":421355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542201,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":1003520,"data_stored":422295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":987136,"data_stored":420661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509498,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":999424,"data_stored":422273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509498,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":991232,"data_stored":421243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509496,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":999424,"data_stored":420855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542200,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1585152,"data_stored":1011063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:33:07.955 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:33:07.956 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:33:08.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.150+0000 7f4a91400640 1 -- 172.21.15.31:0/4146859902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a70003a40 msgr2=0x7f4a70003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:08.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.150+0000 7f4a91400640 1 --2- 172.21.15.31:0/4146859902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a70003a40 0x7f4a70003e60 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c0016f0 tx=0x7f4a7c01c6c0 comp rx=0 tx=0).stop 2024-09-17T05:33:08.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.150+0000 7f4a90a00640 1 -- 172.21.15.31:0/4146859902 reap_dead start 2024-09-17T05:33:08.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.150+0000 7f4a91400640 1 -- 172.21.15.31:0/4146859902 shutdown_connections 2024-09-17T05:33:08.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.150+0000 7f4a91400640 1 -- 172.21.15.31:0/4146859902 >> 172.21.15.31:0/4146859902 conn(0x7f4a8c0d3e70 msgr2=0x7f4a8c0d4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:08.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.150+0000 7f4a91400640 1 -- 172.21.15.31:0/4146859902 shutdown_connections 2024-09-17T05:33:08.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.150+0000 7f4a91400640 1 -- 172.21.15.31:0/4146859902 wait complete. 2024-09-17T05:33:08.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.150+0000 7f4a91400640 1 Processor -- start 2024-09-17T05:33:08.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.150+0000 7f4a91400640 1 -- start start 2024-09-17T05:33:08.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a91400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a70003a40 0x7f4a8c160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:08.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a91400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a8c15f980 0x7f4a8c1583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:08.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a91400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a8c0b78c0 0x7f4a8c06e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:08.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a91400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c169fc0 con 0x7f4a70003a40 2024-09-17T05:33:08.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a91400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c169e40 con 0x7f4a8c15f980 2024-09-17T05:33:08.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a91400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4a8c16a140 con 0x7f4a8c0b78c0 2024-09-17T05:33:08.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a8be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a70003a40 0x7f4a8c160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:08.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a8be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a70003a40 0x7f4a8c160eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41460/0 (socket says 172.21.15.31:41460) 2024-09-17T05:33:08.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a8be00640 1 -- 172.21.15.31:0/1797794444 learned_addr learned my addr 172.21.15.31:0/1797794444 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:08.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a8be00640 1 -- 172.21.15.31:0/1797794444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a8c0b78c0 msgr2=0x7f4a8c06e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:08.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a8be00640 1 --2- 172.21.15.31:0/1797794444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a8c0b78c0 0x7f4a8c06e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:08.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a8be00640 1 -- 172.21.15.31:0/1797794444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a8c15f980 msgr2=0x7f4a8c1583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:08.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a8be00640 1 --2- 172.21.15.31:0/1797794444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a8c15f980 0x7f4a8c1583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:08.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a8be00640 1 -- 172.21.15.31:0/1797794444 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8c1588f0 con 0x7f4a70003a40 2024-09-17T05:33:08.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a8be00640 1 --2- 172.21.15.31:0/1797794444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a70003a40 0x7f4a8c160eb0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c000c10 tx=0x7f4a7c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:08.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a83e00640 1 -- 172.21.15.31:0/1797794444 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c0ba070 con 0x7f4a70003a40 2024-09-17T05:33:08.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a83e00640 1 -- 172.21.15.31:0/1797794444 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a7c006500 con 0x7f4a70003a40 2024-09-17T05:33:08.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a83e00640 1 -- 172.21.15.31:0/1797794444 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c0ad070 con 0x7f4a70003a40 2024-09-17T05:33:08.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a91400640 1 -- 172.21.15.31:0/1797794444 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a8c15fe10 con 0x7f4a70003a40 2024-09-17T05:33:08.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a91400640 1 -- 172.21.15.31:0/1797794444 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a8c1603d0 con 0x7f4a70003a40 2024-09-17T05:33:08.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.154+0000 7f4a91400640 1 -- 172.21.15.31:0/1797794444 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a8c0d1e80 con 0x7f4a70003a40 2024-09-17T05:33:08.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.158+0000 7f4a83e00640 1 -- 172.21.15.31:0/1797794444 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f4a7c0a7400 con 0x7f4a70003a40 2024-09-17T05:33:08.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.158+0000 7f4a83e00640 1 --2- 172.21.15.31:0/1797794444 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a6c073350 0x7f4a6c075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:08.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.158+0000 7f4a83e00640 1 -- 172.21.15.31:0/1797794444 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f4a7c12da70 con 0x7f4a70003a40 2024-09-17T05:33:08.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.158+0000 7f4a8b400640 1 --2- 172.21.15.31:0/1797794444 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a6c073350 0x7f4a6c075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:08.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.158+0000 7f4a8b400640 1 --2- 172.21.15.31:0/1797794444 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a6c073350 0x7f4a6c075810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c0ce310 tx=0x7f4a78005b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.162+0000 7f4a83e00640 1 -- 172.21.15.31:0/1797794444 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4a7c016450 con 0x7f4a70003a40 2024-09-17T05:33:08.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.398+0000 7f4a91400640 1 -- 172.21.15.31:0/1797794444 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f4a8c1649c0 con 0x7f4a70003a40 2024-09-17T05:33:08.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.402+0000 7f4a83e00640 1 -- 172.21.15.31:0/1797794444 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) ==== 190+0+147 (secure 0 0 0) 0x7f4a7c0f8860 con 0x7f4a70003a40 2024-09-17T05:33:08.404 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-09-17T05:33:08.404 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw== 2024-09-17T05:33:08.404 INFO:teuthology.orchestra.run.smithi031.stdout: caps mds = "allow" 2024-09-17T05:33:08.405 INFO:teuthology.orchestra.run.smithi031.stdout: caps mon = "allow r" 2024-09-17T05:33:08.405 INFO:teuthology.orchestra.run.smithi031.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:33:08.405 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2024-09-17T05:33:08.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.406+0000 7f4a91400640 1 -- 172.21.15.31:0/1797794444 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a6c073350 msgr2=0x7f4a6c075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:08.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.406+0000 7f4a91400640 1 --2- 172.21.15.31:0/1797794444 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a6c073350 0x7f4a6c075810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c0ce310 tx=0x7f4a78005b20 comp rx=0 tx=0).stop 2024-09-17T05:33:08.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.406+0000 7f4a91400640 1 -- 172.21.15.31:0/1797794444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a70003a40 msgr2=0x7f4a8c160eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:08.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.406+0000 7f4a91400640 1 --2- 172.21.15.31:0/1797794444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a70003a40 0x7f4a8c160eb0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c000c10 tx=0x7f4a7c003c10 comp rx=0 tx=0).stop 2024-09-17T05:33:08.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.406+0000 7f4a91400640 1 -- 172.21.15.31:0/1797794444 shutdown_connections 2024-09-17T05:33:08.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.406+0000 7f4a91400640 1 --2- 172.21.15.31:0/1797794444 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a6c073350 0x7f4a6c075810 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:08.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.406+0000 7f4a91400640 1 --2- 172.21.15.31:0/1797794444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a8c0b78c0 0x7f4a8c06e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:08.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.406+0000 7f4a91400640 1 --2- 172.21.15.31:0/1797794444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a8c15f980 0x7f4a8c1583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:08.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.406+0000 7f4a91400640 1 --2- 172.21.15.31:0/1797794444 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a70003a40 0x7f4a8c160eb0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:08.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.406+0000 7f4a91400640 1 -- 172.21.15.31:0/1797794444 >> 172.21.15.31:0/1797794444 conn(0x7f4a8c0d3e70 msgr2=0x7f4a8c0ca440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:08.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.406+0000 7f4a91400640 1 -- 172.21.15.31:0/1797794444 shutdown_connections 2024-09-17T05:33:08.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.406+0000 7f4a91400640 1 -- 172.21.15.31:0/1797794444 wait complete. 2024-09-17T05:33:08.426 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:33:08.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f872a000640 1 -- 172.21.15.31:0/3419329315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87240b2e80 msgr2=0x7f87240b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:08.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f872a000640 1 --2- 172.21.15.31:0/3419329315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87240b2e80 0x7f87240b1bd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f870c009840 tx=0x7f870c01c6d0 comp rx=0 tx=0).stop 2024-09-17T05:33:08.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f872a000640 1 -- 172.21.15.31:0/3419329315 shutdown_connections 2024-09-17T05:33:08.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f872a000640 1 --2- 172.21.15.31:0/3419329315 >> v2:172.21.15.155:3300/0 conn(0x7f87240afca0 0x7f87240b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:08.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f872a000640 1 --2- 172.21.15.31:0/3419329315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87240b2e80 0x7f87240b1bd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:08.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f872a000640 1 -- 172.21.15.31:0/3419329315 >> 172.21.15.31:0/3419329315 conn(0x7f87240d1e30 msgr2=0x7f87240d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:08.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f872a000640 1 -- 172.21.15.31:0/3419329315 shutdown_connections 2024-09-17T05:33:08.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f872a000640 1 -- 172.21.15.31:0/3419329315 wait complete. 2024-09-17T05:33:08.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f872a000640 1 Processor -- start 2024-09-17T05:33:08.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f872a000640 1 -- start start 2024-09-17T05:33:08.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f872a000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87240afca0 0x7f872414d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:08.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f872a000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87240b2e80 0x7f87241f5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:08.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f872a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872415f490 0x7f8724158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:08.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f872a000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8724168c80 con 0x7f872415f490 2024-09-17T05:33:08.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f872a000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f87240b2350 con 0x7f87240afca0 2024-09-17T05:33:08.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f872a000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8724168e00 con 0x7f87240b2e80 2024-09-17T05:33:08.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f8723e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872415f490 0x7f8724158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:08.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f8723e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872415f490 0x7f8724158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57028/0 (socket says 172.21.15.31:57028) 2024-09-17T05:33:08.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f8723e00640 1 -- 172.21.15.31:0/896397115 learned_addr learned my addr 172.21.15.31:0/896397115 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:08.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f871be00640 1 --2- 172.21.15.31:0/896397115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87240b2e80 0x7f87241f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:08.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f8723400640 1 --2- 172.21.15.31:0/896397115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87240afca0 0x7f872414d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:08.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f8723e00640 1 -- 172.21.15.31:0/896397115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87240b2e80 msgr2=0x7f87241f5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:08.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f8723e00640 1 --2- 172.21.15.31:0/896397115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87240b2e80 0x7f87241f5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:08.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f8723e00640 1 -- 172.21.15.31:0/896397115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87240afca0 msgr2=0x7f872414d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:08.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f8723e00640 1 --2- 172.21.15.31:0/896397115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87240afca0 0x7f872414d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:08.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.574+0000 7f8723e00640 1 -- 172.21.15.31:0/896397115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87241f5ea0 con 0x7f872415f490 2024-09-17T05:33:08.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.578+0000 7f8723e00640 1 --2- 172.21.15.31:0/896397115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872415f490 0x7f8724158ad0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f871c00eb20 tx=0x7f871c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:08.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.578+0000 7f871b400640 1 -- 172.21.15.31:0/896397115 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c004b30 con 0x7f872415f490 2024-09-17T05:33:08.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.578+0000 7f871b400640 1 -- 172.21.15.31:0/896397115 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f871c004cf0 con 0x7f872415f490 2024-09-17T05:33:08.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.578+0000 7f872a000640 1 -- 172.21.15.31:0/896397115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87241f6180 con 0x7f872415f490 2024-09-17T05:33:08.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.578+0000 7f871b400640 1 -- 172.21.15.31:0/896397115 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c005280 con 0x7f872415f490 2024-09-17T05:33:08.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.578+0000 7f872a000640 1 -- 172.21.15.31:0/896397115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87241f5b90 con 0x7f872415f490 2024-09-17T05:33:08.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.578+0000 7f872a000640 1 -- 172.21.15.31:0/896397115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87240b0130 con 0x7f872415f490 2024-09-17T05:33:08.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.578+0000 7f871b400640 1 -- 172.21.15.31:0/896397115 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f871c005420 con 0x7f872415f490 2024-09-17T05:33:08.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.578+0000 7f871b400640 1 --2- 172.21.15.31:0/896397115 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8700073350 0x7f8700075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:08.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.582+0000 7f871b400640 1 -- 172.21.15.31:0/896397115 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f871c095170 con 0x7f872415f490 2024-09-17T05:33:08.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.582+0000 7f8723400640 1 --2- 172.21.15.31:0/896397115 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8700073350 0x7f8700075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:08.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.582+0000 7f8723400640 1 --2- 172.21.15.31:0/896397115 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8700073350 0x7f8700075810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8714007fd0 tx=0x7f8714009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:08.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.586+0000 7f871b400640 1 -- 172.21.15.31:0/896397115 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f871c05f890 con 0x7f872415f490 2024-09-17T05:33:08.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.802+0000 7f872a000640 1 -- 172.21.15.31:0/896397115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f872415c3a0 con 0x7f872415f490 2024-09-17T05:33:08.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.802+0000 7f871b400640 1 -- 172.21.15.31:0/896397115 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5231 (secure 0 0 0) 0x7f871c0642c0 con 0x7f872415f490 2024-09-17T05:33:08.805 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:08.805 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":56,"btime":"2024-09-17T05:33:01:791448+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2757206675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2757206675},{"type":"v1","addr":"172.21.15.31:6835","nonce":2757206675}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3287361734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3287361734},{"type":"v1","addr":"172.21.15.155:6809","nonce":3287361734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6295,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2426776304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2426776304},{"type":"v1","addr":"172.21.15.155:6835","nonce":2426776304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:32:58.167014+0000","modified":"2024-09-17T05:33:01.193375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6570},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6570":{"gid":6570,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/1737412276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1737412276},{"type":"v1","addr":"172.21.15.31:6834","nonce":1737412276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6570,"qdb_cluster":[6570]},"id":6}]} 2024-09-17T05:33:08.806 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 56 2024-09-17T05:33:08.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.806+0000 7f872a000640 1 -- 172.21.15.31:0/896397115 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8700073350 msgr2=0x7f8700075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:08.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.806+0000 7f872a000640 1 --2- 172.21.15.31:0/896397115 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8700073350 0x7f8700075810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8714007fd0 tx=0x7f8714009040 comp rx=0 tx=0).stop 2024-09-17T05:33:08.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.806+0000 7f872a000640 1 -- 172.21.15.31:0/896397115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872415f490 msgr2=0x7f8724158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:08.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.806+0000 7f872a000640 1 --2- 172.21.15.31:0/896397115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872415f490 0x7f8724158ad0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f871c00eb20 tx=0x7f871c00c2d0 comp rx=0 tx=0).stop 2024-09-17T05:33:08.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.806+0000 7f872a000640 1 -- 172.21.15.31:0/896397115 shutdown_connections 2024-09-17T05:33:08.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.806+0000 7f872a000640 1 --2- 172.21.15.31:0/896397115 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8700073350 0x7f8700075810 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:08.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.806+0000 7f872a000640 1 --2- 172.21.15.31:0/896397115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872415f490 0x7f8724158ad0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:08.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.806+0000 7f872a000640 1 --2- 172.21.15.31:0/896397115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f87240b2e80 0x7f87241f5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:08.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.806+0000 7f872a000640 1 --2- 172.21.15.31:0/896397115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87240afca0 0x7f872414d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:08.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.806+0000 7f872a000640 1 -- 172.21.15.31:0/896397115 >> 172.21.15.31:0/896397115 conn(0x7f87240d1e30 msgr2=0x7f87240ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:08.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.806+0000 7f872a000640 1 -- 172.21.15.31:0/896397115 shutdown_connections 2024-09-17T05:33:08.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:08.806+0000 7f872a000640 1 -- 172.21.15.31:0/896397115 wait complete. 2024-09-17T05:33:09.230 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:32:58.167014+0000', 'modified': '2024-09-17T05:33:01.193375+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6570}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6570': {'gid': 6570, 'name': 'c', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6834/1737412276', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6832', 'nonce': 1737412276}, {'type': 'v1', 'addr': '172.21.15.31:6834', 'nonce': 1737412276}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6570, 'qdb_cluster': [6570]} 2024-09-17T05:33:09.230 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:33:09.230 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:33:09.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.378+0000 7f9801c00640 1 -- 172.21.15.31:0/3732751135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97fc0b49e0 msgr2=0x7f97fc06f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:09.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.378+0000 7f9801c00640 1 --2- 172.21.15.31:0/3732751135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97fc0b49e0 0x7f97fc06f7b0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009bc0 tx=0x7f97f401ca80 comp rx=0 tx=0).stop 2024-09-17T05:33:09.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.378+0000 7f9801c00640 1 -- 172.21.15.31:0/3732751135 shutdown_connections 2024-09-17T05:33:09.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.378+0000 7f9801c00640 1 --2- 172.21.15.31:0/3732751135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97fc0b49e0 0x7f97fc06f7b0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.378+0000 7f9801c00640 1 -- 172.21.15.31:0/3732751135 >> 172.21.15.31:0/3732751135 conn(0x7f97fc0b18f0 msgr2=0x7f97fc0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:09.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.378+0000 7f9801c00640 1 -- 172.21.15.31:0/3732751135 shutdown_connections 2024-09-17T05:33:09.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.378+0000 7f9801c00640 1 -- 172.21.15.31:0/3732751135 wait complete. 2024-09-17T05:33:09.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.378+0000 7f9801c00640 1 Processor -- start 2024-09-17T05:33:09.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.378+0000 7f9801c00640 1 -- start start 2024-09-17T05:33:09.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.378+0000 7f9801c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97fc0b49e0 0x7f97fc152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.378+0000 7f9801c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97fc0cd100 0x7f97fc0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.378+0000 7f9801c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97fc15dae0 0x7f97fc0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.378+0000 7f9801c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc168e90 con 0x7f97fc0cd100 2024-09-17T05:33:09.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.378+0000 7f9801c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc168d10 con 0x7f97fc15dae0 2024-09-17T05:33:09.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.378+0000 7f9801c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f97fc169010 con 0x7f97fc0b49e0 2024-09-17T05:33:09.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.382+0000 7f97f3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97fc0cd100 0x7f97fc0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.382+0000 7f97f3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97fc0cd100 0x7f97fc0cb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57048/0 (socket says 172.21.15.31:57048) 2024-09-17T05:33:09.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.382+0000 7f97f3e00640 1 -- 172.21.15.31:0/162252377 learned_addr learned my addr 172.21.15.31:0/162252377 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:09.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.382+0000 7f97fb400640 1 --2- 172.21.15.31:0/162252377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97fc15dae0 0x7f97fc0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.382+0000 7f97faa00640 1 --2- 172.21.15.31:0/162252377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97fc0b49e0 0x7f97fc152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.382+0000 7f97f3e00640 1 -- 172.21.15.31:0/162252377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97fc0b49e0 msgr2=0x7f97fc152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:09.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.382+0000 7f97f3e00640 1 --2- 172.21.15.31:0/162252377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97fc0b49e0 0x7f97fc152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.382+0000 7f97f3e00640 1 -- 172.21.15.31:0/162252377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97fc15dae0 msgr2=0x7f97fc0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:09.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.382+0000 7f97f3e00640 1 --2- 172.21.15.31:0/162252377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97fc15dae0 0x7f97fc0cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.382+0000 7f97f3e00640 1 -- 172.21.15.31:0/162252377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc0732b0 con 0x7f97fc0cd100 2024-09-17T05:33:09.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.382+0000 7f97faa00640 1 --2- 172.21.15.31:0/162252377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97fc0b49e0 0x7f97fc152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:09.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.382+0000 7f97f3e00640 1 --2- 172.21.15.31:0/162252377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97fc0cd100 0x7f97fc0cb630 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f97e400c4b0 tx=0x7f97e400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:09.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.382+0000 7f97f2a00640 1 -- 172.21.15.31:0/162252377 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4016020 con 0x7f97fc0cd100 2024-09-17T05:33:09.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.382+0000 7f97f2a00640 1 -- 172.21.15.31:0/162252377 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97e4012920 con 0x7f97fc0cd100 2024-09-17T05:33:09.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.382+0000 7f9801c00640 1 -- 172.21.15.31:0/162252377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97fc1533b0 con 0x7f97fc0cd100 2024-09-17T05:33:09.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.382+0000 7f97f2a00640 1 -- 172.21.15.31:0/162252377 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4012d90 con 0x7f97fc0cd100 2024-09-17T05:33:09.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.382+0000 7f9801c00640 1 -- 172.21.15.31:0/162252377 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97fc072fd0 con 0x7f97fc0cd100 2024-09-17T05:33:09.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.382+0000 7f97f2a00640 1 -- 172.21.15.31:0/162252377 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f97e4019020 con 0x7f97fc0cd100 2024-09-17T05:33:09.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97f2a00640 1 --2- 172.21.15.31:0/162252377 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f97d8073320 0x7f97d80757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97f2a00640 1 -- 172.21.15.31:0/162252377 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f97e4094170 con 0x7f97fc0cd100 2024-09-17T05:33:09.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f9804fad000 1 Processor -- start 2024-09-17T05:33:09.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97faa00640 1 --2- 172.21.15.31:0/162252377 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f97d8073320 0x7f97d80757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f9804fad000 1 -- start start 2024-09-17T05:33:09.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97faa00640 1 --2- 172.21.15.31:0/162252377 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f97d8073320 0x7f97d80757e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0016b0 tx=0x7f97ec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:09.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f9804fad000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df729d0 0x55692df72db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f9804fad000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df732f0 0x55692df268d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f9804fad000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df26e10 0x55692df271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f9804fad000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55692de473f0 con 0x55692df26e10 2024-09-17T05:33:09.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f9804fad000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55692dd84b20 con 0x55692df729d0 2024-09-17T05:33:09.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f9804fad000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55692dd73f50 con 0x55692df732f0 2024-09-17T05:33:09.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97fb400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df26e10 0x55692df271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97faa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df729d0 0x55692df72db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97f3e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df732f0 0x55692df268d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97faa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df729d0 0x55692df72db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:44030/0 (socket says 172.21.15.31:44030) 2024-09-17T05:33:09.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97faa00640 1 -- 172.21.15.31:0/3337591713 learned_addr learned my addr 172.21.15.31:0/3337591713 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97faa00640 1 -- 172.21.15.31:0/3337591713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df732f0 msgr2=0x55692df268d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:33:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97faa00640 1 --2- 172.21.15.31:0/3337591713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df732f0 0x55692df268d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97faa00640 1 -- 172.21.15.31:0/3337591713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df26e10 msgr2=0x55692df271f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:33:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97faa00640 1 --2- 172.21.15.31:0/3337591713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df26e10 0x55692df271f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97faa00640 1 -- 172.21.15.31:0/3337591713 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55692dd3b590 con 0x55692df729d0 2024-09-17T05:33:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97f3e00640 1 --2- 172.21.15.31:0/3337591713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df732f0 0x55692df268d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:33:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97faa00640 1 --2- 172.21.15.31:0/3337591713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df729d0 0x55692df72db0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f97ec001e90 tx=0x7f97ec011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a8b64b780d66704 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97eb400640 1 -- 172.21.15.31:0/3337591713 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec003600 con 0x55692df729d0 2024-09-17T05:33:09.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97eb400640 1 -- 172.21.15.31:0/3337591713 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97ec003890 con 0x55692df729d0 2024-09-17T05:33:09.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f97eb400640 1 -- 172.21.15.31:0/3337591713 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec003c40 con 0x55692df729d0 2024-09-17T05:33:09.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f9804fad000 1 -- 172.21.15.31:0/3337591713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df729d0 msgr2=0x55692df72db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:09.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.386+0000 7f9804fad000 1 --2- 172.21.15.31:0/3337591713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df729d0 0x55692df72db0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f97ec001e90 tx=0x7f97ec011000 comp rx=0 tx=0).stop 2024-09-17T05:33:09.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 1 -- 172.21.15.31:0/3337591713 shutdown_connections 2024-09-17T05:33:09.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 1 --2- 172.21.15.31:0/3337591713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df26e10 0x55692df271f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 1 --2- 172.21.15.31:0/3337591713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df732f0 0x55692df268d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 1 --2- 172.21.15.31:0/3337591713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df729d0 0x55692df72db0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 1 -- 172.21.15.31:0/3337591713 >> 172.21.15.31:0/3337591713 conn(0x55692de10130 msgr2=0x55692df55e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:09.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 1 -- 172.21.15.31:0/3337591713 shutdown_connections 2024-09-17T05:33:09.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 1 -- 172.21.15.31:0/3337591713 wait complete. 2024-09-17T05:33:09.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 1 -- start start 2024-09-17T05:33:09.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 1 Processor -- start 2024-09-17T05:33:09.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df26e10 0x55692df28240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df729d0 0x55692df28780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df732f0 0x55692df28cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55692dd0e5d0 con 0x55692df732f0 2024-09-17T05:33:09.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55692dd77d60 con 0x55692df26e10 2024-09-17T05:33:09.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55692dd1a500 con 0x55692df729d0 2024-09-17T05:33:09.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 10 client.0 _ll_register_callbacks cb 0x55692dd1e810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:33:09.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f97fb400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df732f0 0x55692df28cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f97f3e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df729d0 0x55692df28780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f97f3e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df729d0 0x55692df28780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:35272/0 (socket says 172.21.15.31:35272) 2024-09-17T05:33:09.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f97f3e00640 1 -- 172.21.15.31:0/693117614 learned_addr learned my addr 172.21.15.31:0/693117614 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:09.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f97faa00640 1 --2- 172.21.15.31:0/693117614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df26e10 0x55692df28240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f97fb400640 1 -- 172.21.15.31:0/693117614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df729d0 msgr2=0x55692df28780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:33:09.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f97fb400640 1 --2- 172.21.15.31:0/693117614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df729d0 0x55692df28780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f97fb400640 1 -- 172.21.15.31:0/693117614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df26e10 msgr2=0x55692df28240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:33:09.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f97fb400640 1 --2- 172.21.15.31:0/693117614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df26e10 0x55692df28240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f97fb400640 1 -- 172.21.15.31:0/693117614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55692dd12170 con 0x55692df732f0 2024-09-17T05:33:09.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f97fb400640 1 --2- 172.21.15.31:0/693117614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df732f0 0x55692df28cc0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f97f40ac000 tx=0x7f97f4004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcda132c6edcc364 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:09.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f97dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:33:09.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f97dfe00640 1 -- 172.21.15.31:0/693117614 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f40b2040 con 0x55692df732f0 2024-09-17T05:33:09.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 1 -- 172.21.15.31:0/693117614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55692dd0c0f0 con 0x55692df732f0 2024-09-17T05:33:09.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f97dfe00640 1 -- 172.21.15.31:0/693117614 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f97f4003980 con 0x55692df732f0 2024-09-17T05:33:09.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f97dfe00640 1 -- 172.21.15.31:0/693117614 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f97f40c4050 con 0x55692df732f0 2024-09-17T05:33:09.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 10 client.6726 fetch_fsmap learned FSMap version 56 2024-09-17T05:33:09.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.390+0000 7f9804fad000 1 -- 172.21.15.31:0/693117614 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x55692ddf8ef0 con 0x55692df732f0 2024-09-17T05:33:09.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f97dfe00640 1 -- 172.21.15.31:0/693117614 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55692dd0c0f0 con 0x55692df732f0 2024-09-17T05:33:09.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f97dfe00640 1 -- 172.21.15.31:0/693117614 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 56) ==== 3502+0+0 (secure 0 0 0) 0x7f97f40c7020 con 0x55692df732f0 2024-09-17T05:33:09.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f9804fad000 10 client.6726 fetch_fsmap finished waiting for FSMap version 56 2024-09-17T05:33:09.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f9804fad000 10 client.6726 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:33:09.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f9804fad000 20 client.6726 populate_metadata read hostname 'smithi031' 2024-09-17T05:33:09.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f9804fad000 1 --2- 172.21.15.31:0/693117614 >> [v2:172.21.15.31:6832/1737412276,v1:172.21.15.31:6834/1737412276] conn(0x55692df81c70 0x55692df84060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f9804fad000 4 client.6726 mds_command: new command op to 6570 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:33:09.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f9804fad000 1 -- 172.21.15.31:0/693117614 --> [v2:172.21.15.31:6832/1737412276,v1:172.21.15.31:6834/1737412276] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55692dd86a70 con 0x55692df81c70 2024-09-17T05:33:09.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f97faa00640 1 --2- 172.21.15.31:0/693117614 >> [v2:172.21.15.31:6832/1737412276,v1:172.21.15.31:6834/1737412276] conn(0x55692df81c70 0x55692df84060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f97dfe00640 10 client.6726 ms_handle_connect on v2:172.21.15.31:6832/1737412276 2024-09-17T05:33:09.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f97faa00640 1 --2- 172.21.15.31:0/693117614 >> [v2:172.21.15.31:6832/1737412276,v1:172.21.15.31:6834/1737412276] conn(0x55692df81c70 0x55692df84060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aad8ff3aed57b47e server_cookie=70d528f73195f861 in_seq=0 out_seq=0 2024-09-17T05:33:09.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f97dfe00640 1 -- 172.21.15.31:0/693117614 <== mds.0 v2:172.21.15.31:6832/1737412276 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55692dd86a70 con 0x55692df81c70 2024-09-17T05:33:09.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f97dfe00640 10 client.6726 handle_command_reply: tid=0 2024-09-17T05:33:09.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f9804fad000 1 client.6726 shutdown 2024-09-17T05:33:09.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f9804fad000 1 -- 172.21.15.31:0/693117614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df732f0 msgr2=0x55692df28cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f9804fad000 1 --2- 172.21.15.31:0/693117614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df732f0 0x55692df28cc0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f97f40ac000 tx=0x7f97f4004ca0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f9804fad000 1 -- 172.21.15.31:0/693117614 shutdown_connections 2024-09-17T05:33:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f9804fad000 1 --2- 172.21.15.31:0/693117614 >> [v2:172.21.15.31:6832/1737412276,v1:172.21.15.31:6834/1737412276] conn(0x55692df81c70 0x55692df84060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f9804fad000 1 --2- 172.21.15.31:0/693117614 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df732f0 0x55692df28cc0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f9804fad000 1 --2- 172.21.15.31:0/693117614 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df729d0 0x55692df28780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f9804fad000 1 --2- 172.21.15.31:0/693117614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df26e10 0x55692df28240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f97dfe00640 0 client.6726 ms_handle_reset on v2:172.21.15.31:6832/1737412276 2024-09-17T05:33:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f9804fad000 1 -- 172.21.15.31:0/693117614 >> 172.21.15.31:0/693117614 conn(0x55692de10130 msgr2=0x55692df25fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f9804fad000 1 -- 172.21.15.31:0/693117614 shutdown_connections 2024-09-17T05:33:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f9804fad000 1 -- 172.21.15.31:0/693117614 wait complete. 2024-09-17T05:33:09.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.394+0000 7f9804fad000 20 client.6726 trim_cache size 0 max 16384 2024-09-17T05:33:09.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f9804fad000 1 Processor -- start 2024-09-17T05:33:09.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f9804fad000 1 -- start start 2024-09-17T05:33:09.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f9804fad000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df26e10 0x55692dfe43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f9804fad000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df729d0 0x55692dfe4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f9804fad000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df732f0 0x55692dfe4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f9804fad000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc0b0b10 con 0x55692df729d0 2024-09-17T05:33:09.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f9804fad000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc155f10 con 0x55692df732f0 2024-09-17T05:33:09.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f9804fad000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f97fc0b04c0 con 0x55692df26e10 2024-09-17T05:33:09.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f97f3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df729d0 0x55692dfe4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f97f3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df729d0 0x55692dfe4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57076/0 (socket says 172.21.15.31:57076) 2024-09-17T05:33:09.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f97f3e00640 1 -- 172.21.15.31:0/3198611296 learned_addr learned my addr 172.21.15.31:0/3198611296 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:09.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f97fb400640 1 --2- 172.21.15.31:0/3198611296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df732f0 0x55692dfe4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f97faa00640 1 --2- 172.21.15.31:0/3198611296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df26e10 0x55692dfe43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f97f3e00640 1 -- 172.21.15.31:0/3198611296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df26e10 msgr2=0x55692dfe43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:33:09.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f97f3e00640 1 --2- 172.21.15.31:0/3198611296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df26e10 0x55692dfe43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f97f3e00640 1 -- 172.21.15.31:0/3198611296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df732f0 msgr2=0x55692dfe4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:33:09.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f97f3e00640 1 --2- 172.21.15.31:0/3198611296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df732f0 0x55692dfe4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f97f3e00640 1 -- 172.21.15.31:0/3198611296 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55692ddcfd90 con 0x55692df729d0 2024-09-17T05:33:09.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f97faa00640 1 --2- 172.21.15.31:0/3198611296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df26e10 0x55692dfe43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:09.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f97f3e00640 1 --2- 172.21.15.31:0/3198611296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df729d0 0x55692dfe4900 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f97e4092310 tx=0x7f97e401d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02bb888ec148690 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:09.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f97eaa00640 1 -- 172.21.15.31:0/3198611296 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e40681f0 con 0x55692df729d0 2024-09-17T05:33:09.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f97eaa00640 1 -- 172.21.15.31:0/3198611296 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97e405fb90 con 0x55692df729d0 2024-09-17T05:33:09.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.414+0000 7f97eaa00640 1 -- 172.21.15.31:0/3198611296 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e40050b0 con 0x55692df729d0 2024-09-17T05:33:09.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 -- 172.21.15.31:0/3198611296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df729d0 msgr2=0x55692dfe4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:09.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 --2- 172.21.15.31:0/3198611296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df729d0 0x55692dfe4900 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f97e4092310 tx=0x7f97e401d040 comp rx=0 tx=0).stop 2024-09-17T05:33:09.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 -- 172.21.15.31:0/3198611296 shutdown_connections 2024-09-17T05:33:09.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 --2- 172.21.15.31:0/3198611296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df732f0 0x55692dfe4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 --2- 172.21.15.31:0/3198611296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df729d0 0x55692dfe4900 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 --2- 172.21.15.31:0/3198611296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df26e10 0x55692dfe43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 -- 172.21.15.31:0/3198611296 >> 172.21.15.31:0/3198611296 conn(0x55692de10130 msgr2=0x55692df89e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:09.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 -- 172.21.15.31:0/3198611296 shutdown_connections 2024-09-17T05:33:09.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 -- 172.21.15.31:0/3198611296 wait complete. 2024-09-17T05:33:09.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 -- start start 2024-09-17T05:33:09.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 Processor -- start 2024-09-17T05:33:09.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df26e10 0x55692df88a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df729d0 0x55692dfa4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df732f0 0x55692dfa4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55692dd77070 con 0x55692df26e10 2024-09-17T05:33:09.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55692dd7c390 con 0x55692df732f0 2024-09-17T05:33:09.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55692dd838f0 con 0x55692df729d0 2024-09-17T05:33:09.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 10 client.0 _ll_register_callbacks cb 0x7f97f4009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:33:09.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f97faa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df26e10 0x55692df88a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f97faa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df26e10 0x55692df88a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57092/0 (socket says 172.21.15.31:57092) 2024-09-17T05:33:09.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f97faa00640 1 -- 172.21.15.31:0/1291744800 learned_addr learned my addr 172.21.15.31:0/1291744800 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:09.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f97fb400640 1 --2- 172.21.15.31:0/1291744800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df732f0 0x55692dfa4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f97f3e00640 1 --2- 172.21.15.31:0/1291744800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df729d0 0x55692dfa4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f97faa00640 1 -- 172.21.15.31:0/1291744800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df729d0 msgr2=0x55692dfa4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:33:09.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f97faa00640 1 --2- 172.21.15.31:0/1291744800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df729d0 0x55692dfa4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f97faa00640 1 -- 172.21.15.31:0/1291744800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df732f0 msgr2=0x55692dfa4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:33:09.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f97faa00640 1 --2- 172.21.15.31:0/1291744800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df732f0 0x55692dfa4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f97faa00640 1 -- 172.21.15.31:0/1291744800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55692dd3aa90 con 0x55692df26e10 2024-09-17T05:33:09.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f97faa00640 1 --2- 172.21.15.31:0/1291744800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df26e10 0x55692df88a50 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f97ec001e60 tx=0x7f97ec007aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c5ad3be6cb1790 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:09.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f97dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:33:09.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f97dfe00640 1 -- 172.21.15.31:0/1291744800 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec0039b0 con 0x55692df26e10 2024-09-17T05:33:09.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f97dfe00640 1 -- 172.21.15.31:0/1291744800 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f97ec010040 con 0x55692df26e10 2024-09-17T05:33:09.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 -- 172.21.15.31:0/1291744800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97e405fb90 con 0x55692df26e10 2024-09-17T05:33:09.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f97dfe00640 1 -- 172.21.15.31:0/1291744800 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f97ec040050 con 0x55692df26e10 2024-09-17T05:33:09.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 10 client.6732 fetch_fsmap learned FSMap version 56 2024-09-17T05:33:09.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.418+0000 7f9804fad000 1 -- 172.21.15.31:0/1291744800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x55692dd19050 con 0x55692df26e10 2024-09-17T05:33:09.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f97dfe00640 1 -- 172.21.15.31:0/1291744800 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97e405fb90 con 0x55692df26e10 2024-09-17T05:33:09.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f97dfe00640 1 -- 172.21.15.31:0/1291744800 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 56) ==== 3502+0+0 (secure 0 0 0) 0x7f97ec043020 con 0x55692df26e10 2024-09-17T05:33:09.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9804fad000 10 client.6732 fetch_fsmap finished waiting for FSMap version 56 2024-09-17T05:33:09.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9804fad000 10 client.6732 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:33:09.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9804fad000 20 client.6732 populate_metadata read hostname 'smithi031' 2024-09-17T05:33:09.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9804fad000 1 --2- 172.21.15.31:0/1291744800 >> [v2:172.21.15.31:6832/1737412276,v1:172.21.15.31:6834/1737412276] conn(0x55692dfa5000 0x55692dfe8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9804fad000 4 client.6732 mds_command: new command op to 6570 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:33:09.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9804fad000 1 -- 172.21.15.31:0/1291744800 --> [v2:172.21.15.31:6832/1737412276,v1:172.21.15.31:6834/1737412276] -- command(tid 0: {"prefix": "status"}) -- 0x55692dd82520 con 0x55692dfa5000 2024-09-17T05:33:09.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f97f3e00640 1 --2- 172.21.15.31:0/1291744800 >> [v2:172.21.15.31:6832/1737412276,v1:172.21.15.31:6834/1737412276] conn(0x55692dfa5000 0x55692dfe8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f97f3e00640 1 --2- 172.21.15.31:0/1291744800 >> [v2:172.21.15.31:6832/1737412276,v1:172.21.15.31:6834/1737412276] conn(0x55692dfa5000 0x55692dfe8610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4b58867e14a10bd server_cookie=cbd3a55138c99dfa in_seq=0 out_seq=0 2024-09-17T05:33:09.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f97dfe00640 10 client.6732 ms_handle_connect on v2:172.21.15.31:6832/1737412276 2024-09-17T05:33:09.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f97dfe00640 1 -- 172.21.15.31:0/1291744800 <== mds.0 v2:172.21.15.31:6832/1737412276 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55692dd82520 con 0x55692dfa5000 2024-09-17T05:33:09.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f97dfe00640 10 client.6732 handle_command_reply: tid=0 2024-09-17T05:33:09.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9804fad000 1 client.6732 shutdown 2024-09-17T05:33:09.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9804fad000 1 -- 172.21.15.31:0/1291744800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df26e10 msgr2=0x55692df88a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:09.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9804fad000 1 --2- 172.21.15.31:0/1291744800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df26e10 0x55692df88a50 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f97ec001e60 tx=0x7f97ec007aa0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9804fad000 1 -- 172.21.15.31:0/1291744800 shutdown_connections 2024-09-17T05:33:09.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9804fad000 1 --2- 172.21.15.31:0/1291744800 >> [v2:172.21.15.31:6832/1737412276,v1:172.21.15.31:6834/1737412276] conn(0x55692dfa5000 0x55692dfe8610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9804fad000 1 --2- 172.21.15.31:0/1291744800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55692df732f0 0x55692dfa4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9804fad000 1 --2- 172.21.15.31:0/1291744800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55692df729d0 0x55692dfa4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9804fad000 1 --2- 172.21.15.31:0/1291744800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55692df26e10 0x55692df88a50 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f97dfe00640 0 client.6732 ms_handle_reset on v2:172.21.15.31:6832/1737412276 2024-09-17T05:33:09.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9804fad000 1 -- 172.21.15.31:0/1291744800 >> 172.21.15.31:0/1291744800 conn(0x55692de10130 msgr2=0x55692df26470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:09.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9804fad000 1 -- 172.21.15.31:0/1291744800 shutdown_connections 2024-09-17T05:33:09.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9804fad000 1 -- 172.21.15.31:0/1291744800 wait complete. 2024-09-17T05:33:09.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9804fad000 20 client.6732 trim_cache size 0 max 16384 2024-09-17T05:33:09.428 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:33:09.429 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "b668cd1d-3036-4a29-9e5a-69d0df5776a8", 2024-09-17T05:33:09.429 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-17T05:33:09.429 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 6570, 2024-09-17T05:33:09.429 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-09-17T05:33:09.429 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-09-17T05:33:09.429 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-17T05:33:09.429 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 10.663165859999999, 2024-09-17T05:33:09.429 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 56, 2024-09-17T05:33:09.429 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 81, 2024-09-17T05:33:09.429 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 81, 2024-09-17T05:33:09.429 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 15.124939637000001 2024-09-17T05:33:09.429 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:33:09.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9801c00640 1 -- 172.21.15.31:0/162252377 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f97d8073320 msgr2=0x7f97d80757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:09.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9801c00640 1 --2- 172.21.15.31:0/162252377 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f97d8073320 0x7f97d80757e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0016b0 tx=0x7f97ec009040 comp rx=0 tx=0).stop 2024-09-17T05:33:09.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9801c00640 1 -- 172.21.15.31:0/162252377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97fc0cd100 msgr2=0x7f97fc0cb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:09.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9801c00640 1 --2- 172.21.15.31:0/162252377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97fc0cd100 0x7f97fc0cb630 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f97e400c4b0 tx=0x7f97e400c970 comp rx=0 tx=0).stop 2024-09-17T05:33:09.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9801c00640 1 -- 172.21.15.31:0/162252377 shutdown_connections 2024-09-17T05:33:09.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9801c00640 1 --2- 172.21.15.31:0/162252377 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f97d8073320 0x7f97d80757e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9801c00640 1 --2- 172.21.15.31:0/162252377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97fc15dae0 0x7f97fc0cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9801c00640 1 --2- 172.21.15.31:0/162252377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97fc0cd100 0x7f97fc0cb630 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9801c00640 1 --2- 172.21.15.31:0/162252377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97fc0b49e0 0x7f97fc152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9801c00640 1 -- 172.21.15.31:0/162252377 >> 172.21.15.31:0/162252377 conn(0x7f97fc0b18f0 msgr2=0x7f97fc073940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:09.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9801c00640 1 -- 172.21.15.31:0/162252377 shutdown_connections 2024-09-17T05:33:09.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.422+0000 7f9801c00640 1 -- 172.21.15.31:0/162252377 wait complete. 2024-09-17T05:33:09.444 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:33:09.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e11c00640 1 -- 172.21.15.31:0/311587443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e0c15f000 msgr2=0x7f9e0c0d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:09.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e11c00640 1 --2- 172.21.15.31:0/311587443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e0c15f000 0x7f9e0c0d01b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc009870 tx=0x7f9dfc01c7d0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e11c00640 1 -- 172.21.15.31:0/311587443 shutdown_connections 2024-09-17T05:33:09.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e11c00640 1 --2- 172.21.15.31:0/311587443 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e0c15f000 0x7f9e0c0d01b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e11c00640 1 -- 172.21.15.31:0/311587443 >> 172.21.15.31:0/311587443 conn(0x7f9e0c09aa10 msgr2=0x7f9e0c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:09.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e11c00640 1 -- 172.21.15.31:0/311587443 shutdown_connections 2024-09-17T05:33:09.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e11c00640 1 -- 172.21.15.31:0/311587443 wait complete. 2024-09-17T05:33:09.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e11c00640 1 Processor -- start 2024-09-17T05:33:09.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e11c00640 1 -- start start 2024-09-17T05:33:09.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e11c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e0c0b2590 0x7f9e0c1fbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e11c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e0c0cefb0 0x7f9e0c070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e11c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0c15f000 0x7f9e0c0712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e11c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c16a170 con 0x7f9e0c0cefb0 2024-09-17T05:33:09.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e11c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0c169ff0 con 0x7f9e0c15f000 2024-09-17T05:33:09.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e11c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9e0c16a2f0 con 0x7f9e0c0b2590 2024-09-17T05:33:09.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e03e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e0c0cefb0 0x7f9e0c070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e11200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0c15f000 0x7f9e0c0712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e03e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e0c0cefb0 0x7f9e0c070db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57094/0 (socket says 172.21.15.31:57094) 2024-09-17T05:33:09.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e03e00640 1 -- 172.21.15.31:0/3755371036 learned_addr learned my addr 172.21.15.31:0/3755371036 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:09.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e0be00640 1 --2- 172.21.15.31:0/3755371036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e0c0b2590 0x7f9e0c1fbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e03e00640 1 -- 172.21.15.31:0/3755371036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e0c0b2590 msgr2=0x7f9e0c1fbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:09.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e03e00640 1 --2- 172.21.15.31:0/3755371036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e0c0b2590 0x7f9e0c1fbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e03e00640 1 -- 172.21.15.31:0/3755371036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0c15f000 msgr2=0x7f9e0c0712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:09.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e03e00640 1 --2- 172.21.15.31:0/3755371036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0c15f000 0x7f9e0c0712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e03e00640 1 -- 172.21.15.31:0/3755371036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0c1fc090 con 0x7f9e0c0cefb0 2024-09-17T05:33:09.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.590+0000 7f9e03e00640 1 --2- 172.21.15.31:0/3755371036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e0c0cefb0 0x7f9e0c070db0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9df400c4c0 tx=0x7f9df400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:09.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.594+0000 7f9e08c00640 1 -- 172.21.15.31:0/3755371036 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df40052d0 con 0x7f9e0c0cefb0 2024-09-17T05:33:09.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.594+0000 7f9e08c00640 1 -- 172.21.15.31:0/3755371036 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9df4005490 con 0x7f9e0c0cefb0 2024-09-17T05:33:09.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.594+0000 7f9e08c00640 1 -- 172.21.15.31:0/3755371036 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df4012870 con 0x7f9e0c0cefb0 2024-09-17T05:33:09.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.594+0000 7f9e11c00640 1 -- 172.21.15.31:0/3755371036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e0c14fbb0 con 0x7f9e0c0cefb0 2024-09-17T05:33:09.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.594+0000 7f9e11c00640 1 -- 172.21.15.31:0/3755371036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e0c150170 con 0x7f9e0c0cefb0 2024-09-17T05:33:09.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.594+0000 7f9e11c00640 1 -- 172.21.15.31:0/3755371036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e0c09b450 con 0x7f9e0c0cefb0 2024-09-17T05:33:09.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.594+0000 7f9e08c00640 1 -- 172.21.15.31:0/3755371036 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f9df4012a10 con 0x7f9e0c0cefb0 2024-09-17T05:33:09.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.594+0000 7f9e08c00640 1 --2- 172.21.15.31:0/3755371036 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9de8073350 0x7f9de8075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:09.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.594+0000 7f9e08c00640 1 -- 172.21.15.31:0/3755371036 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f9df4093ee0 con 0x7f9e0c0cefb0 2024-09-17T05:33:09.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.594+0000 7f9e0be00640 1 --2- 172.21.15.31:0/3755371036 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9de8073350 0x7f9de8075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:09.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.598+0000 7f9e0be00640 1 --2- 172.21.15.31:0/3755371036 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9de8073350 0x7f9de8075810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0af000 tx=0x7f9dfc0b2040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:09.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.598+0000 7f9e08c00640 1 -- 172.21.15.31:0/3755371036 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9df405e680 con 0x7f9e0c0cefb0 2024-09-17T05:33:09.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.810+0000 7f9e11c00640 1 -- 172.21.15.31:0/3755371036 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9e0c09b170 con 0x7f9e0c0cefb0 2024-09-17T05:33:09.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.810+0000 7f9e08c00640 1 -- 172.21.15.31:0/3755371036 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) ==== 53+0+73 (secure 0 0 0) 0x7f9df40630b0 con 0x7f9e0c0cefb0 2024-09-17T05:33:09.813 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:33:09.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.814+0000 7f9e11c00640 1 -- 172.21.15.31:0/3755371036 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9de8073350 msgr2=0x7f9de8075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:09.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.814+0000 7f9e11c00640 1 --2- 172.21.15.31:0/3755371036 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9de8073350 0x7f9de8075810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0af000 tx=0x7f9dfc0b2040 comp rx=0 tx=0).stop 2024-09-17T05:33:09.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.814+0000 7f9e11c00640 1 -- 172.21.15.31:0/3755371036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e0c0cefb0 msgr2=0x7f9e0c070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:09.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.814+0000 7f9e11c00640 1 --2- 172.21.15.31:0/3755371036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e0c0cefb0 0x7f9e0c070db0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9df400c4c0 tx=0x7f9df400c980 comp rx=0 tx=0).stop 2024-09-17T05:33:09.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.814+0000 7f9e11c00640 1 -- 172.21.15.31:0/3755371036 shutdown_connections 2024-09-17T05:33:09.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.814+0000 7f9e11c00640 1 --2- 172.21.15.31:0/3755371036 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9de8073350 0x7f9de8075810 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.814+0000 7f9e11c00640 1 --2- 172.21.15.31:0/3755371036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0c15f000 0x7f9e0c0712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.814+0000 7f9e11c00640 1 --2- 172.21.15.31:0/3755371036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e0c0cefb0 0x7f9e0c070db0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.814+0000 7f9e11c00640 1 --2- 172.21.15.31:0/3755371036 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e0c0b2590 0x7f9e0c1fbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:09.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.814+0000 7f9e11c00640 1 -- 172.21.15.31:0/3755371036 >> 172.21.15.31:0/3755371036 conn(0x7f9e0c09aa10 msgr2=0x7f9e0c157a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:09.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.814+0000 7f9e11c00640 1 -- 172.21.15.31:0/3755371036 shutdown_connections 2024-09-17T05:33:09.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:09.814+0000 7f9e11c00640 1 -- 172.21.15.31:0/3755371036 wait complete. 2024-09-17T05:33:09.836 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:33:09.836 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:33:09.836 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-17T05:33:09.836 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:33:09.836 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:33:09.836 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:33:09.836 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:33:09.836 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:33:09.836 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:33:09.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:09.837 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-17T05:33:09.846 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:33:09.846 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:33:09.846 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:33:09.846 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:09.846 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-17T05:33:09.846 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:09.846 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:33:09.846 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:09.846 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-17T05:33:09.846 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:33:09.846 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:09.846 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-17T05:33:09.847 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:33:09.847 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:09.847 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-17T05:33:09.847 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:33:09.847 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42163sec preferred_lft 42163sec 2024-09-17T05:33:09.847 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-17T05:33:09.847 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:09.847 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:33:09.847 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:09.847 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-17T05:33:09.847 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:33:09.847 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:fe:f3:3e:aa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:09.847 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:33:09.848 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:09.848 INFO:teuthology.orchestra.run.smithi031.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:33:09.848 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:09.848 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:33:09.848 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:09.848 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:33:09.848 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:09.848 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:33:09.848 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:33:09.848 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:33:09.848 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:09.848 INFO:teuthology.orchestra.run.smithi031.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:33:09.849 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:33:09.849 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:33:09.849 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:09.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:09.850 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:33:09.912 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-17T05:33:09.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:09.914 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-17T05:33:09.967 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-17T05:33:09.967 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:33:09.967 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:33:09.967 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:33:09.968 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:33:09.968 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:33:09.968 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:33:09.968 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:33:09.968 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:33:09.968 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:33:09.968 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:33:09.968 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:33:10.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:33:10.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:33:10.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:10.111 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T05:33:10.120 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:33:10.121 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:33:10.121 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:33:10.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:10.122 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-09-17T05:33:10.189 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:33:10.189 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:33:10.246 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:33:10.246 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:33:10.246 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:33:10.297 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-17T05:33:10.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:10.297 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:33:10.386 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:33:10.387 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:33:10.401 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:33:10.401 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:33:10.401 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:33:10.401 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:33:10.401 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:33:10.405 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:33:10.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:10.405 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:33:10.425 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:33:10.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:33:10.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:33:10.529 INFO:teuthology.orchestra.run.smithi031.stdout:client6741 2024-09-17T05:33:10.529 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:33:10.530 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:10.539 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:33:10.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.730+0000 7fcee7400640 1 -- 172.21.15.31:0/3345064706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcec4004810 msgr2=0x7fcec4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:10.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.730+0000 7fcee7400640 1 --2- 172.21.15.31:0/3345064706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcec4004810 0x7fcec4004c90 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fcec800c310 tx=0x7fcec801f660 comp rx=0 tx=0).stop 2024-09-17T05:33:10.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.730+0000 7fcee7400640 1 -- 172.21.15.31:0/3345064706 shutdown_connections 2024-09-17T05:33:10.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.730+0000 7fcee7400640 1 --2- 172.21.15.31:0/3345064706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcec4004810 0x7fcec4004c90 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:10.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.730+0000 7fcee7400640 1 -- 172.21.15.31:0/3345064706 >> 172.21.15.31:0/3345064706 conn(0x7fcee00b2240 msgr2=0x7fcee00b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:10.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.730+0000 7fcee7400640 1 -- 172.21.15.31:0/3345064706 shutdown_connections 2024-09-17T05:33:10.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.730+0000 7fcee7400640 1 -- 172.21.15.31:0/3345064706 wait complete. 2024-09-17T05:33:10.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fcee7400640 1 Processor -- start 2024-09-17T05:33:10.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fcee7400640 1 -- start start 2024-09-17T05:33:10.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fcee7400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcec4004810 0x7fcee00b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:10.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fcee7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcee015cde0 0x7fcee015d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:10.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fcee7400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee01f81e0 0x7fcee01f8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:10.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fcee7400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcee006cc20 con 0x7fcee015cde0 2024-09-17T05:33:10.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fcee7400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcee01441f0 con 0x7fcec4004810 2024-09-17T05:33:10.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fcee7400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcee006cda0 con 0x7fcee01f81e0 2024-09-17T05:33:10.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fced7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcee015cde0 0x7fcee015d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:10.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fced7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcee015cde0 0x7fcee015d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57102/0 (socket says 172.21.15.31:57102) 2024-09-17T05:33:10.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fced7e00640 1 -- 172.21.15.31:0/3449469191 learned_addr learned my addr 172.21.15.31:0/3449469191 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:10.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fcee5400640 1 --2- 172.21.15.31:0/3449469191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee01f81e0 0x7fcee01f8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:10.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fcee4a00640 1 --2- 172.21.15.31:0/3449469191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcec4004810 0x7fcee00b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:10.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fced7e00640 1 -- 172.21.15.31:0/3449469191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee01f81e0 msgr2=0x7fcee01f8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:10.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fced7e00640 1 --2- 172.21.15.31:0/3449469191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee01f81e0 0x7fcee01f8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:10.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fced7e00640 1 -- 172.21.15.31:0/3449469191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcec4004810 msgr2=0x7fcee00b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:10.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fced7e00640 1 --2- 172.21.15.31:0/3449469191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcec4004810 0x7fcee00b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:10.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fced7e00640 1 -- 172.21.15.31:0/3449469191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee00b5520 con 0x7fcee015cde0 2024-09-17T05:33:10.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fced7e00640 1 --2- 172.21.15.31:0/3449469191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcee015cde0 0x7fcee015d260 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fcec801df30 tx=0x7fcec8001330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:10.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fcedd600640 1 -- 172.21.15.31:0/3449469191 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec8006480 con 0x7fcee015cde0 2024-09-17T05:33:10.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fcedd600640 1 -- 172.21.15.31:0/3449469191 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcec8003600 con 0x7fcee015cde0 2024-09-17T05:33:10.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fcedd600640 1 -- 172.21.15.31:0/3449469191 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec80039f0 con 0x7fcee015cde0 2024-09-17T05:33:10.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fcee7400640 1 -- 172.21.15.31:0/3449469191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee01f8fb0 con 0x7fcee015cde0 2024-09-17T05:33:10.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fcee7400640 1 -- 172.21.15.31:0/3449469191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee00ae710 con 0x7fcee015cde0 2024-09-17T05:33:10.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.734+0000 7fcee7400640 1 -- 172.21.15.31:0/3449469191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcee015e8b0 con 0x7fcee015cde0 2024-09-17T05:33:10.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.738+0000 7fcedd600640 1 -- 172.21.15.31:0/3449469191 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fcec8003b90 con 0x7fcee015cde0 2024-09-17T05:33:10.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.738+0000 7fcedd600640 1 --2- 172.21.15.31:0/3449469191 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcebc073320 0x7fcebc0757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:10.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.738+0000 7fcedd600640 1 -- 172.21.15.31:0/3449469191 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fcec8131bc0 con 0x7fcee015cde0 2024-09-17T05:33:10.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.738+0000 7fcee4a00640 1 --2- 172.21.15.31:0/3449469191 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcebc073320 0x7fcebc0757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:10.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.738+0000 7fcee4a00640 1 --2- 172.21.15.31:0/3449469191 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcebc073320 0x7fcebc0757e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fced0000c10 tx=0x7fced0006d20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:10.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.742+0000 7fcedd600640 1 -- 172.21.15.31:0/3449469191 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fcec8019410 con 0x7fcee015cde0 2024-09-17T05:33:10.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.958+0000 7fcee7400640 1 -- 172.21.15.31:0/3449469191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcee00d0f30 con 0x7fcee015cde0 2024-09-17T05:33:10.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.958+0000 7fcedd600640 1 -- 172.21.15.31:0/3449469191 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) ==== 53+0+73 (secure 0 0 0) 0x7fcec80fc360 con 0x7fcee015cde0 2024-09-17T05:33:10.959 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:33:10.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.958+0000 7fcee7400640 1 -- 172.21.15.31:0/3449469191 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcebc073320 msgr2=0x7fcebc0757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:10.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.958+0000 7fcee7400640 1 --2- 172.21.15.31:0/3449469191 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcebc073320 0x7fcebc0757e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fced0000c10 tx=0x7fced0006d20 comp rx=0 tx=0).stop 2024-09-17T05:33:10.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.958+0000 7fcee7400640 1 -- 172.21.15.31:0/3449469191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcee015cde0 msgr2=0x7fcee015d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:10.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.958+0000 7fcee7400640 1 --2- 172.21.15.31:0/3449469191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcee015cde0 0x7fcee015d260 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fcec801df30 tx=0x7fcec8001330 comp rx=0 tx=0).stop 2024-09-17T05:33:10.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.958+0000 7fcee7400640 1 -- 172.21.15.31:0/3449469191 shutdown_connections 2024-09-17T05:33:10.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.958+0000 7fcee7400640 1 --2- 172.21.15.31:0/3449469191 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcebc073320 0x7fcebc0757e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:10.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.958+0000 7fcee7400640 1 --2- 172.21.15.31:0/3449469191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcee01f81e0 0x7fcee01f8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:10.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.958+0000 7fcee7400640 1 --2- 172.21.15.31:0/3449469191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcee015cde0 0x7fcee015d260 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:10.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.958+0000 7fcee7400640 1 --2- 172.21.15.31:0/3449469191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcec4004810 0x7fcee00b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:10.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.958+0000 7fcee7400640 1 -- 172.21.15.31:0/3449469191 >> 172.21.15.31:0/3449469191 conn(0x7fcee00b2240 msgr2=0x7fcee0142fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:10.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.958+0000 7fcee7400640 1 -- 172.21.15.31:0/3449469191 shutdown_connections 2024-09-17T05:33:10.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:10.958+0000 7fcee7400640 1 -- 172.21.15.31:0/3449469191 wait complete. 2024-09-17T05:33:10.980 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:33:10.980 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:33:10.980 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-09-17T05:33:10.980 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:33:10.980 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:33:10.981 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:33:10.981 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:33:10.981 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:33:10.981 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:33:10.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:10.981 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-09-17T05:33:10.991 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:33:10.991 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:33:10.991 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:33:10.991 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:10.991 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-17T05:33:10.991 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:10.992 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:33:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-09-17T05:33:10.992 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:33:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-09-17T05:33:10.992 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:33:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:10.992 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:33:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-17T05:33:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42165sec preferred_lft 42165sec 2024-09-17T05:33:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-09-17T05:33:10.992 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:10.993 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:33:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:84:cd:fc:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:33:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:10.993 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:33:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:33:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:33:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:10.993 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:33:10.993 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:33:10.994 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:33:10.994 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:10.994 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:33:10.994 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:33:10.994 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:33:10.994 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:10.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:10.995 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:33:11.057 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-17T05:33:11.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:11.060 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-09-17T05:33:11.114 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-09-17T05:33:11.114 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:33:11.114 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-17T05:33:11.114 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:33:11.114 INFO:teuthology.orchestra.run.smithi155.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-17T05:33:11.114 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:33:11.114 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:33:11.114 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:33:11.115 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:33:11.115 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:33:11.115 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:33:11.115 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:33:11.115 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:33:11.115 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:33:11.115 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:33:11.115 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:33:11.115 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:33:11.210 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:33:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:33:11.253 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:33:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:33:11.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:11.260 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-17T05:33:11.268 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:33:11.268 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:33:11.269 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:33:11.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:11.269 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-09-17T05:33:11.333 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:33:11.333 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:33:11.385 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:33:11.385 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:33:11.388 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:33:11.436 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-17T05:33:11.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:11.437 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:33:11.525 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:33:11.525 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:33:11.539 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:33:11.539 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:33:11.539 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:33:11.539 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:33:11.539 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:33:11.543 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:33:11.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:11.543 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:33:11.610 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:33:11.700 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:33:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:33:11.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:33:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:33:11.710 INFO:teuthology.orchestra.run.smithi155.stdout:client5882 2024-09-17T05:33:11.711 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:33:11.711 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:11.762 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:33:11.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.922+0000 7f1cd8a00640 1 -- 172.21.15.31:0/1440693562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd415f700 msgr2=0x7f1cd40d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:11.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.922+0000 7f1cd8a00640 1 --2- 172.21.15.31:0/1440693562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd415f700 0x7f1cd40d0720 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc009c80 tx=0x7f1ccc01cd70 comp rx=0 tx=0).stop 2024-09-17T05:33:11.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.922+0000 7f1cd8a00640 1 -- 172.21.15.31:0/1440693562 shutdown_connections 2024-09-17T05:33:11.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.922+0000 7f1cd8a00640 1 --2- 172.21.15.31:0/1440693562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd415f700 0x7f1cd40d0720 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:11.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.922+0000 7f1cd8a00640 1 --2- 172.21.15.31:0/1440693562 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cd40cff00 0x7f1cd40d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:11.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.922+0000 7f1cd8a00640 1 -- 172.21.15.31:0/1440693562 >> 172.21.15.31:0/1440693562 conn(0x7f1cd40d1da0 msgr2=0x7f1cd40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:11.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.922+0000 7f1cd8a00640 1 -- 172.21.15.31:0/1440693562 shutdown_connections 2024-09-17T05:33:11.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.922+0000 7f1cd8a00640 1 -- 172.21.15.31:0/1440693562 wait complete. 2024-09-17T05:33:11.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1cd8a00640 1 Processor -- start 2024-09-17T05:33:11.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1cd8a00640 1 -- start start 2024-09-17T05:33:11.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1cd8a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cd40cff00 0x7f1cd414f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:11.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1cd8a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cd40d02e0 0x7f1cd40c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:11.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1cd8a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd415f700 0x7f1cd40c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:11.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1cd8a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd40b0cf0 con 0x7f1cd415f700 2024-09-17T05:33:11.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1cd8a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd40b0b70 con 0x7f1cd40cff00 2024-09-17T05:33:11.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1cd8a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1cd4168bf0 con 0x7f1cd40d02e0 2024-09-17T05:33:11.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1cd3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd415f700 0x7f1cd40c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:11.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1cd3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd415f700 0x7f1cd40c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57132/0 (socket says 172.21.15.31:57132) 2024-09-17T05:33:11.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1cd3400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cd40cff00 0x7f1cd414f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:11.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1cd3e00640 1 -- 172.21.15.31:0/3887123274 learned_addr learned my addr 172.21.15.31:0/3887123274 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:11.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1ccbe00640 1 --2- 172.21.15.31:0/3887123274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cd40d02e0 0x7f1cd40c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:11.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1cd3e00640 1 -- 172.21.15.31:0/3887123274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cd40d02e0 msgr2=0x7f1cd40c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:11.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1cd3e00640 1 --2- 172.21.15.31:0/3887123274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cd40d02e0 0x7f1cd40c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:11.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1cd3e00640 1 -- 172.21.15.31:0/3887123274 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cd40cff00 msgr2=0x7f1cd414f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:11.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1cd3e00640 1 --2- 172.21.15.31:0/3887123274 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cd40cff00 0x7f1cd414f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:11.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1cd3e00640 1 -- 172.21.15.31:0/3887123274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd40ce550 con 0x7f1cd415f700 2024-09-17T05:33:11.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1cd3e00640 1 --2- 172.21.15.31:0/3887123274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd415f700 0x7f1cd40c8600 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc009bd0 tx=0x7f1ccc005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:11.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1ccb400640 1 -- 172.21.15.31:0/3887123274 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc0bb070 con 0x7f1cd415f700 2024-09-17T05:33:11.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.926+0000 7f1ccb400640 1 -- 172.21.15.31:0/3887123274 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ccc004b40 con 0x7f1cd415f700 2024-09-17T05:33:11.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.930+0000 7f1cd8a00640 1 -- 172.21.15.31:0/3887123274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cd40ce830 con 0x7f1cd415f700 2024-09-17T05:33:11.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.930+0000 7f1ccb400640 1 -- 172.21.15.31:0/3887123274 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc0b2040 con 0x7f1cd415f700 2024-09-17T05:33:11.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.930+0000 7f1cd8a00640 1 -- 172.21.15.31:0/3887123274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cd40cedf0 con 0x7f1cd415f700 2024-09-17T05:33:11.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.930+0000 7f1cd8a00640 1 -- 172.21.15.31:0/3887123274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cd40d28c0 con 0x7f1cd415f700 2024-09-17T05:33:11.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.930+0000 7f1ccb400640 1 -- 172.21.15.31:0/3887123274 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f1ccc0be070 con 0x7f1cd415f700 2024-09-17T05:33:11.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.930+0000 7f1ccb400640 1 --2- 172.21.15.31:0/3887123274 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1cb0073350 0x7f1cb0075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:11.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.930+0000 7f1ccb400640 1 -- 172.21.15.31:0/3887123274 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f1ccc12dfe0 con 0x7f1cd415f700 2024-09-17T05:33:11.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.930+0000 7f1cd3400640 1 --2- 172.21.15.31:0/3887123274 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1cb0073350 0x7f1cb0075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:11.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.934+0000 7f1cd3400640 1 --2- 172.21.15.31:0/3887123274 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1cb0073350 0x7f1cb0075810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4009be0 tx=0x7f1cc40091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:11.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:11.938+0000 7f1ccb400640 1 -- 172.21.15.31:0/3887123274 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f1ccc016990 con 0x7f1cd415f700 2024-09-17T05:33:12.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:12.146+0000 7f1cd8a00640 1 -- 172.21.15.31:0/3887123274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f1cd40b18d0 con 0x7f1cd415f700 2024-09-17T05:33:12.342 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:33:12.345 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:33:12.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:12.834+0000 7f1ccb400640 1 -- 172.21.15.31:0/3887123274 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v57) ==== 136+0+0 (secure 0 0 0) 0x7f1ccc0f8850 con 0x7f1cd415f700 2024-09-17T05:33:12.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:12.838+0000 7f1cd8a00640 1 -- 172.21.15.31:0/3887123274 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1cb0073350 msgr2=0x7f1cb0075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:12.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:12.838+0000 7f1cd8a00640 1 --2- 172.21.15.31:0/3887123274 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1cb0073350 0x7f1cb0075810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4009be0 tx=0x7f1cc40091e0 comp rx=0 tx=0).stop 2024-09-17T05:33:12.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:12.838+0000 7f1cd8a00640 1 -- 172.21.15.31:0/3887123274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd415f700 msgr2=0x7f1cd40c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:12.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:12.838+0000 7f1cd8a00640 1 --2- 172.21.15.31:0/3887123274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd415f700 0x7f1cd40c8600 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc009bd0 tx=0x7f1ccc005b00 comp rx=0 tx=0).stop 2024-09-17T05:33:12.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:12.838+0000 7f1cd8a00640 1 -- 172.21.15.31:0/3887123274 shutdown_connections 2024-09-17T05:33:12.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:12.838+0000 7f1cd8a00640 1 --2- 172.21.15.31:0/3887123274 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1cb0073350 0x7f1cb0075810 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:12.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:12.838+0000 7f1cd8a00640 1 --2- 172.21.15.31:0/3887123274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cd415f700 0x7f1cd40c8600 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:12.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:12.838+0000 7f1cd8a00640 1 --2- 172.21.15.31:0/3887123274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cd40d02e0 0x7f1cd40c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:12.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:12.838+0000 7f1cd8a00640 1 --2- 172.21.15.31:0/3887123274 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cd40cff00 0x7f1cd414f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:12.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:12.838+0000 7f1cd8a00640 1 -- 172.21.15.31:0/3887123274 >> 172.21.15.31:0/3887123274 conn(0x7f1cd40d1da0 msgr2=0x7f1cd415c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:12.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:12.838+0000 7f1cd8a00640 1 -- 172.21.15.31:0/3887123274 shutdown_connections 2024-09-17T05:33:12.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:12.838+0000 7f1cd8a00640 1 -- 172.21.15.31:0/3887123274 wait complete. 2024-09-17T05:33:12.860 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:33:13.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.010+0000 7fbb2ac00640 1 -- 172.21.15.31:0/416552428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb2415f000 msgr2=0x7fbb240d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:13.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.010+0000 7fbb2ac00640 1 --2- 172.21.15.31:0/416552428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb2415f000 0x7fbb240d01b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009840 tx=0x7fbb1801c620 comp rx=0 tx=0).stop 2024-09-17T05:33:13.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.010+0000 7fbb2ac00640 1 -- 172.21.15.31:0/416552428 shutdown_connections 2024-09-17T05:33:13.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.010+0000 7fbb2ac00640 1 --2- 172.21.15.31:0/416552428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb2415f000 0x7fbb240d01b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.010+0000 7fbb2ac00640 1 -- 172.21.15.31:0/416552428 >> 172.21.15.31:0/416552428 conn(0x7fbb2409aa10 msgr2=0x7fbb2409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:13.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.010+0000 7fbb2ac00640 1 -- 172.21.15.31:0/416552428 shutdown_connections 2024-09-17T05:33:13.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.010+0000 7fbb2ac00640 1 -- 172.21.15.31:0/416552428 wait complete. 2024-09-17T05:33:13.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.010+0000 7fbb2ac00640 1 Processor -- start 2024-09-17T05:33:13.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.010+0000 7fbb2ac00640 1 -- start start 2024-09-17T05:33:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb2ac00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb240b2590 0x7fbb241fad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb2ac00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb240cefb0 0x7fbb24167050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb2ac00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb2415f000 0x7fbb240c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb2ac00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2416a0c0 con 0x7fbb2415f000 2024-09-17T05:33:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb2ac00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbb24169f40 con 0x7fbb240b2590 2024-09-17T05:33:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb2ac00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbb2416a240 con 0x7fbb240cefb0 2024-09-17T05:33:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb2a200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb2415f000 0x7fbb240c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb2a200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb2415f000 0x7fbb240c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57148/0 (socket says 172.21.15.31:57148) 2024-09-17T05:33:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb2a200640 1 -- 172.21.15.31:0/1749035363 learned_addr learned my addr 172.21.15.31:0/1749035363 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb29800640 1 --2- 172.21.15.31:0/1749035363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb240b2590 0x7fbb241fad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:13.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb28e00640 1 --2- 172.21.15.31:0/1749035363 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb240cefb0 0x7fbb24167050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:13.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb2a200640 1 -- 172.21.15.31:0/1749035363 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb240cefb0 msgr2=0x7fbb24167050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:13.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb2a200640 1 --2- 172.21.15.31:0/1749035363 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb240cefb0 0x7fbb24167050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb2a200640 1 -- 172.21.15.31:0/1749035363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb240b2590 msgr2=0x7fbb241fad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:13.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb2a200640 1 --2- 172.21.15.31:0/1749035363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb240b2590 0x7fbb241fad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb2a200640 1 -- 172.21.15.31:0/1749035363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb24072750 con 0x7fbb2415f000 2024-09-17T05:33:13.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb2a200640 1 --2- 172.21.15.31:0/1749035363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb2415f000 0x7fbb240c64a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c001c60 tx=0x7fbb1c001d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:13.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb21600640 1 -- 172.21.15.31:0/1749035363 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c016020 con 0x7fbb2415f000 2024-09-17T05:33:13.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb21600640 1 -- 172.21.15.31:0/1749035363 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb1c00acf0 con 0x7fbb2415f000 2024-09-17T05:33:13.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb2ac00640 1 -- 172.21.15.31:0/1749035363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb241558a0 con 0x7fbb2415f000 2024-09-17T05:33:13.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb21600640 1 -- 172.21.15.31:0/1749035363 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c012680 con 0x7fbb2415f000 2024-09-17T05:33:13.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb2ac00640 1 -- 172.21.15.31:0/1749035363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb24155e60 con 0x7fbb2415f000 2024-09-17T05:33:13.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb2ac00640 1 -- 172.21.15.31:0/1749035363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb240b0560 con 0x7fbb2415f000 2024-09-17T05:33:13.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.014+0000 7fbb21600640 1 -- 172.21.15.31:0/1749035363 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fbb1c019020 con 0x7fbb2415f000 2024-09-17T05:33:13.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.018+0000 7fbb21600640 1 --2- 172.21.15.31:0/1749035363 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbb04073320 0x7fbb040757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:13.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.018+0000 7fbb21600640 1 -- 172.21.15.31:0/1749035363 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fbb1c0949c0 con 0x7fbb2415f000 2024-09-17T05:33:13.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.018+0000 7fbb29800640 1 --2- 172.21.15.31:0/1749035363 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbb04073320 0x7fbb040757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:13.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.018+0000 7fbb29800640 1 --2- 172.21.15.31:0/1749035363 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbb04073320 0x7fbb040757e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbb180ae000 tx=0x7fbb1801ae60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:13.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.022+0000 7fbb21600640 1 -- 172.21.15.31:0/1749035363 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fbb1c020020 con 0x7fbb2415f000 2024-09-17T05:33:13.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.218+0000 7fbb2ac00640 1 -- 172.21.15.31:0/1749035363 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fbb240b0280 con 0x7fbb04073320 2024-09-17T05:33:13.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.218+0000 7fbb21600640 1 -- 172.21.15.31:0/1749035363 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fbb240b0280 con 0x7fbb04073320 2024-09-17T05:33:13.221 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:33:13.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:13.222 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephfs" 2024-09-17T05:33:13.222 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:13.222 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:33:13.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.222+0000 7fbb2ac00640 1 -- 172.21.15.31:0/1749035363 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbb04073320 msgr2=0x7fbb040757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:13.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.222+0000 7fbb2ac00640 1 --2- 172.21.15.31:0/1749035363 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbb04073320 0x7fbb040757e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbb180ae000 tx=0x7fbb1801ae60 comp rx=0 tx=0).stop 2024-09-17T05:33:13.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.222+0000 7fbb2ac00640 1 -- 172.21.15.31:0/1749035363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb2415f000 msgr2=0x7fbb240c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:13.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.222+0000 7fbb2ac00640 1 --2- 172.21.15.31:0/1749035363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb2415f000 0x7fbb240c64a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c001c60 tx=0x7fbb1c001d50 comp rx=0 tx=0).stop 2024-09-17T05:33:13.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.222+0000 7fbb2ac00640 1 -- 172.21.15.31:0/1749035363 shutdown_connections 2024-09-17T05:33:13.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.222+0000 7fbb2ac00640 1 --2- 172.21.15.31:0/1749035363 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbb04073320 0x7fbb040757e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.222+0000 7fbb2ac00640 1 --2- 172.21.15.31:0/1749035363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbb2415f000 0x7fbb240c64a0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.222+0000 7fbb2ac00640 1 --2- 172.21.15.31:0/1749035363 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb240cefb0 0x7fbb24167050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.222+0000 7fbb2ac00640 1 --2- 172.21.15.31:0/1749035363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb240b2590 0x7fbb241fad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.222+0000 7fbb2ac00640 1 -- 172.21.15.31:0/1749035363 >> 172.21.15.31:0/1749035363 conn(0x7fbb2409aa10 msgr2=0x7fbb24071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:13.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.222+0000 7fbb2ac00640 1 -- 172.21.15.31:0/1749035363 shutdown_connections 2024-09-17T05:33:13.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.222+0000 7fbb2ac00640 1 -- 172.21.15.31:0/1749035363 wait complete. 2024-09-17T05:33:13.244 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:33:13.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.390+0000 7f4064200640 1 -- 172.21.15.31:0/2012620529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c15f840 msgr2=0x7f405c15fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:13.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.390+0000 7f4064200640 1 --2- 172.21.15.31:0/2012620529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c15f840 0x7f405c15fcd0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f405c0763e0 tx=0x7f405401cd60 comp rx=0 tx=0).stop 2024-09-17T05:33:13.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.390+0000 7f4064200640 1 -- 172.21.15.31:0/2012620529 shutdown_connections 2024-09-17T05:33:13.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.390+0000 7f4064200640 1 --2- 172.21.15.31:0/2012620529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c15f840 0x7f405c15fcd0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.390+0000 7f4064200640 1 --2- 172.21.15.31:0/2012620529 >> v2:172.21.15.155:3300/0 conn(0x7f405c0c6b00 0x7f405c06d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.390+0000 7f4064200640 1 --2- 172.21.15.31:0/2012620529 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f405c152b90 0x7f405c06f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.390+0000 7f4064200640 1 -- 172.21.15.31:0/2012620529 >> 172.21.15.31:0/2012620529 conn(0x7f405c0cce90 msgr2=0x7f405c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:13.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.390+0000 7f4064200640 1 -- 172.21.15.31:0/2012620529 shutdown_connections 2024-09-17T05:33:13.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.390+0000 7f4064200640 1 -- 172.21.15.31:0/2012620529 wait complete. 2024-09-17T05:33:13.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4064200640 1 Processor -- start 2024-09-17T05:33:13.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4064200640 1 -- start start 2024-09-17T05:33:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4064200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f405c0c6b00 0x7f405c145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4064200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c152b90 0x7f405c0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4064200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f405c15f840 0x7f405c0cf610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4064200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f405c15c3d0 con 0x7f405c152b90 2024-09-17T05:33:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4064200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f405c15c250 con 0x7f405c0c6b00 2024-09-17T05:33:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4064200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f405c15c550 con 0x7f405c15f840 2024-09-17T05:33:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4060e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c152b90 0x7f405c0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4060e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c152b90 0x7f405c0cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57178/0 (socket says 172.21.15.31:57178) 2024-09-17T05:33:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4060e00640 1 -- 172.21.15.31:0/1536159464 learned_addr learned my addr 172.21.15.31:0/1536159464 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4061800640 1 --2- 172.21.15.31:0/1536159464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f405c0c6b00 0x7f405c145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:13.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4062200640 1 --2- 172.21.15.31:0/1536159464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f405c15f840 0x7f405c0cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:13.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4060e00640 1 -- 172.21.15.31:0/1536159464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f405c15f840 msgr2=0x7f405c0cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:13.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4060e00640 1 --2- 172.21.15.31:0/1536159464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f405c15f840 0x7f405c0cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4060e00640 1 -- 172.21.15.31:0/1536159464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f405c0c6b00 msgr2=0x7f405c145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:13.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4060e00640 1 --2- 172.21.15.31:0/1536159464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f405c0c6b00 0x7f405c145000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4060e00640 1 -- 172.21.15.31:0/1536159464 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405c1f7990 con 0x7f405c152b90 2024-09-17T05:33:13.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4062200640 1 --2- 172.21.15.31:0/1536159464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f405c15f840 0x7f405c0cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:13.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4060e00640 1 --2- 172.21.15.31:0/1536159464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c152b90 0x7f405c0cf0d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f404800c920 tx=0x7f404800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:13.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4059600640 1 -- 172.21.15.31:0/1536159464 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4048007c70 con 0x7f405c152b90 2024-09-17T05:33:13.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4059600640 1 -- 172.21.15.31:0/1536159464 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4048005030 con 0x7f405c152b90 2024-09-17T05:33:13.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4064200640 1 -- 172.21.15.31:0/1536159464 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405c0b4470 con 0x7f405c152b90 2024-09-17T05:33:13.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4059600640 1 -- 172.21.15.31:0/1536159464 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4048005480 con 0x7f405c152b90 2024-09-17T05:33:13.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4064200640 1 -- 172.21.15.31:0/1536159464 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f405c150050 con 0x7f405c152b90 2024-09-17T05:33:13.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.394+0000 7f4064200640 1 -- 172.21.15.31:0/1536159464 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f405c06f090 con 0x7f405c152b90 2024-09-17T05:33:13.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.398+0000 7f4059600640 1 -- 172.21.15.31:0/1536159464 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f40480047d0 con 0x7f405c152b90 2024-09-17T05:33:13.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.398+0000 7f4059600640 1 --2- 172.21.15.31:0/1536159464 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f403c073320 0x7f403c0757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:13.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.398+0000 7f4059600640 1 -- 172.21.15.31:0/1536159464 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f40480949c0 con 0x7f405c152b90 2024-09-17T05:33:13.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.398+0000 7f4061800640 1 --2- 172.21.15.31:0/1536159464 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f403c073320 0x7f403c0757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:13.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.398+0000 7f4061800640 1 --2- 172.21.15.31:0/1536159464 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f403c073320 0x7f403c0757e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f405c148c00 tx=0x7f405000a2d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:13.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.402+0000 7f4059600640 1 -- 172.21.15.31:0/1536159464 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4048014070 con 0x7f405c152b90 2024-09-17T05:33:13.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.578+0000 7f4064200640 1 -- 172.21.15.31:0/1536159464 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f405c0cc120 con 0x7f405c152b90 2024-09-17T05:33:13.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.578+0000 7f4059600640 1 -- 172.21.15.31:0/1536159464 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f404805f160 con 0x7f405c152b90 2024-09-17T05:33:13.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.578+0000 7f4064200640 1 -- 172.21.15.31:0/1536159464 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f403c073320 msgr2=0x7f403c0757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:13.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.578+0000 7f4064200640 1 --2- 172.21.15.31:0/1536159464 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f403c073320 0x7f403c0757e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f405c148c00 tx=0x7f405000a2d0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.578+0000 7f4064200640 1 -- 172.21.15.31:0/1536159464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c152b90 msgr2=0x7f405c0cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:13.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.578+0000 7f4064200640 1 --2- 172.21.15.31:0/1536159464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c152b90 0x7f405c0cf0d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f404800c920 tx=0x7f404800cde0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.578+0000 7f4064200640 1 -- 172.21.15.31:0/1536159464 shutdown_connections 2024-09-17T05:33:13.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.578+0000 7f4064200640 1 --2- 172.21.15.31:0/1536159464 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f403c073320 0x7f403c0757e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.578+0000 7f4064200640 1 --2- 172.21.15.31:0/1536159464 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f405c15f840 0x7f405c0cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.578+0000 7f4064200640 1 --2- 172.21.15.31:0/1536159464 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c152b90 0x7f405c0cf0d0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.578+0000 7f4064200640 1 --2- 172.21.15.31:0/1536159464 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f405c0c6b00 0x7f405c145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.578+0000 7f4064200640 1 -- 172.21.15.31:0/1536159464 >> 172.21.15.31:0/1536159464 conn(0x7f405c0cce90 msgr2=0x7f405c14ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:13.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.578+0000 7f4064200640 1 -- 172.21.15.31:0/1536159464 shutdown_connections 2024-09-17T05:33:13.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.578+0000 7f4064200640 1 -- 172.21.15.31:0/1536159464 wait complete. 2024-09-17T05:33:13.602 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create 'abcd@#' 2024-09-17T05:33:13.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.750+0000 7ff84ba00640 1 -- 172.21.15.31:0/1837494042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8440d29b0 msgr2=0x7ff8440b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:13.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.750+0000 7ff84ba00640 1 --2- 172.21.15.31:0/1837494042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8440d29b0 0x7ff8440b1cf0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7ff830009840 tx=0x7ff83001f010 comp rx=0 tx=0).stop 2024-09-17T05:33:13.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.750+0000 7ff84ba00640 1 -- 172.21.15.31:0/1837494042 shutdown_connections 2024-09-17T05:33:13.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.750+0000 7ff84ba00640 1 --2- 172.21.15.31:0/1837494042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8440d29b0 0x7ff8440b1cf0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.750+0000 7ff84ba00640 1 -- 172.21.15.31:0/1837494042 >> 172.21.15.31:0/1837494042 conn(0x7ff8440d1e90 msgr2=0x7ff8440d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:13.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.750+0000 7ff84ba00640 1 -- 172.21.15.31:0/1837494042 shutdown_connections 2024-09-17T05:33:13.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.750+0000 7ff84ba00640 1 -- 172.21.15.31:0/1837494042 wait complete. 2024-09-17T05:33:13.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.750+0000 7ff84ba00640 1 Processor -- start 2024-09-17T05:33:13.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.750+0000 7ff84ba00640 1 -- start start 2024-09-17T05:33:13.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.750+0000 7ff84ba00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8440d00f0 0x7ff844155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:13.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.750+0000 7ff84ba00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8440d04d0 0x7ff8441e64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:13.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff84ba00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8440d29b0 0x7ff8440cec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:13.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff84ba00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff8440b0ed0 con 0x7ff8440d04d0 2024-09-17T05:33:13.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff84ba00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff8440b0d50 con 0x7ff8440d00f0 2024-09-17T05:33:13.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff84ba00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff8440af910 con 0x7ff8440d29b0 2024-09-17T05:33:13.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff843e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8440d04d0 0x7ff8441e64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:13.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff843e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8440d04d0 0x7ff8441e64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57198/0 (socket says 172.21.15.31:57198) 2024-09-17T05:33:13.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff843e00640 1 -- 172.21.15.31:0/746522577 learned_addr learned my addr 172.21.15.31:0/746522577 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:13.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff849a00640 1 --2- 172.21.15.31:0/746522577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8440d29b0 0x7ff8440cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:13.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff849000640 1 --2- 172.21.15.31:0/746522577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8440d00f0 0x7ff844155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:13.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff843e00640 1 -- 172.21.15.31:0/746522577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8440d29b0 msgr2=0x7ff8440cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:13.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff843e00640 1 --2- 172.21.15.31:0/746522577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8440d29b0 0x7ff8440cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff843e00640 1 -- 172.21.15.31:0/746522577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8440d00f0 msgr2=0x7ff844155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:13.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff843e00640 1 --2- 172.21.15.31:0/746522577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8440d00f0 0x7ff844155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:13.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff843e00640 1 -- 172.21.15.31:0/746522577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8440cf7f0 con 0x7ff8440d04d0 2024-09-17T05:33:13.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff843e00640 1 --2- 172.21.15.31:0/746522577 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8440d04d0 0x7ff8441e64e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7ff830009930 tx=0x7ff8300a8c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:13.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff840c00640 1 -- 172.21.15.31:0/746522577 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8300b5040 con 0x7ff8440d04d0 2024-09-17T05:33:13.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff840c00640 1 -- 172.21.15.31:0/746522577 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8300b1680 con 0x7ff8440d04d0 2024-09-17T05:33:13.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff840c00640 1 -- 172.21.15.31:0/746522577 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8300b1a30 con 0x7ff8440d04d0 2024-09-17T05:33:13.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff84ba00640 1 -- 172.21.15.31:0/746522577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8441e6f60 con 0x7ff8440d04d0 2024-09-17T05:33:13.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff84ba00640 1 -- 172.21.15.31:0/746522577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8440c5b60 con 0x7ff8440d04d0 2024-09-17T05:33:13.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff84ba00640 1 -- 172.21.15.31:0/746522577 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8440af200 con 0x7ff8440d04d0 2024-09-17T05:33:13.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.754+0000 7ff840c00640 1 -- 172.21.15.31:0/746522577 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7ff8300c2030 con 0x7ff8440d04d0 2024-09-17T05:33:13.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.758+0000 7ff840c00640 1 --2- 172.21.15.31:0/746522577 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff824073350 0x7ff824075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:13.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.758+0000 7ff840c00640 1 -- 172.21.15.31:0/746522577 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7ff830131c90 con 0x7ff8440d04d0 2024-09-17T05:33:13.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.758+0000 7ff849000640 1 --2- 172.21.15.31:0/746522577 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff824073350 0x7ff824075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:13.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.758+0000 7ff849000640 1 --2- 172.21.15.31:0/746522577 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff824073350 0x7ff824075810 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff838000f70 tx=0x7ff838009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:13.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:13.762+0000 7ff840c00640 1 -- 172.21.15.31:0/746522577 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff8300c9060 con 0x7ff8440d04d0 2024-09-17T05:33:13.966 INFO:teuthology.orchestra.run.smithi031.stderr:Invalid command: invalid chars #@ in abcd@# 2024-09-17T05:33:13.966 INFO:teuthology.orchestra.run.smithi031.stderr:fs volume create [] : Create a CephFS volume 2024-09-17T05:33:13.966 INFO:teuthology.orchestra.run.smithi031.stderr:Error EINVAL: invalid command 2024-09-17T05:33:13.974 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T05:33:13.974 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create testvol 2024-09-17T05:33:14.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.122+0000 7f4bb3400640 1 -- 172.21.15.31:0/234168119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bac0d00f0 msgr2=0x7f4bac0b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:14.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.122+0000 7f4bb3400640 1 --2- 172.21.15.31:0/234168119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bac0d00f0 0x7f4bac0b15e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009900 tx=0x7f4b9c01f0d0 comp rx=0 tx=0).stop 2024-09-17T05:33:14.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.122+0000 7f4bb3400640 1 -- 172.21.15.31:0/234168119 shutdown_connections 2024-09-17T05:33:14.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.122+0000 7f4bb3400640 1 --2- 172.21.15.31:0/234168119 >> v2:172.21.15.155:3300/0 conn(0x7f4bac0d04d0 0x7f4bac0af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:14.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.122+0000 7f4bb3400640 1 --2- 172.21.15.31:0/234168119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bac0d00f0 0x7f4bac0b15e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:14.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.122+0000 7f4bb3400640 1 -- 172.21.15.31:0/234168119 >> 172.21.15.31:0/234168119 conn(0x7f4bac0d1e90 msgr2=0x7f4bac0d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:14.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.122+0000 7f4bb3400640 1 -- 172.21.15.31:0/234168119 shutdown_connections 2024-09-17T05:33:14.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.122+0000 7f4bb3400640 1 -- 172.21.15.31:0/234168119 wait complete. 2024-09-17T05:33:14.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.122+0000 7f4bb3400640 1 Processor -- start 2024-09-17T05:33:14.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb3400640 1 -- start start 2024-09-17T05:33:14.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb3400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bac0d00f0 0x7f4bac14ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:14.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb3400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bac0d04d0 0x7f4bac14ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:14.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bac0d29b0 0x7f4bac0b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:14.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb3400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4bac0b0ed0 con 0x7f4bac0d29b0 2024-09-17T05:33:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb3400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4bac0b0d50 con 0x7f4bac0d04d0 2024-09-17T05:33:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb3400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4bac0af740 con 0x7f4bac0d00f0 2024-09-17T05:33:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb1400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bac0d29b0 0x7f4bac0b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb1400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bac0d29b0 0x7f4bac0b60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57210/0 (socket says 172.21.15.31:57210) 2024-09-17T05:33:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb1400640 1 -- 172.21.15.31:0/963676116 learned_addr learned my addr 172.21.15.31:0/963676116 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4ba3e00640 1 --2- 172.21.15.31:0/963676116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bac0d04d0 0x7f4bac14ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb0a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bac0d00f0 0x7f4bac14ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:14.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb1400640 1 -- 172.21.15.31:0/963676116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bac0d00f0 msgr2=0x7f4bac14ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb1400640 1 --2- 172.21.15.31:0/963676116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bac0d00f0 0x7f4bac14ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb1400640 1 -- 172.21.15.31:0/963676116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bac0d04d0 msgr2=0x7f4bac14ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb1400640 1 --2- 172.21.15.31:0/963676116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bac0d04d0 0x7f4bac14ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb1400640 1 -- 172.21.15.31:0/963676116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bac0cd310 con 0x7f4bac0d29b0 2024-09-17T05:33:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb1400640 1 --2- 172.21.15.31:0/963676116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bac0d29b0 0x7f4bac0b60c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400eb20 tx=0x7f4ba400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4ba9600640 1 -- 172.21.15.31:0/963676116 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4004b30 con 0x7f4bac0d29b0 2024-09-17T05:33:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4ba9600640 1 -- 172.21.15.31:0/963676116 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ba4004cf0 con 0x7f4bac0d29b0 2024-09-17T05:33:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4ba9600640 1 -- 172.21.15.31:0/963676116 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4005280 con 0x7f4bac0d29b0 2024-09-17T05:33:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb3400640 1 -- 172.21.15.31:0/963676116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bac0cd5f0 con 0x7f4bac0d29b0 2024-09-17T05:33:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb3400640 1 -- 172.21.15.31:0/963676116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bac0cdbb0 con 0x7f4bac0d29b0 2024-09-17T05:33:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.126+0000 7f4bb3400640 1 -- 172.21.15.31:0/963676116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bac0af200 con 0x7f4bac0d29b0 2024-09-17T05:33:14.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.130+0000 7f4ba9600640 1 -- 172.21.15.31:0/963676116 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f4ba4005420 con 0x7f4bac0d29b0 2024-09-17T05:33:14.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.130+0000 7f4ba9600640 1 --2- 172.21.15.31:0/963676116 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4b88073320 0x7f4b880757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:14.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.130+0000 7f4ba9600640 1 -- 172.21.15.31:0/963676116 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f4ba4095560 con 0x7f4bac0d29b0 2024-09-17T05:33:14.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.130+0000 7f4bb0a00640 1 --2- 172.21.15.31:0/963676116 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4b88073320 0x7f4b880757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:14.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.130+0000 7f4bb0a00640 1 --2- 172.21.15.31:0/963676116 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4b88073320 0x7f4b880757e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0b2000 tx=0x7f4b9c0aa040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:14.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.134+0000 7f4ba9600640 1 -- 172.21.15.31:0/963676116 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4ba405fd80 con 0x7f4bac0d29b0 2024-09-17T05:33:14.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:14.334+0000 7f4bb3400640 1 -- 172.21.15.31:0/963676116 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "testvol", "target": ["mon-mgr", ""]}) -- 0x7f4bac072710 con 0x7f4b88073320 2024-09-17T05:33:16.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:16.870+0000 7f4ba9600640 1 -- 172.21.15.31:0/963676116 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) ==== 60+0+0 (secure 0 0 0) 0x7f4bac072710 con 0x7f4b88073320 2024-09-17T05:33:16.871 INFO:teuthology.orchestra.run.smithi031.stderr:Volume created successfully (no MDS daemons created) 2024-09-17T05:33:16.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:16.870+0000 7f4bb3400640 1 -- 172.21.15.31:0/963676116 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4b88073320 msgr2=0x7f4b880757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:16.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:16.870+0000 7f4bb3400640 1 --2- 172.21.15.31:0/963676116 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4b88073320 0x7f4b880757e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0b2000 tx=0x7f4b9c0aa040 comp rx=0 tx=0).stop 2024-09-17T05:33:16.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:16.870+0000 7f4bb3400640 1 -- 172.21.15.31:0/963676116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bac0d29b0 msgr2=0x7f4bac0b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:16.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:16.870+0000 7f4bb3400640 1 --2- 172.21.15.31:0/963676116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bac0d29b0 0x7f4bac0b60c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400eb20 tx=0x7f4ba400c2d0 comp rx=0 tx=0).stop 2024-09-17T05:33:16.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:16.870+0000 7f4bb3400640 1 -- 172.21.15.31:0/963676116 shutdown_connections 2024-09-17T05:33:16.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:16.870+0000 7f4bb3400640 1 --2- 172.21.15.31:0/963676116 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4b88073320 0x7f4b880757e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:16.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:16.870+0000 7f4bb3400640 1 --2- 172.21.15.31:0/963676116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bac0d29b0 0x7f4bac0b60c0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:16.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:16.870+0000 7f4bb3400640 1 --2- 172.21.15.31:0/963676116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bac0d04d0 0x7f4bac14ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:16.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:16.870+0000 7f4bb3400640 1 --2- 172.21.15.31:0/963676116 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bac0d00f0 0x7f4bac14ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:16.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:16.870+0000 7f4bb3400640 1 -- 172.21.15.31:0/963676116 >> 172.21.15.31:0/963676116 conn(0x7f4bac0d1e90 msgr2=0x7f4bac1e63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:16.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:16.870+0000 7f4bb3400640 1 -- 172.21.15.31:0/963676116 shutdown_connections 2024-09-17T05:33:16.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:16.870+0000 7f4bb3400640 1 -- 172.21.15.31:0/963676116 wait complete. 2024-09-17T05:33:16.908 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create testvol 'abcd@#' 2024-09-17T05:33:17.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.058+0000 7f2653600640 1 -- 172.21.15.31:0/3024987142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f264c073070 msgr2=0x7f264c0734e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:17.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.058+0000 7f2653600640 1 --2- 172.21.15.31:0/3024987142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f264c073070 0x7f264c0734e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f264c0ce280 tx=0x7f263801c810 comp rx=0 tx=0).stop 2024-09-17T05:33:17.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.058+0000 7f2653600640 1 -- 172.21.15.31:0/3024987142 shutdown_connections 2024-09-17T05:33:17.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.058+0000 7f2653600640 1 --2- 172.21.15.31:0/3024987142 >> v2:172.21.15.155:3300/0 conn(0x7f264c15e8d0 0x7f264c15ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:17.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.058+0000 7f2653600640 1 --2- 172.21.15.31:0/3024987142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f264c073070 0x7f264c0734e0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:17.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.058+0000 7f2653600640 1 -- 172.21.15.31:0/3024987142 >> 172.21.15.31:0/3024987142 conn(0x7f264c0b2060 msgr2=0x7f264c0b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:17.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.058+0000 7f2653600640 1 -- 172.21.15.31:0/3024987142 shutdown_connections 2024-09-17T05:33:17.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.058+0000 7f2653600640 1 -- 172.21.15.31:0/3024987142 wait complete. 2024-09-17T05:33:17.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f2653600640 1 Processor -- start 2024-09-17T05:33:17.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f2653600640 1 -- start start 2024-09-17T05:33:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f2653600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f264c073070 0x7f264c14cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f2653600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f264c0cc570 0x7f264c15b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f2653600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f264c15e8d0 0x7f264c15b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f2653600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f264c0cfeb0 con 0x7f264c0cc570 2024-09-17T05:33:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f2653600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f264c0cfd30 con 0x7f264c15e8d0 2024-09-17T05:33:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f2653600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f264c168480 con 0x7f264c073070 2024-09-17T05:33:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f264be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f264c0cc570 0x7f264c15b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f264be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f264c0cc570 0x7f264c15b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57228/0 (socket says 172.21.15.31:57228) 2024-09-17T05:33:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f2650c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f264c073070 0x7f264c14cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f264be00640 1 -- 172.21.15.31:0/4273994189 learned_addr learned my addr 172.21.15.31:0/4273994189 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:17.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f2651600640 1 --2- 172.21.15.31:0/4273994189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f264c15e8d0 0x7f264c15b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:17.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f264be00640 1 -- 172.21.15.31:0/4273994189 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f264c073070 msgr2=0x7f264c14cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:17.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f264be00640 1 --2- 172.21.15.31:0/4273994189 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f264c073070 0x7f264c14cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:17.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f264be00640 1 -- 172.21.15.31:0/4273994189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f264c15e8d0 msgr2=0x7f264c15b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:17.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f264be00640 1 --2- 172.21.15.31:0/4273994189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f264c15e8d0 0x7f264c15b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:17.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f264be00640 1 -- 172.21.15.31:0/4273994189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f264c0c6020 con 0x7f264c0cc570 2024-09-17T05:33:17.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f264be00640 1 --2- 172.21.15.31:0/4273994189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f264c0cc570 0x7f264c15b3f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2638019420 tx=0x7f26380a66e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:17.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f2648c00640 1 -- 172.21.15.31:0/4273994189 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638004180 con 0x7f264c0cc570 2024-09-17T05:33:17.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f2648c00640 1 -- 172.21.15.31:0/4273994189 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2638004430 con 0x7f264c0cc570 2024-09-17T05:33:17.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f2648c00640 1 -- 172.21.15.31:0/4273994189 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2638005030 con 0x7f264c0cc570 2024-09-17T05:33:17.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f2653600640 1 -- 172.21.15.31:0/4273994189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f264c0c6300 con 0x7f264c0cc570 2024-09-17T05:33:17.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.062+0000 7f2653600640 1 -- 172.21.15.31:0/4273994189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f264c0c68c0 con 0x7f264c0cc570 2024-09-17T05:33:17.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.066+0000 7f2653600640 1 -- 172.21.15.31:0/4273994189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f264c0734e0 con 0x7f264c0cc570 2024-09-17T05:33:17.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.066+0000 7f2648c00640 1 -- 172.21.15.31:0/4273994189 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f26380bf030 con 0x7f264c0cc570 2024-09-17T05:33:17.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.066+0000 7f2648c00640 1 --2- 172.21.15.31:0/4273994189 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f262c073320 0x7f262c0757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:17.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.066+0000 7f2648c00640 1 -- 172.21.15.31:0/4273994189 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6543+0+0 (secure 0 0 0) 0x7f263812e570 con 0x7f264c0cc570 2024-09-17T05:33:17.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.066+0000 7f2650c00640 1 --2- 172.21.15.31:0/4273994189 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f262c073320 0x7f262c0757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:17.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.066+0000 7f2650c00640 1 --2- 172.21.15.31:0/4273994189 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f262c073320 0x7f262c0757e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2640007fd0 tx=0x7f2640009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:17.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.070+0000 7f2648c00640 1 -- 172.21.15.31:0/4273994189 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f26380c6060 con 0x7f264c0cc570 2024-09-17T05:33:17.270 INFO:teuthology.orchestra.run.smithi031.stderr:Invalid command: invalid chars #@ in abcd@# 2024-09-17T05:33:17.270 INFO:teuthology.orchestra.run.smithi031.stderr:fs subvolumegroup create [] [] [] [] [] : Create a CephFS subvolume group in a volume, and optionally, with a specific data pool layout, and a specific numeric mode 2024-09-17T05:33:17.270 INFO:teuthology.orchestra.run.smithi031.stderr:Error EINVAL: invalid command 2024-09-17T05:33:17.277 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T05:33:17.277 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create testvol 'abcd@#' 2024-09-17T05:33:17.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.426+0000 7f96eca00640 1 -- 172.21.15.31:0/4064260562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96e815bd50 msgr2=0x7f96e80ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:17.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.426+0000 7f96eca00640 1 --2- 172.21.15.31:0/4064260562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96e815bd50 0x7f96e80ce5e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f96e80d0f60 tx=0x7f96d801c7a0 comp rx=0 tx=0).stop 2024-09-17T05:33:17.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.426+0000 7f96eca00640 1 -- 172.21.15.31:0/4064260562 shutdown_connections 2024-09-17T05:33:17.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.426+0000 7f96eca00640 1 --2- 172.21.15.31:0/4064260562 >> v2:172.21.15.155:3300/0 conn(0x7f96e80cf4e0 0x7f96e80cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:17.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.426+0000 7f96eca00640 1 --2- 172.21.15.31:0/4064260562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96e815bd50 0x7f96e80ce5e0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:17.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.426+0000 7f96eca00640 1 -- 172.21.15.31:0/4064260562 >> 172.21.15.31:0/4064260562 conn(0x7f96e80d1ea0 msgr2=0x7f96e80d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:17.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.426+0000 7f96eca00640 1 -- 172.21.15.31:0/4064260562 shutdown_connections 2024-09-17T05:33:17.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.426+0000 7f96eca00640 1 -- 172.21.15.31:0/4064260562 wait complete. 2024-09-17T05:33:17.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.426+0000 7f96eca00640 1 Processor -- start 2024-09-17T05:33:17.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.426+0000 7f96eca00640 1 -- start start 2024-09-17T05:33:17.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96eca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96e80cf4e0 0x7f96e80b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:17.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96eca00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96e815bd50 0x7f96e8153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:17.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96eca00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96e815c130 0x7f96e8154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:17.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96eca00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f96e8168e50 con 0x7f96e80cf4e0 2024-09-17T05:33:17.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96eca00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f96e8168cd0 con 0x7f96e815bd50 2024-09-17T05:33:17.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96eca00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f96e8168fd0 con 0x7f96e815c130 2024-09-17T05:33:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96e5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96e80cf4e0 0x7f96e80b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96e5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96e80cf4e0 0x7f96e80b64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57240/0 (socket says 172.21.15.31:57240) 2024-09-17T05:33:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96e5e00640 1 -- 172.21.15.31:0/2459597994 learned_addr learned my addr 172.21.15.31:0/2459597994 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96e5e00640 1 -- 172.21.15.31:0/2459597994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96e815c130 msgr2=0x7f96e8154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96e5e00640 1 --2- 172.21.15.31:0/2459597994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96e815c130 0x7f96e8154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96e5e00640 1 -- 172.21.15.31:0/2459597994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96e815bd50 msgr2=0x7f96e8153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96e5e00640 1 --2- 172.21.15.31:0/2459597994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96e815bd50 0x7f96e8153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96e5e00640 1 -- 172.21.15.31:0/2459597994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e81546b0 con 0x7f96e80cf4e0 2024-09-17T05:33:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96e5e00640 1 --2- 172.21.15.31:0/2459597994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96e80cf4e0 0x7f96e80b64b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f96d80b0040 tx=0x7f96d80a55f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96de000640 1 -- 172.21.15.31:0/2459597994 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d80b2040 con 0x7f96e80cf4e0 2024-09-17T05:33:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96de000640 1 -- 172.21.15.31:0/2459597994 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96d8004490 con 0x7f96e80cf4e0 2024-09-17T05:33:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96de000640 1 -- 172.21.15.31:0/2459597994 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d8005280 con 0x7f96e80cf4e0 2024-09-17T05:33:17.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96eca00640 1 -- 172.21.15.31:0/2459597994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e80b6b70 con 0x7f96e80cf4e0 2024-09-17T05:33:17.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96eca00640 1 -- 172.21.15.31:0/2459597994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e8152e40 con 0x7f96e80cf4e0 2024-09-17T05:33:17.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96eca00640 1 -- 172.21.15.31:0/2459597994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e80ce5e0 con 0x7f96e80cf4e0 2024-09-17T05:33:17.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.430+0000 7f96de000640 1 -- 172.21.15.31:0/2459597994 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f96d8005420 con 0x7f96e80cf4e0 2024-09-17T05:33:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.434+0000 7f96de000640 1 --2- 172.21.15.31:0/2459597994 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f96c4073320 0x7f96c40757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.434+0000 7f96de000640 1 -- 172.21.15.31:0/2459597994 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6543+0+0 (secure 0 0 0) 0x7f96d812e310 con 0x7f96e80cf4e0 2024-09-17T05:33:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.434+0000 7f96dfe00640 1 --2- 172.21.15.31:0/2459597994 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f96c4073320 0x7f96c40757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.434+0000 7f96dfe00640 1 --2- 172.21.15.31:0/2459597994 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f96c4073320 0x7f96c40757e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96d0000f70 tx=0x7f96d00079c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:17.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.438+0000 7f96de000640 1 -- 172.21.15.31:0/2459597994 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f96d80164b0 con 0x7f96e80cf4e0 2024-09-17T05:33:17.641 INFO:teuthology.orchestra.run.smithi031.stderr:Invalid command: invalid chars #@ in abcd@# 2024-09-17T05:33:17.641 INFO:teuthology.orchestra.run.smithi031.stderr:fs subvolume create [] [] [] [] [] [] [--namespace-isolated] [] : Create a CephFS subvolume in a volume, and optionally, with a specific size (in bytes), a specific data pool layout, a specific mode, in a specific subvolume group and in separate RADOS namespace 2024-09-17T05:33:17.641 INFO:teuthology.orchestra.run.smithi031.stderr:Error EINVAL: invalid command 2024-09-17T05:33:17.649 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T05:33:17.650 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm testvol --yes-i-really-mean-it 2024-09-17T05:33:17.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.798+0000 7f8f0be00640 1 -- 172.21.15.31:0/770714393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f040cd100 msgr2=0x7f8f040b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:17.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.798+0000 7f8f0be00640 1 --2- 172.21.15.31:0/770714393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f040cd100 0x7f8f040b42d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f8f0406aab0 tx=0x7f8ef001dad0 comp rx=0 tx=0).stop 2024-09-17T05:33:17.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.798+0000 7f8f0be00640 1 -- 172.21.15.31:0/770714393 shutdown_connections 2024-09-17T05:33:17.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.798+0000 7f8f0be00640 1 --2- 172.21.15.31:0/770714393 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f040cd100 0x7f8f040b42d0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:17.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.798+0000 7f8f0be00640 1 --2- 172.21.15.31:0/770714393 >> v2:172.21.15.155:3300/0 conn(0x7f8f0415dae0 0x7f8f040acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:17.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.798+0000 7f8f0be00640 1 -- 172.21.15.31:0/770714393 >> 172.21.15.31:0/770714393 conn(0x7f8f040b18f0 msgr2=0x7f8f040b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:17.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.798+0000 7f8f0be00640 1 -- 172.21.15.31:0/770714393 shutdown_connections 2024-09-17T05:33:17.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.798+0000 7f8f0be00640 1 -- 172.21.15.31:0/770714393 wait complete. 2024-09-17T05:33:17.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.798+0000 7f8f0be00640 1 Processor -- start 2024-09-17T05:33:17.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.798+0000 7f8f0be00640 1 -- start start 2024-09-17T05:33:17.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.798+0000 7f8f0be00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f040b4810 0x7f8f040c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:17.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.798+0000 7f8f0be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f040cd100 0x7f8f0415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:17.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f0be00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f0415dae0 0x7f8f0415a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:17.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f0be00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8f041674b0 con 0x7f8f040cd100 2024-09-17T05:33:17.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f0be00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8f04167330 con 0x7f8f040b4810 2024-09-17T05:33:17.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f0be00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8f04167630 con 0x7f8f0415dae0 2024-09-17T05:33:17.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f08a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f040cd100 0x7f8f0415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:17.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f08a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f040cd100 0x7f8f0415a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57256/0 (socket says 172.21.15.31:57256) 2024-09-17T05:33:17.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f08a00640 1 -- 172.21.15.31:0/1571751488 learned_addr learned my addr 172.21.15.31:0/1571751488 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:17.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f09400640 1 --2- 172.21.15.31:0/1571751488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f040b4810 0x7f8f040c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:17.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f09e00640 1 --2- 172.21.15.31:0/1571751488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f0415dae0 0x7f8f0415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:17.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f08a00640 1 -- 172.21.15.31:0/1571751488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f0415dae0 msgr2=0x7f8f0415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:17.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f08a00640 1 --2- 172.21.15.31:0/1571751488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f0415dae0 0x7f8f0415a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:17.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f08a00640 1 -- 172.21.15.31:0/1571751488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f040b4810 msgr2=0x7f8f040c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:17.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f08a00640 1 --2- 172.21.15.31:0/1571751488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f040b4810 0x7f8f040c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:17.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f08a00640 1 -- 172.21.15.31:0/1571751488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0409c310 con 0x7f8f040cd100 2024-09-17T05:33:17.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f09e00640 1 --2- 172.21.15.31:0/1571751488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f0415dae0 0x7f8f0415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:17.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f08a00640 1 --2- 172.21.15.31:0/1571751488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f040cd100 0x7f8f0415a3e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00b1040 tx=0x7f8ef0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:17.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f01600640 1 -- 172.21.15.31:0/1571751488 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef00b3070 con 0x7f8f040cd100 2024-09-17T05:33:17.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f01600640 1 -- 172.21.15.31:0/1571751488 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ef0005330 con 0x7f8f040cd100 2024-09-17T05:33:17.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f01600640 1 -- 172.21.15.31:0/1571751488 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef00046d0 con 0x7f8f040cd100 2024-09-17T05:33:17.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f0be00640 1 -- 172.21.15.31:0/1571751488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f0409c5f0 con 0x7f8f040cd100 2024-09-17T05:33:17.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f0be00640 1 -- 172.21.15.31:0/1571751488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f0409cbb0 con 0x7f8f040cd100 2024-09-17T05:33:17.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f0be00640 1 -- 172.21.15.31:0/1571751488 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f04069410 con 0x7f8f040cd100 2024-09-17T05:33:17.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.802+0000 7f8f01600640 1 -- 172.21.15.31:0/1571751488 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f8ef0004870 con 0x7f8f040cd100 2024-09-17T05:33:17.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.806+0000 7f8f01600640 1 --2- 172.21.15.31:0/1571751488 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8ee4073320 0x7f8ee40757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:17.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.806+0000 7f8f01600640 1 -- 172.21.15.31:0/1571751488 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6543+0+0 (secure 0 0 0) 0x7f8ef012e6d0 con 0x7f8f040cd100 2024-09-17T05:33:17.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.806+0000 7f8f09400640 1 --2- 172.21.15.31:0/1571751488 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8ee4073320 0x7f8ee40757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:17.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.806+0000 7f8f09400640 1 --2- 172.21.15.31:0/1571751488 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8ee4073320 0x7f8ee40757e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f04148f70 tx=0x7f8ef80091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:17.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:17.810+0000 7f8f01600640 1 -- 172.21.15.31:0/1571751488 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8ef00177e0 con 0x7f8f040cd100 2024-09-17T05:33:18.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:18.018+0000 7f8f0be00640 1 -- 172.21.15.31:0/1571751488 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "testvol", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) -- 0x7f8f040b42d0 con 0x7f8ee4073320 2024-09-17T05:33:18.023 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-09-17T05:33:18.022+0000 7f21d0200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:33:18.080 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-17T05:33:21.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.046+0000 7f8f01600640 1 -- 172.21.15.31:0/1571751488 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+78 (secure 0 0 0) 0x7f8f040b42d0 con 0x7f8ee4073320 2024-09-17T05:33:21.050 INFO:teuthology.orchestra.run.smithi031.stdout:metadata pool: cephfs.testvol.meta data pool: ['cephfs.testvol.data'] removed 2024-09-17T05:33:21.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.050+0000 7f8f0be00640 1 -- 172.21.15.31:0/1571751488 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8ee4073320 msgr2=0x7f8ee40757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:21.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.050+0000 7f8f0be00640 1 --2- 172.21.15.31:0/1571751488 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8ee4073320 0x7f8ee40757e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f04148f70 tx=0x7f8ef80091e0 comp rx=0 tx=0).stop 2024-09-17T05:33:21.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.050+0000 7f8f0be00640 1 -- 172.21.15.31:0/1571751488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f040cd100 msgr2=0x7f8f0415a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:21.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.050+0000 7f8f0be00640 1 --2- 172.21.15.31:0/1571751488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f040cd100 0x7f8f0415a3e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00b1040 tx=0x7f8ef0004040 comp rx=0 tx=0).stop 2024-09-17T05:33:21.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.050+0000 7f8f0be00640 1 -- 172.21.15.31:0/1571751488 shutdown_connections 2024-09-17T05:33:21.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.050+0000 7f8f0be00640 1 --2- 172.21.15.31:0/1571751488 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8ee4073320 0x7f8ee40757e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:21.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.050+0000 7f8f0be00640 1 --2- 172.21.15.31:0/1571751488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f0415dae0 0x7f8f0415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:21.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.050+0000 7f8f0be00640 1 --2- 172.21.15.31:0/1571751488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f040cd100 0x7f8f0415a3e0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:21.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.050+0000 7f8f0be00640 1 --2- 172.21.15.31:0/1571751488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f040b4810 0x7f8f040c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:21.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.050+0000 7f8f0be00640 1 -- 172.21.15.31:0/1571751488 >> 172.21.15.31:0/1571751488 conn(0x7f8f040b18f0 msgr2=0x7f8f0406fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:21.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.050+0000 7f8f0be00640 1 -- 172.21.15.31:0/1571751488 shutdown_connections 2024-09-17T05:33:21.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.050+0000 7f8f0be00640 1 -- 172.21.15.31:0/1571751488 wait complete. 2024-09-17T05:33:21.077 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:33:21.078 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:33:21.196 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:33:21.284 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:33:21.284 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:33:21.285 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:33:21.285 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:21.294 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:33:21.294 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:21.346 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:33:21.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.546+0000 7fc447200640 1 -- 172.21.15.31:0/595969911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc424003a40 msgr2=0x7fc424003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:21.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.546+0000 7fc447200640 1 --2- 172.21.15.31:0/595969911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc424003a40 0x7fc424003e60 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc430005fd0 tx=0x7fc43001ca40 comp rx=0 tx=0).stop 2024-09-17T05:33:21.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.546+0000 7fc445200640 1 -- 172.21.15.31:0/595969911 reap_dead start 2024-09-17T05:33:21.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.546+0000 7fc447200640 1 -- 172.21.15.31:0/595969911 shutdown_connections 2024-09-17T05:33:21.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.546+0000 7fc447200640 1 -- 172.21.15.31:0/595969911 >> 172.21.15.31:0/595969911 conn(0x7fc4400d1ea0 msgr2=0x7fc4400d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:21.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.546+0000 7fc447200640 1 -- 172.21.15.31:0/595969911 shutdown_connections 2024-09-17T05:33:21.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.546+0000 7fc447200640 1 -- 172.21.15.31:0/595969911 wait complete. 2024-09-17T05:33:21.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc447200640 1 Processor -- start 2024-09-17T05:33:21.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc447200640 1 -- start start 2024-09-17T05:33:21.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc447200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc424003a40 0x7fc4400b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:21.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc447200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4400b1d00 0x7fc4400b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:21.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc447200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4400caf80 0x7fc4400cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:21.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc447200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc440168c70 con 0x7fc4400caf80 2024-09-17T05:33:21.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc447200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc440168af0 con 0x7fc4400b1d00 2024-09-17T05:33:21.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc447200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc440168df0 con 0x7fc424003a40 2024-09-17T05:33:21.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc445200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4400caf80 0x7fc4400cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:21.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc445200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4400caf80 0x7fc4400cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58016/0 (socket says 172.21.15.31:58016) 2024-09-17T05:33:21.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc445200640 1 -- 172.21.15.31:0/88531664 learned_addr learned my addr 172.21.15.31:0/88531664 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:21.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc43fe00640 1 --2- 172.21.15.31:0/88531664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc424003a40 0x7fc4400b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:21.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc43f400640 1 --2- 172.21.15.31:0/88531664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4400b1d00 0x7fc4400b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:21.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc445200640 1 -- 172.21.15.31:0/88531664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc424003a40 msgr2=0x7fc4400b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:21.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc445200640 1 --2- 172.21.15.31:0/88531664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc424003a40 0x7fc4400b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:21.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc445200640 1 -- 172.21.15.31:0/88531664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4400b1d00 msgr2=0x7fc4400b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:21.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc445200640 1 --2- 172.21.15.31:0/88531664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4400b1d00 0x7fc4400b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:21.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc445200640 1 -- 172.21.15.31:0/88531664 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4400b2810 con 0x7fc4400caf80 2024-09-17T05:33:21.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc43f400640 1 --2- 172.21.15.31:0/88531664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4400b1d00 0x7fc4400b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:21.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc445200640 1 --2- 172.21.15.31:0/88531664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4400caf80 0x7fc4400cb430 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc4400d1470 tx=0x7fc43800eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:21.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc437e00640 1 -- 172.21.15.31:0/88531664 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43800c970 con 0x7fc4400caf80 2024-09-17T05:33:21.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc437e00640 1 -- 172.21.15.31:0/88531664 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc438017070 con 0x7fc4400caf80 2024-09-17T05:33:21.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc437e00640 1 -- 172.21.15.31:0/88531664 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43800cea0 con 0x7fc4400caf80 2024-09-17T05:33:21.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc447200640 1 -- 172.21.15.31:0/88531664 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44014aca0 con 0x7fc4400caf80 2024-09-17T05:33:21.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.550+0000 7fc447200640 1 -- 172.21.15.31:0/88531664 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4400b07e0 con 0x7fc4400caf80 2024-09-17T05:33:21.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.554+0000 7fc447200640 1 -- 172.21.15.31:0/88531664 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4400c5dd0 con 0x7fc4400caf80 2024-09-17T05:33:21.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.554+0000 7fc437e00640 1 -- 172.21.15.31:0/88531664 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fc43801c460 con 0x7fc4400caf80 2024-09-17T05:33:21.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.554+0000 7fc437e00640 1 --2- 172.21.15.31:0/88531664 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc420073350 0x7fc420075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:21.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.554+0000 7fc437e00640 1 -- 172.21.15.31:0/88531664 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5795+0+0 (secure 0 0 0) 0x7fc4380948d0 con 0x7fc4400caf80 2024-09-17T05:33:21.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.554+0000 7fc43fe00640 1 --2- 172.21.15.31:0/88531664 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc420073350 0x7fc420075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:21.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.554+0000 7fc43fe00640 1 --2- 172.21.15.31:0/88531664 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc420073350 0x7fc420075810 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc4300af000 tx=0x7fc430019b00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:21.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.558+0000 7fc437e00640 1 -- 172.21.15.31:0/88531664 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc43805f660 con 0x7fc4400caf80 2024-09-17T05:33:21.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.746+0000 7fc447200640 1 -- 172.21.15.31:0/88531664 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc4400c7e20 con 0x7fc4400caf80 2024-09-17T05:33:21.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.746+0000 7fc437e00640 1 -- 172.21.15.31:0/88531664 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v89) ==== 80+0+124 (secure 0 0 0) 0x7fc43805ef60 con 0x7fc4400caf80 2024-09-17T05:33:21.749 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.155:6835/2426776304 2024-09-18T05:33:18.024058+0000 2024-09-17T05:33:21.749 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.155:6834/2426776304 2024-09-18T05:33:18.024058+0000 2024-09-17T05:33:21.749 INFO:teuthology.orchestra.run.smithi031.stderr:listed 2 entries 2024-09-17T05:33:21.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.750+0000 7fc447200640 1 -- 172.21.15.31:0/88531664 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc420073350 msgr2=0x7fc420075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.750+0000 7fc447200640 1 --2- 172.21.15.31:0/88531664 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc420073350 0x7fc420075810 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc4300af000 tx=0x7fc430019b00 comp rx=0 tx=0).stop 2024-09-17T05:33:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.750+0000 7fc447200640 1 -- 172.21.15.31:0/88531664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4400caf80 msgr2=0x7fc4400cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.750+0000 7fc447200640 1 --2- 172.21.15.31:0/88531664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4400caf80 0x7fc4400cb430 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc4400d1470 tx=0x7fc43800eae0 comp rx=0 tx=0).stop 2024-09-17T05:33:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.750+0000 7fc447200640 1 -- 172.21.15.31:0/88531664 shutdown_connections 2024-09-17T05:33:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.750+0000 7fc447200640 1 --2- 172.21.15.31:0/88531664 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc420073350 0x7fc420075810 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.750+0000 7fc447200640 1 --2- 172.21.15.31:0/88531664 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4400caf80 0x7fc4400cb430 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.750+0000 7fc447200640 1 --2- 172.21.15.31:0/88531664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4400b1d00 0x7fc4400b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.750+0000 7fc447200640 1 --2- 172.21.15.31:0/88531664 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc424003a40 0x7fc4400b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.750+0000 7fc447200640 1 -- 172.21.15.31:0/88531664 >> 172.21.15.31:0/88531664 conn(0x7fc4400d1ea0 msgr2=0x7fc4400d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.750+0000 7fc447200640 1 -- 172.21.15.31:0/88531664 shutdown_connections 2024-09-17T05:33:21.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:21.750+0000 7fc447200640 1 -- 172.21.15.31:0/88531664 wait complete. 2024-09-17T05:33:21.771 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:33:21.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:21.771 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:33:21.800 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:33:21.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:21.800 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:33:21.854 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:33:21.855 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:33:21.855 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:21.864 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:33:21.864 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:21.915 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:33:22.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.062+0000 7f0533200640 1 -- 172.21.15.31:0/3563638186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0518003a60 msgr2=0x7f0518003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:22.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.062+0000 7f0533200640 1 --2- 172.21.15.31:0/3563638186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0518003a60 0x7f0518003e80 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0524009b60 tx=0x7f052401d270 comp rx=0 tx=0).stop 2024-09-17T05:33:22.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.062+0000 7f0532800640 1 -- 172.21.15.31:0/3563638186 reap_dead start 2024-09-17T05:33:22.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.062+0000 7f0533200640 1 -- 172.21.15.31:0/3563638186 shutdown_connections 2024-09-17T05:33:22.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.062+0000 7f0533200640 1 -- 172.21.15.31:0/3563638186 >> 172.21.15.31:0/3563638186 conn(0x7f053406dd30 msgr2=0x7f053406e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:22.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0533200640 1 -- 172.21.15.31:0/3563638186 shutdown_connections 2024-09-17T05:33:22.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0533200640 1 -- 172.21.15.31:0/3563638186 wait complete. 2024-09-17T05:33:22.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0533200640 1 Processor -- start 2024-09-17T05:33:22.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0533200640 1 -- start start 2024-09-17T05:33:22.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0533200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0518003a60 0x7f05340c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:22.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0533200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05341f9020 0x7f05340c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:22.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0533200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0534162a60 0x7f053406d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:22.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0533200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0534165ce0 con 0x7f0534162a60 2024-09-17T05:33:22.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0533200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0534165b60 con 0x7f05341f9020 2024-09-17T05:33:22.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0533200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0534165e60 con 0x7f0518003a60 2024-09-17T05:33:22.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0532800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0534162a60 0x7f053406d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:22.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0531e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0518003a60 0x7f05340c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:22.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0532800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0534162a60 0x7f053406d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58036/0 (socket says 172.21.15.31:58036) 2024-09-17T05:33:22.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0531e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0518003a60 0x7f05340c4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:48602/0 (socket says 172.21.15.31:48602) 2024-09-17T05:33:22.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0532800640 1 -- 172.21.15.31:0/3118656897 learned_addr learned my addr 172.21.15.31:0/3118656897 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:22.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0529400640 1 --2- 172.21.15.31:0/3118656897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05341f9020 0x7f05340c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:22.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0532800640 1 -- 172.21.15.31:0/3118656897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0518003a60 msgr2=0x7f05340c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:22.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0532800640 1 --2- 172.21.15.31:0/3118656897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0518003a60 0x7f05340c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:22.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0532800640 1 -- 172.21.15.31:0/3118656897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05341f9020 msgr2=0x7f05340c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:22.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0532800640 1 --2- 172.21.15.31:0/3118656897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05341f9020 0x7f05340c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:22.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0532800640 1 -- 172.21.15.31:0/3118656897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05340c8f60 con 0x7f0534162a60 2024-09-17T05:33:22.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.066+0000 7f0532800640 1 --2- 172.21.15.31:0/3118656897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0534162a60 0x7f053406d130 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f052c002240 tx=0x7f052c0064e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:22.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.070+0000 7f052aa00640 1 -- 172.21.15.31:0/3118656897 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c010890 con 0x7f0534162a60 2024-09-17T05:33:22.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.070+0000 7f052aa00640 1 -- 172.21.15.31:0/3118656897 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f052c016070 con 0x7f0534162a60 2024-09-17T05:33:22.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.070+0000 7f052aa00640 1 -- 172.21.15.31:0/3118656897 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c010dc0 con 0x7f0534162a60 2024-09-17T05:33:22.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.070+0000 7f0533200640 1 -- 172.21.15.31:0/3118656897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05340c89a0 con 0x7f0534162a60 2024-09-17T05:33:22.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.070+0000 7f0533200640 1 -- 172.21.15.31:0/3118656897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05341632a0 con 0x7f0534162a60 2024-09-17T05:33:22.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.070+0000 7f0533200640 1 -- 172.21.15.31:0/3118656897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05340cb360 con 0x7f0534162a60 2024-09-17T05:33:22.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.070+0000 7f052aa00640 1 -- 172.21.15.31:0/3118656897 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f052c01b460 con 0x7f0534162a60 2024-09-17T05:33:22.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.070+0000 7f052aa00640 1 --2- 172.21.15.31:0/3118656897 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0510073350 0x7f0510075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:22.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.070+0000 7f052aa00640 1 -- 172.21.15.31:0/3118656897 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5795+0+0 (secure 0 0 0) 0x7f052c094c90 con 0x7f0534162a60 2024-09-17T05:33:22.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.070+0000 7f0531e00640 1 --2- 172.21.15.31:0/3118656897 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0510073350 0x7f0510075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:22.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.074+0000 7f0531e00640 1 --2- 172.21.15.31:0/3118656897 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0510073350 0x7f0510075810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f05240ae000 tx=0x7f052401a010 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:22.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.074+0000 7f052aa00640 1 -- 172.21.15.31:0/3118656897 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f05340cbd30 con 0x7f0534162a60 2024-09-17T05:33:22.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.266+0000 7f0533200640 1 -- 172.21.15.31:0/3118656897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f05340c4410 con 0x7f0534162a60 2024-09-17T05:33:22.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.266+0000 7f052aa00640 1 -- 172.21.15.31:0/3118656897 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v89) ==== 80+0+124 (secure 0 0 0) 0x7f052c05f460 con 0x7f0534162a60 2024-09-17T05:33:22.269 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.155:6835/2426776304 2024-09-18T05:33:18.024058+0000 2024-09-17T05:33:22.270 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.155:6834/2426776304 2024-09-18T05:33:18.024058+0000 2024-09-17T05:33:22.270 INFO:teuthology.orchestra.run.smithi031.stderr:listed 2 entries 2024-09-17T05:33:22.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.270+0000 7f0533200640 1 -- 172.21.15.31:0/3118656897 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0510073350 msgr2=0x7f0510075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:22.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.270+0000 7f0533200640 1 --2- 172.21.15.31:0/3118656897 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0510073350 0x7f0510075810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f05240ae000 tx=0x7f052401a010 comp rx=0 tx=0).stop 2024-09-17T05:33:22.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.270+0000 7f0533200640 1 -- 172.21.15.31:0/3118656897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0534162a60 msgr2=0x7f053406d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:22.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.270+0000 7f0533200640 1 --2- 172.21.15.31:0/3118656897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0534162a60 0x7f053406d130 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f052c002240 tx=0x7f052c0064e0 comp rx=0 tx=0).stop 2024-09-17T05:33:22.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.270+0000 7f0533200640 1 -- 172.21.15.31:0/3118656897 shutdown_connections 2024-09-17T05:33:22.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.270+0000 7f0533200640 1 --2- 172.21.15.31:0/3118656897 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0510073350 0x7f0510075810 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:22.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.270+0000 7f0533200640 1 --2- 172.21.15.31:0/3118656897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0534162a60 0x7f053406d130 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:22.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.270+0000 7f0533200640 1 --2- 172.21.15.31:0/3118656897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05341f9020 0x7f05340c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:22.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.270+0000 7f0533200640 1 --2- 172.21.15.31:0/3118656897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0518003a60 0x7f05340c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:22.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.270+0000 7f0533200640 1 -- 172.21.15.31:0/3118656897 >> 172.21.15.31:0/3118656897 conn(0x7f053406dd30 msgr2=0x7f053406e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:22.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.270+0000 7f0533200640 1 -- 172.21.15.31:0/3118656897 shutdown_connections 2024-09-17T05:33:22.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.270+0000 7f0533200640 1 -- 172.21.15.31:0/3118656897 wait complete. 2024-09-17T05:33:22.290 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T05:33:22.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:22.291 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T05:33:22.320 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:33:22.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:22.321 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:33:22.370 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:33:22.371 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:33:22.371 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:22.381 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:33:22.381 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:33:22.382 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:33:22.382 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:22.426 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:33:22.426 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:33:22.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.570+0000 7f0ea6800640 1 -- 172.21.15.31:0/1875004450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e84004da0 msgr2=0x7f0e84005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:22.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.570+0000 7f0ea6800640 1 --2- 172.21.15.31:0/1875004450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e84004da0 0x7f0e84005220 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f0e98006fd0 tx=0x7f0e9801ca70 comp rx=0 tx=0).stop 2024-09-17T05:33:22.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.570+0000 7f0e9fe00640 1 -- 172.21.15.31:0/1875004450 reap_dead start 2024-09-17T05:33:22.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.570+0000 7f0ea6800640 1 -- 172.21.15.31:0/1875004450 shutdown_connections 2024-09-17T05:33:22.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.570+0000 7f0ea6800640 1 -- 172.21.15.31:0/1875004450 >> 172.21.15.31:0/1875004450 conn(0x7f0ea00d1dc0 msgr2=0x7f0ea00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:22.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.570+0000 7f0ea6800640 1 -- 172.21.15.31:0/1875004450 shutdown_connections 2024-09-17T05:33:22.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.570+0000 7f0ea6800640 1 -- 172.21.15.31:0/1875004450 wait complete. 2024-09-17T05:33:22.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0ea6800640 1 Processor -- start 2024-09-17T05:33:22.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0ea6800640 1 -- start start 2024-09-17T05:33:22.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0ea6800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e84004da0 0x7f0ea00c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:22.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0ea6800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ea006dd30 0x7f0ea00b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:22.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0ea6800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ea01e6270 0x7f0ea00b7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:22.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0ea6800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea00ae9b0 con 0x7f0ea006dd30 2024-09-17T05:33:22.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0ea6800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea00d2af0 con 0x7f0ea01e6270 2024-09-17T05:33:22.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0ea6800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea00aeb30 con 0x7f0e84004da0 2024-09-17T05:33:22.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0e97e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ea006dd30 0x7f0ea00b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:22.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0e97e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ea006dd30 0x7f0ea00b6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58052/0 (socket says 172.21.15.31:58052) 2024-09-17T05:33:22.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0e97e00640 1 -- 172.21.15.31:0/1629775101 learned_addr learned my addr 172.21.15.31:0/1629775101 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:22.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0e9fe00640 1 --2- 172.21.15.31:0/1629775101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ea01e6270 0x7f0ea00b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:22.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0e9f400640 1 --2- 172.21.15.31:0/1629775101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e84004da0 0x7f0ea00c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:22.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0e97e00640 1 -- 172.21.15.31:0/1629775101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e84004da0 msgr2=0x7f0ea00c4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:22.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0e97e00640 1 --2- 172.21.15.31:0/1629775101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e84004da0 0x7f0ea00c4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0e97e00640 1 -- 172.21.15.31:0/1629775101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ea01e6270 msgr2=0x7f0ea00b7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0e97e00640 1 --2- 172.21.15.31:0/1629775101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ea01e6270 0x7f0ea00b7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0e97e00640 1 -- 172.21.15.31:0/1629775101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea00c5120 con 0x7f0ea006dd30 2024-09-17T05:33:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0e9f400640 1 --2- 172.21.15.31:0/1629775101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e84004da0 0x7f0ea00c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0e97e00640 1 --2- 172.21.15.31:0/1629775101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ea006dd30 0x7f0ea00b6b20 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f0e88003f60 tx=0x7f0e88003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0e97400640 1 -- 172.21.15.31:0/1629775101 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88005220 con 0x7f0ea006dd30 2024-09-17T05:33:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0e97400640 1 -- 172.21.15.31:0/1629775101 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e880053c0 con 0x7f0ea006dd30 2024-09-17T05:33:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0e97400640 1 -- 172.21.15.31:0/1629775101 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e880047b0 con 0x7f0ea006dd30 2024-09-17T05:33:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0ea6800640 1 -- 172.21.15.31:0/1629775101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea01f8ec0 con 0x7f0ea006dd30 2024-09-17T05:33:22.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.574+0000 7f0ea6800640 1 -- 172.21.15.31:0/1629775101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea01e7ec0 con 0x7f0ea006dd30 2024-09-17T05:33:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.578+0000 7f0ea6800640 1 -- 172.21.15.31:0/1629775101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ea006f850 con 0x7f0ea006dd30 2024-09-17T05:33:22.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.578+0000 7f0e97400640 1 -- 172.21.15.31:0/1629775101 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f0e88004970 con 0x7f0ea006dd30 2024-09-17T05:33:22.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.578+0000 7f0e97400640 1 --2- 172.21.15.31:0/1629775101 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0e7c073350 0x7f0e7c075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:22.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.578+0000 7f0e97400640 1 -- 172.21.15.31:0/1629775101 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5795+0+0 (secure 0 0 0) 0x7f0e88094f20 con 0x7f0ea006dd30 2024-09-17T05:33:22.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.578+0000 7f0e9f400640 1 --2- 172.21.15.31:0/1629775101 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0e7c073350 0x7f0e7c075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:22.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.578+0000 7f0e9f400640 1 --2- 172.21.15.31:0/1629775101 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0e7c073350 0x7f0e7c075810 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0e90001d60 tx=0x7f0e90001c10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:22.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.582+0000 7f0e97400640 1 -- 172.21.15.31:0/1629775101 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0e8805fcb0 con 0x7f0ea006dd30 2024-09-17T05:33:22.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.798+0000 7f0ea6800640 1 -- 172.21.15.31:0/1629775101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ea01e7cb0 con 0x7f0ea006dd30 2024-09-17T05:33:22.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.802+0000 7f0e97400640 1 -- 172.21.15.31:0/1629775101 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5231 (secure 0 0 0) 0x7f0e8805f5b0 con 0x7f0ea006dd30 2024-09-17T05:33:22.802 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:22.803 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":62,"btime":"2024-09-17T05:33:19:027856+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2757206675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2757206675},{"type":"v1","addr":"172.21.15.31:6835","nonce":2757206675}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3287361734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3287361734},{"type":"v1","addr":"172.21.15.155:6809","nonce":3287361734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1329190310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1329190310},{"type":"v1","addr":"172.21.15.155:6835","nonce":1329190310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:32:58.167014+0000","modified":"2024-09-17T05:33:01.193375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6570},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6570":{"gid":6570,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/1737412276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1737412276},{"type":"v1","addr":"172.21.15.31:6834","nonce":1737412276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6570,"qdb_cluster":[6570]},"id":6}]} 2024-09-17T05:33:22.803 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 62 2024-09-17T05:33:22.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.802+0000 7f0ea6800640 1 -- 172.21.15.31:0/1629775101 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0e7c073350 msgr2=0x7f0e7c075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:22.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.802+0000 7f0ea6800640 1 --2- 172.21.15.31:0/1629775101 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0e7c073350 0x7f0e7c075810 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0e90001d60 tx=0x7f0e90001c10 comp rx=0 tx=0).stop 2024-09-17T05:33:22.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.802+0000 7f0ea6800640 1 -- 172.21.15.31:0/1629775101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ea006dd30 msgr2=0x7f0ea00b6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:22.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.802+0000 7f0ea6800640 1 --2- 172.21.15.31:0/1629775101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ea006dd30 0x7f0ea00b6b20 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f0e88003f60 tx=0x7f0e88003f90 comp rx=0 tx=0).stop 2024-09-17T05:33:22.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.802+0000 7f0ea6800640 1 -- 172.21.15.31:0/1629775101 shutdown_connections 2024-09-17T05:33:22.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.802+0000 7f0ea6800640 1 --2- 172.21.15.31:0/1629775101 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0e7c073350 0x7f0e7c075810 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:22.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.802+0000 7f0ea6800640 1 --2- 172.21.15.31:0/1629775101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ea01e6270 0x7f0ea00b7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:22.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.802+0000 7f0ea6800640 1 --2- 172.21.15.31:0/1629775101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ea006dd30 0x7f0ea00b6b20 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:22.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.802+0000 7f0ea6800640 1 --2- 172.21.15.31:0/1629775101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e84004da0 0x7f0ea00c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:22.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.802+0000 7f0ea6800640 1 -- 172.21.15.31:0/1629775101 >> 172.21.15.31:0/1629775101 conn(0x7f0ea00d1dc0 msgr2=0x7f0ea0075940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:22.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.802+0000 7f0ea6800640 1 -- 172.21.15.31:0/1629775101 shutdown_connections 2024-09-17T05:33:22.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.802+0000 7f0ea6800640 1 -- 172.21.15.31:0/1629775101 wait complete. 2024-09-17T05:33:22.825 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:33:22.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.970+0000 7fba24e00640 1 -- 172.21.15.31:0/2293588327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba04003fe0 msgr2=0x7fba04004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:22.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.970+0000 7fba24e00640 1 --2- 172.21.15.31:0/2293588327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba04003fe0 0x7fba04004810 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009b90 tx=0x7fba0c01d270 comp rx=0 tx=0).stop 2024-09-17T05:33:22.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.970+0000 7fba1e800640 1 -- 172.21.15.31:0/2293588327 reap_dead start 2024-09-17T05:33:22.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.970+0000 7fba24e00640 1 -- 172.21.15.31:0/2293588327 shutdown_connections 2024-09-17T05:33:22.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.970+0000 7fba24e00640 1 -- 172.21.15.31:0/2293588327 >> 172.21.15.31:0/2293588327 conn(0x7fba200d1dc0 msgr2=0x7fba200d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:22.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.970+0000 7fba24e00640 1 -- 172.21.15.31:0/2293588327 shutdown_connections 2024-09-17T05:33:22.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.970+0000 7fba24e00640 1 -- 172.21.15.31:0/2293588327 wait complete. 2024-09-17T05:33:22.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba24e00640 1 Processor -- start 2024-09-17T05:33:22.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba24e00640 1 -- start start 2024-09-17T05:33:22.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba24e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba04003fe0 0x7fba200b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:22.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba24e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba200b75b0 0x7fba2015e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:22.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba24e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba200b7a10 0x7fba2015ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:22.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba24e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fba2015c470 con 0x7fba04003fe0 2024-09-17T05:33:22.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba24e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fba200d2af0 con 0x7fba200b75b0 2024-09-17T05:33:22.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba24e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fba200ae9b0 con 0x7fba200b7a10 2024-09-17T05:33:22.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba1de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba04003fe0 0x7fba200b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:22.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba1de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba04003fe0 0x7fba200b5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58064/0 (socket says 172.21.15.31:58064) 2024-09-17T05:33:22.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba1de00640 1 -- 172.21.15.31:0/1108885335 learned_addr learned my addr 172.21.15.31:0/1108885335 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:22.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba1d400640 1 --2- 172.21.15.31:0/1108885335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba200b75b0 0x7fba2015e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:22.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba1e800640 1 --2- 172.21.15.31:0/1108885335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba200b7a10 0x7fba2015ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:22.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba1de00640 1 -- 172.21.15.31:0/1108885335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba200b7a10 msgr2=0x7fba2015ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:22.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba1de00640 1 --2- 172.21.15.31:0/1108885335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba200b7a10 0x7fba2015ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:22.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba1de00640 1 -- 172.21.15.31:0/1108885335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba200b75b0 msgr2=0x7fba2015e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:22.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba1de00640 1 --2- 172.21.15.31:0/1108885335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba200b75b0 0x7fba2015e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:22.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba1de00640 1 -- 172.21.15.31:0/1108885335 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba201f58c0 con 0x7fba04003fe0 2024-09-17T05:33:22.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba1de00640 1 --2- 172.21.15.31:0/1108885335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba04003fe0 0x7fba200b5770 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fba10001d60 tx=0x7fba10012aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:22.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba16000640 1 -- 172.21.15.31:0/1108885335 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba10013980 con 0x7fba04003fe0 2024-09-17T05:33:22.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba16000640 1 -- 172.21.15.31:0/1108885335 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba10013b40 con 0x7fba04003fe0 2024-09-17T05:33:22.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba24e00640 1 -- 172.21.15.31:0/1108885335 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba201f55e0 con 0x7fba04003fe0 2024-09-17T05:33:22.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba16000640 1 -- 172.21.15.31:0/1108885335 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba10010480 con 0x7fba04003fe0 2024-09-17T05:33:22.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba24e00640 1 -- 172.21.15.31:0/1108885335 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba200b4f70 con 0x7fba04003fe0 2024-09-17T05:33:22.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.974+0000 7fba24e00640 1 -- 172.21.15.31:0/1108885335 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba200ce670 con 0x7fba04003fe0 2024-09-17T05:33:22.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.978+0000 7fba16000640 1 -- 172.21.15.31:0/1108885335 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fba10010620 con 0x7fba04003fe0 2024-09-17T05:33:22.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.978+0000 7fba16000640 1 --2- 172.21.15.31:0/1108885335 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fba00073350 0x7fba00075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:22.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.978+0000 7fba16000640 1 -- 172.21.15.31:0/1108885335 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5795+0+0 (secure 0 0 0) 0x7fba10098490 con 0x7fba04003fe0 2024-09-17T05:33:22.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.978+0000 7fba1d400640 1 --2- 172.21.15.31:0/1108885335 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fba00073350 0x7fba00075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:22.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.978+0000 7fba1d400640 1 --2- 172.21.15.31:0/1108885335 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fba00073350 0x7fba00075810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0ae000 tx=0x7fba0c01a010 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:22.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:22.982+0000 7fba16000640 1 -- 172.21.15.31:0/1108885335 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fba10062bd0 con 0x7fba04003fe0 2024-09-17T05:33:23.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.190+0000 7fba24e00640 1 -- 172.21.15.31:0/1108885335 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba20072540 con 0x7fba04003fe0 2024-09-17T05:33:23.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.194+0000 7fba16000640 1 -- 172.21.15.31:0/1108885335 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5231 (secure 0 0 0) 0x7fba10067600 con 0x7fba04003fe0 2024-09-17T05:33:23.194 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:23.194 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":62,"btime":"2024-09-17T05:33:19:027856+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2757206675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2757206675},{"type":"v1","addr":"172.21.15.31:6835","nonce":2757206675}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3287361734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3287361734},{"type":"v1","addr":"172.21.15.155:6809","nonce":3287361734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1329190310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1329190310},{"type":"v1","addr":"172.21.15.155:6835","nonce":1329190310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:32:58.167014+0000","modified":"2024-09-17T05:33:01.193375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6570},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6570":{"gid":6570,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/1737412276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1737412276},{"type":"v1","addr":"172.21.15.31:6834","nonce":1737412276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6570,"qdb_cluster":[6570]},"id":6}]} 2024-09-17T05:33:23.195 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 62 2024-09-17T05:33:23.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.194+0000 7fba24e00640 1 -- 172.21.15.31:0/1108885335 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fba00073350 msgr2=0x7fba00075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:23.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.194+0000 7fba24e00640 1 --2- 172.21.15.31:0/1108885335 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fba00073350 0x7fba00075810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0ae000 tx=0x7fba0c01a010 comp rx=0 tx=0).stop 2024-09-17T05:33:23.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.194+0000 7fba24e00640 1 -- 172.21.15.31:0/1108885335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba04003fe0 msgr2=0x7fba200b5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:23.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.194+0000 7fba24e00640 1 --2- 172.21.15.31:0/1108885335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba04003fe0 0x7fba200b5770 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fba10001d60 tx=0x7fba10012aa0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.194+0000 7fba24e00640 1 -- 172.21.15.31:0/1108885335 shutdown_connections 2024-09-17T05:33:23.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.194+0000 7fba24e00640 1 --2- 172.21.15.31:0/1108885335 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fba00073350 0x7fba00075810 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.194+0000 7fba24e00640 1 --2- 172.21.15.31:0/1108885335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fba200b7a10 0x7fba2015ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.194+0000 7fba24e00640 1 --2- 172.21.15.31:0/1108885335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba200b75b0 0x7fba2015e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.194+0000 7fba24e00640 1 --2- 172.21.15.31:0/1108885335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fba04003fe0 0x7fba200b5770 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.194+0000 7fba24e00640 1 -- 172.21.15.31:0/1108885335 >> 172.21.15.31:0/1108885335 conn(0x7fba200d1dc0 msgr2=0x7fba200d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:23.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.194+0000 7fba24e00640 1 -- 172.21.15.31:0/1108885335 shutdown_connections 2024-09-17T05:33:23.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.194+0000 7fba24e00640 1 -- 172.21.15.31:0/1108885335 wait complete. 2024-09-17T05:33:23.216 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:33:23.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.362+0000 7f8d3d200640 1 -- 172.21.15.31:0/2731138656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d3815bd50 msgr2=0x7f8d380ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:23.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.362+0000 7f8d3d200640 1 --2- 172.21.15.31:0/2731138656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d3815bd50 0x7f8d380ce5e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8d28009840 tx=0x7f8d2801c700 comp rx=0 tx=0).stop 2024-09-17T05:33:23.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.362+0000 7f8d3d200640 1 -- 172.21.15.31:0/2731138656 shutdown_connections 2024-09-17T05:33:23.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.362+0000 7f8d3d200640 1 --2- 172.21.15.31:0/2731138656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d3815c130 0x7f8d380ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.362+0000 7f8d3d200640 1 --2- 172.21.15.31:0/2731138656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d3815bd50 0x7f8d380ce5e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.362+0000 7f8d3d200640 1 -- 172.21.15.31:0/2731138656 >> 172.21.15.31:0/2731138656 conn(0x7f8d380d1ea0 msgr2=0x7f8d380d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:23.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.362+0000 7f8d3d200640 1 -- 172.21.15.31:0/2731138656 shutdown_connections 2024-09-17T05:33:23.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.362+0000 7f8d3d200640 1 -- 172.21.15.31:0/2731138656 wait complete. 2024-09-17T05:33:23.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.362+0000 7f8d3d200640 1 Processor -- start 2024-09-17T05:33:23.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.362+0000 7f8d3d200640 1 -- start start 2024-09-17T05:33:23.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d3d200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d380cf4e0 0x7f8d380ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:23.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d3d200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d3815bd50 0x7f8d3814fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:23.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d3d200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d3815c130 0x7f8d380c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:23.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d3d200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8d38168e50 con 0x7f8d3815bd50 2024-09-17T05:33:23.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d3d200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8d38168cd0 con 0x7f8d3815c130 2024-09-17T05:33:23.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d3d200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8d38168fd0 con 0x7f8d380cf4e0 2024-09-17T05:33:23.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d2fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d3815bd50 0x7f8d3814fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:23.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d2fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d3815bd50 0x7f8d3814fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58074/0 (socket says 172.21.15.31:58074) 2024-09-17T05:33:23.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d2fe00640 1 -- 172.21.15.31:0/3371843097 learned_addr learned my addr 172.21.15.31:0/3371843097 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:23.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d35e00640 1 --2- 172.21.15.31:0/3371843097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d380cf4e0 0x7f8d380ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:23.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d36800640 1 --2- 172.21.15.31:0/3371843097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d3815c130 0x7f8d380c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:23.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d2fe00640 1 -- 172.21.15.31:0/3371843097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d380cf4e0 msgr2=0x7f8d380ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:23.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d2fe00640 1 --2- 172.21.15.31:0/3371843097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d380cf4e0 0x7f8d380ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d2fe00640 1 -- 172.21.15.31:0/3371843097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d3815c130 msgr2=0x7f8d380c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:23.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d2fe00640 1 --2- 172.21.15.31:0/3371843097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d3815c130 0x7f8d380c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d2fe00640 1 -- 172.21.15.31:0/3371843097 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d380ca790 con 0x7f8d3815bd50 2024-09-17T05:33:23.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d2fe00640 1 --2- 172.21.15.31:0/3371843097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d3815bd50 0x7f8d3814fc90 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8d2000e9e0 tx=0x7f8d2000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:23.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d2e000640 1 -- 172.21.15.31:0/3371843097 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2000cdb0 con 0x7f8d3815bd50 2024-09-17T05:33:23.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d2e000640 1 -- 172.21.15.31:0/3371843097 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d20004020 con 0x7f8d3815bd50 2024-09-17T05:33:23.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d3d200640 1 -- 172.21.15.31:0/3371843097 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d380caa70 con 0x7f8d3815bd50 2024-09-17T05:33:23.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d2e000640 1 -- 172.21.15.31:0/3371843097 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20004470 con 0x7f8d3815bd50 2024-09-17T05:33:23.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d3d200640 1 -- 172.21.15.31:0/3371843097 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d380cb030 con 0x7f8d3815bd50 2024-09-17T05:33:23.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.366+0000 7f8d3d200640 1 -- 172.21.15.31:0/3371843097 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d380c5dd0 con 0x7f8d3815bd50 2024-09-17T05:33:23.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.370+0000 7f8d2e000640 1 -- 172.21.15.31:0/3371843097 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f8d20003600 con 0x7f8d3815bd50 2024-09-17T05:33:23.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.370+0000 7f8d2e000640 1 --2- 172.21.15.31:0/3371843097 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8d14073320 0x7f8d140757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:23.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.370+0000 7f8d2e000640 1 -- 172.21.15.31:0/3371843097 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5795+0+0 (secure 0 0 0) 0x7f8d20094f40 con 0x7f8d3815bd50 2024-09-17T05:33:23.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.370+0000 7f8d35e00640 1 --2- 172.21.15.31:0/3371843097 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8d14073320 0x7f8d140757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:23.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.370+0000 7f8d35e00640 1 --2- 172.21.15.31:0/3371843097 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8d14073320 0x7f8d140757e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8d280af000 tx=0x7f8d2801af40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:23.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.370+0000 7f8d2e000640 1 -- 172.21.15.31:0/3371843097 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8d2005f800 con 0x7f8d3815bd50 2024-09-17T05:33:23.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.550+0000 7f8d3d200640 1 -- 172.21.15.31:0/3371843097 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d380cc2d0 con 0x7f8d3815bd50 2024-09-17T05:33:23.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.554+0000 7f8d2e000640 1 -- 172.21.15.31:0/3371843097 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+16875 (secure 0 0 0) 0x7f8d20064230 con 0x7f8d3815bd50 2024-09-17T05:33:23.555 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:23.555 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":89,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:33:21.039431+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:32:55.883070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T05:32:57.135509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:6835/2426776304":"2024-09-18T05:33:18.024058+0000","172.21.15.155:6834/2426776304":"2024-09-18T05:33:18.024058+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:33:23.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.554+0000 7f8d3d200640 1 -- 172.21.15.31:0/3371843097 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8d14073320 msgr2=0x7f8d140757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:23.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.554+0000 7f8d3d200640 1 --2- 172.21.15.31:0/3371843097 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8d14073320 0x7f8d140757e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8d280af000 tx=0x7f8d2801af40 comp rx=0 tx=0).stop 2024-09-17T05:33:23.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.554+0000 7f8d3d200640 1 -- 172.21.15.31:0/3371843097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d3815bd50 msgr2=0x7f8d3814fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:23.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.554+0000 7f8d3d200640 1 --2- 172.21.15.31:0/3371843097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d3815bd50 0x7f8d3814fc90 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8d2000e9e0 tx=0x7f8d2000eea0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.554+0000 7f8d3d200640 1 -- 172.21.15.31:0/3371843097 shutdown_connections 2024-09-17T05:33:23.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.554+0000 7f8d3d200640 1 --2- 172.21.15.31:0/3371843097 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8d14073320 0x7f8d140757e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.554+0000 7f8d3d200640 1 --2- 172.21.15.31:0/3371843097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d3815c130 0x7f8d380c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.554+0000 7f8d3d200640 1 --2- 172.21.15.31:0/3371843097 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d3815bd50 0x7f8d3814fc90 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.554+0000 7f8d3d200640 1 --2- 172.21.15.31:0/3371843097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d380cf4e0 0x7f8d380ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.554+0000 7f8d3d200640 1 -- 172.21.15.31:0/3371843097 >> 172.21.15.31:0/3371843097 conn(0x7f8d380d1ea0 msgr2=0x7f8d380b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:23.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.554+0000 7f8d3d200640 1 -- 172.21.15.31:0/3371843097 shutdown_connections 2024-09-17T05:33:23.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.554+0000 7f8d3d200640 1 -- 172.21.15.31:0/3371843097 wait complete. 2024-09-17T05:33:23.576 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:33:23.577 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:33:23.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.722+0000 7f2bc0200640 1 -- 172.21.15.31:0/1684159407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb80cdb30 msgr2=0x7f2bb80cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:23.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.722+0000 7f2bc0200640 1 --2- 172.21.15.31:0/1684159407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb80cdb30 0x7f2bb80cebb0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f2bb80745d0 tx=0x7f2ba401c8c0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.722+0000 7f2bc0200640 1 -- 172.21.15.31:0/1684159407 shutdown_connections 2024-09-17T05:33:23.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.722+0000 7f2bc0200640 1 --2- 172.21.15.31:0/1684159407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bb80d28e0 0x7f2bb80cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.722+0000 7f2bc0200640 1 --2- 172.21.15.31:0/1684159407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb80cdb30 0x7f2bb80cebb0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.722+0000 7f2bc0200640 1 --2- 172.21.15.31:0/1684159407 >> v2:172.21.15.155:3300/0 conn(0x7f2bb815bea0 0x7f2bb80ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.722+0000 7f2bc0200640 1 -- 172.21.15.31:0/1684159407 >> 172.21.15.31:0/1684159407 conn(0x7f2bb80d1dc0 msgr2=0x7f2bb80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:23.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.722+0000 7f2bc0200640 1 -- 172.21.15.31:0/1684159407 shutdown_connections 2024-09-17T05:33:23.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.722+0000 7f2bc0200640 1 -- 172.21.15.31:0/1684159407 wait complete. 2024-09-17T05:33:23.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.722+0000 7f2bc0200640 1 Processor -- start 2024-09-17T05:33:23.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.722+0000 7f2bc0200640 1 -- start start 2024-09-17T05:33:23.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bc0200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bb80cdb30 0x7f2bb8158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:23.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bc0200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bb80d28e0 0x7f2bb806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:23.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bc0200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb815bea0 0x7f2bb80719d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:23.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bc0200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb80af070 con 0x7f2bb815bea0 2024-09-17T05:33:23.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bc0200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb80aeef0 con 0x7f2bb80cdb30 2024-09-17T05:33:23.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bc0200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb80af1f0 con 0x7f2bb80d28e0 2024-09-17T05:33:23.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bbe200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb815bea0 0x7f2bb80719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:23.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bbe200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb815bea0 0x7f2bb80719d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58100/0 (socket says 172.21.15.31:58100) 2024-09-17T05:33:23.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bbe200640 1 -- 172.21.15.31:0/3432593225 learned_addr learned my addr 172.21.15.31:0/3432593225 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:23.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bbd800640 1 --2- 172.21.15.31:0/3432593225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bb80cdb30 0x7f2bb8158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:23.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bbce00640 1 --2- 172.21.15.31:0/3432593225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bb80d28e0 0x7f2bb806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:23.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bbe200640 1 -- 172.21.15.31:0/3432593225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bb80d28e0 msgr2=0x7f2bb806f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:23.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bbe200640 1 --2- 172.21.15.31:0/3432593225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bb80d28e0 0x7f2bb806f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bbe200640 1 -- 172.21.15.31:0/3432593225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bb80cdb30 msgr2=0x7f2bb8158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:23.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bbe200640 1 --2- 172.21.15.31:0/3432593225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bb80cdb30 0x7f2bb8158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bbe200640 1 -- 172.21.15.31:0/3432593225 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb80b2110 con 0x7f2bb815bea0 2024-09-17T05:33:23.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bbe200640 1 --2- 172.21.15.31:0/3432593225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb815bea0 0x7f2bb80719d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000e9c0 tx=0x7f2bb000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:23.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bb5600640 1 -- 172.21.15.31:0/3432593225 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb000cd80 con 0x7f2bb815bea0 2024-09-17T05:33:23.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bb5600640 1 -- 172.21.15.31:0/3432593225 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2bb0004b30 con 0x7f2bb815bea0 2024-09-17T05:33:23.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bb5600640 1 -- 172.21.15.31:0/3432593225 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0005020 con 0x7f2bb815bea0 2024-09-17T05:33:23.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bc0200640 1 -- 172.21.15.31:0/3432593225 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb81f8150 con 0x7f2bb815bea0 2024-09-17T05:33:23.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bc0200640 1 -- 172.21.15.31:0/3432593225 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb81f86f0 con 0x7f2bb815bea0 2024-09-17T05:33:23.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.726+0000 7f2bc0200640 1 -- 172.21.15.31:0/3432593225 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb80cc9d0 con 0x7f2bb815bea0 2024-09-17T05:33:23.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.730+0000 7f2bb5600640 1 -- 172.21.15.31:0/3432593225 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f2bb00051c0 con 0x7f2bb815bea0 2024-09-17T05:33:23.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.730+0000 7f2bb5600640 1 --2- 172.21.15.31:0/3432593225 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2b98073320 0x7f2b980757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:23.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.730+0000 7f2bb5600640 1 -- 172.21.15.31:0/3432593225 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5795+0+0 (secure 0 0 0) 0x7f2bb0094de0 con 0x7f2bb815bea0 2024-09-17T05:33:23.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.730+0000 7f2bbd800640 1 --2- 172.21.15.31:0/3432593225 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2b98073320 0x7f2b980757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:23.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.730+0000 7f2bbd800640 1 --2- 172.21.15.31:0/3432593225 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2b98073320 0x7f2b980757e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00bb50 tx=0x7f2bac00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:23.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.734+0000 7f2bb5600640 1 -- 172.21.15.31:0/3432593225 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2bb0016030 con 0x7f2bb815bea0 2024-09-17T05:33:23.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.950+0000 7f2bc0200640 1 -- 172.21.15.31:0/3432593225 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2bb815a080 con 0x7f2bb815bea0 2024-09-17T05:33:23.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.950+0000 7f2bb5600640 1 -- 172.21.15.31:0/3432593225 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5231 (secure 0 0 0) 0x7f2bb005f520 con 0x7f2bb815bea0 2024-09-17T05:33:23.951 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:23.951 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":62,"btime":"2024-09-17T05:33:19:027856+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2757206675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2757206675},{"type":"v1","addr":"172.21.15.31:6835","nonce":2757206675}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3287361734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3287361734},{"type":"v1","addr":"172.21.15.155:6809","nonce":3287361734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1329190310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1329190310},{"type":"v1","addr":"172.21.15.155:6835","nonce":1329190310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:32:58.167014+0000","modified":"2024-09-17T05:33:01.193375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6570},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6570":{"gid":6570,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/1737412276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1737412276},{"type":"v1","addr":"172.21.15.31:6834","nonce":1737412276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6570,"qdb_cluster":[6570]},"id":6}]} 2024-09-17T05:33:23.952 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 62 2024-09-17T05:33:23.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.950+0000 7f2bc0200640 1 -- 172.21.15.31:0/3432593225 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2b98073320 msgr2=0x7f2b980757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.950+0000 7f2bc0200640 1 --2- 172.21.15.31:0/3432593225 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2b98073320 0x7f2b980757e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00bb50 tx=0x7f2bac00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.950+0000 7f2bc0200640 1 -- 172.21.15.31:0/3432593225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb815bea0 msgr2=0x7f2bb80719d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.950+0000 7f2bc0200640 1 --2- 172.21.15.31:0/3432593225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb815bea0 0x7f2bb80719d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000e9c0 tx=0x7f2bb000ee80 comp rx=0 tx=0).stop 2024-09-17T05:33:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.950+0000 7f2bc0200640 1 -- 172.21.15.31:0/3432593225 shutdown_connections 2024-09-17T05:33:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.950+0000 7f2bc0200640 1 --2- 172.21.15.31:0/3432593225 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2b98073320 0x7f2b980757e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.950+0000 7f2bc0200640 1 --2- 172.21.15.31:0/3432593225 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bb815bea0 0x7f2bb80719d0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.950+0000 7f2bc0200640 1 --2- 172.21.15.31:0/3432593225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bb80d28e0 0x7f2bb806f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.950+0000 7f2bc0200640 1 --2- 172.21.15.31:0/3432593225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bb80cdb30 0x7f2bb8158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.950+0000 7f2bc0200640 1 -- 172.21.15.31:0/3432593225 >> 172.21.15.31:0/3432593225 conn(0x7f2bb80d1dc0 msgr2=0x7f2bb80b6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.950+0000 7f2bc0200640 1 -- 172.21.15.31:0/3432593225 shutdown_connections 2024-09-17T05:33:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:23.950+0000 7f2bc0200640 1 -- 172.21.15.31:0/3432593225 wait complete. 2024-09-17T05:33:23.973 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:33:24.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.118+0000 7f2f2c200640 1 -- 172.21.15.31:0/3115910916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2406ee50 msgr2=0x7f2f240afcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:24.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.118+0000 7f2f2c200640 1 --2- 172.21.15.31:0/3115910916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2406ee50 0x7f2f240afcd0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f2f10009840 tx=0x7f2f1001c790 comp rx=0 tx=0).stop 2024-09-17T05:33:24.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.118+0000 7f2f2c200640 1 -- 172.21.15.31:0/3115910916 shutdown_connections 2024-09-17T05:33:24.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.118+0000 7f2f2c200640 1 --2- 172.21.15.31:0/3115910916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f2415e330 0x7f2f240b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.118+0000 7f2f2c200640 1 --2- 172.21.15.31:0/3115910916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2406ee50 0x7f2f240afcd0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.118+0000 7f2f2c200640 1 -- 172.21.15.31:0/3115910916 >> 172.21.15.31:0/3115910916 conn(0x7f2f240d1dc0 msgr2=0x7f2f240d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:24.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.118+0000 7f2f2c200640 1 -- 172.21.15.31:0/3115910916 shutdown_connections 2024-09-17T05:33:24.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.118+0000 7f2f2c200640 1 -- 172.21.15.31:0/3115910916 wait complete. 2024-09-17T05:33:24.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f2c200640 1 Processor -- start 2024-09-17T05:33:24.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f2c200640 1 -- start start 2024-09-17T05:33:24.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f2c200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f2406ee50 0x7f2f240c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:24.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f2c200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2415df50 0x7f2f24153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:24.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f2c200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f2415e330 0x7f2f2415cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:24.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f2c200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2f240d0fd0 con 0x7f2f2415df50 2024-09-17T05:33:24.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f2c200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2f240d0e50 con 0x7f2f2406ee50 2024-09-17T05:33:24.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f2c200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2f240d1150 con 0x7f2f2415e330 2024-09-17T05:33:24.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f28e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2415df50 0x7f2f24153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:24.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f28e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2415df50 0x7f2f24153660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58116/0 (socket says 172.21.15.31:58116) 2024-09-17T05:33:24.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f28e00640 1 -- 172.21.15.31:0/2169755215 learned_addr learned my addr 172.21.15.31:0/2169755215 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:24.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f2a200640 1 --2- 172.21.15.31:0/2169755215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f2415e330 0x7f2f2415cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:24.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f29800640 1 --2- 172.21.15.31:0/2169755215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f2406ee50 0x7f2f240c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:24.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f28e00640 1 -- 172.21.15.31:0/2169755215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f2415e330 msgr2=0x7f2f2415cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:24.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f28e00640 1 --2- 172.21.15.31:0/2169755215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f2415e330 0x7f2f2415cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f28e00640 1 -- 172.21.15.31:0/2169755215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f2406ee50 msgr2=0x7f2f240c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:24.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f28e00640 1 --2- 172.21.15.31:0/2169755215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f2406ee50 0x7f2f240c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f28e00640 1 -- 172.21.15.31:0/2169755215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f241fae80 con 0x7f2f2415df50 2024-09-17T05:33:24.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f29800640 1 --2- 172.21.15.31:0/2169755215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f2406ee50 0x7f2f240c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:33:24.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f28e00640 1 --2- 172.21.15.31:0/2169755215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2415df50 0x7f2f24153660 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2f10009790 tx=0x7f2f10005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:24.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f21600640 1 -- 172.21.15.31:0/2169755215 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f100b2040 con 0x7f2f2415df50 2024-09-17T05:33:24.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f21600640 1 -- 172.21.15.31:0/2169755215 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f10004240 con 0x7f2f2415df50 2024-09-17T05:33:24.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f2c200640 1 -- 172.21.15.31:0/2169755215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f241fb160 con 0x7f2f2415df50 2024-09-17T05:33:24.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f21600640 1 -- 172.21.15.31:0/2169755215 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f10005020 con 0x7f2f2415df50 2024-09-17T05:33:24.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f2c200640 1 -- 172.21.15.31:0/2169755215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f241fb720 con 0x7f2f2415df50 2024-09-17T05:33:24.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.122+0000 7f2f2c200640 1 -- 172.21.15.31:0/2169755215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f24155ab0 con 0x7f2f2415df50 2024-09-17T05:33:24.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.126+0000 7f2f21600640 1 -- 172.21.15.31:0/2169755215 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f2f100a57d0 con 0x7f2f2415df50 2024-09-17T05:33:24.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.126+0000 7f2f21600640 1 --2- 172.21.15.31:0/2169755215 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2f04073320 0x7f2f040757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:24.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.126+0000 7f2f21600640 1 -- 172.21.15.31:0/2169755215 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5795+0+0 (secure 0 0 0) 0x7f2f1012df90 con 0x7f2f2415df50 2024-09-17T05:33:24.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.126+0000 7f2f29800640 1 --2- 172.21.15.31:0/2169755215 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2f04073320 0x7f2f040757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:24.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.126+0000 7f2f29800640 1 --2- 172.21.15.31:0/2169755215 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2f04073320 0x7f2f040757e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2f18001250 tx=0x7f2f18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:24.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.130+0000 7f2f21600640 1 -- 172.21.15.31:0/2169755215 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2f10016410 con 0x7f2f2415df50 2024-09-17T05:33:24.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.342+0000 7f2f2c200640 1 -- 172.21.15.31:0/2169755215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f2406e6c0 con 0x7f2f2415df50 2024-09-17T05:33:24.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.342+0000 7f2f21600640 1 -- 172.21.15.31:0/2169755215 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5231 (secure 0 0 0) 0x7f2f100f8dd0 con 0x7f2f2415df50 2024-09-17T05:33:24.343 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:24.343 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":62,"btime":"2024-09-17T05:33:19:027856+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2757206675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2757206675},{"type":"v1","addr":"172.21.15.31:6835","nonce":2757206675}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3287361734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3287361734},{"type":"v1","addr":"172.21.15.155:6809","nonce":3287361734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1329190310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1329190310},{"type":"v1","addr":"172.21.15.155:6835","nonce":1329190310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:32:58.167014+0000","modified":"2024-09-17T05:33:01.193375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6570},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6570":{"gid":6570,"name":"c","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/1737412276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1737412276},{"type":"v1","addr":"172.21.15.31:6834","nonce":1737412276}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6570,"qdb_cluster":[6570]},"id":6}]} 2024-09-17T05:33:24.343 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 62 2024-09-17T05:33:24.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.342+0000 7f2f2c200640 1 -- 172.21.15.31:0/2169755215 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2f04073320 msgr2=0x7f2f040757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:24.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.342+0000 7f2f2c200640 1 --2- 172.21.15.31:0/2169755215 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2f04073320 0x7f2f040757e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2f18001250 tx=0x7f2f18009040 comp rx=0 tx=0).stop 2024-09-17T05:33:24.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.342+0000 7f2f2c200640 1 -- 172.21.15.31:0/2169755215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2415df50 msgr2=0x7f2f24153660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:24.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.342+0000 7f2f2c200640 1 --2- 172.21.15.31:0/2169755215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2415df50 0x7f2f24153660 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f2f10009790 tx=0x7f2f10005dd0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.342+0000 7f2f2c200640 1 -- 172.21.15.31:0/2169755215 shutdown_connections 2024-09-17T05:33:24.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.342+0000 7f2f2c200640 1 --2- 172.21.15.31:0/2169755215 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2f04073320 0x7f2f040757e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.342+0000 7f2f2c200640 1 --2- 172.21.15.31:0/2169755215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f2415e330 0x7f2f2415cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.342+0000 7f2f2c200640 1 --2- 172.21.15.31:0/2169755215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2415df50 0x7f2f24153660 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.342+0000 7f2f2c200640 1 --2- 172.21.15.31:0/2169755215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f2406ee50 0x7f2f240c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.342+0000 7f2f2c200640 1 -- 172.21.15.31:0/2169755215 >> 172.21.15.31:0/2169755215 conn(0x7f2f240d1dc0 msgr2=0x7f2f240716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:24.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.342+0000 7f2f2c200640 1 -- 172.21.15.31:0/2169755215 shutdown_connections 2024-09-17T05:33:24.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.342+0000 7f2f2c200640 1 -- 172.21.15.31:0/2169755215 wait complete. 2024-09-17T05:33:24.364 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:33:24.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.510+0000 7f7705400640 1 -- 172.21.15.31:0/1021351397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76e4004220 msgr2=0x7f76e4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:24.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.510+0000 7f7705400640 1 --2- 172.21.15.31:0/1021351397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76e4004220 0x7f76e4004810 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f76ec001800 tx=0x7f76ec01c5b0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.510+0000 7f76ff200640 1 -- 172.21.15.31:0/1021351397 reap_dead start 2024-09-17T05:33:24.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.510+0000 7f7705400640 1 -- 172.21.15.31:0/1021351397 shutdown_connections 2024-09-17T05:33:24.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.510+0000 7f7705400640 1 -- 172.21.15.31:0/1021351397 >> 172.21.15.31:0/1021351397 conn(0x7f77000d1ea0 msgr2=0x7f77000d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:24.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.510+0000 7f7705400640 1 -- 172.21.15.31:0/1021351397 shutdown_connections 2024-09-17T05:33:24.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.510+0000 7f7705400640 1 -- 172.21.15.31:0/1021351397 wait complete. 2024-09-17T05:33:24.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.510+0000 7f7705400640 1 Processor -- start 2024-09-17T05:33:24.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.510+0000 7f7705400640 1 -- start start 2024-09-17T05:33:24.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f7705400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76e4004220 0x7f77000c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:24.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f7705400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77000c85f0 0x7f77000b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:24.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f7705400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77000b5b40 0x7f77000b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:24.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f7705400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7700168bd0 con 0x7f77000c85f0 2024-09-17T05:33:24.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f7705400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7700168a50 con 0x7f77000b5b40 2024-09-17T05:33:24.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f7705400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7700168d50 con 0x7f76e4004220 2024-09-17T05:33:24.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f76fde00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77000c85f0 0x7f77000b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:24.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f76fde00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77000c85f0 0x7f77000b5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58130/0 (socket says 172.21.15.31:58130) 2024-09-17T05:33:24.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f76fde00640 1 -- 172.21.15.31:0/1345410721 learned_addr learned my addr 172.21.15.31:0/1345410721 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:24.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f76fe800640 1 --2- 172.21.15.31:0/1345410721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76e4004220 0x7f77000c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:24.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f76ff200640 1 --2- 172.21.15.31:0/1345410721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77000b5b40 0x7f77000b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:24.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f76fde00640 1 -- 172.21.15.31:0/1345410721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76e4004220 msgr2=0x7f77000c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:24.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f76fde00640 1 --2- 172.21.15.31:0/1345410721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76e4004220 0x7f77000c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f76fde00640 1 -- 172.21.15.31:0/1345410721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77000b5b40 msgr2=0x7f77000b71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:24.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f76fde00640 1 --2- 172.21.15.31:0/1345410721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77000b5b40 0x7f77000b71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f76fde00640 1 -- 172.21.15.31:0/1345410721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77000cb4a0 con 0x7f77000c85f0 2024-09-17T05:33:24.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f76ff200640 1 --2- 172.21.15.31:0/1345410721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77000b5b40 0x7f77000b71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:33:24.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f76fde00640 1 --2- 172.21.15.31:0/1345410721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77000c85f0 0x7f77000b5600 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f76ec005040 tx=0x7f76ec001530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:24.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f76f6a00640 1 -- 172.21.15.31:0/1345410721 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec003810 con 0x7f77000c85f0 2024-09-17T05:33:24.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f76f6a00640 1 -- 172.21.15.31:0/1345410721 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76ec0b3070 con 0x7f77000c85f0 2024-09-17T05:33:24.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f7705400640 1 -- 172.21.15.31:0/1345410721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77000c7f90 con 0x7f77000c85f0 2024-09-17T05:33:24.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f76f6a00640 1 -- 172.21.15.31:0/1345410721 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec003ce0 con 0x7f77000c85f0 2024-09-17T05:33:24.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f7705400640 1 -- 172.21.15.31:0/1345410721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77000cb9f0 con 0x7f77000c85f0 2024-09-17T05:33:24.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f7705400640 1 -- 172.21.15.31:0/1345410721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77000c6590 con 0x7f77000c85f0 2024-09-17T05:33:24.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.514+0000 7f76f6a00640 1 -- 172.21.15.31:0/1345410721 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f76ec0b8470 con 0x7f77000c85f0 2024-09-17T05:33:24.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.518+0000 7f76f6a00640 1 --2- 172.21.15.31:0/1345410721 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f76e0073320 0x7f76e00757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:24.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.518+0000 7f76f6a00640 1 -- 172.21.15.31:0/1345410721 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5795+0+0 (secure 0 0 0) 0x7f76ec12e1c0 con 0x7f77000c85f0 2024-09-17T05:33:24.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.518+0000 7f76fe800640 1 --2- 172.21.15.31:0/1345410721 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f76e0073320 0x7f76e00757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:24.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.518+0000 7f76fe800640 1 --2- 172.21.15.31:0/1345410721 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f76e0073320 0x7f76e00757e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009ac0 tx=0x7f76f00091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:24.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.522+0000 7f76f6a00640 1 -- 172.21.15.31:0/1345410721 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f76ec016630 con 0x7f77000c85f0 2024-09-17T05:33:24.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.694+0000 7f7705400640 1 -- 172.21.15.31:0/1345410721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77000d2530 con 0x7f77000c85f0 2024-09-17T05:33:24.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.698+0000 7f76f6a00640 1 -- 172.21.15.31:0/1345410721 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+16875 (secure 0 0 0) 0x7f76ec0f90f0 con 0x7f77000c85f0 2024-09-17T05:33:24.699 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:24.699 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":89,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:33:21.039431+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:32:55.883070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T05:32:57.135509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:6835/2426776304":"2024-09-18T05:33:18.024058+0000","172.21.15.155:6834/2426776304":"2024-09-18T05:33:18.024058+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:33:24.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.698+0000 7f7705400640 1 -- 172.21.15.31:0/1345410721 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f76e0073320 msgr2=0x7f76e00757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:24.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.698+0000 7f7705400640 1 --2- 172.21.15.31:0/1345410721 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f76e0073320 0x7f76e00757e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009ac0 tx=0x7f76f00091e0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.698+0000 7f7705400640 1 -- 172.21.15.31:0/1345410721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77000c85f0 msgr2=0x7f77000b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.698+0000 7f7705400640 1 --2- 172.21.15.31:0/1345410721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77000c85f0 0x7f77000b5600 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f76ec005040 tx=0x7f76ec001530 comp rx=0 tx=0).stop 2024-09-17T05:33:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.698+0000 7f7705400640 1 -- 172.21.15.31:0/1345410721 shutdown_connections 2024-09-17T05:33:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.698+0000 7f7705400640 1 --2- 172.21.15.31:0/1345410721 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f76e0073320 0x7f76e00757e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.698+0000 7f7705400640 1 --2- 172.21.15.31:0/1345410721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77000b5b40 0x7f77000b71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.698+0000 7f7705400640 1 --2- 172.21.15.31:0/1345410721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f77000c85f0 0x7f77000b5600 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.698+0000 7f7705400640 1 --2- 172.21.15.31:0/1345410721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76e4004220 0x7f77000c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.698+0000 7f7705400640 1 -- 172.21.15.31:0/1345410721 >> 172.21.15.31:0/1345410721 conn(0x7f77000d1ea0 msgr2=0x7f7700159190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.698+0000 7f7705400640 1 -- 172.21.15.31:0/1345410721 shutdown_connections 2024-09-17T05:33:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.698+0000 7f7705400640 1 -- 172.21.15.31:0/1345410721 wait complete. 2024-09-17T05:33:24.722 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:33:24.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.866+0000 7f7febe00640 1 -- 172.21.15.31:0/2760016313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fd0003a10 msgr2=0x7f7fd0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:24.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.866+0000 7f7febe00640 1 --2- 172.21.15.31:0/2760016313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fd0003a10 0x7f7fd0003e30 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc00bb10 tx=0x7f7fdc01cda0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.866+0000 7f7feb400640 1 -- 172.21.15.31:0/2760016313 reap_dead start 2024-09-17T05:33:24.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.866+0000 7f7febe00640 1 -- 172.21.15.31:0/2760016313 shutdown_connections 2024-09-17T05:33:24.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.866+0000 7f7febe00640 1 -- 172.21.15.31:0/2760016313 >> 172.21.15.31:0/2760016313 conn(0x7f7fec09aa10 msgr2=0x7f7fec09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:24.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.866+0000 7f7febe00640 1 -- 172.21.15.31:0/2760016313 shutdown_connections 2024-09-17T05:33:24.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.866+0000 7f7febe00640 1 -- 172.21.15.31:0/2760016313 wait complete. 2024-09-17T05:33:24.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7febe00640 1 Processor -- start 2024-09-17T05:33:24.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7febe00640 1 -- start start 2024-09-17T05:33:24.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7febe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fd0003a10 0x7f7fec15aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:24.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7febe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fec071920 0x7f7fec071da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:24.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7febe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fec1fb1e0 0x7f7fec1fb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:24.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7febe00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec166d80 con 0x7f7fec1fb1e0 2024-09-17T05:33:24.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7febe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec166c00 con 0x7f7fd0003a10 2024-09-17T05:33:24.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7febe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7fec166f00 con 0x7f7fec071920 2024-09-17T05:33:24.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7feb400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fec1fb1e0 0x7f7fec1fb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:24.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7feb400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fec1fb1e0 0x7f7fec1fb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58140/0 (socket says 172.21.15.31:58140) 2024-09-17T05:33:24.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7feb400640 1 -- 172.21.15.31:0/2964920749 learned_addr learned my addr 172.21.15.31:0/2964920749 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:24.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7feaa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fd0003a10 0x7f7fec15aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:24.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7fe3e00640 1 --2- 172.21.15.31:0/2964920749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fec071920 0x7f7fec071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:24.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7feb400640 1 -- 172.21.15.31:0/2964920749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fec071920 msgr2=0x7f7fec071da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:24.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7feb400640 1 --2- 172.21.15.31:0/2964920749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fec071920 0x7f7fec071da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7feb400640 1 -- 172.21.15.31:0/2964920749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fd0003a10 msgr2=0x7f7fec15aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:24.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7feb400640 1 --2- 172.21.15.31:0/2964920749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fd0003a10 0x7f7fec15aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:24.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7feb400640 1 -- 172.21.15.31:0/2964920749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fec1f7b80 con 0x7f7fec1fb1e0 2024-09-17T05:33:24.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7feb400640 1 --2- 172.21.15.31:0/2964920749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fec1fb1e0 0x7f7fec1fb660 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f7fec06d720 tx=0x7f7fe400dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:24.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7fe2a00640 1 -- 172.21.15.31:0/2964920749 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4003d90 con 0x7f7fec1fb1e0 2024-09-17T05:33:24.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7fe2a00640 1 -- 172.21.15.31:0/2964920749 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7fe400de90 con 0x7f7fec1fb1e0 2024-09-17T05:33:24.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7febe00640 1 -- 172.21.15.31:0/2964920749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fec1f7e60 con 0x7f7fec1fb1e0 2024-09-17T05:33:24.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7fe2a00640 1 -- 172.21.15.31:0/2964920749 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400ba20 con 0x7f7fec1fb1e0 2024-09-17T05:33:24.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.870+0000 7f7febe00640 1 -- 172.21.15.31:0/2964920749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fec1f8420 con 0x7f7fec1fb1e0 2024-09-17T05:33:24.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.874+0000 7f7febe00640 1 -- 172.21.15.31:0/2964920749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fec0cc5b0 con 0x7f7fec1fb1e0 2024-09-17T05:33:24.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.874+0000 7f7fe2a00640 1 -- 172.21.15.31:0/2964920749 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f7fe400bbc0 con 0x7f7fec1fb1e0 2024-09-17T05:33:24.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.874+0000 7f7fe2a00640 1 --2- 172.21.15.31:0/2964920749 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7fc8073350 0x7f7fc8075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:24.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.874+0000 7f7fe2a00640 1 -- 172.21.15.31:0/2964920749 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5795+0+0 (secure 0 0 0) 0x7f7fe4094920 con 0x7f7fec1fb1e0 2024-09-17T05:33:24.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.874+0000 7f7feaa00640 1 --2- 172.21.15.31:0/2964920749 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7fc8073350 0x7f7fc8075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:24.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.874+0000 7f7feaa00640 1 --2- 172.21.15.31:0/2964920749 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7fc8073350 0x7f7fc8075810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0b0000 tx=0x7f7fdc0a7040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:24.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:24.878+0000 7f7fe2a00640 1 -- 172.21.15.31:0/2964920749 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7fe405f6b0 con 0x7f7fec1fb1e0 2024-09-17T05:33:25.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.094+0000 7f7febe00640 1 -- 172.21.15.31:0/2964920749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7fec0c4860 con 0x7f7fec1fb1e0 2024-09-17T05:33:25.096 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-09-17T05:33:25.094+0000 7f21d0200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:33:25.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.098+0000 7f7fe2a00640 1 -- 172.21.15.31:0/2964920749 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) ==== 161+0+0 (secure 0 0 0) 0x7f7fe405efb0 con 0x7f7fec1fb1e0 2024-09-17T05:33:25.099 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:33:25.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.098+0000 7f7febe00640 1 -- 172.21.15.31:0/2964920749 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7fc8073350 msgr2=0x7f7fc8075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:25.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.098+0000 7f7febe00640 1 --2- 172.21.15.31:0/2964920749 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7fc8073350 0x7f7fc8075810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0b0000 tx=0x7f7fdc0a7040 comp rx=0 tx=0).stop 2024-09-17T05:33:25.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.098+0000 7f7febe00640 1 -- 172.21.15.31:0/2964920749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fec1fb1e0 msgr2=0x7f7fec1fb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:25.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.098+0000 7f7febe00640 1 --2- 172.21.15.31:0/2964920749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fec1fb1e0 0x7f7fec1fb660 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f7fec06d720 tx=0x7f7fe400dc40 comp rx=0 tx=0).stop 2024-09-17T05:33:25.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.098+0000 7f7febe00640 1 -- 172.21.15.31:0/2964920749 shutdown_connections 2024-09-17T05:33:25.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.098+0000 7f7febe00640 1 --2- 172.21.15.31:0/2964920749 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7fc8073350 0x7f7fc8075810 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:25.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.098+0000 7f7febe00640 1 --2- 172.21.15.31:0/2964920749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7fec1fb1e0 0x7f7fec1fb660 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:25.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.098+0000 7f7febe00640 1 --2- 172.21.15.31:0/2964920749 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7fec071920 0x7f7fec071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:25.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.098+0000 7f7febe00640 1 --2- 172.21.15.31:0/2964920749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7fd0003a10 0x7f7fec15aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:25.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.098+0000 7f7febe00640 1 -- 172.21.15.31:0/2964920749 >> 172.21.15.31:0/2964920749 conn(0x7f7fec09aa10 msgr2=0x7f7fec09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:25.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.098+0000 7f7febe00640 1 -- 172.21.15.31:0/2964920749 shutdown_connections 2024-09-17T05:33:25.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.098+0000 7f7febe00640 1 -- 172.21.15.31:0/2964920749 wait complete. 2024-09-17T05:33:25.109 INFO:tasks.ceph.mds.c.smithi031.stderr: -2964> 2024-09-17T05:32:59.734+0000 7fb607400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:33:25.122 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:33:25.156 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-17T05:33:25.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.270+0000 7fceab000640 1 -- 172.21.15.31:0/1087316436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcea40d1a80 msgr2=0x7fcea406d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:25.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.270+0000 7fceab000640 1 --2- 172.21.15.31:0/1087316436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcea40d1a80 0x7fcea406d160 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fce9c009bf0 tx=0x7fce9c01cba0 comp rx=0 tx=0).stop 2024-09-17T05:33:25.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.270+0000 7fceab000640 1 -- 172.21.15.31:0/1087316436 shutdown_connections 2024-09-17T05:33:25.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.270+0000 7fceab000640 1 --2- 172.21.15.31:0/1087316436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcea40d1a80 0x7fcea406d160 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:25.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.270+0000 7fceab000640 1 --2- 172.21.15.31:0/1087316436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcea40cbeb0 0x7fcea406cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:25.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.270+0000 7fceab000640 1 -- 172.21.15.31:0/1087316436 >> 172.21.15.31:0/1087316436 conn(0x7fcea40d0da0 msgr2=0x7fcea40d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:25.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.270+0000 7fceab000640 1 -- 172.21.15.31:0/1087316436 shutdown_connections 2024-09-17T05:33:25.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.270+0000 7fceab000640 1 -- 172.21.15.31:0/1087316436 wait complete. 2024-09-17T05:33:25.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.270+0000 7fceab000640 1 Processor -- start 2024-09-17T05:33:25.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.270+0000 7fceab000640 1 -- start start 2024-09-17T05:33:25.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fceab000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcea40cbad0 0x7fcea4160c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:25.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fceab000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcea40cbeb0 0x7fcea414b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:25.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fceab000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcea40d1a80 0x7fcea415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:25.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fceab000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcea416b280 con 0x7fcea40cbeb0 2024-09-17T05:33:25.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fceab000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcea416b100 con 0x7fcea40cbad0 2024-09-17T05:33:25.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fceab000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcea416b400 con 0x7fcea40d1a80 2024-09-17T05:33:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fcea3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcea40cbeb0 0x7fcea414b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fcea3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcea40cbeb0 0x7fcea414b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58168/0 (socket says 172.21.15.31:58168) 2024-09-17T05:33:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fcea3400640 1 -- 172.21.15.31:0/3163014342 learned_addr learned my addr 172.21.15.31:0/3163014342 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fcea3400640 1 -- 172.21.15.31:0/3163014342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcea40d1a80 msgr2=0x7fcea415d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fcea3e00640 1 --2- 172.21.15.31:0/3163014342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcea40cbad0 0x7fcea4160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fcea9000640 1 --2- 172.21.15.31:0/3163014342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcea40d1a80 0x7fcea415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fcea3400640 1 --2- 172.21.15.31:0/3163014342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcea40d1a80 0x7fcea415d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fcea3400640 1 -- 172.21.15.31:0/3163014342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcea40cbad0 msgr2=0x7fcea4160c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fcea3400640 1 --2- 172.21.15.31:0/3163014342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcea40cbad0 0x7fcea4160c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fcea3400640 1 -- 172.21.15.31:0/3163014342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea414c110 con 0x7fcea40cbeb0 2024-09-17T05:33:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fcea9000640 1 --2- 172.21.15.31:0/3163014342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcea40d1a80 0x7fcea415d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:33:25.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fcea3e00640 1 --2- 172.21.15.31:0/3163014342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcea40cbad0 0x7fcea4160c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:33:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fcea3400640 1 --2- 172.21.15.31:0/3163014342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcea40cbeb0 0x7fcea414b7b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fce9000d980 tx=0x7fce9000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fce9be00640 1 -- 172.21.15.31:0/3163014342 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce90017070 con 0x7fcea40cbeb0 2024-09-17T05:33:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fce9be00640 1 -- 172.21.15.31:0/3163014342 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce90009d20 con 0x7fcea40cbeb0 2024-09-17T05:33:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fceab000640 1 -- 172.21.15.31:0/3163014342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea414c380 con 0x7fcea40cbeb0 2024-09-17T05:33:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fce9be00640 1 -- 172.21.15.31:0/3163014342 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce900106c0 con 0x7fcea40cbeb0 2024-09-17T05:33:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fceab000640 1 -- 172.21.15.31:0/3163014342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea41613a0 con 0x7fcea40cbeb0 2024-09-17T05:33:25.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fceab000640 1 -- 172.21.15.31:0/3163014342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcea40b6d20 con 0x7fcea40cbeb0 2024-09-17T05:33:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.274+0000 7fce9be00640 1 -- 172.21.15.31:0/3163014342 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fce9001a070 con 0x7fcea40cbeb0 2024-09-17T05:33:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.278+0000 7fce9be00640 1 --2- 172.21.15.31:0/3163014342 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fce84073320 0x7fce840757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.278+0000 7fce9be00640 1 -- 172.21.15.31:0/3163014342 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5881+0+0 (secure 0 0 0) 0x7fce900946e0 con 0x7fcea40cbeb0 2024-09-17T05:33:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.278+0000 7fcea3e00640 1 --2- 172.21.15.31:0/3163014342 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fce84073320 0x7fce840757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:25.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.278+0000 7fcea3e00640 1 --2- 172.21.15.31:0/3163014342 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fce84073320 0x7fce840757e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fce94000f70 tx=0x7fce94009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:25.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.282+0000 7fce9be00640 1 -- 172.21.15.31:0/3163014342 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fce9005f550 con 0x7fcea40cbeb0 2024-09-17T05:33:25.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:25.494+0000 7fceab000640 1 -- 172.21.15.31:0/3163014342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcea40afb30 con 0x7fcea40cbeb0 2024-09-17T05:33:26.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.098+0000 7fce9be00640 1 -- 172.21.15.31:0/3163014342 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) ==== 104+0+0 (secure 0 0 0) 0x7fce9005ee50 con 0x7fcea40cbeb0 2024-09-17T05:33:26.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.102+0000 7fceab000640 1 -- 172.21.15.31:0/3163014342 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fce84073320 msgr2=0x7fce840757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:26.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.102+0000 7fceab000640 1 --2- 172.21.15.31:0/3163014342 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fce84073320 0x7fce840757e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fce94000f70 tx=0x7fce94009040 comp rx=0 tx=0).stop 2024-09-17T05:33:26.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.102+0000 7fceab000640 1 -- 172.21.15.31:0/3163014342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcea40cbeb0 msgr2=0x7fcea414b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:26.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.102+0000 7fceab000640 1 --2- 172.21.15.31:0/3163014342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcea40cbeb0 0x7fcea414b7b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fce9000d980 tx=0x7fce9000de40 comp rx=0 tx=0).stop 2024-09-17T05:33:26.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.102+0000 7fceab000640 1 -- 172.21.15.31:0/3163014342 shutdown_connections 2024-09-17T05:33:26.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.102+0000 7fceab000640 1 --2- 172.21.15.31:0/3163014342 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fce84073320 0x7fce840757e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:26.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.102+0000 7fceab000640 1 --2- 172.21.15.31:0/3163014342 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcea40d1a80 0x7fcea415d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:26.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.102+0000 7fceab000640 1 --2- 172.21.15.31:0/3163014342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcea40cbeb0 0x7fcea414b7b0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:26.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.102+0000 7fceab000640 1 --2- 172.21.15.31:0/3163014342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcea40cbad0 0x7fcea4160c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:26.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.102+0000 7fceab000640 1 -- 172.21.15.31:0/3163014342 >> 172.21.15.31:0/3163014342 conn(0x7fcea40d0da0 msgr2=0x7fcea41553a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:26.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.102+0000 7fceab000640 1 -- 172.21.15.31:0/3163014342 shutdown_connections 2024-09-17T05:33:26.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.102+0000 7fceab000640 1 -- 172.21.15.31:0/3163014342 wait complete. 2024-09-17T05:33:26.127 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:33:26.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.322+0000 7efe93200640 1 -- 172.21.15.31:0/3172230577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe940d02e0 msgr2=0x7efe940d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:26.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.322+0000 7efe93200640 1 --2- 172.21.15.31:0/3172230577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe940d02e0 0x7efe940d0720 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7efe7c009840 tx=0x7efe7c01c7f0 comp rx=0 tx=0).stop 2024-09-17T05:33:26.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.322+0000 7efe93200640 1 -- 172.21.15.31:0/3172230577 shutdown_connections 2024-09-17T05:33:26.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.322+0000 7efe93200640 1 --2- 172.21.15.31:0/3172230577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe940d02e0 0x7efe940d0720 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:26.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.322+0000 7efe93200640 1 --2- 172.21.15.31:0/3172230577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe940cff00 0x7efe940d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:26.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.322+0000 7efe93200640 1 -- 172.21.15.31:0/3172230577 >> 172.21.15.31:0/3172230577 conn(0x7efe940d1da0 msgr2=0x7efe940d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:26.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.322+0000 7efe93200640 1 -- 172.21.15.31:0/3172230577 shutdown_connections 2024-09-17T05:33:26.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.322+0000 7efe93200640 1 -- 172.21.15.31:0/3172230577 wait complete. 2024-09-17T05:33:26.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe93200640 1 Processor -- start 2024-09-17T05:33:26.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe93200640 1 -- start start 2024-09-17T05:33:26.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe93200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe940cff00 0x7efe9414c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:26.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe93200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe940d02e0 0x7efe940cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:26.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe93200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9415eff0 0x7efe940ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:26.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe93200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efe94169170 con 0x7efe940d02e0 2024-09-17T05:33:26.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe93200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efe94168ff0 con 0x7efe9415eff0 2024-09-17T05:33:26.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe93200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efe941692f0 con 0x7efe940cff00 2024-09-17T05:33:26.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe8be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe940d02e0 0x7efe940cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:26.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe8be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe940d02e0 0x7efe940cb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58176/0 (socket says 172.21.15.31:58176) 2024-09-17T05:33:26.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe8be00640 1 -- 172.21.15.31:0/2456200096 learned_addr learned my addr 172.21.15.31:0/2456200096 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:26.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe91e00640 1 --2- 172.21.15.31:0/2456200096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe940cff00 0x7efe9414c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:26.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe92800640 1 --2- 172.21.15.31:0/2456200096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9415eff0 0x7efe940ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:26.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe8be00640 1 -- 172.21.15.31:0/2456200096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe940cff00 msgr2=0x7efe9414c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:26.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe8be00640 1 --2- 172.21.15.31:0/2456200096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe940cff00 0x7efe9414c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:26.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe8be00640 1 -- 172.21.15.31:0/2456200096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9415eff0 msgr2=0x7efe940ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:26.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe8be00640 1 --2- 172.21.15.31:0/2456200096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9415eff0 0x7efe940ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:26.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe8be00640 1 -- 172.21.15.31:0/2456200096 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe940c78e0 con 0x7efe940d02e0 2024-09-17T05:33:26.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe91e00640 1 --2- 172.21.15.31:0/2456200096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe940cff00 0x7efe9414c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:26.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe8be00640 1 --2- 172.21.15.31:0/2456200096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe940d02e0 0x7efe940cb3d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7efe7c009790 tx=0x7efe7c0a5840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:26.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe8a000640 1 -- 172.21.15.31:0/2456200096 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0b2040 con 0x7efe940d02e0 2024-09-17T05:33:26.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe8a000640 1 -- 172.21.15.31:0/2456200096 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe7c0044b0 con 0x7efe940d02e0 2024-09-17T05:33:26.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe93200640 1 -- 172.21.15.31:0/2456200096 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe940c7bc0 con 0x7efe940d02e0 2024-09-17T05:33:26.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe8a000640 1 -- 172.21.15.31:0/2456200096 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c005280 con 0x7efe940d02e0 2024-09-17T05:33:26.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.326+0000 7efe93200640 1 -- 172.21.15.31:0/2456200096 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe940cb910 con 0x7efe940d02e0 2024-09-17T05:33:26.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.330+0000 7efe93200640 1 -- 172.21.15.31:0/2456200096 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe940c7d90 con 0x7efe940d02e0 2024-09-17T05:33:26.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.330+0000 7efe8a000640 1 -- 172.21.15.31:0/2456200096 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7efe7c005420 con 0x7efe940d02e0 2024-09-17T05:33:26.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.330+0000 7efe8a000640 1 --2- 172.21.15.31:0/2456200096 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efe70073320 0x7efe700757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:26.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.330+0000 7efe8a000640 1 -- 172.21.15.31:0/2456200096 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5881+0+0 (secure 0 0 0) 0x7efe7c12dc10 con 0x7efe940d02e0 2024-09-17T05:33:26.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.330+0000 7efe91e00640 1 --2- 172.21.15.31:0/2456200096 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efe70073320 0x7efe700757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:26.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.330+0000 7efe91e00640 1 --2- 172.21.15.31:0/2456200096 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efe70073320 0x7efe700757e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efe84009c30 tx=0x7efe840091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:26.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.334+0000 7efe8a000640 1 -- 172.21.15.31:0/2456200096 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7efe940c7d90 con 0x7efe940d02e0 2024-09-17T05:33:26.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:26.510+0000 7efe93200640 1 -- 172.21.15.31:0/2456200096 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7efe940c9880 con 0x7efe940d02e0 2024-09-17T05:33:27.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.106+0000 7efe8a000640 1 -- 172.21.15.31:0/2456200096 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) ==== 181+0+0 (secure 0 0 0) 0x7efe7c016410 con 0x7efe940d02e0 2024-09-17T05:33:27.107 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:33:27.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.110+0000 7efe93200640 1 -- 172.21.15.31:0/2456200096 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efe70073320 msgr2=0x7efe700757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:27.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.110+0000 7efe93200640 1 --2- 172.21.15.31:0/2456200096 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efe70073320 0x7efe700757e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efe84009c30 tx=0x7efe840091e0 comp rx=0 tx=0).stop 2024-09-17T05:33:27.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.110+0000 7efe93200640 1 -- 172.21.15.31:0/2456200096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe940d02e0 msgr2=0x7efe940cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:27.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.110+0000 7efe93200640 1 --2- 172.21.15.31:0/2456200096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe940d02e0 0x7efe940cb3d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7efe7c009790 tx=0x7efe7c0a5840 comp rx=0 tx=0).stop 2024-09-17T05:33:27.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.110+0000 7efe93200640 1 -- 172.21.15.31:0/2456200096 shutdown_connections 2024-09-17T05:33:27.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.110+0000 7efe93200640 1 --2- 172.21.15.31:0/2456200096 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efe70073320 0x7efe700757e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:27.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.110+0000 7efe93200640 1 --2- 172.21.15.31:0/2456200096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9415eff0 0x7efe940ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:27.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.110+0000 7efe93200640 1 --2- 172.21.15.31:0/2456200096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe940d02e0 0x7efe940cb3d0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:27.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.110+0000 7efe93200640 1 --2- 172.21.15.31:0/2456200096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe940cff00 0x7efe9414c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:27.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.110+0000 7efe93200640 1 -- 172.21.15.31:0/2456200096 >> 172.21.15.31:0/2456200096 conn(0x7efe940d1da0 msgr2=0x7efe940af980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:27.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.110+0000 7efe93200640 1 -- 172.21.15.31:0/2456200096 shutdown_connections 2024-09-17T05:33:27.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.110+0000 7efe93200640 1 -- 172.21.15.31:0/2456200096 wait complete. 2024-09-17T05:33:27.137 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:33:27.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f72400640 1 -- 172.21.15.31:0/2715934611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f6c0b0b60 msgr2=0x7f9f6c166eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:27.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f72400640 1 --2- 172.21.15.31:0/2715934611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f6c0b0b60 0x7f9f6c166eb0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9f64009bc0 tx=0x7f9f6401f3b0 comp rx=0 tx=0).stop 2024-09-17T05:33:27.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f72400640 1 -- 172.21.15.31:0/2715934611 shutdown_connections 2024-09-17T05:33:27.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f72400640 1 --2- 172.21.15.31:0/2715934611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f6c0b0b60 0x7f9f6c166eb0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:27.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f72400640 1 -- 172.21.15.31:0/2715934611 >> 172.21.15.31:0/2715934611 conn(0x7f9f6c0d1da0 msgr2=0x7f9f6c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:27.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f72400640 1 -- 172.21.15.31:0/2715934611 shutdown_connections 2024-09-17T05:33:27.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f72400640 1 -- 172.21.15.31:0/2715934611 wait complete. 2024-09-17T05:33:27.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f72400640 1 Processor -- start 2024-09-17T05:33:27.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f72400640 1 -- start start 2024-09-17T05:33:27.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f72400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f6c0b0b60 0x7f9f6c0b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:27.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f72400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f6c15be10 0x7f9f6c1f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:27.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f72400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f6c15c1f0 0x7f9f6c152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:27.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f72400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c167570 con 0x7f9f6c15c1f0 2024-09-17T05:33:27.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f72400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6c1673f0 con 0x7f9f6c15be10 2024-09-17T05:33:27.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f72400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9f6c1676f0 con 0x7f9f6c0b0b60 2024-09-17T05:33:27.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f6be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f6c15c1f0 0x7f9f6c152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:27.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f6be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f6c15c1f0 0x7f9f6c152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58194/0 (socket says 172.21.15.31:58194) 2024-09-17T05:33:27.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f6be00640 1 -- 172.21.15.31:0/3159415316 learned_addr learned my addr 172.21.15.31:0/3159415316 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:27.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f6b400640 1 --2- 172.21.15.31:0/3159415316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f6c0b0b60 0x7f9f6c0b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:27.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f63e00640 1 --2- 172.21.15.31:0/3159415316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f6c15be10 0x7f9f6c1f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:27.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f6be00640 1 -- 172.21.15.31:0/3159415316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f6c0b0b60 msgr2=0x7f9f6c0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:27.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f6be00640 1 --2- 172.21.15.31:0/3159415316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f6c0b0b60 0x7f9f6c0b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:27.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f6be00640 1 -- 172.21.15.31:0/3159415316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f6c15be10 msgr2=0x7f9f6c1f8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:27.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f6be00640 1 --2- 172.21.15.31:0/3159415316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f6c15be10 0x7f9f6c1f8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:27.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.290+0000 7f9f6be00640 1 -- 172.21.15.31:0/3159415316 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f6c0b06f0 con 0x7f9f6c15c1f0 2024-09-17T05:33:27.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.294+0000 7f9f6be00640 1 --2- 172.21.15.31:0/3159415316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f6c15c1f0 0x7f9f6c152e60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9f6401cfe0 tx=0x7f9f640af580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:27.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.294+0000 7f9f63400640 1 -- 172.21.15.31:0/3159415316 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f640b4040 con 0x7f9f6c15c1f0 2024-09-17T05:33:27.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.294+0000 7f9f63400640 1 -- 172.21.15.31:0/3159415316 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f640bf070 con 0x7f9f6c15c1f0 2024-09-17T05:33:27.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.294+0000 7f9f63400640 1 -- 172.21.15.31:0/3159415316 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f640b09b0 con 0x7f9f6c15c1f0 2024-09-17T05:33:27.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.294+0000 7f9f72400640 1 -- 172.21.15.31:0/3159415316 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f6c0b6ad0 con 0x7f9f6c15c1f0 2024-09-17T05:33:27.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.294+0000 7f9f72400640 1 -- 172.21.15.31:0/3159415316 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f6c0b7090 con 0x7f9f6c15c1f0 2024-09-17T05:33:27.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.294+0000 7f9f72400640 1 -- 172.21.15.31:0/3159415316 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f6c0ce700 con 0x7f9f6c15c1f0 2024-09-17T05:33:27.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.294+0000 7f9f63400640 1 -- 172.21.15.31:0/3159415316 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f9f640b0b70 con 0x7f9f6c15c1f0 2024-09-17T05:33:27.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.294+0000 7f9f63400640 1 --2- 172.21.15.31:0/3159415316 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9f48073320 0x7f9f480757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:27.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.294+0000 7f9f63400640 1 -- 172.21.15.31:0/3159415316 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5443+0+0 (secure 0 0 0) 0x7f9f64132680 con 0x7f9f6c15c1f0 2024-09-17T05:33:27.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.298+0000 7f9f6b400640 1 --2- 172.21.15.31:0/3159415316 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9f48073320 0x7f9f480757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:27.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.298+0000 7f9f6b400640 1 --2- 172.21.15.31:0/3159415316 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9f48073320 0x7f9f480757e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c000f70 tx=0x7f9f5c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:27.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.298+0000 7f9f63400640 1 -- 172.21.15.31:0/3159415316 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9f64018f10 con 0x7f9f6c15c1f0 2024-09-17T05:33:27.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:27.474+0000 7f9f72400640 1 -- 172.21.15.31:0/3159415316 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9f6c1580b0 con 0x7f9f6c15c1f0 2024-09-17T05:33:28.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.106+0000 7f9f63400640 1 -- 172.21.15.31:0/3159415316 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) ==== 169+0+0 (secure 0 0 0) 0x7f9f640fd570 con 0x7f9f6c15c1f0 2024-09-17T05:33:28.109 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-09-17T05:33:28.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.110+0000 7f9f72400640 1 -- 172.21.15.31:0/3159415316 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9f48073320 msgr2=0x7f9f480757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:28.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.110+0000 7f9f72400640 1 --2- 172.21.15.31:0/3159415316 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9f48073320 0x7f9f480757e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c000f70 tx=0x7f9f5c009040 comp rx=0 tx=0).stop 2024-09-17T05:33:28.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.110+0000 7f9f72400640 1 -- 172.21.15.31:0/3159415316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f6c15c1f0 msgr2=0x7f9f6c152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:28.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.110+0000 7f9f72400640 1 --2- 172.21.15.31:0/3159415316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f6c15c1f0 0x7f9f6c152e60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9f6401cfe0 tx=0x7f9f640af580 comp rx=0 tx=0).stop 2024-09-17T05:33:28.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.110+0000 7f9f72400640 1 -- 172.21.15.31:0/3159415316 shutdown_connections 2024-09-17T05:33:28.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.110+0000 7f9f72400640 1 --2- 172.21.15.31:0/3159415316 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9f48073320 0x7f9f480757e0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c000f70 tx=0x7f9f5c009040 comp rx=0 tx=0).stop 2024-09-17T05:33:28.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.110+0000 7f9f72400640 1 --2- 172.21.15.31:0/3159415316 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f6c15c1f0 0x7f9f6c152e60 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:28.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.110+0000 7f9f72400640 1 --2- 172.21.15.31:0/3159415316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f6c15be10 0x7f9f6c1f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:28.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.110+0000 7f9f72400640 1 --2- 172.21.15.31:0/3159415316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f6c0b0b60 0x7f9f6c0b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:28.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.110+0000 7f9f72400640 1 -- 172.21.15.31:0/3159415316 >> 172.21.15.31:0/3159415316 conn(0x7f9f6c0d1da0 msgr2=0x7f9f6c0722d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:28.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.114+0000 7f9f72400640 1 -- 172.21.15.31:0/3159415316 shutdown_connections 2024-09-17T05:33:28.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.114+0000 7f9f72400640 1 -- 172.21.15.31:0/3159415316 wait complete. 2024-09-17T05:33:28.141 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:33:28.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.290+0000 7f01bea00640 1 -- 172.21.15.31:0/862367976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f019c004d50 msgr2=0x7f019c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:28.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.290+0000 7f01bea00640 1 --2- 172.21.15.31:0/862367976 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f019c004d50 0x7f019c0051d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f01b0009ee0 tx=0x7f01b001d630 comp rx=0 tx=0).stop 2024-09-17T05:33:28.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.290+0000 7f01bca00640 1 -- 172.21.15.31:0/862367976 reap_dead start 2024-09-17T05:33:28.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.290+0000 7f01bea00640 1 -- 172.21.15.31:0/862367976 shutdown_connections 2024-09-17T05:33:28.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.290+0000 7f01bea00640 1 -- 172.21.15.31:0/862367976 >> 172.21.15.31:0/862367976 conn(0x7f01b80b18f0 msgr2=0x7f01b80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:28.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.290+0000 7f01bea00640 1 -- 172.21.15.31:0/862367976 shutdown_connections 2024-09-17T05:33:28.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.290+0000 7f01bea00640 1 -- 172.21.15.31:0/862367976 wait complete. 2024-09-17T05:33:28.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01bea00640 1 Processor -- start 2024-09-17T05:33:28.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01bea00640 1 -- start start 2024-09-17T05:33:28.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01bea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01b81546c0 0x7f01b80cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:28.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01bea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01b8154aa0 0x7f01b81f8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:28.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01bea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b81f5970 0x7f01b815c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:28.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01bea00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f01b80ad0d0 con 0x7f01b8154aa0 2024-09-17T05:33:28.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01bea00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f01b80acf50 con 0x7f01b81546c0 2024-09-17T05:33:28.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01bea00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f01b80b4880 con 0x7f01b81f5970 2024-09-17T05:33:28.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01b7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01b8154aa0 0x7f01b81f8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:28.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01b7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01b8154aa0 0x7f01b81f8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58212/0 (socket says 172.21.15.31:58212) 2024-09-17T05:33:28.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01b7400640 1 -- 172.21.15.31:0/3865697051 learned_addr learned my addr 172.21.15.31:0/3865697051 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:28.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01bca00640 1 --2- 172.21.15.31:0/3865697051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b81f5970 0x7f01b815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:28.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01b7e00640 1 --2- 172.21.15.31:0/3865697051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01b81546c0 0x7f01b80cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:28.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01b7400640 1 -- 172.21.15.31:0/3865697051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b81f5970 msgr2=0x7f01b815c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:28.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01b7400640 1 --2- 172.21.15.31:0/3865697051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b81f5970 0x7f01b815c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:28.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01b7400640 1 -- 172.21.15.31:0/3865697051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01b81546c0 msgr2=0x7f01b80cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:28.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01b7400640 1 --2- 172.21.15.31:0/3865697051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01b81546c0 0x7f01b80cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:28.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01b7400640 1 -- 172.21.15.31:0/3865697051 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b81f5190 con 0x7f01b8154aa0 2024-09-17T05:33:28.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01b7400640 1 --2- 172.21.15.31:0/3865697051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01b8154aa0 0x7f01b81f8780 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f01a4011ab0 tx=0x7f01a4011eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:28.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01afe00640 1 -- 172.21.15.31:0/3865697051 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a401e070 con 0x7f01b8154aa0 2024-09-17T05:33:28.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01afe00640 1 -- 172.21.15.31:0/3865697051 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01a400fad0 con 0x7f01b8154aa0 2024-09-17T05:33:28.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01bea00640 1 -- 172.21.15.31:0/3865697051 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b81f8ef0 con 0x7f01b8154aa0 2024-09-17T05:33:28.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01afe00640 1 -- 172.21.15.31:0/3865697051 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a4019410 con 0x7f01b8154aa0 2024-09-17T05:33:28.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.294+0000 7f01bea00640 1 -- 172.21.15.31:0/3865697051 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b81f94b0 con 0x7f01b8154aa0 2024-09-17T05:33:28.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.298+0000 7f01bea00640 1 -- 172.21.15.31:0/3865697051 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01b8069410 con 0x7f01b8154aa0 2024-09-17T05:33:28.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.298+0000 7f01afe00640 1 -- 172.21.15.31:0/3865697051 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f01a4021070 con 0x7f01b8154aa0 2024-09-17T05:33:28.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.298+0000 7f01afe00640 1 --2- 172.21.15.31:0/3865697051 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0198073320 0x7f01980757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:28.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.298+0000 7f01afe00640 1 -- 172.21.15.31:0/3865697051 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5029+0+0 (secure 0 0 0) 0x7f01a4094850 con 0x7f01b8154aa0 2024-09-17T05:33:28.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.298+0000 7f01b7e00640 1 --2- 172.21.15.31:0/3865697051 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0198073320 0x7f01980757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:28.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.298+0000 7f01b7e00640 1 --2- 172.21.15.31:0/3865697051 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0198073320 0x7f01980757e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f01a8006760 tx=0x7f01a8001d70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:28.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.302+0000 7f01afe00640 1 -- 172.21.15.31:0/3865697051 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f01a405f320 con 0x7f01b8154aa0 2024-09-17T05:33:28.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.478+0000 7f01bea00640 1 -- 172.21.15.31:0/3865697051 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f01b80ccad0 con 0x7f01b8154aa0 2024-09-17T05:33:28.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.482+0000 7f01afe00640 1 -- 172.21.15.31:0/3865697051 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v37) ==== 71+0+0 (secure 0 0 0) 0x7f01a4063d50 con 0x7f01b8154aa0 2024-09-17T05:33:28.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.482+0000 7f01bea00640 1 -- 172.21.15.31:0/3865697051 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0198073320 msgr2=0x7f01980757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:28.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.482+0000 7f01bea00640 1 --2- 172.21.15.31:0/3865697051 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0198073320 0x7f01980757e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f01a8006760 tx=0x7f01a8001d70 comp rx=0 tx=0).stop 2024-09-17T05:33:28.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.482+0000 7f01bea00640 1 -- 172.21.15.31:0/3865697051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01b8154aa0 msgr2=0x7f01b81f8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:28.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.482+0000 7f01bea00640 1 --2- 172.21.15.31:0/3865697051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01b8154aa0 0x7f01b81f8780 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f01a4011ab0 tx=0x7f01a4011eb0 comp rx=0 tx=0).stop 2024-09-17T05:33:28.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.482+0000 7f01bea00640 1 -- 172.21.15.31:0/3865697051 shutdown_connections 2024-09-17T05:33:28.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.482+0000 7f01bea00640 1 --2- 172.21.15.31:0/3865697051 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0198073320 0x7f01980757e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:28.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.482+0000 7f01bea00640 1 --2- 172.21.15.31:0/3865697051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f01b81f5970 0x7f01b815c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:28.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.482+0000 7f01bea00640 1 --2- 172.21.15.31:0/3865697051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01b8154aa0 0x7f01b81f8780 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:28.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.482+0000 7f01bea00640 1 --2- 172.21.15.31:0/3865697051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01b81546c0 0x7f01b80cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:28.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.482+0000 7f01bea00640 1 -- 172.21.15.31:0/3865697051 >> 172.21.15.31:0/3865697051 conn(0x7f01b80b18f0 msgr2=0x7f01b8073d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:28.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.482+0000 7f01bea00640 1 -- 172.21.15.31:0/3865697051 shutdown_connections 2024-09-17T05:33:28.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.482+0000 7f01bea00640 1 -- 172.21.15.31:0/3865697051 wait complete. 2024-09-17T05:33:28.506 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars' 2024-09-17T05:33:28.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.658+0000 7ff92a000640 1 -- 172.21.15.31:0/706811472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff908004d50 msgr2=0x7ff9080051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:28.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.658+0000 7ff92a000640 1 --2- 172.21.15.31:0/706811472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff908004d50 0x7ff9080051d0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0013e0 tx=0x7ff91c01d2a0 comp rx=0 tx=0).stop 2024-09-17T05:33:28.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.658+0000 7ff923e00640 1 -- 172.21.15.31:0/706811472 reap_dead start 2024-09-17T05:33:28.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.658+0000 7ff92a000640 1 -- 172.21.15.31:0/706811472 shutdown_connections 2024-09-17T05:33:28.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.658+0000 7ff92a000640 1 -- 172.21.15.31:0/706811472 >> 172.21.15.31:0/706811472 conn(0x7ff9240d1dc0 msgr2=0x7ff9240d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:28.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.658+0000 7ff92a000640 1 -- 172.21.15.31:0/706811472 shutdown_connections 2024-09-17T05:33:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.658+0000 7ff92a000640 1 -- 172.21.15.31:0/706811472 wait complete. 2024-09-17T05:33:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff92a000640 1 Processor -- start 2024-09-17T05:33:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff92a000640 1 -- start start 2024-09-17T05:33:28.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff92a000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff908004d50 0x7ff9241f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff92a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9240cbce0 0x7ff9240c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff92a000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9240b1e10 0x7ff9240b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff92a000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff9240ae9b0 con 0x7ff9240cbce0 2024-09-17T05:33:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff92a000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff9240d2af0 con 0x7ff908004d50 2024-09-17T05:33:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff92a000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff9240aeb30 con 0x7ff9240b1e10 2024-09-17T05:33:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff91be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9240cbce0 0x7ff9240c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff923400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff908004d50 0x7ff9241f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff91be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9240cbce0 0x7ff9240c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37688/0 (socket says 172.21.15.31:37688) 2024-09-17T05:33:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff91be00640 1 -- 172.21.15.31:0/592921062 learned_addr learned my addr 172.21.15.31:0/592921062 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff923e00640 1 --2- 172.21.15.31:0/592921062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9240b1e10 0x7ff9240b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff91be00640 1 -- 172.21.15.31:0/592921062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9240b1e10 msgr2=0x7ff9240b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:28.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff91be00640 1 --2- 172.21.15.31:0/592921062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9240b1e10 0x7ff9240b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:28.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff91be00640 1 -- 172.21.15.31:0/592921062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff908004d50 msgr2=0x7ff9241f25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:28.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff91be00640 1 --2- 172.21.15.31:0/592921062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff908004d50 0x7ff9241f25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:28.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff91be00640 1 -- 172.21.15.31:0/592921062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9241f2ee0 con 0x7ff9240cbce0 2024-09-17T05:33:28.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff923400640 1 --2- 172.21.15.31:0/592921062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff908004d50 0x7ff9241f25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:33:28.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff91be00640 1 --2- 172.21.15.31:0/592921062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9240cbce0 0x7ff9240c79c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff90c011ae0 tx=0x7ff90c009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:28.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff91b400640 1 -- 172.21.15.31:0/592921062 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c01e070 con 0x7ff9240cbce0 2024-09-17T05:33:28.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff91b400640 1 -- 172.21.15.31:0/592921062 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff90c004460 con 0x7ff9240cbce0 2024-09-17T05:33:28.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff91b400640 1 -- 172.21.15.31:0/592921062 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c00fc30 con 0x7ff9240cbce0 2024-09-17T05:33:28.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff92a000640 1 -- 172.21.15.31:0/592921062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9241f31c0 con 0x7ff9240cbce0 2024-09-17T05:33:28.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.662+0000 7ff92a000640 1 -- 172.21.15.31:0/592921062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9240b18f0 con 0x7ff9240cbce0 2024-09-17T05:33:28.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.666+0000 7ff92a000640 1 -- 172.21.15.31:0/592921062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9240af650 con 0x7ff9240cbce0 2024-09-17T05:33:28.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.666+0000 7ff91b400640 1 -- 172.21.15.31:0/592921062 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7ff90c021070 con 0x7ff9240cbce0 2024-09-17T05:33:28.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.666+0000 7ff91b400640 1 --2- 172.21.15.31:0/592921062 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff900073350 0x7ff900075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:28.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.666+0000 7ff91b400640 1 -- 172.21.15.31:0/592921062 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5029+0+0 (secure 0 0 0) 0x7ff90c094c60 con 0x7ff9240cbce0 2024-09-17T05:33:28.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.666+0000 7ff923400640 1 --2- 172.21.15.31:0/592921062 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff900073350 0x7ff900075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:28.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.666+0000 7ff923400640 1 --2- 172.21.15.31:0/592921062 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff900073350 0x7ff900075810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff914000c10 tx=0x7ff914006b80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:28.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.670+0000 7ff91b400640 1 -- 172.21.15.31:0/592921062 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff90c05f760 con 0x7ff9240cbce0 2024-09-17T05:33:28.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:28.910+0000 7ff92a000640 1 -- 172.21.15.31:0/592921062 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]} v 0) -- 0x7ff924159ca0 con 0x7ff9240cbce0 2024-09-17T05:33:29.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.118+0000 7ff91b400640 1 -- 172.21.15.31:0/592921062 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]}]=0 v266) ==== 146+0+0 (secure 0 0 0) 0x7ff90c064190 con 0x7ff9240cbce0 2024-09-17T05:33:29.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.118+0000 7ff92a000640 1 -- 172.21.15.31:0/592921062 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff900073350 msgr2=0x7ff900075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:29.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.118+0000 7ff92a000640 1 --2- 172.21.15.31:0/592921062 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff900073350 0x7ff900075810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff914000c10 tx=0x7ff914006b80 comp rx=0 tx=0).stop 2024-09-17T05:33:29.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.118+0000 7ff92a000640 1 -- 172.21.15.31:0/592921062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9240cbce0 msgr2=0x7ff9240c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:29.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.118+0000 7ff92a000640 1 --2- 172.21.15.31:0/592921062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9240cbce0 0x7ff9240c79c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff90c011ae0 tx=0x7ff90c009ea0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.118+0000 7ff92a000640 1 -- 172.21.15.31:0/592921062 shutdown_connections 2024-09-17T05:33:29.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.118+0000 7ff92a000640 1 --2- 172.21.15.31:0/592921062 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff900073350 0x7ff900075810 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.118+0000 7ff92a000640 1 --2- 172.21.15.31:0/592921062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9240b1e10 0x7ff9240b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.118+0000 7ff92a000640 1 --2- 172.21.15.31:0/592921062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9240cbce0 0x7ff9240c79c0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.118+0000 7ff92a000640 1 --2- 172.21.15.31:0/592921062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff908004d50 0x7ff9241f25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.118+0000 7ff92a000640 1 -- 172.21.15.31:0/592921062 >> 172.21.15.31:0/592921062 conn(0x7ff9240d1dc0 msgr2=0x7ff92415a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:29.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.118+0000 7ff92a000640 1 -- 172.21.15.31:0/592921062 shutdown_connections 2024-09-17T05:33:29.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.118+0000 7ff92a000640 1 -- 172.21.15.31:0/592921062 wait complete. 2024-09-17T05:33:29.140 INFO:tasks.cephfs_test_runner:Test the creating vols, subvols subvolgroups fails when their names uses ... ok 2024-09-17T05:33:29.141 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- theme continues... 2024-09-17T05:33:29.141 INFO:tasks.cephfs_test_runner:test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:33:29.141 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:33:29.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.286+0000 7f760d800640 1 -- 172.21.15.31:0/2394616938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f760815be80 msgr2=0x7f76080ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:29.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.286+0000 7f760d800640 1 --2- 172.21.15.31:0/2394616938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f760815be80 0x7f76080ce4e0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f75f8009840 tx=0x7f75f801c820 comp rx=0 tx=0).stop 2024-09-17T05:33:29.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.286+0000 7f760d800640 1 -- 172.21.15.31:0/2394616938 shutdown_connections 2024-09-17T05:33:29.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.286+0000 7f760d800640 1 --2- 172.21.15.31:0/2394616938 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76080d28c0 0x7f76080cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.286+0000 7f760d800640 1 --2- 172.21.15.31:0/2394616938 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f760815be80 0x7f76080ce4e0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.286+0000 7f760d800640 1 -- 172.21.15.31:0/2394616938 >> 172.21.15.31:0/2394616938 conn(0x7f76080d1da0 msgr2=0x7f76080d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:29.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.286+0000 7f760d800640 1 -- 172.21.15.31:0/2394616938 shutdown_connections 2024-09-17T05:33:29.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.286+0000 7f760d800640 1 -- 172.21.15.31:0/2394616938 wait complete. 2024-09-17T05:33:29.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.286+0000 7f760d800640 1 Processor -- start 2024-09-17T05:33:29.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.286+0000 7f760d800640 1 -- start start 2024-09-17T05:33:29.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.286+0000 7f760d800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76080b53f0 0x7f76080c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:29.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.286+0000 7f760d800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76080d28c0 0x7f76080cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:29.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.286+0000 7f760d800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f760815be80 0x7f76081fb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:29.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f760d800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7608169190 con 0x7f76080b53f0 2024-09-17T05:33:29.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f760d800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7608169010 con 0x7f760815be80 2024-09-17T05:33:29.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f760d800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7608169310 con 0x7f76080d28c0 2024-09-17T05:33:29.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f7606a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76080b53f0 0x7f76080c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:29.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f7606a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76080b53f0 0x7f76080c7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37712/0 (socket says 172.21.15.31:37712) 2024-09-17T05:33:29.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f7606a00640 1 -- 172.21.15.31:0/3660080810 learned_addr learned my addr 172.21.15.31:0/3660080810 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:29.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f75ffe00640 1 --2- 172.21.15.31:0/3660080810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76080d28c0 0x7f76080cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:29.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f7607400640 1 --2- 172.21.15.31:0/3660080810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f760815be80 0x7f76081fb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:29.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f7606a00640 1 -- 172.21.15.31:0/3660080810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76080d28c0 msgr2=0x7f76080cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:29.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f7606a00640 1 --2- 172.21.15.31:0/3660080810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76080d28c0 0x7f76080cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f7606a00640 1 -- 172.21.15.31:0/3660080810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f760815be80 msgr2=0x7f76081fb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:29.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f7606a00640 1 --2- 172.21.15.31:0/3660080810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f760815be80 0x7f76081fb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f7606a00640 1 -- 172.21.15.31:0/3660080810 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f760815a8c0 con 0x7f76080b53f0 2024-09-17T05:33:29.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f7606a00640 1 --2- 172.21.15.31:0/3660080810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76080b53f0 0x7f76080c7360 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f75f8009790 tx=0x7f75f8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:29.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f75fea00640 1 -- 172.21.15.31:0/3660080810 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f80be070 con 0x7f76080b53f0 2024-09-17T05:33:29.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f75fea00640 1 -- 172.21.15.31:0/3660080810 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75f8005070 con 0x7f76080b53f0 2024-09-17T05:33:29.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f75fea00640 1 -- 172.21.15.31:0/3660080810 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f8005460 con 0x7f76080b53f0 2024-09-17T05:33:29.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f760d800640 1 -- 172.21.15.31:0/3660080810 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76080c7e20 con 0x7f76080b53f0 2024-09-17T05:33:29.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f760d800640 1 -- 172.21.15.31:0/3660080810 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76080c86c0 con 0x7f76080b53f0 2024-09-17T05:33:29.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f760d800640 1 -- 172.21.15.31:0/3660080810 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76080c8210 con 0x7f76080b53f0 2024-09-17T05:33:29.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.290+0000 7f75fea00640 1 -- 172.21.15.31:0/3660080810 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f75f80c1070 con 0x7f76080b53f0 2024-09-17T05:33:29.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.294+0000 7f75fea00640 1 --2- 172.21.15.31:0/3660080810 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f75e4073320 0x7f75e40757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:29.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.294+0000 7f75fea00640 1 -- 172.21.15.31:0/3660080810 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5029+0+0 (secure 0 0 0) 0x7f75f812e6a0 con 0x7f76080b53f0 2024-09-17T05:33:29.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.294+0000 7f75ffe00640 1 --2- 172.21.15.31:0/3660080810 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f75e4073320 0x7f75e40757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:29.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.294+0000 7f75ffe00640 1 --2- 172.21.15.31:0/3660080810 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f75e4073320 0x7f75e40757e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f75f0006fd0 tx=0x7f75f0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:29.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.298+0000 7f75fea00640 1 -- 172.21.15.31:0/3660080810 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f760815a8c0 con 0x7f76080b53f0 2024-09-17T05:33:29.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.474+0000 7f760d800640 1 -- 172.21.15.31:0/3660080810 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76080b5860 con 0x7f76080b53f0 2024-09-17T05:33:29.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.474+0000 7f75fea00640 1 -- 172.21.15.31:0/3660080810 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+13189 (secure 0 0 0) 0x7f75f8016410 con 0x7f76080b53f0 2024-09-17T05:33:29.476 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:29.476 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":92,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:33:28.108000+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6834/1737412276":"2024-09-18T05:33:25.096725+0000","172.21.15.31:6832/1737412276":"2024-09-18T05:33:25.096725+0000","172.21.15.155:6835/2426776304":"2024-09-18T05:33:18.024058+0000","172.21.15.155:6834/2426776304":"2024-09-18T05:33:18.024058+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:33:29.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.478+0000 7f760d800640 1 -- 172.21.15.31:0/3660080810 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f75e4073320 msgr2=0x7f75e40757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:29.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.478+0000 7f760d800640 1 --2- 172.21.15.31:0/3660080810 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f75e4073320 0x7f75e40757e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f75f0006fd0 tx=0x7f75f0008040 comp rx=0 tx=0).stop 2024-09-17T05:33:29.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.478+0000 7f760d800640 1 -- 172.21.15.31:0/3660080810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76080b53f0 msgr2=0x7f76080c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:29.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.478+0000 7f760d800640 1 --2- 172.21.15.31:0/3660080810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76080b53f0 0x7f76080c7360 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f75f8009790 tx=0x7f75f8004040 comp rx=0 tx=0).stop 2024-09-17T05:33:29.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.478+0000 7f760d800640 1 -- 172.21.15.31:0/3660080810 shutdown_connections 2024-09-17T05:33:29.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.478+0000 7f760d800640 1 --2- 172.21.15.31:0/3660080810 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f75e4073320 0x7f75e40757e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.478+0000 7f760d800640 1 --2- 172.21.15.31:0/3660080810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f760815be80 0x7f76081fb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.478+0000 7f760d800640 1 --2- 172.21.15.31:0/3660080810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76080d28c0 0x7f76080cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.478+0000 7f760d800640 1 --2- 172.21.15.31:0/3660080810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76080b53f0 0x7f76080c7360 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.478+0000 7f760d800640 1 -- 172.21.15.31:0/3660080810 >> 172.21.15.31:0/3660080810 conn(0x7f76080d1da0 msgr2=0x7f7608071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:29.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.478+0000 7f760d800640 1 -- 172.21.15.31:0/3660080810 shutdown_connections 2024-09-17T05:33:29.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.478+0000 7f760d800640 1 -- 172.21.15.31:0/3660080810 wait complete. 2024-09-17T05:33:29.499 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:28:33.209612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:33:29.499 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:33:29.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.646+0000 7f86c5e00640 1 -- 172.21.15.31:0/2526725759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c015ff50 msgr2=0x7f86c006f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:29.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.646+0000 7f86c5e00640 1 --2- 172.21.15.31:0/2526725759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c015ff50 0x7f86c006f090 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009840 tx=0x7f86a801c800 comp rx=0 tx=0).stop 2024-09-17T05:33:29.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.646+0000 7f86c5e00640 1 -- 172.21.15.31:0/2526725759 shutdown_connections 2024-09-17T05:33:29.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.646+0000 7f86c5e00640 1 --2- 172.21.15.31:0/2526725759 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86c00c6b00 0x7f86c006d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.646+0000 7f86c5e00640 1 --2- 172.21.15.31:0/2526725759 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c015ff50 0x7f86c006f090 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.646+0000 7f86c5e00640 1 -- 172.21.15.31:0/2526725759 >> 172.21.15.31:0/2526725759 conn(0x7f86c00cce90 msgr2=0x7f86c00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:29.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.646+0000 7f86c5e00640 1 -- 172.21.15.31:0/2526725759 shutdown_connections 2024-09-17T05:33:29.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.646+0000 7f86c5e00640 1 -- 172.21.15.31:0/2526725759 wait complete. 2024-09-17T05:33:29.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86c5e00640 1 Processor -- start 2024-09-17T05:33:29.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86c5e00640 1 -- start start 2024-09-17T05:33:29.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86c5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c00c6b00 0x7f86c0144a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:29.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86c5e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86c0152b90 0x7f86c00c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:29.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86c5e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c015ff50 0x7f86c00c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:29.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86c5e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f86c0168bc0 con 0x7f86c00c6b00 2024-09-17T05:33:29.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86c5e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f86c0074040 con 0x7f86c015ff50 2024-09-17T05:33:29.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86c5e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f86c0168d40 con 0x7f86c0152b90 2024-09-17T05:33:29.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86bea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c00c6b00 0x7f86c0144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:29.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86bea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c00c6b00 0x7f86c0144a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37716/0 (socket says 172.21.15.31:37716) 2024-09-17T05:33:29.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86bea00640 1 -- 172.21.15.31:0/4162784575 learned_addr learned my addr 172.21.15.31:0/4162784575 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:29.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86bf400640 1 --2- 172.21.15.31:0/4162784575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c015ff50 0x7f86c00c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:29.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86b7e00640 1 --2- 172.21.15.31:0/4162784575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86c0152b90 0x7f86c00c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:29.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86bea00640 1 -- 172.21.15.31:0/4162784575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86c0152b90 msgr2=0x7f86c00c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:29.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86bea00640 1 --2- 172.21.15.31:0/4162784575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86c0152b90 0x7f86c00c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86bea00640 1 -- 172.21.15.31:0/4162784575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c015ff50 msgr2=0x7f86c00c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:29.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86bea00640 1 --2- 172.21.15.31:0/4162784575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c015ff50 0x7f86c00c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86bea00640 1 -- 172.21.15.31:0/4162784575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c00b0150 con 0x7f86c00c6b00 2024-09-17T05:33:29.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86bea00640 1 --2- 172.21.15.31:0/4162784575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c00c6b00 0x7f86c0144a20 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f86b000c450 tx=0x7f86b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:29.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86b7400640 1 -- 172.21.15.31:0/4162784575 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b0016020 con 0x7f86c00c6b00 2024-09-17T05:33:29.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86b7400640 1 -- 172.21.15.31:0/4162784575 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f86b0012920 con 0x7f86c00c6b00 2024-09-17T05:33:29.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86b7400640 1 -- 172.21.15.31:0/4162784575 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b0012d70 con 0x7f86c00c6b00 2024-09-17T05:33:29.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86c5e00640 1 -- 172.21.15.31:0/4162784575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c00b2a10 con 0x7f86c00c6b00 2024-09-17T05:33:29.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.650+0000 7f86c5e00640 1 -- 172.21.15.31:0/4162784575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c00b0410 con 0x7f86c00c6b00 2024-09-17T05:33:29.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.654+0000 7f86c5e00640 1 -- 172.21.15.31:0/4162784575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c006d630 con 0x7f86c00c6b00 2024-09-17T05:33:29.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.654+0000 7f86b7400640 1 -- 172.21.15.31:0/4162784575 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f86b0019020 con 0x7f86c00c6b00 2024-09-17T05:33:29.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.654+0000 7f86b7400640 1 --2- 172.21.15.31:0/4162784575 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f869c073320 0x7f869c0757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:29.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.654+0000 7f86b7400640 1 -- 172.21.15.31:0/4162784575 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5029+0+0 (secure 0 0 0) 0x7f86b0093e30 con 0x7f86c00c6b00 2024-09-17T05:33:29.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.654+0000 7f86b7e00640 1 --2- 172.21.15.31:0/4162784575 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f869c073320 0x7f869c0757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:29.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.654+0000 7f86b7e00640 1 --2- 172.21.15.31:0/4162784575 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f869c073320 0x7f869c0757e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f86a80ae000 tx=0x7f86a801b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:29.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.658+0000 7f86b7400640 1 -- 172.21.15.31:0/4162784575 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f86b0020030 con 0x7f86c00c6b00 2024-09-17T05:33:29.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.834+0000 7f86c5e00640 1 -- 172.21.15.31:0/4162784575 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f86c015eac0 con 0x7f86c00c6b00 2024-09-17T05:33:29.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.834+0000 7f86b7400640 1 -- 172.21.15.31:0/4162784575 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) ==== 93+0+10 (secure 0 0 0) 0x7f86b005e870 con 0x7f86c00c6b00 2024-09-17T05:33:29.837 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-09-17T05:33:29.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.838+0000 7f86c5e00640 1 -- 172.21.15.31:0/4162784575 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f869c073320 msgr2=0x7f869c0757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:29.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.838+0000 7f86c5e00640 1 --2- 172.21.15.31:0/4162784575 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f869c073320 0x7f869c0757e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f86a80ae000 tx=0x7f86a801b040 comp rx=0 tx=0).stop 2024-09-17T05:33:29.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.838+0000 7f86c5e00640 1 -- 172.21.15.31:0/4162784575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c00c6b00 msgr2=0x7f86c0144a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:29.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.838+0000 7f86c5e00640 1 --2- 172.21.15.31:0/4162784575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c00c6b00 0x7f86c0144a20 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f86b000c450 tx=0x7f86b000c910 comp rx=0 tx=0).stop 2024-09-17T05:33:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.838+0000 7f86c5e00640 1 -- 172.21.15.31:0/4162784575 shutdown_connections 2024-09-17T05:33:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.838+0000 7f86c5e00640 1 --2- 172.21.15.31:0/4162784575 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f869c073320 0x7f869c0757e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.838+0000 7f86c5e00640 1 --2- 172.21.15.31:0/4162784575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c015ff50 0x7f86c00c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.838+0000 7f86c5e00640 1 --2- 172.21.15.31:0/4162784575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86c0152b90 0x7f86c00c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.838+0000 7f86c5e00640 1 --2- 172.21.15.31:0/4162784575 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f86c00c6b00 0x7f86c0144a20 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.838+0000 7f86c5e00640 1 -- 172.21.15.31:0/4162784575 >> 172.21.15.31:0/4162784575 conn(0x7f86c00cce90 msgr2=0x7f86c015d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.838+0000 7f86c5e00640 1 -- 172.21.15.31:0/4162784575 shutdown_connections 2024-09-17T05:33:29.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:29.838+0000 7f86c5e00640 1 -- 172.21.15.31:0/4162784575 wait complete. 2024-09-17T05:33:29.858 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity' 2024-09-17T05:33:30.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.002+0000 7f9076a00640 1 -- 172.21.15.31:0/1406028797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f907015f000 msgr2=0x7f90700d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:30.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.002+0000 7f9076a00640 1 --2- 172.21.15.31:0/1406028797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f907015f000 0x7f90700d01b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9064009840 tx=0x7f906401c790 comp rx=0 tx=0).stop 2024-09-17T05:33:30.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.002+0000 7f9076a00640 1 -- 172.21.15.31:0/1406028797 shutdown_connections 2024-09-17T05:33:30.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.002+0000 7f9076a00640 1 --2- 172.21.15.31:0/1406028797 >> v2:172.21.15.155:3300/0 conn(0x7f90700cefb0 0x7f90700cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:30.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.002+0000 7f9076a00640 1 --2- 172.21.15.31:0/1406028797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f907015f000 0x7f90700d01b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:30.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.002+0000 7f9076a00640 1 -- 172.21.15.31:0/1406028797 >> 172.21.15.31:0/1406028797 conn(0x7f907009aa10 msgr2=0x7f907009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:30.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.002+0000 7f9076a00640 1 -- 172.21.15.31:0/1406028797 shutdown_connections 2024-09-17T05:33:30.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.002+0000 7f9076a00640 1 -- 172.21.15.31:0/1406028797 wait complete. 2024-09-17T05:33:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076a00640 1 Processor -- start 2024-09-17T05:33:30.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076a00640 1 -- start start 2024-09-17T05:33:30.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90700ccaf0 0x7f9070159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:30.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90700cefb0 0x7f90700c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:30.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f907015f000 0x7f90700c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:30.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9070169290 con 0x7f907015f000 2024-09-17T05:33:30.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9070169110 con 0x7f90700ccaf0 2024-09-17T05:33:30.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9070169410 con 0x7f90700cefb0 2024-09-17T05:33:30.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f907015f000 0x7f90700c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:30.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f907015f000 0x7f90700c6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37730/0 (socket says 172.21.15.31:37730) 2024-09-17T05:33:30.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076000640 1 -- 172.21.15.31:0/1276046516 learned_addr learned my addr 172.21.15.31:0/1276046516 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:30.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9075600640 1 --2- 172.21.15.31:0/1276046516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90700ccaf0 0x7f9070159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:30.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9074c00640 1 --2- 172.21.15.31:0/1276046516 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90700cefb0 0x7f90700c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:30.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076000640 1 -- 172.21.15.31:0/1276046516 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90700cefb0 msgr2=0x7f90700c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:30.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076000640 1 --2- 172.21.15.31:0/1276046516 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90700cefb0 0x7f90700c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:30.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076000640 1 -- 172.21.15.31:0/1276046516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90700ccaf0 msgr2=0x7f9070159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:30.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076000640 1 --2- 172.21.15.31:0/1276046516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90700ccaf0 0x7f9070159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:30.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076000640 1 -- 172.21.15.31:0/1276046516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90700c6f20 con 0x7f907015f000 2024-09-17T05:33:30.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076000640 1 --2- 172.21.15.31:0/1276046516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f907015f000 0x7f90700c6930 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f906800c7c0 tx=0x7f906800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:30.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f906d600640 1 -- 172.21.15.31:0/1276046516 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9068003b80 con 0x7f907015f000 2024-09-17T05:33:30.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f906d600640 1 -- 172.21.15.31:0/1276046516 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9068003d20 con 0x7f907015f000 2024-09-17T05:33:30.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f906d600640 1 -- 172.21.15.31:0/1276046516 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906800aab0 con 0x7f907015f000 2024-09-17T05:33:30.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076a00640 1 -- 172.21.15.31:0/1276046516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90700b4c30 con 0x7f907015f000 2024-09-17T05:33:30.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.006+0000 7f9076a00640 1 -- 172.21.15.31:0/1276046516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90700b51f0 con 0x7f907015f000 2024-09-17T05:33:30.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.010+0000 7f9076a00640 1 -- 172.21.15.31:0/1276046516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90700b53f0 con 0x7f907015f000 2024-09-17T05:33:30.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.010+0000 7f906d600640 1 -- 172.21.15.31:0/1276046516 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f906800ac50 con 0x7f907015f000 2024-09-17T05:33:30.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.010+0000 7f906d600640 1 --2- 172.21.15.31:0/1276046516 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9050073350 0x7f9050075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:30.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.010+0000 7f906d600640 1 -- 172.21.15.31:0/1276046516 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5029+0+0 (secure 0 0 0) 0x7f9068094100 con 0x7f907015f000 2024-09-17T05:33:30.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.010+0000 7f9075600640 1 --2- 172.21.15.31:0/1276046516 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9050073350 0x7f9050075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:30.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.010+0000 7f9075600640 1 --2- 172.21.15.31:0/1276046516 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9050073350 0x7f9050075810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f90640ae000 tx=0x7f90640aa040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:30.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.014+0000 7f906d600640 1 -- 172.21.15.31:0/1276046516 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f90700b53f0 con 0x7f907015f000 2024-09-17T05:33:30.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:30.254+0000 7f9076a00640 1 -- 172.21.15.31:0/1276046516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]} v 0) -- 0x7f90700cc5b0 con 0x7f907015f000 2024-09-17T05:33:31.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.126+0000 7f906d600640 1 -- 172.21.15.31:0/1276046516 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]}]=0 v268) ==== 152+0+0 (secure 0 0 0) 0x7f906805f190 con 0x7f907015f000 2024-09-17T05:33:31.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.130+0000 7f9076a00640 1 -- 172.21.15.31:0/1276046516 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9050073350 msgr2=0x7f9050075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:31.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.130+0000 7f9076a00640 1 --2- 172.21.15.31:0/1276046516 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9050073350 0x7f9050075810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f90640ae000 tx=0x7f90640aa040 comp rx=0 tx=0).stop 2024-09-17T05:33:31.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.130+0000 7f9076a00640 1 -- 172.21.15.31:0/1276046516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f907015f000 msgr2=0x7f90700c6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:31.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.130+0000 7f9076a00640 1 --2- 172.21.15.31:0/1276046516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f907015f000 0x7f90700c6930 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f906800c7c0 tx=0x7f906800cc80 comp rx=0 tx=0).stop 2024-09-17T05:33:31.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.130+0000 7f9076a00640 1 -- 172.21.15.31:0/1276046516 shutdown_connections 2024-09-17T05:33:31.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.130+0000 7f9076a00640 1 --2- 172.21.15.31:0/1276046516 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9050073350 0x7f9050075810 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.130+0000 7f9076a00640 1 --2- 172.21.15.31:0/1276046516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f907015f000 0x7f90700c6930 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.130+0000 7f9076a00640 1 --2- 172.21.15.31:0/1276046516 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f90700cefb0 0x7f90700c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.130+0000 7f9076a00640 1 --2- 172.21.15.31:0/1276046516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f90700ccaf0 0x7f9070159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.130+0000 7f9076a00640 1 -- 172.21.15.31:0/1276046516 >> 172.21.15.31:0/1276046516 conn(0x7f907009aa10 msgr2=0x7f907015d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:31.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.130+0000 7f9076a00640 1 -- 172.21.15.31:0/1276046516 shutdown_connections 2024-09-17T05:33:31.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.130+0000 7f9076a00640 1 -- 172.21.15.31:0/1276046516 wait complete. 2024-09-17T05:33:31.155 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:33:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.306+0000 7fa6a0000640 1 -- 172.21.15.31:0/1949200708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa69806cc20 msgr2=0x7fa6980737c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.306+0000 7fa6a0000640 1 --2- 172.21.15.31:0/1949200708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa69806cc20 0x7fa6980737c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa68c009840 tx=0x7fa68c01c710 comp rx=0 tx=0).stop 2024-09-17T05:33:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.306+0000 7fa6a0000640 1 -- 172.21.15.31:0/1949200708 shutdown_connections 2024-09-17T05:33:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.306+0000 7fa6a0000640 1 --2- 172.21.15.31:0/1949200708 >> v2:172.21.15.155:3300/0 conn(0x7fa698071030 0x7fa6980714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.306+0000 7fa6a0000640 1 --2- 172.21.15.31:0/1949200708 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa69806cc20 0x7fa6980737c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.306+0000 7fa6a0000640 1 -- 172.21.15.31:0/1949200708 >> 172.21.15.31:0/1949200708 conn(0x7fa6980d0c90 msgr2=0x7fa6980d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.306+0000 7fa6a0000640 1 -- 172.21.15.31:0/1949200708 shutdown_connections 2024-09-17T05:33:31.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.306+0000 7fa6a0000640 1 -- 172.21.15.31:0/1949200708 wait complete. 2024-09-17T05:33:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.306+0000 7fa6a0000640 1 Processor -- start 2024-09-17T05:33:31.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.306+0000 7fa6a0000640 1 -- start start 2024-09-17T05:33:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa6a0000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa69806cc20 0x7fa6981551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa6a0000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa698071030 0x7fa6980b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa6a0000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa69815c1c0 0x7fa6980b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa6a0000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa698168f30 con 0x7fa69806cc20 2024-09-17T05:33:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa6a0000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa698168db0 con 0x7fa69815c1c0 2024-09-17T05:33:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa6a0000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa6981690b0 con 0x7fa698071030 2024-09-17T05:33:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa69d600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa69806cc20 0x7fa6981551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa69d600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa69806cc20 0x7fa6981551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37746/0 (socket says 172.21.15.31:37746) 2024-09-17T05:33:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa69d600640 1 -- 172.21.15.31:0/1360717960 learned_addr learned my addr 172.21.15.31:0/1360717960 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa69cc00640 1 --2- 172.21.15.31:0/1360717960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa698071030 0x7fa6980b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa69e000640 1 --2- 172.21.15.31:0/1360717960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa69815c1c0 0x7fa6980b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa69d600640 1 -- 172.21.15.31:0/1360717960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa698071030 msgr2=0x7fa6980b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa69d600640 1 --2- 172.21.15.31:0/1360717960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa698071030 0x7fa6980b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa69d600640 1 -- 172.21.15.31:0/1360717960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa69815c1c0 msgr2=0x7fa6980b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa69d600640 1 --2- 172.21.15.31:0/1360717960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa69815c1c0 0x7fa6980b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa69d600640 1 -- 172.21.15.31:0/1360717960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa698166790 con 0x7fa69806cc20 2024-09-17T05:33:31.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa69d600640 1 --2- 172.21.15.31:0/1360717960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa69806cc20 0x7fa6981551c0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fa68c01cbf0 tx=0x7fa68c005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa695600640 1 -- 172.21.15.31:0/1360717960 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c0ac070 con 0x7fa69806cc20 2024-09-17T05:33:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa695600640 1 -- 172.21.15.31:0/1360717960 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa68c0043e0 con 0x7fa69806cc20 2024-09-17T05:33:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa6a0000640 1 -- 172.21.15.31:0/1360717960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa698155890 con 0x7fa69806cc20 2024-09-17T05:33:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa695600640 1 -- 172.21.15.31:0/1360717960 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c0048f0 con 0x7fa69806cc20 2024-09-17T05:33:31.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa6a0000640 1 -- 172.21.15.31:0/1360717960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa698155f50 con 0x7fa69806cc20 2024-09-17T05:33:31.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.310+0000 7fa6a0000640 1 -- 172.21.15.31:0/1360717960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6980737c0 con 0x7fa69806cc20 2024-09-17T05:33:31.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.314+0000 7fa695600640 1 -- 172.21.15.31:0/1360717960 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fa68c0af070 con 0x7fa69806cc20 2024-09-17T05:33:31.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.314+0000 7fa695600640 1 --2- 172.21.15.31:0/1360717960 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa678073320 0x7fa6780757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:31.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.314+0000 7fa695600640 1 -- 172.21.15.31:0/1360717960 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5029+0+0 (secure 0 0 0) 0x7fa68c12e2c0 con 0x7fa69806cc20 2024-09-17T05:33:31.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.314+0000 7fa69cc00640 1 --2- 172.21.15.31:0/1360717960 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa678073320 0x7fa6780757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:31.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.314+0000 7fa69cc00640 1 --2- 172.21.15.31:0/1360717960 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa678073320 0x7fa6780757e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa6981fac50 tx=0x7fa684009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:31.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.318+0000 7fa695600640 1 -- 172.21.15.31:0/1360717960 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa68c0c1030 con 0x7fa69806cc20 2024-09-17T05:33:31.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.498+0000 7fa6a0000640 1 -- 172.21.15.31:0/1360717960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fa6980a1de0 con 0x7fa69806cc20 2024-09-17T05:33:31.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.498+0000 7fa695600640 1 -- 172.21.15.31:0/1360717960 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+1998 (secure 0 0 0) 0x7fa68c016330 con 0x7fa69806cc20 2024-09-17T05:33:31.500 INFO:teuthology.orchestra.run.smithi031.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:33:31.500 INFO:teuthology.orchestra.run.smithi031.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:33:31.500 INFO:teuthology.orchestra.run.smithi031.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:33:31.500 INFO:teuthology.orchestra.run.smithi031.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:33:31.500 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6159.333103 2024-09-17T05:33:31.500 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4566.558105 2024-09-17T05:33:31.500 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4575.968427 2024-09-17T05:33:31.500 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4702.806393 2024-09-17T05:33:31.501 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4956.728274 2024-09-17T05:33:31.501 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 6604.257199 2024-09-17T05:33:31.501 INFO:teuthology.orchestra.run.smithi031.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4779.165073 2024-09-17T05:33:31.501 INFO:teuthology.orchestra.run.smithi031.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4673.795919 2024-09-17T05:33:31.501 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds 20/20 2024-09-17T05:33:31.501 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:33:31.501 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_ms 2/2 2024-09-17T05:33:31.501 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_frag true 2024-09-17T05:33:31.501 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:33:31.501 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:33:31.501 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_verify_scatter true 2024-09-17T05:33:31.501 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:33:31.502 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:33:31.502 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:33:31.502 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced client_mount_timeout 600 2024-09-17T05:33:31.502 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_client 20/20 2024-09-17T05:33:31.502 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_ms 1/1 2024-09-17T05:33:31.502 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:33:31.502 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:33:31.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.502+0000 7fa6a0000640 1 -- 172.21.15.31:0/1360717960 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa678073320 msgr2=0x7fa6780757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:31.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.502+0000 7fa6a0000640 1 --2- 172.21.15.31:0/1360717960 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa678073320 0x7fa6780757e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa6981fac50 tx=0x7fa684009040 comp rx=0 tx=0).stop 2024-09-17T05:33:31.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.502+0000 7fa6a0000640 1 -- 172.21.15.31:0/1360717960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa69806cc20 msgr2=0x7fa6981551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:31.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.502+0000 7fa6a0000640 1 --2- 172.21.15.31:0/1360717960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa69806cc20 0x7fa6981551c0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fa68c01cbf0 tx=0x7fa68c005750 comp rx=0 tx=0).stop 2024-09-17T05:33:31.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.502+0000 7fa6a0000640 1 -- 172.21.15.31:0/1360717960 shutdown_connections 2024-09-17T05:33:31.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.502+0000 7fa6a0000640 1 --2- 172.21.15.31:0/1360717960 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa678073320 0x7fa6780757e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.502+0000 7fa6a0000640 1 --2- 172.21.15.31:0/1360717960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa69815c1c0 0x7fa6980b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.502+0000 7fa6a0000640 1 --2- 172.21.15.31:0/1360717960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa698071030 0x7fa6980b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.502+0000 7fa6a0000640 1 --2- 172.21.15.31:0/1360717960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa69806cc20 0x7fa6981551c0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.502+0000 7fa6a0000640 1 -- 172.21.15.31:0/1360717960 >> 172.21.15.31:0/1360717960 conn(0x7fa6980d0c90 msgr2=0x7fa6980c71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:31.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.502+0000 7fa6a0000640 1 -- 172.21.15.31:0/1360717960 shutdown_connections 2024-09-17T05:33:31.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.502+0000 7fa6a0000640 1 -- 172.21.15.31:0/1360717960 wait complete. 2024-09-17T05:33:31.522 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:33:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.670+0000 7f6307a00640 1 -- 172.21.15.31:0/3862995753 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63000b1650 msgr2=0x7f63000b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.670+0000 7f6307a00640 1 --2- 172.21.15.31:0/3862995753 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63000b1650 0x7f63000b1a30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009900 tx=0x7f62ec01c8e0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.670+0000 7f6307a00640 1 -- 172.21.15.31:0/3862995753 shutdown_connections 2024-09-17T05:33:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.670+0000 7f6307a00640 1 --2- 172.21.15.31:0/3862995753 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63000b1650 0x7f63000b1a30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.670+0000 7f6307a00640 1 --2- 172.21.15.31:0/3862995753 >> v2:172.21.15.155:3300/0 conn(0x7f63001605d0 0x7f63000d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.670+0000 7f6307a00640 1 -- 172.21.15.31:0/3862995753 >> 172.21.15.31:0/3862995753 conn(0x7f63000d1dd0 msgr2=0x7f63000d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:31.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.670+0000 7f6307a00640 1 -- 172.21.15.31:0/3862995753 shutdown_connections 2024-09-17T05:33:31.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.670+0000 7f6307a00640 1 -- 172.21.15.31:0/3862995753 wait complete. 2024-09-17T05:33:31.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6307a00640 1 Processor -- start 2024-09-17T05:33:31.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6307a00640 1 -- start start 2024-09-17T05:33:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6307a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63000aeb00 0x7f6300156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6307a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63000b1650 0x7f63001567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6307a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63001605d0 0x7f630015caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6307a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f63000b0e50 con 0x7f63000aeb00 2024-09-17T05:33:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6307a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f63000b0cd0 con 0x7f63000b1650 2024-09-17T05:33:31.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6307a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f63000b1220 con 0x7f63001605d0 2024-09-17T05:33:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6305000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63000aeb00 0x7f6300156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6305000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63000aeb00 0x7f6300156260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37750/0 (socket says 172.21.15.31:37750) 2024-09-17T05:33:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6305000640 1 -- 172.21.15.31:0/707989852 learned_addr learned my addr 172.21.15.31:0/707989852 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f62ffe00640 1 --2- 172.21.15.31:0/707989852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63000b1650 0x7f63001567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6305a00640 1 --2- 172.21.15.31:0/707989852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63001605d0 0x7f630015caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6305000640 1 -- 172.21.15.31:0/707989852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63001605d0 msgr2=0x7f630015caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6305000640 1 --2- 172.21.15.31:0/707989852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63001605d0 0x7f630015caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6305000640 1 -- 172.21.15.31:0/707989852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63000b1650 msgr2=0x7f63001567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6305000640 1 --2- 172.21.15.31:0/707989852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63000b1650 0x7f63001567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6305000640 1 -- 172.21.15.31:0/707989852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63001576e0 con 0x7f63000aeb00 2024-09-17T05:33:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f62ffe00640 1 --2- 172.21.15.31:0/707989852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63000b1650 0x7f63001567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6305000640 1 --2- 172.21.15.31:0/707989852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63000aeb00 0x7f6300156260 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f62f400e970 tx=0x7f62f400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:31.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f62fcc00640 1 -- 172.21.15.31:0/707989852 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f400cd80 con 0x7f63000aeb00 2024-09-17T05:33:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f62fcc00640 1 -- 172.21.15.31:0/707989852 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62f4004020 con 0x7f63000aeb00 2024-09-17T05:33:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6307a00640 1 -- 172.21.15.31:0/707989852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f630006e8c0 con 0x7f63000aeb00 2024-09-17T05:33:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f62fcc00640 1 -- 172.21.15.31:0/707989852 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f4004470 con 0x7f63000aeb00 2024-09-17T05:33:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.674+0000 7f6307a00640 1 -- 172.21.15.31:0/707989852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f630006ee80 con 0x7f63000aeb00 2024-09-17T05:33:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.678+0000 7f6307a00640 1 -- 172.21.15.31:0/707989852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63000b1a30 con 0x7f63000aeb00 2024-09-17T05:33:31.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.678+0000 7f62fcc00640 1 -- 172.21.15.31:0/707989852 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f62f4003600 con 0x7f63000aeb00 2024-09-17T05:33:31.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.678+0000 7f62fcc00640 1 --2- 172.21.15.31:0/707989852 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f62e0073320 0x7f62e00757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:31.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.678+0000 7f62fcc00640 1 -- 172.21.15.31:0/707989852 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5029+0+0 (secure 0 0 0) 0x7f62f4094b60 con 0x7f63000aeb00 2024-09-17T05:33:31.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.678+0000 7f62ffe00640 1 --2- 172.21.15.31:0/707989852 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f62e0073320 0x7f62e00757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:31.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.678+0000 7f62ffe00640 1 --2- 172.21.15.31:0/707989852 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f62e0073320 0x7f62e00757e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0af000 tx=0x7f62ec01b120 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:31.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.682+0000 7f62fcc00640 1 -- 172.21.15.31:0/707989852 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f62f405fc90 con 0x7f63000aeb00 2024-09-17T05:33:31.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.858+0000 7f6307a00640 1 -- 172.21.15.31:0/707989852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f63000ce6e0 con 0x7f63000aeb00 2024-09-17T05:33:31.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.862+0000 7f62fcc00640 1 -- 172.21.15.31:0/707989852 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f62f405f590 con 0x7f63000aeb00 2024-09-17T05:33:31.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.862+0000 7f6307a00640 1 -- 172.21.15.31:0/707989852 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f62e0073320 msgr2=0x7f62e00757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:31.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.862+0000 7f6307a00640 1 --2- 172.21.15.31:0/707989852 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f62e0073320 0x7f62e00757e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0af000 tx=0x7f62ec01b120 comp rx=0 tx=0).stop 2024-09-17T05:33:31.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.862+0000 7f6307a00640 1 -- 172.21.15.31:0/707989852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63000aeb00 msgr2=0x7f6300156260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:31.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.862+0000 7f6307a00640 1 --2- 172.21.15.31:0/707989852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63000aeb00 0x7f6300156260 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f62f400e970 tx=0x7f62f400ee30 comp rx=0 tx=0).stop 2024-09-17T05:33:31.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.862+0000 7f6307a00640 1 -- 172.21.15.31:0/707989852 shutdown_connections 2024-09-17T05:33:31.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.862+0000 7f6307a00640 1 --2- 172.21.15.31:0/707989852 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f62e0073320 0x7f62e00757e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.862+0000 7f6307a00640 1 --2- 172.21.15.31:0/707989852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f63001605d0 0x7f630015caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.862+0000 7f6307a00640 1 --2- 172.21.15.31:0/707989852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f63000b1650 0x7f63001567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.862+0000 7f6307a00640 1 --2- 172.21.15.31:0/707989852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63000aeb00 0x7f6300156260 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:31.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.862+0000 7f6307a00640 1 -- 172.21.15.31:0/707989852 >> 172.21.15.31:0/707989852 conn(0x7f63000d1dd0 msgr2=0x7f63000711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:31.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.862+0000 7f6307a00640 1 -- 172.21.15.31:0/707989852 shutdown_connections 2024-09-17T05:33:31.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:31.862+0000 7f6307a00640 1 -- 172.21.15.31:0/707989852 wait complete. 2024-09-17T05:33:31.885 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:33:31.885 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:33:31.992 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:33:32.088 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:33:32.089 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:33:32.089 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:32.098 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:33:32.098 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:33:32.098 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:32.107 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:33:32.108 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:33:32.108 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:32.150 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:33:32.150 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:33:32.150 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:32.161 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:33:32.161 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:33:32.162 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:33:32.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.338+0000 7fb491000640 1 -- 172.21.15.31:0/2410530188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c15bea0 msgr2=0x7fb48c0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:32.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.338+0000 7fb491000640 1 --2- 172.21.15.31:0/2410530188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c15bea0 0x7fb48c0ce670 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb48c0745d0 tx=0x7fb47c01c8e0 comp rx=0 tx=0).stop 2024-09-17T05:33:32.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.338+0000 7fb491000640 1 -- 172.21.15.31:0/2410530188 shutdown_connections 2024-09-17T05:33:32.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.338+0000 7fb491000640 1 --2- 172.21.15.31:0/2410530188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb48c0d28e0 0x7fb48c0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:32.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.338+0000 7fb491000640 1 --2- 172.21.15.31:0/2410530188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c15bea0 0x7fb48c0ce670 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:32.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.338+0000 7fb491000640 1 -- 172.21.15.31:0/2410530188 >> 172.21.15.31:0/2410530188 conn(0x7fb48c0d1dc0 msgr2=0x7fb48c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:32.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.338+0000 7fb491000640 1 -- 172.21.15.31:0/2410530188 shutdown_connections 2024-09-17T05:33:32.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.338+0000 7fb491000640 1 -- 172.21.15.31:0/2410530188 wait complete. 2024-09-17T05:33:32.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb491000640 1 Processor -- start 2024-09-17T05:33:32.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb491000640 1 -- start start 2024-09-17T05:33:32.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb491000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb48c0cdb30 0x7fb48c150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:32.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb491000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c0d28e0 0x7fb48c0b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:32.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb491000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb48c15bea0 0x7fb48c0ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:32.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb491000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb48c168fc0 con 0x7fb48c0d28e0 2024-09-17T05:33:32.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb491000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb48c168e40 con 0x7fb48c15bea0 2024-09-17T05:33:32.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb491000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb48c169140 con 0x7fb48c0cdb30 2024-09-17T05:33:32.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb481400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c0d28e0 0x7fb48c0b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:32.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb481400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c0d28e0 0x7fb48c0b64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37778/0 (socket says 172.21.15.31:37778) 2024-09-17T05:33:32.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb481400640 1 -- 172.21.15.31:0/2357460419 learned_addr learned my addr 172.21.15.31:0/2357460419 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:32.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb489e00640 1 --2- 172.21.15.31:0/2357460419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb48c0cdb30 0x7fb48c150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:32.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb48a800640 1 --2- 172.21.15.31:0/2357460419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb48c15bea0 0x7fb48c0ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:32.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb481400640 1 -- 172.21.15.31:0/2357460419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb48c0cdb30 msgr2=0x7fb48c150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:32.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb481400640 1 --2- 172.21.15.31:0/2357460419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb48c0cdb30 0x7fb48c150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:32.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb481400640 1 -- 172.21.15.31:0/2357460419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb48c15bea0 msgr2=0x7fb48c0ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:32.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb481400640 1 --2- 172.21.15.31:0/2357460419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb48c15bea0 0x7fb48c0ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:32.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb481400640 1 -- 172.21.15.31:0/2357460419 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb48c0c9270 con 0x7fb48c0d28e0 2024-09-17T05:33:32.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb481400640 1 --2- 172.21.15.31:0/2357460419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c0d28e0 0x7fb48c0b64d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fb47400c490 tx=0x7fb474001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:32.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb482a00640 1 -- 172.21.15.31:0/2357460419 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb474017070 con 0x7fb48c0d28e0 2024-09-17T05:33:32.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb482a00640 1 -- 172.21.15.31:0/2357460419 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb474003600 con 0x7fb48c0d28e0 2024-09-17T05:33:32.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb482a00640 1 -- 172.21.15.31:0/2357460419 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb474003a90 con 0x7fb48c0d28e0 2024-09-17T05:33:32.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb491000640 1 -- 172.21.15.31:0/2357460419 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb48c0c9550 con 0x7fb48c0d28e0 2024-09-17T05:33:32.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb491000640 1 -- 172.21.15.31:0/2357460419 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb48c0c9b10 con 0x7fb48c0d28e0 2024-09-17T05:33:32.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.342+0000 7fb491000640 1 -- 172.21.15.31:0/2357460419 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb48c151160 con 0x7fb48c0d28e0 2024-09-17T05:33:32.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.346+0000 7fb482a00640 1 -- 172.21.15.31:0/2357460419 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fb47401a070 con 0x7fb48c0d28e0 2024-09-17T05:33:32.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.346+0000 7fb482a00640 1 --2- 172.21.15.31:0/2357460419 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb468073320 0x7fb4680757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:32.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.346+0000 7fb482a00640 1 -- 172.21.15.31:0/2357460419 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5029+0+0 (secure 0 0 0) 0x7fb474093490 con 0x7fb48c0d28e0 2024-09-17T05:33:32.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.346+0000 7fb489e00640 1 --2- 172.21.15.31:0/2357460419 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb468073320 0x7fb4680757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:32.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.346+0000 7fb489e00640 1 --2- 172.21.15.31:0/2357460419 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb468073320 0x7fb4680757e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0af000 tx=0x7fb47c0a7040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:32.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.350+0000 7fb482a00640 1 -- 172.21.15.31:0/2357460419 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb47405df60 con 0x7fb48c0d28e0 2024-09-17T05:33:32.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.562+0000 7fb491000640 1 -- 172.21.15.31:0/2357460419 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb48c06f7e0 con 0x7fb48c0d28e0 2024-09-17T05:33:32.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.562+0000 7fb482a00640 1 -- 172.21.15.31:0/2357460419 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+3917 (secure 0 0 0) 0x7fb474062990 con 0x7fb48c0d28e0 2024-09-17T05:33:32.565 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:32.565 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":64,"btime":"2024-09-17T05:33:26:100521+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2757206675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2757206675},{"type":"v1","addr":"172.21.15.31:6835","nonce":2757206675}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5771,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3287361734","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3287361734},{"type":"v1","addr":"172.21.15.155:6809","nonce":3287361734}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/1329190310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":1329190310},{"type":"v1","addr":"172.21.15.155:6835","nonce":1329190310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3767649229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3767649229},{"type":"v1","addr":"172.21.15.31:6834","nonce":3767649229}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[]} 2024-09-17T05:33:32.566 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 64 2024-09-17T05:33:32.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.566+0000 7fb491000640 1 -- 172.21.15.31:0/2357460419 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb468073320 msgr2=0x7fb4680757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:32.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.566+0000 7fb491000640 1 --2- 172.21.15.31:0/2357460419 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb468073320 0x7fb4680757e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0af000 tx=0x7fb47c0a7040 comp rx=0 tx=0).stop 2024-09-17T05:33:32.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.566+0000 7fb491000640 1 -- 172.21.15.31:0/2357460419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c0d28e0 msgr2=0x7fb48c0b64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:32.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.566+0000 7fb491000640 1 --2- 172.21.15.31:0/2357460419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c0d28e0 0x7fb48c0b64d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fb47400c490 tx=0x7fb474001e80 comp rx=0 tx=0).stop 2024-09-17T05:33:32.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.566+0000 7fb491000640 1 -- 172.21.15.31:0/2357460419 shutdown_connections 2024-09-17T05:33:32.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.566+0000 7fb491000640 1 --2- 172.21.15.31:0/2357460419 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb468073320 0x7fb4680757e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:32.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.566+0000 7fb491000640 1 --2- 172.21.15.31:0/2357460419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb48c15bea0 0x7fb48c0ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:32.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.566+0000 7fb491000640 1 --2- 172.21.15.31:0/2357460419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb48c0d28e0 0x7fb48c0b64d0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:32.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.566+0000 7fb491000640 1 --2- 172.21.15.31:0/2357460419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb48c0cdb30 0x7fb48c150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:32.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.566+0000 7fb491000640 1 -- 172.21.15.31:0/2357460419 >> 172.21.15.31:0/2357460419 conn(0x7fb48c0d1dc0 msgr2=0x7fb48c06f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:32.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.566+0000 7fb491000640 1 -- 172.21.15.31:0/2357460419 shutdown_connections 2024-09-17T05:33:32.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.566+0000 7fb491000640 1 -- 172.21.15.31:0/2357460419 wait complete. 2024-09-17T05:33:32.587 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:33:32.587 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:33:32.587 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:33:32.587 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:33:32.588 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:33:32.588 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:33:32.588 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:33:32.588 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:33:32.588 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:33:32.588 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:33:32.588 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:33:32.589 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:33:32.589 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:33:32.589 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:33:32.589 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:33:32.589 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:33:32.600 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:33:32.601 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:33:32.601 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:33:32.602 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:33:32.603 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:33:32.603 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:33:32.604 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:33:32.604 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:33:32.644 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:33:32.645 DEBUG:teuthology.parallel:result is None 2024-09-17T05:33:32.646 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:33:32.646 DEBUG:teuthology.parallel:result is None 2024-09-17T05:33:32.652 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:33:32.652 DEBUG:teuthology.parallel:result is None 2024-09-17T05:33:32.653 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:33:32.654 DEBUG:teuthology.parallel:result is None 2024-09-17T05:33:32.654 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:33:32.731 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-17T05:33:32.734 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-17T05:33:32.738 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-17T05:33:32.739 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-17T05:33:32.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.806+0000 7f4389400640 1 -- 172.21.15.31:0/3067051703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f438415f110 msgr2=0x7f43840af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:32.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.806+0000 7f4389400640 1 --2- 172.21.15.31:0/3067051703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f438415f110 0x7f43840af770 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4374009840 tx=0x7f437401c820 comp rx=0 tx=0).stop 2024-09-17T05:33:32.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.806+0000 7f4389400640 1 -- 172.21.15.31:0/3067051703 shutdown_connections 2024-09-17T05:33:32.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.806+0000 7f4389400640 1 --2- 172.21.15.31:0/3067051703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f438415f110 0x7f43840af770 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:32.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.806+0000 7f4389400640 1 -- 172.21.15.31:0/3067051703 >> 172.21.15.31:0/3067051703 conn(0x7f4384073490 msgr2=0x7f43840d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:32.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.806+0000 7f4389400640 1 -- 172.21.15.31:0/3067051703 shutdown_connections 2024-09-17T05:33:32.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.806+0000 7f4389400640 1 -- 172.21.15.31:0/3067051703 wait complete. 2024-09-17T05:33:32.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.806+0000 7f4389400640 1 Processor -- start 2024-09-17T05:33:32.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4389400640 1 -- start start 2024-09-17T05:33:32.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4389400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4384074a50 0x7f4384148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:32.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4389400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f438415f110 0x7f4384150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:32.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4389400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f438415f4f0 0x7f43840c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:32.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4389400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f43841695c0 con 0x7f4384074a50 2024-09-17T05:33:32.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4389400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4384169440 con 0x7f438415f110 2024-09-17T05:33:32.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4389400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4384169740 con 0x7f438415f4f0 2024-09-17T05:33:32.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4383e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4384074a50 0x7f4384148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:32.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4383e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4384074a50 0x7f4384148de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37810/0 (socket says 172.21.15.31:37810) 2024-09-17T05:33:32.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4383e00640 1 -- 172.21.15.31:0/1932865268 learned_addr learned my addr 172.21.15.31:0/1932865268 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:32.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4383e00640 1 -- 172.21.15.31:0/1932865268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f438415f4f0 msgr2=0x7f43840c4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:32.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4383e00640 1 --2- 172.21.15.31:0/1932865268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f438415f4f0 0x7f43840c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:32.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4383e00640 1 -- 172.21.15.31:0/1932865268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f438415f110 msgr2=0x7f4384150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:32.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4383e00640 1 --2- 172.21.15.31:0/1932865268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f438415f110 0x7f4384150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:32.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4383e00640 1 -- 172.21.15.31:0/1932865268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4384149320 con 0x7f4384074a50 2024-09-17T05:33:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4383e00640 1 --2- 172.21.15.31:0/1932865268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4384074a50 0x7f4384148de0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f4374009790 tx=0x7f43740a5610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f437be00640 1 -- 172.21.15.31:0/1932865268 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43740b2040 con 0x7f4384074a50 2024-09-17T05:33:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f437be00640 1 -- 172.21.15.31:0/1932865268 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43740043b0 con 0x7f4384074a50 2024-09-17T05:33:32.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4389400640 1 -- 172.21.15.31:0/1932865268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43841527f0 con 0x7f4384074a50 2024-09-17T05:33:32.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f437be00640 1 -- 172.21.15.31:0/1932865268 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4374005280 con 0x7f4384074a50 2024-09-17T05:33:32.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4389400640 1 -- 172.21.15.31:0/1932865268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4384152db0 con 0x7f4384074a50 2024-09-17T05:33:32.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.810+0000 7f4389400640 1 -- 172.21.15.31:0/1932865268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43840af770 con 0x7f4384074a50 2024-09-17T05:33:32.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.814+0000 7f437be00640 1 -- 172.21.15.31:0/1932865268 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f4374005420 con 0x7f4384074a50 2024-09-17T05:33:32.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.814+0000 7f437be00640 1 --2- 172.21.15.31:0/1932865268 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4364073320 0x7f43640757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:32.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.814+0000 7f437be00640 1 -- 172.21.15.31:0/1932865268 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5029+0+0 (secure 0 0 0) 0x7f437412d4e0 con 0x7f4384074a50 2024-09-17T05:33:32.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.814+0000 7f4383400640 1 --2- 172.21.15.31:0/1932865268 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4364073320 0x7f43640757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:32.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.814+0000 7f4383400640 1 --2- 172.21.15.31:0/1932865268 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4364073320 0x7f43640757e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4370000f70 tx=0x7f43700079c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:32.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:32.818+0000 7f437be00640 1 -- 172.21.15.31:0/1932865268 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4374016410 con 0x7f4384074a50 2024-09-17T05:33:33.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.002+0000 7f4389400640 1 -- 172.21.15.31:0/1932865268 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f4384073b60 con 0x7f4384074a50 2024-09-17T05:33:33.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.142+0000 7f437be00640 1 -- 172.21.15.31:0/1932865268 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v94) ==== 97+0+0 (secure 0 0 0) 0x7f43740f8580 con 0x7f4384074a50 2024-09-17T05:33:33.145 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2024-09-17T05:33:33.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.146+0000 7f4389400640 1 -- 172.21.15.31:0/1932865268 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4364073320 msgr2=0x7f43640757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:33.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.146+0000 7f4389400640 1 --2- 172.21.15.31:0/1932865268 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4364073320 0x7f43640757e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4370000f70 tx=0x7f43700079c0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.146+0000 7f4389400640 1 -- 172.21.15.31:0/1932865268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4384074a50 msgr2=0x7f4384148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:33.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.146+0000 7f4389400640 1 --2- 172.21.15.31:0/1932865268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4384074a50 0x7f4384148de0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f4374009790 tx=0x7f43740a5610 comp rx=0 tx=0).stop 2024-09-17T05:33:33.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.146+0000 7f4389400640 1 -- 172.21.15.31:0/1932865268 shutdown_connections 2024-09-17T05:33:33.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.146+0000 7f4389400640 1 --2- 172.21.15.31:0/1932865268 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4364073320 0x7f43640757e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.146+0000 7f4389400640 1 --2- 172.21.15.31:0/1932865268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f438415f4f0 0x7f43840c4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.146+0000 7f4389400640 1 --2- 172.21.15.31:0/1932865268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f438415f110 0x7f4384150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.146+0000 7f4389400640 1 --2- 172.21.15.31:0/1932865268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4384074a50 0x7f4384148de0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.146+0000 7f4389400640 1 -- 172.21.15.31:0/1932865268 >> 172.21.15.31:0/1932865268 conn(0x7f4384073490 msgr2=0x7f4384074340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:33.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.146+0000 7f4389400640 1 -- 172.21.15.31:0/1932865268 shutdown_connections 2024-09-17T05:33:33.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.146+0000 7f4389400640 1 -- 172.21.15.31:0/1932865268 wait complete. 2024-09-17T05:33:33.170 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:33:33.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.314+0000 7f7d63e00640 1 -- 172.21.15.31:0/3109811652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d5c15bea0 msgr2=0x7f7d5c0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:33.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.314+0000 7f7d63e00640 1 --2- 172.21.15.31:0/3109811652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d5c15bea0 0x7f7d5c0ce670 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f7d50009840 tx=0x7f7d5001c790 comp rx=0 tx=0).stop 2024-09-17T05:33:33.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.314+0000 7f7d63e00640 1 -- 172.21.15.31:0/3109811652 shutdown_connections 2024-09-17T05:33:33.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.314+0000 7f7d63e00640 1 --2- 172.21.15.31:0/3109811652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d5c15bea0 0x7f7d5c0ce670 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.314+0000 7f7d63e00640 1 -- 172.21.15.31:0/3109811652 >> 172.21.15.31:0/3109811652 conn(0x7f7d5c0d1dc0 msgr2=0x7f7d5c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:33.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.314+0000 7f7d63e00640 1 -- 172.21.15.31:0/3109811652 shutdown_connections 2024-09-17T05:33:33.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.314+0000 7f7d63e00640 1 -- 172.21.15.31:0/3109811652 wait complete. 2024-09-17T05:33:33.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d63e00640 1 Processor -- start 2024-09-17T05:33:33.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d63e00640 1 -- start start 2024-09-17T05:33:33.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d63e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d5c0cdb30 0x7f7d5c150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:33.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d63e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d5c0d28e0 0x7f7d5c0b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:33.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d63e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d5c15bea0 0x7f7d5c0b7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:33.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d63e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5c16a930 con 0x7f7d5c0cdb30 2024-09-17T05:33:33.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d63e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5c16a7b0 con 0x7f7d5c0d28e0 2024-09-17T05:33:33.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d63e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7d5c16aab0 con 0x7f7d5c15bea0 2024-09-17T05:33:33.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d61400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d5c0cdb30 0x7f7d5c150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:33.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d61400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d5c0cdb30 0x7f7d5c150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37828/0 (socket says 172.21.15.31:37828) 2024-09-17T05:33:33.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d61400640 1 -- 172.21.15.31:0/2021316223 learned_addr learned my addr 172.21.15.31:0/2021316223 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:33.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d60a00640 1 --2- 172.21.15.31:0/2021316223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d5c0d28e0 0x7f7d5c0b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:33.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d61e00640 1 --2- 172.21.15.31:0/2021316223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d5c15bea0 0x7f7d5c0b7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:33.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d61400640 1 -- 172.21.15.31:0/2021316223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d5c15bea0 msgr2=0x7f7d5c0b7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:33.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d61400640 1 --2- 172.21.15.31:0/2021316223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d5c15bea0 0x7f7d5c0b7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d61400640 1 -- 172.21.15.31:0/2021316223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d5c0d28e0 msgr2=0x7f7d5c0b72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:33.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d61400640 1 --2- 172.21.15.31:0/2021316223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d5c0d28e0 0x7f7d5c0b72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d61400640 1 -- 172.21.15.31:0/2021316223 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5c1508a0 con 0x7f7d5c0cdb30 2024-09-17T05:33:33.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d61e00640 1 --2- 172.21.15.31:0/2021316223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d5c15bea0 0x7f7d5c0b7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:33.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d61400640 1 --2- 172.21.15.31:0/2021316223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d5c0cdb30 0x7f7d5c150360 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f7d50000c10 tx=0x7f7d500a65a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:33.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d59600640 1 -- 172.21.15.31:0/2021316223 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50005030 con 0x7f7d5c0cdb30 2024-09-17T05:33:33.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d59600640 1 -- 172.21.15.31:0/2021316223 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d500051d0 con 0x7f7d5c0cdb30 2024-09-17T05:33:33.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d63e00640 1 -- 172.21.15.31:0/2021316223 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d5c154610 con 0x7f7d5c0cdb30 2024-09-17T05:33:33.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d59600640 1 -- 172.21.15.31:0/2021316223 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d500055c0 con 0x7f7d5c0cdb30 2024-09-17T05:33:33.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d63e00640 1 -- 172.21.15.31:0/2021316223 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d5c1525d0 con 0x7f7d5c0cdb30 2024-09-17T05:33:33.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.318+0000 7f7d63e00640 1 -- 172.21.15.31:0/2021316223 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d5c0d2340 con 0x7f7d5c0cdb30 2024-09-17T05:33:33.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.322+0000 7f7d59600640 1 -- 172.21.15.31:0/2021316223 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f7d500b8030 con 0x7f7d5c0cdb30 2024-09-17T05:33:33.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.322+0000 7f7d59600640 1 --2- 172.21.15.31:0/2021316223 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7d3c073350 0x7f7d3c075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:33.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.322+0000 7f7d59600640 1 -- 172.21.15.31:0/2021316223 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4857+0+0 (secure 0 0 0) 0x7f7d5012d980 con 0x7f7d5c0cdb30 2024-09-17T05:33:33.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.322+0000 7f7d60a00640 1 --2- 172.21.15.31:0/2021316223 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7d3c073350 0x7f7d3c075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:33.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.322+0000 7f7d60a00640 1 --2- 172.21.15.31:0/2021316223 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7d3c073350 0x7f7d3c075810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c0b6d70 tx=0x7f7d48001420 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:33.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.326+0000 7f7d59600640 1 -- 172.21.15.31:0/2021316223 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7d500bf070 con 0x7f7d5c0cdb30 2024-09-17T05:33:33.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.562+0000 7f7d63e00640 1 -- 172.21.15.31:0/2021316223 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7d5c0762f0 con 0x7f7d5c0cdb30 2024-09-17T05:33:33.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.562+0000 7f7d59600640 1 -- 172.21.15.31:0/2021316223 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) ==== 80+0+5304 (secure 0 0 0) 0x7f7d500ac030 con 0x7f7d5c0cdb30 2024-09-17T05:33:33.566 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:33.566 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:33:33.566 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2024-09-17T05:33:33.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.566 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2024-09-17T05:33:33.566 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmoloQARAAbTcR/1F1qz7Crjdu1NPSgw==", 2024-09-17T05:33:33.566 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.566 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:33:33.566 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:33:33.567 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:33:33.567 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:33:33.567 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:33.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.567 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2024-09-17T05:33:33.567 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmYrdRDRAAkaDz03U3lMZlkLEVFYlTaw==", 2024-09-17T05:33:33.567 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.567 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:33:33.567 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:33:33.567 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:33:33.568 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:33:33.568 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:33.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.568 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2024-09-17T05:33:33.568 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmpFRCCBAAZRsuAVwSxuMGDeoYCwWFeg==", 2024-09-17T05:33:33.568 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.568 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:33:33.568 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:33:33.568 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:33:33.569 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:33:33.569 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:33.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.569 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2024-09-17T05:33:33.569 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lm23PSFBAAuO+k0kWY28PN7+pEtlUniQ==", 2024-09-17T05:33:33.569 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.569 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:33:33.569 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:33:33.569 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:33:33.569 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:33:33.570 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:33.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.570 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2024-09-17T05:33:33.570 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBTE+lm0miKHxAA2C1pfwBxJtKQhu4xuPumxg==", 2024-09-17T05:33:33.570 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.570 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:33:33.570 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:33:33.570 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:33:33.570 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:33.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.571 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2024-09-17T05:33:33.571 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBWE+lmdQi7NRAA2v4ETg4jynbPF0K4E73KAA==", 2024-09-17T05:33:33.571 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.571 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:33:33.571 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:33:33.571 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:33:33.571 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:33.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.571 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2024-09-17T05:33:33.572 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBaE+lm18eUEBAA8gAhUx9UNa2Lk4uyFBd7Nw==", 2024-09-17T05:33:33.572 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.572 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:33:33.572 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:33:33.572 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:33:33.572 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:33.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.573 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2024-09-17T05:33:33.573 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBdE+lm00moJBAAizrxOP4rI4fGR91dYzlEkw==", 2024-09-17T05:33:33.573 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.573 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:33:33.573 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:33:33.573 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:33:33.573 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:33.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.573 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2024-09-17T05:33:33.573 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBjE+lmhdtUJhAA7+KM8DwQriFwMbpqXAPTuA==", 2024-09-17T05:33:33.574 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.574 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:33:33.574 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:33:33.574 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:33:33.574 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:33.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.574 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2024-09-17T05:33:33.574 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBmE+lm5cByOhAAiMnQIv2O41am/3E+0dp4sg==", 2024-09-17T05:33:33.574 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.574 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:33:33.575 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:33:33.575 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:33:33.575 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:33.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.575 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2024-09-17T05:33:33.575 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBqE+lm19FhExAAo/Sfj2SX5+Y2/Fxz8mbiNQ==", 2024-09-17T05:33:33.575 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.575 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:33:33.575 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:33:33.575 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:33:33.576 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:33.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.576 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2024-09-17T05:33:33.576 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBtE+lmISDbKBAAapUBS+t+N1vUcCbdJic8Dw==", 2024-09-17T05:33:33.576 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.576 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:33:33.577 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:33:33.577 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:33:33.577 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:33.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.577 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2024-09-17T05:33:33.577 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw==", 2024-09-17T05:33:33.577 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.577 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:33:33.577 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2024-09-17T05:33:33.578 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:33:33.578 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:33.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.578 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2024-09-17T05:33:33.578 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmb2pmIhAA7p+G+WnB7ujZZdSlaossYg==", 2024-09-17T05:33:33.578 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.578 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:33:33.578 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:33:33.578 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:33:33.579 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:33:33.579 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:33.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.579 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2024-09-17T05:33:33.579 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmAPPaHhAAyz/gKunaNFyrdkAUy50qmQ==", 2024-09-17T05:33:33.579 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.579 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:33:33.579 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:33:33.579 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:33:33.580 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:33:33.580 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:33.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.580 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2024-09-17T05:33:33.580 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lml72BKBAAgAji5TWedU7azT5oQz3fYg==", 2024-09-17T05:33:33.580 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.580 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:33:33.581 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:33:33.581 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:33:33.581 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:33:33.581 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:33.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.581 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2024-09-17T05:33:33.581 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmtgltIRAAeTv/U/vZ9ZIuGN4JXTHD0A==", 2024-09-17T05:33:33.581 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.581 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:33:33.582 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:33:33.582 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:33:33.582 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:33:33.582 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:33.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.582 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2024-09-17T05:33:33.582 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmTt2oOBAAmR5ykU4WbEzlKFiwI7sMdg==", 2024-09-17T05:33:33.582 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.582 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:33:33.582 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:33:33.583 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:33:33.583 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:33.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.583 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2024-09-17T05:33:33.583 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmKILYNBAAojM8RIq92dO2DQyXppReIw==", 2024-09-17T05:33:33.583 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:33:33.583 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:33:33.583 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:33:33.583 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:33:33.584 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.584 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.584 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:33:33.584 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:33:33.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.566+0000 7f7d63e00640 1 -- 172.21.15.31:0/2021316223 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7d3c073350 msgr2=0x7f7d3c075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:33.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.566+0000 7f7d63e00640 1 --2- 172.21.15.31:0/2021316223 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7d3c073350 0x7f7d3c075810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c0b6d70 tx=0x7f7d48001420 comp rx=0 tx=0).stop 2024-09-17T05:33:33.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.566+0000 7f7d63e00640 1 -- 172.21.15.31:0/2021316223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d5c0cdb30 msgr2=0x7f7d5c150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:33.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.566+0000 7f7d63e00640 1 --2- 172.21.15.31:0/2021316223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d5c0cdb30 0x7f7d5c150360 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f7d50000c10 tx=0x7f7d500a65a0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.566+0000 7f7d63e00640 1 -- 172.21.15.31:0/2021316223 shutdown_connections 2024-09-17T05:33:33.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.566+0000 7f7d63e00640 1 --2- 172.21.15.31:0/2021316223 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7d3c073350 0x7f7d3c075810 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.566+0000 7f7d63e00640 1 --2- 172.21.15.31:0/2021316223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d5c15bea0 0x7f7d5c0b7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.566+0000 7f7d63e00640 1 --2- 172.21.15.31:0/2021316223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d5c0d28e0 0x7f7d5c0b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.566+0000 7f7d63e00640 1 --2- 172.21.15.31:0/2021316223 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d5c0cdb30 0x7f7d5c150360 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.566+0000 7f7d63e00640 1 -- 172.21.15.31:0/2021316223 >> 172.21.15.31:0/2021316223 conn(0x7f7d5c0d1dc0 msgr2=0x7f7d5c0b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:33.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.566+0000 7f7d63e00640 1 -- 172.21.15.31:0/2021316223 shutdown_connections 2024-09-17T05:33:33.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.566+0000 7f7d63e00640 1 -- 172.21.15.31:0/2021316223 wait complete. 2024-09-17T05:33:33.587 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:33:33.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3518e00640 1 -- 172.21.15.31:0/3502083138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35140b3130 msgr2=0x7f35140cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3518e00640 1 --2- 172.21.15.31:0/3502083138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35140b3130 0x7f35140cc550 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f350c009bc0 tx=0x7f350c01cba0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3518e00640 1 -- 172.21.15.31:0/3502083138 shutdown_connections 2024-09-17T05:33:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3518e00640 1 --2- 172.21.15.31:0/3502083138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35140b3130 0x7f35140cc550 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3518e00640 1 --2- 172.21.15.31:0/3502083138 >> v2:172.21.15.155:3300/0 conn(0x7f35140b4bd0 0x7f35140b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3518e00640 1 -- 172.21.15.31:0/3502083138 >> 172.21.15.31:0/3502083138 conn(0x7f35140b18f0 msgr2=0x7f35140b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3518e00640 1 -- 172.21.15.31:0/3502083138 shutdown_connections 2024-09-17T05:33:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3518e00640 1 -- 172.21.15.31:0/3502083138 wait complete. 2024-09-17T05:33:33.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3518e00640 1 Processor -- start 2024-09-17T05:33:33.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3518e00640 1 -- start start 2024-09-17T05:33:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3518e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35140b3130 0x7f351414ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3518e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35140b4bd0 0x7f3514154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3518e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f351415b580 0x7f351409d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3518e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3514167ae0 con 0x7f35140b3130 2024-09-17T05:33:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3518e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3514167960 con 0x7f35140b4bd0 2024-09-17T05:33:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3518e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3514167c60 con 0x7f351415b580 2024-09-17T05:33:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3511e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35140b3130 0x7f351414ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f350be00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35140b4bd0 0x7f3514154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3512800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f351415b580 0x7f351409d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f350be00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35140b4bd0 0x7f3514154190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:43578/0 (socket says 172.21.15.31:43578) 2024-09-17T05:33:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3511e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35140b3130 0x7f351414ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37838/0 (socket says 172.21.15.31:37838) 2024-09-17T05:33:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f350be00640 1 -- 172.21.15.31:0/3383289721 learned_addr learned my addr 172.21.15.31:0/3383289721 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f350be00640 1 -- 172.21.15.31:0/3383289721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f351415b580 msgr2=0x7f351409d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f350be00640 1 --2- 172.21.15.31:0/3383289721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f351415b580 0x7f351409d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f350be00640 1 -- 172.21.15.31:0/3383289721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35140b3130 msgr2=0x7f351414ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f350be00640 1 --2- 172.21.15.31:0/3383289721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35140b3130 0x7f351414ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f350be00640 1 -- 172.21.15.31:0/3383289721 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351409bb00 con 0x7f35140b4bd0 2024-09-17T05:33:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3512800640 1 --2- 172.21.15.31:0/3383289721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f351415b580 0x7f351409d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:33:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.734+0000 7f3511e00640 1 --2- 172.21.15.31:0/3383289721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35140b3130 0x7f351414ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:33:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.738+0000 7f350be00640 1 --2- 172.21.15.31:0/3383289721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35140b4bd0 0x7f3514154190 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00ea20 tx=0x7f34fc00eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:33.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.738+0000 7f350a000640 1 -- 172.21.15.31:0/3383289721 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc00cd20 con 0x7f35140b4bd0 2024-09-17T05:33:33.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.738+0000 7f350a000640 1 -- 172.21.15.31:0/3383289721 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34fc010430 con 0x7f35140b4bd0 2024-09-17T05:33:33.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.738+0000 7f3518e00640 1 -- 172.21.15.31:0/3383289721 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f351409bda0 con 0x7f35140b4bd0 2024-09-17T05:33:33.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.738+0000 7f350a000640 1 -- 172.21.15.31:0/3383289721 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc010860 con 0x7f35140b4bd0 2024-09-17T05:33:33.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.738+0000 7f3518e00640 1 -- 172.21.15.31:0/3383289721 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3514154be0 con 0x7f35140b4bd0 2024-09-17T05:33:33.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.738+0000 7f3518e00640 1 -- 172.21.15.31:0/3383289721 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3514069410 con 0x7f35140b4bd0 2024-09-17T05:33:33.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.738+0000 7f350a000640 1 -- 172.21.15.31:0/3383289721 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f34fc010a00 con 0x7f35140b4bd0 2024-09-17T05:33:33.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.738+0000 7f350a000640 1 --2- 172.21.15.31:0/3383289721 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f34f0073320 0x7f34f00757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:33.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.742+0000 7f350a000640 1 -- 172.21.15.31:0/3383289721 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4857+0+0 (secure 0 0 0) 0x7f34fc094e50 con 0x7f35140b4bd0 2024-09-17T05:33:33.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.742+0000 7f3511e00640 1 --2- 172.21.15.31:0/3383289721 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f34f0073320 0x7f34f00757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:33.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.742+0000 7f3511e00640 1 --2- 172.21.15.31:0/3383289721 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f34f0073320 0x7f34f00757e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3504007fd0 tx=0x7f3504009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:33.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.742+0000 7f350a000640 1 -- 172.21.15.31:0/3383289721 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f34fc05fac0 con 0x7f35140b4bd0 2024-09-17T05:33:33.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.922+0000 7f3518e00640 1 -- 172.21.15.31:0/3383289721 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f35140cc550 con 0x7f35140b4bd0 2024-09-17T05:33:33.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.922+0000 7f350a000640 1 -- 172.21.15.31:0/3383289721 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v96) ==== 84+0+65 (secure 0 0 0) 0x7f35140cc550 con 0x7f35140b4bd0 2024-09-17T05:33:33.923 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:33.923 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:33:33.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:33.923 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-09-17T05:33:33.923 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-09-17T05:33:33.923 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:33.923 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:33:33.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.922+0000 7f3518e00640 1 -- 172.21.15.31:0/3383289721 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f34f0073320 msgr2=0x7f34f00757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:33.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.922+0000 7f3518e00640 1 --2- 172.21.15.31:0/3383289721 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f34f0073320 0x7f34f00757e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3504007fd0 tx=0x7f3504009040 comp rx=0 tx=0).stop 2024-09-17T05:33:33.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.922+0000 7f3518e00640 1 -- 172.21.15.31:0/3383289721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35140b4bd0 msgr2=0x7f3514154190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:33.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.922+0000 7f3518e00640 1 --2- 172.21.15.31:0/3383289721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35140b4bd0 0x7f3514154190 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f34fc00ea20 tx=0x7f34fc00eee0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.922+0000 7f3518e00640 1 -- 172.21.15.31:0/3383289721 shutdown_connections 2024-09-17T05:33:33.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.922+0000 7f3518e00640 1 --2- 172.21.15.31:0/3383289721 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f34f0073320 0x7f34f00757e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.922+0000 7f3518e00640 1 --2- 172.21.15.31:0/3383289721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f351415b580 0x7f351409d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.922+0000 7f3518e00640 1 --2- 172.21.15.31:0/3383289721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35140b4bd0 0x7f3514154190 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.922+0000 7f3518e00640 1 --2- 172.21.15.31:0/3383289721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35140b3130 0x7f351414ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:33.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.922+0000 7f3518e00640 1 -- 172.21.15.31:0/3383289721 >> 172.21.15.31:0/3383289721 conn(0x7f35140b18f0 msgr2=0x7f35140d03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:33.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.922+0000 7f3518e00640 1 -- 172.21.15.31:0/3383289721 shutdown_connections 2024-09-17T05:33:33.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:33.922+0000 7f3518e00640 1 -- 172.21.15.31:0/3383289721 wait complete. 2024-09-17T05:33:33.944 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:33:33.944 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:33:34.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e3600640 1 -- 172.21.15.31:0/1652768441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1dc0cf440 msgr2=0x7ff1dc0ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:34.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e3600640 1 --2- 172.21.15.31:0/1652768441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1dc0cf440 0x7ff1dc0ce350 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009840 tx=0x7ff1c801c820 comp rx=0 tx=0).stop 2024-09-17T05:33:34.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e3600640 1 -- 172.21.15.31:0/1652768441 shutdown_connections 2024-09-17T05:33:34.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e3600640 1 --2- 172.21.15.31:0/1652768441 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1dc0cf440 0x7ff1dc0ce350 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:34.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e3600640 1 --2- 172.21.15.31:0/1652768441 >> v2:172.21.15.155:3300/0 conn(0x7ff1dc0734f0 0x7ff1dc15a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:34.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e3600640 1 -- 172.21.15.31:0/1652768441 >> 172.21.15.31:0/1652768441 conn(0x7ff1dc0cfbc0 msgr2=0x7ff1dc0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:34.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e3600640 1 -- 172.21.15.31:0/1652768441 shutdown_connections 2024-09-17T05:33:34.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e3600640 1 -- 172.21.15.31:0/1652768441 wait complete. 2024-09-17T05:33:34.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e3600640 1 Processor -- start 2024-09-17T05:33:34.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e3600640 1 -- start start 2024-09-17T05:33:34.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e3600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1dc0734f0 0x7ff1dc15efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:34.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e3600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1dc0ce890 0x7ff1dc159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:34.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e3600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1dc0cf440 0x7ff1dc1599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:34.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e3600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff1dc167360 con 0x7ff1dc0cf440 2024-09-17T05:33:34.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e3600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff1dc15ed60 con 0x7ff1dc0734f0 2024-09-17T05:33:34.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e3600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff1dc1674e0 con 0x7ff1dc0ce890 2024-09-17T05:33:34.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e0c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1dc0734f0 0x7ff1dc15efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:34.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e1600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1dc0cf440 0x7ff1dc1599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:34.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e0c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1dc0734f0 0x7ff1dc15efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:43596/0 (socket says 172.21.15.31:43596) 2024-09-17T05:33:34.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1e0c00640 1 -- 172.21.15.31:0/2332919956 learned_addr learned my addr 172.21.15.31:0/2332919956 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:34.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.094+0000 7ff1dbe00640 1 --2- 172.21.15.31:0/2332919956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1dc0ce890 0x7ff1dc159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:34.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.098+0000 7ff1e0c00640 1 -- 172.21.15.31:0/2332919956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1dc0ce890 msgr2=0x7ff1dc159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:34.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.098+0000 7ff1e0c00640 1 --2- 172.21.15.31:0/2332919956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1dc0ce890 0x7ff1dc159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:34.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.098+0000 7ff1e0c00640 1 -- 172.21.15.31:0/2332919956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1dc0cf440 msgr2=0x7ff1dc1599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:34.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.098+0000 7ff1e0c00640 1 --2- 172.21.15.31:0/2332919956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1dc0cf440 0x7ff1dc1599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:34.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.098+0000 7ff1e0c00640 1 -- 172.21.15.31:0/2332919956 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1dc0b4fd0 con 0x7ff1dc0734f0 2024-09-17T05:33:34.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.098+0000 7ff1e0c00640 1 --2- 172.21.15.31:0/2332919956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1dc0734f0 0x7ff1dc15efd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000eb20 tx=0x7ff1d000c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:34.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.098+0000 7ff1d8c00640 1 -- 172.21.15.31:0/2332919956 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d000ce10 con 0x7ff1dc0734f0 2024-09-17T05:33:34.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.098+0000 7ff1d8c00640 1 -- 172.21.15.31:0/2332919956 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1d0004110 con 0x7ff1dc0734f0 2024-09-17T05:33:34.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.098+0000 7ff1d8c00640 1 -- 172.21.15.31:0/2332919956 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0003600 con 0x7ff1dc0734f0 2024-09-17T05:33:34.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.098+0000 7ff1e3600640 1 -- 172.21.15.31:0/2332919956 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1dc09d660 con 0x7ff1dc0734f0 2024-09-17T05:33:34.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.098+0000 7ff1e3600640 1 -- 172.21.15.31:0/2332919956 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1dc1534f0 con 0x7ff1dc0734f0 2024-09-17T05:33:34.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.098+0000 7ff1e3600640 1 -- 172.21.15.31:0/2332919956 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1dc069410 con 0x7ff1dc0734f0 2024-09-17T05:33:34.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.098+0000 7ff1d8c00640 1 -- 172.21.15.31:0/2332919956 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7ff1d00037a0 con 0x7ff1dc0734f0 2024-09-17T05:33:34.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.098+0000 7ff1d8c00640 1 --2- 172.21.15.31:0/2332919956 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff1bc073320 0x7ff1bc0757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:34.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.102+0000 7ff1d8c00640 1 -- 172.21.15.31:0/2332919956 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4857+0+0 (secure 0 0 0) 0x7ff1d0094600 con 0x7ff1dc0734f0 2024-09-17T05:33:34.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.102+0000 7ff1dbe00640 1 --2- 172.21.15.31:0/2332919956 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff1bc073320 0x7ff1bc0757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:34.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.102+0000 7ff1dbe00640 1 --2- 172.21.15.31:0/2332919956 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff1bc073320 0x7ff1bc0757e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff1c80ae000 tx=0x7ff1c80b3040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:34.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.106+0000 7ff1d8c00640 1 -- 172.21.15.31:0/2332919956 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff1d005f0f0 con 0x7ff1dc0734f0 2024-09-17T05:33:34.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:34.298+0000 7ff1e3600640 1 -- 172.21.15.31:0/2332919956 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff1dc09b420 con 0x7ff1dc0734f0 2024-09-17T05:33:35.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.154+0000 7ff1d8c00640 1 -- 172.21.15.31:0/2332919956 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v97) ==== 138+0+0 (secure 0 0 0) 0x7ff1d0063b20 con 0x7ff1dc0734f0 2024-09-17T05:33:35.156 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-09-17T05:33:35.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.158+0000 7ff1e3600640 1 -- 172.21.15.31:0/2332919956 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff1bc073320 msgr2=0x7ff1bc0757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:35.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.158+0000 7ff1e3600640 1 --2- 172.21.15.31:0/2332919956 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff1bc073320 0x7ff1bc0757e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff1c80ae000 tx=0x7ff1c80b3040 comp rx=0 tx=0).stop 2024-09-17T05:33:35.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.158+0000 7ff1e3600640 1 -- 172.21.15.31:0/2332919956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1dc0734f0 msgr2=0x7ff1dc15efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:35.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.158+0000 7ff1e3600640 1 --2- 172.21.15.31:0/2332919956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1dc0734f0 0x7ff1dc15efd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000eb20 tx=0x7ff1d000c3d0 comp rx=0 tx=0).stop 2024-09-17T05:33:35.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.162+0000 7ff1e3600640 1 -- 172.21.15.31:0/2332919956 shutdown_connections 2024-09-17T05:33:35.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.162+0000 7ff1e3600640 1 --2- 172.21.15.31:0/2332919956 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff1bc073320 0x7ff1bc0757e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:35.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.162+0000 7ff1e3600640 1 --2- 172.21.15.31:0/2332919956 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1dc0cf440 0x7ff1dc1599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:35.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.162+0000 7ff1e3600640 1 --2- 172.21.15.31:0/2332919956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1dc0ce890 0x7ff1dc159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:35.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.162+0000 7ff1e3600640 1 --2- 172.21.15.31:0/2332919956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1dc0734f0 0x7ff1dc15efd0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:35.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.162+0000 7ff1e3600640 1 -- 172.21.15.31:0/2332919956 >> 172.21.15.31:0/2332919956 conn(0x7ff1dc0cfbc0 msgr2=0x7ff1dc0aed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:35.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.162+0000 7ff1e3600640 1 -- 172.21.15.31:0/2332919956 shutdown_connections 2024-09-17T05:33:35.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.162+0000 7ff1e3600640 1 -- 172.21.15.31:0/2332919956 wait complete. 2024-09-17T05:33:35.187 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:33:35.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.342+0000 7f7a65400640 1 -- 172.21.15.31:0/2426527025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a6015db50 msgr2=0x7f7a600acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:35.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.342+0000 7f7a65400640 1 --2- 172.21.15.31:0/2426527025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a6015db50 0x7f7a600acd40 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f7a60070900 tx=0x7f7a5001c830 comp rx=0 tx=0).stop 2024-09-17T05:33:35.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.342+0000 7f7a65400640 1 -- 172.21.15.31:0/2426527025 shutdown_connections 2024-09-17T05:33:35.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.342+0000 7f7a65400640 1 --2- 172.21.15.31:0/2426527025 >> v2:172.21.15.155:3300/0 conn(0x7f7a600cd100 0x7f7a600b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:35.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.342+0000 7f7a65400640 1 --2- 172.21.15.31:0/2426527025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a6015db50 0x7f7a600acd40 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:35.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.342+0000 7f7a65400640 1 -- 172.21.15.31:0/2426527025 >> 172.21.15.31:0/2426527025 conn(0x7f7a600b18f0 msgr2=0x7f7a600b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:35.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.342+0000 7f7a65400640 1 -- 172.21.15.31:0/2426527025 shutdown_connections 2024-09-17T05:33:35.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.342+0000 7f7a65400640 1 -- 172.21.15.31:0/2426527025 wait complete. 2024-09-17T05:33:35.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a65400640 1 Processor -- start 2024-09-17T05:33:35.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a65400640 1 -- start start 2024-09-17T05:33:35.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a65400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a600b4880 0x7f7a601f65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:35.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a65400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a600cd100 0x7f7a601502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:35.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a65400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a6015db50 0x7f7a600b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:35.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a65400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7a600ccca0 con 0x7f7a6015db50 2024-09-17T05:33:35.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a65400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7a600ccb20 con 0x7f7a600cd100 2024-09-17T05:33:35.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a65400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7a60167120 con 0x7f7a600b4880 2024-09-17T05:33:35.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a5f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a6015db50 0x7f7a600b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:35.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a55e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a600cd100 0x7f7a601502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:35.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a5f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a6015db50 0x7f7a600b06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37862/0 (socket says 172.21.15.31:37862) 2024-09-17T05:33:35.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a5e800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a600b4880 0x7f7a601f65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:35.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a5f200640 1 -- 172.21.15.31:0/61997433 learned_addr learned my addr 172.21.15.31:0/61997433 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:35.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a5f200640 1 -- 172.21.15.31:0/61997433 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a600b4880 msgr2=0x7f7a601f65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:35.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a5f200640 1 --2- 172.21.15.31:0/61997433 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a600b4880 0x7f7a601f65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:35.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a5f200640 1 -- 172.21.15.31:0/61997433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a600cd100 msgr2=0x7f7a601502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:35.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a5f200640 1 --2- 172.21.15.31:0/61997433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a600cd100 0x7f7a601502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:35.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a5f200640 1 -- 172.21.15.31:0/61997433 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a601f6b30 con 0x7f7a6015db50 2024-09-17T05:33:35.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a55e00640 1 --2- 172.21.15.31:0/61997433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a600cd100 0x7f7a601502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:33:35.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a5f200640 1 --2- 172.21.15.31:0/61997433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a6015db50 0x7f7a600b06b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800c7a0 tx=0x7f7a5800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:35.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a57400640 1 -- 172.21.15.31:0/61997433 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a58003b80 con 0x7f7a6015db50 2024-09-17T05:33:35.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a57400640 1 -- 172.21.15.31:0/61997433 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a58003d40 con 0x7f7a6015db50 2024-09-17T05:33:35.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a57400640 1 -- 172.21.15.31:0/61997433 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5800aab0 con 0x7f7a6015db50 2024-09-17T05:33:35.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a65400640 1 -- 172.21.15.31:0/61997433 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a600afed0 con 0x7f7a6015db50 2024-09-17T05:33:35.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.346+0000 7f7a65400640 1 -- 172.21.15.31:0/61997433 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a601540c0 con 0x7f7a6015db50 2024-09-17T05:33:35.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.350+0000 7f7a65400640 1 -- 172.21.15.31:0/61997433 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a600b4340 con 0x7f7a6015db50 2024-09-17T05:33:35.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.350+0000 7f7a57400640 1 -- 172.21.15.31:0/61997433 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f7a5800ac50 con 0x7f7a6015db50 2024-09-17T05:33:35.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.350+0000 7f7a57400640 1 --2- 172.21.15.31:0/61997433 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7a3c073320 0x7f7a3c0757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:35.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.350+0000 7f7a57400640 1 -- 172.21.15.31:0/61997433 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5227+0+0 (secure 0 0 0) 0x7f7a58094a50 con 0x7f7a6015db50 2024-09-17T05:33:35.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.350+0000 7f7a5e800640 1 --2- 172.21.15.31:0/61997433 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7a3c073320 0x7f7a3c0757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:35.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.354+0000 7f7a5e800640 1 --2- 172.21.15.31:0/61997433 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7a3c073320 0x7f7a3c0757e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a500af000 tx=0x7f7a500a7040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:35.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.354+0000 7f7a57400640 1 -- 172.21.15.31:0/61997433 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7a601f6b30 con 0x7f7a6015db50 2024-09-17T05:33:35.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:35.530+0000 7f7a65400640 1 -- 172.21.15.31:0/61997433 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7a600ae150 con 0x7f7a6015db50 2024-09-17T05:33:36.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.158+0000 7f7a57400640 1 -- 172.21.15.31:0/61997433 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v98) ==== 170+0+0 (secure 0 0 0) 0x7f7a5805f4e0 con 0x7f7a6015db50 2024-09-17T05:33:36.161 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-09-17T05:33:36.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.162+0000 7f7a65400640 1 -- 172.21.15.31:0/61997433 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7a3c073320 msgr2=0x7f7a3c0757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:36.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.162+0000 7f7a65400640 1 --2- 172.21.15.31:0/61997433 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7a3c073320 0x7f7a3c0757e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a500af000 tx=0x7f7a500a7040 comp rx=0 tx=0).stop 2024-09-17T05:33:36.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.162+0000 7f7a65400640 1 -- 172.21.15.31:0/61997433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a6015db50 msgr2=0x7f7a600b06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:36.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.162+0000 7f7a65400640 1 --2- 172.21.15.31:0/61997433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a6015db50 0x7f7a600b06b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800c7a0 tx=0x7f7a5800cc60 comp rx=0 tx=0).stop 2024-09-17T05:33:36.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.162+0000 7f7a65400640 1 -- 172.21.15.31:0/61997433 shutdown_connections 2024-09-17T05:33:36.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.162+0000 7f7a65400640 1 --2- 172.21.15.31:0/61997433 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7a3c073320 0x7f7a3c0757e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:36.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.162+0000 7f7a65400640 1 --2- 172.21.15.31:0/61997433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a6015db50 0x7f7a600b06b0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:36.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.162+0000 7f7a65400640 1 --2- 172.21.15.31:0/61997433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a600cd100 0x7f7a601502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:36.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.162+0000 7f7a65400640 1 --2- 172.21.15.31:0/61997433 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a600b4880 0x7f7a601f65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:36.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.162+0000 7f7a65400640 1 -- 172.21.15.31:0/61997433 >> 172.21.15.31:0/61997433 conn(0x7f7a600b18f0 msgr2=0x7f7a60072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:36.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.166+0000 7f7a65400640 1 -- 172.21.15.31:0/61997433 shutdown_connections 2024-09-17T05:33:36.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.166+0000 7f7a65400640 1 -- 172.21.15.31:0/61997433 wait complete. 2024-09-17T05:33:36.208 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:33:36.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.358+0000 7ff0b0a00640 1 -- 172.21.15.31:0/1857795491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ac0b1650 msgr2=0x7ff0ac0b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:36.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.358+0000 7ff0b0a00640 1 --2- 172.21.15.31:0/1857795491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ac0b1650 0x7ff0ac0b1a30 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7ff094009900 tx=0x7ff09401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:33:36.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.358+0000 7ff0b0a00640 1 -- 172.21.15.31:0/1857795491 shutdown_connections 2024-09-17T05:33:36.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.358+0000 7ff0b0a00640 1 --2- 172.21.15.31:0/1857795491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ac0b1650 0x7ff0ac0b1a30 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:36.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.358+0000 7ff0b0a00640 1 --2- 172.21.15.31:0/1857795491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0ac1605d0 0x7ff0ac0d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:36.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.358+0000 7ff0b0a00640 1 -- 172.21.15.31:0/1857795491 >> 172.21.15.31:0/1857795491 conn(0x7ff0ac0d1dd0 msgr2=0x7ff0ac0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:36.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.358+0000 7ff0b0a00640 1 -- 172.21.15.31:0/1857795491 shutdown_connections 2024-09-17T05:33:36.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.358+0000 7ff0b0a00640 1 -- 172.21.15.31:0/1857795491 wait complete. 2024-09-17T05:33:36.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0b0a00640 1 Processor -- start 2024-09-17T05:33:36.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0b0a00640 1 -- start start 2024-09-17T05:33:36.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0b0a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0ac0aeb00 0x7ff0ac1540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:36.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0b0a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0ac0b1650 0x7ff0ac1f8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:36.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0b0a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ac1605d0 0x7ff0ac0affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:36.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0b0a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac0b0810 con 0x7ff0ac1605d0 2024-09-17T05:33:36.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0b0a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac0b0ee0 con 0x7ff0ac0aeb00 2024-09-17T05:33:36.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0b0a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff0ac0b1220 con 0x7ff0ac0b1650 2024-09-17T05:33:36.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0aa800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ac1605d0 0x7ff0ac0affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:36.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0aa800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ac1605d0 0x7ff0ac0affb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37888/0 (socket says 172.21.15.31:37888) 2024-09-17T05:33:36.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0a9e00640 1 --2- 172.21.15.31:0/34151483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0ac0aeb00 0x7ff0ac1540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:36.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0a1400640 1 --2- 172.21.15.31:0/34151483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0ac0b1650 0x7ff0ac1f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:36.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0aa800640 1 -- 172.21.15.31:0/34151483 learned_addr learned my addr 172.21.15.31:0/34151483 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0aa800640 1 -- 172.21.15.31:0/34151483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0ac0b1650 msgr2=0x7ff0ac1f8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0aa800640 1 --2- 172.21.15.31:0/34151483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0ac0b1650 0x7ff0ac1f8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0aa800640 1 -- 172.21.15.31:0/34151483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0ac0aeb00 msgr2=0x7ff0ac1540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0aa800640 1 --2- 172.21.15.31:0/34151483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0ac0aeb00 0x7ff0ac1540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0aa800640 1 -- 172.21.15.31:0/34151483 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ac06f5d0 con 0x7ff0ac1605d0 2024-09-17T05:33:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0aa800640 1 --2- 172.21.15.31:0/34151483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ac1605d0 0x7ff0ac0affb0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400c7c0 tx=0x7ff0a400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0a2a00640 1 -- 172.21.15.31:0/34151483 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4003b80 con 0x7ff0ac1605d0 2024-09-17T05:33:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0a2a00640 1 -- 172.21.15.31:0/34151483 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0a4003d20 con 0x7ff0ac1605d0 2024-09-17T05:33:36.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0a2a00640 1 -- 172.21.15.31:0/34151483 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a400aab0 con 0x7ff0ac1605d0 2024-09-17T05:33:36.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0b0a00640 1 -- 172.21.15.31:0/34151483 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0ac06f890 con 0x7ff0ac1605d0 2024-09-17T05:33:36.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.362+0000 7ff0b0a00640 1 -- 172.21.15.31:0/34151483 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0ac06df80 con 0x7ff0ac1605d0 2024-09-17T05:33:36.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.366+0000 7ff0b0a00640 1 -- 172.21.15.31:0/34151483 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0ac0b1a30 con 0x7ff0ac1605d0 2024-09-17T05:33:36.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.366+0000 7ff0a2a00640 1 -- 172.21.15.31:0/34151483 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7ff0a400ac50 con 0x7ff0ac1605d0 2024-09-17T05:33:36.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.366+0000 7ff0a2a00640 1 --2- 172.21.15.31:0/34151483 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff088073350 0x7ff088075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.366+0000 7ff0a2a00640 1 -- 172.21.15.31:0/34151483 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5609+0+0 (secure 0 0 0) 0x7ff0a4094c30 con 0x7ff0ac1605d0 2024-09-17T05:33:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.366+0000 7ff0a9e00640 1 --2- 172.21.15.31:0/34151483 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff088073350 0x7ff088075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:36.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.366+0000 7ff0a9e00640 1 --2- 172.21.15.31:0/34151483 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff088073350 0x7ff088075810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff09c004610 tx=0x7ff09c00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:36.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.370+0000 7ff0a2a00640 1 -- 172.21.15.31:0/34151483 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff0a405f4b0 con 0x7ff0ac1605d0 2024-09-17T05:33:36.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:36.582+0000 7ff0b0a00640 1 -- 172.21.15.31:0/34151483 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff0ac0d1080 con 0x7ff0ac1605d0 2024-09-17T05:33:37.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.174+0000 7ff0a2a00640 1 -- 172.21.15.31:0/34151483 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v67) ==== 174+0+0 (secure 0 0 0) 0x7ff0a4063ee0 con 0x7ff0ac1605d0 2024-09-17T05:33:37.178 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 16 and data pool 17 2024-09-17T05:33:37.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.182+0000 7ff0b0a00640 1 -- 172.21.15.31:0/34151483 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff088073350 msgr2=0x7ff088075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:37.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.182+0000 7ff0b0a00640 1 --2- 172.21.15.31:0/34151483 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff088073350 0x7ff088075810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff09c004610 tx=0x7ff09c00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.182+0000 7ff0b0a00640 1 -- 172.21.15.31:0/34151483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ac1605d0 msgr2=0x7ff0ac0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:37.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.182+0000 7ff0b0a00640 1 --2- 172.21.15.31:0/34151483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ac1605d0 0x7ff0ac0affb0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400c7c0 tx=0x7ff0a400cc80 comp rx=0 tx=0).stop 2024-09-17T05:33:37.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.182+0000 7ff0b0a00640 1 -- 172.21.15.31:0/34151483 shutdown_connections 2024-09-17T05:33:37.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.182+0000 7ff0b0a00640 1 --2- 172.21.15.31:0/34151483 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff088073350 0x7ff088075810 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.182+0000 7ff0b0a00640 1 --2- 172.21.15.31:0/34151483 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0ac1605d0 0x7ff0ac0affb0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.182+0000 7ff0b0a00640 1 --2- 172.21.15.31:0/34151483 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0ac0b1650 0x7ff0ac1f8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.182+0000 7ff0b0a00640 1 --2- 172.21.15.31:0/34151483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0ac0aeb00 0x7ff0ac1540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.182+0000 7ff0b0a00640 1 -- 172.21.15.31:0/34151483 >> 172.21.15.31:0/34151483 conn(0x7ff0ac0d1dd0 msgr2=0x7ff0ac155cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:37.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.186+0000 7ff0b0a00640 1 -- 172.21.15.31:0/34151483 shutdown_connections 2024-09-17T05:33:37.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.186+0000 7ff0b0a00640 1 -- 172.21.15.31:0/34151483 wait complete. 2024-09-17T05:33:37.227 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:33:37.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.374+0000 7f6342000640 1 -- 172.21.15.31:0/944604283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f633c0ced80 msgr2=0x7f633c0ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:37.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.374+0000 7f6342000640 1 --2- 172.21.15.31:0/944604283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f633c0ced80 0x7f633c0ae9b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6324009870 tx=0x7f632401c860 comp rx=0 tx=0).stop 2024-09-17T05:33:37.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.374+0000 7f6342000640 1 -- 172.21.15.31:0/944604283 shutdown_connections 2024-09-17T05:33:37.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.374+0000 7f6342000640 1 --2- 172.21.15.31:0/944604283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f633c0ced80 0x7f633c0ae9b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.374+0000 7f6342000640 1 -- 172.21.15.31:0/944604283 >> 172.21.15.31:0/944604283 conn(0x7f633c0d1dc0 msgr2=0x7f633c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.374+0000 7f6342000640 1 -- 172.21.15.31:0/944604283 shutdown_connections 2024-09-17T05:33:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.374+0000 7f6342000640 1 -- 172.21.15.31:0/944604283 wait complete. 2024-09-17T05:33:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f6342000640 1 Processor -- start 2024-09-17T05:33:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f6342000640 1 -- start start 2024-09-17T05:33:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f6342000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f633c0cdb30 0x7f633c200550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f6342000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f633c0ced80 0x7f633c0cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f6342000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f633c15bea0 0x7f633c14a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f6342000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f633c16a890 con 0x7f633c0cdb30 2024-09-17T05:33:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f6342000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f633c16a710 con 0x7f633c15bea0 2024-09-17T05:33:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f6342000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f633c16aa10 con 0x7f633c0ced80 2024-09-17T05:33:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f633b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f633c0cdb30 0x7f633c200550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f633b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f633c0cdb30 0x7f633c200550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37904/0 (socket says 172.21.15.31:37904) 2024-09-17T05:33:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f633b400640 1 -- 172.21.15.31:0/2344649940 learned_addr learned my addr 172.21.15.31:0/2344649940 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:37.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f6333e00640 1 --2- 172.21.15.31:0/2344649940 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f633c0ced80 0x7f633c0cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:37.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f633be00640 1 --2- 172.21.15.31:0/2344649940 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f633c15bea0 0x7f633c14a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:37.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f633b400640 1 -- 172.21.15.31:0/2344649940 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f633c0ced80 msgr2=0x7f633c0cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:37.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f633b400640 1 --2- 172.21.15.31:0/2344649940 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f633c0ced80 0x7f633c0cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f633b400640 1 -- 172.21.15.31:0/2344649940 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f633c15bea0 msgr2=0x7f633c14a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:37.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f633b400640 1 --2- 172.21.15.31:0/2344649940 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f633c15bea0 0x7f633c14a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f633b400640 1 -- 172.21.15.31:0/2344649940 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633c14a7c0 con 0x7f633c0cdb30 2024-09-17T05:33:37.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f6333e00640 1 --2- 172.21.15.31:0/2344649940 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f633c0ced80 0x7f633c0cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:37.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f633b400640 1 --2- 172.21.15.31:0/2344649940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f633c0cdb30 0x7f633c200550 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f632c00c400 tx=0x7f632c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:37.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f6333400640 1 -- 172.21.15.31:0/2344649940 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c017070 con 0x7f633c0cdb30 2024-09-17T05:33:37.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f6342000640 1 -- 172.21.15.31:0/2344649940 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633c14aaa0 con 0x7f633c0cdb30 2024-09-17T05:33:37.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f6333400640 1 -- 172.21.15.31:0/2344649940 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f632c005400 con 0x7f633c0cdb30 2024-09-17T05:33:37.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f6333400640 1 -- 172.21.15.31:0/2344649940 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c003860 con 0x7f633c0cdb30 2024-09-17T05:33:37.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.378+0000 7f6342000640 1 -- 172.21.15.31:0/2344649940 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f633c1fc640 con 0x7f633c0cdb30 2024-09-17T05:33:37.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.382+0000 7f6342000640 1 -- 172.21.15.31:0/2344649940 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f633c0ce670 con 0x7f633c0cdb30 2024-09-17T05:33:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.382+0000 7f6333400640 1 -- 172.21.15.31:0/2344649940 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f632c01a070 con 0x7f633c0cdb30 2024-09-17T05:33:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.382+0000 7f6333400640 1 --2- 172.21.15.31:0/2344649940 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6318073320 0x7f63180757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.382+0000 7f6333400640 1 -- 172.21.15.31:0/2344649940 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f632c093720 con 0x7f633c0cdb30 2024-09-17T05:33:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.382+0000 7f6333e00640 1 --2- 172.21.15.31:0/2344649940 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6318073320 0x7f63180757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:37.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.382+0000 7f6333e00640 1 --2- 172.21.15.31:0/2344649940 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6318073320 0x7f63180757e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f63240af000 tx=0x7f632401b0a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:37.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.386+0000 7f6333400640 1 -- 172.21.15.31:0/2344649940 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f632c05df70 con 0x7f633c0cdb30 2024-09-17T05:33:37.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.562+0000 7f6342000640 1 -- 172.21.15.31:0/2344649940 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f633c1fc400 con 0x7f633c0cdb30 2024-09-17T05:33:37.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.566+0000 7f6333400640 1 -- 172.21.15.31:0/2344649940 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+16713 (secure 0 0 0) 0x7f632c0629a0 con 0x7f633c0cdb30 2024-09-17T05:33:37.566 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:37.567 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":99,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:33:36.585747+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:33:34.313310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T05:33:35.543945+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:33:37.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.566+0000 7f6342000640 1 -- 172.21.15.31:0/2344649940 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6318073320 msgr2=0x7f63180757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:37.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.566+0000 7f6342000640 1 --2- 172.21.15.31:0/2344649940 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6318073320 0x7f63180757e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f63240af000 tx=0x7f632401b0a0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.566+0000 7f6342000640 1 -- 172.21.15.31:0/2344649940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f633c0cdb30 msgr2=0x7f633c200550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:37.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.566+0000 7f6342000640 1 --2- 172.21.15.31:0/2344649940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f633c0cdb30 0x7f633c200550 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f632c00c400 tx=0x7f632c00c8c0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.566+0000 7f6342000640 1 -- 172.21.15.31:0/2344649940 shutdown_connections 2024-09-17T05:33:37.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.566+0000 7f6342000640 1 --2- 172.21.15.31:0/2344649940 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6318073320 0x7f63180757e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.566+0000 7f6342000640 1 --2- 172.21.15.31:0/2344649940 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f633c15bea0 0x7f633c14a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.566+0000 7f6342000640 1 --2- 172.21.15.31:0/2344649940 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f633c0ced80 0x7f633c0cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.566+0000 7f6342000640 1 --2- 172.21.15.31:0/2344649940 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f633c0cdb30 0x7f633c200550 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.566+0000 7f6342000640 1 -- 172.21.15.31:0/2344649940 >> 172.21.15.31:0/2344649940 conn(0x7f633c0d1dc0 msgr2=0x7f633c0b7600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:37.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.566+0000 7f6342000640 1 -- 172.21.15.31:0/2344649940 shutdown_connections 2024-09-17T05:33:37.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.566+0000 7f6342000640 1 -- 172.21.15.31:0/2344649940 wait complete. 2024-09-17T05:33:37.589 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:33:37.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.734+0000 7f794dc00640 1 -- 172.21.15.31:0/1830222746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f794815b890 msgr2=0x7f79480ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.734+0000 7f794dc00640 1 --2- 172.21.15.31:0/1830222746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f794815b890 0x7f79480ce010 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f7938009900 tx=0x7f793801c8b0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.734+0000 7f794dc00640 1 -- 172.21.15.31:0/1830222746 shutdown_connections 2024-09-17T05:33:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.734+0000 7f794dc00640 1 --2- 172.21.15.31:0/1830222746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f794806cc20 0x7f794806d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.734+0000 7f794dc00640 1 --2- 172.21.15.31:0/1830222746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f794815b890 0x7f79480ce010 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.734+0000 7f794dc00640 1 -- 172.21.15.31:0/1830222746 >> 172.21.15.31:0/1830222746 conn(0x7f794806dd30 msgr2=0x7f794806e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.734+0000 7f794dc00640 1 -- 172.21.15.31:0/1830222746 shutdown_connections 2024-09-17T05:33:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.734+0000 7f794dc00640 1 -- 172.21.15.31:0/1830222746 wait complete. 2024-09-17T05:33:37.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.734+0000 7f794dc00640 1 Processor -- start 2024-09-17T05:33:37.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.734+0000 7f794dc00640 1 -- start start 2024-09-17T05:33:37.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.734+0000 7f794dc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f794806cc20 0x7f79480b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:37.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.734+0000 7f794dc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794815b890 0x7f79480af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:37.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.734+0000 7f794dc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f794815bc70 0x7f79481532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:37.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f794dc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f79481687a0 con 0x7f794815bc70 2024-09-17T05:33:37.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f794dc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f79480746f0 con 0x7f794815b890 2024-09-17T05:33:37.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f794dc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7948168920 con 0x7f794806cc20 2024-09-17T05:33:37.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f794d200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f794815bc70 0x7f79481532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:37.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f794d200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f794815bc70 0x7f79481532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37930/0 (socket says 172.21.15.31:37930) 2024-09-17T05:33:37.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f794d200640 1 -- 172.21.15.31:0/2890359725 learned_addr learned my addr 172.21.15.31:0/2890359725 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:37.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f7947e00640 1 --2- 172.21.15.31:0/2890359725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f794806cc20 0x7f79480b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:37.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f793fe00640 1 --2- 172.21.15.31:0/2890359725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794815b890 0x7f79480af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:37.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f794d200640 1 -- 172.21.15.31:0/2890359725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f794806cc20 msgr2=0x7f79480b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:37.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f794d200640 1 --2- 172.21.15.31:0/2890359725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f794806cc20 0x7f79480b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f794d200640 1 -- 172.21.15.31:0/2890359725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794815b890 msgr2=0x7f79480af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:37.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f794d200640 1 --2- 172.21.15.31:0/2890359725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794815b890 0x7f79480af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f794d200640 1 -- 172.21.15.31:0/2890359725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79480afe00 con 0x7f794815bc70 2024-09-17T05:33:37.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f793fe00640 1 --2- 172.21.15.31:0/2890359725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794815b890 0x7f79480af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:33:37.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f794d200640 1 --2- 172.21.15.31:0/2890359725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f794815bc70 0x7f79481532a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f794000eb20 tx=0x7f794000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:37.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f7944c00640 1 -- 172.21.15.31:0/2890359725 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7940004b30 con 0x7f794815bc70 2024-09-17T05:33:37.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f7944c00640 1 -- 172.21.15.31:0/2890359725 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7940004cf0 con 0x7f794815bc70 2024-09-17T05:33:37.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f794dc00640 1 -- 172.21.15.31:0/2890359725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7948152200 con 0x7f794815bc70 2024-09-17T05:33:37.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f7944c00640 1 -- 172.21.15.31:0/2890359725 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7940005280 con 0x7f794815bc70 2024-09-17T05:33:37.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f794dc00640 1 -- 172.21.15.31:0/2890359725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79481527c0 con 0x7f794815bc70 2024-09-17T05:33:37.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f794dc00640 1 -- 172.21.15.31:0/2890359725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f794806d070 con 0x7f794815bc70 2024-09-17T05:33:37.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.738+0000 7f7944c00640 1 -- 172.21.15.31:0/2890359725 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f7940005420 con 0x7f794815bc70 2024-09-17T05:33:37.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.742+0000 7f7944c00640 1 --2- 172.21.15.31:0/2890359725 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7924073320 0x7f79240757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:37.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.742+0000 7f7944c00640 1 -- 172.21.15.31:0/2890359725 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f7940094fd0 con 0x7f794815bc70 2024-09-17T05:33:37.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.742+0000 7f7947e00640 1 --2- 172.21.15.31:0/2890359725 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7924073320 0x7f79240757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:37.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.742+0000 7f7947e00640 1 --2- 172.21.15.31:0/2890359725 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7924073320 0x7f79240757e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f79380af000 tx=0x7f793801b0f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:37.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.746+0000 7f7944c00640 1 -- 172.21.15.31:0/2890359725 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f794005fef0 con 0x7f794815bc70 2024-09-17T05:33:37.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.922+0000 7f794dc00640 1 -- 172.21.15.31:0/2890359725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f79480ce2c0 con 0x7f794815bc70 2024-09-17T05:33:37.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.922+0000 7f7944c00640 1 -- 172.21.15.31:0/2890359725 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+16713 (secure 0 0 0) 0x7f794005f7f0 con 0x7f794815bc70 2024-09-17T05:33:37.924 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:37.924 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":99,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:33:36.585747+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:33:34.313310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T05:33:35.543945+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:33:37.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.926+0000 7f794dc00640 1 -- 172.21.15.31:0/2890359725 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7924073320 msgr2=0x7f79240757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:37.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.926+0000 7f794dc00640 1 --2- 172.21.15.31:0/2890359725 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7924073320 0x7f79240757e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f79380af000 tx=0x7f793801b0f0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.926+0000 7f794dc00640 1 -- 172.21.15.31:0/2890359725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f794815bc70 msgr2=0x7f79481532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:37.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.926+0000 7f794dc00640 1 --2- 172.21.15.31:0/2890359725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f794815bc70 0x7f79481532a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f794000eb20 tx=0x7f794000c2d0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.926+0000 7f794dc00640 1 -- 172.21.15.31:0/2890359725 shutdown_connections 2024-09-17T05:33:37.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.926+0000 7f794dc00640 1 --2- 172.21.15.31:0/2890359725 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7924073320 0x7f79240757e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.926+0000 7f794dc00640 1 --2- 172.21.15.31:0/2890359725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f794815bc70 0x7f79481532a0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.926+0000 7f794dc00640 1 --2- 172.21.15.31:0/2890359725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f794815b890 0x7f79480af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.926+0000 7f794dc00640 1 --2- 172.21.15.31:0/2890359725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f794806cc20 0x7f79480b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:37.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.926+0000 7f794dc00640 1 -- 172.21.15.31:0/2890359725 >> 172.21.15.31:0/2890359725 conn(0x7f794806dd30 msgr2=0x7f79480b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:37.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.926+0000 7f794dc00640 1 -- 172.21.15.31:0/2890359725 shutdown_connections 2024-09-17T05:33:37.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:37.926+0000 7f794dc00640 1 -- 172.21.15.31:0/2890359725 wait complete. 2024-09-17T05:33:37.947 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:33:38.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.094+0000 7f985fa00640 1 -- 172.21.15.31:0/4194158196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98580703d0 msgr2=0x7f985815a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:38.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.094+0000 7f985fa00640 1 --2- 172.21.15.31:0/4194158196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98580703d0 0x7f985815a8b0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f985809e090 tx=0x7f985001dbe0 comp rx=0 tx=0).stop 2024-09-17T05:33:38.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.094+0000 7f985fa00640 1 -- 172.21.15.31:0/4194158196 shutdown_connections 2024-09-17T05:33:38.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.094+0000 7f985fa00640 1 --2- 172.21.15.31:0/4194158196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98580703d0 0x7f985815a8b0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:38.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.094+0000 7f985fa00640 1 --2- 172.21.15.31:0/4194158196 >> v2:172.21.15.155:3300/0 conn(0x7f98580b49b0 0x7f985815ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:38.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.094+0000 7f985fa00640 1 -- 172.21.15.31:0/4194158196 >> 172.21.15.31:0/4194158196 conn(0x7f98580b18f0 msgr2=0x7f98580b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:38.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.094+0000 7f985fa00640 1 -- 172.21.15.31:0/4194158196 shutdown_connections 2024-09-17T05:33:38.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.094+0000 7f985fa00640 1 -- 172.21.15.31:0/4194158196 wait complete. 2024-09-17T05:33:38.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985fa00640 1 Processor -- start 2024-09-17T05:33:38.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985fa00640 1 -- start start 2024-09-17T05:33:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985fa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98580703d0 0x7f9858155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985fa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98580b49b0 0x7f98581546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985fa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985815a4d0 0x7f985815bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985fa00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f98580ccfe0 con 0x7f98580703d0 2024-09-17T05:33:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985fa00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f98580cce60 con 0x7f985815a4d0 2024-09-17T05:33:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985fa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9858167170 con 0x7f98580b49b0 2024-09-17T05:33:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985d000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98580703d0 0x7f9858155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985d000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98580703d0 0x7f9858155430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37954/0 (socket says 172.21.15.31:37954) 2024-09-17T05:33:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985d000640 1 -- 172.21.15.31:0/4205321568 learned_addr learned my addr 172.21.15.31:0/4205321568 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f9857e00640 1 --2- 172.21.15.31:0/4205321568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98580b49b0 0x7f98581546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:38.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985da00640 1 --2- 172.21.15.31:0/4205321568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985815a4d0 0x7f985815bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985d000640 1 -- 172.21.15.31:0/4205321568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98580b49b0 msgr2=0x7f98581546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985d000640 1 --2- 172.21.15.31:0/4205321568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98580b49b0 0x7f98581546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985d000640 1 -- 172.21.15.31:0/4205321568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985815a4d0 msgr2=0x7f985815bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985d000640 1 --2- 172.21.15.31:0/4205321568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985815a4d0 0x7f985815bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985d000640 1 -- 172.21.15.31:0/4205321568 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98581f81b0 con 0x7f98580703d0 2024-09-17T05:33:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f9857e00640 1 --2- 172.21.15.31:0/4205321568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98580b49b0 0x7f98581546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:33:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985d000640 1 --2- 172.21.15.31:0/4205321568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98580703d0 0x7f9858155430 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f984c00b440 tx=0x7f984c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f9854c00640 1 -- 172.21.15.31:0/4205321568 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984c015020 con 0x7f98580703d0 2024-09-17T05:33:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f9854c00640 1 -- 172.21.15.31:0/4205321568 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f984c011980 con 0x7f98580703d0 2024-09-17T05:33:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985fa00640 1 -- 172.21.15.31:0/4205321568 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9858164b70 con 0x7f98580703d0 2024-09-17T05:33:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f9854c00640 1 -- 172.21.15.31:0/4205321568 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984c011dd0 con 0x7f98580703d0 2024-09-17T05:33:38.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.098+0000 7f985fa00640 1 -- 172.21.15.31:0/4205321568 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9858164e30 con 0x7f98580703d0 2024-09-17T05:33:38.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.102+0000 7f985fa00640 1 -- 172.21.15.31:0/4205321568 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f985815a8b0 con 0x7f98580703d0 2024-09-17T05:33:38.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.102+0000 7f9854c00640 1 -- 172.21.15.31:0/4205321568 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f984c018020 con 0x7f98580703d0 2024-09-17T05:33:38.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.102+0000 7f9854c00640 1 --2- 172.21.15.31:0/4205321568 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9838073320 0x7f98380757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:38.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.102+0000 7f9854c00640 1 -- 172.21.15.31:0/4205321568 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5709+0+0 (secure 0 0 0) 0x7f984c094250 con 0x7f98580703d0 2024-09-17T05:33:38.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.102+0000 7f9857e00640 1 --2- 172.21.15.31:0/4205321568 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9838073320 0x7f98380757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:38.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.102+0000 7f9857e00640 1 --2- 172.21.15.31:0/4205321568 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9838073320 0x7f98380757e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f98580b1530 tx=0x7f984400b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:38.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.106+0000 7f9854c00640 1 -- 172.21.15.31:0/4205321568 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f984c01f030 con 0x7f98580703d0 2024-09-17T05:33:38.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:38.322+0000 7f985fa00640 1 -- 172.21.15.31:0/4205321568 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9858069b00 con 0x7f98580703d0 2024-09-17T05:33:39.163 INFO:tasks.ceph.mds.a.smithi031.stderr:2024-09-17T05:33:39.162+0000 7fd176c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:33:39.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.198+0000 7f9854c00640 1 -- 172.21.15.31:0/4205321568 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v70) ==== 118+0+0 (secure 0 0 0) 0x7f984c00d040 con 0x7f98580703d0 2024-09-17T05:33:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.198+0000 7f985fa00640 1 -- 172.21.15.31:0/4205321568 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9838073320 msgr2=0x7f98380757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.198+0000 7f985fa00640 1 --2- 172.21.15.31:0/4205321568 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9838073320 0x7f98380757e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f98580b1530 tx=0x7f984400b390 comp rx=0 tx=0).stop 2024-09-17T05:33:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.198+0000 7f985fa00640 1 -- 172.21.15.31:0/4205321568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98580703d0 msgr2=0x7f9858155430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.198+0000 7f985fa00640 1 --2- 172.21.15.31:0/4205321568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98580703d0 0x7f9858155430 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f984c00b440 tx=0x7f984c00b900 comp rx=0 tx=0).stop 2024-09-17T05:33:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.198+0000 7f985fa00640 1 -- 172.21.15.31:0/4205321568 shutdown_connections 2024-09-17T05:33:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.198+0000 7f985fa00640 1 --2- 172.21.15.31:0/4205321568 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9838073320 0x7f98380757e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.198+0000 7f985fa00640 1 --2- 172.21.15.31:0/4205321568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f985815a4d0 0x7f985815bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:39.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.198+0000 7f985fa00640 1 --2- 172.21.15.31:0/4205321568 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98580b49b0 0x7f98581546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:39.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.198+0000 7f985fa00640 1 --2- 172.21.15.31:0/4205321568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98580703d0 0x7f9858155430 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:39.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.198+0000 7f985fa00640 1 -- 172.21.15.31:0/4205321568 >> 172.21.15.31:0/4205321568 conn(0x7f98580b18f0 msgr2=0x7f9858072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:39.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.202+0000 7f985fa00640 1 -- 172.21.15.31:0/4205321568 shutdown_connections 2024-09-17T05:33:39.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.202+0000 7f985fa00640 1 -- 172.21.15.31:0/4205321568 wait complete. 2024-09-17T05:33:39.225 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:33:39.229 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:33:39.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.382+0000 7fa6d0800640 1 -- 172.21.15.31:0/2248810448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b0003fe0 msgr2=0x7fa6b0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:39.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.382+0000 7fa6d0800640 1 --2- 172.21.15.31:0/2248810448 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b0003fe0 0x7fa6b0004810 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fa6b800c2e0 tx=0x7fa6b801d010 comp rx=0 tx=0).stop 2024-09-17T05:33:39.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.382+0000 7fa6ce800640 1 -- 172.21.15.31:0/2248810448 reap_dead start 2024-09-17T05:33:39.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.382+0000 7fa6d0800640 1 -- 172.21.15.31:0/2248810448 shutdown_connections 2024-09-17T05:33:39.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.382+0000 7fa6d0800640 1 -- 172.21.15.31:0/2248810448 >> 172.21.15.31:0/2248810448 conn(0x7fa6c80d1dc0 msgr2=0x7fa6c80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:39.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.382+0000 7fa6d0800640 1 -- 172.21.15.31:0/2248810448 shutdown_connections 2024-09-17T05:33:39.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.382+0000 7fa6d0800640 1 -- 172.21.15.31:0/2248810448 wait complete. 2024-09-17T05:33:39.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6d0800640 1 Processor -- start 2024-09-17T05:33:39.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6d0800640 1 -- start start 2024-09-17T05:33:39.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6d0800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b0003fe0 0x7fa6c8156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:39.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6d0800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6c80c9870 0x7fa6c81e70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:39.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6d0800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c81e75e0 0x7fa6c81f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:39.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6d0800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c80d0690 con 0x7fa6b0003fe0 2024-09-17T05:33:39.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6d0800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c80d0510 con 0x7fa6c80c9870 2024-09-17T05:33:39.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6d0800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa6c80af440 con 0x7fa6c81e75e0 2024-09-17T05:33:39.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6cde00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b0003fe0 0x7fa6c8156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:39.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6cde00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b0003fe0 0x7fa6c8156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43614/0 (socket says 172.21.15.31:43614) 2024-09-17T05:33:39.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6cde00640 1 -- 172.21.15.31:0/1251907990 learned_addr learned my addr 172.21.15.31:0/1251907990 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:39.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6cd400640 1 --2- 172.21.15.31:0/1251907990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6c80c9870 0x7fa6c81e70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:39.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6ce800640 1 --2- 172.21.15.31:0/1251907990 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c81e75e0 0x7fa6c81f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:39.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6cde00640 1 -- 172.21.15.31:0/1251907990 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c81e75e0 msgr2=0x7fa6c81f5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:39.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6cde00640 1 --2- 172.21.15.31:0/1251907990 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c81e75e0 0x7fa6c81f5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:39.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6cde00640 1 -- 172.21.15.31:0/1251907990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6c80c9870 msgr2=0x7fa6c81e70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:39.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6cde00640 1 --2- 172.21.15.31:0/1251907990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6c80c9870 0x7fa6c81e70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:39.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6cde00640 1 -- 172.21.15.31:0/1251907990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c81f6b90 con 0x7fa6b0003fe0 2024-09-17T05:33:39.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6cd400640 1 --2- 172.21.15.31:0/1251907990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6c80c9870 0x7fa6c81e70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:39.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6cde00640 1 --2- 172.21.15.31:0/1251907990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b0003fe0 0x7fa6c8156290 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc011ab0 tx=0x7fa6bc011eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:39.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6c2000640 1 -- 172.21.15.31:0/1251907990 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc00fd50 con 0x7fa6b0003fe0 2024-09-17T05:33:39.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6c2000640 1 -- 172.21.15.31:0/1251907990 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6bc016070 con 0x7fa6b0003fe0 2024-09-17T05:33:39.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6d0800640 1 -- 172.21.15.31:0/1251907990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6c81e4b50 con 0x7fa6b0003fe0 2024-09-17T05:33:39.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6c2000640 1 -- 172.21.15.31:0/1251907990 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc012690 con 0x7fa6b0003fe0 2024-09-17T05:33:39.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.386+0000 7fa6d0800640 1 -- 172.21.15.31:0/1251907990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6c81e5110 con 0x7fa6b0003fe0 2024-09-17T05:33:39.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.390+0000 7fa6d0800640 1 -- 172.21.15.31:0/1251907990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6c80cf7e0 con 0x7fa6b0003fe0 2024-09-17T05:33:39.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.390+0000 7fa6c2000640 1 -- 172.21.15.31:0/1251907990 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fa6bc018030 con 0x7fa6b0003fe0 2024-09-17T05:33:39.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.390+0000 7fa6c2000640 1 --2- 172.21.15.31:0/1251907990 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa6ac073350 0x7fa6ac075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:39.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.390+0000 7fa6c2000640 1 -- 172.21.15.31:0/1251907990 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7fa6bc094c40 con 0x7fa6b0003fe0 2024-09-17T05:33:39.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.390+0000 7fa6cd400640 1 --2- 172.21.15.31:0/1251907990 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa6ac073350 0x7fa6ac075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:39.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.390+0000 7fa6cd400640 1 --2- 172.21.15.31:0/1251907990 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa6ac073350 0x7fa6ac075810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80ac000 tx=0x7fa6b8019e50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:39.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.394+0000 7fa6c2000640 1 -- 172.21.15.31:0/1251907990 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa6c80cf7e0 con 0x7fa6b0003fe0 2024-09-17T05:33:39.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:39.606+0000 7fa6d0800640 1 -- 172.21.15.31:0/1251907990 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa6c80b14c0 con 0x7fa6b0003fe0 2024-09-17T05:33:40.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.198+0000 7fa6c2000640 1 -- 172.21.15.31:0/1251907990 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v71) ==== 122+0+0 (secure 0 0 0) 0x7fa6bc05fa40 con 0x7fa6b0003fe0 2024-09-17T05:33:40.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.202+0000 7fa6d0800640 1 -- 172.21.15.31:0/1251907990 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa6ac073350 msgr2=0x7fa6ac075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:40.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.202+0000 7fa6d0800640 1 --2- 172.21.15.31:0/1251907990 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa6ac073350 0x7fa6ac075810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80ac000 tx=0x7fa6b8019e50 comp rx=0 tx=0).stop 2024-09-17T05:33:40.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.202+0000 7fa6d0800640 1 -- 172.21.15.31:0/1251907990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b0003fe0 msgr2=0x7fa6c8156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:40.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.202+0000 7fa6d0800640 1 --2- 172.21.15.31:0/1251907990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b0003fe0 0x7fa6c8156290 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc011ab0 tx=0x7fa6bc011eb0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.202+0000 7fa6d0800640 1 -- 172.21.15.31:0/1251907990 shutdown_connections 2024-09-17T05:33:40.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.202+0000 7fa6d0800640 1 --2- 172.21.15.31:0/1251907990 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa6ac073350 0x7fa6ac075810 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.202+0000 7fa6d0800640 1 --2- 172.21.15.31:0/1251907990 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa6c81e75e0 0x7fa6c81f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.202+0000 7fa6d0800640 1 --2- 172.21.15.31:0/1251907990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6c80c9870 0x7fa6c81e70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.202+0000 7fa6d0800640 1 --2- 172.21.15.31:0/1251907990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6b0003fe0 0x7fa6c8156290 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.202+0000 7fa6d0800640 1 -- 172.21.15.31:0/1251907990 >> 172.21.15.31:0/1251907990 conn(0x7fa6c80d1dc0 msgr2=0x7fa6c8072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:40.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.202+0000 7fa6d0800640 1 -- 172.21.15.31:0/1251907990 shutdown_connections 2024-09-17T05:33:40.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.202+0000 7fa6d0800640 1 -- 172.21.15.31:0/1251907990 wait complete. 2024-09-17T05:33:40.224 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:33:40.224 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:33:40.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.370+0000 7fc58d200640 1 -- 172.21.15.31:0/759878087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc58815dae0 msgr2=0x7fc5880acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:40.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.370+0000 7fc58d200640 1 --2- 172.21.15.31:0/759878087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc58815dae0 0x7fc5880acd40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc578009900 tx=0x7fc57801c850 comp rx=0 tx=0).stop 2024-09-17T05:33:40.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.370+0000 7fc58d200640 1 -- 172.21.15.31:0/759878087 shutdown_connections 2024-09-17T05:33:40.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.370+0000 7fc58d200640 1 --2- 172.21.15.31:0/759878087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc5880b49e0 0x7fc58806f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.370+0000 7fc58d200640 1 --2- 172.21.15.31:0/759878087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc58815dae0 0x7fc5880acd40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.370+0000 7fc58d200640 1 -- 172.21.15.31:0/759878087 >> 172.21.15.31:0/759878087 conn(0x7fc5880b18f0 msgr2=0x7fc5880b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:40.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.370+0000 7fc58d200640 1 -- 172.21.15.31:0/759878087 shutdown_connections 2024-09-17T05:33:40.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.370+0000 7fc58d200640 1 -- 172.21.15.31:0/759878087 wait complete. 2024-09-17T05:33:40.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.370+0000 7fc58d200640 1 Processor -- start 2024-09-17T05:33:40.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.370+0000 7fc58d200640 1 -- start start 2024-09-17T05:33:40.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc58d200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5880b49e0 0x7fc5881502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:40.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc58d200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5880cd100 0x7fc5880ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:40.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc58d200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc58815dae0 0x7fc5880ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:40.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc58d200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc5880cf230 con 0x7fc5880cd100 2024-09-17T05:33:40.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc58d200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc5880cf0b0 con 0x7fc5880b49e0 2024-09-17T05:33:40.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc58d200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc5880cf3b0 con 0x7fc58815dae0 2024-09-17T05:33:40.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc57d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5880cd100 0x7fc5880ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:40.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc585e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5880b49e0 0x7fc5881502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:40.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc57d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5880cd100 0x7fc5880ca320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43620/0 (socket says 172.21.15.31:43620) 2024-09-17T05:33:40.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc57d400640 1 -- 172.21.15.31:0/4200762763 learned_addr learned my addr 172.21.15.31:0/4200762763 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:40.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc586800640 1 --2- 172.21.15.31:0/4200762763 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc58815dae0 0x7fc5880ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:40.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc585e00640 1 -- 172.21.15.31:0/4200762763 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc58815dae0 msgr2=0x7fc5880ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:40.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc585e00640 1 --2- 172.21.15.31:0/4200762763 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc58815dae0 0x7fc5880ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc585e00640 1 -- 172.21.15.31:0/4200762763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5880cd100 msgr2=0x7fc5880ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:40.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc585e00640 1 --2- 172.21.15.31:0/4200762763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5880cd100 0x7fc5880ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc585e00640 1 -- 172.21.15.31:0/4200762763 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5880caea0 con 0x7fc5880b49e0 2024-09-17T05:33:40.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc585e00640 1 --2- 172.21.15.31:0/4200762763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5880b49e0 0x7fc5881502a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc5780ac000 tx=0x7fc578005790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:40.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc57ea00640 1 -- 172.21.15.31:0/4200762763 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5780b2040 con 0x7fc5880b49e0 2024-09-17T05:33:40.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc57ea00640 1 -- 172.21.15.31:0/4200762763 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc578004330 con 0x7fc5880b49e0 2024-09-17T05:33:40.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc58d200640 1 -- 172.21.15.31:0/4200762763 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5881f7bf0 con 0x7fc5880b49e0 2024-09-17T05:33:40.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc57ea00640 1 -- 172.21.15.31:0/4200762763 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc578003860 con 0x7fc5880b49e0 2024-09-17T05:33:40.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc58d200640 1 -- 172.21.15.31:0/4200762763 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5881f81b0 con 0x7fc5880b49e0 2024-09-17T05:33:40.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc58d200640 1 -- 172.21.15.31:0/4200762763 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc588069410 con 0x7fc5880b49e0 2024-09-17T05:33:40.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.374+0000 7fc57ea00640 1 -- 172.21.15.31:0/4200762763 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fc578003a00 con 0x7fc5880b49e0 2024-09-17T05:33:40.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.378+0000 7fc57ea00640 1 --2- 172.21.15.31:0/4200762763 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc564073320 0x7fc5640757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:40.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.378+0000 7fc57ea00640 1 -- 172.21.15.31:0/4200762763 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7fc57812ddd0 con 0x7fc5880b49e0 2024-09-17T05:33:40.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.378+0000 7fc57d400640 1 --2- 172.21.15.31:0/4200762763 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc564073320 0x7fc5640757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:40.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.378+0000 7fc57d400640 1 --2- 172.21.15.31:0/4200762763 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc564073320 0x7fc5640757e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc5880736a0 tx=0x7fc570009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:40.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.382+0000 7fc57ea00640 1 -- 172.21.15.31:0/4200762763 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc5780bd060 con 0x7fc5880b49e0 2024-09-17T05:33:40.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.594+0000 7fc58d200640 1 -- 172.21.15.31:0/4200762763 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5880acd40 con 0x7fc5880b49e0 2024-09-17T05:33:40.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.598+0000 7fc57ea00640 1 -- 172.21.15.31:0/4200762763 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5228 (secure 0 0 0) 0x7fc5780164d0 con 0x7fc5880b49e0 2024-09-17T05:33:40.598 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:40.598 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":71,"btime":"2024-09-17T05:33:40:199932+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3921984787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3921984787},{"type":"v1","addr":"172.21.15.155:6809","nonce":3921984787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3122851843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3122851843},{"type":"v1","addr":"172.21.15.155:6835","nonce":3122851843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6936,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/706788626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":706788626},{"type":"v1","addr":"172.21.15.31:6834","nonce":706788626}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:33:36.585711+0000","modified":"2024-09-17T05:33:39.610967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4072380267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":4072380267},{"type":"v1","addr":"172.21.15.31:6835","nonce":4072380267}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6939,"qdb_cluster":[6939]},"id":8}]} 2024-09-17T05:33:40.599 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 71 2024-09-17T05:33:40.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.598+0000 7fc58d200640 1 -- 172.21.15.31:0/4200762763 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc564073320 msgr2=0x7fc5640757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:40.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.598+0000 7fc58d200640 1 --2- 172.21.15.31:0/4200762763 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc564073320 0x7fc5640757e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc5880736a0 tx=0x7fc570009040 comp rx=0 tx=0).stop 2024-09-17T05:33:40.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.598+0000 7fc58d200640 1 -- 172.21.15.31:0/4200762763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5880b49e0 msgr2=0x7fc5881502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:40.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.598+0000 7fc58d200640 1 --2- 172.21.15.31:0/4200762763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5880b49e0 0x7fc5881502a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc5780ac000 tx=0x7fc578005790 comp rx=0 tx=0).stop 2024-09-17T05:33:40.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.598+0000 7fc58d200640 1 -- 172.21.15.31:0/4200762763 shutdown_connections 2024-09-17T05:33:40.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.598+0000 7fc58d200640 1 --2- 172.21.15.31:0/4200762763 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc564073320 0x7fc5640757e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.598+0000 7fc58d200640 1 --2- 172.21.15.31:0/4200762763 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc58815dae0 0x7fc5880ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.598+0000 7fc58d200640 1 --2- 172.21.15.31:0/4200762763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc5880cd100 0x7fc5880ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.598+0000 7fc58d200640 1 --2- 172.21.15.31:0/4200762763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5880b49e0 0x7fc5881502a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.598+0000 7fc58d200640 1 -- 172.21.15.31:0/4200762763 >> 172.21.15.31:0/4200762763 conn(0x7fc5880b18f0 msgr2=0x7fc5880b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:40.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.598+0000 7fc58d200640 1 -- 172.21.15.31:0/4200762763 shutdown_connections 2024-09-17T05:33:40.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.598+0000 7fc58d200640 1 -- 172.21.15.31:0/4200762763 wait complete. 2024-09-17T05:33:40.619 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:33:40.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.762+0000 7fe259600640 1 -- 172.21.15.31:0/48068130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe25415f000 msgr2=0x7fe2540d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:40.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.762+0000 7fe259600640 1 --2- 172.21.15.31:0/48068130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe25415f000 0x7fe2540d01b0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fe244009840 tx=0x7fe24401c700 comp rx=0 tx=0).stop 2024-09-17T05:33:40.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.762+0000 7fe259600640 1 -- 172.21.15.31:0/48068130 shutdown_connections 2024-09-17T05:33:40.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.762+0000 7fe259600640 1 --2- 172.21.15.31:0/48068130 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe25415f000 0x7fe2540d01b0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.762+0000 7fe259600640 1 -- 172.21.15.31:0/48068130 >> 172.21.15.31:0/48068130 conn(0x7fe25409aa10 msgr2=0x7fe25409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:40.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.762+0000 7fe259600640 1 -- 172.21.15.31:0/48068130 shutdown_connections 2024-09-17T05:33:40.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.762+0000 7fe259600640 1 -- 172.21.15.31:0/48068130 wait complete. 2024-09-17T05:33:40.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe259600640 1 Processor -- start 2024-09-17T05:33:40.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe259600640 1 -- start start 2024-09-17T05:33:40.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe259600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2540b2590 0x7fe254152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:40.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe259600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2540cefb0 0x7fe2541fbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:40.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe259600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe25415f000 0x7fe2540afd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:40.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe259600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe25416a110 con 0x7fe2540b2590 2024-09-17T05:33:40.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe259600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe254169f90 con 0x7fe25415f000 2024-09-17T05:33:40.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe259600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe25416a290 con 0x7fe2540cefb0 2024-09-17T05:33:40.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe253e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2540b2590 0x7fe254152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:40.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe253e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2540b2590 0x7fe254152c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43640/0 (socket says 172.21.15.31:43640) 2024-09-17T05:33:40.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe253e00640 1 -- 172.21.15.31:0/2218551527 learned_addr learned my addr 172.21.15.31:0/2218551527 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:40.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe253e00640 1 -- 172.21.15.31:0/2218551527 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2540cefb0 msgr2=0x7fe2541fbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:40.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe24be00640 1 --2- 172.21.15.31:0/2218551527 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2540cefb0 0x7fe2541fbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:40.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe258c00640 1 --2- 172.21.15.31:0/2218551527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe25415f000 0x7fe2540afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:40.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe253e00640 1 --2- 172.21.15.31:0/2218551527 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2540cefb0 0x7fe2541fbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe253e00640 1 -- 172.21.15.31:0/2218551527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe25415f000 msgr2=0x7fe2540afd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:40.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe253e00640 1 --2- 172.21.15.31:0/2218551527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe25415f000 0x7fe2540afd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe253e00640 1 -- 172.21.15.31:0/2218551527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2541f7f10 con 0x7fe2540b2590 2024-09-17T05:33:40.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe258c00640 1 --2- 172.21.15.31:0/2218551527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe25415f000 0x7fe2540afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:33:40.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe24be00640 1 --2- 172.21.15.31:0/2218551527 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2540cefb0 0x7fe2541fbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:33:40.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe253e00640 1 --2- 172.21.15.31:0/2218551527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2540b2590 0x7fe254152c20 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fe244009790 tx=0x7fe2440a86e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:40.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe250c00640 1 -- 172.21.15.31:0/2218551527 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2440a8a70 con 0x7fe2540b2590 2024-09-17T05:33:40.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe250c00640 1 -- 172.21.15.31:0/2218551527 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2440a8c10 con 0x7fe2540b2590 2024-09-17T05:33:40.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe250c00640 1 -- 172.21.15.31:0/2218551527 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244005140 con 0x7fe2540b2590 2024-09-17T05:33:40.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe259600640 1 -- 172.21.15.31:0/2218551527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2541f81f0 con 0x7fe2540b2590 2024-09-17T05:33:40.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.766+0000 7fe259600640 1 -- 172.21.15.31:0/2218551527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2541534a0 con 0x7fe2540b2590 2024-09-17T05:33:40.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.770+0000 7fe259600640 1 -- 172.21.15.31:0/2218551527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe254159b60 con 0x7fe2540b2590 2024-09-17T05:33:40.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.770+0000 7fe250c00640 1 -- 172.21.15.31:0/2218551527 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fe2440052e0 con 0x7fe2540b2590 2024-09-17T05:33:40.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.770+0000 7fe250c00640 1 --2- 172.21.15.31:0/2218551527 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe230073320 0x7fe2300757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:40.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.770+0000 7fe250c00640 1 -- 172.21.15.31:0/2218551527 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7fe24412e9e0 con 0x7fe2540b2590 2024-09-17T05:33:40.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.770+0000 7fe24be00640 1 --2- 172.21.15.31:0/2218551527 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe230073320 0x7fe2300757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:40.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.770+0000 7fe24be00640 1 --2- 172.21.15.31:0/2218551527 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe230073320 0x7fe2300757e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe254159e10 tx=0x7fe23c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:40.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.774+0000 7fe250c00640 1 -- 172.21.15.31:0/2218551527 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe2440ac030 con 0x7fe2540b2590 2024-09-17T05:33:40.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.950+0000 7fe259600640 1 -- 172.21.15.31:0/2218551527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe254159880 con 0x7fe2540b2590 2024-09-17T05:33:40.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.954+0000 7fe250c00640 1 -- 172.21.15.31:0/2218551527 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+16702 (secure 0 0 0) 0x7fe244016410 con 0x7fe2540b2590 2024-09-17T05:33:40.955 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:40.955 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":100,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:33:38.177187+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:33:34.313310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T05:33:35.543945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:33:40.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.954+0000 7fe259600640 1 -- 172.21.15.31:0/2218551527 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe230073320 msgr2=0x7fe2300757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:40.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.954+0000 7fe259600640 1 --2- 172.21.15.31:0/2218551527 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe230073320 0x7fe2300757e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe254159e10 tx=0x7fe23c009040 comp rx=0 tx=0).stop 2024-09-17T05:33:40.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.954+0000 7fe259600640 1 -- 172.21.15.31:0/2218551527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2540b2590 msgr2=0x7fe254152c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:40.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.954+0000 7fe259600640 1 --2- 172.21.15.31:0/2218551527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2540b2590 0x7fe254152c20 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fe244009790 tx=0x7fe2440a86e0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.954+0000 7fe259600640 1 -- 172.21.15.31:0/2218551527 shutdown_connections 2024-09-17T05:33:40.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.954+0000 7fe259600640 1 --2- 172.21.15.31:0/2218551527 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe230073320 0x7fe2300757e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.954+0000 7fe259600640 1 --2- 172.21.15.31:0/2218551527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe25415f000 0x7fe2540afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.954+0000 7fe259600640 1 --2- 172.21.15.31:0/2218551527 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2540cefb0 0x7fe2541fbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.954+0000 7fe259600640 1 --2- 172.21.15.31:0/2218551527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2540b2590 0x7fe254152c20 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:40.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.954+0000 7fe259600640 1 -- 172.21.15.31:0/2218551527 >> 172.21.15.31:0/2218551527 conn(0x7fe25409aa10 msgr2=0x7fe25406dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:40.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.954+0000 7fe259600640 1 -- 172.21.15.31:0/2218551527 shutdown_connections 2024-09-17T05:33:40.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:40.954+0000 7fe259600640 1 -- 172.21.15.31:0/2218551527 wait complete. 2024-09-17T05:33:40.977 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:33:40.978 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:33:41.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.122+0000 7f5db1e00640 1 -- 172.21.15.31:0/493273142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dac15f490 msgr2=0x7f5dac0b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:41.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.122+0000 7f5db1e00640 1 --2- 172.21.15.31:0/493273142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dac15f490 0x7f5dac0b14c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f5dac074950 tx=0x7f5d9c01c800 comp rx=0 tx=0).stop 2024-09-17T05:33:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.122+0000 7f5db1e00640 1 -- 172.21.15.31:0/493273142 shutdown_connections 2024-09-17T05:33:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.122+0000 7f5db1e00640 1 --2- 172.21.15.31:0/493273142 >> v2:172.21.15.155:3300/0 conn(0x7f5dac0afca0 0x7f5dac0b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.122+0000 7f5db1e00640 1 --2- 172.21.15.31:0/493273142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dac15f490 0x7f5dac0b14c0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.122+0000 7f5db1e00640 1 -- 172.21.15.31:0/493273142 >> 172.21.15.31:0/493273142 conn(0x7f5dac0d1e30 msgr2=0x7f5dac0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.122+0000 7f5db1e00640 1 -- 172.21.15.31:0/493273142 shutdown_connections 2024-09-17T05:33:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.122+0000 7f5db1e00640 1 -- 172.21.15.31:0/493273142 wait complete. 2024-09-17T05:33:41.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.122+0000 7f5db1e00640 1 Processor -- start 2024-09-17T05:33:41.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.122+0000 7f5db1e00640 1 -- start start 2024-09-17T05:33:41.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5db1e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dac0afca0 0x7f5dac1f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:41.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5db1e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dac0b2e80 0x7f5dac151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:41.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5db1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dac15f490 0x7f5dac15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:41.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5db1e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac168e00 con 0x7f5dac15f490 2024-09-17T05:33:41.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5db1e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac168c80 con 0x7f5dac0afca0 2024-09-17T05:33:41.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5db1e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5dac168f80 con 0x7f5dac0b2e80 2024-09-17T05:33:41.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5dab400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dac15f490 0x7f5dac15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:41.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5dab400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dac15f490 0x7f5dac15cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43656/0 (socket says 172.21.15.31:43656) 2024-09-17T05:33:41.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5dab400640 1 -- 172.21.15.31:0/3892511402 learned_addr learned my addr 172.21.15.31:0/3892511402 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:41.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5daaa00640 1 --2- 172.21.15.31:0/3892511402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dac0afca0 0x7f5dac1f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:41.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5daa000640 1 --2- 172.21.15.31:0/3892511402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dac0b2e80 0x7f5dac151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:41.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5dab400640 1 -- 172.21.15.31:0/3892511402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dac0b2e80 msgr2=0x7f5dac151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:41.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5dab400640 1 --2- 172.21.15.31:0/3892511402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dac0b2e80 0x7f5dac151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5dab400640 1 -- 172.21.15.31:0/3892511402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dac0afca0 msgr2=0x7f5dac1f86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:41.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5dab400640 1 --2- 172.21.15.31:0/3892511402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dac0afca0 0x7f5dac1f86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5dab400640 1 -- 172.21.15.31:0/3892511402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dac1f8c00 con 0x7f5dac15f490 2024-09-17T05:33:41.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5dab400640 1 --2- 172.21.15.31:0/3892511402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dac15f490 0x7f5dac15cc60 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f5da400ea20 tx=0x7f5da400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:41.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5da3400640 1 -- 172.21.15.31:0/3892511402 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da400cde0 con 0x7f5dac15f490 2024-09-17T05:33:41.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5da3400640 1 -- 172.21.15.31:0/3892511402 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5da4004c40 con 0x7f5dac15f490 2024-09-17T05:33:41.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5db1e00640 1 -- 172.21.15.31:0/3892511402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dac1fb630 con 0x7f5dac15f490 2024-09-17T05:33:41.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5da3400640 1 -- 172.21.15.31:0/3892511402 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da4005280 con 0x7f5dac15f490 2024-09-17T05:33:41.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5db1e00640 1 -- 172.21.15.31:0/3892511402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dac1fbbf0 con 0x7f5dac15f490 2024-09-17T05:33:41.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.126+0000 7f5db1e00640 1 -- 172.21.15.31:0/3892511402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dac0b00d0 con 0x7f5dac15f490 2024-09-17T05:33:41.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.130+0000 7f5da3400640 1 -- 172.21.15.31:0/3892511402 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f5da4005420 con 0x7f5dac15f490 2024-09-17T05:33:41.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.130+0000 7f5da3400640 1 --2- 172.21.15.31:0/3892511402 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5d8c073320 0x7f5d8c0757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:41.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.130+0000 7f5da3400640 1 -- 172.21.15.31:0/3892511402 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7f5da4094ce0 con 0x7f5dac15f490 2024-09-17T05:33:41.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.130+0000 7f5daaa00640 1 --2- 172.21.15.31:0/3892511402 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5d8c073320 0x7f5d8c0757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:41.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.130+0000 7f5daaa00640 1 --2- 172.21.15.31:0/3892511402 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5d8c073320 0x7f5d8c0757e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c0af000 tx=0x7f5d9c01b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:41.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.134+0000 7f5da3400640 1 -- 172.21.15.31:0/3892511402 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5da4016030 con 0x7f5dac15f490 2024-09-17T05:33:41.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.310+0000 7f5db1e00640 1 -- 172.21.15.31:0/3892511402 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5dac0cffa0 con 0x7f5d8c073320 2024-09-17T05:33:41.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.314+0000 7f5da3400640 1 -- 172.21.15.31:0/3892511402 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252105 (secure 0 0 0) 0x7f5dac0cffa0 con 0x7f5d8c073320 2024-09-17T05:33:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:41.322 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:33:41.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.318+0000 7f5db1e00640 1 -- 172.21.15.31:0/3892511402 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5d8c073320 msgr2=0x7f5d8c0757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:41.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.318+0000 7f5db1e00640 1 --2- 172.21.15.31:0/3892511402 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5d8c073320 0x7f5d8c0757e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c0af000 tx=0x7f5d9c01b040 comp rx=0 tx=0).stop 2024-09-17T05:33:41.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.318+0000 7f5db1e00640 1 -- 172.21.15.31:0/3892511402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dac15f490 msgr2=0x7f5dac15cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:41.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.318+0000 7f5db1e00640 1 --2- 172.21.15.31:0/3892511402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dac15f490 0x7f5dac15cc60 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f5da400ea20 tx=0x7f5da400eee0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.318+0000 7f5db1e00640 1 -- 172.21.15.31:0/3892511402 shutdown_connections 2024-09-17T05:33:41.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.318+0000 7f5db1e00640 1 --2- 172.21.15.31:0/3892511402 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5d8c073320 0x7f5d8c0757e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.318+0000 7f5db1e00640 1 --2- 172.21.15.31:0/3892511402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5dac15f490 0x7f5dac15cc60 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.318+0000 7f5db1e00640 1 --2- 172.21.15.31:0/3892511402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5dac0b2e80 0x7f5dac151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.318+0000 7f5db1e00640 1 --2- 172.21.15.31:0/3892511402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5dac0afca0 0x7f5dac1f86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.318+0000 7f5db1e00640 1 -- 172.21.15.31:0/3892511402 >> 172.21.15.31:0/3892511402 conn(0x7f5dac0d1e30 msgr2=0x7f5dac0d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:41.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.318+0000 7f5db1e00640 1 -- 172.21.15.31:0/3892511402 shutdown_connections 2024-09-17T05:33:41.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.318+0000 7f5db1e00640 1 -- 172.21.15.31:0/3892511402 wait complete. 2024-09-17T05:33:41.341 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-09-17T05:33:40.712237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":157,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260356,"kb_used_data":10816,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714364,"statfs":{"total":773094113280,"available":772827508736,"internally_reserved":0,"allocated":11075584,"data_stored":5468204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.560777"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.206067+0000","last_change":"2024-09-17T05:33:37.198548+0000","last_active":"2024-09-17T05:33:37.206067+0000","last_peered":"2024-09-17T05:33:37.206067+0000","last_clean":"2024-09-17T05:33:37.206067+0000","last_became_active":"2024-09-17T05:33:37.198235+0000","last_became_peered":"2024-09-17T05:33:37.198235+0000","last_unstale":"2024-09-17T05:33:37.206067+0000","last_undegraded":"2024-09-17T05:33:37.206067+0000","last_fullsized":"2024-09-17T05:33:37.206067+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:28.281393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.189584+0000","last_change":"2024-09-17T05:33:37.204301+0000","last_active":"2024-09-17T05:33:38.189584+0000","last_peered":"2024-09-17T05:33:38.189584+0000","last_clean":"2024-09-17T05:33:38.189584+0000","last_became_active":"2024-09-17T05:33:37.203932+0000","last_became_peered":"2024-09-17T05:33:37.203932+0000","last_unstale":"2024-09-17T05:33:38.189584+0000","last_undegraded":"2024-09-17T05:33:38.189584+0000","last_fullsized":"2024-09-17T05:33:38.189584+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:06.063824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.197719+0000","last_change":"2024-09-17T05:33:37.192820+0000","last_active":"2024-09-17T05:33:37.197719+0000","last_peered":"2024-09-17T05:33:37.197719+0000","last_clean":"2024-09-17T05:33:37.197719+0000","last_became_active":"2024-09-17T05:33:37.192490+0000","last_became_peered":"2024-09-17T05:33:37.192490+0000","last_unstale":"2024-09-17T05:33:37.197719+0000","last_undegraded":"2024-09-17T05:33:37.197719+0000","last_fullsized":"2024-09-17T05:33:37.197719+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:15.287123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.205722+0000","last_change":"2024-09-17T05:33:37.190303+0000","last_active":"2024-09-17T05:33:37.205722+0000","last_peered":"2024-09-17T05:33:37.205722+0000","last_clean":"2024-09-17T05:33:37.205722+0000","last_became_active":"2024-09-17T05:33:37.190010+0000","last_became_peered":"2024-09-17T05:33:37.190010+0000","last_unstale":"2024-09-17T05:33:37.205722+0000","last_undegraded":"2024-09-17T05:33:37.205722+0000","last_fullsized":"2024-09-17T05:33:37.205722+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:56.513649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.192320+0000","last_change":"2024-09-17T05:33:37.183136+0000","last_active":"2024-09-17T05:33:37.192320+0000","last_peered":"2024-09-17T05:33:37.192320+0000","last_clean":"2024-09-17T05:33:37.192320+0000","last_became_active":"2024-09-17T05:33:37.182796+0000","last_became_peered":"2024-09-17T05:33:37.182796+0000","last_unstale":"2024-09-17T05:33:37.192320+0000","last_undegraded":"2024-09-17T05:33:37.192320+0000","last_fullsized":"2024-09-17T05:33:37.192320+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:47.397873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.209986+0000","last_change":"2024-09-17T05:33:37.204409+0000","last_active":"2024-09-17T05:33:37.209986+0000","last_peered":"2024-09-17T05:33:37.209986+0000","last_clean":"2024-09-17T05:33:37.209986+0000","last_became_active":"2024-09-17T05:33:37.199294+0000","last_became_peered":"2024-09-17T05:33:37.199294+0000","last_unstale":"2024-09-17T05:33:37.209986+0000","last_undegraded":"2024-09-17T05:33:37.209986+0000","last_fullsized":"2024-09-17T05:33:37.209986+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:57:11.550687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188319+0000","last_change":"2024-09-17T05:33:37.196307+0000","last_active":"2024-09-17T05:33:38.188319+0000","last_peered":"2024-09-17T05:33:38.188319+0000","last_clean":"2024-09-17T05:33:38.188319+0000","last_became_active":"2024-09-17T05:33:37.195956+0000","last_became_peered":"2024-09-17T05:33:37.195956+0000","last_unstale":"2024-09-17T05:33:38.188319+0000","last_undegraded":"2024-09-17T05:33:38.188319+0000","last_fullsized":"2024-09-17T05:33:38.188319+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:44.186072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.208216+0000","last_change":"2024-09-17T05:33:37.204770+0000","last_active":"2024-09-17T05:33:37.208216+0000","last_peered":"2024-09-17T05:33:37.208216+0000","last_clean":"2024-09-17T05:33:37.208216+0000","last_became_active":"2024-09-17T05:33:37.204515+0000","last_became_peered":"2024-09-17T05:33:37.204515+0000","last_unstale":"2024-09-17T05:33:37.208216+0000","last_undegraded":"2024-09-17T05:33:37.208216+0000","last_fullsized":"2024-09-17T05:33:37.208216+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:50.487929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.204904+0000","last_change":"2024-09-17T05:33:37.195468+0000","last_active":"2024-09-17T05:33:37.204904+0000","last_peered":"2024-09-17T05:33:37.204904+0000","last_clean":"2024-09-17T05:33:37.204904+0000","last_became_active":"2024-09-17T05:33:37.194501+0000","last_became_peered":"2024-09-17T05:33:37.194501+0000","last_unstale":"2024-09-17T05:33:37.204904+0000","last_undegraded":"2024-09-17T05:33:37.204904+0000","last_fullsized":"2024-09-17T05:33:37.204904+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:56.268466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.200932+0000","last_change":"2024-09-17T05:33:37.194598+0000","last_active":"2024-09-17T05:33:37.200932+0000","last_peered":"2024-09-17T05:33:37.200932+0000","last_clean":"2024-09-17T05:33:37.200932+0000","last_became_active":"2024-09-17T05:33:37.194314+0000","last_became_peered":"2024-09-17T05:33:37.194314+0000","last_unstale":"2024-09-17T05:33:37.200932+0000","last_undegraded":"2024-09-17T05:33:37.200932+0000","last_fullsized":"2024-09-17T05:33:37.200932+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:11.808394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188730+0000","last_change":"2024-09-17T05:33:37.199898+0000","last_active":"2024-09-17T05:33:38.188730+0000","last_peered":"2024-09-17T05:33:38.188730+0000","last_clean":"2024-09-17T05:33:38.188730+0000","last_became_active":"2024-09-17T05:33:37.199557+0000","last_became_peered":"2024-09-17T05:33:37.199557+0000","last_unstale":"2024-09-17T05:33:38.188730+0000","last_undegraded":"2024-09-17T05:33:38.188730+0000","last_fullsized":"2024-09-17T05:33:38.188730+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:33:23.216217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.205695+0000","last_change":"2024-09-17T05:33:37.195355+0000","last_active":"2024-09-17T05:33:37.205695+0000","last_peered":"2024-09-17T05:33:37.205695+0000","last_clean":"2024-09-17T05:33:37.205695+0000","last_became_active":"2024-09-17T05:33:37.194279+0000","last_became_peered":"2024-09-17T05:33:37.194279+0000","last_unstale":"2024-09-17T05:33:37.205695+0000","last_undegraded":"2024-09-17T05:33:37.205695+0000","last_fullsized":"2024-09-17T05:33:37.205695+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:06.159165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.203633+0000","last_change":"2024-09-17T05:33:37.199516+0000","last_active":"2024-09-17T05:33:37.203633+0000","last_peered":"2024-09-17T05:33:37.203633+0000","last_clean":"2024-09-17T05:33:37.203633+0000","last_became_active":"2024-09-17T05:33:37.199170+0000","last_became_peered":"2024-09-17T05:33:37.199170+0000","last_unstale":"2024-09-17T05:33:37.203633+0000","last_undegraded":"2024-09-17T05:33:37.203633+0000","last_fullsized":"2024-09-17T05:33:37.203633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:10.244727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.203405+0000","last_change":"2024-09-17T05:33:37.197206+0000","last_active":"2024-09-17T05:33:37.203405+0000","last_peered":"2024-09-17T05:33:37.203405+0000","last_clean":"2024-09-17T05:33:37.203405+0000","last_became_active":"2024-09-17T05:33:37.196821+0000","last_became_peered":"2024-09-17T05:33:37.196821+0000","last_unstale":"2024-09-17T05:33:37.203405+0000","last_undegraded":"2024-09-17T05:33:37.203405+0000","last_fullsized":"2024-09-17T05:33:37.203405+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:57.757562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.210531+0000","last_change":"2024-09-17T05:33:37.204400+0000","last_active":"2024-09-17T05:33:37.210531+0000","last_peered":"2024-09-17T05:33:37.210531+0000","last_clean":"2024-09-17T05:33:37.210531+0000","last_became_active":"2024-09-17T05:33:37.199146+0000","last_became_peered":"2024-09-17T05:33:37.199146+0000","last_unstale":"2024-09-17T05:33:37.210531+0000","last_undegraded":"2024-09-17T05:33:37.210531+0000","last_fullsized":"2024-09-17T05:33:37.210531+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:20:36.153010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.195264+0000","last_change":"2024-09-17T05:33:37.191655+0000","last_active":"2024-09-17T05:33:37.195264+0000","last_peered":"2024-09-17T05:33:37.195264+0000","last_clean":"2024-09-17T05:33:37.195264+0000","last_became_active":"2024-09-17T05:33:37.189494+0000","last_became_peered":"2024-09-17T05:33:37.189494+0000","last_unstale":"2024-09-17T05:33:37.195264+0000","last_undegraded":"2024-09-17T05:33:37.195264+0000","last_fullsized":"2024-09-17T05:33:37.195264+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:16.395230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188781+0000","last_change":"2024-09-17T05:33:37.202144+0000","last_active":"2024-09-17T05:33:38.188781+0000","last_peered":"2024-09-17T05:33:38.188781+0000","last_clean":"2024-09-17T05:33:38.188781+0000","last_became_active":"2024-09-17T05:33:37.201841+0000","last_became_peered":"2024-09-17T05:33:37.201841+0000","last_unstale":"2024-09-17T05:33:38.188781+0000","last_undegraded":"2024-09-17T05:33:38.188781+0000","last_fullsized":"2024-09-17T05:33:38.188781+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:05.323073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.208761+0000","last_change":"2024-09-17T05:33:37.201695+0000","last_active":"2024-09-17T05:33:37.208761+0000","last_peered":"2024-09-17T05:33:37.208761+0000","last_clean":"2024-09-17T05:33:37.208761+0000","last_became_active":"2024-09-17T05:33:37.199837+0000","last_became_peered":"2024-09-17T05:33:37.199837+0000","last_unstale":"2024-09-17T05:33:37.208761+0000","last_undegraded":"2024-09-17T05:33:37.208761+0000","last_fullsized":"2024-09-17T05:33:37.208761+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:28.947917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.205448+0000","last_change":"2024-09-17T05:33:37.201807+0000","last_active":"2024-09-17T05:33:37.205448+0000","last_peered":"2024-09-17T05:33:37.205448+0000","last_clean":"2024-09-17T05:33:37.205448+0000","last_became_active":"2024-09-17T05:33:37.201467+0000","last_became_peered":"2024-09-17T05:33:37.201467+0000","last_unstale":"2024-09-17T05:33:37.205448+0000","last_undegraded":"2024-09-17T05:33:37.205448+0000","last_fullsized":"2024-09-17T05:33:37.205448+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:25.034174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188928+0000","last_change":"2024-09-17T05:33:37.184547+0000","last_active":"2024-09-17T05:33:38.188928+0000","last_peered":"2024-09-17T05:33:38.188928+0000","last_clean":"2024-09-17T05:33:38.188928+0000","last_became_active":"2024-09-17T05:33:37.184244+0000","last_became_peered":"2024-09-17T05:33:37.184244+0000","last_unstale":"2024-09-17T05:33:38.188928+0000","last_undegraded":"2024-09-17T05:33:38.188928+0000","last_fullsized":"2024-09-17T05:33:38.188928+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:14.456108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.189307+0000","last_change":"2024-09-17T05:33:37.193845+0000","last_active":"2024-09-17T05:33:38.189307+0000","last_peered":"2024-09-17T05:33:38.189307+0000","last_clean":"2024-09-17T05:33:38.189307+0000","last_became_active":"2024-09-17T05:33:37.193475+0000","last_became_peered":"2024-09-17T05:33:37.193475+0000","last_unstale":"2024-09-17T05:33:38.189307+0000","last_undegraded":"2024-09-17T05:33:38.189307+0000","last_fullsized":"2024-09-17T05:33:38.189307+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:14:25.565762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181315+0000","last_change":"2024-09-17T05:33:37.193398+0000","last_active":"2024-09-17T05:33:38.181315+0000","last_peered":"2024-09-17T05:33:38.181315+0000","last_clean":"2024-09-17T05:33:38.181315+0000","last_became_active":"2024-09-17T05:33:37.192753+0000","last_became_peered":"2024-09-17T05:33:37.192753+0000","last_unstale":"2024-09-17T05:33:38.181315+0000","last_undegraded":"2024-09-17T05:33:38.181315+0000","last_fullsized":"2024-09-17T05:33:38.181315+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:18.318833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188869+0000","last_change":"2024-09-17T05:33:37.189334+0000","last_active":"2024-09-17T05:33:38.188869+0000","last_peered":"2024-09-17T05:33:38.188869+0000","last_clean":"2024-09-17T05:33:38.188869+0000","last_became_active":"2024-09-17T05:33:37.187998+0000","last_became_peered":"2024-09-17T05:33:37.187998+0000","last_unstale":"2024-09-17T05:33:38.188869+0000","last_undegraded":"2024-09-17T05:33:38.188869+0000","last_fullsized":"2024-09-17T05:33:38.188869+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:58.193938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181114+0000","last_change":"2024-09-17T05:33:37.194717+0000","last_active":"2024-09-17T05:33:38.181114+0000","last_peered":"2024-09-17T05:33:38.181114+0000","last_clean":"2024-09-17T05:33:38.181114+0000","last_became_active":"2024-09-17T05:33:37.191325+0000","last_became_peered":"2024-09-17T05:33:37.191325+0000","last_unstale":"2024-09-17T05:33:38.181114+0000","last_undegraded":"2024-09-17T05:33:38.181114+0000","last_fullsized":"2024-09-17T05:33:38.181114+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:51.540960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.189113+0000","last_change":"2024-09-17T05:33:37.200778+0000","last_active":"2024-09-17T05:33:38.189113+0000","last_peered":"2024-09-17T05:33:38.189113+0000","last_clean":"2024-09-17T05:33:38.189113+0000","last_became_active":"2024-09-17T05:33:37.199567+0000","last_became_peered":"2024-09-17T05:33:37.199567+0000","last_unstale":"2024-09-17T05:33:38.189113+0000","last_undegraded":"2024-09-17T05:33:38.189113+0000","last_fullsized":"2024-09-17T05:33:38.189113+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:18.318833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.198598+0000","last_change":"2024-09-17T05:33:37.190286+0000","last_active":"2024-09-17T05:33:37.198598+0000","last_peered":"2024-09-17T05:33:37.198598+0000","last_clean":"2024-09-17T05:33:37.198598+0000","last_became_active":"2024-09-17T05:33:37.189907+0000","last_became_peered":"2024-09-17T05:33:37.189907+0000","last_unstale":"2024-09-17T05:33:37.198598+0000","last_undegraded":"2024-09-17T05:33:37.198598+0000","last_fullsized":"2024-09-17T05:33:37.198598+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:51.429878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.213640+0000","last_change":"2024-09-17T05:33:37.206563+0000","last_active":"2024-09-17T05:33:37.213640+0000","last_peered":"2024-09-17T05:33:37.213640+0000","last_clean":"2024-09-17T05:33:37.213640+0000","last_became_active":"2024-09-17T05:33:37.206247+0000","last_became_peered":"2024-09-17T05:33:37.206247+0000","last_unstale":"2024-09-17T05:33:37.213640+0000","last_undegraded":"2024-09-17T05:33:37.213640+0000","last_fullsized":"2024-09-17T05:33:37.213640+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:07.260045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181698+0000","last_change":"2024-09-17T05:33:37.192899+0000","last_active":"2024-09-17T05:33:38.181698+0000","last_peered":"2024-09-17T05:33:38.181698+0000","last_clean":"2024-09-17T05:33:38.181698+0000","last_became_active":"2024-09-17T05:33:37.192098+0000","last_became_peered":"2024-09-17T05:33:37.192098+0000","last_unstale":"2024-09-17T05:33:38.181698+0000","last_undegraded":"2024-09-17T05:33:38.181698+0000","last_fullsized":"2024-09-17T05:33:38.181698+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:30.695230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188709+0000","last_change":"2024-09-17T05:33:37.189857+0000","last_active":"2024-09-17T05:33:38.188709+0000","last_peered":"2024-09-17T05:33:38.188709+0000","last_clean":"2024-09-17T05:33:38.188709+0000","last_became_active":"2024-09-17T05:33:37.188353+0000","last_became_peered":"2024-09-17T05:33:37.188353+0000","last_unstale":"2024-09-17T05:33:38.188709+0000","last_undegraded":"2024-09-17T05:33:38.188709+0000","last_fullsized":"2024-09-17T05:33:38.188709+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:45.489290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188416+0000","last_change":"2024-09-17T05:33:37.198803+0000","last_active":"2024-09-17T05:33:38.188416+0000","last_peered":"2024-09-17T05:33:38.188416+0000","last_clean":"2024-09-17T05:33:38.188416+0000","last_became_active":"2024-09-17T05:33:37.198400+0000","last_became_peered":"2024-09-17T05:33:37.198400+0000","last_unstale":"2024-09-17T05:33:38.188416+0000","last_undegraded":"2024-09-17T05:33:38.188416+0000","last_fullsized":"2024-09-17T05:33:38.188416+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:51.652465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.197163+0000","last_change":"2024-09-17T05:33:37.189034+0000","last_active":"2024-09-17T05:33:37.197163+0000","last_peered":"2024-09-17T05:33:37.197163+0000","last_clean":"2024-09-17T05:33:37.197163+0000","last_became_active":"2024-09-17T05:33:37.188693+0000","last_became_peered":"2024-09-17T05:33:37.188693+0000","last_unstale":"2024-09-17T05:33:37.197163+0000","last_undegraded":"2024-09-17T05:33:37.197163+0000","last_fullsized":"2024-09-17T05:33:37.197163+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:30.642109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.210331+0000","last_change":"2024-09-17T05:33:37.205105+0000","last_active":"2024-09-17T05:33:37.210331+0000","last_peered":"2024-09-17T05:33:37.210331+0000","last_clean":"2024-09-17T05:33:37.210331+0000","last_became_active":"2024-09-17T05:33:37.199969+0000","last_became_peered":"2024-09-17T05:33:37.199969+0000","last_unstale":"2024-09-17T05:33:37.210331+0000","last_undegraded":"2024-09-17T05:33:37.210331+0000","last_fullsized":"2024-09-17T05:33:37.210331+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:19.123604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.207439+0000","last_change":"2024-09-17T05:33:37.203111+0000","last_active":"2024-09-17T05:33:37.207439+0000","last_peered":"2024-09-17T05:33:37.207439+0000","last_clean":"2024-09-17T05:33:37.207439+0000","last_became_active":"2024-09-17T05:33:37.198677+0000","last_became_peered":"2024-09-17T05:33:37.198677+0000","last_unstale":"2024-09-17T05:33:37.207439+0000","last_undegraded":"2024-09-17T05:33:37.207439+0000","last_fullsized":"2024-09-17T05:33:37.207439+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:23.015696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"99'4","reported_seq":19,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.189820+0000","last_change":"2024-09-17T05:33:36.185939+0000","last_active":"2024-09-17T05:33:38.189820+0000","last_peered":"2024-09-17T05:33:38.189820+0000","last_clean":"2024-09-17T05:33:38.189820+0000","last_became_active":"2024-09-17T05:33:36.185641+0000","last_became_peered":"2024-09-17T05:33:36.185641+0000","last_unstale":"2024-09-17T05:33:38.189820+0000","last_undegraded":"2024-09-17T05:33:38.189820+0000","last_fullsized":"2024-09-17T05:33:38.189820+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:15:14.736109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.205939+0000","last_change":"2024-09-17T05:33:37.196335+0000","last_active":"2024-09-17T05:33:37.205939+0000","last_peered":"2024-09-17T05:33:37.205939+0000","last_clean":"2024-09-17T05:33:37.205939+0000","last_became_active":"2024-09-17T05:33:37.195639+0000","last_became_peered":"2024-09-17T05:33:37.195639+0000","last_unstale":"2024-09-17T05:33:37.205939+0000","last_undegraded":"2024-09-17T05:33:37.205939+0000","last_fullsized":"2024-09-17T05:33:37.205939+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:02.193234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"99'1","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.216582+0000","last_change":"2024-09-17T05:33:36.188605+0000","last_active":"2024-09-17T05:33:37.216582+0000","last_peered":"2024-09-17T05:33:37.216582+0000","last_clean":"2024-09-17T05:33:37.216582+0000","last_became_active":"2024-09-17T05:33:36.188314+0000","last_became_peered":"2024-09-17T05:33:36.188314+0000","last_unstale":"2024-09-17T05:33:37.216582+0000","last_undegraded":"2024-09-17T05:33:37.216582+0000","last_fullsized":"2024-09-17T05:33:37.216582+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:07.630269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.209922+0000","last_change":"2024-09-17T05:33:37.204753+0000","last_active":"2024-09-17T05:33:37.209922+0000","last_peered":"2024-09-17T05:33:37.209922+0000","last_clean":"2024-09-17T05:33:37.209922+0000","last_became_active":"2024-09-17T05:33:37.199543+0000","last_became_peered":"2024-09-17T05:33:37.199543+0000","last_unstale":"2024-09-17T05:33:37.209922+0000","last_undegraded":"2024-09-17T05:33:37.209922+0000","last_fullsized":"2024-09-17T05:33:37.209922+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:44.311663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"99'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.219601+0000","last_change":"2024-09-17T05:33:36.195022+0000","last_active":"2024-09-17T05:33:37.219601+0000","last_peered":"2024-09-17T05:33:37.219601+0000","last_clean":"2024-09-17T05:33:37.219601+0000","last_became_active":"2024-09-17T05:33:36.194718+0000","last_became_peered":"2024-09-17T05:33:36.194718+0000","last_unstale":"2024-09-17T05:33:37.219601+0000","last_undegraded":"2024-09-17T05:33:37.219601+0000","last_fullsized":"2024-09-17T05:33:37.219601+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:13.871822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.210892+0000","last_change":"2024-09-17T05:33:37.206615+0000","last_active":"2024-09-17T05:33:37.210892+0000","last_peered":"2024-09-17T05:33:37.210892+0000","last_clean":"2024-09-17T05:33:37.210892+0000","last_became_active":"2024-09-17T05:33:37.206364+0000","last_became_peered":"2024-09-17T05:33:37.206364+0000","last_unstale":"2024-09-17T05:33:37.210892+0000","last_undegraded":"2024-09-17T05:33:37.210892+0000","last_fullsized":"2024-09-17T05:33:37.210892+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:15.966704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"99'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.219518+0000","last_change":"2024-09-17T05:33:36.194101+0000","last_active":"2024-09-17T05:33:37.219518+0000","last_peered":"2024-09-17T05:33:37.219518+0000","last_clean":"2024-09-17T05:33:37.219518+0000","last_became_active":"2024-09-17T05:33:36.193844+0000","last_became_peered":"2024-09-17T05:33:36.193844+0000","last_unstale":"2024-09-17T05:33:37.219518+0000","last_undegraded":"2024-09-17T05:33:37.219518+0000","last_fullsized":"2024-09-17T05:33:37.219518+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:47.495496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.206031+0000","last_change":"2024-09-17T05:33:37.197843+0000","last_active":"2024-09-17T05:33:37.206031+0000","last_peered":"2024-09-17T05:33:37.206031+0000","last_clean":"2024-09-17T05:33:37.206031+0000","last_became_active":"2024-09-17T05:33:37.197563+0000","last_became_peered":"2024-09-17T05:33:37.197563+0000","last_unstale":"2024-09-17T05:33:37.206031+0000","last_undegraded":"2024-09-17T05:33:37.206031+0000","last_fullsized":"2024-09-17T05:33:37.206031+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:15.160513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"99'1","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188197+0000","last_change":"2024-09-17T05:33:36.195216+0000","last_active":"2024-09-17T05:33:38.188197+0000","last_peered":"2024-09-17T05:33:38.188197+0000","last_clean":"2024-09-17T05:33:38.188197+0000","last_became_active":"2024-09-17T05:33:36.194901+0000","last_became_peered":"2024-09-17T05:33:36.194901+0000","last_unstale":"2024-09-17T05:33:38.188197+0000","last_undegraded":"2024-09-17T05:33:38.188197+0000","last_fullsized":"2024-09-17T05:33:38.188197+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:49.125565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188977+0000","last_change":"2024-09-17T05:33:37.203471+0000","last_active":"2024-09-17T05:33:38.188977+0000","last_peered":"2024-09-17T05:33:38.188977+0000","last_clean":"2024-09-17T05:33:38.188977+0000","last_became_active":"2024-09-17T05:33:37.203150+0000","last_became_peered":"2024-09-17T05:33:37.203150+0000","last_unstale":"2024-09-17T05:33:38.188977+0000","last_undegraded":"2024-09-17T05:33:38.188977+0000","last_fullsized":"2024-09-17T05:33:38.188977+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:20.388125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"99'1","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181438+0000","last_change":"2024-09-17T05:33:36.184508+0000","last_active":"2024-09-17T05:33:38.181438+0000","last_peered":"2024-09-17T05:33:38.181438+0000","last_clean":"2024-09-17T05:33:38.181438+0000","last_became_active":"2024-09-17T05:33:36.181927+0000","last_became_peered":"2024-09-17T05:33:36.181927+0000","last_unstale":"2024-09-17T05:33:38.181438+0000","last_undegraded":"2024-09-17T05:33:38.181438+0000","last_fullsized":"2024-09-17T05:33:38.181438+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:02.209396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.213100+0000","last_change":"2024-09-17T05:33:37.201931+0000","last_active":"2024-09-17T05:33:37.213100+0000","last_peered":"2024-09-17T05:33:37.213100+0000","last_clean":"2024-09-17T05:33:37.213100+0000","last_became_active":"2024-09-17T05:33:37.201598+0000","last_became_peered":"2024-09-17T05:33:37.201598+0000","last_unstale":"2024-09-17T05:33:37.213100+0000","last_undegraded":"2024-09-17T05:33:37.213100+0000","last_fullsized":"2024-09-17T05:33:37.213100+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:49.804959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188992+0000","last_change":"2024-09-17T05:33:36.187069+0000","last_active":"2024-09-17T05:33:38.188992+0000","last_peered":"2024-09-17T05:33:38.188992+0000","last_clean":"2024-09-17T05:33:38.188992+0000","last_became_active":"2024-09-17T05:33:36.186737+0000","last_became_peered":"2024-09-17T05:33:36.186737+0000","last_unstale":"2024-09-17T05:33:38.188992+0000","last_undegraded":"2024-09-17T05:33:38.188992+0000","last_fullsized":"2024-09-17T05:33:38.188992+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:31.392650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188198+0000","last_change":"2024-09-17T05:33:37.196482+0000","last_active":"2024-09-17T05:33:38.188198+0000","last_peered":"2024-09-17T05:33:38.188198+0000","last_clean":"2024-09-17T05:33:38.188198+0000","last_became_active":"2024-09-17T05:33:37.196203+0000","last_became_peered":"2024-09-17T05:33:37.196203+0000","last_unstale":"2024-09-17T05:33:38.188198+0000","last_undegraded":"2024-09-17T05:33:38.188198+0000","last_fullsized":"2024-09-17T05:33:38.188198+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:20.563565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.179119+0000","last_change":"2024-09-17T05:33:36.188096+0000","last_active":"2024-09-17T05:33:37.179119+0000","last_peered":"2024-09-17T05:33:37.179119+0000","last_clean":"2024-09-17T05:33:37.179119+0000","last_became_active":"2024-09-17T05:33:36.187824+0000","last_became_peered":"2024-09-17T05:33:36.187824+0000","last_unstale":"2024-09-17T05:33:37.179119+0000","last_undegraded":"2024-09-17T05:33:37.179119+0000","last_fullsized":"2024-09-17T05:33:37.179119+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:45.649412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.190285+0000","last_change":"2024-09-17T05:33:37.197819+0000","last_active":"2024-09-17T05:33:38.190285+0000","last_peered":"2024-09-17T05:33:38.190285+0000","last_clean":"2024-09-17T05:33:38.190285+0000","last_became_active":"2024-09-17T05:33:37.197479+0000","last_became_peered":"2024-09-17T05:33:37.197479+0000","last_unstale":"2024-09-17T05:33:38.190285+0000","last_undegraded":"2024-09-17T05:33:38.190285+0000","last_fullsized":"2024-09-17T05:33:38.190285+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:03.816668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.175442+0000","last_change":"2024-09-17T05:33:36.194935+0000","last_active":"2024-09-17T05:33:37.175442+0000","last_peered":"2024-09-17T05:33:37.175442+0000","last_clean":"2024-09-17T05:33:37.175442+0000","last_became_active":"2024-09-17T05:33:36.194618+0000","last_became_peered":"2024-09-17T05:33:36.194618+0000","last_unstale":"2024-09-17T05:33:37.175442+0000","last_undegraded":"2024-09-17T05:33:37.175442+0000","last_fullsized":"2024-09-17T05:33:37.175442+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:35.820191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.208846+0000","last_change":"2024-09-17T05:33:37.203543+0000","last_active":"2024-09-17T05:33:37.208846+0000","last_peered":"2024-09-17T05:33:37.208846+0000","last_clean":"2024-09-17T05:33:37.208846+0000","last_became_active":"2024-09-17T05:33:37.202484+0000","last_became_peered":"2024-09-17T05:33:37.202484+0000","last_unstale":"2024-09-17T05:33:37.208846+0000","last_undegraded":"2024-09-17T05:33:37.208846+0000","last_fullsized":"2024-09-17T05:33:37.208846+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:16.921190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181915+0000","last_change":"2024-09-17T05:33:36.185906+0000","last_active":"2024-09-17T05:33:38.181915+0000","last_peered":"2024-09-17T05:33:38.181915+0000","last_clean":"2024-09-17T05:33:38.181915+0000","last_became_active":"2024-09-17T05:33:36.185594+0000","last_became_peered":"2024-09-17T05:33:36.185594+0000","last_unstale":"2024-09-17T05:33:38.181915+0000","last_undegraded":"2024-09-17T05:33:38.181915+0000","last_fullsized":"2024-09-17T05:33:38.181915+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:01.185916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181767+0000","last_change":"2024-09-17T05:33:37.189557+0000","last_active":"2024-09-17T05:33:38.181767+0000","last_peered":"2024-09-17T05:33:38.181767+0000","last_clean":"2024-09-17T05:33:38.181767+0000","last_became_active":"2024-09-17T05:33:37.187894+0000","last_became_peered":"2024-09-17T05:33:37.187894+0000","last_unstale":"2024-09-17T05:33:38.181767+0000","last_undegraded":"2024-09-17T05:33:38.181767+0000","last_fullsized":"2024-09-17T05:33:38.181767+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:22.751496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"99'3","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.217490+0000","last_change":"2024-09-17T05:33:36.179043+0000","last_active":"2024-09-17T05:33:37.217490+0000","last_peered":"2024-09-17T05:33:37.217490+0000","last_clean":"2024-09-17T05:33:37.217490+0000","last_became_active":"2024-09-17T05:33:36.178758+0000","last_became_peered":"2024-09-17T05:33:36.178758+0000","last_unstale":"2024-09-17T05:33:37.217490+0000","last_undegraded":"2024-09-17T05:33:37.217490+0000","last_fullsized":"2024-09-17T05:33:37.217490+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.435044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.189319+0000","last_change":"2024-09-17T05:33:37.187607+0000","last_active":"2024-09-17T05:33:38.189319+0000","last_peered":"2024-09-17T05:33:38.189319+0000","last_clean":"2024-09-17T05:33:38.189319+0000","last_became_active":"2024-09-17T05:33:37.187175+0000","last_became_peered":"2024-09-17T05:33:37.187175+0000","last_unstale":"2024-09-17T05:33:38.189319+0000","last_undegraded":"2024-09-17T05:33:38.189319+0000","last_fullsized":"2024-09-17T05:33:38.189319+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:12.387261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"99'6","reported_seq":19,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.222084+0000","last_change":"2024-09-17T05:33:36.187968+0000","last_active":"2024-09-17T05:33:37.222084+0000","last_peered":"2024-09-17T05:33:37.222084+0000","last_clean":"2024-09-17T05:33:37.222084+0000","last_became_active":"2024-09-17T05:33:36.187668+0000","last_became_peered":"2024-09-17T05:33:36.187668+0000","last_unstale":"2024-09-17T05:33:37.222084+0000","last_undegraded":"2024-09-17T05:33:37.222084+0000","last_fullsized":"2024-09-17T05:33:37.222084+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:01.963503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181353+0000","last_change":"2024-09-17T05:33:37.188800+0000","last_active":"2024-09-17T05:33:38.181353+0000","last_peered":"2024-09-17T05:33:38.181353+0000","last_clean":"2024-09-17T05:33:38.181353+0000","last_became_active":"2024-09-17T05:33:37.188506+0000","last_became_peered":"2024-09-17T05:33:37.188506+0000","last_unstale":"2024-09-17T05:33:38.181353+0000","last_undegraded":"2024-09-17T05:33:38.181353+0000","last_fullsized":"2024-09-17T05:33:38.181353+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:57.249213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"99'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.219604+0000","last_change":"2024-09-17T05:33:36.186343+0000","last_active":"2024-09-17T05:33:37.219604+0000","last_peered":"2024-09-17T05:33:37.219604+0000","last_clean":"2024-09-17T05:33:37.219604+0000","last_became_active":"2024-09-17T05:33:36.186036+0000","last_became_peered":"2024-09-17T05:33:36.186036+0000","last_unstale":"2024-09-17T05:33:37.219604+0000","last_undegraded":"2024-09-17T05:33:37.219604+0000","last_fullsized":"2024-09-17T05:33:37.219604+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:51.043200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181566+0000","last_change":"2024-09-17T05:33:37.191239+0000","last_active":"2024-09-17T05:33:38.181566+0000","last_peered":"2024-09-17T05:33:38.181566+0000","last_clean":"2024-09-17T05:33:38.181566+0000","last_became_active":"2024-09-17T05:33:37.190887+0000","last_became_peered":"2024-09-17T05:33:37.190887+0000","last_unstale":"2024-09-17T05:33:38.181566+0000","last_undegraded":"2024-09-17T05:33:38.181566+0000","last_fullsized":"2024-09-17T05:33:38.181566+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:06.063824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.191912+0000","last_change":"2024-09-17T05:33:36.193177+0000","last_active":"2024-09-17T05:33:37.191912+0000","last_peered":"2024-09-17T05:33:37.191912+0000","last_clean":"2024-09-17T05:33:37.191912+0000","last_became_active":"2024-09-17T05:33:36.192904+0000","last_became_peered":"2024-09-17T05:33:36.192904+0000","last_unstale":"2024-09-17T05:33:37.191912+0000","last_undegraded":"2024-09-17T05:33:37.191912+0000","last_fullsized":"2024-09-17T05:33:37.191912+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:22.782710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181230+0000","last_change":"2024-09-17T05:33:37.177613+0000","last_active":"2024-09-17T05:33:38.181230+0000","last_peered":"2024-09-17T05:33:38.181230+0000","last_clean":"2024-09-17T05:33:38.181230+0000","last_became_active":"2024-09-17T05:33:37.177258+0000","last_became_peered":"2024-09-17T05:33:37.177258+0000","last_unstale":"2024-09-17T05:33:38.181230+0000","last_undegraded":"2024-09-17T05:33:38.181230+0000","last_fullsized":"2024-09-17T05:33:38.181230+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:58.193938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"99'8","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.220411+0000","last_change":"2024-09-17T05:33:36.189723+0000","last_active":"2024-09-17T05:33:37.220411+0000","last_peered":"2024-09-17T05:33:37.220411+0000","last_clean":"2024-09-17T05:33:37.220411+0000","last_became_active":"2024-09-17T05:33:36.189396+0000","last_became_peered":"2024-09-17T05:33:36.189396+0000","last_unstale":"2024-09-17T05:33:37.220411+0000","last_undegraded":"2024-09-17T05:33:37.220411+0000","last_fullsized":"2024-09-17T05:33:37.220411+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:27.890433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.192014+0000","last_change":"2024-09-17T05:33:37.187300+0000","last_active":"2024-09-17T05:33:37.192014+0000","last_peered":"2024-09-17T05:33:37.192014+0000","last_clean":"2024-09-17T05:33:37.192014+0000","last_became_active":"2024-09-17T05:33:37.186994+0000","last_became_peered":"2024-09-17T05:33:37.186994+0000","last_unstale":"2024-09-17T05:33:37.192014+0000","last_undegraded":"2024-09-17T05:33:37.192014+0000","last_fullsized":"2024-09-17T05:33:37.192014+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:15.587504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"99'1","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.216733+0000","last_change":"2024-09-17T05:33:36.183518+0000","last_active":"2024-09-17T05:33:37.216733+0000","last_peered":"2024-09-17T05:33:37.216733+0000","last_clean":"2024-09-17T05:33:37.216733+0000","last_became_active":"2024-09-17T05:33:36.182963+0000","last_became_peered":"2024-09-17T05:33:36.182963+0000","last_unstale":"2024-09-17T05:33:37.216733+0000","last_undegraded":"2024-09-17T05:33:37.216733+0000","last_fullsized":"2024-09-17T05:33:37.216733+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:18.448929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.213480+0000","last_change":"2024-09-17T05:33:37.205441+0000","last_active":"2024-09-17T05:33:37.213480+0000","last_peered":"2024-09-17T05:33:37.213480+0000","last_clean":"2024-09-17T05:33:37.213480+0000","last_became_active":"2024-09-17T05:33:37.199999+0000","last_became_peered":"2024-09-17T05:33:37.199999+0000","last_unstale":"2024-09-17T05:33:37.213480+0000","last_undegraded":"2024-09-17T05:33:37.213480+0000","last_fullsized":"2024-09-17T05:33:37.213480+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:46.824579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"99'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.215750+0000","last_change":"2024-09-17T05:33:36.185213+0000","last_active":"2024-09-17T05:33:37.215750+0000","last_peered":"2024-09-17T05:33:37.215750+0000","last_clean":"2024-09-17T05:33:37.215750+0000","last_became_active":"2024-09-17T05:33:36.184922+0000","last_became_peered":"2024-09-17T05:33:36.184922+0000","last_unstale":"2024-09-17T05:33:37.215750+0000","last_undegraded":"2024-09-17T05:33:37.215750+0000","last_fullsized":"2024-09-17T05:33:37.215750+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:09:44.841793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.200401+0000","last_change":"2024-09-17T05:33:37.194797+0000","last_active":"2024-09-17T05:33:37.200401+0000","last_peered":"2024-09-17T05:33:37.200401+0000","last_clean":"2024-09-17T05:33:37.200401+0000","last_became_active":"2024-09-17T05:33:37.194482+0000","last_became_peered":"2024-09-17T05:33:37.194482+0000","last_unstale":"2024-09-17T05:33:37.200401+0000","last_undegraded":"2024-09-17T05:33:37.200401+0000","last_fullsized":"2024-09-17T05:33:37.200401+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:31.099832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"99'1","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.217790+0000","last_change":"2024-09-17T05:33:36.186848+0000","last_active":"2024-09-17T05:33:37.217790+0000","last_peered":"2024-09-17T05:33:37.217790+0000","last_clean":"2024-09-17T05:33:37.217790+0000","last_became_active":"2024-09-17T05:33:36.186598+0000","last_became_peered":"2024-09-17T05:33:36.186598+0000","last_unstale":"2024-09-17T05:33:37.217790+0000","last_undegraded":"2024-09-17T05:33:37.217790+0000","last_fullsized":"2024-09-17T05:33:37.217790+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:02.209396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.200803+0000","last_change":"2024-09-17T05:33:37.196549+0000","last_active":"2024-09-17T05:33:37.200803+0000","last_peered":"2024-09-17T05:33:37.200803+0000","last_clean":"2024-09-17T05:33:37.200803+0000","last_became_active":"2024-09-17T05:33:37.194748+0000","last_became_peered":"2024-09-17T05:33:37.194748+0000","last_unstale":"2024-09-17T05:33:37.200803+0000","last_undegraded":"2024-09-17T05:33:37.200803+0000","last_fullsized":"2024-09-17T05:33:37.200803+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:28.827566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188381+0000","last_change":"2024-09-17T05:33:36.181618+0000","last_active":"2024-09-17T05:33:38.188381+0000","last_peered":"2024-09-17T05:33:38.188381+0000","last_clean":"2024-09-17T05:33:38.188381+0000","last_became_active":"2024-09-17T05:33:36.180247+0000","last_became_peered":"2024-09-17T05:33:36.180247+0000","last_unstale":"2024-09-17T05:33:38.188381+0000","last_undegraded":"2024-09-17T05:33:38.188381+0000","last_fullsized":"2024-09-17T05:33:38.188381+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:21.290242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.194635+0000","last_change":"2024-09-17T05:33:37.187830+0000","last_active":"2024-09-17T05:33:37.194635+0000","last_peered":"2024-09-17T05:33:37.194635+0000","last_clean":"2024-09-17T05:33:37.194635+0000","last_became_active":"2024-09-17T05:33:37.187410+0000","last_became_peered":"2024-09-17T05:33:37.187410+0000","last_unstale":"2024-09-17T05:33:37.194635+0000","last_undegraded":"2024-09-17T05:33:37.194635+0000","last_fullsized":"2024-09-17T05:33:37.194635+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:51.879131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"99'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.219439+0000","last_change":"2024-09-17T05:33:36.190579+0000","last_active":"2024-09-17T05:33:37.219439+0000","last_peered":"2024-09-17T05:33:37.219439+0000","last_clean":"2024-09-17T05:33:37.219439+0000","last_became_active":"2024-09-17T05:33:36.190250+0000","last_became_peered":"2024-09-17T05:33:36.190250+0000","last_unstale":"2024-09-17T05:33:37.219439+0000","last_undegraded":"2024-09-17T05:33:37.219439+0000","last_fullsized":"2024-09-17T05:33:37.219439+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:16.985626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.194069+0000","last_change":"2024-09-17T05:33:37.185010+0000","last_active":"2024-09-17T05:33:37.194069+0000","last_peered":"2024-09-17T05:33:37.194069+0000","last_clean":"2024-09-17T05:33:37.194069+0000","last_became_active":"2024-09-17T05:33:37.184190+0000","last_became_peered":"2024-09-17T05:33:37.184190+0000","last_unstale":"2024-09-17T05:33:37.194069+0000","last_undegraded":"2024-09-17T05:33:37.194069+0000","last_fullsized":"2024-09-17T05:33:37.194069+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:37.936078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.174587+0000","last_change":"2024-09-17T05:33:36.191010+0000","last_active":"2024-09-17T05:33:37.174587+0000","last_peered":"2024-09-17T05:33:37.174587+0000","last_clean":"2024-09-17T05:33:37.174587+0000","last_became_active":"2024-09-17T05:33:36.190576+0000","last_became_peered":"2024-09-17T05:33:36.190576+0000","last_unstale":"2024-09-17T05:33:37.174587+0000","last_undegraded":"2024-09-17T05:33:37.174587+0000","last_fullsized":"2024-09-17T05:33:37.174587+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:21:05.407685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.203475+0000","last_change":"2024-09-17T05:33:37.197069+0000","last_active":"2024-09-17T05:33:37.203475+0000","last_peered":"2024-09-17T05:33:37.203475+0000","last_clean":"2024-09-17T05:33:37.203475+0000","last_became_active":"2024-09-17T05:33:37.196795+0000","last_became_peered":"2024-09-17T05:33:37.196795+0000","last_unstale":"2024-09-17T05:33:37.203475+0000","last_undegraded":"2024-09-17T05:33:37.203475+0000","last_fullsized":"2024-09-17T05:33:37.203475+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:59:41.230491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.186334+0000","last_change":"2024-09-17T05:33:36.190748+0000","last_active":"2024-09-17T05:33:37.186334+0000","last_peered":"2024-09-17T05:33:37.186334+0000","last_clean":"2024-09-17T05:33:37.186334+0000","last_became_active":"2024-09-17T05:33:36.190464+0000","last_became_peered":"2024-09-17T05:33:36.190464+0000","last_unstale":"2024-09-17T05:33:37.186334+0000","last_undegraded":"2024-09-17T05:33:37.186334+0000","last_fullsized":"2024-09-17T05:33:37.186334+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:37.914902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181199+0000","last_change":"2024-09-17T05:33:37.192843+0000","last_active":"2024-09-17T05:33:38.181199+0000","last_peered":"2024-09-17T05:33:38.181199+0000","last_clean":"2024-09-17T05:33:38.181199+0000","last_became_active":"2024-09-17T05:33:37.192560+0000","last_became_peered":"2024-09-17T05:33:37.192560+0000","last_unstale":"2024-09-17T05:33:38.181199+0000","last_undegraded":"2024-09-17T05:33:38.181199+0000","last_fullsized":"2024-09-17T05:33:38.181199+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:20.388125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.179336+0000","last_change":"2024-09-17T05:33:36.181773+0000","last_active":"2024-09-17T05:33:37.179336+0000","last_peered":"2024-09-17T05:33:37.179336+0000","last_clean":"2024-09-17T05:33:37.179336+0000","last_became_active":"2024-09-17T05:33:36.178711+0000","last_became_peered":"2024-09-17T05:33:36.178711+0000","last_unstale":"2024-09-17T05:33:37.179336+0000","last_undegraded":"2024-09-17T05:33:37.179336+0000","last_fullsized":"2024-09-17T05:33:37.179336+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:48.666049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.211290+0000","last_change":"2024-09-17T05:33:37.205485+0000","last_active":"2024-09-17T05:33:37.211290+0000","last_peered":"2024-09-17T05:33:37.211290+0000","last_clean":"2024-09-17T05:33:37.211290+0000","last_became_active":"2024-09-17T05:33:37.205148+0000","last_became_peered":"2024-09-17T05:33:37.205148+0000","last_unstale":"2024-09-17T05:33:37.211290+0000","last_undegraded":"2024-09-17T05:33:37.211290+0000","last_fullsized":"2024-09-17T05:33:37.211290+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:28.258002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"99'2","reported_seq":17,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.182058+0000","last_change":"2024-09-17T05:33:36.192261+0000","last_active":"2024-09-17T05:33:38.182058+0000","last_peered":"2024-09-17T05:33:38.182058+0000","last_clean":"2024-09-17T05:33:38.182058+0000","last_became_active":"2024-09-17T05:33:36.191958+0000","last_became_peered":"2024-09-17T05:33:36.191958+0000","last_unstale":"2024-09-17T05:33:38.182058+0000","last_undegraded":"2024-09-17T05:33:38.182058+0000","last_fullsized":"2024-09-17T05:33:38.182058+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:27.940599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.186336+0000","last_change":"2024-09-17T05:33:37.183504+0000","last_active":"2024-09-17T05:33:37.186336+0000","last_peered":"2024-09-17T05:33:37.186336+0000","last_clean":"2024-09-17T05:33:37.186336+0000","last_became_active":"2024-09-17T05:33:37.183215+0000","last_became_peered":"2024-09-17T05:33:37.183215+0000","last_unstale":"2024-09-17T05:33:37.186336+0000","last_undegraded":"2024-09-17T05:33:37.186336+0000","last_fullsized":"2024-09-17T05:33:37.186336+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:28.011500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.191554+0000","last_change":"2024-09-17T05:33:36.185400+0000","last_active":"2024-09-17T05:33:37.191554+0000","last_peered":"2024-09-17T05:33:37.191554+0000","last_clean":"2024-09-17T05:33:37.191554+0000","last_became_active":"2024-09-17T05:33:36.185049+0000","last_became_peered":"2024-09-17T05:33:36.185049+0000","last_unstale":"2024-09-17T05:33:37.191554+0000","last_undegraded":"2024-09-17T05:33:37.191554+0000","last_fullsized":"2024-09-17T05:33:37.191554+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:21.361929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.206189+0000","last_change":"2024-09-17T05:33:37.203635+0000","last_active":"2024-09-17T05:33:37.206189+0000","last_peered":"2024-09-17T05:33:37.206189+0000","last_clean":"2024-09-17T05:33:37.206189+0000","last_became_active":"2024-09-17T05:33:37.203341+0000","last_became_peered":"2024-09-17T05:33:37.203341+0000","last_unstale":"2024-09-17T05:33:37.206189+0000","last_undegraded":"2024-09-17T05:33:37.206189+0000","last_fullsized":"2024-09-17T05:33:37.206189+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:04.793239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.176010+0000","last_change":"2024-09-17T05:33:36.184278+0000","last_active":"2024-09-17T05:33:37.176010+0000","last_peered":"2024-09-17T05:33:37.176010+0000","last_clean":"2024-09-17T05:33:37.176010+0000","last_became_active":"2024-09-17T05:33:36.182942+0000","last_became_peered":"2024-09-17T05:33:36.182942+0000","last_unstale":"2024-09-17T05:33:37.176010+0000","last_undegraded":"2024-09-17T05:33:37.176010+0000","last_fullsized":"2024-09-17T05:33:37.176010+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:03.441188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.211893+0000","last_change":"2024-09-17T05:33:37.208975+0000","last_active":"2024-09-17T05:33:37.211893+0000","last_peered":"2024-09-17T05:33:37.211893+0000","last_clean":"2024-09-17T05:33:37.211893+0000","last_became_active":"2024-09-17T05:33:37.208669+0000","last_became_peered":"2024-09-17T05:33:37.208669+0000","last_unstale":"2024-09-17T05:33:37.211893+0000","last_undegraded":"2024-09-17T05:33:37.211893+0000","last_fullsized":"2024-09-17T05:33:37.211893+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:53.686531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181822+0000","last_change":"2024-09-17T05:33:36.191804+0000","last_active":"2024-09-17T05:33:38.181822+0000","last_peered":"2024-09-17T05:33:38.181822+0000","last_clean":"2024-09-17T05:33:38.181822+0000","last_became_active":"2024-09-17T05:33:36.191476+0000","last_became_peered":"2024-09-17T05:33:36.191476+0000","last_unstale":"2024-09-17T05:33:38.181822+0000","last_undegraded":"2024-09-17T05:33:38.181822+0000","last_fullsized":"2024-09-17T05:33:38.181822+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:15.913873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188763+0000","last_change":"2024-09-17T05:33:37.182756+0000","last_active":"2024-09-17T05:33:38.188763+0000","last_peered":"2024-09-17T05:33:38.188763+0000","last_clean":"2024-09-17T05:33:38.188763+0000","last_became_active":"2024-09-17T05:33:37.182386+0000","last_became_peered":"2024-09-17T05:33:37.182386+0000","last_unstale":"2024-09-17T05:33:38.188763+0000","last_undegraded":"2024-09-17T05:33:38.188763+0000","last_fullsized":"2024-09-17T05:33:38.188763+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:48:37.033743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188831+0000","last_change":"2024-09-17T05:33:36.182776+0000","last_active":"2024-09-17T05:33:38.188831+0000","last_peered":"2024-09-17T05:33:38.188831+0000","last_clean":"2024-09-17T05:33:38.188831+0000","last_became_active":"2024-09-17T05:33:36.181450+0000","last_became_peered":"2024-09-17T05:33:36.181450+0000","last_unstale":"2024-09-17T05:33:38.188831+0000","last_undegraded":"2024-09-17T05:33:38.188831+0000","last_fullsized":"2024-09-17T05:33:38.188831+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:35.113488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.189204+0000","last_change":"2024-09-17T05:33:37.194383+0000","last_active":"2024-09-17T05:33:38.189204+0000","last_peered":"2024-09-17T05:33:38.189204+0000","last_clean":"2024-09-17T05:33:38.189204+0000","last_became_active":"2024-09-17T05:33:37.193877+0000","last_became_peered":"2024-09-17T05:33:37.193877+0000","last_unstale":"2024-09-17T05:33:38.189204+0000","last_undegraded":"2024-09-17T05:33:38.189204+0000","last_fullsized":"2024-09-17T05:33:38.189204+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:57.249213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188925+0000","last_change":"2024-09-17T05:33:36.194371+0000","last_active":"2024-09-17T05:33:38.188925+0000","last_peered":"2024-09-17T05:33:38.188925+0000","last_clean":"2024-09-17T05:33:38.188925+0000","last_became_active":"2024-09-17T05:33:36.194102+0000","last_became_peered":"2024-09-17T05:33:36.194102+0000","last_unstale":"2024-09-17T05:33:38.188925+0000","last_undegraded":"2024-09-17T05:33:38.188925+0000","last_fullsized":"2024-09-17T05:33:38.188925+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:27.894549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.203499+0000","last_change":"2024-09-17T05:33:37.197593+0000","last_active":"2024-09-17T05:33:37.203499+0000","last_peered":"2024-09-17T05:33:37.203499+0000","last_clean":"2024-09-17T05:33:37.203499+0000","last_became_active":"2024-09-17T05:33:37.196259+0000","last_became_peered":"2024-09-17T05:33:37.196259+0000","last_unstale":"2024-09-17T05:33:37.203499+0000","last_undegraded":"2024-09-17T05:33:37.203499+0000","last_fullsized":"2024-09-17T05:33:37.203499+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:11.599316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.174783+0000","last_change":"2024-09-17T05:33:36.194749+0000","last_active":"2024-09-17T05:33:37.174783+0000","last_peered":"2024-09-17T05:33:37.174783+0000","last_clean":"2024-09-17T05:33:37.174783+0000","last_became_active":"2024-09-17T05:33:36.194450+0000","last_became_peered":"2024-09-17T05:33:36.194450+0000","last_unstale":"2024-09-17T05:33:37.174783+0000","last_undegraded":"2024-09-17T05:33:37.174783+0000","last_fullsized":"2024-09-17T05:33:37.174783+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:59.150028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.206156+0000","last_change":"2024-09-17T05:33:37.201760+0000","last_active":"2024-09-17T05:33:37.206156+0000","last_peered":"2024-09-17T05:33:37.206156+0000","last_clean":"2024-09-17T05:33:37.206156+0000","last_became_active":"2024-09-17T05:33:37.201464+0000","last_became_peered":"2024-09-17T05:33:37.201464+0000","last_unstale":"2024-09-17T05:33:37.206156+0000","last_undegraded":"2024-09-17T05:33:37.206156+0000","last_fullsized":"2024-09-17T05:33:37.206156+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:37.274984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.179592+0000","last_change":"2024-09-17T05:33:36.178995+0000","last_active":"2024-09-17T05:33:37.179592+0000","last_peered":"2024-09-17T05:33:37.179592+0000","last_clean":"2024-09-17T05:33:37.179592+0000","last_became_active":"2024-09-17T05:33:36.178345+0000","last_became_peered":"2024-09-17T05:33:36.178345+0000","last_unstale":"2024-09-17T05:33:37.179592+0000","last_undegraded":"2024-09-17T05:33:37.179592+0000","last_fullsized":"2024-09-17T05:33:37.179592+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:45.267705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181359+0000","last_change":"2024-09-17T05:33:37.194665+0000","last_active":"2024-09-17T05:33:38.181359+0000","last_peered":"2024-09-17T05:33:38.181359+0000","last_clean":"2024-09-17T05:33:38.181359+0000","last_became_active":"2024-09-17T05:33:37.190958+0000","last_became_peered":"2024-09-17T05:33:37.190958+0000","last_unstale":"2024-09-17T05:33:38.181359+0000","last_undegraded":"2024-09-17T05:33:38.181359+0000","last_fullsized":"2024-09-17T05:33:38.181359+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:11.115371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188317+0000","last_change":"2024-09-17T05:33:36.184450+0000","last_active":"2024-09-17T05:33:38.188317+0000","last_peered":"2024-09-17T05:33:38.188317+0000","last_clean":"2024-09-17T05:33:38.188317+0000","last_became_active":"2024-09-17T05:33:36.182140+0000","last_became_peered":"2024-09-17T05:33:36.182140+0000","last_unstale":"2024-09-17T05:33:38.188317+0000","last_undegraded":"2024-09-17T05:33:38.188317+0000","last_fullsized":"2024-09-17T05:33:38.188317+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:31.474501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":281,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.183345+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:33:37.183345+0000","last_peered":"2024-09-17T05:33:37.183345+0000","last_clean":"2024-09-17T05:33:37.183345+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:33:37.183345+0000","last_undegraded":"2024-09-17T05:33:37.183345+0000","last_fullsized":"2024-09-17T05:33:37.183345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509504,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":1826816,"data_stored":1124740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1228800,"data_stored":533826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542208,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1232896,"data_stored":534360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509505,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1236992,"data_stored":540056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1253376,"data_stored":541738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509505,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1224704,"data_stored":533756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509503,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1232896,"data_stored":533880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542207,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32984,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338856,"statfs":{"total":96636764160,"available":96602988544,"internally_reserved":0,"allocated":1839104,"data_stored":1125848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:33:41.345 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:33:41.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.526+0000 7f0daa800640 1 -- 172.21.15.31:0/588210531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d88004060 msgr2=0x7f0d88004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.526+0000 7f0daa800640 1 --2- 172.21.15.31:0/588210531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d88004060 0x7f0d88004810 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c009b30 tx=0x7f0d8c01d230 comp rx=0 tx=0).stop 2024-09-17T05:33:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.526+0000 7f0da3e00640 1 -- 172.21.15.31:0/588210531 reap_dead start 2024-09-17T05:33:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.526+0000 7f0daa800640 1 -- 172.21.15.31:0/588210531 shutdown_connections 2024-09-17T05:33:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.526+0000 7f0daa800640 1 -- 172.21.15.31:0/588210531 >> 172.21.15.31:0/588210531 conn(0x7f0da40d0c90 msgr2=0x7f0da40d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.526+0000 7f0daa800640 1 -- 172.21.15.31:0/588210531 shutdown_connections 2024-09-17T05:33:41.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.526+0000 7f0daa800640 1 -- 172.21.15.31:0/588210531 wait complete. 2024-09-17T05:33:41.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0daa800640 1 Processor -- start 2024-09-17T05:33:41.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0daa800640 1 -- start start 2024-09-17T05:33:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0daa800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d88004060 0x7f0da4147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0daa800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0da41f5c90 0x7f0da40c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0daa800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0da41f6110 0x7f0da40b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0daa800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0da40706b0 con 0x7f0da41f5c90 2024-09-17T05:33:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0daa800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0da4070530 con 0x7f0d88004060 2024-09-17T05:33:41.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0daa800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0da4070830 con 0x7f0da41f6110 2024-09-17T05:33:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0d9be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0da41f5c90 0x7f0da40c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0d9be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0da41f5c90 0x7f0da40c4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43670/0 (socket says 172.21.15.31:43670) 2024-09-17T05:33:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0d9be00640 1 -- 172.21.15.31:0/41475243 learned_addr learned my addr 172.21.15.31:0/41475243 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0da3400640 1 --2- 172.21.15.31:0/41475243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d88004060 0x7f0da4147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0da3e00640 1 --2- 172.21.15.31:0/41475243 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0da41f6110 0x7f0da40b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0d9be00640 1 -- 172.21.15.31:0/41475243 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0da41f6110 msgr2=0x7f0da40b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0d9be00640 1 --2- 172.21.15.31:0/41475243 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0da41f6110 0x7f0da40b28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0d9be00640 1 -- 172.21.15.31:0/41475243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d88004060 msgr2=0x7f0da4147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0d9be00640 1 --2- 172.21.15.31:0/41475243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d88004060 0x7f0da4147460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0d9be00640 1 -- 172.21.15.31:0/41475243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da41f6ba0 con 0x7f0da41f5c90 2024-09-17T05:33:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0da3400640 1 --2- 172.21.15.31:0/41475243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d88004060 0x7f0da4147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:41.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0d9be00640 1 --2- 172.21.15.31:0/41475243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0da41f5c90 0x7f0da40c4840 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0af040 tx=0x7f0d8c0acd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0d9b400640 1 -- 172.21.15.31:0/41475243 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c0bd020 con 0x7f0da41f5c90 2024-09-17T05:33:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0d9b400640 1 -- 172.21.15.31:0/41475243 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d8c0ace10 con 0x7f0da41f5c90 2024-09-17T05:33:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0d9b400640 1 -- 172.21.15.31:0/41475243 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c0b1040 con 0x7f0da41f5c90 2024-09-17T05:33:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0daa800640 1 -- 172.21.15.31:0/41475243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0da41f65e0 con 0x7f0da41f5c90 2024-09-17T05:33:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0daa800640 1 -- 172.21.15.31:0/41475243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0da40c6540 con 0x7f0da41f5c90 2024-09-17T05:33:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.530+0000 7f0daa800640 1 -- 172.21.15.31:0/41475243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0da406fe20 con 0x7f0da41f5c90 2024-09-17T05:33:41.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.534+0000 7f0d9b400640 1 -- 172.21.15.31:0/41475243 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f0d8c0c0070 con 0x7f0da41f5c90 2024-09-17T05:33:41.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.534+0000 7f0d9b400640 1 --2- 172.21.15.31:0/41475243 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d80073320 0x7f0d800757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:41.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.534+0000 7f0d9b400640 1 -- 172.21.15.31:0/41475243 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7f0d8c12ef60 con 0x7f0da41f5c90 2024-09-17T05:33:41.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.534+0000 7f0da3400640 1 --2- 172.21.15.31:0/41475243 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d80073320 0x7f0d800757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:41.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.534+0000 7f0da3400640 1 --2- 172.21.15.31:0/41475243 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d80073320 0x7f0d800757e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0d94000c10 tx=0x7f0d94006b80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:41.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.538+0000 7f0d9b400640 1 -- 172.21.15.31:0/41475243 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0d8c016f40 con 0x7f0da41f5c90 2024-09-17T05:33:41.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.710+0000 7f0daa800640 1 -- 172.21.15.31:0/41475243 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0da40cb8b0 con 0x7f0d80073320 2024-09-17T05:33:41.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.714+0000 7f0d9b400640 1 -- 172.21.15.31:0/41475243 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252105 (secure 0 0 0) 0x7f0da40cb8b0 con 0x7f0d80073320 2024-09-17T05:33:41.720 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:41.721 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:33:41.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.718+0000 7f0daa800640 1 -- 172.21.15.31:0/41475243 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d80073320 msgr2=0x7f0d800757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:41.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.718+0000 7f0daa800640 1 --2- 172.21.15.31:0/41475243 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d80073320 0x7f0d800757e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0d94000c10 tx=0x7f0d94006b80 comp rx=0 tx=0).stop 2024-09-17T05:33:41.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.718+0000 7f0daa800640 1 -- 172.21.15.31:0/41475243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0da41f5c90 msgr2=0x7f0da40c4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:41.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.718+0000 7f0daa800640 1 --2- 172.21.15.31:0/41475243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0da41f5c90 0x7f0da40c4840 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0af040 tx=0x7f0d8c0acd20 comp rx=0 tx=0).stop 2024-09-17T05:33:41.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.718+0000 7f0daa800640 1 -- 172.21.15.31:0/41475243 shutdown_connections 2024-09-17T05:33:41.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.718+0000 7f0daa800640 1 --2- 172.21.15.31:0/41475243 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d80073320 0x7f0d800757e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.718+0000 7f0daa800640 1 --2- 172.21.15.31:0/41475243 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0da41f6110 0x7f0da40b28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.718+0000 7f0daa800640 1 --2- 172.21.15.31:0/41475243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0da41f5c90 0x7f0da40c4840 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.718+0000 7f0daa800640 1 --2- 172.21.15.31:0/41475243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d88004060 0x7f0da4147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.718+0000 7f0daa800640 1 -- 172.21.15.31:0/41475243 >> 172.21.15.31:0/41475243 conn(0x7f0da40d0c90 msgr2=0x7f0da4070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:41.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.718+0000 7f0daa800640 1 -- 172.21.15.31:0/41475243 shutdown_connections 2024-09-17T05:33:41.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.718+0000 7f0daa800640 1 -- 172.21.15.31:0/41475243 wait complete. 2024-09-17T05:33:41.741 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-09-17T05:33:40.712237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":157,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260356,"kb_used_data":10816,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714364,"statfs":{"total":773094113280,"available":772827508736,"internally_reserved":0,"allocated":11075584,"data_stored":5468204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.560777"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.206067+0000","last_change":"2024-09-17T05:33:37.198548+0000","last_active":"2024-09-17T05:33:37.206067+0000","last_peered":"2024-09-17T05:33:37.206067+0000","last_clean":"2024-09-17T05:33:37.206067+0000","last_became_active":"2024-09-17T05:33:37.198235+0000","last_became_peered":"2024-09-17T05:33:37.198235+0000","last_unstale":"2024-09-17T05:33:37.206067+0000","last_undegraded":"2024-09-17T05:33:37.206067+0000","last_fullsized":"2024-09-17T05:33:37.206067+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:28.281393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.189584+0000","last_change":"2024-09-17T05:33:37.204301+0000","last_active":"2024-09-17T05:33:38.189584+0000","last_peered":"2024-09-17T05:33:38.189584+0000","last_clean":"2024-09-17T05:33:38.189584+0000","last_became_active":"2024-09-17T05:33:37.203932+0000","last_became_peered":"2024-09-17T05:33:37.203932+0000","last_unstale":"2024-09-17T05:33:38.189584+0000","last_undegraded":"2024-09-17T05:33:38.189584+0000","last_fullsized":"2024-09-17T05:33:38.189584+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:06.063824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.197719+0000","last_change":"2024-09-17T05:33:37.192820+0000","last_active":"2024-09-17T05:33:37.197719+0000","last_peered":"2024-09-17T05:33:37.197719+0000","last_clean":"2024-09-17T05:33:37.197719+0000","last_became_active":"2024-09-17T05:33:37.192490+0000","last_became_peered":"2024-09-17T05:33:37.192490+0000","last_unstale":"2024-09-17T05:33:37.197719+0000","last_undegraded":"2024-09-17T05:33:37.197719+0000","last_fullsized":"2024-09-17T05:33:37.197719+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:15.287123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.205722+0000","last_change":"2024-09-17T05:33:37.190303+0000","last_active":"2024-09-17T05:33:37.205722+0000","last_peered":"2024-09-17T05:33:37.205722+0000","last_clean":"2024-09-17T05:33:37.205722+0000","last_became_active":"2024-09-17T05:33:37.190010+0000","last_became_peered":"2024-09-17T05:33:37.190010+0000","last_unstale":"2024-09-17T05:33:37.205722+0000","last_undegraded":"2024-09-17T05:33:37.205722+0000","last_fullsized":"2024-09-17T05:33:37.205722+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:56.513649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.192320+0000","last_change":"2024-09-17T05:33:37.183136+0000","last_active":"2024-09-17T05:33:37.192320+0000","last_peered":"2024-09-17T05:33:37.192320+0000","last_clean":"2024-09-17T05:33:37.192320+0000","last_became_active":"2024-09-17T05:33:37.182796+0000","last_became_peered":"2024-09-17T05:33:37.182796+0000","last_unstale":"2024-09-17T05:33:37.192320+0000","last_undegraded":"2024-09-17T05:33:37.192320+0000","last_fullsized":"2024-09-17T05:33:37.192320+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:47.397873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.209986+0000","last_change":"2024-09-17T05:33:37.204409+0000","last_active":"2024-09-17T05:33:37.209986+0000","last_peered":"2024-09-17T05:33:37.209986+0000","last_clean":"2024-09-17T05:33:37.209986+0000","last_became_active":"2024-09-17T05:33:37.199294+0000","last_became_peered":"2024-09-17T05:33:37.199294+0000","last_unstale":"2024-09-17T05:33:37.209986+0000","last_undegraded":"2024-09-17T05:33:37.209986+0000","last_fullsized":"2024-09-17T05:33:37.209986+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:57:11.550687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188319+0000","last_change":"2024-09-17T05:33:37.196307+0000","last_active":"2024-09-17T05:33:38.188319+0000","last_peered":"2024-09-17T05:33:38.188319+0000","last_clean":"2024-09-17T05:33:38.188319+0000","last_became_active":"2024-09-17T05:33:37.195956+0000","last_became_peered":"2024-09-17T05:33:37.195956+0000","last_unstale":"2024-09-17T05:33:38.188319+0000","last_undegraded":"2024-09-17T05:33:38.188319+0000","last_fullsized":"2024-09-17T05:33:38.188319+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:44.186072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.208216+0000","last_change":"2024-09-17T05:33:37.204770+0000","last_active":"2024-09-17T05:33:37.208216+0000","last_peered":"2024-09-17T05:33:37.208216+0000","last_clean":"2024-09-17T05:33:37.208216+0000","last_became_active":"2024-09-17T05:33:37.204515+0000","last_became_peered":"2024-09-17T05:33:37.204515+0000","last_unstale":"2024-09-17T05:33:37.208216+0000","last_undegraded":"2024-09-17T05:33:37.208216+0000","last_fullsized":"2024-09-17T05:33:37.208216+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:50.487929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.204904+0000","last_change":"2024-09-17T05:33:37.195468+0000","last_active":"2024-09-17T05:33:37.204904+0000","last_peered":"2024-09-17T05:33:37.204904+0000","last_clean":"2024-09-17T05:33:37.204904+0000","last_became_active":"2024-09-17T05:33:37.194501+0000","last_became_peered":"2024-09-17T05:33:37.194501+0000","last_unstale":"2024-09-17T05:33:37.204904+0000","last_undegraded":"2024-09-17T05:33:37.204904+0000","last_fullsized":"2024-09-17T05:33:37.204904+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:56.268466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.200932+0000","last_change":"2024-09-17T05:33:37.194598+0000","last_active":"2024-09-17T05:33:37.200932+0000","last_peered":"2024-09-17T05:33:37.200932+0000","last_clean":"2024-09-17T05:33:37.200932+0000","last_became_active":"2024-09-17T05:33:37.194314+0000","last_became_peered":"2024-09-17T05:33:37.194314+0000","last_unstale":"2024-09-17T05:33:37.200932+0000","last_undegraded":"2024-09-17T05:33:37.200932+0000","last_fullsized":"2024-09-17T05:33:37.200932+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:11.808394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188730+0000","last_change":"2024-09-17T05:33:37.199898+0000","last_active":"2024-09-17T05:33:38.188730+0000","last_peered":"2024-09-17T05:33:38.188730+0000","last_clean":"2024-09-17T05:33:38.188730+0000","last_became_active":"2024-09-17T05:33:37.199557+0000","last_became_peered":"2024-09-17T05:33:37.199557+0000","last_unstale":"2024-09-17T05:33:38.188730+0000","last_undegraded":"2024-09-17T05:33:38.188730+0000","last_fullsized":"2024-09-17T05:33:38.188730+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:33:23.216217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.205695+0000","last_change":"2024-09-17T05:33:37.195355+0000","last_active":"2024-09-17T05:33:37.205695+0000","last_peered":"2024-09-17T05:33:37.205695+0000","last_clean":"2024-09-17T05:33:37.205695+0000","last_became_active":"2024-09-17T05:33:37.194279+0000","last_became_peered":"2024-09-17T05:33:37.194279+0000","last_unstale":"2024-09-17T05:33:37.205695+0000","last_undegraded":"2024-09-17T05:33:37.205695+0000","last_fullsized":"2024-09-17T05:33:37.205695+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:06.159165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.203633+0000","last_change":"2024-09-17T05:33:37.199516+0000","last_active":"2024-09-17T05:33:37.203633+0000","last_peered":"2024-09-17T05:33:37.203633+0000","last_clean":"2024-09-17T05:33:37.203633+0000","last_became_active":"2024-09-17T05:33:37.199170+0000","last_became_peered":"2024-09-17T05:33:37.199170+0000","last_unstale":"2024-09-17T05:33:37.203633+0000","last_undegraded":"2024-09-17T05:33:37.203633+0000","last_fullsized":"2024-09-17T05:33:37.203633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:10.244727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.203405+0000","last_change":"2024-09-17T05:33:37.197206+0000","last_active":"2024-09-17T05:33:37.203405+0000","last_peered":"2024-09-17T05:33:37.203405+0000","last_clean":"2024-09-17T05:33:37.203405+0000","last_became_active":"2024-09-17T05:33:37.196821+0000","last_became_peered":"2024-09-17T05:33:37.196821+0000","last_unstale":"2024-09-17T05:33:37.203405+0000","last_undegraded":"2024-09-17T05:33:37.203405+0000","last_fullsized":"2024-09-17T05:33:37.203405+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:57.757562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.210531+0000","last_change":"2024-09-17T05:33:37.204400+0000","last_active":"2024-09-17T05:33:37.210531+0000","last_peered":"2024-09-17T05:33:37.210531+0000","last_clean":"2024-09-17T05:33:37.210531+0000","last_became_active":"2024-09-17T05:33:37.199146+0000","last_became_peered":"2024-09-17T05:33:37.199146+0000","last_unstale":"2024-09-17T05:33:37.210531+0000","last_undegraded":"2024-09-17T05:33:37.210531+0000","last_fullsized":"2024-09-17T05:33:37.210531+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:20:36.153010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.195264+0000","last_change":"2024-09-17T05:33:37.191655+0000","last_active":"2024-09-17T05:33:37.195264+0000","last_peered":"2024-09-17T05:33:37.195264+0000","last_clean":"2024-09-17T05:33:37.195264+0000","last_became_active":"2024-09-17T05:33:37.189494+0000","last_became_peered":"2024-09-17T05:33:37.189494+0000","last_unstale":"2024-09-17T05:33:37.195264+0000","last_undegraded":"2024-09-17T05:33:37.195264+0000","last_fullsized":"2024-09-17T05:33:37.195264+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:16.395230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188781+0000","last_change":"2024-09-17T05:33:37.202144+0000","last_active":"2024-09-17T05:33:38.188781+0000","last_peered":"2024-09-17T05:33:38.188781+0000","last_clean":"2024-09-17T05:33:38.188781+0000","last_became_active":"2024-09-17T05:33:37.201841+0000","last_became_peered":"2024-09-17T05:33:37.201841+0000","last_unstale":"2024-09-17T05:33:38.188781+0000","last_undegraded":"2024-09-17T05:33:38.188781+0000","last_fullsized":"2024-09-17T05:33:38.188781+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:05.323073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.208761+0000","last_change":"2024-09-17T05:33:37.201695+0000","last_active":"2024-09-17T05:33:37.208761+0000","last_peered":"2024-09-17T05:33:37.208761+0000","last_clean":"2024-09-17T05:33:37.208761+0000","last_became_active":"2024-09-17T05:33:37.199837+0000","last_became_peered":"2024-09-17T05:33:37.199837+0000","last_unstale":"2024-09-17T05:33:37.208761+0000","last_undegraded":"2024-09-17T05:33:37.208761+0000","last_fullsized":"2024-09-17T05:33:37.208761+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:28.947917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.205448+0000","last_change":"2024-09-17T05:33:37.201807+0000","last_active":"2024-09-17T05:33:37.205448+0000","last_peered":"2024-09-17T05:33:37.205448+0000","last_clean":"2024-09-17T05:33:37.205448+0000","last_became_active":"2024-09-17T05:33:37.201467+0000","last_became_peered":"2024-09-17T05:33:37.201467+0000","last_unstale":"2024-09-17T05:33:37.205448+0000","last_undegraded":"2024-09-17T05:33:37.205448+0000","last_fullsized":"2024-09-17T05:33:37.205448+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:25.034174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188928+0000","last_change":"2024-09-17T05:33:37.184547+0000","last_active":"2024-09-17T05:33:38.188928+0000","last_peered":"2024-09-17T05:33:38.188928+0000","last_clean":"2024-09-17T05:33:38.188928+0000","last_became_active":"2024-09-17T05:33:37.184244+0000","last_became_peered":"2024-09-17T05:33:37.184244+0000","last_unstale":"2024-09-17T05:33:38.188928+0000","last_undegraded":"2024-09-17T05:33:38.188928+0000","last_fullsized":"2024-09-17T05:33:38.188928+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:14.456108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.189307+0000","last_change":"2024-09-17T05:33:37.193845+0000","last_active":"2024-09-17T05:33:38.189307+0000","last_peered":"2024-09-17T05:33:38.189307+0000","last_clean":"2024-09-17T05:33:38.189307+0000","last_became_active":"2024-09-17T05:33:37.193475+0000","last_became_peered":"2024-09-17T05:33:37.193475+0000","last_unstale":"2024-09-17T05:33:38.189307+0000","last_undegraded":"2024-09-17T05:33:38.189307+0000","last_fullsized":"2024-09-17T05:33:38.189307+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:14:25.565762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181315+0000","last_change":"2024-09-17T05:33:37.193398+0000","last_active":"2024-09-17T05:33:38.181315+0000","last_peered":"2024-09-17T05:33:38.181315+0000","last_clean":"2024-09-17T05:33:38.181315+0000","last_became_active":"2024-09-17T05:33:37.192753+0000","last_became_peered":"2024-09-17T05:33:37.192753+0000","last_unstale":"2024-09-17T05:33:38.181315+0000","last_undegraded":"2024-09-17T05:33:38.181315+0000","last_fullsized":"2024-09-17T05:33:38.181315+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:18.318833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188869+0000","last_change":"2024-09-17T05:33:37.189334+0000","last_active":"2024-09-17T05:33:38.188869+0000","last_peered":"2024-09-17T05:33:38.188869+0000","last_clean":"2024-09-17T05:33:38.188869+0000","last_became_active":"2024-09-17T05:33:37.187998+0000","last_became_peered":"2024-09-17T05:33:37.187998+0000","last_unstale":"2024-09-17T05:33:38.188869+0000","last_undegraded":"2024-09-17T05:33:38.188869+0000","last_fullsized":"2024-09-17T05:33:38.188869+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:58.193938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181114+0000","last_change":"2024-09-17T05:33:37.194717+0000","last_active":"2024-09-17T05:33:38.181114+0000","last_peered":"2024-09-17T05:33:38.181114+0000","last_clean":"2024-09-17T05:33:38.181114+0000","last_became_active":"2024-09-17T05:33:37.191325+0000","last_became_peered":"2024-09-17T05:33:37.191325+0000","last_unstale":"2024-09-17T05:33:38.181114+0000","last_undegraded":"2024-09-17T05:33:38.181114+0000","last_fullsized":"2024-09-17T05:33:38.181114+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:51.540960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.189113+0000","last_change":"2024-09-17T05:33:37.200778+0000","last_active":"2024-09-17T05:33:38.189113+0000","last_peered":"2024-09-17T05:33:38.189113+0000","last_clean":"2024-09-17T05:33:38.189113+0000","last_became_active":"2024-09-17T05:33:37.199567+0000","last_became_peered":"2024-09-17T05:33:37.199567+0000","last_unstale":"2024-09-17T05:33:38.189113+0000","last_undegraded":"2024-09-17T05:33:38.189113+0000","last_fullsized":"2024-09-17T05:33:38.189113+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:18.318833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.198598+0000","last_change":"2024-09-17T05:33:37.190286+0000","last_active":"2024-09-17T05:33:37.198598+0000","last_peered":"2024-09-17T05:33:37.198598+0000","last_clean":"2024-09-17T05:33:37.198598+0000","last_became_active":"2024-09-17T05:33:37.189907+0000","last_became_peered":"2024-09-17T05:33:37.189907+0000","last_unstale":"2024-09-17T05:33:37.198598+0000","last_undegraded":"2024-09-17T05:33:37.198598+0000","last_fullsized":"2024-09-17T05:33:37.198598+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:51.429878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.213640+0000","last_change":"2024-09-17T05:33:37.206563+0000","last_active":"2024-09-17T05:33:37.213640+0000","last_peered":"2024-09-17T05:33:37.213640+0000","last_clean":"2024-09-17T05:33:37.213640+0000","last_became_active":"2024-09-17T05:33:37.206247+0000","last_became_peered":"2024-09-17T05:33:37.206247+0000","last_unstale":"2024-09-17T05:33:37.213640+0000","last_undegraded":"2024-09-17T05:33:37.213640+0000","last_fullsized":"2024-09-17T05:33:37.213640+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:07.260045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181698+0000","last_change":"2024-09-17T05:33:37.192899+0000","last_active":"2024-09-17T05:33:38.181698+0000","last_peered":"2024-09-17T05:33:38.181698+0000","last_clean":"2024-09-17T05:33:38.181698+0000","last_became_active":"2024-09-17T05:33:37.192098+0000","last_became_peered":"2024-09-17T05:33:37.192098+0000","last_unstale":"2024-09-17T05:33:38.181698+0000","last_undegraded":"2024-09-17T05:33:38.181698+0000","last_fullsized":"2024-09-17T05:33:38.181698+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:30.695230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188709+0000","last_change":"2024-09-17T05:33:37.189857+0000","last_active":"2024-09-17T05:33:38.188709+0000","last_peered":"2024-09-17T05:33:38.188709+0000","last_clean":"2024-09-17T05:33:38.188709+0000","last_became_active":"2024-09-17T05:33:37.188353+0000","last_became_peered":"2024-09-17T05:33:37.188353+0000","last_unstale":"2024-09-17T05:33:38.188709+0000","last_undegraded":"2024-09-17T05:33:38.188709+0000","last_fullsized":"2024-09-17T05:33:38.188709+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:45.489290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188416+0000","last_change":"2024-09-17T05:33:37.198803+0000","last_active":"2024-09-17T05:33:38.188416+0000","last_peered":"2024-09-17T05:33:38.188416+0000","last_clean":"2024-09-17T05:33:38.188416+0000","last_became_active":"2024-09-17T05:33:37.198400+0000","last_became_peered":"2024-09-17T05:33:37.198400+0000","last_unstale":"2024-09-17T05:33:38.188416+0000","last_undegraded":"2024-09-17T05:33:38.188416+0000","last_fullsized":"2024-09-17T05:33:38.188416+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:51.652465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.197163+0000","last_change":"2024-09-17T05:33:37.189034+0000","last_active":"2024-09-17T05:33:37.197163+0000","last_peered":"2024-09-17T05:33:37.197163+0000","last_clean":"2024-09-17T05:33:37.197163+0000","last_became_active":"2024-09-17T05:33:37.188693+0000","last_became_peered":"2024-09-17T05:33:37.188693+0000","last_unstale":"2024-09-17T05:33:37.197163+0000","last_undegraded":"2024-09-17T05:33:37.197163+0000","last_fullsized":"2024-09-17T05:33:37.197163+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:30.642109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.210331+0000","last_change":"2024-09-17T05:33:37.205105+0000","last_active":"2024-09-17T05:33:37.210331+0000","last_peered":"2024-09-17T05:33:37.210331+0000","last_clean":"2024-09-17T05:33:37.210331+0000","last_became_active":"2024-09-17T05:33:37.199969+0000","last_became_peered":"2024-09-17T05:33:37.199969+0000","last_unstale":"2024-09-17T05:33:37.210331+0000","last_undegraded":"2024-09-17T05:33:37.210331+0000","last_fullsized":"2024-09-17T05:33:37.210331+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:19.123604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.207439+0000","last_change":"2024-09-17T05:33:37.203111+0000","last_active":"2024-09-17T05:33:37.207439+0000","last_peered":"2024-09-17T05:33:37.207439+0000","last_clean":"2024-09-17T05:33:37.207439+0000","last_became_active":"2024-09-17T05:33:37.198677+0000","last_became_peered":"2024-09-17T05:33:37.198677+0000","last_unstale":"2024-09-17T05:33:37.207439+0000","last_undegraded":"2024-09-17T05:33:37.207439+0000","last_fullsized":"2024-09-17T05:33:37.207439+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:23.015696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"99'4","reported_seq":19,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.189820+0000","last_change":"2024-09-17T05:33:36.185939+0000","last_active":"2024-09-17T05:33:38.189820+0000","last_peered":"2024-09-17T05:33:38.189820+0000","last_clean":"2024-09-17T05:33:38.189820+0000","last_became_active":"2024-09-17T05:33:36.185641+0000","last_became_peered":"2024-09-17T05:33:36.185641+0000","last_unstale":"2024-09-17T05:33:38.189820+0000","last_undegraded":"2024-09-17T05:33:38.189820+0000","last_fullsized":"2024-09-17T05:33:38.189820+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:15:14.736109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.205939+0000","last_change":"2024-09-17T05:33:37.196335+0000","last_active":"2024-09-17T05:33:37.205939+0000","last_peered":"2024-09-17T05:33:37.205939+0000","last_clean":"2024-09-17T05:33:37.205939+0000","last_became_active":"2024-09-17T05:33:37.195639+0000","last_became_peered":"2024-09-17T05:33:37.195639+0000","last_unstale":"2024-09-17T05:33:37.205939+0000","last_undegraded":"2024-09-17T05:33:37.205939+0000","last_fullsized":"2024-09-17T05:33:37.205939+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:02.193234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"99'1","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.216582+0000","last_change":"2024-09-17T05:33:36.188605+0000","last_active":"2024-09-17T05:33:37.216582+0000","last_peered":"2024-09-17T05:33:37.216582+0000","last_clean":"2024-09-17T05:33:37.216582+0000","last_became_active":"2024-09-17T05:33:36.188314+0000","last_became_peered":"2024-09-17T05:33:36.188314+0000","last_unstale":"2024-09-17T05:33:37.216582+0000","last_undegraded":"2024-09-17T05:33:37.216582+0000","last_fullsized":"2024-09-17T05:33:37.216582+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:07.630269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.209922+0000","last_change":"2024-09-17T05:33:37.204753+0000","last_active":"2024-09-17T05:33:37.209922+0000","last_peered":"2024-09-17T05:33:37.209922+0000","last_clean":"2024-09-17T05:33:37.209922+0000","last_became_active":"2024-09-17T05:33:37.199543+0000","last_became_peered":"2024-09-17T05:33:37.199543+0000","last_unstale":"2024-09-17T05:33:37.209922+0000","last_undegraded":"2024-09-17T05:33:37.209922+0000","last_fullsized":"2024-09-17T05:33:37.209922+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:44.311663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"99'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.219601+0000","last_change":"2024-09-17T05:33:36.195022+0000","last_active":"2024-09-17T05:33:37.219601+0000","last_peered":"2024-09-17T05:33:37.219601+0000","last_clean":"2024-09-17T05:33:37.219601+0000","last_became_active":"2024-09-17T05:33:36.194718+0000","last_became_peered":"2024-09-17T05:33:36.194718+0000","last_unstale":"2024-09-17T05:33:37.219601+0000","last_undegraded":"2024-09-17T05:33:37.219601+0000","last_fullsized":"2024-09-17T05:33:37.219601+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:13.871822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.210892+0000","last_change":"2024-09-17T05:33:37.206615+0000","last_active":"2024-09-17T05:33:37.210892+0000","last_peered":"2024-09-17T05:33:37.210892+0000","last_clean":"2024-09-17T05:33:37.210892+0000","last_became_active":"2024-09-17T05:33:37.206364+0000","last_became_peered":"2024-09-17T05:33:37.206364+0000","last_unstale":"2024-09-17T05:33:37.210892+0000","last_undegraded":"2024-09-17T05:33:37.210892+0000","last_fullsized":"2024-09-17T05:33:37.210892+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:15.966704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"99'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.219518+0000","last_change":"2024-09-17T05:33:36.194101+0000","last_active":"2024-09-17T05:33:37.219518+0000","last_peered":"2024-09-17T05:33:37.219518+0000","last_clean":"2024-09-17T05:33:37.219518+0000","last_became_active":"2024-09-17T05:33:36.193844+0000","last_became_peered":"2024-09-17T05:33:36.193844+0000","last_unstale":"2024-09-17T05:33:37.219518+0000","last_undegraded":"2024-09-17T05:33:37.219518+0000","last_fullsized":"2024-09-17T05:33:37.219518+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:47.495496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.206031+0000","last_change":"2024-09-17T05:33:37.197843+0000","last_active":"2024-09-17T05:33:37.206031+0000","last_peered":"2024-09-17T05:33:37.206031+0000","last_clean":"2024-09-17T05:33:37.206031+0000","last_became_active":"2024-09-17T05:33:37.197563+0000","last_became_peered":"2024-09-17T05:33:37.197563+0000","last_unstale":"2024-09-17T05:33:37.206031+0000","last_undegraded":"2024-09-17T05:33:37.206031+0000","last_fullsized":"2024-09-17T05:33:37.206031+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:15.160513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"99'1","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188197+0000","last_change":"2024-09-17T05:33:36.195216+0000","last_active":"2024-09-17T05:33:38.188197+0000","last_peered":"2024-09-17T05:33:38.188197+0000","last_clean":"2024-09-17T05:33:38.188197+0000","last_became_active":"2024-09-17T05:33:36.194901+0000","last_became_peered":"2024-09-17T05:33:36.194901+0000","last_unstale":"2024-09-17T05:33:38.188197+0000","last_undegraded":"2024-09-17T05:33:38.188197+0000","last_fullsized":"2024-09-17T05:33:38.188197+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:49.125565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188977+0000","last_change":"2024-09-17T05:33:37.203471+0000","last_active":"2024-09-17T05:33:38.188977+0000","last_peered":"2024-09-17T05:33:38.188977+0000","last_clean":"2024-09-17T05:33:38.188977+0000","last_became_active":"2024-09-17T05:33:37.203150+0000","last_became_peered":"2024-09-17T05:33:37.203150+0000","last_unstale":"2024-09-17T05:33:38.188977+0000","last_undegraded":"2024-09-17T05:33:38.188977+0000","last_fullsized":"2024-09-17T05:33:38.188977+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:20.388125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"99'1","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181438+0000","last_change":"2024-09-17T05:33:36.184508+0000","last_active":"2024-09-17T05:33:38.181438+0000","last_peered":"2024-09-17T05:33:38.181438+0000","last_clean":"2024-09-17T05:33:38.181438+0000","last_became_active":"2024-09-17T05:33:36.181927+0000","last_became_peered":"2024-09-17T05:33:36.181927+0000","last_unstale":"2024-09-17T05:33:38.181438+0000","last_undegraded":"2024-09-17T05:33:38.181438+0000","last_fullsized":"2024-09-17T05:33:38.181438+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:02.209396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.213100+0000","last_change":"2024-09-17T05:33:37.201931+0000","last_active":"2024-09-17T05:33:37.213100+0000","last_peered":"2024-09-17T05:33:37.213100+0000","last_clean":"2024-09-17T05:33:37.213100+0000","last_became_active":"2024-09-17T05:33:37.201598+0000","last_became_peered":"2024-09-17T05:33:37.201598+0000","last_unstale":"2024-09-17T05:33:37.213100+0000","last_undegraded":"2024-09-17T05:33:37.213100+0000","last_fullsized":"2024-09-17T05:33:37.213100+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:49.804959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188992+0000","last_change":"2024-09-17T05:33:36.187069+0000","last_active":"2024-09-17T05:33:38.188992+0000","last_peered":"2024-09-17T05:33:38.188992+0000","last_clean":"2024-09-17T05:33:38.188992+0000","last_became_active":"2024-09-17T05:33:36.186737+0000","last_became_peered":"2024-09-17T05:33:36.186737+0000","last_unstale":"2024-09-17T05:33:38.188992+0000","last_undegraded":"2024-09-17T05:33:38.188992+0000","last_fullsized":"2024-09-17T05:33:38.188992+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:31.392650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188198+0000","last_change":"2024-09-17T05:33:37.196482+0000","last_active":"2024-09-17T05:33:38.188198+0000","last_peered":"2024-09-17T05:33:38.188198+0000","last_clean":"2024-09-17T05:33:38.188198+0000","last_became_active":"2024-09-17T05:33:37.196203+0000","last_became_peered":"2024-09-17T05:33:37.196203+0000","last_unstale":"2024-09-17T05:33:38.188198+0000","last_undegraded":"2024-09-17T05:33:38.188198+0000","last_fullsized":"2024-09-17T05:33:38.188198+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:20.563565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.179119+0000","last_change":"2024-09-17T05:33:36.188096+0000","last_active":"2024-09-17T05:33:37.179119+0000","last_peered":"2024-09-17T05:33:37.179119+0000","last_clean":"2024-09-17T05:33:37.179119+0000","last_became_active":"2024-09-17T05:33:36.187824+0000","last_became_peered":"2024-09-17T05:33:36.187824+0000","last_unstale":"2024-09-17T05:33:37.179119+0000","last_undegraded":"2024-09-17T05:33:37.179119+0000","last_fullsized":"2024-09-17T05:33:37.179119+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:45.649412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.190285+0000","last_change":"2024-09-17T05:33:37.197819+0000","last_active":"2024-09-17T05:33:38.190285+0000","last_peered":"2024-09-17T05:33:38.190285+0000","last_clean":"2024-09-17T05:33:38.190285+0000","last_became_active":"2024-09-17T05:33:37.197479+0000","last_became_peered":"2024-09-17T05:33:37.197479+0000","last_unstale":"2024-09-17T05:33:38.190285+0000","last_undegraded":"2024-09-17T05:33:38.190285+0000","last_fullsized":"2024-09-17T05:33:38.190285+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:03.816668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.175442+0000","last_change":"2024-09-17T05:33:36.194935+0000","last_active":"2024-09-17T05:33:37.175442+0000","last_peered":"2024-09-17T05:33:37.175442+0000","last_clean":"2024-09-17T05:33:37.175442+0000","last_became_active":"2024-09-17T05:33:36.194618+0000","last_became_peered":"2024-09-17T05:33:36.194618+0000","last_unstale":"2024-09-17T05:33:37.175442+0000","last_undegraded":"2024-09-17T05:33:37.175442+0000","last_fullsized":"2024-09-17T05:33:37.175442+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:25:35.820191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.208846+0000","last_change":"2024-09-17T05:33:37.203543+0000","last_active":"2024-09-17T05:33:37.208846+0000","last_peered":"2024-09-17T05:33:37.208846+0000","last_clean":"2024-09-17T05:33:37.208846+0000","last_became_active":"2024-09-17T05:33:37.202484+0000","last_became_peered":"2024-09-17T05:33:37.202484+0000","last_unstale":"2024-09-17T05:33:37.208846+0000","last_undegraded":"2024-09-17T05:33:37.208846+0000","last_fullsized":"2024-09-17T05:33:37.208846+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:16.921190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181915+0000","last_change":"2024-09-17T05:33:36.185906+0000","last_active":"2024-09-17T05:33:38.181915+0000","last_peered":"2024-09-17T05:33:38.181915+0000","last_clean":"2024-09-17T05:33:38.181915+0000","last_became_active":"2024-09-17T05:33:36.185594+0000","last_became_peered":"2024-09-17T05:33:36.185594+0000","last_unstale":"2024-09-17T05:33:38.181915+0000","last_undegraded":"2024-09-17T05:33:38.181915+0000","last_fullsized":"2024-09-17T05:33:38.181915+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:01.185916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181767+0000","last_change":"2024-09-17T05:33:37.189557+0000","last_active":"2024-09-17T05:33:38.181767+0000","last_peered":"2024-09-17T05:33:38.181767+0000","last_clean":"2024-09-17T05:33:38.181767+0000","last_became_active":"2024-09-17T05:33:37.187894+0000","last_became_peered":"2024-09-17T05:33:37.187894+0000","last_unstale":"2024-09-17T05:33:38.181767+0000","last_undegraded":"2024-09-17T05:33:38.181767+0000","last_fullsized":"2024-09-17T05:33:38.181767+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:22.751496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"99'3","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.217490+0000","last_change":"2024-09-17T05:33:36.179043+0000","last_active":"2024-09-17T05:33:37.217490+0000","last_peered":"2024-09-17T05:33:37.217490+0000","last_clean":"2024-09-17T05:33:37.217490+0000","last_became_active":"2024-09-17T05:33:36.178758+0000","last_became_peered":"2024-09-17T05:33:36.178758+0000","last_unstale":"2024-09-17T05:33:37.217490+0000","last_undegraded":"2024-09-17T05:33:37.217490+0000","last_fullsized":"2024-09-17T05:33:37.217490+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:40.435044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.189319+0000","last_change":"2024-09-17T05:33:37.187607+0000","last_active":"2024-09-17T05:33:38.189319+0000","last_peered":"2024-09-17T05:33:38.189319+0000","last_clean":"2024-09-17T05:33:38.189319+0000","last_became_active":"2024-09-17T05:33:37.187175+0000","last_became_peered":"2024-09-17T05:33:37.187175+0000","last_unstale":"2024-09-17T05:33:38.189319+0000","last_undegraded":"2024-09-17T05:33:38.189319+0000","last_fullsized":"2024-09-17T05:33:38.189319+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:12.387261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"99'6","reported_seq":19,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.222084+0000","last_change":"2024-09-17T05:33:36.187968+0000","last_active":"2024-09-17T05:33:37.222084+0000","last_peered":"2024-09-17T05:33:37.222084+0000","last_clean":"2024-09-17T05:33:37.222084+0000","last_became_active":"2024-09-17T05:33:36.187668+0000","last_became_peered":"2024-09-17T05:33:36.187668+0000","last_unstale":"2024-09-17T05:33:37.222084+0000","last_undegraded":"2024-09-17T05:33:37.222084+0000","last_fullsized":"2024-09-17T05:33:37.222084+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:01.963503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181353+0000","last_change":"2024-09-17T05:33:37.188800+0000","last_active":"2024-09-17T05:33:38.181353+0000","last_peered":"2024-09-17T05:33:38.181353+0000","last_clean":"2024-09-17T05:33:38.181353+0000","last_became_active":"2024-09-17T05:33:37.188506+0000","last_became_peered":"2024-09-17T05:33:37.188506+0000","last_unstale":"2024-09-17T05:33:38.181353+0000","last_undegraded":"2024-09-17T05:33:38.181353+0000","last_fullsized":"2024-09-17T05:33:38.181353+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:57.249213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"99'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.219604+0000","last_change":"2024-09-17T05:33:36.186343+0000","last_active":"2024-09-17T05:33:37.219604+0000","last_peered":"2024-09-17T05:33:37.219604+0000","last_clean":"2024-09-17T05:33:37.219604+0000","last_became_active":"2024-09-17T05:33:36.186036+0000","last_became_peered":"2024-09-17T05:33:36.186036+0000","last_unstale":"2024-09-17T05:33:37.219604+0000","last_undegraded":"2024-09-17T05:33:37.219604+0000","last_fullsized":"2024-09-17T05:33:37.219604+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:51.043200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181566+0000","last_change":"2024-09-17T05:33:37.191239+0000","last_active":"2024-09-17T05:33:38.181566+0000","last_peered":"2024-09-17T05:33:38.181566+0000","last_clean":"2024-09-17T05:33:38.181566+0000","last_became_active":"2024-09-17T05:33:37.190887+0000","last_became_peered":"2024-09-17T05:33:37.190887+0000","last_unstale":"2024-09-17T05:33:38.181566+0000","last_undegraded":"2024-09-17T05:33:38.181566+0000","last_fullsized":"2024-09-17T05:33:38.181566+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:06.063824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.191912+0000","last_change":"2024-09-17T05:33:36.193177+0000","last_active":"2024-09-17T05:33:37.191912+0000","last_peered":"2024-09-17T05:33:37.191912+0000","last_clean":"2024-09-17T05:33:37.191912+0000","last_became_active":"2024-09-17T05:33:36.192904+0000","last_became_peered":"2024-09-17T05:33:36.192904+0000","last_unstale":"2024-09-17T05:33:37.191912+0000","last_undegraded":"2024-09-17T05:33:37.191912+0000","last_fullsized":"2024-09-17T05:33:37.191912+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:22.782710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181230+0000","last_change":"2024-09-17T05:33:37.177613+0000","last_active":"2024-09-17T05:33:38.181230+0000","last_peered":"2024-09-17T05:33:38.181230+0000","last_clean":"2024-09-17T05:33:38.181230+0000","last_became_active":"2024-09-17T05:33:37.177258+0000","last_became_peered":"2024-09-17T05:33:37.177258+0000","last_unstale":"2024-09-17T05:33:38.181230+0000","last_undegraded":"2024-09-17T05:33:38.181230+0000","last_fullsized":"2024-09-17T05:33:38.181230+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:58.193938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"99'8","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.220411+0000","last_change":"2024-09-17T05:33:36.189723+0000","last_active":"2024-09-17T05:33:37.220411+0000","last_peered":"2024-09-17T05:33:37.220411+0000","last_clean":"2024-09-17T05:33:37.220411+0000","last_became_active":"2024-09-17T05:33:36.189396+0000","last_became_peered":"2024-09-17T05:33:36.189396+0000","last_unstale":"2024-09-17T05:33:37.220411+0000","last_undegraded":"2024-09-17T05:33:37.220411+0000","last_fullsized":"2024-09-17T05:33:37.220411+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:27.890433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.192014+0000","last_change":"2024-09-17T05:33:37.187300+0000","last_active":"2024-09-17T05:33:37.192014+0000","last_peered":"2024-09-17T05:33:37.192014+0000","last_clean":"2024-09-17T05:33:37.192014+0000","last_became_active":"2024-09-17T05:33:37.186994+0000","last_became_peered":"2024-09-17T05:33:37.186994+0000","last_unstale":"2024-09-17T05:33:37.192014+0000","last_undegraded":"2024-09-17T05:33:37.192014+0000","last_fullsized":"2024-09-17T05:33:37.192014+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:15.587504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"99'1","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.216733+0000","last_change":"2024-09-17T05:33:36.183518+0000","last_active":"2024-09-17T05:33:37.216733+0000","last_peered":"2024-09-17T05:33:37.216733+0000","last_clean":"2024-09-17T05:33:37.216733+0000","last_became_active":"2024-09-17T05:33:36.182963+0000","last_became_peered":"2024-09-17T05:33:36.182963+0000","last_unstale":"2024-09-17T05:33:37.216733+0000","last_undegraded":"2024-09-17T05:33:37.216733+0000","last_fullsized":"2024-09-17T05:33:37.216733+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:18.448929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.213480+0000","last_change":"2024-09-17T05:33:37.205441+0000","last_active":"2024-09-17T05:33:37.213480+0000","last_peered":"2024-09-17T05:33:37.213480+0000","last_clean":"2024-09-17T05:33:37.213480+0000","last_became_active":"2024-09-17T05:33:37.199999+0000","last_became_peered":"2024-09-17T05:33:37.199999+0000","last_unstale":"2024-09-17T05:33:37.213480+0000","last_undegraded":"2024-09-17T05:33:37.213480+0000","last_fullsized":"2024-09-17T05:33:37.213480+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:11:46.824579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"99'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.215750+0000","last_change":"2024-09-17T05:33:36.185213+0000","last_active":"2024-09-17T05:33:37.215750+0000","last_peered":"2024-09-17T05:33:37.215750+0000","last_clean":"2024-09-17T05:33:37.215750+0000","last_became_active":"2024-09-17T05:33:36.184922+0000","last_became_peered":"2024-09-17T05:33:36.184922+0000","last_unstale":"2024-09-17T05:33:37.215750+0000","last_undegraded":"2024-09-17T05:33:37.215750+0000","last_fullsized":"2024-09-17T05:33:37.215750+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:09:44.841793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.200401+0000","last_change":"2024-09-17T05:33:37.194797+0000","last_active":"2024-09-17T05:33:37.200401+0000","last_peered":"2024-09-17T05:33:37.200401+0000","last_clean":"2024-09-17T05:33:37.200401+0000","last_became_active":"2024-09-17T05:33:37.194482+0000","last_became_peered":"2024-09-17T05:33:37.194482+0000","last_unstale":"2024-09-17T05:33:37.200401+0000","last_undegraded":"2024-09-17T05:33:37.200401+0000","last_fullsized":"2024-09-17T05:33:37.200401+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:31.099832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"99'1","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.217790+0000","last_change":"2024-09-17T05:33:36.186848+0000","last_active":"2024-09-17T05:33:37.217790+0000","last_peered":"2024-09-17T05:33:37.217790+0000","last_clean":"2024-09-17T05:33:37.217790+0000","last_became_active":"2024-09-17T05:33:36.186598+0000","last_became_peered":"2024-09-17T05:33:36.186598+0000","last_unstale":"2024-09-17T05:33:37.217790+0000","last_undegraded":"2024-09-17T05:33:37.217790+0000","last_fullsized":"2024-09-17T05:33:37.217790+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:02.209396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.200803+0000","last_change":"2024-09-17T05:33:37.196549+0000","last_active":"2024-09-17T05:33:37.200803+0000","last_peered":"2024-09-17T05:33:37.200803+0000","last_clean":"2024-09-17T05:33:37.200803+0000","last_became_active":"2024-09-17T05:33:37.194748+0000","last_became_peered":"2024-09-17T05:33:37.194748+0000","last_unstale":"2024-09-17T05:33:37.200803+0000","last_undegraded":"2024-09-17T05:33:37.200803+0000","last_fullsized":"2024-09-17T05:33:37.200803+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:28.827566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188381+0000","last_change":"2024-09-17T05:33:36.181618+0000","last_active":"2024-09-17T05:33:38.188381+0000","last_peered":"2024-09-17T05:33:38.188381+0000","last_clean":"2024-09-17T05:33:38.188381+0000","last_became_active":"2024-09-17T05:33:36.180247+0000","last_became_peered":"2024-09-17T05:33:36.180247+0000","last_unstale":"2024-09-17T05:33:38.188381+0000","last_undegraded":"2024-09-17T05:33:38.188381+0000","last_fullsized":"2024-09-17T05:33:38.188381+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:21.290242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.194635+0000","last_change":"2024-09-17T05:33:37.187830+0000","last_active":"2024-09-17T05:33:37.194635+0000","last_peered":"2024-09-17T05:33:37.194635+0000","last_clean":"2024-09-17T05:33:37.194635+0000","last_became_active":"2024-09-17T05:33:37.187410+0000","last_became_peered":"2024-09-17T05:33:37.187410+0000","last_unstale":"2024-09-17T05:33:37.194635+0000","last_undegraded":"2024-09-17T05:33:37.194635+0000","last_fullsized":"2024-09-17T05:33:37.194635+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:51.879131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"99'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.219439+0000","last_change":"2024-09-17T05:33:36.190579+0000","last_active":"2024-09-17T05:33:37.219439+0000","last_peered":"2024-09-17T05:33:37.219439+0000","last_clean":"2024-09-17T05:33:37.219439+0000","last_became_active":"2024-09-17T05:33:36.190250+0000","last_became_peered":"2024-09-17T05:33:36.190250+0000","last_unstale":"2024-09-17T05:33:37.219439+0000","last_undegraded":"2024-09-17T05:33:37.219439+0000","last_fullsized":"2024-09-17T05:33:37.219439+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:16.985626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.194069+0000","last_change":"2024-09-17T05:33:37.185010+0000","last_active":"2024-09-17T05:33:37.194069+0000","last_peered":"2024-09-17T05:33:37.194069+0000","last_clean":"2024-09-17T05:33:37.194069+0000","last_became_active":"2024-09-17T05:33:37.184190+0000","last_became_peered":"2024-09-17T05:33:37.184190+0000","last_unstale":"2024-09-17T05:33:37.194069+0000","last_undegraded":"2024-09-17T05:33:37.194069+0000","last_fullsized":"2024-09-17T05:33:37.194069+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:37.936078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.174587+0000","last_change":"2024-09-17T05:33:36.191010+0000","last_active":"2024-09-17T05:33:37.174587+0000","last_peered":"2024-09-17T05:33:37.174587+0000","last_clean":"2024-09-17T05:33:37.174587+0000","last_became_active":"2024-09-17T05:33:36.190576+0000","last_became_peered":"2024-09-17T05:33:36.190576+0000","last_unstale":"2024-09-17T05:33:37.174587+0000","last_undegraded":"2024-09-17T05:33:37.174587+0000","last_fullsized":"2024-09-17T05:33:37.174587+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:21:05.407685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.203475+0000","last_change":"2024-09-17T05:33:37.197069+0000","last_active":"2024-09-17T05:33:37.203475+0000","last_peered":"2024-09-17T05:33:37.203475+0000","last_clean":"2024-09-17T05:33:37.203475+0000","last_became_active":"2024-09-17T05:33:37.196795+0000","last_became_peered":"2024-09-17T05:33:37.196795+0000","last_unstale":"2024-09-17T05:33:37.203475+0000","last_undegraded":"2024-09-17T05:33:37.203475+0000","last_fullsized":"2024-09-17T05:33:37.203475+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:59:41.230491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.186334+0000","last_change":"2024-09-17T05:33:36.190748+0000","last_active":"2024-09-17T05:33:37.186334+0000","last_peered":"2024-09-17T05:33:37.186334+0000","last_clean":"2024-09-17T05:33:37.186334+0000","last_became_active":"2024-09-17T05:33:36.190464+0000","last_became_peered":"2024-09-17T05:33:36.190464+0000","last_unstale":"2024-09-17T05:33:37.186334+0000","last_undegraded":"2024-09-17T05:33:37.186334+0000","last_fullsized":"2024-09-17T05:33:37.186334+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:37.914902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181199+0000","last_change":"2024-09-17T05:33:37.192843+0000","last_active":"2024-09-17T05:33:38.181199+0000","last_peered":"2024-09-17T05:33:38.181199+0000","last_clean":"2024-09-17T05:33:38.181199+0000","last_became_active":"2024-09-17T05:33:37.192560+0000","last_became_peered":"2024-09-17T05:33:37.192560+0000","last_unstale":"2024-09-17T05:33:38.181199+0000","last_undegraded":"2024-09-17T05:33:38.181199+0000","last_fullsized":"2024-09-17T05:33:38.181199+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:20.388125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.179336+0000","last_change":"2024-09-17T05:33:36.181773+0000","last_active":"2024-09-17T05:33:37.179336+0000","last_peered":"2024-09-17T05:33:37.179336+0000","last_clean":"2024-09-17T05:33:37.179336+0000","last_became_active":"2024-09-17T05:33:36.178711+0000","last_became_peered":"2024-09-17T05:33:36.178711+0000","last_unstale":"2024-09-17T05:33:37.179336+0000","last_undegraded":"2024-09-17T05:33:37.179336+0000","last_fullsized":"2024-09-17T05:33:37.179336+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:48.666049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.211290+0000","last_change":"2024-09-17T05:33:37.205485+0000","last_active":"2024-09-17T05:33:37.211290+0000","last_peered":"2024-09-17T05:33:37.211290+0000","last_clean":"2024-09-17T05:33:37.211290+0000","last_became_active":"2024-09-17T05:33:37.205148+0000","last_became_peered":"2024-09-17T05:33:37.205148+0000","last_unstale":"2024-09-17T05:33:37.211290+0000","last_undegraded":"2024-09-17T05:33:37.211290+0000","last_fullsized":"2024-09-17T05:33:37.211290+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:28.258002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"99'2","reported_seq":17,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.182058+0000","last_change":"2024-09-17T05:33:36.192261+0000","last_active":"2024-09-17T05:33:38.182058+0000","last_peered":"2024-09-17T05:33:38.182058+0000","last_clean":"2024-09-17T05:33:38.182058+0000","last_became_active":"2024-09-17T05:33:36.191958+0000","last_became_peered":"2024-09-17T05:33:36.191958+0000","last_unstale":"2024-09-17T05:33:38.182058+0000","last_undegraded":"2024-09-17T05:33:38.182058+0000","last_fullsized":"2024-09-17T05:33:38.182058+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:27.940599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.186336+0000","last_change":"2024-09-17T05:33:37.183504+0000","last_active":"2024-09-17T05:33:37.186336+0000","last_peered":"2024-09-17T05:33:37.186336+0000","last_clean":"2024-09-17T05:33:37.186336+0000","last_became_active":"2024-09-17T05:33:37.183215+0000","last_became_peered":"2024-09-17T05:33:37.183215+0000","last_unstale":"2024-09-17T05:33:37.186336+0000","last_undegraded":"2024-09-17T05:33:37.186336+0000","last_fullsized":"2024-09-17T05:33:37.186336+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:53:28.011500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.191554+0000","last_change":"2024-09-17T05:33:36.185400+0000","last_active":"2024-09-17T05:33:37.191554+0000","last_peered":"2024-09-17T05:33:37.191554+0000","last_clean":"2024-09-17T05:33:37.191554+0000","last_became_active":"2024-09-17T05:33:36.185049+0000","last_became_peered":"2024-09-17T05:33:36.185049+0000","last_unstale":"2024-09-17T05:33:37.191554+0000","last_undegraded":"2024-09-17T05:33:37.191554+0000","last_fullsized":"2024-09-17T05:33:37.191554+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:21.361929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.206189+0000","last_change":"2024-09-17T05:33:37.203635+0000","last_active":"2024-09-17T05:33:37.206189+0000","last_peered":"2024-09-17T05:33:37.206189+0000","last_clean":"2024-09-17T05:33:37.206189+0000","last_became_active":"2024-09-17T05:33:37.203341+0000","last_became_peered":"2024-09-17T05:33:37.203341+0000","last_unstale":"2024-09-17T05:33:37.206189+0000","last_undegraded":"2024-09-17T05:33:37.206189+0000","last_fullsized":"2024-09-17T05:33:37.206189+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:04.793239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.176010+0000","last_change":"2024-09-17T05:33:36.184278+0000","last_active":"2024-09-17T05:33:37.176010+0000","last_peered":"2024-09-17T05:33:37.176010+0000","last_clean":"2024-09-17T05:33:37.176010+0000","last_became_active":"2024-09-17T05:33:36.182942+0000","last_became_peered":"2024-09-17T05:33:36.182942+0000","last_unstale":"2024-09-17T05:33:37.176010+0000","last_undegraded":"2024-09-17T05:33:37.176010+0000","last_fullsized":"2024-09-17T05:33:37.176010+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:03.441188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.211893+0000","last_change":"2024-09-17T05:33:37.208975+0000","last_active":"2024-09-17T05:33:37.211893+0000","last_peered":"2024-09-17T05:33:37.211893+0000","last_clean":"2024-09-17T05:33:37.211893+0000","last_became_active":"2024-09-17T05:33:37.208669+0000","last_became_peered":"2024-09-17T05:33:37.208669+0000","last_unstale":"2024-09-17T05:33:37.211893+0000","last_undegraded":"2024-09-17T05:33:37.211893+0000","last_fullsized":"2024-09-17T05:33:37.211893+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:53.686531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181822+0000","last_change":"2024-09-17T05:33:36.191804+0000","last_active":"2024-09-17T05:33:38.181822+0000","last_peered":"2024-09-17T05:33:38.181822+0000","last_clean":"2024-09-17T05:33:38.181822+0000","last_became_active":"2024-09-17T05:33:36.191476+0000","last_became_peered":"2024-09-17T05:33:36.191476+0000","last_unstale":"2024-09-17T05:33:38.181822+0000","last_undegraded":"2024-09-17T05:33:38.181822+0000","last_fullsized":"2024-09-17T05:33:38.181822+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:15.913873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188763+0000","last_change":"2024-09-17T05:33:37.182756+0000","last_active":"2024-09-17T05:33:38.188763+0000","last_peered":"2024-09-17T05:33:38.188763+0000","last_clean":"2024-09-17T05:33:38.188763+0000","last_became_active":"2024-09-17T05:33:37.182386+0000","last_became_peered":"2024-09-17T05:33:37.182386+0000","last_unstale":"2024-09-17T05:33:38.188763+0000","last_undegraded":"2024-09-17T05:33:38.188763+0000","last_fullsized":"2024-09-17T05:33:38.188763+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:48:37.033743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188831+0000","last_change":"2024-09-17T05:33:36.182776+0000","last_active":"2024-09-17T05:33:38.188831+0000","last_peered":"2024-09-17T05:33:38.188831+0000","last_clean":"2024-09-17T05:33:38.188831+0000","last_became_active":"2024-09-17T05:33:36.181450+0000","last_became_peered":"2024-09-17T05:33:36.181450+0000","last_unstale":"2024-09-17T05:33:38.188831+0000","last_undegraded":"2024-09-17T05:33:38.188831+0000","last_fullsized":"2024-09-17T05:33:38.188831+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:35.113488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.189204+0000","last_change":"2024-09-17T05:33:37.194383+0000","last_active":"2024-09-17T05:33:38.189204+0000","last_peered":"2024-09-17T05:33:38.189204+0000","last_clean":"2024-09-17T05:33:38.189204+0000","last_became_active":"2024-09-17T05:33:37.193877+0000","last_became_peered":"2024-09-17T05:33:37.193877+0000","last_unstale":"2024-09-17T05:33:38.189204+0000","last_undegraded":"2024-09-17T05:33:38.189204+0000","last_fullsized":"2024-09-17T05:33:38.189204+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:57.249213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188925+0000","last_change":"2024-09-17T05:33:36.194371+0000","last_active":"2024-09-17T05:33:38.188925+0000","last_peered":"2024-09-17T05:33:38.188925+0000","last_clean":"2024-09-17T05:33:38.188925+0000","last_became_active":"2024-09-17T05:33:36.194102+0000","last_became_peered":"2024-09-17T05:33:36.194102+0000","last_unstale":"2024-09-17T05:33:38.188925+0000","last_undegraded":"2024-09-17T05:33:38.188925+0000","last_fullsized":"2024-09-17T05:33:38.188925+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:27.894549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.203499+0000","last_change":"2024-09-17T05:33:37.197593+0000","last_active":"2024-09-17T05:33:37.203499+0000","last_peered":"2024-09-17T05:33:37.203499+0000","last_clean":"2024-09-17T05:33:37.203499+0000","last_became_active":"2024-09-17T05:33:37.196259+0000","last_became_peered":"2024-09-17T05:33:37.196259+0000","last_unstale":"2024-09-17T05:33:37.203499+0000","last_undegraded":"2024-09-17T05:33:37.203499+0000","last_fullsized":"2024-09-17T05:33:37.203499+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:11.599316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.174783+0000","last_change":"2024-09-17T05:33:36.194749+0000","last_active":"2024-09-17T05:33:37.174783+0000","last_peered":"2024-09-17T05:33:37.174783+0000","last_clean":"2024-09-17T05:33:37.174783+0000","last_became_active":"2024-09-17T05:33:36.194450+0000","last_became_peered":"2024-09-17T05:33:36.194450+0000","last_unstale":"2024-09-17T05:33:37.174783+0000","last_undegraded":"2024-09-17T05:33:37.174783+0000","last_fullsized":"2024-09-17T05:33:37.174783+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:59.150028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.206156+0000","last_change":"2024-09-17T05:33:37.201760+0000","last_active":"2024-09-17T05:33:37.206156+0000","last_peered":"2024-09-17T05:33:37.206156+0000","last_clean":"2024-09-17T05:33:37.206156+0000","last_became_active":"2024-09-17T05:33:37.201464+0000","last_became_peered":"2024-09-17T05:33:37.201464+0000","last_unstale":"2024-09-17T05:33:37.206156+0000","last_undegraded":"2024-09-17T05:33:37.206156+0000","last_fullsized":"2024-09-17T05:33:37.206156+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:37.274984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.179592+0000","last_change":"2024-09-17T05:33:36.178995+0000","last_active":"2024-09-17T05:33:37.179592+0000","last_peered":"2024-09-17T05:33:37.179592+0000","last_clean":"2024-09-17T05:33:37.179592+0000","last_became_active":"2024-09-17T05:33:36.178345+0000","last_became_peered":"2024-09-17T05:33:36.178345+0000","last_unstale":"2024-09-17T05:33:37.179592+0000","last_undegraded":"2024-09-17T05:33:37.179592+0000","last_fullsized":"2024-09-17T05:33:37.179592+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:45.267705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.181359+0000","last_change":"2024-09-17T05:33:37.194665+0000","last_active":"2024-09-17T05:33:38.181359+0000","last_peered":"2024-09-17T05:33:38.181359+0000","last_clean":"2024-09-17T05:33:38.181359+0000","last_became_active":"2024-09-17T05:33:37.190958+0000","last_became_peered":"2024-09-17T05:33:37.190958+0000","last_unstale":"2024-09-17T05:33:38.181359+0000","last_undegraded":"2024-09-17T05:33:38.181359+0000","last_fullsized":"2024-09-17T05:33:38.181359+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:36.151360+0000","last_clean_scrub_stamp":"2024-09-17T05:33:36.151360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:11.115371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-17T05:33:38.188317+0000","last_change":"2024-09-17T05:33:36.184450+0000","last_active":"2024-09-17T05:33:38.188317+0000","last_peered":"2024-09-17T05:33:38.188317+0000","last_clean":"2024-09-17T05:33:38.188317+0000","last_became_active":"2024-09-17T05:33:36.182140+0000","last_became_peered":"2024-09-17T05:33:36.182140+0000","last_unstale":"2024-09-17T05:33:38.188317+0000","last_undegraded":"2024-09-17T05:33:38.188317+0000","last_fullsized":"2024-09-17T05:33:38.188317+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:33:35.144042+0000","last_clean_scrub_stamp":"2024-09-17T05:33:35.144042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:31.474501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":281,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T05:33:37.183345+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:33:37.183345+0000","last_peered":"2024-09-17T05:33:37.183345+0000","last_clean":"2024-09-17T05:33:37.183345+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:33:37.183345+0000","last_undegraded":"2024-09-17T05:33:37.183345+0000","last_fullsized":"2024-09-17T05:33:37.183345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509504,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":1826816,"data_stored":1124740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1228800,"data_stored":533826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542208,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1232896,"data_stored":534360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509505,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1236992,"data_stored":540056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1253376,"data_stored":541738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509505,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1224704,"data_stored":533756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509503,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1232896,"data_stored":533880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542207,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32984,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338856,"statfs":{"total":96636764160,"available":96602988544,"internally_reserved":0,"allocated":1839104,"data_stored":1125848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:33:41.745 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:33:41.745 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:33:41.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff341e00640 1 -- 172.21.15.31:0/522804916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff33c1605d0 msgr2=0x7ff33c0d0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:41.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff341e00640 1 --2- 172.21.15.31:0/522804916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff33c1605d0 0x7ff33c0d0690 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7ff33c074840 tx=0x7ff32c01c8a0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff341e00640 1 -- 172.21.15.31:0/522804916 shutdown_connections 2024-09-17T05:33:41.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff341e00640 1 --2- 172.21.15.31:0/522804916 >> v2:172.21.15.155:3300/0 conn(0x7ff33c0aeb00 0x7ff33c0aefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff341e00640 1 --2- 172.21.15.31:0/522804916 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff33c0b1650 0x7ff33c0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff341e00640 1 --2- 172.21.15.31:0/522804916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff33c1605d0 0x7ff33c0d0690 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff341e00640 1 -- 172.21.15.31:0/522804916 >> 172.21.15.31:0/522804916 conn(0x7ff33c0d1dd0 msgr2=0x7ff33c0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:41.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff341e00640 1 -- 172.21.15.31:0/522804916 shutdown_connections 2024-09-17T05:33:41.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff341e00640 1 -- 172.21.15.31:0/522804916 wait complete. 2024-09-17T05:33:41.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff341e00640 1 Processor -- start 2024-09-17T05:33:41.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff341e00640 1 -- start start 2024-09-17T05:33:41.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff341e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff33c0aeb00 0x7ff33c165560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:41.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff341e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff33c0b1650 0x7ff33c166600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:41.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff341e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff33c1605d0 0x7ff33c06dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:41.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff341e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c0b1220 con 0x7ff33c1605d0 2024-09-17T05:33:41.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff341e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c0b0ee0 con 0x7ff33c0b1650 2024-09-17T05:33:41.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff341e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff33c0b13a0 con 0x7ff33c0aeb00 2024-09-17T05:33:41.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff33b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff33c1605d0 0x7ff33c06dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:41.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff33b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff33c1605d0 0x7ff33c06dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43692/0 (socket says 172.21.15.31:43692) 2024-09-17T05:33:41.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff33b400640 1 -- 172.21.15.31:0/2574573870 learned_addr learned my addr 172.21.15.31:0/2574573870 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:41.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff33aa00640 1 --2- 172.21.15.31:0/2574573870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff33c0aeb00 0x7ff33c165560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.934+0000 7ff332000640 1 --2- 172.21.15.31:0/2574573870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff33c0b1650 0x7ff33c166600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.938+0000 7ff33b400640 1 -- 172.21.15.31:0/2574573870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff33c0aeb00 msgr2=0x7ff33c165560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.938+0000 7ff33b400640 1 --2- 172.21.15.31:0/2574573870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff33c0aeb00 0x7ff33c165560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.938+0000 7ff33b400640 1 -- 172.21.15.31:0/2574573870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff33c0b1650 msgr2=0x7ff33c166600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.938+0000 7ff33b400640 1 --2- 172.21.15.31:0/2574573870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff33c0b1650 0x7ff33c166600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.938+0000 7ff33b400640 1 -- 172.21.15.31:0/2574573870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c0b6cc0 con 0x7ff33c1605d0 2024-09-17T05:33:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.938+0000 7ff33b400640 1 --2- 172.21.15.31:0/2574573870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff33c1605d0 0x7ff33c06dd30 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff33400dac0 tx=0x7ff33400df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.938+0000 7ff333e00640 1 -- 172.21.15.31:0/2574573870 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33400bdd0 con 0x7ff33c1605d0 2024-09-17T05:33:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.938+0000 7ff333e00640 1 -- 172.21.15.31:0/2574573870 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff334003980 con 0x7ff33c1605d0 2024-09-17T05:33:41.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.938+0000 7ff341e00640 1 -- 172.21.15.31:0/2574573870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33c0b6fa0 con 0x7ff33c1605d0 2024-09-17T05:33:41.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.938+0000 7ff333e00640 1 -- 172.21.15.31:0/2574573870 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff334003dd0 con 0x7ff33c1605d0 2024-09-17T05:33:41.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.938+0000 7ff341e00640 1 -- 172.21.15.31:0/2574573870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff33c0b7560 con 0x7ff33c1605d0 2024-09-17T05:33:41.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.938+0000 7ff341e00640 1 -- 172.21.15.31:0/2574573870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff33c0b1a30 con 0x7ff33c1605d0 2024-09-17T05:33:41.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.938+0000 7ff333e00640 1 -- 172.21.15.31:0/2574573870 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7ff334003f70 con 0x7ff33c1605d0 2024-09-17T05:33:41.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.938+0000 7ff333e00640 1 --2- 172.21.15.31:0/2574573870 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff318073320 0x7ff3180757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:41.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.942+0000 7ff333e00640 1 -- 172.21.15.31:0/2574573870 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7ff334094c70 con 0x7ff33c1605d0 2024-09-17T05:33:41.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.942+0000 7ff33aa00640 1 --2- 172.21.15.31:0/2574573870 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff318073320 0x7ff3180757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:41.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.942+0000 7ff33aa00640 1 --2- 172.21.15.31:0/2574573870 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff318073320 0x7ff3180757e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0af000 tx=0x7ff32c01b0e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:41.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:41.942+0000 7ff333e00640 1 -- 172.21.15.31:0/2574573870 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff334020030 con 0x7ff33c1605d0 2024-09-17T05:33:42.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.182+0000 7ff341e00640 1 -- 172.21.15.31:0/2574573870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff33c0d1080 con 0x7ff33c1605d0 2024-09-17T05:33:42.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.186+0000 7ff333e00640 1 -- 172.21.15.31:0/2574573870 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) ==== 190+0+147 (secure 0 0 0) 0x7ff334017030 con 0x7ff33c1605d0 2024-09-17T05:33:42.187 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-09-17T05:33:42.187 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw== 2024-09-17T05:33:42.187 INFO:teuthology.orchestra.run.smithi031.stdout: caps mds = "allow" 2024-09-17T05:33:42.187 INFO:teuthology.orchestra.run.smithi031.stdout: caps mon = "allow r" 2024-09-17T05:33:42.187 INFO:teuthology.orchestra.run.smithi031.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:33:42.187 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2024-09-17T05:33:42.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.186+0000 7ff341e00640 1 -- 172.21.15.31:0/2574573870 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff318073320 msgr2=0x7ff3180757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:42.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.186+0000 7ff341e00640 1 --2- 172.21.15.31:0/2574573870 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff318073320 0x7ff3180757e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0af000 tx=0x7ff32c01b0e0 comp rx=0 tx=0).stop 2024-09-17T05:33:42.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.186+0000 7ff341e00640 1 -- 172.21.15.31:0/2574573870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff33c1605d0 msgr2=0x7ff33c06dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:42.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.186+0000 7ff341e00640 1 --2- 172.21.15.31:0/2574573870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff33c1605d0 0x7ff33c06dd30 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff33400dac0 tx=0x7ff33400df80 comp rx=0 tx=0).stop 2024-09-17T05:33:42.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.186+0000 7ff341e00640 1 -- 172.21.15.31:0/2574573870 shutdown_connections 2024-09-17T05:33:42.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.186+0000 7ff341e00640 1 --2- 172.21.15.31:0/2574573870 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff318073320 0x7ff3180757e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:42.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.186+0000 7ff341e00640 1 --2- 172.21.15.31:0/2574573870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff33c1605d0 0x7ff33c06dd30 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:42.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.186+0000 7ff341e00640 1 --2- 172.21.15.31:0/2574573870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff33c0b1650 0x7ff33c166600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:42.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.186+0000 7ff341e00640 1 --2- 172.21.15.31:0/2574573870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff33c0aeb00 0x7ff33c165560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:42.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.186+0000 7ff341e00640 1 -- 172.21.15.31:0/2574573870 >> 172.21.15.31:0/2574573870 conn(0x7ff33c0d1dd0 msgr2=0x7ff33c0cc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:42.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.186+0000 7ff341e00640 1 -- 172.21.15.31:0/2574573870 shutdown_connections 2024-09-17T05:33:42.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.186+0000 7ff341e00640 1 -- 172.21.15.31:0/2574573870 wait complete. 2024-09-17T05:33:42.210 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:33:42.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.354+0000 7f30e7c00640 1 -- 172.21.15.31:0/4021377400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30e00d2060 msgr2=0x7f30e00cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.354+0000 7f30e7c00640 1 --2- 172.21.15.31:0/4021377400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30e00d2060 0x7f30e00cf660 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009900 tx=0x7f30d401d340 comp rx=0 tx=0).stop 2024-09-17T05:33:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.354+0000 7f30e7c00640 1 -- 172.21.15.31:0/4021377400 shutdown_connections 2024-09-17T05:33:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.354+0000 7f30e7c00640 1 --2- 172.21.15.31:0/4021377400 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30e00d2440 0x7f30e00d28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.354+0000 7f30e7c00640 1 --2- 172.21.15.31:0/4021377400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30e00d2060 0x7f30e00cf660 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.354+0000 7f30e7c00640 1 -- 172.21.15.31:0/4021377400 >> 172.21.15.31:0/4021377400 conn(0x7f30e00d3fe0 msgr2=0x7f30e00d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.354+0000 7f30e7c00640 1 -- 172.21.15.31:0/4021377400 shutdown_connections 2024-09-17T05:33:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.354+0000 7f30e7c00640 1 -- 172.21.15.31:0/4021377400 wait complete. 2024-09-17T05:33:42.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e7c00640 1 Processor -- start 2024-09-17T05:33:42.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e7c00640 1 -- start start 2024-09-17T05:33:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e7c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30e00d09f0 0x7f30e0159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e7c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30e00d2060 0x7f30e00cde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e7c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30e00d2440 0x7f30e014a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e7c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f30e016ba40 con 0x7f30e00d09f0 2024-09-17T05:33:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e7c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f30e016b8c0 con 0x7f30e00d2060 2024-09-17T05:33:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e7c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f30e016bbc0 con 0x7f30e00d2440 2024-09-17T05:33:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e5200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30e00d09f0 0x7f30e0159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e5200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30e00d09f0 0x7f30e0159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43710/0 (socket says 172.21.15.31:43710) 2024-09-17T05:33:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e5200640 1 -- 172.21.15.31:0/4235704756 learned_addr learned my addr 172.21.15.31:0/4235704756 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30dfe00640 1 --2- 172.21.15.31:0/4235704756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30e00d2060 0x7f30e00cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e5c00640 1 --2- 172.21.15.31:0/4235704756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30e00d2440 0x7f30e014a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e5200640 1 -- 172.21.15.31:0/4235704756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30e00d2440 msgr2=0x7f30e014a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e5200640 1 --2- 172.21.15.31:0/4235704756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30e00d2440 0x7f30e014a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e5200640 1 -- 172.21.15.31:0/4235704756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30e00d2060 msgr2=0x7f30e00cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e5200640 1 --2- 172.21.15.31:0/4235704756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30e00d2060 0x7f30e00cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e5200640 1 -- 172.21.15.31:0/4235704756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e0158ee0 con 0x7f30e00d09f0 2024-09-17T05:33:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e5c00640 1 --2- 172.21.15.31:0/4235704756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30e00d2440 0x7f30e014a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:33:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e5200640 1 --2- 172.21.15.31:0/4235704756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30e00d09f0 0x7f30e0159780 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f30d40b0040 tx=0x7f30d4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30dcc00640 1 -- 172.21.15.31:0/4235704756 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d40b2040 con 0x7f30e00d09f0 2024-09-17T05:33:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30dcc00640 1 -- 172.21.15.31:0/4235704756 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30d4003600 con 0x7f30e00d09f0 2024-09-17T05:33:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30dcc00640 1 -- 172.21.15.31:0/4235704756 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d4003a50 con 0x7f30e00d09f0 2024-09-17T05:33:42.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e7c00640 1 -- 172.21.15.31:0/4235704756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e01591c0 con 0x7f30e00d09f0 2024-09-17T05:33:42.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.358+0000 7f30e7c00640 1 -- 172.21.15.31:0/4235704756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e015d0c0 con 0x7f30e00d09f0 2024-09-17T05:33:42.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.362+0000 7f30e7c00640 1 -- 172.21.15.31:0/4235704756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e00cf660 con 0x7f30e00d09f0 2024-09-17T05:33:42.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.362+0000 7f30dcc00640 1 -- 172.21.15.31:0/4235704756 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f30d40bf060 con 0x7f30e00d09f0 2024-09-17T05:33:42.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.362+0000 7f30dcc00640 1 --2- 172.21.15.31:0/4235704756 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f30c0073320 0x7f30c00757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:42.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.362+0000 7f30dcc00640 1 -- 172.21.15.31:0/4235704756 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7f30d412e0f0 con 0x7f30e00d09f0 2024-09-17T05:33:42.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.362+0000 7f30dfe00640 1 --2- 172.21.15.31:0/4235704756 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f30c0073320 0x7f30c00757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:42.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.362+0000 7f30dfe00640 1 --2- 172.21.15.31:0/4235704756 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f30c0073320 0x7f30c00757e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f30cc005fd0 tx=0x7f30cc005d10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:42.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.366+0000 7f30dcc00640 1 -- 172.21.15.31:0/4235704756 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f30d40164d0 con 0x7f30e00d09f0 2024-09-17T05:33:42.399 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:33:42.403 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:33:42.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.578+0000 7f30e7c00640 1 -- 172.21.15.31:0/4235704756 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30e00d07d0 con 0x7f30e00d09f0 2024-09-17T05:33:42.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.578+0000 7f30dcc00640 1 -- 172.21.15.31:0/4235704756 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5228 (secure 0 0 0) 0x7f30d40f8ee0 con 0x7f30e00d09f0 2024-09-17T05:33:42.580 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:42.580 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":71,"btime":"2024-09-17T05:33:40:199932+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3921984787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3921984787},{"type":"v1","addr":"172.21.15.155:6809","nonce":3921984787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3122851843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3122851843},{"type":"v1","addr":"172.21.15.155:6835","nonce":3122851843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6936,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/706788626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":706788626},{"type":"v1","addr":"172.21.15.31:6834","nonce":706788626}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:33:36.585711+0000","modified":"2024-09-17T05:33:39.610967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4072380267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":4072380267},{"type":"v1","addr":"172.21.15.31:6835","nonce":4072380267}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6939,"qdb_cluster":[6939]},"id":8}]} 2024-09-17T05:33:42.580 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 71 2024-09-17T05:33:42.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.582+0000 7f30e7c00640 1 -- 172.21.15.31:0/4235704756 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f30c0073320 msgr2=0x7f30c00757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:42.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.582+0000 7f30e7c00640 1 --2- 172.21.15.31:0/4235704756 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f30c0073320 0x7f30c00757e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f30cc005fd0 tx=0x7f30cc005d10 comp rx=0 tx=0).stop 2024-09-17T05:33:42.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.582+0000 7f30e7c00640 1 -- 172.21.15.31:0/4235704756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30e00d09f0 msgr2=0x7f30e0159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:42.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.582+0000 7f30e7c00640 1 --2- 172.21.15.31:0/4235704756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30e00d09f0 0x7f30e0159780 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f30d40b0040 tx=0x7f30d4004040 comp rx=0 tx=0).stop 2024-09-17T05:33:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.582+0000 7f30e7c00640 1 -- 172.21.15.31:0/4235704756 shutdown_connections 2024-09-17T05:33:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.582+0000 7f30e7c00640 1 --2- 172.21.15.31:0/4235704756 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f30c0073320 0x7f30c00757e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.582+0000 7f30e7c00640 1 --2- 172.21.15.31:0/4235704756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30e00d2440 0x7f30e014a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.582+0000 7f30e7c00640 1 --2- 172.21.15.31:0/4235704756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30e00d2060 0x7f30e00cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.582+0000 7f30e7c00640 1 --2- 172.21.15.31:0/4235704756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30e00d09f0 0x7f30e0159780 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.582+0000 7f30e7c00640 1 -- 172.21.15.31:0/4235704756 >> 172.21.15.31:0/4235704756 conn(0x7f30e00d3fe0 msgr2=0x7f30e006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.582+0000 7f30e7c00640 1 -- 172.21.15.31:0/4235704756 shutdown_connections 2024-09-17T05:33:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:42.582+0000 7f30e7c00640 1 -- 172.21.15.31:0/4235704756 wait complete. 2024-09-17T05:33:43.004 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:33:36.585711+0000', 'modified': '2024-09-17T05:33:39.610967+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6939}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6939': {'gid': 6939, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/4072380267', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6833', 'nonce': 4072380267}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 4072380267}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6939, 'qdb_cluster': [6939]} 2024-09-17T05:33:43.005 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:33:43.005 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T05:33:43.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.154+0000 7f7cfee00640 1 -- 172.21.15.31:0/1312632884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf8068960 msgr2=0x7f7cf80cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:43.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.154+0000 7f7cfee00640 1 --2- 172.21.15.31:0/1312632884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf8068960 0x7f7cf80cca70 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8073c40 tx=0x7f7ce401c8c0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.154+0000 7f7cfee00640 1 -- 172.21.15.31:0/1312632884 shutdown_connections 2024-09-17T05:33:43.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.154+0000 7f7cfee00640 1 --2- 172.21.15.31:0/1312632884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cf8068d40 0x7f7cf80ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.154+0000 7f7cfee00640 1 --2- 172.21.15.31:0/1312632884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf8068960 0x7f7cf80cca70 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.154+0000 7f7cfee00640 1 --2- 172.21.15.31:0/1312632884 >> v2:172.21.15.155:3300/0 conn(0x7f7cf815a240 0x7f7cf815e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.154+0000 7f7cfee00640 1 -- 172.21.15.31:0/1312632884 >> 172.21.15.31:0/1312632884 conn(0x7f7cf8073490 msgr2=0x7f7cf80d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:43.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.154+0000 7f7cfee00640 1 -- 172.21.15.31:0/1312632884 shutdown_connections 2024-09-17T05:33:43.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.154+0000 7f7cfee00640 1 -- 172.21.15.31:0/1312632884 wait complete. 2024-09-17T05:33:43.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.154+0000 7f7cfee00640 1 Processor -- start 2024-09-17T05:33:43.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfee00640 1 -- start start 2024-09-17T05:33:43.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfee00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cf8068960 0x7f7cf8155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfee00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf8068d40 0x7f7cf815b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfee00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cf815a240 0x7f7cf815cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfee00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf8074ee0 con 0x7f7cf8068d40 2024-09-17T05:33:43.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfee00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf8074d60 con 0x7f7cf815a240 2024-09-17T05:33:43.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfee00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf8075060 con 0x7f7cf8068960 2024-09-17T05:33:43.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfd000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf8068d40 0x7f7cf815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfd000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf8068d40 0x7f7cf815b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43736/0 (socket says 172.21.15.31:43736) 2024-09-17T05:33:43.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfd000640 1 -- 172.21.15.31:0/1562090411 learned_addr learned my addr 172.21.15.31:0/1562090411 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:43.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfda00640 1 --2- 172.21.15.31:0/1562090411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cf8068960 0x7f7cf8155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfe400640 1 --2- 172.21.15.31:0/1562090411 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cf815a240 0x7f7cf815cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfd000640 1 -- 172.21.15.31:0/1562090411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cf8068960 msgr2=0x7f7cf8155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:43.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfd000640 1 --2- 172.21.15.31:0/1562090411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cf8068960 0x7f7cf8155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfd000640 1 -- 172.21.15.31:0/1562090411 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cf815a240 msgr2=0x7f7cf815cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:43.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfd000640 1 --2- 172.21.15.31:0/1562090411 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cf815a240 0x7f7cf815cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfd000640 1 -- 172.21.15.31:0/1562090411 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf80b5500 con 0x7f7cf8068d40 2024-09-17T05:33:43.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfd000640 1 --2- 172.21.15.31:0/1562090411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf8068d40 0x7f7cf815b090 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009850 tx=0x7f7ce40a55c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:43.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cf5600640 1 -- 172.21.15.31:0/1562090411 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce40bb070 con 0x7f7cf8068d40 2024-09-17T05:33:43.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cf5600640 1 -- 172.21.15.31:0/1562090411 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ce4004470 con 0x7f7cf8068d40 2024-09-17T05:33:43.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cf5600640 1 -- 172.21.15.31:0/1562090411 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce40b2040 con 0x7f7cf8068d40 2024-09-17T05:33:43.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfee00640 1 -- 172.21.15.31:0/1562090411 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf80b57e0 con 0x7f7cf8068d40 2024-09-17T05:33:43.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.158+0000 7f7cfee00640 1 -- 172.21.15.31:0/1562090411 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf80b5da0 con 0x7f7cf8068d40 2024-09-17T05:33:43.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7cf5600640 1 -- 172.21.15.31:0/1562090411 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f7ce40052d0 con 0x7f7cf8068d40 2024-09-17T05:33:43.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7cf5600640 1 --2- 172.21.15.31:0/1562090411 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7cd8073350 0x7f7cd8075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7d03844000 1 Processor -- start 2024-09-17T05:33:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7cf5600640 1 -- 172.21.15.31:0/1562090411 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7f7ce412dcc0 con 0x7f7cf8068d40 2024-09-17T05:33:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7d03844000 1 -- start start 2024-09-17T05:33:43.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7cfda00640 1 --2- 172.21.15.31:0/1562090411 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7cd8073350 0x7f7cd8075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7cfda00640 1 --2- 172.21.15.31:0/1562090411 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7cd8073350 0x7f7cd8075810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7cf815d9f0 tx=0x7f7cec00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7d03844000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375a9d0 0x55a1c375adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7d03844000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c375b2f0 0x55a1c370e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7d03844000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c370ee10 0x55a1c370f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7d03844000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a1c362f3f0 con 0x55a1c375a9d0 2024-09-17T05:33:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7d03844000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a1c356cb20 con 0x55a1c370ee10 2024-09-17T05:33:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7d03844000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55a1c355bf50 con 0x55a1c375b2f0 2024-09-17T05:33:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7cfda00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375a9d0 0x55a1c375adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7cfe400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c370ee10 0x55a1c370f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7cfda00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375a9d0 0x55a1c375adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43738/0 (socket says 172.21.15.31:43738) 2024-09-17T05:33:43.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7cfda00640 1 -- 172.21.15.31:0/2062460825 learned_addr learned my addr 172.21.15.31:0/2062460825 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:43.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7cfd000640 1 --2- 172.21.15.31:0/2062460825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c375b2f0 0x55a1c370e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7cfda00640 1 -- 172.21.15.31:0/2062460825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c375b2f0 msgr2=0x55a1c370e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:33:43.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7cfda00640 1 --2- 172.21.15.31:0/2062460825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c375b2f0 0x55a1c370e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7cfda00640 1 -- 172.21.15.31:0/2062460825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c370ee10 msgr2=0x55a1c370f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:33:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7cfda00640 1 --2- 172.21.15.31:0/2062460825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c370ee10 0x55a1c370f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7cfda00640 1 -- 172.21.15.31:0/2062460825 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1c3523590 con 0x55a1c375a9d0 2024-09-17T05:33:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.162+0000 7f7cfda00640 1 --2- 172.21.15.31:0/2062460825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375a9d0 0x55a1c375adb0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f7cec010f50 tx=0x7f7cec013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e081bd1b4949333a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7cea000640 1 -- 172.21.15.31:0/2062460825 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec01e420 con 0x55a1c375a9d0 2024-09-17T05:33:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7cea000640 1 -- 172.21.15.31:0/2062460825 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7cec01e6b0 con 0x55a1c375a9d0 2024-09-17T05:33:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7cea000640 1 -- 172.21.15.31:0/2062460825 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec01ea80 con 0x55a1c375a9d0 2024-09-17T05:33:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 1 -- 172.21.15.31:0/2062460825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375a9d0 msgr2=0x55a1c375adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 1 --2- 172.21.15.31:0/2062460825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375a9d0 0x55a1c375adb0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f7cec010f50 tx=0x7f7cec013000 comp rx=0 tx=0).stop 2024-09-17T05:33:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 1 -- 172.21.15.31:0/2062460825 shutdown_connections 2024-09-17T05:33:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 1 --2- 172.21.15.31:0/2062460825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c370ee10 0x55a1c370f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 1 --2- 172.21.15.31:0/2062460825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c375b2f0 0x55a1c370e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 1 --2- 172.21.15.31:0/2062460825 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375a9d0 0x55a1c375adb0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 1 -- 172.21.15.31:0/2062460825 >> 172.21.15.31:0/2062460825 conn(0x55a1c35f8130 msgr2=0x55a1c373de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:43.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 1 -- 172.21.15.31:0/2062460825 shutdown_connections 2024-09-17T05:33:43.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 1 -- 172.21.15.31:0/2062460825 wait complete. 2024-09-17T05:33:43.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 1 -- start start 2024-09-17T05:33:43.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 1 Processor -- start 2024-09-17T05:33:43.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c370ee10 0x55a1c373b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375a9d0 0x55a1c373be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c375b2f0 0x55a1c373c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a1c34f65d0 con 0x55a1c375a9d0 2024-09-17T05:33:43.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a1c355fd60 con 0x55a1c375b2f0 2024-09-17T05:33:43.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55a1c3502500 con 0x55a1c370ee10 2024-09-17T05:33:43.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 10 client.0 _ll_register_callbacks cb 0x55a1c3506810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:33:43.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7cfd000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375a9d0 0x55a1c373be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7cfd000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375a9d0 0x55a1c373be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43746/0 (socket says 172.21.15.31:43746) 2024-09-17T05:33:43.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7cfd000640 1 -- 172.21.15.31:0/970762807 learned_addr learned my addr 172.21.15.31:0/970762807 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7cfda00640 1 --2- 172.21.15.31:0/970762807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c370ee10 0x55a1c373b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7cfe400640 1 --2- 172.21.15.31:0/970762807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c375b2f0 0x55a1c373c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7cfd000640 1 -- 172.21.15.31:0/970762807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c370ee10 msgr2=0x55a1c373b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:33:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7cfd000640 1 --2- 172.21.15.31:0/970762807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c370ee10 0x55a1c373b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7cfd000640 1 -- 172.21.15.31:0/970762807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c375b2f0 msgr2=0x55a1c373c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:33:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7cfd000640 1 --2- 172.21.15.31:0/970762807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c375b2f0 0x55a1c373c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7cfd000640 1 -- 172.21.15.31:0/970762807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1c34fa170 con 0x55a1c375a9d0 2024-09-17T05:33:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7cfd000640 1 --2- 172.21.15.31:0/970762807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375a9d0 0x55a1c373be70 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f7ce401cda0 tx=0x7f7ce40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70986e038c5d5340 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7cdea00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:33:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7cdea00640 1 -- 172.21.15.31:0/970762807 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4101ac0 con 0x55a1c375a9d0 2024-09-17T05:33:43.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7cdea00640 1 -- 172.21.15.31:0/970762807 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7f7ce40f76d0 con 0x55a1c375a9d0 2024-09-17T05:33:43.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.166+0000 7f7d03844000 1 -- 172.21.15.31:0/970762807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a1c34f40f0 con 0x55a1c375a9d0 2024-09-17T05:33:43.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7cdea00640 1 -- 172.21.15.31:0/970762807 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f7ce40fcea0 con 0x55a1c375a9d0 2024-09-17T05:33:43.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 10 client.7053 fetch_fsmap learned FSMap version 71 2024-09-17T05:33:43.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 1 -- 172.21.15.31:0/970762807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) -- 0x55a1c35e0ef0 con 0x55a1c375a9d0 2024-09-17T05:33:43.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7cdea00640 1 -- 172.21.15.31:0/970762807 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55a1c34f40f0 con 0x55a1c375a9d0 2024-09-17T05:33:43.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7cdea00640 1 -- 172.21.15.31:0/970762807 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 71) ==== 3502+0+0 (secure 0 0 0) 0x7f7ce40ff0a0 con 0x55a1c375a9d0 2024-09-17T05:33:43.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 10 client.7053 fetch_fsmap finished waiting for FSMap version 71 2024-09-17T05:33:43.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 10 client.7053 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:33:43.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 20 client.7053 populate_metadata read hostname 'smithi031' 2024-09-17T05:33:43.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 1 --2- 172.21.15.31:0/970762807 >> [v2:172.21.15.31:6833/4072380267,v1:172.21.15.31:6835/4072380267] conn(0x55a1c373d0f0 0x55a1c376cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 4 client.7053 mds_command: new command op to 6939 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:33:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 1 -- 172.21.15.31:0/970762807 --> [v2:172.21.15.31:6833/4072380267,v1:172.21.15.31:6835/4072380267] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1c356ea70 con 0x55a1c373d0f0 2024-09-17T05:33:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7cfda00640 1 --2- 172.21.15.31:0/970762807 >> [v2:172.21.15.31:6833/4072380267,v1:172.21.15.31:6835/4072380267] conn(0x55a1c373d0f0 0x55a1c376cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7cfda00640 1 --2- 172.21.15.31:0/970762807 >> [v2:172.21.15.31:6833/4072380267,v1:172.21.15.31:6835/4072380267] conn(0x55a1c373d0f0 0x55a1c376cc90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81db2f70b2a498c3 server_cookie=a24ed63442693ab5 in_seq=0 out_seq=0 2024-09-17T05:33:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7cdea00640 10 client.7053 ms_handle_connect on v2:172.21.15.31:6833/4072380267 2024-09-17T05:33:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7cdea00640 1 -- 172.21.15.31:0/970762807 <== mds.0 v2:172.21.15.31:6833/4072380267 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a1c356ea70 con 0x55a1c373d0f0 2024-09-17T05:33:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7cdea00640 10 client.7053 handle_command_reply: tid=0 2024-09-17T05:33:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 1 client.7053 shutdown 2024-09-17T05:33:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 1 -- 172.21.15.31:0/970762807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375a9d0 msgr2=0x55a1c373be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:43.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 1 --2- 172.21.15.31:0/970762807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375a9d0 0x55a1c373be70 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f7ce401cda0 tx=0x7f7ce40057f0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 1 -- 172.21.15.31:0/970762807 shutdown_connections 2024-09-17T05:33:43.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 1 --2- 172.21.15.31:0/970762807 >> [v2:172.21.15.31:6833/4072380267,v1:172.21.15.31:6835/4072380267] conn(0x55a1c373d0f0 0x55a1c376cc90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 1 --2- 172.21.15.31:0/970762807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c375b2f0 0x55a1c373c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 1 --2- 172.21.15.31:0/970762807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375a9d0 0x55a1c373be70 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7cdea00640 0 client.7053 ms_handle_reset on v2:172.21.15.31:6833/4072380267 2024-09-17T05:33:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 1 --2- 172.21.15.31:0/970762807 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c370ee10 0x55a1c373b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 1 -- 172.21.15.31:0/970762807 >> 172.21.15.31:0/970762807 conn(0x55a1c35f8130 msgr2=0x55a1c370dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 1 -- 172.21.15.31:0/970762807 shutdown_connections 2024-09-17T05:33:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 1 -- 172.21.15.31:0/970762807 wait complete. 2024-09-17T05:33:43.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.170+0000 7f7d03844000 20 client.7053 trim_cache size 0 max 16384 2024-09-17T05:33:43.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7d03844000 1 Processor -- start 2024-09-17T05:33:43.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7d03844000 1 -- start start 2024-09-17T05:33:43.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7d03844000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c370ee10 0x55a1c37ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7d03844000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c375a9d0 0x55a1c37cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7d03844000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375b2f0 0x55a1c37cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7d03844000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf8203db0 con 0x55a1c375b2f0 2024-09-17T05:33:43.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7d03844000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf8164930 con 0x55a1c370ee10 2024-09-17T05:33:43.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7d03844000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf8163c90 con 0x55a1c375a9d0 2024-09-17T05:33:43.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7cfe400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375b2f0 0x55a1c37cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7cfe400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375b2f0 0x55a1c37cd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43750/0 (socket says 172.21.15.31:43750) 2024-09-17T05:33:43.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7cfe400640 1 -- 172.21.15.31:0/4588398 learned_addr learned my addr 172.21.15.31:0/4588398 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:43.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7cfda00640 1 --2- 172.21.15.31:0/4588398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c370ee10 0x55a1c37ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7cfd000640 1 --2- 172.21.15.31:0/4588398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c375a9d0 0x55a1c37cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7cfe400640 1 -- 172.21.15.31:0/4588398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c375a9d0 msgr2=0x55a1c37cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:33:43.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7cfe400640 1 --2- 172.21.15.31:0/4588398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c375a9d0 0x55a1c37cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7cfe400640 1 -- 172.21.15.31:0/4588398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c370ee10 msgr2=0x55a1c37ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:33:43.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7cfe400640 1 --2- 172.21.15.31:0/4588398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c370ee10 0x55a1c37ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7cfe400640 1 -- 172.21.15.31:0/4588398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1c35b7d90 con 0x55a1c375b2f0 2024-09-17T05:33:43.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7cfe400640 1 --2- 172.21.15.31:0/4588398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375b2f0 0x55a1c37cd850 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00134e0 tx=0x7f7cf00138e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27dd107725545396 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:43.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7ce9600640 1 -- 172.21.15.31:0/4588398 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0004b30 con 0x55a1c375b2f0 2024-09-17T05:33:43.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7ce9600640 1 -- 172.21.15.31:0/4588398 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7cf0004cf0 con 0x55a1c375b2f0 2024-09-17T05:33:43.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.190+0000 7f7ce9600640 1 -- 172.21.15.31:0/4588398 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0005280 con 0x55a1c375b2f0 2024-09-17T05:33:43.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 -- 172.21.15.31:0/4588398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375b2f0 msgr2=0x55a1c37cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:43.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 --2- 172.21.15.31:0/4588398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375b2f0 0x55a1c37cd850 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00134e0 tx=0x7f7cf00138e0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 -- 172.21.15.31:0/4588398 shutdown_connections 2024-09-17T05:33:43.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 --2- 172.21.15.31:0/4588398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375b2f0 0x55a1c37cd850 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 --2- 172.21.15.31:0/4588398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c375a9d0 0x55a1c37cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 --2- 172.21.15.31:0/4588398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c370ee10 0x55a1c37ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 -- 172.21.15.31:0/4588398 >> 172.21.15.31:0/4588398 conn(0x55a1c35f8130 msgr2=0x55a1c3716ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:43.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 -- 172.21.15.31:0/4588398 shutdown_connections 2024-09-17T05:33:43.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 -- 172.21.15.31:0/4588398 wait complete. 2024-09-17T05:33:43.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 -- start start 2024-09-17T05:33:43.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 Processor -- start 2024-09-17T05:33:43.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c370ee10 0x55a1c37d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c375a9d0 0x55a1c37d1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375b2f0 0x55a1c37d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55a1c355fd60 con 0x55a1c375b2f0 2024-09-17T05:33:43.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf81642e0 con 0x55a1c375a9d0 2024-09-17T05:33:43.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55a1c34f65d0 con 0x55a1c370ee10 2024-09-17T05:33:43.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 10 client.0 _ll_register_callbacks cb 0x7f7ce40f4ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:33:43.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7cfe400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375b2f0 0x55a1c37d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7cfe400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375b2f0 0x55a1c37d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43764/0 (socket says 172.21.15.31:43764) 2024-09-17T05:33:43.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7cfe400640 1 -- 172.21.15.31:0/2466816930 learned_addr learned my addr 172.21.15.31:0/2466816930 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:43.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7cfd000640 1 --2- 172.21.15.31:0/2466816930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c375a9d0 0x55a1c37d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7cfda00640 1 --2- 172.21.15.31:0/2466816930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c370ee10 0x55a1c37d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7cfe400640 1 -- 172.21.15.31:0/2466816930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c370ee10 msgr2=0x55a1c37d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:33:43.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7cfe400640 1 --2- 172.21.15.31:0/2466816930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c370ee10 0x55a1c37d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7cfe400640 1 -- 172.21.15.31:0/2466816930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c375a9d0 msgr2=0x55a1c37d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:33:43.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7cfe400640 1 --2- 172.21.15.31:0/2466816930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c375a9d0 0x55a1c37d1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7cfe400640 1 -- 172.21.15.31:0/2466816930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1c3522a90 con 0x55a1c375b2f0 2024-09-17T05:33:43.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7cfd000640 1 --2- 172.21.15.31:0/2466816930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c375a9d0 0x55a1c37d1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:43.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7cfe400640 1 --2- 172.21.15.31:0/2466816930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375b2f0 0x55a1c37d1680 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x55a1c362dc60 tx=0x7f7cf0005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0458bd48aaaeaed server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:43.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7cdea00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:33:43.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7cdea00640 1 -- 172.21.15.31:0/2466816930 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0004b30 con 0x55a1c375b2f0 2024-09-17T05:33:43.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7cdea00640 1 -- 172.21.15.31:0/2466816930 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7f7cf0005650 con 0x55a1c375b2f0 2024-09-17T05:33:43.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 -- 172.21.15.31:0/2466816930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cf0004cf0 con 0x55a1c375b2f0 2024-09-17T05:33:43.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7cdea00640 1 -- 172.21.15.31:0/2466816930 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f7cf0009cc0 con 0x55a1c375b2f0 2024-09-17T05:33:43.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 10 client.7059 fetch_fsmap learned FSMap version 71 2024-09-17T05:33:43.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.194+0000 7f7d03844000 1 -- 172.21.15.31:0/2466816930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) -- 0x55a1c3501050 con 0x55a1c375b2f0 2024-09-17T05:33:43.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cdea00640 1 -- 172.21.15.31:0/2466816930 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7cf0004cf0 con 0x55a1c375b2f0 2024-09-17T05:33:43.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cdea00640 1 -- 172.21.15.31:0/2466816930 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 71) ==== 3502+0+0 (secure 0 0 0) 0x7f7cf0037080 con 0x55a1c375b2f0 2024-09-17T05:33:43.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7d03844000 10 client.7059 fetch_fsmap finished waiting for FSMap version 71 2024-09-17T05:33:43.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7d03844000 10 client.7059 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:33:43.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7d03844000 20 client.7059 populate_metadata read hostname 'smithi031' 2024-09-17T05:33:43.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7d03844000 1 --2- 172.21.15.31:0/2466816930 >> [v2:172.21.15.31:6833/4072380267,v1:172.21.15.31:6835/4072380267] conn(0x55a1c3770450 0x55a1c376f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7d03844000 4 client.7059 mds_command: new command op to 6939 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:33:43.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7d03844000 1 -- 172.21.15.31:0/2466816930 --> [v2:172.21.15.31:6833/4072380267,v1:172.21.15.31:6835/4072380267] -- command(tid 0: {"prefix": "status"}) -- 0x55a1c356a520 con 0x55a1c3770450 2024-09-17T05:33:43.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cfda00640 1 --2- 172.21.15.31:0/2466816930 >> [v2:172.21.15.31:6833/4072380267,v1:172.21.15.31:6835/4072380267] conn(0x55a1c3770450 0x55a1c376f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cfda00640 1 --2- 172.21.15.31:0/2466816930 >> [v2:172.21.15.31:6833/4072380267,v1:172.21.15.31:6835/4072380267] conn(0x55a1c3770450 0x55a1c376f510 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4b7e39f36a4df1c server_cookie=696d3e02e0512a41 in_seq=0 out_seq=0 2024-09-17T05:33:43.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cdea00640 10 client.7059 ms_handle_connect on v2:172.21.15.31:6833/4072380267 2024-09-17T05:33:43.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cdea00640 1 -- 172.21.15.31:0/2466816930 <== mds.0 v2:172.21.15.31:6833/4072380267 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55a1c356a520 con 0x55a1c3770450 2024-09-17T05:33:43.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cdea00640 10 client.7059 handle_command_reply: tid=0 2024-09-17T05:33:43.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7d03844000 1 client.7059 shutdown 2024-09-17T05:33:43.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7d03844000 1 -- 172.21.15.31:0/2466816930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375b2f0 msgr2=0x55a1c37d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:43.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7d03844000 1 --2- 172.21.15.31:0/2466816930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375b2f0 0x55a1c37d1680 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x55a1c362dc60 tx=0x7f7cf0005250 comp rx=0 tx=0).stop 2024-09-17T05:33:43.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7d03844000 1 -- 172.21.15.31:0/2466816930 shutdown_connections 2024-09-17T05:33:43.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7d03844000 1 --2- 172.21.15.31:0/2466816930 >> [v2:172.21.15.31:6833/4072380267,v1:172.21.15.31:6835/4072380267] conn(0x55a1c3770450 0x55a1c376f510 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7d03844000 1 --2- 172.21.15.31:0/2466816930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55a1c375b2f0 0x55a1c37d1680 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7d03844000 1 --2- 172.21.15.31:0/2466816930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1c375a9d0 0x55a1c37d1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7d03844000 1 --2- 172.21.15.31:0/2466816930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55a1c370ee10 0x55a1c37d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7d03844000 1 -- 172.21.15.31:0/2466816930 >> 172.21.15.31:0/2466816930 conn(0x55a1c35f8130 msgr2=0x55a1c37595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:43.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cdea00640 0 client.7059 ms_handle_reset on v2:172.21.15.31:6833/4072380267 2024-09-17T05:33:43.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7d03844000 1 -- 172.21.15.31:0/2466816930 shutdown_connections 2024-09-17T05:33:43.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7d03844000 1 -- 172.21.15.31:0/2466816930 wait complete. 2024-09-17T05:33:43.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7d03844000 20 client.7059 trim_cache size 0 max 16384 2024-09-17T05:33:43.205 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:33:43.205 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "b668cd1d-3036-4a29-9e5a-69d0df5776a8", 2024-09-17T05:33:43.205 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-17T05:33:43.205 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 6939, 2024-09-17T05:33:43.205 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-09-17T05:33:43.205 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-09-17T05:33:43.205 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-17T05:33:43.205 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 6.0210882789999998, 2024-09-17T05:33:43.205 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 71, 2024-09-17T05:33:43.205 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 100, 2024-09-17T05:33:43.206 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 100, 2024-09-17T05:33:43.206 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 10.461492038999999 2024-09-17T05:33:43.206 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:33:43.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cfee00640 1 -- 172.21.15.31:0/1562090411 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7cd8073350 msgr2=0x7f7cd8075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:43.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cfee00640 1 --2- 172.21.15.31:0/1562090411 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7cd8073350 0x7f7cd8075810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7cf815d9f0 tx=0x7f7cec00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cfee00640 1 -- 172.21.15.31:0/1562090411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf8068d40 msgr2=0x7f7cf815b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:43.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cfee00640 1 --2- 172.21.15.31:0/1562090411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf8068d40 0x7f7cf815b090 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009850 tx=0x7f7ce40a55c0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cfee00640 1 -- 172.21.15.31:0/1562090411 shutdown_connections 2024-09-17T05:33:43.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cfee00640 1 --2- 172.21.15.31:0/1562090411 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7cd8073350 0x7f7cd8075810 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cfee00640 1 --2- 172.21.15.31:0/1562090411 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cf815a240 0x7f7cf815cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cfee00640 1 --2- 172.21.15.31:0/1562090411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf8068d40 0x7f7cf815b090 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cfee00640 1 --2- 172.21.15.31:0/1562090411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cf8068960 0x7f7cf8155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cfee00640 1 -- 172.21.15.31:0/1562090411 >> 172.21.15.31:0/1562090411 conn(0x7f7cf8073490 msgr2=0x7f7cf8158410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:43.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cfee00640 1 -- 172.21.15.31:0/1562090411 shutdown_connections 2024-09-17T05:33:43.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.198+0000 7f7cfee00640 1 -- 172.21.15.31:0/1562090411 wait complete. 2024-09-17T05:33:43.221 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:33:43.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.366+0000 7f842a800640 1 -- 172.21.15.31:0/3445864518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8408004d50 msgr2=0x7f84080051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:43.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.366+0000 7f842a800640 1 --2- 172.21.15.31:0/3445864518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8408004d50 0x7f84080051d0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f841c009ee0 tx=0x7f841c01d5f0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.366+0000 7f8423e00640 1 -- 172.21.15.31:0/3445864518 reap_dead start 2024-09-17T05:33:43.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.366+0000 7f842a800640 1 -- 172.21.15.31:0/3445864518 shutdown_connections 2024-09-17T05:33:43.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.366+0000 7f842a800640 1 -- 172.21.15.31:0/3445864518 >> 172.21.15.31:0/3445864518 conn(0x7f84240d1d90 msgr2=0x7f84240d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:43.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.366+0000 7f842a800640 1 -- 172.21.15.31:0/3445864518 shutdown_connections 2024-09-17T05:33:43.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.366+0000 7f842a800640 1 -- 172.21.15.31:0/3445864518 wait complete. 2024-09-17T05:33:43.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.366+0000 7f842a800640 1 Processor -- start 2024-09-17T05:33:43.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.366+0000 7f842a800640 1 -- start start 2024-09-17T05:33:43.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f842a800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8408004d50 0x7f842415aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f842a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84240c57f0 0x7f84240c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f842a800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f842406f380 0x7f842406f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f842a800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8424164c80 con 0x7f84240c57f0 2024-09-17T05:33:43.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f842a800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f842415c180 con 0x7f8408004d50 2024-09-17T05:33:43.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f842a800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8424164e00 con 0x7f842406f380 2024-09-17T05:33:43.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f8422a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84240c57f0 0x7f84240c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f8422a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84240c57f0 0x7f84240c5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43772/0 (socket says 172.21.15.31:43772) 2024-09-17T05:33:43.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f8422a00640 1 -- 172.21.15.31:0/2259505706 learned_addr learned my addr 172.21.15.31:0/2259505706 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:43.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f8423400640 1 --2- 172.21.15.31:0/2259505706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8408004d50 0x7f842415aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f8423e00640 1 --2- 172.21.15.31:0/2259505706 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f842406f380 0x7f842406f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f8422a00640 1 -- 172.21.15.31:0/2259505706 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f842406f380 msgr2=0x7f842406f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:43.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f8422a00640 1 --2- 172.21.15.31:0/2259505706 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f842406f380 0x7f842406f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f8422a00640 1 -- 172.21.15.31:0/2259505706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8408004d50 msgr2=0x7f842415aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:43.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f8422a00640 1 --2- 172.21.15.31:0/2259505706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8408004d50 0x7f842415aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f8422a00640 1 -- 172.21.15.31:0/2259505706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84241f5900 con 0x7f84240c57f0 2024-09-17T05:33:43.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f8422a00640 1 --2- 172.21.15.31:0/2259505706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84240c57f0 0x7f84240c5c70 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f841000e600 tx=0x7f841000eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:43.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f841b400640 1 -- 172.21.15.31:0/2259505706 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410015020 con 0x7f84240c57f0 2024-09-17T05:33:43.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f841b400640 1 -- 172.21.15.31:0/2259505706 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f841000ca90 con 0x7f84240c57f0 2024-09-17T05:33:43.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f841b400640 1 -- 172.21.15.31:0/2259505706 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410011460 con 0x7f84240c57f0 2024-09-17T05:33:43.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f842a800640 1 -- 172.21.15.31:0/2259505706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842406e8a0 con 0x7f84240c57f0 2024-09-17T05:33:43.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f842a800640 1 -- 172.21.15.31:0/2259505706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84241f5be0 con 0x7f84240c57f0 2024-09-17T05:33:43.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.370+0000 7f842a800640 1 -- 172.21.15.31:0/2259505706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8424160120 con 0x7f84240c57f0 2024-09-17T05:33:43.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.374+0000 7f841b400640 1 -- 172.21.15.31:0/2259505706 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f8410018020 con 0x7f84240c57f0 2024-09-17T05:33:43.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.374+0000 7f841b400640 1 --2- 172.21.15.31:0/2259505706 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8404073350 0x7f8404075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:43.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.374+0000 7f841b400640 1 -- 172.21.15.31:0/2259505706 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5767+0+0 (secure 0 0 0) 0x7f8410094ad0 con 0x7f84240c57f0 2024-09-17T05:33:43.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.374+0000 7f8423400640 1 --2- 172.21.15.31:0/2259505706 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8404073350 0x7f8404075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:43.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.374+0000 7f8423400640 1 --2- 172.21.15.31:0/2259505706 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8404073350 0x7f8404075810 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8414000c10 tx=0x7f8414006b50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:43.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.378+0000 7f841b400640 1 -- 172.21.15.31:0/2259505706 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f841001f020 con 0x7f84240c57f0 2024-09-17T05:33:43.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.590+0000 7f842a800640 1 -- 172.21.15.31:0/2259505706 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8424070270 con 0x7f84240c57f0 2024-09-17T05:33:43.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.590+0000 7f841b400640 1 -- 172.21.15.31:0/2259505706 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v71) ==== 53+0+73 (secure 0 0 0) 0x7f841005f910 con 0x7f84240c57f0 2024-09-17T05:33:43.591 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:33:43.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.590+0000 7f842a800640 1 -- 172.21.15.31:0/2259505706 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8404073350 msgr2=0x7f8404075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:43.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.590+0000 7f842a800640 1 --2- 172.21.15.31:0/2259505706 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8404073350 0x7f8404075810 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8414000c10 tx=0x7f8414006b50 comp rx=0 tx=0).stop 2024-09-17T05:33:43.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.590+0000 7f842a800640 1 -- 172.21.15.31:0/2259505706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84240c57f0 msgr2=0x7f84240c5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:43.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.590+0000 7f842a800640 1 --2- 172.21.15.31:0/2259505706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84240c57f0 0x7f84240c5c70 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f841000e600 tx=0x7f841000eac0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.590+0000 7f842a800640 1 -- 172.21.15.31:0/2259505706 shutdown_connections 2024-09-17T05:33:43.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.590+0000 7f842a800640 1 --2- 172.21.15.31:0/2259505706 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8404073350 0x7f8404075810 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.590+0000 7f842a800640 1 --2- 172.21.15.31:0/2259505706 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f842406f380 0x7f842406f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.590+0000 7f842a800640 1 --2- 172.21.15.31:0/2259505706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84240c57f0 0x7f84240c5c70 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.590+0000 7f842a800640 1 --2- 172.21.15.31:0/2259505706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8408004d50 0x7f842415aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:43.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.590+0000 7f842a800640 1 -- 172.21.15.31:0/2259505706 >> 172.21.15.31:0/2259505706 conn(0x7f84240d1d90 msgr2=0x7f84240cf930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:43.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.590+0000 7f842a800640 1 -- 172.21.15.31:0/2259505706 shutdown_connections 2024-09-17T05:33:43.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43.590+0000 7f842a800640 1 -- 172.21.15.31:0/2259505706 wait complete. 2024-09-17T05:33:43.613 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:33:43.613 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:33:43.613 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-17T05:33:43.613 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:33:43.613 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:33:43.613 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:33:43.613 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:33:43.613 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:33:43.614 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:33:43.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:43.614 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-17T05:33:43.623 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:33:43.623 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:33:43.623 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:33:43.623 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:43.623 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-17T05:33:43.623 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:43.623 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:33:43.623 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:43.624 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-17T05:33:43.624 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:33:43.624 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:43.624 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-17T05:33:43.624 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:33:43.624 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:43.624 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-17T05:33:43.624 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:33:43.624 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42129sec preferred_lft 42129sec 2024-09-17T05:33:43.624 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-17T05:33:43.624 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:43.624 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:33:43.625 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:43.625 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-17T05:33:43.625 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:33:43.625 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:fe:f3:3e:aa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:43.625 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:33:43.625 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:43.625 INFO:teuthology.orchestra.run.smithi031.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:33:43.625 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:43.625 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:33:43.625 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:43.625 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:33:43.625 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:43.625 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:33:43.626 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:33:43.626 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:33:43.626 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:43.626 INFO:teuthology.orchestra.run.smithi031.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:33:43.626 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:33:43.626 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:33:43.626 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:43.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:43.627 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:33:43.691 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-17T05:33:43.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:43.694 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-17T05:33:43.751 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-17T05:33:43.751 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:33:43.751 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:33:43.751 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:33:43.751 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:33:43.751 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:33:43.752 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:33:43.752 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:33:43.752 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:33:43.752 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:33:43.752 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:33:43.752 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:33:43.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:33:43.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:33:43.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:43.889 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T05:33:43.900 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:33:43.900 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:33:43.900 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:33:43.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:43.900 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-09-17T05:33:43.961 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:33:43.961 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:33:44.014 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:33:44.014 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:33:44.014 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:33:44.069 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-17T05:33:44.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:44.069 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:33:44.158 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:33:44.159 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:33:44.173 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:33:44.173 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:33:44.173 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:33:44.174 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:33:44.174 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:33:44.178 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:33:44.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:44.178 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:33:44.199 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:33:44.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:33:44.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:33:44.307 INFO:teuthology.orchestra.run.smithi031.stdout:client6748 2024-09-17T05:33:44.307 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:33:44.307 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:44.316 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:33:44.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.502+0000 7fd39a800640 1 -- 172.21.15.31:0/1102340870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3940b11a0 msgr2=0x7fd394165670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:44.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.502+0000 7fd39a800640 1 --2- 172.21.15.31:0/1102340870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3940b11a0 0x7fd394165670 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009c80 tx=0x7fd38c01cda0 comp rx=0 tx=0).stop 2024-09-17T05:33:44.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.502+0000 7fd39a800640 1 -- 172.21.15.31:0/1102340870 shutdown_connections 2024-09-17T05:33:44.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.502+0000 7fd39a800640 1 --2- 172.21.15.31:0/1102340870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3940b11a0 0x7fd394165670 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:44.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.502+0000 7fd39a800640 1 --2- 172.21.15.31:0/1102340870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3940b0ce0 0x7fd3940b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:44.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.502+0000 7fd39a800640 1 -- 172.21.15.31:0/1102340870 >> 172.21.15.31:0/1102340870 conn(0x7fd39409aa10 msgr2=0x7fd39409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:44.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.502+0000 7fd39a800640 1 -- 172.21.15.31:0/1102340870 shutdown_connections 2024-09-17T05:33:44.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.502+0000 7fd39a800640 1 -- 172.21.15.31:0/1102340870 wait complete. 2024-09-17T05:33:44.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd39a800640 1 Processor -- start 2024-09-17T05:33:44.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd39a800640 1 -- start start 2024-09-17T05:33:44.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd39a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3940b0ce0 0x7fd39413f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:44.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd39a800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3940b11a0 0x7fd394157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:44.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd39a800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3940b4d80 0x7fd394157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:44.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd39a800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd394168a30 con 0x7fd3940b0ce0 2024-09-17T05:33:44.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd39a800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd3941688b0 con 0x7fd3940b4d80 2024-09-17T05:33:44.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd39a800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd394168bb0 con 0x7fd3940b11a0 2024-09-17T05:33:44.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd399400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3940b0ce0 0x7fd39413f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:44.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd399400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3940b0ce0 0x7fd39413f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43792/0 (socket says 172.21.15.31:43792) 2024-09-17T05:33:44.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd399400640 1 -- 172.21.15.31:0/3302155206 learned_addr learned my addr 172.21.15.31:0/3302155206 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:44.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd399e00640 1 --2- 172.21.15.31:0/3302155206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3940b4d80 0x7fd394157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:44.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd398a00640 1 --2- 172.21.15.31:0/3302155206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3940b11a0 0x7fd394157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:44.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd399400640 1 -- 172.21.15.31:0/3302155206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3940b11a0 msgr2=0x7fd394157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:44.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd399400640 1 --2- 172.21.15.31:0/3302155206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3940b11a0 0x7fd394157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:44.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd399400640 1 -- 172.21.15.31:0/3302155206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3940b4d80 msgr2=0x7fd394157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:44.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd399400640 1 --2- 172.21.15.31:0/3302155206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3940b4d80 0x7fd394157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:44.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd399400640 1 -- 172.21.15.31:0/3302155206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd394146940 con 0x7fd3940b0ce0 2024-09-17T05:33:44.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd399400640 1 --2- 172.21.15.31:0/3302155206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3940b0ce0 0x7fd39413f5f0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fd38800c3c0 tx=0x7fd38800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:44.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd391600640 1 -- 172.21.15.31:0/3302155206 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388017070 con 0x7fd3940b0ce0 2024-09-17T05:33:44.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd391600640 1 -- 172.21.15.31:0/3302155206 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3880053c0 con 0x7fd3940b0ce0 2024-09-17T05:33:44.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd391600640 1 -- 172.21.15.31:0/3302155206 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388003860 con 0x7fd3940b0ce0 2024-09-17T05:33:44.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd39a800640 1 -- 172.21.15.31:0/3302155206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3941fb190 con 0x7fd3940b0ce0 2024-09-17T05:33:44.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd39a800640 1 -- 172.21.15.31:0/3302155206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3941fb750 con 0x7fd3940b0ce0 2024-09-17T05:33:44.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.506+0000 7fd39a800640 1 -- 172.21.15.31:0/3302155206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3940b5160 con 0x7fd3940b0ce0 2024-09-17T05:33:44.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.510+0000 7fd391600640 1 -- 172.21.15.31:0/3302155206 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fd38801a070 con 0x7fd3940b0ce0 2024-09-17T05:33:44.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.510+0000 7fd391600640 1 --2- 172.21.15.31:0/3302155206 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd374073320 0x7fd3740757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:44.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.510+0000 7fd391600640 1 -- 172.21.15.31:0/3302155206 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7fd3880937a0 con 0x7fd3940b0ce0 2024-09-17T05:33:44.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.510+0000 7fd398a00640 1 --2- 172.21.15.31:0/3302155206 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd374073320 0x7fd3740757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:44.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.510+0000 7fd398a00640 1 --2- 172.21.15.31:0/3302155206 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd374073320 0x7fd3740757e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd394148df0 tx=0x7fd380005e30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:44.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.514+0000 7fd391600640 1 -- 172.21.15.31:0/3302155206 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd38805df00 con 0x7fd3940b0ce0 2024-09-17T05:33:44.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.726+0000 7fd39a800640 1 -- 172.21.15.31:0/3302155206 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd39415b7b0 con 0x7fd3940b0ce0 2024-09-17T05:33:44.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.726+0000 7fd391600640 1 -- 172.21.15.31:0/3302155206 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v71) ==== 53+0+73 (secure 0 0 0) 0x7fd388062930 con 0x7fd3940b0ce0 2024-09-17T05:33:44.729 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:33:44.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.730+0000 7fd39a800640 1 -- 172.21.15.31:0/3302155206 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd374073320 msgr2=0x7fd3740757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:44.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.730+0000 7fd39a800640 1 --2- 172.21.15.31:0/3302155206 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd374073320 0x7fd3740757e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd394148df0 tx=0x7fd380005e30 comp rx=0 tx=0).stop 2024-09-17T05:33:44.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.730+0000 7fd39a800640 1 -- 172.21.15.31:0/3302155206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3940b0ce0 msgr2=0x7fd39413f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:44.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.730+0000 7fd39a800640 1 --2- 172.21.15.31:0/3302155206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3940b0ce0 0x7fd39413f5f0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fd38800c3c0 tx=0x7fd38800c880 comp rx=0 tx=0).stop 2024-09-17T05:33:44.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.730+0000 7fd39a800640 1 -- 172.21.15.31:0/3302155206 shutdown_connections 2024-09-17T05:33:44.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.730+0000 7fd39a800640 1 --2- 172.21.15.31:0/3302155206 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd374073320 0x7fd3740757e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:44.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.730+0000 7fd39a800640 1 --2- 172.21.15.31:0/3302155206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3940b4d80 0x7fd394157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:44.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.730+0000 7fd39a800640 1 --2- 172.21.15.31:0/3302155206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3940b11a0 0x7fd394157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:44.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.730+0000 7fd39a800640 1 --2- 172.21.15.31:0/3302155206 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3940b0ce0 0x7fd39413f5f0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:44.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.730+0000 7fd39a800640 1 -- 172.21.15.31:0/3302155206 >> 172.21.15.31:0/3302155206 conn(0x7fd39409aa10 msgr2=0x7fd39415a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:44.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.730+0000 7fd39a800640 1 -- 172.21.15.31:0/3302155206 shutdown_connections 2024-09-17T05:33:44.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:44.730+0000 7fd39a800640 1 -- 172.21.15.31:0/3302155206 wait complete. 2024-09-17T05:33:44.750 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:33:44.750 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:33:44.750 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-09-17T05:33:44.751 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:33:44.751 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:33:44.751 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:33:44.751 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:33:44.751 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:33:44.751 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:33:44.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:44.751 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-09-17T05:33:44.761 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:33:44.761 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:33:44.761 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:33:44.761 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:44.761 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-17T05:33:44.761 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:44.761 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:33:44.762 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:44.762 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-09-17T05:33:44.762 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:33:44.762 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:44.762 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-09-17T05:33:44.762 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:33:44.762 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:44.762 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:33:44.762 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:44.762 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-17T05:33:44.762 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42131sec preferred_lft 42131sec 2024-09-17T05:33:44.762 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-09-17T05:33:44.762 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:44.762 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:33:44.763 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:84:cd:fc:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:44.763 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:33:44.763 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:44.763 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:33:44.763 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:33:44.763 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:33:44.763 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:44.763 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:33:44.763 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:44.763 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:33:44.763 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:33:44.763 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:33:44.763 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:44.764 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:33:44.764 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:33:44.764 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:33:44.764 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:33:44.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:44.765 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:33:44.831 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-17T05:33:44.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:44.834 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-09-17T05:33:44.890 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-09-17T05:33:44.890 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:33:44.891 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-17T05:33:44.891 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:33:44.891 INFO:teuthology.orchestra.run.smithi155.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-17T05:33:44.891 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:33:44.891 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:33:44.891 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:33:44.891 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:33:44.891 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:33:44.891 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:33:44.891 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:33:44.891 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:33:44.892 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:33:44.892 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:33:44.892 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:33:44.892 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:33:44.979 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:33:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:33:45.020 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:33:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:33:45.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:45.027 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-17T05:33:45.037 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:33:45.037 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:33:45.037 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:33:45.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:45.037 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-09-17T05:33:45.105 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:33:45.105 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:33:45.153 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:33:45.153 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:33:45.153 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:33:45.205 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-17T05:33:45.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:45.205 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:33:45.294 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:33:45.294 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:33:45.306 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:33:45.306 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:33:45.307 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:33:45.307 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:33:45.307 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:33:45.310 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:33:45.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:45.311 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:33:45.329 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:33:45.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:33:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:33:45.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:33:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:33:45.433 INFO:teuthology.orchestra.run.smithi155.stdout:client7074 2024-09-17T05:33:45.433 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:33:45.434 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:45.442 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:33:45.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.594+0000 7fe593000640 1 -- 172.21.15.31:0/347423457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe58c15c1f0 msgr2=0x7fe58c0cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:45.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.594+0000 7fe593000640 1 --2- 172.21.15.31:0/347423457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe58c15c1f0 0x7fe58c0cec40 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fe58c073e00 tx=0x7fe57401c8c0 comp rx=0 tx=0).stop 2024-09-17T05:33:45.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.594+0000 7fe593000640 1 -- 172.21.15.31:0/347423457 shutdown_connections 2024-09-17T05:33:45.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.594+0000 7fe593000640 1 --2- 172.21.15.31:0/347423457 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe58c0b0b60 0x7fe58c0cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:45.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.594+0000 7fe593000640 1 --2- 172.21.15.31:0/347423457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe58c15c1f0 0x7fe58c0cec40 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:45.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.594+0000 7fe593000640 1 --2- 172.21.15.31:0/347423457 >> v2:172.21.15.155:3300/0 conn(0x7fe58c15be10 0x7fe58c0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:45.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.594+0000 7fe593000640 1 -- 172.21.15.31:0/347423457 >> 172.21.15.31:0/347423457 conn(0x7fe58c0d1da0 msgr2=0x7fe58c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:45.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.594+0000 7fe593000640 1 -- 172.21.15.31:0/347423457 shutdown_connections 2024-09-17T05:33:45.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.594+0000 7fe593000640 1 -- 172.21.15.31:0/347423457 wait complete. 2024-09-17T05:33:45.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.594+0000 7fe593000640 1 Processor -- start 2024-09-17T05:33:45.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.594+0000 7fe593000640 1 -- start start 2024-09-17T05:33:45.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe593000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe58c0b0b60 0x7fe58c155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:45.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe593000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe58c15be10 0x7fe58c156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:45.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe593000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe58c15c1f0 0x7fe58c06ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:45.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe593000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe58c0ccf60 con 0x7fe58c15c1f0 2024-09-17T05:33:45.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe593000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe58c0ccde0 con 0x7fe58c0b0b60 2024-09-17T05:33:45.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe593000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe58c0cd0e0 con 0x7fe58c15be10 2024-09-17T05:33:45.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe58be00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe58c0b0b60 0x7fe58c155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:45.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe591000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe58c15c1f0 0x7fe58c06ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:45.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe58be00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe58c0b0b60 0x7fe58c155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:53880/0 (socket says 172.21.15.31:53880) 2024-09-17T05:33:45.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe58be00640 1 -- 172.21.15.31:0/3550620760 learned_addr learned my addr 172.21.15.31:0/3550620760 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:45.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe591000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe58c15c1f0 0x7fe58c06ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43822/0 (socket says 172.21.15.31:43822) 2024-09-17T05:33:45.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe583e00640 1 --2- 172.21.15.31:0/3550620760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe58c15be10 0x7fe58c156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:45.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe591000640 1 -- 172.21.15.31:0/3550620760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe58c15be10 msgr2=0x7fe58c156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:45.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe591000640 1 --2- 172.21.15.31:0/3550620760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe58c15be10 0x7fe58c156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:45.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe591000640 1 -- 172.21.15.31:0/3550620760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe58c0b0b60 msgr2=0x7fe58c155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:45.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe591000640 1 --2- 172.21.15.31:0/3550620760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe58c0b0b60 0x7fe58c155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:45.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe591000640 1 -- 172.21.15.31:0/3550620760 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58c0b6f90 con 0x7fe58c15c1f0 2024-09-17T05:33:45.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe591000640 1 --2- 172.21.15.31:0/3550620760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe58c15c1f0 0x7fe58c06ed80 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fe58400e9c0 tx=0x7fe58400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:45.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe588c00640 1 -- 172.21.15.31:0/3550620760 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe584004d30 con 0x7fe58c15c1f0 2024-09-17T05:33:45.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe588c00640 1 -- 172.21.15.31:0/3550620760 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe58400cb20 con 0x7fe58c15c1f0 2024-09-17T05:33:45.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe593000640 1 -- 172.21.15.31:0/3550620760 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe58c0b69d0 con 0x7fe58c15c1f0 2024-09-17T05:33:45.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe588c00640 1 -- 172.21.15.31:0/3550620760 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe584005020 con 0x7fe58c15c1f0 2024-09-17T05:33:45.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe593000640 1 -- 172.21.15.31:0/3550620760 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe58c0c59e0 con 0x7fe58c15c1f0 2024-09-17T05:33:45.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.598+0000 7fe593000640 1 -- 172.21.15.31:0/3550620760 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe58c0cd590 con 0x7fe58c15c1f0 2024-09-17T05:33:45.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.602+0000 7fe588c00640 1 -- 172.21.15.31:0/3550620760 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fe5840051c0 con 0x7fe58c15c1f0 2024-09-17T05:33:45.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.602+0000 7fe588c00640 1 --2- 172.21.15.31:0/3550620760 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe568073320 0x7fe5680757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:45.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.602+0000 7fe588c00640 1 -- 172.21.15.31:0/3550620760 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7fe584094d00 con 0x7fe58c15c1f0 2024-09-17T05:33:45.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.602+0000 7fe58be00640 1 --2- 172.21.15.31:0/3550620760 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe568073320 0x7fe5680757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:45.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.602+0000 7fe58be00640 1 --2- 172.21.15.31:0/3550620760 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe568073320 0x7fe5680757e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe57c004610 tx=0x7fe57c00b440 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:45.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.606+0000 7fe588c00640 1 -- 172.21.15.31:0/3550620760 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe584016030 con 0x7fe58c15c1f0 2024-09-17T05:33:45.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:45.818+0000 7fe593000640 1 -- 172.21.15.31:0/3550620760 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fe58c070350 con 0x7fe58c15c1f0 2024-09-17T05:33:46.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.226+0000 7fe588c00640 1 -- 172.21.15.31:0/3550620760 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v72) ==== 136+0+0 (secure 0 0 0) 0x7fe58405f470 con 0x7fe58c15c1f0 2024-09-17T05:33:46.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.230+0000 7fe593000640 1 -- 172.21.15.31:0/3550620760 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe568073320 msgr2=0x7fe5680757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:46.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.230+0000 7fe593000640 1 --2- 172.21.15.31:0/3550620760 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe568073320 0x7fe5680757e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe57c004610 tx=0x7fe57c00b440 comp rx=0 tx=0).stop 2024-09-17T05:33:46.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.230+0000 7fe593000640 1 -- 172.21.15.31:0/3550620760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe58c15c1f0 msgr2=0x7fe58c06ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:46.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.230+0000 7fe593000640 1 --2- 172.21.15.31:0/3550620760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe58c15c1f0 0x7fe58c06ed80 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fe58400e9c0 tx=0x7fe58400edc0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.230+0000 7fe593000640 1 -- 172.21.15.31:0/3550620760 shutdown_connections 2024-09-17T05:33:46.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.230+0000 7fe593000640 1 --2- 172.21.15.31:0/3550620760 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe568073320 0x7fe5680757e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.230+0000 7fe593000640 1 --2- 172.21.15.31:0/3550620760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe58c15c1f0 0x7fe58c06ed80 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.230+0000 7fe593000640 1 --2- 172.21.15.31:0/3550620760 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe58c15be10 0x7fe58c156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.230+0000 7fe593000640 1 --2- 172.21.15.31:0/3550620760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe58c0b0b60 0x7fe58c155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.230+0000 7fe593000640 1 -- 172.21.15.31:0/3550620760 >> 172.21.15.31:0/3550620760 conn(0x7fe58c0d1da0 msgr2=0x7fe58c071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:46.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.230+0000 7fe593000640 1 -- 172.21.15.31:0/3550620760 shutdown_connections 2024-09-17T05:33:46.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.230+0000 7fe593000640 1 -- 172.21.15.31:0/3550620760 wait complete. 2024-09-17T05:33:46.254 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:33:46.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.402+0000 7fc1ef600640 1 -- 172.21.15.31:0/2829410096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1d0003c40 msgr2=0x7fc1d0004040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:46.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.402+0000 7fc1ef600640 1 --2- 172.21.15.31:0/2829410096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1d0003c40 0x7fc1d0004040 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc006f80 tx=0x7fc1dc01cf00 comp rx=0 tx=0).stop 2024-09-17T05:33:46.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.402+0000 7fc1ef600640 1 -- 172.21.15.31:0/2829410096 shutdown_connections 2024-09-17T05:33:46.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.402+0000 7fc1ef600640 1 --2- 172.21.15.31:0/2829410096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1d0003c40 0x7fc1d0004040 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.402+0000 7fc1ef600640 1 -- 172.21.15.31:0/2829410096 >> 172.21.15.31:0/2829410096 conn(0x7fc1e80b2240 msgr2=0x7fc1e80b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:46.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.402+0000 7fc1ef600640 1 -- 172.21.15.31:0/2829410096 shutdown_connections 2024-09-17T05:33:46.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.402+0000 7fc1ef600640 1 -- 172.21.15.31:0/2829410096 wait complete. 2024-09-17T05:33:46.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.402+0000 7fc1ef600640 1 Processor -- start 2024-09-17T05:33:46.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.402+0000 7fc1ef600640 1 -- start start 2024-09-17T05:33:46.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1ef600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0003c40 0x7fc1e814bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:46.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1ef600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1e81e7b30 0x7fc1e81f8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:46.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1ef600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e814c110 0x7fc1e80b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:46.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1ef600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e806d5b0 con 0x7fc1e81e7b30 2024-09-17T05:33:46.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1ef600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e806d430 con 0x7fc1e814c110 2024-09-17T05:33:46.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1ef600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e806d730 con 0x7fc1d0003c40 2024-09-17T05:33:46.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1e7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1e81e7b30 0x7fc1e81f8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:46.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1e7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1e81e7b30 0x7fc1e81f8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43846/0 (socket says 172.21.15.31:43846) 2024-09-17T05:33:46.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1e7e00640 1 -- 172.21.15.31:0/2453921048 learned_addr learned my addr 172.21.15.31:0/2453921048 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:46.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1ecc00640 1 --2- 172.21.15.31:0/2453921048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0003c40 0x7fc1e814bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:46.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1ed600640 1 --2- 172.21.15.31:0/2453921048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e814c110 0x7fc1e80b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:46.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1e7e00640 1 -- 172.21.15.31:0/2453921048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0003c40 msgr2=0x7fc1e814bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:46.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1e7e00640 1 --2- 172.21.15.31:0/2453921048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0003c40 0x7fc1e814bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1e7e00640 1 -- 172.21.15.31:0/2453921048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e814c110 msgr2=0x7fc1e80b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:46.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1e7e00640 1 --2- 172.21.15.31:0/2453921048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e814c110 0x7fc1e80b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1e7e00640 1 -- 172.21.15.31:0/2453921048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e81fbc40 con 0x7fc1e81e7b30 2024-09-17T05:33:46.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1e7e00640 1 --2- 172.21.15.31:0/2453921048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1e81e7b30 0x7fc1e81f8f00 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40066b0 tx=0x7fc1d4001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:46.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1e4c00640 1 -- 172.21.15.31:0/2453921048 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4011640 con 0x7fc1e81e7b30 2024-09-17T05:33:46.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1e4c00640 1 -- 172.21.15.31:0/2453921048 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1d4016020 con 0x7fc1e81e7b30 2024-09-17T05:33:46.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1e4c00640 1 -- 172.21.15.31:0/2453921048 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4011a80 con 0x7fc1e81e7b30 2024-09-17T05:33:46.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1ef600640 1 -- 172.21.15.31:0/2453921048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e81fbf20 con 0x7fc1e81e7b30 2024-09-17T05:33:46.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1ef600640 1 -- 172.21.15.31:0/2453921048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e81fc4e0 con 0x7fc1e81e7b30 2024-09-17T05:33:46.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1ef600640 1 -- 172.21.15.31:0/2453921048 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e8068a80 con 0x7fc1e81e7b30 2024-09-17T05:33:46.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.406+0000 7fc1e4c00640 1 -- 172.21.15.31:0/2453921048 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7fc1d4011c20 con 0x7fc1e81e7b30 2024-09-17T05:33:46.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.410+0000 7fc1e4c00640 1 --2- 172.21.15.31:0/2453921048 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc1c8073320 0x7fc1c80757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:46.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.410+0000 7fc1e4c00640 1 -- 172.21.15.31:0/2453921048 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7fc1d4094fb0 con 0x7fc1e81e7b30 2024-09-17T05:33:46.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.410+0000 7fc1ecc00640 1 --2- 172.21.15.31:0/2453921048 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc1c8073320 0x7fc1c80757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:46.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.410+0000 7fc1ecc00640 1 --2- 172.21.15.31:0/2453921048 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc1c8073320 0x7fc1c80757e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0ab000 tx=0x7fc1dc019d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:46.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.414+0000 7fc1e4c00640 1 -- 172.21.15.31:0/2453921048 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc1d4020020 con 0x7fc1e81e7b30 2024-09-17T05:33:46.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.610+0000 7fc1ef600640 1 -- 172.21.15.31:0/2453921048 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fc1e81f9440 con 0x7fc1c8073320 2024-09-17T05:33:46.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.610+0000 7fc1e4c00640 1 -- 172.21.15.31:0/2453921048 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fc1dc006ba0 con 0x7fc1c8073320 2024-09-17T05:33:46.612 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:33:46.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:46.612 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephfs" 2024-09-17T05:33:46.612 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:46.612 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:33:46.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.610+0000 7fc1ef600640 1 -- 172.21.15.31:0/2453921048 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc1c8073320 msgr2=0x7fc1c80757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:46.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.610+0000 7fc1ef600640 1 --2- 172.21.15.31:0/2453921048 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc1c8073320 0x7fc1c80757e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0ab000 tx=0x7fc1dc019d40 comp rx=0 tx=0).stop 2024-09-17T05:33:46.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.610+0000 7fc1ef600640 1 -- 172.21.15.31:0/2453921048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1e81e7b30 msgr2=0x7fc1e81f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:46.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.610+0000 7fc1ef600640 1 --2- 172.21.15.31:0/2453921048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1e81e7b30 0x7fc1e81f8f00 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40066b0 tx=0x7fc1d4001800 comp rx=0 tx=0).stop 2024-09-17T05:33:46.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.610+0000 7fc1ef600640 1 -- 172.21.15.31:0/2453921048 shutdown_connections 2024-09-17T05:33:46.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.610+0000 7fc1ef600640 1 --2- 172.21.15.31:0/2453921048 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc1c8073320 0x7fc1c80757e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.610+0000 7fc1ef600640 1 --2- 172.21.15.31:0/2453921048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1e814c110 0x7fc1e80b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.610+0000 7fc1ef600640 1 --2- 172.21.15.31:0/2453921048 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1e81e7b30 0x7fc1e81f8f00 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.610+0000 7fc1ef600640 1 --2- 172.21.15.31:0/2453921048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1d0003c40 0x7fc1e814bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.614+0000 7fc1ef600640 1 -- 172.21.15.31:0/2453921048 >> 172.21.15.31:0/2453921048 conn(0x7fc1e80b2240 msgr2=0x7fc1e80b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:46.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.614+0000 7fc1ef600640 1 -- 172.21.15.31:0/2453921048 shutdown_connections 2024-09-17T05:33:46.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.614+0000 7fc1ef600640 1 -- 172.21.15.31:0/2453921048 wait complete. 2024-09-17T05:33:46.633 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:33:46.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.782+0000 7eff8e600640 1 -- 172.21.15.31:0/1135555379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff6c005920 msgr2=0x7eff6c005da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:46.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.782+0000 7eff8e600640 1 --2- 172.21.15.31:0/1135555379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff6c005920 0x7eff6c005da0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7eff8806fcf0 tx=0x7eff7401d210 comp rx=0 tx=0).stop 2024-09-17T05:33:46.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.782+0000 7eff8e600640 1 -- 172.21.15.31:0/1135555379 shutdown_connections 2024-09-17T05:33:46.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.782+0000 7eff8e600640 1 --2- 172.21.15.31:0/1135555379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff6c005920 0x7eff6c005da0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.782+0000 7eff8e600640 1 -- 172.21.15.31:0/1135555379 >> 172.21.15.31:0/1135555379 conn(0x7eff880b18f0 msgr2=0x7eff880b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:46.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.782+0000 7eff8e600640 1 -- 172.21.15.31:0/1135555379 shutdown_connections 2024-09-17T05:33:46.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.782+0000 7eff8e600640 1 -- 172.21.15.31:0/1135555379 wait complete. 2024-09-17T05:33:46.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.782+0000 7eff8e600640 1 Processor -- start 2024-09-17T05:33:46.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.782+0000 7eff8e600640 1 -- start start 2024-09-17T05:33:46.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff8e600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff6c005920 0x7eff88157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:46.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff8e600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff881eca60 0x7eff88155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:46.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff8e600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff881ecee0 0x7eff88155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:46.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff8e600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7eff880ceba0 con 0x7eff881eca60 2024-09-17T05:33:46.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff8e600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7eff880cea20 con 0x7eff881ecee0 2024-09-17T05:33:46.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff8e600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7eff880ced20 con 0x7eff6c005920 2024-09-17T05:33:46.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff86a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff881eca60 0x7eff88155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:46.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff86a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff881eca60 0x7eff88155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43868/0 (socket says 172.21.15.31:43868) 2024-09-17T05:33:46.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff86a00640 1 -- 172.21.15.31:0/2618105056 learned_addr learned my addr 172.21.15.31:0/2618105056 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:46.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff87400640 1 --2- 172.21.15.31:0/2618105056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff6c005920 0x7eff88157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:46.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff87e00640 1 --2- 172.21.15.31:0/2618105056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff881ecee0 0x7eff88155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:46.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff86a00640 1 -- 172.21.15.31:0/2618105056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff6c005920 msgr2=0x7eff88157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:46.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff86a00640 1 --2- 172.21.15.31:0/2618105056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff6c005920 0x7eff88157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff86a00640 1 -- 172.21.15.31:0/2618105056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff881ecee0 msgr2=0x7eff88155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:46.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff86a00640 1 --2- 172.21.15.31:0/2618105056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff881ecee0 0x7eff88155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff86a00640 1 -- 172.21.15.31:0/2618105056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff881ea420 con 0x7eff881eca60 2024-09-17T05:33:46.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff87400640 1 --2- 172.21.15.31:0/2618105056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff6c005920 0x7eff88157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:33:46.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff86a00640 1 --2- 172.21.15.31:0/2618105056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff881eca60 0x7eff88155790 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7eff7401cc80 tx=0x7eff740ad990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:46.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff7f400640 1 -- 172.21.15.31:0/2618105056 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff740ba070 con 0x7eff881eca60 2024-09-17T05:33:46.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff7f400640 1 -- 172.21.15.31:0/2618105056 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff740adb00 con 0x7eff881eca60 2024-09-17T05:33:46.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff7f400640 1 -- 172.21.15.31:0/2618105056 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff740b2040 con 0x7eff881eca60 2024-09-17T05:33:46.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff8e600640 1 -- 172.21.15.31:0/2618105056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff881ea700 con 0x7eff881eca60 2024-09-17T05:33:46.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff8e600640 1 -- 172.21.15.31:0/2618105056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff8809b990 con 0x7eff881eca60 2024-09-17T05:33:46.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff8e600640 1 -- 172.21.15.31:0/2618105056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff88069410 con 0x7eff881eca60 2024-09-17T05:33:46.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.786+0000 7eff7f400640 1 -- 172.21.15.31:0/2618105056 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7eff740b6410 con 0x7eff881eca60 2024-09-17T05:33:46.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.790+0000 7eff7f400640 1 --2- 172.21.15.31:0/2618105056 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7eff68073350 0x7eff68075810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:46.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.790+0000 7eff7f400640 1 -- 172.21.15.31:0/2618105056 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7eff7412ea40 con 0x7eff881eca60 2024-09-17T05:33:46.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.790+0000 7eff87400640 1 --2- 172.21.15.31:0/2618105056 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7eff68073350 0x7eff68075810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:46.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.790+0000 7eff87400640 1 --2- 172.21.15.31:0/2618105056 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7eff68073350 0x7eff68075810 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7eff78000c10 tx=0x7eff78006a90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:46.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.794+0000 7eff7f400640 1 -- 172.21.15.31:0/2618105056 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7eff74016f20 con 0x7eff881eca60 2024-09-17T05:33:46.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.970+0000 7eff8e600640 1 -- 172.21.15.31:0/2618105056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7eff880cf280 con 0x7eff881eca60 2024-09-17T05:33:46.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.970+0000 7eff7f400640 1 -- 172.21.15.31:0/2618105056 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7eff740f9230 con 0x7eff881eca60 2024-09-17T05:33:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.974+0000 7eff8e600640 1 -- 172.21.15.31:0/2618105056 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7eff68073350 msgr2=0x7eff68075810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.974+0000 7eff8e600640 1 --2- 172.21.15.31:0/2618105056 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7eff68073350 0x7eff68075810 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7eff78000c10 tx=0x7eff78006a90 comp rx=0 tx=0).stop 2024-09-17T05:33:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.974+0000 7eff8e600640 1 -- 172.21.15.31:0/2618105056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff881eca60 msgr2=0x7eff88155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.974+0000 7eff8e600640 1 --2- 172.21.15.31:0/2618105056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff881eca60 0x7eff88155790 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7eff7401cc80 tx=0x7eff740ad990 comp rx=0 tx=0).stop 2024-09-17T05:33:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.974+0000 7eff8e600640 1 -- 172.21.15.31:0/2618105056 shutdown_connections 2024-09-17T05:33:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.974+0000 7eff8e600640 1 --2- 172.21.15.31:0/2618105056 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7eff68073350 0x7eff68075810 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.974+0000 7eff8e600640 1 --2- 172.21.15.31:0/2618105056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff881ecee0 0x7eff88155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.974+0000 7eff8e600640 1 --2- 172.21.15.31:0/2618105056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff881eca60 0x7eff88155790 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.974+0000 7eff8e600640 1 --2- 172.21.15.31:0/2618105056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff6c005920 0x7eff88157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.974+0000 7eff8e600640 1 -- 172.21.15.31:0/2618105056 >> 172.21.15.31:0/2618105056 conn(0x7eff880b18f0 msgr2=0x7eff880ad330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:46.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.974+0000 7eff8e600640 1 -- 172.21.15.31:0/2618105056 shutdown_connections 2024-09-17T05:33:46.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:46.974+0000 7eff8e600640 1 -- 172.21.15.31:0/2618105056 wait complete. 2024-09-17T05:33:46.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:46.995 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b) 2024-09-17T05:33:47.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:47.026 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/fake) 2024-09-17T05:33:47.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:47.094 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-17T05:33:47.147 INFO:teuthology.orchestra.run.smithi031.stdout:cephfs_data 2024-09-17T05:33:47.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:47.147 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b) 2024-09-17T05:33:47.218 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:33:47.218 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol42470/.meta 2024-09-17T05:33:47.285 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol42470 2024-09-17T05:33:47.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.474+0000 7f0d2f200640 1 -- 172.21.15.31:0/898727574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30161230 msgr2=0x7f0d300d4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:47.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.474+0000 7f0d2f200640 1 --2- 172.21.15.31:0/898727574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30161230 0x7f0d300d4510 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f0d3008dfd0 tx=0x7f0d2001c740 comp rx=0 tx=0).stop 2024-09-17T05:33:47.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.474+0000 7f0d2f200640 1 -- 172.21.15.31:0/898727574 shutdown_connections 2024-09-17T05:33:47.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.474+0000 7f0d2f200640 1 --2- 172.21.15.31:0/898727574 >> v2:172.21.15.155:3300/0 conn(0x7f0d300b0a90 0x7f0d300d2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:47.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.474+0000 7f0d2f200640 1 --2- 172.21.15.31:0/898727574 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d30161230 0x7f0d300d4510 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:47.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.474+0000 7f0d2f200640 1 -- 172.21.15.31:0/898727574 >> 172.21.15.31:0/898727574 conn(0x7f0d3009d0c0 msgr2=0x7f0d300d3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:47.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.474+0000 7f0d2f200640 1 -- 172.21.15.31:0/898727574 shutdown_connections 2024-09-17T05:33:47.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.474+0000 7f0d2f200640 1 -- 172.21.15.31:0/898727574 wait complete. 2024-09-17T05:33:47.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.474+0000 7f0d2f200640 1 Processor -- start 2024-09-17T05:33:47.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.474+0000 7f0d2f200640 1 -- start start 2024-09-17T05:33:47.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d2f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d300b0a90 0x7f0d301fb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:47.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d2f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d300d2780 0x7f0d301f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:47.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d2f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d30161230 0x7f0d300b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:47.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d2f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3016aed0 con 0x7f0d300d2780 2024-09-17T05:33:47.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d2f200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0d3016ad50 con 0x7f0d30161230 2024-09-17T05:33:47.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d2f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3016b050 con 0x7f0d300b0a90 2024-09-17T05:33:47.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d27e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d300d2780 0x7f0d301f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:47.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d27e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d300d2780 0x7f0d301f7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43876/0 (socket says 172.21.15.31:43876) 2024-09-17T05:33:47.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d27e00640 1 -- 172.21.15.31:0/2925356445 learned_addr learned my addr 172.21.15.31:0/2925356445 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:47.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d2de00640 1 --2- 172.21.15.31:0/2925356445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d300b0a90 0x7f0d301fb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:47.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d2e800640 1 --2- 172.21.15.31:0/2925356445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d30161230 0x7f0d300b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:47.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d27e00640 1 -- 172.21.15.31:0/2925356445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d300b0a90 msgr2=0x7f0d301fb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:47.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d27e00640 1 --2- 172.21.15.31:0/2925356445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d300b0a90 0x7f0d301fb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:47.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d27e00640 1 -- 172.21.15.31:0/2925356445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d30161230 msgr2=0x7f0d300b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:47.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d27e00640 1 --2- 172.21.15.31:0/2925356445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d30161230 0x7f0d300b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:47.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d27e00640 1 -- 172.21.15.31:0/2925356445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d301f7fc0 con 0x7f0d300d2780 2024-09-17T05:33:47.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d2e800640 1 --2- 172.21.15.31:0/2925356445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d30161230 0x7f0d300b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:47.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d27e00640 1 --2- 172.21.15.31:0/2925356445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d300d2780 0x7f0d301f7650 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800d950 tx=0x7f0d1800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:47.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d26000640 1 -- 172.21.15.31:0/2925356445 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d18017070 con 0x7f0d300d2780 2024-09-17T05:33:47.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d26000640 1 -- 172.21.15.31:0/2925356445 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d18009d20 con 0x7f0d300d2780 2024-09-17T05:33:47.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d26000640 1 -- 172.21.15.31:0/2925356445 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d180106c0 con 0x7f0d300d2780 2024-09-17T05:33:47.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d2f200640 1 -- 172.21.15.31:0/2925356445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d301f82a0 con 0x7f0d300d2780 2024-09-17T05:33:47.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d2f200640 1 -- 172.21.15.31:0/2925356445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d301fba70 con 0x7f0d300d2780 2024-09-17T05:33:47.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d2f200640 1 -- 172.21.15.31:0/2925356445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d300d2240 con 0x7f0d300d2780 2024-09-17T05:33:47.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.478+0000 7f0d26000640 1 -- 172.21.15.31:0/2925356445 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f0d18010860 con 0x7f0d300d2780 2024-09-17T05:33:47.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.482+0000 7f0d26000640 1 --2- 172.21.15.31:0/2925356445 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d0c073320 0x7f0d0c0757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:47.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.482+0000 7f0d26000640 1 -- 172.21.15.31:0/2925356445 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f0d180947f0 con 0x7f0d300d2780 2024-09-17T05:33:47.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.482+0000 7f0d2de00640 1 --2- 172.21.15.31:0/2925356445 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d0c073320 0x7f0d0c0757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:47.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.482+0000 7f0d2de00640 1 --2- 172.21.15.31:0/2925356445 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d0c073320 0x7f0d0c0757e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0d200af000 tx=0x7f0d2001af80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:47.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.486+0000 7f0d26000640 1 -- 172.21.15.31:0/2925356445 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0d1805efe0 con 0x7f0d300d2780 2024-09-17T05:33:47.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.686+0000 7f0d2f200640 1 -- 172.21.15.31:0/2925356445 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol42470", "target": ["mon-mgr", ""]}) -- 0x7f0d30069e30 con 0x7f0d0c073320 2024-09-17T05:33:47.693 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:33:47.690+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:33:47.693 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:33:47.690+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:33:47.693 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:33:47.690+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:33:47.693 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:33:47.690+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:33:47.694 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:33:47.690+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:33:47.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.838+0000 7f0d26000640 1 -- 172.21.15.31:0/2925356445 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7f0d200042a0 con 0x7f0d0c073320 2024-09-17T05:33:47.839 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b 2024-09-17T05:33:47.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.838+0000 7f0d2f200640 1 -- 172.21.15.31:0/2925356445 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d0c073320 msgr2=0x7f0d0c0757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:47.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.838+0000 7f0d2f200640 1 --2- 172.21.15.31:0/2925356445 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d0c073320 0x7f0d0c0757e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0d200af000 tx=0x7f0d2001af80 comp rx=0 tx=0).stop 2024-09-17T05:33:47.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.838+0000 7f0d2f200640 1 -- 172.21.15.31:0/2925356445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d300d2780 msgr2=0x7f0d301f7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:47.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.838+0000 7f0d2f200640 1 --2- 172.21.15.31:0/2925356445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d300d2780 0x7f0d301f7650 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800d950 tx=0x7f0d1800de10 comp rx=0 tx=0).stop 2024-09-17T05:33:47.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.838+0000 7f0d2f200640 1 -- 172.21.15.31:0/2925356445 shutdown_connections 2024-09-17T05:33:47.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.838+0000 7f0d2f200640 1 --2- 172.21.15.31:0/2925356445 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d0c073320 0x7f0d0c0757e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:47.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.838+0000 7f0d2f200640 1 --2- 172.21.15.31:0/2925356445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d30161230 0x7f0d300b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:47.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.838+0000 7f0d2f200640 1 --2- 172.21.15.31:0/2925356445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d300d2780 0x7f0d301f7650 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:47.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.838+0000 7f0d2f200640 1 --2- 172.21.15.31:0/2925356445 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d300b0a90 0x7f0d301fb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:47.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.838+0000 7f0d2f200640 1 -- 172.21.15.31:0/2925356445 >> 172.21.15.31:0/2925356445 conn(0x7f0d3009d0c0 msgr2=0x7f0d300b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:47.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.838+0000 7f0d2f200640 1 -- 172.21.15.31:0/2925356445 shutdown_connections 2024-09-17T05:33:47.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:47.838+0000 7f0d2f200640 1 -- 172.21.15.31:0/2925356445 wait complete. 2024-09-17T05:33:47.860 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs 2024-09-17T05:33:48.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a18800640 1 -- 172.21.15.31:0/1379045089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a100b28d0 msgr2=0x7f9a100ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:48.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a18800640 1 --2- 172.21.15.31:0/1379045089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a100b28d0 0x7f9a100ce270 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009900 tx=0x7f9a0001c8b0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a18800640 1 -- 172.21.15.31:0/1379045089 shutdown_connections 2024-09-17T05:33:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a18800640 1 --2- 172.21.15.31:0/1379045089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a100b28d0 0x7f9a100ce270 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a18800640 1 --2- 172.21.15.31:0/1379045089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a101603f0 0x7f9a100b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a18800640 1 -- 172.21.15.31:0/1379045089 >> 172.21.15.31:0/1379045089 conn(0x7f9a100d1df0 msgr2=0x7f9a100d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a18800640 1 -- 172.21.15.31:0/1379045089 shutdown_connections 2024-09-17T05:33:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a18800640 1 -- 172.21.15.31:0/1379045089 wait complete. 2024-09-17T05:33:48.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a18800640 1 Processor -- start 2024-09-17T05:33:48.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a18800640 1 -- start start 2024-09-17T05:33:48.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a18800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a100b1190 0x7f9a1015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:48.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a18800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a100b28d0 0x7f9a1014d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:48.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a18800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a101603f0 0x7f9a100c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:48.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a18800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9a101694f0 con 0x7f9a100b28d0 2024-09-17T05:33:48.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a18800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9a100b34a0 con 0x7f9a100b1190 2024-09-17T05:33:48.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a18800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9a10169670 con 0x7f9a101603f0 2024-09-17T05:33:48.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a15e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a100b1190 0x7f9a1015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:48.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a15400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a100b28d0 0x7f9a1014d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:48.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a15e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a100b1190 0x7f9a1015ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:53956/0 (socket says 172.21.15.31:53956) 2024-09-17T05:33:48.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a15e00640 1 -- 172.21.15.31:0/2232777310 learned_addr learned my addr 172.21.15.31:0/2232777310 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:48.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a16800640 1 --2- 172.21.15.31:0/2232777310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a101603f0 0x7f9a100c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:48.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a15400640 1 -- 172.21.15.31:0/2232777310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a101603f0 msgr2=0x7f9a100c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:48.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a15400640 1 --2- 172.21.15.31:0/2232777310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a101603f0 0x7f9a100c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a15400640 1 -- 172.21.15.31:0/2232777310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a100b1190 msgr2=0x7f9a1015ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:48.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a15400640 1 --2- 172.21.15.31:0/2232777310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a100b1190 0x7f9a1015ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.010+0000 7f9a15400640 1 -- 172.21.15.31:0/2232777310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1006ded0 con 0x7f9a100b28d0 2024-09-17T05:33:48.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.014+0000 7f9a15400640 1 --2- 172.21.15.31:0/2232777310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a100b28d0 0x7f9a1014d070 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f9a000ac000 tx=0x7f9a000a5890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:48.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.014+0000 7f9a0a000640 1 -- 172.21.15.31:0/2232777310 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a000b2040 con 0x7f9a100b28d0 2024-09-17T05:33:48.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.014+0000 7f9a0a000640 1 -- 172.21.15.31:0/2232777310 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a000043e0 con 0x7f9a100b28d0 2024-09-17T05:33:48.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.014+0000 7f9a0a000640 1 -- 172.21.15.31:0/2232777310 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00005290 con 0x7f9a100b28d0 2024-09-17T05:33:48.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.014+0000 7f9a18800640 1 -- 172.21.15.31:0/2232777310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1006e1b0 con 0x7f9a100b28d0 2024-09-17T05:33:48.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.014+0000 7f9a18800640 1 -- 172.21.15.31:0/2232777310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a1006e770 con 0x7f9a100b28d0 2024-09-17T05:33:48.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.014+0000 7f9a18800640 1 -- 172.21.15.31:0/2232777310 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a100ce270 con 0x7f9a100b28d0 2024-09-17T05:33:48.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.014+0000 7f9a0a000640 1 -- 172.21.15.31:0/2232777310 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 16) ==== 97336+0+0 (secure 0 0 0) 0x7f9a00005430 con 0x7f9a100b28d0 2024-09-17T05:33:48.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.014+0000 7f9a0a000640 1 --2- 172.21.15.31:0/2232777310 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f99f4073320 0x7f99f40757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:48.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.014+0000 7f9a0a000640 1 -- 172.21.15.31:0/2232777310 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f9a0012de90 con 0x7f9a100b28d0 2024-09-17T05:33:48.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.014+0000 7f9a15e00640 1 --2- 172.21.15.31:0/2232777310 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f99f4073320 0x7f99f40757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:48.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.018+0000 7f9a15e00640 1 --2- 172.21.15.31:0/2232777310 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f99f4073320 0x7f99f40757e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009c00 tx=0x7f9a040091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:48.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.018+0000 7f9a0a000640 1 -- 172.21.15.31:0/2232777310 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9a000164d0 con 0x7f9a100b28d0 2024-09-17T05:33:48.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.218+0000 7f9a18800640 1 -- 172.21.15.31:0/2232777310 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) -- 0x7f9a1015dd20 con 0x7f99f4073320 2024-09-17T05:33:48.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.222+0000 7f9a0a000640 1 -- 172.21.15.31:0/2232777310 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7f9a1015dd20 con 0x7f99f4073320 2024-09-17T05:33:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:33:48.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:48.225 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "subvol42470" 2024-09-17T05:33:48.225 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:33:48.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.226+0000 7f9a18800640 1 -- 172.21.15.31:0/2232777310 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f99f4073320 msgr2=0x7f99f40757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:48.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.226+0000 7f9a18800640 1 --2- 172.21.15.31:0/2232777310 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f99f4073320 0x7f99f40757e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009c00 tx=0x7f9a040091e0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.226+0000 7f9a18800640 1 -- 172.21.15.31:0/2232777310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a100b28d0 msgr2=0x7f9a1014d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:48.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.226+0000 7f9a18800640 1 --2- 172.21.15.31:0/2232777310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a100b28d0 0x7f9a1014d070 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f9a000ac000 tx=0x7f9a000a5890 comp rx=0 tx=0).stop 2024-09-17T05:33:48.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.226+0000 7f9a18800640 1 -- 172.21.15.31:0/2232777310 shutdown_connections 2024-09-17T05:33:48.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.226+0000 7f9a18800640 1 --2- 172.21.15.31:0/2232777310 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f99f4073320 0x7f99f40757e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.226+0000 7f9a18800640 1 --2- 172.21.15.31:0/2232777310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a101603f0 0x7f9a100c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.226+0000 7f9a18800640 1 --2- 172.21.15.31:0/2232777310 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a100b28d0 0x7f9a1014d070 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.226+0000 7f9a18800640 1 --2- 172.21.15.31:0/2232777310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a100b1190 0x7f9a1015ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.226+0000 7f9a18800640 1 -- 172.21.15.31:0/2232777310 >> 172.21.15.31:0/2232777310 conn(0x7f9a100d1df0 msgr2=0x7f9a100b6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:48.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.230+0000 7f9a18800640 1 -- 172.21.15.31:0/2232777310 shutdown_connections 2024-09-17T05:33:48.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.230+0000 7f9a18800640 1 -- 172.21.15.31:0/2232777310 wait complete. 2024-09-17T05:33:48.252 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol42470 2024-09-17T05:33:48.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.398+0000 7ff0a3200640 1 -- 172.21.15.31:0/1757243078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c15f340 msgr2=0x7ff09c0b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:48.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.398+0000 7ff0a3200640 1 --2- 172.21.15.31:0/1757243078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c15f340 0x7ff09c0b34a0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009900 tx=0x7ff08c01c8e0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.398+0000 7ff0a3200640 1 -- 172.21.15.31:0/1757243078 shutdown_connections 2024-09-17T05:33:48.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.398+0000 7ff0a3200640 1 --2- 172.21.15.31:0/1757243078 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff09c0b39e0 0x7ff09c0b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.398+0000 7ff0a3200640 1 --2- 172.21.15.31:0/1757243078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c15f340 0x7ff09c0b34a0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.398+0000 7ff0a3200640 1 -- 172.21.15.31:0/1757243078 >> 172.21.15.31:0/1757243078 conn(0x7ff09c0d1e00 msgr2=0x7ff09c0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:48.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff0a3200640 1 -- 172.21.15.31:0/1757243078 shutdown_connections 2024-09-17T05:33:48.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff0a3200640 1 -- 172.21.15.31:0/1757243078 wait complete. 2024-09-17T05:33:48.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff0a3200640 1 Processor -- start 2024-09-17T05:33:48.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff0a3200640 1 -- start start 2024-09-17T05:33:48.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff0a3200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c0b2a00 0x7ff09c147170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:48.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff0a3200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff09c0b39e0 0x7ff09c15d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:48.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff0a3200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff09c15f340 0x7ff09c15d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:48.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff0a3200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c168cd0 con 0x7ff09c0b2a00 2024-09-17T05:33:48.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff0a3200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c168b50 con 0x7ff09c0b39e0 2024-09-17T05:33:48.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff0a3200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff09c168e50 con 0x7ff09c15f340 2024-09-17T05:33:48.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff09be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c0b2a00 0x7ff09c147170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:48.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff09be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c0b2a00 0x7ff09c147170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43926/0 (socket says 172.21.15.31:43926) 2024-09-17T05:33:48.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff09be00640 1 -- 172.21.15.31:0/1274638871 learned_addr learned my addr 172.21.15.31:0/1274638871 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:48.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff0a1200640 1 --2- 172.21.15.31:0/1274638871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff09c15f340 0x7ff09c15d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff093400640 1 --2- 172.21.15.31:0/1274638871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff09c0b39e0 0x7ff09c15d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff09be00640 1 -- 172.21.15.31:0/1274638871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff09c15f340 msgr2=0x7ff09c15d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff09be00640 1 --2- 172.21.15.31:0/1274638871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff09c15f340 0x7ff09c15d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff09be00640 1 -- 172.21.15.31:0/1274638871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff09c0b39e0 msgr2=0x7ff09c15d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff09be00640 1 --2- 172.21.15.31:0/1274638871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff09c0b39e0 0x7ff09c15d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff09be00640 1 -- 172.21.15.31:0/1274638871 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c0d1980 con 0x7ff09c0b2a00 2024-09-17T05:33:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff093400640 1 --2- 172.21.15.31:0/1274638871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff09c0b39e0 0x7ff09c15d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff09be00640 1 --2- 172.21.15.31:0/1274638871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c0b2a00 0x7ff09c147170 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009850 tx=0x7ff08c0a5810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff098c00640 1 -- 172.21.15.31:0/1274638871 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c0b2040 con 0x7ff09c0b2a00 2024-09-17T05:33:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff098c00640 1 -- 172.21.15.31:0/1274638871 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff08c0044b0 con 0x7ff09c0b2a00 2024-09-17T05:33:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff098c00640 1 -- 172.21.15.31:0/1274638871 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c005270 con 0x7ff09c0b2a00 2024-09-17T05:33:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.402+0000 7ff0a3200640 1 -- 172.21.15.31:0/1274638871 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09c1fb350 con 0x7ff09c0b2a00 2024-09-17T05:33:48.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.406+0000 7ff0a3200640 1 -- 172.21.15.31:0/1274638871 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff09c1fb910 con 0x7ff09c0b2a00 2024-09-17T05:33:48.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.406+0000 7ff0a3200640 1 -- 172.21.15.31:0/1274638871 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff09c0b34a0 con 0x7ff09c0b2a00 2024-09-17T05:33:48.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.406+0000 7ff098c00640 1 -- 172.21.15.31:0/1274638871 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) ==== 97387+0+0 (secure 0 0 0) 0x7ff08c0bd060 con 0x7ff09c0b2a00 2024-09-17T05:33:48.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.406+0000 7ff098c00640 1 --2- 172.21.15.31:0/1274638871 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff0780733b0 0x7ff078075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:48.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.406+0000 7ff098c00640 1 -- 172.21.15.31:0/1274638871 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7ff08c12df90 con 0x7ff09c0b2a00 2024-09-17T05:33:48.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.406+0000 7ff093400640 1 --2- 172.21.15.31:0/1274638871 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff0780733b0 0x7ff078075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:48.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.406+0000 7ff093400640 1 --2- 172.21.15.31:0/1274638871 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff0780733b0 0x7ff078075870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff09c166570 tx=0x7ff084009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:48.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.410+0000 7ff098c00640 1 -- 172.21.15.31:0/1274638871 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff08c0164d0 con 0x7ff09c0b2a00 2024-09-17T05:33:48.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.618+0000 7ff0a3200640 1 -- 172.21.15.31:0/1274638871 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol42470", "target": ["mon-mgr", ""]}) -- 0x7ff09c070ca0 con 0x7ff0780733b0 2024-09-17T05:33:48.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.642+0000 7ff098c00640 1 -- 172.21.15.31:0/1274638871 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+705 (secure 0 0 0) 0x7ff09c070ca0 con 0x7ff0780733b0 2024-09-17T05:33:48.644 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:33:48.644 INFO:teuthology.orchestra.run.smithi031.stdout: "atime": "2024-09-17 05:33:47", 2024-09-17T05:33:48.644 INFO:teuthology.orchestra.run.smithi031.stdout: "bytes_pcent": "undefined", 2024-09-17T05:33:48.644 INFO:teuthology.orchestra.run.smithi031.stdout: "bytes_quota": "infinite", 2024-09-17T05:33:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: "bytes_used": 0, 2024-09-17T05:33:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: "created_at": "2024-09-17 05:33:47", 2024-09-17T05:33:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: "ctime": "2024-09-17 05:33:47", 2024-09-17T05:33:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: "data_pool": "cephfs_data", 2024-09-17T05:33:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: "earmark": "", 2024-09-17T05:33:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: "features": [ 2024-09-17T05:33:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot-clone", 2024-09-17T05:33:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot-autoprotect" 2024-09-17T05:33:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:33:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: "flavor": 1, 2024-09-17T05:33:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: "gid": 0, 2024-09-17T05:33:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: "mode": 16877, 2024-09-17T05:33:48.646 INFO:teuthology.orchestra.run.smithi031.stdout: "mon_addrs": [ 2024-09-17T05:33:48.646 INFO:teuthology.orchestra.run.smithi031.stdout: "172.21.15.31:6789", 2024-09-17T05:33:48.646 INFO:teuthology.orchestra.run.smithi031.stdout: "172.21.15.155:6789", 2024-09-17T05:33:48.646 INFO:teuthology.orchestra.run.smithi031.stdout: "172.21.15.155:6790" 2024-09-17T05:33:48.646 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:33:48.646 INFO:teuthology.orchestra.run.smithi031.stdout: "mtime": "2024-09-17 05:33:47", 2024-09-17T05:33:48.646 INFO:teuthology.orchestra.run.smithi031.stdout: "path": "/volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b", 2024-09-17T05:33:48.646 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_namespace": "", 2024-09-17T05:33:48.646 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "complete", 2024-09-17T05:33:48.646 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "subvolume", 2024-09-17T05:33:48.646 INFO:teuthology.orchestra.run.smithi031.stdout: "uid": 0 2024-09-17T05:33:48.646 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:33:48.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.646+0000 7ff0a3200640 1 -- 172.21.15.31:0/1274638871 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff0780733b0 msgr2=0x7ff078075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:48.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.646+0000 7ff0a3200640 1 --2- 172.21.15.31:0/1274638871 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff0780733b0 0x7ff078075870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff09c166570 tx=0x7ff084009040 comp rx=0 tx=0).stop 2024-09-17T05:33:48.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.646+0000 7ff0a3200640 1 -- 172.21.15.31:0/1274638871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c0b2a00 msgr2=0x7ff09c147170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:48.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.646+0000 7ff0a3200640 1 --2- 172.21.15.31:0/1274638871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c0b2a00 0x7ff09c147170 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009850 tx=0x7ff08c0a5810 comp rx=0 tx=0).stop 2024-09-17T05:33:48.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.646+0000 7ff0a3200640 1 -- 172.21.15.31:0/1274638871 shutdown_connections 2024-09-17T05:33:48.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.646+0000 7ff0a3200640 1 --2- 172.21.15.31:0/1274638871 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff0780733b0 0x7ff078075870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.646+0000 7ff0a3200640 1 --2- 172.21.15.31:0/1274638871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff09c15f340 0x7ff09c15d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.646+0000 7ff0a3200640 1 --2- 172.21.15.31:0/1274638871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff09c0b39e0 0x7ff09c15d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.646+0000 7ff0a3200640 1 --2- 172.21.15.31:0/1274638871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c0b2a00 0x7ff09c147170 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.646+0000 7ff0a3200640 1 -- 172.21.15.31:0/1274638871 >> 172.21.15.31:0/1274638871 conn(0x7ff09c0d1e00 msgr2=0x7ff09c0b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:48.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.646+0000 7ff0a3200640 1 -- 172.21.15.31:0/1274638871 shutdown_connections 2024-09-17T05:33:48.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.646+0000 7ff0a3200640 1 -- 172.21.15.31:0/1274638871 wait complete. 2024-09-17T05:33:48.665 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume resize cephfs subvol42470 10485760 2024-09-17T05:33:48.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc840200640 1 -- 172.21.15.31:0/3484996056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc83815f390 msgr2=0x7fc8380cfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:48.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc840200640 1 --2- 172.21.15.31:0/3484996056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc83815f390 0x7fc8380cfc30 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009900 tx=0x7fc82c01c8b0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc840200640 1 -- 172.21.15.31:0/3484996056 shutdown_connections 2024-09-17T05:33:48.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc840200640 1 --2- 172.21.15.31:0/3484996056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8380d28e0 0x7fc8380d0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc840200640 1 --2- 172.21.15.31:0/3484996056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc83815f390 0x7fc8380cfc30 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc840200640 1 -- 172.21.15.31:0/3484996056 >> 172.21.15.31:0/3484996056 conn(0x7fc8380d1dc0 msgr2=0x7fc8380d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:48.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc840200640 1 -- 172.21.15.31:0/3484996056 shutdown_connections 2024-09-17T05:33:48.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc840200640 1 -- 172.21.15.31:0/3484996056 wait complete. 2024-09-17T05:33:48.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc840200640 1 Processor -- start 2024-09-17T05:33:48.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc840200640 1 -- start start 2024-09-17T05:33:48.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc840200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8380d06b0 0x7fc83806ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:48.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc840200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8380d28e0 0x7fc83814e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:48.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc840200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc83815f390 0x7fc8380b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:48.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc840200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc838169060 con 0x7fc8380d06b0 2024-09-17T05:33:48.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc840200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc838168ee0 con 0x7fc8380d28e0 2024-09-17T05:33:48.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc840200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc8381691e0 con 0x7fc83815f390 2024-09-17T05:33:48.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc83d800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8380d06b0 0x7fc83806ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:48.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc83d800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8380d06b0 0x7fc83806ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45794/0 (socket says 172.21.15.31:45794) 2024-09-17T05:33:48.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc83d800640 1 -- 172.21.15.31:0/448111395 learned_addr learned my addr 172.21.15.31:0/448111395 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:48.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.818+0000 7fc83ce00640 1 --2- 172.21.15.31:0/448111395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8380d28e0 0x7fc83814e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:48.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.822+0000 7fc83e200640 1 --2- 172.21.15.31:0/448111395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc83815f390 0x7fc8380b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:48.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.822+0000 7fc83d800640 1 -- 172.21.15.31:0/448111395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc83815f390 msgr2=0x7fc8380b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:48.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.822+0000 7fc83d800640 1 --2- 172.21.15.31:0/448111395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc83815f390 0x7fc8380b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.822+0000 7fc83d800640 1 -- 172.21.15.31:0/448111395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8380d28e0 msgr2=0x7fc83814e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:48.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.822+0000 7fc83d800640 1 --2- 172.21.15.31:0/448111395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8380d28e0 0x7fc83814e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:48.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.822+0000 7fc83d800640 1 -- 172.21.15.31:0/448111395 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8381fb520 con 0x7fc8380d06b0 2024-09-17T05:33:48.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.822+0000 7fc83d800640 1 --2- 172.21.15.31:0/448111395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8380d06b0 0x7fc83806ef10 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009850 tx=0x7fc82c0a5680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:48.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.822+0000 7fc835600640 1 -- 172.21.15.31:0/448111395 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c0b2040 con 0x7fc8380d06b0 2024-09-17T05:33:48.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.822+0000 7fc835600640 1 -- 172.21.15.31:0/448111395 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc82c0042c0 con 0x7fc8380d06b0 2024-09-17T05:33:48.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.822+0000 7fc835600640 1 -- 172.21.15.31:0/448111395 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c005030 con 0x7fc8380d06b0 2024-09-17T05:33:48.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.822+0000 7fc840200640 1 -- 172.21.15.31:0/448111395 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8381fb800 con 0x7fc8380d06b0 2024-09-17T05:33:48.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.822+0000 7fc840200640 1 -- 172.21.15.31:0/448111395 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8381fbdc0 con 0x7fc8380d06b0 2024-09-17T05:33:48.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.822+0000 7fc840200640 1 -- 172.21.15.31:0/448111395 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8380b1350 con 0x7fc8380d06b0 2024-09-17T05:33:48.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.822+0000 7fc835600640 1 -- 172.21.15.31:0/448111395 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) ==== 97387+0+0 (secure 0 0 0) 0x7fc82c0051d0 con 0x7fc8380d06b0 2024-09-17T05:33:48.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.826+0000 7fc835600640 1 --2- 172.21.15.31:0/448111395 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc8180733b0 0x7fc818075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:48.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.826+0000 7fc835600640 1 -- 172.21.15.31:0/448111395 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7fc82c12e160 con 0x7fc8380d06b0 2024-09-17T05:33:48.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.826+0000 7fc83ce00640 1 --2- 172.21.15.31:0/448111395 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc8180733b0 0x7fc818075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:48.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.826+0000 7fc83ce00640 1 --2- 172.21.15.31:0/448111395 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc8180733b0 0x7fc818075870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc83814d920 tx=0x7fc82400b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:48.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:48.830+0000 7fc835600640 1 -- 172.21.15.31:0/448111395 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc82c0164d0 con 0x7fc8380d06b0 2024-09-17T05:33:49.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.038+0000 7fc840200640 1 -- 172.21.15.31:0/448111395 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume resize", "vol_name": "cephfs", "sub_name": "subvol42470", "new_size": "10485760", "target": ["mon-mgr", ""]}) -- 0x7fc83806fd20 con 0x7fc8180733b0 2024-09-17T05:33:49.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.066+0000 7fc835600640 1 -- 172.21.15.31:0/448111395 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+128 (secure 0 0 0) 0x7fc83806fd20 con 0x7fc8180733b0 2024-09-17T05:33:49.070 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:33:49.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:49.070 INFO:teuthology.orchestra.run.smithi031.stdout: "bytes_used": 0 2024-09-17T05:33:49.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:49.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:49.070 INFO:teuthology.orchestra.run.smithi031.stdout: "bytes_quota": 10485760 2024-09-17T05:33:49.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:33:49.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:33:49.071 INFO:teuthology.orchestra.run.smithi031.stdout: "bytes_pcent": "0.00" 2024-09-17T05:33:49.071 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:49.071 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:33:49.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.070+0000 7fc840200640 1 -- 172.21.15.31:0/448111395 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc8180733b0 msgr2=0x7fc818075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:49.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.070+0000 7fc840200640 1 --2- 172.21.15.31:0/448111395 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc8180733b0 0x7fc818075870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc83814d920 tx=0x7fc82400b390 comp rx=0 tx=0).stop 2024-09-17T05:33:49.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.070+0000 7fc840200640 1 -- 172.21.15.31:0/448111395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8380d06b0 msgr2=0x7fc83806ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:49.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.070+0000 7fc840200640 1 --2- 172.21.15.31:0/448111395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8380d06b0 0x7fc83806ef10 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009850 tx=0x7fc82c0a5680 comp rx=0 tx=0).stop 2024-09-17T05:33:49.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.070+0000 7fc840200640 1 -- 172.21.15.31:0/448111395 shutdown_connections 2024-09-17T05:33:49.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.070+0000 7fc840200640 1 --2- 172.21.15.31:0/448111395 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc8180733b0 0x7fc818075870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.070+0000 7fc840200640 1 --2- 172.21.15.31:0/448111395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc83815f390 0x7fc8380b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.070+0000 7fc840200640 1 --2- 172.21.15.31:0/448111395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8380d28e0 0x7fc83814e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.070+0000 7fc840200640 1 --2- 172.21.15.31:0/448111395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8380d06b0 0x7fc83806ef10 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.070+0000 7fc840200640 1 -- 172.21.15.31:0/448111395 >> 172.21.15.31:0/448111395 conn(0x7fc8380d1dc0 msgr2=0x7fc8381524a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:49.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.070+0000 7fc840200640 1 -- 172.21.15.31:0/448111395 shutdown_connections 2024-09-17T05:33:49.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.070+0000 7fc840200640 1 -- 172.21.15.31:0/448111395 wait complete. 2024-09-17T05:33:49.091 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol42470 2024-09-17T05:33:49.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.238+0000 7f0a8d400640 1 -- 172.21.15.31:0/956349247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a880cd100 msgr2=0x7f0a880b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:49.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.238+0000 7f0a8d400640 1 --2- 172.21.15.31:0/956349247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a880cd100 0x7f0a880b42d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f0a88070d30 tx=0x7f0a7401c830 comp rx=0 tx=0).stop 2024-09-17T05:33:49.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.238+0000 7f0a8d400640 1 -- 172.21.15.31:0/956349247 shutdown_connections 2024-09-17T05:33:49.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.238+0000 7f0a8d400640 1 --2- 172.21.15.31:0/956349247 >> v2:172.21.15.155:3300/0 conn(0x7f0a880b4810 0x7f0a880ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.238+0000 7f0a8d400640 1 --2- 172.21.15.31:0/956349247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a880cd100 0x7f0a880b42d0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.238+0000 7f0a8d400640 1 --2- 172.21.15.31:0/956349247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a8815dae0 0x7f0a880acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.238+0000 7f0a8d400640 1 -- 172.21.15.31:0/956349247 >> 172.21.15.31:0/956349247 conn(0x7f0a880b18f0 msgr2=0x7f0a880b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:49.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.238+0000 7f0a8d400640 1 -- 172.21.15.31:0/956349247 shutdown_connections 2024-09-17T05:33:49.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.238+0000 7f0a8d400640 1 -- 172.21.15.31:0/956349247 wait complete. 2024-09-17T05:33:49.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a8d400640 1 Processor -- start 2024-09-17T05:33:49.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a8d400640 1 -- start start 2024-09-17T05:33:49.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a8d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a880b4810 0x7f0a88073230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:49.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a8d400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a880cd100 0x7f0a8814d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:49.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a8d400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a8815dae0 0x7f0a88155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:49.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a8d400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0a880cf440 con 0x7f0a880b4810 2024-09-17T05:33:49.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a8d400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0a880cf2c0 con 0x7f0a880cd100 2024-09-17T05:33:49.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a8d400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0a8806e7a0 con 0x7f0a8815dae0 2024-09-17T05:33:49.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a86800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a880b4810 0x7f0a88073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:49.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a86800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a880b4810 0x7f0a88073230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45822/0 (socket says 172.21.15.31:45822) 2024-09-17T05:33:49.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a86800640 1 -- 172.21.15.31:0/1333963501 learned_addr learned my addr 172.21.15.31:0/1333963501 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:49.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a87200640 1 --2- 172.21.15.31:0/1333963501 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a8815dae0 0x7f0a88155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:49.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a85e00640 1 --2- 172.21.15.31:0/1333963501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a880cd100 0x7f0a8814d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:49.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a86800640 1 -- 172.21.15.31:0/1333963501 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a8815dae0 msgr2=0x7f0a88155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:49.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a86800640 1 --2- 172.21.15.31:0/1333963501 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a8815dae0 0x7f0a88155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a86800640 1 -- 172.21.15.31:0/1333963501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a880cd100 msgr2=0x7f0a8814d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:49.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a86800640 1 --2- 172.21.15.31:0/1333963501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a880cd100 0x7f0a8814d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a86800640 1 -- 172.21.15.31:0/1333963501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a88073770 con 0x7f0a880b4810 2024-09-17T05:33:49.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.242+0000 7f0a86800640 1 --2- 172.21.15.31:0/1333963501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a880b4810 0x7f0a88073230 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800d750 tx=0x7f0a7800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:49.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.246+0000 7f0a7ea00640 1 -- 172.21.15.31:0/1333963501 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a78017070 con 0x7f0a880b4810 2024-09-17T05:33:49.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.246+0000 7f0a7ea00640 1 -- 172.21.15.31:0/1333963501 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a78009d20 con 0x7f0a880b4810 2024-09-17T05:33:49.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.246+0000 7f0a8d400640 1 -- 172.21.15.31:0/1333963501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a88152a00 con 0x7f0a880b4810 2024-09-17T05:33:49.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.246+0000 7f0a7ea00640 1 -- 172.21.15.31:0/1333963501 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a78005280 con 0x7f0a880b4810 2024-09-17T05:33:49.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.246+0000 7f0a8d400640 1 -- 172.21.15.31:0/1333963501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a88152fc0 con 0x7f0a880b4810 2024-09-17T05:33:49.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.246+0000 7f0a8d400640 1 -- 172.21.15.31:0/1333963501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a880b42d0 con 0x7f0a880b4810 2024-09-17T05:33:49.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.246+0000 7f0a7ea00640 1 -- 172.21.15.31:0/1333963501 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) ==== 97387+0+0 (secure 0 0 0) 0x7f0a78005420 con 0x7f0a880b4810 2024-09-17T05:33:49.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.250+0000 7f0a7ea00640 1 --2- 172.21.15.31:0/1333963501 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0a680733b0 0x7f0a68075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:49.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.250+0000 7f0a7ea00640 1 -- 172.21.15.31:0/1333963501 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f0a78094550 con 0x7f0a880b4810 2024-09-17T05:33:49.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.250+0000 7f0a85e00640 1 --2- 172.21.15.31:0/1333963501 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0a680733b0 0x7f0a68075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:49.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.250+0000 7f0a85e00640 1 --2- 172.21.15.31:0/1333963501 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0a680733b0 0x7f0a68075870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0a740af000 tx=0x7f0a7401b070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:49.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.254+0000 7f0a7ea00640 1 -- 172.21.15.31:0/1333963501 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0a7800de60 con 0x7f0a880b4810 2024-09-17T05:33:49.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.454+0000 7f0a8d400640 1 -- 172.21.15.31:0/1333963501 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol42470", "target": ["mon-mgr", ""]}) -- 0x7f0a88074510 con 0x7f0a680733b0 2024-09-17T05:33:49.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.486+0000 7f0a7ea00640 1 -- 172.21.15.31:0/1333963501 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+698 (secure 0 0 0) 0x7f0a88074510 con 0x7f0a680733b0 2024-09-17T05:33:49.488 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:33:49.488 INFO:teuthology.orchestra.run.smithi031.stdout: "atime": "2024-09-17 05:33:47", 2024-09-17T05:33:49.488 INFO:teuthology.orchestra.run.smithi031.stdout: "bytes_pcent": "0.00", 2024-09-17T05:33:49.488 INFO:teuthology.orchestra.run.smithi031.stdout: "bytes_quota": 10485760, 2024-09-17T05:33:49.488 INFO:teuthology.orchestra.run.smithi031.stdout: "bytes_used": 0, 2024-09-17T05:33:49.488 INFO:teuthology.orchestra.run.smithi031.stdout: "created_at": "2024-09-17 05:33:47", 2024-09-17T05:33:49.488 INFO:teuthology.orchestra.run.smithi031.stdout: "ctime": "2024-09-17 05:33:49", 2024-09-17T05:33:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "data_pool": "cephfs_data", 2024-09-17T05:33:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "earmark": "", 2024-09-17T05:33:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "features": [ 2024-09-17T05:33:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot-clone", 2024-09-17T05:33:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot-autoprotect" 2024-09-17T05:33:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:33:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "flavor": 1, 2024-09-17T05:33:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "gid": 0, 2024-09-17T05:33:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "mode": 16877, 2024-09-17T05:33:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "mon_addrs": [ 2024-09-17T05:33:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: "172.21.15.31:6789", 2024-09-17T05:33:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: "172.21.15.155:6789", 2024-09-17T05:33:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: "172.21.15.155:6790" 2024-09-17T05:33:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:33:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: "mtime": "2024-09-17 05:33:47", 2024-09-17T05:33:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: "path": "/volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b", 2024-09-17T05:33:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_namespace": "", 2024-09-17T05:33:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "complete", 2024-09-17T05:33:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "subvolume", 2024-09-17T05:33:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: "uid": 0 2024-09-17T05:33:49.490 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:33:49.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.490+0000 7f0a8d400640 1 -- 172.21.15.31:0/1333963501 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0a680733b0 msgr2=0x7f0a68075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:49.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.490+0000 7f0a8d400640 1 --2- 172.21.15.31:0/1333963501 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0a680733b0 0x7f0a68075870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0a740af000 tx=0x7f0a7401b070 comp rx=0 tx=0).stop 2024-09-17T05:33:49.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.490+0000 7f0a8d400640 1 -- 172.21.15.31:0/1333963501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a880b4810 msgr2=0x7f0a88073230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:49.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.490+0000 7f0a8d400640 1 --2- 172.21.15.31:0/1333963501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a880b4810 0x7f0a88073230 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800d750 tx=0x7f0a7800dc10 comp rx=0 tx=0).stop 2024-09-17T05:33:49.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.490+0000 7f0a8d400640 1 -- 172.21.15.31:0/1333963501 shutdown_connections 2024-09-17T05:33:49.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.490+0000 7f0a8d400640 1 --2- 172.21.15.31:0/1333963501 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0a680733b0 0x7f0a68075870 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.490+0000 7f0a8d400640 1 --2- 172.21.15.31:0/1333963501 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0a8815dae0 0x7f0a88155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.490+0000 7f0a8d400640 1 --2- 172.21.15.31:0/1333963501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0a880cd100 0x7f0a8814d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.490+0000 7f0a8d400640 1 --2- 172.21.15.31:0/1333963501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a880b4810 0x7f0a88073230 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.490+0000 7f0a8d400640 1 -- 172.21.15.31:0/1333963501 >> 172.21.15.31:0/1333963501 conn(0x7f0a880b18f0 msgr2=0x7f0a8806fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:49.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.490+0000 7f0a8d400640 1 -- 172.21.15.31:0/1333963501 shutdown_connections 2024-09-17T05:33:49.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.490+0000 7f0a8d400640 1 -- 172.21.15.31:0/1333963501 wait complete. 2024-09-17T05:33:49.509 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol42470 --mode 777 --uid 1000 --gid 1000 2024-09-17T05:33:49.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.662+0000 7f3d8ca00640 1 -- 172.21.15.31:0/4039742161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880b2570 msgr2=0x7f3d88160600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:49.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.662+0000 7f3d8ca00640 1 --2- 172.21.15.31:0/4039742161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880b2570 0x7f3d88160600 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f3d880733b0 tx=0x7f3d8001f3a0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.662+0000 7f3d8ca00640 1 -- 172.21.15.31:0/4039742161 shutdown_connections 2024-09-17T05:33:49.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.662+0000 7f3d8ca00640 1 --2- 172.21.15.31:0/4039742161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880b2570 0x7f3d88160600 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.662+0000 7f3d8ca00640 1 --2- 172.21.15.31:0/4039742161 >> v2:172.21.15.155:3300/0 conn(0x7f3d880cfc80 0x7f3d880d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.662+0000 7f3d8ca00640 1 -- 172.21.15.31:0/4039742161 >> 172.21.15.31:0/4039742161 conn(0x7f3d880d1c40 msgr2=0x7f3d880d2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:49.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.662+0000 7f3d8ca00640 1 -- 172.21.15.31:0/4039742161 shutdown_connections 2024-09-17T05:33:49.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.662+0000 7f3d8ca00640 1 -- 172.21.15.31:0/4039742161 wait complete. 2024-09-17T05:33:49.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d8ca00640 1 Processor -- start 2024-09-17T05:33:49.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d8ca00640 1 -- start start 2024-09-17T05:33:49.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d8ca00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d880b2570 0x7f3d88152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:49.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d8ca00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d880cfc80 0x7f3d8815f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:49.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d8ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880d2760 0x7f3d880b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:49.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d8ca00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3d880af780 con 0x7f3d880d2760 2024-09-17T05:33:49.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d8ca00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3d880af600 con 0x7f3d880cfc80 2024-09-17T05:33:49.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d8ca00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3d880af900 con 0x7f3d880b2570 2024-09-17T05:33:49.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d87e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880d2760 0x7f3d880b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:49.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d87e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880d2760 0x7f3d880b6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45828/0 (socket says 172.21.15.31:45828) 2024-09-17T05:33:49.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d87e00640 1 -- 172.21.15.31:0/1890749471 learned_addr learned my addr 172.21.15.31:0/1890749471 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:49.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d7fe00640 1 --2- 172.21.15.31:0/1890749471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d880cfc80 0x7f3d8815f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:49.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d87400640 1 --2- 172.21.15.31:0/1890749471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d880b2570 0x7f3d88152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:49.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d87e00640 1 -- 172.21.15.31:0/1890749471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d880b2570 msgr2=0x7f3d88152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:49.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d87e00640 1 --2- 172.21.15.31:0/1890749471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d880b2570 0x7f3d88152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d87e00640 1 -- 172.21.15.31:0/1890749471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d880cfc80 msgr2=0x7f3d8815f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:49.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d87e00640 1 --2- 172.21.15.31:0/1890749471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d880cfc80 0x7f3d8815f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d87e00640 1 -- 172.21.15.31:0/1890749471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d88153440 con 0x7f3d880d2760 2024-09-17T05:33:49.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d7fe00640 1 --2- 172.21.15.31:0/1890749471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d880cfc80 0x7f3d8815f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:49.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d87400640 1 --2- 172.21.15.31:0/1890749471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d880b2570 0x7f3d88152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:49.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d87e00640 1 --2- 172.21.15.31:0/1890749471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880d2760 0x7f3d880b6ff0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f3d80009bd0 tx=0x7f3d80003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:49.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d7f400640 1 -- 172.21.15.31:0/1890749471 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d800b4040 con 0x7f3d880d2760 2024-09-17T05:33:49.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d7f400640 1 -- 172.21.15.31:0/1890749471 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d800be070 con 0x7f3d880d2760 2024-09-17T05:33:49.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d8ca00640 1 -- 172.21.15.31:0/1890749471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d880b5f50 con 0x7f3d880d2760 2024-09-17T05:33:49.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d7f400640 1 -- 172.21.15.31:0/1890749471 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d800af8a0 con 0x7f3d880d2760 2024-09-17T05:33:49.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.666+0000 7f3d8ca00640 1 -- 172.21.15.31:0/1890749471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d880b6510 con 0x7f3d880d2760 2024-09-17T05:33:49.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.670+0000 7f3d8ca00640 1 -- 172.21.15.31:0/1890749471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d880d0060 con 0x7f3d880d2760 2024-09-17T05:33:49.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.670+0000 7f3d7f400640 1 -- 172.21.15.31:0/1890749471 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) ==== 97387+0+0 (secure 0 0 0) 0x7f3d800af4c0 con 0x7f3d880d2760 2024-09-17T05:33:49.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.670+0000 7f3d7f400640 1 --2- 172.21.15.31:0/1890749471 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3d640733e0 0x7f3d640758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:49.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.670+0000 7f3d7f400640 1 -- 172.21.15.31:0/1890749471 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f3d80132610 con 0x7f3d880d2760 2024-09-17T05:33:49.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.670+0000 7f3d87400640 1 --2- 172.21.15.31:0/1890749471 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3d640733e0 0x7f3d640758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:49.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.670+0000 7f3d87400640 1 --2- 172.21.15.31:0/1890749471 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3d640733e0 0x7f3d640758a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3d780058d0 tx=0x7f3d78005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:49.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.674+0000 7f3d7f400640 1 -- 172.21.15.31:0/1890749471 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f3d880b12e0 con 0x7f3d880d2760 2024-09-17T05:33:49.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.882+0000 7f3d8ca00640 1 -- 172.21.15.31:0/1890749471 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol42470", "mode": "777", "uid": 1000, "gid": 1000, "target": ["mon-mgr", ""]}) -- 0x7f3d88071d30 con 0x7f3d640733e0 2024-09-17T05:33:49.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.914+0000 7f3d7f400640 1 -- 172.21.15.31:0/1890749471 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3d88071d30 con 0x7f3d640733e0 2024-09-17T05:33:49.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.918+0000 7f3d8ca00640 1 -- 172.21.15.31:0/1890749471 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3d640733e0 msgr2=0x7f3d640758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:49.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.918+0000 7f3d8ca00640 1 --2- 172.21.15.31:0/1890749471 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3d640733e0 0x7f3d640758a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3d780058d0 tx=0x7f3d78005860 comp rx=0 tx=0).stop 2024-09-17T05:33:49.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.918+0000 7f3d8ca00640 1 -- 172.21.15.31:0/1890749471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880d2760 msgr2=0x7f3d880b6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:49.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.918+0000 7f3d8ca00640 1 --2- 172.21.15.31:0/1890749471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880d2760 0x7f3d880b6ff0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f3d80009bd0 tx=0x7f3d80003f60 comp rx=0 tx=0).stop 2024-09-17T05:33:49.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.918+0000 7f3d8ca00640 1 -- 172.21.15.31:0/1890749471 shutdown_connections 2024-09-17T05:33:49.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.918+0000 7f3d8ca00640 1 --2- 172.21.15.31:0/1890749471 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3d640733e0 0x7f3d640758a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.918+0000 7f3d8ca00640 1 --2- 172.21.15.31:0/1890749471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d880d2760 0x7f3d880b6ff0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.918+0000 7f3d8ca00640 1 --2- 172.21.15.31:0/1890749471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d880cfc80 0x7f3d8815f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.918+0000 7f3d8ca00640 1 --2- 172.21.15.31:0/1890749471 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d880b2570 0x7f3d88152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.918+0000 7f3d8ca00640 1 -- 172.21.15.31:0/1890749471 >> 172.21.15.31:0/1890749471 conn(0x7f3d880d1c40 msgr2=0x7f3d880708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.918+0000 7f3d8ca00640 1 -- 172.21.15.31:0/1890749471 shutdown_connections 2024-09-17T05:33:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:49.918+0000 7f3d8ca00640 1 -- 172.21.15.31:0/1890749471 wait complete. 2024-09-17T05:33:49.939 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol42470 2024-09-17T05:33:50.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f9683400640 1 -- 172.21.15.31:0/1491512731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f967c0afb10 msgr2=0x7f967c0affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:50.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f9683400640 1 --2- 172.21.15.31:0/1491512731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f967c0afb10 0x7f967c0affc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9674009c80 tx=0x7f967401cda0 comp rx=0 tx=0).stop 2024-09-17T05:33:50.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f9683400640 1 -- 172.21.15.31:0/1491512731 shutdown_connections 2024-09-17T05:33:50.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f9683400640 1 --2- 172.21.15.31:0/1491512731 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f967c0afb10 0x7f967c0affc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:50.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f9683400640 1 --2- 172.21.15.31:0/1491512731 >> v2:172.21.15.155:3300/0 conn(0x7f967c0b1650 0x7f967c0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:50.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f9683400640 1 -- 172.21.15.31:0/1491512731 >> 172.21.15.31:0/1491512731 conn(0x7f967c0d1dd0 msgr2=0x7f967c0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:50.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f9683400640 1 -- 172.21.15.31:0/1491512731 shutdown_connections 2024-09-17T05:33:50.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f9683400640 1 -- 172.21.15.31:0/1491512731 wait complete. 2024-09-17T05:33:50.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f9683400640 1 Processor -- start 2024-09-17T05:33:50.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f9683400640 1 -- start start 2024-09-17T05:33:50.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f9683400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f967c0afb10 0x7f967c15cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:50.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f9683400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f967c0b1650 0x7f967c15ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:50.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f9683400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f967c1605d0 0x7f967c15efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:50.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f9683400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f967c169540 con 0x7f967c0b1650 2024-09-17T05:33:50.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f9683400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f967c0b1430 con 0x7f967c1605d0 2024-09-17T05:33:50.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f9683400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f967c1696c0 con 0x7f967c0afb10 2024-09-17T05:33:50.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f967be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f967c0b1650 0x7f967c15ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:50.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f9680a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f967c0afb10 0x7f967c15cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:50.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f9681400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f967c1605d0 0x7f967c15efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:50.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f967be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f967c0b1650 0x7f967c15ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45840/0 (socket says 172.21.15.31:45840) 2024-09-17T05:33:50.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.090+0000 7f967be00640 1 -- 172.21.15.31:0/1905295421 learned_addr learned my addr 172.21.15.31:0/1905295421 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:50.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.094+0000 7f9680a00640 1 -- 172.21.15.31:0/1905295421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f967c1605d0 msgr2=0x7f967c15efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:50.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.094+0000 7f9680a00640 1 --2- 172.21.15.31:0/1905295421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f967c1605d0 0x7f967c15efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:50.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.094+0000 7f9680a00640 1 -- 172.21.15.31:0/1905295421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f967c0b1650 msgr2=0x7f967c15ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:50.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.094+0000 7f9680a00640 1 --2- 172.21.15.31:0/1905295421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f967c0b1650 0x7f967c15ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:50.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.094+0000 7f9680a00640 1 -- 172.21.15.31:0/1905295421 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f967c15f8b0 con 0x7f967c0afb10 2024-09-17T05:33:50.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.094+0000 7f967be00640 1 --2- 172.21.15.31:0/1905295421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f967c0b1650 0x7f967c15ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:33:50.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.094+0000 7f9680a00640 1 --2- 172.21.15.31:0/1905295421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f967c0afb10 0x7f967c15cf30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f967000c3c0 tx=0x7f967000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:50.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.094+0000 7f9678c00640 1 -- 172.21.15.31:0/1905295421 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9670017070 con 0x7f967c0afb10 2024-09-17T05:33:50.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.094+0000 7f9678c00640 1 -- 172.21.15.31:0/1905295421 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96700053c0 con 0x7f967c0afb10 2024-09-17T05:33:50.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.094+0000 7f9678c00640 1 -- 172.21.15.31:0/1905295421 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9670003840 con 0x7f967c0afb10 2024-09-17T05:33:50.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.094+0000 7f9683400640 1 -- 172.21.15.31:0/1905295421 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f967c15f5d0 con 0x7f967c0afb10 2024-09-17T05:33:50.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.094+0000 7f9683400640 1 -- 172.21.15.31:0/1905295421 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f967c0b5110 con 0x7f967c0afb10 2024-09-17T05:33:50.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.094+0000 7f9683400640 1 -- 172.21.15.31:0/1905295421 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f967c0affc0 con 0x7f967c0afb10 2024-09-17T05:33:50.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.094+0000 7f9678c00640 1 -- 172.21.15.31:0/1905295421 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 17) ==== 97387+0+0 (secure 0 0 0) 0x7f967001a070 con 0x7f967c0afb10 2024-09-17T05:33:50.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.094+0000 7f9678c00640 1 --2- 172.21.15.31:0/1905295421 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f965c0733e0 0x7f965c0758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:50.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.094+0000 7f9678c00640 1 -- 172.21.15.31:0/1905295421 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f96700937a0 con 0x7f967c0afb10 2024-09-17T05:33:50.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.098+0000 7f967be00640 1 --2- 172.21.15.31:0/1905295421 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f965c0733e0 0x7f965c0758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:50.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.098+0000 7f967be00640 1 --2- 172.21.15.31:0/1905295421 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f965c0733e0 0x7f965c0758a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f967c166cf0 tx=0x7f96680091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:50.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.102+0000 7f9678c00640 1 -- 172.21.15.31:0/1905295421 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f967005ded0 con 0x7f967c0afb10 2024-09-17T05:33:50.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.302+0000 7f9683400640 1 -- 172.21.15.31:0/1905295421 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol42470", "target": ["mon-mgr", ""]}) -- 0x7f967c0d24f0 con 0x7f965c0733e0 2024-09-17T05:33:50.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.330+0000 7f9678c00640 1 -- 172.21.15.31:0/1905295421 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7f967c0d24f0 con 0x7f965c0733e0 2024-09-17T05:33:50.332 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b 2024-09-17T05:33:50.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.334+0000 7f9683400640 1 -- 172.21.15.31:0/1905295421 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f965c0733e0 msgr2=0x7f965c0758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:50.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.334+0000 7f9683400640 1 --2- 172.21.15.31:0/1905295421 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f965c0733e0 0x7f965c0758a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f967c166cf0 tx=0x7f96680091e0 comp rx=0 tx=0).stop 2024-09-17T05:33:50.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.334+0000 7f9683400640 1 -- 172.21.15.31:0/1905295421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f967c0afb10 msgr2=0x7f967c15cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:50.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.334+0000 7f9683400640 1 --2- 172.21.15.31:0/1905295421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f967c0afb10 0x7f967c15cf30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f967000c3c0 tx=0x7f967000c880 comp rx=0 tx=0).stop 2024-09-17T05:33:50.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.334+0000 7f9683400640 1 -- 172.21.15.31:0/1905295421 shutdown_connections 2024-09-17T05:33:50.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.334+0000 7f9683400640 1 --2- 172.21.15.31:0/1905295421 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f965c0733e0 0x7f965c0758a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:50.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.334+0000 7f9683400640 1 --2- 172.21.15.31:0/1905295421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f967c1605d0 0x7f967c15efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:50.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.334+0000 7f9683400640 1 --2- 172.21.15.31:0/1905295421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f967c0b1650 0x7f967c15ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:50.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.334+0000 7f9683400640 1 --2- 172.21.15.31:0/1905295421 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f967c0afb10 0x7f967c15cf30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:50.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.334+0000 7f9683400640 1 -- 172.21.15.31:0/1905295421 >> 172.21.15.31:0/1905295421 conn(0x7f967c0d1dd0 msgr2=0x7f967c0cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:50.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.334+0000 7f9683400640 1 -- 172.21.15.31:0/1905295421 shutdown_connections 2024-09-17T05:33:50.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:50.334+0000 7f9683400640 1 -- 172.21.15.31:0/1905295421 wait complete. 2024-09-17T05:33:50.353 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol42470 with 8 files each 1MB size under directory volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b 2024-09-17T05:33:50.353 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:33:50.353 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:50.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:50.362 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T05:33:50.441 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-17T05:33:50.441 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-17T05:33:50.441 INFO:teuthology.orchestra.run.smithi031.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02181 s, 48.1 MB/s 2024-09-17T05:33:50.443 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:33:50.443 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:50.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:50.495 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T05:33:50.565 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-17T05:33:50.565 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-17T05:33:50.566 INFO:teuthology.orchestra.run.smithi031.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019079 s, 55.0 MB/s 2024-09-17T05:33:50.566 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:33:50.566 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:50.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:50.618 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T05:33:50.689 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-17T05:33:50.689 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-17T05:33:50.689 INFO:teuthology.orchestra.run.smithi031.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191271 s, 54.8 MB/s 2024-09-17T05:33:50.690 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:33:50.691 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:50.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:50.742 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T05:33:50.811 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-17T05:33:50.811 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-17T05:33:50.811 INFO:teuthology.orchestra.run.smithi031.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165716 s, 63.3 MB/s 2024-09-17T05:33:50.812 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:33:50.812 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:50.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:50.862 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T05:33:50.931 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-17T05:33:50.931 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-17T05:33:50.931 INFO:teuthology.orchestra.run.smithi031.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169025 s, 62.0 MB/s 2024-09-17T05:33:50.932 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:33:50.932 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:50.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:50.982 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T05:33:51.055 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-17T05:33:51.055 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-17T05:33:51.055 INFO:teuthology.orchestra.run.smithi031.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204496 s, 51.3 MB/s 2024-09-17T05:33:51.056 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:33:51.056 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:51.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:51.110 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T05:33:51.186 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-17T05:33:51.186 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-17T05:33:51.186 INFO:teuthology.orchestra.run.smithi031.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191605 s, 54.7 MB/s 2024-09-17T05:33:51.187 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:33:51.187 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:33:51.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:51.239 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T05:33:51.309 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-17T05:33:51.309 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-17T05:33:51.309 INFO:teuthology.orchestra.run.smithi031.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0181463 s, 57.8 MB/s 2024-09-17T05:33:51.311 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol42470 subvol_snap7800 2024-09-17T05:33:51.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.502+0000 7f6fa8800640 1 -- 172.21.15.31:0/526822233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00cf440 msgr2=0x7f6fa00ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:51.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.502+0000 7f6fa8800640 1 --2- 172.21.15.31:0/526822233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00cf440 0x7f6fa00ce350 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0070c30 tx=0x7f6f9001c8c0 comp rx=0 tx=0).stop 2024-09-17T05:33:51.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.502+0000 7f6fa8800640 1 -- 172.21.15.31:0/526822233 shutdown_connections 2024-09-17T05:33:51.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.502+0000 7f6fa8800640 1 --2- 172.21.15.31:0/526822233 >> v2:172.21.15.155:3300/0 conn(0x7f6fa00ce890 0x7f6fa015df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:51.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.502+0000 7f6fa8800640 1 --2- 172.21.15.31:0/526822233 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00cf440 0x7f6fa00ce350 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:51.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.502+0000 7f6fa8800640 1 --2- 172.21.15.31:0/526822233 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00734f0 0x7f6fa015a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:51.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.502+0000 7f6fa8800640 1 -- 172.21.15.31:0/526822233 >> 172.21.15.31:0/526822233 conn(0x7f6fa00cfbc0 msgr2=0x7f6fa00cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:51.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.502+0000 7f6fa8800640 1 -- 172.21.15.31:0/526822233 shutdown_connections 2024-09-17T05:33:51.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.502+0000 7f6fa8800640 1 -- 172.21.15.31:0/526822233 wait complete. 2024-09-17T05:33:51.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.502+0000 7f6fa8800640 1 Processor -- start 2024-09-17T05:33:51.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.502+0000 7f6fa8800640 1 -- start start 2024-09-17T05:33:51.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa8800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fa00734f0 0x7f6fa0155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:51.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa8800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00ce890 0x7f6fa013cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:51.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa8800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00cf440 0x7f6fa0140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:51.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa8800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa015edb0 con 0x7f6fa00cf440 2024-09-17T05:33:51.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa8800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa015ec30 con 0x7f6fa00734f0 2024-09-17T05:33:51.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa8800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa006eb40 con 0x7f6fa00ce890 2024-09-17T05:33:51.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa6800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00cf440 0x7f6fa0140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:51.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa6800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00cf440 0x7f6fa0140140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45862/0 (socket says 172.21.15.31:45862) 2024-09-17T05:33:51.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa6800640 1 -- 172.21.15.31:0/2754368282 learned_addr learned my addr 172.21.15.31:0/2754368282 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:51.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa5e00640 1 --2- 172.21.15.31:0/2754368282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fa00734f0 0x7f6fa0155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:51.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa5400640 1 --2- 172.21.15.31:0/2754368282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00ce890 0x7f6fa013cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:51.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa6800640 1 -- 172.21.15.31:0/2754368282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00ce890 msgr2=0x7f6fa013cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:51.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa6800640 1 --2- 172.21.15.31:0/2754368282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00ce890 0x7f6fa013cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:51.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa6800640 1 -- 172.21.15.31:0/2754368282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fa00734f0 msgr2=0x7f6fa0155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:51.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa6800640 1 --2- 172.21.15.31:0/2754368282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fa00734f0 0x7f6fa0155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:51.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa6800640 1 -- 172.21.15.31:0/2754368282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa013d460 con 0x7f6fa00cf440 2024-09-17T05:33:51.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa6800640 1 --2- 172.21.15.31:0/2754368282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00cf440 0x7f6fa0140140 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00dd80 tx=0x7f6f9c00b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:51.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6f9a000640 1 -- 172.21.15.31:0/2754368282 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c004d30 con 0x7f6fa00cf440 2024-09-17T05:33:51.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6f9a000640 1 -- 172.21.15.31:0/2754368282 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f9c00be40 con 0x7f6fa00cf440 2024-09-17T05:33:51.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa8800640 1 -- 172.21.15.31:0/2754368282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa013d820 con 0x7f6fa00cf440 2024-09-17T05:33:51.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6f9a000640 1 -- 172.21.15.31:0/2754368282 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c00e8c0 con 0x7f6fa00cf440 2024-09-17T05:33:51.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa8800640 1 -- 172.21.15.31:0/2754368282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa013e0c0 con 0x7f6fa00cf440 2024-09-17T05:33:51.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.506+0000 7f6fa8800640 1 -- 172.21.15.31:0/2754368282 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa0069410 con 0x7f6fa00cf440 2024-09-17T05:33:51.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.510+0000 7f6f9a000640 1 -- 172.21.15.31:0/2754368282 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) ==== 97387+0+0 (secure 0 0 0) 0x7f6f9c00ea60 con 0x7f6fa00cf440 2024-09-17T05:33:51.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.510+0000 7f6f9a000640 1 --2- 172.21.15.31:0/2754368282 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6f840733b0 0x7f6f84075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:51.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.510+0000 7f6f9a000640 1 -- 172.21.15.31:0/2754368282 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f6f9c095170 con 0x7f6fa00cf440 2024-09-17T05:33:51.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.510+0000 7f6fa5e00640 1 --2- 172.21.15.31:0/2754368282 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6f840733b0 0x7f6f84075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:51.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.510+0000 7f6fa5e00640 1 --2- 172.21.15.31:0/2754368282 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6f840733b0 0x7f6f84075870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6f94004630 tx=0x7f6f9400b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:51.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.514+0000 7f6f9a000640 1 -- 172.21.15.31:0/2754368282 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6f9c05f760 con 0x7f6fa00cf440 2024-09-17T05:33:51.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.718+0000 7f6fa8800640 1 -- 172.21.15.31:0/2754368282 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol42470", "snap_name": "subvol_snap7800", "target": ["mon-mgr", ""]}) -- 0x7f6fa013dc20 con 0x7f6f840733b0 2024-09-17T05:33:51.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.750+0000 7f6f9a000640 1 -- 172.21.15.31:0/2754368282 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6f94005020 con 0x7f6f840733b0 2024-09-17T05:33:51.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.750+0000 7f6fa8800640 1 -- 172.21.15.31:0/2754368282 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6f840733b0 msgr2=0x7f6f84075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:51.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.750+0000 7f6fa8800640 1 --2- 172.21.15.31:0/2754368282 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6f840733b0 0x7f6f84075870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6f94004630 tx=0x7f6f9400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:33:51.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.750+0000 7f6fa8800640 1 -- 172.21.15.31:0/2754368282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00cf440 msgr2=0x7f6fa0140140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:51.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.750+0000 7f6fa8800640 1 --2- 172.21.15.31:0/2754368282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00cf440 0x7f6fa0140140 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00dd80 tx=0x7f6f9c00b730 comp rx=0 tx=0).stop 2024-09-17T05:33:51.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.750+0000 7f6fa8800640 1 -- 172.21.15.31:0/2754368282 shutdown_connections 2024-09-17T05:33:51.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.750+0000 7f6fa8800640 1 --2- 172.21.15.31:0/2754368282 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6f840733b0 0x7f6f84075870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:51.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.750+0000 7f6fa8800640 1 --2- 172.21.15.31:0/2754368282 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa00cf440 0x7f6fa0140140 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:51.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.750+0000 7f6fa8800640 1 --2- 172.21.15.31:0/2754368282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa00ce890 0x7f6fa013cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:51.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.750+0000 7f6fa8800640 1 --2- 172.21.15.31:0/2754368282 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fa00734f0 0x7f6fa0155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:51.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.750+0000 7f6fa8800640 1 -- 172.21.15.31:0/2754368282 >> 172.21.15.31:0/2754368282 conn(0x7f6fa00cfbc0 msgr2=0x7f6fa01538c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:51.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.750+0000 7f6fa8800640 1 -- 172.21.15.31:0/2754368282 shutdown_connections 2024-09-17T05:33:51.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.750+0000 7f6fa8800640 1 -- 172.21.15.31:0/2754368282 wait complete. 2024-09-17T05:33:51.773 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol42470 subvol_snap7800 subvol_clone15990 2024-09-17T05:33:51.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.926+0000 7f4855200640 1 -- 172.21.15.31:0/1840235726 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f485015ac70 msgr2=0x7f48500cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:51.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.926+0000 7f4855200640 1 --2- 172.21.15.31:0/1840235726 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f485015ac70 0x7f48500cf2a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4840009870 tx=0x7f484001c750 comp rx=0 tx=0).stop 2024-09-17T05:33:51.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.926+0000 7f4855200640 1 -- 172.21.15.31:0/1840235726 shutdown_connections 2024-09-17T05:33:51.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.926+0000 7f4855200640 1 --2- 172.21.15.31:0/1840235726 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f485015ac70 0x7f48500cf2a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:51.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.926+0000 7f4855200640 1 -- 172.21.15.31:0/1840235726 >> 172.21.15.31:0/1840235726 conn(0x7f48500cd740 msgr2=0x7f48500cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:51.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.926+0000 7f4855200640 1 -- 172.21.15.31:0/1840235726 shutdown_connections 2024-09-17T05:33:51.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.926+0000 7f4855200640 1 -- 172.21.15.31:0/1840235726 wait complete. 2024-09-17T05:33:51.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.926+0000 7f4855200640 1 Processor -- start 2024-09-17T05:33:51.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.926+0000 7f4855200640 1 -- start start 2024-09-17T05:33:51.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.926+0000 7f4855200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48500b2e50 0x7f485006cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:51.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.926+0000 7f4855200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48500cbdb0 0x7f485006d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.926+0000 7f4855200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f485015ac70 0x7f485015b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.926+0000 7f4855200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4850169080 con 0x7f48500cbdb0 2024-09-17T05:33:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.926+0000 7f4855200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4850168f00 con 0x7f485015ac70 2024-09-17T05:33:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.926+0000 7f4855200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4850169200 con 0x7f48500b2e50 2024-09-17T05:33:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.930+0000 7f4847e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48500cbdb0 0x7f485006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.930+0000 7f4847e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48500cbdb0 0x7f485006d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45872/0 (socket says 172.21.15.31:45872) 2024-09-17T05:33:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.930+0000 7f4847e00640 1 -- 172.21.15.31:0/2416797321 learned_addr learned my addr 172.21.15.31:0/2416797321 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.930+0000 7f484de00640 1 --2- 172.21.15.31:0/2416797321 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48500b2e50 0x7f485006cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.930+0000 7f484e800640 1 --2- 172.21.15.31:0/2416797321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f485015ac70 0x7f485015b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.930+0000 7f4847e00640 1 -- 172.21.15.31:0/2416797321 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48500b2e50 msgr2=0x7f485006cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.930+0000 7f4847e00640 1 --2- 172.21.15.31:0/2416797321 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48500b2e50 0x7f485006cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.930+0000 7f4847e00640 1 -- 172.21.15.31:0/2416797321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f485015ac70 msgr2=0x7f485015b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.930+0000 7f4847e00640 1 --2- 172.21.15.31:0/2416797321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f485015ac70 0x7f485015b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.930+0000 7f4847e00640 1 -- 172.21.15.31:0/2416797321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4850070da0 con 0x7f48500cbdb0 2024-09-17T05:33:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.930+0000 7f4847e00640 1 --2- 172.21.15.31:0/2416797321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48500cbdb0 0x7f485006d160 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f483800c500 tx=0x7f483800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.930+0000 7f4846000640 1 -- 172.21.15.31:0/2416797321 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48380052d0 con 0x7f48500cbdb0 2024-09-17T05:33:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.930+0000 7f4846000640 1 -- 172.21.15.31:0/2416797321 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4838005490 con 0x7f48500cbdb0 2024-09-17T05:33:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.930+0000 7f4846000640 1 -- 172.21.15.31:0/2416797321 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838012850 con 0x7f48500cbdb0 2024-09-17T05:33:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.930+0000 7f4855200640 1 -- 172.21.15.31:0/2416797321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4850071080 con 0x7f48500cbdb0 2024-09-17T05:33:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.930+0000 7f4855200640 1 -- 172.21.15.31:0/2416797321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4850071640 con 0x7f48500cbdb0 2024-09-17T05:33:51.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.930+0000 7f4855200640 1 -- 172.21.15.31:0/2416797321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48500cf2a0 con 0x7f48500cbdb0 2024-09-17T05:33:51.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.930+0000 7f4846000640 1 -- 172.21.15.31:0/2416797321 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) ==== 97387+0+0 (secure 0 0 0) 0x7f48380129f0 con 0x7f48500cbdb0 2024-09-17T05:33:51.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.934+0000 7f4846000640 1 --2- 172.21.15.31:0/2416797321 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f482c0733b0 0x7f482c075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:51.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.934+0000 7f4846000640 1 -- 172.21.15.31:0/2416797321 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f4838094110 con 0x7f48500cbdb0 2024-09-17T05:33:51.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.934+0000 7f484de00640 1 --2- 172.21.15.31:0/2416797321 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f482c0733b0 0x7f482c075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:51.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.934+0000 7f484de00640 1 --2- 172.21.15.31:0/2416797321 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f482c0733b0 0x7f482c075870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f48400af000 tx=0x7f484001af90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:51.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:51.938+0000 7f4846000640 1 -- 172.21.15.31:0/2416797321 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f483805e790 con 0x7f48500cbdb0 2024-09-17T05:33:52.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.150+0000 7f4855200640 1 -- 172.21.15.31:0/2416797321 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol42470", "snap_name": "subvol_snap7800", "target_sub_name": "subvol_clone15990", "target": ["mon-mgr", ""]}) -- 0x7f485015c340 con 0x7f482c0733b0 2024-09-17T05:33:52.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.230+0000 7f4846000640 1 -- 172.21.15.31:0/2416797321 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f485015c340 con 0x7f482c0733b0 2024-09-17T05:33:52.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.234+0000 7f4855200640 1 -- 172.21.15.31:0/2416797321 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f482c0733b0 msgr2=0x7f482c075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:52.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.234+0000 7f4855200640 1 --2- 172.21.15.31:0/2416797321 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f482c0733b0 0x7f482c075870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f48400af000 tx=0x7f484001af90 comp rx=0 tx=0).stop 2024-09-17T05:33:52.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.234+0000 7f4855200640 1 -- 172.21.15.31:0/2416797321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48500cbdb0 msgr2=0x7f485006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:52.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.234+0000 7f4855200640 1 --2- 172.21.15.31:0/2416797321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48500cbdb0 0x7f485006d160 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f483800c500 tx=0x7f483800c9c0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.234+0000 7f4855200640 1 -- 172.21.15.31:0/2416797321 shutdown_connections 2024-09-17T05:33:52.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.234+0000 7f4855200640 1 --2- 172.21.15.31:0/2416797321 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f482c0733b0 0x7f482c075870 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.234+0000 7f4855200640 1 --2- 172.21.15.31:0/2416797321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f485015ac70 0x7f485015b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.234+0000 7f4855200640 1 --2- 172.21.15.31:0/2416797321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f48500cbdb0 0x7f485006d160 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.234+0000 7f4855200640 1 --2- 172.21.15.31:0/2416797321 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f48500b2e50 0x7f485006cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.234+0000 7f4855200640 1 -- 172.21.15.31:0/2416797321 >> 172.21.15.31:0/2416797321 conn(0x7f48500cd740 msgr2=0x7f48500ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:52.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.234+0000 7f4855200640 1 -- 172.21.15.31:0/2416797321 shutdown_connections 2024-09-17T05:33:52.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.234+0000 7f4855200640 1 -- 172.21.15.31:0/2416797321 wait complete. 2024-09-17T05:33:52.236 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:33:52.234+0000 7f46fe600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:33:52.236 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:33:52.234+0000 7f46fe600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:33:52.236 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:33:52.234+0000 7f46fe600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:33:52.237 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:33:52.234+0000 7f46fe600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:33:52.237 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:33:52.234+0000 7f46fe600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:33:52.253 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:33:52.250+0000 7f46fd200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:33:52.253 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:33:52.250+0000 7f46fd200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:33:52.254 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:33:52.250+0000 7f46fd200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:33:52.254 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:33:52.250+0000 7f46fd200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:33:52.254 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:33:52.250+0000 7f46fd200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:33:52.260 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone15990 2024-09-17T05:33:52.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d1b200640 1 -- 172.21.15.31:0/3148759200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d1c155080 msgr2=0x7f8d1c0cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:52.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d1b200640 1 --2- 172.21.15.31:0/3148759200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d1c155080 0x7f8d1c0cd510 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009bc0 tx=0x7f8d0c01cba0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d1b200640 1 -- 172.21.15.31:0/3148759200 shutdown_connections 2024-09-17T05:33:52.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d1b200640 1 --2- 172.21.15.31:0/3148759200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d1c155080 0x7f8d1c0cd510 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d1b200640 1 -- 172.21.15.31:0/3148759200 >> 172.21.15.31:0/3148759200 conn(0x7f8d1c06dd30 msgr2=0x7f8d1c06e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:52.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d1b200640 1 -- 172.21.15.31:0/3148759200 shutdown_connections 2024-09-17T05:33:52.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d1b200640 1 -- 172.21.15.31:0/3148759200 wait complete. 2024-09-17T05:33:52.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d1b200640 1 Processor -- start 2024-09-17T05:33:52.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d1b200640 1 -- start start 2024-09-17T05:33:52.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d1b200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d1c0cba70 0x7f8d1c150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:52.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d1b200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d1c0cda50 0x7f8d1c070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:52.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d1b200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d1c155080 0x7f8d1c071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:52.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d1b200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c168fe0 con 0x7f8d1c0cda50 2024-09-17T05:33:52.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d1b200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c168e60 con 0x7f8d1c155080 2024-09-17T05:33:52.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d1b200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8d1c169160 con 0x7f8d1c0cba70 2024-09-17T05:33:52.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d19400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d1c0cda50 0x7f8d1c070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:52.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d19400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d1c0cda50 0x7f8d1c070ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45922/0 (socket says 172.21.15.31:45922) 2024-09-17T05:33:52.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d19400640 1 -- 172.21.15.31:0/1066215402 learned_addr learned my addr 172.21.15.31:0/1066215402 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:52.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d19e00640 1 --2- 172.21.15.31:0/1066215402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d1c0cba70 0x7f8d1c150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:52.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.438+0000 7f8d1a800640 1 --2- 172.21.15.31:0/1066215402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d1c155080 0x7f8d1c071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:52.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.442+0000 7f8d19400640 1 -- 172.21.15.31:0/1066215402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d1c0cba70 msgr2=0x7f8d1c150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:52.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.442+0000 7f8d19400640 1 --2- 172.21.15.31:0/1066215402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d1c0cba70 0x7f8d1c150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.442+0000 7f8d19400640 1 -- 172.21.15.31:0/1066215402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d1c155080 msgr2=0x7f8d1c071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:52.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.442+0000 7f8d19400640 1 --2- 172.21.15.31:0/1066215402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d1c155080 0x7f8d1c071020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.442+0000 7f8d19400640 1 -- 172.21.15.31:0/1066215402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d1c1fbbe0 con 0x7f8d1c0cda50 2024-09-17T05:33:52.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.442+0000 7f8d19e00640 1 --2- 172.21.15.31:0/1066215402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d1c0cba70 0x7f8d1c150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:33:52.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.442+0000 7f8d1a800640 1 --2- 172.21.15.31:0/1066215402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d1c155080 0x7f8d1c071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:33:52.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.442+0000 7f8d19400640 1 --2- 172.21.15.31:0/1066215402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d1c0cda50 0x7f8d1c070ae0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f8d0800c490 tx=0x7f8d0800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:52.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.442+0000 7f8d12000640 1 -- 172.21.15.31:0/1066215402 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d080052d0 con 0x7f8d1c0cda50 2024-09-17T05:33:52.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.442+0000 7f8d12000640 1 -- 172.21.15.31:0/1066215402 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d08005490 con 0x7f8d1c0cda50 2024-09-17T05:33:52.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.442+0000 7f8d12000640 1 -- 172.21.15.31:0/1066215402 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d080038b0 con 0x7f8d1c0cda50 2024-09-17T05:33:52.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.442+0000 7f8d1b200640 1 -- 172.21.15.31:0/1066215402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d1c1fbec0 con 0x7f8d1c0cda50 2024-09-17T05:33:52.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.442+0000 7f8d1b200640 1 -- 172.21.15.31:0/1066215402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d1c1533b0 con 0x7f8d1c0cda50 2024-09-17T05:33:52.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.442+0000 7f8d1b200640 1 -- 172.21.15.31:0/1066215402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d1c0cd510 con 0x7f8d1c0cda50 2024-09-17T05:33:52.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.442+0000 7f8d12000640 1 -- 172.21.15.31:0/1066215402 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) ==== 97387+0+0 (secure 0 0 0) 0x7f8d08003a50 con 0x7f8d1c0cda50 2024-09-17T05:33:52.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.446+0000 7f8d12000640 1 --2- 172.21.15.31:0/1066215402 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8cfc0733b0 0x7f8cfc075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:52.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.446+0000 7f8d12000640 1 -- 172.21.15.31:0/1066215402 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f8d08094130 con 0x7f8d1c0cda50 2024-09-17T05:33:52.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.446+0000 7f8d19e00640 1 --2- 172.21.15.31:0/1066215402 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8cfc0733b0 0x7f8cfc075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:52.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.446+0000 7f8d19e00640 1 --2- 172.21.15.31:0/1066215402 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8cfc0733b0 0x7f8cfc075870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0af000 tx=0x7f8d0c01b3e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:52.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.450+0000 7f8d12000640 1 -- 172.21.15.31:0/1066215402 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8d0805e720 con 0x7f8d1c0cda50 2024-09-17T05:33:52.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.682+0000 7f8d1b200640 1 -- 172.21.15.31:0/1066215402 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone15990", "target": ["mon-mgr", ""]}) -- 0x7f8d1c0c4410 con 0x7f8cfc0733b0 2024-09-17T05:33:52.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.750+0000 7f8d12000640 1 -- 172.21.15.31:0/1066215402 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7f8d1c0c4410 con 0x7f8cfc0733b0 2024-09-17T05:33:52.751 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:33:52.751 INFO:teuthology.orchestra.run.smithi031.stdout: "status": { 2024-09-17T05:33:52.751 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "complete" 2024-09-17T05:33:52.752 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:33:52.752 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:33:52.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.750+0000 7f8d1b200640 1 -- 172.21.15.31:0/1066215402 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8cfc0733b0 msgr2=0x7f8cfc075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:52.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.750+0000 7f8d1b200640 1 --2- 172.21.15.31:0/1066215402 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8cfc0733b0 0x7f8cfc075870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0af000 tx=0x7f8d0c01b3e0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.750+0000 7f8d1b200640 1 -- 172.21.15.31:0/1066215402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d1c0cda50 msgr2=0x7f8d1c070ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:52.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.750+0000 7f8d1b200640 1 --2- 172.21.15.31:0/1066215402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d1c0cda50 0x7f8d1c070ae0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f8d0800c490 tx=0x7f8d0800c950 comp rx=0 tx=0).stop 2024-09-17T05:33:52.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.750+0000 7f8d1b200640 1 -- 172.21.15.31:0/1066215402 shutdown_connections 2024-09-17T05:33:52.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.750+0000 7f8d1b200640 1 --2- 172.21.15.31:0/1066215402 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8cfc0733b0 0x7f8cfc075870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.750+0000 7f8d1b200640 1 --2- 172.21.15.31:0/1066215402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d1c155080 0x7f8d1c071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.750+0000 7f8d1b200640 1 --2- 172.21.15.31:0/1066215402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d1c0cda50 0x7f8d1c070ae0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.750+0000 7f8d1b200640 1 --2- 172.21.15.31:0/1066215402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d1c0cba70 0x7f8d1c150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.750+0000 7f8d1b200640 1 -- 172.21.15.31:0/1066215402 >> 172.21.15.31:0/1066215402 conn(0x7f8d1c06dd30 msgr2=0x7f8d1c1516c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:52.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.750+0000 7f8d1b200640 1 -- 172.21.15.31:0/1066215402 shutdown_connections 2024-09-17T05:33:52.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.754+0000 7f8d1b200640 1 -- 172.21.15.31:0/1066215402 wait complete. 2024-09-17T05:33:52.774 DEBUG:tasks.cephfs.test_volumes:current clone state = complete 2024-09-17T05:33:52.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:52.774 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol_clone15990/.meta) 2024-09-17T05:33:52.796 INFO:teuthology.orchestra.run.smithi031.stdout:[GLOBAL] 2024-09-17T05:33:52.796 INFO:teuthology.orchestra.run.smithi031.stdout:version = 2 2024-09-17T05:33:52.796 INFO:teuthology.orchestra.run.smithi031.stdout:type = clone 2024-09-17T05:33:52.796 INFO:teuthology.orchestra.run.smithi031.stdout:path = /volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98 2024-09-17T05:33:52.796 INFO:teuthology.orchestra.run.smithi031.stdout:state = complete 2024-09-17T05:33:52.796 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:33:52.798 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol42470 2024-09-17T05:33:52.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21d6400640 1 -- 172.21.15.31:0/3645852789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21d00b4a50 msgr2=0x7f21d00ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:52.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21d6400640 1 --2- 172.21.15.31:0/3645852789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21d00b4a50 0x7f21d00ce810 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f21d0069950 tx=0x7f21c801caf0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21d6400640 1 -- 172.21.15.31:0/3645852789 shutdown_connections 2024-09-17T05:33:52.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21d6400640 1 --2- 172.21.15.31:0/3645852789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21d00b4a50 0x7f21d00ce810 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21d6400640 1 --2- 172.21.15.31:0/3645852789 >> v2:172.21.15.155:3300/0 conn(0x7f21d015db50 0x7f21d00acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21d6400640 1 -- 172.21.15.31:0/3645852789 >> 172.21.15.31:0/3645852789 conn(0x7f21d00b18f0 msgr2=0x7f21d00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:52.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21d6400640 1 -- 172.21.15.31:0/3645852789 shutdown_connections 2024-09-17T05:33:52.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21d6400640 1 -- 172.21.15.31:0/3645852789 wait complete. 2024-09-17T05:33:52.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21d6400640 1 Processor -- start 2024-09-17T05:33:52.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21d6400640 1 -- start start 2024-09-17T05:33:52.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21d6400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21d00b4a50 0x7f21d009bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:52.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21d6400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21d00cd100 0x7f21d009aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:52.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21d6400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d015db50 0x7f21d0155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:52.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21d6400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f21d0167120 con 0x7f21d00b4a50 2024-09-17T05:33:52.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21d6400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f21d00cf550 con 0x7f21d015db50 2024-09-17T05:33:52.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21d6400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f21d01672a0 con 0x7f21d00cd100 2024-09-17T05:33:52.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21cf400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21d00b4a50 0x7f21d009bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:52.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21cf400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21d00b4a50 0x7f21d009bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45930/0 (socket says 172.21.15.31:45930) 2024-09-17T05:33:52.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.990+0000 7f21cf400640 1 -- 172.21.15.31:0/1173691479 learned_addr learned my addr 172.21.15.31:0/1173691479 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:52.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.994+0000 7f21c7e00640 1 --2- 172.21.15.31:0/1173691479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21d00cd100 0x7f21d009aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:52.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.994+0000 7f21cfe00640 1 --2- 172.21.15.31:0/1173691479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d015db50 0x7f21d0155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:52.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.994+0000 7f21cf400640 1 -- 172.21.15.31:0/1173691479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21d00cd100 msgr2=0x7f21d009aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:52.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.994+0000 7f21cf400640 1 --2- 172.21.15.31:0/1173691479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21d00cd100 0x7f21d009aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.994+0000 7f21cf400640 1 -- 172.21.15.31:0/1173691479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d015db50 msgr2=0x7f21d0155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:52.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.994+0000 7f21cf400640 1 --2- 172.21.15.31:0/1173691479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d015db50 0x7f21d0155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:52.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.994+0000 7f21cf400640 1 -- 172.21.15.31:0/1173691479 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d009da70 con 0x7f21d00b4a50 2024-09-17T05:33:52.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.994+0000 7f21cf400640 1 --2- 172.21.15.31:0/1173691479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21d00b4a50 0x7f21d009bc30 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f21c000ea90 tx=0x7f21c000ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:52.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.994+0000 7f21c7400640 1 -- 172.21.15.31:0/1173691479 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c001b070 con 0x7f21d00b4a50 2024-09-17T05:33:52.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.994+0000 7f21c7400640 1 -- 172.21.15.31:0/1173691479 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21c000ccb0 con 0x7f21d00b4a50 2024-09-17T05:33:52.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.994+0000 7f21d6400640 1 -- 172.21.15.31:0/1173691479 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d01f5f80 con 0x7f21d00b4a50 2024-09-17T05:33:52.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.994+0000 7f21c7400640 1 -- 172.21.15.31:0/1173691479 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c0016670 con 0x7f21d00b4a50 2024-09-17T05:33:52.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.994+0000 7f21d6400640 1 -- 172.21.15.31:0/1173691479 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d01f6540 con 0x7f21d00b4a50 2024-09-17T05:33:52.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.994+0000 7f21d6400640 1 -- 172.21.15.31:0/1173691479 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d00ce810 con 0x7f21d00b4a50 2024-09-17T05:33:52.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.994+0000 7f21c7400640 1 -- 172.21.15.31:0/1173691479 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) ==== 97387+0+0 (secure 0 0 0) 0x7f21c001e070 con 0x7f21d00b4a50 2024-09-17T05:33:52.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.998+0000 7f21c7400640 1 --2- 172.21.15.31:0/1173691479 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f21ac0733b0 0x7f21ac075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:52.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.998+0000 7f21c7400640 1 -- 172.21.15.31:0/1173691479 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f21c00947e0 con 0x7f21d00b4a50 2024-09-17T05:33:52.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.998+0000 7f21c7e00640 1 --2- 172.21.15.31:0/1173691479 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f21ac0733b0 0x7f21ac075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:52.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:52.998+0000 7f21c7e00640 1 --2- 172.21.15.31:0/1173691479 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f21ac0733b0 0x7f21ac075870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f21d00d07a0 tx=0x7f21b8001420 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:53.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.002+0000 7f21c7400640 1 -- 172.21.15.31:0/1173691479 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f21d009da70 con 0x7f21d00b4a50 2024-09-17T05:33:53.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.206+0000 7f21d6400640 1 -- 172.21.15.31:0/1173691479 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol42470", "target": ["mon-mgr", ""]}) -- 0x7f21d00d04f0 con 0x7f21ac0733b0 2024-09-17T05:33:53.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.218+0000 7f21c7400640 1 -- 172.21.15.31:0/1173691479 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7f21d00d04f0 con 0x7f21ac0733b0 2024-09-17T05:33:53.219 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b 2024-09-17T05:33:53.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.218+0000 7f21d6400640 1 -- 172.21.15.31:0/1173691479 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f21ac0733b0 msgr2=0x7f21ac075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:53.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.218+0000 7f21d6400640 1 --2- 172.21.15.31:0/1173691479 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f21ac0733b0 0x7f21ac075870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f21d00d07a0 tx=0x7f21b8001420 comp rx=0 tx=0).stop 2024-09-17T05:33:53.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.218+0000 7f21d6400640 1 -- 172.21.15.31:0/1173691479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21d00b4a50 msgr2=0x7f21d009bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:53.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.218+0000 7f21d6400640 1 --2- 172.21.15.31:0/1173691479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21d00b4a50 0x7f21d009bc30 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f21c000ea90 tx=0x7f21c000ef50 comp rx=0 tx=0).stop 2024-09-17T05:33:53.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.218+0000 7f21d6400640 1 -- 172.21.15.31:0/1173691479 shutdown_connections 2024-09-17T05:33:53.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.218+0000 7f21d6400640 1 --2- 172.21.15.31:0/1173691479 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f21ac0733b0 0x7f21ac075870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:53.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.218+0000 7f21d6400640 1 --2- 172.21.15.31:0/1173691479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21d015db50 0x7f21d0155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:53.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.218+0000 7f21d6400640 1 --2- 172.21.15.31:0/1173691479 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21d00cd100 0x7f21d009aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:53.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.218+0000 7f21d6400640 1 --2- 172.21.15.31:0/1173691479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f21d00b4a50 0x7f21d009bc30 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:53.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.218+0000 7f21d6400640 1 -- 172.21.15.31:0/1173691479 >> 172.21.15.31:0/1173691479 conn(0x7f21d00b18f0 msgr2=0x7f21d0150130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:53.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.218+0000 7f21d6400640 1 -- 172.21.15.31:0/1173691479 shutdown_connections 2024-09-17T05:33:53.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.218+0000 7f21d6400640 1 -- 172.21.15.31:0/1173691479 wait complete. 2024-09-17T05:33:53.241 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol_clone15990 2024-09-17T05:33:53.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.390+0000 7f2cb1600640 1 -- 172.21.15.31:0/270344530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cac074210 msgr2=0x7f2cac06d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:53.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.390+0000 7f2cb1600640 1 --2- 172.21.15.31:0/270344530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cac074210 0x7f2cac06d420 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009840 tx=0x7f2c9401c790 comp rx=0 tx=0).stop 2024-09-17T05:33:53.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.390+0000 7f2cb1600640 1 -- 172.21.15.31:0/270344530 shutdown_connections 2024-09-17T05:33:53.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.390+0000 7f2cb1600640 1 --2- 172.21.15.31:0/270344530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cac074210 0x7f2cac06d420 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:53.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.390+0000 7f2cb1600640 1 --2- 172.21.15.31:0/270344530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cac15be60 0x7f2cac0d1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:53.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.390+0000 7f2cb1600640 1 -- 172.21.15.31:0/270344530 >> 172.21.15.31:0/270344530 conn(0x7f2cac0d0c70 msgr2=0x7f2cac0d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:53.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.390+0000 7f2cb1600640 1 -- 172.21.15.31:0/270344530 shutdown_connections 2024-09-17T05:33:53.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.390+0000 7f2cb1600640 1 -- 172.21.15.31:0/270344530 wait complete. 2024-09-17T05:33:53.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.390+0000 7f2cb1600640 1 Processor -- start 2024-09-17T05:33:53.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.390+0000 7f2cb1600640 1 -- start start 2024-09-17T05:33:53.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.390+0000 7f2cb1600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cac074210 0x7f2cac14a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:53.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.390+0000 7f2cb1600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cac15be60 0x7f2cac14f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:53.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.390+0000 7f2cb1600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cac15f930 0x7f2cac157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:53.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.390+0000 7f2cb1600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2cac168cd0 con 0x7f2cac15f930 2024-09-17T05:33:53.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.390+0000 7f2cb1600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2cac0cd4d0 con 0x7f2cac15be60 2024-09-17T05:33:53.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.390+0000 7f2cb1600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2cac168e50 con 0x7f2cac074210 2024-09-17T05:33:53.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.394+0000 7f2cab400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cac15f930 0x7f2cac157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:53.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.394+0000 7f2cab400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cac15f930 0x7f2cac157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45964/0 (socket says 172.21.15.31:45964) 2024-09-17T05:33:53.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.394+0000 7f2cab400640 1 -- 172.21.15.31:0/2396248833 learned_addr learned my addr 172.21.15.31:0/2396248833 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:53.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.394+0000 7f2ca3e00640 1 --2- 172.21.15.31:0/2396248833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cac15be60 0x7f2cac14f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:53.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.394+0000 7f2caaa00640 1 --2- 172.21.15.31:0/2396248833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cac074210 0x7f2cac14a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:53.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.394+0000 7f2cab400640 1 -- 172.21.15.31:0/2396248833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cac074210 msgr2=0x7f2cac14a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:53.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.394+0000 7f2cab400640 1 --2- 172.21.15.31:0/2396248833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cac074210 0x7f2cac14a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:53.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.394+0000 7f2cab400640 1 -- 172.21.15.31:0/2396248833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cac15be60 msgr2=0x7f2cac14f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:53.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.394+0000 7f2cab400640 1 --2- 172.21.15.31:0/2396248833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cac15be60 0x7f2cac14f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:53.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.394+0000 7f2cab400640 1 -- 172.21.15.31:0/2396248833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cac14f840 con 0x7f2cac15f930 2024-09-17T05:33:53.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.394+0000 7f2cab400640 1 --2- 172.21.15.31:0/2396248833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cac15f930 0x7f2cac157390 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400cb10 tx=0x7f2ca400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:53.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.394+0000 7f2ca2a00640 1 -- 172.21.15.31:0/2396248833 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4016020 con 0x7f2cac15f930 2024-09-17T05:33:53.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.394+0000 7f2ca2a00640 1 -- 172.21.15.31:0/2396248833 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ca400ce50 con 0x7f2cac15f930 2024-09-17T05:33:53.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.394+0000 7f2ca2a00640 1 -- 172.21.15.31:0/2396248833 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca400ae00 con 0x7f2cac15f930 2024-09-17T05:33:53.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.394+0000 7f2cb1600640 1 -- 172.21.15.31:0/2396248833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cac14fda0 con 0x7f2cac15f930 2024-09-17T05:33:53.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.394+0000 7f2cb1600640 1 -- 172.21.15.31:0/2396248833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cac1f8c50 con 0x7f2cac15f930 2024-09-17T05:33:53.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.394+0000 7f2cb1600640 1 -- 172.21.15.31:0/2396248833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cac06d420 con 0x7f2cac15f930 2024-09-17T05:33:53.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.394+0000 7f2ca2a00640 1 -- 172.21.15.31:0/2396248833 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) ==== 97387+0+0 (secure 0 0 0) 0x7f2ca4019020 con 0x7f2cac15f930 2024-09-17T05:33:53.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.398+0000 7f2ca2a00640 1 --2- 172.21.15.31:0/2396248833 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2c880733b0 0x7f2c88075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:53.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.398+0000 7f2ca2a00640 1 -- 172.21.15.31:0/2396248833 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f2ca40947b0 con 0x7f2cac15f930 2024-09-17T05:33:53.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.398+0000 7f2caaa00640 1 --2- 172.21.15.31:0/2396248833 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2c880733b0 0x7f2c88075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:53.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.398+0000 7f2caaa00640 1 --2- 172.21.15.31:0/2396248833 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2c880733b0 0x7f2c88075870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c005d90 tx=0x7f2c9c00b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:53.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.402+0000 7f2ca2a00640 1 -- 172.21.15.31:0/2396248833 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2ca4020020 con 0x7f2cac15f930 2024-09-17T05:33:53.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.602+0000 7f2cb1600640 1 -- 172.21.15.31:0/2396248833 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol_clone15990", "target": ["mon-mgr", ""]}) -- 0x7f2cac0d0a50 con 0x7f2c880733b0 2024-09-17T05:33:53.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.606+0000 7f2ca2a00640 1 -- 172.21.15.31:0/2396248833 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+73 (secure 0 0 0) 0x7f2cac0d0a50 con 0x7f2c880733b0 2024-09-17T05:33:53.609 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98 2024-09-17T05:33:53.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.610+0000 7f2cb1600640 1 -- 172.21.15.31:0/2396248833 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2c880733b0 msgr2=0x7f2c88075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:53.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.610+0000 7f2cb1600640 1 --2- 172.21.15.31:0/2396248833 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2c880733b0 0x7f2c88075870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c005d90 tx=0x7f2c9c00b390 comp rx=0 tx=0).stop 2024-09-17T05:33:53.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.610+0000 7f2cb1600640 1 -- 172.21.15.31:0/2396248833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cac15f930 msgr2=0x7f2cac157390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:53.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.610+0000 7f2cb1600640 1 --2- 172.21.15.31:0/2396248833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cac15f930 0x7f2cac157390 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400cb10 tx=0x7f2ca400cc00 comp rx=0 tx=0).stop 2024-09-17T05:33:53.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.610+0000 7f2cb1600640 1 -- 172.21.15.31:0/2396248833 shutdown_connections 2024-09-17T05:33:53.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.610+0000 7f2cb1600640 1 --2- 172.21.15.31:0/2396248833 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2c880733b0 0x7f2c88075870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:53.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.610+0000 7f2cb1600640 1 --2- 172.21.15.31:0/2396248833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2cac15f930 0x7f2cac157390 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:53.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.610+0000 7f2cb1600640 1 --2- 172.21.15.31:0/2396248833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cac15be60 0x7f2cac14f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:53.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.610+0000 7f2cb1600640 1 --2- 172.21.15.31:0/2396248833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cac074210 0x7f2cac14a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:53.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.610+0000 7f2cb1600640 1 -- 172.21.15.31:0/2396248833 >> 172.21.15.31:0/2396248833 conn(0x7f2cac0d0c70 msgr2=0x7f2cac151150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:53.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.610+0000 7f2cb1600640 1 -- 172.21.15.31:0/2396248833 shutdown_connections 2024-09-17T05:33:53.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.610+0000 7f2cb1600640 1 -- 172.21.15.31:0/2396248833 wait complete. 2024-09-17T05:33:53.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:53.630 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800) 2024-09-17T05:33:53.641 INFO:teuthology.orchestra.run.smithi031.stdout:9 2024-09-17T05:33:53.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:53.642 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98) 2024-09-17T05:33:53.699 INFO:teuthology.orchestra.run.smithi031.stdout:9 2024-09-17T05:33:53.700 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol_clone15990 2024-09-17T05:33:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.894+0000 7fd7ada00640 1 -- 172.21.15.31:0/1713715764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd78c003ab0 msgr2=0x7fd78c003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.894+0000 7fd7ada00640 1 --2- 172.21.15.31:0/1713715764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd78c003ab0 0x7fd78c003ed0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd7980016c0 tx=0x7fd79801c750 comp rx=0 tx=0).stop 2024-09-17T05:33:53.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.894+0000 7fd7ada00640 1 -- 172.21.15.31:0/1713715764 shutdown_connections 2024-09-17T05:33:53.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.894+0000 7fd7ada00640 1 --2- 172.21.15.31:0/1713715764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd78c003ab0 0x7fd78c003ed0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:53.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.894+0000 7fd7ada00640 1 -- 172.21.15.31:0/1713715764 >> 172.21.15.31:0/1713715764 conn(0x7fd7a809aa10 msgr2=0x7fd7a809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:53.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.894+0000 7fd7ada00640 1 -- 172.21.15.31:0/1713715764 shutdown_connections 2024-09-17T05:33:53.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.894+0000 7fd7ada00640 1 -- 172.21.15.31:0/1713715764 wait complete. 2024-09-17T05:33:53.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.894+0000 7fd7ada00640 1 Processor -- start 2024-09-17T05:33:53.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ada00640 1 -- start start 2024-09-17T05:33:53.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ada00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd78c003ab0 0x7fd7a80b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:53.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ada00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7a8157650 0x7fd7a8157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:53.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ada00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7a81f8470 0x7fd7a81f88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:53.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ada00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a80cf090 con 0x7fd7a81f8470 2024-09-17T05:33:53.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ada00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a80cef10 con 0x7fd7a8157650 2024-09-17T05:33:53.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ada00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a80cf210 con 0x7fd78c003ab0 2024-09-17T05:33:53.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ad000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7a81f8470 0x7fd7a81f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:53.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ad000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7a81f8470 0x7fd7a81f88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45980/0 (socket says 172.21.15.31:45980) 2024-09-17T05:33:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ad000640 1 -- 172.21.15.31:0/3166025683 learned_addr learned my addr 172.21.15.31:0/3166025683 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:33:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7a7e00640 1 --2- 172.21.15.31:0/3166025683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd78c003ab0 0x7fd7a80b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd79fe00640 1 --2- 172.21.15.31:0/3166025683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7a8157650 0x7fd7a8157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ad000640 1 -- 172.21.15.31:0/3166025683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd78c003ab0 msgr2=0x7fd7a80b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ad000640 1 --2- 172.21.15.31:0/3166025683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd78c003ab0 0x7fd7a80b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ad000640 1 -- 172.21.15.31:0/3166025683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7a8157650 msgr2=0x7fd7a8157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ad000640 1 --2- 172.21.15.31:0/3166025683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7a8157650 0x7fd7a8157ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ad000640 1 -- 172.21.15.31:0/3166025683 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a80b5200 con 0x7fd7a81f8470 2024-09-17T05:33:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd79fe00640 1 --2- 172.21.15.31:0/3166025683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7a8157650 0x7fd7a8157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:33:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ad000640 1 --2- 172.21.15.31:0/3166025683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7a81f8470 0x7fd7a81f88d0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8070240 tx=0x7fd7a000e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7a4c00640 1 -- 172.21.15.31:0/3166025683 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0010890 con 0x7fd7a81f8470 2024-09-17T05:33:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7a4c00640 1 -- 172.21.15.31:0/3166025683 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7a0017070 con 0x7fd7a81f8470 2024-09-17T05:33:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7a4c00640 1 -- 172.21.15.31:0/3166025683 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0010de0 con 0x7fd7a81f8470 2024-09-17T05:33:53.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ada00640 1 -- 172.21.15.31:0/3166025683 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a80b54e0 con 0x7fd7a81f8470 2024-09-17T05:33:53.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ada00640 1 -- 172.21.15.31:0/3166025683 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a80b5aa0 con 0x7fd7a81f8470 2024-09-17T05:33:53.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.898+0000 7fd7ada00640 1 -- 172.21.15.31:0/3166025683 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a80cc790 con 0x7fd7a81f8470 2024-09-17T05:33:53.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.902+0000 7fd7a4c00640 1 -- 172.21.15.31:0/3166025683 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 17) ==== 97387+0+0 (secure 0 0 0) 0x7fd7a001c460 con 0x7fd7a81f8470 2024-09-17T05:33:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.902+0000 7fd7a4c00640 1 --2- 172.21.15.31:0/3166025683 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd7840733b0 0x7fd784075870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:33:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.902+0000 7fd7a4c00640 1 -- 172.21.15.31:0/3166025683 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7fd7a0094980 con 0x7fd7a81f8470 2024-09-17T05:33:53.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.902+0000 7fd7a7e00640 1 --2- 172.21.15.31:0/3166025683 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd7840733b0 0x7fd784075870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:33:53.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.902+0000 7fd7a7e00640 1 --2- 172.21.15.31:0/3166025683 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd7840733b0 0x7fd784075870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd78c004790 tx=0x7fd798019540 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:33:53.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:53.906+0000 7fd7a4c00640 1 -- 172.21.15.31:0/3166025683 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd7a005f650 con 0x7fd7a81f8470 2024-09-17T05:33:54.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:54.106+0000 7fd7ada00640 1 -- 172.21.15.31:0/3166025683 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol_clone15990", "target": ["mon-mgr", ""]}) -- 0x7fd7a8069e30 con 0x7fd7840733b0 2024-09-17T05:33:54.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:54.114+0000 7fd7a4c00640 1 -- 172.21.15.31:0/3166025683 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+743 (secure 0 0 0) 0x7fd7980b0040 con 0x7fd7840733b0 2024-09-17T05:33:54.115 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:33:54.115 INFO:teuthology.orchestra.run.smithi031.stdout: "atime": "2024-09-17 05:33:47", 2024-09-17T05:33:54.115 INFO:teuthology.orchestra.run.smithi031.stdout: "bytes_pcent": "80.00", 2024-09-17T05:33:54.115 INFO:teuthology.orchestra.run.smithi031.stdout: "bytes_quota": 10485760, 2024-09-17T05:33:54.115 INFO:teuthology.orchestra.run.smithi031.stdout: "bytes_used": 8388608, 2024-09-17T05:33:54.116 INFO:teuthology.orchestra.run.smithi031.stdout: "created_at": "2024-09-17 05:33:52", 2024-09-17T05:33:54.116 INFO:teuthology.orchestra.run.smithi031.stdout: "ctime": "2024-09-17 05:33:52", 2024-09-17T05:33:54.116 INFO:teuthology.orchestra.run.smithi031.stdout: "data_pool": "cephfs_data", 2024-09-17T05:33:54.116 INFO:teuthology.orchestra.run.smithi031.stdout: "earmark": "", 2024-09-17T05:33:54.116 INFO:teuthology.orchestra.run.smithi031.stdout: "features": [ 2024-09-17T05:33:54.116 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot-clone", 2024-09-17T05:33:54.116 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot-autoprotect", 2024-09-17T05:33:54.116 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot-retention" 2024-09-17T05:33:54.116 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:33:54.116 INFO:teuthology.orchestra.run.smithi031.stdout: "flavor": 2, 2024-09-17T05:33:54.116 INFO:teuthology.orchestra.run.smithi031.stdout: "gid": 1000, 2024-09-17T05:33:54.116 INFO:teuthology.orchestra.run.smithi031.stdout: "mode": 16895, 2024-09-17T05:33:54.116 INFO:teuthology.orchestra.run.smithi031.stdout: "mon_addrs": [ 2024-09-17T05:33:54.117 INFO:teuthology.orchestra.run.smithi031.stdout: "172.21.15.31:6789", 2024-09-17T05:33:54.117 INFO:teuthology.orchestra.run.smithi031.stdout: "172.21.15.155:6789", 2024-09-17T05:33:54.117 INFO:teuthology.orchestra.run.smithi031.stdout: "172.21.15.155:6790" 2024-09-17T05:33:54.117 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2024-09-17T05:33:54.117 INFO:teuthology.orchestra.run.smithi031.stdout: "mtime": "2024-09-17 05:33:51", 2024-09-17T05:33:54.117 INFO:teuthology.orchestra.run.smithi031.stdout: "path": "/volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98", 2024-09-17T05:33:54.117 INFO:teuthology.orchestra.run.smithi031.stdout: "pool_namespace": "", 2024-09-17T05:33:54.117 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "complete", 2024-09-17T05:33:54.117 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "clone", 2024-09-17T05:33:54.117 INFO:teuthology.orchestra.run.smithi031.stdout: "uid": 1000 2024-09-17T05:33:54.117 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:33:54.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:54.114+0000 7fd7ada00640 1 -- 172.21.15.31:0/3166025683 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd7840733b0 msgr2=0x7fd784075870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:54.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:54.114+0000 7fd7ada00640 1 --2- 172.21.15.31:0/3166025683 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd7840733b0 0x7fd784075870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd78c004790 tx=0x7fd798019540 comp rx=0 tx=0).stop 2024-09-17T05:33:54.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:54.114+0000 7fd7ada00640 1 -- 172.21.15.31:0/3166025683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7a81f8470 msgr2=0x7fd7a81f88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:33:54.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:54.114+0000 7fd7ada00640 1 --2- 172.21.15.31:0/3166025683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7a81f8470 0x7fd7a81f88d0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8070240 tx=0x7fd7a000e9a0 comp rx=0 tx=0).stop 2024-09-17T05:33:54.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:54.114+0000 7fd7ada00640 1 -- 172.21.15.31:0/3166025683 shutdown_connections 2024-09-17T05:33:54.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:54.114+0000 7fd7ada00640 1 --2- 172.21.15.31:0/3166025683 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd7840733b0 0x7fd784075870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:54.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:54.114+0000 7fd7ada00640 1 --2- 172.21.15.31:0/3166025683 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7a81f8470 0x7fd7a81f88d0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:54.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:54.114+0000 7fd7ada00640 1 --2- 172.21.15.31:0/3166025683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7a8157650 0x7fd7a8157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:54.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:54.114+0000 7fd7ada00640 1 --2- 172.21.15.31:0/3166025683 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd78c003ab0 0x7fd7a80b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:33:54.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:54.114+0000 7fd7ada00640 1 -- 172.21.15.31:0/3166025683 >> 172.21.15.31:0/3166025683 conn(0x7fd7a809aa10 msgr2=0x7fd7a809adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:33:54.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:54.114+0000 7fd7ada00640 1 -- 172.21.15.31:0/3166025683 shutdown_connections 2024-09-17T05:33:54.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:33:54.114+0000 7fd7ada00640 1 -- 172.21.15.31:0/3166025683 wait complete. 2024-09-17T05:33:54.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:54.137 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800) 2024-09-17T05:33:54.146 INFO:teuthology.orchestra.run.smithi031.stderr:volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800: ceph.quota.max_bytes: No such attribute 2024-09-17T05:33:54.147 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:33:54.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:54.147 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800) 2024-09-17T05:33:54.202 INFO:teuthology.orchestra.run.smithi031.stdout:cephfs_data 2024-09-17T05:33:54.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:54.203 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool_namespace volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800) 2024-09-17T05:33:54.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:54.259 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec find volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800) 2024-09-17T05:33:54.316 INFO:teuthology.orchestra.run.smithi031.stdout:volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800 2024-09-17T05:33:54.317 INFO:teuthology.orchestra.run.smithi031.stdout:volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.2 2024-09-17T05:33:54.317 INFO:teuthology.orchestra.run.smithi031.stdout:volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.5 2024-09-17T05:33:54.317 INFO:teuthology.orchestra.run.smithi031.stdout:volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.4 2024-09-17T05:33:54.317 INFO:teuthology.orchestra.run.smithi031.stdout:volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.7 2024-09-17T05:33:54.317 INFO:teuthology.orchestra.run.smithi031.stdout:volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.6 2024-09-17T05:33:54.317 INFO:teuthology.orchestra.run.smithi031.stdout:volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.0 2024-09-17T05:33:54.317 INFO:teuthology.orchestra.run.smithi031.stdout:volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.3 2024-09-17T05:33:54.317 INFO:teuthology.orchestra.run.smithi031.stdout:volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.1 2024-09-17T05:33:54.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:54.318 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800) 2024-09-17T05:33:54.369 INFO:teuthology.orchestra.run.smithi031.stdout:41ff 2024-09-17T05:33:54.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:54.370 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/) 2024-09-17T05:33:54.421 INFO:teuthology.orchestra.run.smithi031.stdout:41ff 2024-09-17T05:33:54.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:54.422 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800) 2024-09-17T05:33:54.473 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:54.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:54.474 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/) 2024-09-17T05:33:54.529 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:54.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:54.530 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800) 2024-09-17T05:33:54.581 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:54.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:54.582 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/) 2024-09-17T05:33:54.633 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:54.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:54.634 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800) 2024-09-17T05:33:54.685 INFO:teuthology.orchestra.run.smithi031.stdout:1726551231 2024-09-17T05:33:54.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:54.686 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/) 2024-09-17T05:33:54.737 INFO:teuthology.orchestra.run.smithi031.stdout:1726551231 2024-09-17T05:33:54.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:54.739 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.2) 2024-09-17T05:33:54.795 INFO:teuthology.orchestra.run.smithi031.stdout:81b4 2024-09-17T05:33:54.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:54.796 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.2) 2024-09-17T05:33:54.853 INFO:teuthology.orchestra.run.smithi031.stdout:81b4 2024-09-17T05:33:54.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:54.855 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.2) 2024-09-17T05:33:54.910 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:54.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:54.911 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.2) 2024-09-17T05:33:54.965 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:54.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:54.967 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.2) 2024-09-17T05:33:55.021 INFO:teuthology.orchestra.run.smithi031.stdout:1271 2024-09-17T05:33:55.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:55.022 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.2) 2024-09-17T05:33:55.077 INFO:teuthology.orchestra.run.smithi031.stdout:1271 2024-09-17T05:33:55.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:55.078 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.2) 2024-09-17T05:33:55.134 INFO:teuthology.orchestra.run.smithi031.stdout:1726551230 2024-09-17T05:33:55.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:55.135 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.2) 2024-09-17T05:33:55.190 INFO:teuthology.orchestra.run.smithi031.stdout:1726551230 2024-09-17T05:33:55.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:55.191 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.5) 2024-09-17T05:33:55.248 INFO:teuthology.orchestra.run.smithi031.stdout:81b4 2024-09-17T05:33:55.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:55.249 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.5) 2024-09-17T05:33:55.302 INFO:teuthology.orchestra.run.smithi031.stdout:81b4 2024-09-17T05:33:55.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:55.303 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.5) 2024-09-17T05:33:55.353 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:55.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:55.354 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.5) 2024-09-17T05:33:55.405 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:55.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:55.406 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.5) 2024-09-17T05:33:55.461 INFO:teuthology.orchestra.run.smithi031.stdout:1271 2024-09-17T05:33:55.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:55.462 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.5) 2024-09-17T05:33:55.513 INFO:teuthology.orchestra.run.smithi031.stdout:1271 2024-09-17T05:33:55.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:55.514 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.5) 2024-09-17T05:33:55.566 INFO:teuthology.orchestra.run.smithi031.stdout:1726551231 2024-09-17T05:33:55.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:55.567 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.5) 2024-09-17T05:33:55.622 INFO:teuthology.orchestra.run.smithi031.stdout:1726551231 2024-09-17T05:33:55.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:55.623 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.4) 2024-09-17T05:33:55.677 INFO:teuthology.orchestra.run.smithi031.stdout:81b4 2024-09-17T05:33:55.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:55.678 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.4) 2024-09-17T05:33:55.734 INFO:teuthology.orchestra.run.smithi031.stdout:81b4 2024-09-17T05:33:55.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:55.735 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.4) 2024-09-17T05:33:55.786 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:55.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:55.787 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.4) 2024-09-17T05:33:55.841 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:55.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:55.843 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.4) 2024-09-17T05:33:55.893 INFO:teuthology.orchestra.run.smithi031.stdout:1271 2024-09-17T05:33:55.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:55.895 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.4) 2024-09-17T05:33:55.946 INFO:teuthology.orchestra.run.smithi031.stdout:1271 2024-09-17T05:33:55.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:55.947 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.4) 2024-09-17T05:33:57.746 INFO:teuthology.orchestra.run.smithi031.stdout:1726551230 2024-09-17T05:33:57.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:57.747 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.4) 2024-09-17T05:33:57.758 INFO:teuthology.orchestra.run.smithi031.stdout:1726551230 2024-09-17T05:33:57.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:57.759 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.7) 2024-09-17T05:33:57.812 INFO:teuthology.orchestra.run.smithi031.stdout:81b4 2024-09-17T05:33:57.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:57.813 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.7) 2024-09-17T05:33:57.866 INFO:teuthology.orchestra.run.smithi031.stdout:81b4 2024-09-17T05:33:57.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:57.867 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.7) 2024-09-17T05:33:57.918 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:57.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:57.919 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.7) 2024-09-17T05:33:57.974 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:57.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:57.975 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.7) 2024-09-17T05:33:58.026 INFO:teuthology.orchestra.run.smithi031.stdout:1271 2024-09-17T05:33:58.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:58.027 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.7) 2024-09-17T05:33:58.078 INFO:teuthology.orchestra.run.smithi031.stdout:1271 2024-09-17T05:33:58.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:58.079 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.7) 2024-09-17T05:33:58.131 INFO:teuthology.orchestra.run.smithi031.stdout:1726551231 2024-09-17T05:33:58.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:58.132 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.7) 2024-09-17T05:33:58.183 INFO:teuthology.orchestra.run.smithi031.stdout:1726551231 2024-09-17T05:33:58.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:58.184 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.6) 2024-09-17T05:33:58.236 INFO:teuthology.orchestra.run.smithi031.stdout:81b4 2024-09-17T05:33:58.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:58.237 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.6) 2024-09-17T05:33:58.290 INFO:teuthology.orchestra.run.smithi031.stdout:81b4 2024-09-17T05:33:58.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:58.291 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.6) 2024-09-17T05:33:58.342 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:58.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:58.343 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.6) 2024-09-17T05:33:58.394 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:58.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:58.395 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.6) 2024-09-17T05:33:58.446 INFO:teuthology.orchestra.run.smithi031.stdout:1271 2024-09-17T05:33:58.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:58.447 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.6) 2024-09-17T05:33:58.498 INFO:teuthology.orchestra.run.smithi031.stdout:1271 2024-09-17T05:33:58.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:58.501 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.6) 2024-09-17T05:33:58.554 INFO:teuthology.orchestra.run.smithi031.stdout:1726551231 2024-09-17T05:33:58.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:58.556 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.6) 2024-09-17T05:33:58.610 INFO:teuthology.orchestra.run.smithi031.stdout:1726551231 2024-09-17T05:33:58.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:58.612 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.0) 2024-09-17T05:33:58.668 INFO:teuthology.orchestra.run.smithi031.stdout:81b4 2024-09-17T05:33:58.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:58.669 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.0) 2024-09-17T05:33:58.723 INFO:teuthology.orchestra.run.smithi031.stdout:81b4 2024-09-17T05:33:58.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:58.725 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.0) 2024-09-17T05:33:58.779 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:58.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:58.780 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.0) 2024-09-17T05:33:58.834 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:58.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:58.835 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.0) 2024-09-17T05:33:58.886 INFO:teuthology.orchestra.run.smithi031.stdout:1271 2024-09-17T05:33:58.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:58.887 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.0) 2024-09-17T05:33:58.942 INFO:teuthology.orchestra.run.smithi031.stdout:1271 2024-09-17T05:33:58.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:58.943 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.0) 2024-09-17T05:33:59.001 INFO:teuthology.orchestra.run.smithi031.stdout:1726551230 2024-09-17T05:33:59.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:59.003 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.0) 2024-09-17T05:33:59.058 INFO:teuthology.orchestra.run.smithi031.stdout:1726551230 2024-09-17T05:33:59.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:59.060 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.3) 2024-09-17T05:33:59.116 INFO:teuthology.orchestra.run.smithi031.stdout:81b4 2024-09-17T05:33:59.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:59.117 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.3) 2024-09-17T05:33:59.170 INFO:teuthology.orchestra.run.smithi031.stdout:81b4 2024-09-17T05:33:59.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:59.172 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.3) 2024-09-17T05:33:59.222 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:59.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:59.223 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.3) 2024-09-17T05:33:59.278 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:59.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:59.279 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.3) 2024-09-17T05:33:59.334 INFO:teuthology.orchestra.run.smithi031.stdout:1271 2024-09-17T05:33:59.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:59.335 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.3) 2024-09-17T05:33:59.386 INFO:teuthology.orchestra.run.smithi031.stdout:1271 2024-09-17T05:33:59.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:59.387 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.3) 2024-09-17T05:33:59.442 INFO:teuthology.orchestra.run.smithi031.stdout:1726551230 2024-09-17T05:33:59.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:59.443 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.3) 2024-09-17T05:33:59.494 INFO:teuthology.orchestra.run.smithi031.stdout:1726551230 2024-09-17T05:33:59.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:59.495 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.1) 2024-09-17T05:33:59.547 INFO:teuthology.orchestra.run.smithi031.stdout:81b4 2024-09-17T05:33:59.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:59.549 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.1) 2024-09-17T05:33:59.599 INFO:teuthology.orchestra.run.smithi031.stdout:81b4 2024-09-17T05:33:59.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:59.600 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.1) 2024-09-17T05:33:59.650 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:59.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:59.651 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.1) 2024-09-17T05:33:59.706 INFO:teuthology.orchestra.run.smithi031.stdout:1000 2024-09-17T05:33:59.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:59.707 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.1) 2024-09-17T05:33:59.762 INFO:teuthology.orchestra.run.smithi031.stdout:1271 2024-09-17T05:33:59.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:59.763 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.1) 2024-09-17T05:33:59.815 INFO:teuthology.orchestra.run.smithi031.stdout:1271 2024-09-17T05:33:59.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:59.816 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b/.snap/subvol_snap7800/subvolume_file.1) 2024-09-17T05:33:59.869 INFO:teuthology.orchestra.run.smithi031.stdout:1726551230 2024-09-17T05:33:59.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:33:59.871 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone15990/2ef1e91f-2b10-4aa7-8ca1-729f3096aa98/subvolume_file.1) 2024-09-17T05:33:59.926 INFO:teuthology.orchestra.run.smithi031.stdout:1726551230 2024-09-17T05:33:59.928 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol42470 fake subvol_clone83471 2024-09-17T05:34:00.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.130+0000 7f0c2ae00640 1 -- 172.21.15.31:0/1675778256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c240cebf0 msgr2=0x7f0c240cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:00.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.130+0000 7f0c2ae00640 1 --2- 172.21.15.31:0/1675778256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c240cebf0 0x7f0c240cc8b0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f0c240b7e50 tx=0x7f0c0c01c6e0 comp rx=0 tx=0).stop 2024-09-17T05:34:00.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.130+0000 7f0c2ae00640 1 -- 172.21.15.31:0/1675778256 shutdown_connections 2024-09-17T05:34:00.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.130+0000 7f0c2ae00640 1 --2- 172.21.15.31:0/1675778256 >> v2:172.21.15.155:3300/0 conn(0x7f0c240b6400 0x7f0c240ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:00.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.130+0000 7f0c2ae00640 1 --2- 172.21.15.31:0/1675778256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c240cebf0 0x7f0c240cc8b0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:00.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.130+0000 7f0c2ae00640 1 -- 172.21.15.31:0/1675778256 >> 172.21.15.31:0/1675778256 conn(0x7f0c240d1da0 msgr2=0x7f0c240d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:00.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.130+0000 7f0c2ae00640 1 -- 172.21.15.31:0/1675778256 shutdown_connections 2024-09-17T05:34:00.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.130+0000 7f0c2ae00640 1 -- 172.21.15.31:0/1675778256 wait complete. 2024-09-17T05:34:00.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c2ae00640 1 Processor -- start 2024-09-17T05:34:00.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c2ae00640 1 -- start start 2024-09-17T05:34:00.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c2ae00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c240b6400 0x7f0c240715e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:00.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c2ae00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c240cebf0 0x7f0c2414af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:00.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c2ae00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2415be80 0x7f0c2414b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:00.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c2ae00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0c24169210 con 0x7f0c240b6400 2024-09-17T05:34:00.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c2ae00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0c24169090 con 0x7f0c240cebf0 2024-09-17T05:34:00.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c2ae00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0c24169390 con 0x7f0c2415be80 2024-09-17T05:34:00.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c23e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c240b6400 0x7f0c240715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:00.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c23e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c240b6400 0x7f0c240715e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47182/0 (socket says 172.21.15.31:47182) 2024-09-17T05:34:00.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c23e00640 1 -- 172.21.15.31:0/1162003907 learned_addr learned my addr 172.21.15.31:0/1162003907 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:00.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c1b400640 1 --2- 172.21.15.31:0/1162003907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c240cebf0 0x7f0c2414af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:00.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c28e00640 1 --2- 172.21.15.31:0/1162003907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2415be80 0x7f0c2414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:00.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c23e00640 1 -- 172.21.15.31:0/1162003907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2415be80 msgr2=0x7f0c2414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:00.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c23e00640 1 --2- 172.21.15.31:0/1162003907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2415be80 0x7f0c2414b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:00.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c23e00640 1 -- 172.21.15.31:0/1162003907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c240cebf0 msgr2=0x7f0c2414af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:00.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c23e00640 1 --2- 172.21.15.31:0/1162003907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c240cebf0 0x7f0c2414af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:00.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c23e00640 1 -- 172.21.15.31:0/1162003907 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c240cbe60 con 0x7f0c240b6400 2024-09-17T05:34:00.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c23e00640 1 --2- 172.21.15.31:0/1162003907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c240b6400 0x7f0c240715e0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0c1400b410 tx=0x7f0c1400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:00.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c20c00640 1 -- 172.21.15.31:0/1162003907 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c14015030 con 0x7f0c240b6400 2024-09-17T05:34:00.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c20c00640 1 -- 172.21.15.31:0/1162003907 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c14004020 con 0x7f0c240b6400 2024-09-17T05:34:00.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c2ae00640 1 -- 172.21.15.31:0/1162003907 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c241fb430 con 0x7f0c240b6400 2024-09-17T05:34:00.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c20c00640 1 -- 172.21.15.31:0/1162003907 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c140044b0 con 0x7f0c240b6400 2024-09-17T05:34:00.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.134+0000 7f0c2ae00640 1 -- 172.21.15.31:0/1162003907 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c241fb9f0 con 0x7f0c240b6400 2024-09-17T05:34:00.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.138+0000 7f0c2ae00640 1 -- 172.21.15.31:0/1162003907 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c240ce4e0 con 0x7f0c240b6400 2024-09-17T05:34:00.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.138+0000 7f0c20c00640 1 -- 172.21.15.31:0/1162003907 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) ==== 97489+0+0 (secure 0 0 0) 0x7f0c14018070 con 0x7f0c240b6400 2024-09-17T05:34:00.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.138+0000 7f0c20c00640 1 --2- 172.21.15.31:0/1162003907 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c000734d0 0x7f0c00075990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:00.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.138+0000 7f0c20c00640 1 -- 172.21.15.31:0/1162003907 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f0c140942c0 con 0x7f0c240b6400 2024-09-17T05:34:00.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.138+0000 7f0c1b400640 1 --2- 172.21.15.31:0/1162003907 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c000734d0 0x7f0c00075990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:00.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.138+0000 7f0c1b400640 1 --2- 172.21.15.31:0/1162003907 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c000734d0 0x7f0c00075990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c0ae000 tx=0x7f0c0c01af20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:00.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.142+0000 7f0c20c00640 1 -- 172.21.15.31:0/1162003907 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0c1405ef20 con 0x7f0c240b6400 2024-09-17T05:34:00.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.358+0000 7f0c2ae00640 1 -- 172.21.15.31:0/1162003907 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol42470", "snap_name": "fake", "target_sub_name": "subvol_clone83471", "target": ["mon-mgr", ""]}) -- 0x7f0c24070e60 con 0x7f0c000734d0 2024-09-17T05:34:00.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.430+0000 7f0c20c00640 1 -- 172.21.15.31:0/1162003907 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0c24070e60 con 0x7f0c000734d0 2024-09-17T05:34:00.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.434+0000 7f0c2ae00640 1 -- 172.21.15.31:0/1162003907 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c000734d0 msgr2=0x7f0c00075990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:00.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.434+0000 7f0c2ae00640 1 --2- 172.21.15.31:0/1162003907 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c000734d0 0x7f0c00075990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c0ae000 tx=0x7f0c0c01af20 comp rx=0 tx=0).stop 2024-09-17T05:34:00.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.434+0000 7f0c2ae00640 1 -- 172.21.15.31:0/1162003907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c240b6400 msgr2=0x7f0c240715e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:00.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.434+0000 7f0c2ae00640 1 --2- 172.21.15.31:0/1162003907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c240b6400 0x7f0c240715e0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0c1400b410 tx=0x7f0c1400b8d0 comp rx=0 tx=0).stop 2024-09-17T05:34:00.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.434+0000 7f0c2ae00640 1 -- 172.21.15.31:0/1162003907 shutdown_connections 2024-09-17T05:34:00.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.434+0000 7f0c2ae00640 1 --2- 172.21.15.31:0/1162003907 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c000734d0 0x7f0c00075990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:00.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.434+0000 7f0c2ae00640 1 --2- 172.21.15.31:0/1162003907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c2415be80 0x7f0c2414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:00.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.434+0000 7f0c2ae00640 1 --2- 172.21.15.31:0/1162003907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c240cebf0 0x7f0c2414af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:00.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.434+0000 7f0c2ae00640 1 --2- 172.21.15.31:0/1162003907 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c240b6400 0x7f0c240715e0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:00.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.434+0000 7f0c2ae00640 1 -- 172.21.15.31:0/1162003907 >> 172.21.15.31:0/1162003907 conn(0x7f0c240d1da0 msgr2=0x7f0c240d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:00.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.434+0000 7f0c2ae00640 1 -- 172.21.15.31:0/1162003907 shutdown_connections 2024-09-17T05:34:00.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.434+0000 7f0c2ae00640 1 -- 172.21.15.31:0/1162003907 wait complete. 2024-09-17T05:34:00.456 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone83471 2024-09-17T05:34:00.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.602+0000 7f9e1aa00640 1 -- 172.21.15.31:0/2347425497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e140cdf20 msgr2=0x7f9e140b1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:00.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.602+0000 7f9e1aa00640 1 --2- 172.21.15.31:0/2347425497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e140cdf20 0x7f9e140b1860 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c009c80 tx=0x7f9e0c01cd70 comp rx=0 tx=0).stop 2024-09-17T05:34:00.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.602+0000 7f9e1aa00640 1 -- 172.21.15.31:0/2347425497 shutdown_connections 2024-09-17T05:34:00.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.602+0000 7f9e1aa00640 1 --2- 172.21.15.31:0/2347425497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e140cdf20 0x7f9e140b1860 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:00.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.602+0000 7f9e1aa00640 1 --2- 172.21.15.31:0/2347425497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e140b3bb0 0x7f9e140b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:00.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.602+0000 7f9e1aa00640 1 -- 172.21.15.31:0/2347425497 >> 172.21.15.31:0/2347425497 conn(0x7f9e140d1e00 msgr2=0x7f9e140d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:00.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.602+0000 7f9e1aa00640 1 -- 172.21.15.31:0/2347425497 shutdown_connections 2024-09-17T05:34:00.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.602+0000 7f9e1aa00640 1 -- 172.21.15.31:0/2347425497 wait complete. 2024-09-17T05:34:00.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e1aa00640 1 Processor -- start 2024-09-17T05:34:00.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e1aa00640 1 -- start start 2024-09-17T05:34:00.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e1aa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e140b3bb0 0x7f9e1414c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:00.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e1aa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e140cdf20 0x7f9e140b7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:00.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e1aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e1415f340 0x7f9e140713f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:00.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e1aa00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9e14168f90 con 0x7f9e1415f340 2024-09-17T05:34:00.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e1aa00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9e14168e10 con 0x7f9e140cdf20 2024-09-17T05:34:00.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e1aa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9e14169110 con 0x7f9e140b3bb0 2024-09-17T05:34:00.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e18a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e1415f340 0x7f9e140713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:00.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e18a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e1415f340 0x7f9e140713f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47192/0 (socket says 172.21.15.31:47192) 2024-09-17T05:34:00.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e18a00640 1 -- 172.21.15.31:0/3078348627 learned_addr learned my addr 172.21.15.31:0/3078348627 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:00.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e0b400640 1 --2- 172.21.15.31:0/3078348627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e140cdf20 0x7f9e140b7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:00.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e13e00640 1 --2- 172.21.15.31:0/3078348627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e140b3bb0 0x7f9e1414c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:00.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e18a00640 1 -- 172.21.15.31:0/3078348627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e140b3bb0 msgr2=0x7f9e1414c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:00.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e18a00640 1 --2- 172.21.15.31:0/3078348627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e140b3bb0 0x7f9e1414c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:00.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e18a00640 1 -- 172.21.15.31:0/3078348627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e140cdf20 msgr2=0x7f9e140b7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:00.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e18a00640 1 --2- 172.21.15.31:0/3078348627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e140cdf20 0x7f9e140b7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:00.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e18a00640 1 -- 172.21.15.31:0/3078348627 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e140c84f0 con 0x7f9e1415f340 2024-09-17T05:34:00.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e18a00640 1 --2- 172.21.15.31:0/3078348627 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e1415f340 0x7f9e140713f0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c01b420 tx=0x7f9e0c003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:00.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e10c00640 1 -- 172.21.15.31:0/3078348627 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0bb070 con 0x7f9e1415f340 2024-09-17T05:34:00.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e10c00640 1 -- 172.21.15.31:0/3078348627 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e0c004d40 con 0x7f9e1415f340 2024-09-17T05:34:00.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e10c00640 1 -- 172.21.15.31:0/3078348627 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0b2040 con 0x7f9e1415f340 2024-09-17T05:34:00.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e1aa00640 1 -- 172.21.15.31:0/3078348627 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e140b6e90 con 0x7f9e1415f340 2024-09-17T05:34:00.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.606+0000 7f9e1aa00640 1 -- 172.21.15.31:0/3078348627 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e1414cb10 con 0x7f9e1415f340 2024-09-17T05:34:00.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.610+0000 7f9e1aa00640 1 -- 172.21.15.31:0/3078348627 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e140b6c80 con 0x7f9e1415f340 2024-09-17T05:34:00.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.610+0000 7f9e10c00640 1 -- 172.21.15.31:0/3078348627 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) ==== 97489+0+0 (secure 0 0 0) 0x7f9e0c0ad850 con 0x7f9e1415f340 2024-09-17T05:34:00.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.610+0000 7f9e10c00640 1 --2- 172.21.15.31:0/3078348627 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9df00734d0 0x7f9df0075990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:00.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.610+0000 7f9e10c00640 1 -- 172.21.15.31:0/3078348627 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f9e0c12e460 con 0x7f9e1415f340 2024-09-17T05:34:00.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.610+0000 7f9e13e00640 1 --2- 172.21.15.31:0/3078348627 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9df00734d0 0x7f9df0075990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:00.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.610+0000 7f9e13e00640 1 --2- 172.21.15.31:0/3078348627 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9df00734d0 0x7f9df0075990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9e04000f70 tx=0x7f9e04009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:00.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.614+0000 7f9e10c00640 1 -- 172.21.15.31:0/3078348627 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9e0c0f2120 con 0x7f9e1415f340 2024-09-17T05:34:00.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:00.830+0000 7f9e1aa00640 1 -- 172.21.15.31:0/3078348627 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone83471", "target": ["mon-mgr", ""]}) -- 0x7f9e140c82a0 con 0x7f9df00734d0 2024-09-17T05:34:02.759 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:02.758+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:02.759 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:02.758+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:02.759 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:02.758+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:02.759 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:02.758+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:02.759 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:02.758+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:02.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:02.774+0000 7f9e10c00640 1 -- 172.21.15.31:0/3078348627 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+153 (secure 0 0 0) 0x7f9e140c82a0 con 0x7f9df00734d0 2024-09-17T05:34:02.775 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:34:02.775 INFO:teuthology.orchestra.run.smithi031.stdout: "status": { 2024-09-17T05:34:02.775 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "pending", 2024-09-17T05:34:02.775 INFO:teuthology.orchestra.run.smithi031.stdout: "source": { 2024-09-17T05:34:02.775 INFO:teuthology.orchestra.run.smithi031.stdout: "volume": "cephfs", 2024-09-17T05:34:02.776 INFO:teuthology.orchestra.run.smithi031.stdout: "subvolume": "subvol42470", 2024-09-17T05:34:02.776 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot": "fake" 2024-09-17T05:34:02.776 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:02.776 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:02.776 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:34:02.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:02.774+0000 7f9e1aa00640 1 -- 172.21.15.31:0/3078348627 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9df00734d0 msgr2=0x7f9df0075990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:02.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:02.774+0000 7f9e1aa00640 1 --2- 172.21.15.31:0/3078348627 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9df00734d0 0x7f9df0075990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9e04000f70 tx=0x7f9e04009040 comp rx=0 tx=0).stop 2024-09-17T05:34:02.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:02.774+0000 7f9e1aa00640 1 -- 172.21.15.31:0/3078348627 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e1415f340 msgr2=0x7f9e140713f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:02.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:02.774+0000 7f9e1aa00640 1 --2- 172.21.15.31:0/3078348627 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e1415f340 0x7f9e140713f0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c01b420 tx=0x7f9e0c003f40 comp rx=0 tx=0).stop 2024-09-17T05:34:02.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:02.778+0000 7f9e1aa00640 1 -- 172.21.15.31:0/3078348627 shutdown_connections 2024-09-17T05:34:02.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:02.778+0000 7f9e1aa00640 1 --2- 172.21.15.31:0/3078348627 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9df00734d0 0x7f9df0075990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:02.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:02.778+0000 7f9e1aa00640 1 --2- 172.21.15.31:0/3078348627 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e1415f340 0x7f9e140713f0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:02.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:02.778+0000 7f9e1aa00640 1 --2- 172.21.15.31:0/3078348627 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e140cdf20 0x7f9e140b7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:02.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:02.778+0000 7f9e1aa00640 1 --2- 172.21.15.31:0/3078348627 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e140b3bb0 0x7f9e1414c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:02.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:02.778+0000 7f9e1aa00640 1 -- 172.21.15.31:0/3078348627 >> 172.21.15.31:0/3078348627 conn(0x7f9e140d1e00 msgr2=0x7f9e140aea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:02.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:02.778+0000 7f9e1aa00640 1 -- 172.21.15.31:0/3078348627 shutdown_connections 2024-09-17T05:34:02.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:02.778+0000 7f9e1aa00640 1 -- 172.21.15.31:0/3078348627 wait complete. 2024-09-17T05:34:02.806 DEBUG:tasks.cephfs.test_volumes:current clone state = pending 2024-09-17T05:34:03.808 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone83471 2024-09-17T05:34:03.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.970+0000 7fd95f200640 1 -- 172.21.15.31:0/4039582330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96015bd40 msgr2=0x7fd9600d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:03.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.970+0000 7fd95f200640 1 --2- 172.21.15.31:0/4039582330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96015bd40 0x7fd9600d0240 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fd960073190 tx=0x7fd95001c600 comp rx=0 tx=0).stop 2024-09-17T05:34:03.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.970+0000 7fd95f200640 1 -- 172.21.15.31:0/4039582330 shutdown_connections 2024-09-17T05:34:03.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.970+0000 7fd95f200640 1 --2- 172.21.15.31:0/4039582330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9600d20f0 0x7fd9600ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:03.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.970+0000 7fd95f200640 1 --2- 172.21.15.31:0/4039582330 >> v2:172.21.15.155:3300/0 conn(0x7fd9600b0d10 0x7fd9600d1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:03.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.970+0000 7fd95f200640 1 --2- 172.21.15.31:0/4039582330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96015bd40 0x7fd9600d0240 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:03.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.970+0000 7fd95f200640 1 -- 172.21.15.31:0/4039582330 >> 172.21.15.31:0/4039582330 conn(0x7fd96009aa10 msgr2=0x7fd96009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:03.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.970+0000 7fd95f200640 1 -- 172.21.15.31:0/4039582330 shutdown_connections 2024-09-17T05:34:03.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.970+0000 7fd95f200640 1 -- 172.21.15.31:0/4039582330 wait complete. 2024-09-17T05:34:03.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.970+0000 7fd95f200640 1 Processor -- start 2024-09-17T05:34:03.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.970+0000 7fd95f200640 1 -- start start 2024-09-17T05:34:03.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9600b0d10 0x7fd96014b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:03.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9600d20f0 0x7fd9600ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:03.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96015bd40 0x7fd9600caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:03.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd9600ccdc0 con 0x7fd96015bd40 2024-09-17T05:34:03.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95f200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd9600ccc40 con 0x7fd9600d20f0 2024-09-17T05:34:03.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd9600ccf40 con 0x7fd9600b0d10 2024-09-17T05:34:03.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96015bd40 0x7fd9600caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:03.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96015bd40 0x7fd9600caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47238/0 (socket says 172.21.15.31:47238) 2024-09-17T05:34:03.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95e800640 1 -- 172.21.15.31:0/4183664218 learned_addr learned my addr 172.21.15.31:0/4183664218 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:03.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd955400640 1 --2- 172.21.15.31:0/4183664218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9600d20f0 0x7fd9600ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:03.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95de00640 1 --2- 172.21.15.31:0/4183664218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9600b0d10 0x7fd96014b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:03.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95e800640 1 -- 172.21.15.31:0/4183664218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9600b0d10 msgr2=0x7fd96014b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:03.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95e800640 1 --2- 172.21.15.31:0/4183664218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9600b0d10 0x7fd96014b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:03.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95e800640 1 -- 172.21.15.31:0/4183664218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9600d20f0 msgr2=0x7fd9600ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:03.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95e800640 1 --2- 172.21.15.31:0/4183664218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9600d20f0 0x7fd9600ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:03.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95e800640 1 -- 172.21.15.31:0/4183664218 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9600cb210 con 0x7fd96015bd40 2024-09-17T05:34:03.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd955400640 1 --2- 172.21.15.31:0/4183664218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9600d20f0 0x7fd9600ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:34:03.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95de00640 1 --2- 172.21.15.31:0/4183664218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9600b0d10 0x7fd96014b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:34:03.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95e800640 1 --2- 172.21.15.31:0/4183664218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96015bd40 0x7fd9600caa80 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fd95800eb20 tx=0x7fd95800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:03.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd956a00640 1 -- 172.21.15.31:0/4183664218 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958004b30 con 0x7fd96015bd40 2024-09-17T05:34:03.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd956a00640 1 -- 172.21.15.31:0/4183664218 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd958004cf0 con 0x7fd96015bd40 2024-09-17T05:34:03.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95f200640 1 -- 172.21.15.31:0/4183664218 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9600b7630 con 0x7fd96015bd40 2024-09-17T05:34:03.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd956a00640 1 -- 172.21.15.31:0/4183664218 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958005280 con 0x7fd96015bd40 2024-09-17T05:34:03.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95f200640 1 -- 172.21.15.31:0/4183664218 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9600cb760 con 0x7fd96015bd40 2024-09-17T05:34:03.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd95f200640 1 -- 172.21.15.31:0/4183664218 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd96009adf0 con 0x7fd96015bd40 2024-09-17T05:34:03.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.974+0000 7fd956a00640 1 -- 172.21.15.31:0/4183664218 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 18) ==== 97489+0+0 (secure 0 0 0) 0x7fd958005420 con 0x7fd96015bd40 2024-09-17T05:34:03.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.978+0000 7fd956a00640 1 --2- 172.21.15.31:0/4183664218 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd93c0734d0 0x7fd93c075990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:03.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.978+0000 7fd956a00640 1 -- 172.21.15.31:0/4183664218 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7fd958095590 con 0x7fd96015bd40 2024-09-17T05:34:03.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.978+0000 7fd95de00640 1 --2- 172.21.15.31:0/4183664218 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd93c0734d0 0x7fd93c075990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:03.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.978+0000 7fd95de00640 1 --2- 172.21.15.31:0/4183664218 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd93c0734d0 0x7fd93c075990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd9500ae000 tx=0x7fd95001ae40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:03.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:03.982+0000 7fd956a00640 1 -- 172.21.15.31:0/4183664218 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd958060080 con 0x7fd96015bd40 2024-09-17T05:34:04.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:04.194+0000 7fd95f200640 1 -- 172.21.15.31:0/4183664218 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone83471", "target": ["mon-mgr", ""]}) -- 0x7fd960069e30 con 0x7fd93c0734d0 2024-09-17T05:34:04.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:04.798+0000 7fd956a00640 1 -- 172.21.15.31:0/4183664218 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 19) ==== 97540+0+0 (secure 0 0 0) 0x7fd95805bbf0 con 0x7fd96015bd40 2024-09-17T05:34:07.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:07.754+0000 7fd956a00640 1 -- 172.21.15.31:0/4183664218 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7fd9500af040 con 0x7fd93c0734d0 2024-09-17T05:34:07.755 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:34:07.755 INFO:teuthology.orchestra.run.smithi031.stdout: "status": { 2024-09-17T05:34:07.755 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "complete" 2024-09-17T05:34:07.755 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:07.755 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:34:07.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:07.754+0000 7fd95f200640 1 -- 172.21.15.31:0/4183664218 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd93c0734d0 msgr2=0x7fd93c075990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:07.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:07.754+0000 7fd95f200640 1 --2- 172.21.15.31:0/4183664218 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd93c0734d0 0x7fd93c075990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd9500ae000 tx=0x7fd95001ae40 comp rx=0 tx=0).stop 2024-09-17T05:34:07.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:07.754+0000 7fd95f200640 1 -- 172.21.15.31:0/4183664218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96015bd40 msgr2=0x7fd9600caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:07.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:07.754+0000 7fd95f200640 1 --2- 172.21.15.31:0/4183664218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96015bd40 0x7fd9600caa80 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fd95800eb20 tx=0x7fd95800c2d0 comp rx=0 tx=0).stop 2024-09-17T05:34:07.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:07.754+0000 7fd95f200640 1 -- 172.21.15.31:0/4183664218 shutdown_connections 2024-09-17T05:34:07.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:07.754+0000 7fd95f200640 1 --2- 172.21.15.31:0/4183664218 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd93c0734d0 0x7fd93c075990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:07.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:07.754+0000 7fd95f200640 1 --2- 172.21.15.31:0/4183664218 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd96015bd40 0x7fd9600caa80 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:07.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:07.754+0000 7fd95f200640 1 --2- 172.21.15.31:0/4183664218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9600d20f0 0x7fd9600ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:07.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:07.754+0000 7fd95f200640 1 --2- 172.21.15.31:0/4183664218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9600b0d10 0x7fd96014b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:07.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:07.754+0000 7fd95f200640 1 -- 172.21.15.31:0/4183664218 >> 172.21.15.31:0/4183664218 conn(0x7fd96009aa10 msgr2=0x7fd960155ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:07.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:07.758+0000 7fd95f200640 1 -- 172.21.15.31:0/4183664218 shutdown_connections 2024-09-17T05:34:07.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:07.758+0000 7fd95f200640 1 -- 172.21.15.31:0/4183664218 wait complete. 2024-09-17T05:34:07.782 DEBUG:tasks.cephfs.test_volumes:current clone state = complete 2024-09-17T05:34:07.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:07.783 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol_clone83471/.meta) 2024-09-17T05:34:07.805 INFO:teuthology.orchestra.run.smithi031.stdout:[GLOBAL] 2024-09-17T05:34:07.805 INFO:teuthology.orchestra.run.smithi031.stdout:version = 2 2024-09-17T05:34:07.805 INFO:teuthology.orchestra.run.smithi031.stdout:type = clone 2024-09-17T05:34:07.805 INFO:teuthology.orchestra.run.smithi031.stdout:path = /volumes/_nogroup/subvol_clone83471/59c98df1-3adc-410c-9f90-1fc0643c893e 2024-09-17T05:34:07.805 INFO:teuthology.orchestra.run.smithi031.stdout:state = complete 2024-09-17T05:34:07.805 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:07.808 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot info cephfs subvol42470 subvol_snap7800 2024-09-17T05:34:08.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f7171600640 1 -- 172.21.15.31:0/1601211903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f716c0b0b60 msgr2=0x7f716c0ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:08.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f7171600640 1 --2- 172.21.15.31:0/1601211903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f716c0b0b60 0x7f716c0ccbd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7164009c80 tx=0x7f716401f5a0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f7171600640 1 -- 172.21.15.31:0/1601211903 shutdown_connections 2024-09-17T05:34:08.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f7171600640 1 --2- 172.21.15.31:0/1601211903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f716c0b0b60 0x7f716c0ccbd0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f7171600640 1 --2- 172.21.15.31:0/1601211903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f716c15be10 0x7f716c0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f7171600640 1 -- 172.21.15.31:0/1601211903 >> 172.21.15.31:0/1601211903 conn(0x7f716c0d1da0 msgr2=0x7f716c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:08.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f7171600640 1 -- 172.21.15.31:0/1601211903 shutdown_connections 2024-09-17T05:34:08.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f7171600640 1 -- 172.21.15.31:0/1601211903 wait complete. 2024-09-17T05:34:08.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f7171600640 1 Processor -- start 2024-09-17T05:34:08.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f7171600640 1 -- start start 2024-09-17T05:34:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f7171600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f716c0b0b60 0x7f716c15ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f7171600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f716c15be10 0x7f716c14a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f7171600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f716c15c1f0 0x7f716c15c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f7171600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f716c0cd4a0 con 0x7f716c15c1f0 2024-09-17T05:34:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f7171600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f716c0cd320 con 0x7f716c0b0b60 2024-09-17T05:34:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f7171600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f716c0cd620 con 0x7f716c15be10 2024-09-17T05:34:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f716b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f716c15c1f0 0x7f716c15c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f716aa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f716c0b0b60 0x7f716c15ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f716b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f716c15c1f0 0x7f716c15c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47240/0 (socket says 172.21.15.31:47240) 2024-09-17T05:34:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f716b400640 1 -- 172.21.15.31:0/1196532262 learned_addr learned my addr 172.21.15.31:0/1196532262 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:08.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.002+0000 7f7162000640 1 --2- 172.21.15.31:0/1196532262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f716c15be10 0x7f716c14a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:08.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.006+0000 7f716b400640 1 -- 172.21.15.31:0/1196532262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f716c15be10 msgr2=0x7f716c14a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:08.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.006+0000 7f716b400640 1 --2- 172.21.15.31:0/1196532262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f716c15be10 0x7f716c14a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.006+0000 7f716b400640 1 -- 172.21.15.31:0/1196532262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f716c0b0b60 msgr2=0x7f716c15ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:08.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.006+0000 7f716b400640 1 --2- 172.21.15.31:0/1196532262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f716c0b0b60 0x7f716c15ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.006+0000 7f716b400640 1 -- 172.21.15.31:0/1196532262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716c14a620 con 0x7f716c15c1f0 2024-09-17T05:34:08.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.006+0000 7f716b400640 1 --2- 172.21.15.31:0/1196532262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f716c15c1f0 0x7f716c15c870 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f7164009bd0 tx=0x7f7164009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:08.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.006+0000 7f7163400640 1 -- 172.21.15.31:0/1196532262 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164004e60 con 0x7f716c15c1f0 2024-09-17T05:34:08.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.006+0000 7f7163400640 1 -- 172.21.15.31:0/1196532262 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71640be030 con 0x7f716c15c1f0 2024-09-17T05:34:08.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.006+0000 7f7171600640 1 -- 172.21.15.31:0/1196532262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f716c15cdb0 con 0x7f716c15c1f0 2024-09-17T05:34:08.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.006+0000 7f7163400640 1 -- 172.21.15.31:0/1196532262 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71640afb00 con 0x7f716c15c1f0 2024-09-17T05:34:08.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.006+0000 7f7171600640 1 -- 172.21.15.31:0/1196532262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f716c1595e0 con 0x7f716c15c1f0 2024-09-17T05:34:08.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.006+0000 7f7171600640 1 -- 172.21.15.31:0/1196532262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f716c0cdb10 con 0x7f716c15c1f0 2024-09-17T05:34:08.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.006+0000 7f7163400640 1 -- 172.21.15.31:0/1196532262 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) ==== 97540+0+0 (secure 0 0 0) 0x7f71640afca0 con 0x7f716c15c1f0 2024-09-17T05:34:08.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.010+0000 7f7163400640 1 --2- 172.21.15.31:0/1196532262 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7148073560 0x7f7148075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:08.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.010+0000 7f7163400640 1 -- 172.21.15.31:0/1196532262 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f71641332e0 con 0x7f716c15c1f0 2024-09-17T05:34:08.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.010+0000 7f716aa00640 1 --2- 172.21.15.31:0/1196532262 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7148073560 0x7f7148075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:08.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.010+0000 7f716aa00640 1 --2- 172.21.15.31:0/1196532262 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7148073560 0x7f7148075a20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f716c158090 tx=0x7f715c0091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:08.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.014+0000 7f7163400640 1 -- 172.21.15.31:0/1196532262 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f716c15cdb0 con 0x7f716c15c1f0 2024-09-17T05:34:08.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.222+0000 7f7171600640 1 -- 172.21.15.31:0/1196532262 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot info", "vol_name": "cephfs", "sub_name": "subvol42470", "snap_name": "subvol_snap7800", "target": ["mon-mgr", ""]}) -- 0x7f716c0c8770 con 0x7f7148073560 2024-09-17T05:34:08.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.234+0000 7f7163400640 1 -- 172.21.15.31:0/1196532262 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+115 (secure 0 0 0) 0x7f716c0c8770 con 0x7f7148073560 2024-09-17T05:34:08.236 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:34:08.236 INFO:teuthology.orchestra.run.smithi031.stdout: "created_at": "2024-09-17 05:33:51.747744", 2024-09-17T05:34:08.236 INFO:teuthology.orchestra.run.smithi031.stdout: "data_pool": "cephfs_data", 2024-09-17T05:34:08.236 INFO:teuthology.orchestra.run.smithi031.stdout: "has_pending_clones": "no" 2024-09-17T05:34:08.236 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:34:08.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.238+0000 7f7171600640 1 -- 172.21.15.31:0/1196532262 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7148073560 msgr2=0x7f7148075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.238+0000 7f7171600640 1 --2- 172.21.15.31:0/1196532262 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7148073560 0x7f7148075a20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f716c158090 tx=0x7f715c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.238+0000 7f7171600640 1 -- 172.21.15.31:0/1196532262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f716c15c1f0 msgr2=0x7f716c15c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.238+0000 7f7171600640 1 --2- 172.21.15.31:0/1196532262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f716c15c1f0 0x7f716c15c870 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f7164009bd0 tx=0x7f7164009390 comp rx=0 tx=0).stop 2024-09-17T05:34:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.238+0000 7f7171600640 1 -- 172.21.15.31:0/1196532262 shutdown_connections 2024-09-17T05:34:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.238+0000 7f7171600640 1 --2- 172.21.15.31:0/1196532262 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7148073560 0x7f7148075a20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.238+0000 7f7171600640 1 --2- 172.21.15.31:0/1196532262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f716c15c1f0 0x7f716c15c870 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.238+0000 7f7171600640 1 --2- 172.21.15.31:0/1196532262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f716c15be10 0x7f716c14a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.238+0000 7f7171600640 1 --2- 172.21.15.31:0/1196532262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f716c0b0b60 0x7f716c15ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.238+0000 7f7171600640 1 -- 172.21.15.31:0/1196532262 >> 172.21.15.31:0/1196532262 conn(0x7f716c0d1da0 msgr2=0x7f716c15faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.238+0000 7f7171600640 1 -- 172.21.15.31:0/1196532262 shutdown_connections 2024-09-17T05:34:08.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.238+0000 7f7171600640 1 -- 172.21.15.31:0/1196532262 wait complete. 2024-09-17T05:34:08.258 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs subvol42470 2024-09-17T05:34:08.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ffb800640 1 -- 172.21.15.31:0/1665055732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ff415be10 msgr2=0x7f8ff40ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:08.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ffb800640 1 --2- 172.21.15.31:0/1665055732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ff415be10 0x7f8ff40ce700 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4074e00 tx=0x7f8fe401f0b0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ffb800640 1 -- 172.21.15.31:0/1665055732 shutdown_connections 2024-09-17T05:34:08.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ffb800640 1 --2- 172.21.15.31:0/1665055732 >> v2:172.21.15.155:3300/0 conn(0x7f8ff40b0b60 0x7f8ff40cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ffb800640 1 --2- 172.21.15.31:0/1665055732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff415c1f0 0x7f8ff40cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ffb800640 1 --2- 172.21.15.31:0/1665055732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ff415be10 0x7f8ff40ce700 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ffb800640 1 -- 172.21.15.31:0/1665055732 >> 172.21.15.31:0/1665055732 conn(0x7f8ff40d1da0 msgr2=0x7f8ff40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:08.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ffb800640 1 -- 172.21.15.31:0/1665055732 shutdown_connections 2024-09-17T05:34:08.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ffb800640 1 -- 172.21.15.31:0/1665055732 wait complete. 2024-09-17T05:34:08.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ffb800640 1 Processor -- start 2024-09-17T05:34:08.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ffb800640 1 -- start start 2024-09-17T05:34:08.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ffb800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff40b0b60 0x7f8ff40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:08.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ffb800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ff415be10 0x7f8ff41f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:08.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ffb800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff415c1f0 0x7f8ff41f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:08.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ffb800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41600a0 con 0x7f8ff415be10 2024-09-17T05:34:08.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ffb800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff415ff20 con 0x7f8ff40b0b60 2024-09-17T05:34:08.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ffb800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff4160220 con 0x7f8ff415c1f0 2024-09-17T05:34:08.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8febe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ff415be10 0x7f8ff41f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:08.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8febe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ff415be10 0x7f8ff41f5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:47248/0 (socket says 172.21.15.31:47248) 2024-09-17T05:34:08.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8febe00640 1 -- 172.21.15.31:0/728719056 learned_addr learned my addr 172.21.15.31:0/728719056 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:08.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ff8e00640 1 --2- 172.21.15.31:0/728719056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff40b0b60 0x7f8ff40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:08.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8ff9800640 1 --2- 172.21.15.31:0/728719056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff415c1f0 0x7f8ff41f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:08.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8febe00640 1 -- 172.21.15.31:0/728719056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff415c1f0 msgr2=0x7f8ff41f6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:08.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8febe00640 1 --2- 172.21.15.31:0/728719056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff415c1f0 0x7f8ff41f6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8febe00640 1 -- 172.21.15.31:0/728719056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff40b0b60 msgr2=0x7f8ff40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:08.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8febe00640 1 --2- 172.21.15.31:0/728719056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff40b0b60 0x7f8ff40cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8febe00640 1 -- 172.21.15.31:0/728719056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff4159da0 con 0x7f8ff415be10 2024-09-17T05:34:08.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.410+0000 7f8febe00640 1 --2- 172.21.15.31:0/728719056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ff415be10 0x7f8ff41f5e00 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00c970 tx=0x7f8fdc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:08.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.414+0000 7f8ff1600640 1 -- 172.21.15.31:0/728719056 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc004220 con 0x7f8ff415be10 2024-09-17T05:34:08.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.414+0000 7f8ff1600640 1 -- 172.21.15.31:0/728719056 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8fdc0079b0 con 0x7f8ff415be10 2024-09-17T05:34:08.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.414+0000 7f8ff1600640 1 -- 172.21.15.31:0/728719056 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0044b0 con 0x7f8ff415be10 2024-09-17T05:34:08.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.414+0000 7f8ffb800640 1 -- 172.21.15.31:0/728719056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff40c81d0 con 0x7f8ff415be10 2024-09-17T05:34:08.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.414+0000 7f8ffb800640 1 -- 172.21.15.31:0/728719056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff415a320 con 0x7f8ff415be10 2024-09-17T05:34:08.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.414+0000 7f8ffb800640 1 -- 172.21.15.31:0/728719056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff41606d0 con 0x7f8ff415be10 2024-09-17T05:34:08.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.414+0000 7f8ff1600640 1 -- 172.21.15.31:0/728719056 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) ==== 97540+0+0 (secure 0 0 0) 0x7f8fdc003600 con 0x7f8ff415be10 2024-09-17T05:34:08.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.418+0000 7f8ff1600640 1 --2- 172.21.15.31:0/728719056 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8fd0073590 0x7f8fd0075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:08.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.418+0000 7f8ff1600640 1 -- 172.21.15.31:0/728719056 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f8fdc0949a0 con 0x7f8ff415be10 2024-09-17T05:34:08.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.418+0000 7f8ff8e00640 1 --2- 172.21.15.31:0/728719056 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8fd0073590 0x7f8fd0075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:08.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.418+0000 7f8ff8e00640 1 --2- 172.21.15.31:0/728719056 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8fd0073590 0x7f8fd0075a50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40b2000 tx=0x7f8fe401d8f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:08.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.422+0000 7f8ff1600640 1 -- 172.21.15.31:0/728719056 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8fdc014030 con 0x7f8ff415be10 2024-09-17T05:34:08.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.626+0000 7f8ffb800640 1 -- 172.21.15.31:0/728719056 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "subvol42470", "target": ["mon-mgr", ""]}) -- 0x7f8ff40cebd0 con 0x7f8fd0073590 2024-09-17T05:34:08.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.638+0000 7f8ff1600640 1 -- 172.21.15.31:0/728719056 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+86 (secure 0 0 0) 0x7f8ff40cebd0 con 0x7f8fd0073590 2024-09-17T05:34:08.639 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:34:08.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:08.640 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "fake" 2024-09-17T05:34:08.640 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:08.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:08.640 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "subvol_snap7800" 2024-09-17T05:34:08.640 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:08.640 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:34:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.638+0000 7f8ffb800640 1 -- 172.21.15.31:0/728719056 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8fd0073590 msgr2=0x7f8fd0075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.638+0000 7f8ffb800640 1 --2- 172.21.15.31:0/728719056 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8fd0073590 0x7f8fd0075a50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40b2000 tx=0x7f8fe401d8f0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.638+0000 7f8ffb800640 1 -- 172.21.15.31:0/728719056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ff415be10 msgr2=0x7f8ff41f5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.638+0000 7f8ffb800640 1 --2- 172.21.15.31:0/728719056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ff415be10 0x7f8ff41f5e00 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00c970 tx=0x7f8fdc00ce30 comp rx=0 tx=0).stop 2024-09-17T05:34:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.638+0000 7f8ffb800640 1 -- 172.21.15.31:0/728719056 shutdown_connections 2024-09-17T05:34:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.638+0000 7f8ffb800640 1 --2- 172.21.15.31:0/728719056 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8fd0073590 0x7f8fd0075a50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.638+0000 7f8ffb800640 1 --2- 172.21.15.31:0/728719056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8ff415c1f0 0x7f8ff41f6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.638+0000 7f8ffb800640 1 --2- 172.21.15.31:0/728719056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ff415be10 0x7f8ff41f5e00 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.638+0000 7f8ffb800640 1 --2- 172.21.15.31:0/728719056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ff40b0b60 0x7f8ff40cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.638+0000 7f8ffb800640 1 -- 172.21.15.31:0/728719056 >> 172.21.15.31:0/728719056 conn(0x7f8ff40d1da0 msgr2=0x7f8ff40af890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:08.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.642+0000 7f8ffb800640 1 -- 172.21.15.31:0/728719056 shutdown_connections 2024-09-17T05:34:08.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.642+0000 7f8ffb800640 1 -- 172.21.15.31:0/728719056 wait complete. 2024-09-17T05:34:08.661 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol42470 subvol_snap7800 2024-09-17T05:34:08.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a66c00640 1 -- 172.21.15.31:0/2135990014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a6015ffd0 msgr2=0x7f8a600d2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:08.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a66c00640 1 --2- 172.21.15.31:0/2135990014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a6015ffd0 0x7f8a600d2910 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f8a50005fd0 tx=0x7f8a5001c760 comp rx=0 tx=0).stop 2024-09-17T05:34:08.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a66c00640 1 -- 172.21.15.31:0/2135990014 shutdown_connections 2024-09-17T05:34:08.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a66c00640 1 --2- 172.21.15.31:0/2135990014 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a601603b0 0x7f8a60160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a66c00640 1 --2- 172.21.15.31:0/2135990014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a6015ffd0 0x7f8a600d2910 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a66c00640 1 -- 172.21.15.31:0/2135990014 >> 172.21.15.31:0/2135990014 conn(0x7f8a600d1df0 msgr2=0x7f8a600d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:08.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a66c00640 1 -- 172.21.15.31:0/2135990014 shutdown_connections 2024-09-17T05:34:08.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a66c00640 1 -- 172.21.15.31:0/2135990014 wait complete. 2024-09-17T05:34:08.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a66c00640 1 Processor -- start 2024-09-17T05:34:08.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a66c00640 1 -- start start 2024-09-17T05:34:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a66c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a600af580 0x7f8a6015b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a66c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6015ffd0 0x7f8a6006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a66c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a601603b0 0x7f8a6015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:08.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a66c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8a601691d0 con 0x7f8a600af580 2024-09-17T05:34:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a66c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8a60169050 con 0x7f8a6015ffd0 2024-09-17T05:34:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a66c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8a60169350 con 0x7f8a601603b0 2024-09-17T05:34:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a5fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a600af580 0x7f8a6015b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a5fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a600af580 0x7f8a6015b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60404/0 (socket says 172.21.15.31:60404) 2024-09-17T05:34:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a5fe00640 1 -- 172.21.15.31:0/3102268361 learned_addr learned my addr 172.21.15.31:0/3102268361 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a64c00640 1 --2- 172.21.15.31:0/3102268361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a601603b0 0x7f8a6015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.818+0000 7f8a5f400640 1 --2- 172.21.15.31:0/3102268361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6015ffd0 0x7f8a6006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.822+0000 7f8a5fe00640 1 -- 172.21.15.31:0/3102268361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a601603b0 msgr2=0x7f8a6015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.822+0000 7f8a5fe00640 1 --2- 172.21.15.31:0/3102268361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a601603b0 0x7f8a6015a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.822+0000 7f8a5fe00640 1 -- 172.21.15.31:0/3102268361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6015ffd0 msgr2=0x7f8a6006e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.822+0000 7f8a5fe00640 1 --2- 172.21.15.31:0/3102268361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6015ffd0 0x7f8a6006e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.822+0000 7f8a5fe00640 1 -- 172.21.15.31:0/3102268361 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a601f7c80 con 0x7f8a600af580 2024-09-17T05:34:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.822+0000 7f8a64c00640 1 --2- 172.21.15.31:0/3102268361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a601603b0 0x7f8a6015a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:08.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.822+0000 7f8a5f400640 1 --2- 172.21.15.31:0/3102268361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6015ffd0 0x7f8a6006e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:08.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.822+0000 7f8a5fe00640 1 --2- 172.21.15.31:0/3102268361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a600af580 0x7f8a6015b020 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009790 tx=0x7f8a50005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:08.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.822+0000 7f8a57e00640 1 -- 172.21.15.31:0/3102268361 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a500bb020 con 0x7f8a600af580 2024-09-17T05:34:08.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.822+0000 7f8a57e00640 1 -- 172.21.15.31:0/3102268361 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a50004bd0 con 0x7f8a600af580 2024-09-17T05:34:08.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.822+0000 7f8a66c00640 1 -- 172.21.15.31:0/3102268361 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a601f7f60 con 0x7f8a600af580 2024-09-17T05:34:08.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.822+0000 7f8a57e00640 1 -- 172.21.15.31:0/3102268361 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a500041f0 con 0x7f8a600af580 2024-09-17T05:34:08.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.822+0000 7f8a66c00640 1 -- 172.21.15.31:0/3102268361 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a601f8520 con 0x7f8a600af580 2024-09-17T05:34:08.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.822+0000 7f8a66c00640 1 -- 172.21.15.31:0/3102268361 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a600d2910 con 0x7f8a600af580 2024-09-17T05:34:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.822+0000 7f8a57e00640 1 -- 172.21.15.31:0/3102268361 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) ==== 97540+0+0 (secure 0 0 0) 0x7f8a500be020 con 0x7f8a600af580 2024-09-17T05:34:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.822+0000 7f8a57e00640 1 --2- 172.21.15.31:0/3102268361 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8a40073560 0x7f8a40075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.822+0000 7f8a57e00640 1 -- 172.21.15.31:0/3102268361 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f8a5012f4f0 con 0x7f8a600af580 2024-09-17T05:34:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.826+0000 7f8a5f400640 1 --2- 172.21.15.31:0/3102268361 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8a40073560 0x7f8a40075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:08.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.826+0000 7f8a5f400640 1 --2- 172.21.15.31:0/3102268361 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8a40073560 0x7f8a40075a20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8a60165d50 tx=0x7f8a4c00b5b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:08.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:08.826+0000 7f8a57e00640 1 -- 172.21.15.31:0/3102268361 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8a500c5030 con 0x7f8a600af580 2024-09-17T05:34:09.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.038+0000 7f8a66c00640 1 -- 172.21.15.31:0/3102268361 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol42470", "snap_name": "subvol_snap7800", "target": ["mon-mgr", ""]}) -- 0x7f8a601f8760 con 0x7f8a40073560 2024-09-17T05:34:09.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.062+0000 7f8a57e00640 1 -- 172.21.15.31:0/3102268361 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8a4c00b7c0 con 0x7f8a40073560 2024-09-17T05:34:09.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.066+0000 7f8a66c00640 1 -- 172.21.15.31:0/3102268361 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8a40073560 msgr2=0x7f8a40075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:09.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.066+0000 7f8a66c00640 1 --2- 172.21.15.31:0/3102268361 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8a40073560 0x7f8a40075a20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8a60165d50 tx=0x7f8a4c00b5b0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.066+0000 7f8a66c00640 1 -- 172.21.15.31:0/3102268361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a600af580 msgr2=0x7f8a6015b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:09.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.066+0000 7f8a66c00640 1 --2- 172.21.15.31:0/3102268361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a600af580 0x7f8a6015b020 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009790 tx=0x7f8a50005ce0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.066+0000 7f8a66c00640 1 -- 172.21.15.31:0/3102268361 shutdown_connections 2024-09-17T05:34:09.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.066+0000 7f8a66c00640 1 --2- 172.21.15.31:0/3102268361 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8a40073560 0x7f8a40075a20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.066+0000 7f8a66c00640 1 --2- 172.21.15.31:0/3102268361 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a601603b0 0x7f8a6015a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.066+0000 7f8a66c00640 1 --2- 172.21.15.31:0/3102268361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6015ffd0 0x7f8a6006e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.066+0000 7f8a66c00640 1 --2- 172.21.15.31:0/3102268361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a600af580 0x7f8a6015b020 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.066+0000 7f8a66c00640 1 -- 172.21.15.31:0/3102268361 >> 172.21.15.31:0/3102268361 conn(0x7f8a600d1df0 msgr2=0x7f8a600af9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:09.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.066+0000 7f8a66c00640 1 -- 172.21.15.31:0/3102268361 shutdown_connections 2024-09-17T05:34:09.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.066+0000 7f8a66c00640 1 -- 172.21.15.31:0/3102268361 wait complete. 2024-09-17T05:34:09.086 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol42470 fake 2024-09-17T05:34:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.238+0000 7f71eb800640 1 -- 172.21.15.31:0/4071421296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71cc003a60 msgr2=0x7f71cc003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.238+0000 7f71eb800640 1 --2- 172.21.15.31:0/4071421296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71cc003a60 0x7f71cc003e80 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f71d800c2e0 tx=0x7f71d801f6a0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.238+0000 7f71eb800640 1 -- 172.21.15.31:0/4071421296 shutdown_connections 2024-09-17T05:34:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.238+0000 7f71eb800640 1 --2- 172.21.15.31:0/4071421296 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71cc003a60 0x7f71cc003e80 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.238+0000 7f71eb800640 1 -- 172.21.15.31:0/4071421296 >> 172.21.15.31:0/4071421296 conn(0x7f71e40d1da0 msgr2=0x7f71e40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.238+0000 7f71eb800640 1 -- 172.21.15.31:0/4071421296 shutdown_connections 2024-09-17T05:34:09.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.238+0000 7f71eb800640 1 -- 172.21.15.31:0/4071421296 wait complete. 2024-09-17T05:34:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71eb800640 1 Processor -- start 2024-09-17T05:34:09.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71eb800640 1 -- start start 2024-09-17T05:34:09.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71eb800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71cc003a60 0x7f71e41f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:09.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71eb800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71e41f6820 0x7f71e40b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:09.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71eb800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e4148940 0x7f71e40b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:09.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71eb800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f71e40ceae0 con 0x7f71e4148940 2024-09-17T05:34:09.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71eb800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f71e40ce960 con 0x7f71cc003a60 2024-09-17T05:34:09.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71eb800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f71e40cec60 con 0x7f71e41f6820 2024-09-17T05:34:09.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71e9800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e4148940 0x7f71e40b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:09.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71e9800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e4148940 0x7f71e40b2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60424/0 (socket says 172.21.15.31:60424) 2024-09-17T05:34:09.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71e9800640 1 -- 172.21.15.31:0/2433911714 learned_addr learned my addr 172.21.15.31:0/2433911714 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:09.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71e3e00640 1 --2- 172.21.15.31:0/2433911714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71e41f6820 0x7f71e40b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:09.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71e8e00640 1 --2- 172.21.15.31:0/2433911714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71cc003a60 0x7f71e41f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:09.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71e9800640 1 -- 172.21.15.31:0/2433911714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71e41f6820 msgr2=0x7f71e40b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:09.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71e9800640 1 --2- 172.21.15.31:0/2433911714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71e41f6820 0x7f71e40b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71e9800640 1 -- 172.21.15.31:0/2433911714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71cc003a60 msgr2=0x7f71e41f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:09.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71e9800640 1 --2- 172.21.15.31:0/2433911714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71cc003a60 0x7f71e41f62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71e9800640 1 -- 172.21.15.31:0/2433911714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e4148ed0 con 0x7f71e4148940 2024-09-17T05:34:09.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71e9800640 1 --2- 172.21.15.31:0/2433911714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e4148940 0x7f71e40b2df0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f71e415c630 tx=0x7f71dc00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:09.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71e0c00640 1 -- 172.21.15.31:0/2433911714 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc004b30 con 0x7f71e4148940 2024-09-17T05:34:09.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71e0c00640 1 -- 172.21.15.31:0/2433911714 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71dc004cd0 con 0x7f71e4148940 2024-09-17T05:34:09.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71e0c00640 1 -- 172.21.15.31:0/2433911714 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc003be0 con 0x7f71e4148940 2024-09-17T05:34:09.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.242+0000 7f71eb800640 1 -- 172.21.15.31:0/2433911714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e41491b0 con 0x7f71e4148940 2024-09-17T05:34:09.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.246+0000 7f71eb800640 1 -- 172.21.15.31:0/2433911714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e4149770 con 0x7f71e4148940 2024-09-17T05:34:09.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.246+0000 7f71eb800640 1 -- 172.21.15.31:0/2433911714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71e40cf1c0 con 0x7f71e4148940 2024-09-17T05:34:09.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.246+0000 7f71e0c00640 1 -- 172.21.15.31:0/2433911714 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) ==== 97540+0+0 (secure 0 0 0) 0x7f71dc004050 con 0x7f71e4148940 2024-09-17T05:34:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.246+0000 7f71e0c00640 1 --2- 172.21.15.31:0/2433911714 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f71c4073590 0x7f71c4075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.246+0000 7f71e0c00640 1 -- 172.21.15.31:0/2433911714 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f71dc0954f0 con 0x7f71e4148940 2024-09-17T05:34:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.246+0000 7f71e8e00640 1 --2- 172.21.15.31:0/2433911714 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f71c4073590 0x7f71c4075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.246+0000 7f71e8e00640 1 --2- 172.21.15.31:0/2433911714 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f71c4073590 0x7f71c4075a50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f71d80b0000 tx=0x7f71d801c4e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:09.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.250+0000 7f71e0c00640 1 -- 172.21.15.31:0/2433911714 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f71dc05f9b0 con 0x7f71e4148940 2024-09-17T05:34:09.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.454+0000 7f71eb800640 1 -- 172.21.15.31:0/2433911714 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol42470", "snap_name": "fake", "target": ["mon-mgr", ""]}) -- 0x7f71e4070350 con 0x7f71c4073590 2024-09-17T05:34:09.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.486+0000 7f71e0c00640 1 -- 172.21.15.31:0/2433911714 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f71e4070350 con 0x7f71c4073590 2024-09-17T05:34:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.486+0000 7f71eb800640 1 -- 172.21.15.31:0/2433911714 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f71c4073590 msgr2=0x7f71c4075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.486+0000 7f71eb800640 1 --2- 172.21.15.31:0/2433911714 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f71c4073590 0x7f71c4075a50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f71d80b0000 tx=0x7f71d801c4e0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.486+0000 7f71eb800640 1 -- 172.21.15.31:0/2433911714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e4148940 msgr2=0x7f71e40b2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.486+0000 7f71eb800640 1 --2- 172.21.15.31:0/2433911714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e4148940 0x7f71e40b2df0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f71e415c630 tx=0x7f71dc00f3c0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.486+0000 7f71eb800640 1 -- 172.21.15.31:0/2433911714 shutdown_connections 2024-09-17T05:34:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.486+0000 7f71eb800640 1 --2- 172.21.15.31:0/2433911714 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f71c4073590 0x7f71c4075a50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.486+0000 7f71eb800640 1 --2- 172.21.15.31:0/2433911714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71e4148940 0x7f71e40b2df0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.486+0000 7f71eb800640 1 --2- 172.21.15.31:0/2433911714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f71e41f6820 0x7f71e40b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.486+0000 7f71eb800640 1 --2- 172.21.15.31:0/2433911714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71cc003a60 0x7f71e41f62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.486+0000 7f71eb800640 1 -- 172.21.15.31:0/2433911714 >> 172.21.15.31:0/2433911714 conn(0x7f71e40d1da0 msgr2=0x7f71e40b0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:09.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.490+0000 7f71eb800640 1 -- 172.21.15.31:0/2433911714 shutdown_connections 2024-09-17T05:34:09.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.490+0000 7f71eb800640 1 -- 172.21.15.31:0/2433911714 wait complete. 2024-09-17T05:34:09.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:09.509 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol42470/.meta) 2024-09-17T05:34:09.531 INFO:teuthology.orchestra.run.smithi031.stdout:[GLOBAL] 2024-09-17T05:34:09.531 INFO:teuthology.orchestra.run.smithi031.stdout:version = 1 2024-09-17T05:34:09.531 INFO:teuthology.orchestra.run.smithi031.stdout:type = subvolume 2024-09-17T05:34:09.531 INFO:teuthology.orchestra.run.smithi031.stdout:path = /volumes/_nogroup/subvol42470/5e30874e-e840-4b0e-9842-c9bef986bb6b 2024-09-17T05:34:09.532 INFO:teuthology.orchestra.run.smithi031.stdout:state = complete 2024-09-17T05:34:09.532 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:09.533 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol42470 2024-09-17T05:34:09.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.722+0000 7f66ca800640 1 -- 172.21.15.31:0/278227334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c415bd40 msgr2=0x7f66c40d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:09.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.722+0000 7f66ca800640 1 --2- 172.21.15.31:0/278227334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c415bd40 0x7f66c40d0240 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f66b8009900 tx=0x7f66b801c8e0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.722+0000 7f66ca800640 1 -- 172.21.15.31:0/278227334 shutdown_connections 2024-09-17T05:34:09.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.722+0000 7f66ca800640 1 --2- 172.21.15.31:0/278227334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66c40b0d10 0x7f66c40d1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.722+0000 7f66ca800640 1 --2- 172.21.15.31:0/278227334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c415bd40 0x7f66c40d0240 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.722+0000 7f66ca800640 1 -- 172.21.15.31:0/278227334 >> 172.21.15.31:0/278227334 conn(0x7f66c409aa10 msgr2=0x7f66c409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:09.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.722+0000 7f66ca800640 1 -- 172.21.15.31:0/278227334 shutdown_connections 2024-09-17T05:34:09.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.722+0000 7f66ca800640 1 -- 172.21.15.31:0/278227334 wait complete. 2024-09-17T05:34:09.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.722+0000 7f66ca800640 1 Processor -- start 2024-09-17T05:34:09.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.722+0000 7f66ca800640 1 -- start start 2024-09-17T05:34:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66ca800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66c40b0d10 0x7f66c414e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66ca800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66c40d20f0 0x7f66c40af880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66ca800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c415bd40 0x7f66c40afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66ca800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f66c4168d00 con 0x7f66c415bd40 2024-09-17T05:34:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66ca800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f66c4168b80 con 0x7f66c40b0d10 2024-09-17T05:34:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66ca800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f66c4168e80 con 0x7f66c40d20f0 2024-09-17T05:34:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66c9e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c415bd40 0x7f66c40afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66c9e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c415bd40 0x7f66c40afdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60442/0 (socket says 172.21.15.31:60442) 2024-09-17T05:34:09.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66c9e00640 1 -- 172.21.15.31:0/1234729372 learned_addr learned my addr 172.21.15.31:0/1234729372 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66c9400640 1 --2- 172.21.15.31:0/1234729372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66c40b0d10 0x7f66c414e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66c8a00640 1 --2- 172.21.15.31:0/1234729372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66c40d20f0 0x7f66c40af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66c9e00640 1 -- 172.21.15.31:0/1234729372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66c40d20f0 msgr2=0x7f66c40af880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66c9e00640 1 --2- 172.21.15.31:0/1234729372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66c40d20f0 0x7f66c40af880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66c9e00640 1 -- 172.21.15.31:0/1234729372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66c40b0d10 msgr2=0x7f66c414e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66c9e00640 1 --2- 172.21.15.31:0/1234729372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66c40b0d10 0x7f66c414e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66c9e00640 1 -- 172.21.15.31:0/1234729372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c41522d0 con 0x7f66c415bd40 2024-09-17T05:34:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66c8a00640 1 --2- 172.21.15.31:0/1234729372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66c40d20f0 0x7f66c40af880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66c9e00640 1 --2- 172.21.15.31:0/1234729372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c415bd40 0x7f66c40afdc0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f66bc00c780 tx=0x7f66bc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66c1600640 1 -- 172.21.15.31:0/1234729372 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc004b70 con 0x7f66c415bd40 2024-09-17T05:34:09.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66c1600640 1 -- 172.21.15.31:0/1234729372 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66bc004e00 con 0x7f66c415bd40 2024-09-17T05:34:09.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66ca800640 1 -- 172.21.15.31:0/1234729372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c41525b0 con 0x7f66c415bd40 2024-09-17T05:34:09.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66c1600640 1 -- 172.21.15.31:0/1234729372 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc00aa90 con 0x7f66c415bd40 2024-09-17T05:34:09.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66ca800640 1 -- 172.21.15.31:0/1234729372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c4152b70 con 0x7f66c415bd40 2024-09-17T05:34:09.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66ca800640 1 -- 172.21.15.31:0/1234729372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c4152d70 con 0x7f66c415bd40 2024-09-17T05:34:09.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.726+0000 7f66c1600640 1 -- 172.21.15.31:0/1234729372 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) ==== 97540+0+0 (secure 0 0 0) 0x7f66bc00ac30 con 0x7f66c415bd40 2024-09-17T05:34:09.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.730+0000 7f66c1600640 1 --2- 172.21.15.31:0/1234729372 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f66a4073560 0x7f66a4075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:09.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.730+0000 7f66c1600640 1 -- 172.21.15.31:0/1234729372 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f66bc094bc0 con 0x7f66c415bd40 2024-09-17T05:34:09.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.730+0000 7f66c9400640 1 --2- 172.21.15.31:0/1234729372 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f66a4073560 0x7f66a4075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:09.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.730+0000 7f66c9400640 1 --2- 172.21.15.31:0/1234729372 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f66a4073560 0x7f66a4075a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f66b80ae000 tx=0x7f66b801b120 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:09.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.734+0000 7f66c1600640 1 -- 172.21.15.31:0/1234729372 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f66c4152d70 con 0x7f66c415bd40 2024-09-17T05:34:09.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.938+0000 7f66ca800640 1 -- 172.21.15.31:0/1234729372 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol42470", "target": ["mon-mgr", ""]}) -- 0x7f66c4152080 con 0x7f66a4073560 2024-09-17T05:34:09.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.974+0000 7f66c1600640 1 -- 172.21.15.31:0/1234729372 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f66c4152080 con 0x7f66a4073560 2024-09-17T05:34:09.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.978+0000 7f66ca800640 1 -- 172.21.15.31:0/1234729372 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f66a4073560 msgr2=0x7f66a4075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:09.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.978+0000 7f66ca800640 1 --2- 172.21.15.31:0/1234729372 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f66a4073560 0x7f66a4075a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f66b80ae000 tx=0x7f66b801b120 comp rx=0 tx=0).stop 2024-09-17T05:34:09.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.978+0000 7f66ca800640 1 -- 172.21.15.31:0/1234729372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c415bd40 msgr2=0x7f66c40afdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:09.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.978+0000 7f66ca800640 1 --2- 172.21.15.31:0/1234729372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c415bd40 0x7f66c40afdc0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f66bc00c780 tx=0x7f66bc00cc40 comp rx=0 tx=0).stop 2024-09-17T05:34:09.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.978+0000 7f66ca800640 1 -- 172.21.15.31:0/1234729372 shutdown_connections 2024-09-17T05:34:09.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.978+0000 7f66ca800640 1 --2- 172.21.15.31:0/1234729372 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f66a4073560 0x7f66a4075a20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.978+0000 7f66ca800640 1 --2- 172.21.15.31:0/1234729372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f66c415bd40 0x7f66c40afdc0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.978+0000 7f66ca800640 1 --2- 172.21.15.31:0/1234729372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66c40d20f0 0x7f66c40af880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.978+0000 7f66ca800640 1 --2- 172.21.15.31:0/1234729372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f66c40b0d10 0x7f66c414e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:09.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.978+0000 7f66ca800640 1 -- 172.21.15.31:0/1234729372 >> 172.21.15.31:0/1234729372 conn(0x7f66c409aa10 msgr2=0x7f66c406dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:09.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.978+0000 7f66ca800640 1 -- 172.21.15.31:0/1234729372 shutdown_connections 2024-09-17T05:34:09.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:09.978+0000 7f66ca800640 1 -- 172.21.15.31:0/1234729372 wait complete. 2024-09-17T05:34:09.983 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:09.982+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:09.983 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:09.982+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:09.983 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:09.982+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:09.983 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:09.982+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:09.983 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:09.982+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:09.999 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:09.998+0000 7f46f8c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:09.999 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:09.998+0000 7f46f8c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:10.000 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:09.998+0000 7f46f8c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:10.000 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:09.998+0000 7f46f8c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:10.000 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:09.998+0000 7f46f8c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:10.007 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone15990 2024-09-17T05:34:10.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.166+0000 7f9ac3c00640 1 -- 172.21.15.31:0/415376165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9abc0b1650 msgr2=0x7f9abc0b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:10.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.166+0000 7f9ac3c00640 1 --2- 172.21.15.31:0/415376165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9abc0b1650 0x7f9abc0b1a30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009900 tx=0x7f9aa801c8e0 comp rx=0 tx=0).stop 2024-09-17T05:34:10.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.166+0000 7f9ac3c00640 1 -- 172.21.15.31:0/415376165 shutdown_connections 2024-09-17T05:34:10.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.166+0000 7f9ac3c00640 1 --2- 172.21.15.31:0/415376165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9abc0b1650 0x7f9abc0b1a30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:10.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.166+0000 7f9ac3c00640 1 --2- 172.21.15.31:0/415376165 >> v2:172.21.15.155:3300/0 conn(0x7f9abc1605d0 0x7f9abc0d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:10.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.166+0000 7f9ac3c00640 1 -- 172.21.15.31:0/415376165 >> 172.21.15.31:0/415376165 conn(0x7f9abc0d1dd0 msgr2=0x7f9abc0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:10.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.166+0000 7f9ac3c00640 1 -- 172.21.15.31:0/415376165 shutdown_connections 2024-09-17T05:34:10.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.166+0000 7f9ac3c00640 1 -- 172.21.15.31:0/415376165 wait complete. 2024-09-17T05:34:10.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.166+0000 7f9ac3c00640 1 Processor -- start 2024-09-17T05:34:10.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.166+0000 7f9ac3c00640 1 -- start start 2024-09-17T05:34:10.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.166+0000 7f9ac3c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9abc0aeb00 0x7f9abc15a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:10.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.166+0000 7f9ac3c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9abc0b1650 0x7f9abc148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:10.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.166+0000 7f9ac3c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9abc1605d0 0x7f9abc148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:10.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.166+0000 7f9ac3c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc0b0810 con 0x7f9abc0aeb00 2024-09-17T05:34:10.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.166+0000 7f9ac3c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc0b0ee0 con 0x7f9abc1605d0 2024-09-17T05:34:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.166+0000 7f9ac3c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9abc0b1220 con 0x7f9abc0b1650 2024-09-17T05:34:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.170+0000 7f9ac1200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9abc0aeb00 0x7f9abc15a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.170+0000 7f9ac1200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9abc0aeb00 0x7f9abc15a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60476/0 (socket says 172.21.15.31:60476) 2024-09-17T05:34:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.170+0000 7f9ac1200640 1 -- 172.21.15.31:0/3124953904 learned_addr learned my addr 172.21.15.31:0/3124953904 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.170+0000 7f9abbe00640 1 --2- 172.21.15.31:0/3124953904 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9abc0b1650 0x7f9abc148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.170+0000 7f9ac1c00640 1 --2- 172.21.15.31:0/3124953904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9abc1605d0 0x7f9abc148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.170+0000 7f9ac1200640 1 -- 172.21.15.31:0/3124953904 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9abc0b1650 msgr2=0x7f9abc148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.170+0000 7f9ac1200640 1 --2- 172.21.15.31:0/3124953904 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9abc0b1650 0x7f9abc148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.170+0000 7f9ac1200640 1 -- 172.21.15.31:0/3124953904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9abc1605d0 msgr2=0x7f9abc148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.170+0000 7f9ac1200640 1 --2- 172.21.15.31:0/3124953904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9abc1605d0 0x7f9abc148b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.170+0000 7f9ac1200640 1 -- 172.21.15.31:0/3124953904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9abc0cb910 con 0x7f9abc0aeb00 2024-09-17T05:34:10.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.170+0000 7f9ac1200640 1 --2- 172.21.15.31:0/3124953904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9abc0aeb00 0x7f9abc15a350 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000e7a0 tx=0x7f9ab000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:10.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.170+0000 7f9ab8c00640 1 -- 172.21.15.31:0/3124953904 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab000ccc0 con 0x7f9abc0aeb00 2024-09-17T05:34:10.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.170+0000 7f9ab8c00640 1 -- 172.21.15.31:0/3124953904 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ab0010430 con 0x7f9abc0aeb00 2024-09-17T05:34:10.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.170+0000 7f9ab8c00640 1 -- 172.21.15.31:0/3124953904 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0010860 con 0x7f9abc0aeb00 2024-09-17T05:34:10.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.170+0000 7f9ac3c00640 1 -- 172.21.15.31:0/3124953904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9abc159870 con 0x7f9abc0aeb00 2024-09-17T05:34:10.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.170+0000 7f9ac3c00640 1 -- 172.21.15.31:0/3124953904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9abc159e30 con 0x7f9abc0aeb00 2024-09-17T05:34:10.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.170+0000 7f9ac3c00640 1 -- 172.21.15.31:0/3124953904 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9abc159690 con 0x7f9abc0aeb00 2024-09-17T05:34:10.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.170+0000 7f9ab8c00640 1 -- 172.21.15.31:0/3124953904 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) ==== 97540+0+0 (secure 0 0 0) 0x7f9ab0010a00 con 0x7f9abc0aeb00 2024-09-17T05:34:10.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.174+0000 7f9ab8c00640 1 --2- 172.21.15.31:0/3124953904 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9a9c073560 0x7f9a9c075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:10.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.174+0000 7f9ab8c00640 1 -- 172.21.15.31:0/3124953904 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f9ab0095b60 con 0x7f9abc0aeb00 2024-09-17T05:34:10.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.174+0000 7f9abbe00640 1 --2- 172.21.15.31:0/3124953904 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9a9c073560 0x7f9a9c075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:10.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.174+0000 7f9abbe00640 1 --2- 172.21.15.31:0/3124953904 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9a9c073560 0x7f9a9c075a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80af000 tx=0x7f9aa801b120 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:10.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.174+0000 7f9ab8c00640 1 -- 172.21.15.31:0/3124953904 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9abc159690 con 0x7f9abc0aeb00 2024-09-17T05:34:10.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.374+0000 7f9ac3c00640 1 -- 172.21.15.31:0/3124953904 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone15990", "target": ["mon-mgr", ""]}) -- 0x7f9abc0b1a30 con 0x7f9a9c073560 2024-09-17T05:34:10.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.390+0000 7f9ab8c00640 1 -- 172.21.15.31:0/3124953904 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9abc0b1a30 con 0x7f9a9c073560 2024-09-17T05:34:10.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.394+0000 7f9ac3c00640 1 -- 172.21.15.31:0/3124953904 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9a9c073560 msgr2=0x7f9a9c075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:10.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.394+0000 7f9ac3c00640 1 --2- 172.21.15.31:0/3124953904 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9a9c073560 0x7f9a9c075a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80af000 tx=0x7f9aa801b120 comp rx=0 tx=0).stop 2024-09-17T05:34:10.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.394+0000 7f9ac3c00640 1 -- 172.21.15.31:0/3124953904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9abc0aeb00 msgr2=0x7f9abc15a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:10.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.394+0000 7f9ac3c00640 1 --2- 172.21.15.31:0/3124953904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9abc0aeb00 0x7f9abc15a350 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000e7a0 tx=0x7f9ab000ec60 comp rx=0 tx=0).stop 2024-09-17T05:34:10.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.394+0000 7f9ac3c00640 1 -- 172.21.15.31:0/3124953904 shutdown_connections 2024-09-17T05:34:10.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.394+0000 7f9ac3c00640 1 --2- 172.21.15.31:0/3124953904 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9a9c073560 0x7f9a9c075a20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:10.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.394+0000 7f9ac3c00640 1 --2- 172.21.15.31:0/3124953904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9abc1605d0 0x7f9abc148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:10.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.394+0000 7f9ac3c00640 1 --2- 172.21.15.31:0/3124953904 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9abc0b1650 0x7f9abc148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:10.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.394+0000 7f9ac3c00640 1 --2- 172.21.15.31:0/3124953904 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9abc0aeb00 0x7f9abc15a350 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:10.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.394+0000 7f9ac3c00640 1 -- 172.21.15.31:0/3124953904 >> 172.21.15.31:0/3124953904 conn(0x7f9abc0d1dd0 msgr2=0x7f9abc071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:10.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.394+0000 7f9ac3c00640 1 -- 172.21.15.31:0/3124953904 shutdown_connections 2024-09-17T05:34:10.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.394+0000 7f9ac3c00640 1 -- 172.21.15.31:0/3124953904 wait complete. 2024-09-17T05:34:10.420 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone83471 2024-09-17T05:34:10.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.574+0000 7f6515600640 1 -- 172.21.15.31:0/1490333062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64f4004810 msgr2=0x7f64f4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:10.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.574+0000 7f6515600640 1 --2- 172.21.15.31:0/1490333062 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f64f4004810 0x7f64f4004c90 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f6510073ef0 tx=0x7f64f801c860 comp rx=0 tx=0).stop 2024-09-17T05:34:10.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.574+0000 7f650f400640 1 -- 172.21.15.31:0/1490333062 reap_dead start 2024-09-17T05:34:10.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.574+0000 7f6515600640 1 -- 172.21.15.31:0/1490333062 shutdown_connections 2024-09-17T05:34:10.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.574+0000 7f6515600640 1 -- 172.21.15.31:0/1490333062 >> 172.21.15.31:0/1490333062 conn(0x7f65100d1e00 msgr2=0x7f65100d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:10.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.574+0000 7f6515600640 1 -- 172.21.15.31:0/1490333062 shutdown_connections 2024-09-17T05:34:10.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.574+0000 7f6515600640 1 -- 172.21.15.31:0/1490333062 wait complete. 2024-09-17T05:34:10.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f6515600640 1 Processor -- start 2024-09-17T05:34:10.578 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f6515600640 1 -- start start 2024-09-17T05:34:10.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f6515600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64f4004810 0x7f651006edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:10.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f6515600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65100b16f0 0x7f651015bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:10.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f6515600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f651015c1c0 0x7f65100b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:10.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f6515600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f65100b26d0 con 0x7f651015c1c0 2024-09-17T05:34:10.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f6515600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6510168360 con 0x7f65100b16f0 2024-09-17T05:34:10.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f6515600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f65101f8060 con 0x7f64f4004810 2024-09-17T05:34:10.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f650f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f651015c1c0 0x7f65100b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:10.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f650f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f651015c1c0 0x7f65100b6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60504/0 (socket says 172.21.15.31:60504) 2024-09-17T05:34:10.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f650f400640 1 -- 172.21.15.31:0/4162009576 learned_addr learned my addr 172.21.15.31:0/4162009576 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:10.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f650ea00640 1 --2- 172.21.15.31:0/4162009576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64f4004810 0x7f651006edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:10.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f6507e00640 1 --2- 172.21.15.31:0/4162009576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65100b16f0 0x7f651015bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:10.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f650f400640 1 -- 172.21.15.31:0/4162009576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64f4004810 msgr2=0x7f651006edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:10.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f650f400640 1 --2- 172.21.15.31:0/4162009576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64f4004810 0x7f651006edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:10.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f650f400640 1 -- 172.21.15.31:0/4162009576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65100b16f0 msgr2=0x7f651015bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:10.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f650f400640 1 --2- 172.21.15.31:0/4162009576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65100b16f0 0x7f651015bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:10.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f650f400640 1 -- 172.21.15.31:0/4162009576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65101fbac0 con 0x7f651015c1c0 2024-09-17T05:34:10.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f650f400640 1 --2- 172.21.15.31:0/4162009576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f651015c1c0 0x7f65100b6130 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f65100d29d0 tx=0x7f6508006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:10.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f6506a00640 1 -- 172.21.15.31:0/4162009576 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650800f9a0 con 0x7f651015c1c0 2024-09-17T05:34:10.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f6506a00640 1 -- 172.21.15.31:0/4162009576 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6508018070 con 0x7f651015c1c0 2024-09-17T05:34:10.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f6506a00640 1 -- 172.21.15.31:0/4162009576 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650800fe20 con 0x7f651015c1c0 2024-09-17T05:34:10.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f6515600640 1 -- 172.21.15.31:0/4162009576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65101fbda0 con 0x7f651015c1c0 2024-09-17T05:34:10.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f6515600640 1 -- 172.21.15.31:0/4162009576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65101fc360 con 0x7f651015c1c0 2024-09-17T05:34:10.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.578+0000 7f6515600640 1 -- 172.21.15.31:0/4162009576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65100ccf10 con 0x7f651015c1c0 2024-09-17T05:34:10.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.582+0000 7f6506a00640 1 -- 172.21.15.31:0/4162009576 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) ==== 97540+0+0 (secure 0 0 0) 0x7f6508011430 con 0x7f651015c1c0 2024-09-17T05:34:10.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.582+0000 7f6506a00640 1 --2- 172.21.15.31:0/4162009576 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f64ec073590 0x7f64ec075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:10.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.582+0000 7f6506a00640 1 -- 172.21.15.31:0/4162009576 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f65080958d0 con 0x7f651015c1c0 2024-09-17T05:34:10.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.582+0000 7f650ea00640 1 --2- 172.21.15.31:0/4162009576 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f64ec073590 0x7f64ec075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:10.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.582+0000 7f650ea00640 1 --2- 172.21.15.31:0/4162009576 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f64ec073590 0x7f64ec075a50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6500009c60 tx=0x7f65000091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:10.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.586+0000 7f6506a00640 1 -- 172.21.15.31:0/4162009576 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f65100d2c90 con 0x7f651015c1c0 2024-09-17T05:34:10.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.786+0000 7f6515600640 1 -- 172.21.15.31:0/4162009576 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone83471", "target": ["mon-mgr", ""]}) -- 0x7f65101f81e0 con 0x7f64ec073590 2024-09-17T05:34:10.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.802+0000 7f6506a00640 1 -- 172.21.15.31:0/4162009576 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f65101f81e0 con 0x7f64ec073590 2024-09-17T05:34:10.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.806+0000 7f6515600640 1 -- 172.21.15.31:0/4162009576 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f64ec073590 msgr2=0x7f64ec075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:10.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.806+0000 7f6515600640 1 --2- 172.21.15.31:0/4162009576 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f64ec073590 0x7f64ec075a50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6500009c60 tx=0x7f65000091e0 comp rx=0 tx=0).stop 2024-09-17T05:34:10.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.806+0000 7f6515600640 1 -- 172.21.15.31:0/4162009576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f651015c1c0 msgr2=0x7f65100b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:10.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.806+0000 7f6515600640 1 --2- 172.21.15.31:0/4162009576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f651015c1c0 0x7f65100b6130 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f65100d29d0 tx=0x7f6508006660 comp rx=0 tx=0).stop 2024-09-17T05:34:10.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.806+0000 7f6515600640 1 -- 172.21.15.31:0/4162009576 shutdown_connections 2024-09-17T05:34:10.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.806+0000 7f6515600640 1 --2- 172.21.15.31:0/4162009576 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f64ec073590 0x7f64ec075a50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:10.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.806+0000 7f6515600640 1 --2- 172.21.15.31:0/4162009576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f651015c1c0 0x7f65100b6130 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:10.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.806+0000 7f6515600640 1 --2- 172.21.15.31:0/4162009576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65100b16f0 0x7f651015bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:10.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.806+0000 7f6515600640 1 --2- 172.21.15.31:0/4162009576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f64f4004810 0x7f651006edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:10.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.806+0000 7f6515600640 1 -- 172.21.15.31:0/4162009576 >> 172.21.15.31:0/4162009576 conn(0x7f65100d1e00 msgr2=0x7f65100cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:10.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.806+0000 7f6515600640 1 -- 172.21.15.31:0/4162009576 shutdown_connections 2024-09-17T05:34:10.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10.806+0000 7f6515600640 1 -- 172.21.15.31:0/4162009576 wait complete. 2024-09-17T05:34:10.833 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:34:10.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:34:10.888 INFO:teuthology.orchestra.run.smithi031.stdout:2 2024-09-17T05:34:10.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:34:10.895 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:34:10.895 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:34:11.000 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:34:11.116 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:34:11.116 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:34:11.117 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:34:11.117 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:34:11.126 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:34:11.126 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:34:11.180 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:34:11.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.366+0000 7f982b400640 1 -- 172.21.15.31:0/3018060943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9808004220 msgr2=0x7f9808004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:11.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.366+0000 7f982b400640 1 --2- 172.21.15.31:0/3018060943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9808004220 0x7f9808004810 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f980c001830 tx=0x7f980c01f010 comp rx=0 tx=0).stop 2024-09-17T05:34:11.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.366+0000 7f9829400640 1 -- 172.21.15.31:0/3018060943 reap_dead start 2024-09-17T05:34:11.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.366+0000 7f982b400640 1 -- 172.21.15.31:0/3018060943 shutdown_connections 2024-09-17T05:34:11.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.366+0000 7f982b400640 1 -- 172.21.15.31:0/3018060943 >> 172.21.15.31:0/3018060943 conn(0x7f98240b18f0 msgr2=0x7f98240b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:11.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f982b400640 1 -- 172.21.15.31:0/3018060943 shutdown_connections 2024-09-17T05:34:11.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f982b400640 1 -- 172.21.15.31:0/3018060943 wait complete. 2024-09-17T05:34:11.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f982b400640 1 Processor -- start 2024-09-17T05:34:11.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f982b400640 1 -- start start 2024-09-17T05:34:11.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f982b400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9808004220 0x7f9824154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:11.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f982b400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98241498a0 0x7f98241f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:11.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f982b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98240c8f70 0x7f98240c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:11.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f982b400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f98240b3070 con 0x7f98240c8f70 2024-09-17T05:34:11.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f982b400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f982406f020 con 0x7f98241498a0 2024-09-17T05:34:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f982b400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f98240b31f0 con 0x7f9808004220 2024-09-17T05:34:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f9829400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98240c8f70 0x7f98240c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f9829400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98240c8f70 0x7f98240c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60522/0 (socket says 172.21.15.31:60522) 2024-09-17T05:34:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f9829400640 1 -- 172.21.15.31:0/4188717451 learned_addr learned my addr 172.21.15.31:0/4188717451 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f9828a00640 1 --2- 172.21.15.31:0/4188717451 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9808004220 0x7f9824154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f981be00640 1 --2- 172.21.15.31:0/4188717451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98241498a0 0x7f98241f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f9829400640 1 -- 172.21.15.31:0/4188717451 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9808004220 msgr2=0x7f9824154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f9829400640 1 --2- 172.21.15.31:0/4188717451 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9808004220 0x7f9824154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f9829400640 1 -- 172.21.15.31:0/4188717451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98241498a0 msgr2=0x7f98241f4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f9829400640 1 --2- 172.21.15.31:0/4188717451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98241498a0 0x7f98241f4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:11.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f9829400640 1 -- 172.21.15.31:0/4188717451 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98240af800 con 0x7f98240c8f70 2024-09-17T05:34:11.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f9829400640 1 --2- 172.21.15.31:0/4188717451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98240c8f70 0x7f98240c93f0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f98240b2950 tx=0x7f981c006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:11.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f9821600640 1 -- 172.21.15.31:0/4188717451 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c015070 con 0x7f98240c8f70 2024-09-17T05:34:11.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f9821600640 1 -- 172.21.15.31:0/4188717451 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f981c00faa0 con 0x7f98240c8f70 2024-09-17T05:34:11.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f9821600640 1 -- 172.21.15.31:0/4188717451 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c011430 con 0x7f98240c8f70 2024-09-17T05:34:11.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.370+0000 7f982b400640 1 -- 172.21.15.31:0/4188717451 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98240afae0 con 0x7f98240c8f70 2024-09-17T05:34:11.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.374+0000 7f982b400640 1 -- 172.21.15.31:0/4188717451 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98240b00a0 con 0x7f98240c8f70 2024-09-17T05:34:11.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.374+0000 7f982b400640 1 -- 172.21.15.31:0/4188717451 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9824069410 con 0x7f98240c8f70 2024-09-17T05:34:11.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.374+0000 7f9821600640 1 -- 172.21.15.31:0/4188717451 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) ==== 97540+0+0 (secure 0 0 0) 0x7f981c0115d0 con 0x7f98240c8f70 2024-09-17T05:34:11.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.374+0000 7f9821600640 1 --2- 172.21.15.31:0/4188717451 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9800073560 0x7f9800075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:11.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.374+0000 7f9821600640 1 -- 172.21.15.31:0/4188717451 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f981c095790 con 0x7f98240c8f70 2024-09-17T05:34:11.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.374+0000 7f9828a00640 1 --2- 172.21.15.31:0/4188717451 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9800073560 0x7f9800075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:11.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.374+0000 7f9828a00640 1 --2- 172.21.15.31:0/4188717451 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9800073560 0x7f9800075a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f982406af30 tx=0x7f98140091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:11.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.378+0000 7f9821600640 1 -- 172.21.15.31:0/4188717451 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f981c060250 con 0x7f98240c8f70 2024-09-17T05:34:11.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.570+0000 7f982b400640 1 -- 172.21.15.31:0/4188717451 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f982415b2a0 con 0x7f98240c8f70 2024-09-17T05:34:11.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.570+0000 7f9821600640 1 -- 172.21.15.31:0/4188717451 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v102) ==== 80+0+0 (secure 0 0 0) 0x7f981c05fb50 con 0x7f98240c8f70 2024-09-17T05:34:11.572 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:34:11.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.574+0000 7f982b400640 1 -- 172.21.15.31:0/4188717451 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9800073560 msgr2=0x7f9800075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:11.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.574+0000 7f982b400640 1 --2- 172.21.15.31:0/4188717451 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9800073560 0x7f9800075a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f982406af30 tx=0x7f98140091e0 comp rx=0 tx=0).stop 2024-09-17T05:34:11.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.574+0000 7f982b400640 1 -- 172.21.15.31:0/4188717451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98240c8f70 msgr2=0x7f98240c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:11.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.574+0000 7f982b400640 1 --2- 172.21.15.31:0/4188717451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98240c8f70 0x7f98240c93f0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f98240b2950 tx=0x7f981c006720 comp rx=0 tx=0).stop 2024-09-17T05:34:11.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.574+0000 7f982b400640 1 -- 172.21.15.31:0/4188717451 shutdown_connections 2024-09-17T05:34:11.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.574+0000 7f982b400640 1 --2- 172.21.15.31:0/4188717451 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9800073560 0x7f9800075a20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:11.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.574+0000 7f982b400640 1 --2- 172.21.15.31:0/4188717451 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98240c8f70 0x7f98240c93f0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:11.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.574+0000 7f982b400640 1 --2- 172.21.15.31:0/4188717451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98241498a0 0x7f98241f4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:11.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.574+0000 7f982b400640 1 --2- 172.21.15.31:0/4188717451 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9808004220 0x7f9824154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:11.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.574+0000 7f982b400640 1 -- 172.21.15.31:0/4188717451 >> 172.21.15.31:0/4188717451 conn(0x7f98240b18f0 msgr2=0x7f9824159420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:11.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.574+0000 7f982b400640 1 -- 172.21.15.31:0/4188717451 shutdown_connections 2024-09-17T05:34:11.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.574+0000 7f982b400640 1 -- 172.21.15.31:0/4188717451 wait complete. 2024-09-17T05:34:11.594 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:34:11.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:11.594 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:34:11.647 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:34:11.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:11.647 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:34:11.669 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:34:11.669 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:34:11.669 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:34:11.678 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:34:11.679 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:34:11.733 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:34:11.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.882+0000 7f8d79800640 1 -- 172.21.15.31:0/2688675945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d740cdb30 msgr2=0x7f8d740af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:11.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.882+0000 7f8d79800640 1 --2- 172.21.15.31:0/2688675945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d740cdb30 0x7f8d740af0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009bf0 tx=0x7f8d6c01cb00 comp rx=0 tx=0).stop 2024-09-17T05:34:11.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.882+0000 7f8d79800640 1 -- 172.21.15.31:0/2688675945 shutdown_connections 2024-09-17T05:34:11.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.882+0000 7f8d79800640 1 --2- 172.21.15.31:0/2688675945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d740cdb30 0x7f8d740af0c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:11.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.882+0000 7f8d79800640 1 -- 172.21.15.31:0/2688675945 >> 172.21.15.31:0/2688675945 conn(0x7f8d740d1dc0 msgr2=0x7f8d740d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:11.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.882+0000 7f8d79800640 1 -- 172.21.15.31:0/2688675945 shutdown_connections 2024-09-17T05:34:11.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.882+0000 7f8d79800640 1 -- 172.21.15.31:0/2688675945 wait complete. 2024-09-17T05:34:11.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.882+0000 7f8d79800640 1 Processor -- start 2024-09-17T05:34:11.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.882+0000 7f8d79800640 1 -- start start 2024-09-17T05:34:11.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.882+0000 7f8d79800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d740cdb30 0x7f8d741421e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:11.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.882+0000 7f8d79800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d740ced80 0x7f8d74153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:11.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.882+0000 7f8d79800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d7415bea0 0x7f8d7414ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:11.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.882+0000 7f8d79800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7416a8f0 con 0x7f8d740cdb30 2024-09-17T05:34:11.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.882+0000 7f8d79800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7416a770 con 0x7f8d740ced80 2024-09-17T05:34:11.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.882+0000 7f8d79800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8d7416aa70 con 0x7f8d7415bea0 2024-09-17T05:34:11.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.886+0000 7f8d72a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d740cdb30 0x7f8d741421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:11.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.886+0000 7f8d72a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d740cdb30 0x7f8d741421e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60538/0 (socket says 172.21.15.31:60538) 2024-09-17T05:34:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.886+0000 7f8d72a00640 1 -- 172.21.15.31:0/3551430776 learned_addr learned my addr 172.21.15.31:0/3551430776 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.886+0000 7f8d6be00640 1 --2- 172.21.15.31:0/3551430776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d740ced80 0x7f8d74153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.886+0000 7f8d73400640 1 --2- 172.21.15.31:0/3551430776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d7415bea0 0x7f8d7414ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.886+0000 7f8d72a00640 1 -- 172.21.15.31:0/3551430776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d7415bea0 msgr2=0x7f8d7414ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.886+0000 7f8d72a00640 1 --2- 172.21.15.31:0/3551430776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d7415bea0 0x7f8d7414ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.886+0000 7f8d72a00640 1 -- 172.21.15.31:0/3551430776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d740ced80 msgr2=0x7f8d74153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.886+0000 7f8d72a00640 1 --2- 172.21.15.31:0/3551430776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d740ced80 0x7f8d74153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.886+0000 7f8d72a00640 1 -- 172.21.15.31:0/3551430776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d740b3650 con 0x7f8d740cdb30 2024-09-17T05:34:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.886+0000 7f8d72a00640 1 --2- 172.21.15.31:0/3551430776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d740cdb30 0x7f8d741421e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400c400 tx=0x7f8d6400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:11.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.886+0000 7f8d6aa00640 1 -- 172.21.15.31:0/3551430776 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d64017070 con 0x7f8d740cdb30 2024-09-17T05:34:11.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.886+0000 7f8d6aa00640 1 -- 172.21.15.31:0/3551430776 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d64005400 con 0x7f8d740cdb30 2024-09-17T05:34:11.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.886+0000 7f8d79800640 1 -- 172.21.15.31:0/3551430776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d740b3930 con 0x7f8d740cdb30 2024-09-17T05:34:11.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.886+0000 7f8d6aa00640 1 -- 172.21.15.31:0/3551430776 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d64003860 con 0x7f8d740cdb30 2024-09-17T05:34:11.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.886+0000 7f8d79800640 1 -- 172.21.15.31:0/3551430776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d74153630 con 0x7f8d740cdb30 2024-09-17T05:34:11.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.886+0000 7f8d79800640 1 -- 172.21.15.31:0/3551430776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d740ce670 con 0x7f8d740cdb30 2024-09-17T05:34:11.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.886+0000 7f8d6aa00640 1 -- 172.21.15.31:0/3551430776 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) ==== 97540+0+0 (secure 0 0 0) 0x7f8d6401a070 con 0x7f8d740cdb30 2024-09-17T05:34:11.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.890+0000 7f8d6aa00640 1 --2- 172.21.15.31:0/3551430776 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8d50073590 0x7f8d50075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:11.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.890+0000 7f8d6aa00640 1 -- 172.21.15.31:0/3551430776 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f8d64093c00 con 0x7f8d740cdb30 2024-09-17T05:34:11.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.890+0000 7f8d6be00640 1 --2- 172.21.15.31:0/3551430776 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8d50073590 0x7f8d50075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:11.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.890+0000 7f8d6be00640 1 --2- 172.21.15.31:0/3551430776 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8d50073590 0x7f8d50075a50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8d741f91f0 tx=0x7f8d5c001730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:11.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:11.894+0000 7f8d6aa00640 1 -- 172.21.15.31:0/3551430776 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8d6405e000 con 0x7f8d740cdb30 2024-09-17T05:34:12.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.082+0000 7f8d79800640 1 -- 172.21.15.31:0/3551430776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8d740c85a0 con 0x7f8d740cdb30 2024-09-17T05:34:12.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.082+0000 7f8d6aa00640 1 -- 172.21.15.31:0/3551430776 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v102) ==== 80+0+0 (secure 0 0 0) 0x7f8d64062a30 con 0x7f8d740cdb30 2024-09-17T05:34:12.084 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:34:12.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.086+0000 7f8d79800640 1 -- 172.21.15.31:0/3551430776 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8d50073590 msgr2=0x7f8d50075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:12.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.086+0000 7f8d79800640 1 --2- 172.21.15.31:0/3551430776 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8d50073590 0x7f8d50075a50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8d741f91f0 tx=0x7f8d5c001730 comp rx=0 tx=0).stop 2024-09-17T05:34:12.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.086+0000 7f8d79800640 1 -- 172.21.15.31:0/3551430776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d740cdb30 msgr2=0x7f8d741421e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:12.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.086+0000 7f8d79800640 1 --2- 172.21.15.31:0/3551430776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d740cdb30 0x7f8d741421e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400c400 tx=0x7f8d6400c8c0 comp rx=0 tx=0).stop 2024-09-17T05:34:12.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.086+0000 7f8d79800640 1 -- 172.21.15.31:0/3551430776 shutdown_connections 2024-09-17T05:34:12.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.086+0000 7f8d79800640 1 --2- 172.21.15.31:0/3551430776 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8d50073590 0x7f8d50075a50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:12.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.086+0000 7f8d79800640 1 --2- 172.21.15.31:0/3551430776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d7415bea0 0x7f8d7414ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:12.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.086+0000 7f8d79800640 1 --2- 172.21.15.31:0/3551430776 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d740ced80 0x7f8d74153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:12.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.086+0000 7f8d79800640 1 --2- 172.21.15.31:0/3551430776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d740cdb30 0x7f8d741421e0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:12.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.086+0000 7f8d79800640 1 -- 172.21.15.31:0/3551430776 >> 172.21.15.31:0/3551430776 conn(0x7f8d740d1dc0 msgr2=0x7f8d740d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:12.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.086+0000 7f8d79800640 1 -- 172.21.15.31:0/3551430776 shutdown_connections 2024-09-17T05:34:12.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.086+0000 7f8d79800640 1 -- 172.21.15.31:0/3551430776 wait complete. 2024-09-17T05:34:12.105 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T05:34:12.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:12.106 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T05:34:12.132 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:34:12.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:12.132 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:34:12.186 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:34:12.186 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:34:12.186 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:34:12.195 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:34:12.195 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:34:12.195 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:34:12.195 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:34:12.237 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:34:12.238 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:34:12.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.386+0000 7fdb99e00640 1 -- 172.21.15.31:0/668308410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9415b580 msgr2=0x7fdb9415b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:12.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.386+0000 7fdb99e00640 1 --2- 172.21.15.31:0/668308410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9415b580 0x7fdb9415b960 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fdb84009840 tx=0x7fdb8401c820 comp rx=0 tx=0).stop 2024-09-17T05:34:12.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.386+0000 7fdb99e00640 1 -- 172.21.15.31:0/668308410 shutdown_connections 2024-09-17T05:34:12.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.386+0000 7fdb99e00640 1 --2- 172.21.15.31:0/668308410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9415b580 0x7fdb9415b960 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:12.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.386+0000 7fdb99e00640 1 -- 172.21.15.31:0/668308410 >> 172.21.15.31:0/668308410 conn(0x7fdb940b18f0 msgr2=0x7fdb940b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:12.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.386+0000 7fdb99e00640 1 -- 172.21.15.31:0/668308410 shutdown_connections 2024-09-17T05:34:12.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.386+0000 7fdb99e00640 1 -- 172.21.15.31:0/668308410 wait complete. 2024-09-17T05:34:12.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb99e00640 1 Processor -- start 2024-09-17T05:34:12.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb99e00640 1 -- start start 2024-09-17T05:34:12.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb99e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb940b3300 0x7fdb941fc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:12.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb99e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb940b4bd0 0x7fdb94154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:12.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb99e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb9415b580 0x7fdb941420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:12.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb99e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdb94169360 con 0x7fdb940b3300 2024-09-17T05:34:12.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb99e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdb941691e0 con 0x7fdb940b4bd0 2024-09-17T05:34:12.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb99e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdb941694e0 con 0x7fdb9415b580 2024-09-17T05:34:12.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb92a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb940b3300 0x7fdb941fc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:12.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb92a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb940b3300 0x7fdb941fc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60566/0 (socket says 172.21.15.31:60566) 2024-09-17T05:34:12.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb92a00640 1 -- 172.21.15.31:0/1019152191 learned_addr learned my addr 172.21.15.31:0/1019152191 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:12.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb8be00640 1 --2- 172.21.15.31:0/1019152191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb940b4bd0 0x7fdb94154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:12.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb93400640 1 --2- 172.21.15.31:0/1019152191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb9415b580 0x7fdb941420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:12.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb92a00640 1 -- 172.21.15.31:0/1019152191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb9415b580 msgr2=0x7fdb941420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:12.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb92a00640 1 --2- 172.21.15.31:0/1019152191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb9415b580 0x7fdb941420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:12.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb92a00640 1 -- 172.21.15.31:0/1019152191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb940b4bd0 msgr2=0x7fdb94154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:12.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb92a00640 1 --2- 172.21.15.31:0/1019152191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb940b4bd0 0x7fdb94154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:12.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb92a00640 1 -- 172.21.15.31:0/1019152191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb941539c0 con 0x7fdb940b3300 2024-09-17T05:34:12.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb92a00640 1 --2- 172.21.15.31:0/1019152191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb940b3300 0x7fdb941fc050 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fdb84009790 tx=0x7fdb84004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:12.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb8b400640 1 -- 172.21.15.31:0/1019152191 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb840bb070 con 0x7fdb940b3300 2024-09-17T05:34:12.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb8b400640 1 -- 172.21.15.31:0/1019152191 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb84005030 con 0x7fdb940b3300 2024-09-17T05:34:12.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb99e00640 1 -- 172.21.15.31:0/1019152191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb94153ca0 con 0x7fdb940b3300 2024-09-17T05:34:12.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb8b400640 1 -- 172.21.15.31:0/1019152191 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb840b2040 con 0x7fdb940b3300 2024-09-17T05:34:12.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.390+0000 7fdb99e00640 1 -- 172.21.15.31:0/1019152191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb94154260 con 0x7fdb940b3300 2024-09-17T05:34:12.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.394+0000 7fdb99e00640 1 -- 172.21.15.31:0/1019152191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb9415b960 con 0x7fdb940b3300 2024-09-17T05:34:12.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.394+0000 7fdb8b400640 1 -- 172.21.15.31:0/1019152191 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) ==== 97540+0+0 (secure 0 0 0) 0x7fdb840be070 con 0x7fdb940b3300 2024-09-17T05:34:12.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.394+0000 7fdb8b400640 1 --2- 172.21.15.31:0/1019152191 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdb70073560 0x7fdb70075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:12.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.394+0000 7fdb8b400640 1 -- 172.21.15.31:0/1019152191 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7fdb8412e0d0 con 0x7fdb940b3300 2024-09-17T05:34:12.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.394+0000 7fdb8be00640 1 --2- 172.21.15.31:0/1019152191 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdb70073560 0x7fdb70075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:12.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.394+0000 7fdb8be00640 1 --2- 172.21.15.31:0/1019152191 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdb70073560 0x7fdb70075a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdb941fb5a0 tx=0x7fdb7c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:12.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.398+0000 7fdb8b400640 1 -- 172.21.15.31:0/1019152191 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fdb84016410 con 0x7fdb940b3300 2024-09-17T05:34:12.456 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:34:12.459 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:34:12.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.610+0000 7fdb99e00640 1 -- 172.21.15.31:0/1019152191 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb940b1e70 con 0x7fdb940b3300 2024-09-17T05:34:12.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.610+0000 7fdb8b400640 1 -- 172.21.15.31:0/1019152191 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5228 (secure 0 0 0) 0x7fdb84101020 con 0x7fdb940b3300 2024-09-17T05:34:12.614 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:12.614 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":72,"btime":"2024-09-17T05:33:46:226011+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3921984787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3921984787},{"type":"v1","addr":"172.21.15.155:6809","nonce":3921984787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3122851843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3122851843},{"type":"v1","addr":"172.21.15.155:6835","nonce":3122851843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6936,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/706788626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":706788626},{"type":"v1","addr":"172.21.15.31:6834","nonce":706788626}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:33:36.585711+0000","modified":"2024-09-17T05:33:39.610967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4072380267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":4072380267},{"type":"v1","addr":"172.21.15.31:6835","nonce":4072380267}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6939,"qdb_cluster":[6939]},"id":8}]} 2024-09-17T05:34:12.614 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 72 2024-09-17T05:34:12.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.614+0000 7fdb99e00640 1 -- 172.21.15.31:0/1019152191 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdb70073560 msgr2=0x7fdb70075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:12.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.614+0000 7fdb99e00640 1 --2- 172.21.15.31:0/1019152191 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdb70073560 0x7fdb70075a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdb941fb5a0 tx=0x7fdb7c009040 comp rx=0 tx=0).stop 2024-09-17T05:34:12.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.614+0000 7fdb99e00640 1 -- 172.21.15.31:0/1019152191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb940b3300 msgr2=0x7fdb941fc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:12.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.614+0000 7fdb99e00640 1 --2- 172.21.15.31:0/1019152191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb940b3300 0x7fdb941fc050 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fdb84009790 tx=0x7fdb84004040 comp rx=0 tx=0).stop 2024-09-17T05:34:12.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.614+0000 7fdb99e00640 1 -- 172.21.15.31:0/1019152191 shutdown_connections 2024-09-17T05:34:12.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.614+0000 7fdb99e00640 1 --2- 172.21.15.31:0/1019152191 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdb70073560 0x7fdb70075a20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:12.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.614+0000 7fdb99e00640 1 --2- 172.21.15.31:0/1019152191 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb9415b580 0x7fdb941420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:12.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.614+0000 7fdb99e00640 1 --2- 172.21.15.31:0/1019152191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb940b4bd0 0x7fdb94154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:12.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.614+0000 7fdb99e00640 1 --2- 172.21.15.31:0/1019152191 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb940b3300 0x7fdb941fc050 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:12.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.614+0000 7fdb99e00640 1 -- 172.21.15.31:0/1019152191 >> 172.21.15.31:0/1019152191 conn(0x7fdb940b18f0 msgr2=0x7fdb940af400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:12.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.614+0000 7fdb99e00640 1 -- 172.21.15.31:0/1019152191 shutdown_connections 2024-09-17T05:34:12.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.614+0000 7fdb99e00640 1 -- 172.21.15.31:0/1019152191 wait complete. 2024-09-17T05:34:12.635 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:34:12.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.782+0000 7f95f4e00640 1 -- 172.21.15.31:0/576125760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95d4003ab0 msgr2=0x7f95d4003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:12.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.782+0000 7f95f4e00640 1 --2- 172.21.15.31:0/576125760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95d4003ab0 0x7f95d4003ed0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f95e00016f0 tx=0x7f95e001c760 comp rx=0 tx=0).stop 2024-09-17T05:34:12.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.782+0000 7f95f4e00640 1 -- 172.21.15.31:0/576125760 shutdown_connections 2024-09-17T05:34:12.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.782+0000 7f95f4e00640 1 --2- 172.21.15.31:0/576125760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95d4003ab0 0x7f95d4003ed0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:12.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.782+0000 7f95f4e00640 1 -- 172.21.15.31:0/576125760 >> 172.21.15.31:0/576125760 conn(0x7f95f00d0c90 msgr2=0x7f95f00d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:12.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.782+0000 7f95f4e00640 1 -- 172.21.15.31:0/576125760 shutdown_connections 2024-09-17T05:34:12.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.782+0000 7f95f4e00640 1 -- 172.21.15.31:0/576125760 wait complete. 2024-09-17T05:34:12.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95f4e00640 1 Processor -- start 2024-09-17T05:34:12.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95f4e00640 1 -- start start 2024-09-17T05:34:12.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95f4e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95d4003ab0 0x7f95f00b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:12.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95f4e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f00ca270 0x7f95f00b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95f4e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95f00b6250 0x7f95f01598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95f4e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f95f0074520 con 0x7f95d4003ab0 2024-09-17T05:34:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95f4e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f95f00743a0 con 0x7f95f00ca270 2024-09-17T05:34:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95f4e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f95f006fd80 con 0x7f95f00b6250 2024-09-17T05:34:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95ede00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95d4003ab0 0x7f95f00b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95ede00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95d4003ab0 0x7f95f00b3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60586/0 (socket says 172.21.15.31:60586) 2024-09-17T05:34:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95ede00640 1 -- 172.21.15.31:0/4065938681 learned_addr learned my addr 172.21.15.31:0/4065938681 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95e7e00640 1 --2- 172.21.15.31:0/4065938681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f00ca270 0x7f95f00b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95ee800640 1 --2- 172.21.15.31:0/4065938681 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95f00b6250 0x7f95f01598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:12.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95ede00640 1 -- 172.21.15.31:0/4065938681 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95f00b6250 msgr2=0x7f95f01598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:12.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95ede00640 1 --2- 172.21.15.31:0/4065938681 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95f00b6250 0x7f95f01598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:12.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95ede00640 1 -- 172.21.15.31:0/4065938681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f00ca270 msgr2=0x7f95f00b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:12.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95ede00640 1 --2- 172.21.15.31:0/4065938681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f00ca270 0x7f95f00b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:12.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95ede00640 1 -- 172.21.15.31:0/4065938681 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f01fbc90 con 0x7f95d4003ab0 2024-09-17T05:34:12.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95ee800640 1 --2- 172.21.15.31:0/4065938681 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95f00b6250 0x7f95f01598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:12.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95ede00640 1 --2- 172.21.15.31:0/4065938681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95d4003ab0 0x7f95f00b3110 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f95e0000c10 tx=0x7f95e0003b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:12.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95e6000640 1 -- 172.21.15.31:0/4065938681 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e00bd070 con 0x7f95d4003ab0 2024-09-17T05:34:12.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95e6000640 1 -- 172.21.15.31:0/4065938681 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95e0006500 con 0x7f95d4003ab0 2024-09-17T05:34:12.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95e6000640 1 -- 172.21.15.31:0/4065938681 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e00a64c0 con 0x7f95d4003ab0 2024-09-17T05:34:12.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95f4e00640 1 -- 172.21.15.31:0/4065938681 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f01f7900 con 0x7f95d4003ab0 2024-09-17T05:34:12.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95f4e00640 1 -- 172.21.15.31:0/4065938681 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f01f7ba0 con 0x7f95d4003ab0 2024-09-17T05:34:12.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.786+0000 7f95f4e00640 1 -- 172.21.15.31:0/4065938681 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95f00702e0 con 0x7f95d4003ab0 2024-09-17T05:34:12.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.790+0000 7f95e6000640 1 -- 172.21.15.31:0/4065938681 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 19) ==== 97540+0+0 (secure 0 0 0) 0x7f95e00a6660 con 0x7f95d4003ab0 2024-09-17T05:34:12.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.790+0000 7f95e6000640 1 --2- 172.21.15.31:0/4065938681 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95cc073560 0x7f95cc075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:12.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.790+0000 7f95e6000640 1 -- 172.21.15.31:0/4065938681 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5767+0+0 (secure 0 0 0) 0x7f95e012e6d0 con 0x7f95d4003ab0 2024-09-17T05:34:12.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.790+0000 7f95e7e00640 1 --2- 172.21.15.31:0/4065938681 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95cc073560 0x7f95cc075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:12.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.790+0000 7f95e7e00640 1 --2- 172.21.15.31:0/4065938681 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95cc073560 0x7f95cc075a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f95f01e9780 tx=0x7f95d800b450 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:12.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.794+0000 7f95e6000640 1 -- 172.21.15.31:0/4065938681 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f95e00aa050 con 0x7f95d4003ab0 2024-09-17T05:34:12.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:12.834+0000 7f95e6000640 1 -- 172.21.15.31:0/4065938681 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f95e00f4dd0 con 0x7f95d4003ab0 2024-09-17T05:34:13.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.022+0000 7f95f4e00640 1 -- 172.21.15.31:0/4065938681 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95f0071b70 con 0x7f95d4003ab0 2024-09-17T05:34:13.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.022+0000 7f95e6000640 1 -- 172.21.15.31:0/4065938681 <== mon.0 v2:172.21.15.31:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5228 (secure 0 0 0) 0x7f95e00164f0 con 0x7f95d4003ab0 2024-09-17T05:34:13.023 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:13.023 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":72,"btime":"2024-09-17T05:33:46:226011+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3921984787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3921984787},{"type":"v1","addr":"172.21.15.155:6809","nonce":3921984787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3122851843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3122851843},{"type":"v1","addr":"172.21.15.155:6835","nonce":3122851843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6936,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/706788626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":706788626},{"type":"v1","addr":"172.21.15.31:6834","nonce":706788626}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:33:36.585711+0000","modified":"2024-09-17T05:33:39.610967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4072380267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":4072380267},{"type":"v1","addr":"172.21.15.31:6835","nonce":4072380267}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6939,"qdb_cluster":[6939]},"id":8}]} 2024-09-17T05:34:13.023 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 72 2024-09-17T05:34:13.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.022+0000 7f95f4e00640 1 -- 172.21.15.31:0/4065938681 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95cc073560 msgr2=0x7f95cc075a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:13.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.022+0000 7f95f4e00640 1 --2- 172.21.15.31:0/4065938681 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95cc073560 0x7f95cc075a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f95f01e9780 tx=0x7f95d800b450 comp rx=0 tx=0).stop 2024-09-17T05:34:13.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.022+0000 7f95f4e00640 1 -- 172.21.15.31:0/4065938681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95d4003ab0 msgr2=0x7f95f00b3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:13.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.022+0000 7f95f4e00640 1 --2- 172.21.15.31:0/4065938681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95d4003ab0 0x7f95f00b3110 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f95e0000c10 tx=0x7f95e0003b70 comp rx=0 tx=0).stop 2024-09-17T05:34:13.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.022+0000 7f95f4e00640 1 -- 172.21.15.31:0/4065938681 shutdown_connections 2024-09-17T05:34:13.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.022+0000 7f95f4e00640 1 --2- 172.21.15.31:0/4065938681 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95cc073560 0x7f95cc075a20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.022+0000 7f95f4e00640 1 --2- 172.21.15.31:0/4065938681 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95f00b6250 0x7f95f01598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.022+0000 7f95f4e00640 1 --2- 172.21.15.31:0/4065938681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f00ca270 0x7f95f00b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.022+0000 7f95f4e00640 1 --2- 172.21.15.31:0/4065938681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95d4003ab0 0x7f95f00b3110 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.022+0000 7f95f4e00640 1 -- 172.21.15.31:0/4065938681 >> 172.21.15.31:0/4065938681 conn(0x7f95f00d0c90 msgr2=0x7f95f006d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:13.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.022+0000 7f95f4e00640 1 -- 172.21.15.31:0/4065938681 shutdown_connections 2024-09-17T05:34:13.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.022+0000 7f95f4e00640 1 -- 172.21.15.31:0/4065938681 wait complete. 2024-09-17T05:34:13.049 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:34:13.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.198+0000 7f36c5400640 1 -- 172.21.15.31:0/2722128861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36c0164ab0 msgr2=0x7f36c0166ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:13.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.198+0000 7f36c5400640 1 --2- 172.21.15.31:0/2722128861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36c0164ab0 0x7f36c0166ea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f36b8009bf0 tx=0x7f36b801f3d0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.198+0000 7f36c5400640 1 -- 172.21.15.31:0/2722128861 shutdown_connections 2024-09-17T05:34:13.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.198+0000 7f36c5400640 1 --2- 172.21.15.31:0/2722128861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36c0164ab0 0x7f36c0166ea0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.198+0000 7f36c5400640 1 -- 172.21.15.31:0/2722128861 >> 172.21.15.31:0/2722128861 conn(0x7f36c00b18f0 msgr2=0x7f36c00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:13.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.198+0000 7f36c5400640 1 -- 172.21.15.31:0/2722128861 shutdown_connections 2024-09-17T05:34:13.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.198+0000 7f36c5400640 1 -- 172.21.15.31:0/2722128861 wait complete. 2024-09-17T05:34:13.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.198+0000 7f36c5400640 1 Processor -- start 2024-09-17T05:34:13.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.198+0000 7f36c5400640 1 -- start start 2024-09-17T05:34:13.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.198+0000 7f36c5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36c015bfa0 0x7f36c0152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:13.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.198+0000 7f36c5400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36c015c3e0 0x7f36c0163b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:13.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.198+0000 7f36c5400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36c0164ab0 0x7f36c0164090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:13.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.198+0000 7f36c5400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f36c0167560 con 0x7f36c015bfa0 2024-09-17T05:34:13.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.198+0000 7f36c5400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f36c01673e0 con 0x7f36c015c3e0 2024-09-17T05:34:13.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.198+0000 7f36c5400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f36c01676e0 con 0x7f36c0164ab0 2024-09-17T05:34:13.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.202+0000 7f36be800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36c015bfa0 0x7f36c0152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:13.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.202+0000 7f36be800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36c015bfa0 0x7f36c0152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60596/0 (socket says 172.21.15.31:60596) 2024-09-17T05:34:13.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.202+0000 7f36be800640 1 -- 172.21.15.31:0/3352422065 learned_addr learned my addr 172.21.15.31:0/3352422065 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:13.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.202+0000 7f36b5e00640 1 --2- 172.21.15.31:0/3352422065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36c015c3e0 0x7f36c0163b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:13.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.202+0000 7f36bf200640 1 --2- 172.21.15.31:0/3352422065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36c0164ab0 0x7f36c0164090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:13.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.202+0000 7f36be800640 1 -- 172.21.15.31:0/3352422065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36c0164ab0 msgr2=0x7f36c0164090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:13.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.202+0000 7f36be800640 1 --2- 172.21.15.31:0/3352422065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36c0164ab0 0x7f36c0164090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.202+0000 7f36be800640 1 -- 172.21.15.31:0/3352422065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36c015c3e0 msgr2=0x7f36c0163b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:13.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.202+0000 7f36be800640 1 --2- 172.21.15.31:0/3352422065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36c015c3e0 0x7f36c0163b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.202+0000 7f36be800640 1 -- 172.21.15.31:0/3352422065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c01537c0 con 0x7f36c015bfa0 2024-09-17T05:34:13.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.202+0000 7f36be800640 1 --2- 172.21.15.31:0/3352422065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36c015bfa0 0x7f36c0152910 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f36b000c4c0 tx=0x7f36b000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:13.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.202+0000 7f36b7400640 1 -- 172.21.15.31:0/3352422065 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b0016020 con 0x7f36c015bfa0 2024-09-17T05:34:13.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.202+0000 7f36c5400640 1 -- 172.21.15.31:0/3352422065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c0153320 con 0x7f36c015bfa0 2024-09-17T05:34:13.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.202+0000 7f36b7400640 1 -- 172.21.15.31:0/3352422065 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36b0012a00 con 0x7f36c015bfa0 2024-09-17T05:34:13.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.202+0000 7f36b7400640 1 -- 172.21.15.31:0/3352422065 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b0012e50 con 0x7f36c015bfa0 2024-09-17T05:34:13.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.202+0000 7f36c5400640 1 -- 172.21.15.31:0/3352422065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c0152e50 con 0x7f36c015bfa0 2024-09-17T05:34:13.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.202+0000 7f36c5400640 1 -- 172.21.15.31:0/3352422065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36c01f8a30 con 0x7f36c015bfa0 2024-09-17T05:34:13.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.202+0000 7f36b7400640 1 -- 172.21.15.31:0/3352422065 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f36b0019020 con 0x7f36c015bfa0 2024-09-17T05:34:13.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.206+0000 7f36b7400640 1 --2- 172.21.15.31:0/3352422065 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f369c073820 0x7f369c075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:13.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.206+0000 7f36b7400640 1 -- 172.21.15.31:0/3352422065 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5823+0+0 (secure 0 0 0) 0x7f36b0094a50 con 0x7f36c015bfa0 2024-09-17T05:34:13.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.206+0000 7f36b5e00640 1 --2- 172.21.15.31:0/3352422065 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f369c073820 0x7f369c075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:13.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.206+0000 7f36b5e00640 1 --2- 172.21.15.31:0/3352422065 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f369c073820 0x7f369c075ce0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f36a8000c10 tx=0x7f36a8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:13.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.210+0000 7f36b7400640 1 -- 172.21.15.31:0/3352422065 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f36b0020020 con 0x7f36c015bfa0 2024-09-17T05:34:13.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.390+0000 7f36c5400640 1 -- 172.21.15.31:0/3352422065 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36c0069410 con 0x7f36c015bfa0 2024-09-17T05:34:13.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.394+0000 7f36b7400640 1 -- 172.21.15.31:0/3352422065 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16909 (secure 0 0 0) 0x7f36b005ecc0 con 0x7f36c015bfa0 2024-09-17T05:34:13.394 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:13.394 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":103,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:34:12.827691+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:33:34.313310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T05:33:35.543945+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":103,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1a","mappings":[{"from":0,"to":2}]},{"pgid":"17.37","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:34:13.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.394+0000 7f36c5400640 1 -- 172.21.15.31:0/3352422065 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f369c073820 msgr2=0x7f369c075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.394+0000 7f36c5400640 1 --2- 172.21.15.31:0/3352422065 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f369c073820 0x7f369c075ce0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f36a8000c10 tx=0x7f36a8009040 comp rx=0 tx=0).stop 2024-09-17T05:34:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.394+0000 7f36c5400640 1 -- 172.21.15.31:0/3352422065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36c015bfa0 msgr2=0x7f36c0152910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.394+0000 7f36c5400640 1 --2- 172.21.15.31:0/3352422065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36c015bfa0 0x7f36c0152910 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f36b000c4c0 tx=0x7f36b000c980 comp rx=0 tx=0).stop 2024-09-17T05:34:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.394+0000 7f36c5400640 1 -- 172.21.15.31:0/3352422065 shutdown_connections 2024-09-17T05:34:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.394+0000 7f36c5400640 1 --2- 172.21.15.31:0/3352422065 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f369c073820 0x7f369c075ce0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.394+0000 7f36c5400640 1 --2- 172.21.15.31:0/3352422065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36c0164ab0 0x7f36c0164090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.394+0000 7f36c5400640 1 --2- 172.21.15.31:0/3352422065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36c015c3e0 0x7f36c0163b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.394+0000 7f36c5400640 1 --2- 172.21.15.31:0/3352422065 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36c015bfa0 0x7f36c0152910 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.394+0000 7f36c5400640 1 -- 172.21.15.31:0/3352422065 >> 172.21.15.31:0/3352422065 conn(0x7f36c00b18f0 msgr2=0x7f36c01546e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.394+0000 7f36c5400640 1 -- 172.21.15.31:0/3352422065 shutdown_connections 2024-09-17T05:34:13.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.394+0000 7f36c5400640 1 -- 172.21.15.31:0/3352422065 wait complete. 2024-09-17T05:34:13.416 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:34:13.416 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:34:13.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.562+0000 7f9609c00640 1 -- 172.21.15.31:0/1555762180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96040af4f0 msgr2=0x7f96040ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.562+0000 7f9609c00640 1 --2- 172.21.15.31:0/1555762180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96040af4f0 0x7f96040ce700 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f95fc009bc0 tx=0x7f95fc01cae0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.562+0000 7f9609c00640 1 -- 172.21.15.31:0/1555762180 shutdown_connections 2024-09-17T05:34:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.562+0000 7f9609c00640 1 --2- 172.21.15.31:0/1555762180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96040af4f0 0x7f96040ce700 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.562+0000 7f9609c00640 1 --2- 172.21.15.31:0/1555762180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96040cc750 0x7f9604068c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.562+0000 7f9609c00640 1 -- 172.21.15.31:0/1555762180 >> 172.21.15.31:0/1555762180 conn(0x7f96040b1f10 msgr2=0x7f96040b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.562+0000 7f9609c00640 1 -- 172.21.15.31:0/1555762180 shutdown_connections 2024-09-17T05:34:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.562+0000 7f9609c00640 1 -- 172.21.15.31:0/1555762180 wait complete. 2024-09-17T05:34:13.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.562+0000 7f9609c00640 1 Processor -- start 2024-09-17T05:34:13.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.562+0000 7f9609c00640 1 -- start start 2024-09-17T05:34:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9609c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96040af4f0 0x7f9604154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9609c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f960415e4a0 0x7f96040b3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9609c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96040b48b0 0x7f96040b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9609c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f96041680f0 con 0x7f96040b48b0 2024-09-17T05:34:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9609c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9604167f70 con 0x7f96040af4f0 2024-09-17T05:34:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9609c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9604168270 con 0x7f960415e4a0 2024-09-17T05:34:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9603400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96040b48b0 0x7f96040b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9603400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96040b48b0 0x7f96040b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60614/0 (socket says 172.21.15.31:60614) 2024-09-17T05:34:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9603400640 1 -- 172.21.15.31:0/378315126 learned_addr learned my addr 172.21.15.31:0/378315126 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f95fa000640 1 --2- 172.21.15.31:0/378315126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f960415e4a0 0x7f96040b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9602a00640 1 --2- 172.21.15.31:0/378315126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96040af4f0 0x7f9604154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9603400640 1 -- 172.21.15.31:0/378315126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f960415e4a0 msgr2=0x7f96040b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9603400640 1 --2- 172.21.15.31:0/378315126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f960415e4a0 0x7f96040b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9603400640 1 -- 172.21.15.31:0/378315126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96040af4f0 msgr2=0x7f9604154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9603400640 1 --2- 172.21.15.31:0/378315126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96040af4f0 0x7f9604154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9603400640 1 -- 172.21.15.31:0/378315126 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96040b3a80 con 0x7f96040b48b0 2024-09-17T05:34:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9602a00640 1 --2- 172.21.15.31:0/378315126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96040af4f0 0x7f9604154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9603400640 1 --2- 172.21.15.31:0/378315126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96040b48b0 0x7f96040b0d80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f95fc01c550 tx=0x7f95fc005a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:13.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f95fb400640 1 -- 172.21.15.31:0/378315126 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0b2040 con 0x7f96040b48b0 2024-09-17T05:34:13.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f95fb400640 1 -- 172.21.15.31:0/378315126 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95fc0bb070 con 0x7f96040b48b0 2024-09-17T05:34:13.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f95fb400640 1 -- 172.21.15.31:0/378315126 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc004390 con 0x7f96040b48b0 2024-09-17T05:34:13.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9609c00640 1 -- 172.21.15.31:0/378315126 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96040b3d60 con 0x7f96040b48b0 2024-09-17T05:34:13.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9609c00640 1 -- 172.21.15.31:0/378315126 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96040b4320 con 0x7f96040b48b0 2024-09-17T05:34:13.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f9609c00640 1 -- 172.21.15.31:0/378315126 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9604068c40 con 0x7f96040b48b0 2024-09-17T05:34:13.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.566+0000 7f95fb400640 1 -- 172.21.15.31:0/378315126 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f95fc004530 con 0x7f96040b48b0 2024-09-17T05:34:13.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.570+0000 7f95fb400640 1 --2- 172.21.15.31:0/378315126 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95e00736b0 0x7f95e0075b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:13.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.570+0000 7f95fb400640 1 -- 172.21.15.31:0/378315126 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5823+0+0 (secure 0 0 0) 0x7f95fc12f370 con 0x7f96040b48b0 2024-09-17T05:34:13.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.570+0000 7f9602a00640 1 --2- 172.21.15.31:0/378315126 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95e00736b0 0x7f95e0075b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:13.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.570+0000 7f9602a00640 1 --2- 172.21.15.31:0/378315126 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95e00736b0 0x7f95e0075b70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f96040ce160 tx=0x7f95f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:13.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.574+0000 7f95fb400640 1 -- 172.21.15.31:0/378315126 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f95fc016790 con 0x7f96040b48b0 2024-09-17T05:34:13.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.786+0000 7f9609c00640 1 -- 172.21.15.31:0/378315126 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9604074d50 con 0x7f96040b48b0 2024-09-17T05:34:13.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.786+0000 7f95fb400640 1 -- 172.21.15.31:0/378315126 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5228 (secure 0 0 0) 0x7f95fc0f9ce0 con 0x7f96040b48b0 2024-09-17T05:34:13.787 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:13.787 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":72,"btime":"2024-09-17T05:33:46:226011+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3921984787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3921984787},{"type":"v1","addr":"172.21.15.155:6809","nonce":3921984787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3122851843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3122851843},{"type":"v1","addr":"172.21.15.155:6835","nonce":3122851843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6936,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/706788626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":706788626},{"type":"v1","addr":"172.21.15.31:6834","nonce":706788626}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:33:36.585711+0000","modified":"2024-09-17T05:33:39.610967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4072380267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":4072380267},{"type":"v1","addr":"172.21.15.31:6835","nonce":4072380267}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6939,"qdb_cluster":[6939]},"id":8}]} 2024-09-17T05:34:13.788 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 72 2024-09-17T05:34:13.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.786+0000 7f9609c00640 1 -- 172.21.15.31:0/378315126 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95e00736b0 msgr2=0x7f95e0075b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:13.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.786+0000 7f9609c00640 1 --2- 172.21.15.31:0/378315126 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95e00736b0 0x7f95e0075b70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f96040ce160 tx=0x7f95f4009040 comp rx=0 tx=0).stop 2024-09-17T05:34:13.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.786+0000 7f9609c00640 1 -- 172.21.15.31:0/378315126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96040b48b0 msgr2=0x7f96040b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:13.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.786+0000 7f9609c00640 1 --2- 172.21.15.31:0/378315126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96040b48b0 0x7f96040b0d80 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f95fc01c550 tx=0x7f95fc005a80 comp rx=0 tx=0).stop 2024-09-17T05:34:13.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.786+0000 7f9609c00640 1 -- 172.21.15.31:0/378315126 shutdown_connections 2024-09-17T05:34:13.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.786+0000 7f9609c00640 1 --2- 172.21.15.31:0/378315126 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95e00736b0 0x7f95e0075b70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.786+0000 7f9609c00640 1 --2- 172.21.15.31:0/378315126 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96040b48b0 0x7f96040b0d80 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.786+0000 7f9609c00640 1 --2- 172.21.15.31:0/378315126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f960415e4a0 0x7f96040b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.786+0000 7f9609c00640 1 --2- 172.21.15.31:0/378315126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96040af4f0 0x7f9604154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.786+0000 7f9609c00640 1 -- 172.21.15.31:0/378315126 >> 172.21.15.31:0/378315126 conn(0x7f96040b1f10 msgr2=0x7f960406fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:13.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.786+0000 7f9609c00640 1 -- 172.21.15.31:0/378315126 shutdown_connections 2024-09-17T05:34:13.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.786+0000 7f9609c00640 1 -- 172.21.15.31:0/378315126 wait complete. 2024-09-17T05:34:13.808 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:34:13.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.954+0000 7f83a9c00640 1 -- 172.21.15.31:0/1541806290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8388003a60 msgr2=0x7f8388003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:13.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.954+0000 7f83a9c00640 1 --2- 172.21.15.31:0/1541806290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8388003a60 0x7f8388003e80 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f839400ac40 tx=0x7f839401e050 comp rx=0 tx=0).stop 2024-09-17T05:34:13.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.954+0000 7f83a3400640 1 -- 172.21.15.31:0/1541806290 reap_dead start 2024-09-17T05:34:13.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.954+0000 7f83a9c00640 1 -- 172.21.15.31:0/1541806290 shutdown_connections 2024-09-17T05:34:13.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.954+0000 7f83a9c00640 1 -- 172.21.15.31:0/1541806290 >> 172.21.15.31:0/1541806290 conn(0x7f83a40b18f0 msgr2=0x7f83a40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:13.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.954+0000 7f83a9c00640 1 -- 172.21.15.31:0/1541806290 shutdown_connections 2024-09-17T05:34:13.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.954+0000 7f83a9c00640 1 -- 172.21.15.31:0/1541806290 wait complete. 2024-09-17T05:34:13.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a9c00640 1 Processor -- start 2024-09-17T05:34:13.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a9c00640 1 -- start start 2024-09-17T05:34:13.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a9c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8388003a60 0x7f83a40cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:13.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a9c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83a415bb20 0x7f83a40cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:13.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a9c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83a4151a20 0x7f83a40ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:13.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a9c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f83a40ccbe0 con 0x7f83a4151a20 2024-09-17T05:34:13.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a9c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f83a40cca60 con 0x7f83a415bb20 2024-09-17T05:34:13.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a9c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f83a40ccd60 con 0x7f8388003a60 2024-09-17T05:34:13.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83a4151a20 0x7f83a40ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:13.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a2a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8388003a60 0x7f83a40cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:13.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83a4151a20 0x7f83a40ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60634/0 (socket says 172.21.15.31:60634) 2024-09-17T05:34:13.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a3400640 1 -- 172.21.15.31:0/1444483243 learned_addr learned my addr 172.21.15.31:0/1444483243 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:13.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a2000640 1 --2- 172.21.15.31:0/1444483243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83a415bb20 0x7f83a40cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:13.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a3400640 1 -- 172.21.15.31:0/1444483243 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8388003a60 msgr2=0x7f83a40cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:13.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a3400640 1 --2- 172.21.15.31:0/1444483243 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8388003a60 0x7f83a40cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a3400640 1 -- 172.21.15.31:0/1444483243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83a415bb20 msgr2=0x7f83a40cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:13.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a3400640 1 --2- 172.21.15.31:0/1444483243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83a415bb20 0x7f83a40cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:13.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a3400640 1 -- 172.21.15.31:0/1444483243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a41f7b50 con 0x7f83a4151a20 2024-09-17T05:34:13.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a3400640 1 --2- 172.21.15.31:0/1444483243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83a4151a20 0x7f83a40ce020 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f839c006290 tx=0x7f839c006750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:13.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f839aa00640 1 -- 172.21.15.31:0/1444483243 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c00fc60 con 0x7f83a4151a20 2024-09-17T05:34:13.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f839aa00640 1 -- 172.21.15.31:0/1444483243 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f839c00fe20 con 0x7f83a4151a20 2024-09-17T05:34:13.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f839aa00640 1 -- 172.21.15.31:0/1444483243 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c011690 con 0x7f83a4151a20 2024-09-17T05:34:13.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a9c00640 1 -- 172.21.15.31:0/1444483243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a415c070 con 0x7f83a4151a20 2024-09-17T05:34:13.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.958+0000 7f83a9c00640 1 -- 172.21.15.31:0/1444483243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a41f7df0 con 0x7f83a4151a20 2024-09-17T05:34:13.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.962+0000 7f83a9c00640 1 -- 172.21.15.31:0/1444483243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a40b42a0 con 0x7f83a4151a20 2024-09-17T05:34:13.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.962+0000 7f839aa00640 1 -- 172.21.15.31:0/1444483243 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f839c011830 con 0x7f83a4151a20 2024-09-17T05:34:13.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.962+0000 7f839aa00640 1 --2- 172.21.15.31:0/1444483243 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8384073680 0x7f8384075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:13.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.962+0000 7f839aa00640 1 -- 172.21.15.31:0/1444483243 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5823+0+0 (secure 0 0 0) 0x7f839c095290 con 0x7f83a4151a20 2024-09-17T05:34:13.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.962+0000 7f83a2a00640 1 --2- 172.21.15.31:0/1444483243 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8384073680 0x7f8384075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:13.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.962+0000 7f83a2a00640 1 --2- 172.21.15.31:0/1444483243 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8384073680 0x7f8384075b40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f83940af000 tx=0x7f839401adf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:13.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:13.966+0000 7f839aa00640 1 -- 172.21.15.31:0/1444483243 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f839c05f5e0 con 0x7f83a4151a20 2024-09-17T05:34:14.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.178+0000 7f83a9c00640 1 -- 172.21.15.31:0/1444483243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83a406feb0 con 0x7f83a4151a20 2024-09-17T05:34:14.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.178+0000 7f839aa00640 1 -- 172.21.15.31:0/1444483243 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5228 (secure 0 0 0) 0x7f839c064010 con 0x7f83a4151a20 2024-09-17T05:34:14.181 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:14.181 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":72,"btime":"2024-09-17T05:33:46:226011+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3921984787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3921984787},{"type":"v1","addr":"172.21.15.155:6809","nonce":3921984787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3122851843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3122851843},{"type":"v1","addr":"172.21.15.155:6835","nonce":3122851843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6936,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/706788626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":706788626},{"type":"v1","addr":"172.21.15.31:6834","nonce":706788626}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:33:36.585711+0000","modified":"2024-09-17T05:33:39.610967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/4072380267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":4072380267},{"type":"v1","addr":"172.21.15.31:6835","nonce":4072380267}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6939,"qdb_cluster":[6939]},"id":8}]} 2024-09-17T05:34:14.182 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 72 2024-09-17T05:34:14.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.182+0000 7f83a9c00640 1 -- 172.21.15.31:0/1444483243 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8384073680 msgr2=0x7f8384075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:14.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.182+0000 7f83a9c00640 1 --2- 172.21.15.31:0/1444483243 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8384073680 0x7f8384075b40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f83940af000 tx=0x7f839401adf0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.182+0000 7f83a9c00640 1 -- 172.21.15.31:0/1444483243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83a4151a20 msgr2=0x7f83a40ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:14.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.182+0000 7f83a9c00640 1 --2- 172.21.15.31:0/1444483243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83a4151a20 0x7f83a40ce020 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f839c006290 tx=0x7f839c006750 comp rx=0 tx=0).stop 2024-09-17T05:34:14.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.182+0000 7f83a9c00640 1 -- 172.21.15.31:0/1444483243 shutdown_connections 2024-09-17T05:34:14.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.182+0000 7f83a9c00640 1 --2- 172.21.15.31:0/1444483243 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8384073680 0x7f8384075b40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.182+0000 7f83a9c00640 1 --2- 172.21.15.31:0/1444483243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f83a4151a20 0x7f83a40ce020 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.182+0000 7f83a9c00640 1 --2- 172.21.15.31:0/1444483243 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83a415bb20 0x7f83a40cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.182+0000 7f83a9c00640 1 --2- 172.21.15.31:0/1444483243 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8388003a60 0x7f83a40cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.182+0000 7f83a9c00640 1 -- 172.21.15.31:0/1444483243 >> 172.21.15.31:0/1444483243 conn(0x7f83a40b18f0 msgr2=0x7f83a40af8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:14.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.182+0000 7f83a9c00640 1 -- 172.21.15.31:0/1444483243 shutdown_connections 2024-09-17T05:34:14.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.182+0000 7f83a9c00640 1 -- 172.21.15.31:0/1444483243 wait complete. 2024-09-17T05:34:14.202 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:34:14.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.350+0000 7fa9fba00640 1 -- 172.21.15.31:0/4232703383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9f415f490 msgr2=0x7fa9f40b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:14.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.350+0000 7fa9fba00640 1 --2- 172.21.15.31:0/4232703383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9f415f490 0x7fa9f40b14c0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4073dd0 tx=0x7fa9e801c830 comp rx=0 tx=0).stop 2024-09-17T05:34:14.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.350+0000 7fa9fba00640 1 -- 172.21.15.31:0/4232703383 shutdown_connections 2024-09-17T05:34:14.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.350+0000 7fa9fba00640 1 --2- 172.21.15.31:0/4232703383 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9f40b1f40 0x7fa9f40cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.350+0000 7fa9fba00640 1 --2- 172.21.15.31:0/4232703383 >> v2:172.21.15.155:3300/0 conn(0x7fa9f40b2e80 0x7fa9f40b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.350+0000 7fa9fba00640 1 --2- 172.21.15.31:0/4232703383 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9f415f490 0x7fa9f40b14c0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.350+0000 7fa9fba00640 1 -- 172.21.15.31:0/4232703383 >> 172.21.15.31:0/4232703383 conn(0x7fa9f40d1e30 msgr2=0x7fa9f40d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:14.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.350+0000 7fa9fba00640 1 -- 172.21.15.31:0/4232703383 shutdown_connections 2024-09-17T05:34:14.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.350+0000 7fa9fba00640 1 -- 172.21.15.31:0/4232703383 wait complete. 2024-09-17T05:34:14.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.350+0000 7fa9fba00640 1 Processor -- start 2024-09-17T05:34:14.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.350+0000 7fa9fba00640 1 -- start start 2024-09-17T05:34:14.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.350+0000 7fa9fba00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9f40b1f40 0x7fa9f415a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:14.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.350+0000 7fa9fba00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9f40b2e80 0x7fa9f41f7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:14.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.350+0000 7fa9fba00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9f415f490 0x7fa9f41f7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:14.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.350+0000 7fa9fba00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f40b0030 con 0x7fa9f415f490 2024-09-17T05:34:14.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.350+0000 7fa9fba00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f40afeb0 con 0x7fa9f40b1f40 2024-09-17T05:34:14.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.350+0000 7fa9fba00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f40b01b0 con 0x7fa9f40b2e80 2024-09-17T05:34:14.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9f9a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9f415f490 0x7fa9f41f7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:14.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9f9a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9f415f490 0x7fa9f41f7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60656/0 (socket says 172.21.15.31:60656) 2024-09-17T05:34:14.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9f9a00640 1 -- 172.21.15.31:0/1472102848 learned_addr learned my addr 172.21.15.31:0/1472102848 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:14.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9f9000640 1 --2- 172.21.15.31:0/1472102848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9f40b1f40 0x7fa9f415a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:14.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9f3e00640 1 --2- 172.21.15.31:0/1472102848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9f40b2e80 0x7fa9f41f7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:14.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9f9a00640 1 -- 172.21.15.31:0/1472102848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9f40b2e80 msgr2=0x7fa9f41f7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:14.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9f9a00640 1 --2- 172.21.15.31:0/1472102848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9f40b2e80 0x7fa9f41f7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9f9a00640 1 -- 172.21.15.31:0/1472102848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9f40b1f40 msgr2=0x7fa9f415a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:14.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9f9a00640 1 --2- 172.21.15.31:0/1472102848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9f40b1f40 0x7fa9f415a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9f9a00640 1 -- 172.21.15.31:0/1472102848 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f40cb580 con 0x7fa9f415f490 2024-09-17T05:34:14.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9f9000640 1 --2- 172.21.15.31:0/1472102848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9f40b1f40 0x7fa9f415a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:14.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9f9a00640 1 --2- 172.21.15.31:0/1472102848 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9f415f490 0x7fa9f41f7a50 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00e990 tx=0x7fa9ec00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:14.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9f0c00640 1 -- 172.21.15.31:0/1472102848 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec004d30 con 0x7fa9f415f490 2024-09-17T05:34:14.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9f0c00640 1 -- 172.21.15.31:0/1472102848 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9ec00cb00 con 0x7fa9f415f490 2024-09-17T05:34:14.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9f0c00640 1 -- 172.21.15.31:0/1472102848 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec005020 con 0x7fa9f415f490 2024-09-17T05:34:14.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9fba00640 1 -- 172.21.15.31:0/1472102848 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f415ab30 con 0x7fa9f415f490 2024-09-17T05:34:14.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9fba00640 1 -- 172.21.15.31:0/1472102848 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f40ca1b0 con 0x7fa9f415f490 2024-09-17T05:34:14.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9fba00640 1 -- 172.21.15.31:0/1472102848 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9f40cfda0 con 0x7fa9f415f490 2024-09-17T05:34:14.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.354+0000 7fa9f0c00640 1 -- 172.21.15.31:0/1472102848 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7fa9ec0051c0 con 0x7fa9f415f490 2024-09-17T05:34:14.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.358+0000 7fa9f0c00640 1 --2- 172.21.15.31:0/1472102848 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa9d4073680 0x7fa9d4075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:14.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.358+0000 7fa9f0c00640 1 -- 172.21.15.31:0/1472102848 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5823+0+0 (secure 0 0 0) 0x7fa9ec0954e0 con 0x7fa9f415f490 2024-09-17T05:34:14.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.358+0000 7fa9f9000640 1 --2- 172.21.15.31:0/1472102848 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa9d4073680 0x7fa9d4075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:14.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.358+0000 7fa9f9000640 1 --2- 172.21.15.31:0/1472102848 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa9d4073680 0x7fa9d4075b40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80af000 tx=0x7fa9e801b070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:14.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.362+0000 7fa9f0c00640 1 -- 172.21.15.31:0/1472102848 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa9ec016030 con 0x7fa9f415f490 2024-09-17T05:34:14.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.538+0000 7fa9fba00640 1 -- 172.21.15.31:0/1472102848 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa9f41f8650 con 0x7fa9f415f490 2024-09-17T05:34:14.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.542+0000 7fa9f0c00640 1 -- 172.21.15.31:0/1472102848 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16909 (secure 0 0 0) 0x7fa9ec05fd10 con 0x7fa9f415f490 2024-09-17T05:34:14.543 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:14.543 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":103,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:34:12.827691+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:33:34.313310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T05:33:35.543945+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":103,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.1a","mappings":[{"from":0,"to":2}]},{"pgid":"17.37","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:34:14.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.542+0000 7fa9fba00640 1 -- 172.21.15.31:0/1472102848 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa9d4073680 msgr2=0x7fa9d4075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:14.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.542+0000 7fa9fba00640 1 --2- 172.21.15.31:0/1472102848 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa9d4073680 0x7fa9d4075b40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80af000 tx=0x7fa9e801b070 comp rx=0 tx=0).stop 2024-09-17T05:34:14.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.542+0000 7fa9fba00640 1 -- 172.21.15.31:0/1472102848 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9f415f490 msgr2=0x7fa9f41f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:14.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.542+0000 7fa9fba00640 1 --2- 172.21.15.31:0/1472102848 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9f415f490 0x7fa9f41f7a50 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00e990 tx=0x7fa9ec00ee50 comp rx=0 tx=0).stop 2024-09-17T05:34:14.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.542+0000 7fa9fba00640 1 -- 172.21.15.31:0/1472102848 shutdown_connections 2024-09-17T05:34:14.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.542+0000 7fa9fba00640 1 --2- 172.21.15.31:0/1472102848 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa9d4073680 0x7fa9d4075b40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.542+0000 7fa9fba00640 1 --2- 172.21.15.31:0/1472102848 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9f415f490 0x7fa9f41f7a50 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.542+0000 7fa9fba00640 1 --2- 172.21.15.31:0/1472102848 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9f40b2e80 0x7fa9f41f7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.542+0000 7fa9fba00640 1 --2- 172.21.15.31:0/1472102848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9f40b1f40 0x7fa9f415a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.542+0000 7fa9fba00640 1 -- 172.21.15.31:0/1472102848 >> 172.21.15.31:0/1472102848 conn(0x7fa9f40d1e30 msgr2=0x7fa9f40ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:14.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.542+0000 7fa9fba00640 1 -- 172.21.15.31:0/1472102848 shutdown_connections 2024-09-17T05:34:14.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.542+0000 7fa9fba00640 1 -- 172.21.15.31:0/1472102848 wait complete. 2024-09-17T05:34:14.564 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:34:14.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.710+0000 7fc377e00640 1 -- 172.21.15.31:0/3763979186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3781617b0 msgr2=0x7fc3780d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:14.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.710+0000 7fc377e00640 1 --2- 172.21.15.31:0/3763979186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3781617b0 0x7fc3780d0c50 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc360009840 tx=0x7fc36001c7f0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.710+0000 7fc377e00640 1 -- 172.21.15.31:0/3763979186 shutdown_connections 2024-09-17T05:34:14.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.710+0000 7fc377e00640 1 --2- 172.21.15.31:0/3763979186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3780d29e0 0x7fc3780b6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.710+0000 7fc377e00640 1 --2- 172.21.15.31:0/3763979186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3781617b0 0x7fc3780d0c50 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.710+0000 7fc377e00640 1 -- 172.21.15.31:0/3763979186 >> 172.21.15.31:0/3763979186 conn(0x7fc3780d3e00 msgr2=0x7fc3780d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:14.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.710+0000 7fc377e00640 1 -- 172.21.15.31:0/3763979186 shutdown_connections 2024-09-17T05:34:14.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.710+0000 7fc377e00640 1 -- 172.21.15.31:0/3763979186 wait complete. 2024-09-17T05:34:14.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc377e00640 1 Processor -- start 2024-09-17T05:34:14.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc377e00640 1 -- start start 2024-09-17T05:34:14.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc377e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3780d29e0 0x7fc37815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:14.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc377e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3781613d0 0x7fc378155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:14.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc377e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3781617b0 0x7fc3780cd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:14.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc377e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc37816acc0 con 0x7fc3781613d0 2024-09-17T05:34:14.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc377e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc3780b81c0 con 0x7fc3781617b0 2024-09-17T05:34:14.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc377e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc37816ae40 con 0x7fc3780d29e0 2024-09-17T05:34:14.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc36fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3781613d0 0x7fc378155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:14.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc36fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3781613d0 0x7fc378155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60668/0 (socket says 172.21.15.31:60668) 2024-09-17T05:34:14.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc36fe00640 1 -- 172.21.15.31:0/3185241693 learned_addr learned my addr 172.21.15.31:0/3185241693 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:14.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc376a00640 1 --2- 172.21.15.31:0/3185241693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3780d29e0 0x7fc37815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:14.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc377400640 1 --2- 172.21.15.31:0/3185241693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3781617b0 0x7fc3780cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:14.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc36fe00640 1 -- 172.21.15.31:0/3185241693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3780d29e0 msgr2=0x7fc37815b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:14.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc36fe00640 1 --2- 172.21.15.31:0/3185241693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3780d29e0 0x7fc37815b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc36fe00640 1 -- 172.21.15.31:0/3185241693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3781617b0 msgr2=0x7fc3780cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:14.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc36fe00640 1 --2- 172.21.15.31:0/3185241693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3781617b0 0x7fc3780cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc36fe00640 1 -- 172.21.15.31:0/3185241693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc378159550 con 0x7fc3781613d0 2024-09-17T05:34:14.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc36fe00640 1 --2- 172.21.15.31:0/3185241693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3781613d0 0x7fc378155c30 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fc360009790 tx=0x7fc360005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:14.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc36ea00640 1 -- 172.21.15.31:0/3185241693 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3600b2040 con 0x7fc3781613d0 2024-09-17T05:34:14.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc36ea00640 1 -- 172.21.15.31:0/3185241693 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc360004330 con 0x7fc3781613d0 2024-09-17T05:34:14.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc36ea00640 1 -- 172.21.15.31:0/3185241693 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360003800 con 0x7fc3781613d0 2024-09-17T05:34:14.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc377e00640 1 -- 172.21.15.31:0/3185241693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc378159830 con 0x7fc3781613d0 2024-09-17T05:34:14.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc377e00640 1 -- 172.21.15.31:0/3185241693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc378159df0 con 0x7fc3781613d0 2024-09-17T05:34:14.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.714+0000 7fc377e00640 1 -- 172.21.15.31:0/3185241693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3780b6f80 con 0x7fc3781613d0 2024-09-17T05:34:14.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.718+0000 7fc36ea00640 1 -- 172.21.15.31:0/3185241693 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7fc3600bd060 con 0x7fc3781613d0 2024-09-17T05:34:14.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.718+0000 7fc36ea00640 1 --2- 172.21.15.31:0/3185241693 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc354073680 0x7fc354075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:14.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.718+0000 7fc36ea00640 1 -- 172.21.15.31:0/3185241693 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5823+0+0 (secure 0 0 0) 0x7fc36012e2c0 con 0x7fc3781613d0 2024-09-17T05:34:14.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.718+0000 7fc376a00640 1 --2- 172.21.15.31:0/3185241693 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc354073680 0x7fc354075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:14.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.718+0000 7fc376a00640 1 --2- 172.21.15.31:0/3185241693 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc354073680 0x7fc354075b40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc368001910 tx=0x7fc368001420 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:14.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.722+0000 7fc36ea00640 1 -- 172.21.15.31:0/3185241693 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc360016410 con 0x7fc3781613d0 2024-09-17T05:34:14.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.934+0000 7fc377e00640 1 -- 172.21.15.31:0/3185241693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc37815a9b0 con 0x7fc3781613d0 2024-09-17T05:34:14.937 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-09-17T05:34:14.934+0000 7f21d0200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:34:14.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.938+0000 7fc36ea00640 1 -- 172.21.15.31:0/3185241693 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) ==== 161+0+0 (secure 0 0 0) 0x7fc3600f8530 con 0x7fc3781613d0 2024-09-17T05:34:14.939 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:34:14.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.942+0000 7fc377e00640 1 -- 172.21.15.31:0/3185241693 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc354073680 msgr2=0x7fc354075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:14.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.942+0000 7fc377e00640 1 --2- 172.21.15.31:0/3185241693 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc354073680 0x7fc354075b40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc368001910 tx=0x7fc368001420 comp rx=0 tx=0).stop 2024-09-17T05:34:14.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.942+0000 7fc377e00640 1 -- 172.21.15.31:0/3185241693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3781613d0 msgr2=0x7fc378155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:14.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.942+0000 7fc377e00640 1 --2- 172.21.15.31:0/3185241693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3781613d0 0x7fc378155c30 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fc360009790 tx=0x7fc360005d20 comp rx=0 tx=0).stop 2024-09-17T05:34:14.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.942+0000 7fc377e00640 1 -- 172.21.15.31:0/3185241693 shutdown_connections 2024-09-17T05:34:14.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.942+0000 7fc377e00640 1 --2- 172.21.15.31:0/3185241693 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc354073680 0x7fc354075b40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.942+0000 7fc377e00640 1 --2- 172.21.15.31:0/3185241693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3781617b0 0x7fc3780cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.942+0000 7fc377e00640 1 --2- 172.21.15.31:0/3185241693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3781613d0 0x7fc378155c30 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.942+0000 7fc377e00640 1 --2- 172.21.15.31:0/3185241693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc3780d29e0 0x7fc37815b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:14.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.942+0000 7fc377e00640 1 -- 172.21.15.31:0/3185241693 >> 172.21.15.31:0/3185241693 conn(0x7fc3780d3e00 msgr2=0x7fc3780c99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:14.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.942+0000 7fc377e00640 1 -- 172.21.15.31:0/3185241693 shutdown_connections 2024-09-17T05:34:14.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:14.942+0000 7fc377e00640 1 -- 172.21.15.31:0/3185241693 wait complete. 2024-09-17T05:34:14.965 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:34:15.009 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-17T05:34:15.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.114+0000 7f6d48c00640 1 -- 172.21.15.31:0/2632655979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d440b0210 msgr2=0x7f6d441670a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:15.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.114+0000 7f6d48c00640 1 --2- 172.21.15.31:0/2632655979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d440b0210 0x7f6d441670a0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009bc0 tx=0x7f6d3c01cb70 comp rx=0 tx=0).stop 2024-09-17T05:34:15.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.114+0000 7f6d48c00640 1 -- 172.21.15.31:0/2632655979 shutdown_connections 2024-09-17T05:34:15.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.114+0000 7f6d48c00640 1 --2- 172.21.15.31:0/2632655979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d440b0210 0x7f6d441670a0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:15.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.114+0000 7f6d48c00640 1 -- 172.21.15.31:0/2632655979 >> 172.21.15.31:0/2632655979 conn(0x7f6d440d1e90 msgr2=0x7f6d440d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:15.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.114+0000 7f6d48c00640 1 -- 172.21.15.31:0/2632655979 shutdown_connections 2024-09-17T05:34:15.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.114+0000 7f6d48c00640 1 -- 172.21.15.31:0/2632655979 wait complete. 2024-09-17T05:34:15.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d48c00640 1 Processor -- start 2024-09-17T05:34:15.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d48c00640 1 -- start start 2024-09-17T05:34:15.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d48c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d440b0210 0x7f6d440c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:15.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d48c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d440d00f0 0x7f6d44143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:15.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d48c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d440d29b0 0x7f6d441536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:15.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d48c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4416a510 con 0x7f6d440d29b0 2024-09-17T05:34:15.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d48c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4416a390 con 0x7f6d440d00f0 2024-09-17T05:34:15.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d48c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6d4416a690 con 0x7f6d440b0210 2024-09-17T05:34:15.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d42800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d440d29b0 0x7f6d441536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:15.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d42800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d440d29b0 0x7f6d441536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60708/0 (socket says 172.21.15.31:60708) 2024-09-17T05:34:15.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d41e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d440b0210 0x7f6d440c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:15.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d42800640 1 -- 172.21.15.31:0/2568676180 learned_addr learned my addr 172.21.15.31:0/2568676180 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:15.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d3be00640 1 --2- 172.21.15.31:0/2568676180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d440d00f0 0x7f6d44143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:15.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d42800640 1 -- 172.21.15.31:0/2568676180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d440b0210 msgr2=0x7f6d440c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:15.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d42800640 1 --2- 172.21.15.31:0/2568676180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d440b0210 0x7f6d440c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:15.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d42800640 1 -- 172.21.15.31:0/2568676180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d440d00f0 msgr2=0x7f6d44143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:15.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d42800640 1 --2- 172.21.15.31:0/2568676180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d440d00f0 0x7f6d44143060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:15.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d42800640 1 -- 172.21.15.31:0/2568676180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d441435a0 con 0x7f6d440d29b0 2024-09-17T05:34:15.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d3be00640 1 --2- 172.21.15.31:0/2568676180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d440d00f0 0x7f6d44143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:15.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d42800640 1 --2- 172.21.15.31:0/2568676180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d440d29b0 0x7f6d441536c0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c01a7a0 tx=0x7f6d3c0a5bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:15.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d3a000640 1 -- 172.21.15.31:0/2568676180 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c0bb070 con 0x7f6d440d29b0 2024-09-17T05:34:15.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d3a000640 1 -- 172.21.15.31:0/2568676180 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d3c004e00 con 0x7f6d440d29b0 2024-09-17T05:34:15.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d48c00640 1 -- 172.21.15.31:0/2568676180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d440cf4e0 con 0x7f6d440d29b0 2024-09-17T05:34:15.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d3a000640 1 -- 172.21.15.31:0/2568676180 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c0b2040 con 0x7f6d440d29b0 2024-09-17T05:34:15.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.118+0000 7f6d48c00640 1 -- 172.21.15.31:0/2568676180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d441439c0 con 0x7f6d440d29b0 2024-09-17T05:34:15.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.122+0000 7f6d48c00640 1 -- 172.21.15.31:0/2568676180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d440b15e0 con 0x7f6d440d29b0 2024-09-17T05:34:15.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.122+0000 7f6d3a000640 1 -- 172.21.15.31:0/2568676180 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f6d3c004360 con 0x7f6d440d29b0 2024-09-17T05:34:15.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.122+0000 7f6d3a000640 1 --2- 172.21.15.31:0/2568676180 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d20073680 0x7f6d20075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:15.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.122+0000 7f6d3a000640 1 -- 172.21.15.31:0/2568676180 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5881+0+0 (secure 0 0 0) 0x7f6d3c12eac0 con 0x7f6d440d29b0 2024-09-17T05:34:15.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.122+0000 7f6d41e00640 1 --2- 172.21.15.31:0/2568676180 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d20073680 0x7f6d20075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:15.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.122+0000 7f6d41e00640 1 --2- 172.21.15.31:0/2568676180 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d20073680 0x7f6d20075b40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6d34007fd0 tx=0x7f6d34007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:15.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.126+0000 7f6d3a000640 1 -- 172.21.15.31:0/2568676180 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6d3c0f2120 con 0x7f6d440d29b0 2024-09-17T05:34:15.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.342+0000 7f6d48c00640 1 -- 172.21.15.31:0/2568676180 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6d440b4870 con 0x7f6d440d29b0 2024-09-17T05:34:15.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.938+0000 7f6d3a000640 1 -- 172.21.15.31:0/2568676180 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v74) ==== 104+0+0 (secure 0 0 0) 0x7f6d441435a0 con 0x7f6d440d29b0 2024-09-17T05:34:15.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.942+0000 7f6d48c00640 1 -- 172.21.15.31:0/2568676180 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d20073680 msgr2=0x7f6d20075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:15.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.942+0000 7f6d48c00640 1 --2- 172.21.15.31:0/2568676180 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d20073680 0x7f6d20075b40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6d34007fd0 tx=0x7f6d34007e40 comp rx=0 tx=0).stop 2024-09-17T05:34:15.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.942+0000 7f6d48c00640 1 -- 172.21.15.31:0/2568676180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d440d29b0 msgr2=0x7f6d441536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:15.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.942+0000 7f6d48c00640 1 --2- 172.21.15.31:0/2568676180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d440d29b0 0x7f6d441536c0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c01a7a0 tx=0x7f6d3c0a5bc0 comp rx=0 tx=0).stop 2024-09-17T05:34:15.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.942+0000 7f6d48c00640 1 -- 172.21.15.31:0/2568676180 shutdown_connections 2024-09-17T05:34:15.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.942+0000 7f6d48c00640 1 --2- 172.21.15.31:0/2568676180 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d20073680 0x7f6d20075b40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:15.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.942+0000 7f6d48c00640 1 --2- 172.21.15.31:0/2568676180 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d440d29b0 0x7f6d441536c0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:15.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.942+0000 7f6d48c00640 1 --2- 172.21.15.31:0/2568676180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d440d00f0 0x7f6d44143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:15.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.942+0000 7f6d48c00640 1 --2- 172.21.15.31:0/2568676180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d440b0210 0x7f6d440c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:15.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.942+0000 7f6d48c00640 1 -- 172.21.15.31:0/2568676180 >> 172.21.15.31:0/2568676180 conn(0x7f6d440d1e90 msgr2=0x7f6d440d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:15.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.942+0000 7f6d48c00640 1 -- 172.21.15.31:0/2568676180 shutdown_connections 2024-09-17T05:34:15.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:15.942+0000 7f6d48c00640 1 -- 172.21.15.31:0/2568676180 wait complete. 2024-09-17T05:34:15.970 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:34:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.170+0000 7f7cd2a00640 1 -- 172.21.15.31:0/2876077355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ccc0cb250 msgr2=0x7f7ccc06ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:16.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.170+0000 7f7cd2a00640 1 --2- 172.21.15.31:0/2876077355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ccc0cb250 0x7f7ccc06ef10 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0b6100 tx=0x7f7cbc01c830 comp rx=0 tx=0).stop 2024-09-17T05:34:16.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.170+0000 7f7cd2a00640 1 -- 172.21.15.31:0/2876077355 shutdown_connections 2024-09-17T05:34:16.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.170+0000 7f7cd2a00640 1 --2- 172.21.15.31:0/2876077355 >> v2:172.21.15.155:3300/0 conn(0x7f7ccc070580 0x7f7ccc0af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:16.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.170+0000 7f7cd2a00640 1 --2- 172.21.15.31:0/2876077355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ccc0cb250 0x7f7ccc06ef10 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:16.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.170+0000 7f7cd2a00640 1 -- 172.21.15.31:0/2876077355 >> 172.21.15.31:0/2876077355 conn(0x7f7ccc0d0000 msgr2=0x7f7ccc0d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:16.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.170+0000 7f7cd2a00640 1 -- 172.21.15.31:0/2876077355 shutdown_connections 2024-09-17T05:34:16.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.170+0000 7f7cd2a00640 1 -- 172.21.15.31:0/2876077355 wait complete. 2024-09-17T05:34:16.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.170+0000 7f7cd2a00640 1 Processor -- start 2024-09-17T05:34:16.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.170+0000 7f7cd2a00640 1 -- start start 2024-09-17T05:34:16.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7cd2a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ccc070580 0x7f7ccc1fadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:16.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7cd2a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ccc0cb250 0x7f7ccc165170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:16.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7cd2a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ccc0cb630 0x7f7ccc15b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:16.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7cd2a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc0ce970 con 0x7f7ccc070580 2024-09-17T05:34:16.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7cd2a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7ccc0ce7f0 con 0x7f7ccc0cb250 2024-09-17T05:34:16.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7cd2a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7ccc167f00 con 0x7f7ccc0cb630 2024-09-17T05:34:16.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7ccbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ccc070580 0x7f7ccc1fadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:16.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7ccbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ccc070580 0x7f7ccc1fadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60736/0 (socket says 172.21.15.31:60736) 2024-09-17T05:34:16.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7ccbe00640 1 -- 172.21.15.31:0/318974608 learned_addr learned my addr 172.21.15.31:0/318974608 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:16.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7cc3400640 1 --2- 172.21.15.31:0/318974608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ccc0cb250 0x7f7ccc165170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:16.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7cd0a00640 1 --2- 172.21.15.31:0/318974608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ccc0cb630 0x7f7ccc15b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:16.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7ccbe00640 1 -- 172.21.15.31:0/318974608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ccc0cb630 msgr2=0x7f7ccc15b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:16.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7ccbe00640 1 --2- 172.21.15.31:0/318974608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ccc0cb630 0x7f7ccc15b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:16.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7ccbe00640 1 -- 172.21.15.31:0/318974608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ccc0cb250 msgr2=0x7f7ccc165170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:16.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7ccbe00640 1 --2- 172.21.15.31:0/318974608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ccc0cb250 0x7f7ccc165170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:16.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7ccbe00640 1 -- 172.21.15.31:0/318974608 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ccc0c9520 con 0x7f7ccc070580 2024-09-17T05:34:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7cc3400640 1 --2- 172.21.15.31:0/318974608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ccc0cb250 0x7f7ccc165170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:34:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7cd0a00640 1 --2- 172.21.15.31:0/318974608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ccc0cb630 0x7f7ccc15b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:34:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7ccbe00640 1 --2- 172.21.15.31:0/318974608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ccc070580 0x7f7ccc1fadf0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0b0040 tx=0x7f7cbc0a56d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7cc8c00640 1 -- 172.21.15.31:0/318974608 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0bc070 con 0x7f7ccc070580 2024-09-17T05:34:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7cc8c00640 1 -- 172.21.15.31:0/318974608 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7cbc0044d0 con 0x7f7ccc070580 2024-09-17T05:34:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7cc8c00640 1 -- 172.21.15.31:0/318974608 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0b2040 con 0x7f7ccc070580 2024-09-17T05:34:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7cd2a00640 1 -- 172.21.15.31:0/318974608 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ccc1fb840 con 0x7f7ccc070580 2024-09-17T05:34:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7cd2a00640 1 -- 172.21.15.31:0/318974608 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ccc0c9f30 con 0x7f7ccc070580 2024-09-17T05:34:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7cd2a00640 1 -- 172.21.15.31:0/318974608 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ccc164a90 con 0x7f7ccc070580 2024-09-17T05:34:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.174+0000 7f7cc8c00640 1 -- 172.21.15.31:0/318974608 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f7cbc005280 con 0x7f7ccc070580 2024-09-17T05:34:16.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.178+0000 7f7cc8c00640 1 --2- 172.21.15.31:0/318974608 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7ca8073680 0x7f7ca8075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:16.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.178+0000 7f7cc8c00640 1 -- 172.21.15.31:0/318974608 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5881+0+0 (secure 0 0 0) 0x7f7cbc12ebc0 con 0x7f7ccc070580 2024-09-17T05:34:16.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.178+0000 7f7cc3400640 1 --2- 172.21.15.31:0/318974608 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7ca8073680 0x7f7ca8075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:16.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.178+0000 7f7cc3400640 1 --2- 172.21.15.31:0/318974608 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7ca8073680 0x7f7ca8075b40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4005fd0 tx=0x7f7cb4005da0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:16.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.182+0000 7f7cc8c00640 1 -- 172.21.15.31:0/318974608 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7ccc164a90 con 0x7f7ccc070580 2024-09-17T05:34:16.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.358+0000 7f7cd2a00640 1 -- 172.21.15.31:0/318974608 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7ccc0d0d00 con 0x7f7ccc070580 2024-09-17T05:34:16.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.946+0000 7f7cc8c00640 1 -- 172.21.15.31:0/318974608 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v105) ==== 181+0+0 (secure 0 0 0) 0x7f7cbc0164b0 con 0x7f7ccc070580 2024-09-17T05:34:16.947 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:34:16.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.950+0000 7f7cd2a00640 1 -- 172.21.15.31:0/318974608 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7ca8073680 msgr2=0x7f7ca8075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:16.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.950+0000 7f7cd2a00640 1 --2- 172.21.15.31:0/318974608 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7ca8073680 0x7f7ca8075b40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4005fd0 tx=0x7f7cb4005da0 comp rx=0 tx=0).stop 2024-09-17T05:34:16.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.950+0000 7f7cd2a00640 1 -- 172.21.15.31:0/318974608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ccc070580 msgr2=0x7f7ccc1fadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:16.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.950+0000 7f7cd2a00640 1 --2- 172.21.15.31:0/318974608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ccc070580 0x7f7ccc1fadf0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0b0040 tx=0x7f7cbc0a56d0 comp rx=0 tx=0).stop 2024-09-17T05:34:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.950+0000 7f7cd2a00640 1 -- 172.21.15.31:0/318974608 shutdown_connections 2024-09-17T05:34:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.950+0000 7f7cd2a00640 1 --2- 172.21.15.31:0/318974608 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7ca8073680 0x7f7ca8075b40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.950+0000 7f7cd2a00640 1 --2- 172.21.15.31:0/318974608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7ccc0cb630 0x7f7ccc15b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.950+0000 7f7cd2a00640 1 --2- 172.21.15.31:0/318974608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ccc0cb250 0x7f7ccc165170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.950+0000 7f7cd2a00640 1 --2- 172.21.15.31:0/318974608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ccc070580 0x7f7ccc1fadf0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.950+0000 7f7cd2a00640 1 -- 172.21.15.31:0/318974608 >> 172.21.15.31:0/318974608 conn(0x7f7ccc0d0000 msgr2=0x7f7ccc0b1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.950+0000 7f7cd2a00640 1 -- 172.21.15.31:0/318974608 shutdown_connections 2024-09-17T05:34:16.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:16.950+0000 7f7cd2a00640 1 -- 172.21.15.31:0/318974608 wait complete. 2024-09-17T05:34:16.977 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:34:17.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.130+0000 7fdbddc00640 1 -- 172.21.15.31:0/1598783493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd80cff00 msgr2=0x7fdbd80d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:17.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.130+0000 7fdbddc00640 1 --2- 172.21.15.31:0/1598783493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd80cff00 0x7fdbd80d28c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009900 tx=0x7fdbc801c8b0 comp rx=0 tx=0).stop 2024-09-17T05:34:17.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.130+0000 7fdbddc00640 1 -- 172.21.15.31:0/1598783493 shutdown_connections 2024-09-17T05:34:17.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.130+0000 7fdbddc00640 1 --2- 172.21.15.31:0/1598783493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbd80d02e0 0x7fdbd80d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:17.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.130+0000 7fdbddc00640 1 --2- 172.21.15.31:0/1598783493 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd80cff00 0x7fdbd80d28c0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:17.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.130+0000 7fdbddc00640 1 -- 172.21.15.31:0/1598783493 >> 172.21.15.31:0/1598783493 conn(0x7fdbd80d1da0 msgr2=0x7fdbd80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:17.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.130+0000 7fdbddc00640 1 -- 172.21.15.31:0/1598783493 shutdown_connections 2024-09-17T05:34:17.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.130+0000 7fdbddc00640 1 -- 172.21.15.31:0/1598783493 wait complete. 2024-09-17T05:34:17.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbddc00640 1 Processor -- start 2024-09-17T05:34:17.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbddc00640 1 -- start start 2024-09-17T05:34:17.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbddc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd80cff00 0x7fdbd8151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:17.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbddc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbd80d02e0 0x7fdbd80c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:17.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbddc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbd815eff0 0x7fdbd80ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:17.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbddc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd8169140 con 0x7fdbd80cff00 2024-09-17T05:34:17.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbddc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd8168fc0 con 0x7fdbd815eff0 2024-09-17T05:34:17.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbddc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdbd81692c0 con 0x7fdbd80d02e0 2024-09-17T05:34:17.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbd7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd80cff00 0x7fdbd8151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:17.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbd7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd80cff00 0x7fdbd8151e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60754/0 (socket says 172.21.15.31:60754) 2024-09-17T05:34:17.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbd7e00640 1 -- 172.21.15.31:0/1797776695 learned_addr learned my addr 172.21.15.31:0/1797776695 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:17.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbcfe00640 1 --2- 172.21.15.31:0/1797776695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbd80d02e0 0x7fdbd80c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:17.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbdd200640 1 --2- 172.21.15.31:0/1797776695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbd815eff0 0x7fdbd80ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:17.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbd7e00640 1 -- 172.21.15.31:0/1797776695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbd80d02e0 msgr2=0x7fdbd80c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:17.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbd7e00640 1 --2- 172.21.15.31:0/1797776695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbd80d02e0 0x7fdbd80c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:17.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbd7e00640 1 -- 172.21.15.31:0/1797776695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbd815eff0 msgr2=0x7fdbd80ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:17.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbd7e00640 1 --2- 172.21.15.31:0/1797776695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbd815eff0 0x7fdbd80ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:17.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbd7e00640 1 -- 172.21.15.31:0/1797776695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd80cf6e0 con 0x7fdbd80cff00 2024-09-17T05:34:17.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbd7e00640 1 --2- 172.21.15.31:0/1797776695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd80cff00 0x7fdbd8151e50 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80b0040 tx=0x7fdbc80a5770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:17.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbd4c00640 1 -- 172.21.15.31:0/1797776695 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc80ba020 con 0x7fdbd80cff00 2024-09-17T05:34:17.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbd4c00640 1 -- 172.21.15.31:0/1797776695 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbc80053e0 con 0x7fdbd80cff00 2024-09-17T05:34:17.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbd4c00640 1 -- 172.21.15.31:0/1797776695 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc80b2040 con 0x7fdbd80cff00 2024-09-17T05:34:17.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbddc00640 1 -- 172.21.15.31:0/1797776695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd80b4f30 con 0x7fdbd80cff00 2024-09-17T05:34:17.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbddc00640 1 -- 172.21.15.31:0/1797776695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd80b54b0 con 0x7fdbd80cff00 2024-09-17T05:34:17.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.134+0000 7fdbddc00640 1 -- 172.21.15.31:0/1797776695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbd80d28c0 con 0x7fdbd80cff00 2024-09-17T05:34:17.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.138+0000 7fdbd4c00640 1 -- 172.21.15.31:0/1797776695 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7fdbc80046d0 con 0x7fdbd80cff00 2024-09-17T05:34:17.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.138+0000 7fdbd4c00640 1 --2- 172.21.15.31:0/1797776695 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdbb4073670 0x7fdbb4075b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:17.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.138+0000 7fdbd4c00640 1 -- 172.21.15.31:0/1797776695 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5443+0+0 (secure 0 0 0) 0x7fdbc812ec20 con 0x7fdbd80cff00 2024-09-17T05:34:17.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.138+0000 7fdbcfe00640 1 --2- 172.21.15.31:0/1797776695 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdbb4073670 0x7fdbb4075b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:17.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.138+0000 7fdbcfe00640 1 --2- 172.21.15.31:0/1797776695 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdbb4073670 0x7fdbb4075b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00058d0 tx=0x7fdbc0005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:17.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.142+0000 7fdbd4c00640 1 -- 172.21.15.31:0/1797776695 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fdbc80164d0 con 0x7fdbd80cff00 2024-09-17T05:34:17.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.322+0000 7fdbddc00640 1 -- 172.21.15.31:0/1797776695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdbd8152390 con 0x7fdbd80cff00 2024-09-17T05:34:17.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.946+0000 7fdbd4c00640 1 -- 172.21.15.31:0/1797776695 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v106) ==== 169+0+0 (secure 0 0 0) 0x7fdbc80f9650 con 0x7fdbd80cff00 2024-09-17T05:34:17.949 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-09-17T05:34:17.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.950+0000 7fdbddc00640 1 -- 172.21.15.31:0/1797776695 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdbb4073670 msgr2=0x7fdbb4075b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:17.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.950+0000 7fdbddc00640 1 --2- 172.21.15.31:0/1797776695 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdbb4073670 0x7fdbb4075b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00058d0 tx=0x7fdbc0005860 comp rx=0 tx=0).stop 2024-09-17T05:34:17.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.950+0000 7fdbddc00640 1 -- 172.21.15.31:0/1797776695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd80cff00 msgr2=0x7fdbd8151e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:17.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.950+0000 7fdbddc00640 1 --2- 172.21.15.31:0/1797776695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd80cff00 0x7fdbd8151e50 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80b0040 tx=0x7fdbc80a5770 comp rx=0 tx=0).stop 2024-09-17T05:34:17.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.954+0000 7fdbddc00640 1 -- 172.21.15.31:0/1797776695 shutdown_connections 2024-09-17T05:34:17.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.954+0000 7fdbddc00640 1 --2- 172.21.15.31:0/1797776695 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdbb4073670 0x7fdbb4075b30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:17.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.954+0000 7fdbddc00640 1 --2- 172.21.15.31:0/1797776695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbd815eff0 0x7fdbd80ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:17.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.954+0000 7fdbddc00640 1 --2- 172.21.15.31:0/1797776695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbd80d02e0 0x7fdbd80c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:17.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.954+0000 7fdbddc00640 1 --2- 172.21.15.31:0/1797776695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbd80cff00 0x7fdbd8151e50 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:17.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.954+0000 7fdbddc00640 1 -- 172.21.15.31:0/1797776695 >> 172.21.15.31:0/1797776695 conn(0x7fdbd80d1da0 msgr2=0x7fdbd80d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:17.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.954+0000 7fdbddc00640 1 -- 172.21.15.31:0/1797776695 shutdown_connections 2024-09-17T05:34:17.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:17.954+0000 7fdbddc00640 1 -- 172.21.15.31:0/1797776695 wait complete. 2024-09-17T05:34:17.985 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:34:18.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.134+0000 7f4bc3600640 1 -- 172.21.15.31:0/1371090212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bbc073d10 msgr2=0x7f4bbc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:18.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.134+0000 7f4bc3600640 1 --2- 172.21.15.31:0/1371090212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bbc073d10 0x7f4bbc06e7a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0729f0 tx=0x7f4bb401cb10 comp rx=0 tx=0).stop 2024-09-17T05:34:18.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.134+0000 7f4bc3600640 1 -- 172.21.15.31:0/1371090212 shutdown_connections 2024-09-17T05:34:18.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.134+0000 7f4bc3600640 1 --2- 172.21.15.31:0/1371090212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bbc073d10 0x7f4bbc06e7a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:18.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.134+0000 7f4bc3600640 1 --2- 172.21.15.31:0/1371090212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bbc15a660 0x7f4bbc0cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:18.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.134+0000 7f4bc3600640 1 -- 172.21.15.31:0/1371090212 >> 172.21.15.31:0/1371090212 conn(0x7f4bbc0b18f0 msgr2=0x7f4bbc0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:18.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.134+0000 7f4bc3600640 1 -- 172.21.15.31:0/1371090212 shutdown_connections 2024-09-17T05:34:18.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.134+0000 7f4bc3600640 1 -- 172.21.15.31:0/1371090212 wait complete. 2024-09-17T05:34:18.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc3600640 1 Processor -- start 2024-09-17T05:34:18.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc3600640 1 -- start start 2024-09-17T05:34:18.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc3600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bbc073d10 0x7f4bbc14c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:18.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc3600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bbc0b42d0 0x7f4bbc15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:18.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc3600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bbc15a660 0x7f4bbc1f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:18.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc3600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc167310 con 0x7f4bbc15a660 2024-09-17T05:34:18.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc3600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4bbc167190 con 0x7f4bbc0b42d0 2024-09-17T05:34:18.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc3600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4bbc167490 con 0x7f4bbc073d10 2024-09-17T05:34:18.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc1600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bbc15a660 0x7f4bbc1f7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:18.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc1600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bbc15a660 0x7f4bbc1f7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60768/0 (socket says 172.21.15.31:60768) 2024-09-17T05:34:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc1600640 1 -- 172.21.15.31:0/2330144039 learned_addr learned my addr 172.21.15.31:0/2330144039 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc0c00640 1 --2- 172.21.15.31:0/2330144039 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bbc073d10 0x7f4bbc14c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bbbe00640 1 --2- 172.21.15.31:0/2330144039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bbc0b42d0 0x7f4bbc15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc1600640 1 -- 172.21.15.31:0/2330144039 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bbc073d10 msgr2=0x7f4bbc14c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc1600640 1 --2- 172.21.15.31:0/2330144039 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bbc073d10 0x7f4bbc14c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc1600640 1 -- 172.21.15.31:0/2330144039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bbc0b42d0 msgr2=0x7f4bbc15b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc1600640 1 --2- 172.21.15.31:0/2330144039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bbc0b42d0 0x7f4bbc15b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:18.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc1600640 1 -- 172.21.15.31:0/2330144039 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bbc15bce0 con 0x7f4bbc15a660 2024-09-17T05:34:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc1600640 1 --2- 172.21.15.31:0/2330144039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bbc15a660 0x7f4bbc1f7ab0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009b10 tx=0x7f4bb4009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bb8c00640 1 -- 172.21.15.31:0/2330144039 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb40bb070 con 0x7f4bbc15a660 2024-09-17T05:34:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bb8c00640 1 -- 172.21.15.31:0/2330144039 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bb4004d40 con 0x7f4bbc15a660 2024-09-17T05:34:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bb8c00640 1 -- 172.21.15.31:0/2330144039 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb40b2040 con 0x7f4bbc15a660 2024-09-17T05:34:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc3600640 1 -- 172.21.15.31:0/2330144039 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bbc15bfc0 con 0x7f4bbc15a660 2024-09-17T05:34:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.138+0000 7f4bc3600640 1 -- 172.21.15.31:0/2330144039 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bbc09bfd0 con 0x7f4bbc15a660 2024-09-17T05:34:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.142+0000 7f4bc3600640 1 -- 172.21.15.31:0/2330144039 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bbc069410 con 0x7f4bbc15a660 2024-09-17T05:34:18.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.142+0000 7f4bb8c00640 1 -- 172.21.15.31:0/2330144039 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f4bb40a58e0 con 0x7f4bbc15a660 2024-09-17T05:34:18.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.142+0000 7f4bb8c00640 1 --2- 172.21.15.31:0/2330144039 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4b9c073680 0x7f4b9c075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:18.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.142+0000 7f4bb8c00640 1 -- 172.21.15.31:0/2330144039 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4971+0+0 (secure 0 0 0) 0x7f4bb412e680 con 0x7f4bbc15a660 2024-09-17T05:34:18.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.142+0000 7f4bc0c00640 1 --2- 172.21.15.31:0/2330144039 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4b9c073680 0x7f4b9c075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:18.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.142+0000 7f4bc0c00640 1 --2- 172.21.15.31:0/2330144039 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4b9c073680 0x7f4b9c075b40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000a7f0 tx=0x7f4bb0010040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:18.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.146+0000 7f4bb8c00640 1 -- 172.21.15.31:0/2330144039 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4bb4016790 con 0x7f4bbc15a660 2024-09-17T05:34:18.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.322+0000 7f4bc3600640 1 -- 172.21.15.31:0/2330144039 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f4bbc06e7a0 con 0x7f4bbc15a660 2024-09-17T05:34:18.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.326+0000 7f4bb8c00640 1 -- 172.21.15.31:0/2330144039 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v39) ==== 71+0+0 (secure 0 0 0) 0x7f4bb40f8bf0 con 0x7f4bbc15a660 2024-09-17T05:34:18.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.326+0000 7f4bc3600640 1 -- 172.21.15.31:0/2330144039 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4b9c073680 msgr2=0x7f4b9c075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:18.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.326+0000 7f4bc3600640 1 --2- 172.21.15.31:0/2330144039 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4b9c073680 0x7f4b9c075b40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000a7f0 tx=0x7f4bb0010040 comp rx=0 tx=0).stop 2024-09-17T05:34:18.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.326+0000 7f4bc3600640 1 -- 172.21.15.31:0/2330144039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bbc15a660 msgr2=0x7f4bbc1f7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:18.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.326+0000 7f4bc3600640 1 --2- 172.21.15.31:0/2330144039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bbc15a660 0x7f4bbc1f7ab0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009b10 tx=0x7f4bb4009300 comp rx=0 tx=0).stop 2024-09-17T05:34:18.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.330+0000 7f4bc3600640 1 -- 172.21.15.31:0/2330144039 shutdown_connections 2024-09-17T05:34:18.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.330+0000 7f4bc3600640 1 --2- 172.21.15.31:0/2330144039 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4b9c073680 0x7f4b9c075b40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:18.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.330+0000 7f4bc3600640 1 --2- 172.21.15.31:0/2330144039 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bbc15a660 0x7f4bbc1f7ab0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:18.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.330+0000 7f4bc3600640 1 --2- 172.21.15.31:0/2330144039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bbc0b42d0 0x7f4bbc15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:18.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.330+0000 7f4bc3600640 1 --2- 172.21.15.31:0/2330144039 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bbc073d10 0x7f4bbc14c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:18.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.330+0000 7f4bc3600640 1 -- 172.21.15.31:0/2330144039 >> 172.21.15.31:0/2330144039 conn(0x7f4bbc0b18f0 msgr2=0x7f4bbc0cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:18.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.330+0000 7f4bc3600640 1 -- 172.21.15.31:0/2330144039 shutdown_connections 2024-09-17T05:34:18.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.330+0000 7f4bc3600640 1 -- 172.21.15.31:0/2330144039 wait complete. 2024-09-17T05:34:18.350 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity' 2024-09-17T05:34:18.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.494+0000 7f0fb8800640 1 -- 172.21.15.31:0/3899930598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f98003a10 msgr2=0x7f0f98003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:18.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.494+0000 7f0fb8800640 1 --2- 172.21.15.31:0/3899930598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f98003a10 0x7f0f98003e30 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009b60 tx=0x7f0fa401d270 comp rx=0 tx=0).stop 2024-09-17T05:34:18.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.494+0000 7f0fb6800640 1 -- 172.21.15.31:0/3899930598 reap_dead start 2024-09-17T05:34:18.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.494+0000 7f0fb8800640 1 -- 172.21.15.31:0/3899930598 shutdown_connections 2024-09-17T05:34:18.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.494+0000 7f0fb8800640 1 -- 172.21.15.31:0/3899930598 >> 172.21.15.31:0/3899930598 conn(0x7f0fb00d1dc0 msgr2=0x7f0fb00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:18.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.494+0000 7f0fb8800640 1 -- 172.21.15.31:0/3899930598 shutdown_connections 2024-09-17T05:34:18.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.494+0000 7f0fb8800640 1 -- 172.21.15.31:0/3899930598 wait complete. 2024-09-17T05:34:18.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb8800640 1 Processor -- start 2024-09-17T05:34:18.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb8800640 1 -- start start 2024-09-17T05:34:18.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb8800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f98003a10 0x7f0fb01f8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:18.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb8800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fb01651f0 0x7f0fb014a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:18.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb8800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0fb014a6c0 0x7f0fb014ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:18.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb8800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb0166f00 con 0x7f0fb014a6c0 2024-09-17T05:34:18.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb8800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb0166d80 con 0x7f0f98003a10 2024-09-17T05:34:18.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb8800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb0167080 con 0x7f0fb01651f0 2024-09-17T05:34:18.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb6800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0fb014a6c0 0x7f0fb014ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:18.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb6800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0fb014a6c0 0x7f0fb014ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60784/0 (socket says 172.21.15.31:60784) 2024-09-17T05:34:18.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb6800640 1 -- 172.21.15.31:0/1612376584 learned_addr learned my addr 172.21.15.31:0/1612376584 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:18.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb5e00640 1 --2- 172.21.15.31:0/1612376584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f98003a10 0x7f0fb01f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:18.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb5400640 1 --2- 172.21.15.31:0/1612376584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fb01651f0 0x7f0fb014a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:18.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb6800640 1 -- 172.21.15.31:0/1612376584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fb01651f0 msgr2=0x7f0fb014a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:18.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb6800640 1 --2- 172.21.15.31:0/1612376584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fb01651f0 0x7f0fb014a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:18.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb6800640 1 -- 172.21.15.31:0/1612376584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f98003a10 msgr2=0x7f0fb01f8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:18.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb6800640 1 --2- 172.21.15.31:0/1612376584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f98003a10 0x7f0fb01f8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:18.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb6800640 1 -- 172.21.15.31:0/1612376584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb0164750 con 0x7f0fb014a6c0 2024-09-17T05:34:18.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb6800640 1 --2- 172.21.15.31:0/1612376584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0fb014a6c0 0x7f0fb014ab40 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00d1d20 tx=0x7f0fac010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:18.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0faa000640 1 -- 172.21.15.31:0/1612376584 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac003980 con 0x7f0fb014a6c0 2024-09-17T05:34:18.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0faa000640 1 -- 172.21.15.31:0/1612376584 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fac015070 con 0x7f0fb014a6c0 2024-09-17T05:34:18.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0faa000640 1 -- 172.21.15.31:0/1612376584 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac004030 con 0x7f0fb014a6c0 2024-09-17T05:34:18.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb8800640 1 -- 172.21.15.31:0/1612376584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb00cbf40 con 0x7f0fb014a6c0 2024-09-17T05:34:18.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.498+0000 7f0fb8800640 1 -- 172.21.15.31:0/1612376584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb0164cd0 con 0x7f0fb014a6c0 2024-09-17T05:34:18.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.502+0000 7f0fb8800640 1 -- 172.21.15.31:0/1612376584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb00ceb90 con 0x7f0fb014a6c0 2024-09-17T05:34:18.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.502+0000 7f0faa000640 1 -- 172.21.15.31:0/1612376584 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f0fac0041d0 con 0x7f0fb014a6c0 2024-09-17T05:34:18.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.502+0000 7f0faa000640 1 --2- 172.21.15.31:0/1612376584 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0f94073680 0x7f0f94075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:18.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.502+0000 7f0faa000640 1 -- 172.21.15.31:0/1612376584 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4971+0+0 (secure 0 0 0) 0x7f0fac094e20 con 0x7f0fb014a6c0 2024-09-17T05:34:18.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.502+0000 7f0fb5e00640 1 --2- 172.21.15.31:0/1612376584 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0f94073680 0x7f0f94075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:18.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.506+0000 7f0fb5e00640 1 --2- 172.21.15.31:0/1612376584 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0f94073680 0x7f0f94075b40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40ae000 tx=0x7f0fa401a010 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:18.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.506+0000 7f0faa000640 1 -- 172.21.15.31:0/1612376584 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0fac05f3e0 con 0x7f0fb014a6c0 2024-09-17T05:34:18.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.750+0000 7f0fb8800640 1 -- 172.21.15.31:0/1612376584 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]} v 0) -- 0x7f0fb0164ea0 con 0x7f0fb014a6c0 2024-09-17T05:34:18.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.958+0000 7f0faa000640 1 -- 172.21.15.31:0/1612376584 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]}]=0 v309) ==== 149+0+0 (secure 0 0 0) 0x7f0fac063e10 con 0x7f0fb014a6c0 2024-09-17T05:34:18.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.958+0000 7f0fb8800640 1 -- 172.21.15.31:0/1612376584 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0f94073680 msgr2=0x7f0f94075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:18.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.958+0000 7f0fb8800640 1 --2- 172.21.15.31:0/1612376584 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0f94073680 0x7f0f94075b40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40ae000 tx=0x7f0fa401a010 comp rx=0 tx=0).stop 2024-09-17T05:34:18.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.958+0000 7f0fb8800640 1 -- 172.21.15.31:0/1612376584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0fb014a6c0 msgr2=0x7f0fb014ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:18.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.958+0000 7f0fb8800640 1 --2- 172.21.15.31:0/1612376584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0fb014a6c0 0x7f0fb014ab40 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00d1d20 tx=0x7f0fac010f40 comp rx=0 tx=0).stop 2024-09-17T05:34:18.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.958+0000 7f0fb8800640 1 -- 172.21.15.31:0/1612376584 shutdown_connections 2024-09-17T05:34:18.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.958+0000 7f0fb8800640 1 --2- 172.21.15.31:0/1612376584 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0f94073680 0x7f0f94075b40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:18.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.958+0000 7f0fb8800640 1 --2- 172.21.15.31:0/1612376584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0fb014a6c0 0x7f0fb014ab40 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:18.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.958+0000 7f0fb8800640 1 --2- 172.21.15.31:0/1612376584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0fb01651f0 0x7f0fb014a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:18.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.958+0000 7f0fb8800640 1 --2- 172.21.15.31:0/1612376584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f98003a10 0x7f0fb01f8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:18.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.958+0000 7f0fb8800640 1 -- 172.21.15.31:0/1612376584 >> 172.21.15.31:0/1612376584 conn(0x7f0fb00d1dc0 msgr2=0x7f0fb0166360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:18.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.958+0000 7f0fb8800640 1 -- 172.21.15.31:0/1612376584 shutdown_connections 2024-09-17T05:34:18.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:18.958+0000 7f0fb8800640 1 -- 172.21.15.31:0/1612376584 wait complete. 2024-09-17T05:34:18.980 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- theme continues... ... ok 2024-09-17T05:34:18.980 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_no_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- theme continues... 2024-09-17T05:34:18.980 INFO:tasks.cephfs_test_runner:test_subvolume_no_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:34:18.981 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:34:19.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.126+0000 7f1f86800640 1 -- 172.21.15.31:0/1602247544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f8015db50 msgr2=0x7f1f800acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:19.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.126+0000 7f1f86800640 1 --2- 172.21.15.31:0/1602247544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f8015db50 0x7f1f800acd40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f1f80074c10 tx=0x7f1f7001db60 comp rx=0 tx=0).stop 2024-09-17T05:34:19.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.126+0000 7f1f86800640 1 -- 172.21.15.31:0/1602247544 shutdown_connections 2024-09-17T05:34:19.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.126+0000 7f1f86800640 1 --2- 172.21.15.31:0/1602247544 >> v2:172.21.15.155:3300/0 conn(0x7f1f800b4a50 0x7f1f800ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.126+0000 7f1f86800640 1 --2- 172.21.15.31:0/1602247544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f8015db50 0x7f1f800acd40 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.126+0000 7f1f86800640 1 -- 172.21.15.31:0/1602247544 >> 172.21.15.31:0/1602247544 conn(0x7f1f800b18f0 msgr2=0x7f1f800b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:19.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.126+0000 7f1f86800640 1 -- 172.21.15.31:0/1602247544 shutdown_connections 2024-09-17T05:34:19.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.126+0000 7f1f86800640 1 -- 172.21.15.31:0/1602247544 wait complete. 2024-09-17T05:34:19.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.126+0000 7f1f86800640 1 Processor -- start 2024-09-17T05:34:19.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.126+0000 7f1f86800640 1 -- start start 2024-09-17T05:34:19.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f86800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f800b4a50 0x7f1f801fada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:19.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f86800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f800cd100 0x7f1f8014adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:19.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f86800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f8015db50 0x7f1f80073290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:19.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f86800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1f80167120 con 0x7f1f8015db50 2024-09-17T05:34:19.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f86800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1f800cf550 con 0x7f1f800b4a50 2024-09-17T05:34:19.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f86800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1f801672a0 con 0x7f1f800cd100 2024-09-17T05:34:19.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f7fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f8015db50 0x7f1f80073290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:19.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f7fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f8015db50 0x7f1f80073290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56880/0 (socket says 172.21.15.31:56880) 2024-09-17T05:34:19.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f7fe00640 1 -- 172.21.15.31:0/973893952 learned_addr learned my addr 172.21.15.31:0/973893952 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:19.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f7f400640 1 --2- 172.21.15.31:0/973893952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f800b4a50 0x7f1f801fada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:19.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f77e00640 1 --2- 172.21.15.31:0/973893952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f800cd100 0x7f1f8014adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:19.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f7fe00640 1 -- 172.21.15.31:0/973893952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f800cd100 msgr2=0x7f1f8014adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:19.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f7fe00640 1 --2- 172.21.15.31:0/973893952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f800cd100 0x7f1f8014adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f7fe00640 1 -- 172.21.15.31:0/973893952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f800b4a50 msgr2=0x7f1f801fada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:19.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f7fe00640 1 --2- 172.21.15.31:0/973893952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f800b4a50 0x7f1f801fada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f7fe00640 1 -- 172.21.15.31:0/973893952 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f801fb3f0 con 0x7f1f8015db50 2024-09-17T05:34:19.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f7f400640 1 --2- 172.21.15.31:0/973893952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f800b4a50 0x7f1f801fada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:34:19.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f77e00640 1 --2- 172.21.15.31:0/973893952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f800cd100 0x7f1f8014adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:34:19.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f7fe00640 1 --2- 172.21.15.31:0/973893952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f8015db50 0x7f1f80073290 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800cd10 tx=0x7f1f7800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:19.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f77400640 1 -- 172.21.15.31:0/973893952 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7800f450 con 0x7f1f8015db50 2024-09-17T05:34:19.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f77400640 1 -- 172.21.15.31:0/973893952 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f7800f6e0 con 0x7f1f8015db50 2024-09-17T05:34:19.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f77400640 1 -- 172.21.15.31:0/973893952 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7800fb30 con 0x7f1f8015db50 2024-09-17T05:34:19.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f86800640 1 -- 172.21.15.31:0/973893952 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f801fb6d0 con 0x7f1f8015db50 2024-09-17T05:34:19.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f86800640 1 -- 172.21.15.31:0/973893952 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f801fbc90 con 0x7f1f8015db50 2024-09-17T05:34:19.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.130+0000 7f1f86800640 1 -- 172.21.15.31:0/973893952 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f800ce7f0 con 0x7f1f8015db50 2024-09-17T05:34:19.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.134+0000 7f1f77400640 1 -- 172.21.15.31:0/973893952 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f1f7800fcd0 con 0x7f1f8015db50 2024-09-17T05:34:19.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.134+0000 7f1f77400640 1 --2- 172.21.15.31:0/973893952 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1f5c073680 0x7f1f5c075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:19.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.134+0000 7f1f77400640 1 -- 172.21.15.31:0/973893952 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4971+0+0 (secure 0 0 0) 0x7f1f780954a0 con 0x7f1f8015db50 2024-09-17T05:34:19.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.134+0000 7f1f7f400640 1 --2- 172.21.15.31:0/973893952 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1f5c073680 0x7f1f5c075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:19.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.134+0000 7f1f7f400640 1 --2- 172.21.15.31:0/973893952 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1f5c073680 0x7f1f5c075b40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1f700b0000 tx=0x7f1f7001c3a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:19.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.138+0000 7f1f77400640 1 -- 172.21.15.31:0/973893952 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f1f78014030 con 0x7f1f8015db50 2024-09-17T05:34:19.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.314+0000 7f1f86800640 1 -- 172.21.15.31:0/973893952 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f8015b340 con 0x7f1f8015db50 2024-09-17T05:34:19.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.314+0000 7f1f77400640 1 -- 172.21.15.31:0/973893952 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+13104 (secure 0 0 0) 0x7f1f78060080 con 0x7f1f8015db50 2024-09-17T05:34:19.316 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:19.316 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":106,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:34:17.948745+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6835/4072380267":"2024-09-18T05:34:14.939017+0000","172.21.15.31:6833/4072380267":"2024-09-18T05:34:14.939017+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:34:19.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.318+0000 7f1f86800640 1 -- 172.21.15.31:0/973893952 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1f5c073680 msgr2=0x7f1f5c075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:19.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.318+0000 7f1f86800640 1 --2- 172.21.15.31:0/973893952 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1f5c073680 0x7f1f5c075b40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1f700b0000 tx=0x7f1f7001c3a0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.318+0000 7f1f86800640 1 -- 172.21.15.31:0/973893952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f8015db50 msgr2=0x7f1f80073290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:19.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.318+0000 7f1f86800640 1 --2- 172.21.15.31:0/973893952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f8015db50 0x7f1f80073290 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800cd10 tx=0x7f1f7800a620 comp rx=0 tx=0).stop 2024-09-17T05:34:19.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.318+0000 7f1f86800640 1 -- 172.21.15.31:0/973893952 shutdown_connections 2024-09-17T05:34:19.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.318+0000 7f1f86800640 1 --2- 172.21.15.31:0/973893952 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1f5c073680 0x7f1f5c075b40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.318+0000 7f1f86800640 1 --2- 172.21.15.31:0/973893952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f8015db50 0x7f1f80073290 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.318+0000 7f1f86800640 1 --2- 172.21.15.31:0/973893952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f800cd100 0x7f1f8014adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.318+0000 7f1f86800640 1 --2- 172.21.15.31:0/973893952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f800b4a50 0x7f1f801fada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.318+0000 7f1f86800640 1 -- 172.21.15.31:0/973893952 >> 172.21.15.31:0/973893952 conn(0x7f1f800b18f0 msgr2=0x7f1f8015a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:19.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.318+0000 7f1f86800640 1 -- 172.21.15.31:0/973893952 shutdown_connections 2024-09-17T05:34:19.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.318+0000 7f1f86800640 1 -- 172.21.15.31:0/973893952 wait complete. 2024-09-17T05:34:19.339 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:28:33.209612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:34:19.339 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:34:19.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.486+0000 7fa7af400640 1 -- 172.21.15.31:0/3945916256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a81605d0 msgr2=0x7fa7a80d0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:19.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.486+0000 7fa7af400640 1 --2- 172.21.15.31:0/3945916256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a81605d0 0x7fa7a80d0690 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8074840 tx=0x7fa79c01c8a0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.486+0000 7fa7af400640 1 -- 172.21.15.31:0/3945916256 shutdown_connections 2024-09-17T05:34:19.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.486+0000 7fa7af400640 1 --2- 172.21.15.31:0/3945916256 >> v2:172.21.15.155:3300/0 conn(0x7fa7a80aeb00 0x7fa7a80aefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.486+0000 7fa7af400640 1 --2- 172.21.15.31:0/3945916256 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a80b1650 0x7fa7a80b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.486+0000 7fa7af400640 1 --2- 172.21.15.31:0/3945916256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a81605d0 0x7fa7a80d0690 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.486+0000 7fa7af400640 1 -- 172.21.15.31:0/3945916256 >> 172.21.15.31:0/3945916256 conn(0x7fa7a80d1dd0 msgr2=0x7fa7a80d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:19.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.486+0000 7fa7af400640 1 -- 172.21.15.31:0/3945916256 shutdown_connections 2024-09-17T05:34:19.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.486+0000 7fa7af400640 1 -- 172.21.15.31:0/3945916256 wait complete. 2024-09-17T05:34:19.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7af400640 1 Processor -- start 2024-09-17T05:34:19.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7af400640 1 -- start start 2024-09-17T05:34:19.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7af400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a80aeb00 0x7fa7a80b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:19.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7af400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a80b1650 0x7fa7a81658e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:19.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7af400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a81605d0 0x7fa7a814cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:19.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7af400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a80b13a0 con 0x7fa7a80aeb00 2024-09-17T05:34:19.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7af400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a80b1220 con 0x7fa7a80b1650 2024-09-17T05:34:19.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7af400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa7a80afd00 con 0x7fa7a81605d0 2024-09-17T05:34:19.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7aca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a80aeb00 0x7fa7a80b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:19.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7aca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a80aeb00 0x7fa7a80b5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56904/0 (socket says 172.21.15.31:56904) 2024-09-17T05:34:19.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7aca00640 1 -- 172.21.15.31:0/3816897370 learned_addr learned my addr 172.21.15.31:0/3816897370 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:19.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7a7e00640 1 --2- 172.21.15.31:0/3816897370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a80b1650 0x7fa7a81658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:19.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7ad400640 1 --2- 172.21.15.31:0/3816897370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a81605d0 0x7fa7a814cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:19.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7aca00640 1 -- 172.21.15.31:0/3816897370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a81605d0 msgr2=0x7fa7a814cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:19.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7aca00640 1 --2- 172.21.15.31:0/3816897370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a81605d0 0x7fa7a814cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7aca00640 1 -- 172.21.15.31:0/3816897370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a80b1650 msgr2=0x7fa7a81658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:19.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7aca00640 1 --2- 172.21.15.31:0/3816897370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a80b1650 0x7fa7a81658e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7aca00640 1 -- 172.21.15.31:0/3816897370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a8166330 con 0x7fa7a80aeb00 2024-09-17T05:34:19.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7ad400640 1 --2- 172.21.15.31:0/3816897370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a81605d0 0x7fa7a814cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:19.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7aca00640 1 --2- 172.21.15.31:0/3816897370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a80aeb00 0x7fa7a80b5770 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fa79c01af50 tx=0x7fa79c005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:19.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7a4c00640 1 -- 172.21.15.31:0/3816897370 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0b2040 con 0x7fa7a80aeb00 2024-09-17T05:34:19.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7a4c00640 1 -- 172.21.15.31:0/3816897370 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa79c004340 con 0x7fa7a80aeb00 2024-09-17T05:34:19.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7a4c00640 1 -- 172.21.15.31:0/3816897370 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c005290 con 0x7fa7a80aeb00 2024-09-17T05:34:19.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7af400640 1 -- 172.21.15.31:0/3816897370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a8166610 con 0x7fa7a80aeb00 2024-09-17T05:34:19.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7af400640 1 -- 172.21.15.31:0/3816897370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a806e6a0 con 0x7fa7a80aeb00 2024-09-17T05:34:19.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.490+0000 7fa7af400640 1 -- 172.21.15.31:0/3816897370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a80b1a30 con 0x7fa7a80aeb00 2024-09-17T05:34:19.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.494+0000 7fa7a4c00640 1 -- 172.21.15.31:0/3816897370 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7fa79c0bd060 con 0x7fa7a80aeb00 2024-09-17T05:34:19.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.494+0000 7fa7a4c00640 1 --2- 172.21.15.31:0/3816897370 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa788073680 0x7fa788075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:19.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.494+0000 7fa7a4c00640 1 -- 172.21.15.31:0/3816897370 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4971+0+0 (secure 0 0 0) 0x7fa79c12deb0 con 0x7fa7a80aeb00 2024-09-17T05:34:19.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.494+0000 7fa7a7e00640 1 --2- 172.21.15.31:0/3816897370 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa788073680 0x7fa788075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:19.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.494+0000 7fa7a7e00640 1 --2- 172.21.15.31:0/3816897370 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa788073680 0x7fa788075b40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa7a806e1d0 tx=0x7fa79400b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:19.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.498+0000 7fa7a4c00640 1 -- 172.21.15.31:0/3816897370 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa79c016490 con 0x7fa7a80aeb00 2024-09-17T05:34:19.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.674+0000 7fa7af400640 1 -- 172.21.15.31:0/3816897370 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa7a80d1080 con 0x7fa7a80aeb00 2024-09-17T05:34:19.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.674+0000 7fa7a4c00640 1 -- 172.21.15.31:0/3816897370 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) ==== 93+0+10 (secure 0 0 0) 0x7fa79c0f8ac0 con 0x7fa7a80aeb00 2024-09-17T05:34:19.675 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-09-17T05:34:19.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.674+0000 7fa7af400640 1 -- 172.21.15.31:0/3816897370 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa788073680 msgr2=0x7fa788075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:19.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.674+0000 7fa7af400640 1 --2- 172.21.15.31:0/3816897370 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa788073680 0x7fa788075b40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa7a806e1d0 tx=0x7fa79400b390 comp rx=0 tx=0).stop 2024-09-17T05:34:19.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.674+0000 7fa7af400640 1 -- 172.21.15.31:0/3816897370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a80aeb00 msgr2=0x7fa7a80b5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:19.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.674+0000 7fa7af400640 1 --2- 172.21.15.31:0/3816897370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a80aeb00 0x7fa7a80b5770 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fa79c01af50 tx=0x7fa79c005e70 comp rx=0 tx=0).stop 2024-09-17T05:34:19.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.674+0000 7fa7af400640 1 -- 172.21.15.31:0/3816897370 shutdown_connections 2024-09-17T05:34:19.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.674+0000 7fa7af400640 1 --2- 172.21.15.31:0/3816897370 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa788073680 0x7fa788075b40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.674+0000 7fa7af400640 1 --2- 172.21.15.31:0/3816897370 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a81605d0 0x7fa7a814cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.674+0000 7fa7af400640 1 --2- 172.21.15.31:0/3816897370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a80b1650 0x7fa7a81658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.674+0000 7fa7af400640 1 --2- 172.21.15.31:0/3816897370 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7a80aeb00 0x7fa7a80b5770 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.674+0000 7fa7af400640 1 -- 172.21.15.31:0/3816897370 >> 172.21.15.31:0/3816897370 conn(0x7fa7a80d1dd0 msgr2=0x7fa7a80cee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:19.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.674+0000 7fa7af400640 1 -- 172.21.15.31:0/3816897370 shutdown_connections 2024-09-17T05:34:19.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.674+0000 7fa7af400640 1 -- 172.21.15.31:0/3816897370 wait complete. 2024-09-17T05:34:19.696 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2' 2024-09-17T05:34:19.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.842+0000 7fccc7800640 1 -- 172.21.15.31:0/892600493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccc00cd100 msgr2=0x7fccc006f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:19.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.842+0000 7fccc7800640 1 --2- 172.21.15.31:0/892600493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccc00cd100 0x7fccc006f7b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fccac009840 tx=0x7fccac01c790 comp rx=0 tx=0).stop 2024-09-17T05:34:19.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.842+0000 7fccc7800640 1 -- 172.21.15.31:0/892600493 shutdown_connections 2024-09-17T05:34:19.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.842+0000 7fccc7800640 1 --2- 172.21.15.31:0/892600493 >> v2:172.21.15.155:3300/0 conn(0x7fccc00b49e0 0x7fccc00acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.842+0000 7fccc7800640 1 --2- 172.21.15.31:0/892600493 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccc00cd100 0x7fccc006f7b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.842+0000 7fccc7800640 1 -- 172.21.15.31:0/892600493 >> 172.21.15.31:0/892600493 conn(0x7fccc00b18f0 msgr2=0x7fccc00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:19.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.842+0000 7fccc7800640 1 -- 172.21.15.31:0/892600493 shutdown_connections 2024-09-17T05:34:19.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.842+0000 7fccc7800640 1 -- 172.21.15.31:0/892600493 wait complete. 2024-09-17T05:34:19.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.842+0000 7fccc7800640 1 Processor -- start 2024-09-17T05:34:19.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.842+0000 7fccc7800640 1 -- start start 2024-09-17T05:34:19.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc7800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccc00b49e0 0x7fccc01640e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:19.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc7800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccc00cd100 0x7fccc01fac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:19.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc7800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccc015dae0 0x7fccc015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:19.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc7800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fccc00cf100 con 0x7fccc015dae0 2024-09-17T05:34:19.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc7800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fccc00cef80 con 0x7fccc00cd100 2024-09-17T05:34:19.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc7800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fccc00cf280 con 0x7fccc00b49e0 2024-09-17T05:34:19.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc5800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccc015dae0 0x7fccc015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:19.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc4e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccc00b49e0 0x7fccc01640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:19.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc5800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccc015dae0 0x7fccc015cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56908/0 (socket says 172.21.15.31:56908) 2024-09-17T05:34:19.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccbfe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccc00cd100 0x7fccc01fac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:19.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc5800640 1 -- 172.21.15.31:0/3898699118 learned_addr learned my addr 172.21.15.31:0/3898699118 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:19.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc4e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccc00b49e0 0x7fccc01640e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:35702/0 (socket says 172.21.15.31:35702) 2024-09-17T05:34:19.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc5800640 1 -- 172.21.15.31:0/3898699118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccc00b49e0 msgr2=0x7fccc01640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:19.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc5800640 1 --2- 172.21.15.31:0/3898699118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccc00b49e0 0x7fccc01640e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc5800640 1 -- 172.21.15.31:0/3898699118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccc00cd100 msgr2=0x7fccc01fac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:19.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc5800640 1 --2- 172.21.15.31:0/3898699118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccc00cd100 0x7fccc01fac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:19.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc5800640 1 -- 172.21.15.31:0/3898699118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc01fb3e0 con 0x7fccc015dae0 2024-09-17T05:34:19.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc5800640 1 --2- 172.21.15.31:0/3898699118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccc015dae0 0x7fccc015cbd0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fccb800bba0 tx=0x7fccb80095b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:19.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccbcc00640 1 -- 172.21.15.31:0/3898699118 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb8009c40 con 0x7fccc015dae0 2024-09-17T05:34:19.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccbcc00640 1 -- 172.21.15.31:0/3898699118 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccb8009de0 con 0x7fccc015dae0 2024-09-17T05:34:19.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccbcc00640 1 -- 172.21.15.31:0/3898699118 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb8004d70 con 0x7fccc015dae0 2024-09-17T05:34:19.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc7800640 1 -- 172.21.15.31:0/3898699118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc01fb6c0 con 0x7fccc015dae0 2024-09-17T05:34:19.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc7800640 1 -- 172.21.15.31:0/3898699118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc0162680 con 0x7fccc015dae0 2024-09-17T05:34:19.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.846+0000 7fccc7800640 1 -- 172.21.15.31:0/3898699118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc0069410 con 0x7fccc015dae0 2024-09-17T05:34:19.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.850+0000 7fccbcc00640 1 -- 172.21.15.31:0/3898699118 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7fccb8015410 con 0x7fccc015dae0 2024-09-17T05:34:19.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.850+0000 7fccbcc00640 1 --2- 172.21.15.31:0/3898699118 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcca0073680 0x7fcca0075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:19.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.850+0000 7fccbcc00640 1 -- 172.21.15.31:0/3898699118 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4971+0+0 (secure 0 0 0) 0x7fccb8094570 con 0x7fccc015dae0 2024-09-17T05:34:19.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.850+0000 7fccc4e00640 1 --2- 172.21.15.31:0/3898699118 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcca0073680 0x7fcca0075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:19.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.850+0000 7fccc4e00640 1 --2- 172.21.15.31:0/3898699118 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcca0073680 0x7fcca0075b40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fccb4007fd0 tx=0x7fccb4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:19.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:19.854+0000 7fccbcc00640 1 -- 172.21.15.31:0/3898699118 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fccb805eaa0 con 0x7fccc015dae0 2024-09-17T05:34:20.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:20.094+0000 7fccc7800640 1 -- 172.21.15.31:0/3898699118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]} v 0) -- 0x7fccc00acd40 con 0x7fccc015dae0 2024-09-17T05:34:20.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:20.966+0000 7fccbcc00640 1 -- 172.21.15.31:0/3898699118 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]}]=0 v311) ==== 151+0+0 (secure 0 0 0) 0x7fccb80634d0 con 0x7fccc015dae0 2024-09-17T05:34:20.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:20.966+0000 7fccc7800640 1 -- 172.21.15.31:0/3898699118 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcca0073680 msgr2=0x7fcca0075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:20.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:20.966+0000 7fccc7800640 1 --2- 172.21.15.31:0/3898699118 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcca0073680 0x7fcca0075b40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fccb4007fd0 tx=0x7fccb4009040 comp rx=0 tx=0).stop 2024-09-17T05:34:20.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:20.966+0000 7fccc7800640 1 -- 172.21.15.31:0/3898699118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccc015dae0 msgr2=0x7fccc015cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:20.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:20.966+0000 7fccc7800640 1 --2- 172.21.15.31:0/3898699118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccc015dae0 0x7fccc015cbd0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fccb800bba0 tx=0x7fccb80095b0 comp rx=0 tx=0).stop 2024-09-17T05:34:20.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:20.966+0000 7fccc7800640 1 -- 172.21.15.31:0/3898699118 shutdown_connections 2024-09-17T05:34:20.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:20.966+0000 7fccc7800640 1 --2- 172.21.15.31:0/3898699118 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcca0073680 0x7fcca0075b40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:20.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:20.966+0000 7fccc7800640 1 --2- 172.21.15.31:0/3898699118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fccc015dae0 0x7fccc015cbd0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:20.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:20.966+0000 7fccc7800640 1 --2- 172.21.15.31:0/3898699118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fccc00cd100 0x7fccc01fac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:20.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:20.966+0000 7fccc7800640 1 --2- 172.21.15.31:0/3898699118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fccc00b49e0 0x7fccc01640e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:20.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:20.966+0000 7fccc7800640 1 -- 172.21.15.31:0/3898699118 >> 172.21.15.31:0/3898699118 conn(0x7fccc00b18f0 msgr2=0x7fccc0073250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:20.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:20.966+0000 7fccc7800640 1 -- 172.21.15.31:0/3898699118 shutdown_connections 2024-09-17T05:34:20.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:20.966+0000 7fccc7800640 1 -- 172.21.15.31:0/3898699118 wait complete. 2024-09-17T05:34:20.994 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:34:21.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.142+0000 7f93d7400640 1 -- 172.21.15.31:0/2797730244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d00cd100 msgr2=0x7f93d006f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.142+0000 7f93d7400640 1 --2- 172.21.15.31:0/2797730244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d00cd100 0x7f93d006f7b0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009840 tx=0x7f93bc01c700 comp rx=0 tx=0).stop 2024-09-17T05:34:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.142+0000 7f93d7400640 1 -- 172.21.15.31:0/2797730244 shutdown_connections 2024-09-17T05:34:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.142+0000 7f93d7400640 1 --2- 172.21.15.31:0/2797730244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93d00b49e0 0x7f93d00acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.142+0000 7f93d7400640 1 --2- 172.21.15.31:0/2797730244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d00cd100 0x7f93d006f7b0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.142+0000 7f93d7400640 1 -- 172.21.15.31:0/2797730244 >> 172.21.15.31:0/2797730244 conn(0x7f93d00b18f0 msgr2=0x7f93d00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.142+0000 7f93d7400640 1 -- 172.21.15.31:0/2797730244 shutdown_connections 2024-09-17T05:34:21.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.142+0000 7f93d7400640 1 -- 172.21.15.31:0/2797730244 wait complete. 2024-09-17T05:34:21.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d7400640 1 Processor -- start 2024-09-17T05:34:21.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d7400640 1 -- start start 2024-09-17T05:34:21.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d7400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93d00b49e0 0x7f93d0144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:21.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d7400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93d00cd100 0x7f93d01f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:21.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d015dae0 0x7f93d0164a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:21.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d7400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f93d00cf0d0 con 0x7f93d015dae0 2024-09-17T05:34:21.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d7400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f93d00cef50 con 0x7f93d00b49e0 2024-09-17T05:34:21.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d7400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f93d00cf250 con 0x7f93d00cd100 2024-09-17T05:34:21.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d015dae0 0x7f93d0164a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:21.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d015dae0 0x7f93d0164a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56936/0 (socket says 172.21.15.31:56936) 2024-09-17T05:34:21.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d5400640 1 -- 172.21.15.31:0/355608175 learned_addr learned my addr 172.21.15.31:0/355608175 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:21.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93cfe00640 1 --2- 172.21.15.31:0/355608175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93d00cd100 0x7f93d01f7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:21.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d4a00640 1 --2- 172.21.15.31:0/355608175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93d00b49e0 0x7f93d0144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:21.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d5400640 1 -- 172.21.15.31:0/355608175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93d00cd100 msgr2=0x7f93d01f7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:21.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d5400640 1 --2- 172.21.15.31:0/355608175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93d00cd100 0x7f93d01f7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:21.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d5400640 1 -- 172.21.15.31:0/355608175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93d00b49e0 msgr2=0x7f93d0144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:21.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d5400640 1 --2- 172.21.15.31:0/355608175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93d00b49e0 0x7f93d0144a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:21.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d5400640 1 -- 172.21.15.31:0/355608175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d01f80d0 con 0x7f93d015dae0 2024-09-17T05:34:21.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d5400640 1 --2- 172.21.15.31:0/355608175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d015dae0 0x7f93d0164a50 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f93c800dd80 tx=0x7f93c800b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:21.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93ccc00640 1 -- 172.21.15.31:0/355608175 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c8004d30 con 0x7f93d015dae0 2024-09-17T05:34:21.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93ccc00640 1 -- 172.21.15.31:0/355608175 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93c8005020 con 0x7f93d015dae0 2024-09-17T05:34:21.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d7400640 1 -- 172.21.15.31:0/355608175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d0143f60 con 0x7f93d015dae0 2024-09-17T05:34:21.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93ccc00640 1 -- 172.21.15.31:0/355608175 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c8005470 con 0x7f93d015dae0 2024-09-17T05:34:21.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.146+0000 7f93d7400640 1 -- 172.21.15.31:0/355608175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d0144520 con 0x7f93d015dae0 2024-09-17T05:34:21.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.150+0000 7f93d7400640 1 -- 172.21.15.31:0/355608175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93d0069410 con 0x7f93d015dae0 2024-09-17T05:34:21.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.150+0000 7f93ccc00640 1 -- 172.21.15.31:0/355608175 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f93c8005820 con 0x7f93d015dae0 2024-09-17T05:34:21.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.150+0000 7f93ccc00640 1 --2- 172.21.15.31:0/355608175 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f93b0073680 0x7f93b0075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:21.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.150+0000 7f93ccc00640 1 -- 172.21.15.31:0/355608175 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4971+0+0 (secure 0 0 0) 0x7f93c8095520 con 0x7f93d015dae0 2024-09-17T05:34:21.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.150+0000 7f93d4a00640 1 --2- 172.21.15.31:0/355608175 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f93b0073680 0x7f93b0075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:21.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.150+0000 7f93d4a00640 1 --2- 172.21.15.31:0/355608175 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f93b0073680 0x7f93b0075b40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f93d01faa30 tx=0x7f93c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:21.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.154+0000 7f93ccc00640 1 -- 172.21.15.31:0/355608175 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f93c8060130 con 0x7f93d015dae0 2024-09-17T05:34:21.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.330+0000 7f93d7400640 1 -- 172.21.15.31:0/355608175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f93d00acd40 con 0x7f93d015dae0 2024-09-17T05:34:21.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.334+0000 7f93ccc00640 1 -- 172.21.15.31:0/355608175 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v39) ==== 59+0+1998 (secure 0 0 0) 0x7f93c805fa30 con 0x7f93d015dae0 2024-09-17T05:34:21.334 INFO:teuthology.orchestra.run.smithi031.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:34:21.334 INFO:teuthology.orchestra.run.smithi031.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:34:21.334 INFO:teuthology.orchestra.run.smithi031.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:34:21.334 INFO:teuthology.orchestra.run.smithi031.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:34:21.335 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6159.333103 2024-09-17T05:34:21.335 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4566.558105 2024-09-17T05:34:21.335 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4575.968427 2024-09-17T05:34:21.335 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4702.806393 2024-09-17T05:34:21.335 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4956.728274 2024-09-17T05:34:21.335 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 6604.257199 2024-09-17T05:34:21.335 INFO:teuthology.orchestra.run.smithi031.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4779.165073 2024-09-17T05:34:21.335 INFO:teuthology.orchestra.run.smithi031.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4673.795919 2024-09-17T05:34:21.335 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds 20/20 2024-09-17T05:34:21.335 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:34:21.335 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_ms 2/2 2024-09-17T05:34:21.335 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_frag true 2024-09-17T05:34:21.336 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:34:21.336 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:34:21.336 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_verify_scatter true 2024-09-17T05:34:21.336 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:34:21.336 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:34:21.336 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:34:21.336 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced client_mount_timeout 600 2024-09-17T05:34:21.336 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_client 20/20 2024-09-17T05:34:21.336 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_ms 1/1 2024-09-17T05:34:21.336 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:34:21.336 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:34:21.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.334+0000 7f93d7400640 1 -- 172.21.15.31:0/355608175 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f93b0073680 msgr2=0x7f93b0075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:21.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.334+0000 7f93d7400640 1 --2- 172.21.15.31:0/355608175 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f93b0073680 0x7f93b0075b40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f93d01faa30 tx=0x7f93c4009040 comp rx=0 tx=0).stop 2024-09-17T05:34:21.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.334+0000 7f93d7400640 1 -- 172.21.15.31:0/355608175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d015dae0 msgr2=0x7f93d0164a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:21.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.334+0000 7f93d7400640 1 --2- 172.21.15.31:0/355608175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d015dae0 0x7f93d0164a50 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f93c800dd80 tx=0x7f93c800b730 comp rx=0 tx=0).stop 2024-09-17T05:34:21.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.334+0000 7f93d7400640 1 -- 172.21.15.31:0/355608175 shutdown_connections 2024-09-17T05:34:21.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.334+0000 7f93d7400640 1 --2- 172.21.15.31:0/355608175 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f93b0073680 0x7f93b0075b40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:21.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.334+0000 7f93d7400640 1 --2- 172.21.15.31:0/355608175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93d015dae0 0x7f93d0164a50 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:21.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.334+0000 7f93d7400640 1 --2- 172.21.15.31:0/355608175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93d00cd100 0x7f93d01f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:21.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.334+0000 7f93d7400640 1 --2- 172.21.15.31:0/355608175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93d00b49e0 0x7f93d0144a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:21.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.334+0000 7f93d7400640 1 -- 172.21.15.31:0/355608175 >> 172.21.15.31:0/355608175 conn(0x7f93d00b18f0 msgr2=0x7f93d00b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:21.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.334+0000 7f93d7400640 1 -- 172.21.15.31:0/355608175 shutdown_connections 2024-09-17T05:34:21.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.334+0000 7f93d7400640 1 -- 172.21.15.31:0/355608175 wait complete. 2024-09-17T05:34:21.355 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:34:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.502+0000 7f23ad000640 1 -- 172.21.15.31:0/3671222135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a80b1650 msgr2=0x7f23a80b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.502+0000 7f23ad000640 1 --2- 172.21.15.31:0/3671222135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a80b1650 0x7f23a80b1a30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2390009840 tx=0x7f239001c820 comp rx=0 tx=0).stop 2024-09-17T05:34:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.502+0000 7f23ad000640 1 -- 172.21.15.31:0/3671222135 shutdown_connections 2024-09-17T05:34:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.502+0000 7f23ad000640 1 --2- 172.21.15.31:0/3671222135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a80b1650 0x7f23a80b1a30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.502+0000 7f23ad000640 1 -- 172.21.15.31:0/3671222135 >> 172.21.15.31:0/3671222135 conn(0x7f23a80d1dd0 msgr2=0x7f23a80d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f23ad000640 1 -- 172.21.15.31:0/3671222135 shutdown_connections 2024-09-17T05:34:21.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f23ad000640 1 -- 172.21.15.31:0/3671222135 wait complete. 2024-09-17T05:34:21.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f23ad000640 1 Processor -- start 2024-09-17T05:34:21.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f23ad000640 1 -- start start 2024-09-17T05:34:21.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f23ad000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23a80afb10 0x7f23a815a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:21.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f23ad000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a80b1650 0x7f23a80cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:21.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f23ad000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a81605d0 0x7f23a80ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:21.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f23ad000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f23a80b1220 con 0x7f23a80b1650 2024-09-17T05:34:21.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f23ad000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f23a80b0ee0 con 0x7f23a81605d0 2024-09-17T05:34:21.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f23ad000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f23a80b13a0 con 0x7f23a80afb10 2024-09-17T05:34:21.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f239fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a80b1650 0x7f23a80cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:21.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f239fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a80b1650 0x7f23a80cdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56938/0 (socket says 172.21.15.31:56938) 2024-09-17T05:34:21.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f239fe00640 1 -- 172.21.15.31:0/4030774236 learned_addr learned my addr 172.21.15.31:0/4030774236 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:21.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f23a5e00640 1 --2- 172.21.15.31:0/4030774236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23a80afb10 0x7f23a815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:21.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f23a6800640 1 --2- 172.21.15.31:0/4030774236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a81605d0 0x7f23a80ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:21.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f239fe00640 1 -- 172.21.15.31:0/4030774236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23a80afb10 msgr2=0x7f23a815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:21.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f239fe00640 1 --2- 172.21.15.31:0/4030774236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23a80afb10 0x7f23a815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:21.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f239fe00640 1 -- 172.21.15.31:0/4030774236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a81605d0 msgr2=0x7f23a80ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:21.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f239fe00640 1 --2- 172.21.15.31:0/4030774236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a81605d0 0x7f23a80ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:21.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f239fe00640 1 -- 172.21.15.31:0/4030774236 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a80c5a00 con 0x7f23a80b1650 2024-09-17T05:34:21.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.506+0000 7f239fe00640 1 --2- 172.21.15.31:0/4030774236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a80b1650 0x7f23a80cdb90 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f239001a450 tx=0x7f23900a66d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:21.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.510+0000 7f239e000640 1 -- 172.21.15.31:0/4030774236 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23900042c0 con 0x7f23a80b1650 2024-09-17T05:34:21.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.510+0000 7f239e000640 1 -- 172.21.15.31:0/4030774236 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23900be070 con 0x7f23a80b1650 2024-09-17T05:34:21.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.510+0000 7f239e000640 1 -- 172.21.15.31:0/4030774236 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2390005290 con 0x7f23a80b1650 2024-09-17T05:34:21.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.510+0000 7f23ad000640 1 -- 172.21.15.31:0/4030774236 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a80c5ce0 con 0x7f23a80b1650 2024-09-17T05:34:21.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.510+0000 7f23ad000640 1 -- 172.21.15.31:0/4030774236 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a80c62a0 con 0x7f23a80b1650 2024-09-17T05:34:21.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.510+0000 7f23ad000640 1 -- 172.21.15.31:0/4030774236 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a80c8820 con 0x7f23a80b1650 2024-09-17T05:34:21.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.510+0000 7f239e000640 1 -- 172.21.15.31:0/4030774236 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f2390005430 con 0x7f23a80b1650 2024-09-17T05:34:21.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.510+0000 7f239e000640 1 --2- 172.21.15.31:0/4030774236 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2384073680 0x7f2384075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:21.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.510+0000 7f239e000640 1 -- 172.21.15.31:0/4030774236 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4971+0+0 (secure 0 0 0) 0x7f239012f3c0 con 0x7f23a80b1650 2024-09-17T05:34:21.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.510+0000 7f23a5e00640 1 --2- 172.21.15.31:0/4030774236 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2384073680 0x7f2384075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:21.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.514+0000 7f23a5e00640 1 --2- 172.21.15.31:0/4030774236 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2384073680 0x7f2384075b40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2398001870 tx=0x7f2398001380 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:21.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.514+0000 7f239e000640 1 -- 172.21.15.31:0/4030774236 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f23a80c8820 con 0x7f23a80b1650 2024-09-17T05:34:21.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.690+0000 7f23ad000640 1 -- 172.21.15.31:0/4030774236 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f23a80affc0 con 0x7f23a80b1650 2024-09-17T05:34:21.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.694+0000 7f239e000640 1 -- 172.21.15.31:0/4030774236 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7f2390016410 con 0x7f23a80b1650 2024-09-17T05:34:21.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.698+0000 7f23ad000640 1 -- 172.21.15.31:0/4030774236 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2384073680 msgr2=0x7f2384075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:21.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.698+0000 7f23ad000640 1 --2- 172.21.15.31:0/4030774236 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2384073680 0x7f2384075b40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2398001870 tx=0x7f2398001380 comp rx=0 tx=0).stop 2024-09-17T05:34:21.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.698+0000 7f23ad000640 1 -- 172.21.15.31:0/4030774236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a80b1650 msgr2=0x7f23a80cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:21.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.698+0000 7f23ad000640 1 --2- 172.21.15.31:0/4030774236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a80b1650 0x7f23a80cdb90 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f239001a450 tx=0x7f23900a66d0 comp rx=0 tx=0).stop 2024-09-17T05:34:21.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.698+0000 7f23ad000640 1 -- 172.21.15.31:0/4030774236 shutdown_connections 2024-09-17T05:34:21.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.698+0000 7f23ad000640 1 --2- 172.21.15.31:0/4030774236 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2384073680 0x7f2384075b40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:21.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.698+0000 7f23ad000640 1 --2- 172.21.15.31:0/4030774236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23a81605d0 0x7f23a80ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:21.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.698+0000 7f23ad000640 1 --2- 172.21.15.31:0/4030774236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a80b1650 0x7f23a80cdb90 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:21.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.698+0000 7f23ad000640 1 --2- 172.21.15.31:0/4030774236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f23a80afb10 0x7f23a815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:21.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.698+0000 7f23ad000640 1 -- 172.21.15.31:0/4030774236 >> 172.21.15.31:0/4030774236 conn(0x7f23a80d1dd0 msgr2=0x7f23a80b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:21.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.698+0000 7f23ad000640 1 -- 172.21.15.31:0/4030774236 shutdown_connections 2024-09-17T05:34:21.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:21.698+0000 7f23ad000640 1 -- 172.21.15.31:0/4030774236 wait complete. 2024-09-17T05:34:21.718 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:34:21.719 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:34:21.824 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:34:21.924 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:34:21.924 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:34:21.924 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:34:21.933 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:34:21.933 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:34:21.933 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:34:21.943 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:34:21.943 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:34:21.943 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:34:21.989 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:34:21.990 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:34:21.990 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:34:21.999 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:34:21.999 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:34:21.999 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:34:22.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.178+0000 7ffb16200640 1 -- 172.21.15.31:0/195896354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb100cdb30 msgr2=0x7ffb100aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:22.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.178+0000 7ffb16200640 1 --2- 172.21.15.31:0/195896354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb100cdb30 0x7ffb100aeef0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7ffb100cc3a0 tx=0x7ffb0801cd80 comp rx=0 tx=0).stop 2024-09-17T05:34:22.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.178+0000 7ffb16200640 1 -- 172.21.15.31:0/195896354 shutdown_connections 2024-09-17T05:34:22.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.178+0000 7ffb16200640 1 --2- 172.21.15.31:0/195896354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb100cdb30 0x7ffb100aeef0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:22.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.178+0000 7ffb16200640 1 --2- 172.21.15.31:0/195896354 >> v2:172.21.15.155:3300/0 conn(0x7ffb100ced80 0x7ffb100ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:22.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.178+0000 7ffb16200640 1 -- 172.21.15.31:0/195896354 >> 172.21.15.31:0/195896354 conn(0x7ffb100d1dc0 msgr2=0x7ffb100d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:22.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.178+0000 7ffb16200640 1 -- 172.21.15.31:0/195896354 shutdown_connections 2024-09-17T05:34:22.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.178+0000 7ffb16200640 1 -- 172.21.15.31:0/195896354 wait complete. 2024-09-17T05:34:22.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb16200640 1 Processor -- start 2024-09-17T05:34:22.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb16200640 1 -- start start 2024-09-17T05:34:22.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb16200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb100cdb30 0x7ffb10154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:22.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb16200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb100ced80 0x7ffb10154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:22.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb16200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb1015bea0 0x7ffb101f7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb16200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ffb101692f0 con 0x7ffb1015bea0 2024-09-17T05:34:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb16200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffb10169170 con 0x7ffb100cdb30 2024-09-17T05:34:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb16200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffb10169470 con 0x7ffb100ced80 2024-09-17T05:34:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb0fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb1015bea0 0x7ffb101f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb0fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb1015bea0 0x7ffb101f7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56950/0 (socket says 172.21.15.31:56950) 2024-09-17T05:34:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb0fe00640 1 -- 172.21.15.31:0/1890976156 learned_addr learned my addr 172.21.15.31:0/1890976156 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb0f400640 1 --2- 172.21.15.31:0/1890976156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb100cdb30 0x7ffb10154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb06a00640 1 --2- 172.21.15.31:0/1890976156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb100ced80 0x7ffb10154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb0fe00640 1 -- 172.21.15.31:0/1890976156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb100ced80 msgr2=0x7ffb10154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb0fe00640 1 --2- 172.21.15.31:0/1890976156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb100ced80 0x7ffb10154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb0fe00640 1 -- 172.21.15.31:0/1890976156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb100cdb30 msgr2=0x7ffb10154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb0fe00640 1 --2- 172.21.15.31:0/1890976156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb100cdb30 0x7ffb10154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb0fe00640 1 -- 172.21.15.31:0/1890976156 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb10152dd0 con 0x7ffb1015bea0 2024-09-17T05:34:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb06a00640 1 --2- 172.21.15.31:0/1890976156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb100ced80 0x7ffb10154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:34:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb0fe00640 1 --2- 172.21.15.31:0/1890976156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb1015bea0 0x7ffb101f7bd0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009bd0 tx=0x7ffb080a5bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb07e00640 1 -- 172.21.15.31:0/1890976156 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb080bb070 con 0x7ffb1015bea0 2024-09-17T05:34:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb07e00640 1 -- 172.21.15.31:0/1890976156 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb08004d40 con 0x7ffb1015bea0 2024-09-17T05:34:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb07e00640 1 -- 172.21.15.31:0/1890976156 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb080b2040 con 0x7ffb1015bea0 2024-09-17T05:34:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb16200640 1 -- 172.21.15.31:0/1890976156 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb101530b0 con 0x7ffb1015bea0 2024-09-17T05:34:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb16200640 1 -- 172.21.15.31:0/1890976156 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb10153670 con 0x7ffb1015bea0 2024-09-17T05:34:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.182+0000 7ffb16200640 1 -- 172.21.15.31:0/1890976156 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb100ce670 con 0x7ffb1015bea0 2024-09-17T05:34:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.186+0000 7ffb07e00640 1 -- 172.21.15.31:0/1890976156 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7ffb080be070 con 0x7ffb1015bea0 2024-09-17T05:34:22.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.186+0000 7ffb07e00640 1 --2- 172.21.15.31:0/1890976156 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ffaec073680 0x7ffaec075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:22.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.186+0000 7ffb07e00640 1 -- 172.21.15.31:0/1890976156 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4971+0+0 (secure 0 0 0) 0x7ffb0812e640 con 0x7ffb1015bea0 2024-09-17T05:34:22.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.186+0000 7ffb0f400640 1 --2- 172.21.15.31:0/1890976156 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ffaec073680 0x7ffaec075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:22.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.186+0000 7ffb0f400640 1 --2- 172.21.15.31:0/1890976156 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ffaec073680 0x7ffaec075b40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000b810 tx=0x7ffb00008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:22.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.190+0000 7ffb07e00640 1 -- 172.21.15.31:0/1890976156 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ffb08016970 con 0x7ffb1015bea0 2024-09-17T05:34:22.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.402+0000 7ffb16200640 1 -- 172.21.15.31:0/1890976156 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb10072520 con 0x7ffb1015bea0 2024-09-17T05:34:22.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.402+0000 7ffb07e00640 1 -- 172.21.15.31:0/1890976156 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+3911 (secure 0 0 0) 0x7ffb080f91c0 con 0x7ffb1015bea0 2024-09-17T05:34:22.403 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:22.403 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":74,"btime":"2024-09-17T05:34:15:941226+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3921984787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3921984787},{"type":"v1","addr":"172.21.15.155:6809","nonce":3921984787}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3122851843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3122851843},{"type":"v1","addr":"172.21.15.155:6835","nonce":3122851843}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":6936,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/706788626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":706788626},{"type":"v1","addr":"172.21.15.31:6834","nonce":706788626}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7003,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/625403075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":625403075},{"type":"v1","addr":"172.21.15.31:6835","nonce":625403075}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[]} 2024-09-17T05:34:22.403 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 74 2024-09-17T05:34:22.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.402+0000 7ffb16200640 1 -- 172.21.15.31:0/1890976156 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ffaec073680 msgr2=0x7ffaec075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:22.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.402+0000 7ffb16200640 1 --2- 172.21.15.31:0/1890976156 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ffaec073680 0x7ffaec075b40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000b810 tx=0x7ffb00008040 comp rx=0 tx=0).stop 2024-09-17T05:34:22.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.402+0000 7ffb16200640 1 -- 172.21.15.31:0/1890976156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb1015bea0 msgr2=0x7ffb101f7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:22.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.402+0000 7ffb16200640 1 --2- 172.21.15.31:0/1890976156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb1015bea0 0x7ffb101f7bd0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009bd0 tx=0x7ffb080a5bc0 comp rx=0 tx=0).stop 2024-09-17T05:34:22.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.402+0000 7ffb16200640 1 -- 172.21.15.31:0/1890976156 shutdown_connections 2024-09-17T05:34:22.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.402+0000 7ffb16200640 1 --2- 172.21.15.31:0/1890976156 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ffaec073680 0x7ffaec075b40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:22.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.402+0000 7ffb16200640 1 --2- 172.21.15.31:0/1890976156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb1015bea0 0x7ffb101f7bd0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:22.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.402+0000 7ffb16200640 1 --2- 172.21.15.31:0/1890976156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb100ced80 0x7ffb10154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:22.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.402+0000 7ffb16200640 1 --2- 172.21.15.31:0/1890976156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb100cdb30 0x7ffb10154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:22.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.402+0000 7ffb16200640 1 -- 172.21.15.31:0/1890976156 >> 172.21.15.31:0/1890976156 conn(0x7ffb100d1dc0 msgr2=0x7ffb100d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:22.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.402+0000 7ffb16200640 1 -- 172.21.15.31:0/1890976156 shutdown_connections 2024-09-17T05:34:22.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:22.402+0000 7ffb16200640 1 -- 172.21.15.31:0/1890976156 wait complete. 2024-09-17T05:34:22.425 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:34:22.425 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:34:22.425 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:34:22.425 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:34:22.426 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:34:22.426 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:34:22.426 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:34:22.426 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:34:22.426 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:34:22.426 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:34:22.427 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:34:22.427 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:34:22.427 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:34:22.427 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:34:22.427 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:34:22.427 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:34:22.437 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:34:22.437 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:34:22.438 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:34:22.438 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:34:22.442 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:34:22.442 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:34:22.483 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:34:22.484 DEBUG:teuthology.parallel:result is None 2024-09-17T05:34:22.486 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:34:22.486 DEBUG:teuthology.parallel:result is None 2024-09-17T05:34:22.492 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:34:22.492 DEBUG:teuthology.parallel:result is None 2024-09-17T05:34:22.570 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-17T05:34:22.570 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-17T05:34:22.581 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-17T05:34:25.261 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-17T05:34:28.441 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:34:28.442 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:34:28.446 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:34:28.447 DEBUG:teuthology.parallel:result is None 2024-09-17T05:34:28.447 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:34:28.539 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-17T05:34:28.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcff400640 1 -- 172.21.15.31:0/1258881346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf815b580 msgr2=0x7efcf815b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:28.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcff400640 1 --2- 172.21.15.31:0/1258881346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf815b580 0x7efcf815b960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efcec009840 tx=0x7efcec01c820 comp rx=0 tx=0).stop 2024-09-17T05:34:28.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcff400640 1 -- 172.21.15.31:0/1258881346 shutdown_connections 2024-09-17T05:34:28.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcff400640 1 --2- 172.21.15.31:0/1258881346 >> v2:172.21.15.31:3300/0 conn(0x7efcf80b4bd0 0x7efcf80b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:28.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcff400640 1 --2- 172.21.15.31:0/1258881346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf815b580 0x7efcf815b960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:28.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcff400640 1 -- 172.21.15.31:0/1258881346 >> 172.21.15.31:0/1258881346 conn(0x7efcf80b18f0 msgr2=0x7efcf80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:28.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcff400640 1 -- 172.21.15.31:0/1258881346 shutdown_connections 2024-09-17T05:34:28.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcff400640 1 -- 172.21.15.31:0/1258881346 wait complete. 2024-09-17T05:34:28.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcff400640 1 Processor -- start 2024-09-17T05:34:28.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcff400640 1 -- start start 2024-09-17T05:34:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcff400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcf80b4bd0 0x7efcf81fb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcff400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcf815b580 0x7efcf81fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcff400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf815bea0 0x7efcf80af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcff400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efcf8167f60 con 0x7efcf815b580 2024-09-17T05:34:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcff400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efcf8167de0 con 0x7efcf80b4bd0 2024-09-17T05:34:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcff400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efcf81680e0 con 0x7efcf815bea0 2024-09-17T05:34:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcf7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcf815b580 0x7efcf81fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcf7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcf815b580 0x7efcf81fbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46426/0 (socket says 172.21.15.31:46426) 2024-09-17T05:34:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.606+0000 7efcf7e00640 1 -- 172.21.15.31:0/1108134154 learned_addr learned my addr 172.21.15.31:0/1108134154 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.610+0000 7efcfca00640 1 --2- 172.21.15.31:0/1108134154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcf80b4bd0 0x7efcf81fb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.610+0000 7efcfd400640 1 --2- 172.21.15.31:0/1108134154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf815bea0 0x7efcf80af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.610+0000 7efcf7e00640 1 -- 172.21.15.31:0/1108134154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf815bea0 msgr2=0x7efcf80af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.610+0000 7efcf7e00640 1 --2- 172.21.15.31:0/1108134154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf815bea0 0x7efcf80af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.610+0000 7efcf7e00640 1 -- 172.21.15.31:0/1108134154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcf80b4bd0 msgr2=0x7efcf81fb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.610+0000 7efcf7e00640 1 --2- 172.21.15.31:0/1108134154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcf80b4bd0 0x7efcf81fb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.610+0000 7efcf7e00640 1 -- 172.21.15.31:0/1108134154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf80b0390 con 0x7efcf815b580 2024-09-17T05:34:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.610+0000 7efcfca00640 1 --2- 172.21.15.31:0/1108134154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcf80b4bd0 0x7efcf81fb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.610+0000 7efcfd400640 1 --2- 172.21.15.31:0/1108134154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf815bea0 0x7efcf80af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.610+0000 7efcf7e00640 1 --2- 172.21.15.31:0/1108134154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcf815b580 0x7efcf81fbd90 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7efce400e9c0 tx=0x7efce400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.610+0000 7efcf4c00640 1 -- 172.21.15.31:0/1108134154 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce400cd80 con 0x7efcf815b580 2024-09-17T05:34:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.610+0000 7efcf4c00640 1 -- 172.21.15.31:0/1108134154 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efce4004020 con 0x7efcf815b580 2024-09-17T05:34:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.610+0000 7efcf4c00640 1 -- 172.21.15.31:0/1108134154 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce4004450 con 0x7efcf815b580 2024-09-17T05:34:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.610+0000 7efcff400640 1 -- 172.21.15.31:0/1108134154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcf80b0670 con 0x7efcf815b580 2024-09-17T05:34:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.610+0000 7efcff400640 1 -- 172.21.15.31:0/1108134154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcf80b0c30 con 0x7efcf815b580 2024-09-17T05:34:28.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.610+0000 7efcff400640 1 -- 172.21.15.31:0/1108134154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcf8069410 con 0x7efcf815b580 2024-09-17T05:34:28.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.610+0000 7efcf4c00640 1 -- 172.21.15.31:0/1108134154 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7efce4003600 con 0x7efcf815b580 2024-09-17T05:34:28.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.614+0000 7efcf4c00640 1 --2- 172.21.15.31:0/1108134154 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efcd8073680 0x7efcd8075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:28.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.614+0000 7efcf4c00640 1 -- 172.21.15.31:0/1108134154 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4971+0+0 (secure 0 0 0) 0x7efce4095390 con 0x7efcf815b580 2024-09-17T05:34:28.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.614+0000 7efcfca00640 1 --2- 172.21.15.31:0/1108134154 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efcd8073680 0x7efcd8075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:28.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.614+0000 7efcfca00640 1 --2- 172.21.15.31:0/1108134154 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efcd8073680 0x7efcd8075b40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efcec0af000 tx=0x7efcec01b060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.618+0000 7efcf4c00640 1 -- 172.21.15.31:0/1108134154 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7efce405ff10 con 0x7efcf815b580 2024-09-17T05:34:28.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:28.802+0000 7efcff400640 1 -- 172.21.15.31:0/1108134154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7efcf80b2bf0 con 0x7efcf815b580 2024-09-17T05:34:29.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:29.994+0000 7efcf4c00640 1 -- 172.21.15.31:0/1108134154 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v111) ==== 97+0+0 (secure 0 0 0) 0x7efce405f810 con 0x7efcf815b580 2024-09-17T05:34:29.998 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2024-09-17T05:34:30.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:29.998+0000 7efcff400640 1 -- 172.21.15.31:0/1108134154 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efcd8073680 msgr2=0x7efcd8075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:30.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:29.998+0000 7efcff400640 1 --2- 172.21.15.31:0/1108134154 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efcd8073680 0x7efcd8075b40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efcec0af000 tx=0x7efcec01b060 comp rx=0 tx=0).stop 2024-09-17T05:34:30.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:29.998+0000 7efcff400640 1 -- 172.21.15.31:0/1108134154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcf815b580 msgr2=0x7efcf81fbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:30.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:29.998+0000 7efcff400640 1 --2- 172.21.15.31:0/1108134154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcf815b580 0x7efcf81fbd90 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7efce400e9c0 tx=0x7efce400ee80 comp rx=0 tx=0).stop 2024-09-17T05:34:30.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:29.998+0000 7efcff400640 1 -- 172.21.15.31:0/1108134154 shutdown_connections 2024-09-17T05:34:30.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:29.998+0000 7efcff400640 1 --2- 172.21.15.31:0/1108134154 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efcd8073680 0x7efcd8075b40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:29.998+0000 7efcff400640 1 --2- 172.21.15.31:0/1108134154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcf815bea0 0x7efcf80af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:29.998+0000 7efcff400640 1 --2- 172.21.15.31:0/1108134154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcf815b580 0x7efcf81fbd90 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:29.998+0000 7efcff400640 1 --2- 172.21.15.31:0/1108134154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcf80b4bd0 0x7efcf81fb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:29.998+0000 7efcff400640 1 -- 172.21.15.31:0/1108134154 >> 172.21.15.31:0/1108134154 conn(0x7efcf80b18f0 msgr2=0x7efcf81512e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:30.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:29.998+0000 7efcff400640 1 -- 172.21.15.31:0/1108134154 shutdown_connections 2024-09-17T05:34:30.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:29.998+0000 7efcff400640 1 -- 172.21.15.31:0/1108134154 wait complete. 2024-09-17T05:34:30.027 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:34:30.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb20b200640 1 -- 172.21.15.31:0/3755745428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb20c15bc70 msgr2=0x7fb20c0cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:30.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb20b200640 1 --2- 172.21.15.31:0/3755745428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb20c15bc70 0x7fb20c0cc550 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0cdd00 tx=0x7fb1f401c8a0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb20b200640 1 -- 172.21.15.31:0/3755745428 shutdown_connections 2024-09-17T05:34:30.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb20b200640 1 --2- 172.21.15.31:0/3755745428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb20c15bc70 0x7fb20c0cc550 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb20b200640 1 --2- 172.21.15.31:0/3755745428 >> v2:172.21.15.155:3300/0 conn(0x7fb20c15b890 0x7fb20c0ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb20b200640 1 -- 172.21.15.31:0/3755745428 >> 172.21.15.31:0/3755745428 conn(0x7fb20c06dd30 msgr2=0x7fb20c06e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:30.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb20b200640 1 -- 172.21.15.31:0/3755745428 shutdown_connections 2024-09-17T05:34:30.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb20b200640 1 -- 172.21.15.31:0/3755745428 wait complete. 2024-09-17T05:34:30.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb20b200640 1 Processor -- start 2024-09-17T05:34:30.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb20b200640 1 -- start start 2024-09-17T05:34:30.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb20b200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb20c06cc20 0x7fb20c0c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:30.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb20b200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb20c15b890 0x7fb20c154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:30.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb20b200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb20c15bc70 0x7fb20c0c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:30.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb20b200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c168ca0 con 0x7fb20c06cc20 2024-09-17T05:34:30.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb20b200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c168b20 con 0x7fb20c15b890 2024-09-17T05:34:30.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb20b200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb20c168e20 con 0x7fb20c15bc70 2024-09-17T05:34:30.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb209e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb20c06cc20 0x7fb20c0c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:30.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb209e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb20c06cc20 0x7fb20c0c7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46436/0 (socket says 172.21.15.31:46436) 2024-09-17T05:34:30.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb209e00640 1 -- 172.21.15.31:0/2398262104 learned_addr learned my addr 172.21.15.31:0/2398262104 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:30.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb201400640 1 --2- 172.21.15.31:0/2398262104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb20c15b890 0x7fb20c154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:30.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb20a800640 1 --2- 172.21.15.31:0/2398262104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb20c15bc70 0x7fb20c0c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:30.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb209e00640 1 -- 172.21.15.31:0/2398262104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb20c15bc70 msgr2=0x7fb20c0c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:30.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb209e00640 1 --2- 172.21.15.31:0/2398262104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb20c15bc70 0x7fb20c0c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb209e00640 1 -- 172.21.15.31:0/2398262104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb20c15b890 msgr2=0x7fb20c154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:30.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb209e00640 1 --2- 172.21.15.31:0/2398262104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb20c15b890 0x7fb20c154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.178+0000 7fb209e00640 1 -- 172.21.15.31:0/2398262104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20c0b59d0 con 0x7fb20c06cc20 2024-09-17T05:34:30.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.182+0000 7fb209e00640 1 --2- 172.21.15.31:0/2398262104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb20c06cc20 0x7fb20c0c7190 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00e9f0 tx=0x7fb1fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:30.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.182+0000 7fb202a00640 1 -- 172.21.15.31:0/2398262104 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc00cd80 con 0x7fb20c06cc20 2024-09-17T05:34:30.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.182+0000 7fb202a00640 1 -- 172.21.15.31:0/2398262104 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1fc010430 con 0x7fb20c06cc20 2024-09-17T05:34:30.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.182+0000 7fb202a00640 1 -- 172.21.15.31:0/2398262104 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc010860 con 0x7fb20c06cc20 2024-09-17T05:34:30.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.182+0000 7fb20b200640 1 -- 172.21.15.31:0/2398262104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb20c15c380 con 0x7fb20c06cc20 2024-09-17T05:34:30.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.182+0000 7fb20b200640 1 -- 172.21.15.31:0/2398262104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb20c15c830 con 0x7fb20c06cc20 2024-09-17T05:34:30.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.182+0000 7fb20b200640 1 -- 172.21.15.31:0/2398262104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb20c0b5ba0 con 0x7fb20c06cc20 2024-09-17T05:34:30.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.182+0000 7fb202a00640 1 -- 172.21.15.31:0/2398262104 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7fb1fc010a00 con 0x7fb20c06cc20 2024-09-17T05:34:30.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.182+0000 7fb202a00640 1 --2- 172.21.15.31:0/2398262104 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb1e8073680 0x7fb1e8075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:30.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.182+0000 7fb202a00640 1 -- 172.21.15.31:0/2398262104 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 4885+0+0 (secure 0 0 0) 0x7fb1fc095360 con 0x7fb20c06cc20 2024-09-17T05:34:30.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.182+0000 7fb201400640 1 --2- 172.21.15.31:0/2398262104 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb1e8073680 0x7fb1e8075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:30.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.186+0000 7fb201400640 1 --2- 172.21.15.31:0/2398262104 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb1e8073680 0x7fb1e8075b40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40af000 tx=0x7fb1f401b0e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:30.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.186+0000 7fb202a00640 1 -- 172.21.15.31:0/2398262104 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb1fc0600c0 con 0x7fb20c06cc20 2024-09-17T05:34:30.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.422+0000 7fb20b200640 1 -- 172.21.15.31:0/2398262104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb20c0ce010 con 0x7fb20c06cc20 2024-09-17T05:34:30.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.422+0000 7fb202a00640 1 -- 172.21.15.31:0/2398262104 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) ==== 80+0+5304 (secure 0 0 0) 0x7fb1fc05f9c0 con 0x7fb20c06cc20 2024-09-17T05:34:30.426 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:30.426 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:34:30.426 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2024-09-17T05:34:30.426 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.426 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2024-09-17T05:34:30.426 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmoloQARAAbTcR/1F1qz7Crjdu1NPSgw==", 2024-09-17T05:34:30.426 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.426 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:34:30.427 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:34:30.427 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:34:30.427 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:34:30.427 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:30.427 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.427 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2024-09-17T05:34:30.427 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmYrdRDRAAkaDz03U3lMZlkLEVFYlTaw==", 2024-09-17T05:34:30.427 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.427 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:34:30.427 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:34:30.427 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:34:30.428 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:34:30.428 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.428 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:30.428 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.428 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2024-09-17T05:34:30.428 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmpFRCCBAAZRsuAVwSxuMGDeoYCwWFeg==", 2024-09-17T05:34:30.428 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.428 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:34:30.428 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:34:30.428 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:34:30.428 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:34:30.428 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.428 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:30.429 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.429 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2024-09-17T05:34:30.429 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lm23PSFBAAuO+k0kWY28PN7+pEtlUniQ==", 2024-09-17T05:34:30.429 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.429 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:34:30.429 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:34:30.429 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:34:30.429 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:34:30.429 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.429 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:30.429 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.429 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2024-09-17T05:34:30.429 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBTE+lm0miKHxAA2C1pfwBxJtKQhu4xuPumxg==", 2024-09-17T05:34:30.430 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.430 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:34:30.430 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:34:30.430 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:34:30.430 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.430 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:30.430 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.430 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2024-09-17T05:34:30.430 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBWE+lmdQi7NRAA2v4ETg4jynbPF0K4E73KAA==", 2024-09-17T05:34:30.430 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.430 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:34:30.430 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:34:30.431 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:34:30.431 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:30.431 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.431 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2024-09-17T05:34:30.431 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBaE+lm18eUEBAA8gAhUx9UNa2Lk4uyFBd7Nw==", 2024-09-17T05:34:30.431 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.431 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:34:30.431 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:34:30.431 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:34:30.431 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:30.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.432 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2024-09-17T05:34:30.432 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBdE+lm00moJBAAizrxOP4rI4fGR91dYzlEkw==", 2024-09-17T05:34:30.432 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.432 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:34:30.432 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:34:30.432 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:34:30.432 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:30.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.432 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2024-09-17T05:34:30.432 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBjE+lmhdtUJhAA7+KM8DwQriFwMbpqXAPTuA==", 2024-09-17T05:34:30.432 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.433 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:34:30.433 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:34:30.433 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:34:30.433 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:30.433 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.433 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2024-09-17T05:34:30.433 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBmE+lm5cByOhAAiMnQIv2O41am/3E+0dp4sg==", 2024-09-17T05:34:30.433 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.433 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:34:30.433 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:34:30.433 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:34:30.434 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:30.434 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.434 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2024-09-17T05:34:30.434 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBqE+lm19FhExAAo/Sfj2SX5+Y2/Fxz8mbiNQ==", 2024-09-17T05:34:30.434 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.434 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:34:30.434 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:34:30.434 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:34:30.434 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:30.434 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.434 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2024-09-17T05:34:30.435 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBtE+lmISDbKBAAapUBS+t+N1vUcCbdJic8Dw==", 2024-09-17T05:34:30.435 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.435 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:34:30.435 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:34:30.435 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:34:30.435 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:30.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.435 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2024-09-17T05:34:30.435 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw==", 2024-09-17T05:34:30.435 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.435 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:34:30.436 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2024-09-17T05:34:30.436 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:34:30.436 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:30.436 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.436 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2024-09-17T05:34:30.436 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmb2pmIhAA7p+G+WnB7ujZZdSlaossYg==", 2024-09-17T05:34:30.436 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.436 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:34:30.436 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:34:30.436 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:34:30.436 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:34:30.436 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.437 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:30.437 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.437 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2024-09-17T05:34:30.437 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmAPPaHhAAyz/gKunaNFyrdkAUy50qmQ==", 2024-09-17T05:34:30.437 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.437 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:34:30.437 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:34:30.437 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:34:30.437 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:34:30.437 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.437 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:30.437 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.438 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2024-09-17T05:34:30.438 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lml72BKBAAgAji5TWedU7azT5oQz3fYg==", 2024-09-17T05:34:30.438 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.438 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:34:30.438 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:34:30.438 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:34:30.438 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:34:30.438 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:30.438 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.438 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2024-09-17T05:34:30.438 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmtgltIRAAeTv/U/vZ9ZIuGN4JXTHD0A==", 2024-09-17T05:34:30.438 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.439 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:34:30.439 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:34:30.439 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:34:30.439 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:34:30.439 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.439 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:30.439 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.439 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2024-09-17T05:34:30.439 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmTt2oOBAAmR5ykU4WbEzlKFiwI7sMdg==", 2024-09-17T05:34:30.439 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.439 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:34:30.439 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:34:30.439 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:34:30.440 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:34:30.440 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.440 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2024-09-17T05:34:30.440 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmKILYNBAAojM8RIq92dO2DQyXppReIw==", 2024-09-17T05:34:30.440 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:34:30.440 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:34:30.440 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:34:30.440 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:34:30.440 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.440 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.440 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:34:30.440 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:34:30.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.426+0000 7fb20b200640 1 -- 172.21.15.31:0/2398262104 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb1e8073680 msgr2=0x7fb1e8075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:30.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.426+0000 7fb20b200640 1 --2- 172.21.15.31:0/2398262104 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb1e8073680 0x7fb1e8075b40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40af000 tx=0x7fb1f401b0e0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.426+0000 7fb20b200640 1 -- 172.21.15.31:0/2398262104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb20c06cc20 msgr2=0x7fb20c0c7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:30.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.426+0000 7fb20b200640 1 --2- 172.21.15.31:0/2398262104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb20c06cc20 0x7fb20c0c7190 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00e9f0 tx=0x7fb1fc00eeb0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.426+0000 7fb20b200640 1 -- 172.21.15.31:0/2398262104 shutdown_connections 2024-09-17T05:34:30.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.426+0000 7fb20b200640 1 --2- 172.21.15.31:0/2398262104 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb1e8073680 0x7fb1e8075b40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.426+0000 7fb20b200640 1 --2- 172.21.15.31:0/2398262104 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb20c15bc70 0x7fb20c0c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.426+0000 7fb20b200640 1 --2- 172.21.15.31:0/2398262104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb20c15b890 0x7fb20c154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.426+0000 7fb20b200640 1 --2- 172.21.15.31:0/2398262104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb20c06cc20 0x7fb20c0c7190 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.426+0000 7fb20b200640 1 -- 172.21.15.31:0/2398262104 >> 172.21.15.31:0/2398262104 conn(0x7fb20c06dd30 msgr2=0x7fb20c070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:30.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.426+0000 7fb20b200640 1 -- 172.21.15.31:0/2398262104 shutdown_connections 2024-09-17T05:34:30.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.426+0000 7fb20b200640 1 -- 172.21.15.31:0/2398262104 wait complete. 2024-09-17T05:34:30.447 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:34:30.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b7e200640 1 -- 172.21.15.31:0/3250699013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b7815af60 msgr2=0x7f0b780cffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:30.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b7e200640 1 --2- 172.21.15.31:0/3250699013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b7815af60 0x7f0b780cffc0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009900 tx=0x7f0b6801c8e0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b7e200640 1 -- 172.21.15.31:0/3250699013 shutdown_connections 2024-09-17T05:34:30.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b7e200640 1 --2- 172.21.15.31:0/3250699013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b780737c0 0x7f0b78073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b7e200640 1 --2- 172.21.15.31:0/3250699013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b7815af60 0x7f0b780cffc0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b7e200640 1 -- 172.21.15.31:0/3250699013 >> 172.21.15.31:0/3250699013 conn(0x7f0b780d0c90 msgr2=0x7f0b780d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:30.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b7e200640 1 -- 172.21.15.31:0/3250699013 shutdown_connections 2024-09-17T05:34:30.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b7e200640 1 -- 172.21.15.31:0/3250699013 wait complete. 2024-09-17T05:34:30.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b7e200640 1 Processor -- start 2024-09-17T05:34:30.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b7e200640 1 -- start start 2024-09-17T05:34:30.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b7e200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b780737c0 0x7f0b780b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:30.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b7e200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b78074160 0x7f0b780c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:30.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b7e200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b7815af60 0x7f0b78162c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:30.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b7e200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0b78167cc0 con 0x7f0b780737c0 2024-09-17T05:34:30.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b7e200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0b78167b40 con 0x7f0b78074160 2024-09-17T05:34:30.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b7e200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0b78167e40 con 0x7f0b7815af60 2024-09-17T05:34:30.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b77400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b780737c0 0x7f0b780b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:30.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b77400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b780737c0 0x7f0b780b2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46450/0 (socket says 172.21.15.31:46450) 2024-09-17T05:34:30.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b77400640 1 -- 172.21.15.31:0/3887215005 learned_addr learned my addr 172.21.15.31:0/3887215005 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:30.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b6fe00640 1 --2- 172.21.15.31:0/3887215005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b78074160 0x7f0b780c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:30.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b77e00640 1 --2- 172.21.15.31:0/3887215005 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b7815af60 0x7f0b78162c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:30.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b77400640 1 -- 172.21.15.31:0/3887215005 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b7815af60 msgr2=0x7f0b78162c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:30.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b77400640 1 --2- 172.21.15.31:0/3887215005 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b7815af60 0x7f0b78162c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b77400640 1 -- 172.21.15.31:0/3887215005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b78074160 msgr2=0x7f0b780c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:30.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b77400640 1 --2- 172.21.15.31:0/3887215005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b78074160 0x7f0b780c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b77400640 1 -- 172.21.15.31:0/3887215005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b780b3550 con 0x7f0b780737c0 2024-09-17T05:34:30.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.594+0000 7f0b77400640 1 --2- 172.21.15.31:0/3887215005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b780737c0 0x7f0b780b2f70 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f0b680b0040 tx=0x7f0b680a5640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:30.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.598+0000 7f0b6f400640 1 -- 172.21.15.31:0/3887215005 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b680bc070 con 0x7f0b780737c0 2024-09-17T05:34:30.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.598+0000 7f0b6f400640 1 -- 172.21.15.31:0/3887215005 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b68004430 con 0x7f0b780737c0 2024-09-17T05:34:30.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.598+0000 7f0b6f400640 1 -- 172.21.15.31:0/3887215005 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b680b2040 con 0x7f0b780737c0 2024-09-17T05:34:30.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.598+0000 7f0b7e200640 1 -- 172.21.15.31:0/3887215005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7815c4d0 con 0x7f0b780737c0 2024-09-17T05:34:30.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.598+0000 7f0b7e200640 1 -- 172.21.15.31:0/3887215005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b7815cd70 con 0x7f0b780737c0 2024-09-17T05:34:30.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.598+0000 7f0b7e200640 1 -- 172.21.15.31:0/3887215005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b78073c20 con 0x7f0b780737c0 2024-09-17T05:34:30.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.598+0000 7f0b6f400640 1 -- 172.21.15.31:0/3887215005 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f0b68003860 con 0x7f0b780737c0 2024-09-17T05:34:30.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.598+0000 7f0b6f400640 1 --2- 172.21.15.31:0/3887215005 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0b54073680 0x7f0b54075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:30.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.598+0000 7f0b6f400640 1 -- 172.21.15.31:0/3887215005 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 4885+0+0 (secure 0 0 0) 0x7f0b6812e1c0 con 0x7f0b780737c0 2024-09-17T05:34:30.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.598+0000 7f0b6fe00640 1 --2- 172.21.15.31:0/3887215005 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0b54073680 0x7f0b54075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:30.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.598+0000 7f0b6fe00640 1 --2- 172.21.15.31:0/3887215005 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0b54073680 0x7f0b54075b40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0b60005fd0 tx=0x7f0b60005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:30.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.602+0000 7f0b6f400640 1 -- 172.21.15.31:0/3887215005 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0b680164d0 con 0x7f0b780737c0 2024-09-17T05:34:30.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.782+0000 7f0b7e200640 1 -- 172.21.15.31:0/3887215005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0b780c7050 con 0x7f0b780737c0 2024-09-17T05:34:30.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.782+0000 7f0b6f400640 1 -- 172.21.15.31:0/3887215005 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v111) ==== 84+0+65 (secure 0 0 0) 0x7f0b680f8e50 con 0x7f0b780737c0 2024-09-17T05:34:30.783 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:30.783 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:34:30.784 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:30.784 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-09-17T05:34:30.784 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-09-17T05:34:30.784 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:30.784 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:34:30.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.782+0000 7f0b7e200640 1 -- 172.21.15.31:0/3887215005 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0b54073680 msgr2=0x7f0b54075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:30.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.782+0000 7f0b7e200640 1 --2- 172.21.15.31:0/3887215005 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0b54073680 0x7f0b54075b40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0b60005fd0 tx=0x7f0b60005860 comp rx=0 tx=0).stop 2024-09-17T05:34:30.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.782+0000 7f0b7e200640 1 -- 172.21.15.31:0/3887215005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b780737c0 msgr2=0x7f0b780b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:30.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.782+0000 7f0b7e200640 1 --2- 172.21.15.31:0/3887215005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b780737c0 0x7f0b780b2f70 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f0b680b0040 tx=0x7f0b680a5640 comp rx=0 tx=0).stop 2024-09-17T05:34:30.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.782+0000 7f0b7e200640 1 -- 172.21.15.31:0/3887215005 shutdown_connections 2024-09-17T05:34:30.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.782+0000 7f0b7e200640 1 --2- 172.21.15.31:0/3887215005 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0b54073680 0x7f0b54075b40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.782+0000 7f0b7e200640 1 --2- 172.21.15.31:0/3887215005 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b7815af60 0x7f0b78162c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.782+0000 7f0b7e200640 1 --2- 172.21.15.31:0/3887215005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b78074160 0x7f0b780c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.782+0000 7f0b7e200640 1 --2- 172.21.15.31:0/3887215005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b780737c0 0x7f0b780b2f70 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.782+0000 7f0b7e200640 1 -- 172.21.15.31:0/3887215005 >> 172.21.15.31:0/3887215005 conn(0x7f0b780d0c90 msgr2=0x7f0b780c73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:30.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.782+0000 7f0b7e200640 1 -- 172.21.15.31:0/3887215005 shutdown_connections 2024-09-17T05:34:30.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.782+0000 7f0b7e200640 1 -- 172.21.15.31:0/3887215005 wait complete. 2024-09-17T05:34:30.805 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:34:30.805 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:34:30.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.954+0000 7f0cbdc00640 1 -- 172.21.15.31:0/2743485420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80734f0 msgr2=0x7f0cb815a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:30.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.954+0000 7f0cbdc00640 1 --2- 172.21.15.31:0/2743485420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80734f0 0x7f0cb815a9d0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009900 tx=0x7f0ca801c820 comp rx=0 tx=0).stop 2024-09-17T05:34:30.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.954+0000 7f0cbdc00640 1 -- 172.21.15.31:0/2743485420 shutdown_connections 2024-09-17T05:34:30.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.954+0000 7f0cbdc00640 1 --2- 172.21.15.31:0/2743485420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80734f0 0x7f0cb815a9d0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.954+0000 7f0cbdc00640 1 -- 172.21.15.31:0/2743485420 >> 172.21.15.31:0/2743485420 conn(0x7f0cb80cfbc0 msgr2=0x7f0cb80cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:30.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.954+0000 7f0cbdc00640 1 -- 172.21.15.31:0/2743485420 shutdown_connections 2024-09-17T05:34:30.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.954+0000 7f0cbdc00640 1 -- 172.21.15.31:0/2743485420 wait complete. 2024-09-17T05:34:30.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cbdc00640 1 Processor -- start 2024-09-17T05:34:30.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cbdc00640 1 -- start start 2024-09-17T05:34:30.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cbdc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80734f0 0x7f0cb81523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:30.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cbdc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cb80cf440 0x7f0cb81f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:30.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cbdc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cb815e680 0x7f0cb809aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:30.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cbdc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb81698b0 con 0x7f0cb80734f0 2024-09-17T05:34:30.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cbdc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb806fe70 con 0x7f0cb815e680 2024-09-17T05:34:30.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cbdc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0cb8169a30 con 0x7f0cb80cf440 2024-09-17T05:34:30.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cb6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80734f0 0x7f0cb81523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:30.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cb6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80734f0 0x7f0cb81523a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46480/0 (socket says 172.21.15.31:46480) 2024-09-17T05:34:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cb6a00640 1 -- 172.21.15.31:0/220023071 learned_addr learned my addr 172.21.15.31:0/220023071 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cafe00640 1 --2- 172.21.15.31:0/220023071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cb80cf440 0x7f0cb81f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cb7400640 1 --2- 172.21.15.31:0/220023071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cb815e680 0x7f0cb809aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cb6a00640 1 -- 172.21.15.31:0/220023071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cb80cf440 msgr2=0x7f0cb81f8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cb6a00640 1 --2- 172.21.15.31:0/220023071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cb80cf440 0x7f0cb81f8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cb6a00640 1 -- 172.21.15.31:0/220023071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cb815e680 msgr2=0x7f0cb809aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cb6a00640 1 --2- 172.21.15.31:0/220023071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cb815e680 0x7f0cb809aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cb6a00640 1 -- 172.21.15.31:0/220023071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb809d880 con 0x7f0cb80734f0 2024-09-17T05:34:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cb6a00640 1 --2- 172.21.15.31:0/220023071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80734f0 0x7f0cb81523a0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8019430 tx=0x7f0ca8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0caea00640 1 -- 172.21.15.31:0/220023071 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca80b2040 con 0x7f0cb80734f0 2024-09-17T05:34:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0caea00640 1 -- 172.21.15.31:0/220023071 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ca8005030 con 0x7f0cb80734f0 2024-09-17T05:34:30.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0caea00640 1 -- 172.21.15.31:0/220023071 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8005460 con 0x7f0cb80734f0 2024-09-17T05:34:30.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cbdc00640 1 -- 172.21.15.31:0/220023071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cb80b3ce0 con 0x7f0cb80734f0 2024-09-17T05:34:30.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cbdc00640 1 -- 172.21.15.31:0/220023071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cb809db60 con 0x7f0cb80734f0 2024-09-17T05:34:30.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.958+0000 7f0cbdc00640 1 -- 172.21.15.31:0/220023071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cb8069410 con 0x7f0cb80734f0 2024-09-17T05:34:30.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.962+0000 7f0caea00640 1 -- 172.21.15.31:0/220023071 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f0ca80046d0 con 0x7f0cb80734f0 2024-09-17T05:34:30.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.962+0000 7f0caea00640 1 --2- 172.21.15.31:0/220023071 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c94073680 0x7f0c94075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:30.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.962+0000 7f0caea00640 1 -- 172.21.15.31:0/220023071 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 4885+0+0 (secure 0 0 0) 0x7f0ca812ec10 con 0x7f0cb80734f0 2024-09-17T05:34:30.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.962+0000 7f0cafe00640 1 --2- 172.21.15.31:0/220023071 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c94073680 0x7f0c94075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:30.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.962+0000 7f0cafe00640 1 --2- 172.21.15.31:0/220023071 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c94073680 0x7f0c94075b40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0000f70 tx=0x7f0ca0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:30.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:30.966+0000 7f0caea00640 1 -- 172.21.15.31:0/220023071 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0ca80164d0 con 0x7f0cb80734f0 2024-09-17T05:34:31.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:31.142+0000 7f0cbdc00640 1 -- 172.21.15.31:0/220023071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0cb815a9d0 con 0x7f0cb80734f0 2024-09-17T05:34:31.974 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-17T05:34:32.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.018+0000 7f0caea00640 1 -- 172.21.15.31:0/220023071 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v112) ==== 138+0+0 (secure 0 0 0) 0x7f0ca80f9220 con 0x7f0cb80734f0 2024-09-17T05:34:32.049 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-09-17T05:34:32.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.022+0000 7f0cbdc00640 1 -- 172.21.15.31:0/220023071 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c94073680 msgr2=0x7f0c94075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:32.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.022+0000 7f0cbdc00640 1 --2- 172.21.15.31:0/220023071 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c94073680 0x7f0c94075b40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0000f70 tx=0x7f0ca0009040 comp rx=0 tx=0).stop 2024-09-17T05:34:32.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.022+0000 7f0cbdc00640 1 -- 172.21.15.31:0/220023071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80734f0 msgr2=0x7f0cb81523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:32.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.022+0000 7f0cbdc00640 1 --2- 172.21.15.31:0/220023071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80734f0 0x7f0cb81523a0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8019430 tx=0x7f0ca8004040 comp rx=0 tx=0).stop 2024-09-17T05:34:32.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.022+0000 7f0cbdc00640 1 -- 172.21.15.31:0/220023071 shutdown_connections 2024-09-17T05:34:32.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.022+0000 7f0cbdc00640 1 --2- 172.21.15.31:0/220023071 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c94073680 0x7f0c94075b40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:32.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.022+0000 7f0cbdc00640 1 --2- 172.21.15.31:0/220023071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cb815e680 0x7f0cb809aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:32.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.022+0000 7f0cbdc00640 1 --2- 172.21.15.31:0/220023071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cb80cf440 0x7f0cb81f8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:32.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.022+0000 7f0cbdc00640 1 --2- 172.21.15.31:0/220023071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80734f0 0x7f0cb81523a0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:32.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.022+0000 7f0cbdc00640 1 -- 172.21.15.31:0/220023071 >> 172.21.15.31:0/220023071 conn(0x7f0cb80cfbc0 msgr2=0x7f0cb80cc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:32.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.022+0000 7f0cbdc00640 1 -- 172.21.15.31:0/220023071 shutdown_connections 2024-09-17T05:34:32.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.022+0000 7f0cbdc00640 1 -- 172.21.15.31:0/220023071 wait complete. 2024-09-17T05:34:32.054 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:34:32.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.210+0000 7f36d3e00640 1 -- 172.21.15.31:0/2648502419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36cc15dae0 msgr2=0x7f36cc0acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:32.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.210+0000 7f36d3e00640 1 --2- 172.21.15.31:0/2648502419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36cc15dae0 0x7f36cc0acd40 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f36c000aa10 tx=0x7f36c001dba0 comp rx=0 tx=0).stop 2024-09-17T05:34:32.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.210+0000 7f36d3e00640 1 -- 172.21.15.31:0/2648502419 shutdown_connections 2024-09-17T05:34:32.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.210+0000 7f36d3e00640 1 --2- 172.21.15.31:0/2648502419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc0b49e0 0x7f36cc06f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:32.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.210+0000 7f36d3e00640 1 --2- 172.21.15.31:0/2648502419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36cc15dae0 0x7f36cc0acd40 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:32.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.210+0000 7f36d3e00640 1 -- 172.21.15.31:0/2648502419 >> 172.21.15.31:0/2648502419 conn(0x7f36cc0b18f0 msgr2=0x7f36cc0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:32.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.210+0000 7f36d3e00640 1 -- 172.21.15.31:0/2648502419 shutdown_connections 2024-09-17T05:34:32.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.210+0000 7f36d3e00640 1 -- 172.21.15.31:0/2648502419 wait complete. 2024-09-17T05:34:32.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d3e00640 1 Processor -- start 2024-09-17T05:34:32.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d3e00640 1 -- start start 2024-09-17T05:34:32.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d3e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc0b49e0 0x7f36cc1438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:32.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36cc0cd100 0x7f36cc09aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:32.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d3e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc15dae0 0x7f36cc09d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:32.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d3e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f36cc0cf230 con 0x7f36cc0cd100 2024-09-17T05:34:32.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d3e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f36cc0cf0b0 con 0x7f36cc15dae0 2024-09-17T05:34:32.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d3e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f36cc0cf3b0 con 0x7f36cc0b49e0 2024-09-17T05:34:32.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d0a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36cc0cd100 0x7f36cc09aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:32.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d0a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36cc0cd100 0x7f36cc09aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46494/0 (socket says 172.21.15.31:46494) 2024-09-17T05:34:32.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d0a00640 1 -- 172.21.15.31:0/186330015 learned_addr learned my addr 172.21.15.31:0/186330015 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:32.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d1e00640 1 --2- 172.21.15.31:0/186330015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc15dae0 0x7f36cc09d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:32.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d1400640 1 --2- 172.21.15.31:0/186330015 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc0b49e0 0x7f36cc1438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:32.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d0a00640 1 -- 172.21.15.31:0/186330015 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc0b49e0 msgr2=0x7f36cc1438d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:32.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d0a00640 1 --2- 172.21.15.31:0/186330015 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc0b49e0 0x7f36cc1438d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:32.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d0a00640 1 -- 172.21.15.31:0/186330015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc15dae0 msgr2=0x7f36cc09d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:32.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d0a00640 1 --2- 172.21.15.31:0/186330015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc15dae0 0x7f36cc09d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:32.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d0a00640 1 -- 172.21.15.31:0/186330015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36cc157d00 con 0x7f36cc0cd100 2024-09-17T05:34:32.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d0a00640 1 --2- 172.21.15.31:0/186330015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36cc0cd100 0x7f36cc09aa10 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f36b800c450 tx=0x7f36b800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:32.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36c9600640 1 -- 172.21.15.31:0/186330015 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8012830 con 0x7f36cc0cd100 2024-09-17T05:34:32.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36c9600640 1 -- 172.21.15.31:0/186330015 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36b8017070 con 0x7f36cc0cd100 2024-09-17T05:34:32.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d3e00640 1 -- 172.21.15.31:0/186330015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36cc153df0 con 0x7f36cc0cd100 2024-09-17T05:34:32.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36c9600640 1 -- 172.21.15.31:0/186330015 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8012d80 con 0x7f36cc0cd100 2024-09-17T05:34:32.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.214+0000 7f36d3e00640 1 -- 172.21.15.31:0/186330015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36cc1582a0 con 0x7f36cc0cd100 2024-09-17T05:34:32.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.218+0000 7f36d3e00640 1 -- 172.21.15.31:0/186330015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36cc0acd40 con 0x7f36cc0cd100 2024-09-17T05:34:32.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.218+0000 7f36c9600640 1 -- 172.21.15.31:0/186330015 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f36b8007020 con 0x7f36cc0cd100 2024-09-17T05:34:32.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.218+0000 7f36c9600640 1 --2- 172.21.15.31:0/186330015 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f36ac073680 0x7f36ac075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:32.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.218+0000 7f36c9600640 1 -- 172.21.15.31:0/186330015 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5255+0+0 (secure 0 0 0) 0x7f36b8094c50 con 0x7f36cc0cd100 2024-09-17T05:34:32.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.218+0000 7f36d1400640 1 --2- 172.21.15.31:0/186330015 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f36ac073680 0x7f36ac075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:32.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.222+0000 7f36d1400640 1 --2- 172.21.15.31:0/186330015 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f36ac073680 0x7f36ac075b40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f36c00b0000 tx=0x7f36c001c3e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:32.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.222+0000 7f36c9600640 1 -- 172.21.15.31:0/186330015 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f36b805f8f0 con 0x7f36cc0cd100 2024-09-17T05:34:32.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:32.398+0000 7f36d3e00640 1 -- 172.21.15.31:0/186330015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f36cc15a960 con 0x7f36cc0cd100 2024-09-17T05:34:33.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.025+0000 7f36c9600640 1 -- 172.21.15.31:0/186330015 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v113) ==== 170+0+0 (secure 0 0 0) 0x7f36b805f1f0 con 0x7f36cc0cd100 2024-09-17T05:34:33.029 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-09-17T05:34:33.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.029+0000 7f36d3e00640 1 -- 172.21.15.31:0/186330015 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f36ac073680 msgr2=0x7f36ac075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:33.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.029+0000 7f36d3e00640 1 --2- 172.21.15.31:0/186330015 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f36ac073680 0x7f36ac075b40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f36c00b0000 tx=0x7f36c001c3e0 comp rx=0 tx=0).stop 2024-09-17T05:34:33.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.029+0000 7f36d3e00640 1 -- 172.21.15.31:0/186330015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36cc0cd100 msgr2=0x7f36cc09aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:33.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.029+0000 7f36d3e00640 1 --2- 172.21.15.31:0/186330015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36cc0cd100 0x7f36cc09aa10 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f36b800c450 tx=0x7f36b800c910 comp rx=0 tx=0).stop 2024-09-17T05:34:33.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.029+0000 7f36d3e00640 1 -- 172.21.15.31:0/186330015 shutdown_connections 2024-09-17T05:34:33.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.029+0000 7f36d3e00640 1 --2- 172.21.15.31:0/186330015 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f36ac073680 0x7f36ac075b40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:33.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.029+0000 7f36d3e00640 1 --2- 172.21.15.31:0/186330015 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36cc15dae0 0x7f36cc09d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:33.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.029+0000 7f36d3e00640 1 --2- 172.21.15.31:0/186330015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36cc0cd100 0x7f36cc09aa10 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:33.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.029+0000 7f36d3e00640 1 --2- 172.21.15.31:0/186330015 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36cc0b49e0 0x7f36cc1438d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:33.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.029+0000 7f36d3e00640 1 -- 172.21.15.31:0/186330015 >> 172.21.15.31:0/186330015 conn(0x7f36cc0b18f0 msgr2=0x7f36cc0b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:33.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.029+0000 7f36d3e00640 1 -- 172.21.15.31:0/186330015 shutdown_connections 2024-09-17T05:34:33.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.029+0000 7f36d3e00640 1 -- 172.21.15.31:0/186330015 wait complete. 2024-09-17T05:34:33.069 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:34:33.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.217+0000 7fec4e400640 1 -- 172.21.15.31:0/4221924202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec4815dae0 msgr2=0x7fec480acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:33.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.217+0000 7fec4e400640 1 --2- 172.21.15.31:0/4221924202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec4815dae0 0x7fec480acd40 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fec38009840 tx=0x7fec3801c700 comp rx=0 tx=0).stop 2024-09-17T05:34:33.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.217+0000 7fec4e400640 1 -- 172.21.15.31:0/4221924202 shutdown_connections 2024-09-17T05:34:33.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.217+0000 7fec4e400640 1 --2- 172.21.15.31:0/4221924202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec4815dae0 0x7fec480acd40 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:33.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.217+0000 7fec4e400640 1 -- 172.21.15.31:0/4221924202 >> 172.21.15.31:0/4221924202 conn(0x7fec480b18f0 msgr2=0x7fec480b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:33.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.217+0000 7fec4e400640 1 -- 172.21.15.31:0/4221924202 shutdown_connections 2024-09-17T05:34:33.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.217+0000 7fec4e400640 1 -- 172.21.15.31:0/4221924202 wait complete. 2024-09-17T05:34:33.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec4e400640 1 Processor -- start 2024-09-17T05:34:33.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec4e400640 1 -- start start 2024-09-17T05:34:33.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec4e400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec480b49e0 0x7fec480aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:33.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec4e400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec480cd100 0x7fec481f8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:33.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec4e400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec4815dae0 0x7fec4809cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:33.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec4e400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fec48168e30 con 0x7fec480cd100 2024-09-17T05:34:33.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec4e400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fec48168cb0 con 0x7fec4815dae0 2024-09-17T05:34:33.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec4e400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fec48168fb0 con 0x7fec480b49e0 2024-09-17T05:34:33.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec3fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec480cd100 0x7fec481f8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:33.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec3fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec480cd100 0x7fec481f8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46506/0 (socket says 172.21.15.31:46506) 2024-09-17T05:34:33.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec3fe00640 1 -- 172.21.15.31:0/1387234272 learned_addr learned my addr 172.21.15.31:0/1387234272 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:33.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec47400640 1 --2- 172.21.15.31:0/1387234272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec480b49e0 0x7fec480aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:33.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec47e00640 1 --2- 172.21.15.31:0/1387234272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec4815dae0 0x7fec4809cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:33.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec3fe00640 1 -- 172.21.15.31:0/1387234272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec480b49e0 msgr2=0x7fec480aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:33.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec3fe00640 1 --2- 172.21.15.31:0/1387234272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec480b49e0 0x7fec480aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:33.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec3fe00640 1 -- 172.21.15.31:0/1387234272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec4815dae0 msgr2=0x7fec4809cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:33.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec3fe00640 1 --2- 172.21.15.31:0/1387234272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec4815dae0 0x7fec4809cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:33.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec3fe00640 1 -- 172.21.15.31:0/1387234272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec4809d1e0 con 0x7fec480cd100 2024-09-17T05:34:33.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec3fe00640 1 --2- 172.21.15.31:0/1387234272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec480cd100 0x7fec481f8bb0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fec3000c480 tx=0x7fec3000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:33.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec3f400640 1 -- 172.21.15.31:0/1387234272 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec30012830 con 0x7fec480cd100 2024-09-17T05:34:33.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec3f400640 1 -- 172.21.15.31:0/1387234272 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec30017070 con 0x7fec480cd100 2024-09-17T05:34:33.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec3f400640 1 -- 172.21.15.31:0/1387234272 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec30012d80 con 0x7fec480cd100 2024-09-17T05:34:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec4e400640 1 -- 172.21.15.31:0/1387234272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec4809da40 con 0x7fec480cd100 2024-09-17T05:34:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.221+0000 7fec4e400640 1 -- 172.21.15.31:0/1387234272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec4809d760 con 0x7fec480cd100 2024-09-17T05:34:33.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.225+0000 7fec4e400640 1 -- 172.21.15.31:0/1387234272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec480acd40 con 0x7fec480cd100 2024-09-17T05:34:33.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.225+0000 7fec3f400640 1 -- 172.21.15.31:0/1387234272 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7fec30007020 con 0x7fec480cd100 2024-09-17T05:34:33.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.225+0000 7fec3f400640 1 --2- 172.21.15.31:0/1387234272 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fec24073680 0x7fec24075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:33.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.225+0000 7fec3f400640 1 -- 172.21.15.31:0/1387234272 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5637+0+0 (secure 0 0 0) 0x7fec300951a0 con 0x7fec480cd100 2024-09-17T05:34:33.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.229+0000 7fec47400640 1 --2- 172.21.15.31:0/1387234272 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fec24073680 0x7fec24075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:33.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.229+0000 7fec47400640 1 --2- 172.21.15.31:0/1387234272 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fec24073680 0x7fec24075b40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fec380af000 tx=0x7fec3801af40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:33.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.229+0000 7fec3f400640 1 -- 172.21.15.31:0/1387234272 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fec3005f670 con 0x7fec480cd100 2024-09-17T05:34:33.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:33.465+0000 7fec4e400640 1 -- 172.21.15.31:0/1387234272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fec480ae2e0 con 0x7fec480cd100 2024-09-17T05:34:34.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.029+0000 7fec3f400640 1 -- 172.21.15.31:0/1387234272 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v78) ==== 174+0+0 (secure 0 0 0) 0x7fec300640a0 con 0x7fec480cd100 2024-09-17T05:34:34.031 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 18 and data pool 19 2024-09-17T05:34:34.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.033+0000 7fec4e400640 1 -- 172.21.15.31:0/1387234272 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fec24073680 msgr2=0x7fec24075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:34.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.033+0000 7fec4e400640 1 --2- 172.21.15.31:0/1387234272 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fec24073680 0x7fec24075b40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fec380af000 tx=0x7fec3801af40 comp rx=0 tx=0).stop 2024-09-17T05:34:34.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.033+0000 7fec4e400640 1 -- 172.21.15.31:0/1387234272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec480cd100 msgr2=0x7fec481f8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:34.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.033+0000 7fec4e400640 1 --2- 172.21.15.31:0/1387234272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec480cd100 0x7fec481f8bb0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fec3000c480 tx=0x7fec3000c940 comp rx=0 tx=0).stop 2024-09-17T05:34:34.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.037+0000 7fec4e400640 1 -- 172.21.15.31:0/1387234272 shutdown_connections 2024-09-17T05:34:34.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.037+0000 7fec4e400640 1 --2- 172.21.15.31:0/1387234272 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fec24073680 0x7fec24075b40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.037+0000 7fec4e400640 1 --2- 172.21.15.31:0/1387234272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec4815dae0 0x7fec4809cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.037+0000 7fec4e400640 1 --2- 172.21.15.31:0/1387234272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec480cd100 0x7fec481f8bb0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.037+0000 7fec4e400640 1 --2- 172.21.15.31:0/1387234272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fec480b49e0 0x7fec480aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.037+0000 7fec4e400640 1 -- 172.21.15.31:0/1387234272 >> 172.21.15.31:0/1387234272 conn(0x7fec480b18f0 msgr2=0x7fec4806fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:34.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.041+0000 7fec4e400640 1 -- 172.21.15.31:0/1387234272 shutdown_connections 2024-09-17T05:34:34.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.041+0000 7fec4e400640 1 -- 172.21.15.31:0/1387234272 wait complete. 2024-09-17T05:34:34.091 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:34:34.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.237+0000 7fa80b200640 1 -- 172.21.15.31:0/2080213019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8040d29e0 msgr2=0x7fa8040b6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:34.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.237+0000 7fa80b200640 1 --2- 172.21.15.31:0/2080213019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8040d29e0 0x7fa8040b6f80 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fa800009c80 tx=0x7fa80001cd30 comp rx=0 tx=0).stop 2024-09-17T05:34:34.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.237+0000 7fa80b200640 1 -- 172.21.15.31:0/2080213019 shutdown_connections 2024-09-17T05:34:34.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.237+0000 7fa80b200640 1 --2- 172.21.15.31:0/2080213019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8040d29e0 0x7fa8040b6f80 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.237+0000 7fa80b200640 1 --2- 172.21.15.31:0/2080213019 >> v2:172.21.15.155:3300/0 conn(0x7fa8041617b0 0x7fa8040d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.237+0000 7fa80b200640 1 -- 172.21.15.31:0/2080213019 >> 172.21.15.31:0/2080213019 conn(0x7fa8040d3e00 msgr2=0x7fa8040d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:34.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.237+0000 7fa80b200640 1 -- 172.21.15.31:0/2080213019 shutdown_connections 2024-09-17T05:34:34.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.237+0000 7fa80b200640 1 -- 172.21.15.31:0/2080213019 wait complete. 2024-09-17T05:34:34.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.237+0000 7fa80b200640 1 Processor -- start 2024-09-17T05:34:34.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.237+0000 7fa80b200640 1 -- start start 2024-09-17T05:34:34.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa80b200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8040d29e0 0x7fa804150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:34.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa80b200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8041613d0 0x7fa8040cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:34.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa80b200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8041617b0 0x7fa80415bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:34.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa80b200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa80416acc0 con 0x7fa8041613d0 2024-09-17T05:34:34.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa80b200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa8040b8240 con 0x7fa8041617b0 2024-09-17T05:34:34.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa80b200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa80416ae40 con 0x7fa8040d29e0 2024-09-17T05:34:34.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa809400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8041613d0 0x7fa8040cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:34.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa809400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8041613d0 0x7fa8040cbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46530/0 (socket says 172.21.15.31:46530) 2024-09-17T05:34:34.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa809400640 1 -- 172.21.15.31:0/1980336071 learned_addr learned my addr 172.21.15.31:0/1980336071 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:34.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa80a800640 1 --2- 172.21.15.31:0/1980336071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8041617b0 0x7fa80415bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:34.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa809e00640 1 --2- 172.21.15.31:0/1980336071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8040d29e0 0x7fa804150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:34.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa809400640 1 -- 172.21.15.31:0/1980336071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8040d29e0 msgr2=0x7fa804150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:34.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa809400640 1 --2- 172.21.15.31:0/1980336071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8040d29e0 0x7fa804150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa809400640 1 -- 172.21.15.31:0/1980336071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8041617b0 msgr2=0x7fa80415bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:34.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa809400640 1 --2- 172.21.15.31:0/1980336071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8041617b0 0x7fa80415bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa809400640 1 -- 172.21.15.31:0/1980336071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8041513e0 con 0x7fa8041613d0 2024-09-17T05:34:34.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa80a800640 1 --2- 172.21.15.31:0/1980336071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8041617b0 0x7fa80415bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:34.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa809400640 1 --2- 172.21.15.31:0/1980336071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8041613d0 0x7fa8040cbbf0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400d700 tx=0x7fa7f400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:34.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa7fe000640 1 -- 172.21.15.31:0/1980336071 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4017070 con 0x7fa8041613d0 2024-09-17T05:34:34.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa7fe000640 1 -- 172.21.15.31:0/1980336071 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7f4009b10 con 0x7fa8041613d0 2024-09-17T05:34:34.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa80b200640 1 -- 172.21.15.31:0/1980336071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8040cd7e0 con 0x7fa8041613d0 2024-09-17T05:34:34.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa7fe000640 1 -- 172.21.15.31:0/1980336071 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4010460 con 0x7fa8041613d0 2024-09-17T05:34:34.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa80b200640 1 -- 172.21.15.31:0/1980336071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8040cda80 con 0x7fa8041613d0 2024-09-17T05:34:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.241+0000 7fa80b200640 1 -- 172.21.15.31:0/1980336071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8040b6f60 con 0x7fa8041613d0 2024-09-17T05:34:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.245+0000 7fa7fe000640 1 -- 172.21.15.31:0/1980336071 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7fa7f401a070 con 0x7fa8041613d0 2024-09-17T05:34:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.245+0000 7fa7fe000640 1 --2- 172.21.15.31:0/1980336071 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa7e8073680 0x7fa7e8075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.245+0000 7fa7fe000640 1 -- 172.21.15.31:0/1980336071 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5737+0+0 (secure 0 0 0) 0x7fa7f4094d30 con 0x7fa8041613d0 2024-09-17T05:34:34.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.245+0000 7fa809e00640 1 --2- 172.21.15.31:0/1980336071 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa7e8073680 0x7fa7e8075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:34.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.245+0000 7fa809e00640 1 --2- 172.21.15.31:0/1980336071 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa7e8073680 0x7fa7e8075b40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8004e30 tx=0x7fa7f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:34.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.249+0000 7fa7fe000640 1 -- 172.21.15.31:0/1980336071 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa8041513e0 con 0x7fa8041613d0 2024-09-17T05:34:34.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.425+0000 7fa80b200640 1 -- 172.21.15.31:0/1980336071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8040d0f50 con 0x7fa8041613d0 2024-09-17T05:34:34.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.425+0000 7fa7fe000640 1 -- 172.21.15.31:0/1980336071 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+16820 (secure 0 0 0) 0x7fa7f405f600 con 0x7fa8041613d0 2024-09-17T05:34:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:34.429 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":114,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:34:33.468593+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:34:31.156126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T05:34:32.412462+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:34:34.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.429+0000 7fa80b200640 1 -- 172.21.15.31:0/1980336071 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa7e8073680 msgr2=0x7fa7e8075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:34.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.429+0000 7fa80b200640 1 --2- 172.21.15.31:0/1980336071 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa7e8073680 0x7fa7e8075b40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8004e30 tx=0x7fa7f8009040 comp rx=0 tx=0).stop 2024-09-17T05:34:34.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.429+0000 7fa80b200640 1 -- 172.21.15.31:0/1980336071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8041613d0 msgr2=0x7fa8040cbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:34.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.429+0000 7fa80b200640 1 --2- 172.21.15.31:0/1980336071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8041613d0 0x7fa8040cbbf0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fa7f400d700 tx=0x7fa7f400dbc0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.429+0000 7fa80b200640 1 -- 172.21.15.31:0/1980336071 shutdown_connections 2024-09-17T05:34:34.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.429+0000 7fa80b200640 1 --2- 172.21.15.31:0/1980336071 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa7e8073680 0x7fa7e8075b40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.429+0000 7fa80b200640 1 --2- 172.21.15.31:0/1980336071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8041617b0 0x7fa80415bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.429+0000 7fa80b200640 1 --2- 172.21.15.31:0/1980336071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8041613d0 0x7fa8040cbbf0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.429+0000 7fa80b200640 1 --2- 172.21.15.31:0/1980336071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8040d29e0 0x7fa804150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.429+0000 7fa80b200640 1 -- 172.21.15.31:0/1980336071 >> 172.21.15.31:0/1980336071 conn(0x7fa8040d3e00 msgr2=0x7fa804153f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:34.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.429+0000 7fa80b200640 1 -- 172.21.15.31:0/1980336071 shutdown_connections 2024-09-17T05:34:34.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.429+0000 7fa80b200640 1 -- 172.21.15.31:0/1980336071 wait complete. 2024-09-17T05:34:34.451 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:34:34.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.593+0000 7f4a47000640 1 -- 172.21.15.31:0/2517335626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a400b4bd0 msgr2=0x7f4a400b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:34.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.593+0000 7f4a47000640 1 --2- 172.21.15.31:0/2517335626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a400b4bd0 0x7f4a400b2bf0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f4a4006db60 tx=0x7f4a2801c8c0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a47000640 1 -- 172.21.15.31:0/2517335626 shutdown_connections 2024-09-17T05:34:34.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a47000640 1 --2- 172.21.15.31:0/2517335626 >> v2:172.21.15.155:3300/0 conn(0x7f4a400b3130 0x7f4a400cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a47000640 1 --2- 172.21.15.31:0/2517335626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a400b4bd0 0x7f4a400b2bf0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a47000640 1 -- 172.21.15.31:0/2517335626 >> 172.21.15.31:0/2517335626 conn(0x7f4a400b18f0 msgr2=0x7f4a400b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:34.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a47000640 1 -- 172.21.15.31:0/2517335626 shutdown_connections 2024-09-17T05:34:34.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a47000640 1 -- 172.21.15.31:0/2517335626 wait complete. 2024-09-17T05:34:34.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a47000640 1 Processor -- start 2024-09-17T05:34:34.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a47000640 1 -- start start 2024-09-17T05:34:34.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a47000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a400b3130 0x7f4a4014c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:34.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a47000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a400b4bd0 0x7f4a400ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:34.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a47000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4015b580 0x7f4a40138150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:34.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a47000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4a40167ae0 con 0x7f4a400b3130 2024-09-17T05:34:34.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a47000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a40167960 con 0x7f4a4015b580 2024-09-17T05:34:34.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a47000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4a40167c60 con 0x7f4a400b4bd0 2024-09-17T05:34:34.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a3fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a400b3130 0x7f4a4014c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:34.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a3fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a400b3130 0x7f4a4014c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46538/0 (socket says 172.21.15.31:46538) 2024-09-17T05:34:34.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a3fe00640 1 -- 172.21.15.31:0/3199642622 learned_addr learned my addr 172.21.15.31:0/3199642622 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:34.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a45000640 1 --2- 172.21.15.31:0/3199642622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4015b580 0x7f4a40138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:34.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a37e00640 1 --2- 172.21.15.31:0/3199642622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a400b4bd0 0x7f4a400ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:34.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a3fe00640 1 -- 172.21.15.31:0/3199642622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a400b4bd0 msgr2=0x7f4a400ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:34.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a3fe00640 1 --2- 172.21.15.31:0/3199642622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a400b4bd0 0x7f4a400ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a3fe00640 1 -- 172.21.15.31:0/3199642622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4015b580 msgr2=0x7f4a40138150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:34.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a3fe00640 1 --2- 172.21.15.31:0/3199642622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4015b580 0x7f4a40138150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a3fe00640 1 -- 172.21.15.31:0/3199642622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a401f8a20 con 0x7f4a400b3130 2024-09-17T05:34:34.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a45000640 1 --2- 172.21.15.31:0/3199642622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4015b580 0x7f4a40138150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:34.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a3fe00640 1 --2- 172.21.15.31:0/3199642622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a400b3130 0x7f4a4014c680 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f4a3000c3c0 tx=0x7f4a3000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:34.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a3cc00640 1 -- 172.21.15.31:0/3199642622 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30017070 con 0x7f4a400b3130 2024-09-17T05:34:34.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a3cc00640 1 -- 172.21.15.31:0/3199642622 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a300053c0 con 0x7f4a400b3130 2024-09-17T05:34:34.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.597+0000 7f4a3cc00640 1 -- 172.21.15.31:0/3199642622 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30003860 con 0x7f4a400b3130 2024-09-17T05:34:34.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.601+0000 7f4a47000640 1 -- 172.21.15.31:0/3199642622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a401f8cc0 con 0x7f4a400b3130 2024-09-17T05:34:34.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.601+0000 7f4a47000640 1 -- 172.21.15.31:0/3199642622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a401f9280 con 0x7f4a400b3130 2024-09-17T05:34:34.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.601+0000 7f4a47000640 1 -- 172.21.15.31:0/3199642622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a40069410 con 0x7f4a400b3130 2024-09-17T05:34:34.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.601+0000 7f4a3cc00640 1 -- 172.21.15.31:0/3199642622 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f4a3001a070 con 0x7f4a400b3130 2024-09-17T05:34:34.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.601+0000 7f4a3cc00640 1 --2- 172.21.15.31:0/3199642622 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a1c073680 0x7f4a1c075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:34.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.601+0000 7f4a3cc00640 1 -- 172.21.15.31:0/3199642622 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5737+0+0 (secure 0 0 0) 0x7f4a30093d50 con 0x7f4a400b3130 2024-09-17T05:34:34.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.601+0000 7f4a37e00640 1 --2- 172.21.15.31:0/3199642622 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a1c073680 0x7f4a1c075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:34.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.605+0000 7f4a37e00640 1 --2- 172.21.15.31:0/3199642622 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a1c073680 0x7f4a1c075b40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4a280af000 tx=0x7f4a2801b100 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:34.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.605+0000 7f4a3cc00640 1 -- 172.21.15.31:0/3199642622 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4a3005e050 con 0x7f4a400b3130 2024-09-17T05:34:34.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.785+0000 7f4a47000640 1 -- 172.21.15.31:0/3199642622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a400cc550 con 0x7f4a400b3130 2024-09-17T05:34:34.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.785+0000 7f4a3cc00640 1 -- 172.21.15.31:0/3199642622 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+16820 (secure 0 0 0) 0x7f4a30062a80 con 0x7f4a400b3130 2024-09-17T05:34:34.788 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:34.788 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":114,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:34:33.468593+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:34:31.156126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T05:34:32.412462+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:34:34.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.789+0000 7f4a47000640 1 -- 172.21.15.31:0/3199642622 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a1c073680 msgr2=0x7f4a1c075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:34.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.789+0000 7f4a47000640 1 --2- 172.21.15.31:0/3199642622 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a1c073680 0x7f4a1c075b40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4a280af000 tx=0x7f4a2801b100 comp rx=0 tx=0).stop 2024-09-17T05:34:34.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.789+0000 7f4a47000640 1 -- 172.21.15.31:0/3199642622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a400b3130 msgr2=0x7f4a4014c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:34.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.789+0000 7f4a47000640 1 --2- 172.21.15.31:0/3199642622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a400b3130 0x7f4a4014c680 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f4a3000c3c0 tx=0x7f4a3000c880 comp rx=0 tx=0).stop 2024-09-17T05:34:34.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.789+0000 7f4a47000640 1 -- 172.21.15.31:0/3199642622 shutdown_connections 2024-09-17T05:34:34.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.789+0000 7f4a47000640 1 --2- 172.21.15.31:0/3199642622 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a1c073680 0x7f4a1c075b40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.789+0000 7f4a47000640 1 --2- 172.21.15.31:0/3199642622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a4015b580 0x7f4a40138150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.789+0000 7f4a47000640 1 --2- 172.21.15.31:0/3199642622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a400b4bd0 0x7f4a400ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.789+0000 7f4a47000640 1 --2- 172.21.15.31:0/3199642622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a400b3130 0x7f4a4014c680 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.789+0000 7f4a47000640 1 -- 172.21.15.31:0/3199642622 >> 172.21.15.31:0/3199642622 conn(0x7f4a400b18f0 msgr2=0x7f4a400aebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:34.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.789+0000 7f4a47000640 1 -- 172.21.15.31:0/3199642622 shutdown_connections 2024-09-17T05:34:34.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.789+0000 7f4a47000640 1 -- 172.21.15.31:0/3199642622 wait complete. 2024-09-17T05:34:34.810 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:34:34.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.957+0000 7fde0ba00640 1 -- 172.21.15.31:0/537129450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde040b4a50 msgr2=0x7fde040acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:34.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.957+0000 7fde0ba00640 1 --2- 172.21.15.31:0/537129450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde040b4a50 0x7fde040acd40 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fde0406e730 tx=0x7fddec01c830 comp rx=0 tx=0).stop 2024-09-17T05:34:34.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.957+0000 7fde0ba00640 1 -- 172.21.15.31:0/537129450 shutdown_connections 2024-09-17T05:34:34.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.957+0000 7fde0ba00640 1 --2- 172.21.15.31:0/537129450 >> v2:172.21.15.155:3300/0 conn(0x7fde040cd100 0x7fde040ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.957+0000 7fde0ba00640 1 --2- 172.21.15.31:0/537129450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde040b4a50 0x7fde040acd40 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.957+0000 7fde0ba00640 1 -- 172.21.15.31:0/537129450 >> 172.21.15.31:0/537129450 conn(0x7fde040b18f0 msgr2=0x7fde040b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:34.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.957+0000 7fde0ba00640 1 -- 172.21.15.31:0/537129450 shutdown_connections 2024-09-17T05:34:34.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.957+0000 7fde0ba00640 1 -- 172.21.15.31:0/537129450 wait complete. 2024-09-17T05:34:34.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde0ba00640 1 Processor -- start 2024-09-17T05:34:34.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde0ba00640 1 -- start start 2024-09-17T05:34:34.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde0ba00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde040b4a50 0x7fde0414f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:34.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde0ba00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde040cd100 0x7fde041f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:34.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde0ba00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde0415db50 0x7fde04150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:34.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde0ba00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fde04167120 con 0x7fde040b4a50 2024-09-17T05:34:34.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde0ba00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fde040cf550 con 0x7fde0415db50 2024-09-17T05:34:34.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde0ba00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fde041672a0 con 0x7fde040cd100 2024-09-17T05:34:34.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde09000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde040b4a50 0x7fde0414f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:34.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde09000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde040b4a50 0x7fde0414f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46554/0 (socket says 172.21.15.31:46554) 2024-09-17T05:34:34.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde09000640 1 -- 172.21.15.31:0/3375066417 learned_addr learned my addr 172.21.15.31:0/3375066417 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:34.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fddfbe00640 1 --2- 172.21.15.31:0/3375066417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde040cd100 0x7fde041f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:34.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde09a00640 1 --2- 172.21.15.31:0/3375066417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde0415db50 0x7fde04150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:34.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde09000640 1 -- 172.21.15.31:0/3375066417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde040cd100 msgr2=0x7fde041f6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:34.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde09000640 1 --2- 172.21.15.31:0/3375066417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde040cd100 0x7fde041f6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde09000640 1 -- 172.21.15.31:0/3375066417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde0415db50 msgr2=0x7fde04150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:34.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde09000640 1 --2- 172.21.15.31:0/3375066417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde0415db50 0x7fde04150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:34.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde09000640 1 -- 172.21.15.31:0/3375066417 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde041f7240 con 0x7fde040b4a50 2024-09-17T05:34:34.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde09000640 1 --2- 172.21.15.31:0/3375066417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde040b4a50 0x7fde0414f9f0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fddf400b440 tx=0x7fddf400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:34.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde01600640 1 -- 172.21.15.31:0/3375066417 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf4015020 con 0x7fde040b4a50 2024-09-17T05:34:34.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde01600640 1 -- 172.21.15.31:0/3375066417 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fddf4011980 con 0x7fde040b4a50 2024-09-17T05:34:34.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde01600640 1 -- 172.21.15.31:0/3375066417 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf4011dd0 con 0x7fde040b4a50 2024-09-17T05:34:34.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde0ba00640 1 -- 172.21.15.31:0/3375066417 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde040b1000 con 0x7fde040b4a50 2024-09-17T05:34:34.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.961+0000 7fde0ba00640 1 -- 172.21.15.31:0/3375066417 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde040b0190 con 0x7fde040b4a50 2024-09-17T05:34:34.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.965+0000 7fde0ba00640 1 -- 172.21.15.31:0/3375066417 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde04069410 con 0x7fde040b4a50 2024-09-17T05:34:34.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.965+0000 7fde01600640 1 -- 172.21.15.31:0/3375066417 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7fddf4018020 con 0x7fde040b4a50 2024-09-17T05:34:34.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.965+0000 7fde01600640 1 --2- 172.21.15.31:0/3375066417 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdde0073680 0x7fdde0075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:34.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.965+0000 7fde01600640 1 -- 172.21.15.31:0/3375066417 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5737+0+0 (secure 0 0 0) 0x7fddf4094cf0 con 0x7fde040b4a50 2024-09-17T05:34:34.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.965+0000 7fddfbe00640 1 --2- 172.21.15.31:0/3375066417 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdde0073680 0x7fdde0075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:34.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.965+0000 7fddfbe00640 1 --2- 172.21.15.31:0/3375066417 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdde0073680 0x7fdde0075b40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fddec0af000 tx=0x7fddec01b070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:34.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:34.969+0000 7fde01600640 1 -- 172.21.15.31:0/3375066417 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fddf401f030 con 0x7fde040b4a50 2024-09-17T05:34:35.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:35.185+0000 7fde0ba00640 1 -- 172.21.15.31:0/3375066417 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fde040ad200 con 0x7fde040b4a50 2024-09-17T05:34:36.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.057+0000 7fde01600640 1 -- 172.21.15.31:0/3375066417 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v80) ==== 118+0+0 (secure 0 0 0) 0x7fde041f7240 con 0x7fde040b4a50 2024-09-17T05:34:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.061+0000 7fde0ba00640 1 -- 172.21.15.31:0/3375066417 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdde0073680 msgr2=0x7fdde0075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.061+0000 7fde0ba00640 1 --2- 172.21.15.31:0/3375066417 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdde0073680 0x7fdde0075b40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fddec0af000 tx=0x7fddec01b070 comp rx=0 tx=0).stop 2024-09-17T05:34:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.061+0000 7fde0ba00640 1 -- 172.21.15.31:0/3375066417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde040b4a50 msgr2=0x7fde0414f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.061+0000 7fde0ba00640 1 --2- 172.21.15.31:0/3375066417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde040b4a50 0x7fde0414f9f0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fddf400b440 tx=0x7fddf400b900 comp rx=0 tx=0).stop 2024-09-17T05:34:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.061+0000 7fde0ba00640 1 -- 172.21.15.31:0/3375066417 shutdown_connections 2024-09-17T05:34:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.061+0000 7fde0ba00640 1 --2- 172.21.15.31:0/3375066417 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdde0073680 0x7fdde0075b40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.061+0000 7fde0ba00640 1 --2- 172.21.15.31:0/3375066417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde0415db50 0x7fde04150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.061+0000 7fde0ba00640 1 --2- 172.21.15.31:0/3375066417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde040cd100 0x7fde041f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.061+0000 7fde0ba00640 1 --2- 172.21.15.31:0/3375066417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde040b4a50 0x7fde0414f9f0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.061+0000 7fde0ba00640 1 -- 172.21.15.31:0/3375066417 >> 172.21.15.31:0/3375066417 conn(0x7fde040b18f0 msgr2=0x7fde04155190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:36.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.061+0000 7fde0ba00640 1 -- 172.21.15.31:0/3375066417 shutdown_connections 2024-09-17T05:34:36.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.061+0000 7fde0ba00640 1 -- 172.21.15.31:0/3375066417 wait complete. 2024-09-17T05:34:36.087 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:34:36.087 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:34:36.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.237+0000 7f6231600640 1 -- 172.21.15.31:0/1433552269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f622c073e40 msgr2=0x7f622c0cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:36.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.237+0000 7f6231600640 1 --2- 172.21.15.31:0/1433552269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f622c073e40 0x7f622c0cb8c0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f6218009840 tx=0x7f621801c7e0 comp rx=0 tx=0).stop 2024-09-17T05:34:36.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.237+0000 7f6231600640 1 -- 172.21.15.31:0/1433552269 shutdown_connections 2024-09-17T05:34:36.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.237+0000 7f6231600640 1 --2- 172.21.15.31:0/1433552269 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f622c073e40 0x7f622c0cb8c0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:36.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.237+0000 7f6231600640 1 --2- 172.21.15.31:0/1433552269 >> v2:172.21.15.155:3300/0 conn(0x7f622c073a60 0x7f622c15bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:36.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.237+0000 7f6231600640 1 -- 172.21.15.31:0/1433552269 >> 172.21.15.31:0/1433552269 conn(0x7f622c0d0c70 msgr2=0x7f622c0d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:36.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.237+0000 7f6231600640 1 -- 172.21.15.31:0/1433552269 shutdown_connections 2024-09-17T05:34:36.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.237+0000 7f6231600640 1 -- 172.21.15.31:0/1433552269 wait complete. 2024-09-17T05:34:36.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f6231600640 1 Processor -- start 2024-09-17T05:34:36.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f6231600640 1 -- start start 2024-09-17T05:34:36.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f6231600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f622c073a60 0x7f622c157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:36.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f6231600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f622c073e40 0x7f622c159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:36.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f6231600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622c151830 0x7f622c14fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f6231600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f622c0cf500 con 0x7f622c073e40 2024-09-17T05:34:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f6231600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f622c0cf380 con 0x7f622c151830 2024-09-17T05:34:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f6231600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f622c0cf680 con 0x7f622c073a60 2024-09-17T05:34:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f622a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f622c073e40 0x7f622c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f622a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f622c073e40 0x7f622c159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46570/0 (socket says 172.21.15.31:46570) 2024-09-17T05:34:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f622a000640 1 -- 172.21.15.31:0/1266919371 learned_addr learned my addr 172.21.15.31:0/1266919371 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f622aa00640 1 --2- 172.21.15.31:0/1266919371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f622c073a60 0x7f622c157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f622b400640 1 --2- 172.21.15.31:0/1266919371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622c151830 0x7f622c14fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f622a000640 1 -- 172.21.15.31:0/1266919371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f622c073a60 msgr2=0x7f622c157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f622a000640 1 --2- 172.21.15.31:0/1266919371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f622c073a60 0x7f622c157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f622a000640 1 -- 172.21.15.31:0/1266919371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622c151830 msgr2=0x7f622c14fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:36.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f622a000640 1 --2- 172.21.15.31:0/1266919371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622c151830 0x7f622c14fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:36.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f622a000640 1 -- 172.21.15.31:0/1266919371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622c156e90 con 0x7f622c073e40 2024-09-17T05:34:36.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f622a000640 1 --2- 172.21.15.31:0/1266919371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f622c073e40 0x7f622c159900 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f6218009790 tx=0x7f62180a5670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:36.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f6222a00640 1 -- 172.21.15.31:0/1266919371 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62180bb070 con 0x7f622c073e40 2024-09-17T05:34:36.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f6222a00640 1 -- 172.21.15.31:0/1266919371 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6218005030 con 0x7f622c073e40 2024-09-17T05:34:36.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f6222a00640 1 -- 172.21.15.31:0/1266919371 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62180b2040 con 0x7f622c073e40 2024-09-17T05:34:36.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f6231600640 1 -- 172.21.15.31:0/1266919371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f622c157170 con 0x7f622c073e40 2024-09-17T05:34:36.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.241+0000 7f6231600640 1 -- 172.21.15.31:0/1266919371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f622c157a10 con 0x7f622c073e40 2024-09-17T05:34:36.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.245+0000 7f6231600640 1 -- 172.21.15.31:0/1266919371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f622c0cfbc0 con 0x7f622c073e40 2024-09-17T05:34:36.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.245+0000 7f6222a00640 1 -- 172.21.15.31:0/1266919371 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f62180be070 con 0x7f622c073e40 2024-09-17T05:34:36.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.245+0000 7f6222a00640 1 --2- 172.21.15.31:0/1266919371 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f620c073680 0x7f620c075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:36.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.245+0000 7f6222a00640 1 -- 172.21.15.31:0/1266919371 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5737+0+0 (secure 0 0 0) 0x7f621812e240 con 0x7f622c073e40 2024-09-17T05:34:36.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.245+0000 7f622aa00640 1 --2- 172.21.15.31:0/1266919371 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f620c073680 0x7f620c075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:36.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.245+0000 7f622aa00640 1 --2- 172.21.15.31:0/1266919371 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f620c073680 0x7f620c075b40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f621c00abe0 tx=0x7f621c00a2d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:36.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.249+0000 7f6222a00640 1 -- 172.21.15.31:0/1266919371 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f62180163d0 con 0x7f622c073e40 2024-09-17T05:34:36.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:36.461+0000 7f6231600640 1 -- 172.21.15.31:0/1266919371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f622c157340 con 0x7f622c073e40 2024-09-17T05:34:37.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.065+0000 7f6222a00640 1 -- 172.21.15.31:0/1266919371 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v81) ==== 122+0+0 (secure 0 0 0) 0x7f62180f8540 con 0x7f622c073e40 2024-09-17T05:34:37.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.065+0000 7f6231600640 1 -- 172.21.15.31:0/1266919371 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f620c073680 msgr2=0x7f620c075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:37.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.065+0000 7f6231600640 1 --2- 172.21.15.31:0/1266919371 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f620c073680 0x7f620c075b40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f621c00abe0 tx=0x7f621c00a2d0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.065+0000 7f6231600640 1 -- 172.21.15.31:0/1266919371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f622c073e40 msgr2=0x7f622c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:37.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.065+0000 7f6231600640 1 --2- 172.21.15.31:0/1266919371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f622c073e40 0x7f622c159900 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f6218009790 tx=0x7f62180a5670 comp rx=0 tx=0).stop 2024-09-17T05:34:37.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.065+0000 7f6231600640 1 -- 172.21.15.31:0/1266919371 shutdown_connections 2024-09-17T05:34:37.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.065+0000 7f6231600640 1 --2- 172.21.15.31:0/1266919371 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f620c073680 0x7f620c075b40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.065+0000 7f6231600640 1 --2- 172.21.15.31:0/1266919371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f622c151830 0x7f622c14fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.065+0000 7f6231600640 1 --2- 172.21.15.31:0/1266919371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f622c073e40 0x7f622c159900 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.065+0000 7f6231600640 1 --2- 172.21.15.31:0/1266919371 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f622c073a60 0x7f622c157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.065+0000 7f6231600640 1 -- 172.21.15.31:0/1266919371 >> 172.21.15.31:0/1266919371 conn(0x7f622c0d0c70 msgr2=0x7f622c0ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:37.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.065+0000 7f6231600640 1 -- 172.21.15.31:0/1266919371 shutdown_connections 2024-09-17T05:34:37.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.065+0000 7f6231600640 1 -- 172.21.15.31:0/1266919371 wait complete. 2024-09-17T05:34:37.093 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:34:37.093 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:34:37.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.241+0000 7f8ebee00640 1 -- 172.21.15.31:0/972233280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8eb80cdb30 msgr2=0x7f8eb80aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:37.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.241+0000 7f8ebee00640 1 --2- 172.21.15.31:0/972233280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8eb80cdb30 0x7f8eb80aeef0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80cc3a0 tx=0x7f8eb001cd80 comp rx=0 tx=0).stop 2024-09-17T05:34:37.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.241+0000 7f8ebee00640 1 -- 172.21.15.31:0/972233280 shutdown_connections 2024-09-17T05:34:37.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.241+0000 7f8ebee00640 1 --2- 172.21.15.31:0/972233280 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8eb80cdb30 0x7f8eb80aeef0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.241+0000 7f8ebee00640 1 --2- 172.21.15.31:0/972233280 >> v2:172.21.15.155:3300/0 conn(0x7f8eb80ced80 0x7f8eb80ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.241+0000 7f8ebee00640 1 -- 172.21.15.31:0/972233280 >> 172.21.15.31:0/972233280 conn(0x7f8eb80d1dc0 msgr2=0x7f8eb80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:37.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.241+0000 7f8ebee00640 1 -- 172.21.15.31:0/972233280 shutdown_connections 2024-09-17T05:34:37.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.241+0000 7f8ebee00640 1 -- 172.21.15.31:0/972233280 wait complete. 2024-09-17T05:34:37.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8ebee00640 1 Processor -- start 2024-09-17T05:34:37.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8ebee00640 1 -- start start 2024-09-17T05:34:37.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8ebee00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8eb80cdb30 0x7f8eb8151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:37.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8ebee00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8eb80ced80 0x7f8eb8071610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:37.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8ebee00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb815bea0 0x7f8eb8071b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:37.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8ebee00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb81692f0 con 0x7f8eb80cdb30 2024-09-17T05:34:37.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8ebee00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb8169170 con 0x7f8eb815bea0 2024-09-17T05:34:37.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8ebee00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb8169470 con 0x7f8eb80ced80 2024-09-17T05:34:37.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8eb7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8eb80cdb30 0x7f8eb8151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:37.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8eb7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8eb80cdb30 0x7f8eb8151ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46588/0 (socket says 172.21.15.31:46588) 2024-09-17T05:34:37.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8eb7e00640 1 -- 172.21.15.31:0/3822086911 learned_addr learned my addr 172.21.15.31:0/3822086911 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:37.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8eafe00640 1 --2- 172.21.15.31:0/3822086911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8eb80ced80 0x7f8eb8071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:37.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8ebce00640 1 --2- 172.21.15.31:0/3822086911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb815bea0 0x7f8eb8071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:37.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8eb7e00640 1 -- 172.21.15.31:0/3822086911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8eb80ced80 msgr2=0x7f8eb8071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:37.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8eb7e00640 1 --2- 172.21.15.31:0/3822086911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8eb80ced80 0x7f8eb8071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8eb7e00640 1 -- 172.21.15.31:0/3822086911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb815bea0 msgr2=0x7f8eb8071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:37.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8eb7e00640 1 --2- 172.21.15.31:0/3822086911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb815bea0 0x7f8eb8071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8eb7e00640 1 -- 172.21.15.31:0/3822086911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb80b1570 con 0x7f8eb80cdb30 2024-09-17T05:34:37.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8eb7e00640 1 --2- 172.21.15.31:0/3822086911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8eb80cdb30 0x7f8eb8151ba0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f8ea800b440 tx=0x7f8ea800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:37.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8eb4c00640 1 -- 172.21.15.31:0/3822086911 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8015020 con 0x7f8eb80cdb30 2024-09-17T05:34:37.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8eb4c00640 1 -- 172.21.15.31:0/3822086911 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ea8011980 con 0x7f8eb80cdb30 2024-09-17T05:34:37.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8eb4c00640 1 -- 172.21.15.31:0/3822086911 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8011dd0 con 0x7f8eb80cdb30 2024-09-17T05:34:37.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8ebee00640 1 -- 172.21.15.31:0/3822086911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb8158330 con 0x7f8eb80cdb30 2024-09-17T05:34:37.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.245+0000 7f8ebee00640 1 -- 172.21.15.31:0/3822086911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb80b36f0 con 0x7f8eb80cdb30 2024-09-17T05:34:37.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.249+0000 7f8ebee00640 1 -- 172.21.15.31:0/3822086911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb80ce020 con 0x7f8eb80cdb30 2024-09-17T05:34:37.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.249+0000 7f8eb4c00640 1 -- 172.21.15.31:0/3822086911 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f8ea8018020 con 0x7f8eb80cdb30 2024-09-17T05:34:37.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.249+0000 7f8eb4c00640 1 --2- 172.21.15.31:0/3822086911 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8e94073680 0x7f8e94075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:37.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.249+0000 7f8eb4c00640 1 -- 172.21.15.31:0/3822086911 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5737+0+0 (secure 0 0 0) 0x7f8ea8094880 con 0x7f8eb80cdb30 2024-09-17T05:34:37.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.249+0000 7f8eafe00640 1 --2- 172.21.15.31:0/3822086911 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8e94073680 0x7f8e94075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:37.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.249+0000 7f8eafe00640 1 --2- 172.21.15.31:0/3822086911 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8e94073680 0x7f8e94075b40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80cc3f0 tx=0x7f8ea000b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:37.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.253+0000 7f8eb4c00640 1 -- 172.21.15.31:0/3822086911 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8ea801f030 con 0x7f8eb80cdb30 2024-09-17T05:34:37.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.465+0000 7f8ebee00640 1 -- 172.21.15.31:0/3822086911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8eb80ce620 con 0x7f8eb80cdb30 2024-09-17T05:34:37.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.465+0000 7f8eb4c00640 1 -- 172.21.15.31:0/3822086911 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5222 (secure 0 0 0) 0x7f8ea800d040 con 0x7f8eb80cdb30 2024-09-17T05:34:37.469 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:37.469 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":81,"btime":"2024-09-17T05:34:37:062019+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6398,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/296432902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":296432902},{"type":"v1","addr":"172.21.15.31:6834","nonce":296432902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/951265381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":951265381},{"type":"v1","addr":"172.21.15.155:6809","nonce":951265381}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/119812259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":119812259},{"type":"v1","addr":"172.21.15.155:6835","nonce":119812259}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:34:33.468561+0000","modified":"2024-09-17T05:34:36.465649+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7416},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7416":{"gid":7416,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/1466764013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1466764013},{"type":"v1","addr":"172.21.15.31:6835","nonce":1466764013}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7416,"qdb_cluster":[7416]},"id":9}]} 2024-09-17T05:34:37.470 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 81 2024-09-17T05:34:37.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.469+0000 7f8ebee00640 1 -- 172.21.15.31:0/3822086911 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8e94073680 msgr2=0x7f8e94075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:37.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.469+0000 7f8ebee00640 1 --2- 172.21.15.31:0/3822086911 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8e94073680 0x7f8e94075b40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80cc3f0 tx=0x7f8ea000b390 comp rx=0 tx=0).stop 2024-09-17T05:34:37.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.469+0000 7f8ebee00640 1 -- 172.21.15.31:0/3822086911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8eb80cdb30 msgr2=0x7f8eb8151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:37.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.469+0000 7f8ebee00640 1 --2- 172.21.15.31:0/3822086911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8eb80cdb30 0x7f8eb8151ba0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f8ea800b440 tx=0x7f8ea800b900 comp rx=0 tx=0).stop 2024-09-17T05:34:37.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.469+0000 7f8ebee00640 1 -- 172.21.15.31:0/3822086911 shutdown_connections 2024-09-17T05:34:37.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.469+0000 7f8ebee00640 1 --2- 172.21.15.31:0/3822086911 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8e94073680 0x7f8e94075b40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.469+0000 7f8ebee00640 1 --2- 172.21.15.31:0/3822086911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8eb815bea0 0x7f8eb8071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.469+0000 7f8ebee00640 1 --2- 172.21.15.31:0/3822086911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8eb80ced80 0x7f8eb8071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.469+0000 7f8ebee00640 1 --2- 172.21.15.31:0/3822086911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8eb80cdb30 0x7f8eb8151ba0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.469+0000 7f8ebee00640 1 -- 172.21.15.31:0/3822086911 >> 172.21.15.31:0/3822086911 conn(0x7f8eb80d1dc0 msgr2=0x7f8eb806dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:37.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.469+0000 7f8ebee00640 1 -- 172.21.15.31:0/3822086911 shutdown_connections 2024-09-17T05:34:37.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.469+0000 7f8ebee00640 1 -- 172.21.15.31:0/3822086911 wait complete. 2024-09-17T05:34:37.491 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:34:37.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.637+0000 7f1f1f600640 1 -- 172.21.15.31:0/4132400649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f1815f490 msgr2=0x7f1f180b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:37.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.637+0000 7f1f1f600640 1 --2- 172.21.15.31:0/4132400649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f1815f490 0x7f1f180b14c0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f1f18073dd0 tx=0x7f1f0c01c830 comp rx=0 tx=0).stop 2024-09-17T05:34:37.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.637+0000 7f1f1f600640 1 -- 172.21.15.31:0/4132400649 shutdown_connections 2024-09-17T05:34:37.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.637+0000 7f1f1f600640 1 --2- 172.21.15.31:0/4132400649 >> v2:172.21.15.155:3300/0 conn(0x7f1f180b2e80 0x7f1f180b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.637+0000 7f1f1f600640 1 --2- 172.21.15.31:0/4132400649 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f1815f490 0x7f1f180b14c0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.637+0000 7f1f1f600640 1 -- 172.21.15.31:0/4132400649 >> 172.21.15.31:0/4132400649 conn(0x7f1f180d1e30 msgr2=0x7f1f180d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:37.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.637+0000 7f1f1f600640 1 -- 172.21.15.31:0/4132400649 shutdown_connections 2024-09-17T05:34:37.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.637+0000 7f1f1f600640 1 -- 172.21.15.31:0/4132400649 wait complete. 2024-09-17T05:34:37.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.637+0000 7f1f1f600640 1 Processor -- start 2024-09-17T05:34:37.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.637+0000 7f1f1f600640 1 -- start start 2024-09-17T05:34:37.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.637+0000 7f1f1f600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f180b1f40 0x7f1f180cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:37.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.637+0000 7f1f1f600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f180b2e80 0x7f1f1814f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:37.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.637+0000 7f1f1f600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f1815f490 0x7f1f18158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:37.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.637+0000 7f1f1f600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1f18168e90 con 0x7f1f180b1f40 2024-09-17T05:34:37.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.637+0000 7f1f1f600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1815f9e0 con 0x7f1f1815f490 2024-09-17T05:34:37.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.637+0000 7f1f1f600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1f18169010 con 0x7f1f180b2e80 2024-09-17T05:34:37.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f1cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f180b1f40 0x7f1f180cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:37.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f1cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f180b1f40 0x7f1f180cdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46604/0 (socket says 172.21.15.31:46604) 2024-09-17T05:34:37.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f1cc00640 1 -- 172.21.15.31:0/2254178058 learned_addr learned my addr 172.21.15.31:0/2254178058 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:37.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f17e00640 1 --2- 172.21.15.31:0/2254178058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f180b2e80 0x7f1f1814f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:37.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f1d600640 1 --2- 172.21.15.31:0/2254178058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f1815f490 0x7f1f18158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:37.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f1cc00640 1 -- 172.21.15.31:0/2254178058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f180b2e80 msgr2=0x7f1f1814f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:37.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f1cc00640 1 --2- 172.21.15.31:0/2254178058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f180b2e80 0x7f1f1814f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f1cc00640 1 -- 172.21.15.31:0/2254178058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f1815f490 msgr2=0x7f1f18158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:37.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f1cc00640 1 --2- 172.21.15.31:0/2254178058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f1815f490 0x7f1f18158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f1cc00640 1 -- 172.21.15.31:0/2254178058 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f18159050 con 0x7f1f180b1f40 2024-09-17T05:34:37.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f17e00640 1 --2- 172.21.15.31:0/2254178058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f180b2e80 0x7f1f1814f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:37.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f1cc00640 1 --2- 172.21.15.31:0/2254178058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f180b1f40 0x7f1f180cdd70 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0b0040 tx=0x7f1f0c005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:37.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f14c00640 1 -- 172.21.15.31:0/2254178058 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c0b2040 con 0x7f1f180b1f40 2024-09-17T05:34:37.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f14c00640 1 -- 172.21.15.31:0/2254178058 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f0c004330 con 0x7f1f180b1f40 2024-09-17T05:34:37.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f1f600640 1 -- 172.21.15.31:0/2254178058 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f18159330 con 0x7f1f180b1f40 2024-09-17T05:34:37.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f14c00640 1 -- 172.21.15.31:0/2254178058 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c005280 con 0x7f1f180b1f40 2024-09-17T05:34:37.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f1f600640 1 -- 172.21.15.31:0/2254178058 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1814f840 con 0x7f1f180b1f40 2024-09-17T05:34:37.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f1f600640 1 -- 172.21.15.31:0/2254178058 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f180cfda0 con 0x7f1f180b1f40 2024-09-17T05:34:37.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.641+0000 7f1f14c00640 1 -- 172.21.15.31:0/2254178058 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f1f0c005420 con 0x7f1f180b1f40 2024-09-17T05:34:37.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.645+0000 7f1f14c00640 1 --2- 172.21.15.31:0/2254178058 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1ef8073680 0x7f1ef8075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:37.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.645+0000 7f1f14c00640 1 -- 172.21.15.31:0/2254178058 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5737+0+0 (secure 0 0 0) 0x7f1f0c12e4f0 con 0x7f1f180b1f40 2024-09-17T05:34:37.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.645+0000 7f1f17e00640 1 --2- 172.21.15.31:0/2254178058 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1ef8073680 0x7f1ef8075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:37.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.645+0000 7f1f17e00640 1 --2- 172.21.15.31:0/2254178058 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1ef8073680 0x7f1ef8075b40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1f18071d20 tx=0x7f1f040091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:37.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.649+0000 7f1f14c00640 1 -- 172.21.15.31:0/2254178058 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f1f0c0164b0 con 0x7f1f180b1f40 2024-09-17T05:34:37.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.825+0000 7f1f1f600640 1 -- 172.21.15.31:0/2254178058 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f18159500 con 0x7f1f180b1f40 2024-09-17T05:34:37.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.825+0000 7f1f14c00640 1 -- 172.21.15.31:0/2254178058 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+16807 (secure 0 0 0) 0x7f1f0c0f8770 con 0x7f1f180b1f40 2024-09-17T05:34:37.827 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:37.828 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":115,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:34:35.046717+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:34:31.156126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T05:34:32.412462+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:34:37.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.825+0000 7f1f1f600640 1 -- 172.21.15.31:0/2254178058 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1ef8073680 msgr2=0x7f1ef8075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:37.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.825+0000 7f1f1f600640 1 --2- 172.21.15.31:0/2254178058 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1ef8073680 0x7f1ef8075b40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1f18071d20 tx=0x7f1f040091e0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.825+0000 7f1f1f600640 1 -- 172.21.15.31:0/2254178058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f180b1f40 msgr2=0x7f1f180cdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:37.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.825+0000 7f1f1f600640 1 --2- 172.21.15.31:0/2254178058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f180b1f40 0x7f1f180cdd70 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0b0040 tx=0x7f1f0c005e00 comp rx=0 tx=0).stop 2024-09-17T05:34:37.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.829+0000 7f1f1f600640 1 -- 172.21.15.31:0/2254178058 shutdown_connections 2024-09-17T05:34:37.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.829+0000 7f1f1f600640 1 --2- 172.21.15.31:0/2254178058 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1ef8073680 0x7f1ef8075b40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.829+0000 7f1f1f600640 1 --2- 172.21.15.31:0/2254178058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f1815f490 0x7f1f18158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.829+0000 7f1f1f600640 1 --2- 172.21.15.31:0/2254178058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f180b2e80 0x7f1f1814f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.829+0000 7f1f1f600640 1 --2- 172.21.15.31:0/2254178058 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f180b1f40 0x7f1f180cdd70 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:37.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.829+0000 7f1f1f600640 1 -- 172.21.15.31:0/2254178058 >> 172.21.15.31:0/2254178058 conn(0x7f1f180d1e30 msgr2=0x7f1f1806dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:37.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.829+0000 7f1f1f600640 1 -- 172.21.15.31:0/2254178058 shutdown_connections 2024-09-17T05:34:37.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.829+0000 7f1f1f600640 1 -- 172.21.15.31:0/2254178058 wait complete. 2024-09-17T05:34:37.850 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:34:37.850 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:34:37.983 INFO:tasks.ceph.mds.c.smithi031.stderr:2024-09-17T05:34:37.981+0000 7f19ac400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:34:37.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.997+0000 7f9d2a600640 1 -- 172.21.15.31:0/1784040676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d2415be80 msgr2=0x7f9d240ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:37.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.997+0000 7f9d2a600640 1 --2- 172.21.15.31:0/1784040676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d2415be80 0x7f9d240ce4e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9d14009840 tx=0x7f9d1401c820 comp rx=0 tx=0).stop 2024-09-17T05:34:37.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.997+0000 7f9d2a600640 1 -- 172.21.15.31:0/1784040676 shutdown_connections 2024-09-17T05:34:37.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.997+0000 7f9d2a600640 1 --2- 172.21.15.31:0/1784040676 >> v2:172.21.15.155:3300/0 conn(0x7f9d240d28c0 0x7f9d240cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.997+0000 7f9d2a600640 1 --2- 172.21.15.31:0/1784040676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d2415be80 0x7f9d240ce4e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.997+0000 7f9d2a600640 1 -- 172.21.15.31:0/1784040676 >> 172.21.15.31:0/1784040676 conn(0x7f9d240d1da0 msgr2=0x7f9d240d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:38.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.997+0000 7f9d2a600640 1 -- 172.21.15.31:0/1784040676 shutdown_connections 2024-09-17T05:34:38.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.997+0000 7f9d2a600640 1 -- 172.21.15.31:0/1784040676 wait complete. 2024-09-17T05:34:38.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.997+0000 7f9d2a600640 1 Processor -- start 2024-09-17T05:34:38.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:37.997+0000 7f9d2a600640 1 -- start start 2024-09-17T05:34:38.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d2a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d240b53f0 0x7f9d2414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:38.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d2a600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d240d28c0 0x7f9d24157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:38.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d2a600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d2415be80 0x7f9d2414c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:38.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d2a600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9d24169110 con 0x7f9d240b53f0 2024-09-17T05:34:38.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d2a600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9d24168f90 con 0x7f9d2415be80 2024-09-17T05:34:38.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d2a600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9d24169290 con 0x7f9d240d28c0 2024-09-17T05:34:38.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d23400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d240b53f0 0x7f9d2414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:38.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d23400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d240b53f0 0x7f9d2414b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46612/0 (socket says 172.21.15.31:46612) 2024-09-17T05:34:38.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d23400640 1 -- 172.21.15.31:0/3288246110 learned_addr learned my addr 172.21.15.31:0/3288246110 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:38.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d23e00640 1 --2- 172.21.15.31:0/3288246110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d2415be80 0x7f9d2414c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:38.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d22a00640 1 --2- 172.21.15.31:0/3288246110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d240d28c0 0x7f9d24157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:38.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d23400640 1 -- 172.21.15.31:0/3288246110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d240d28c0 msgr2=0x7f9d24157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:38.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d23400640 1 --2- 172.21.15.31:0/3288246110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d240d28c0 0x7f9d24157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d23400640 1 -- 172.21.15.31:0/3288246110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d2415be80 msgr2=0x7f9d2414c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:38.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d23400640 1 --2- 172.21.15.31:0/3288246110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d2415be80 0x7f9d2414c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d23400640 1 -- 172.21.15.31:0/3288246110 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2415ab80 con 0x7f9d240b53f0 2024-09-17T05:34:38.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d23e00640 1 --2- 172.21.15.31:0/3288246110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d2415be80 0x7f9d2414c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:38.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d23400640 1 --2- 172.21.15.31:0/3288246110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d240b53f0 0x7f9d2414b2e0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f9d1401a450 tx=0x7f9d140a6760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:38.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d1b400640 1 -- 172.21.15.31:0/3288246110 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d14004140 con 0x7f9d240b53f0 2024-09-17T05:34:38.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d1b400640 1 -- 172.21.15.31:0/3288246110 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d140043d0 con 0x7f9d240b53f0 2024-09-17T05:34:38.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d2a600640 1 -- 172.21.15.31:0/3288246110 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d24155540 con 0x7f9d240b53f0 2024-09-17T05:34:38.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d1b400640 1 -- 172.21.15.31:0/3288246110 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d14003860 con 0x7f9d240b53f0 2024-09-17T05:34:38.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d2a600640 1 -- 172.21.15.31:0/3288246110 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d24155b00 con 0x7f9d240b53f0 2024-09-17T05:34:38.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d2a600640 1 -- 172.21.15.31:0/3288246110 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d240b5880 con 0x7f9d240b53f0 2024-09-17T05:34:38.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.001+0000 7f9d1b400640 1 -- 172.21.15.31:0/3288246110 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f9d140bf020 con 0x7f9d240b53f0 2024-09-17T05:34:38.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.005+0000 7f9d1b400640 1 --2- 172.21.15.31:0/3288246110 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9d04073680 0x7f9d04075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:38.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.005+0000 7f9d1b400640 1 -- 172.21.15.31:0/3288246110 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5737+0+0 (secure 0 0 0) 0x7f9d1412ee90 con 0x7f9d240b53f0 2024-09-17T05:34:38.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.005+0000 7f9d22a00640 1 --2- 172.21.15.31:0/3288246110 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9d04073680 0x7f9d04075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:38.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.005+0000 7f9d22a00640 1 --2- 172.21.15.31:0/3288246110 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9d04073680 0x7f9d04075b40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9d100096c0 tx=0x7f9d10009260 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:38.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.009+0000 7f9d1b400640 1 -- 172.21.15.31:0/3288246110 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9d14016410 con 0x7f9d240b53f0 2024-09-17T05:34:38.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.181+0000 7f9d2a600640 1 -- 172.21.15.31:0/3288246110 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9d2406cf90 con 0x7f9d04073680 2024-09-17T05:34:38.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.185+0000 7f9d1b400640 1 -- 172.21.15.31:0/3288246110 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247114 (secure 0 0 0) 0x7f9d2406cf90 con 0x7f9d04073680 2024-09-17T05:34:38.192 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:38.194 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:34:38.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.189+0000 7f9d2a600640 1 -- 172.21.15.31:0/3288246110 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9d04073680 msgr2=0x7f9d04075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:38.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.189+0000 7f9d2a600640 1 --2- 172.21.15.31:0/3288246110 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9d04073680 0x7f9d04075b40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9d100096c0 tx=0x7f9d10009260 comp rx=0 tx=0).stop 2024-09-17T05:34:38.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.189+0000 7f9d2a600640 1 -- 172.21.15.31:0/3288246110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d240b53f0 msgr2=0x7f9d2414b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:38.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.189+0000 7f9d2a600640 1 --2- 172.21.15.31:0/3288246110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d240b53f0 0x7f9d2414b2e0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f9d1401a450 tx=0x7f9d140a6760 comp rx=0 tx=0).stop 2024-09-17T05:34:38.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.189+0000 7f9d2a600640 1 -- 172.21.15.31:0/3288246110 shutdown_connections 2024-09-17T05:34:38.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.189+0000 7f9d2a600640 1 --2- 172.21.15.31:0/3288246110 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9d04073680 0x7f9d04075b40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.189+0000 7f9d2a600640 1 --2- 172.21.15.31:0/3288246110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d2415be80 0x7f9d2414c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.189+0000 7f9d2a600640 1 --2- 172.21.15.31:0/3288246110 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d240d28c0 0x7f9d24157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.189+0000 7f9d2a600640 1 --2- 172.21.15.31:0/3288246110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d240b53f0 0x7f9d2414b2e0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.189+0000 7f9d2a600640 1 -- 172.21.15.31:0/3288246110 >> 172.21.15.31:0/3288246110 conn(0x7f9d240d1da0 msgr2=0x7f9d2414e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:38.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.189+0000 7f9d2a600640 1 -- 172.21.15.31:0/3288246110 shutdown_connections 2024-09-17T05:34:38.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.189+0000 7f9d2a600640 1 -- 172.21.15.31:0/3288246110 wait complete. 2024-09-17T05:34:38.213 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-09-17T05:34:36.724100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261628,"kb_used_data":12112,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713092,"statfs":{"total":773094113280,"available":772826206208,"internally_reserved":0,"allocated":12402688,"data_stored":6083138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.699917"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.042053+0000","last_change":"2024-09-17T05:34:33.042053+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.042053+0000","last_undegraded":"2024-09-17T05:34:33.042053+0000","last_fullsized":"2024-09-17T05:34:33.042053+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.048156+0000","last_change":"2024-09-17T05:34:33.048156+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.048156+0000","last_undegraded":"2024-09-17T05:34:33.048156+0000","last_fullsized":"2024-09-17T05:34:33.048156+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.047881+0000","last_change":"2024-09-17T05:34:33.047881+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.047881+0000","last_undegraded":"2024-09-17T05:34:33.047881+0000","last_fullsized":"2024-09-17T05:34:33.047881+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.042091+0000","last_change":"2024-09-17T05:34:33.042091+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.042091+0000","last_undegraded":"2024-09-17T05:34:33.042091+0000","last_fullsized":"2024-09-17T05:34:33.042091+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.047799+0000","last_change":"2024-09-17T05:34:33.047799+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.047799+0000","last_undegraded":"2024-09-17T05:34:33.047799+0000","last_fullsized":"2024-09-17T05:34:33.047799+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.040014+0000","last_change":"2024-09-17T05:34:33.040014+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.040014+0000","last_undegraded":"2024-09-17T05:34:33.040014+0000","last_fullsized":"2024-09-17T05:34:33.040014+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.040177+0000","last_change":"2024-09-17T05:34:33.040177+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.040177+0000","last_undegraded":"2024-09-17T05:34:33.040177+0000","last_fullsized":"2024-09-17T05:34:33.040177+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.045841+0000","last_change":"2024-09-17T05:34:33.045841+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.045841+0000","last_undegraded":"2024-09-17T05:34:33.045841+0000","last_fullsized":"2024-09-17T05:34:33.045841+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.048526+0000","last_change":"2024-09-17T05:34:33.048526+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.048526+0000","last_undegraded":"2024-09-17T05:34:33.048526+0000","last_fullsized":"2024-09-17T05:34:33.048526+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.047327+0000","last_change":"2024-09-17T05:34:33.047327+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.047327+0000","last_undegraded":"2024-09-17T05:34:33.047327+0000","last_fullsized":"2024-09-17T05:34:33.047327+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.049891+0000","last_change":"2024-09-17T05:34:33.049891+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.049891+0000","last_undegraded":"2024-09-17T05:34:33.049891+0000","last_fullsized":"2024-09-17T05:34:33.049891+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.048126+0000","last_change":"2024-09-17T05:34:33.048126+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.048126+0000","last_undegraded":"2024-09-17T05:34:33.048126+0000","last_fullsized":"2024-09-17T05:34:33.048126+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.042330+0000","last_change":"2024-09-17T05:34:33.042330+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.042330+0000","last_undegraded":"2024-09-17T05:34:33.042330+0000","last_fullsized":"2024-09-17T05:34:33.042330+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.047385+0000","last_change":"2024-09-17T05:34:33.047385+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.047385+0000","last_undegraded":"2024-09-17T05:34:33.047385+0000","last_fullsized":"2024-09-17T05:34:33.047385+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.041335+0000","last_change":"2024-09-17T05:34:33.041335+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.041335+0000","last_undegraded":"2024-09-17T05:34:33.041335+0000","last_fullsized":"2024-09-17T05:34:33.041335+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.045466+0000","last_change":"2024-09-17T05:34:33.045466+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.045466+0000","last_undegraded":"2024-09-17T05:34:33.045466+0000","last_fullsized":"2024-09-17T05:34:33.045466+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.040276+0000","last_change":"2024-09-17T05:34:33.040276+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.040276+0000","last_undegraded":"2024-09-17T05:34:33.040276+0000","last_fullsized":"2024-09-17T05:34:33.040276+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.044988+0000","last_change":"2024-09-17T05:34:33.044988+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.044988+0000","last_undegraded":"2024-09-17T05:34:33.044988+0000","last_fullsized":"2024-09-17T05:34:33.044988+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.049491+0000","last_change":"2024-09-17T05:34:33.049491+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.049491+0000","last_undegraded":"2024-09-17T05:34:33.049491+0000","last_fullsized":"2024-09-17T05:34:33.049491+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.039963+0000","last_change":"2024-09-17T05:34:33.039963+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.039963+0000","last_undegraded":"2024-09-17T05:34:33.039963+0000","last_fullsized":"2024-09-17T05:34:33.039963+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.049575+0000","last_change":"2024-09-17T05:34:33.049575+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.049575+0000","last_undegraded":"2024-09-17T05:34:33.049575+0000","last_fullsized":"2024-09-17T05:34:33.049575+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.048549+0000","last_change":"2024-09-17T05:34:33.048549+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.048549+0000","last_undegraded":"2024-09-17T05:34:33.048549+0000","last_fullsized":"2024-09-17T05:34:33.048549+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.046697+0000","last_change":"2024-09-17T05:34:33.046697+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.046697+0000","last_undegraded":"2024-09-17T05:34:33.046697+0000","last_fullsized":"2024-09-17T05:34:33.046697+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.047224+0000","last_change":"2024-09-17T05:34:33.047224+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.047224+0000","last_undegraded":"2024-09-17T05:34:33.047224+0000","last_fullsized":"2024-09-17T05:34:33.047224+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.046386+0000","last_change":"2024-09-17T05:34:33.046386+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.046386+0000","last_undegraded":"2024-09-17T05:34:33.046386+0000","last_fullsized":"2024-09-17T05:34:33.046386+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.043229+0000","last_change":"2024-09-17T05:34:33.043229+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.043229+0000","last_undegraded":"2024-09-17T05:34:33.043229+0000","last_fullsized":"2024-09-17T05:34:33.043229+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.041165+0000","last_change":"2024-09-17T05:34:33.041165+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.041165+0000","last_undegraded":"2024-09-17T05:34:33.041165+0000","last_fullsized":"2024-09-17T05:34:33.041165+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.042365+0000","last_change":"2024-09-17T05:34:33.042365+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.042365+0000","last_undegraded":"2024-09-17T05:34:33.042365+0000","last_fullsized":"2024-09-17T05:34:33.042365+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.041071+0000","last_change":"2024-09-17T05:34:33.041071+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.041071+0000","last_undegraded":"2024-09-17T05:34:33.041071+0000","last_fullsized":"2024-09-17T05:34:33.041071+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.040283+0000","last_change":"2024-09-17T05:34:33.040283+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.040283+0000","last_undegraded":"2024-09-17T05:34:33.040283+0000","last_fullsized":"2024-09-17T05:34:33.040283+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.046534+0000","last_change":"2024-09-17T05:34:33.046534+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.046534+0000","last_undegraded":"2024-09-17T05:34:33.046534+0000","last_fullsized":"2024-09-17T05:34:33.046534+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.040188+0000","last_change":"2024-09-17T05:34:33.040188+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.040188+0000","last_undegraded":"2024-09-17T05:34:33.040188+0000","last_fullsized":"2024-09-17T05:34:33.040188+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.038860+0000","last_change":"2024-09-17T05:34:33.038860+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.038860+0000","last_undegraded":"2024-09-17T05:34:33.038860+0000","last_fullsized":"2024-09-17T05:34:33.038860+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.063562+0000","last_change":"2024-09-17T05:34:33.060411+0000","last_active":"2024-09-17T05:34:33.063562+0000","last_peered":"2024-09-17T05:34:33.063562+0000","last_clean":"2024-09-17T05:34:33.063562+0000","last_became_active":"2024-09-17T05:34:33.060044+0000","last_became_peered":"2024-09-17T05:34:33.060044+0000","last_unstale":"2024-09-17T05:34:33.063562+0000","last_undegraded":"2024-09-17T05:34:33.063562+0000","last_fullsized":"2024-09-17T05:34:33.063562+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:29.989093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.048089+0000","last_change":"2024-09-17T05:34:33.048089+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.048089+0000","last_undegraded":"2024-09-17T05:34:33.048089+0000","last_fullsized":"2024-09-17T05:34:33.048089+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.066129+0000","last_change":"2024-09-17T05:34:33.062317+0000","last_active":"2024-09-17T05:34:33.066129+0000","last_peered":"2024-09-17T05:34:33.066129+0000","last_clean":"2024-09-17T05:34:33.066129+0000","last_became_active":"2024-09-17T05:34:33.061996+0000","last_became_peered":"2024-09-17T05:34:33.061996+0000","last_unstale":"2024-09-17T05:34:33.066129+0000","last_undegraded":"2024-09-17T05:34:33.066129+0000","last_fullsized":"2024-09-17T05:34:33.066129+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:13.718392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.046499+0000","last_change":"2024-09-17T05:34:33.046499+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.046499+0000","last_undegraded":"2024-09-17T05:34:33.046499+0000","last_fullsized":"2024-09-17T05:34:33.046499+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.064444+0000","last_change":"2024-09-17T05:34:33.062863+0000","last_active":"2024-09-17T05:34:33.064444+0000","last_peered":"2024-09-17T05:34:33.064444+0000","last_clean":"2024-09-17T05:34:33.064444+0000","last_became_active":"2024-09-17T05:34:33.062606+0000","last_became_peered":"2024-09-17T05:34:33.062606+0000","last_unstale":"2024-09-17T05:34:33.064444+0000","last_undegraded":"2024-09-17T05:34:33.064444+0000","last_fullsized":"2024-09-17T05:34:33.064444+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:41.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.047190+0000","last_change":"2024-09-17T05:34:33.047190+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.047190+0000","last_undegraded":"2024-09-17T05:34:33.047190+0000","last_fullsized":"2024-09-17T05:34:33.047190+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.063522+0000","last_change":"2024-09-17T05:34:33.061506+0000","last_active":"2024-09-17T05:34:33.063522+0000","last_peered":"2024-09-17T05:34:33.063522+0000","last_clean":"2024-09-17T05:34:33.063522+0000","last_became_active":"2024-09-17T05:34:33.060829+0000","last_became_peered":"2024-09-17T05:34:33.060829+0000","last_unstale":"2024-09-17T05:34:33.063522+0000","last_undegraded":"2024-09-17T05:34:33.063522+0000","last_fullsized":"2024-09-17T05:34:33.063522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:24.118495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.038927+0000","last_change":"2024-09-17T05:34:33.038927+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.038927+0000","last_undegraded":"2024-09-17T05:34:33.038927+0000","last_fullsized":"2024-09-17T05:34:33.038927+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.063924+0000","last_change":"2024-09-17T05:34:33.062761+0000","last_active":"2024-09-17T05:34:33.063924+0000","last_peered":"2024-09-17T05:34:33.063924+0000","last_clean":"2024-09-17T05:34:33.063924+0000","last_became_active":"2024-09-17T05:34:33.062415+0000","last_became_peered":"2024-09-17T05:34:33.062415+0000","last_unstale":"2024-09-17T05:34:33.063924+0000","last_undegraded":"2024-09-17T05:34:33.063924+0000","last_fullsized":"2024-09-17T05:34:33.063924+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:11.993783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.041657+0000","last_change":"2024-09-17T05:34:33.041657+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.041657+0000","last_undegraded":"2024-09-17T05:34:33.041657+0000","last_fullsized":"2024-09-17T05:34:33.041657+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.062980+0000","last_change":"2024-09-17T05:34:33.057749+0000","last_active":"2024-09-17T05:34:33.062980+0000","last_peered":"2024-09-17T05:34:33.062980+0000","last_clean":"2024-09-17T05:34:33.062980+0000","last_became_active":"2024-09-17T05:34:33.057379+0000","last_became_peered":"2024-09-17T05:34:33.057379+0000","last_unstale":"2024-09-17T05:34:33.062980+0000","last_undegraded":"2024-09-17T05:34:33.062980+0000","last_fullsized":"2024-09-17T05:34:33.062980+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:27.542818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.045374+0000","last_change":"2024-09-17T05:34:33.045374+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.045374+0000","last_undegraded":"2024-09-17T05:34:33.045374+0000","last_fullsized":"2024-09-17T05:34:33.045374+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.063284+0000","last_change":"2024-09-17T05:34:33.058494+0000","last_active":"2024-09-17T05:34:33.063284+0000","last_peered":"2024-09-17T05:34:33.063284+0000","last_clean":"2024-09-17T05:34:33.063284+0000","last_became_active":"2024-09-17T05:34:33.057230+0000","last_became_peered":"2024-09-17T05:34:33.057230+0000","last_unstale":"2024-09-17T05:34:33.063284+0000","last_undegraded":"2024-09-17T05:34:33.063284+0000","last_fullsized":"2024-09-17T05:34:33.063284+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:05.766165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.045221+0000","last_change":"2024-09-17T05:34:33.045221+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.045221+0000","last_undegraded":"2024-09-17T05:34:33.045221+0000","last_fullsized":"2024-09-17T05:34:33.045221+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.062293+0000","last_change":"2024-09-17T05:34:33.060390+0000","last_active":"2024-09-17T05:34:33.062293+0000","last_peered":"2024-09-17T05:34:33.062293+0000","last_clean":"2024-09-17T05:34:33.062293+0000","last_became_active":"2024-09-17T05:34:33.059726+0000","last_became_peered":"2024-09-17T05:34:33.059726+0000","last_unstale":"2024-09-17T05:34:33.062293+0000","last_undegraded":"2024-09-17T05:34:33.062293+0000","last_fullsized":"2024-09-17T05:34:33.062293+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:12.781684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.040451+0000","last_change":"2024-09-17T05:34:33.040451+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.040451+0000","last_undegraded":"2024-09-17T05:34:33.040451+0000","last_fullsized":"2024-09-17T05:34:33.040451+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.059296+0000","last_change":"2024-09-17T05:34:33.055033+0000","last_active":"2024-09-17T05:34:33.059296+0000","last_peered":"2024-09-17T05:34:33.059296+0000","last_clean":"2024-09-17T05:34:33.059296+0000","last_became_active":"2024-09-17T05:34:33.053730+0000","last_became_peered":"2024-09-17T05:34:33.053730+0000","last_unstale":"2024-09-17T05:34:33.059296+0000","last_undegraded":"2024-09-17T05:34:33.059296+0000","last_fullsized":"2024-09-17T05:34:33.059296+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:13.100634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.042531+0000","last_change":"2024-09-17T05:34:33.042531+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.042531+0000","last_undegraded":"2024-09-17T05:34:33.042531+0000","last_fullsized":"2024-09-17T05:34:33.042531+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.061636+0000","last_change":"2024-09-17T05:34:33.053229+0000","last_active":"2024-09-17T05:34:33.061636+0000","last_peered":"2024-09-17T05:34:33.061636+0000","last_clean":"2024-09-17T05:34:33.061636+0000","last_became_active":"2024-09-17T05:34:33.052960+0000","last_became_peered":"2024-09-17T05:34:33.052960+0000","last_unstale":"2024-09-17T05:34:33.061636+0000","last_undegraded":"2024-09-17T05:34:33.061636+0000","last_fullsized":"2024-09-17T05:34:33.061636+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:57.298426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.045448+0000","last_change":"2024-09-17T05:34:33.045448+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.045448+0000","last_undegraded":"2024-09-17T05:34:33.045448+0000","last_fullsized":"2024-09-17T05:34:33.045448+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.059127+0000","last_change":"2024-09-17T05:34:33.054751+0000","last_active":"2024-09-17T05:34:33.059127+0000","last_peered":"2024-09-17T05:34:33.059127+0000","last_clean":"2024-09-17T05:34:33.059127+0000","last_became_active":"2024-09-17T05:34:33.054460+0000","last_became_peered":"2024-09-17T05:34:33.054460+0000","last_unstale":"2024-09-17T05:34:33.059127+0000","last_undegraded":"2024-09-17T05:34:33.059127+0000","last_fullsized":"2024-09-17T05:34:33.059127+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:28.590421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.045467+0000","last_change":"2024-09-17T05:34:33.045467+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.045467+0000","last_undegraded":"2024-09-17T05:34:33.045467+0000","last_fullsized":"2024-09-17T05:34:33.045467+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.060636+0000","last_change":"2024-09-17T05:34:33.057015+0000","last_active":"2024-09-17T05:34:33.060636+0000","last_peered":"2024-09-17T05:34:33.060636+0000","last_clean":"2024-09-17T05:34:33.060636+0000","last_became_active":"2024-09-17T05:34:33.056734+0000","last_became_peered":"2024-09-17T05:34:33.056734+0000","last_unstale":"2024-09-17T05:34:33.060636+0000","last_undegraded":"2024-09-17T05:34:33.060636+0000","last_fullsized":"2024-09-17T05:34:33.060636+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:07.870301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.039436+0000","last_change":"2024-09-17T05:34:33.039436+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.039436+0000","last_undegraded":"2024-09-17T05:34:33.039436+0000","last_fullsized":"2024-09-17T05:34:33.039436+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.053597+0000","last_change":"2024-09-17T05:34:33.050723+0000","last_active":"2024-09-17T05:34:33.053597+0000","last_peered":"2024-09-17T05:34:33.053597+0000","last_clean":"2024-09-17T05:34:33.053597+0000","last_became_active":"2024-09-17T05:34:33.050285+0000","last_became_peered":"2024-09-17T05:34:33.050285+0000","last_unstale":"2024-09-17T05:34:33.053597+0000","last_undegraded":"2024-09-17T05:34:33.053597+0000","last_fullsized":"2024-09-17T05:34:33.053597+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:06:17.903431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.045140+0000","last_change":"2024-09-17T05:34:33.045140+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.045140+0000","last_undegraded":"2024-09-17T05:34:33.045140+0000","last_fullsized":"2024-09-17T05:34:33.045140+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.058730+0000","last_change":"2024-09-17T05:34:33.057209+0000","last_active":"2024-09-17T05:34:33.058730+0000","last_peered":"2024-09-17T05:34:33.058730+0000","last_clean":"2024-09-17T05:34:33.058730+0000","last_became_active":"2024-09-17T05:34:33.056797+0000","last_became_peered":"2024-09-17T05:34:33.056797+0000","last_unstale":"2024-09-17T05:34:33.058730+0000","last_undegraded":"2024-09-17T05:34:33.058730+0000","last_fullsized":"2024-09-17T05:34:33.058730+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:58.053728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.047255+0000","last_change":"2024-09-17T05:34:33.047255+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.047255+0000","last_undegraded":"2024-09-17T05:34:33.047255+0000","last_fullsized":"2024-09-17T05:34:33.047255+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.068911+0000","last_change":"2024-09-17T05:34:33.065180+0000","last_active":"2024-09-17T05:34:33.068911+0000","last_peered":"2024-09-17T05:34:33.068911+0000","last_clean":"2024-09-17T05:34:33.068911+0000","last_became_active":"2024-09-17T05:34:33.064968+0000","last_became_peered":"2024-09-17T05:34:33.064968+0000","last_unstale":"2024-09-17T05:34:33.068911+0000","last_undegraded":"2024-09-17T05:34:33.068911+0000","last_fullsized":"2024-09-17T05:34:33.068911+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:30.738747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.048459+0000","last_change":"2024-09-17T05:34:33.048459+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.048459+0000","last_undegraded":"2024-09-17T05:34:33.048459+0000","last_fullsized":"2024-09-17T05:34:33.048459+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.059326+0000","last_change":"2024-09-17T05:34:33.056067+0000","last_active":"2024-09-17T05:34:33.059326+0000","last_peered":"2024-09-17T05:34:33.059326+0000","last_clean":"2024-09-17T05:34:33.059326+0000","last_became_active":"2024-09-17T05:34:33.055790+0000","last_became_peered":"2024-09-17T05:34:33.055790+0000","last_unstale":"2024-09-17T05:34:33.059326+0000","last_undegraded":"2024-09-17T05:34:33.059326+0000","last_fullsized":"2024-09-17T05:34:33.059326+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:59.583119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.041982+0000","last_change":"2024-09-17T05:34:33.041982+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.041982+0000","last_undegraded":"2024-09-17T05:34:33.041982+0000","last_fullsized":"2024-09-17T05:34:33.041982+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.065020+0000","last_change":"2024-09-17T05:34:33.063900+0000","last_active":"2024-09-17T05:34:33.065020+0000","last_peered":"2024-09-17T05:34:33.065020+0000","last_clean":"2024-09-17T05:34:33.065020+0000","last_became_active":"2024-09-17T05:34:33.063632+0000","last_became_peered":"2024-09-17T05:34:33.063632+0000","last_unstale":"2024-09-17T05:34:33.065020+0000","last_undegraded":"2024-09-17T05:34:33.065020+0000","last_fullsized":"2024-09-17T05:34:33.065020+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:50.711042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.038832+0000","last_change":"2024-09-17T05:34:33.038832+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.038832+0000","last_undegraded":"2024-09-17T05:34:33.038832+0000","last_fullsized":"2024-09-17T05:34:33.038832+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.068922+0000","last_change":"2024-09-17T05:34:33.063478+0000","last_active":"2024-09-17T05:34:33.068922+0000","last_peered":"2024-09-17T05:34:33.068922+0000","last_clean":"2024-09-17T05:34:33.068922+0000","last_became_active":"2024-09-17T05:34:33.062829+0000","last_became_peered":"2024-09-17T05:34:33.062829+0000","last_unstale":"2024-09-17T05:34:33.068922+0000","last_undegraded":"2024-09-17T05:34:33.068922+0000","last_fullsized":"2024-09-17T05:34:33.068922+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:09.761160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.045978+0000","last_change":"2024-09-17T05:34:33.045978+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.045978+0000","last_undegraded":"2024-09-17T05:34:33.045978+0000","last_fullsized":"2024-09-17T05:34:33.045978+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.066221+0000","last_change":"2024-09-17T05:34:33.061407+0000","last_active":"2024-09-17T05:34:33.066221+0000","last_peered":"2024-09-17T05:34:33.066221+0000","last_clean":"2024-09-17T05:34:33.066221+0000","last_became_active":"2024-09-17T05:34:33.061107+0000","last_became_peered":"2024-09-17T05:34:33.061107+0000","last_unstale":"2024-09-17T05:34:33.066221+0000","last_undegraded":"2024-09-17T05:34:33.066221+0000","last_fullsized":"2024-09-17T05:34:33.066221+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:12.157711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.039819+0000","last_change":"2024-09-17T05:34:33.039819+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.039819+0000","last_undegraded":"2024-09-17T05:34:33.039819+0000","last_fullsized":"2024-09-17T05:34:33.039819+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.055411+0000","last_change":"2024-09-17T05:34:33.053534+0000","last_active":"2024-09-17T05:34:33.055411+0000","last_peered":"2024-09-17T05:34:33.055411+0000","last_clean":"2024-09-17T05:34:33.055411+0000","last_became_active":"2024-09-17T05:34:33.053241+0000","last_became_peered":"2024-09-17T05:34:33.053241+0000","last_unstale":"2024-09-17T05:34:33.055411+0000","last_undegraded":"2024-09-17T05:34:33.055411+0000","last_fullsized":"2024-09-17T05:34:33.055411+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:19.593849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.040272+0000","last_change":"2024-09-17T05:34:33.040272+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.040272+0000","last_undegraded":"2024-09-17T05:34:33.040272+0000","last_fullsized":"2024-09-17T05:34:33.040272+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.061939+0000","last_change":"2024-09-17T05:34:33.053720+0000","last_active":"2024-09-17T05:34:33.061939+0000","last_peered":"2024-09-17T05:34:33.061939+0000","last_clean":"2024-09-17T05:34:33.061939+0000","last_became_active":"2024-09-17T05:34:33.053422+0000","last_became_peered":"2024-09-17T05:34:33.053422+0000","last_unstale":"2024-09-17T05:34:33.061939+0000","last_undegraded":"2024-09-17T05:34:33.061939+0000","last_fullsized":"2024-09-17T05:34:33.061939+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:04.345899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.044701+0000","last_change":"2024-09-17T05:34:33.044701+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.044701+0000","last_undegraded":"2024-09-17T05:34:33.044701+0000","last_fullsized":"2024-09-17T05:34:33.044701+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.061003+0000","last_change":"2024-09-17T05:34:33.044645+0000","last_active":"2024-09-17T05:34:33.061003+0000","last_peered":"2024-09-17T05:34:33.061003+0000","last_clean":"2024-09-17T05:34:33.061003+0000","last_became_active":"2024-09-17T05:34:33.043462+0000","last_became_peered":"2024-09-17T05:34:33.043462+0000","last_unstale":"2024-09-17T05:34:33.061003+0000","last_undegraded":"2024-09-17T05:34:33.061003+0000","last_fullsized":"2024-09-17T05:34:33.061003+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:09.761160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.047104+0000","last_change":"2024-09-17T05:34:33.047104+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.047104+0000","last_undegraded":"2024-09-17T05:34:33.047104+0000","last_fullsized":"2024-09-17T05:34:33.047104+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.065000+0000","last_change":"2024-09-17T05:34:33.063648+0000","last_active":"2024-09-17T05:34:33.065000+0000","last_peered":"2024-09-17T05:34:33.065000+0000","last_clean":"2024-09-17T05:34:33.065000+0000","last_became_active":"2024-09-17T05:34:33.063359+0000","last_became_peered":"2024-09-17T05:34:33.063359+0000","last_unstale":"2024-09-17T05:34:33.065000+0000","last_undegraded":"2024-09-17T05:34:33.065000+0000","last_fullsized":"2024-09-17T05:34:33.065000+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:37.613384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.039999+0000","last_change":"2024-09-17T05:34:33.039999+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.039999+0000","last_undegraded":"2024-09-17T05:34:33.039999+0000","last_fullsized":"2024-09-17T05:34:33.039999+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.054539+0000","last_change":"2024-09-17T05:34:33.050448+0000","last_active":"2024-09-17T05:34:33.054539+0000","last_peered":"2024-09-17T05:34:33.054539+0000","last_clean":"2024-09-17T05:34:33.054539+0000","last_became_active":"2024-09-17T05:34:33.048788+0000","last_became_peered":"2024-09-17T05:34:33.048788+0000","last_unstale":"2024-09-17T05:34:33.054539+0000","last_undegraded":"2024-09-17T05:34:33.054539+0000","last_fullsized":"2024-09-17T05:34:33.054539+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:37.423267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.040174+0000","last_change":"2024-09-17T05:34:33.040174+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.040174+0000","last_undegraded":"2024-09-17T05:34:33.040174+0000","last_fullsized":"2024-09-17T05:34:33.040174+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.063756+0000","last_change":"2024-09-17T05:34:33.060194+0000","last_active":"2024-09-17T05:34:33.063756+0000","last_peered":"2024-09-17T05:34:33.063756+0000","last_clean":"2024-09-17T05:34:33.063756+0000","last_became_active":"2024-09-17T05:34:33.059578+0000","last_became_peered":"2024-09-17T05:34:33.059578+0000","last_unstale":"2024-09-17T05:34:33.063756+0000","last_undegraded":"2024-09-17T05:34:33.063756+0000","last_fullsized":"2024-09-17T05:34:33.063756+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:22:51.977468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.046836+0000","last_change":"2024-09-17T05:34:33.046836+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.046836+0000","last_undegraded":"2024-09-17T05:34:33.046836+0000","last_fullsized":"2024-09-17T05:34:33.046836+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.060304+0000","last_change":"2024-09-17T05:34:33.058966+0000","last_active":"2024-09-17T05:34:33.060304+0000","last_peered":"2024-09-17T05:34:33.060304+0000","last_clean":"2024-09-17T05:34:33.060304+0000","last_became_active":"2024-09-17T05:34:33.058457+0000","last_became_peered":"2024-09-17T05:34:33.058457+0000","last_unstale":"2024-09-17T05:34:33.060304+0000","last_undegraded":"2024-09-17T05:34:33.060304+0000","last_fullsized":"2024-09-17T05:34:33.060304+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:24.808411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.042931+0000","last_change":"2024-09-17T05:34:33.042931+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.042931+0000","last_undegraded":"2024-09-17T05:34:33.042931+0000","last_fullsized":"2024-09-17T05:34:33.042931+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.063973+0000","last_change":"2024-09-17T05:34:33.059901+0000","last_active":"2024-09-17T05:34:33.063973+0000","last_peered":"2024-09-17T05:34:33.063973+0000","last_clean":"2024-09-17T05:34:33.063973+0000","last_became_active":"2024-09-17T05:34:33.059478+0000","last_became_peered":"2024-09-17T05:34:33.059478+0000","last_unstale":"2024-09-17T05:34:33.063973+0000","last_undegraded":"2024-09-17T05:34:33.063973+0000","last_fullsized":"2024-09-17T05:34:33.063973+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:10.243476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.045334+0000","last_change":"2024-09-17T05:34:33.045334+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.045334+0000","last_undegraded":"2024-09-17T05:34:33.045334+0000","last_fullsized":"2024-09-17T05:34:33.045334+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.063901+0000","last_change":"2024-09-17T05:34:33.061713+0000","last_active":"2024-09-17T05:34:33.063901+0000","last_peered":"2024-09-17T05:34:33.063901+0000","last_clean":"2024-09-17T05:34:33.063901+0000","last_became_active":"2024-09-17T05:34:33.058269+0000","last_became_peered":"2024-09-17T05:34:33.058269+0000","last_unstale":"2024-09-17T05:34:33.063901+0000","last_undegraded":"2024-09-17T05:34:33.063901+0000","last_fullsized":"2024-09-17T05:34:33.063901+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:49.547024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.042082+0000","last_change":"2024-09-17T05:34:33.042082+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.042082+0000","last_undegraded":"2024-09-17T05:34:33.042082+0000","last_fullsized":"2024-09-17T05:34:33.042082+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.069225+0000","last_change":"2024-09-17T05:34:33.066694+0000","last_active":"2024-09-17T05:34:33.069225+0000","last_peered":"2024-09-17T05:34:33.069225+0000","last_clean":"2024-09-17T05:34:33.069225+0000","last_became_active":"2024-09-17T05:34:33.066446+0000","last_became_peered":"2024-09-17T05:34:33.066446+0000","last_unstale":"2024-09-17T05:34:33.069225+0000","last_undegraded":"2024-09-17T05:34:33.069225+0000","last_fullsized":"2024-09-17T05:34:33.069225+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:18.671717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.039957+0000","last_change":"2024-09-17T05:34:33.039957+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.039957+0000","last_undegraded":"2024-09-17T05:34:33.039957+0000","last_fullsized":"2024-09-17T05:34:33.039957+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.062157+0000","last_change":"2024-09-17T05:34:33.053142+0000","last_active":"2024-09-17T05:34:33.062157+0000","last_peered":"2024-09-17T05:34:33.062157+0000","last_clean":"2024-09-17T05:34:33.062157+0000","last_became_active":"2024-09-17T05:34:33.052812+0000","last_became_peered":"2024-09-17T05:34:33.052812+0000","last_unstale":"2024-09-17T05:34:33.062157+0000","last_undegraded":"2024-09-17T05:34:33.062157+0000","last_fullsized":"2024-09-17T05:34:33.062157+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:06.513338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.044802+0000","last_change":"2024-09-17T05:34:33.044802+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.044802+0000","last_undegraded":"2024-09-17T05:34:33.044802+0000","last_fullsized":"2024-09-17T05:34:33.044802+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.062224+0000","last_change":"2024-09-17T05:34:33.055315+0000","last_active":"2024-09-17T05:34:33.062224+0000","last_peered":"2024-09-17T05:34:33.062224+0000","last_clean":"2024-09-17T05:34:33.062224+0000","last_became_active":"2024-09-17T05:34:33.055048+0000","last_became_peered":"2024-09-17T05:34:33.055048+0000","last_unstale":"2024-09-17T05:34:33.062224+0000","last_undegraded":"2024-09-17T05:34:33.062224+0000","last_fullsized":"2024-09-17T05:34:33.062224+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:00.301924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.047729+0000","last_change":"2024-09-17T05:34:33.047729+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.047729+0000","last_undegraded":"2024-09-17T05:34:33.047729+0000","last_fullsized":"2024-09-17T05:34:33.047729+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.063483+0000","last_change":"2024-09-17T05:34:33.058160+0000","last_active":"2024-09-17T05:34:33.063483+0000","last_peered":"2024-09-17T05:34:33.063483+0000","last_clean":"2024-09-17T05:34:33.063483+0000","last_became_active":"2024-09-17T05:34:33.057770+0000","last_became_peered":"2024-09-17T05:34:33.057770+0000","last_unstale":"2024-09-17T05:34:33.063483+0000","last_undegraded":"2024-09-17T05:34:33.063483+0000","last_fullsized":"2024-09-17T05:34:33.063483+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:38.508512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.051003+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:34:33.051003+0000","last_peered":"2024-09-17T05:34:33.051003+0000","last_clean":"2024-09-17T05:34:33.051003+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:34:33.051003+0000","last_undegraded":"2024-09-17T05:34:33.051003+0000","last_fullsized":"2024-09-17T05:34:33.051003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509515,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33140,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338700,"statfs":{"total":96636764160,"available":96602828800,"internally_reserved":0,"allocated":1998848,"data_stored":1204744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1404928,"data_stored":614376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542219,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1404928,"data_stored":614376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1404928,"data_stored":614376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1392640,"data_stored":608073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509516,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1392640,"data_stored":608073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509514,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1404928,"data_stored":614376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542218,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33144,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338696,"statfs":{"total":96636764160,"available":96602824704,"internally_reserved":0,"allocated":1998848,"data_stored":1204744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:34:38.217 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:34:38.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.401+0000 7f7721c00640 1 -- 172.21.15.31:0/4228557794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7700003a10 msgr2=0x7f7700003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:38.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.401+0000 7f7721c00640 1 --2- 172.21.15.31:0/4228557794 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7700003a10 0x7f7700003e30 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f770c005fd0 tx=0x7f770c01cda0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.401+0000 7f771b400640 1 -- 172.21.15.31:0/4228557794 reap_dead start 2024-09-17T05:34:38.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.401+0000 7f7721c00640 1 -- 172.21.15.31:0/4228557794 shutdown_connections 2024-09-17T05:34:38.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.401+0000 7f7721c00640 1 -- 172.21.15.31:0/4228557794 >> 172.21.15.31:0/4228557794 conn(0x7f771c0d1e30 msgr2=0x7f771c0d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:38.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.401+0000 7f7721c00640 1 -- 172.21.15.31:0/4228557794 shutdown_connections 2024-09-17T05:34:38.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.401+0000 7f7721c00640 1 -- 172.21.15.31:0/4228557794 wait complete. 2024-09-17T05:34:38.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f7721c00640 1 Processor -- start 2024-09-17T05:34:38.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f7721c00640 1 -- start start 2024-09-17T05:34:38.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f7721c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7700003a10 0x7f771c0c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:38.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f7721c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f771c0cbfe0 0x7f771c0c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f7721c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f771c0ce0b0 0x7f771c0ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f7721c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f771c0b1e10 con 0x7f771c0ce0b0 2024-09-17T05:34:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f7721c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f771c0b1c90 con 0x7f7700003a10 2024-09-17T05:34:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f7721c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f771c0b1f90 con 0x7f771c0cbfe0 2024-09-17T05:34:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f771b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f771c0ce0b0 0x7f771c0ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f771b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f771c0ce0b0 0x7f771c0ce530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46640/0 (socket says 172.21.15.31:46640) 2024-09-17T05:34:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f771b400640 1 -- 172.21.15.31:0/142703922 learned_addr learned my addr 172.21.15.31:0/142703922 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:38.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f771aa00640 1 --2- 172.21.15.31:0/142703922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7700003a10 0x7f771c0c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f7713e00640 1 --2- 172.21.15.31:0/142703922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f771c0cbfe0 0x7f771c0c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f771b400640 1 -- 172.21.15.31:0/142703922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f771c0cbfe0 msgr2=0x7f771c0c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f771b400640 1 --2- 172.21.15.31:0/142703922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f771c0cbfe0 0x7f771c0c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f771b400640 1 -- 172.21.15.31:0/142703922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7700003a10 msgr2=0x7f771c0c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f771b400640 1 --2- 172.21.15.31:0/142703922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7700003a10 0x7f771c0c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f771b400640 1 -- 172.21.15.31:0/142703922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771c0c8340 con 0x7f771c0ce0b0 2024-09-17T05:34:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f771b400640 1 --2- 172.21.15.31:0/142703922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f771c0ce0b0 0x7f771c0ce530 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f771c09fd70 tx=0x7f7714011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f7712a00640 1 -- 172.21.15.31:0/142703922 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714017070 con 0x7f771c0ce0b0 2024-09-17T05:34:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f7712a00640 1 -- 172.21.15.31:0/142703922 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7714013a50 con 0x7f771c0ce0b0 2024-09-17T05:34:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f7712a00640 1 -- 172.21.15.31:0/142703922 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77140123e0 con 0x7f771c0ce0b0 2024-09-17T05:34:38.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f7721c00640 1 -- 172.21.15.31:0/142703922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771c1f7e70 con 0x7f771c0ce0b0 2024-09-17T05:34:38.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f7721c00640 1 -- 172.21.15.31:0/142703922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f771c1f8430 con 0x7f771c0ce0b0 2024-09-17T05:34:38.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.405+0000 7f7721c00640 1 -- 172.21.15.31:0/142703922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f771c0b1370 con 0x7f771c0ce0b0 2024-09-17T05:34:38.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.409+0000 7f7712a00640 1 -- 172.21.15.31:0/142703922 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f7714012580 con 0x7f771c0ce0b0 2024-09-17T05:34:38.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.409+0000 7f7712a00640 1 --2- 172.21.15.31:0/142703922 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f76f8073680 0x7f76f8075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:38.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.409+0000 7f7712a00640 1 -- 172.21.15.31:0/142703922 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5737+0+0 (secure 0 0 0) 0x7f7714098c10 con 0x7f771c0ce0b0 2024-09-17T05:34:38.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.409+0000 7f771aa00640 1 --2- 172.21.15.31:0/142703922 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f76f8073680 0x7f76f8075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:38.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.409+0000 7f771aa00640 1 --2- 172.21.15.31:0/142703922 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f76f8073680 0x7f76f8075b40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f770c0b0000 tx=0x7f770c0a7040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:38.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.413+0000 7f7712a00640 1 -- 172.21.15.31:0/142703922 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7714063010 con 0x7f771c0ce0b0 2024-09-17T05:34:38.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.585+0000 7f7721c00640 1 -- 172.21.15.31:0/142703922 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f771c070c10 con 0x7f76f8073680 2024-09-17T05:34:38.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.589+0000 7f7712a00640 1 -- 172.21.15.31:0/142703922 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247114 (secure 0 0 0) 0x7f771c070c10 con 0x7f76f8073680 2024-09-17T05:34:38.594 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:38.595 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:34:38.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.593+0000 7f7721c00640 1 -- 172.21.15.31:0/142703922 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f76f8073680 msgr2=0x7f76f8075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:38.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.593+0000 7f7721c00640 1 --2- 172.21.15.31:0/142703922 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f76f8073680 0x7f76f8075b40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f770c0b0000 tx=0x7f770c0a7040 comp rx=0 tx=0).stop 2024-09-17T05:34:38.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.593+0000 7f7721c00640 1 -- 172.21.15.31:0/142703922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f771c0ce0b0 msgr2=0x7f771c0ce530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:38.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.593+0000 7f7721c00640 1 --2- 172.21.15.31:0/142703922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f771c0ce0b0 0x7f771c0ce530 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f771c09fd70 tx=0x7f7714011a10 comp rx=0 tx=0).stop 2024-09-17T05:34:38.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.593+0000 7f7721c00640 1 -- 172.21.15.31:0/142703922 shutdown_connections 2024-09-17T05:34:38.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.593+0000 7f7721c00640 1 --2- 172.21.15.31:0/142703922 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f76f8073680 0x7f76f8075b40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.593+0000 7f7721c00640 1 --2- 172.21.15.31:0/142703922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f771c0ce0b0 0x7f771c0ce530 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.593+0000 7f7721c00640 1 --2- 172.21.15.31:0/142703922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f771c0cbfe0 0x7f771c0c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.593+0000 7f7721c00640 1 --2- 172.21.15.31:0/142703922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7700003a10 0x7f771c0c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.593+0000 7f7721c00640 1 -- 172.21.15.31:0/142703922 >> 172.21.15.31:0/142703922 conn(0x7f771c0d1e30 msgr2=0x7f771c0b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:38.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.593+0000 7f7721c00640 1 -- 172.21.15.31:0/142703922 shutdown_connections 2024-09-17T05:34:38.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.593+0000 7f7721c00640 1 -- 172.21.15.31:0/142703922 wait complete. 2024-09-17T05:34:38.614 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-09-17T05:34:36.724100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261628,"kb_used_data":12112,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713092,"statfs":{"total":773094113280,"available":772826206208,"internally_reserved":0,"allocated":12402688,"data_stored":6083138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.699917"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.042053+0000","last_change":"2024-09-17T05:34:33.042053+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.042053+0000","last_undegraded":"2024-09-17T05:34:33.042053+0000","last_fullsized":"2024-09-17T05:34:33.042053+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.048156+0000","last_change":"2024-09-17T05:34:33.048156+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.048156+0000","last_undegraded":"2024-09-17T05:34:33.048156+0000","last_fullsized":"2024-09-17T05:34:33.048156+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.047881+0000","last_change":"2024-09-17T05:34:33.047881+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.047881+0000","last_undegraded":"2024-09-17T05:34:33.047881+0000","last_fullsized":"2024-09-17T05:34:33.047881+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.042091+0000","last_change":"2024-09-17T05:34:33.042091+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.042091+0000","last_undegraded":"2024-09-17T05:34:33.042091+0000","last_fullsized":"2024-09-17T05:34:33.042091+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.047799+0000","last_change":"2024-09-17T05:34:33.047799+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.047799+0000","last_undegraded":"2024-09-17T05:34:33.047799+0000","last_fullsized":"2024-09-17T05:34:33.047799+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.040014+0000","last_change":"2024-09-17T05:34:33.040014+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.040014+0000","last_undegraded":"2024-09-17T05:34:33.040014+0000","last_fullsized":"2024-09-17T05:34:33.040014+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.040177+0000","last_change":"2024-09-17T05:34:33.040177+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.040177+0000","last_undegraded":"2024-09-17T05:34:33.040177+0000","last_fullsized":"2024-09-17T05:34:33.040177+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.045841+0000","last_change":"2024-09-17T05:34:33.045841+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.045841+0000","last_undegraded":"2024-09-17T05:34:33.045841+0000","last_fullsized":"2024-09-17T05:34:33.045841+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.048526+0000","last_change":"2024-09-17T05:34:33.048526+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.048526+0000","last_undegraded":"2024-09-17T05:34:33.048526+0000","last_fullsized":"2024-09-17T05:34:33.048526+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.047327+0000","last_change":"2024-09-17T05:34:33.047327+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.047327+0000","last_undegraded":"2024-09-17T05:34:33.047327+0000","last_fullsized":"2024-09-17T05:34:33.047327+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.049891+0000","last_change":"2024-09-17T05:34:33.049891+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.049891+0000","last_undegraded":"2024-09-17T05:34:33.049891+0000","last_fullsized":"2024-09-17T05:34:33.049891+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.048126+0000","last_change":"2024-09-17T05:34:33.048126+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.048126+0000","last_undegraded":"2024-09-17T05:34:33.048126+0000","last_fullsized":"2024-09-17T05:34:33.048126+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.042330+0000","last_change":"2024-09-17T05:34:33.042330+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.042330+0000","last_undegraded":"2024-09-17T05:34:33.042330+0000","last_fullsized":"2024-09-17T05:34:33.042330+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.047385+0000","last_change":"2024-09-17T05:34:33.047385+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.047385+0000","last_undegraded":"2024-09-17T05:34:33.047385+0000","last_fullsized":"2024-09-17T05:34:33.047385+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.041335+0000","last_change":"2024-09-17T05:34:33.041335+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.041335+0000","last_undegraded":"2024-09-17T05:34:33.041335+0000","last_fullsized":"2024-09-17T05:34:33.041335+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.045466+0000","last_change":"2024-09-17T05:34:33.045466+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.045466+0000","last_undegraded":"2024-09-17T05:34:33.045466+0000","last_fullsized":"2024-09-17T05:34:33.045466+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.040276+0000","last_change":"2024-09-17T05:34:33.040276+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.040276+0000","last_undegraded":"2024-09-17T05:34:33.040276+0000","last_fullsized":"2024-09-17T05:34:33.040276+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.044988+0000","last_change":"2024-09-17T05:34:33.044988+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.044988+0000","last_undegraded":"2024-09-17T05:34:33.044988+0000","last_fullsized":"2024-09-17T05:34:33.044988+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.049491+0000","last_change":"2024-09-17T05:34:33.049491+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.049491+0000","last_undegraded":"2024-09-17T05:34:33.049491+0000","last_fullsized":"2024-09-17T05:34:33.049491+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.039963+0000","last_change":"2024-09-17T05:34:33.039963+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.039963+0000","last_undegraded":"2024-09-17T05:34:33.039963+0000","last_fullsized":"2024-09-17T05:34:33.039963+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.049575+0000","last_change":"2024-09-17T05:34:33.049575+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.049575+0000","last_undegraded":"2024-09-17T05:34:33.049575+0000","last_fullsized":"2024-09-17T05:34:33.049575+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.048549+0000","last_change":"2024-09-17T05:34:33.048549+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.048549+0000","last_undegraded":"2024-09-17T05:34:33.048549+0000","last_fullsized":"2024-09-17T05:34:33.048549+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.046697+0000","last_change":"2024-09-17T05:34:33.046697+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.046697+0000","last_undegraded":"2024-09-17T05:34:33.046697+0000","last_fullsized":"2024-09-17T05:34:33.046697+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.047224+0000","last_change":"2024-09-17T05:34:33.047224+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.047224+0000","last_undegraded":"2024-09-17T05:34:33.047224+0000","last_fullsized":"2024-09-17T05:34:33.047224+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.046386+0000","last_change":"2024-09-17T05:34:33.046386+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.046386+0000","last_undegraded":"2024-09-17T05:34:33.046386+0000","last_fullsized":"2024-09-17T05:34:33.046386+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.043229+0000","last_change":"2024-09-17T05:34:33.043229+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.043229+0000","last_undegraded":"2024-09-17T05:34:33.043229+0000","last_fullsized":"2024-09-17T05:34:33.043229+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.041165+0000","last_change":"2024-09-17T05:34:33.041165+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.041165+0000","last_undegraded":"2024-09-17T05:34:33.041165+0000","last_fullsized":"2024-09-17T05:34:33.041165+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.042365+0000","last_change":"2024-09-17T05:34:33.042365+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.042365+0000","last_undegraded":"2024-09-17T05:34:33.042365+0000","last_fullsized":"2024-09-17T05:34:33.042365+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.041071+0000","last_change":"2024-09-17T05:34:33.041071+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.041071+0000","last_undegraded":"2024-09-17T05:34:33.041071+0000","last_fullsized":"2024-09-17T05:34:33.041071+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.040283+0000","last_change":"2024-09-17T05:34:33.040283+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.040283+0000","last_undegraded":"2024-09-17T05:34:33.040283+0000","last_fullsized":"2024-09-17T05:34:33.040283+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.046534+0000","last_change":"2024-09-17T05:34:33.046534+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.046534+0000","last_undegraded":"2024-09-17T05:34:33.046534+0000","last_fullsized":"2024-09-17T05:34:33.046534+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.040188+0000","last_change":"2024-09-17T05:34:33.040188+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.040188+0000","last_undegraded":"2024-09-17T05:34:33.040188+0000","last_fullsized":"2024-09-17T05:34:33.040188+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.038860+0000","last_change":"2024-09-17T05:34:33.038860+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.038860+0000","last_undegraded":"2024-09-17T05:34:33.038860+0000","last_fullsized":"2024-09-17T05:34:33.038860+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.063562+0000","last_change":"2024-09-17T05:34:33.060411+0000","last_active":"2024-09-17T05:34:33.063562+0000","last_peered":"2024-09-17T05:34:33.063562+0000","last_clean":"2024-09-17T05:34:33.063562+0000","last_became_active":"2024-09-17T05:34:33.060044+0000","last_became_peered":"2024-09-17T05:34:33.060044+0000","last_unstale":"2024-09-17T05:34:33.063562+0000","last_undegraded":"2024-09-17T05:34:33.063562+0000","last_fullsized":"2024-09-17T05:34:33.063562+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:29.989093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.048089+0000","last_change":"2024-09-17T05:34:33.048089+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.048089+0000","last_undegraded":"2024-09-17T05:34:33.048089+0000","last_fullsized":"2024-09-17T05:34:33.048089+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.066129+0000","last_change":"2024-09-17T05:34:33.062317+0000","last_active":"2024-09-17T05:34:33.066129+0000","last_peered":"2024-09-17T05:34:33.066129+0000","last_clean":"2024-09-17T05:34:33.066129+0000","last_became_active":"2024-09-17T05:34:33.061996+0000","last_became_peered":"2024-09-17T05:34:33.061996+0000","last_unstale":"2024-09-17T05:34:33.066129+0000","last_undegraded":"2024-09-17T05:34:33.066129+0000","last_fullsized":"2024-09-17T05:34:33.066129+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:13.718392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.046499+0000","last_change":"2024-09-17T05:34:33.046499+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.046499+0000","last_undegraded":"2024-09-17T05:34:33.046499+0000","last_fullsized":"2024-09-17T05:34:33.046499+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.064444+0000","last_change":"2024-09-17T05:34:33.062863+0000","last_active":"2024-09-17T05:34:33.064444+0000","last_peered":"2024-09-17T05:34:33.064444+0000","last_clean":"2024-09-17T05:34:33.064444+0000","last_became_active":"2024-09-17T05:34:33.062606+0000","last_became_peered":"2024-09-17T05:34:33.062606+0000","last_unstale":"2024-09-17T05:34:33.064444+0000","last_undegraded":"2024-09-17T05:34:33.064444+0000","last_fullsized":"2024-09-17T05:34:33.064444+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:41.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.047190+0000","last_change":"2024-09-17T05:34:33.047190+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.047190+0000","last_undegraded":"2024-09-17T05:34:33.047190+0000","last_fullsized":"2024-09-17T05:34:33.047190+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.063522+0000","last_change":"2024-09-17T05:34:33.061506+0000","last_active":"2024-09-17T05:34:33.063522+0000","last_peered":"2024-09-17T05:34:33.063522+0000","last_clean":"2024-09-17T05:34:33.063522+0000","last_became_active":"2024-09-17T05:34:33.060829+0000","last_became_peered":"2024-09-17T05:34:33.060829+0000","last_unstale":"2024-09-17T05:34:33.063522+0000","last_undegraded":"2024-09-17T05:34:33.063522+0000","last_fullsized":"2024-09-17T05:34:33.063522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:24.118495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.038927+0000","last_change":"2024-09-17T05:34:33.038927+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.038927+0000","last_undegraded":"2024-09-17T05:34:33.038927+0000","last_fullsized":"2024-09-17T05:34:33.038927+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.063924+0000","last_change":"2024-09-17T05:34:33.062761+0000","last_active":"2024-09-17T05:34:33.063924+0000","last_peered":"2024-09-17T05:34:33.063924+0000","last_clean":"2024-09-17T05:34:33.063924+0000","last_became_active":"2024-09-17T05:34:33.062415+0000","last_became_peered":"2024-09-17T05:34:33.062415+0000","last_unstale":"2024-09-17T05:34:33.063924+0000","last_undegraded":"2024-09-17T05:34:33.063924+0000","last_fullsized":"2024-09-17T05:34:33.063924+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:11.993783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.041657+0000","last_change":"2024-09-17T05:34:33.041657+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.041657+0000","last_undegraded":"2024-09-17T05:34:33.041657+0000","last_fullsized":"2024-09-17T05:34:33.041657+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.062980+0000","last_change":"2024-09-17T05:34:33.057749+0000","last_active":"2024-09-17T05:34:33.062980+0000","last_peered":"2024-09-17T05:34:33.062980+0000","last_clean":"2024-09-17T05:34:33.062980+0000","last_became_active":"2024-09-17T05:34:33.057379+0000","last_became_peered":"2024-09-17T05:34:33.057379+0000","last_unstale":"2024-09-17T05:34:33.062980+0000","last_undegraded":"2024-09-17T05:34:33.062980+0000","last_fullsized":"2024-09-17T05:34:33.062980+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:27.542818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.045374+0000","last_change":"2024-09-17T05:34:33.045374+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.045374+0000","last_undegraded":"2024-09-17T05:34:33.045374+0000","last_fullsized":"2024-09-17T05:34:33.045374+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.063284+0000","last_change":"2024-09-17T05:34:33.058494+0000","last_active":"2024-09-17T05:34:33.063284+0000","last_peered":"2024-09-17T05:34:33.063284+0000","last_clean":"2024-09-17T05:34:33.063284+0000","last_became_active":"2024-09-17T05:34:33.057230+0000","last_became_peered":"2024-09-17T05:34:33.057230+0000","last_unstale":"2024-09-17T05:34:33.063284+0000","last_undegraded":"2024-09-17T05:34:33.063284+0000","last_fullsized":"2024-09-17T05:34:33.063284+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:05.766165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.045221+0000","last_change":"2024-09-17T05:34:33.045221+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.045221+0000","last_undegraded":"2024-09-17T05:34:33.045221+0000","last_fullsized":"2024-09-17T05:34:33.045221+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.062293+0000","last_change":"2024-09-17T05:34:33.060390+0000","last_active":"2024-09-17T05:34:33.062293+0000","last_peered":"2024-09-17T05:34:33.062293+0000","last_clean":"2024-09-17T05:34:33.062293+0000","last_became_active":"2024-09-17T05:34:33.059726+0000","last_became_peered":"2024-09-17T05:34:33.059726+0000","last_unstale":"2024-09-17T05:34:33.062293+0000","last_undegraded":"2024-09-17T05:34:33.062293+0000","last_fullsized":"2024-09-17T05:34:33.062293+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:12.781684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.040451+0000","last_change":"2024-09-17T05:34:33.040451+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.040451+0000","last_undegraded":"2024-09-17T05:34:33.040451+0000","last_fullsized":"2024-09-17T05:34:33.040451+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.059296+0000","last_change":"2024-09-17T05:34:33.055033+0000","last_active":"2024-09-17T05:34:33.059296+0000","last_peered":"2024-09-17T05:34:33.059296+0000","last_clean":"2024-09-17T05:34:33.059296+0000","last_became_active":"2024-09-17T05:34:33.053730+0000","last_became_peered":"2024-09-17T05:34:33.053730+0000","last_unstale":"2024-09-17T05:34:33.059296+0000","last_undegraded":"2024-09-17T05:34:33.059296+0000","last_fullsized":"2024-09-17T05:34:33.059296+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:13.100634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.042531+0000","last_change":"2024-09-17T05:34:33.042531+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.042531+0000","last_undegraded":"2024-09-17T05:34:33.042531+0000","last_fullsized":"2024-09-17T05:34:33.042531+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.061636+0000","last_change":"2024-09-17T05:34:33.053229+0000","last_active":"2024-09-17T05:34:33.061636+0000","last_peered":"2024-09-17T05:34:33.061636+0000","last_clean":"2024-09-17T05:34:33.061636+0000","last_became_active":"2024-09-17T05:34:33.052960+0000","last_became_peered":"2024-09-17T05:34:33.052960+0000","last_unstale":"2024-09-17T05:34:33.061636+0000","last_undegraded":"2024-09-17T05:34:33.061636+0000","last_fullsized":"2024-09-17T05:34:33.061636+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:57.298426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.045448+0000","last_change":"2024-09-17T05:34:33.045448+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.045448+0000","last_undegraded":"2024-09-17T05:34:33.045448+0000","last_fullsized":"2024-09-17T05:34:33.045448+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.059127+0000","last_change":"2024-09-17T05:34:33.054751+0000","last_active":"2024-09-17T05:34:33.059127+0000","last_peered":"2024-09-17T05:34:33.059127+0000","last_clean":"2024-09-17T05:34:33.059127+0000","last_became_active":"2024-09-17T05:34:33.054460+0000","last_became_peered":"2024-09-17T05:34:33.054460+0000","last_unstale":"2024-09-17T05:34:33.059127+0000","last_undegraded":"2024-09-17T05:34:33.059127+0000","last_fullsized":"2024-09-17T05:34:33.059127+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:28.590421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.045467+0000","last_change":"2024-09-17T05:34:33.045467+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.045467+0000","last_undegraded":"2024-09-17T05:34:33.045467+0000","last_fullsized":"2024-09-17T05:34:33.045467+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.060636+0000","last_change":"2024-09-17T05:34:33.057015+0000","last_active":"2024-09-17T05:34:33.060636+0000","last_peered":"2024-09-17T05:34:33.060636+0000","last_clean":"2024-09-17T05:34:33.060636+0000","last_became_active":"2024-09-17T05:34:33.056734+0000","last_became_peered":"2024-09-17T05:34:33.056734+0000","last_unstale":"2024-09-17T05:34:33.060636+0000","last_undegraded":"2024-09-17T05:34:33.060636+0000","last_fullsized":"2024-09-17T05:34:33.060636+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:07.870301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.039436+0000","last_change":"2024-09-17T05:34:33.039436+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.039436+0000","last_undegraded":"2024-09-17T05:34:33.039436+0000","last_fullsized":"2024-09-17T05:34:33.039436+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.053597+0000","last_change":"2024-09-17T05:34:33.050723+0000","last_active":"2024-09-17T05:34:33.053597+0000","last_peered":"2024-09-17T05:34:33.053597+0000","last_clean":"2024-09-17T05:34:33.053597+0000","last_became_active":"2024-09-17T05:34:33.050285+0000","last_became_peered":"2024-09-17T05:34:33.050285+0000","last_unstale":"2024-09-17T05:34:33.053597+0000","last_undegraded":"2024-09-17T05:34:33.053597+0000","last_fullsized":"2024-09-17T05:34:33.053597+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:06:17.903431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.045140+0000","last_change":"2024-09-17T05:34:33.045140+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.045140+0000","last_undegraded":"2024-09-17T05:34:33.045140+0000","last_fullsized":"2024-09-17T05:34:33.045140+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.058730+0000","last_change":"2024-09-17T05:34:33.057209+0000","last_active":"2024-09-17T05:34:33.058730+0000","last_peered":"2024-09-17T05:34:33.058730+0000","last_clean":"2024-09-17T05:34:33.058730+0000","last_became_active":"2024-09-17T05:34:33.056797+0000","last_became_peered":"2024-09-17T05:34:33.056797+0000","last_unstale":"2024-09-17T05:34:33.058730+0000","last_undegraded":"2024-09-17T05:34:33.058730+0000","last_fullsized":"2024-09-17T05:34:33.058730+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:58.053728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.047255+0000","last_change":"2024-09-17T05:34:33.047255+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.047255+0000","last_undegraded":"2024-09-17T05:34:33.047255+0000","last_fullsized":"2024-09-17T05:34:33.047255+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.068911+0000","last_change":"2024-09-17T05:34:33.065180+0000","last_active":"2024-09-17T05:34:33.068911+0000","last_peered":"2024-09-17T05:34:33.068911+0000","last_clean":"2024-09-17T05:34:33.068911+0000","last_became_active":"2024-09-17T05:34:33.064968+0000","last_became_peered":"2024-09-17T05:34:33.064968+0000","last_unstale":"2024-09-17T05:34:33.068911+0000","last_undegraded":"2024-09-17T05:34:33.068911+0000","last_fullsized":"2024-09-17T05:34:33.068911+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:30.738747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.048459+0000","last_change":"2024-09-17T05:34:33.048459+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.048459+0000","last_undegraded":"2024-09-17T05:34:33.048459+0000","last_fullsized":"2024-09-17T05:34:33.048459+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.059326+0000","last_change":"2024-09-17T05:34:33.056067+0000","last_active":"2024-09-17T05:34:33.059326+0000","last_peered":"2024-09-17T05:34:33.059326+0000","last_clean":"2024-09-17T05:34:33.059326+0000","last_became_active":"2024-09-17T05:34:33.055790+0000","last_became_peered":"2024-09-17T05:34:33.055790+0000","last_unstale":"2024-09-17T05:34:33.059326+0000","last_undegraded":"2024-09-17T05:34:33.059326+0000","last_fullsized":"2024-09-17T05:34:33.059326+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:59.583119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.041982+0000","last_change":"2024-09-17T05:34:33.041982+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.041982+0000","last_undegraded":"2024-09-17T05:34:33.041982+0000","last_fullsized":"2024-09-17T05:34:33.041982+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.065020+0000","last_change":"2024-09-17T05:34:33.063900+0000","last_active":"2024-09-17T05:34:33.065020+0000","last_peered":"2024-09-17T05:34:33.065020+0000","last_clean":"2024-09-17T05:34:33.065020+0000","last_became_active":"2024-09-17T05:34:33.063632+0000","last_became_peered":"2024-09-17T05:34:33.063632+0000","last_unstale":"2024-09-17T05:34:33.065020+0000","last_undegraded":"2024-09-17T05:34:33.065020+0000","last_fullsized":"2024-09-17T05:34:33.065020+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:22:50.711042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.038832+0000","last_change":"2024-09-17T05:34:33.038832+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.038832+0000","last_undegraded":"2024-09-17T05:34:33.038832+0000","last_fullsized":"2024-09-17T05:34:33.038832+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.068922+0000","last_change":"2024-09-17T05:34:33.063478+0000","last_active":"2024-09-17T05:34:33.068922+0000","last_peered":"2024-09-17T05:34:33.068922+0000","last_clean":"2024-09-17T05:34:33.068922+0000","last_became_active":"2024-09-17T05:34:33.062829+0000","last_became_peered":"2024-09-17T05:34:33.062829+0000","last_unstale":"2024-09-17T05:34:33.068922+0000","last_undegraded":"2024-09-17T05:34:33.068922+0000","last_fullsized":"2024-09-17T05:34:33.068922+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:09.761160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.045978+0000","last_change":"2024-09-17T05:34:33.045978+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.045978+0000","last_undegraded":"2024-09-17T05:34:33.045978+0000","last_fullsized":"2024-09-17T05:34:33.045978+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.066221+0000","last_change":"2024-09-17T05:34:33.061407+0000","last_active":"2024-09-17T05:34:33.066221+0000","last_peered":"2024-09-17T05:34:33.066221+0000","last_clean":"2024-09-17T05:34:33.066221+0000","last_became_active":"2024-09-17T05:34:33.061107+0000","last_became_peered":"2024-09-17T05:34:33.061107+0000","last_unstale":"2024-09-17T05:34:33.066221+0000","last_undegraded":"2024-09-17T05:34:33.066221+0000","last_fullsized":"2024-09-17T05:34:33.066221+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:12.157711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.039819+0000","last_change":"2024-09-17T05:34:33.039819+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.039819+0000","last_undegraded":"2024-09-17T05:34:33.039819+0000","last_fullsized":"2024-09-17T05:34:33.039819+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.055411+0000","last_change":"2024-09-17T05:34:33.053534+0000","last_active":"2024-09-17T05:34:33.055411+0000","last_peered":"2024-09-17T05:34:33.055411+0000","last_clean":"2024-09-17T05:34:33.055411+0000","last_became_active":"2024-09-17T05:34:33.053241+0000","last_became_peered":"2024-09-17T05:34:33.053241+0000","last_unstale":"2024-09-17T05:34:33.055411+0000","last_undegraded":"2024-09-17T05:34:33.055411+0000","last_fullsized":"2024-09-17T05:34:33.055411+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:18:19.593849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.040272+0000","last_change":"2024-09-17T05:34:33.040272+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.040272+0000","last_undegraded":"2024-09-17T05:34:33.040272+0000","last_fullsized":"2024-09-17T05:34:33.040272+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.061939+0000","last_change":"2024-09-17T05:34:33.053720+0000","last_active":"2024-09-17T05:34:33.061939+0000","last_peered":"2024-09-17T05:34:33.061939+0000","last_clean":"2024-09-17T05:34:33.061939+0000","last_became_active":"2024-09-17T05:34:33.053422+0000","last_became_peered":"2024-09-17T05:34:33.053422+0000","last_unstale":"2024-09-17T05:34:33.061939+0000","last_undegraded":"2024-09-17T05:34:33.061939+0000","last_fullsized":"2024-09-17T05:34:33.061939+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:04.345899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.044701+0000","last_change":"2024-09-17T05:34:33.044701+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.044701+0000","last_undegraded":"2024-09-17T05:34:33.044701+0000","last_fullsized":"2024-09-17T05:34:33.044701+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.061003+0000","last_change":"2024-09-17T05:34:33.044645+0000","last_active":"2024-09-17T05:34:33.061003+0000","last_peered":"2024-09-17T05:34:33.061003+0000","last_clean":"2024-09-17T05:34:33.061003+0000","last_became_active":"2024-09-17T05:34:33.043462+0000","last_became_peered":"2024-09-17T05:34:33.043462+0000","last_unstale":"2024-09-17T05:34:33.061003+0000","last_undegraded":"2024-09-17T05:34:33.061003+0000","last_fullsized":"2024-09-17T05:34:33.061003+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:09.761160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.047104+0000","last_change":"2024-09-17T05:34:33.047104+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.047104+0000","last_undegraded":"2024-09-17T05:34:33.047104+0000","last_fullsized":"2024-09-17T05:34:33.047104+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.065000+0000","last_change":"2024-09-17T05:34:33.063648+0000","last_active":"2024-09-17T05:34:33.065000+0000","last_peered":"2024-09-17T05:34:33.065000+0000","last_clean":"2024-09-17T05:34:33.065000+0000","last_became_active":"2024-09-17T05:34:33.063359+0000","last_became_peered":"2024-09-17T05:34:33.063359+0000","last_unstale":"2024-09-17T05:34:33.065000+0000","last_undegraded":"2024-09-17T05:34:33.065000+0000","last_fullsized":"2024-09-17T05:34:33.065000+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:37.613384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.039999+0000","last_change":"2024-09-17T05:34:33.039999+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.039999+0000","last_undegraded":"2024-09-17T05:34:33.039999+0000","last_fullsized":"2024-09-17T05:34:33.039999+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.054539+0000","last_change":"2024-09-17T05:34:33.050448+0000","last_active":"2024-09-17T05:34:33.054539+0000","last_peered":"2024-09-17T05:34:33.054539+0000","last_clean":"2024-09-17T05:34:33.054539+0000","last_became_active":"2024-09-17T05:34:33.048788+0000","last_became_peered":"2024-09-17T05:34:33.048788+0000","last_unstale":"2024-09-17T05:34:33.054539+0000","last_undegraded":"2024-09-17T05:34:33.054539+0000","last_fullsized":"2024-09-17T05:34:33.054539+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:37.423267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.040174+0000","last_change":"2024-09-17T05:34:33.040174+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.040174+0000","last_undegraded":"2024-09-17T05:34:33.040174+0000","last_fullsized":"2024-09-17T05:34:33.040174+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.063756+0000","last_change":"2024-09-17T05:34:33.060194+0000","last_active":"2024-09-17T05:34:33.063756+0000","last_peered":"2024-09-17T05:34:33.063756+0000","last_clean":"2024-09-17T05:34:33.063756+0000","last_became_active":"2024-09-17T05:34:33.059578+0000","last_became_peered":"2024-09-17T05:34:33.059578+0000","last_unstale":"2024-09-17T05:34:33.063756+0000","last_undegraded":"2024-09-17T05:34:33.063756+0000","last_fullsized":"2024-09-17T05:34:33.063756+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:22:51.977468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.046836+0000","last_change":"2024-09-17T05:34:33.046836+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.046836+0000","last_undegraded":"2024-09-17T05:34:33.046836+0000","last_fullsized":"2024-09-17T05:34:33.046836+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.060304+0000","last_change":"2024-09-17T05:34:33.058966+0000","last_active":"2024-09-17T05:34:33.060304+0000","last_peered":"2024-09-17T05:34:33.060304+0000","last_clean":"2024-09-17T05:34:33.060304+0000","last_became_active":"2024-09-17T05:34:33.058457+0000","last_became_peered":"2024-09-17T05:34:33.058457+0000","last_unstale":"2024-09-17T05:34:33.060304+0000","last_undegraded":"2024-09-17T05:34:33.060304+0000","last_fullsized":"2024-09-17T05:34:33.060304+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:24:24.808411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.042931+0000","last_change":"2024-09-17T05:34:33.042931+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.042931+0000","last_undegraded":"2024-09-17T05:34:33.042931+0000","last_fullsized":"2024-09-17T05:34:33.042931+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.063973+0000","last_change":"2024-09-17T05:34:33.059901+0000","last_active":"2024-09-17T05:34:33.063973+0000","last_peered":"2024-09-17T05:34:33.063973+0000","last_clean":"2024-09-17T05:34:33.063973+0000","last_became_active":"2024-09-17T05:34:33.059478+0000","last_became_peered":"2024-09-17T05:34:33.059478+0000","last_unstale":"2024-09-17T05:34:33.063973+0000","last_undegraded":"2024-09-17T05:34:33.063973+0000","last_fullsized":"2024-09-17T05:34:33.063973+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:10.243476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.045334+0000","last_change":"2024-09-17T05:34:33.045334+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.045334+0000","last_undegraded":"2024-09-17T05:34:33.045334+0000","last_fullsized":"2024-09-17T05:34:33.045334+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.063901+0000","last_change":"2024-09-17T05:34:33.061713+0000","last_active":"2024-09-17T05:34:33.063901+0000","last_peered":"2024-09-17T05:34:33.063901+0000","last_clean":"2024-09-17T05:34:33.063901+0000","last_became_active":"2024-09-17T05:34:33.058269+0000","last_became_peered":"2024-09-17T05:34:33.058269+0000","last_unstale":"2024-09-17T05:34:33.063901+0000","last_undegraded":"2024-09-17T05:34:33.063901+0000","last_fullsized":"2024-09-17T05:34:33.063901+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:49.547024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.042082+0000","last_change":"2024-09-17T05:34:33.042082+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.042082+0000","last_undegraded":"2024-09-17T05:34:33.042082+0000","last_fullsized":"2024-09-17T05:34:33.042082+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.069225+0000","last_change":"2024-09-17T05:34:33.066694+0000","last_active":"2024-09-17T05:34:33.069225+0000","last_peered":"2024-09-17T05:34:33.069225+0000","last_clean":"2024-09-17T05:34:33.069225+0000","last_became_active":"2024-09-17T05:34:33.066446+0000","last_became_peered":"2024-09-17T05:34:33.066446+0000","last_unstale":"2024-09-17T05:34:33.069225+0000","last_undegraded":"2024-09-17T05:34:33.069225+0000","last_fullsized":"2024-09-17T05:34:33.069225+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:18.671717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.039957+0000","last_change":"2024-09-17T05:34:33.039957+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.039957+0000","last_undegraded":"2024-09-17T05:34:33.039957+0000","last_fullsized":"2024-09-17T05:34:33.039957+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.062157+0000","last_change":"2024-09-17T05:34:33.053142+0000","last_active":"2024-09-17T05:34:33.062157+0000","last_peered":"2024-09-17T05:34:33.062157+0000","last_clean":"2024-09-17T05:34:33.062157+0000","last_became_active":"2024-09-17T05:34:33.052812+0000","last_became_peered":"2024-09-17T05:34:33.052812+0000","last_unstale":"2024-09-17T05:34:33.062157+0000","last_undegraded":"2024-09-17T05:34:33.062157+0000","last_fullsized":"2024-09-17T05:34:33.062157+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:06.513338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.044802+0000","last_change":"2024-09-17T05:34:33.044802+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.044802+0000","last_undegraded":"2024-09-17T05:34:33.044802+0000","last_fullsized":"2024-09-17T05:34:33.044802+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.062224+0000","last_change":"2024-09-17T05:34:33.055315+0000","last_active":"2024-09-17T05:34:33.062224+0000","last_peered":"2024-09-17T05:34:33.062224+0000","last_clean":"2024-09-17T05:34:33.062224+0000","last_became_active":"2024-09-17T05:34:33.055048+0000","last_became_peered":"2024-09-17T05:34:33.055048+0000","last_unstale":"2024-09-17T05:34:33.062224+0000","last_undegraded":"2024-09-17T05:34:33.062224+0000","last_fullsized":"2024-09-17T05:34:33.062224+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:29:00.301924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-09-17T05:34:33.047729+0000","last_change":"2024-09-17T05:34:33.047729+0000","last_active":"2024-09-17T05:34:33.022052+0000","last_peered":"2024-09-17T05:34:33.022052+0000","last_clean":"2024-09-17T05:34:33.022052+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:34:33.047729+0000","last_undegraded":"2024-09-17T05:34:33.047729+0000","last_fullsized":"2024-09-17T05:34:33.047729+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.063483+0000","last_change":"2024-09-17T05:34:33.058160+0000","last_active":"2024-09-17T05:34:33.063483+0000","last_peered":"2024-09-17T05:34:33.063483+0000","last_clean":"2024-09-17T05:34:33.063483+0000","last_became_active":"2024-09-17T05:34:33.057770+0000","last_became_peered":"2024-09-17T05:34:33.057770+0000","last_unstale":"2024-09-17T05:34:33.063483+0000","last_undegraded":"2024-09-17T05:34:33.063483+0000","last_fullsized":"2024-09-17T05:34:33.063483+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:38.508512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":307,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T05:34:33.051003+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:34:33.051003+0000","last_peered":"2024-09-17T05:34:33.051003+0000","last_clean":"2024-09-17T05:34:33.051003+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:34:33.051003+0000","last_undegraded":"2024-09-17T05:34:33.051003+0000","last_fullsized":"2024-09-17T05:34:33.051003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509515,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33140,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338700,"statfs":{"total":96636764160,"available":96602828800,"internally_reserved":0,"allocated":1998848,"data_stored":1204744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1404928,"data_stored":614376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542219,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1404928,"data_stored":614376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1404928,"data_stored":614376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1392640,"data_stored":608073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509516,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1392640,"data_stored":608073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509514,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1404928,"data_stored":614376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542218,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33144,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338696,"statfs":{"total":96636764160,"available":96602824704,"internally_reserved":0,"allocated":1998848,"data_stored":1204744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:34:38.618 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:34:38.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.801+0000 7f7c31c00640 1 -- 172.21.15.31:0/2891451215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c10003a60 msgr2=0x7f7c10003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:38.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.801+0000 7f7c31c00640 1 --2- 172.21.15.31:0/2891451215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c10003a60 0x7f7c10003e80 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c006fc0 tx=0x7f7c1c01cf40 comp rx=0 tx=0).stop 2024-09-17T05:34:38.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.801+0000 7f7c2b400640 1 -- 172.21.15.31:0/2891451215 reap_dead start 2024-09-17T05:34:38.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.801+0000 7f7c31c00640 1 -- 172.21.15.31:0/2891451215 shutdown_connections 2024-09-17T05:34:38.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.801+0000 7f7c31c00640 1 -- 172.21.15.31:0/2891451215 >> 172.21.15.31:0/2891451215 conn(0x7f7c2c0d1dc0 msgr2=0x7f7c2c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:38.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.801+0000 7f7c31c00640 1 -- 172.21.15.31:0/2891451215 shutdown_connections 2024-09-17T05:34:38.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.801+0000 7f7c31c00640 1 -- 172.21.15.31:0/2891451215 wait complete. 2024-09-17T05:34:38.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c31c00640 1 Processor -- start 2024-09-17T05:34:38.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c31c00640 1 -- start start 2024-09-17T05:34:38.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c31c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c10003a60 0x7f7c2c0c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:38.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c31c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c2c0cbde0 0x7f7c2c157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:38.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c31c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c2c1f56f0 0x7f7c2c0b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:38.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c31c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c166cf0 con 0x7f7c2c0cbde0 2024-09-17T05:34:38.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c31c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c166b70 con 0x7f7c2c1f56f0 2024-09-17T05:34:38.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c31c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7c2c166e70 con 0x7f7c10003a60 2024-09-17T05:34:38.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c22000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c2c0cbde0 0x7f7c2c157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:38.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c22000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c2c0cbde0 0x7f7c2c157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45394/0 (socket says 172.21.15.31:45394) 2024-09-17T05:34:38.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c22000640 1 -- 172.21.15.31:0/1785869171 learned_addr learned my addr 172.21.15.31:0/1785869171 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:38.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c2b400640 1 --2- 172.21.15.31:0/1785869171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c2c1f56f0 0x7f7c2c0b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:38.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c2aa00640 1 --2- 172.21.15.31:0/1785869171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c10003a60 0x7f7c2c0c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:38.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c22000640 1 -- 172.21.15.31:0/1785869171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c10003a60 msgr2=0x7f7c2c0c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:38.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c22000640 1 --2- 172.21.15.31:0/1785869171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c10003a60 0x7f7c2c0c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c22000640 1 -- 172.21.15.31:0/1785869171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c2c1f56f0 msgr2=0x7f7c2c0b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:38.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c22000640 1 --2- 172.21.15.31:0/1785869171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c2c1f56f0 0x7f7c2c0b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c22000640 1 -- 172.21.15.31:0/1785869171 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2c0cc260 con 0x7f7c2c0cbde0 2024-09-17T05:34:38.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c22000640 1 --2- 172.21.15.31:0/1785869171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c2c0cbde0 0x7f7c2c157db0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400fa00 tx=0x7f7c1400fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:38.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c23400640 1 -- 172.21.15.31:0/1785869171 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1400bcb0 con 0x7f7c2c0cbde0 2024-09-17T05:34:38.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c23400640 1 -- 172.21.15.31:0/1785869171 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c14005020 con 0x7f7c2c0cbde0 2024-09-17T05:34:38.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c23400640 1 -- 172.21.15.31:0/1785869171 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14005410 con 0x7f7c2c0cbde0 2024-09-17T05:34:38.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c31c00640 1 -- 172.21.15.31:0/1785869171 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c2c0c9500 con 0x7f7c2c0cbde0 2024-09-17T05:34:38.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.805+0000 7f7c31c00640 1 -- 172.21.15.31:0/1785869171 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c2c0ca090 con 0x7f7c2c0cbde0 2024-09-17T05:34:38.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.809+0000 7f7c31c00640 1 -- 172.21.15.31:0/1785869171 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c2c0ae9b0 con 0x7f7c2c0cbde0 2024-09-17T05:34:38.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.809+0000 7f7c23400640 1 -- 172.21.15.31:0/1785869171 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f7c14019030 con 0x7f7c2c0cbde0 2024-09-17T05:34:38.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.809+0000 7f7c23400640 1 --2- 172.21.15.31:0/1785869171 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7c08073680 0x7f7c08075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:38.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.809+0000 7f7c23400640 1 -- 172.21.15.31:0/1785869171 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5737+0+0 (secure 0 0 0) 0x7f7c14094d70 con 0x7f7c2c0cbde0 2024-09-17T05:34:38.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.809+0000 7f7c2aa00640 1 --2- 172.21.15.31:0/1785869171 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7c08073680 0x7f7c08075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:38.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.809+0000 7f7c2aa00640 1 --2- 172.21.15.31:0/1785869171 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7c08073680 0x7f7c08075b40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0ab000 tx=0x7f7c1c019d80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:38.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.813+0000 7f7c23400640 1 -- 172.21.15.31:0/1785869171 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7c1405f030 con 0x7f7c2c0cbde0 2024-09-17T05:34:38.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.985+0000 7f7c31c00640 1 -- 172.21.15.31:0/1785869171 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7c2c072680 con 0x7f7c08073680 2024-09-17T05:34:38.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.989+0000 7f7c23400640 1 -- 172.21.15.31:0/1785869171 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252482 (secure 0 0 0) 0x7f7c2c072680 con 0x7f7c08073680 2024-09-17T05:34:38.995 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:38.996 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:34:38.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.993+0000 7f7c31c00640 1 -- 172.21.15.31:0/1785869171 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7c08073680 msgr2=0x7f7c08075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:38.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.993+0000 7f7c31c00640 1 --2- 172.21.15.31:0/1785869171 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7c08073680 0x7f7c08075b40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0ab000 tx=0x7f7c1c019d80 comp rx=0 tx=0).stop 2024-09-17T05:34:38.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.993+0000 7f7c31c00640 1 -- 172.21.15.31:0/1785869171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c2c0cbde0 msgr2=0x7f7c2c157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:38.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.993+0000 7f7c31c00640 1 --2- 172.21.15.31:0/1785869171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c2c0cbde0 0x7f7c2c157db0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400fa00 tx=0x7f7c1400fec0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.993+0000 7f7c31c00640 1 -- 172.21.15.31:0/1785869171 shutdown_connections 2024-09-17T05:34:38.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.993+0000 7f7c31c00640 1 --2- 172.21.15.31:0/1785869171 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7c08073680 0x7f7c08075b40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.993+0000 7f7c31c00640 1 --2- 172.21.15.31:0/1785869171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c2c1f56f0 0x7f7c2c0b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.993+0000 7f7c31c00640 1 --2- 172.21.15.31:0/1785869171 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c2c0cbde0 0x7f7c2c157db0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.993+0000 7f7c31c00640 1 --2- 172.21.15.31:0/1785869171 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c10003a60 0x7f7c2c0c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:38.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.993+0000 7f7c31c00640 1 -- 172.21.15.31:0/1785869171 >> 172.21.15.31:0/1785869171 conn(0x7f7c2c0d1dc0 msgr2=0x7f7c2c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:38.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.993+0000 7f7c31c00640 1 -- 172.21.15.31:0/1785869171 shutdown_connections 2024-09-17T05:34:38.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:38.993+0000 7f7c31c00640 1 -- 172.21.15.31:0/1785869171 wait complete. 2024-09-17T05:34:39.016 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2024-09-17T05:34:38.724411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261924,"kb_used_data":12392,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712796,"statfs":{"total":773094113280,"available":772825903104,"internally_reserved":0,"allocated":12689408,"data_stored":6205612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001071"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055190+0000","last_change":"2024-09-17T05:34:34.055750+0000","last_active":"2024-09-17T05:34:35.055190+0000","last_peered":"2024-09-17T05:34:35.055190+0000","last_clean":"2024-09-17T05:34:35.055190+0000","last_became_active":"2024-09-17T05:34:34.055339+0000","last_became_peered":"2024-09-17T05:34:34.055339+0000","last_unstale":"2024-09-17T05:34:35.055190+0000","last_undegraded":"2024-09-17T05:34:35.055190+0000","last_fullsized":"2024-09-17T05:34:35.055190+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:27.970525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308260+0000","last_change":"2024-09-17T05:34:34.064991+0000","last_active":"2024-09-17T05:34:35.308260+0000","last_peered":"2024-09-17T05:34:35.308260+0000","last_clean":"2024-09-17T05:34:35.308260+0000","last_became_active":"2024-09-17T05:34:34.064734+0000","last_became_peered":"2024-09-17T05:34:34.064734+0000","last_unstale":"2024-09-17T05:34:35.308260+0000","last_undegraded":"2024-09-17T05:34:35.308260+0000","last_fullsized":"2024-09-17T05:34:35.308260+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:35.842002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824914+0000","last_change":"2024-09-17T05:34:34.060826+0000","last_active":"2024-09-17T05:34:35.824914+0000","last_peered":"2024-09-17T05:34:35.824914+0000","last_clean":"2024-09-17T05:34:35.824914+0000","last_became_active":"2024-09-17T05:34:34.060563+0000","last_became_peered":"2024-09-17T05:34:34.060563+0000","last_unstale":"2024-09-17T05:34:35.824914+0000","last_undegraded":"2024-09-17T05:34:35.824914+0000","last_fullsized":"2024-09-17T05:34:35.824914+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:05.356098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.054940+0000","last_change":"2024-09-17T05:34:34.061282+0000","last_active":"2024-09-17T05:34:35.054940+0000","last_peered":"2024-09-17T05:34:35.054940+0000","last_clean":"2024-09-17T05:34:35.054940+0000","last_became_active":"2024-09-17T05:34:34.060977+0000","last_became_peered":"2024-09-17T05:34:34.060977+0000","last_unstale":"2024-09-17T05:34:35.054940+0000","last_undegraded":"2024-09-17T05:34:35.054940+0000","last_fullsized":"2024-09-17T05:34:35.054940+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:01.869217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824356+0000","last_change":"2024-09-17T05:34:34.061319+0000","last_active":"2024-09-17T05:34:35.824356+0000","last_peered":"2024-09-17T05:34:35.824356+0000","last_clean":"2024-09-17T05:34:35.824356+0000","last_became_active":"2024-09-17T05:34:34.061042+0000","last_became_peered":"2024-09-17T05:34:34.061042+0000","last_unstale":"2024-09-17T05:34:35.824356+0000","last_undegraded":"2024-09-17T05:34:35.824356+0000","last_fullsized":"2024-09-17T05:34:35.824356+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:25.323565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060338+0000","last_change":"2024-09-17T05:34:34.064901+0000","last_active":"2024-09-17T05:34:35.060338+0000","last_peered":"2024-09-17T05:34:35.060338+0000","last_clean":"2024-09-17T05:34:35.060338+0000","last_became_active":"2024-09-17T05:34:34.064606+0000","last_became_peered":"2024-09-17T05:34:34.064606+0000","last_unstale":"2024-09-17T05:34:35.060338+0000","last_undegraded":"2024-09-17T05:34:35.060338+0000","last_fullsized":"2024-09-17T05:34:35.060338+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:04.695299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060590+0000","last_change":"2024-09-17T05:34:34.052907+0000","last_active":"2024-09-17T05:34:35.060590+0000","last_peered":"2024-09-17T05:34:35.060590+0000","last_clean":"2024-09-17T05:34:35.060590+0000","last_became_active":"2024-09-17T05:34:34.052142+0000","last_became_peered":"2024-09-17T05:34:34.052142+0000","last_unstale":"2024-09-17T05:34:35.060590+0000","last_undegraded":"2024-09-17T05:34:35.060590+0000","last_fullsized":"2024-09-17T05:34:35.060590+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:44:28.112098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.823875+0000","last_change":"2024-09-17T05:34:34.058597+0000","last_active":"2024-09-17T05:34:35.823875+0000","last_peered":"2024-09-17T05:34:35.823875+0000","last_clean":"2024-09-17T05:34:35.823875+0000","last_became_active":"2024-09-17T05:34:34.057974+0000","last_became_peered":"2024-09-17T05:34:34.057974+0000","last_unstale":"2024-09-17T05:34:35.823875+0000","last_undegraded":"2024-09-17T05:34:35.823875+0000","last_fullsized":"2024-09-17T05:34:35.823875+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:14.563634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824937+0000","last_change":"2024-09-17T05:34:34.060541+0000","last_active":"2024-09-17T05:34:35.824937+0000","last_peered":"2024-09-17T05:34:35.824937+0000","last_clean":"2024-09-17T05:34:35.824937+0000","last_became_active":"2024-09-17T05:34:34.060177+0000","last_became_peered":"2024-09-17T05:34:34.060177+0000","last_unstale":"2024-09-17T05:34:35.824937+0000","last_undegraded":"2024-09-17T05:34:35.824937+0000","last_fullsized":"2024-09-17T05:34:35.824937+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:39.518711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308509+0000","last_change":"2024-09-17T05:34:34.064257+0000","last_active":"2024-09-17T05:34:35.308509+0000","last_peered":"2024-09-17T05:34:35.308509+0000","last_clean":"2024-09-17T05:34:35.308509+0000","last_became_active":"2024-09-17T05:34:34.063921+0000","last_became_peered":"2024-09-17T05:34:34.063921+0000","last_unstale":"2024-09-17T05:34:35.308509+0000","last_undegraded":"2024-09-17T05:34:35.308509+0000","last_fullsized":"2024-09-17T05:34:35.308509+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:02.587125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820409+0000","last_change":"2024-09-17T05:34:34.062319+0000","last_active":"2024-09-17T05:34:35.820409+0000","last_peered":"2024-09-17T05:34:35.820409+0000","last_clean":"2024-09-17T05:34:35.820409+0000","last_became_active":"2024-09-17T05:34:34.061891+0000","last_became_peered":"2024-09-17T05:34:34.061891+0000","last_unstale":"2024-09-17T05:34:35.820409+0000","last_undegraded":"2024-09-17T05:34:35.820409+0000","last_fullsized":"2024-09-17T05:34:35.820409+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:52.704848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824778+0000","last_change":"2024-09-17T05:34:34.069527+0000","last_active":"2024-09-17T05:34:35.824778+0000","last_peered":"2024-09-17T05:34:35.824778+0000","last_clean":"2024-09-17T05:34:35.824778+0000","last_became_active":"2024-09-17T05:34:34.069203+0000","last_became_peered":"2024-09-17T05:34:34.069203+0000","last_unstale":"2024-09-17T05:34:35.824778+0000","last_undegraded":"2024-09-17T05:34:35.824778+0000","last_fullsized":"2024-09-17T05:34:35.824778+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:58.308625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055208+0000","last_change":"2024-09-17T05:34:34.053461+0000","last_active":"2024-09-17T05:34:35.055208+0000","last_peered":"2024-09-17T05:34:35.055208+0000","last_clean":"2024-09-17T05:34:35.055208+0000","last_became_active":"2024-09-17T05:34:34.053150+0000","last_became_peered":"2024-09-17T05:34:34.053150+0000","last_unstale":"2024-09-17T05:34:35.055208+0000","last_undegraded":"2024-09-17T05:34:35.055208+0000","last_fullsized":"2024-09-17T05:34:35.055208+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:25.698259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308120+0000","last_change":"2024-09-17T05:34:34.068063+0000","last_active":"2024-09-17T05:34:35.308120+0000","last_peered":"2024-09-17T05:34:35.308120+0000","last_clean":"2024-09-17T05:34:35.308120+0000","last_became_active":"2024-09-17T05:34:34.067740+0000","last_became_peered":"2024-09-17T05:34:34.067740+0000","last_unstale":"2024-09-17T05:34:35.308120+0000","last_undegraded":"2024-09-17T05:34:35.308120+0000","last_fullsized":"2024-09-17T05:34:35.308120+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:35.468348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.054751+0000","last_change":"2024-09-17T05:34:34.050124+0000","last_active":"2024-09-17T05:34:35.054751+0000","last_peered":"2024-09-17T05:34:35.054751+0000","last_clean":"2024-09-17T05:34:35.054751+0000","last_became_active":"2024-09-17T05:34:34.049793+0000","last_became_peered":"2024-09-17T05:34:34.049793+0000","last_unstale":"2024-09-17T05:34:35.054751+0000","last_undegraded":"2024-09-17T05:34:35.054751+0000","last_fullsized":"2024-09-17T05:34:35.054751+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:14.195829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340889+0000","last_change":"2024-09-17T05:34:34.075280+0000","last_active":"2024-09-17T05:34:35.340889+0000","last_peered":"2024-09-17T05:34:35.340889+0000","last_clean":"2024-09-17T05:34:35.340889+0000","last_became_active":"2024-09-17T05:34:34.074846+0000","last_became_peered":"2024-09-17T05:34:34.074846+0000","last_unstale":"2024-09-17T05:34:35.340889+0000","last_undegraded":"2024-09-17T05:34:35.340889+0000","last_fullsized":"2024-09-17T05:34:35.340889+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:56.401594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060208+0000","last_change":"2024-09-17T05:34:34.062265+0000","last_active":"2024-09-17T05:34:35.060208+0000","last_peered":"2024-09-17T05:34:35.060208+0000","last_clean":"2024-09-17T05:34:35.060208+0000","last_became_active":"2024-09-17T05:34:34.061946+0000","last_became_peered":"2024-09-17T05:34:34.061946+0000","last_unstale":"2024-09-17T05:34:35.060208+0000","last_undegraded":"2024-09-17T05:34:35.060208+0000","last_fullsized":"2024-09-17T05:34:35.060208+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:44.745005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340991+0000","last_change":"2024-09-17T05:34:34.056046+0000","last_active":"2024-09-17T05:34:35.340991+0000","last_peered":"2024-09-17T05:34:35.340991+0000","last_clean":"2024-09-17T05:34:35.340991+0000","last_became_active":"2024-09-17T05:34:34.055395+0000","last_became_peered":"2024-09-17T05:34:34.055395+0000","last_unstale":"2024-09-17T05:34:35.340991+0000","last_undegraded":"2024-09-17T05:34:35.340991+0000","last_fullsized":"2024-09-17T05:34:35.340991+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:24:30.440670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820609+0000","last_change":"2024-09-17T05:34:34.053760+0000","last_active":"2024-09-17T05:34:35.820609+0000","last_peered":"2024-09-17T05:34:35.820609+0000","last_clean":"2024-09-17T05:34:35.820609+0000","last_became_active":"2024-09-17T05:34:34.053404+0000","last_became_peered":"2024-09-17T05:34:34.053404+0000","last_unstale":"2024-09-17T05:34:35.820609+0000","last_undegraded":"2024-09-17T05:34:35.820609+0000","last_fullsized":"2024-09-17T05:34:35.820609+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:00.251054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340917+0000","last_change":"2024-09-17T05:34:34.069933+0000","last_active":"2024-09-17T05:34:35.340917+0000","last_peered":"2024-09-17T05:34:35.340917+0000","last_clean":"2024-09-17T05:34:35.340917+0000","last_became_active":"2024-09-17T05:34:34.069588+0000","last_became_peered":"2024-09-17T05:34:34.069588+0000","last_unstale":"2024-09-17T05:34:35.340917+0000","last_undegraded":"2024-09-17T05:34:35.340917+0000","last_fullsized":"2024-09-17T05:34:35.340917+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:46.802117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824227+0000","last_change":"2024-09-17T05:34:34.060634+0000","last_active":"2024-09-17T05:34:35.824227+0000","last_peered":"2024-09-17T05:34:35.824227+0000","last_clean":"2024-09-17T05:34:35.824227+0000","last_became_active":"2024-09-17T05:34:34.060351+0000","last_became_peered":"2024-09-17T05:34:34.060351+0000","last_unstale":"2024-09-17T05:34:35.824227+0000","last_undegraded":"2024-09-17T05:34:35.824227+0000","last_fullsized":"2024-09-17T05:34:35.824227+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:05.798788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820214+0000","last_change":"2024-09-17T05:34:34.066387+0000","last_active":"2024-09-17T05:34:35.820214+0000","last_peered":"2024-09-17T05:34:35.820214+0000","last_clean":"2024-09-17T05:34:35.820214+0000","last_became_active":"2024-09-17T05:34:34.066139+0000","last_became_peered":"2024-09-17T05:34:34.066139+0000","last_unstale":"2024-09-17T05:34:35.820214+0000","last_undegraded":"2024-09-17T05:34:35.820214+0000","last_fullsized":"2024-09-17T05:34:35.820214+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:31.838964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824485+0000","last_change":"2024-09-17T05:34:34.062062+0000","last_active":"2024-09-17T05:34:35.824485+0000","last_peered":"2024-09-17T05:34:35.824485+0000","last_clean":"2024-09-17T05:34:35.824485+0000","last_became_active":"2024-09-17T05:34:34.059953+0000","last_became_peered":"2024-09-17T05:34:34.059953+0000","last_unstale":"2024-09-17T05:34:35.824485+0000","last_undegraded":"2024-09-17T05:34:35.824485+0000","last_fullsized":"2024-09-17T05:34:35.824485+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:07.523538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820302+0000","last_change":"2024-09-17T05:34:34.057766+0000","last_active":"2024-09-17T05:34:35.820302+0000","last_peered":"2024-09-17T05:34:35.820302+0000","last_clean":"2024-09-17T05:34:35.820302+0000","last_became_active":"2024-09-17T05:34:34.057278+0000","last_became_peered":"2024-09-17T05:34:34.057278+0000","last_unstale":"2024-09-17T05:34:35.820302+0000","last_undegraded":"2024-09-17T05:34:35.820302+0000","last_fullsized":"2024-09-17T05:34:35.820302+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:56.603465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308568+0000","last_change":"2024-09-17T05:34:34.065158+0000","last_active":"2024-09-17T05:34:35.308568+0000","last_peered":"2024-09-17T05:34:35.308568+0000","last_clean":"2024-09-17T05:34:35.308568+0000","last_became_active":"2024-09-17T05:34:34.064854+0000","last_became_peered":"2024-09-17T05:34:34.064854+0000","last_unstale":"2024-09-17T05:34:35.308568+0000","last_undegraded":"2024-09-17T05:34:35.308568+0000","last_fullsized":"2024-09-17T05:34:35.308568+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:33.652582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340978+0000","last_change":"2024-09-17T05:34:34.078814+0000","last_active":"2024-09-17T05:34:35.340978+0000","last_peered":"2024-09-17T05:34:35.340978+0000","last_clean":"2024-09-17T05:34:35.340978+0000","last_became_active":"2024-09-17T05:34:34.077965+0000","last_became_peered":"2024-09-17T05:34:34.077965+0000","last_unstale":"2024-09-17T05:34:35.340978+0000","last_undegraded":"2024-09-17T05:34:35.340978+0000","last_fullsized":"2024-09-17T05:34:35.340978+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:43.780806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.054990+0000","last_change":"2024-09-17T05:34:34.049290+0000","last_active":"2024-09-17T05:34:35.054990+0000","last_peered":"2024-09-17T05:34:35.054990+0000","last_clean":"2024-09-17T05:34:35.054990+0000","last_became_active":"2024-09-17T05:34:34.048975+0000","last_became_peered":"2024-09-17T05:34:34.048975+0000","last_unstale":"2024-09-17T05:34:35.054990+0000","last_undegraded":"2024-09-17T05:34:35.054990+0000","last_fullsized":"2024-09-17T05:34:35.054990+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:59.063927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.059840+0000","last_change":"2024-09-17T05:34:34.053789+0000","last_active":"2024-09-17T05:34:35.059840+0000","last_peered":"2024-09-17T05:34:35.059840+0000","last_clean":"2024-09-17T05:34:35.059840+0000","last_became_active":"2024-09-17T05:34:34.053466+0000","last_became_peered":"2024-09-17T05:34:34.053466+0000","last_unstale":"2024-09-17T05:34:35.059840+0000","last_undegraded":"2024-09-17T05:34:35.059840+0000","last_fullsized":"2024-09-17T05:34:35.059840+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:25.864261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.054977+0000","last_change":"2024-09-17T05:34:34.058615+0000","last_active":"2024-09-17T05:34:35.054977+0000","last_peered":"2024-09-17T05:34:35.054977+0000","last_clean":"2024-09-17T05:34:35.054977+0000","last_became_active":"2024-09-17T05:34:34.058250+0000","last_became_peered":"2024-09-17T05:34:34.058250+0000","last_unstale":"2024-09-17T05:34:35.054977+0000","last_undegraded":"2024-09-17T05:34:35.054977+0000","last_fullsized":"2024-09-17T05:34:35.054977+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:05.508279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055122+0000","last_change":"2024-09-17T05:34:34.050440+0000","last_active":"2024-09-17T05:34:35.055122+0000","last_peered":"2024-09-17T05:34:35.055122+0000","last_clean":"2024-09-17T05:34:35.055122+0000","last_became_active":"2024-09-17T05:34:34.050065+0000","last_became_peered":"2024-09-17T05:34:34.050065+0000","last_unstale":"2024-09-17T05:34:35.055122+0000","last_undegraded":"2024-09-17T05:34:35.055122+0000","last_fullsized":"2024-09-17T05:34:35.055122+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:12.157816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824200+0000","last_change":"2024-09-17T05:34:34.078291+0000","last_active":"2024-09-17T05:34:35.824200+0000","last_peered":"2024-09-17T05:34:35.824200+0000","last_clean":"2024-09-17T05:34:35.824200+0000","last_became_active":"2024-09-17T05:34:34.078014+0000","last_became_peered":"2024-09-17T05:34:34.078014+0000","last_unstale":"2024-09-17T05:34:35.824200+0000","last_undegraded":"2024-09-17T05:34:35.824200+0000","last_fullsized":"2024-09-17T05:34:35.824200+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:04:30.198638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.059792+0000","last_change":"2024-09-17T05:34:34.053475+0000","last_active":"2024-09-17T05:34:35.059792+0000","last_peered":"2024-09-17T05:34:35.059792+0000","last_clean":"2024-09-17T05:34:35.059792+0000","last_became_active":"2024-09-17T05:34:34.053168+0000","last_became_peered":"2024-09-17T05:34:34.053168+0000","last_unstale":"2024-09-17T05:34:35.059792+0000","last_undegraded":"2024-09-17T05:34:35.059792+0000","last_fullsized":"2024-09-17T05:34:35.059792+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:53.847482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.341197+0000","last_change":"2024-09-17T05:34:34.056102+0000","last_active":"2024-09-17T05:34:35.341197+0000","last_peered":"2024-09-17T05:34:35.341197+0000","last_clean":"2024-09-17T05:34:35.341197+0000","last_became_active":"2024-09-17T05:34:34.055779+0000","last_became_peered":"2024-09-17T05:34:34.055779+0000","last_unstale":"2024-09-17T05:34:35.341197+0000","last_undegraded":"2024-09-17T05:34:35.341197+0000","last_fullsized":"2024-09-17T05:34:35.341197+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:58.561334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"114'4","reported_seq":19,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825235+0000","last_change":"2024-09-17T05:34:33.060411+0000","last_active":"2024-09-17T05:34:35.825235+0000","last_peered":"2024-09-17T05:34:35.825235+0000","last_clean":"2024-09-17T05:34:35.825235+0000","last_became_active":"2024-09-17T05:34:33.060044+0000","last_became_peered":"2024-09-17T05:34:33.060044+0000","last_unstale":"2024-09-17T05:34:35.825235+0000","last_undegraded":"2024-09-17T05:34:35.825235+0000","last_fullsized":"2024-09-17T05:34:35.825235+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:18.211934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825046+0000","last_change":"2024-09-17T05:34:34.077842+0000","last_active":"2024-09-17T05:34:35.825046+0000","last_peered":"2024-09-17T05:34:35.825046+0000","last_clean":"2024-09-17T05:34:35.825046+0000","last_became_active":"2024-09-17T05:34:34.077560+0000","last_became_peered":"2024-09-17T05:34:34.077560+0000","last_unstale":"2024-09-17T05:34:35.825046+0000","last_undegraded":"2024-09-17T05:34:35.825046+0000","last_fullsized":"2024-09-17T05:34:35.825046+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:30.999293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060668+0000","last_change":"2024-09-17T05:34:33.062317+0000","last_active":"2024-09-17T05:34:35.060668+0000","last_peered":"2024-09-17T05:34:35.060668+0000","last_clean":"2024-09-17T05:34:35.060668+0000","last_became_active":"2024-09-17T05:34:33.061996+0000","last_became_peered":"2024-09-17T05:34:33.061996+0000","last_unstale":"2024-09-17T05:34:35.060668+0000","last_undegraded":"2024-09-17T05:34:35.060668+0000","last_fullsized":"2024-09-17T05:34:35.060668+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:24.141886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825177+0000","last_change":"2024-09-17T05:34:34.068416+0000","last_active":"2024-09-17T05:34:35.825177+0000","last_peered":"2024-09-17T05:34:35.825177+0000","last_clean":"2024-09-17T05:34:35.825177+0000","last_became_active":"2024-09-17T05:34:34.068076+0000","last_became_peered":"2024-09-17T05:34:34.068076+0000","last_unstale":"2024-09-17T05:34:35.825177+0000","last_undegraded":"2024-09-17T05:34:35.825177+0000","last_fullsized":"2024-09-17T05:34:35.825177+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:22.876201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820554+0000","last_change":"2024-09-17T05:34:33.062863+0000","last_active":"2024-09-17T05:34:35.820554+0000","last_peered":"2024-09-17T05:34:35.820554+0000","last_clean":"2024-09-17T05:34:35.820554+0000","last_became_active":"2024-09-17T05:34:33.062606+0000","last_became_peered":"2024-09-17T05:34:33.062606+0000","last_unstale":"2024-09-17T05:34:35.820554+0000","last_undegraded":"2024-09-17T05:34:35.820554+0000","last_fullsized":"2024-09-17T05:34:35.820554+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:37.910420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825201+0000","last_change":"2024-09-17T05:34:34.072411+0000","last_active":"2024-09-17T05:34:35.825201+0000","last_peered":"2024-09-17T05:34:35.825201+0000","last_clean":"2024-09-17T05:34:35.825201+0000","last_became_active":"2024-09-17T05:34:34.071876+0000","last_became_peered":"2024-09-17T05:34:34.071876+0000","last_unstale":"2024-09-17T05:34:35.825201+0000","last_undegraded":"2024-09-17T05:34:35.825201+0000","last_fullsized":"2024-09-17T05:34:35.825201+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:22.523783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308387+0000","last_change":"2024-09-17T05:34:33.061506+0000","last_active":"2024-09-17T05:34:35.308387+0000","last_peered":"2024-09-17T05:34:35.308387+0000","last_clean":"2024-09-17T05:34:35.308387+0000","last_became_active":"2024-09-17T05:34:33.060829+0000","last_became_peered":"2024-09-17T05:34:33.060829+0000","last_unstale":"2024-09-17T05:34:35.308387+0000","last_undegraded":"2024-09-17T05:34:35.308387+0000","last_fullsized":"2024-09-17T05:34:35.308387+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:01.183566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340894+0000","last_change":"2024-09-17T05:34:34.049231+0000","last_active":"2024-09-17T05:34:35.340894+0000","last_peered":"2024-09-17T05:34:35.340894+0000","last_clean":"2024-09-17T05:34:35.340894+0000","last_became_active":"2024-09-17T05:34:34.048974+0000","last_became_peered":"2024-09-17T05:34:34.048974+0000","last_unstale":"2024-09-17T05:34:35.340894+0000","last_undegraded":"2024-09-17T05:34:35.340894+0000","last_fullsized":"2024-09-17T05:34:35.340894+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:47:19.598707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.307983+0000","last_change":"2024-09-17T05:34:33.062761+0000","last_active":"2024-09-17T05:34:35.307983+0000","last_peered":"2024-09-17T05:34:35.307983+0000","last_clean":"2024-09-17T05:34:35.307983+0000","last_became_active":"2024-09-17T05:34:33.062415+0000","last_became_peered":"2024-09-17T05:34:33.062415+0000","last_unstale":"2024-09-17T05:34:35.307983+0000","last_undegraded":"2024-09-17T05:34:35.307983+0000","last_fullsized":"2024-09-17T05:34:35.307983+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:31.919752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060120+0000","last_change":"2024-09-17T05:34:34.055171+0000","last_active":"2024-09-17T05:34:35.060120+0000","last_peered":"2024-09-17T05:34:35.060120+0000","last_clean":"2024-09-17T05:34:35.060120+0000","last_became_active":"2024-09-17T05:34:34.054552+0000","last_became_peered":"2024-09-17T05:34:34.054552+0000","last_unstale":"2024-09-17T05:34:35.060120+0000","last_undegraded":"2024-09-17T05:34:35.060120+0000","last_fullsized":"2024-09-17T05:34:35.060120+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:50.789978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340608+0000","last_change":"2024-09-17T05:34:33.057749+0000","last_active":"2024-09-17T05:34:35.340608+0000","last_peered":"2024-09-17T05:34:35.340608+0000","last_clean":"2024-09-17T05:34:35.340608+0000","last_became_active":"2024-09-17T05:34:33.057379+0000","last_became_peered":"2024-09-17T05:34:33.057379+0000","last_unstale":"2024-09-17T05:34:35.340608+0000","last_undegraded":"2024-09-17T05:34:35.340608+0000","last_fullsized":"2024-09-17T05:34:35.340608+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:22:51.977468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.823917+0000","last_change":"2024-09-17T05:34:34.058285+0000","last_active":"2024-09-17T05:34:35.823917+0000","last_peered":"2024-09-17T05:34:35.823917+0000","last_clean":"2024-09-17T05:34:35.823917+0000","last_became_active":"2024-09-17T05:34:34.057608+0000","last_became_peered":"2024-09-17T05:34:34.057608+0000","last_unstale":"2024-09-17T05:34:35.823917+0000","last_undegraded":"2024-09-17T05:34:35.823917+0000","last_fullsized":"2024-09-17T05:34:35.823917+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:06.776364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.059760+0000","last_change":"2024-09-17T05:34:33.058494+0000","last_active":"2024-09-17T05:34:35.059760+0000","last_peered":"2024-09-17T05:34:35.059760+0000","last_clean":"2024-09-17T05:34:35.059760+0000","last_became_active":"2024-09-17T05:34:33.057230+0000","last_became_peered":"2024-09-17T05:34:33.057230+0000","last_unstale":"2024-09-17T05:34:35.059760+0000","last_undegraded":"2024-09-17T05:34:35.059760+0000","last_fullsized":"2024-09-17T05:34:35.059760+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:06.513338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308163+0000","last_change":"2024-09-17T05:34:34.064359+0000","last_active":"2024-09-17T05:34:35.308163+0000","last_peered":"2024-09-17T05:34:35.308163+0000","last_clean":"2024-09-17T05:34:35.308163+0000","last_became_active":"2024-09-17T05:34:34.064027+0000","last_became_peered":"2024-09-17T05:34:34.064027+0000","last_unstale":"2024-09-17T05:34:35.308163+0000","last_undegraded":"2024-09-17T05:34:35.308163+0000","last_fullsized":"2024-09-17T05:34:35.308163+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:31.748946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308230+0000","last_change":"2024-09-17T05:34:33.060390+0000","last_active":"2024-09-17T05:34:35.308230+0000","last_peered":"2024-09-17T05:34:35.308230+0000","last_clean":"2024-09-17T05:34:35.308230+0000","last_became_active":"2024-09-17T05:34:33.059726+0000","last_became_peered":"2024-09-17T05:34:33.059726+0000","last_unstale":"2024-09-17T05:34:35.308230+0000","last_undegraded":"2024-09-17T05:34:35.308230+0000","last_fullsized":"2024-09-17T05:34:35.308230+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:00.111980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055526+0000","last_change":"2024-09-17T05:34:34.063038+0000","last_active":"2024-09-17T05:34:35.055526+0000","last_peered":"2024-09-17T05:34:35.055526+0000","last_clean":"2024-09-17T05:34:35.055526+0000","last_became_active":"2024-09-17T05:34:34.062775+0000","last_became_peered":"2024-09-17T05:34:34.062775+0000","last_unstale":"2024-09-17T05:34:35.055526+0000","last_undegraded":"2024-09-17T05:34:35.055526+0000","last_fullsized":"2024-09-17T05:34:35.055526+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:07.115420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.061873+0000","last_change":"2024-09-17T05:34:33.055033+0000","last_active":"2024-09-17T05:34:35.061873+0000","last_peered":"2024-09-17T05:34:35.061873+0000","last_clean":"2024-09-17T05:34:35.061873+0000","last_became_active":"2024-09-17T05:34:33.053730+0000","last_became_peered":"2024-09-17T05:34:33.053730+0000","last_unstale":"2024-09-17T05:34:35.061873+0000","last_undegraded":"2024-09-17T05:34:35.061873+0000","last_fullsized":"2024-09-17T05:34:35.061873+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:45.665453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.061724+0000","last_change":"2024-09-17T05:34:34.055421+0000","last_active":"2024-09-17T05:34:35.061724+0000","last_peered":"2024-09-17T05:34:35.061724+0000","last_clean":"2024-09-17T05:34:35.061724+0000","last_became_active":"2024-09-17T05:34:34.055124+0000","last_became_peered":"2024-09-17T05:34:34.055124+0000","last_unstale":"2024-09-17T05:34:35.061724+0000","last_undegraded":"2024-09-17T05:34:35.061724+0000","last_fullsized":"2024-09-17T05:34:35.061724+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:38.127405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.341138+0000","last_change":"2024-09-17T05:34:33.053229+0000","last_active":"2024-09-17T05:34:35.341138+0000","last_peered":"2024-09-17T05:34:35.341138+0000","last_clean":"2024-09-17T05:34:35.341138+0000","last_became_active":"2024-09-17T05:34:33.052960+0000","last_became_peered":"2024-09-17T05:34:33.052960+0000","last_unstale":"2024-09-17T05:34:35.341138+0000","last_undegraded":"2024-09-17T05:34:35.341138+0000","last_fullsized":"2024-09-17T05:34:35.341138+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:44.853325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825227+0000","last_change":"2024-09-17T05:34:34.067686+0000","last_active":"2024-09-17T05:34:35.825227+0000","last_peered":"2024-09-17T05:34:35.825227+0000","last_clean":"2024-09-17T05:34:35.825227+0000","last_became_active":"2024-09-17T05:34:34.064490+0000","last_became_peered":"2024-09-17T05:34:34.064490+0000","last_unstale":"2024-09-17T05:34:35.825227+0000","last_undegraded":"2024-09-17T05:34:35.825227+0000","last_fullsized":"2024-09-17T05:34:35.825227+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:23.888318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"114'3","reported_seq":18,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060791+0000","last_change":"2024-09-17T05:34:33.054751+0000","last_active":"2024-09-17T05:34:35.060791+0000","last_peered":"2024-09-17T05:34:35.060791+0000","last_clean":"2024-09-17T05:34:35.060791+0000","last_became_active":"2024-09-17T05:34:33.054460+0000","last_became_peered":"2024-09-17T05:34:33.054460+0000","last_unstale":"2024-09-17T05:34:35.060791+0000","last_undegraded":"2024-09-17T05:34:35.060791+0000","last_fullsized":"2024-09-17T05:34:35.060791+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:06:02.019659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825387+0000","last_change":"2024-09-17T05:34:34.063549+0000","last_active":"2024-09-17T05:34:35.825387+0000","last_peered":"2024-09-17T05:34:35.825387+0000","last_clean":"2024-09-17T05:34:35.825387+0000","last_became_active":"2024-09-17T05:34:34.063248+0000","last_became_peered":"2024-09-17T05:34:34.063248+0000","last_unstale":"2024-09-17T05:34:35.825387+0000","last_undegraded":"2024-09-17T05:34:35.825387+0000","last_fullsized":"2024-09-17T05:34:35.825387+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:57.703158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"114'6","reported_seq":21,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824875+0000","last_change":"2024-09-17T05:34:33.057015+0000","last_active":"2024-09-17T05:34:35.824875+0000","last_peered":"2024-09-17T05:34:35.824875+0000","last_clean":"2024-09-17T05:34:35.824875+0000","last_became_active":"2024-09-17T05:34:33.056734+0000","last_became_peered":"2024-09-17T05:34:33.056734+0000","last_unstale":"2024-09-17T05:34:35.824875+0000","last_undegraded":"2024-09-17T05:34:35.824875+0000","last_fullsized":"2024-09-17T05:34:35.824875+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:34.831803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055205+0000","last_change":"2024-09-17T05:34:34.062614+0000","last_active":"2024-09-17T05:34:35.055205+0000","last_peered":"2024-09-17T05:34:35.055205+0000","last_clean":"2024-09-17T05:34:35.055205+0000","last_became_active":"2024-09-17T05:34:34.062249+0000","last_became_peered":"2024-09-17T05:34:34.062249+0000","last_unstale":"2024-09-17T05:34:35.055205+0000","last_undegraded":"2024-09-17T05:34:35.055205+0000","last_fullsized":"2024-09-17T05:34:35.055205+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:00:38.101184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055387+0000","last_change":"2024-09-17T05:34:33.050723+0000","last_active":"2024-09-17T05:34:35.055387+0000","last_peered":"2024-09-17T05:34:35.055387+0000","last_clean":"2024-09-17T05:34:35.055387+0000","last_became_active":"2024-09-17T05:34:33.050285+0000","last_became_peered":"2024-09-17T05:34:33.050285+0000","last_unstale":"2024-09-17T05:34:35.055387+0000","last_undegraded":"2024-09-17T05:34:35.055387+0000","last_fullsized":"2024-09-17T05:34:35.055387+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:29.206583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.307999+0000","last_change":"2024-09-17T05:34:34.072871+0000","last_active":"2024-09-17T05:34:35.307999+0000","last_peered":"2024-09-17T05:34:35.307999+0000","last_clean":"2024-09-17T05:34:35.307999+0000","last_became_active":"2024-09-17T05:34:34.072586+0000","last_became_peered":"2024-09-17T05:34:34.072586+0000","last_unstale":"2024-09-17T05:34:35.307999+0000","last_undegraded":"2024-09-17T05:34:35.307999+0000","last_fullsized":"2024-09-17T05:34:35.307999+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:41.983789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308300+0000","last_change":"2024-09-17T05:34:33.057209+0000","last_active":"2024-09-17T05:34:35.308300+0000","last_peered":"2024-09-17T05:34:35.308300+0000","last_clean":"2024-09-17T05:34:35.308300+0000","last_became_active":"2024-09-17T05:34:33.056797+0000","last_became_peered":"2024-09-17T05:34:33.056797+0000","last_unstale":"2024-09-17T05:34:35.308300+0000","last_undegraded":"2024-09-17T05:34:35.308300+0000","last_fullsized":"2024-09-17T05:34:35.308300+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:19.076711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824265+0000","last_change":"2024-09-17T05:34:34.064005+0000","last_active":"2024-09-17T05:34:35.824265+0000","last_peered":"2024-09-17T05:34:35.824265+0000","last_clean":"2024-09-17T05:34:35.824265+0000","last_became_active":"2024-09-17T05:34:34.060338+0000","last_became_peered":"2024-09-17T05:34:34.060338+0000","last_unstale":"2024-09-17T05:34:35.824265+0000","last_undegraded":"2024-09-17T05:34:35.824265+0000","last_fullsized":"2024-09-17T05:34:35.824265+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:10.771359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"114'8","reported_seq":23,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824069+0000","last_change":"2024-09-17T05:34:33.065180+0000","last_active":"2024-09-17T05:34:35.824069+0000","last_peered":"2024-09-17T05:34:35.824069+0000","last_clean":"2024-09-17T05:34:35.824069+0000","last_became_active":"2024-09-17T05:34:33.064968+0000","last_became_peered":"2024-09-17T05:34:33.064968+0000","last_unstale":"2024-09-17T05:34:35.824069+0000","last_undegraded":"2024-09-17T05:34:35.824069+0000","last_fullsized":"2024-09-17T05:34:35.824069+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:09.728225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824902+0000","last_change":"2024-09-17T05:34:34.070480+0000","last_active":"2024-09-17T05:34:35.824902+0000","last_peered":"2024-09-17T05:34:35.824902+0000","last_clean":"2024-09-17T05:34:35.824902+0000","last_became_active":"2024-09-17T05:34:34.069303+0000","last_became_peered":"2024-09-17T05:34:34.069303+0000","last_unstale":"2024-09-17T05:34:35.824902+0000","last_undegraded":"2024-09-17T05:34:35.824902+0000","last_fullsized":"2024-09-17T05:34:35.824902+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:36.024997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.061928+0000","last_change":"2024-09-17T05:34:33.056067+0000","last_active":"2024-09-17T05:34:35.061928+0000","last_peered":"2024-09-17T05:34:35.061928+0000","last_clean":"2024-09-17T05:34:35.061928+0000","last_became_active":"2024-09-17T05:34:33.055790+0000","last_became_peered":"2024-09-17T05:34:33.055790+0000","last_unstale":"2024-09-17T05:34:35.061928+0000","last_undegraded":"2024-09-17T05:34:35.061928+0000","last_fullsized":"2024-09-17T05:34:35.061928+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:33.135478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.061779+0000","last_change":"2024-09-17T05:34:34.061817+0000","last_active":"2024-09-17T05:34:35.061779+0000","last_peered":"2024-09-17T05:34:35.061779+0000","last_clean":"2024-09-17T05:34:35.061779+0000","last_became_active":"2024-09-17T05:34:34.061394+0000","last_became_peered":"2024-09-17T05:34:34.061394+0000","last_unstale":"2024-09-17T05:34:35.061779+0000","last_undegraded":"2024-09-17T05:34:35.061779+0000","last_fullsized":"2024-09-17T05:34:35.061779+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:21.288618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820430+0000","last_change":"2024-09-17T05:34:33.063900+0000","last_active":"2024-09-17T05:34:35.820430+0000","last_peered":"2024-09-17T05:34:35.820430+0000","last_clean":"2024-09-17T05:34:35.820430+0000","last_became_active":"2024-09-17T05:34:33.063632+0000","last_became_peered":"2024-09-17T05:34:33.063632+0000","last_unstale":"2024-09-17T05:34:35.820430+0000","last_undegraded":"2024-09-17T05:34:35.820430+0000","last_fullsized":"2024-09-17T05:34:35.820430+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:53:26.921272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340985+0000","last_change":"2024-09-17T05:34:34.075935+0000","last_active":"2024-09-17T05:34:35.340985+0000","last_peered":"2024-09-17T05:34:35.340985+0000","last_clean":"2024-09-17T05:34:35.340985+0000","last_became_active":"2024-09-17T05:34:34.074477+0000","last_became_peered":"2024-09-17T05:34:34.074477+0000","last_unstale":"2024-09-17T05:34:35.340985+0000","last_undegraded":"2024-09-17T05:34:35.340985+0000","last_fullsized":"2024-09-17T05:34:35.340985+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:06.767712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060893+0000","last_change":"2024-09-17T05:34:33.063478+0000","last_active":"2024-09-17T05:34:35.060893+0000","last_peered":"2024-09-17T05:34:35.060893+0000","last_clean":"2024-09-17T05:34:35.060893+0000","last_became_active":"2024-09-17T05:34:33.062829+0000","last_became_peered":"2024-09-17T05:34:33.062829+0000","last_unstale":"2024-09-17T05:34:35.060893+0000","last_undegraded":"2024-09-17T05:34:35.060893+0000","last_fullsized":"2024-09-17T05:34:35.060893+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:57.298426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308271+0000","last_change":"2024-09-17T05:34:34.064589+0000","last_active":"2024-09-17T05:34:35.308271+0000","last_peered":"2024-09-17T05:34:35.308271+0000","last_clean":"2024-09-17T05:34:35.308271+0000","last_became_active":"2024-09-17T05:34:34.064291+0000","last_became_peered":"2024-09-17T05:34:34.064291+0000","last_unstale":"2024-09-17T05:34:35.308271+0000","last_undegraded":"2024-09-17T05:34:35.308271+0000","last_fullsized":"2024-09-17T05:34:35.308271+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:10.738424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060239+0000","last_change":"2024-09-17T05:34:33.061407+0000","last_active":"2024-09-17T05:34:35.060239+0000","last_peered":"2024-09-17T05:34:35.060239+0000","last_clean":"2024-09-17T05:34:35.060239+0000","last_became_active":"2024-09-17T05:34:33.061107+0000","last_became_peered":"2024-09-17T05:34:33.061107+0000","last_unstale":"2024-09-17T05:34:35.060239+0000","last_undegraded":"2024-09-17T05:34:35.060239+0000","last_fullsized":"2024-09-17T05:34:35.060239+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:52.128959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055349+0000","last_change":"2024-09-17T05:34:34.048103+0000","last_active":"2024-09-17T05:34:35.055349+0000","last_peered":"2024-09-17T05:34:35.055349+0000","last_clean":"2024-09-17T05:34:35.055349+0000","last_became_active":"2024-09-17T05:34:34.047778+0000","last_became_peered":"2024-09-17T05:34:34.047778+0000","last_unstale":"2024-09-17T05:34:35.055349+0000","last_undegraded":"2024-09-17T05:34:35.055349+0000","last_fullsized":"2024-09-17T05:34:35.055349+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:08.470009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060095+0000","last_change":"2024-09-17T05:34:33.053534+0000","last_active":"2024-09-17T05:34:35.060095+0000","last_peered":"2024-09-17T05:34:35.060095+0000","last_clean":"2024-09-17T05:34:35.060095+0000","last_became_active":"2024-09-17T05:34:33.053241+0000","last_became_peered":"2024-09-17T05:34:33.053241+0000","last_unstale":"2024-09-17T05:34:35.060095+0000","last_undegraded":"2024-09-17T05:34:35.060095+0000","last_fullsized":"2024-09-17T05:34:35.060095+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:11.021007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060369+0000","last_change":"2024-09-17T05:34:34.054874+0000","last_active":"2024-09-17T05:34:35.060369+0000","last_peered":"2024-09-17T05:34:35.060369+0000","last_clean":"2024-09-17T05:34:35.060369+0000","last_became_active":"2024-09-17T05:34:34.054212+0000","last_became_peered":"2024-09-17T05:34:34.054212+0000","last_unstale":"2024-09-17T05:34:35.060369+0000","last_undegraded":"2024-09-17T05:34:35.060369+0000","last_fullsized":"2024-09-17T05:34:35.060369+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:33.184808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340732+0000","last_change":"2024-09-17T05:34:33.053720+0000","last_active":"2024-09-17T05:34:35.340732+0000","last_peered":"2024-09-17T05:34:35.340732+0000","last_clean":"2024-09-17T05:34:35.340732+0000","last_became_active":"2024-09-17T05:34:33.053422+0000","last_became_peered":"2024-09-17T05:34:33.053422+0000","last_unstale":"2024-09-17T05:34:35.340732+0000","last_undegraded":"2024-09-17T05:34:35.340732+0000","last_fullsized":"2024-09-17T05:34:35.340732+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:18.671717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308049+0000","last_change":"2024-09-17T05:34:34.077530+0000","last_active":"2024-09-17T05:34:35.308049+0000","last_peered":"2024-09-17T05:34:35.308049+0000","last_clean":"2024-09-17T05:34:35.308049+0000","last_became_active":"2024-09-17T05:34:34.077169+0000","last_became_peered":"2024-09-17T05:34:34.077169+0000","last_unstale":"2024-09-17T05:34:35.308049+0000","last_undegraded":"2024-09-17T05:34:35.308049+0000","last_fullsized":"2024-09-17T05:34:35.308049+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:52.333720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340564+0000","last_change":"2024-09-17T05:34:33.044645+0000","last_active":"2024-09-17T05:34:35.340564+0000","last_peered":"2024-09-17T05:34:35.340564+0000","last_clean":"2024-09-17T05:34:35.340564+0000","last_became_active":"2024-09-17T05:34:33.043462+0000","last_became_peered":"2024-09-17T05:34:33.043462+0000","last_unstale":"2024-09-17T05:34:35.340564+0000","last_undegraded":"2024-09-17T05:34:35.340564+0000","last_fullsized":"2024-09-17T05:34:35.340564+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:22.412396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824158+0000","last_change":"2024-09-17T05:34:34.078231+0000","last_active":"2024-09-17T05:34:35.824158+0000","last_peered":"2024-09-17T05:34:35.824158+0000","last_clean":"2024-09-17T05:34:35.824158+0000","last_became_active":"2024-09-17T05:34:34.077916+0000","last_became_peered":"2024-09-17T05:34:34.077916+0000","last_unstale":"2024-09-17T05:34:35.824158+0000","last_undegraded":"2024-09-17T05:34:35.824158+0000","last_fullsized":"2024-09-17T05:34:35.824158+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:16:02.059560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820112+0000","last_change":"2024-09-17T05:34:33.063648+0000","last_active":"2024-09-17T05:34:35.820112+0000","last_peered":"2024-09-17T05:34:35.820112+0000","last_clean":"2024-09-17T05:34:35.820112+0000","last_became_active":"2024-09-17T05:34:33.063359+0000","last_became_peered":"2024-09-17T05:34:33.063359+0000","last_unstale":"2024-09-17T05:34:35.820112+0000","last_undegraded":"2024-09-17T05:34:35.820112+0000","last_fullsized":"2024-09-17T05:34:35.820112+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:48.271437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.061260+0000","last_change":"2024-09-17T05:34:34.052351+0000","last_active":"2024-09-17T05:34:35.061260+0000","last_peered":"2024-09-17T05:34:35.061260+0000","last_clean":"2024-09-17T05:34:35.061260+0000","last_became_active":"2024-09-17T05:34:34.051953+0000","last_became_peered":"2024-09-17T05:34:34.051953+0000","last_unstale":"2024-09-17T05:34:35.061260+0000","last_undegraded":"2024-09-17T05:34:35.061260+0000","last_fullsized":"2024-09-17T05:34:35.061260+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:45.007688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055330+0000","last_change":"2024-09-17T05:34:33.050448+0000","last_active":"2024-09-17T05:34:35.055330+0000","last_peered":"2024-09-17T05:34:35.055330+0000","last_clean":"2024-09-17T05:34:35.055330+0000","last_became_active":"2024-09-17T05:34:33.048788+0000","last_became_peered":"2024-09-17T05:34:33.048788+0000","last_unstale":"2024-09-17T05:34:35.055330+0000","last_undegraded":"2024-09-17T05:34:35.055330+0000","last_fullsized":"2024-09-17T05:34:35.055330+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:52.322184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055205+0000","last_change":"2024-09-17T05:34:34.066644+0000","last_active":"2024-09-17T05:34:35.055205+0000","last_peered":"2024-09-17T05:34:35.055205+0000","last_clean":"2024-09-17T05:34:35.055205+0000","last_became_active":"2024-09-17T05:34:34.055068+0000","last_became_peered":"2024-09-17T05:34:34.055068+0000","last_unstale":"2024-09-17T05:34:35.055205+0000","last_undegraded":"2024-09-17T05:34:35.055205+0000","last_fullsized":"2024-09-17T05:34:35.055205+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:50.557224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825072+0000","last_change":"2024-09-17T05:34:33.060194+0000","last_active":"2024-09-17T05:34:35.825072+0000","last_peered":"2024-09-17T05:34:35.825072+0000","last_clean":"2024-09-17T05:34:35.825072+0000","last_became_active":"2024-09-17T05:34:33.059578+0000","last_became_peered":"2024-09-17T05:34:33.059578+0000","last_unstale":"2024-09-17T05:34:35.825072+0000","last_undegraded":"2024-09-17T05:34:35.825072+0000","last_fullsized":"2024-09-17T05:34:35.825072+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:58.774105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308425+0000","last_change":"2024-09-17T05:34:34.066256+0000","last_active":"2024-09-17T05:34:35.308425+0000","last_peered":"2024-09-17T05:34:35.308425+0000","last_clean":"2024-09-17T05:34:35.308425+0000","last_became_active":"2024-09-17T05:34:34.065865+0000","last_became_peered":"2024-09-17T05:34:34.065865+0000","last_unstale":"2024-09-17T05:34:35.308425+0000","last_undegraded":"2024-09-17T05:34:35.308425+0000","last_fullsized":"2024-09-17T05:34:35.308425+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:07.184666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308273+0000","last_change":"2024-09-17T05:34:33.058966+0000","last_active":"2024-09-17T05:34:35.308273+0000","last_peered":"2024-09-17T05:34:35.308273+0000","last_clean":"2024-09-17T05:34:35.308273+0000","last_became_active":"2024-09-17T05:34:33.058457+0000","last_became_peered":"2024-09-17T05:34:33.058457+0000","last_unstale":"2024-09-17T05:34:35.308273+0000","last_undegraded":"2024-09-17T05:34:35.308273+0000","last_fullsized":"2024-09-17T05:34:35.308273+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:32.894237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060736+0000","last_change":"2024-09-17T05:34:34.067228+0000","last_active":"2024-09-17T05:34:35.060736+0000","last_peered":"2024-09-17T05:34:35.060736+0000","last_clean":"2024-09-17T05:34:35.060736+0000","last_became_active":"2024-09-17T05:34:34.066952+0000","last_became_peered":"2024-09-17T05:34:34.066952+0000","last_unstale":"2024-09-17T05:34:35.060736+0000","last_undegraded":"2024-09-17T05:34:35.060736+0000","last_fullsized":"2024-09-17T05:34:35.060736+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:14:18.920767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820173+0000","last_change":"2024-09-17T05:34:33.059901+0000","last_active":"2024-09-17T05:34:35.820173+0000","last_peered":"2024-09-17T05:34:35.820173+0000","last_clean":"2024-09-17T05:34:35.820173+0000","last_became_active":"2024-09-17T05:34:33.059478+0000","last_became_peered":"2024-09-17T05:34:33.059478+0000","last_unstale":"2024-09-17T05:34:35.820173+0000","last_undegraded":"2024-09-17T05:34:35.820173+0000","last_fullsized":"2024-09-17T05:34:35.820173+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:17.994218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824666+0000","last_change":"2024-09-17T05:34:34.059000+0000","last_active":"2024-09-17T05:34:35.824666+0000","last_peered":"2024-09-17T05:34:35.824666+0000","last_clean":"2024-09-17T05:34:35.824666+0000","last_became_active":"2024-09-17T05:34:34.058596+0000","last_became_peered":"2024-09-17T05:34:34.058596+0000","last_unstale":"2024-09-17T05:34:35.824666+0000","last_undegraded":"2024-09-17T05:34:35.824666+0000","last_fullsized":"2024-09-17T05:34:35.824666+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:42.792537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308429+0000","last_change":"2024-09-17T05:34:33.061713+0000","last_active":"2024-09-17T05:34:35.308429+0000","last_peered":"2024-09-17T05:34:35.308429+0000","last_clean":"2024-09-17T05:34:35.308429+0000","last_became_active":"2024-09-17T05:34:33.058269+0000","last_became_peered":"2024-09-17T05:34:33.058269+0000","last_unstale":"2024-09-17T05:34:35.308429+0000","last_undegraded":"2024-09-17T05:34:35.308429+0000","last_fullsized":"2024-09-17T05:34:35.308429+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:41.349784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.059940+0000","last_change":"2024-09-17T05:34:34.066122+0000","last_active":"2024-09-17T05:34:35.059940+0000","last_peered":"2024-09-17T05:34:35.059940+0000","last_clean":"2024-09-17T05:34:35.059940+0000","last_became_active":"2024-09-17T05:34:34.065874+0000","last_became_peered":"2024-09-17T05:34:34.065874+0000","last_unstale":"2024-09-17T05:34:35.059940+0000","last_undegraded":"2024-09-17T05:34:35.059940+0000","last_fullsized":"2024-09-17T05:34:35.059940+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:17.461766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824654+0000","last_change":"2024-09-17T05:34:33.066694+0000","last_active":"2024-09-17T05:34:35.824654+0000","last_peered":"2024-09-17T05:34:35.824654+0000","last_clean":"2024-09-17T05:34:35.824654+0000","last_became_active":"2024-09-17T05:34:33.066446+0000","last_became_peered":"2024-09-17T05:34:33.066446+0000","last_unstale":"2024-09-17T05:34:35.824654+0000","last_undegraded":"2024-09-17T05:34:35.824654+0000","last_fullsized":"2024-09-17T05:34:35.824654+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:44.853325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340784+0000","last_change":"2024-09-17T05:34:34.052402+0000","last_active":"2024-09-17T05:34:35.340784+0000","last_peered":"2024-09-17T05:34:35.340784+0000","last_clean":"2024-09-17T05:34:35.340784+0000","last_became_active":"2024-09-17T05:34:34.051407+0000","last_became_peered":"2024-09-17T05:34:34.051407+0000","last_unstale":"2024-09-17T05:34:35.340784+0000","last_undegraded":"2024-09-17T05:34:35.340784+0000","last_fullsized":"2024-09-17T05:34:35.340784+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:51.254812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340657+0000","last_change":"2024-09-17T05:34:33.053142+0000","last_active":"2024-09-17T05:34:35.340657+0000","last_peered":"2024-09-17T05:34:35.340657+0000","last_clean":"2024-09-17T05:34:35.340657+0000","last_became_active":"2024-09-17T05:34:33.052812+0000","last_became_peered":"2024-09-17T05:34:33.052812+0000","last_unstale":"2024-09-17T05:34:35.340657+0000","last_undegraded":"2024-09-17T05:34:35.340657+0000","last_fullsized":"2024-09-17T05:34:35.340657+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:18.041208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308014+0000","last_change":"2024-09-17T05:34:34.066359+0000","last_active":"2024-09-17T05:34:35.308014+0000","last_peered":"2024-09-17T05:34:35.308014+0000","last_clean":"2024-09-17T05:34:35.308014+0000","last_became_active":"2024-09-17T05:34:34.065935+0000","last_became_peered":"2024-09-17T05:34:34.065935+0000","last_unstale":"2024-09-17T05:34:35.308014+0000","last_undegraded":"2024-09-17T05:34:35.308014+0000","last_fullsized":"2024-09-17T05:34:35.308014+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:08.880501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820256+0000","last_change":"2024-09-17T05:34:33.055315+0000","last_active":"2024-09-17T05:34:35.820256+0000","last_peered":"2024-09-17T05:34:35.820256+0000","last_clean":"2024-09-17T05:34:35.820256+0000","last_became_active":"2024-09-17T05:34:33.055048+0000","last_became_peered":"2024-09-17T05:34:33.055048+0000","last_unstale":"2024-09-17T05:34:35.820256+0000","last_undegraded":"2024-09-17T05:34:35.820256+0000","last_fullsized":"2024-09-17T05:34:35.820256+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:33.090059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824098+0000","last_change":"2024-09-17T05:34:34.079181+0000","last_active":"2024-09-17T05:34:35.824098+0000","last_peered":"2024-09-17T05:34:35.824098+0000","last_clean":"2024-09-17T05:34:35.824098+0000","last_became_active":"2024-09-17T05:34:34.077863+0000","last_became_peered":"2024-09-17T05:34:34.077863+0000","last_unstale":"2024-09-17T05:34:35.824098+0000","last_undegraded":"2024-09-17T05:34:35.824098+0000","last_fullsized":"2024-09-17T05:34:35.824098+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:24:30.440670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824421+0000","last_change":"2024-09-17T05:34:33.058160+0000","last_active":"2024-09-17T05:34:35.824421+0000","last_peered":"2024-09-17T05:34:35.824421+0000","last_clean":"2024-09-17T05:34:35.824421+0000","last_became_active":"2024-09-17T05:34:33.057770+0000","last_became_peered":"2024-09-17T05:34:33.057770+0000","last_unstale":"2024-09-17T05:34:35.824421+0000","last_undegraded":"2024-09-17T05:34:35.824421+0000","last_fullsized":"2024-09-17T05:34:35.824421+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:30.948080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":312,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.823969+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:34:35.823969+0000","last_peered":"2024-09-17T05:34:35.823969+0000","last_clean":"2024-09-17T05:34:35.823969+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:34:35.823969+0000","last_undegraded":"2024-09-17T05:34:35.823969+0000","last_fullsized":"2024-09-17T05:34:35.823969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2048000,"data_stored":1220125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509517,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1441792,"data_stored":629119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542220,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1437696,"data_stored":627619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509517,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1433600,"data_stored":627577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509517,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1437696,"data_stored":627667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509517,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1437696,"data_stored":628123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509515,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1429504,"data_stored":627507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542219,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2023424,"data_stored":1217875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:34:39.019 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:34:39.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.201+0000 7ff442c00640 1 -- 172.21.15.31:0/3058266604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff43c0cede0 msgr2=0x7ff43c15a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:39.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.201+0000 7ff442c00640 1 --2- 172.21.15.31:0/3058266604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff43c0cede0 0x7ff43c15a6d0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7ff428009900 tx=0x7ff42801c8b0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.201+0000 7ff442c00640 1 -- 172.21.15.31:0/3058266604 shutdown_connections 2024-09-17T05:34:39.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.201+0000 7ff442c00640 1 --2- 172.21.15.31:0/3058266604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff43c0cede0 0x7ff43c15a6d0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.201+0000 7ff442c00640 1 --2- 172.21.15.31:0/3058266604 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff43c151020 0x7ff43c0ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.201+0000 7ff442c00640 1 -- 172.21.15.31:0/3058266604 >> 172.21.15.31:0/3058266604 conn(0x7ff43c0b1ff0 msgr2=0x7ff43c0b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:39.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.201+0000 7ff442c00640 1 -- 172.21.15.31:0/3058266604 shutdown_connections 2024-09-17T05:34:39.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.201+0000 7ff442c00640 1 -- 172.21.15.31:0/3058266604 wait complete. 2024-09-17T05:34:39.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff442c00640 1 Processor -- start 2024-09-17T05:34:39.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff442c00640 1 -- start start 2024-09-17T05:34:39.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff442c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff43c0cede0 0x7ff43c1f7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:39.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff442c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff43c151020 0x7ff43c154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff442c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff43c15ac10 0x7ff43c154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff442c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c0cd200 con 0x7ff43c0cede0 2024-09-17T05:34:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff442c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c0cd080 con 0x7ff43c15ac10 2024-09-17T05:34:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff442c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff43c0cd380 con 0x7ff43c151020 2024-09-17T05:34:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff441800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff43c0cede0 0x7ff43c1f7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff441800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff43c0cede0 0x7ff43c1f7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45424/0 (socket says 172.21.15.31:45424) 2024-09-17T05:34:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff441800640 1 -- 172.21.15.31:0/2973175743 learned_addr learned my addr 172.21.15.31:0/2973175743 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff442200640 1 --2- 172.21.15.31:0/2973175743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff43c15ac10 0x7ff43c154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff441800640 1 -- 172.21.15.31:0/2973175743 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff43c151020 msgr2=0x7ff43c154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff441800640 1 --2- 172.21.15.31:0/2973175743 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff43c151020 0x7ff43c154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff441800640 1 -- 172.21.15.31:0/2973175743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff43c15ac10 msgr2=0x7ff43c154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:39.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff441800640 1 --2- 172.21.15.31:0/2973175743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff43c15ac10 0x7ff43c154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff441800640 1 -- 172.21.15.31:0/2973175743 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c155750 con 0x7ff43c0cede0 2024-09-17T05:34:39.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff442200640 1 --2- 172.21.15.31:0/2973175743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff43c15ac10 0x7ff43c154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:34:39.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff441800640 1 --2- 172.21.15.31:0/2973175743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff43c0cede0 0x7ff43c1f7f70 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7ff43000eac0 tx=0x7ff43000ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:39.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff439600640 1 -- 172.21.15.31:0/2973175743 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43001b070 con 0x7ff43c0cede0 2024-09-17T05:34:39.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff439600640 1 -- 172.21.15.31:0/2973175743 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff43000ce30 con 0x7ff43c0cede0 2024-09-17T05:34:39.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff439600640 1 -- 172.21.15.31:0/2973175743 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff430016650 con 0x7ff43c0cede0 2024-09-17T05:34:39.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff442c00640 1 -- 172.21.15.31:0/2973175743 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff43c155a30 con 0x7ff43c0cede0 2024-09-17T05:34:39.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.205+0000 7ff442c00640 1 -- 172.21.15.31:0/2973175743 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff43c1f7a70 con 0x7ff43c0cede0 2024-09-17T05:34:39.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.209+0000 7ff442c00640 1 -- 172.21.15.31:0/2973175743 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff43c15a6d0 con 0x7ff43c0cede0 2024-09-17T05:34:39.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.209+0000 7ff439600640 1 -- 172.21.15.31:0/2973175743 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7ff43001e070 con 0x7ff43c0cede0 2024-09-17T05:34:39.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.209+0000 7ff439600640 1 --2- 172.21.15.31:0/2973175743 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff41c073680 0x7ff41c075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:39.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.209+0000 7ff439600640 1 -- 172.21.15.31:0/2973175743 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5737+0+0 (secure 0 0 0) 0x7ff430094e80 con 0x7ff43c0cede0 2024-09-17T05:34:39.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.209+0000 7ff440e00640 1 --2- 172.21.15.31:0/2973175743 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff41c073680 0x7ff41c075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:39.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.209+0000 7ff440e00640 1 --2- 172.21.15.31:0/2973175743 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff41c073680 0x7ff41c075b40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff4280af000 tx=0x7ff428019650 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:39.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.213+0000 7ff439600640 1 -- 172.21.15.31:0/2973175743 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff43005f0c0 con 0x7ff43c0cede0 2024-09-17T05:34:39.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.453+0000 7ff442c00640 1 -- 172.21.15.31:0/2973175743 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff43c15a9b0 con 0x7ff43c0cede0 2024-09-17T05:34:39.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.453+0000 7ff439600640 1 -- 172.21.15.31:0/2973175743 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1605 (secure 0 0 0) 0x7ff430063af0 con 0x7ff43c0cede0 2024-09-17T05:34:39.455 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:39.455 INFO:teuthology.orchestra.run.smithi031.stdout:{"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":379,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":115,"num_osds":8,"num_up_osds":8,"osd_up_since":1726550913,"num_in_osds":8,"osd_in_since":1726550903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":268210176,"bytes_avail":772825903104,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":81,"btime":"2024-09-17T05:34:37:062019+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":7416}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2024-09-17T05:33:48.714041+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T05:34:39.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.453+0000 7ff442c00640 1 -- 172.21.15.31:0/2973175743 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff41c073680 msgr2=0x7ff41c075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:39.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.453+0000 7ff442c00640 1 --2- 172.21.15.31:0/2973175743 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff41c073680 0x7ff41c075b40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff4280af000 tx=0x7ff428019650 comp rx=0 tx=0).stop 2024-09-17T05:34:39.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.453+0000 7ff442c00640 1 -- 172.21.15.31:0/2973175743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff43c0cede0 msgr2=0x7ff43c1f7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:39.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.453+0000 7ff442c00640 1 --2- 172.21.15.31:0/2973175743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff43c0cede0 0x7ff43c1f7f70 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7ff43000eac0 tx=0x7ff43000ef80 comp rx=0 tx=0).stop 2024-09-17T05:34:39.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.453+0000 7ff442c00640 1 -- 172.21.15.31:0/2973175743 shutdown_connections 2024-09-17T05:34:39.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.453+0000 7ff442c00640 1 --2- 172.21.15.31:0/2973175743 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff41c073680 0x7ff41c075b40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.453+0000 7ff442c00640 1 --2- 172.21.15.31:0/2973175743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff43c15ac10 0x7ff43c154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.453+0000 7ff442c00640 1 --2- 172.21.15.31:0/2973175743 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff43c151020 0x7ff43c154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.453+0000 7ff442c00640 1 --2- 172.21.15.31:0/2973175743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff43c0cede0 0x7ff43c1f7f70 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.453+0000 7ff442c00640 1 -- 172.21.15.31:0/2973175743 >> 172.21.15.31:0/2973175743 conn(0x7ff43c0b1ff0 msgr2=0x7ff43c0b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:39.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.453+0000 7ff442c00640 1 -- 172.21.15.31:0/2973175743 shutdown_connections 2024-09-17T05:34:39.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.453+0000 7ff442c00640 1 -- 172.21.15.31:0/2973175743 wait complete. 2024-09-17T05:34:39.477 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:34:39.477 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:34:39.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.621+0000 7fa405000640 1 -- 172.21.15.31:0/207927176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa40015bb90 msgr2=0x7fa40015f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:39.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.621+0000 7fa405000640 1 --2- 172.21.15.31:0/207927176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa40015bb90 0x7fa40015f960 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fa4000cf850 tx=0x7fa3f001c8c0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.621+0000 7fa405000640 1 -- 172.21.15.31:0/207927176 shutdown_connections 2024-09-17T05:34:39.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.621+0000 7fa405000640 1 --2- 172.21.15.31:0/207927176 >> v2:172.21.15.155:3300/0 conn(0x7fa40015bf70 0x7fa4000b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.621+0000 7fa405000640 1 --2- 172.21.15.31:0/207927176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa40015bb90 0x7fa40015f960 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.621+0000 7fa405000640 1 -- 172.21.15.31:0/207927176 >> 172.21.15.31:0/207927176 conn(0x7fa4000d1d90 msgr2=0x7fa4000d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:39.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.621+0000 7fa405000640 1 -- 172.21.15.31:0/207927176 shutdown_connections 2024-09-17T05:34:39.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.621+0000 7fa405000640 1 -- 172.21.15.31:0/207927176 wait complete. 2024-09-17T05:34:39.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.621+0000 7fa405000640 1 Processor -- start 2024-09-17T05:34:39.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.621+0000 7fa405000640 1 -- start start 2024-09-17T05:34:39.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa405000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4000d2940 0x7fa4001fbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:39.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa405000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa40015bb90 0x7fa4000c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:39.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa405000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa40015bf70 0x7fa400071260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:39.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa405000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa400168ca0 con 0x7fa40015bb90 2024-09-17T05:34:39.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa405000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa4000b66a0 con 0x7fa40015bf70 2024-09-17T05:34:39.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa405000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa400168e20 con 0x7fa4000d2940 2024-09-17T05:34:39.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa3f7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa40015bb90 0x7fa4000c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:39.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa3f7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa40015bb90 0x7fa4000c6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45448/0 (socket says 172.21.15.31:45448) 2024-09-17T05:34:39.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa3f7e00640 1 -- 172.21.15.31:0/2177839374 learned_addr learned my addr 172.21.15.31:0/2177839374 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:39.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa3fe800640 1 --2- 172.21.15.31:0/2177839374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa40015bf70 0x7fa400071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:39.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa3fde00640 1 --2- 172.21.15.31:0/2177839374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4000d2940 0x7fa4001fbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:39.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa3f7e00640 1 -- 172.21.15.31:0/2177839374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4000d2940 msgr2=0x7fa4001fbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:39.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa3f7e00640 1 --2- 172.21.15.31:0/2177839374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4000d2940 0x7fa4001fbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa3f7e00640 1 -- 172.21.15.31:0/2177839374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa40015bf70 msgr2=0x7fa400071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:39.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa3f7e00640 1 --2- 172.21.15.31:0/2177839374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa40015bf70 0x7fa400071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa3f7e00640 1 -- 172.21.15.31:0/2177839374 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa400071cb0 con 0x7fa40015bb90 2024-09-17T05:34:39.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa3fe800640 1 --2- 172.21.15.31:0/2177839374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa40015bf70 0x7fa400071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:39.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa3f7e00640 1 --2- 172.21.15.31:0/2177839374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa40015bb90 0x7fa4000c6e40 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800c500 tx=0x7fa3e800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:39.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa3f6000640 1 -- 172.21.15.31:0/2177839374 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8017070 con 0x7fa40015bb90 2024-09-17T05:34:39.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa3f6000640 1 -- 172.21.15.31:0/2177839374 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3e8003600 con 0x7fa40015bb90 2024-09-17T05:34:39.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa3f6000640 1 -- 172.21.15.31:0/2177839374 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8003a90 con 0x7fa40015bb90 2024-09-17T05:34:39.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa405000640 1 -- 172.21.15.31:0/2177839374 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa400071f90 con 0x7fa40015bb90 2024-09-17T05:34:39.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa405000640 1 -- 172.21.15.31:0/2177839374 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4001fb390 con 0x7fa40015bb90 2024-09-17T05:34:39.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa405000640 1 -- 172.21.15.31:0/2177839374 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4000b53e0 con 0x7fa40015bb90 2024-09-17T05:34:39.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.625+0000 7fa3f6000640 1 -- 172.21.15.31:0/2177839374 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7fa3e801a070 con 0x7fa40015bb90 2024-09-17T05:34:39.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.629+0000 7fa3f6000640 1 --2- 172.21.15.31:0/2177839374 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa3dc073680 0x7fa3dc075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:39.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.629+0000 7fa3f6000640 1 -- 172.21.15.31:0/2177839374 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5737+0+0 (secure 0 0 0) 0x7fa3e8093f00 con 0x7fa40015bb90 2024-09-17T05:34:39.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.629+0000 7fa3fde00640 1 --2- 172.21.15.31:0/2177839374 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa3dc073680 0x7fa3dc075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:39.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.629+0000 7fa3fde00640 1 --2- 172.21.15.31:0/2177839374 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa3dc073680 0x7fa3dc075b40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00af000 tx=0x7fa3f001b100 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:39.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.633+0000 7fa3f6000640 1 -- 172.21.15.31:0/2177839374 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa3e805e280 con 0x7fa40015bb90 2024-09-17T05:34:39.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.801+0000 7fa405000640 1 -- 172.21.15.31:0/2177839374 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa400070270 con 0x7fa3dc073680 2024-09-17T05:34:39.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.805+0000 7fa3f6000640 1 -- 172.21.15.31:0/2177839374 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252482 (secure 0 0 0) 0x7fa400070270 con 0x7fa3dc073680 2024-09-17T05:34:39.811 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:39.813 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:34:39.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.809+0000 7fa405000640 1 -- 172.21.15.31:0/2177839374 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa3dc073680 msgr2=0x7fa3dc075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:39.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.809+0000 7fa405000640 1 --2- 172.21.15.31:0/2177839374 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa3dc073680 0x7fa3dc075b40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00af000 tx=0x7fa3f001b100 comp rx=0 tx=0).stop 2024-09-17T05:34:39.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.809+0000 7fa405000640 1 -- 172.21.15.31:0/2177839374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa40015bb90 msgr2=0x7fa4000c6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:39.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.809+0000 7fa405000640 1 --2- 172.21.15.31:0/2177839374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa40015bb90 0x7fa4000c6e40 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800c500 tx=0x7fa3e800c9c0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.809+0000 7fa405000640 1 -- 172.21.15.31:0/2177839374 shutdown_connections 2024-09-17T05:34:39.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.809+0000 7fa405000640 1 --2- 172.21.15.31:0/2177839374 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa3dc073680 0x7fa3dc075b40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.809+0000 7fa405000640 1 --2- 172.21.15.31:0/2177839374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa40015bf70 0x7fa400071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.809+0000 7fa405000640 1 --2- 172.21.15.31:0/2177839374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa40015bb90 0x7fa4000c6e40 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.809+0000 7fa405000640 1 --2- 172.21.15.31:0/2177839374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4000d2940 0x7fa4001fbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:39.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.809+0000 7fa405000640 1 -- 172.21.15.31:0/2177839374 >> 172.21.15.31:0/2177839374 conn(0x7fa4000d1d90 msgr2=0x7fa4000b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:39.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.809+0000 7fa405000640 1 -- 172.21.15.31:0/2177839374 shutdown_connections 2024-09-17T05:34:39.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:39.809+0000 7fa405000640 1 -- 172.21.15.31:0/2177839374 wait complete. 2024-09-17T05:34:39.833 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2024-09-17T05:34:38.724411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261924,"kb_used_data":12392,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712796,"statfs":{"total":773094113280,"available":772825903104,"internally_reserved":0,"allocated":12689408,"data_stored":6205612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001071"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055190+0000","last_change":"2024-09-17T05:34:34.055750+0000","last_active":"2024-09-17T05:34:35.055190+0000","last_peered":"2024-09-17T05:34:35.055190+0000","last_clean":"2024-09-17T05:34:35.055190+0000","last_became_active":"2024-09-17T05:34:34.055339+0000","last_became_peered":"2024-09-17T05:34:34.055339+0000","last_unstale":"2024-09-17T05:34:35.055190+0000","last_undegraded":"2024-09-17T05:34:35.055190+0000","last_fullsized":"2024-09-17T05:34:35.055190+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:27.970525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308260+0000","last_change":"2024-09-17T05:34:34.064991+0000","last_active":"2024-09-17T05:34:35.308260+0000","last_peered":"2024-09-17T05:34:35.308260+0000","last_clean":"2024-09-17T05:34:35.308260+0000","last_became_active":"2024-09-17T05:34:34.064734+0000","last_became_peered":"2024-09-17T05:34:34.064734+0000","last_unstale":"2024-09-17T05:34:35.308260+0000","last_undegraded":"2024-09-17T05:34:35.308260+0000","last_fullsized":"2024-09-17T05:34:35.308260+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:35.842002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824914+0000","last_change":"2024-09-17T05:34:34.060826+0000","last_active":"2024-09-17T05:34:35.824914+0000","last_peered":"2024-09-17T05:34:35.824914+0000","last_clean":"2024-09-17T05:34:35.824914+0000","last_became_active":"2024-09-17T05:34:34.060563+0000","last_became_peered":"2024-09-17T05:34:34.060563+0000","last_unstale":"2024-09-17T05:34:35.824914+0000","last_undegraded":"2024-09-17T05:34:35.824914+0000","last_fullsized":"2024-09-17T05:34:35.824914+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:05.356098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.054940+0000","last_change":"2024-09-17T05:34:34.061282+0000","last_active":"2024-09-17T05:34:35.054940+0000","last_peered":"2024-09-17T05:34:35.054940+0000","last_clean":"2024-09-17T05:34:35.054940+0000","last_became_active":"2024-09-17T05:34:34.060977+0000","last_became_peered":"2024-09-17T05:34:34.060977+0000","last_unstale":"2024-09-17T05:34:35.054940+0000","last_undegraded":"2024-09-17T05:34:35.054940+0000","last_fullsized":"2024-09-17T05:34:35.054940+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:01.869217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824356+0000","last_change":"2024-09-17T05:34:34.061319+0000","last_active":"2024-09-17T05:34:35.824356+0000","last_peered":"2024-09-17T05:34:35.824356+0000","last_clean":"2024-09-17T05:34:35.824356+0000","last_became_active":"2024-09-17T05:34:34.061042+0000","last_became_peered":"2024-09-17T05:34:34.061042+0000","last_unstale":"2024-09-17T05:34:35.824356+0000","last_undegraded":"2024-09-17T05:34:35.824356+0000","last_fullsized":"2024-09-17T05:34:35.824356+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:25.323565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060338+0000","last_change":"2024-09-17T05:34:34.064901+0000","last_active":"2024-09-17T05:34:35.060338+0000","last_peered":"2024-09-17T05:34:35.060338+0000","last_clean":"2024-09-17T05:34:35.060338+0000","last_became_active":"2024-09-17T05:34:34.064606+0000","last_became_peered":"2024-09-17T05:34:34.064606+0000","last_unstale":"2024-09-17T05:34:35.060338+0000","last_undegraded":"2024-09-17T05:34:35.060338+0000","last_fullsized":"2024-09-17T05:34:35.060338+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:04.695299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060590+0000","last_change":"2024-09-17T05:34:34.052907+0000","last_active":"2024-09-17T05:34:35.060590+0000","last_peered":"2024-09-17T05:34:35.060590+0000","last_clean":"2024-09-17T05:34:35.060590+0000","last_became_active":"2024-09-17T05:34:34.052142+0000","last_became_peered":"2024-09-17T05:34:34.052142+0000","last_unstale":"2024-09-17T05:34:35.060590+0000","last_undegraded":"2024-09-17T05:34:35.060590+0000","last_fullsized":"2024-09-17T05:34:35.060590+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:44:28.112098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.823875+0000","last_change":"2024-09-17T05:34:34.058597+0000","last_active":"2024-09-17T05:34:35.823875+0000","last_peered":"2024-09-17T05:34:35.823875+0000","last_clean":"2024-09-17T05:34:35.823875+0000","last_became_active":"2024-09-17T05:34:34.057974+0000","last_became_peered":"2024-09-17T05:34:34.057974+0000","last_unstale":"2024-09-17T05:34:35.823875+0000","last_undegraded":"2024-09-17T05:34:35.823875+0000","last_fullsized":"2024-09-17T05:34:35.823875+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:14.563634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824937+0000","last_change":"2024-09-17T05:34:34.060541+0000","last_active":"2024-09-17T05:34:35.824937+0000","last_peered":"2024-09-17T05:34:35.824937+0000","last_clean":"2024-09-17T05:34:35.824937+0000","last_became_active":"2024-09-17T05:34:34.060177+0000","last_became_peered":"2024-09-17T05:34:34.060177+0000","last_unstale":"2024-09-17T05:34:35.824937+0000","last_undegraded":"2024-09-17T05:34:35.824937+0000","last_fullsized":"2024-09-17T05:34:35.824937+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:39.518711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308509+0000","last_change":"2024-09-17T05:34:34.064257+0000","last_active":"2024-09-17T05:34:35.308509+0000","last_peered":"2024-09-17T05:34:35.308509+0000","last_clean":"2024-09-17T05:34:35.308509+0000","last_became_active":"2024-09-17T05:34:34.063921+0000","last_became_peered":"2024-09-17T05:34:34.063921+0000","last_unstale":"2024-09-17T05:34:35.308509+0000","last_undegraded":"2024-09-17T05:34:35.308509+0000","last_fullsized":"2024-09-17T05:34:35.308509+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:02.587125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820409+0000","last_change":"2024-09-17T05:34:34.062319+0000","last_active":"2024-09-17T05:34:35.820409+0000","last_peered":"2024-09-17T05:34:35.820409+0000","last_clean":"2024-09-17T05:34:35.820409+0000","last_became_active":"2024-09-17T05:34:34.061891+0000","last_became_peered":"2024-09-17T05:34:34.061891+0000","last_unstale":"2024-09-17T05:34:35.820409+0000","last_undegraded":"2024-09-17T05:34:35.820409+0000","last_fullsized":"2024-09-17T05:34:35.820409+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:52.704848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824778+0000","last_change":"2024-09-17T05:34:34.069527+0000","last_active":"2024-09-17T05:34:35.824778+0000","last_peered":"2024-09-17T05:34:35.824778+0000","last_clean":"2024-09-17T05:34:35.824778+0000","last_became_active":"2024-09-17T05:34:34.069203+0000","last_became_peered":"2024-09-17T05:34:34.069203+0000","last_unstale":"2024-09-17T05:34:35.824778+0000","last_undegraded":"2024-09-17T05:34:35.824778+0000","last_fullsized":"2024-09-17T05:34:35.824778+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:58.308625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055208+0000","last_change":"2024-09-17T05:34:34.053461+0000","last_active":"2024-09-17T05:34:35.055208+0000","last_peered":"2024-09-17T05:34:35.055208+0000","last_clean":"2024-09-17T05:34:35.055208+0000","last_became_active":"2024-09-17T05:34:34.053150+0000","last_became_peered":"2024-09-17T05:34:34.053150+0000","last_unstale":"2024-09-17T05:34:35.055208+0000","last_undegraded":"2024-09-17T05:34:35.055208+0000","last_fullsized":"2024-09-17T05:34:35.055208+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:25.698259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308120+0000","last_change":"2024-09-17T05:34:34.068063+0000","last_active":"2024-09-17T05:34:35.308120+0000","last_peered":"2024-09-17T05:34:35.308120+0000","last_clean":"2024-09-17T05:34:35.308120+0000","last_became_active":"2024-09-17T05:34:34.067740+0000","last_became_peered":"2024-09-17T05:34:34.067740+0000","last_unstale":"2024-09-17T05:34:35.308120+0000","last_undegraded":"2024-09-17T05:34:35.308120+0000","last_fullsized":"2024-09-17T05:34:35.308120+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:35.468348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.054751+0000","last_change":"2024-09-17T05:34:34.050124+0000","last_active":"2024-09-17T05:34:35.054751+0000","last_peered":"2024-09-17T05:34:35.054751+0000","last_clean":"2024-09-17T05:34:35.054751+0000","last_became_active":"2024-09-17T05:34:34.049793+0000","last_became_peered":"2024-09-17T05:34:34.049793+0000","last_unstale":"2024-09-17T05:34:35.054751+0000","last_undegraded":"2024-09-17T05:34:35.054751+0000","last_fullsized":"2024-09-17T05:34:35.054751+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:14.195829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340889+0000","last_change":"2024-09-17T05:34:34.075280+0000","last_active":"2024-09-17T05:34:35.340889+0000","last_peered":"2024-09-17T05:34:35.340889+0000","last_clean":"2024-09-17T05:34:35.340889+0000","last_became_active":"2024-09-17T05:34:34.074846+0000","last_became_peered":"2024-09-17T05:34:34.074846+0000","last_unstale":"2024-09-17T05:34:35.340889+0000","last_undegraded":"2024-09-17T05:34:35.340889+0000","last_fullsized":"2024-09-17T05:34:35.340889+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:56.401594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060208+0000","last_change":"2024-09-17T05:34:34.062265+0000","last_active":"2024-09-17T05:34:35.060208+0000","last_peered":"2024-09-17T05:34:35.060208+0000","last_clean":"2024-09-17T05:34:35.060208+0000","last_became_active":"2024-09-17T05:34:34.061946+0000","last_became_peered":"2024-09-17T05:34:34.061946+0000","last_unstale":"2024-09-17T05:34:35.060208+0000","last_undegraded":"2024-09-17T05:34:35.060208+0000","last_fullsized":"2024-09-17T05:34:35.060208+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:44.745005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340991+0000","last_change":"2024-09-17T05:34:34.056046+0000","last_active":"2024-09-17T05:34:35.340991+0000","last_peered":"2024-09-17T05:34:35.340991+0000","last_clean":"2024-09-17T05:34:35.340991+0000","last_became_active":"2024-09-17T05:34:34.055395+0000","last_became_peered":"2024-09-17T05:34:34.055395+0000","last_unstale":"2024-09-17T05:34:35.340991+0000","last_undegraded":"2024-09-17T05:34:35.340991+0000","last_fullsized":"2024-09-17T05:34:35.340991+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:24:30.440670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820609+0000","last_change":"2024-09-17T05:34:34.053760+0000","last_active":"2024-09-17T05:34:35.820609+0000","last_peered":"2024-09-17T05:34:35.820609+0000","last_clean":"2024-09-17T05:34:35.820609+0000","last_became_active":"2024-09-17T05:34:34.053404+0000","last_became_peered":"2024-09-17T05:34:34.053404+0000","last_unstale":"2024-09-17T05:34:35.820609+0000","last_undegraded":"2024-09-17T05:34:35.820609+0000","last_fullsized":"2024-09-17T05:34:35.820609+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:00.251054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340917+0000","last_change":"2024-09-17T05:34:34.069933+0000","last_active":"2024-09-17T05:34:35.340917+0000","last_peered":"2024-09-17T05:34:35.340917+0000","last_clean":"2024-09-17T05:34:35.340917+0000","last_became_active":"2024-09-17T05:34:34.069588+0000","last_became_peered":"2024-09-17T05:34:34.069588+0000","last_unstale":"2024-09-17T05:34:35.340917+0000","last_undegraded":"2024-09-17T05:34:35.340917+0000","last_fullsized":"2024-09-17T05:34:35.340917+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:46.802117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824227+0000","last_change":"2024-09-17T05:34:34.060634+0000","last_active":"2024-09-17T05:34:35.824227+0000","last_peered":"2024-09-17T05:34:35.824227+0000","last_clean":"2024-09-17T05:34:35.824227+0000","last_became_active":"2024-09-17T05:34:34.060351+0000","last_became_peered":"2024-09-17T05:34:34.060351+0000","last_unstale":"2024-09-17T05:34:35.824227+0000","last_undegraded":"2024-09-17T05:34:35.824227+0000","last_fullsized":"2024-09-17T05:34:35.824227+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:05.798788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820214+0000","last_change":"2024-09-17T05:34:34.066387+0000","last_active":"2024-09-17T05:34:35.820214+0000","last_peered":"2024-09-17T05:34:35.820214+0000","last_clean":"2024-09-17T05:34:35.820214+0000","last_became_active":"2024-09-17T05:34:34.066139+0000","last_became_peered":"2024-09-17T05:34:34.066139+0000","last_unstale":"2024-09-17T05:34:35.820214+0000","last_undegraded":"2024-09-17T05:34:35.820214+0000","last_fullsized":"2024-09-17T05:34:35.820214+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:31.838964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824485+0000","last_change":"2024-09-17T05:34:34.062062+0000","last_active":"2024-09-17T05:34:35.824485+0000","last_peered":"2024-09-17T05:34:35.824485+0000","last_clean":"2024-09-17T05:34:35.824485+0000","last_became_active":"2024-09-17T05:34:34.059953+0000","last_became_peered":"2024-09-17T05:34:34.059953+0000","last_unstale":"2024-09-17T05:34:35.824485+0000","last_undegraded":"2024-09-17T05:34:35.824485+0000","last_fullsized":"2024-09-17T05:34:35.824485+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:07.523538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820302+0000","last_change":"2024-09-17T05:34:34.057766+0000","last_active":"2024-09-17T05:34:35.820302+0000","last_peered":"2024-09-17T05:34:35.820302+0000","last_clean":"2024-09-17T05:34:35.820302+0000","last_became_active":"2024-09-17T05:34:34.057278+0000","last_became_peered":"2024-09-17T05:34:34.057278+0000","last_unstale":"2024-09-17T05:34:35.820302+0000","last_undegraded":"2024-09-17T05:34:35.820302+0000","last_fullsized":"2024-09-17T05:34:35.820302+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:56.603465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308568+0000","last_change":"2024-09-17T05:34:34.065158+0000","last_active":"2024-09-17T05:34:35.308568+0000","last_peered":"2024-09-17T05:34:35.308568+0000","last_clean":"2024-09-17T05:34:35.308568+0000","last_became_active":"2024-09-17T05:34:34.064854+0000","last_became_peered":"2024-09-17T05:34:34.064854+0000","last_unstale":"2024-09-17T05:34:35.308568+0000","last_undegraded":"2024-09-17T05:34:35.308568+0000","last_fullsized":"2024-09-17T05:34:35.308568+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:33.652582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340978+0000","last_change":"2024-09-17T05:34:34.078814+0000","last_active":"2024-09-17T05:34:35.340978+0000","last_peered":"2024-09-17T05:34:35.340978+0000","last_clean":"2024-09-17T05:34:35.340978+0000","last_became_active":"2024-09-17T05:34:34.077965+0000","last_became_peered":"2024-09-17T05:34:34.077965+0000","last_unstale":"2024-09-17T05:34:35.340978+0000","last_undegraded":"2024-09-17T05:34:35.340978+0000","last_fullsized":"2024-09-17T05:34:35.340978+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:43.780806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.054990+0000","last_change":"2024-09-17T05:34:34.049290+0000","last_active":"2024-09-17T05:34:35.054990+0000","last_peered":"2024-09-17T05:34:35.054990+0000","last_clean":"2024-09-17T05:34:35.054990+0000","last_became_active":"2024-09-17T05:34:34.048975+0000","last_became_peered":"2024-09-17T05:34:34.048975+0000","last_unstale":"2024-09-17T05:34:35.054990+0000","last_undegraded":"2024-09-17T05:34:35.054990+0000","last_fullsized":"2024-09-17T05:34:35.054990+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:59.063927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.059840+0000","last_change":"2024-09-17T05:34:34.053789+0000","last_active":"2024-09-17T05:34:35.059840+0000","last_peered":"2024-09-17T05:34:35.059840+0000","last_clean":"2024-09-17T05:34:35.059840+0000","last_became_active":"2024-09-17T05:34:34.053466+0000","last_became_peered":"2024-09-17T05:34:34.053466+0000","last_unstale":"2024-09-17T05:34:35.059840+0000","last_undegraded":"2024-09-17T05:34:35.059840+0000","last_fullsized":"2024-09-17T05:34:35.059840+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:25.864261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.054977+0000","last_change":"2024-09-17T05:34:34.058615+0000","last_active":"2024-09-17T05:34:35.054977+0000","last_peered":"2024-09-17T05:34:35.054977+0000","last_clean":"2024-09-17T05:34:35.054977+0000","last_became_active":"2024-09-17T05:34:34.058250+0000","last_became_peered":"2024-09-17T05:34:34.058250+0000","last_unstale":"2024-09-17T05:34:35.054977+0000","last_undegraded":"2024-09-17T05:34:35.054977+0000","last_fullsized":"2024-09-17T05:34:35.054977+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:05.508279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055122+0000","last_change":"2024-09-17T05:34:34.050440+0000","last_active":"2024-09-17T05:34:35.055122+0000","last_peered":"2024-09-17T05:34:35.055122+0000","last_clean":"2024-09-17T05:34:35.055122+0000","last_became_active":"2024-09-17T05:34:34.050065+0000","last_became_peered":"2024-09-17T05:34:34.050065+0000","last_unstale":"2024-09-17T05:34:35.055122+0000","last_undegraded":"2024-09-17T05:34:35.055122+0000","last_fullsized":"2024-09-17T05:34:35.055122+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:12.157816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824200+0000","last_change":"2024-09-17T05:34:34.078291+0000","last_active":"2024-09-17T05:34:35.824200+0000","last_peered":"2024-09-17T05:34:35.824200+0000","last_clean":"2024-09-17T05:34:35.824200+0000","last_became_active":"2024-09-17T05:34:34.078014+0000","last_became_peered":"2024-09-17T05:34:34.078014+0000","last_unstale":"2024-09-17T05:34:35.824200+0000","last_undegraded":"2024-09-17T05:34:35.824200+0000","last_fullsized":"2024-09-17T05:34:35.824200+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:04:30.198638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.059792+0000","last_change":"2024-09-17T05:34:34.053475+0000","last_active":"2024-09-17T05:34:35.059792+0000","last_peered":"2024-09-17T05:34:35.059792+0000","last_clean":"2024-09-17T05:34:35.059792+0000","last_became_active":"2024-09-17T05:34:34.053168+0000","last_became_peered":"2024-09-17T05:34:34.053168+0000","last_unstale":"2024-09-17T05:34:35.059792+0000","last_undegraded":"2024-09-17T05:34:35.059792+0000","last_fullsized":"2024-09-17T05:34:35.059792+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:53.847482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.341197+0000","last_change":"2024-09-17T05:34:34.056102+0000","last_active":"2024-09-17T05:34:35.341197+0000","last_peered":"2024-09-17T05:34:35.341197+0000","last_clean":"2024-09-17T05:34:35.341197+0000","last_became_active":"2024-09-17T05:34:34.055779+0000","last_became_peered":"2024-09-17T05:34:34.055779+0000","last_unstale":"2024-09-17T05:34:35.341197+0000","last_undegraded":"2024-09-17T05:34:35.341197+0000","last_fullsized":"2024-09-17T05:34:35.341197+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:58.561334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"114'4","reported_seq":19,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825235+0000","last_change":"2024-09-17T05:34:33.060411+0000","last_active":"2024-09-17T05:34:35.825235+0000","last_peered":"2024-09-17T05:34:35.825235+0000","last_clean":"2024-09-17T05:34:35.825235+0000","last_became_active":"2024-09-17T05:34:33.060044+0000","last_became_peered":"2024-09-17T05:34:33.060044+0000","last_unstale":"2024-09-17T05:34:35.825235+0000","last_undegraded":"2024-09-17T05:34:35.825235+0000","last_fullsized":"2024-09-17T05:34:35.825235+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:18.211934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825046+0000","last_change":"2024-09-17T05:34:34.077842+0000","last_active":"2024-09-17T05:34:35.825046+0000","last_peered":"2024-09-17T05:34:35.825046+0000","last_clean":"2024-09-17T05:34:35.825046+0000","last_became_active":"2024-09-17T05:34:34.077560+0000","last_became_peered":"2024-09-17T05:34:34.077560+0000","last_unstale":"2024-09-17T05:34:35.825046+0000","last_undegraded":"2024-09-17T05:34:35.825046+0000","last_fullsized":"2024-09-17T05:34:35.825046+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:30.999293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060668+0000","last_change":"2024-09-17T05:34:33.062317+0000","last_active":"2024-09-17T05:34:35.060668+0000","last_peered":"2024-09-17T05:34:35.060668+0000","last_clean":"2024-09-17T05:34:35.060668+0000","last_became_active":"2024-09-17T05:34:33.061996+0000","last_became_peered":"2024-09-17T05:34:33.061996+0000","last_unstale":"2024-09-17T05:34:35.060668+0000","last_undegraded":"2024-09-17T05:34:35.060668+0000","last_fullsized":"2024-09-17T05:34:35.060668+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:24.141886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825177+0000","last_change":"2024-09-17T05:34:34.068416+0000","last_active":"2024-09-17T05:34:35.825177+0000","last_peered":"2024-09-17T05:34:35.825177+0000","last_clean":"2024-09-17T05:34:35.825177+0000","last_became_active":"2024-09-17T05:34:34.068076+0000","last_became_peered":"2024-09-17T05:34:34.068076+0000","last_unstale":"2024-09-17T05:34:35.825177+0000","last_undegraded":"2024-09-17T05:34:35.825177+0000","last_fullsized":"2024-09-17T05:34:35.825177+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:22.876201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820554+0000","last_change":"2024-09-17T05:34:33.062863+0000","last_active":"2024-09-17T05:34:35.820554+0000","last_peered":"2024-09-17T05:34:35.820554+0000","last_clean":"2024-09-17T05:34:35.820554+0000","last_became_active":"2024-09-17T05:34:33.062606+0000","last_became_peered":"2024-09-17T05:34:33.062606+0000","last_unstale":"2024-09-17T05:34:35.820554+0000","last_undegraded":"2024-09-17T05:34:35.820554+0000","last_fullsized":"2024-09-17T05:34:35.820554+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:37.910420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825201+0000","last_change":"2024-09-17T05:34:34.072411+0000","last_active":"2024-09-17T05:34:35.825201+0000","last_peered":"2024-09-17T05:34:35.825201+0000","last_clean":"2024-09-17T05:34:35.825201+0000","last_became_active":"2024-09-17T05:34:34.071876+0000","last_became_peered":"2024-09-17T05:34:34.071876+0000","last_unstale":"2024-09-17T05:34:35.825201+0000","last_undegraded":"2024-09-17T05:34:35.825201+0000","last_fullsized":"2024-09-17T05:34:35.825201+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:22.523783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308387+0000","last_change":"2024-09-17T05:34:33.061506+0000","last_active":"2024-09-17T05:34:35.308387+0000","last_peered":"2024-09-17T05:34:35.308387+0000","last_clean":"2024-09-17T05:34:35.308387+0000","last_became_active":"2024-09-17T05:34:33.060829+0000","last_became_peered":"2024-09-17T05:34:33.060829+0000","last_unstale":"2024-09-17T05:34:35.308387+0000","last_undegraded":"2024-09-17T05:34:35.308387+0000","last_fullsized":"2024-09-17T05:34:35.308387+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:01.183566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340894+0000","last_change":"2024-09-17T05:34:34.049231+0000","last_active":"2024-09-17T05:34:35.340894+0000","last_peered":"2024-09-17T05:34:35.340894+0000","last_clean":"2024-09-17T05:34:35.340894+0000","last_became_active":"2024-09-17T05:34:34.048974+0000","last_became_peered":"2024-09-17T05:34:34.048974+0000","last_unstale":"2024-09-17T05:34:35.340894+0000","last_undegraded":"2024-09-17T05:34:35.340894+0000","last_fullsized":"2024-09-17T05:34:35.340894+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:47:19.598707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.307983+0000","last_change":"2024-09-17T05:34:33.062761+0000","last_active":"2024-09-17T05:34:35.307983+0000","last_peered":"2024-09-17T05:34:35.307983+0000","last_clean":"2024-09-17T05:34:35.307983+0000","last_became_active":"2024-09-17T05:34:33.062415+0000","last_became_peered":"2024-09-17T05:34:33.062415+0000","last_unstale":"2024-09-17T05:34:35.307983+0000","last_undegraded":"2024-09-17T05:34:35.307983+0000","last_fullsized":"2024-09-17T05:34:35.307983+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:31.919752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060120+0000","last_change":"2024-09-17T05:34:34.055171+0000","last_active":"2024-09-17T05:34:35.060120+0000","last_peered":"2024-09-17T05:34:35.060120+0000","last_clean":"2024-09-17T05:34:35.060120+0000","last_became_active":"2024-09-17T05:34:34.054552+0000","last_became_peered":"2024-09-17T05:34:34.054552+0000","last_unstale":"2024-09-17T05:34:35.060120+0000","last_undegraded":"2024-09-17T05:34:35.060120+0000","last_fullsized":"2024-09-17T05:34:35.060120+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:50.789978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340608+0000","last_change":"2024-09-17T05:34:33.057749+0000","last_active":"2024-09-17T05:34:35.340608+0000","last_peered":"2024-09-17T05:34:35.340608+0000","last_clean":"2024-09-17T05:34:35.340608+0000","last_became_active":"2024-09-17T05:34:33.057379+0000","last_became_peered":"2024-09-17T05:34:33.057379+0000","last_unstale":"2024-09-17T05:34:35.340608+0000","last_undegraded":"2024-09-17T05:34:35.340608+0000","last_fullsized":"2024-09-17T05:34:35.340608+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:22:51.977468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.823917+0000","last_change":"2024-09-17T05:34:34.058285+0000","last_active":"2024-09-17T05:34:35.823917+0000","last_peered":"2024-09-17T05:34:35.823917+0000","last_clean":"2024-09-17T05:34:35.823917+0000","last_became_active":"2024-09-17T05:34:34.057608+0000","last_became_peered":"2024-09-17T05:34:34.057608+0000","last_unstale":"2024-09-17T05:34:35.823917+0000","last_undegraded":"2024-09-17T05:34:35.823917+0000","last_fullsized":"2024-09-17T05:34:35.823917+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:06.776364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.059760+0000","last_change":"2024-09-17T05:34:33.058494+0000","last_active":"2024-09-17T05:34:35.059760+0000","last_peered":"2024-09-17T05:34:35.059760+0000","last_clean":"2024-09-17T05:34:35.059760+0000","last_became_active":"2024-09-17T05:34:33.057230+0000","last_became_peered":"2024-09-17T05:34:33.057230+0000","last_unstale":"2024-09-17T05:34:35.059760+0000","last_undegraded":"2024-09-17T05:34:35.059760+0000","last_fullsized":"2024-09-17T05:34:35.059760+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:06.513338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308163+0000","last_change":"2024-09-17T05:34:34.064359+0000","last_active":"2024-09-17T05:34:35.308163+0000","last_peered":"2024-09-17T05:34:35.308163+0000","last_clean":"2024-09-17T05:34:35.308163+0000","last_became_active":"2024-09-17T05:34:34.064027+0000","last_became_peered":"2024-09-17T05:34:34.064027+0000","last_unstale":"2024-09-17T05:34:35.308163+0000","last_undegraded":"2024-09-17T05:34:35.308163+0000","last_fullsized":"2024-09-17T05:34:35.308163+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:31.748946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308230+0000","last_change":"2024-09-17T05:34:33.060390+0000","last_active":"2024-09-17T05:34:35.308230+0000","last_peered":"2024-09-17T05:34:35.308230+0000","last_clean":"2024-09-17T05:34:35.308230+0000","last_became_active":"2024-09-17T05:34:33.059726+0000","last_became_peered":"2024-09-17T05:34:33.059726+0000","last_unstale":"2024-09-17T05:34:35.308230+0000","last_undegraded":"2024-09-17T05:34:35.308230+0000","last_fullsized":"2024-09-17T05:34:35.308230+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:00.111980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055526+0000","last_change":"2024-09-17T05:34:34.063038+0000","last_active":"2024-09-17T05:34:35.055526+0000","last_peered":"2024-09-17T05:34:35.055526+0000","last_clean":"2024-09-17T05:34:35.055526+0000","last_became_active":"2024-09-17T05:34:34.062775+0000","last_became_peered":"2024-09-17T05:34:34.062775+0000","last_unstale":"2024-09-17T05:34:35.055526+0000","last_undegraded":"2024-09-17T05:34:35.055526+0000","last_fullsized":"2024-09-17T05:34:35.055526+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:07.115420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.061873+0000","last_change":"2024-09-17T05:34:33.055033+0000","last_active":"2024-09-17T05:34:35.061873+0000","last_peered":"2024-09-17T05:34:35.061873+0000","last_clean":"2024-09-17T05:34:35.061873+0000","last_became_active":"2024-09-17T05:34:33.053730+0000","last_became_peered":"2024-09-17T05:34:33.053730+0000","last_unstale":"2024-09-17T05:34:35.061873+0000","last_undegraded":"2024-09-17T05:34:35.061873+0000","last_fullsized":"2024-09-17T05:34:35.061873+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:45.665453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.061724+0000","last_change":"2024-09-17T05:34:34.055421+0000","last_active":"2024-09-17T05:34:35.061724+0000","last_peered":"2024-09-17T05:34:35.061724+0000","last_clean":"2024-09-17T05:34:35.061724+0000","last_became_active":"2024-09-17T05:34:34.055124+0000","last_became_peered":"2024-09-17T05:34:34.055124+0000","last_unstale":"2024-09-17T05:34:35.061724+0000","last_undegraded":"2024-09-17T05:34:35.061724+0000","last_fullsized":"2024-09-17T05:34:35.061724+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:38.127405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.341138+0000","last_change":"2024-09-17T05:34:33.053229+0000","last_active":"2024-09-17T05:34:35.341138+0000","last_peered":"2024-09-17T05:34:35.341138+0000","last_clean":"2024-09-17T05:34:35.341138+0000","last_became_active":"2024-09-17T05:34:33.052960+0000","last_became_peered":"2024-09-17T05:34:33.052960+0000","last_unstale":"2024-09-17T05:34:35.341138+0000","last_undegraded":"2024-09-17T05:34:35.341138+0000","last_fullsized":"2024-09-17T05:34:35.341138+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:44.853325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825227+0000","last_change":"2024-09-17T05:34:34.067686+0000","last_active":"2024-09-17T05:34:35.825227+0000","last_peered":"2024-09-17T05:34:35.825227+0000","last_clean":"2024-09-17T05:34:35.825227+0000","last_became_active":"2024-09-17T05:34:34.064490+0000","last_became_peered":"2024-09-17T05:34:34.064490+0000","last_unstale":"2024-09-17T05:34:35.825227+0000","last_undegraded":"2024-09-17T05:34:35.825227+0000","last_fullsized":"2024-09-17T05:34:35.825227+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:23.888318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"114'3","reported_seq":18,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060791+0000","last_change":"2024-09-17T05:34:33.054751+0000","last_active":"2024-09-17T05:34:35.060791+0000","last_peered":"2024-09-17T05:34:35.060791+0000","last_clean":"2024-09-17T05:34:35.060791+0000","last_became_active":"2024-09-17T05:34:33.054460+0000","last_became_peered":"2024-09-17T05:34:33.054460+0000","last_unstale":"2024-09-17T05:34:35.060791+0000","last_undegraded":"2024-09-17T05:34:35.060791+0000","last_fullsized":"2024-09-17T05:34:35.060791+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:06:02.019659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825387+0000","last_change":"2024-09-17T05:34:34.063549+0000","last_active":"2024-09-17T05:34:35.825387+0000","last_peered":"2024-09-17T05:34:35.825387+0000","last_clean":"2024-09-17T05:34:35.825387+0000","last_became_active":"2024-09-17T05:34:34.063248+0000","last_became_peered":"2024-09-17T05:34:34.063248+0000","last_unstale":"2024-09-17T05:34:35.825387+0000","last_undegraded":"2024-09-17T05:34:35.825387+0000","last_fullsized":"2024-09-17T05:34:35.825387+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:57.703158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"114'6","reported_seq":21,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824875+0000","last_change":"2024-09-17T05:34:33.057015+0000","last_active":"2024-09-17T05:34:35.824875+0000","last_peered":"2024-09-17T05:34:35.824875+0000","last_clean":"2024-09-17T05:34:35.824875+0000","last_became_active":"2024-09-17T05:34:33.056734+0000","last_became_peered":"2024-09-17T05:34:33.056734+0000","last_unstale":"2024-09-17T05:34:35.824875+0000","last_undegraded":"2024-09-17T05:34:35.824875+0000","last_fullsized":"2024-09-17T05:34:35.824875+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:34.831803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055205+0000","last_change":"2024-09-17T05:34:34.062614+0000","last_active":"2024-09-17T05:34:35.055205+0000","last_peered":"2024-09-17T05:34:35.055205+0000","last_clean":"2024-09-17T05:34:35.055205+0000","last_became_active":"2024-09-17T05:34:34.062249+0000","last_became_peered":"2024-09-17T05:34:34.062249+0000","last_unstale":"2024-09-17T05:34:35.055205+0000","last_undegraded":"2024-09-17T05:34:35.055205+0000","last_fullsized":"2024-09-17T05:34:35.055205+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:00:38.101184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055387+0000","last_change":"2024-09-17T05:34:33.050723+0000","last_active":"2024-09-17T05:34:35.055387+0000","last_peered":"2024-09-17T05:34:35.055387+0000","last_clean":"2024-09-17T05:34:35.055387+0000","last_became_active":"2024-09-17T05:34:33.050285+0000","last_became_peered":"2024-09-17T05:34:33.050285+0000","last_unstale":"2024-09-17T05:34:35.055387+0000","last_undegraded":"2024-09-17T05:34:35.055387+0000","last_fullsized":"2024-09-17T05:34:35.055387+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:29.206583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.307999+0000","last_change":"2024-09-17T05:34:34.072871+0000","last_active":"2024-09-17T05:34:35.307999+0000","last_peered":"2024-09-17T05:34:35.307999+0000","last_clean":"2024-09-17T05:34:35.307999+0000","last_became_active":"2024-09-17T05:34:34.072586+0000","last_became_peered":"2024-09-17T05:34:34.072586+0000","last_unstale":"2024-09-17T05:34:35.307999+0000","last_undegraded":"2024-09-17T05:34:35.307999+0000","last_fullsized":"2024-09-17T05:34:35.307999+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:41.983789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308300+0000","last_change":"2024-09-17T05:34:33.057209+0000","last_active":"2024-09-17T05:34:35.308300+0000","last_peered":"2024-09-17T05:34:35.308300+0000","last_clean":"2024-09-17T05:34:35.308300+0000","last_became_active":"2024-09-17T05:34:33.056797+0000","last_became_peered":"2024-09-17T05:34:33.056797+0000","last_unstale":"2024-09-17T05:34:35.308300+0000","last_undegraded":"2024-09-17T05:34:35.308300+0000","last_fullsized":"2024-09-17T05:34:35.308300+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:19.076711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824265+0000","last_change":"2024-09-17T05:34:34.064005+0000","last_active":"2024-09-17T05:34:35.824265+0000","last_peered":"2024-09-17T05:34:35.824265+0000","last_clean":"2024-09-17T05:34:35.824265+0000","last_became_active":"2024-09-17T05:34:34.060338+0000","last_became_peered":"2024-09-17T05:34:34.060338+0000","last_unstale":"2024-09-17T05:34:35.824265+0000","last_undegraded":"2024-09-17T05:34:35.824265+0000","last_fullsized":"2024-09-17T05:34:35.824265+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:10.771359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"114'8","reported_seq":23,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824069+0000","last_change":"2024-09-17T05:34:33.065180+0000","last_active":"2024-09-17T05:34:35.824069+0000","last_peered":"2024-09-17T05:34:35.824069+0000","last_clean":"2024-09-17T05:34:35.824069+0000","last_became_active":"2024-09-17T05:34:33.064968+0000","last_became_peered":"2024-09-17T05:34:33.064968+0000","last_unstale":"2024-09-17T05:34:35.824069+0000","last_undegraded":"2024-09-17T05:34:35.824069+0000","last_fullsized":"2024-09-17T05:34:35.824069+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:09.728225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824902+0000","last_change":"2024-09-17T05:34:34.070480+0000","last_active":"2024-09-17T05:34:35.824902+0000","last_peered":"2024-09-17T05:34:35.824902+0000","last_clean":"2024-09-17T05:34:35.824902+0000","last_became_active":"2024-09-17T05:34:34.069303+0000","last_became_peered":"2024-09-17T05:34:34.069303+0000","last_unstale":"2024-09-17T05:34:35.824902+0000","last_undegraded":"2024-09-17T05:34:35.824902+0000","last_fullsized":"2024-09-17T05:34:35.824902+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:36.024997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.061928+0000","last_change":"2024-09-17T05:34:33.056067+0000","last_active":"2024-09-17T05:34:35.061928+0000","last_peered":"2024-09-17T05:34:35.061928+0000","last_clean":"2024-09-17T05:34:35.061928+0000","last_became_active":"2024-09-17T05:34:33.055790+0000","last_became_peered":"2024-09-17T05:34:33.055790+0000","last_unstale":"2024-09-17T05:34:35.061928+0000","last_undegraded":"2024-09-17T05:34:35.061928+0000","last_fullsized":"2024-09-17T05:34:35.061928+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:33.135478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.061779+0000","last_change":"2024-09-17T05:34:34.061817+0000","last_active":"2024-09-17T05:34:35.061779+0000","last_peered":"2024-09-17T05:34:35.061779+0000","last_clean":"2024-09-17T05:34:35.061779+0000","last_became_active":"2024-09-17T05:34:34.061394+0000","last_became_peered":"2024-09-17T05:34:34.061394+0000","last_unstale":"2024-09-17T05:34:35.061779+0000","last_undegraded":"2024-09-17T05:34:35.061779+0000","last_fullsized":"2024-09-17T05:34:35.061779+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:21.288618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820430+0000","last_change":"2024-09-17T05:34:33.063900+0000","last_active":"2024-09-17T05:34:35.820430+0000","last_peered":"2024-09-17T05:34:35.820430+0000","last_clean":"2024-09-17T05:34:35.820430+0000","last_became_active":"2024-09-17T05:34:33.063632+0000","last_became_peered":"2024-09-17T05:34:33.063632+0000","last_unstale":"2024-09-17T05:34:35.820430+0000","last_undegraded":"2024-09-17T05:34:35.820430+0000","last_fullsized":"2024-09-17T05:34:35.820430+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:53:26.921272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340985+0000","last_change":"2024-09-17T05:34:34.075935+0000","last_active":"2024-09-17T05:34:35.340985+0000","last_peered":"2024-09-17T05:34:35.340985+0000","last_clean":"2024-09-17T05:34:35.340985+0000","last_became_active":"2024-09-17T05:34:34.074477+0000","last_became_peered":"2024-09-17T05:34:34.074477+0000","last_unstale":"2024-09-17T05:34:35.340985+0000","last_undegraded":"2024-09-17T05:34:35.340985+0000","last_fullsized":"2024-09-17T05:34:35.340985+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:06.767712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060893+0000","last_change":"2024-09-17T05:34:33.063478+0000","last_active":"2024-09-17T05:34:35.060893+0000","last_peered":"2024-09-17T05:34:35.060893+0000","last_clean":"2024-09-17T05:34:35.060893+0000","last_became_active":"2024-09-17T05:34:33.062829+0000","last_became_peered":"2024-09-17T05:34:33.062829+0000","last_unstale":"2024-09-17T05:34:35.060893+0000","last_undegraded":"2024-09-17T05:34:35.060893+0000","last_fullsized":"2024-09-17T05:34:35.060893+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:57.298426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308271+0000","last_change":"2024-09-17T05:34:34.064589+0000","last_active":"2024-09-17T05:34:35.308271+0000","last_peered":"2024-09-17T05:34:35.308271+0000","last_clean":"2024-09-17T05:34:35.308271+0000","last_became_active":"2024-09-17T05:34:34.064291+0000","last_became_peered":"2024-09-17T05:34:34.064291+0000","last_unstale":"2024-09-17T05:34:35.308271+0000","last_undegraded":"2024-09-17T05:34:35.308271+0000","last_fullsized":"2024-09-17T05:34:35.308271+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:10.738424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060239+0000","last_change":"2024-09-17T05:34:33.061407+0000","last_active":"2024-09-17T05:34:35.060239+0000","last_peered":"2024-09-17T05:34:35.060239+0000","last_clean":"2024-09-17T05:34:35.060239+0000","last_became_active":"2024-09-17T05:34:33.061107+0000","last_became_peered":"2024-09-17T05:34:33.061107+0000","last_unstale":"2024-09-17T05:34:35.060239+0000","last_undegraded":"2024-09-17T05:34:35.060239+0000","last_fullsized":"2024-09-17T05:34:35.060239+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:52.128959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055349+0000","last_change":"2024-09-17T05:34:34.048103+0000","last_active":"2024-09-17T05:34:35.055349+0000","last_peered":"2024-09-17T05:34:35.055349+0000","last_clean":"2024-09-17T05:34:35.055349+0000","last_became_active":"2024-09-17T05:34:34.047778+0000","last_became_peered":"2024-09-17T05:34:34.047778+0000","last_unstale":"2024-09-17T05:34:35.055349+0000","last_undegraded":"2024-09-17T05:34:35.055349+0000","last_fullsized":"2024-09-17T05:34:35.055349+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:08.470009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060095+0000","last_change":"2024-09-17T05:34:33.053534+0000","last_active":"2024-09-17T05:34:35.060095+0000","last_peered":"2024-09-17T05:34:35.060095+0000","last_clean":"2024-09-17T05:34:35.060095+0000","last_became_active":"2024-09-17T05:34:33.053241+0000","last_became_peered":"2024-09-17T05:34:33.053241+0000","last_unstale":"2024-09-17T05:34:35.060095+0000","last_undegraded":"2024-09-17T05:34:35.060095+0000","last_fullsized":"2024-09-17T05:34:35.060095+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:11.021007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060369+0000","last_change":"2024-09-17T05:34:34.054874+0000","last_active":"2024-09-17T05:34:35.060369+0000","last_peered":"2024-09-17T05:34:35.060369+0000","last_clean":"2024-09-17T05:34:35.060369+0000","last_became_active":"2024-09-17T05:34:34.054212+0000","last_became_peered":"2024-09-17T05:34:34.054212+0000","last_unstale":"2024-09-17T05:34:35.060369+0000","last_undegraded":"2024-09-17T05:34:35.060369+0000","last_fullsized":"2024-09-17T05:34:35.060369+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:33.184808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340732+0000","last_change":"2024-09-17T05:34:33.053720+0000","last_active":"2024-09-17T05:34:35.340732+0000","last_peered":"2024-09-17T05:34:35.340732+0000","last_clean":"2024-09-17T05:34:35.340732+0000","last_became_active":"2024-09-17T05:34:33.053422+0000","last_became_peered":"2024-09-17T05:34:33.053422+0000","last_unstale":"2024-09-17T05:34:35.340732+0000","last_undegraded":"2024-09-17T05:34:35.340732+0000","last_fullsized":"2024-09-17T05:34:35.340732+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:18.671717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308049+0000","last_change":"2024-09-17T05:34:34.077530+0000","last_active":"2024-09-17T05:34:35.308049+0000","last_peered":"2024-09-17T05:34:35.308049+0000","last_clean":"2024-09-17T05:34:35.308049+0000","last_became_active":"2024-09-17T05:34:34.077169+0000","last_became_peered":"2024-09-17T05:34:34.077169+0000","last_unstale":"2024-09-17T05:34:35.308049+0000","last_undegraded":"2024-09-17T05:34:35.308049+0000","last_fullsized":"2024-09-17T05:34:35.308049+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:52.333720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340564+0000","last_change":"2024-09-17T05:34:33.044645+0000","last_active":"2024-09-17T05:34:35.340564+0000","last_peered":"2024-09-17T05:34:35.340564+0000","last_clean":"2024-09-17T05:34:35.340564+0000","last_became_active":"2024-09-17T05:34:33.043462+0000","last_became_peered":"2024-09-17T05:34:33.043462+0000","last_unstale":"2024-09-17T05:34:35.340564+0000","last_undegraded":"2024-09-17T05:34:35.340564+0000","last_fullsized":"2024-09-17T05:34:35.340564+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:22.412396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824158+0000","last_change":"2024-09-17T05:34:34.078231+0000","last_active":"2024-09-17T05:34:35.824158+0000","last_peered":"2024-09-17T05:34:35.824158+0000","last_clean":"2024-09-17T05:34:35.824158+0000","last_became_active":"2024-09-17T05:34:34.077916+0000","last_became_peered":"2024-09-17T05:34:34.077916+0000","last_unstale":"2024-09-17T05:34:35.824158+0000","last_undegraded":"2024-09-17T05:34:35.824158+0000","last_fullsized":"2024-09-17T05:34:35.824158+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:16:02.059560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820112+0000","last_change":"2024-09-17T05:34:33.063648+0000","last_active":"2024-09-17T05:34:35.820112+0000","last_peered":"2024-09-17T05:34:35.820112+0000","last_clean":"2024-09-17T05:34:35.820112+0000","last_became_active":"2024-09-17T05:34:33.063359+0000","last_became_peered":"2024-09-17T05:34:33.063359+0000","last_unstale":"2024-09-17T05:34:35.820112+0000","last_undegraded":"2024-09-17T05:34:35.820112+0000","last_fullsized":"2024-09-17T05:34:35.820112+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:48.271437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.061260+0000","last_change":"2024-09-17T05:34:34.052351+0000","last_active":"2024-09-17T05:34:35.061260+0000","last_peered":"2024-09-17T05:34:35.061260+0000","last_clean":"2024-09-17T05:34:35.061260+0000","last_became_active":"2024-09-17T05:34:34.051953+0000","last_became_peered":"2024-09-17T05:34:34.051953+0000","last_unstale":"2024-09-17T05:34:35.061260+0000","last_undegraded":"2024-09-17T05:34:35.061260+0000","last_fullsized":"2024-09-17T05:34:35.061260+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:45.007688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055330+0000","last_change":"2024-09-17T05:34:33.050448+0000","last_active":"2024-09-17T05:34:35.055330+0000","last_peered":"2024-09-17T05:34:35.055330+0000","last_clean":"2024-09-17T05:34:35.055330+0000","last_became_active":"2024-09-17T05:34:33.048788+0000","last_became_peered":"2024-09-17T05:34:33.048788+0000","last_unstale":"2024-09-17T05:34:35.055330+0000","last_undegraded":"2024-09-17T05:34:35.055330+0000","last_fullsized":"2024-09-17T05:34:35.055330+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:52.322184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055205+0000","last_change":"2024-09-17T05:34:34.066644+0000","last_active":"2024-09-17T05:34:35.055205+0000","last_peered":"2024-09-17T05:34:35.055205+0000","last_clean":"2024-09-17T05:34:35.055205+0000","last_became_active":"2024-09-17T05:34:34.055068+0000","last_became_peered":"2024-09-17T05:34:34.055068+0000","last_unstale":"2024-09-17T05:34:35.055205+0000","last_undegraded":"2024-09-17T05:34:35.055205+0000","last_fullsized":"2024-09-17T05:34:35.055205+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:50.557224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825072+0000","last_change":"2024-09-17T05:34:33.060194+0000","last_active":"2024-09-17T05:34:35.825072+0000","last_peered":"2024-09-17T05:34:35.825072+0000","last_clean":"2024-09-17T05:34:35.825072+0000","last_became_active":"2024-09-17T05:34:33.059578+0000","last_became_peered":"2024-09-17T05:34:33.059578+0000","last_unstale":"2024-09-17T05:34:35.825072+0000","last_undegraded":"2024-09-17T05:34:35.825072+0000","last_fullsized":"2024-09-17T05:34:35.825072+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:58.774105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308425+0000","last_change":"2024-09-17T05:34:34.066256+0000","last_active":"2024-09-17T05:34:35.308425+0000","last_peered":"2024-09-17T05:34:35.308425+0000","last_clean":"2024-09-17T05:34:35.308425+0000","last_became_active":"2024-09-17T05:34:34.065865+0000","last_became_peered":"2024-09-17T05:34:34.065865+0000","last_unstale":"2024-09-17T05:34:35.308425+0000","last_undegraded":"2024-09-17T05:34:35.308425+0000","last_fullsized":"2024-09-17T05:34:35.308425+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:07.184666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308273+0000","last_change":"2024-09-17T05:34:33.058966+0000","last_active":"2024-09-17T05:34:35.308273+0000","last_peered":"2024-09-17T05:34:35.308273+0000","last_clean":"2024-09-17T05:34:35.308273+0000","last_became_active":"2024-09-17T05:34:33.058457+0000","last_became_peered":"2024-09-17T05:34:33.058457+0000","last_unstale":"2024-09-17T05:34:35.308273+0000","last_undegraded":"2024-09-17T05:34:35.308273+0000","last_fullsized":"2024-09-17T05:34:35.308273+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:32.894237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060736+0000","last_change":"2024-09-17T05:34:34.067228+0000","last_active":"2024-09-17T05:34:35.060736+0000","last_peered":"2024-09-17T05:34:35.060736+0000","last_clean":"2024-09-17T05:34:35.060736+0000","last_became_active":"2024-09-17T05:34:34.066952+0000","last_became_peered":"2024-09-17T05:34:34.066952+0000","last_unstale":"2024-09-17T05:34:35.060736+0000","last_undegraded":"2024-09-17T05:34:35.060736+0000","last_fullsized":"2024-09-17T05:34:35.060736+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:14:18.920767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820173+0000","last_change":"2024-09-17T05:34:33.059901+0000","last_active":"2024-09-17T05:34:35.820173+0000","last_peered":"2024-09-17T05:34:35.820173+0000","last_clean":"2024-09-17T05:34:35.820173+0000","last_became_active":"2024-09-17T05:34:33.059478+0000","last_became_peered":"2024-09-17T05:34:33.059478+0000","last_unstale":"2024-09-17T05:34:35.820173+0000","last_undegraded":"2024-09-17T05:34:35.820173+0000","last_fullsized":"2024-09-17T05:34:35.820173+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:17.994218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824666+0000","last_change":"2024-09-17T05:34:34.059000+0000","last_active":"2024-09-17T05:34:35.824666+0000","last_peered":"2024-09-17T05:34:35.824666+0000","last_clean":"2024-09-17T05:34:35.824666+0000","last_became_active":"2024-09-17T05:34:34.058596+0000","last_became_peered":"2024-09-17T05:34:34.058596+0000","last_unstale":"2024-09-17T05:34:35.824666+0000","last_undegraded":"2024-09-17T05:34:35.824666+0000","last_fullsized":"2024-09-17T05:34:35.824666+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:42.792537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308429+0000","last_change":"2024-09-17T05:34:33.061713+0000","last_active":"2024-09-17T05:34:35.308429+0000","last_peered":"2024-09-17T05:34:35.308429+0000","last_clean":"2024-09-17T05:34:35.308429+0000","last_became_active":"2024-09-17T05:34:33.058269+0000","last_became_peered":"2024-09-17T05:34:33.058269+0000","last_unstale":"2024-09-17T05:34:35.308429+0000","last_undegraded":"2024-09-17T05:34:35.308429+0000","last_fullsized":"2024-09-17T05:34:35.308429+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:41.349784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.059940+0000","last_change":"2024-09-17T05:34:34.066122+0000","last_active":"2024-09-17T05:34:35.059940+0000","last_peered":"2024-09-17T05:34:35.059940+0000","last_clean":"2024-09-17T05:34:35.059940+0000","last_became_active":"2024-09-17T05:34:34.065874+0000","last_became_peered":"2024-09-17T05:34:34.065874+0000","last_unstale":"2024-09-17T05:34:35.059940+0000","last_undegraded":"2024-09-17T05:34:35.059940+0000","last_fullsized":"2024-09-17T05:34:35.059940+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:17.461766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824654+0000","last_change":"2024-09-17T05:34:33.066694+0000","last_active":"2024-09-17T05:34:35.824654+0000","last_peered":"2024-09-17T05:34:35.824654+0000","last_clean":"2024-09-17T05:34:35.824654+0000","last_became_active":"2024-09-17T05:34:33.066446+0000","last_became_peered":"2024-09-17T05:34:33.066446+0000","last_unstale":"2024-09-17T05:34:35.824654+0000","last_undegraded":"2024-09-17T05:34:35.824654+0000","last_fullsized":"2024-09-17T05:34:35.824654+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:44.853325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340784+0000","last_change":"2024-09-17T05:34:34.052402+0000","last_active":"2024-09-17T05:34:35.340784+0000","last_peered":"2024-09-17T05:34:35.340784+0000","last_clean":"2024-09-17T05:34:35.340784+0000","last_became_active":"2024-09-17T05:34:34.051407+0000","last_became_peered":"2024-09-17T05:34:34.051407+0000","last_unstale":"2024-09-17T05:34:35.340784+0000","last_undegraded":"2024-09-17T05:34:35.340784+0000","last_fullsized":"2024-09-17T05:34:35.340784+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:51.254812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340657+0000","last_change":"2024-09-17T05:34:33.053142+0000","last_active":"2024-09-17T05:34:35.340657+0000","last_peered":"2024-09-17T05:34:35.340657+0000","last_clean":"2024-09-17T05:34:35.340657+0000","last_became_active":"2024-09-17T05:34:33.052812+0000","last_became_peered":"2024-09-17T05:34:33.052812+0000","last_unstale":"2024-09-17T05:34:35.340657+0000","last_undegraded":"2024-09-17T05:34:35.340657+0000","last_fullsized":"2024-09-17T05:34:35.340657+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:18.041208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308014+0000","last_change":"2024-09-17T05:34:34.066359+0000","last_active":"2024-09-17T05:34:35.308014+0000","last_peered":"2024-09-17T05:34:35.308014+0000","last_clean":"2024-09-17T05:34:35.308014+0000","last_became_active":"2024-09-17T05:34:34.065935+0000","last_became_peered":"2024-09-17T05:34:34.065935+0000","last_unstale":"2024-09-17T05:34:35.308014+0000","last_undegraded":"2024-09-17T05:34:35.308014+0000","last_fullsized":"2024-09-17T05:34:35.308014+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:08.880501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820256+0000","last_change":"2024-09-17T05:34:33.055315+0000","last_active":"2024-09-17T05:34:35.820256+0000","last_peered":"2024-09-17T05:34:35.820256+0000","last_clean":"2024-09-17T05:34:35.820256+0000","last_became_active":"2024-09-17T05:34:33.055048+0000","last_became_peered":"2024-09-17T05:34:33.055048+0000","last_unstale":"2024-09-17T05:34:35.820256+0000","last_undegraded":"2024-09-17T05:34:35.820256+0000","last_fullsized":"2024-09-17T05:34:35.820256+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:33.090059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824098+0000","last_change":"2024-09-17T05:34:34.079181+0000","last_active":"2024-09-17T05:34:35.824098+0000","last_peered":"2024-09-17T05:34:35.824098+0000","last_clean":"2024-09-17T05:34:35.824098+0000","last_became_active":"2024-09-17T05:34:34.077863+0000","last_became_peered":"2024-09-17T05:34:34.077863+0000","last_unstale":"2024-09-17T05:34:35.824098+0000","last_undegraded":"2024-09-17T05:34:35.824098+0000","last_fullsized":"2024-09-17T05:34:35.824098+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:24:30.440670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824421+0000","last_change":"2024-09-17T05:34:33.058160+0000","last_active":"2024-09-17T05:34:35.824421+0000","last_peered":"2024-09-17T05:34:35.824421+0000","last_clean":"2024-09-17T05:34:35.824421+0000","last_became_active":"2024-09-17T05:34:33.057770+0000","last_became_peered":"2024-09-17T05:34:33.057770+0000","last_unstale":"2024-09-17T05:34:35.824421+0000","last_undegraded":"2024-09-17T05:34:35.824421+0000","last_fullsized":"2024-09-17T05:34:35.824421+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:30.948080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":312,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.823969+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:34:35.823969+0000","last_peered":"2024-09-17T05:34:35.823969+0000","last_clean":"2024-09-17T05:34:35.823969+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:34:35.823969+0000","last_undegraded":"2024-09-17T05:34:35.823969+0000","last_fullsized":"2024-09-17T05:34:35.823969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2048000,"data_stored":1220125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509517,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1441792,"data_stored":629119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542220,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1437696,"data_stored":627619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509517,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1433600,"data_stored":627577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509517,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1437696,"data_stored":627667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509517,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1437696,"data_stored":628123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509515,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1429504,"data_stored":627507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542219,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2023424,"data_stored":1217875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:34:42.520 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:34:42.524 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:34:42.837 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:34:42.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.993+0000 7f8f6ce00640 1 -- 172.21.15.31:0/2349183271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f680b2e80 msgr2=0x7f8f680b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:42.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.993+0000 7f8f6ce00640 1 --2- 172.21.15.31:0/2349183271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f680b2e80 0x7f8f680b1a00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8f50009840 tx=0x7f8f5001c6d0 comp rx=0 tx=0).stop 2024-09-17T05:34:42.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.993+0000 7f8f6ce00640 1 -- 172.21.15.31:0/2349183271 shutdown_connections 2024-09-17T05:34:42.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.993+0000 7f8f6ce00640 1 --2- 172.21.15.31:0/2349183271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f680b2e80 0x7f8f680b1a00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:42.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.993+0000 7f8f6ce00640 1 --2- 172.21.15.31:0/2349183271 >> v2:172.21.15.155:3300/0 conn(0x7f8f6815f490 0x7f8f680b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:42.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.993+0000 7f8f6ce00640 1 -- 172.21.15.31:0/2349183271 >> 172.21.15.31:0/2349183271 conn(0x7f8f680d1e30 msgr2=0x7f8f680d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:42.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.993+0000 7f8f6ce00640 1 -- 172.21.15.31:0/2349183271 shutdown_connections 2024-09-17T05:34:42.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.993+0000 7f8f6ce00640 1 -- 172.21.15.31:0/2349183271 wait complete. 2024-09-17T05:34:42.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.993+0000 7f8f6ce00640 1 Processor -- start 2024-09-17T05:34:42.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.993+0000 7f8f6ce00640 1 -- start start 2024-09-17T05:34:42.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.993+0000 7f8f6ce00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f680b1f40 0x7f8f680b7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:42.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.993+0000 7f8f6ce00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f680b2e80 0x7f8f681502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:42.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.993+0000 7f8f6ce00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f6815f490 0x7f8f68159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:42.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f6ce00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8f68168e90 con 0x7f8f6815f490 2024-09-17T05:34:42.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f6ce00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6815f9e0 con 0x7f8f680b1f40 2024-09-17T05:34:42.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f6ce00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8f68169010 con 0x7f8f680b2e80 2024-09-17T05:34:42.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f66800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f6815f490 0x7f8f68159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:42.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f66800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f6815f490 0x7f8f68159650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45464/0 (socket says 172.21.15.31:45464) 2024-09-17T05:34:42.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f66800640 1 -- 172.21.15.31:0/2443580616 learned_addr learned my addr 172.21.15.31:0/2443580616 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:42.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f5fe00640 1 --2- 172.21.15.31:0/2443580616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f680b2e80 0x7f8f681502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:42.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f65e00640 1 --2- 172.21.15.31:0/2443580616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f680b1f40 0x7f8f680b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:42.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f66800640 1 -- 172.21.15.31:0/2443580616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f680b2e80 msgr2=0x7f8f681502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:42.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f66800640 1 --2- 172.21.15.31:0/2443580616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f680b2e80 0x7f8f681502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:42.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f66800640 1 -- 172.21.15.31:0/2443580616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f680b1f40 msgr2=0x7f8f680b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:42.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f66800640 1 --2- 172.21.15.31:0/2443580616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f680b1f40 0x7f8f680b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:42.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f66800640 1 -- 172.21.15.31:0/2443580616 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f681fb3d0 con 0x7f8f6815f490 2024-09-17T05:34:43.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f66800640 1 --2- 172.21.15.31:0/2443580616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f6815f490 0x7f8f68159650 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000cbc0 tx=0x7f8f6000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:43.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f5e000640 1 -- 172.21.15.31:0/2443580616 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f60016020 con 0x7f8f6815f490 2024-09-17T05:34:43.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f5e000640 1 -- 172.21.15.31:0/2443580616 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f6000ab00 con 0x7f8f6815f490 2024-09-17T05:34:43.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f6ce00640 1 -- 172.21.15.31:0/2443580616 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f680b6940 con 0x7f8f6815f490 2024-09-17T05:34:43.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f5e000640 1 -- 172.21.15.31:0/2443580616 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f60012420 con 0x7f8f6815f490 2024-09-17T05:34:43.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f6ce00640 1 -- 172.21.15.31:0/2443580616 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f681507e0 con 0x7f8f6815f490 2024-09-17T05:34:43.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f6ce00640 1 -- 172.21.15.31:0/2443580616 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f680cfda0 con 0x7f8f6815f490 2024-09-17T05:34:43.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:42.997+0000 7f8f5e000640 1 -- 172.21.15.31:0/2443580616 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f8f60019020 con 0x7f8f6815f490 2024-09-17T05:34:43.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.001+0000 7f8f5e000640 1 --2- 172.21.15.31:0/2443580616 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8f44073680 0x7f8f44075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:43.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.001+0000 7f8f5e000640 1 -- 172.21.15.31:0/2443580616 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5737+0+0 (secure 0 0 0) 0x7f8f60094d00 con 0x7f8f6815f490 2024-09-17T05:34:43.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.001+0000 7f8f65e00640 1 --2- 172.21.15.31:0/2443580616 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8f44073680 0x7f8f44075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:43.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.001+0000 7f8f65e00640 1 --2- 172.21.15.31:0/2443580616 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8f44073680 0x7f8f44075b40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009b40 tx=0x7f8f580091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:43.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.005+0000 7f8f5e000640 1 -- 172.21.15.31:0/2443580616 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8f60020020 con 0x7f8f6815f490 2024-09-17T05:34:43.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.177+0000 7f8f6ce00640 1 -- 172.21.15.31:0/2443580616 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f6815abc0 con 0x7f8f44073680 2024-09-17T05:34:43.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.181+0000 7f8f5e000640 1 -- 172.21.15.31:0/2443580616 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252482 (secure 0 0 0) 0x7f8f6815abc0 con 0x7f8f44073680 2024-09-17T05:34:43.186 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:43.187 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:34:43.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.185+0000 7f8f6ce00640 1 -- 172.21.15.31:0/2443580616 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8f44073680 msgr2=0x7f8f44075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:43.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.185+0000 7f8f6ce00640 1 --2- 172.21.15.31:0/2443580616 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8f44073680 0x7f8f44075b40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009b40 tx=0x7f8f580091e0 comp rx=0 tx=0).stop 2024-09-17T05:34:43.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.185+0000 7f8f6ce00640 1 -- 172.21.15.31:0/2443580616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f6815f490 msgr2=0x7f8f68159650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:43.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.185+0000 7f8f6ce00640 1 --2- 172.21.15.31:0/2443580616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f6815f490 0x7f8f68159650 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000cbc0 tx=0x7f8f6000ccb0 comp rx=0 tx=0).stop 2024-09-17T05:34:43.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.185+0000 7f8f6ce00640 1 -- 172.21.15.31:0/2443580616 shutdown_connections 2024-09-17T05:34:43.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.185+0000 7f8f6ce00640 1 --2- 172.21.15.31:0/2443580616 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8f44073680 0x7f8f44075b40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:43.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.185+0000 7f8f6ce00640 1 --2- 172.21.15.31:0/2443580616 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f6815f490 0x7f8f68159650 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:43.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.185+0000 7f8f6ce00640 1 --2- 172.21.15.31:0/2443580616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8f680b2e80 0x7f8f681502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:43.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.185+0000 7f8f6ce00640 1 --2- 172.21.15.31:0/2443580616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f680b1f40 0x7f8f680b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:43.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.185+0000 7f8f6ce00640 1 -- 172.21.15.31:0/2443580616 >> 172.21.15.31:0/2443580616 conn(0x7f8f680d1e30 msgr2=0x7f8f680cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:43.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.185+0000 7f8f6ce00640 1 -- 172.21.15.31:0/2443580616 shutdown_connections 2024-09-17T05:34:43.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.185+0000 7f8f6ce00640 1 -- 172.21.15.31:0/2443580616 wait complete. 2024-09-17T05:34:43.206 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2024-09-17T05:34:42.725331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261924,"kb_used_data":12392,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712796,"statfs":{"total":773094113280,"available":772825903104,"internally_reserved":0,"allocated":12689408,"data_stored":6205612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.691027"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055190+0000","last_change":"2024-09-17T05:34:34.055750+0000","last_active":"2024-09-17T05:34:35.055190+0000","last_peered":"2024-09-17T05:34:35.055190+0000","last_clean":"2024-09-17T05:34:35.055190+0000","last_became_active":"2024-09-17T05:34:34.055339+0000","last_became_peered":"2024-09-17T05:34:34.055339+0000","last_unstale":"2024-09-17T05:34:35.055190+0000","last_undegraded":"2024-09-17T05:34:35.055190+0000","last_fullsized":"2024-09-17T05:34:35.055190+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:37:27.970525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308260+0000","last_change":"2024-09-17T05:34:34.064991+0000","last_active":"2024-09-17T05:34:35.308260+0000","last_peered":"2024-09-17T05:34:35.308260+0000","last_clean":"2024-09-17T05:34:35.308260+0000","last_became_active":"2024-09-17T05:34:34.064734+0000","last_became_peered":"2024-09-17T05:34:34.064734+0000","last_unstale":"2024-09-17T05:34:35.308260+0000","last_undegraded":"2024-09-17T05:34:35.308260+0000","last_fullsized":"2024-09-17T05:34:35.308260+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:35.842002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824914+0000","last_change":"2024-09-17T05:34:34.060826+0000","last_active":"2024-09-17T05:34:35.824914+0000","last_peered":"2024-09-17T05:34:35.824914+0000","last_clean":"2024-09-17T05:34:35.824914+0000","last_became_active":"2024-09-17T05:34:34.060563+0000","last_became_peered":"2024-09-17T05:34:34.060563+0000","last_unstale":"2024-09-17T05:34:35.824914+0000","last_undegraded":"2024-09-17T05:34:35.824914+0000","last_fullsized":"2024-09-17T05:34:35.824914+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:05.356098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.054940+0000","last_change":"2024-09-17T05:34:34.061282+0000","last_active":"2024-09-17T05:34:35.054940+0000","last_peered":"2024-09-17T05:34:35.054940+0000","last_clean":"2024-09-17T05:34:35.054940+0000","last_became_active":"2024-09-17T05:34:34.060977+0000","last_became_peered":"2024-09-17T05:34:34.060977+0000","last_unstale":"2024-09-17T05:34:35.054940+0000","last_undegraded":"2024-09-17T05:34:35.054940+0000","last_fullsized":"2024-09-17T05:34:35.054940+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:01.869217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824356+0000","last_change":"2024-09-17T05:34:34.061319+0000","last_active":"2024-09-17T05:34:35.824356+0000","last_peered":"2024-09-17T05:34:35.824356+0000","last_clean":"2024-09-17T05:34:35.824356+0000","last_became_active":"2024-09-17T05:34:34.061042+0000","last_became_peered":"2024-09-17T05:34:34.061042+0000","last_unstale":"2024-09-17T05:34:35.824356+0000","last_undegraded":"2024-09-17T05:34:35.824356+0000","last_fullsized":"2024-09-17T05:34:35.824356+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:25.323565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060338+0000","last_change":"2024-09-17T05:34:34.064901+0000","last_active":"2024-09-17T05:34:35.060338+0000","last_peered":"2024-09-17T05:34:35.060338+0000","last_clean":"2024-09-17T05:34:35.060338+0000","last_became_active":"2024-09-17T05:34:34.064606+0000","last_became_peered":"2024-09-17T05:34:34.064606+0000","last_unstale":"2024-09-17T05:34:35.060338+0000","last_undegraded":"2024-09-17T05:34:35.060338+0000","last_fullsized":"2024-09-17T05:34:35.060338+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:04.695299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060590+0000","last_change":"2024-09-17T05:34:34.052907+0000","last_active":"2024-09-17T05:34:35.060590+0000","last_peered":"2024-09-17T05:34:35.060590+0000","last_clean":"2024-09-17T05:34:35.060590+0000","last_became_active":"2024-09-17T05:34:34.052142+0000","last_became_peered":"2024-09-17T05:34:34.052142+0000","last_unstale":"2024-09-17T05:34:35.060590+0000","last_undegraded":"2024-09-17T05:34:35.060590+0000","last_fullsized":"2024-09-17T05:34:35.060590+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:44:28.112098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.823875+0000","last_change":"2024-09-17T05:34:34.058597+0000","last_active":"2024-09-17T05:34:35.823875+0000","last_peered":"2024-09-17T05:34:35.823875+0000","last_clean":"2024-09-17T05:34:35.823875+0000","last_became_active":"2024-09-17T05:34:34.057974+0000","last_became_peered":"2024-09-17T05:34:34.057974+0000","last_unstale":"2024-09-17T05:34:35.823875+0000","last_undegraded":"2024-09-17T05:34:35.823875+0000","last_fullsized":"2024-09-17T05:34:35.823875+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:14.563634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824937+0000","last_change":"2024-09-17T05:34:34.060541+0000","last_active":"2024-09-17T05:34:35.824937+0000","last_peered":"2024-09-17T05:34:35.824937+0000","last_clean":"2024-09-17T05:34:35.824937+0000","last_became_active":"2024-09-17T05:34:34.060177+0000","last_became_peered":"2024-09-17T05:34:34.060177+0000","last_unstale":"2024-09-17T05:34:35.824937+0000","last_undegraded":"2024-09-17T05:34:35.824937+0000","last_fullsized":"2024-09-17T05:34:35.824937+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:39.518711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308509+0000","last_change":"2024-09-17T05:34:34.064257+0000","last_active":"2024-09-17T05:34:35.308509+0000","last_peered":"2024-09-17T05:34:35.308509+0000","last_clean":"2024-09-17T05:34:35.308509+0000","last_became_active":"2024-09-17T05:34:34.063921+0000","last_became_peered":"2024-09-17T05:34:34.063921+0000","last_unstale":"2024-09-17T05:34:35.308509+0000","last_undegraded":"2024-09-17T05:34:35.308509+0000","last_fullsized":"2024-09-17T05:34:35.308509+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:02.587125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820409+0000","last_change":"2024-09-17T05:34:34.062319+0000","last_active":"2024-09-17T05:34:35.820409+0000","last_peered":"2024-09-17T05:34:35.820409+0000","last_clean":"2024-09-17T05:34:35.820409+0000","last_became_active":"2024-09-17T05:34:34.061891+0000","last_became_peered":"2024-09-17T05:34:34.061891+0000","last_unstale":"2024-09-17T05:34:35.820409+0000","last_undegraded":"2024-09-17T05:34:35.820409+0000","last_fullsized":"2024-09-17T05:34:35.820409+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:52.704848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824778+0000","last_change":"2024-09-17T05:34:34.069527+0000","last_active":"2024-09-17T05:34:35.824778+0000","last_peered":"2024-09-17T05:34:35.824778+0000","last_clean":"2024-09-17T05:34:35.824778+0000","last_became_active":"2024-09-17T05:34:34.069203+0000","last_became_peered":"2024-09-17T05:34:34.069203+0000","last_unstale":"2024-09-17T05:34:35.824778+0000","last_undegraded":"2024-09-17T05:34:35.824778+0000","last_fullsized":"2024-09-17T05:34:35.824778+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:58.308625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055208+0000","last_change":"2024-09-17T05:34:34.053461+0000","last_active":"2024-09-17T05:34:35.055208+0000","last_peered":"2024-09-17T05:34:35.055208+0000","last_clean":"2024-09-17T05:34:35.055208+0000","last_became_active":"2024-09-17T05:34:34.053150+0000","last_became_peered":"2024-09-17T05:34:34.053150+0000","last_unstale":"2024-09-17T05:34:35.055208+0000","last_undegraded":"2024-09-17T05:34:35.055208+0000","last_fullsized":"2024-09-17T05:34:35.055208+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:25.698259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308120+0000","last_change":"2024-09-17T05:34:34.068063+0000","last_active":"2024-09-17T05:34:35.308120+0000","last_peered":"2024-09-17T05:34:35.308120+0000","last_clean":"2024-09-17T05:34:35.308120+0000","last_became_active":"2024-09-17T05:34:34.067740+0000","last_became_peered":"2024-09-17T05:34:34.067740+0000","last_unstale":"2024-09-17T05:34:35.308120+0000","last_undegraded":"2024-09-17T05:34:35.308120+0000","last_fullsized":"2024-09-17T05:34:35.308120+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:35:35.468348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.054751+0000","last_change":"2024-09-17T05:34:34.050124+0000","last_active":"2024-09-17T05:34:35.054751+0000","last_peered":"2024-09-17T05:34:35.054751+0000","last_clean":"2024-09-17T05:34:35.054751+0000","last_became_active":"2024-09-17T05:34:34.049793+0000","last_became_peered":"2024-09-17T05:34:34.049793+0000","last_unstale":"2024-09-17T05:34:35.054751+0000","last_undegraded":"2024-09-17T05:34:35.054751+0000","last_fullsized":"2024-09-17T05:34:35.054751+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:14.195829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340889+0000","last_change":"2024-09-17T05:34:34.075280+0000","last_active":"2024-09-17T05:34:35.340889+0000","last_peered":"2024-09-17T05:34:35.340889+0000","last_clean":"2024-09-17T05:34:35.340889+0000","last_became_active":"2024-09-17T05:34:34.074846+0000","last_became_peered":"2024-09-17T05:34:34.074846+0000","last_unstale":"2024-09-17T05:34:35.340889+0000","last_undegraded":"2024-09-17T05:34:35.340889+0000","last_fullsized":"2024-09-17T05:34:35.340889+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:56.401594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060208+0000","last_change":"2024-09-17T05:34:34.062265+0000","last_active":"2024-09-17T05:34:35.060208+0000","last_peered":"2024-09-17T05:34:35.060208+0000","last_clean":"2024-09-17T05:34:35.060208+0000","last_became_active":"2024-09-17T05:34:34.061946+0000","last_became_peered":"2024-09-17T05:34:34.061946+0000","last_unstale":"2024-09-17T05:34:35.060208+0000","last_undegraded":"2024-09-17T05:34:35.060208+0000","last_fullsized":"2024-09-17T05:34:35.060208+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:44.745005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340991+0000","last_change":"2024-09-17T05:34:34.056046+0000","last_active":"2024-09-17T05:34:35.340991+0000","last_peered":"2024-09-17T05:34:35.340991+0000","last_clean":"2024-09-17T05:34:35.340991+0000","last_became_active":"2024-09-17T05:34:34.055395+0000","last_became_peered":"2024-09-17T05:34:34.055395+0000","last_unstale":"2024-09-17T05:34:35.340991+0000","last_undegraded":"2024-09-17T05:34:35.340991+0000","last_fullsized":"2024-09-17T05:34:35.340991+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:24:30.440670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820609+0000","last_change":"2024-09-17T05:34:34.053760+0000","last_active":"2024-09-17T05:34:35.820609+0000","last_peered":"2024-09-17T05:34:35.820609+0000","last_clean":"2024-09-17T05:34:35.820609+0000","last_became_active":"2024-09-17T05:34:34.053404+0000","last_became_peered":"2024-09-17T05:34:34.053404+0000","last_unstale":"2024-09-17T05:34:35.820609+0000","last_undegraded":"2024-09-17T05:34:35.820609+0000","last_fullsized":"2024-09-17T05:34:35.820609+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:00.251054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340917+0000","last_change":"2024-09-17T05:34:34.069933+0000","last_active":"2024-09-17T05:34:35.340917+0000","last_peered":"2024-09-17T05:34:35.340917+0000","last_clean":"2024-09-17T05:34:35.340917+0000","last_became_active":"2024-09-17T05:34:34.069588+0000","last_became_peered":"2024-09-17T05:34:34.069588+0000","last_unstale":"2024-09-17T05:34:35.340917+0000","last_undegraded":"2024-09-17T05:34:35.340917+0000","last_fullsized":"2024-09-17T05:34:35.340917+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:46.802117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824227+0000","last_change":"2024-09-17T05:34:34.060634+0000","last_active":"2024-09-17T05:34:35.824227+0000","last_peered":"2024-09-17T05:34:35.824227+0000","last_clean":"2024-09-17T05:34:35.824227+0000","last_became_active":"2024-09-17T05:34:34.060351+0000","last_became_peered":"2024-09-17T05:34:34.060351+0000","last_unstale":"2024-09-17T05:34:35.824227+0000","last_undegraded":"2024-09-17T05:34:35.824227+0000","last_fullsized":"2024-09-17T05:34:35.824227+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:05.798788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820214+0000","last_change":"2024-09-17T05:34:34.066387+0000","last_active":"2024-09-17T05:34:35.820214+0000","last_peered":"2024-09-17T05:34:35.820214+0000","last_clean":"2024-09-17T05:34:35.820214+0000","last_became_active":"2024-09-17T05:34:34.066139+0000","last_became_peered":"2024-09-17T05:34:34.066139+0000","last_unstale":"2024-09-17T05:34:35.820214+0000","last_undegraded":"2024-09-17T05:34:35.820214+0000","last_fullsized":"2024-09-17T05:34:35.820214+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:31.838964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824485+0000","last_change":"2024-09-17T05:34:34.062062+0000","last_active":"2024-09-17T05:34:35.824485+0000","last_peered":"2024-09-17T05:34:35.824485+0000","last_clean":"2024-09-17T05:34:35.824485+0000","last_became_active":"2024-09-17T05:34:34.059953+0000","last_became_peered":"2024-09-17T05:34:34.059953+0000","last_unstale":"2024-09-17T05:34:35.824485+0000","last_undegraded":"2024-09-17T05:34:35.824485+0000","last_fullsized":"2024-09-17T05:34:35.824485+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:07.523538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820302+0000","last_change":"2024-09-17T05:34:34.057766+0000","last_active":"2024-09-17T05:34:35.820302+0000","last_peered":"2024-09-17T05:34:35.820302+0000","last_clean":"2024-09-17T05:34:35.820302+0000","last_became_active":"2024-09-17T05:34:34.057278+0000","last_became_peered":"2024-09-17T05:34:34.057278+0000","last_unstale":"2024-09-17T05:34:35.820302+0000","last_undegraded":"2024-09-17T05:34:35.820302+0000","last_fullsized":"2024-09-17T05:34:35.820302+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:56.603465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308568+0000","last_change":"2024-09-17T05:34:34.065158+0000","last_active":"2024-09-17T05:34:35.308568+0000","last_peered":"2024-09-17T05:34:35.308568+0000","last_clean":"2024-09-17T05:34:35.308568+0000","last_became_active":"2024-09-17T05:34:34.064854+0000","last_became_peered":"2024-09-17T05:34:34.064854+0000","last_unstale":"2024-09-17T05:34:35.308568+0000","last_undegraded":"2024-09-17T05:34:35.308568+0000","last_fullsized":"2024-09-17T05:34:35.308568+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:33.652582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340978+0000","last_change":"2024-09-17T05:34:34.078814+0000","last_active":"2024-09-17T05:34:35.340978+0000","last_peered":"2024-09-17T05:34:35.340978+0000","last_clean":"2024-09-17T05:34:35.340978+0000","last_became_active":"2024-09-17T05:34:34.077965+0000","last_became_peered":"2024-09-17T05:34:34.077965+0000","last_unstale":"2024-09-17T05:34:35.340978+0000","last_undegraded":"2024-09-17T05:34:35.340978+0000","last_fullsized":"2024-09-17T05:34:35.340978+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:43.780806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.054990+0000","last_change":"2024-09-17T05:34:34.049290+0000","last_active":"2024-09-17T05:34:35.054990+0000","last_peered":"2024-09-17T05:34:35.054990+0000","last_clean":"2024-09-17T05:34:35.054990+0000","last_became_active":"2024-09-17T05:34:34.048975+0000","last_became_peered":"2024-09-17T05:34:34.048975+0000","last_unstale":"2024-09-17T05:34:35.054990+0000","last_undegraded":"2024-09-17T05:34:35.054990+0000","last_fullsized":"2024-09-17T05:34:35.054990+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:59.063927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.059840+0000","last_change":"2024-09-17T05:34:34.053789+0000","last_active":"2024-09-17T05:34:35.059840+0000","last_peered":"2024-09-17T05:34:35.059840+0000","last_clean":"2024-09-17T05:34:35.059840+0000","last_became_active":"2024-09-17T05:34:34.053466+0000","last_became_peered":"2024-09-17T05:34:34.053466+0000","last_unstale":"2024-09-17T05:34:35.059840+0000","last_undegraded":"2024-09-17T05:34:35.059840+0000","last_fullsized":"2024-09-17T05:34:35.059840+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:40:25.864261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.054977+0000","last_change":"2024-09-17T05:34:34.058615+0000","last_active":"2024-09-17T05:34:35.054977+0000","last_peered":"2024-09-17T05:34:35.054977+0000","last_clean":"2024-09-17T05:34:35.054977+0000","last_became_active":"2024-09-17T05:34:34.058250+0000","last_became_peered":"2024-09-17T05:34:34.058250+0000","last_unstale":"2024-09-17T05:34:35.054977+0000","last_undegraded":"2024-09-17T05:34:35.054977+0000","last_fullsized":"2024-09-17T05:34:35.054977+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:05.508279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055122+0000","last_change":"2024-09-17T05:34:34.050440+0000","last_active":"2024-09-17T05:34:35.055122+0000","last_peered":"2024-09-17T05:34:35.055122+0000","last_clean":"2024-09-17T05:34:35.055122+0000","last_became_active":"2024-09-17T05:34:34.050065+0000","last_became_peered":"2024-09-17T05:34:34.050065+0000","last_unstale":"2024-09-17T05:34:35.055122+0000","last_undegraded":"2024-09-17T05:34:35.055122+0000","last_fullsized":"2024-09-17T05:34:35.055122+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:12.157816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824200+0000","last_change":"2024-09-17T05:34:34.078291+0000","last_active":"2024-09-17T05:34:35.824200+0000","last_peered":"2024-09-17T05:34:35.824200+0000","last_clean":"2024-09-17T05:34:35.824200+0000","last_became_active":"2024-09-17T05:34:34.078014+0000","last_became_peered":"2024-09-17T05:34:34.078014+0000","last_unstale":"2024-09-17T05:34:35.824200+0000","last_undegraded":"2024-09-17T05:34:35.824200+0000","last_fullsized":"2024-09-17T05:34:35.824200+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:04:30.198638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.059792+0000","last_change":"2024-09-17T05:34:34.053475+0000","last_active":"2024-09-17T05:34:35.059792+0000","last_peered":"2024-09-17T05:34:35.059792+0000","last_clean":"2024-09-17T05:34:35.059792+0000","last_became_active":"2024-09-17T05:34:34.053168+0000","last_became_peered":"2024-09-17T05:34:34.053168+0000","last_unstale":"2024-09-17T05:34:35.059792+0000","last_undegraded":"2024-09-17T05:34:35.059792+0000","last_fullsized":"2024-09-17T05:34:35.059792+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:53.847482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.341197+0000","last_change":"2024-09-17T05:34:34.056102+0000","last_active":"2024-09-17T05:34:35.341197+0000","last_peered":"2024-09-17T05:34:35.341197+0000","last_clean":"2024-09-17T05:34:35.341197+0000","last_became_active":"2024-09-17T05:34:34.055779+0000","last_became_peered":"2024-09-17T05:34:34.055779+0000","last_unstale":"2024-09-17T05:34:35.341197+0000","last_undegraded":"2024-09-17T05:34:35.341197+0000","last_fullsized":"2024-09-17T05:34:35.341197+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:58.561334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"114'4","reported_seq":19,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825235+0000","last_change":"2024-09-17T05:34:33.060411+0000","last_active":"2024-09-17T05:34:35.825235+0000","last_peered":"2024-09-17T05:34:35.825235+0000","last_clean":"2024-09-17T05:34:35.825235+0000","last_became_active":"2024-09-17T05:34:33.060044+0000","last_became_peered":"2024-09-17T05:34:33.060044+0000","last_unstale":"2024-09-17T05:34:35.825235+0000","last_undegraded":"2024-09-17T05:34:35.825235+0000","last_fullsized":"2024-09-17T05:34:35.825235+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:18.211934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825046+0000","last_change":"2024-09-17T05:34:34.077842+0000","last_active":"2024-09-17T05:34:35.825046+0000","last_peered":"2024-09-17T05:34:35.825046+0000","last_clean":"2024-09-17T05:34:35.825046+0000","last_became_active":"2024-09-17T05:34:34.077560+0000","last_became_peered":"2024-09-17T05:34:34.077560+0000","last_unstale":"2024-09-17T05:34:35.825046+0000","last_undegraded":"2024-09-17T05:34:35.825046+0000","last_fullsized":"2024-09-17T05:34:35.825046+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:30.999293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060668+0000","last_change":"2024-09-17T05:34:33.062317+0000","last_active":"2024-09-17T05:34:35.060668+0000","last_peered":"2024-09-17T05:34:35.060668+0000","last_clean":"2024-09-17T05:34:35.060668+0000","last_became_active":"2024-09-17T05:34:33.061996+0000","last_became_peered":"2024-09-17T05:34:33.061996+0000","last_unstale":"2024-09-17T05:34:35.060668+0000","last_undegraded":"2024-09-17T05:34:35.060668+0000","last_fullsized":"2024-09-17T05:34:35.060668+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:24.141886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825177+0000","last_change":"2024-09-17T05:34:34.068416+0000","last_active":"2024-09-17T05:34:35.825177+0000","last_peered":"2024-09-17T05:34:35.825177+0000","last_clean":"2024-09-17T05:34:35.825177+0000","last_became_active":"2024-09-17T05:34:34.068076+0000","last_became_peered":"2024-09-17T05:34:34.068076+0000","last_unstale":"2024-09-17T05:34:35.825177+0000","last_undegraded":"2024-09-17T05:34:35.825177+0000","last_fullsized":"2024-09-17T05:34:35.825177+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:22.876201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820554+0000","last_change":"2024-09-17T05:34:33.062863+0000","last_active":"2024-09-17T05:34:35.820554+0000","last_peered":"2024-09-17T05:34:35.820554+0000","last_clean":"2024-09-17T05:34:35.820554+0000","last_became_active":"2024-09-17T05:34:33.062606+0000","last_became_peered":"2024-09-17T05:34:33.062606+0000","last_unstale":"2024-09-17T05:34:35.820554+0000","last_undegraded":"2024-09-17T05:34:35.820554+0000","last_fullsized":"2024-09-17T05:34:35.820554+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:47:37.910420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825201+0000","last_change":"2024-09-17T05:34:34.072411+0000","last_active":"2024-09-17T05:34:35.825201+0000","last_peered":"2024-09-17T05:34:35.825201+0000","last_clean":"2024-09-17T05:34:35.825201+0000","last_became_active":"2024-09-17T05:34:34.071876+0000","last_became_peered":"2024-09-17T05:34:34.071876+0000","last_unstale":"2024-09-17T05:34:35.825201+0000","last_undegraded":"2024-09-17T05:34:35.825201+0000","last_fullsized":"2024-09-17T05:34:35.825201+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:22.523783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308387+0000","last_change":"2024-09-17T05:34:33.061506+0000","last_active":"2024-09-17T05:34:35.308387+0000","last_peered":"2024-09-17T05:34:35.308387+0000","last_clean":"2024-09-17T05:34:35.308387+0000","last_became_active":"2024-09-17T05:34:33.060829+0000","last_became_peered":"2024-09-17T05:34:33.060829+0000","last_unstale":"2024-09-17T05:34:35.308387+0000","last_undegraded":"2024-09-17T05:34:35.308387+0000","last_fullsized":"2024-09-17T05:34:35.308387+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:01.183566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340894+0000","last_change":"2024-09-17T05:34:34.049231+0000","last_active":"2024-09-17T05:34:35.340894+0000","last_peered":"2024-09-17T05:34:35.340894+0000","last_clean":"2024-09-17T05:34:35.340894+0000","last_became_active":"2024-09-17T05:34:34.048974+0000","last_became_peered":"2024-09-17T05:34:34.048974+0000","last_unstale":"2024-09-17T05:34:35.340894+0000","last_undegraded":"2024-09-17T05:34:35.340894+0000","last_fullsized":"2024-09-17T05:34:35.340894+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:47:19.598707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.307983+0000","last_change":"2024-09-17T05:34:33.062761+0000","last_active":"2024-09-17T05:34:35.307983+0000","last_peered":"2024-09-17T05:34:35.307983+0000","last_clean":"2024-09-17T05:34:35.307983+0000","last_became_active":"2024-09-17T05:34:33.062415+0000","last_became_peered":"2024-09-17T05:34:33.062415+0000","last_unstale":"2024-09-17T05:34:35.307983+0000","last_undegraded":"2024-09-17T05:34:35.307983+0000","last_fullsized":"2024-09-17T05:34:35.307983+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:31.919752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060120+0000","last_change":"2024-09-17T05:34:34.055171+0000","last_active":"2024-09-17T05:34:35.060120+0000","last_peered":"2024-09-17T05:34:35.060120+0000","last_clean":"2024-09-17T05:34:35.060120+0000","last_became_active":"2024-09-17T05:34:34.054552+0000","last_became_peered":"2024-09-17T05:34:34.054552+0000","last_unstale":"2024-09-17T05:34:35.060120+0000","last_undegraded":"2024-09-17T05:34:35.060120+0000","last_fullsized":"2024-09-17T05:34:35.060120+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:50.789978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340608+0000","last_change":"2024-09-17T05:34:33.057749+0000","last_active":"2024-09-17T05:34:35.340608+0000","last_peered":"2024-09-17T05:34:35.340608+0000","last_clean":"2024-09-17T05:34:35.340608+0000","last_became_active":"2024-09-17T05:34:33.057379+0000","last_became_peered":"2024-09-17T05:34:33.057379+0000","last_unstale":"2024-09-17T05:34:35.340608+0000","last_undegraded":"2024-09-17T05:34:35.340608+0000","last_fullsized":"2024-09-17T05:34:35.340608+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:22:51.977468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.823917+0000","last_change":"2024-09-17T05:34:34.058285+0000","last_active":"2024-09-17T05:34:35.823917+0000","last_peered":"2024-09-17T05:34:35.823917+0000","last_clean":"2024-09-17T05:34:35.823917+0000","last_became_active":"2024-09-17T05:34:34.057608+0000","last_became_peered":"2024-09-17T05:34:34.057608+0000","last_unstale":"2024-09-17T05:34:35.823917+0000","last_undegraded":"2024-09-17T05:34:35.823917+0000","last_fullsized":"2024-09-17T05:34:35.823917+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:06.776364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.059760+0000","last_change":"2024-09-17T05:34:33.058494+0000","last_active":"2024-09-17T05:34:35.059760+0000","last_peered":"2024-09-17T05:34:35.059760+0000","last_clean":"2024-09-17T05:34:35.059760+0000","last_became_active":"2024-09-17T05:34:33.057230+0000","last_became_peered":"2024-09-17T05:34:33.057230+0000","last_unstale":"2024-09-17T05:34:35.059760+0000","last_undegraded":"2024-09-17T05:34:35.059760+0000","last_fullsized":"2024-09-17T05:34:35.059760+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:06.513338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308163+0000","last_change":"2024-09-17T05:34:34.064359+0000","last_active":"2024-09-17T05:34:35.308163+0000","last_peered":"2024-09-17T05:34:35.308163+0000","last_clean":"2024-09-17T05:34:35.308163+0000","last_became_active":"2024-09-17T05:34:34.064027+0000","last_became_peered":"2024-09-17T05:34:34.064027+0000","last_unstale":"2024-09-17T05:34:35.308163+0000","last_undegraded":"2024-09-17T05:34:35.308163+0000","last_fullsized":"2024-09-17T05:34:35.308163+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:31.748946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308230+0000","last_change":"2024-09-17T05:34:33.060390+0000","last_active":"2024-09-17T05:34:35.308230+0000","last_peered":"2024-09-17T05:34:35.308230+0000","last_clean":"2024-09-17T05:34:35.308230+0000","last_became_active":"2024-09-17T05:34:33.059726+0000","last_became_peered":"2024-09-17T05:34:33.059726+0000","last_unstale":"2024-09-17T05:34:35.308230+0000","last_undegraded":"2024-09-17T05:34:35.308230+0000","last_fullsized":"2024-09-17T05:34:35.308230+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:00.111980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055526+0000","last_change":"2024-09-17T05:34:34.063038+0000","last_active":"2024-09-17T05:34:35.055526+0000","last_peered":"2024-09-17T05:34:35.055526+0000","last_clean":"2024-09-17T05:34:35.055526+0000","last_became_active":"2024-09-17T05:34:34.062775+0000","last_became_peered":"2024-09-17T05:34:34.062775+0000","last_unstale":"2024-09-17T05:34:35.055526+0000","last_undegraded":"2024-09-17T05:34:35.055526+0000","last_fullsized":"2024-09-17T05:34:35.055526+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:07.115420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.061873+0000","last_change":"2024-09-17T05:34:33.055033+0000","last_active":"2024-09-17T05:34:35.061873+0000","last_peered":"2024-09-17T05:34:35.061873+0000","last_clean":"2024-09-17T05:34:35.061873+0000","last_became_active":"2024-09-17T05:34:33.053730+0000","last_became_peered":"2024-09-17T05:34:33.053730+0000","last_unstale":"2024-09-17T05:34:35.061873+0000","last_undegraded":"2024-09-17T05:34:35.061873+0000","last_fullsized":"2024-09-17T05:34:35.061873+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:21:45.665453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.061724+0000","last_change":"2024-09-17T05:34:34.055421+0000","last_active":"2024-09-17T05:34:35.061724+0000","last_peered":"2024-09-17T05:34:35.061724+0000","last_clean":"2024-09-17T05:34:35.061724+0000","last_became_active":"2024-09-17T05:34:34.055124+0000","last_became_peered":"2024-09-17T05:34:34.055124+0000","last_unstale":"2024-09-17T05:34:35.061724+0000","last_undegraded":"2024-09-17T05:34:35.061724+0000","last_fullsized":"2024-09-17T05:34:35.061724+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:38.127405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.341138+0000","last_change":"2024-09-17T05:34:33.053229+0000","last_active":"2024-09-17T05:34:35.341138+0000","last_peered":"2024-09-17T05:34:35.341138+0000","last_clean":"2024-09-17T05:34:35.341138+0000","last_became_active":"2024-09-17T05:34:33.052960+0000","last_became_peered":"2024-09-17T05:34:33.052960+0000","last_unstale":"2024-09-17T05:34:35.341138+0000","last_undegraded":"2024-09-17T05:34:35.341138+0000","last_fullsized":"2024-09-17T05:34:35.341138+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:44.853325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825227+0000","last_change":"2024-09-17T05:34:34.067686+0000","last_active":"2024-09-17T05:34:35.825227+0000","last_peered":"2024-09-17T05:34:35.825227+0000","last_clean":"2024-09-17T05:34:35.825227+0000","last_became_active":"2024-09-17T05:34:34.064490+0000","last_became_peered":"2024-09-17T05:34:34.064490+0000","last_unstale":"2024-09-17T05:34:35.825227+0000","last_undegraded":"2024-09-17T05:34:35.825227+0000","last_fullsized":"2024-09-17T05:34:35.825227+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:23.888318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"114'3","reported_seq":18,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060791+0000","last_change":"2024-09-17T05:34:33.054751+0000","last_active":"2024-09-17T05:34:35.060791+0000","last_peered":"2024-09-17T05:34:35.060791+0000","last_clean":"2024-09-17T05:34:35.060791+0000","last_became_active":"2024-09-17T05:34:33.054460+0000","last_became_peered":"2024-09-17T05:34:33.054460+0000","last_unstale":"2024-09-17T05:34:35.060791+0000","last_undegraded":"2024-09-17T05:34:35.060791+0000","last_fullsized":"2024-09-17T05:34:35.060791+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:06:02.019659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825387+0000","last_change":"2024-09-17T05:34:34.063549+0000","last_active":"2024-09-17T05:34:35.825387+0000","last_peered":"2024-09-17T05:34:35.825387+0000","last_clean":"2024-09-17T05:34:35.825387+0000","last_became_active":"2024-09-17T05:34:34.063248+0000","last_became_peered":"2024-09-17T05:34:34.063248+0000","last_unstale":"2024-09-17T05:34:35.825387+0000","last_undegraded":"2024-09-17T05:34:35.825387+0000","last_fullsized":"2024-09-17T05:34:35.825387+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:57.703158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"114'6","reported_seq":21,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824875+0000","last_change":"2024-09-17T05:34:33.057015+0000","last_active":"2024-09-17T05:34:35.824875+0000","last_peered":"2024-09-17T05:34:35.824875+0000","last_clean":"2024-09-17T05:34:35.824875+0000","last_became_active":"2024-09-17T05:34:33.056734+0000","last_became_peered":"2024-09-17T05:34:33.056734+0000","last_unstale":"2024-09-17T05:34:35.824875+0000","last_undegraded":"2024-09-17T05:34:35.824875+0000","last_fullsized":"2024-09-17T05:34:35.824875+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:34.831803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055205+0000","last_change":"2024-09-17T05:34:34.062614+0000","last_active":"2024-09-17T05:34:35.055205+0000","last_peered":"2024-09-17T05:34:35.055205+0000","last_clean":"2024-09-17T05:34:35.055205+0000","last_became_active":"2024-09-17T05:34:34.062249+0000","last_became_peered":"2024-09-17T05:34:34.062249+0000","last_unstale":"2024-09-17T05:34:35.055205+0000","last_undegraded":"2024-09-17T05:34:35.055205+0000","last_fullsized":"2024-09-17T05:34:35.055205+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:00:38.101184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055387+0000","last_change":"2024-09-17T05:34:33.050723+0000","last_active":"2024-09-17T05:34:35.055387+0000","last_peered":"2024-09-17T05:34:35.055387+0000","last_clean":"2024-09-17T05:34:35.055387+0000","last_became_active":"2024-09-17T05:34:33.050285+0000","last_became_peered":"2024-09-17T05:34:33.050285+0000","last_unstale":"2024-09-17T05:34:35.055387+0000","last_undegraded":"2024-09-17T05:34:35.055387+0000","last_fullsized":"2024-09-17T05:34:35.055387+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:56:29.206583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.307999+0000","last_change":"2024-09-17T05:34:34.072871+0000","last_active":"2024-09-17T05:34:35.307999+0000","last_peered":"2024-09-17T05:34:35.307999+0000","last_clean":"2024-09-17T05:34:35.307999+0000","last_became_active":"2024-09-17T05:34:34.072586+0000","last_became_peered":"2024-09-17T05:34:34.072586+0000","last_unstale":"2024-09-17T05:34:35.307999+0000","last_undegraded":"2024-09-17T05:34:35.307999+0000","last_fullsized":"2024-09-17T05:34:35.307999+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:41.983789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308300+0000","last_change":"2024-09-17T05:34:33.057209+0000","last_active":"2024-09-17T05:34:35.308300+0000","last_peered":"2024-09-17T05:34:35.308300+0000","last_clean":"2024-09-17T05:34:35.308300+0000","last_became_active":"2024-09-17T05:34:33.056797+0000","last_became_peered":"2024-09-17T05:34:33.056797+0000","last_unstale":"2024-09-17T05:34:35.308300+0000","last_undegraded":"2024-09-17T05:34:35.308300+0000","last_fullsized":"2024-09-17T05:34:35.308300+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:19.076711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824265+0000","last_change":"2024-09-17T05:34:34.064005+0000","last_active":"2024-09-17T05:34:35.824265+0000","last_peered":"2024-09-17T05:34:35.824265+0000","last_clean":"2024-09-17T05:34:35.824265+0000","last_became_active":"2024-09-17T05:34:34.060338+0000","last_became_peered":"2024-09-17T05:34:34.060338+0000","last_unstale":"2024-09-17T05:34:35.824265+0000","last_undegraded":"2024-09-17T05:34:35.824265+0000","last_fullsized":"2024-09-17T05:34:35.824265+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:10.771359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"114'8","reported_seq":23,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824069+0000","last_change":"2024-09-17T05:34:33.065180+0000","last_active":"2024-09-17T05:34:35.824069+0000","last_peered":"2024-09-17T05:34:35.824069+0000","last_clean":"2024-09-17T05:34:35.824069+0000","last_became_active":"2024-09-17T05:34:33.064968+0000","last_became_peered":"2024-09-17T05:34:33.064968+0000","last_unstale":"2024-09-17T05:34:35.824069+0000","last_undegraded":"2024-09-17T05:34:35.824069+0000","last_fullsized":"2024-09-17T05:34:35.824069+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:09.728225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824902+0000","last_change":"2024-09-17T05:34:34.070480+0000","last_active":"2024-09-17T05:34:35.824902+0000","last_peered":"2024-09-17T05:34:35.824902+0000","last_clean":"2024-09-17T05:34:35.824902+0000","last_became_active":"2024-09-17T05:34:34.069303+0000","last_became_peered":"2024-09-17T05:34:34.069303+0000","last_unstale":"2024-09-17T05:34:35.824902+0000","last_undegraded":"2024-09-17T05:34:35.824902+0000","last_fullsized":"2024-09-17T05:34:35.824902+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:36.024997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.061928+0000","last_change":"2024-09-17T05:34:33.056067+0000","last_active":"2024-09-17T05:34:35.061928+0000","last_peered":"2024-09-17T05:34:35.061928+0000","last_clean":"2024-09-17T05:34:35.061928+0000","last_became_active":"2024-09-17T05:34:33.055790+0000","last_became_peered":"2024-09-17T05:34:33.055790+0000","last_unstale":"2024-09-17T05:34:35.061928+0000","last_undegraded":"2024-09-17T05:34:35.061928+0000","last_fullsized":"2024-09-17T05:34:35.061928+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:33.135478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.061779+0000","last_change":"2024-09-17T05:34:34.061817+0000","last_active":"2024-09-17T05:34:35.061779+0000","last_peered":"2024-09-17T05:34:35.061779+0000","last_clean":"2024-09-17T05:34:35.061779+0000","last_became_active":"2024-09-17T05:34:34.061394+0000","last_became_peered":"2024-09-17T05:34:34.061394+0000","last_unstale":"2024-09-17T05:34:35.061779+0000","last_undegraded":"2024-09-17T05:34:35.061779+0000","last_fullsized":"2024-09-17T05:34:35.061779+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:21.288618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820430+0000","last_change":"2024-09-17T05:34:33.063900+0000","last_active":"2024-09-17T05:34:35.820430+0000","last_peered":"2024-09-17T05:34:35.820430+0000","last_clean":"2024-09-17T05:34:35.820430+0000","last_became_active":"2024-09-17T05:34:33.063632+0000","last_became_peered":"2024-09-17T05:34:33.063632+0000","last_unstale":"2024-09-17T05:34:35.820430+0000","last_undegraded":"2024-09-17T05:34:35.820430+0000","last_fullsized":"2024-09-17T05:34:35.820430+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:53:26.921272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340985+0000","last_change":"2024-09-17T05:34:34.075935+0000","last_active":"2024-09-17T05:34:35.340985+0000","last_peered":"2024-09-17T05:34:35.340985+0000","last_clean":"2024-09-17T05:34:35.340985+0000","last_became_active":"2024-09-17T05:34:34.074477+0000","last_became_peered":"2024-09-17T05:34:34.074477+0000","last_unstale":"2024-09-17T05:34:35.340985+0000","last_undegraded":"2024-09-17T05:34:35.340985+0000","last_fullsized":"2024-09-17T05:34:35.340985+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:34:06.767712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060893+0000","last_change":"2024-09-17T05:34:33.063478+0000","last_active":"2024-09-17T05:34:35.060893+0000","last_peered":"2024-09-17T05:34:35.060893+0000","last_clean":"2024-09-17T05:34:35.060893+0000","last_became_active":"2024-09-17T05:34:33.062829+0000","last_became_peered":"2024-09-17T05:34:33.062829+0000","last_unstale":"2024-09-17T05:34:35.060893+0000","last_undegraded":"2024-09-17T05:34:35.060893+0000","last_fullsized":"2024-09-17T05:34:35.060893+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:57.298426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308271+0000","last_change":"2024-09-17T05:34:34.064589+0000","last_active":"2024-09-17T05:34:35.308271+0000","last_peered":"2024-09-17T05:34:35.308271+0000","last_clean":"2024-09-17T05:34:35.308271+0000","last_became_active":"2024-09-17T05:34:34.064291+0000","last_became_peered":"2024-09-17T05:34:34.064291+0000","last_unstale":"2024-09-17T05:34:35.308271+0000","last_undegraded":"2024-09-17T05:34:35.308271+0000","last_fullsized":"2024-09-17T05:34:35.308271+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:10.738424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060239+0000","last_change":"2024-09-17T05:34:33.061407+0000","last_active":"2024-09-17T05:34:35.060239+0000","last_peered":"2024-09-17T05:34:35.060239+0000","last_clean":"2024-09-17T05:34:35.060239+0000","last_became_active":"2024-09-17T05:34:33.061107+0000","last_became_peered":"2024-09-17T05:34:33.061107+0000","last_unstale":"2024-09-17T05:34:35.060239+0000","last_undegraded":"2024-09-17T05:34:35.060239+0000","last_fullsized":"2024-09-17T05:34:35.060239+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:52.128959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055349+0000","last_change":"2024-09-17T05:34:34.048103+0000","last_active":"2024-09-17T05:34:35.055349+0000","last_peered":"2024-09-17T05:34:35.055349+0000","last_clean":"2024-09-17T05:34:35.055349+0000","last_became_active":"2024-09-17T05:34:34.047778+0000","last_became_peered":"2024-09-17T05:34:34.047778+0000","last_unstale":"2024-09-17T05:34:35.055349+0000","last_undegraded":"2024-09-17T05:34:35.055349+0000","last_fullsized":"2024-09-17T05:34:35.055349+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:08.470009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060095+0000","last_change":"2024-09-17T05:34:33.053534+0000","last_active":"2024-09-17T05:34:35.060095+0000","last_peered":"2024-09-17T05:34:35.060095+0000","last_clean":"2024-09-17T05:34:35.060095+0000","last_became_active":"2024-09-17T05:34:33.053241+0000","last_became_peered":"2024-09-17T05:34:33.053241+0000","last_unstale":"2024-09-17T05:34:35.060095+0000","last_undegraded":"2024-09-17T05:34:35.060095+0000","last_fullsized":"2024-09-17T05:34:35.060095+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:11.021007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060369+0000","last_change":"2024-09-17T05:34:34.054874+0000","last_active":"2024-09-17T05:34:35.060369+0000","last_peered":"2024-09-17T05:34:35.060369+0000","last_clean":"2024-09-17T05:34:35.060369+0000","last_became_active":"2024-09-17T05:34:34.054212+0000","last_became_peered":"2024-09-17T05:34:34.054212+0000","last_unstale":"2024-09-17T05:34:35.060369+0000","last_undegraded":"2024-09-17T05:34:35.060369+0000","last_fullsized":"2024-09-17T05:34:35.060369+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:33.184808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340732+0000","last_change":"2024-09-17T05:34:33.053720+0000","last_active":"2024-09-17T05:34:35.340732+0000","last_peered":"2024-09-17T05:34:35.340732+0000","last_clean":"2024-09-17T05:34:35.340732+0000","last_became_active":"2024-09-17T05:34:33.053422+0000","last_became_peered":"2024-09-17T05:34:33.053422+0000","last_unstale":"2024-09-17T05:34:35.340732+0000","last_undegraded":"2024-09-17T05:34:35.340732+0000","last_fullsized":"2024-09-17T05:34:35.340732+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:18.671717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308049+0000","last_change":"2024-09-17T05:34:34.077530+0000","last_active":"2024-09-17T05:34:35.308049+0000","last_peered":"2024-09-17T05:34:35.308049+0000","last_clean":"2024-09-17T05:34:35.308049+0000","last_became_active":"2024-09-17T05:34:34.077169+0000","last_became_peered":"2024-09-17T05:34:34.077169+0000","last_unstale":"2024-09-17T05:34:35.308049+0000","last_undegraded":"2024-09-17T05:34:35.308049+0000","last_fullsized":"2024-09-17T05:34:35.308049+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:52.333720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340564+0000","last_change":"2024-09-17T05:34:33.044645+0000","last_active":"2024-09-17T05:34:35.340564+0000","last_peered":"2024-09-17T05:34:35.340564+0000","last_clean":"2024-09-17T05:34:35.340564+0000","last_became_active":"2024-09-17T05:34:33.043462+0000","last_became_peered":"2024-09-17T05:34:33.043462+0000","last_unstale":"2024-09-17T05:34:35.340564+0000","last_undegraded":"2024-09-17T05:34:35.340564+0000","last_fullsized":"2024-09-17T05:34:35.340564+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:22.412396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824158+0000","last_change":"2024-09-17T05:34:34.078231+0000","last_active":"2024-09-17T05:34:35.824158+0000","last_peered":"2024-09-17T05:34:35.824158+0000","last_clean":"2024-09-17T05:34:35.824158+0000","last_became_active":"2024-09-17T05:34:34.077916+0000","last_became_peered":"2024-09-17T05:34:34.077916+0000","last_unstale":"2024-09-17T05:34:35.824158+0000","last_undegraded":"2024-09-17T05:34:35.824158+0000","last_fullsized":"2024-09-17T05:34:35.824158+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:16:02.059560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820112+0000","last_change":"2024-09-17T05:34:33.063648+0000","last_active":"2024-09-17T05:34:35.820112+0000","last_peered":"2024-09-17T05:34:35.820112+0000","last_clean":"2024-09-17T05:34:35.820112+0000","last_became_active":"2024-09-17T05:34:33.063359+0000","last_became_peered":"2024-09-17T05:34:33.063359+0000","last_unstale":"2024-09-17T05:34:35.820112+0000","last_undegraded":"2024-09-17T05:34:35.820112+0000","last_fullsized":"2024-09-17T05:34:35.820112+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:48.271437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.061260+0000","last_change":"2024-09-17T05:34:34.052351+0000","last_active":"2024-09-17T05:34:35.061260+0000","last_peered":"2024-09-17T05:34:35.061260+0000","last_clean":"2024-09-17T05:34:35.061260+0000","last_became_active":"2024-09-17T05:34:34.051953+0000","last_became_peered":"2024-09-17T05:34:34.051953+0000","last_unstale":"2024-09-17T05:34:35.061260+0000","last_undegraded":"2024-09-17T05:34:35.061260+0000","last_fullsized":"2024-09-17T05:34:35.061260+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:45.007688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055330+0000","last_change":"2024-09-17T05:34:33.050448+0000","last_active":"2024-09-17T05:34:35.055330+0000","last_peered":"2024-09-17T05:34:35.055330+0000","last_clean":"2024-09-17T05:34:35.055330+0000","last_became_active":"2024-09-17T05:34:33.048788+0000","last_became_peered":"2024-09-17T05:34:33.048788+0000","last_unstale":"2024-09-17T05:34:35.055330+0000","last_undegraded":"2024-09-17T05:34:35.055330+0000","last_fullsized":"2024-09-17T05:34:35.055330+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:52.322184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.055205+0000","last_change":"2024-09-17T05:34:34.066644+0000","last_active":"2024-09-17T05:34:35.055205+0000","last_peered":"2024-09-17T05:34:35.055205+0000","last_clean":"2024-09-17T05:34:35.055205+0000","last_became_active":"2024-09-17T05:34:34.055068+0000","last_became_peered":"2024-09-17T05:34:34.055068+0000","last_unstale":"2024-09-17T05:34:35.055205+0000","last_undegraded":"2024-09-17T05:34:35.055205+0000","last_fullsized":"2024-09-17T05:34:35.055205+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:50.557224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"114'1","reported_seq":16,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.825072+0000","last_change":"2024-09-17T05:34:33.060194+0000","last_active":"2024-09-17T05:34:35.825072+0000","last_peered":"2024-09-17T05:34:35.825072+0000","last_clean":"2024-09-17T05:34:35.825072+0000","last_became_active":"2024-09-17T05:34:33.059578+0000","last_became_peered":"2024-09-17T05:34:33.059578+0000","last_unstale":"2024-09-17T05:34:35.825072+0000","last_undegraded":"2024-09-17T05:34:35.825072+0000","last_fullsized":"2024-09-17T05:34:35.825072+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:58.774105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308425+0000","last_change":"2024-09-17T05:34:34.066256+0000","last_active":"2024-09-17T05:34:35.308425+0000","last_peered":"2024-09-17T05:34:35.308425+0000","last_clean":"2024-09-17T05:34:35.308425+0000","last_became_active":"2024-09-17T05:34:34.065865+0000","last_became_peered":"2024-09-17T05:34:34.065865+0000","last_unstale":"2024-09-17T05:34:35.308425+0000","last_undegraded":"2024-09-17T05:34:35.308425+0000","last_fullsized":"2024-09-17T05:34:35.308425+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:07.184666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308273+0000","last_change":"2024-09-17T05:34:33.058966+0000","last_active":"2024-09-17T05:34:35.308273+0000","last_peered":"2024-09-17T05:34:35.308273+0000","last_clean":"2024-09-17T05:34:35.308273+0000","last_became_active":"2024-09-17T05:34:33.058457+0000","last_became_peered":"2024-09-17T05:34:33.058457+0000","last_unstale":"2024-09-17T05:34:35.308273+0000","last_undegraded":"2024-09-17T05:34:35.308273+0000","last_fullsized":"2024-09-17T05:34:35.308273+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:49:32.894237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.060736+0000","last_change":"2024-09-17T05:34:34.067228+0000","last_active":"2024-09-17T05:34:35.060736+0000","last_peered":"2024-09-17T05:34:35.060736+0000","last_clean":"2024-09-17T05:34:35.060736+0000","last_became_active":"2024-09-17T05:34:34.066952+0000","last_became_peered":"2024-09-17T05:34:34.066952+0000","last_unstale":"2024-09-17T05:34:35.060736+0000","last_undegraded":"2024-09-17T05:34:35.060736+0000","last_fullsized":"2024-09-17T05:34:35.060736+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:14:18.920767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820173+0000","last_change":"2024-09-17T05:34:33.059901+0000","last_active":"2024-09-17T05:34:35.820173+0000","last_peered":"2024-09-17T05:34:35.820173+0000","last_clean":"2024-09-17T05:34:35.820173+0000","last_became_active":"2024-09-17T05:34:33.059478+0000","last_became_peered":"2024-09-17T05:34:33.059478+0000","last_unstale":"2024-09-17T05:34:35.820173+0000","last_undegraded":"2024-09-17T05:34:35.820173+0000","last_fullsized":"2024-09-17T05:34:35.820173+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:17.994218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824666+0000","last_change":"2024-09-17T05:34:34.059000+0000","last_active":"2024-09-17T05:34:35.824666+0000","last_peered":"2024-09-17T05:34:35.824666+0000","last_clean":"2024-09-17T05:34:35.824666+0000","last_became_active":"2024-09-17T05:34:34.058596+0000","last_became_peered":"2024-09-17T05:34:34.058596+0000","last_unstale":"2024-09-17T05:34:35.824666+0000","last_undegraded":"2024-09-17T05:34:35.824666+0000","last_fullsized":"2024-09-17T05:34:35.824666+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:42:42.792537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308429+0000","last_change":"2024-09-17T05:34:33.061713+0000","last_active":"2024-09-17T05:34:35.308429+0000","last_peered":"2024-09-17T05:34:35.308429+0000","last_clean":"2024-09-17T05:34:35.308429+0000","last_became_active":"2024-09-17T05:34:33.058269+0000","last_became_peered":"2024-09-17T05:34:33.058269+0000","last_unstale":"2024-09-17T05:34:35.308429+0000","last_undegraded":"2024-09-17T05:34:35.308429+0000","last_fullsized":"2024-09-17T05:34:35.308429+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:41.349784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.059940+0000","last_change":"2024-09-17T05:34:34.066122+0000","last_active":"2024-09-17T05:34:35.059940+0000","last_peered":"2024-09-17T05:34:35.059940+0000","last_clean":"2024-09-17T05:34:35.059940+0000","last_became_active":"2024-09-17T05:34:34.065874+0000","last_became_peered":"2024-09-17T05:34:34.065874+0000","last_unstale":"2024-09-17T05:34:35.059940+0000","last_undegraded":"2024-09-17T05:34:35.059940+0000","last_fullsized":"2024-09-17T05:34:35.059940+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:17.461766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824654+0000","last_change":"2024-09-17T05:34:33.066694+0000","last_active":"2024-09-17T05:34:35.824654+0000","last_peered":"2024-09-17T05:34:35.824654+0000","last_clean":"2024-09-17T05:34:35.824654+0000","last_became_active":"2024-09-17T05:34:33.066446+0000","last_became_peered":"2024-09-17T05:34:33.066446+0000","last_unstale":"2024-09-17T05:34:35.824654+0000","last_undegraded":"2024-09-17T05:34:35.824654+0000","last_fullsized":"2024-09-17T05:34:35.824654+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:44.853325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340784+0000","last_change":"2024-09-17T05:34:34.052402+0000","last_active":"2024-09-17T05:34:35.340784+0000","last_peered":"2024-09-17T05:34:35.340784+0000","last_clean":"2024-09-17T05:34:35.340784+0000","last_became_active":"2024-09-17T05:34:34.051407+0000","last_became_peered":"2024-09-17T05:34:34.051407+0000","last_unstale":"2024-09-17T05:34:35.340784+0000","last_undegraded":"2024-09-17T05:34:35.340784+0000","last_fullsized":"2024-09-17T05:34:35.340784+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:51.254812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.340657+0000","last_change":"2024-09-17T05:34:33.053142+0000","last_active":"2024-09-17T05:34:35.340657+0000","last_peered":"2024-09-17T05:34:35.340657+0000","last_clean":"2024-09-17T05:34:35.340657+0000","last_became_active":"2024-09-17T05:34:33.052812+0000","last_became_peered":"2024-09-17T05:34:33.052812+0000","last_unstale":"2024-09-17T05:34:35.340657+0000","last_undegraded":"2024-09-17T05:34:35.340657+0000","last_fullsized":"2024-09-17T05:34:35.340657+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:18.041208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.308014+0000","last_change":"2024-09-17T05:34:34.066359+0000","last_active":"2024-09-17T05:34:35.308014+0000","last_peered":"2024-09-17T05:34:35.308014+0000","last_clean":"2024-09-17T05:34:35.308014+0000","last_became_active":"2024-09-17T05:34:34.065935+0000","last_became_peered":"2024-09-17T05:34:34.065935+0000","last_unstale":"2024-09-17T05:34:35.308014+0000","last_undegraded":"2024-09-17T05:34:35.308014+0000","last_fullsized":"2024-09-17T05:34:35.308014+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:08.880501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.820256+0000","last_change":"2024-09-17T05:34:33.055315+0000","last_active":"2024-09-17T05:34:35.820256+0000","last_peered":"2024-09-17T05:34:35.820256+0000","last_clean":"2024-09-17T05:34:35.820256+0000","last_became_active":"2024-09-17T05:34:33.055048+0000","last_became_peered":"2024-09-17T05:34:33.055048+0000","last_unstale":"2024-09-17T05:34:35.820256+0000","last_undegraded":"2024-09-17T05:34:35.820256+0000","last_fullsized":"2024-09-17T05:34:35.820256+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:33.090059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824098+0000","last_change":"2024-09-17T05:34:34.079181+0000","last_active":"2024-09-17T05:34:35.824098+0000","last_peered":"2024-09-17T05:34:35.824098+0000","last_clean":"2024-09-17T05:34:35.824098+0000","last_became_active":"2024-09-17T05:34:34.077863+0000","last_became_peered":"2024-09-17T05:34:34.077863+0000","last_unstale":"2024-09-17T05:34:35.824098+0000","last_undegraded":"2024-09-17T05:34:35.824098+0000","last_fullsized":"2024-09-17T05:34:35.824098+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:33.022052+0000","last_clean_scrub_stamp":"2024-09-17T05:34:33.022052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:24:30.440670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"114'2","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.824421+0000","last_change":"2024-09-17T05:34:33.058160+0000","last_active":"2024-09-17T05:34:35.824421+0000","last_peered":"2024-09-17T05:34:35.824421+0000","last_clean":"2024-09-17T05:34:35.824421+0000","last_became_active":"2024-09-17T05:34:33.057770+0000","last_became_peered":"2024-09-17T05:34:33.057770+0000","last_unstale":"2024-09-17T05:34:35.824421+0000","last_undegraded":"2024-09-17T05:34:35.824421+0000","last_fullsized":"2024-09-17T05:34:35.824421+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:34:32.011853+0000","last_clean_scrub_stamp":"2024-09-17T05:34:32.011853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:30.948080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":312,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-09-17T05:34:35.823969+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:34:35.823969+0000","last_peered":"2024-09-17T05:34:35.823969+0000","last_clean":"2024-09-17T05:34:35.823969+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:34:35.823969+0000","last_undegraded":"2024-09-17T05:34:35.823969+0000","last_fullsized":"2024-09-17T05:34:35.823969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509516,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2048000,"data_stored":1220125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509517,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1441792,"data_stored":629119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542220,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1437696,"data_stored":627619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509517,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1433600,"data_stored":627577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509517,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1437696,"data_stored":627667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509517,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1437696,"data_stored":628123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509515,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1429504,"data_stored":627507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542219,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2023424,"data_stored":1217875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:34:43.210 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:34:43.211 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:34:43.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f174b600640 1 -- 172.21.15.31:0/1233622346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17440b1650 msgr2=0x7f17440b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:43.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f174b600640 1 --2- 172.21.15.31:0/1233622346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17440b1650 0x7f17440b1a30 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f1744073810 tx=0x7f172c01c800 comp rx=0 tx=0).stop 2024-09-17T05:34:43.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f174b600640 1 -- 172.21.15.31:0/1233622346 shutdown_connections 2024-09-17T05:34:43.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f174b600640 1 --2- 172.21.15.31:0/1233622346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17440b1650 0x7f17440b1a30 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:43.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f174b600640 1 --2- 172.21.15.31:0/1233622346 >> v2:172.21.15.155:3300/0 conn(0x7f17441605d0 0x7f17440d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:43.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f174b600640 1 -- 172.21.15.31:0/1233622346 >> 172.21.15.31:0/1233622346 conn(0x7f17440d1dd0 msgr2=0x7f17440d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:43.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f174b600640 1 -- 172.21.15.31:0/1233622346 shutdown_connections 2024-09-17T05:34:43.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f174b600640 1 -- 172.21.15.31:0/1233622346 wait complete. 2024-09-17T05:34:43.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f174b600640 1 Processor -- start 2024-09-17T05:34:43.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f174b600640 1 -- start start 2024-09-17T05:34:43.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f174b600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17440aeb00 0x7f17440cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:43.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f174b600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17440b1650 0x7f17440cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:43.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f174b600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17441605d0 0x7f17440ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:43.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f174b600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f17440b0ee0 con 0x7f17440b1650 2024-09-17T05:34:43.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f174b600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f17440b0840 con 0x7f17441605d0 2024-09-17T05:34:43.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f174b600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f17440b1220 con 0x7f17440aeb00 2024-09-17T05:34:43.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f173be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17440b1650 0x7f17440cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:43.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f173be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17440b1650 0x7f17440cc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45480/0 (socket says 172.21.15.31:45480) 2024-09-17T05:34:43.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.401+0000 7f173be00640 1 -- 172.21.15.31:0/893084475 learned_addr learned my addr 172.21.15.31:0/893084475 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:43.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.405+0000 7f1749600640 1 --2- 172.21.15.31:0/893084475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17441605d0 0x7f17440ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:43.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.405+0000 7f1748c00640 1 --2- 172.21.15.31:0/893084475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17440aeb00 0x7f17440cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:43.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.405+0000 7f173be00640 1 -- 172.21.15.31:0/893084475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17440aeb00 msgr2=0x7f17440cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:43.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.405+0000 7f173be00640 1 --2- 172.21.15.31:0/893084475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17440aeb00 0x7f17440cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:43.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.405+0000 7f173be00640 1 -- 172.21.15.31:0/893084475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17441605d0 msgr2=0x7f17440ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:43.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.405+0000 7f173be00640 1 --2- 172.21.15.31:0/893084475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17441605d0 0x7f17440ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:43.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.405+0000 7f173be00640 1 -- 172.21.15.31:0/893084475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1744157270 con 0x7f17440b1650 2024-09-17T05:34:43.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.405+0000 7f173be00640 1 --2- 172.21.15.31:0/893084475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17440b1650 0x7f17440cc9f0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f172c000c10 tx=0x7f172c0a6690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:43.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.405+0000 7f1741600640 1 -- 172.21.15.31:0/893084475 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c004380 con 0x7f17440b1650 2024-09-17T05:34:43.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.405+0000 7f1741600640 1 -- 172.21.15.31:0/893084475 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f172c0be070 con 0x7f17440b1650 2024-09-17T05:34:43.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.405+0000 7f1741600640 1 -- 172.21.15.31:0/893084475 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c005230 con 0x7f17440b1650 2024-09-17T05:34:43.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.405+0000 7f174b600640 1 -- 172.21.15.31:0/893084475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17440c67e0 con 0x7f17440b1650 2024-09-17T05:34:43.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.405+0000 7f174b600640 1 -- 172.21.15.31:0/893084475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17440c6da0 con 0x7f17440b1650 2024-09-17T05:34:43.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.405+0000 7f174b600640 1 -- 172.21.15.31:0/893084475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17440b1a30 con 0x7f17440b1650 2024-09-17T05:34:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.405+0000 7f1741600640 1 -- 172.21.15.31:0/893084475 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f172c0053d0 con 0x7f17440b1650 2024-09-17T05:34:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.409+0000 7f1741600640 1 --2- 172.21.15.31:0/893084475 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1720073680 0x7f1720075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.409+0000 7f1741600640 1 -- 172.21.15.31:0/893084475 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5737+0+0 (secure 0 0 0) 0x7f172c12f860 con 0x7f17440b1650 2024-09-17T05:34:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.409+0000 7f1748c00640 1 --2- 172.21.15.31:0/893084475 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1720073680 0x7f1720075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.409+0000 7f1748c00640 1 --2- 172.21.15.31:0/893084475 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1720073680 0x7f1720075b40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1734009ad0 tx=0x7f17340091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:43.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.413+0000 7f1741600640 1 -- 172.21.15.31:0/893084475 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f172c0163f0 con 0x7f17440b1650 2024-09-17T05:34:43.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.649+0000 7f174b600640 1 -- 172.21.15.31:0/893084475 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f17440d1080 con 0x7f17440b1650 2024-09-17T05:34:43.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.653+0000 7f1741600640 1 -- 172.21.15.31:0/893084475 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) ==== 190+0+147 (secure 0 0 0) 0x7f172c0fa2e0 con 0x7f17440b1650 2024-09-17T05:34:43.656 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-09-17T05:34:43.656 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw== 2024-09-17T05:34:43.656 INFO:teuthology.orchestra.run.smithi031.stdout: caps mds = "allow" 2024-09-17T05:34:43.656 INFO:teuthology.orchestra.run.smithi031.stdout: caps mon = "allow r" 2024-09-17T05:34:43.656 INFO:teuthology.orchestra.run.smithi031.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:34:43.657 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2024-09-17T05:34:43.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.657+0000 7f174b600640 1 -- 172.21.15.31:0/893084475 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1720073680 msgr2=0x7f1720075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:43.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.657+0000 7f174b600640 1 --2- 172.21.15.31:0/893084475 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1720073680 0x7f1720075b40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1734009ad0 tx=0x7f17340091e0 comp rx=0 tx=0).stop 2024-09-17T05:34:43.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.657+0000 7f174b600640 1 -- 172.21.15.31:0/893084475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17440b1650 msgr2=0x7f17440cc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:43.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.657+0000 7f174b600640 1 --2- 172.21.15.31:0/893084475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17440b1650 0x7f17440cc9f0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f172c000c10 tx=0x7f172c0a6690 comp rx=0 tx=0).stop 2024-09-17T05:34:43.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.657+0000 7f174b600640 1 -- 172.21.15.31:0/893084475 shutdown_connections 2024-09-17T05:34:43.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.657+0000 7f174b600640 1 --2- 172.21.15.31:0/893084475 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1720073680 0x7f1720075b40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:43.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.657+0000 7f174b600640 1 --2- 172.21.15.31:0/893084475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17441605d0 0x7f17440ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:43.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.657+0000 7f174b600640 1 --2- 172.21.15.31:0/893084475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17440b1650 0x7f17440cc9f0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:43.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.657+0000 7f174b600640 1 --2- 172.21.15.31:0/893084475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17440aeb00 0x7f17440cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:43.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.657+0000 7f174b600640 1 -- 172.21.15.31:0/893084475 >> 172.21.15.31:0/893084475 conn(0x7f17440d1dd0 msgr2=0x7f1744071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:43.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.657+0000 7f174b600640 1 -- 172.21.15.31:0/893084475 shutdown_connections 2024-09-17T05:34:43.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.657+0000 7f174b600640 1 -- 172.21.15.31:0/893084475 wait complete. 2024-09-17T05:34:43.678 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:34:43.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.825+0000 7fe656c00640 1 -- 172.21.15.31:0/1605560036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe65015bea0 msgr2=0x7fe6500ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:43.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.825+0000 7fe656c00640 1 --2- 172.21.15.31:0/1605560036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe65015bea0 0x7fe6500ce670 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe640009840 tx=0x7fe64001c560 comp rx=0 tx=0).stop 2024-09-17T05:34:43.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.825+0000 7fe656c00640 1 -- 172.21.15.31:0/1605560036 shutdown_connections 2024-09-17T05:34:43.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.825+0000 7fe656c00640 1 --2- 172.21.15.31:0/1605560036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe65015bea0 0x7fe6500ce670 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:43.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.825+0000 7fe656c00640 1 -- 172.21.15.31:0/1605560036 >> 172.21.15.31:0/1605560036 conn(0x7fe6500d1dc0 msgr2=0x7fe6500d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:43.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.825+0000 7fe656c00640 1 -- 172.21.15.31:0/1605560036 shutdown_connections 2024-09-17T05:34:43.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.825+0000 7fe656c00640 1 -- 172.21.15.31:0/1605560036 wait complete. 2024-09-17T05:34:43.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe656c00640 1 Processor -- start 2024-09-17T05:34:43.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe656c00640 1 -- start start 2024-09-17T05:34:43.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe656c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6500cdb30 0x7fe65014c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:43.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe656c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6500d28e0 0x7fe6501fbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:43.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe656c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe65015bea0 0x7fe6500c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:43.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe656c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe65016a930 con 0x7fe6500cdb30 2024-09-17T05:34:43.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe656c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe65016a7b0 con 0x7fe6500d28e0 2024-09-17T05:34:43.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe656c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe65016aab0 con 0x7fe65015bea0 2024-09-17T05:34:43.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe64fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6500cdb30 0x7fe65014c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:43.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe64fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6500cdb30 0x7fe65014c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45482/0 (socket says 172.21.15.31:45482) 2024-09-17T05:34:43.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe64fe00640 1 -- 172.21.15.31:0/1608886003 learned_addr learned my addr 172.21.15.31:0/1608886003 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:43.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe647e00640 1 --2- 172.21.15.31:0/1608886003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6500d28e0 0x7fe6501fbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:43.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe654c00640 1 --2- 172.21.15.31:0/1608886003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe65015bea0 0x7fe6500c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:43.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe64fe00640 1 -- 172.21.15.31:0/1608886003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe65015bea0 msgr2=0x7fe6500c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:43.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe64fe00640 1 --2- 172.21.15.31:0/1608886003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe65015bea0 0x7fe6500c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:43.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe64fe00640 1 -- 172.21.15.31:0/1608886003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6500d28e0 msgr2=0x7fe6501fbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:43.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe64fe00640 1 --2- 172.21.15.31:0/1608886003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6500d28e0 0x7fe6501fbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:43.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe64fe00640 1 -- 172.21.15.31:0/1608886003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6500c6660 con 0x7fe6500cdb30 2024-09-17T05:34:43.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe654c00640 1 --2- 172.21.15.31:0/1608886003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe65015bea0 0x7fe6500c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:43.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe64fe00640 1 --2- 172.21.15.31:0/1608886003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6500cdb30 0x7fe65014c0c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fe64001ac10 tx=0x7fe640005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:43.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe64cc00640 1 -- 172.21.15.31:0/1608886003 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe640005030 con 0x7fe6500cdb30 2024-09-17T05:34:43.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe64cc00640 1 -- 172.21.15.31:0/1608886003 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6400b9030 con 0x7fe6500cdb30 2024-09-17T05:34:43.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe64cc00640 1 -- 172.21.15.31:0/1608886003 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe640005520 con 0x7fe6500cdb30 2024-09-17T05:34:43.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.829+0000 7fe656c00640 1 -- 172.21.15.31:0/1608886003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6500c6940 con 0x7fe6500cdb30 2024-09-17T05:34:43.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.833+0000 7fe656c00640 1 -- 172.21.15.31:0/1608886003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6501fc4a0 con 0x7fe6500cdb30 2024-09-17T05:34:43.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.833+0000 7fe656c00640 1 -- 172.21.15.31:0/1608886003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6500c6b80 con 0x7fe6500cdb30 2024-09-17T05:34:43.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.833+0000 7fe64cc00640 1 -- 172.21.15.31:0/1608886003 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7fe640003780 con 0x7fe6500cdb30 2024-09-17T05:34:43.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.833+0000 7fe64cc00640 1 --2- 172.21.15.31:0/1608886003 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe62c073680 0x7fe62c075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:43.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.833+0000 7fe64cc00640 1 -- 172.21.15.31:0/1608886003 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7fe64012f140 con 0x7fe6500cdb30 2024-09-17T05:34:43.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.833+0000 7fe647e00640 1 --2- 172.21.15.31:0/1608886003 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe62c073680 0x7fe62c075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:43.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.837+0000 7fe647e00640 1 --2- 172.21.15.31:0/1608886003 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe62c073680 0x7fe62c075b40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe65015a230 tx=0x7fe638009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:43.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:43.837+0000 7fe64cc00640 1 -- 172.21.15.31:0/1608886003 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe6500c6b80 con 0x7fe6500cdb30 2024-09-17T05:34:44.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.049+0000 7fe656c00640 1 -- 172.21.15.31:0/1608886003 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6500ce670 con 0x7fe6500cdb30 2024-09-17T05:34:44.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.049+0000 7fe64cc00640 1 -- 172.21.15.31:0/1608886003 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5222 (secure 0 0 0) 0x7fe640016330 con 0x7fe6500cdb30 2024-09-17T05:34:44.053 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:44.053 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":81,"btime":"2024-09-17T05:34:37:062019+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6398,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/296432902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":296432902},{"type":"v1","addr":"172.21.15.31:6834","nonce":296432902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/951265381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":951265381},{"type":"v1","addr":"172.21.15.155:6809","nonce":951265381}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/119812259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":119812259},{"type":"v1","addr":"172.21.15.155:6835","nonce":119812259}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:34:33.468561+0000","modified":"2024-09-17T05:34:36.465649+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7416},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7416":{"gid":7416,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/1466764013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1466764013},{"type":"v1","addr":"172.21.15.31:6835","nonce":1466764013}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7416,"qdb_cluster":[7416]},"id":9}]} 2024-09-17T05:34:44.054 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 81 2024-09-17T05:34:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.053+0000 7fe656c00640 1 -- 172.21.15.31:0/1608886003 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe62c073680 msgr2=0x7fe62c075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.053+0000 7fe656c00640 1 --2- 172.21.15.31:0/1608886003 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe62c073680 0x7fe62c075b40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe65015a230 tx=0x7fe638009040 comp rx=0 tx=0).stop 2024-09-17T05:34:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.053+0000 7fe656c00640 1 -- 172.21.15.31:0/1608886003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6500cdb30 msgr2=0x7fe65014c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.053+0000 7fe656c00640 1 --2- 172.21.15.31:0/1608886003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6500cdb30 0x7fe65014c0c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fe64001ac10 tx=0x7fe640005760 comp rx=0 tx=0).stop 2024-09-17T05:34:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.053+0000 7fe656c00640 1 -- 172.21.15.31:0/1608886003 shutdown_connections 2024-09-17T05:34:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.053+0000 7fe656c00640 1 --2- 172.21.15.31:0/1608886003 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe62c073680 0x7fe62c075b40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.053+0000 7fe656c00640 1 --2- 172.21.15.31:0/1608886003 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe65015bea0 0x7fe6500c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.053+0000 7fe656c00640 1 --2- 172.21.15.31:0/1608886003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6500d28e0 0x7fe6501fbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.053+0000 7fe656c00640 1 --2- 172.21.15.31:0/1608886003 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6500cdb30 0x7fe65014c0c0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.053+0000 7fe656c00640 1 -- 172.21.15.31:0/1608886003 >> 172.21.15.31:0/1608886003 conn(0x7fe6500d1dc0 msgr2=0x7fe6500b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.053+0000 7fe656c00640 1 -- 172.21.15.31:0/1608886003 shutdown_connections 2024-09-17T05:34:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.053+0000 7fe656c00640 1 -- 172.21.15.31:0/1608886003 wait complete. 2024-09-17T05:34:44.478 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 81, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:34:33.468561+0000', 'modified': '2024-09-17T05:34:36.465649+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7416}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7416': {'gid': 7416, 'name': 'c', 'rank': 0, 'incarnation': 78, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.31:6835/1466764013', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6833', 'nonce': 1466764013}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 1466764013}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7416, 'qdb_cluster': [7416]} 2024-09-17T05:34:44.479 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:34:44.479 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:34:44.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.629+0000 7fb152400640 1 -- 172.21.15.31:0/1523135270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb14c0d01b0 msgr2=0x7fb14c0cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:44.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.629+0000 7fb152400640 1 --2- 172.21.15.31:0/1523135270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb14c0d01b0 0x7fb14c0cefb0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fb134009900 tx=0x7fb13401c850 comp rx=0 tx=0).stop 2024-09-17T05:34:44.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.629+0000 7fb152400640 1 -- 172.21.15.31:0/1523135270 shutdown_connections 2024-09-17T05:34:44.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.629+0000 7fb152400640 1 --2- 172.21.15.31:0/1523135270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb14c0d01b0 0x7fb14c0cefb0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.629+0000 7fb152400640 1 -- 172.21.15.31:0/1523135270 >> 172.21.15.31:0/1523135270 conn(0x7fb14c09aa10 msgr2=0x7fb14c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:44.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.629+0000 7fb152400640 1 -- 172.21.15.31:0/1523135270 shutdown_connections 2024-09-17T05:34:44.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.629+0000 7fb152400640 1 -- 172.21.15.31:0/1523135270 wait complete. 2024-09-17T05:34:44.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb152400640 1 Processor -- start 2024-09-17T05:34:44.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb152400640 1 -- start start 2024-09-17T05:34:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb152400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb14c0b2590 0x7fb14c1595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb152400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb14c0d01b0 0x7fb14c154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb152400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb14c15f000 0x7fb14c0c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb152400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c16a0f0 con 0x7fb14c0d01b0 2024-09-17T05:34:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb152400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c169f70 con 0x7fb14c0b2590 2024-09-17T05:34:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb152400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb14c16a270 con 0x7fb14c15f000 2024-09-17T05:34:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb143e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb14c0d01b0 0x7fb14c154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb143e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb14c0d01b0 0x7fb14c154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45494/0 (socket says 172.21.15.31:45494) 2024-09-17T05:34:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb143e00640 1 -- 172.21.15.31:0/4083090117 learned_addr learned my addr 172.21.15.31:0/4083090117 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb143e00640 1 -- 172.21.15.31:0/4083090117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb14c15f000 msgr2=0x7fb14c0c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb143e00640 1 --2- 172.21.15.31:0/4083090117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb14c15f000 0x7fb14c0c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb143e00640 1 -- 172.21.15.31:0/4083090117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb14c0b2590 msgr2=0x7fb14c1595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb151000640 1 --2- 172.21.15.31:0/4083090117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb14c0b2590 0x7fb14c1595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb143e00640 1 --2- 172.21.15.31:0/4083090117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb14c0b2590 0x7fb14c1595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb143e00640 1 -- 172.21.15.31:0/4083090117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c158df0 con 0x7fb14c0d01b0 2024-09-17T05:34:44.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb151000640 1 --2- 172.21.15.31:0/4083090117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb14c0b2590 0x7fb14c1595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:34:44.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb143e00640 1 --2- 172.21.15.31:0/4083090117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb14c0d01b0 0x7fb14c154c40 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fb134009850 tx=0x7fb1340a5620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:44.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb149600640 1 -- 172.21.15.31:0/4083090117 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1340b2040 con 0x7fb14c0d01b0 2024-09-17T05:34:44.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb149600640 1 -- 172.21.15.31:0/4083090117 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb134004430 con 0x7fb14c0d01b0 2024-09-17T05:34:44.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb149600640 1 -- 172.21.15.31:0/4083090117 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134005280 con 0x7fb14c0d01b0 2024-09-17T05:34:44.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb152400640 1 -- 172.21.15.31:0/4083090117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14c0cba90 con 0x7fb14c0d01b0 2024-09-17T05:34:44.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.633+0000 7fb152400640 1 -- 172.21.15.31:0/4083090117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb14c159090 con 0x7fb14c0d01b0 2024-09-17T05:34:44.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb149600640 1 -- 172.21.15.31:0/4083090117 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7fb134005420 con 0x7fb14c0d01b0 2024-09-17T05:34:44.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb149600640 1 --2- 172.21.15.31:0/4083090117 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb128073680 0x7fb128075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb156d91000 1 Processor -- start 2024-09-17T05:34:44.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb149600640 1 -- 172.21.15.31:0/4083090117 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7fb13412e900 con 0x7fb14c0d01b0 2024-09-17T05:34:44.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb151000640 1 --2- 172.21.15.31:0/4083090117 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb128073680 0x7fb128075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb156d91000 1 -- start start 2024-09-17T05:34:44.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb151000640 1 --2- 172.21.15.31:0/4083090117 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb128073680 0x7fb128075b40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb13c000f70 tx=0x7fb13c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:44.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb156d91000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604db0bc9d0 0x5604db0bcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb156d91000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bd2f0 0x5604db0708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb156d91000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db070e10 0x5604db0711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb156d91000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5604daf913f0 con 0x5604db0bd2f0 2024-09-17T05:34:44.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb156d91000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5604daeceb20 con 0x5604db070e10 2024-09-17T05:34:44.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb156d91000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5604daebdf50 con 0x5604db0bc9d0 2024-09-17T05:34:44.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb143e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bd2f0 0x5604db0708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb143e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bd2f0 0x5604db0708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45496/0 (socket says 172.21.15.31:45496) 2024-09-17T05:34:44.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb143e00640 1 -- 172.21.15.31:0/299740081 learned_addr learned my addr 172.21.15.31:0/299740081 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:44.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb151000640 1 --2- 172.21.15.31:0/299740081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604db0bc9d0 0x5604db0bcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb151a00640 1 --2- 172.21.15.31:0/299740081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db070e10 0x5604db0711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb143e00640 1 -- 172.21.15.31:0/299740081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604db0bc9d0 msgr2=0x5604db0bcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:34:44.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb143e00640 1 --2- 172.21.15.31:0/299740081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604db0bc9d0 0x5604db0bcdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb143e00640 1 -- 172.21.15.31:0/299740081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db070e10 msgr2=0x5604db0711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:34:44.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb143e00640 1 --2- 172.21.15.31:0/299740081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db070e10 0x5604db0711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb143e00640 1 -- 172.21.15.31:0/299740081 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604dae85590 con 0x5604db0bd2f0 2024-09-17T05:34:44.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.637+0000 7fb143e00640 1 --2- 172.21.15.31:0/299740081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bd2f0 0x5604db0708d0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fb134005710 tx=0x7fb1340f8310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4d8eb97476888e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:44.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb141600640 1 -- 172.21.15.31:0/299740081 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1340bd030 con 0x5604db0bd2f0 2024-09-17T05:34:44.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb141600640 1 -- 172.21.15.31:0/299740081 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1340f89c0 con 0x5604db0bd2f0 2024-09-17T05:34:44.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb141600640 1 -- 172.21.15.31:0/299740081 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1340fd4a0 con 0x5604db0bd2f0 2024-09-17T05:34:44.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 1 -- 172.21.15.31:0/299740081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bd2f0 msgr2=0x5604db0708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:44.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 1 --2- 172.21.15.31:0/299740081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bd2f0 0x5604db0708d0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fb134005710 tx=0x7fb1340f8310 comp rx=0 tx=0).stop 2024-09-17T05:34:44.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 1 -- 172.21.15.31:0/299740081 shutdown_connections 2024-09-17T05:34:44.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 1 --2- 172.21.15.31:0/299740081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db070e10 0x5604db0711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 1 --2- 172.21.15.31:0/299740081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bd2f0 0x5604db0708d0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 1 --2- 172.21.15.31:0/299740081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604db0bc9d0 0x5604db0bcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 1 -- 172.21.15.31:0/299740081 >> 172.21.15.31:0/299740081 conn(0x5604daf5a130 msgr2=0x5604db09fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:44.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 1 -- 172.21.15.31:0/299740081 shutdown_connections 2024-09-17T05:34:44.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 1 -- 172.21.15.31:0/299740081 wait complete. 2024-09-17T05:34:44.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 1 -- start start 2024-09-17T05:34:44.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 1 Processor -- start 2024-09-17T05:34:44.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604db070e10 0x5604db0c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bc9d0 0x5604db0c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db0bd2f0 0x5604db0c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5604dae585d0 con 0x5604db0bc9d0 2024-09-17T05:34:44.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5604daec1d60 con 0x5604db0bd2f0 2024-09-17T05:34:44.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5604dae64500 con 0x5604db070e10 2024-09-17T05:34:44.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 10 client.0 _ll_register_callbacks cb 0x5604dae68810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:34:44.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb143e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bc9d0 0x5604db0c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb143e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bc9d0 0x5604db0c42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45498/0 (socket says 172.21.15.31:45498) 2024-09-17T05:34:44.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb143e00640 1 -- 172.21.15.31:0/1408537047 learned_addr learned my addr 172.21.15.31:0/1408537047 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:44.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb151a00640 1 --2- 172.21.15.31:0/1408537047 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db0bd2f0 0x5604db0c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb151000640 1 --2- 172.21.15.31:0/1408537047 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604db070e10 0x5604db0c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb143e00640 1 -- 172.21.15.31:0/1408537047 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604db070e10 msgr2=0x5604db0c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:34:44.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb143e00640 1 --2- 172.21.15.31:0/1408537047 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604db070e10 0x5604db0c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb143e00640 1 -- 172.21.15.31:0/1408537047 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db0bd2f0 msgr2=0x5604db0c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:34:44.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb143e00640 1 --2- 172.21.15.31:0/1408537047 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db0bd2f0 0x5604db0c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb143e00640 1 -- 172.21.15.31:0/1408537047 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604dae5c170 con 0x5604db0bc9d0 2024-09-17T05:34:44.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb143e00640 1 --2- 172.21.15.31:0/1408537047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bc9d0 0x5604db0c42a0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fb134098230 tx=0x7fb13412c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c9aa40b26a715e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:44.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb13a000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:34:44.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb13a000640 1 -- 172.21.15.31:0/1408537047 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1340bd040 con 0x5604db0bc9d0 2024-09-17T05:34:44.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb13a000640 1 -- 172.21.15.31:0/1408537047 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7fb13411bc40 con 0x5604db0bc9d0 2024-09-17T05:34:44.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb156d91000 1 -- 172.21.15.31:0/1408537047 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5604dae560f0 con 0x5604db0bc9d0 2024-09-17T05:34:44.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.641+0000 7fb13a000640 1 -- 172.21.15.31:0/1408537047 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fb13411a270 con 0x5604db0bc9d0 2024-09-17T05:34:44.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 10 client.7575 fetch_fsmap learned FSMap version 81 2024-09-17T05:34:44.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 1 -- 172.21.15.31:0/1408537047 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x5604daf42ef0 con 0x5604db0bc9d0 2024-09-17T05:34:44.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb13a000640 1 -- 172.21.15.31:0/1408537047 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5604dae560f0 con 0x5604db0bc9d0 2024-09-17T05:34:44.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb13a000640 1 -- 172.21.15.31:0/1408537047 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 81) ==== 3502+0+0 (secure 0 0 0) 0x7fb134101ec0 con 0x5604db0bc9d0 2024-09-17T05:34:44.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 10 client.7575 fetch_fsmap finished waiting for FSMap version 81 2024-09-17T05:34:44.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 10 client.7575 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:34:44.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 20 client.7575 populate_metadata read hostname 'smithi031' 2024-09-17T05:34:44.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 1 --2- 172.21.15.31:0/1408537047 >> [v2:172.21.15.31:6833/1466764013,v1:172.21.15.31:6835/1466764013] conn(0x5604db0cc130 0x5604db0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 4 client.7575 mds_command: new command op to 7416 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:34:44.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 1 -- 172.21.15.31:0/1408537047 --> [v2:172.21.15.31:6833/1466764013,v1:172.21.15.31:6835/1466764013] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604daed0a70 con 0x5604db0cc130 2024-09-17T05:34:44.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb151000640 1 --2- 172.21.15.31:0/1408537047 >> [v2:172.21.15.31:6833/1466764013,v1:172.21.15.31:6835/1466764013] conn(0x5604db0cc130 0x5604db0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb151000640 1 --2- 172.21.15.31:0/1408537047 >> [v2:172.21.15.31:6833/1466764013,v1:172.21.15.31:6835/1466764013] conn(0x5604db0cc130 0x5604db0ce520 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88258ed112f2929c server_cookie=3c04ea1ddd39c789 in_seq=0 out_seq=0 2024-09-17T05:34:44.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb13a000640 10 client.7575 ms_handle_connect on v2:172.21.15.31:6833/1466764013 2024-09-17T05:34:44.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb13a000640 1 -- 172.21.15.31:0/1408537047 <== mds.0 v2:172.21.15.31:6833/1466764013 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5604daed0a70 con 0x5604db0cc130 2024-09-17T05:34:44.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb13a000640 10 client.7575 handle_command_reply: tid=0 2024-09-17T05:34:44.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 1 client.7575 shutdown 2024-09-17T05:34:44.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 1 -- 172.21.15.31:0/1408537047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bc9d0 msgr2=0x5604db0c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:44.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 1 --2- 172.21.15.31:0/1408537047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bc9d0 0x5604db0c42a0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fb134098230 tx=0x7fb13412c690 comp rx=0 tx=0).stop 2024-09-17T05:34:44.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 1 -- 172.21.15.31:0/1408537047 shutdown_connections 2024-09-17T05:34:44.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 1 --2- 172.21.15.31:0/1408537047 >> [v2:172.21.15.31:6833/1466764013,v1:172.21.15.31:6835/1466764013] conn(0x5604db0cc130 0x5604db0ce520 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 1 --2- 172.21.15.31:0/1408537047 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db0bd2f0 0x5604db0c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 1 --2- 172.21.15.31:0/1408537047 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bc9d0 0x5604db0c42a0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 1 --2- 172.21.15.31:0/1408537047 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604db070e10 0x5604db0c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb13a000640 0 client.7575 ms_handle_reset on v2:172.21.15.31:6833/1466764013 2024-09-17T05:34:44.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 1 -- 172.21.15.31:0/1408537047 >> 172.21.15.31:0/1408537047 conn(0x5604daf5a130 msgr2=0x5604db06ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:44.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 1 -- 172.21.15.31:0/1408537047 shutdown_connections 2024-09-17T05:34:44.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 1 -- 172.21.15.31:0/1408537047 wait complete. 2024-09-17T05:34:44.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.645+0000 7fb156d91000 20 client.7575 trim_cache size 0 max 16384 2024-09-17T05:34:44.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb156d91000 1 Processor -- start 2024-09-17T05:34:44.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb156d91000 1 -- start start 2024-09-17T05:34:44.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb156d91000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604daf5a130 0x5604db0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb156d91000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db070e10 0x5604db0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb156d91000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604db0bc9d0 0x5604db0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb156d91000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c0c5c00 con 0x5604daf5a130 2024-09-17T05:34:44.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb156d91000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c200b90 con 0x5604db070e10 2024-09-17T05:34:44.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb156d91000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5604dae89ec0 con 0x5604db0bc9d0 2024-09-17T05:34:44.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb151000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604daf5a130 0x5604db0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb151000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604daf5a130 0x5604db0700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45506/0 (socket says 172.21.15.31:45506) 2024-09-17T05:34:44.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb151000640 1 -- 172.21.15.31:0/857289375 learned_addr learned my addr 172.21.15.31:0/857289375 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:44.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb151a00640 1 --2- 172.21.15.31:0/857289375 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604db0bc9d0 0x5604db0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb143e00640 1 --2- 172.21.15.31:0/857289375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db070e10 0x5604db0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb151000640 1 -- 172.21.15.31:0/857289375 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604db0bc9d0 msgr2=0x5604db0ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:34:44.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb151000640 1 --2- 172.21.15.31:0/857289375 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604db0bc9d0 0x5604db0ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb151000640 1 -- 172.21.15.31:0/857289375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db070e10 msgr2=0x5604db0705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:34:44.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb151000640 1 --2- 172.21.15.31:0/857289375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db070e10 0x5604db0705f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb151000640 1 -- 172.21.15.31:0/857289375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604daf19d90 con 0x5604daf5a130 2024-09-17T05:34:44.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb143e00640 1 --2- 172.21.15.31:0/857289375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db070e10 0x5604db0705f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:44.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb151000640 1 --2- 172.21.15.31:0/857289375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604daf5a130 0x5604db0700b0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00d520 tx=0x7fb13c016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc30cb749e4e9e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:44.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb140c00640 1 -- 172.21.15.31:0/857289375 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c02f070 con 0x5604daf5a130 2024-09-17T05:34:44.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb140c00640 1 -- 172.21.15.31:0/857289375 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb13c003880 con 0x5604daf5a130 2024-09-17T05:34:44.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.665+0000 7fb140c00640 1 -- 172.21.15.31:0/857289375 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c003c70 con 0x5604daf5a130 2024-09-17T05:34:44.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 -- 172.21.15.31:0/857289375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604daf5a130 msgr2=0x5604db0700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:44.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 --2- 172.21.15.31:0/857289375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604daf5a130 0x5604db0700b0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00d520 tx=0x7fb13c016040 comp rx=0 tx=0).stop 2024-09-17T05:34:44.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 -- 172.21.15.31:0/857289375 shutdown_connections 2024-09-17T05:34:44.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 --2- 172.21.15.31:0/857289375 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604db0bc9d0 0x5604db0ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 --2- 172.21.15.31:0/857289375 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db070e10 0x5604db0705f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 --2- 172.21.15.31:0/857289375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604daf5a130 0x5604db0700b0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 -- 172.21.15.31:0/857289375 >> 172.21.15.31:0/857289375 conn(0x5604db0bc2f0 msgr2=0x5604db078bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:44.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 -- 172.21.15.31:0/857289375 shutdown_connections 2024-09-17T05:34:44.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 -- 172.21.15.31:0/857289375 wait complete. 2024-09-17T05:34:44.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 -- start start 2024-09-17T05:34:44.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 Processor -- start 2024-09-17T05:34:44.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604daf5a130 0x5604db13b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db070e10 0x5604db13b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bc9d0 0x5604db13bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5604daec1d60 con 0x5604db0bc9d0 2024-09-17T05:34:44.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5604dae585d0 con 0x5604db070e10 2024-09-17T05:34:44.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5604dae64500 con 0x5604daf5a130 2024-09-17T05:34:44.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 10 client.0 _ll_register_callbacks cb 0x7fb13c001370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:34:44.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb151a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bc9d0 0x5604db13bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb151a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bc9d0 0x5604db13bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45522/0 (socket says 172.21.15.31:45522) 2024-09-17T05:34:44.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb151a00640 1 -- 172.21.15.31:0/4032161972 learned_addr learned my addr 172.21.15.31:0/4032161972 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:44.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb151000640 1 --2- 172.21.15.31:0/4032161972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604daf5a130 0x5604db13b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb143e00640 1 --2- 172.21.15.31:0/4032161972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db070e10 0x5604db13b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb151a00640 1 -- 172.21.15.31:0/4032161972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604daf5a130 msgr2=0x5604db13b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:34:44.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb151a00640 1 --2- 172.21.15.31:0/4032161972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604daf5a130 0x5604db13b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb151a00640 1 -- 172.21.15.31:0/4032161972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db070e10 msgr2=0x5604db13b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:34:44.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb151a00640 1 --2- 172.21.15.31:0/4032161972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db070e10 0x5604db13b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb151a00640 1 -- 172.21.15.31:0/4032161972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604dae84a90 con 0x5604db0bc9d0 2024-09-17T05:34:44.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb151a00640 1 --2- 172.21.15.31:0/4032161972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bc9d0 0x5604db13bb40 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fb1440055c0 tx=0x7fb144001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7abd4394544c4c92 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:44.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb13a000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:34:44.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb13a000640 1 -- 172.21.15.31:0/4032161972 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144016480 con 0x5604db0bc9d0 2024-09-17T05:34:44.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 -- 172.21.15.31:0/4032161972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb13c003880 con 0x5604db0bc9d0 2024-09-17T05:34:44.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb13a000640 1 -- 172.21.15.31:0/4032161972 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7fb144016620 con 0x5604db0bc9d0 2024-09-17T05:34:44.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb13a000640 1 -- 172.21.15.31:0/4032161972 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fb144022050 con 0x5604db0bc9d0 2024-09-17T05:34:44.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 10 client.7581 fetch_fsmap learned FSMap version 81 2024-09-17T05:34:44.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb156d91000 1 -- 172.21.15.31:0/4032161972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x5604dae63050 con 0x5604db0bc9d0 2024-09-17T05:34:44.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.669+0000 7fb13a000640 1 -- 172.21.15.31:0/4032161972 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb13c003880 con 0x5604db0bc9d0 2024-09-17T05:34:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb13a000640 1 -- 172.21.15.31:0/4032161972 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 81) ==== 3502+0+0 (secure 0 0 0) 0x7fb144025020 con 0x5604db0bc9d0 2024-09-17T05:34:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb156d91000 10 client.7581 fetch_fsmap finished waiting for FSMap version 81 2024-09-17T05:34:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb156d91000 10 client.7581 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:34:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb156d91000 20 client.7581 populate_metadata read hostname 'smithi031' 2024-09-17T05:34:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb156d91000 1 --2- 172.21.15.31:0/4032161972 >> [v2:172.21.15.31:6833/1466764013,v1:172.21.15.31:6835/1466764013] conn(0x5604db0bd2f0 0x5604db0d3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb156d91000 4 client.7581 mds_command: new command op to 7416 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:34:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb156d91000 1 -- 172.21.15.31:0/4032161972 --> [v2:172.21.15.31:6833/1466764013,v1:172.21.15.31:6835/1466764013] -- command(tid 0: {"prefix": "status"}) -- 0x5604daecc520 con 0x5604db0bd2f0 2024-09-17T05:34:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb151000640 1 --2- 172.21.15.31:0/4032161972 >> [v2:172.21.15.31:6833/1466764013,v1:172.21.15.31:6835/1466764013] conn(0x5604db0bd2f0 0x5604db0d3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb151000640 1 --2- 172.21.15.31:0/4032161972 >> [v2:172.21.15.31:6833/1466764013,v1:172.21.15.31:6835/1466764013] conn(0x5604db0bd2f0 0x5604db0d3000 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97bcc2d17459fb server_cookie=16fa17f11e8b97e2 in_seq=0 out_seq=0 2024-09-17T05:34:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb13a000640 10 client.7581 ms_handle_connect on v2:172.21.15.31:6833/1466764013 2024-09-17T05:34:44.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb13a000640 1 -- 172.21.15.31:0/4032161972 <== mds.0 v2:172.21.15.31:6833/1466764013 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5604daecc520 con 0x5604db0bd2f0 2024-09-17T05:34:44.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb13a000640 10 client.7581 handle_command_reply: tid=0 2024-09-17T05:34:44.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb156d91000 1 client.7581 shutdown 2024-09-17T05:34:44.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb156d91000 1 -- 172.21.15.31:0/4032161972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bc9d0 msgr2=0x5604db13bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:44.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb156d91000 1 --2- 172.21.15.31:0/4032161972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bc9d0 0x5604db13bb40 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fb1440055c0 tx=0x7fb144001a50 comp rx=0 tx=0).stop 2024-09-17T05:34:44.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb156d91000 1 -- 172.21.15.31:0/4032161972 shutdown_connections 2024-09-17T05:34:44.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb156d91000 1 --2- 172.21.15.31:0/4032161972 >> [v2:172.21.15.31:6833/1466764013,v1:172.21.15.31:6835/1466764013] conn(0x5604db0bd2f0 0x5604db0d3000 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb156d91000 1 --2- 172.21.15.31:0/4032161972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5604db0bc9d0 0x5604db13bb40 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb156d91000 1 --2- 172.21.15.31:0/4032161972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604db070e10 0x5604db13b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb156d91000 1 --2- 172.21.15.31:0/4032161972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5604daf5a130 0x5604db13b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb156d91000 1 -- 172.21.15.31:0/4032161972 >> 172.21.15.31:0/4032161972 conn(0x5604db0bc2f0 msgr2=0x5604db06f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:44.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb13a000640 0 client.7581 ms_handle_reset on v2:172.21.15.31:6833/1466764013 2024-09-17T05:34:44.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb156d91000 1 -- 172.21.15.31:0/4032161972 shutdown_connections 2024-09-17T05:34:44.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb156d91000 1 -- 172.21.15.31:0/4032161972 wait complete. 2024-09-17T05:34:44.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb156d91000 20 client.7581 trim_cache size 0 max 16384 2024-09-17T05:34:44.681 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:34:44.681 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "b668cd1d-3036-4a29-9e5a-69d0df5776a8", 2024-09-17T05:34:44.681 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-17T05:34:44.681 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 7416, 2024-09-17T05:34:44.681 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-09-17T05:34:44.682 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-09-17T05:34:44.682 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-17T05:34:44.682 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 10.642049952000001, 2024-09-17T05:34:44.682 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 81, 2024-09-17T05:34:44.682 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 116, 2024-09-17T05:34:44.682 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 115, 2024-09-17T05:34:44.682 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 22.101891801000001 2024-09-17T05:34:44.682 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:34:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb152400640 1 -- 172.21.15.31:0/4083090117 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb128073680 msgr2=0x7fb128075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb152400640 1 --2- 172.21.15.31:0/4083090117 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb128073680 0x7fb128075b40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb13c000f70 tx=0x7fb13c009040 comp rx=0 tx=0).stop 2024-09-17T05:34:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb152400640 1 -- 172.21.15.31:0/4083090117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb14c0d01b0 msgr2=0x7fb14c154c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb152400640 1 --2- 172.21.15.31:0/4083090117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb14c0d01b0 0x7fb14c154c40 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fb134009850 tx=0x7fb1340a5620 comp rx=0 tx=0).stop 2024-09-17T05:34:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb152400640 1 -- 172.21.15.31:0/4083090117 shutdown_connections 2024-09-17T05:34:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb152400640 1 --2- 172.21.15.31:0/4083090117 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb128073680 0x7fb128075b40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb152400640 1 --2- 172.21.15.31:0/4083090117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb14c15f000 0x7fb14c0c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb152400640 1 --2- 172.21.15.31:0/4083090117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb14c0d01b0 0x7fb14c154c40 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb152400640 1 --2- 172.21.15.31:0/4083090117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb14c0b2590 0x7fb14c1595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb152400640 1 -- 172.21.15.31:0/4083090117 >> 172.21.15.31:0/4083090117 conn(0x7fb14c09aa10 msgr2=0x7fb14c0708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:44.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb152400640 1 -- 172.21.15.31:0/4083090117 shutdown_connections 2024-09-17T05:34:44.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.673+0000 7fb152400640 1 -- 172.21.15.31:0/4083090117 wait complete. 2024-09-17T05:34:44.694 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:34:44.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.845+0000 7f619f200640 1 -- 172.21.15.31:0/2817456109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619806cc20 msgr2=0x7f619806d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:44.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.845+0000 7f619f200640 1 --2- 172.21.15.31:0/2817456109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619806cc20 0x7f619806d090 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f6194009c80 tx=0x7f619401cd70 comp rx=0 tx=0).stop 2024-09-17T05:34:44.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.845+0000 7f619f200640 1 -- 172.21.15.31:0/2817456109 shutdown_connections 2024-09-17T05:34:44.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.845+0000 7f619f200640 1 --2- 172.21.15.31:0/2817456109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619806cc20 0x7f619806d090 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.845+0000 7f619f200640 1 --2- 172.21.15.31:0/2817456109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f619815bc70 0x7f61980ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.845+0000 7f619f200640 1 -- 172.21.15.31:0/2817456109 >> 172.21.15.31:0/2817456109 conn(0x7f619806dd30 msgr2=0x7f619806e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:44.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.845+0000 7f619f200640 1 -- 172.21.15.31:0/2817456109 shutdown_connections 2024-09-17T05:34:44.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.845+0000 7f619f200640 1 -- 172.21.15.31:0/2817456109 wait complete. 2024-09-17T05:34:44.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.845+0000 7f619f200640 1 Processor -- start 2024-09-17T05:34:44.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.845+0000 7f619f200640 1 -- start start 2024-09-17T05:34:44.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f619806cc20 0x7f61980c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f619815b890 0x7f619815d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619815bc70 0x7f619815e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f61981687a0 con 0x7f619815bc70 2024-09-17T05:34:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619f200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61980746c0 con 0x7f619806cc20 2024-09-17T05:34:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6198168920 con 0x7f619815b890 2024-09-17T05:34:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619815bc70 0x7f619815e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619815bc70 0x7f619815e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45536/0 (socket says 172.21.15.31:45536) 2024-09-17T05:34:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619e800640 1 -- 172.21.15.31:0/446527439 learned_addr learned my addr 172.21.15.31:0/446527439 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619de00640 1 --2- 172.21.15.31:0/446527439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f619806cc20 0x7f61980c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619d400640 1 --2- 172.21.15.31:0/446527439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f619815b890 0x7f619815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619e800640 1 -- 172.21.15.31:0/446527439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f619815b890 msgr2=0x7f619815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:44.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619e800640 1 --2- 172.21.15.31:0/446527439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f619815b890 0x7f619815d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619e800640 1 -- 172.21.15.31:0/446527439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f619806cc20 msgr2=0x7f61980c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:44.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619e800640 1 --2- 172.21.15.31:0/446527439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f619806cc20 0x7f61980c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:44.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619e800640 1 -- 172.21.15.31:0/446527439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61980c5e40 con 0x7f619815bc70 2024-09-17T05:34:44.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619e800640 1 --2- 172.21.15.31:0/446527439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619815bc70 0x7f619815e360 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f619401cba0 tx=0x7f6194009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:44.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f6192000640 1 -- 172.21.15.31:0/446527439 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61940bb070 con 0x7f619815bc70 2024-09-17T05:34:44.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f6192000640 1 -- 172.21.15.31:0/446527439 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6194004e00 con 0x7f619815bc70 2024-09-17T05:34:44.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f6192000640 1 -- 172.21.15.31:0/446527439 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61940b2040 con 0x7f619815bc70 2024-09-17T05:34:44.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619f200640 1 -- 172.21.15.31:0/446527439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61980b11e0 con 0x7f619815bc70 2024-09-17T05:34:44.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619f200640 1 -- 172.21.15.31:0/446527439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61980c60e0 con 0x7f619815bc70 2024-09-17T05:34:44.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.849+0000 7f619f200640 1 -- 172.21.15.31:0/446527439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61980b1700 con 0x7f619815bc70 2024-09-17T05:34:44.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.853+0000 7f6192000640 1 -- 172.21.15.31:0/446527439 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f61940ad850 con 0x7f619815bc70 2024-09-17T05:34:44.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.853+0000 7f6192000640 1 --2- 172.21.15.31:0/446527439 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f617c073680 0x7f617c075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:44.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.853+0000 7f6192000640 1 -- 172.21.15.31:0/446527439 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5795+0+0 (secure 0 0 0) 0x7f619412eb00 con 0x7f619815bc70 2024-09-17T05:34:44.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.853+0000 7f619de00640 1 --2- 172.21.15.31:0/446527439 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f617c073680 0x7f617c075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:44.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.853+0000 7f619de00640 1 --2- 172.21.15.31:0/446527439 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f617c073680 0x7f617c075b40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f618c007fd0 tx=0x7f618c007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:44.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:44.857+0000 7f6192000640 1 -- 172.21.15.31:0/446527439 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f61980b1700 con 0x7f619815bc70 2024-09-17T05:34:45.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:45.073+0000 7f619f200640 1 -- 172.21.15.31:0/446527439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f619806d090 con 0x7f619815bc70 2024-09-17T05:34:45.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:45.073+0000 7f6192000640 1 -- 172.21.15.31:0/446527439 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v81) ==== 53+0+73 (secure 0 0 0) 0x7f6194130e20 con 0x7f619815bc70 2024-09-17T05:34:45.077 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:34:45.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:45.077+0000 7f619f200640 1 -- 172.21.15.31:0/446527439 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f617c073680 msgr2=0x7f617c075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:45.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:45.077+0000 7f619f200640 1 --2- 172.21.15.31:0/446527439 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f617c073680 0x7f617c075b40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f618c007fd0 tx=0x7f618c007e40 comp rx=0 tx=0).stop 2024-09-17T05:34:45.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:45.077+0000 7f619f200640 1 -- 172.21.15.31:0/446527439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619815bc70 msgr2=0x7f619815e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:45.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:45.077+0000 7f619f200640 1 --2- 172.21.15.31:0/446527439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619815bc70 0x7f619815e360 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f619401cba0 tx=0x7f6194009390 comp rx=0 tx=0).stop 2024-09-17T05:34:45.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:45.077+0000 7f619f200640 1 -- 172.21.15.31:0/446527439 shutdown_connections 2024-09-17T05:34:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:45.077+0000 7f619f200640 1 --2- 172.21.15.31:0/446527439 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f617c073680 0x7f617c075b40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:45.077+0000 7f619f200640 1 --2- 172.21.15.31:0/446527439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619815bc70 0x7f619815e360 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:45.077+0000 7f619f200640 1 --2- 172.21.15.31:0/446527439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f619815b890 0x7f619815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:45.077+0000 7f619f200640 1 --2- 172.21.15.31:0/446527439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f619806cc20 0x7f61980c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:45.077+0000 7f619f200640 1 -- 172.21.15.31:0/446527439 >> 172.21.15.31:0/446527439 conn(0x7f619806dd30 msgr2=0x7f61980b5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:45.077+0000 7f619f200640 1 -- 172.21.15.31:0/446527439 shutdown_connections 2024-09-17T05:34:45.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:45.077+0000 7f619f200640 1 -- 172.21.15.31:0/446527439 wait complete. 2024-09-17T05:34:45.099 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:34:45.099 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:34:45.099 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-17T05:34:45.099 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:34:45.099 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:34:45.099 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:34:45.099 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:34:45.100 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:34:45.100 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:34:45.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:45.100 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-17T05:34:45.109 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:34:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:34:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:34:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:34:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-17T05:34:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:34:45.110 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:34:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:34:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-17T05:34:45.110 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:34:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:34:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-17T05:34:45.110 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:34:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-17T05:34:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-17T05:34:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:34:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42067sec preferred_lft 42067sec 2024-09-17T05:34:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-17T05:34:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:34:45.111 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:34:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:34:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-17T05:34:45.111 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:34:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:fe:f3:3e:aa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:34:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:34:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:34:45.111 INFO:teuthology.orchestra.run.smithi031.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:34:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:34:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:34:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:34:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:34:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:34:45.112 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:34:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:34:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:34:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:34:45.112 INFO:teuthology.orchestra.run.smithi031.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:34:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:34:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:34:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:34:45.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:45.114 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:34:45.175 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-17T05:34:45.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:45.177 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-17T05:34:45.235 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-17T05:34:45.235 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:34:45.235 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:34:45.235 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:34:45.235 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:34:45.235 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:34:45.235 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:34:45.236 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:34:45.236 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:34:45.236 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:34:45.236 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:34:45.236 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:34:45.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:34:45.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:34:45.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:45.379 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T05:34:45.388 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:34:45.389 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:34:45.389 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:34:45.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:45.389 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-09-17T05:34:45.454 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:34:45.454 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:34:45.509 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:34:45.510 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:34:45.510 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:34:45.560 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-17T05:34:45.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:45.561 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:34:45.650 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:34:45.650 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:34:45.663 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:34:45.663 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:34:45.663 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:34:45.663 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:34:45.663 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:34:45.667 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:34:45.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:45.667 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:34:45.687 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:34:45.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:34:45.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:34:45.801 INFO:teuthology.orchestra.run.smithi031.stdout:client6509 2024-09-17T05:34:45.802 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:34:45.802 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:34:45.811 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:34:46.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.001+0000 7f5b45a00640 1 -- 172.21.15.31:0/773936907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b400ced80 msgr2=0x7f5b400ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:46.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.001+0000 7f5b45a00640 1 --2- 172.21.15.31:0/773936907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b400ced80 0x7f5b400ae9b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009840 tx=0x7f5b2801c820 comp rx=0 tx=0).stop 2024-09-17T05:34:46.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.001+0000 7f5b45a00640 1 -- 172.21.15.31:0/773936907 shutdown_connections 2024-09-17T05:34:46.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.001+0000 7f5b45a00640 1 --2- 172.21.15.31:0/773936907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b400cdb30 0x7f5b400aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:46.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.001+0000 7f5b45a00640 1 --2- 172.21.15.31:0/773936907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b400ced80 0x7f5b400ae9b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:46.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.001+0000 7f5b45a00640 1 -- 172.21.15.31:0/773936907 >> 172.21.15.31:0/773936907 conn(0x7f5b400d1dc0 msgr2=0x7f5b400d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:46.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.001+0000 7f5b45a00640 1 -- 172.21.15.31:0/773936907 shutdown_connections 2024-09-17T05:34:46.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.001+0000 7f5b45a00640 1 -- 172.21.15.31:0/773936907 wait complete. 2024-09-17T05:34:46.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b45a00640 1 Processor -- start 2024-09-17T05:34:46.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b45a00640 1 -- start start 2024-09-17T05:34:46.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b45a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b400cdb30 0x7f5b40157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:46.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b45a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b400ced80 0x7f5b401f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:46.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b45a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b4015bea0 0x7f5b400c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:46.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b45a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5b40169340 con 0x7f5b400ced80 2024-09-17T05:34:46.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b45a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5b401691c0 con 0x7f5b4015bea0 2024-09-17T05:34:46.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b45a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5b401694c0 con 0x7f5b400cdb30 2024-09-17T05:34:46.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b37e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b400ced80 0x7f5b401f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b37e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b400ced80 0x7f5b401f5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45550/0 (socket says 172.21.15.31:45550) 2024-09-17T05:34:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b37e00640 1 -- 172.21.15.31:0/369183727 learned_addr learned my addr 172.21.15.31:0/369183727 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b3f400640 1 --2- 172.21.15.31:0/369183727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b4015bea0 0x7f5b400c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b3ea00640 1 --2- 172.21.15.31:0/369183727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b400cdb30 0x7f5b40157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b37e00640 1 -- 172.21.15.31:0/369183727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b400cdb30 msgr2=0x7f5b40157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b37e00640 1 --2- 172.21.15.31:0/369183727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b400cdb30 0x7f5b40157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b37e00640 1 -- 172.21.15.31:0/369183727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b4015bea0 msgr2=0x7f5b400c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b37e00640 1 --2- 172.21.15.31:0/369183727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b4015bea0 0x7f5b400c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b37e00640 1 -- 172.21.15.31:0/369183727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b401f62a0 con 0x7f5b400ced80 2024-09-17T05:34:46.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b37e00640 1 --2- 172.21.15.31:0/369183727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b400ced80 0x7f5b401f5980 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009790 tx=0x7f5b28005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:46.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b36a00640 1 -- 172.21.15.31:0/369183727 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b280b2040 con 0x7f5b400ced80 2024-09-17T05:34:46.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b36a00640 1 -- 172.21.15.31:0/369183727 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b28004320 con 0x7f5b400ced80 2024-09-17T05:34:46.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b45a00640 1 -- 172.21.15.31:0/369183727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b401f6580 con 0x7f5b400ced80 2024-09-17T05:34:46.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b36a00640 1 -- 172.21.15.31:0/369183727 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b280044f0 con 0x7f5b400ced80 2024-09-17T05:34:46.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.005+0000 7f5b45a00640 1 -- 172.21.15.31:0/369183727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b40157e70 con 0x7f5b400ced80 2024-09-17T05:34:46.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.009+0000 7f5b45a00640 1 -- 172.21.15.31:0/369183727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b400ce670 con 0x7f5b400ced80 2024-09-17T05:34:46.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.009+0000 7f5b36a00640 1 -- 172.21.15.31:0/369183727 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f5b28005280 con 0x7f5b400ced80 2024-09-17T05:34:46.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.009+0000 7f5b36a00640 1 --2- 172.21.15.31:0/369183727 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5b1c073680 0x7f5b1c075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:46.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.009+0000 7f5b36a00640 1 -- 172.21.15.31:0/369183727 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5795+0+0 (secure 0 0 0) 0x7f5b2812e3d0 con 0x7f5b400ced80 2024-09-17T05:34:46.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.009+0000 7f5b3ea00640 1 --2- 172.21.15.31:0/369183727 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5b1c073680 0x7f5b1c075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:46.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.009+0000 7f5b3ea00640 1 --2- 172.21.15.31:0/369183727 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5b1c073680 0x7f5b1c075b40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5b30007fd0 tx=0x7f5b30007ea0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:46.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.013+0000 7f5b36a00640 1 -- 172.21.15.31:0/369183727 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5b280bc060 con 0x7f5b400ced80 2024-09-17T05:34:46.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.233+0000 7f5b45a00640 1 -- 172.21.15.31:0/369183727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5b400b06f0 con 0x7f5b400ced80 2024-09-17T05:34:46.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.233+0000 7f5b36a00640 1 -- 172.21.15.31:0/369183727 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v81) ==== 53+0+73 (secure 0 0 0) 0x7f5b28016410 con 0x7f5b400ced80 2024-09-17T05:34:46.237 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:34:46.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.233+0000 7f5b45a00640 1 -- 172.21.15.31:0/369183727 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5b1c073680 msgr2=0x7f5b1c075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:46.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.233+0000 7f5b45a00640 1 --2- 172.21.15.31:0/369183727 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5b1c073680 0x7f5b1c075b40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5b30007fd0 tx=0x7f5b30007ea0 comp rx=0 tx=0).stop 2024-09-17T05:34:46.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.233+0000 7f5b45a00640 1 -- 172.21.15.31:0/369183727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b400ced80 msgr2=0x7f5b401f5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:46.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.233+0000 7f5b45a00640 1 --2- 172.21.15.31:0/369183727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b400ced80 0x7f5b401f5980 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009790 tx=0x7f5b28005dd0 comp rx=0 tx=0).stop 2024-09-17T05:34:46.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.233+0000 7f5b45a00640 1 -- 172.21.15.31:0/369183727 shutdown_connections 2024-09-17T05:34:46.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.233+0000 7f5b45a00640 1 --2- 172.21.15.31:0/369183727 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5b1c073680 0x7f5b1c075b40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:46.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.233+0000 7f5b45a00640 1 --2- 172.21.15.31:0/369183727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b4015bea0 0x7f5b400c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:46.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.233+0000 7f5b45a00640 1 --2- 172.21.15.31:0/369183727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b400ced80 0x7f5b401f5980 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:46.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.233+0000 7f5b45a00640 1 --2- 172.21.15.31:0/369183727 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b400cdb30 0x7f5b40157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:46.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.233+0000 7f5b45a00640 1 -- 172.21.15.31:0/369183727 >> 172.21.15.31:0/369183727 conn(0x7f5b400d1dc0 msgr2=0x7f5b40071370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:46.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.233+0000 7f5b45a00640 1 -- 172.21.15.31:0/369183727 shutdown_connections 2024-09-17T05:34:46.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:46.233+0000 7f5b45a00640 1 -- 172.21.15.31:0/369183727 wait complete. 2024-09-17T05:34:46.257 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:34:46.257 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:34:46.257 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-09-17T05:34:46.257 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:34:46.257 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:34:46.257 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:34:46.257 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:34:46.257 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:34:46.257 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:34:46.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:46.258 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-09-17T05:34:46.267 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:34:46.268 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:34:46.268 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:34:46.268 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:34:46.268 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-17T05:34:46.268 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:34:46.268 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:34:46.268 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:34:46.268 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-09-17T05:34:46.268 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:34:46.268 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:34:46.268 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-09-17T05:34:46.269 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:34:46.269 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-09-17T05:34:46.269 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:34:46.269 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-09-17T05:34:46.269 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-17T05:34:46.269 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42069sec preferred_lft 42069sec 2024-09-17T05:34:46.269 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-09-17T05:34:46.269 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:34:46.269 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:34:46.269 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:84:cd:fc:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:34:46.269 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:34:46.269 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:34:46.269 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:34:46.270 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:34:46.270 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:34:46.270 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:34:46.270 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:34:46.270 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:34:46.270 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:34:46.270 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:34:46.270 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:34:46.270 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:34:46.270 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:34:46.270 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:34:46.271 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:34:46.271 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:34:46.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:46.272 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:34:46.337 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-17T05:34:46.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:46.339 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-09-17T05:34:46.393 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-09-17T05:34:46.393 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:34:46.393 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-17T05:34:46.393 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:34:46.393 INFO:teuthology.orchestra.run.smithi155.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-17T05:34:46.394 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:34:46.394 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:34:46.394 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:34:46.394 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:34:46.394 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:34:46.394 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:34:46.394 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:34:46.394 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:34:46.394 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:34:46.394 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:34:46.394 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:34:46.395 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:34:46.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:34:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:34:46.532 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:34:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:34:46.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:46.539 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-17T05:34:46.547 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:34:46.547 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:34:46.548 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:34:46.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:46.549 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-09-17T05:34:46.608 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:34:46.609 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:34:46.657 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:34:46.657 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:34:46.658 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:34:46.713 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-17T05:34:46.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:46.713 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:34:46.807 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:34:46.808 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:34:46.820 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:34:46.820 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:34:46.821 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:34:46.821 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:34:46.821 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:34:46.824 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:34:46.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:46.825 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:34:46.889 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:34:46.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:34:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:34:46.988 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:34:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:34:46.994 INFO:teuthology.orchestra.run.smithi155.stdout:client6518 2024-09-17T05:34:46.994 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:34:46.995 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:34:47.004 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:34:47.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.165+0000 7f053de00640 1 -- 172.21.15.31:0/4181205828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05380b0b60 msgr2=0x7f05380ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:47.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.165+0000 7f053de00640 1 --2- 172.21.15.31:0/4181205828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05380b0b60 0x7f05380ccbd0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f0530009bc0 tx=0x7f053001f3b0 comp rx=0 tx=0).stop 2024-09-17T05:34:47.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.165+0000 7f053de00640 1 -- 172.21.15.31:0/4181205828 shutdown_connections 2024-09-17T05:34:47.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.165+0000 7f053de00640 1 --2- 172.21.15.31:0/4181205828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05380b0b60 0x7f05380ccbd0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:47.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.165+0000 7f053de00640 1 --2- 172.21.15.31:0/4181205828 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f053815be10 0x7f05380ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:47.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.165+0000 7f053de00640 1 -- 172.21.15.31:0/4181205828 >> 172.21.15.31:0/4181205828 conn(0x7f05380d1da0 msgr2=0x7f05380d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:47.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.165+0000 7f053de00640 1 -- 172.21.15.31:0/4181205828 shutdown_connections 2024-09-17T05:34:47.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.165+0000 7f053de00640 1 -- 172.21.15.31:0/4181205828 wait complete. 2024-09-17T05:34:47.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.165+0000 7f053de00640 1 Processor -- start 2024-09-17T05:34:47.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.165+0000 7f053de00640 1 -- start start 2024-09-17T05:34:47.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.165+0000 7f053de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05380b0b60 0x7f05380c6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:47.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.165+0000 7f053de00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f053815be10 0x7f05380c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:47.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.165+0000 7f053de00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f053815c1f0 0x7f05380c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:47.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.165+0000 7f053de00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f05380cd290 con 0x7f05380b0b60 2024-09-17T05:34:47.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.165+0000 7f053de00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f05380cd110 con 0x7f053815c1f0 2024-09-17T05:34:47.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.165+0000 7f053de00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f05380cd410 con 0x7f053815be10 2024-09-17T05:34:47.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.169+0000 7f0536a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05380b0b60 0x7f05380c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:47.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.169+0000 7f0536a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05380b0b60 0x7f05380c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45562/0 (socket says 172.21.15.31:45562) 2024-09-17T05:34:47.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.169+0000 7f0536a00640 1 -- 172.21.15.31:0/3356247901 learned_addr learned my addr 172.21.15.31:0/3356247901 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:47.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.169+0000 7f0537400640 1 --2- 172.21.15.31:0/3356247901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f053815c1f0 0x7f05380c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:47.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.169+0000 7f052fe00640 1 --2- 172.21.15.31:0/3356247901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f053815be10 0x7f05380c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:47.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.169+0000 7f0536a00640 1 -- 172.21.15.31:0/3356247901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f053815be10 msgr2=0x7f05380c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:47.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.169+0000 7f0536a00640 1 --2- 172.21.15.31:0/3356247901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f053815be10 0x7f05380c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:47.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.169+0000 7f0536a00640 1 -- 172.21.15.31:0/3356247901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f053815c1f0 msgr2=0x7f05380c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:47.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.169+0000 7f0536a00640 1 --2- 172.21.15.31:0/3356247901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f053815c1f0 0x7f05380c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:47.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.169+0000 7f0536a00640 1 -- 172.21.15.31:0/3356247901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05380cff00 con 0x7f05380b0b60 2024-09-17T05:34:47.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.169+0000 7f0536a00640 1 --2- 172.21.15.31:0/3356247901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05380b0b60 0x7f05380c6920 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f052800d980 tx=0x7f052800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:47.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.169+0000 7f052f400640 1 -- 172.21.15.31:0/3356247901 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0528017070 con 0x7f05380b0b60 2024-09-17T05:34:47.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.169+0000 7f052f400640 1 -- 172.21.15.31:0/3356247901 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0528009d20 con 0x7f05380b0b60 2024-09-17T05:34:47.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.169+0000 7f052f400640 1 -- 172.21.15.31:0/3356247901 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0528004280 con 0x7f05380b0b60 2024-09-17T05:34:47.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.169+0000 7f053de00640 1 -- 172.21.15.31:0/3356247901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05380d14f0 con 0x7f05380b0b60 2024-09-17T05:34:47.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.169+0000 7f053de00640 1 -- 172.21.15.31:0/3356247901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05380c5630 con 0x7f05380b0b60 2024-09-17T05:34:47.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.169+0000 7f053de00640 1 -- 172.21.15.31:0/3356247901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05380ccbd0 con 0x7f05380b0b60 2024-09-17T05:34:47.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.169+0000 7f052f400640 1 -- 172.21.15.31:0/3356247901 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f0528003600 con 0x7f05380b0b60 2024-09-17T05:34:47.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.173+0000 7f052f400640 1 --2- 172.21.15.31:0/3356247901 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0514073680 0x7f0514075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:47.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.173+0000 7f052f400640 1 -- 172.21.15.31:0/3356247901 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5795+0+0 (secure 0 0 0) 0x7f0528095070 con 0x7f05380b0b60 2024-09-17T05:34:47.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.173+0000 7f052fe00640 1 --2- 172.21.15.31:0/3356247901 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0514073680 0x7f0514075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:47.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.173+0000 7f052fe00640 1 --2- 172.21.15.31:0/3356247901 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0514073680 0x7f0514075b40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f05380b7720 tx=0x7f0520007ea0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:47.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.177+0000 7f052f400640 1 -- 172.21.15.31:0/3356247901 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f052805f270 con 0x7f05380b0b60 2024-09-17T05:34:47.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.389+0000 7f053de00640 1 -- 172.21.15.31:0/3356247901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f0538070350 con 0x7f05380b0b60 2024-09-17T05:34:47.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.805+0000 7f052f400640 1 -- 172.21.15.31:0/3356247901 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v82) ==== 136+0+0 (secure 0 0 0) 0x7f0528063ca0 con 0x7f05380b0b60 2024-09-17T05:34:47.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.809+0000 7f053de00640 1 -- 172.21.15.31:0/3356247901 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0514073680 msgr2=0x7f0514075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:47.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.809+0000 7f053de00640 1 --2- 172.21.15.31:0/3356247901 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0514073680 0x7f0514075b40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f05380b7720 tx=0x7f0520007ea0 comp rx=0 tx=0).stop 2024-09-17T05:34:47.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.809+0000 7f053de00640 1 -- 172.21.15.31:0/3356247901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05380b0b60 msgr2=0x7f05380c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:47.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.809+0000 7f053de00640 1 --2- 172.21.15.31:0/3356247901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05380b0b60 0x7f05380c6920 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f052800d980 tx=0x7f052800de40 comp rx=0 tx=0).stop 2024-09-17T05:34:47.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.809+0000 7f053de00640 1 -- 172.21.15.31:0/3356247901 shutdown_connections 2024-09-17T05:34:47.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.809+0000 7f053de00640 1 --2- 172.21.15.31:0/3356247901 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0514073680 0x7f0514075b40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:47.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.809+0000 7f053de00640 1 --2- 172.21.15.31:0/3356247901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f053815c1f0 0x7f05380c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:47.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.809+0000 7f053de00640 1 --2- 172.21.15.31:0/3356247901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f053815be10 0x7f05380c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:47.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.809+0000 7f053de00640 1 --2- 172.21.15.31:0/3356247901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05380b0b60 0x7f05380c6920 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:47.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.809+0000 7f053de00640 1 -- 172.21.15.31:0/3356247901 >> 172.21.15.31:0/3356247901 conn(0x7f05380d1da0 msgr2=0x7f05380afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:47.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.809+0000 7f053de00640 1 -- 172.21.15.31:0/3356247901 shutdown_connections 2024-09-17T05:34:47.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.809+0000 7f053de00640 1 -- 172.21.15.31:0/3356247901 wait complete. 2024-09-17T05:34:47.833 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:34:47.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.981+0000 7f487fe00640 1 -- 172.21.15.31:0/2135528374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f488015f300 msgr2=0x7f488006f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:47.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.981+0000 7f487fe00640 1 --2- 172.21.15.31:0/2135528374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f488015f300 0x7f488006f990 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f48800ccbc0 tx=0x7f487801cd80 comp rx=0 tx=0).stop 2024-09-17T05:34:47.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.981+0000 7f487fe00640 1 -- 172.21.15.31:0/2135528374 shutdown_connections 2024-09-17T05:34:47.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.981+0000 7f487fe00640 1 --2- 172.21.15.31:0/2135528374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f488015f300 0x7f488006f990 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:47.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.981+0000 7f487fe00640 1 --2- 172.21.15.31:0/2135528374 >> v2:172.21.15.155:3300/0 conn(0x7f4880074980 0x7f488015edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:47.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.981+0000 7f487fe00640 1 -- 172.21.15.31:0/2135528374 >> 172.21.15.31:0/2135528374 conn(0x7f4880073490 msgr2=0x7f48800d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:47.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.981+0000 7f487fe00640 1 -- 172.21.15.31:0/2135528374 shutdown_connections 2024-09-17T05:34:47.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.981+0000 7f487fe00640 1 -- 172.21.15.31:0/2135528374 wait complete. 2024-09-17T05:34:47.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f487fe00640 1 Processor -- start 2024-09-17T05:34:47.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f487fe00640 1 -- start start 2024-09-17T05:34:47.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f487fe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48800745a0 0x7f48800b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:47.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f487fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4880074980 0x7f48801583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:47.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f487fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f488015f300 0x7f48801588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:47.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f487fe00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4880167b40 con 0x7f4880074980 2024-09-17T05:34:47.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f487fe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4880070c80 con 0x7f48800745a0 2024-09-17T05:34:47.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f487fe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4880167cc0 con 0x7f488015f300 2024-09-17T05:34:47.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f4876000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4880074980 0x7f48801583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:47.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f4876000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4880074980 0x7f48801583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45594/0 (socket says 172.21.15.31:45594) 2024-09-17T05:34:47.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f4876000640 1 -- 172.21.15.31:0/1104731963 learned_addr learned my addr 172.21.15.31:0/1104731963 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:47.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f487ea00640 1 --2- 172.21.15.31:0/1104731963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48800745a0 0x7f48800b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:47.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f487f400640 1 --2- 172.21.15.31:0/1104731963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f488015f300 0x7f48801588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:47.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f4876000640 1 -- 172.21.15.31:0/1104731963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f488015f300 msgr2=0x7f48801588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:47.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f4876000640 1 --2- 172.21.15.31:0/1104731963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f488015f300 0x7f48801588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:47.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f4876000640 1 -- 172.21.15.31:0/1104731963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48800745a0 msgr2=0x7f48800b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:47.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f4876000640 1 --2- 172.21.15.31:0/1104731963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48800745a0 0x7f48800b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:47.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f4876000640 1 -- 172.21.15.31:0/1104731963 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48800afcd0 con 0x7f4880074980 2024-09-17T05:34:47.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f4876000640 1 --2- 172.21.15.31:0/1104731963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4880074980 0x7f48801583a0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f486800d980 tx=0x7f486800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:47.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f4877400640 1 -- 172.21.15.31:0/1104731963 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4868017030 con 0x7f4880074980 2024-09-17T05:34:47.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f4877400640 1 -- 172.21.15.31:0/1104731963 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4868009b20 con 0x7f4880074980 2024-09-17T05:34:47.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f4877400640 1 -- 172.21.15.31:0/1104731963 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4868004020 con 0x7f4880074980 2024-09-17T05:34:47.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f487fe00640 1 -- 172.21.15.31:0/1104731963 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48800affb0 con 0x7f4880074980 2024-09-17T05:34:47.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f487fe00640 1 -- 172.21.15.31:0/1104731963 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48800b0570 con 0x7f4880074980 2024-09-17T05:34:47.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.985+0000 7f487fe00640 1 -- 172.21.15.31:0/1104731963 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f488015edc0 con 0x7f4880074980 2024-09-17T05:34:47.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.989+0000 7f4877400640 1 -- 172.21.15.31:0/1104731963 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f486801a070 con 0x7f4880074980 2024-09-17T05:34:47.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.989+0000 7f4877400640 1 --2- 172.21.15.31:0/1104731963 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f485c073680 0x7f485c075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:47.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.989+0000 7f4877400640 1 -- 172.21.15.31:0/1104731963 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5795+0+0 (secure 0 0 0) 0x7f4868094cb0 con 0x7f4880074980 2024-09-17T05:34:47.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.989+0000 7f487ea00640 1 --2- 172.21.15.31:0/1104731963 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f485c073680 0x7f485c075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:47.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.989+0000 7f487ea00640 1 --2- 172.21.15.31:0/1104731963 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f485c073680 0x7f485c075b40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4870007fd0 tx=0x7f4870009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:47.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:47.993+0000 7f4877400640 1 -- 172.21.15.31:0/1104731963 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f486805ef70 con 0x7f4880074980 2024-09-17T05:34:48.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.193+0000 7f487fe00640 1 -- 172.21.15.31:0/1104731963 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f48801560f0 con 0x7f485c073680 2024-09-17T05:34:48.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.193+0000 7f4877400640 1 -- 172.21.15.31:0/1104731963 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f48801560f0 con 0x7f485c073680 2024-09-17T05:34:48.197 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:34:48.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:34:48.197 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephfs" 2024-09-17T05:34:48.198 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:48.198 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:34:48.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.197+0000 7f487fe00640 1 -- 172.21.15.31:0/1104731963 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f485c073680 msgr2=0x7f485c075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:48.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.197+0000 7f487fe00640 1 --2- 172.21.15.31:0/1104731963 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f485c073680 0x7f485c075b40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4870007fd0 tx=0x7f4870009040 comp rx=0 tx=0).stop 2024-09-17T05:34:48.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.197+0000 7f487fe00640 1 -- 172.21.15.31:0/1104731963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4880074980 msgr2=0x7f48801583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:48.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.197+0000 7f487fe00640 1 --2- 172.21.15.31:0/1104731963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4880074980 0x7f48801583a0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f486800d980 tx=0x7f486800de40 comp rx=0 tx=0).stop 2024-09-17T05:34:48.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.197+0000 7f487fe00640 1 -- 172.21.15.31:0/1104731963 shutdown_connections 2024-09-17T05:34:48.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.197+0000 7f487fe00640 1 --2- 172.21.15.31:0/1104731963 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f485c073680 0x7f485c075b40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:48.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.197+0000 7f487fe00640 1 --2- 172.21.15.31:0/1104731963 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f488015f300 0x7f48801588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:48.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.197+0000 7f487fe00640 1 --2- 172.21.15.31:0/1104731963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4880074980 0x7f48801583a0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:48.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.197+0000 7f487fe00640 1 --2- 172.21.15.31:0/1104731963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f48800745a0 0x7f48800b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:48.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.197+0000 7f487fe00640 1 -- 172.21.15.31:0/1104731963 >> 172.21.15.31:0/1104731963 conn(0x7f4880073490 msgr2=0x7f4880164950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:48.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.197+0000 7f487fe00640 1 -- 172.21.15.31:0/1104731963 shutdown_connections 2024-09-17T05:34:48.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.197+0000 7f487fe00640 1 -- 172.21.15.31:0/1104731963 wait complete. 2024-09-17T05:34:48.220 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:34:48.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3769e00640 1 -- 172.21.15.31:0/1586263146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37640b2a00 msgr2=0x7f37640b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:48.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3769e00640 1 --2- 172.21.15.31:0/1586263146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37640b2a00 0x7f37640b39e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f374c009900 tx=0x7f374c01c8b0 comp rx=0 tx=0).stop 2024-09-17T05:34:48.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3769e00640 1 -- 172.21.15.31:0/1586263146 shutdown_connections 2024-09-17T05:34:48.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3769e00640 1 --2- 172.21.15.31:0/1586263146 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37640b2a00 0x7f37640b39e0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:48.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3769e00640 1 --2- 172.21.15.31:0/1586263146 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f376415f340 0x7f37640b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:48.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3769e00640 1 -- 172.21.15.31:0/1586263146 >> 172.21.15.31:0/1586263146 conn(0x7f37640d1e00 msgr2=0x7f37640d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:48.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3769e00640 1 -- 172.21.15.31:0/1586263146 shutdown_connections 2024-09-17T05:34:48.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3769e00640 1 -- 172.21.15.31:0/1586263146 wait complete. 2024-09-17T05:34:48.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3769e00640 1 Processor -- start 2024-09-17T05:34:48.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3769e00640 1 -- start start 2024-09-17T05:34:48.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3769e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37640b2a00 0x7f376415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3769e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37640ccf10 0x7f3764158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3769e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f376415f340 0x7f37641facb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3769e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3764168f10 con 0x7f37640b2a00 2024-09-17T05:34:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3769e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3764168d90 con 0x7f376415f340 2024-09-17T05:34:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3769e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3764169090 con 0x7f37640ccf10 2024-09-17T05:34:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3762a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37640b2a00 0x7f376415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3762a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37640b2a00 0x7f376415bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45610/0 (socket says 172.21.15.31:45610) 2024-09-17T05:34:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3762a00640 1 -- 172.21.15.31:0/80792571 learned_addr learned my addr 172.21.15.31:0/80792571 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f375be00640 1 --2- 172.21.15.31:0/80792571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37640ccf10 0x7f3764158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.369+0000 7f3763400640 1 --2- 172.21.15.31:0/80792571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f376415f340 0x7f37641facb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.373+0000 7f3762a00640 1 -- 172.21.15.31:0/80792571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37640ccf10 msgr2=0x7f3764158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.373+0000 7f3762a00640 1 --2- 172.21.15.31:0/80792571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37640ccf10 0x7f3764158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.373+0000 7f3762a00640 1 -- 172.21.15.31:0/80792571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f376415f340 msgr2=0x7f37641facb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.373+0000 7f3762a00640 1 --2- 172.21.15.31:0/80792571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f376415f340 0x7f37641facb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.373+0000 7f3762a00640 1 -- 172.21.15.31:0/80792571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37640c5940 con 0x7f37640b2a00 2024-09-17T05:34:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.373+0000 7f3763400640 1 --2- 172.21.15.31:0/80792571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f376415f340 0x7f37641facb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.373+0000 7f3762a00640 1 --2- 172.21.15.31:0/80792571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37640b2a00 0x7f376415bae0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f375400d950 tx=0x7f375400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.373+0000 7f375b400640 1 -- 172.21.15.31:0/80792571 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3754017070 con 0x7f37640b2a00 2024-09-17T05:34:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.373+0000 7f375b400640 1 -- 172.21.15.31:0/80792571 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3754009d20 con 0x7f37640b2a00 2024-09-17T05:34:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.373+0000 7f375b400640 1 -- 172.21.15.31:0/80792571 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37540106c0 con 0x7f37640b2a00 2024-09-17T05:34:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.373+0000 7f3769e00640 1 -- 172.21.15.31:0/80792571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f376415db10 con 0x7f37640b2a00 2024-09-17T05:34:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.373+0000 7f3769e00640 1 -- 172.21.15.31:0/80792571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37641fb880 con 0x7f37640b2a00 2024-09-17T05:34:48.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.373+0000 7f3769e00640 1 -- 172.21.15.31:0/80792571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37640cd3a0 con 0x7f37640b2a00 2024-09-17T05:34:48.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.373+0000 7f375b400640 1 -- 172.21.15.31:0/80792571 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f375401a070 con 0x7f37640b2a00 2024-09-17T05:34:48.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.373+0000 7f375b400640 1 --2- 172.21.15.31:0/80792571 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f37400736b0 0x7f3740075b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:48.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.377+0000 7f375b400640 1 -- 172.21.15.31:0/80792571 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5795+0+0 (secure 0 0 0) 0x7f3754094c60 con 0x7f37640b2a00 2024-09-17T05:34:48.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.377+0000 7f375be00640 1 --2- 172.21.15.31:0/80792571 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f37400736b0 0x7f3740075b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:48.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.377+0000 7f375be00640 1 --2- 172.21.15.31:0/80792571 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f37400736b0 0x7f3740075b70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f374c0af000 tx=0x7f374c01b0f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:48.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.377+0000 7f375b400640 1 -- 172.21.15.31:0/80792571 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f375405ee50 con 0x7f37640b2a00 2024-09-17T05:34:48.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.557+0000 7f3769e00640 1 -- 172.21.15.31:0/80792571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f376415e420 con 0x7f37640b2a00 2024-09-17T05:34:48.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.557+0000 7f375b400640 1 -- 172.21.15.31:0/80792571 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7f3754063880 con 0x7f37640b2a00 2024-09-17T05:34:48.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.561+0000 7f3769e00640 1 -- 172.21.15.31:0/80792571 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f37400736b0 msgr2=0x7f3740075b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:48.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.561+0000 7f3769e00640 1 --2- 172.21.15.31:0/80792571 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f37400736b0 0x7f3740075b70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f374c0af000 tx=0x7f374c01b0f0 comp rx=0 tx=0).stop 2024-09-17T05:34:48.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.561+0000 7f3769e00640 1 -- 172.21.15.31:0/80792571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37640b2a00 msgr2=0x7f376415bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:48.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.561+0000 7f3769e00640 1 --2- 172.21.15.31:0/80792571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37640b2a00 0x7f376415bae0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f375400d950 tx=0x7f375400de10 comp rx=0 tx=0).stop 2024-09-17T05:34:48.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.561+0000 7f3769e00640 1 -- 172.21.15.31:0/80792571 shutdown_connections 2024-09-17T05:34:48.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.561+0000 7f3769e00640 1 --2- 172.21.15.31:0/80792571 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f37400736b0 0x7f3740075b70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:48.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.561+0000 7f3769e00640 1 --2- 172.21.15.31:0/80792571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f376415f340 0x7f37641facb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:48.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.561+0000 7f3769e00640 1 --2- 172.21.15.31:0/80792571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f37640ccf10 0x7f3764158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:48.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.561+0000 7f3769e00640 1 --2- 172.21.15.31:0/80792571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37640b2a00 0x7f376415bae0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:48.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.561+0000 7f3769e00640 1 -- 172.21.15.31:0/80792571 >> 172.21.15.31:0/80792571 conn(0x7f37640d1e00 msgr2=0x7f376406de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:48.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.561+0000 7f3769e00640 1 -- 172.21.15.31:0/80792571 shutdown_connections 2024-09-17T05:34:48.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:48.561+0000 7f3769e00640 1 -- 172.21.15.31:0/80792571 wait complete. 2024-09-17T05:34:48.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:48.583 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol81990/90cb822b-a414-493e-af8a-2171358548d8) 2024-09-17T05:34:48.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:48.611 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol81990/90cb822b-a414-493e-af8a-2171358548d8/.snap/fake) 2024-09-17T05:34:48.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:48.682 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-17T05:34:48.739 INFO:teuthology.orchestra.run.smithi031.stdout:cephfs_data 2024-09-17T05:34:48.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:48.739 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol81990/90cb822b-a414-493e-af8a-2171358548d8) 2024-09-17T05:34:48.810 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:34:48.810 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol81990/.meta 2024-09-17T05:34:48.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:48.878 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/subvol_grp14870/subvol15551/ea83c0ac-a09b-4067-8b59-48b608fb511d) 2024-09-17T05:34:48.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:48.948 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/subvol_grp14870/subvol15551/ea83c0ac-a09b-4067-8b59-48b608fb511d/.snap/fake) 2024-09-17T05:34:49.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:49.021 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-17T05:34:49.075 INFO:teuthology.orchestra.run.smithi031.stdout:cephfs_data 2024-09-17T05:34:49.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:49.075 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/subvol_grp14870/subvol15551/ea83c0ac-a09b-4067-8b59-48b608fb511d) 2024-09-17T05:34:49.141 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:34:49.141 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/subvol_grp14870/subvol15551/.meta 2024-09-17T05:34:49.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:49.205 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol76272/b37e4ffa-9dbd-4bbe-a2fd-79fd39dac489) 2024-09-17T05:34:49.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:49.272 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-17T05:34:49.322 INFO:teuthology.orchestra.run.smithi031.stdout:cephfs_data 2024-09-17T05:34:49.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:49.323 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol76272/b37e4ffa-9dbd-4bbe-a2fd-79fd39dac489) 2024-09-17T05:34:49.391 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:34:49.391 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol76272/.meta 2024-09-17T05:34:49.457 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol81990 2024-09-17T05:34:49.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7521200640 1 -- 172.21.15.31:0/4207129246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f751c0afb10 msgr2=0x7f751c0affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:49.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7521200640 1 --2- 172.21.15.31:0/4207129246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f751c0afb10 0x7f751c0affc0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f751c073810 tx=0x7f751401cb80 comp rx=0 tx=0).stop 2024-09-17T05:34:49.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7521200640 1 -- 172.21.15.31:0/4207129246 shutdown_connections 2024-09-17T05:34:49.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7521200640 1 --2- 172.21.15.31:0/4207129246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f751c0afb10 0x7f751c0affc0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:49.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7521200640 1 --2- 172.21.15.31:0/4207129246 >> v2:172.21.15.155:3300/0 conn(0x7f751c1605d0 0x7f751c0d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7521200640 1 -- 172.21.15.31:0/4207129246 >> 172.21.15.31:0/4207129246 conn(0x7f751c0d1dd0 msgr2=0x7f751c0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7521200640 1 -- 172.21.15.31:0/4207129246 shutdown_connections 2024-09-17T05:34:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7521200640 1 -- 172.21.15.31:0/4207129246 wait complete. 2024-09-17T05:34:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7521200640 1 Processor -- start 2024-09-17T05:34:49.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7521200640 1 -- start start 2024-09-17T05:34:49.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7521200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f751c0afb10 0x7f751c1599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:49.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7521200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f751c0b1650 0x7f751c15e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:49.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7521200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f751c1605d0 0x7f751c15add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:49.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7521200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f751c169540 con 0x7f751c0b1650 2024-09-17T05:34:49.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7521200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f751c0b1430 con 0x7f751c1605d0 2024-09-17T05:34:49.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7521200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f751c1696c0 con 0x7f751c0afb10 2024-09-17T05:34:49.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7511400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f751c0b1650 0x7f751c15e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:49.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7511400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f751c0b1650 0x7f751c15e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39536/0 (socket says 172.21.15.31:39536) 2024-09-17T05:34:49.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7511400640 1 -- 172.21.15.31:0/3361294215 learned_addr learned my addr 172.21.15.31:0/3361294215 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:49.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f751a800640 1 --2- 172.21.15.31:0/3361294215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f751c1605d0 0x7f751c15add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:49.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7519e00640 1 --2- 172.21.15.31:0/3361294215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f751c0afb10 0x7f751c1599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:49.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7511400640 1 -- 172.21.15.31:0/3361294215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f751c0afb10 msgr2=0x7f751c1599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:49.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7511400640 1 --2- 172.21.15.31:0/3361294215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f751c0afb10 0x7f751c1599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:49.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7511400640 1 -- 172.21.15.31:0/3361294215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f751c1605d0 msgr2=0x7f751c15add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:49.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7511400640 1 --2- 172.21.15.31:0/3361294215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f751c1605d0 0x7f751c15add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:49.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.653+0000 7f7511400640 1 -- 172.21.15.31:0/3361294215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751c0b7320 con 0x7f751c0b1650 2024-09-17T05:34:49.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.657+0000 7f7511400640 1 --2- 172.21.15.31:0/3361294215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f751c0b1650 0x7f751c15e380 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f750400c480 tx=0x7f750400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.657+0000 7f7512a00640 1 -- 172.21.15.31:0/3361294215 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7504016020 con 0x7f751c0b1650 2024-09-17T05:34:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.657+0000 7f7512a00640 1 -- 172.21.15.31:0/3361294215 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7504012920 con 0x7f751c0b1650 2024-09-17T05:34:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.657+0000 7f7512a00640 1 -- 172.21.15.31:0/3361294215 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7504012d70 con 0x7f751c0b1650 2024-09-17T05:34:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.657+0000 7f7521200640 1 -- 172.21.15.31:0/3361294215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751c15d5c0 con 0x7f751c0b1650 2024-09-17T05:34:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.657+0000 7f7521200640 1 -- 172.21.15.31:0/3361294215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f751c15db80 con 0x7f751c0b1650 2024-09-17T05:34:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.657+0000 7f7521200640 1 -- 172.21.15.31:0/3361294215 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f751c0affc0 con 0x7f751c0b1650 2024-09-17T05:34:49.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.657+0000 7f7512a00640 1 -- 172.21.15.31:0/3361294215 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f7504019020 con 0x7f751c0b1650 2024-09-17T05:34:49.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.657+0000 7f7512a00640 1 --2- 172.21.15.31:0/3361294215 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f74f8073680 0x7f74f8075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:49.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.657+0000 7f7512a00640 1 -- 172.21.15.31:0/3361294215 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5795+0+0 (secure 0 0 0) 0x7f75040949c0 con 0x7f751c0b1650 2024-09-17T05:34:49.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.657+0000 7f7519e00640 1 --2- 172.21.15.31:0/3361294215 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f74f8073680 0x7f74f8075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:49.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.661+0000 7f7519e00640 1 --2- 172.21.15.31:0/3361294215 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f74f8073680 0x7f74f8075b40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f750c00bb50 tx=0x7f750c00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:49.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.661+0000 7f7512a00640 1 -- 172.21.15.31:0/3361294215 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7504020020 con 0x7f751c0b1650 2024-09-17T05:34:49.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.865+0000 7f7521200640 1 -- 172.21.15.31:0/3361294215 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol81990", "target": ["mon-mgr", ""]}) -- 0x7f751c0d1080 con 0x7f74f8073680 2024-09-17T05:34:49.877 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:49.873+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:49.877 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:49.873+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:49.877 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:49.873+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:49.877 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:49.873+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:49.877 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:49.873+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:49.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.917+0000 7f7512a00640 1 -- 172.21.15.31:0/3361294215 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7f751c0d1080 con 0x7f74f8073680 2024-09-17T05:34:49.920 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/_nogroup/subvol81990/90cb822b-a414-493e-af8a-2171358548d8 2024-09-17T05:34:49.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.921+0000 7f7521200640 1 -- 172.21.15.31:0/3361294215 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f74f8073680 msgr2=0x7f74f8075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:49.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.921+0000 7f7521200640 1 --2- 172.21.15.31:0/3361294215 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f74f8073680 0x7f74f8075b40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f750c00bb50 tx=0x7f750c00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:34:49.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.921+0000 7f7521200640 1 -- 172.21.15.31:0/3361294215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f751c0b1650 msgr2=0x7f751c15e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:49.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.921+0000 7f7521200640 1 --2- 172.21.15.31:0/3361294215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f751c0b1650 0x7f751c15e380 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f750400c480 tx=0x7f750400c940 comp rx=0 tx=0).stop 2024-09-17T05:34:49.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.921+0000 7f7521200640 1 -- 172.21.15.31:0/3361294215 shutdown_connections 2024-09-17T05:34:49.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.921+0000 7f7521200640 1 --2- 172.21.15.31:0/3361294215 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f74f8073680 0x7f74f8075b40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:49.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.921+0000 7f7521200640 1 --2- 172.21.15.31:0/3361294215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f751c1605d0 0x7f751c15add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:49.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.921+0000 7f7521200640 1 --2- 172.21.15.31:0/3361294215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f751c0b1650 0x7f751c15e380 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:49.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.921+0000 7f7521200640 1 --2- 172.21.15.31:0/3361294215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f751c0afb10 0x7f751c1599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:49.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.921+0000 7f7521200640 1 -- 172.21.15.31:0/3361294215 >> 172.21.15.31:0/3361294215 conn(0x7f751c0d1dd0 msgr2=0x7f751c0b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:49.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.921+0000 7f7521200640 1 -- 172.21.15.31:0/3361294215 shutdown_connections 2024-09-17T05:34:49.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:49.921+0000 7f7521200640 1 -- 172.21.15.31:0/3361294215 wait complete. 2024-09-17T05:34:49.941 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol15551 subvol_grp14870 2024-09-17T05:34:50.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.093+0000 7fce39000640 1 -- 172.21.15.31:0/1095163022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce340cfca0 msgr2=0x7fce340d0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:50.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.093+0000 7fce39000640 1 --2- 172.21.15.31:0/1095163022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce340cfca0 0x7fce340d0080 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fce24009900 tx=0x7fce2401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.093+0000 7fce39000640 1 -- 172.21.15.31:0/1095163022 shutdown_connections 2024-09-17T05:34:50.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.093+0000 7fce39000640 1 --2- 172.21.15.31:0/1095163022 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce340b2a20 0x7fce3415fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.093+0000 7fce39000640 1 --2- 172.21.15.31:0/1095163022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce340cfca0 0x7fce340d0080 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.093+0000 7fce39000640 1 -- 172.21.15.31:0/1095163022 >> 172.21.15.31:0/1095163022 conn(0x7fce340d1c60 msgr2=0x7fce340d2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:50.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.093+0000 7fce39000640 1 -- 172.21.15.31:0/1095163022 shutdown_connections 2024-09-17T05:34:50.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.093+0000 7fce39000640 1 -- 172.21.15.31:0/1095163022 wait complete. 2024-09-17T05:34:50.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce39000640 1 Processor -- start 2024-09-17T05:34:50.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce39000640 1 -- start start 2024-09-17T05:34:50.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce39000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce340b2a20 0x7fce34154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:50.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce39000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340cfca0 0x7fce340c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:50.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce39000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce3415ff80 0x7fce340cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:50.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce39000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fce34169300 con 0x7fce340b2a20 2024-09-17T05:34:50.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce39000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce34169180 con 0x7fce340cfca0 2024-09-17T05:34:50.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce39000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fce34169480 con 0x7fce3415ff80 2024-09-17T05:34:50.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce33400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce340b2a20 0x7fce34154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:50.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce33400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce340b2a20 0x7fce34154fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39568/0 (socket says 172.21.15.31:39568) 2024-09-17T05:34:50.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce33400640 1 -- 172.21.15.31:0/1107933535 learned_addr learned my addr 172.21.15.31:0/1107933535 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:50.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce2be00640 1 --2- 172.21.15.31:0/1107933535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340cfca0 0x7fce340c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:50.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce33e00640 1 --2- 172.21.15.31:0/1107933535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce3415ff80 0x7fce340cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:50.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce33400640 1 -- 172.21.15.31:0/1107933535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce3415ff80 msgr2=0x7fce340cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:50.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce33400640 1 --2- 172.21.15.31:0/1107933535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce3415ff80 0x7fce340cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce33400640 1 -- 172.21.15.31:0/1107933535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340cfca0 msgr2=0x7fce340c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:50.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce33400640 1 --2- 172.21.15.31:0/1107933535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340cfca0 0x7fce340c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce33400640 1 -- 172.21.15.31:0/1107933535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce340c5f30 con 0x7fce340b2a20 2024-09-17T05:34:50.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce2be00640 1 --2- 172.21.15.31:0/1107933535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340cfca0 0x7fce340c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:34:50.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce33e00640 1 --2- 172.21.15.31:0/1107933535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce3415ff80 0x7fce340cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:34:50.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce33400640 1 --2- 172.21.15.31:0/1107933535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce340b2a20 0x7fce34154fb0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fce240b0040 tx=0x7fce24004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:50.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce2b400640 1 -- 172.21.15.31:0/1107933535 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce240ba020 con 0x7fce340b2a20 2024-09-17T05:34:50.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce2b400640 1 -- 172.21.15.31:0/1107933535 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce24005030 con 0x7fce340b2a20 2024-09-17T05:34:50.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce2b400640 1 -- 172.21.15.31:0/1107933535 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce240b2040 con 0x7fce340b2a20 2024-09-17T05:34:50.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce39000640 1 -- 172.21.15.31:0/1107933535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce340c6210 con 0x7fce340b2a20 2024-09-17T05:34:50.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.097+0000 7fce39000640 1 -- 172.21.15.31:0/1107933535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce340c67d0 con 0x7fce340b2a20 2024-09-17T05:34:50.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.101+0000 7fce39000640 1 -- 172.21.15.31:0/1107933535 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce3415bee0 con 0x7fce340b2a20 2024-09-17T05:34:50.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.101+0000 7fce2b400640 1 -- 172.21.15.31:0/1107933535 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7fce24005440 con 0x7fce340b2a20 2024-09-17T05:34:50.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.101+0000 7fce2b400640 1 --2- 172.21.15.31:0/1107933535 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fce10073680 0x7fce10075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:50.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.101+0000 7fce2b400640 1 -- 172.21.15.31:0/1107933535 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5795+0+0 (secure 0 0 0) 0x7fce2412eb80 con 0x7fce340b2a20 2024-09-17T05:34:50.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.101+0000 7fce2be00640 1 --2- 172.21.15.31:0/1107933535 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fce10073680 0x7fce10075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:50.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.101+0000 7fce2be00640 1 --2- 172.21.15.31:0/1107933535 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fce10073680 0x7fce10075b40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fce1c005fd0 tx=0x7fce1c005dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:50.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.105+0000 7fce2b400640 1 -- 172.21.15.31:0/1107933535 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fce240c4060 con 0x7fce340b2a20 2024-09-17T05:34:50.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.309+0000 7fce39000640 1 -- 172.21.15.31:0/1107933535 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol15551", "group_name": "subvol_grp14870", "target": ["mon-mgr", ""]}) -- 0x7fce3415bc00 con 0x7fce10073680 2024-09-17T05:34:50.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.341+0000 7fce2b400640 1 -- 172.21.15.31:0/1107933535 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+74 (secure 0 0 0) 0x7fce3415bc00 con 0x7fce10073680 2024-09-17T05:34:50.344 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/subvol_grp14870/subvol15551/ea83c0ac-a09b-4067-8b59-48b608fb511d 2024-09-17T05:34:50.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.345+0000 7fce39000640 1 -- 172.21.15.31:0/1107933535 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fce10073680 msgr2=0x7fce10075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:50.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.345+0000 7fce39000640 1 --2- 172.21.15.31:0/1107933535 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fce10073680 0x7fce10075b40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fce1c005fd0 tx=0x7fce1c005dc0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.345+0000 7fce39000640 1 -- 172.21.15.31:0/1107933535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce340b2a20 msgr2=0x7fce34154fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:50.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.345+0000 7fce39000640 1 --2- 172.21.15.31:0/1107933535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce340b2a20 0x7fce34154fb0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fce240b0040 tx=0x7fce24004040 comp rx=0 tx=0).stop 2024-09-17T05:34:50.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.345+0000 7fce39000640 1 -- 172.21.15.31:0/1107933535 shutdown_connections 2024-09-17T05:34:50.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.345+0000 7fce39000640 1 --2- 172.21.15.31:0/1107933535 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fce10073680 0x7fce10075b40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.345+0000 7fce39000640 1 --2- 172.21.15.31:0/1107933535 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce3415ff80 0x7fce340cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.345+0000 7fce39000640 1 --2- 172.21.15.31:0/1107933535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce340cfca0 0x7fce340c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.345+0000 7fce39000640 1 --2- 172.21.15.31:0/1107933535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce340b2a20 0x7fce34154fb0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.345+0000 7fce39000640 1 -- 172.21.15.31:0/1107933535 >> 172.21.15.31:0/1107933535 conn(0x7fce340d1c60 msgr2=0x7fce3406dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:50.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.345+0000 7fce39000640 1 -- 172.21.15.31:0/1107933535 shutdown_connections 2024-09-17T05:34:50.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.345+0000 7fce39000640 1 -- 172.21.15.31:0/1107933535 wait complete. 2024-09-17T05:34:50.366 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol76272 2024-09-17T05:34:50.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.513+0000 7f2e93200640 1 -- 172.21.15.31:0/2876876579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e8c0b0d10 msgr2=0x7f2e8c0d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:50.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.513+0000 7f2e93200640 1 --2- 172.21.15.31:0/2876876579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e8c0b0d10 0x7f2e8c0d1bb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009840 tx=0x7f2e7c01c820 comp rx=0 tx=0).stop 2024-09-17T05:34:50.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.513+0000 7f2e93200640 1 -- 172.21.15.31:0/2876876579 shutdown_connections 2024-09-17T05:34:50.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.513+0000 7f2e93200640 1 --2- 172.21.15.31:0/2876876579 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e8c0d20f0 0x7f2e8c0cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.513+0000 7f2e93200640 1 --2- 172.21.15.31:0/2876876579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e8c0b0d10 0x7f2e8c0d1bb0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.513+0000 7f2e93200640 1 -- 172.21.15.31:0/2876876579 >> 172.21.15.31:0/2876876579 conn(0x7f2e8c09aa10 msgr2=0x7f2e8c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:50.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.513+0000 7f2e93200640 1 -- 172.21.15.31:0/2876876579 shutdown_connections 2024-09-17T05:34:50.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.513+0000 7f2e93200640 1 -- 172.21.15.31:0/2876876579 wait complete. 2024-09-17T05:34:50.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.513+0000 7f2e93200640 1 Processor -- start 2024-09-17T05:34:50.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e93200640 1 -- start start 2024-09-17T05:34:50.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e93200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e8c0b0d10 0x7f2e8c0b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:50.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e93200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e8c0d20f0 0x7f2e8c1fba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:50.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e93200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e8c15bd40 0x7f2e8c0b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:50.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e93200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c168cb0 con 0x7f2e8c0b0d10 2024-09-17T05:34:50.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e93200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c168b30 con 0x7f2e8c0d20f0 2024-09-17T05:34:50.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e93200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2e8c168e30 con 0x7f2e8c15bd40 2024-09-17T05:34:50.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e91e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e8c0b0d10 0x7f2e8c0b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:50.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e91e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e8c0b0d10 0x7f2e8c0b4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39574/0 (socket says 172.21.15.31:39574) 2024-09-17T05:34:50.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e91e00640 1 -- 172.21.15.31:0/2793779186 learned_addr learned my addr 172.21.15.31:0/2793779186 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:50.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e92800640 1 --2- 172.21.15.31:0/2793779186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e8c15bd40 0x7f2e8c0b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:50.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e91400640 1 --2- 172.21.15.31:0/2793779186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e8c0d20f0 0x7f2e8c1fba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:50.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e91e00640 1 -- 172.21.15.31:0/2793779186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e8c15bd40 msgr2=0x7f2e8c0b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:50.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e91e00640 1 --2- 172.21.15.31:0/2793779186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e8c15bd40 0x7f2e8c0b6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e91e00640 1 -- 172.21.15.31:0/2793779186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e8c0d20f0 msgr2=0x7f2e8c1fba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:50.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e91e00640 1 --2- 172.21.15.31:0/2793779186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e8c0d20f0 0x7f2e8c1fba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e91e00640 1 -- 172.21.15.31:0/2793779186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c0b5140 con 0x7f2e8c0b0d10 2024-09-17T05:34:50.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e91e00640 1 --2- 172.21.15.31:0/2793779186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e8c0b0d10 0x7f2e8c0b4ab0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000c3c0 tx=0x7f2e8000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:50.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e86000640 1 -- 172.21.15.31:0/2793779186 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e800052d0 con 0x7f2e8c0b0d10 2024-09-17T05:34:50.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e86000640 1 -- 172.21.15.31:0/2793779186 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e80007020 con 0x7f2e8c0b0d10 2024-09-17T05:34:50.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e86000640 1 -- 172.21.15.31:0/2793779186 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e80007470 con 0x7f2e8c0b0d10 2024-09-17T05:34:50.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e93200640 1 -- 172.21.15.31:0/2793779186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8c0b5420 con 0x7f2e8c0b0d10 2024-09-17T05:34:50.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e93200640 1 -- 172.21.15.31:0/2793779186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e8c1f8150 con 0x7f2e8c0b0d10 2024-09-17T05:34:50.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.517+0000 7f2e93200640 1 -- 172.21.15.31:0/2793779186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e8c1f7c60 con 0x7f2e8c0b0d10 2024-09-17T05:34:50.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.521+0000 7f2e86000640 1 -- 172.21.15.31:0/2793779186 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 20) ==== 97642+0+0 (secure 0 0 0) 0x7f2e800067e0 con 0x7f2e8c0b0d10 2024-09-17T05:34:50.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.521+0000 7f2e86000640 1 --2- 172.21.15.31:0/2793779186 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2e70073680 0x7f2e70075b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:50.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.521+0000 7f2e86000640 1 -- 172.21.15.31:0/2793779186 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5795+0+0 (secure 0 0 0) 0x7f2e80093f70 con 0x7f2e8c0b0d10 2024-09-17T05:34:50.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.521+0000 7f2e91400640 1 --2- 172.21.15.31:0/2793779186 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2e70073680 0x7f2e70075b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:50.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.521+0000 7f2e91400640 1 --2- 172.21.15.31:0/2793779186 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2e70073680 0x7f2e70075b40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c0af000 tx=0x7f2e7c01b060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:50.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.525+0000 7f2e86000640 1 -- 172.21.15.31:0/2793779186 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2e8005e1f0 con 0x7f2e8c0b0d10 2024-09-17T05:34:50.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.737+0000 7f2e93200640 1 -- 172.21.15.31:0/2793779186 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol76272", "target": ["mon-mgr", ""]}) -- 0x7f2e8c069e30 con 0x7f2e70073680 2024-09-17T05:34:50.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.765+0000 7f2e86000640 1 -- 172.21.15.31:0/2793779186 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+144 (secure 0 0 0) 0x7f2e7c004140 con 0x7f2e70073680 2024-09-17T05:34:50.767 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:34:50.767 INFO:teuthology.orchestra.run.smithi031.stdout: "status": { 2024-09-17T05:34:50.768 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "pending", 2024-09-17T05:34:50.768 INFO:teuthology.orchestra.run.smithi031.stdout: "source": { 2024-09-17T05:34:50.768 INFO:teuthology.orchestra.run.smithi031.stdout: "volume": "fake", 2024-09-17T05:34:50.768 INFO:teuthology.orchestra.run.smithi031.stdout: "subvolume": "fake", 2024-09-17T05:34:50.768 INFO:teuthology.orchestra.run.smithi031.stdout: "snapshot": "fake" 2024-09-17T05:34:50.768 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:50.768 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:34:50.768 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:34:50.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.765+0000 7f2e93200640 1 -- 172.21.15.31:0/2793779186 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2e70073680 msgr2=0x7f2e70075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:50.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.765+0000 7f2e93200640 1 --2- 172.21.15.31:0/2793779186 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2e70073680 0x7f2e70075b40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c0af000 tx=0x7f2e7c01b060 comp rx=0 tx=0).stop 2024-09-17T05:34:50.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.765+0000 7f2e93200640 1 -- 172.21.15.31:0/2793779186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e8c0b0d10 msgr2=0x7f2e8c0b4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:50.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.765+0000 7f2e93200640 1 --2- 172.21.15.31:0/2793779186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e8c0b0d10 0x7f2e8c0b4ab0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000c3c0 tx=0x7f2e8000c880 comp rx=0 tx=0).stop 2024-09-17T05:34:50.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.765+0000 7f2e93200640 1 -- 172.21.15.31:0/2793779186 shutdown_connections 2024-09-17T05:34:50.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.765+0000 7f2e93200640 1 --2- 172.21.15.31:0/2793779186 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2e70073680 0x7f2e70075b40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.765+0000 7f2e93200640 1 --2- 172.21.15.31:0/2793779186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e8c15bd40 0x7f2e8c0b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.765+0000 7f2e93200640 1 --2- 172.21.15.31:0/2793779186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e8c0d20f0 0x7f2e8c1fba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.765+0000 7f2e93200640 1 --2- 172.21.15.31:0/2793779186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e8c0b0d10 0x7f2e8c0b4ab0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.765+0000 7f2e93200640 1 -- 172.21.15.31:0/2793779186 >> 172.21.15.31:0/2793779186 conn(0x7f2e8c09aa10 msgr2=0x7f2e8c06e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:50.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.769+0000 7f2e93200640 1 -- 172.21.15.31:0/2793779186 shutdown_connections 2024-09-17T05:34:50.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.769+0000 7f2e93200640 1 -- 172.21.15.31:0/2793779186 wait complete. 2024-09-17T05:34:50.788 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol81990 fake 2024-09-17T05:34:50.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.941+0000 7f8952a00640 1 -- 172.21.15.31:0/608112330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f894c15be10 msgr2=0x7f894c0ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:50.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.941+0000 7f8952a00640 1 --2- 172.21.15.31:0/608112330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f894c15be10 0x7f894c0ce700 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f894c074e00 tx=0x7f893c01f0b0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.941+0000 7f8952a00640 1 -- 172.21.15.31:0/608112330 shutdown_connections 2024-09-17T05:34:50.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.941+0000 7f8952a00640 1 --2- 172.21.15.31:0/608112330 >> v2:172.21.15.155:3300/0 conn(0x7f894c0b0b60 0x7f894c0cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.941+0000 7f8952a00640 1 --2- 172.21.15.31:0/608112330 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f894c15c1f0 0x7f894c0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.941+0000 7f8952a00640 1 --2- 172.21.15.31:0/608112330 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f894c15be10 0x7f894c0ce700 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.941+0000 7f8952a00640 1 -- 172.21.15.31:0/608112330 >> 172.21.15.31:0/608112330 conn(0x7f894c0d1da0 msgr2=0x7f894c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:50.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.941+0000 7f8952a00640 1 -- 172.21.15.31:0/608112330 shutdown_connections 2024-09-17T05:34:50.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.941+0000 7f8952a00640 1 -- 172.21.15.31:0/608112330 wait complete. 2024-09-17T05:34:50.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f8952a00640 1 Processor -- start 2024-09-17T05:34:50.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f8952a00640 1 -- start start 2024-09-17T05:34:50.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f8952a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f894c0b0b60 0x7f894c15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:50.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f8952a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f894c15be10 0x7f894c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:50.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f8952a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f894c15c1f0 0x7f894c0c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f8952a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f894c1600a0 con 0x7f894c0b0b60 2024-09-17T05:34:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f8952a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f894c15ff20 con 0x7f894c15c1f0 2024-09-17T05:34:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f8952a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f894c160220 con 0x7f894c15be10 2024-09-17T05:34:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f894be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f894c0b0b60 0x7f894c15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f894be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f894c0b0b60 0x7f894c15adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39600/0 (socket says 172.21.15.31:39600) 2024-09-17T05:34:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f894be00640 1 -- 172.21.15.31:0/3664342710 learned_addr learned my addr 172.21.15.31:0/3664342710 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f8943400640 1 --2- 172.21.15.31:0/3664342710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f894c15be10 0x7f894c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f8950a00640 1 --2- 172.21.15.31:0/3664342710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f894c15c1f0 0x7f894c0c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f894be00640 1 -- 172.21.15.31:0/3664342710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f894c15be10 msgr2=0x7f894c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f894be00640 1 --2- 172.21.15.31:0/3664342710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f894c15be10 0x7f894c15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f894be00640 1 -- 172.21.15.31:0/3664342710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f894c15c1f0 msgr2=0x7f894c0c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:50.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f894be00640 1 --2- 172.21.15.31:0/3664342710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f894c15c1f0 0x7f894c0c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:50.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f894be00640 1 -- 172.21.15.31:0/3664342710 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f894c06ede0 con 0x7f894c0b0b60 2024-09-17T05:34:50.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f894be00640 1 --2- 172.21.15.31:0/3664342710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f894c0b0b60 0x7f894c15adb0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f893c0b3040 tx=0x7f893c005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:50.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f8948c00640 1 -- 172.21.15.31:0/3664342710 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893c0be070 con 0x7f894c0b0b60 2024-09-17T05:34:50.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f8948c00640 1 -- 172.21.15.31:0/3664342710 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f893c0053e0 con 0x7f894c0b0b60 2024-09-17T05:34:50.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f8952a00640 1 -- 172.21.15.31:0/3664342710 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f894c06f080 con 0x7f894c0b0b60 2024-09-17T05:34:50.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f8948c00640 1 -- 172.21.15.31:0/3664342710 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893c0b5040 con 0x7f894c0b0b60 2024-09-17T05:34:50.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f8952a00640 1 -- 172.21.15.31:0/3664342710 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f894c06f640 con 0x7f894c0b0b60 2024-09-17T05:34:50.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.945+0000 7f8952a00640 1 -- 172.21.15.31:0/3664342710 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f894c070350 con 0x7f894c0b0b60 2024-09-17T05:34:50.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.949+0000 7f8948c00640 1 -- 172.21.15.31:0/3664342710 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 21) ==== 97693+0+0 (secure 0 0 0) 0x7f893c0c1070 con 0x7f894c0b0b60 2024-09-17T05:34:50.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.949+0000 7f8948c00640 1 --2- 172.21.15.31:0/3664342710 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8928073710 0x7f8928075bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:50.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.949+0000 7f8948c00640 1 -- 172.21.15.31:0/3664342710 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5795+0+0 (secure 0 0 0) 0x7f893c131990 con 0x7f894c0b0b60 2024-09-17T05:34:50.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.949+0000 7f8943400640 1 --2- 172.21.15.31:0/3664342710 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8928073710 0x7f8928075bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:50.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.949+0000 7f8943400640 1 --2- 172.21.15.31:0/3664342710 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8928073710 0x7f8928075bd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f894c0af160 tx=0x7f893400b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:50.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:50.953+0000 7f8948c00640 1 -- 172.21.15.31:0/3664342710 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f893c018c10 con 0x7f894c0b0b60 2024-09-17T05:34:51.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.161+0000 7f8952a00640 1 -- 172.21.15.31:0/3664342710 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol81990", "snap_name": "fake", "target": ["mon-mgr", ""]}) -- 0x7f894c0aebd0 con 0x7f8928073710 2024-09-17T05:34:51.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.209+0000 7f8948c00640 1 -- 172.21.15.31:0/3664342710 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f894c0aebd0 con 0x7f8928073710 2024-09-17T05:34:51.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.209+0000 7f8952a00640 1 -- 172.21.15.31:0/3664342710 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8928073710 msgr2=0x7f8928075bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:51.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.209+0000 7f8952a00640 1 --2- 172.21.15.31:0/3664342710 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8928073710 0x7f8928075bd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f894c0af160 tx=0x7f893400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:34:51.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.209+0000 7f8952a00640 1 -- 172.21.15.31:0/3664342710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f894c0b0b60 msgr2=0x7f894c15adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:51.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.209+0000 7f8952a00640 1 --2- 172.21.15.31:0/3664342710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f894c0b0b60 0x7f894c15adb0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f893c0b3040 tx=0x7f893c005760 comp rx=0 tx=0).stop 2024-09-17T05:34:51.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.209+0000 7f8952a00640 1 -- 172.21.15.31:0/3664342710 shutdown_connections 2024-09-17T05:34:51.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.209+0000 7f8952a00640 1 --2- 172.21.15.31:0/3664342710 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8928073710 0x7f8928075bd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:51.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.209+0000 7f8952a00640 1 --2- 172.21.15.31:0/3664342710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f894c15c1f0 0x7f894c0c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:51.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.209+0000 7f8952a00640 1 --2- 172.21.15.31:0/3664342710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f894c15be10 0x7f894c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:51.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.209+0000 7f8952a00640 1 --2- 172.21.15.31:0/3664342710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f894c0b0b60 0x7f894c15adb0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:51.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.209+0000 7f8952a00640 1 -- 172.21.15.31:0/3664342710 >> 172.21.15.31:0/3664342710 conn(0x7f894c0d1da0 msgr2=0x7f894c0af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:51.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.209+0000 7f8952a00640 1 -- 172.21.15.31:0/3664342710 shutdown_connections 2024-09-17T05:34:51.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.209+0000 7f8952a00640 1 -- 172.21.15.31:0/3664342710 wait complete. 2024-09-17T05:34:51.232 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol15551 fake subvol_grp14870 2024-09-17T05:34:51.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7648400640 1 -- 172.21.15.31:0/2035325241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76280051d0 msgr2=0x7f762800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:51.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7648400640 1 --2- 172.21.15.31:0/2035325241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76280051d0 0x7f762800b9d0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f7638009eb0 tx=0x7f763801d5f0 comp rx=0 tx=0).stop 2024-09-17T05:34:51.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7648400640 1 -- 172.21.15.31:0/2035325241 shutdown_connections 2024-09-17T05:34:51.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7648400640 1 --2- 172.21.15.31:0/2035325241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76280051d0 0x7f762800b9d0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:51.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7648400640 1 -- 172.21.15.31:0/2035325241 >> 172.21.15.31:0/2035325241 conn(0x7f76400d1d70 msgr2=0x7f76400d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:51.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7648400640 1 -- 172.21.15.31:0/2035325241 shutdown_connections 2024-09-17T05:34:51.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7648400640 1 -- 172.21.15.31:0/2035325241 wait complete. 2024-09-17T05:34:51.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7648400640 1 Processor -- start 2024-09-17T05:34:51.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7648400640 1 -- start start 2024-09-17T05:34:51.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7648400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76280051d0 0x7f76400c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:51.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7648400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640153c80 0x7f76400b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7648400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76400b55b0 0x7f76400af970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7648400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f76400d2c20 con 0x7f76280051d0 2024-09-17T05:34:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7648400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f76400d2aa0 con 0x7f7640153c80 2024-09-17T05:34:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7648400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f76400d06a0 con 0x7f76400b55b0 2024-09-17T05:34:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7645a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76280051d0 0x7f76400c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7645a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76280051d0 0x7f76400c4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39610/0 (socket says 172.21.15.31:39610) 2024-09-17T05:34:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7645a00640 1 -- 172.21.15.31:0/2546550779 learned_addr learned my addr 172.21.15.31:0/2546550779 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7645000640 1 --2- 172.21.15.31:0/2546550779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640153c80 0x7f76400b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7646400640 1 --2- 172.21.15.31:0/2546550779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76400b55b0 0x7f76400af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7645a00640 1 -- 172.21.15.31:0/2546550779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76400b55b0 msgr2=0x7f76400af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7645a00640 1 --2- 172.21.15.31:0/2546550779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76400b55b0 0x7f76400af970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:51.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7645a00640 1 -- 172.21.15.31:0/2546550779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640153c80 msgr2=0x7f76400b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:51.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7645a00640 1 --2- 172.21.15.31:0/2546550779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640153c80 0x7f76400b7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:51.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7645a00640 1 -- 172.21.15.31:0/2546550779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76400b63c0 con 0x7f76280051d0 2024-09-17T05:34:51.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.385+0000 7f7645a00640 1 --2- 172.21.15.31:0/2546550779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76280051d0 0x7f76400c4f20 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f7634003eb0 tx=0x7f7634001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:51.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.389+0000 7f763d600640 1 -- 172.21.15.31:0/2546550779 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7634015070 con 0x7f76280051d0 2024-09-17T05:34:51.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.389+0000 7f763d600640 1 -- 172.21.15.31:0/2546550779 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7634011840 con 0x7f76280051d0 2024-09-17T05:34:51.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.389+0000 7f7648400640 1 -- 172.21.15.31:0/2546550779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76400b66a0 con 0x7f76280051d0 2024-09-17T05:34:51.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.389+0000 7f763d600640 1 -- 172.21.15.31:0/2546550779 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7634011c50 con 0x7f76280051d0 2024-09-17T05:34:51.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.389+0000 7f7648400640 1 -- 172.21.15.31:0/2546550779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76400b6c60 con 0x7f76280051d0 2024-09-17T05:34:51.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.389+0000 7f7648400640 1 -- 172.21.15.31:0/2546550779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76400d0b90 con 0x7f76280051d0 2024-09-17T05:34:51.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.389+0000 7f763d600640 1 -- 172.21.15.31:0/2546550779 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 21) ==== 97693+0+0 (secure 0 0 0) 0x7f7634018070 con 0x7f76280051d0 2024-09-17T05:34:51.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.389+0000 7f763d600640 1 --2- 172.21.15.31:0/2546550779 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7620073740 0x7f7620075c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:51.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.389+0000 7f763d600640 1 -- 172.21.15.31:0/2546550779 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5795+0+0 (secure 0 0 0) 0x7f76340956d0 con 0x7f76280051d0 2024-09-17T05:34:51.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.389+0000 7f7645000640 1 --2- 172.21.15.31:0/2546550779 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7620073740 0x7f7620075c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:51.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.393+0000 7f7645000640 1 --2- 172.21.15.31:0/2546550779 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7620073740 0x7f7620075c00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f76401540a0 tx=0x7f762c006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:51.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.393+0000 7f763d600640 1 -- 172.21.15.31:0/2546550779 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f763405f930 con 0x7f76280051d0 2024-09-17T05:34:51.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.601+0000 7f7648400640 1 -- 172.21.15.31:0/2546550779 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol15551", "snap_name": "fake", "group_name": "subvol_grp14870", "target": ["mon-mgr", ""]}) -- 0x7f7640070a60 con 0x7f7620073740 2024-09-17T05:34:51.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.641+0000 7f763d600640 1 -- 172.21.15.31:0/2546550779 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7640070a60 con 0x7f7620073740 2024-09-17T05:34:51.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.645+0000 7f7648400640 1 -- 172.21.15.31:0/2546550779 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7620073740 msgr2=0x7f7620075c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:51.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.645+0000 7f7648400640 1 --2- 172.21.15.31:0/2546550779 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7620073740 0x7f7620075c00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f76401540a0 tx=0x7f762c006040 comp rx=0 tx=0).stop 2024-09-17T05:34:51.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.645+0000 7f7648400640 1 -- 172.21.15.31:0/2546550779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76280051d0 msgr2=0x7f76400c4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:51.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.645+0000 7f7648400640 1 --2- 172.21.15.31:0/2546550779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76280051d0 0x7f76400c4f20 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f7634003eb0 tx=0x7f7634001640 comp rx=0 tx=0).stop 2024-09-17T05:34:51.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.645+0000 7f7648400640 1 -- 172.21.15.31:0/2546550779 shutdown_connections 2024-09-17T05:34:51.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.645+0000 7f7648400640 1 --2- 172.21.15.31:0/2546550779 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7620073740 0x7f7620075c00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:51.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.645+0000 7f7648400640 1 --2- 172.21.15.31:0/2546550779 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f76400b55b0 0x7f76400af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:51.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.645+0000 7f7648400640 1 --2- 172.21.15.31:0/2546550779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7640153c80 0x7f76400b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:51.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.645+0000 7f7648400640 1 --2- 172.21.15.31:0/2546550779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76280051d0 0x7f76400c4f20 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:51.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.645+0000 7f7648400640 1 -- 172.21.15.31:0/2546550779 >> 172.21.15.31:0/2546550779 conn(0x7f76400d1d70 msgr2=0x7f764015e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:51.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.645+0000 7f7648400640 1 -- 172.21.15.31:0/2546550779 shutdown_connections 2024-09-17T05:34:51.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.645+0000 7f7648400640 1 -- 172.21.15.31:0/2546550779 wait complete. 2024-09-17T05:34:51.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:51.666 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol81990/.meta) 2024-09-17T05:34:51.688 INFO:teuthology.orchestra.run.smithi031.stdout:[GLOBAL] 2024-09-17T05:34:51.688 INFO:teuthology.orchestra.run.smithi031.stdout:version = 1 2024-09-17T05:34:51.688 INFO:teuthology.orchestra.run.smithi031.stdout:type = subvolume 2024-09-17T05:34:51.688 INFO:teuthology.orchestra.run.smithi031.stdout:path = /volumes/_nogroup/subvol81990/90cb822b-a414-493e-af8a-2171358548d8 2024-09-17T05:34:51.688 INFO:teuthology.orchestra.run.smithi031.stdout:state = complete 2024-09-17T05:34:51.688 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:51.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:51.690 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/subvol_grp14870/subvol15551/.meta) 2024-09-17T05:34:51.756 INFO:teuthology.orchestra.run.smithi031.stdout:[GLOBAL] 2024-09-17T05:34:51.756 INFO:teuthology.orchestra.run.smithi031.stdout:version = 1 2024-09-17T05:34:51.756 INFO:teuthology.orchestra.run.smithi031.stdout:type = subvolume 2024-09-17T05:34:51.756 INFO:teuthology.orchestra.run.smithi031.stdout:path = /volumes/subvol_grp14870/subvol15551/ea83c0ac-a09b-4067-8b59-48b608fb511d 2024-09-17T05:34:51.756 INFO:teuthology.orchestra.run.smithi031.stdout:state = complete 2024-09-17T05:34:51.756 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:51.758 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol81990 2024-09-17T05:34:51.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.949+0000 7fe6cf200640 1 -- 172.21.15.31:0/733589736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d00d02a0 msgr2=0x7fe6d00ad890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:51.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.949+0000 7fe6cf200640 1 --2- 172.21.15.31:0/733589736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d00d02a0 0x7fe6d00ad890 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00ce540 tx=0x7fe6c801cd80 comp rx=0 tx=0).stop 2024-09-17T05:34:51.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.949+0000 7fe6cf200640 1 -- 172.21.15.31:0/733589736 shutdown_connections 2024-09-17T05:34:51.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.949+0000 7fe6cf200640 1 --2- 172.21.15.31:0/733589736 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d00d02a0 0x7fe6d00ad890 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:51.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.949+0000 7fe6cf200640 1 --2- 172.21.15.31:0/733589736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d0070d30 0x7fe6d00cfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:51.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.949+0000 7fe6cf200640 1 --2- 172.21.15.31:0/733589736 >> v2:172.21.15.155:3300/0 conn(0x7fe6d015dd50 0x7fe6d0070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:51.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.949+0000 7fe6cf200640 1 -- 172.21.15.31:0/733589736 >> 172.21.15.31:0/733589736 conn(0x7fe6d00b2680 msgr2=0x7fe6d00b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:51.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.949+0000 7fe6cf200640 1 -- 172.21.15.31:0/733589736 shutdown_connections 2024-09-17T05:34:51.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.949+0000 7fe6cf200640 1 -- 172.21.15.31:0/733589736 wait complete. 2024-09-17T05:34:51.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.949+0000 7fe6cf200640 1 Processor -- start 2024-09-17T05:34:51.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.949+0000 7fe6cf200640 1 -- start start 2024-09-17T05:34:51.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6cf200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d0070d30 0x7fe6d0152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:51.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6cf200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6d00d02a0 0x7fe6d01520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:51.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6cf200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d015dd50 0x7fe6d00c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:51.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6cf200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d0071290 con 0x7fe6d0070d30 2024-09-17T05:34:51.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6cf200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d0071110 con 0x7fe6d00d02a0 2024-09-17T05:34:51.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6cf200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d0161f50 con 0x7fe6d015dd50 2024-09-17T05:34:51.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6cde00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d0070d30 0x7fe6d0152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:51.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6cde00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d0070d30 0x7fe6d0152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39624/0 (socket says 172.21.15.31:39624) 2024-09-17T05:34:51.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6cde00640 1 -- 172.21.15.31:0/634833617 learned_addr learned my addr 172.21.15.31:0/634833617 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:51.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6c7e00640 1 --2- 172.21.15.31:0/634833617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6d00d02a0 0x7fe6d01520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:51.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6ce800640 1 --2- 172.21.15.31:0/634833617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d015dd50 0x7fe6d00c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:51.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6cde00640 1 -- 172.21.15.31:0/634833617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d015dd50 msgr2=0x7fe6d00c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:51.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6cde00640 1 --2- 172.21.15.31:0/634833617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d015dd50 0x7fe6d00c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:51.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6cde00640 1 -- 172.21.15.31:0/634833617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6d00d02a0 msgr2=0x7fe6d01520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:51.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6cde00640 1 --2- 172.21.15.31:0/634833617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6d00d02a0 0x7fe6d01520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:51.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6cde00640 1 -- 172.21.15.31:0/634833617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d00b64e0 con 0x7fe6d0070d30 2024-09-17T05:34:51.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6cde00640 1 --2- 172.21.15.31:0/634833617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d0070d30 0x7fe6d0152e60 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00058d0 tx=0x7fe6c000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:51.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6c6000640 1 -- 172.21.15.31:0/634833617 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0017070 con 0x7fe6d0070d30 2024-09-17T05:34:51.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6c6000640 1 -- 172.21.15.31:0/634833617 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6c0009d20 con 0x7fe6d0070d30 2024-09-17T05:34:51.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6cf200640 1 -- 172.21.15.31:0/634833617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d00b5f20 con 0x7fe6d0070d30 2024-09-17T05:34:51.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6c6000640 1 -- 172.21.15.31:0/634833617 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00106c0 con 0x7fe6d0070d30 2024-09-17T05:34:51.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6cf200640 1 -- 172.21.15.31:0/634833617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d00c5070 con 0x7fe6d0070d30 2024-09-17T05:34:51.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6cf200640 1 -- 172.21.15.31:0/634833617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d0162440 con 0x7fe6d0070d30 2024-09-17T05:34:51.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.953+0000 7fe6c6000640 1 -- 172.21.15.31:0/634833617 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 21) ==== 97693+0+0 (secure 0 0 0) 0x7fe6c001a070 con 0x7fe6d0070d30 2024-09-17T05:34:51.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.957+0000 7fe6c6000640 1 --2- 172.21.15.31:0/634833617 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe6ac073710 0x7fe6ac075bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:51.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.957+0000 7fe6c6000640 1 -- 172.21.15.31:0/634833617 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5795+0+0 (secure 0 0 0) 0x7fe6c0094c30 con 0x7fe6d0070d30 2024-09-17T05:34:51.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.957+0000 7fe6c7e00640 1 --2- 172.21.15.31:0/634833617 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe6ac073710 0x7fe6ac075bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:51.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.957+0000 7fe6c7e00640 1 --2- 172.21.15.31:0/634833617 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe6ac073710 0x7fe6ac075bd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe6d015ee50 tx=0x7fe6b800b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:51.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:51.961+0000 7fe6c6000640 1 -- 172.21.15.31:0/634833617 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe6c005eed0 con 0x7fe6d0070d30 2024-09-17T05:34:52.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.161+0000 7fe6cf200640 1 -- 172.21.15.31:0/634833617 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol81990", "target": ["mon-mgr", ""]}) -- 0x7fe6d00c54f0 con 0x7fe6ac073710 2024-09-17T05:34:52.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.201+0000 7fe6c6000640 1 -- 172.21.15.31:0/634833617 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe6d00c54f0 con 0x7fe6ac073710 2024-09-17T05:34:52.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.201+0000 7fe6cf200640 1 -- 172.21.15.31:0/634833617 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe6ac073710 msgr2=0x7fe6ac075bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:52.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.201+0000 7fe6cf200640 1 --2- 172.21.15.31:0/634833617 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe6ac073710 0x7fe6ac075bd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe6d015ee50 tx=0x7fe6b800b2e0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.201+0000 7fe6cf200640 1 -- 172.21.15.31:0/634833617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d0070d30 msgr2=0x7fe6d0152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:52.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.201+0000 7fe6cf200640 1 --2- 172.21.15.31:0/634833617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d0070d30 0x7fe6d0152e60 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00058d0 tx=0x7fe6c000dde0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.201+0000 7fe6cf200640 1 -- 172.21.15.31:0/634833617 shutdown_connections 2024-09-17T05:34:52.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.201+0000 7fe6cf200640 1 --2- 172.21.15.31:0/634833617 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe6ac073710 0x7fe6ac075bd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.201+0000 7fe6cf200640 1 --2- 172.21.15.31:0/634833617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6d015dd50 0x7fe6d00c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.201+0000 7fe6cf200640 1 --2- 172.21.15.31:0/634833617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6d00d02a0 0x7fe6d01520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.201+0000 7fe6cf200640 1 --2- 172.21.15.31:0/634833617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6d0070d30 0x7fe6d0152e60 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.201+0000 7fe6cf200640 1 -- 172.21.15.31:0/634833617 >> 172.21.15.31:0/634833617 conn(0x7fe6d00b2680 msgr2=0x7fe6d015bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:52.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.201+0000 7fe6cf200640 1 -- 172.21.15.31:0/634833617 shutdown_connections 2024-09-17T05:34:52.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.201+0000 7fe6cf200640 1 -- 172.21.15.31:0/634833617 wait complete. 2024-09-17T05:34:52.209 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:52.205+0000 7f46f9600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:52.209 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:52.205+0000 7f46f9600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:52.209 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:52.205+0000 7f46f9600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:52.210 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:52.205+0000 7f46f9600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:52.210 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:52.205+0000 7f46f9600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:52.226 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:52.225+0000 7f46fa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:52.226 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:52.225+0000 7f46fa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:52.226 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:52.225+0000 7f46fa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:52.226 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:52.225+0000 7f46fa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:52.226 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:52.225+0000 7f46fa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:34:52.230 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol15551 subvol_grp14870 2024-09-17T05:34:52.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.381+0000 7fdb8fe00640 1 -- 172.21.15.31:0/2067822887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb900cff00 msgr2=0x7fdb900d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:52.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.381+0000 7fdb8fe00640 1 --2- 172.21.15.31:0/2067822887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb900cff00 0x7fdb900d28c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009900 tx=0x7fdb8001c8b0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.381+0000 7fdb8fe00640 1 -- 172.21.15.31:0/2067822887 shutdown_connections 2024-09-17T05:34:52.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.381+0000 7fdb8fe00640 1 --2- 172.21.15.31:0/2067822887 >> v2:172.21.15.155:3300/0 conn(0x7fdb9015f700 0x7fdb900d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.381+0000 7fdb8fe00640 1 --2- 172.21.15.31:0/2067822887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb900cff00 0x7fdb900d28c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.381+0000 7fdb8fe00640 1 -- 172.21.15.31:0/2067822887 >> 172.21.15.31:0/2067822887 conn(0x7fdb900d1da0 msgr2=0x7fdb900d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:52.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.381+0000 7fdb8fe00640 1 -- 172.21.15.31:0/2067822887 shutdown_connections 2024-09-17T05:34:52.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.381+0000 7fdb8fe00640 1 -- 172.21.15.31:0/2067822887 wait complete. 2024-09-17T05:34:52.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb8fe00640 1 Processor -- start 2024-09-17T05:34:52.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb8fe00640 1 -- start start 2024-09-17T05:34:52.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb8fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb900cff00 0x7fdb9015e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:52.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb8fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb900d02e0 0x7fdb90154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:52.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb8fe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb9015f700 0x7fdb901552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:52.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb8fe00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdb900b0c00 con 0x7fdb900d02e0 2024-09-17T05:34:52.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb8fe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdb900b0a80 con 0x7fdb9015f700 2024-09-17T05:34:52.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb8fe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdb90168bf0 con 0x7fdb900cff00 2024-09-17T05:34:52.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb87e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb900d02e0 0x7fdb90154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:52.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb8ea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb900cff00 0x7fdb9015e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:52.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb87e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb900d02e0 0x7fdb90154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39666/0 (socket says 172.21.15.31:39666) 2024-09-17T05:34:52.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb87e00640 1 -- 172.21.15.31:0/515969136 learned_addr learned my addr 172.21.15.31:0/515969136 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:52.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb8f400640 1 --2- 172.21.15.31:0/515969136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb9015f700 0x7fdb901552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:52.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb8ea00640 1 -- 172.21.15.31:0/515969136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb9015f700 msgr2=0x7fdb901552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:52.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb8ea00640 1 --2- 172.21.15.31:0/515969136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb9015f700 0x7fdb901552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb8ea00640 1 -- 172.21.15.31:0/515969136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb900d02e0 msgr2=0x7fdb90154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:52.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb8ea00640 1 --2- 172.21.15.31:0/515969136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb900d02e0 0x7fdb90154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb8ea00640 1 -- 172.21.15.31:0/515969136 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb9015cc80 con 0x7fdb900cff00 2024-09-17T05:34:52.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb87e00640 1 --2- 172.21.15.31:0/515969136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb900d02e0 0x7fdb90154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:34:52.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb8ea00640 1 --2- 172.21.15.31:0/515969136 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb900cff00 0x7fdb9015e580 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdb800ac000 tx=0x7fdb80005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:52.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb87400640 1 -- 172.21.15.31:0/515969136 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb800b2040 con 0x7fdb900cff00 2024-09-17T05:34:52.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb87400640 1 -- 172.21.15.31:0/515969136 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb80005320 con 0x7fdb900cff00 2024-09-17T05:34:52.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb87400640 1 -- 172.21.15.31:0/515969136 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb800046d0 con 0x7fdb900cff00 2024-09-17T05:34:52.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb8fe00640 1 -- 172.21.15.31:0/515969136 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb9015cf60 con 0x7fdb900cff00 2024-09-17T05:34:52.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.385+0000 7fdb8fe00640 1 -- 172.21.15.31:0/515969136 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb9015d520 con 0x7fdb900cff00 2024-09-17T05:34:52.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.389+0000 7fdb8fe00640 1 -- 172.21.15.31:0/515969136 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb900cc880 con 0x7fdb900cff00 2024-09-17T05:34:52.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.389+0000 7fdb87400640 1 -- 172.21.15.31:0/515969136 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 21) ==== 97693+0+0 (secure 0 0 0) 0x7fdb800a5870 con 0x7fdb900cff00 2024-09-17T05:34:52.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.389+0000 7fdb87400640 1 --2- 172.21.15.31:0/515969136 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdb6c073710 0x7fdb6c075bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:52.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.389+0000 7fdb87400640 1 -- 172.21.15.31:0/515969136 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(117..117 src has 1..117) ==== 5795+0+0 (secure 0 0 0) 0x7fdb8012f8e0 con 0x7fdb900cff00 2024-09-17T05:34:52.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.389+0000 7fdb87e00640 1 --2- 172.21.15.31:0/515969136 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdb6c073710 0x7fdb6c075bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:52.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.389+0000 7fdb87e00640 1 --2- 172.21.15.31:0/515969136 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdb6c073710 0x7fdb6c075bd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdb900b2bd0 tx=0x7fdb78009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:52.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.393+0000 7fdb87400640 1 -- 172.21.15.31:0/515969136 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fdb800164d0 con 0x7fdb900cff00 2024-09-17T05:34:52.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.605+0000 7fdb8fe00640 1 -- 172.21.15.31:0/515969136 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol15551", "group_name": "subvol_grp14870", "target": ["mon-mgr", ""]}) -- 0x7fdb90069e60 con 0x7fdb6c073710 2024-09-17T05:34:52.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.641+0000 7fdb87400640 1 -- 172.21.15.31:0/515969136 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdb78001980 con 0x7fdb6c073710 2024-09-17T05:34:52.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.645+0000 7fdb8fe00640 1 -- 172.21.15.31:0/515969136 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdb6c073710 msgr2=0x7fdb6c075bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:52.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.645+0000 7fdb8fe00640 1 --2- 172.21.15.31:0/515969136 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdb6c073710 0x7fdb6c075bd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdb900b2bd0 tx=0x7fdb78009040 comp rx=0 tx=0).stop 2024-09-17T05:34:52.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.645+0000 7fdb8fe00640 1 -- 172.21.15.31:0/515969136 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb900cff00 msgr2=0x7fdb9015e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:52.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.645+0000 7fdb8fe00640 1 --2- 172.21.15.31:0/515969136 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb900cff00 0x7fdb9015e580 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdb800ac000 tx=0x7fdb80005de0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.645+0000 7fdb8fe00640 1 -- 172.21.15.31:0/515969136 shutdown_connections 2024-09-17T05:34:52.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.645+0000 7fdb8fe00640 1 --2- 172.21.15.31:0/515969136 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdb6c073710 0x7fdb6c075bd0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.645+0000 7fdb8fe00640 1 --2- 172.21.15.31:0/515969136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb9015f700 0x7fdb901552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.645+0000 7fdb8fe00640 1 --2- 172.21.15.31:0/515969136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb900d02e0 0x7fdb90154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.645+0000 7fdb8fe00640 1 --2- 172.21.15.31:0/515969136 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb900cff00 0x7fdb9015e580 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.645+0000 7fdb8fe00640 1 -- 172.21.15.31:0/515969136 >> 172.21.15.31:0/515969136 conn(0x7fdb900d1da0 msgr2=0x7fdb9006e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:52.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.645+0000 7fdb8fe00640 1 -- 172.21.15.31:0/515969136 shutdown_connections 2024-09-17T05:34:52.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.645+0000 7fdb8fe00640 1 -- 172.21.15.31:0/515969136 wait complete. 2024-09-17T05:34:52.672 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol76272 2024-09-17T05:34:52.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.837+0000 7f7595800640 1 -- 172.21.15.31:0/2332642499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7590157df0 msgr2=0x7f75900af530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:52.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.837+0000 7f7595800640 1 --2- 172.21.15.31:0/2332642499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7590157df0 0x7f75900af530 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7580009900 tx=0x7f758001c850 comp rx=0 tx=0).stop 2024-09-17T05:34:52.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.837+0000 7f7595800640 1 -- 172.21.15.31:0/2332642499 shutdown_connections 2024-09-17T05:34:52.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.837+0000 7f7595800640 1 --2- 172.21.15.31:0/2332642499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7590070d80 0x7f759015de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.837+0000 7f7595800640 1 --2- 172.21.15.31:0/2332642499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7590157df0 0x7f75900af530 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.837+0000 7f7595800640 1 -- 172.21.15.31:0/2332642499 >> 172.21.15.31:0/2332642499 conn(0x7f75900742f0 msgr2=0x7f7590074700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:52.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.837+0000 7f7595800640 1 -- 172.21.15.31:0/2332642499 shutdown_connections 2024-09-17T05:34:52.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.837+0000 7f7595800640 1 -- 172.21.15.31:0/2332642499 wait complete. 2024-09-17T05:34:52.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.837+0000 7f7595800640 1 Processor -- start 2024-09-17T05:34:52.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7595800640 1 -- start start 2024-09-17T05:34:52.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7595800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7590070d80 0x7f75900992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:52.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7595800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7590157df0 0x7f75900b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:52.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7595800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f759015e360 0x7f75901f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:52.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7595800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f759015b150 con 0x7f759015e360 2024-09-17T05:34:52.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7595800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f75900d1120 con 0x7f7590157df0 2024-09-17T05:34:52.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7595800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f759015b2d0 con 0x7f7590070d80 2024-09-17T05:34:52.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7594e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f759015e360 0x7f75901f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:52.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f758fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7590070d80 0x7f75900992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:52.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7594e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f759015e360 0x7f75901f6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39670/0 (socket says 172.21.15.31:39670) 2024-09-17T05:34:52.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7587e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7590157df0 0x7f75900b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:52.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7594e00640 1 -- 172.21.15.31:0/1478848821 learned_addr learned my addr 172.21.15.31:0/1478848821 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:52.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7594e00640 1 -- 172.21.15.31:0/1478848821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7590070d80 msgr2=0x7f75900992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:52.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7594e00640 1 --2- 172.21.15.31:0/1478848821 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7590070d80 0x7f75900992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7594e00640 1 -- 172.21.15.31:0/1478848821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7590157df0 msgr2=0x7f75900b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:52.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7594e00640 1 --2- 172.21.15.31:0/1478848821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7590157df0 0x7f75900b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:52.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7594e00640 1 -- 172.21.15.31:0/1478848821 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75900c3c60 con 0x7f759015e360 2024-09-17T05:34:52.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7587e00640 1 --2- 172.21.15.31:0/1478848821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7590157df0 0x7f75900b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:34:52.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7594e00640 1 --2- 172.21.15.31:0/1478848821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f759015e360 0x7f75901f6ec0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f758800c6b0 tx=0x7f758800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:52.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f758cc00640 1 -- 172.21.15.31:0/1478848821 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7588003b80 con 0x7f759015e360 2024-09-17T05:34:52.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f758cc00640 1 -- 172.21.15.31:0/1478848821 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7588003d40 con 0x7f759015e360 2024-09-17T05:34:52.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7595800640 1 -- 172.21.15.31:0/1478848821 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75901f3b90 con 0x7f759015e360 2024-09-17T05:34:52.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f758cc00640 1 -- 172.21.15.31:0/1478848821 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7588005330 con 0x7f759015e360 2024-09-17T05:34:52.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.841+0000 7f7595800640 1 -- 172.21.15.31:0/1478848821 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75901f4150 con 0x7f759015e360 2024-09-17T05:34:52.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.845+0000 7f7595800640 1 -- 172.21.15.31:0/1478848821 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f759015de20 con 0x7f759015e360 2024-09-17T05:34:52.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.845+0000 7f758cc00640 1 -- 172.21.15.31:0/1478848821 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 21) ==== 97693+0+0 (secure 0 0 0) 0x7f75880054d0 con 0x7f759015e360 2024-09-17T05:34:52.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.845+0000 7f758cc00640 1 --2- 172.21.15.31:0/1478848821 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f756c073710 0x7f756c075bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:52.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.845+0000 7f758cc00640 1 -- 172.21.15.31:0/1478848821 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5851+0+0 (secure 0 0 0) 0x7f7588094780 con 0x7f759015e360 2024-09-17T05:34:52.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.845+0000 7f758fe00640 1 --2- 172.21.15.31:0/1478848821 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f756c073710 0x7f756c075bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:52.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.845+0000 7f758fe00640 1 --2- 172.21.15.31:0/1478848821 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f756c073710 0x7f756c075bd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f75800af000 tx=0x7f758001b090 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:52.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:52.849+0000 7f758cc00640 1 -- 172.21.15.31:0/1478848821 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f758805e9c0 con 0x7f759015e360 2024-09-17T05:34:53.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.061+0000 7f7595800640 1 -- 172.21.15.31:0/1478848821 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol76272", "target": ["mon-mgr", ""]}) -- 0x7f7590074fc0 con 0x7f756c073710 2024-09-17T05:34:53.083 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:34:53.081+0000 7f46f6e00640 -1 mgr.server reply reply (11) Resource temporarily unavailable subvolume 'subvol76272' is not ready for operation rm (use --force to override) 2024-09-17T05:34:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.081+0000 7f758cc00640 1 -- 172.21.15.31:0/1478848821 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -11 subvolume 'subvol76272' is not ready for operation rm (use --force to override)) ==== 87+0+0 (secure 0 0 0) 0x7f7590074fc0 con 0x7f756c073710 2024-09-17T05:34:53.083 INFO:teuthology.orchestra.run.smithi031.stderr:Error EAGAIN: subvolume 'subvol76272' is not ready for operation rm (use --force to override) 2024-09-17T05:34:53.092 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-09-17T05:34:53.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:53.093 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol76272/.meta) 2024-09-17T05:34:53.118 INFO:teuthology.orchestra.run.smithi031.stdout:[GLOBAL] 2024-09-17T05:34:53.118 INFO:teuthology.orchestra.run.smithi031.stdout:version = 1 2024-09-17T05:34:53.119 INFO:teuthology.orchestra.run.smithi031.stdout:type = clone 2024-09-17T05:34:53.119 INFO:teuthology.orchestra.run.smithi031.stdout:path = /volumes/_nogroup/subvol76272/b37e4ffa-9dbd-4bbe-a2fd-79fd39dac489 2024-09-17T05:34:53.119 INFO:teuthology.orchestra.run.smithi031.stdout:state = pending 2024-09-17T05:34:53.119 INFO:teuthology.orchestra.run.smithi031.stdout:[source] 2024-09-17T05:34:53.119 INFO:teuthology.orchestra.run.smithi031.stdout:volume = fake 2024-09-17T05:34:53.119 INFO:teuthology.orchestra.run.smithi031.stdout:subvolume = fake 2024-09-17T05:34:53.119 INFO:teuthology.orchestra.run.smithi031.stdout:snapshot = fake 2024-09-17T05:34:53.121 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol76272 --force 2024-09-17T05:34:53.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.309+0000 7f2fa7800640 1 -- 172.21.15.31:0/3527399066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fa00d0b20 msgr2=0x7f2fa00ca650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:53.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.309+0000 7f2fa7800640 1 --2- 172.21.15.31:0/3527399066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fa00d0b20 0x7f2fa00ca650 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009900 tx=0x7f2f8801f0d0 comp rx=0 tx=0).stop 2024-09-17T05:34:53.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.309+0000 7f2fa7800640 1 -- 172.21.15.31:0/3527399066 shutdown_connections 2024-09-17T05:34:53.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.309+0000 7f2fa7800640 1 --2- 172.21.15.31:0/3527399066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fa00d0b20 0x7f2fa00ca650 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:53.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.309+0000 7f2fa7800640 1 -- 172.21.15.31:0/3527399066 >> 172.21.15.31:0/3527399066 conn(0x7f2fa00d0000 msgr2=0x7f2fa00d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:53.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.309+0000 7f2fa7800640 1 -- 172.21.15.31:0/3527399066 shutdown_connections 2024-09-17T05:34:53.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.309+0000 7f2fa7800640 1 -- 172.21.15.31:0/3527399066 wait complete. 2024-09-17T05:34:53.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.309+0000 7f2fa7800640 1 Processor -- start 2024-09-17T05:34:53.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.309+0000 7f2fa7800640 1 -- start start 2024-09-17T05:34:53.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.309+0000 7f2fa7800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fa006ebe0 0x7f2fa00b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:53.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.309+0000 7f2fa7800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fa0074470 0x7f2fa0158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:53.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.309+0000 7f2fa7800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fa0148210 0x7f2fa01486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:53.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.309+0000 7f2fa7800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa00cb420 con 0x7f2fa006ebe0 2024-09-17T05:34:53.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.309+0000 7f2fa7800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa00cb2a0 con 0x7f2fa0074470 2024-09-17T05:34:53.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.309+0000 7f2fa7800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa00cb5a0 con 0x7f2fa0148210 2024-09-17T05:34:53.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.309+0000 7f2fa4e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fa006ebe0 0x7f2fa00b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:53.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.313+0000 7f2fa4e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fa006ebe0 0x7f2fa00b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39686/0 (socket says 172.21.15.31:39686) 2024-09-17T05:34:53.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.313+0000 7f2fa4e00640 1 -- 172.21.15.31:0/3143337813 learned_addr learned my addr 172.21.15.31:0/3143337813 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:53.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.313+0000 7f2f97e00640 1 --2- 172.21.15.31:0/3143337813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fa0074470 0x7f2fa0158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:53.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.313+0000 7f2fa5800640 1 --2- 172.21.15.31:0/3143337813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fa0148210 0x7f2fa01486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:53.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.313+0000 7f2fa4e00640 1 -- 172.21.15.31:0/3143337813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fa0148210 msgr2=0x7f2fa01486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:53.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.313+0000 7f2fa4e00640 1 --2- 172.21.15.31:0/3143337813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fa0148210 0x7f2fa01486c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:53.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.313+0000 7f2fa4e00640 1 -- 172.21.15.31:0/3143337813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fa0074470 msgr2=0x7f2fa0158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:53.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.313+0000 7f2fa4e00640 1 --2- 172.21.15.31:0/3143337813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fa0074470 0x7f2fa0158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:53.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.313+0000 7f2fa4e00640 1 -- 172.21.15.31:0/3143337813 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa0148cb0 con 0x7f2fa006ebe0 2024-09-17T05:34:53.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.313+0000 7f2fa4e00640 1 --2- 172.21.15.31:0/3143337813 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fa006ebe0 0x7f2fa00b3f00 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f2f9000c530 tx=0x7f2f9000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:53.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.313+0000 7f2f9d600640 1 -- 172.21.15.31:0/3143337813 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f90017070 con 0x7f2fa006ebe0 2024-09-17T05:34:53.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.313+0000 7f2f9d600640 1 -- 172.21.15.31:0/3143337813 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f90003600 con 0x7f2fa006ebe0 2024-09-17T05:34:53.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.313+0000 7f2fa7800640 1 -- 172.21.15.31:0/3143337813 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa0148f90 con 0x7f2fa006ebe0 2024-09-17T05:34:53.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.313+0000 7f2f9d600640 1 -- 172.21.15.31:0/3143337813 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f90003a50 con 0x7f2fa006ebe0 2024-09-17T05:34:53.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.313+0000 7f2fa7800640 1 -- 172.21.15.31:0/3143337813 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa009c7a0 con 0x7f2fa006ebe0 2024-09-17T05:34:53.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.313+0000 7f2fa7800640 1 -- 172.21.15.31:0/3143337813 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa0074850 con 0x7f2fa006ebe0 2024-09-17T05:34:53.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.313+0000 7f2f9d600640 1 -- 172.21.15.31:0/3143337813 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 21) ==== 97693+0+0 (secure 0 0 0) 0x7f2f9001a070 con 0x7f2fa006ebe0 2024-09-17T05:34:53.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.317+0000 7f2f9d600640 1 --2- 172.21.15.31:0/3143337813 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2f7c073740 0x7f2f7c075c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:53.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.317+0000 7f2f9d600640 1 -- 172.21.15.31:0/3143337813 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5851+0+0 (secure 0 0 0) 0x7f2f90094060 con 0x7f2fa006ebe0 2024-09-17T05:34:53.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.317+0000 7f2f97e00640 1 --2- 172.21.15.31:0/3143337813 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2f7c073740 0x7f2f7c075c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:53.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.317+0000 7f2f97e00640 1 --2- 172.21.15.31:0/3143337813 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2f7c073740 0x7f2f7c075c00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2f880b2000 tx=0x7f2f8801d910 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:53.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.321+0000 7f2f9d600640 1 -- 172.21.15.31:0/3143337813 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2f9005e220 con 0x7f2fa006ebe0 2024-09-17T05:34:53.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.517+0000 7f2fa7800640 1 -- 172.21.15.31:0/3143337813 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol76272", "force": true, "target": ["mon-mgr", ""]}) -- 0x7f2fa0145ed0 con 0x7f2f7c073740 2024-09-17T05:34:53.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.549+0000 7f2f9d600640 1 -- 172.21.15.31:0/3143337813 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2fa0145ed0 con 0x7f2f7c073740 2024-09-17T05:34:53.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.549+0000 7f2fa7800640 1 -- 172.21.15.31:0/3143337813 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2f7c073740 msgr2=0x7f2f7c075c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:53.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.549+0000 7f2fa7800640 1 --2- 172.21.15.31:0/3143337813 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2f7c073740 0x7f2f7c075c00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2f880b2000 tx=0x7f2f8801d910 comp rx=0 tx=0).stop 2024-09-17T05:34:53.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.549+0000 7f2fa7800640 1 -- 172.21.15.31:0/3143337813 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fa006ebe0 msgr2=0x7f2fa00b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:53.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.549+0000 7f2fa7800640 1 --2- 172.21.15.31:0/3143337813 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fa006ebe0 0x7f2fa00b3f00 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f2f9000c530 tx=0x7f2f9000c9f0 comp rx=0 tx=0).stop 2024-09-17T05:34:53.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.549+0000 7f2fa7800640 1 -- 172.21.15.31:0/3143337813 shutdown_connections 2024-09-17T05:34:53.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.549+0000 7f2fa7800640 1 --2- 172.21.15.31:0/3143337813 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2f7c073740 0x7f2f7c075c00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:53.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.549+0000 7f2fa7800640 1 --2- 172.21.15.31:0/3143337813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2fa0148210 0x7f2fa01486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:53.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.549+0000 7f2fa7800640 1 --2- 172.21.15.31:0/3143337813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fa0074470 0x7f2fa0158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:53.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.549+0000 7f2fa7800640 1 --2- 172.21.15.31:0/3143337813 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fa006ebe0 0x7f2fa00b3f00 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:53.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.549+0000 7f2fa7800640 1 -- 172.21.15.31:0/3143337813 >> 172.21.15.31:0/3143337813 conn(0x7f2fa00d0000 msgr2=0x7f2fa00b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:53.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.549+0000 7f2fa7800640 1 -- 172.21.15.31:0/3143337813 shutdown_connections 2024-09-17T05:34:53.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.549+0000 7f2fa7800640 1 -- 172.21.15.31:0/3143337813 wait complete. 2024-09-17T05:34:53.575 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs 2024-09-17T05:34:53.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.721+0000 7f541d400640 1 -- 172.21.15.31:0/2752626295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54180cf710 msgr2=0x7f54180ca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:53.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.721+0000 7f541d400640 1 --2- 172.21.15.31:0/2752626295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54180cf710 0x7f54180ca480 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f5418052010 tx=0x7f540001c770 comp rx=0 tx=0).stop 2024-09-17T05:34:53.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.721+0000 7f541d400640 1 -- 172.21.15.31:0/2752626295 shutdown_connections 2024-09-17T05:34:53.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.721+0000 7f541d400640 1 --2- 172.21.15.31:0/2752626295 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54180cf710 0x7f54180ca480 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:53.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.721+0000 7f541d400640 1 --2- 172.21.15.31:0/2752626295 >> v2:172.21.15.155:3300/0 conn(0x7f5418151410 0x7f54180cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:53.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.721+0000 7f541d400640 1 -- 172.21.15.31:0/2752626295 >> 172.21.15.31:0/2752626295 conn(0x7f54180cfc20 msgr2=0x7f54180d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:53.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.721+0000 7f541d400640 1 -- 172.21.15.31:0/2752626295 shutdown_connections 2024-09-17T05:34:53.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.721+0000 7f541d400640 1 -- 172.21.15.31:0/2752626295 wait complete. 2024-09-17T05:34:53.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f541d400640 1 Processor -- start 2024-09-17T05:34:53.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f541d400640 1 -- start start 2024-09-17T05:34:53.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f541d400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54180ca9c0 0x7f54181f9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:53.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f541d400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54180cf710 0x7f541814a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:53.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f541d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5418151410 0x7f541814fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:53.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f541d400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5418168480 con 0x7f5418151410 2024-09-17T05:34:53.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f541d400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f54180ae3b0 con 0x7f54180cf710 2024-09-17T05:34:53.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f541d400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5418168600 con 0x7f54180ca9c0 2024-09-17T05:34:53.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f5417200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5418151410 0x7f541814fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:53.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f5417200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5418151410 0x7f541814fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39708/0 (socket says 172.21.15.31:39708) 2024-09-17T05:34:53.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f5417200640 1 -- 172.21.15.31:0/2586294103 learned_addr learned my addr 172.21.15.31:0/2586294103 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:53.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f540de00640 1 --2- 172.21.15.31:0/2586294103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54180cf710 0x7f541814a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:53.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f5416800640 1 --2- 172.21.15.31:0/2586294103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54180ca9c0 0x7f54181f9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:53.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f5417200640 1 -- 172.21.15.31:0/2586294103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54180ca9c0 msgr2=0x7f54181f9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:53.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f5417200640 1 --2- 172.21.15.31:0/2586294103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54180ca9c0 0x7f54181f9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:53.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f5417200640 1 -- 172.21.15.31:0/2586294103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54180cf710 msgr2=0x7f541814a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:53.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f5417200640 1 --2- 172.21.15.31:0/2586294103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54180cf710 0x7f541814a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:53.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f5417200640 1 -- 172.21.15.31:0/2586294103 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54181f9d90 con 0x7f5418151410 2024-09-17T05:34:53.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f5417200640 1 --2- 172.21.15.31:0/2586294103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5418151410 0x7f541814fbf0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f541000cbc0 tx=0x7f541000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:53.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f540f400640 1 -- 172.21.15.31:0/2586294103 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5410016020 con 0x7f5418151410 2024-09-17T05:34:53.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f540f400640 1 -- 172.21.15.31:0/2586294103 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f541000ab00 con 0x7f5418151410 2024-09-17T05:34:53.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f541d400640 1 -- 172.21.15.31:0/2586294103 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54181fa070 con 0x7f5418151410 2024-09-17T05:34:53.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f540f400640 1 -- 172.21.15.31:0/2586294103 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5410012420 con 0x7f5418151410 2024-09-17T05:34:53.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.725+0000 7f541d400640 1 -- 172.21.15.31:0/2586294103 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5418151960 con 0x7f5418151410 2024-09-17T05:34:53.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.729+0000 7f541d400640 1 -- 172.21.15.31:0/2586294103 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5418166040 con 0x7f5418151410 2024-09-17T05:34:53.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.729+0000 7f540f400640 1 -- 172.21.15.31:0/2586294103 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 21) ==== 97693+0+0 (secure 0 0 0) 0x7f5410019020 con 0x7f5418151410 2024-09-17T05:34:53.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.729+0000 7f540f400640 1 --2- 172.21.15.31:0/2586294103 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f53f4073710 0x7f53f4075bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:53.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.729+0000 7f540f400640 1 -- 172.21.15.31:0/2586294103 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5851+0+0 (secure 0 0 0) 0x7f5410094fc0 con 0x7f5418151410 2024-09-17T05:34:53.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.729+0000 7f5416800640 1 --2- 172.21.15.31:0/2586294103 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f53f4073710 0x7f53f4075bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:53.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.729+0000 7f5416800640 1 --2- 172.21.15.31:0/2586294103 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f53f4073710 0x7f53f4075bd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f54080058d0 tx=0x7f5408005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:53.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.733+0000 7f540f400640 1 -- 172.21.15.31:0/2586294103 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5410020020 con 0x7f5418151410 2024-09-17T05:34:53.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.941+0000 7f541d400640 1 -- 172.21.15.31:0/2586294103 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) -- 0x7f541814eeb0 con 0x7f53f4073710 2024-09-17T05:34:53.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.945+0000 7f540f400640 1 -- 172.21.15.31:0/2586294103 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f541814eeb0 con 0x7f53f4073710 2024-09-17T05:34:53.945 INFO:teuthology.orchestra.run.smithi031.stdout:[] 2024-09-17T05:34:53.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.945+0000 7f541d400640 1 -- 172.21.15.31:0/2586294103 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f53f4073710 msgr2=0x7f53f4075bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:53.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.945+0000 7f541d400640 1 --2- 172.21.15.31:0/2586294103 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f53f4073710 0x7f53f4075bd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f54080058d0 tx=0x7f5408005860 comp rx=0 tx=0).stop 2024-09-17T05:34:53.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.945+0000 7f541d400640 1 -- 172.21.15.31:0/2586294103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5418151410 msgr2=0x7f541814fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:53.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.945+0000 7f541d400640 1 --2- 172.21.15.31:0/2586294103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5418151410 0x7f541814fbf0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f541000cbc0 tx=0x7f541000ccb0 comp rx=0 tx=0).stop 2024-09-17T05:34:53.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.945+0000 7f541d400640 1 -- 172.21.15.31:0/2586294103 shutdown_connections 2024-09-17T05:34:53.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.945+0000 7f541d400640 1 --2- 172.21.15.31:0/2586294103 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f53f4073710 0x7f53f4075bd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:53.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.945+0000 7f541d400640 1 --2- 172.21.15.31:0/2586294103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5418151410 0x7f541814fbf0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:53.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.945+0000 7f541d400640 1 --2- 172.21.15.31:0/2586294103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f54180cf710 0x7f541814a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:53.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.945+0000 7f541d400640 1 --2- 172.21.15.31:0/2586294103 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54180ca9c0 0x7f54181f9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:53.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.945+0000 7f541d400640 1 -- 172.21.15.31:0/2586294103 >> 172.21.15.31:0/2586294103 conn(0x7f54180cfc20 msgr2=0x7f541814f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:53.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.945+0000 7f541d400640 1 -- 172.21.15.31:0/2586294103 shutdown_connections 2024-09-17T05:34:53.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:53.945+0000 7f541d400640 1 -- 172.21.15.31:0/2586294103 wait complete. 2024-09-17T05:34:53.967 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:34:54.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:34:54.019 INFO:teuthology.orchestra.run.smithi031.stdout:2 2024-09-17T05:34:54.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:34:54.026 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:34:54.026 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:34:54.176 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:34:54.288 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:34:54.288 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:34:54.288 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:34:54.288 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:34:54.297 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:34:54.297 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:34:54.349 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:34:54.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.541+0000 7f1efd000640 1 -- 172.21.15.31:0/2651076847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1edc005170 msgr2=0x7f1edc005920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:54.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.541+0000 7f1efd000640 1 --2- 172.21.15.31:0/2651076847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1edc005170 0x7f1edc005920 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00016f0 tx=0x7f1ee001c7b0 comp rx=0 tx=0).stop 2024-09-17T05:34:54.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.541+0000 7f1ef6800640 1 -- 172.21.15.31:0/2651076847 reap_dead start 2024-09-17T05:34:54.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.541+0000 7f1efd000640 1 -- 172.21.15.31:0/2651076847 shutdown_connections 2024-09-17T05:34:54.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.541+0000 7f1efd000640 1 -- 172.21.15.31:0/2651076847 >> 172.21.15.31:0/2651076847 conn(0x7f1ef80b18f0 msgr2=0x7f1ef80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:54.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.541+0000 7f1efd000640 1 -- 172.21.15.31:0/2651076847 shutdown_connections 2024-09-17T05:34:54.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.541+0000 7f1efd000640 1 -- 172.21.15.31:0/2651076847 wait complete. 2024-09-17T05:34:54.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1efd000640 1 Processor -- start 2024-09-17T05:34:54.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1efd000640 1 -- start start 2024-09-17T05:34:54.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1efd000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1edc005170 0x7f1ef809aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:54.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1efd000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ef81f93f0 0x7f1ef81f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:54.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1efd000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ef809cfa0 0x7f1ef814c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:54.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1efd000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef8166120 con 0x7f1ef809cfa0 2024-09-17T05:34:54.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1efd000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef80cf4e0 con 0x7f1edc005170 2024-09-17T05:34:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1efd000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef81662a0 con 0x7f1ef81f93f0 2024-09-17T05:34:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1ef6800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ef809cfa0 0x7f1ef814c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1ef6800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ef809cfa0 0x7f1ef814c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39720/0 (socket says 172.21.15.31:39720) 2024-09-17T05:34:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1ef6800640 1 -- 172.21.15.31:0/1352951561 learned_addr learned my addr 172.21.15.31:0/1352951561 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1ef5e00640 1 --2- 172.21.15.31:0/1352951561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1edc005170 0x7f1ef809aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1eed400640 1 --2- 172.21.15.31:0/1352951561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ef81f93f0 0x7f1ef81f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1ef6800640 1 -- 172.21.15.31:0/1352951561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ef81f93f0 msgr2=0x7f1ef81f5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1ef6800640 1 --2- 172.21.15.31:0/1352951561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ef81f93f0 0x7f1ef81f5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1ef6800640 1 -- 172.21.15.31:0/1352951561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1edc005170 msgr2=0x7f1ef809aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:54.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1ef6800640 1 --2- 172.21.15.31:0/1352951561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1edc005170 0x7f1ef809aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:54.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1ef6800640 1 -- 172.21.15.31:0/1352951561 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef809db10 con 0x7f1ef809cfa0 2024-09-17T05:34:54.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1eed400640 1 --2- 172.21.15.31:0/1352951561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ef81f93f0 0x7f1ef81f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:34:54.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1ef5e00640 1 --2- 172.21.15.31:0/1352951561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1edc005170 0x7f1ef809aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:34:54.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1ef6800640 1 --2- 172.21.15.31:0/1352951561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ef809cfa0 0x7f1ef814c090 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f1ef80708e0 tx=0x7f1ef0010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:54.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1eeea00640 1 -- 172.21.15.31:0/1352951561 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0004b30 con 0x7f1ef809cfa0 2024-09-17T05:34:54.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1eeea00640 1 -- 172.21.15.31:0/1352951561 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ef0015070 con 0x7f1ef809cfa0 2024-09-17T05:34:54.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1efd000640 1 -- 172.21.15.31:0/1352951561 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef81f6570 con 0x7f1ef809cfa0 2024-09-17T05:34:54.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1eeea00640 1 -- 172.21.15.31:0/1352951561 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0003980 con 0x7f1ef809cfa0 2024-09-17T05:34:54.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1efd000640 1 -- 172.21.15.31:0/1352951561 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef81f6b30 con 0x7f1ef809cfa0 2024-09-17T05:34:54.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.545+0000 7f1efd000640 1 -- 172.21.15.31:0/1352951561 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ef8069410 con 0x7f1ef809cfa0 2024-09-17T05:34:54.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.549+0000 7f1eeea00640 1 -- 172.21.15.31:0/1352951561 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 21) ==== 97693+0+0 (secure 0 0 0) 0x7f1ef0003b20 con 0x7f1ef809cfa0 2024-09-17T05:34:54.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.549+0000 7f1eeea00640 1 --2- 172.21.15.31:0/1352951561 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1ed4073740 0x7f1ed4075c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:54.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.549+0000 7f1eeea00640 1 -- 172.21.15.31:0/1352951561 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5851+0+0 (secure 0 0 0) 0x7f1ef0095410 con 0x7f1ef809cfa0 2024-09-17T05:34:54.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.549+0000 7f1ef5e00640 1 --2- 172.21.15.31:0/1352951561 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1ed4073740 0x7f1ed4075c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:54.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.549+0000 7f1ef5e00640 1 --2- 172.21.15.31:0/1352951561 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1ed4073740 0x7f1ed4075c00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8011920 tx=0x7f1ee8000f40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:54.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.553+0000 7f1eeea00640 1 -- 172.21.15.31:0/1352951561 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f1ef005fb50 con 0x7f1ef809cfa0 2024-09-17T05:34:54.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.741+0000 7f1efd000640 1 -- 172.21.15.31:0/1352951561 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1ef80ae360 con 0x7f1ef809cfa0 2024-09-17T05:34:54.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.741+0000 7f1eeea00640 1 -- 172.21.15.31:0/1352951561 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v118) ==== 80+0+0 (secure 0 0 0) 0x7f1ef005f450 con 0x7f1ef809cfa0 2024-09-17T05:34:54.745 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:34:54.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.745+0000 7f1efd000640 1 -- 172.21.15.31:0/1352951561 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1ed4073740 msgr2=0x7f1ed4075c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:54.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.745+0000 7f1efd000640 1 --2- 172.21.15.31:0/1352951561 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1ed4073740 0x7f1ed4075c00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8011920 tx=0x7f1ee8000f40 comp rx=0 tx=0).stop 2024-09-17T05:34:54.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.745+0000 7f1efd000640 1 -- 172.21.15.31:0/1352951561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ef809cfa0 msgr2=0x7f1ef814c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:54.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.745+0000 7f1efd000640 1 --2- 172.21.15.31:0/1352951561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ef809cfa0 0x7f1ef814c090 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f1ef80708e0 tx=0x7f1ef0010f40 comp rx=0 tx=0).stop 2024-09-17T05:34:54.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.745+0000 7f1efd000640 1 -- 172.21.15.31:0/1352951561 shutdown_connections 2024-09-17T05:34:54.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.745+0000 7f1efd000640 1 --2- 172.21.15.31:0/1352951561 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1ed4073740 0x7f1ed4075c00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:54.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.745+0000 7f1efd000640 1 --2- 172.21.15.31:0/1352951561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ef809cfa0 0x7f1ef814c090 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:54.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.745+0000 7f1efd000640 1 --2- 172.21.15.31:0/1352951561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ef81f93f0 0x7f1ef81f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:54.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.745+0000 7f1efd000640 1 --2- 172.21.15.31:0/1352951561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1edc005170 0x7f1ef809aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:54.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.745+0000 7f1efd000640 1 -- 172.21.15.31:0/1352951561 >> 172.21.15.31:0/1352951561 conn(0x7f1ef80b18f0 msgr2=0x7f1ef8075940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:54.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.745+0000 7f1efd000640 1 -- 172.21.15.31:0/1352951561 shutdown_connections 2024-09-17T05:34:54.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:54.745+0000 7f1efd000640 1 -- 172.21.15.31:0/1352951561 wait complete. 2024-09-17T05:34:54.767 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:34:54.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:54.768 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:34:54.831 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:34:54.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:54.831 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:34:54.851 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:34:54.851 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:34:54.851 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:34:54.862 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:34:54.862 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:34:54.913 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:34:55.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.061+0000 7fa383200640 1 -- 172.21.15.31:0/1921812651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa37c15bd40 msgr2=0x7fa37c160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:55.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.061+0000 7fa383200640 1 --2- 172.21.15.31:0/1921812651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa37c15bd40 0x7fa37c160140 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa370009870 tx=0x7fa37001c820 comp rx=0 tx=0).stop 2024-09-17T05:34:55.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.061+0000 7fa383200640 1 -- 172.21.15.31:0/1921812651 shutdown_connections 2024-09-17T05:34:55.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.061+0000 7fa383200640 1 --2- 172.21.15.31:0/1921812651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa37c15bd40 0x7fa37c160140 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.061+0000 7fa383200640 1 -- 172.21.15.31:0/1921812651 >> 172.21.15.31:0/1921812651 conn(0x7fa37c073490 msgr2=0x7fa37c0d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:55.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.061+0000 7fa383200640 1 -- 172.21.15.31:0/1921812651 shutdown_connections 2024-09-17T05:34:55.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.061+0000 7fa383200640 1 -- 172.21.15.31:0/1921812651 wait complete. 2024-09-17T05:34:55.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa383200640 1 Processor -- start 2024-09-17T05:34:55.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa383200640 1 -- start start 2024-09-17T05:34:55.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa383200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa37c074340 0x7fa37c0b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:55.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa383200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa37c0cd3e0 0x7fa37c09dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:55.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa383200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa37c15bd40 0x7fa37c09a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:55.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa383200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c16a950 con 0x7fa37c0cd3e0 2024-09-17T05:34:55.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa383200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c16a7d0 con 0x7fa37c15bd40 2024-09-17T05:34:55.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa383200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa37c16aad0 con 0x7fa37c074340 2024-09-17T05:34:55.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa381400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa37c0cd3e0 0x7fa37c09dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:55.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa381400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa37c0cd3e0 0x7fa37c09dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39728/0 (socket says 172.21.15.31:39728) 2024-09-17T05:34:55.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa381400640 1 -- 172.21.15.31:0/1817061737 learned_addr learned my addr 172.21.15.31:0/1817061737 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:55.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa381e00640 1 --2- 172.21.15.31:0/1817061737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa37c074340 0x7fa37c0b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:55.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa382800640 1 --2- 172.21.15.31:0/1817061737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa37c15bd40 0x7fa37c09a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:55.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa381400640 1 -- 172.21.15.31:0/1817061737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa37c074340 msgr2=0x7fa37c0b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:55.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa381400640 1 --2- 172.21.15.31:0/1817061737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa37c074340 0x7fa37c0b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa381400640 1 -- 172.21.15.31:0/1817061737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa37c15bd40 msgr2=0x7fa37c09a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:55.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa381400640 1 --2- 172.21.15.31:0/1817061737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa37c15bd40 0x7fa37c09a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa381400640 1 -- 172.21.15.31:0/1817061737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37c0b48d0 con 0x7fa37c0cd3e0 2024-09-17T05:34:55.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa382800640 1 --2- 172.21.15.31:0/1817061737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa37c15bd40 0x7fa37c09a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:55.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa381400640 1 --2- 172.21.15.31:0/1817061737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa37c0cd3e0 0x7fa37c09dae0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fa36c00c4c0 tx=0x7fa36c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:55.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa376000640 1 -- 172.21.15.31:0/1817061737 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c016020 con 0x7fa37c0cd3e0 2024-09-17T05:34:55.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa376000640 1 -- 172.21.15.31:0/1817061737 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa36c012a00 con 0x7fa37c0cd3e0 2024-09-17T05:34:55.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa383200640 1 -- 172.21.15.31:0/1817061737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37c09cd20 con 0x7fa37c0cd3e0 2024-09-17T05:34:55.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa376000640 1 -- 172.21.15.31:0/1817061737 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c012e50 con 0x7fa37c0cd3e0 2024-09-17T05:34:55.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa383200640 1 -- 172.21.15.31:0/1817061737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa37c09d2e0 con 0x7fa37c0cd3e0 2024-09-17T05:34:55.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.065+0000 7fa383200640 1 -- 172.21.15.31:0/1817061737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa37c160140 con 0x7fa37c0cd3e0 2024-09-17T05:34:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.069+0000 7fa376000640 1 -- 172.21.15.31:0/1817061737 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fa36c019020 con 0x7fa37c0cd3e0 2024-09-17T05:34:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.069+0000 7fa376000640 1 --2- 172.21.15.31:0/1817061737 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa3600739d0 0x7fa360075e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.069+0000 7fa376000640 1 -- 172.21.15.31:0/1817061737 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5851+0+0 (secure 0 0 0) 0x7fa36c094e20 con 0x7fa37c0cd3e0 2024-09-17T05:34:55.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.069+0000 7fa381e00640 1 --2- 172.21.15.31:0/1817061737 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa3600739d0 0x7fa360075e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:55.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.069+0000 7fa381e00640 1 --2- 172.21.15.31:0/1817061737 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa3600739d0 0x7fa360075e90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa3700af000 tx=0x7fa37001b060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:55.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.073+0000 7fa376000640 1 -- 172.21.15.31:0/1817061737 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa36c020020 con 0x7fa37c0cd3e0 2024-09-17T05:34:55.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.261+0000 7fa383200640 1 -- 172.21.15.31:0/1817061737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa37c0ce410 con 0x7fa37c0cd3e0 2024-09-17T05:34:55.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.261+0000 7fa376000640 1 -- 172.21.15.31:0/1817061737 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v118) ==== 80+0+0 (secure 0 0 0) 0x7fa36c05f3b0 con 0x7fa37c0cd3e0 2024-09-17T05:34:55.263 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:34:55.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.265+0000 7fa383200640 1 -- 172.21.15.31:0/1817061737 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa3600739d0 msgr2=0x7fa360075e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:55.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.265+0000 7fa383200640 1 --2- 172.21.15.31:0/1817061737 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa3600739d0 0x7fa360075e90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa3700af000 tx=0x7fa37001b060 comp rx=0 tx=0).stop 2024-09-17T05:34:55.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.265+0000 7fa383200640 1 -- 172.21.15.31:0/1817061737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa37c0cd3e0 msgr2=0x7fa37c09dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:55.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.265+0000 7fa383200640 1 --2- 172.21.15.31:0/1817061737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa37c0cd3e0 0x7fa37c09dae0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fa36c00c4c0 tx=0x7fa36c00c980 comp rx=0 tx=0).stop 2024-09-17T05:34:55.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.265+0000 7fa383200640 1 -- 172.21.15.31:0/1817061737 shutdown_connections 2024-09-17T05:34:55.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.265+0000 7fa383200640 1 --2- 172.21.15.31:0/1817061737 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa3600739d0 0x7fa360075e90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.265+0000 7fa383200640 1 --2- 172.21.15.31:0/1817061737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa37c15bd40 0x7fa37c09a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.265+0000 7fa383200640 1 --2- 172.21.15.31:0/1817061737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa37c0cd3e0 0x7fa37c09dae0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.265+0000 7fa383200640 1 --2- 172.21.15.31:0/1817061737 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa37c074340 0x7fa37c0b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.265+0000 7fa383200640 1 -- 172.21.15.31:0/1817061737 >> 172.21.15.31:0/1817061737 conn(0x7fa37c073490 msgr2=0x7fa37c0b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:55.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.265+0000 7fa383200640 1 -- 172.21.15.31:0/1817061737 shutdown_connections 2024-09-17T05:34:55.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.265+0000 7fa383200640 1 -- 172.21.15.31:0/1817061737 wait complete. 2024-09-17T05:34:55.285 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T05:34:55.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:55.285 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T05:34:55.314 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:34:55.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:34:55.314 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:34:55.366 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:34:55.366 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:34:55.366 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:34:55.375 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:34:55.375 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:34:55.375 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:34:55.376 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:34:55.417 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:34:55.417 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:34:55.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.561+0000 7fb2aea00640 1 -- 172.21.15.31:0/1400521199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a80ced80 msgr2=0x7fb2a80ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:55.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.561+0000 7fb2aea00640 1 --2- 172.21.15.31:0/1400521199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a80ced80 0x7fb2a80ae9b0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fb290009900 tx=0x7fb29001c8e0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.561+0000 7fb2aea00640 1 -- 172.21.15.31:0/1400521199 shutdown_connections 2024-09-17T05:34:55.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.561+0000 7fb2aea00640 1 --2- 172.21.15.31:0/1400521199 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2a80cdb30 0x7fb2a80aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.561+0000 7fb2aea00640 1 --2- 172.21.15.31:0/1400521199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a80ced80 0x7fb2a80ae9b0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.561+0000 7fb2aea00640 1 -- 172.21.15.31:0/1400521199 >> 172.21.15.31:0/1400521199 conn(0x7fb2a80d1dc0 msgr2=0x7fb2a80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:55.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.561+0000 7fb2aea00640 1 -- 172.21.15.31:0/1400521199 shutdown_connections 2024-09-17T05:34:55.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.561+0000 7fb2aea00640 1 -- 172.21.15.31:0/1400521199 wait complete. 2024-09-17T05:34:55.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb2aea00640 1 Processor -- start 2024-09-17T05:34:55.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb2aea00640 1 -- start start 2024-09-17T05:34:55.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb2aea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2a80cdb30 0x7fb2a815a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:55.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb2aea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a80ced80 0x7fb2a8156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:55.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb2aea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2a815bea0 0x7fb2a8156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:55.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb2aea00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a8169340 con 0x7fb2a80ced80 2024-09-17T05:34:55.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb2aea00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a81691c0 con 0x7fb2a80cdb30 2024-09-17T05:34:55.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb2aea00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a81694c0 con 0x7fb2a815bea0 2024-09-17T05:34:55.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb29fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a80ced80 0x7fb2a8156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:55.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb29fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a80ced80 0x7fb2a8156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39748/0 (socket says 172.21.15.31:39748) 2024-09-17T05:34:55.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb29fe00640 1 -- 172.21.15.31:0/3172454870 learned_addr learned my addr 172.21.15.31:0/3172454870 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:55.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb2aca00640 1 --2- 172.21.15.31:0/3172454870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2a815bea0 0x7fb2a8156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:55.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb2a7e00640 1 --2- 172.21.15.31:0/3172454870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2a80cdb30 0x7fb2a815a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:55.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb29fe00640 1 -- 172.21.15.31:0/3172454870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2a815bea0 msgr2=0x7fb2a8156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:55.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb29fe00640 1 --2- 172.21.15.31:0/3172454870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2a815bea0 0x7fb2a8156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb29fe00640 1 -- 172.21.15.31:0/3172454870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2a80cdb30 msgr2=0x7fb2a815a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:55.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb29fe00640 1 --2- 172.21.15.31:0/3172454870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2a80cdb30 0x7fb2a815a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb29fe00640 1 -- 172.21.15.31:0/3172454870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a80b7c70 con 0x7fb2a80ced80 2024-09-17T05:34:55.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb2a7e00640 1 --2- 172.21.15.31:0/3172454870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2a80cdb30 0x7fb2a815a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:55.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb29fe00640 1 --2- 172.21.15.31:0/3172454870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a80ced80 0x7fb2a8156030 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fb2900b0040 tx=0x7fb2900a56e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:55.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb2a4c00640 1 -- 172.21.15.31:0/3172454870 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2900b2040 con 0x7fb2a80ced80 2024-09-17T05:34:55.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb2a4c00640 1 -- 172.21.15.31:0/3172454870 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb290005070 con 0x7fb2a80ced80 2024-09-17T05:34:55.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb2a4c00640 1 -- 172.21.15.31:0/3172454870 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2900044f0 con 0x7fb2a80ced80 2024-09-17T05:34:55.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb2aea00640 1 -- 172.21.15.31:0/3172454870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a80cb4f0 con 0x7fb2a80ced80 2024-09-17T05:34:55.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.565+0000 7fb2aea00640 1 -- 172.21.15.31:0/3172454870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a80cba70 con 0x7fb2a80ced80 2024-09-17T05:34:55.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.569+0000 7fb2aea00640 1 -- 172.21.15.31:0/3172454870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2a80ce670 con 0x7fb2a80ced80 2024-09-17T05:34:55.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.569+0000 7fb2a4c00640 1 -- 172.21.15.31:0/3172454870 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fb290005480 con 0x7fb2a80ced80 2024-09-17T05:34:55.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.569+0000 7fb2a4c00640 1 --2- 172.21.15.31:0/3172454870 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb284073830 0x7fb284075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:55.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.569+0000 7fb2a4c00640 1 -- 172.21.15.31:0/3172454870 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5851+0+0 (secure 0 0 0) 0x7fb29012e0a0 con 0x7fb2a80ced80 2024-09-17T05:34:55.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.569+0000 7fb2a7e00640 1 --2- 172.21.15.31:0/3172454870 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb284073830 0x7fb284075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:55.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.569+0000 7fb2a7e00640 1 --2- 172.21.15.31:0/3172454870 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb284073830 0x7fb284075cf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb2980016b0 tx=0x7fb298009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:55.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.573+0000 7fb2a4c00640 1 -- 172.21.15.31:0/3172454870 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb2900164d0 con 0x7fb2a80ced80 2024-09-17T05:34:55.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.785+0000 7fb2aea00640 1 -- 172.21.15.31:0/3172454870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2a80762f0 con 0x7fb2a80ced80 2024-09-17T05:34:55.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.785+0000 7fb2a4c00640 1 -- 172.21.15.31:0/3172454870 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5222 (secure 0 0 0) 0x7fb2900f85b0 con 0x7fb2a80ced80 2024-09-17T05:34:55.789 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:55.789 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":82,"btime":"2024-09-17T05:34:47:801172+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6398,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/296432902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":296432902},{"type":"v1","addr":"172.21.15.31:6834","nonce":296432902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/951265381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":951265381},{"type":"v1","addr":"172.21.15.155:6809","nonce":951265381}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/119812259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":119812259},{"type":"v1","addr":"172.21.15.155:6835","nonce":119812259}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:34:33.468561+0000","modified":"2024-09-17T05:34:36.465649+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7416},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7416":{"gid":7416,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/1466764013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1466764013},{"type":"v1","addr":"172.21.15.31:6835","nonce":1466764013}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7416,"qdb_cluster":[7416]},"id":9}]} 2024-09-17T05:34:55.789 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 82 2024-09-17T05:34:55.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.789+0000 7fb2aea00640 1 -- 172.21.15.31:0/3172454870 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb284073830 msgr2=0x7fb284075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:55.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.789+0000 7fb2aea00640 1 --2- 172.21.15.31:0/3172454870 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb284073830 0x7fb284075cf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb2980016b0 tx=0x7fb298009040 comp rx=0 tx=0).stop 2024-09-17T05:34:55.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.789+0000 7fb2aea00640 1 -- 172.21.15.31:0/3172454870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a80ced80 msgr2=0x7fb2a8156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:55.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.789+0000 7fb2aea00640 1 --2- 172.21.15.31:0/3172454870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a80ced80 0x7fb2a8156030 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fb2900b0040 tx=0x7fb2900a56e0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.789+0000 7fb2aea00640 1 -- 172.21.15.31:0/3172454870 shutdown_connections 2024-09-17T05:34:55.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.789+0000 7fb2aea00640 1 --2- 172.21.15.31:0/3172454870 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb284073830 0x7fb284075cf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.789+0000 7fb2aea00640 1 --2- 172.21.15.31:0/3172454870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb2a815bea0 0x7fb2a8156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.789+0000 7fb2aea00640 1 --2- 172.21.15.31:0/3172454870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb2a80ced80 0x7fb2a8156030 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.789+0000 7fb2aea00640 1 --2- 172.21.15.31:0/3172454870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2a80cdb30 0x7fb2a815a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.789+0000 7fb2aea00640 1 -- 172.21.15.31:0/3172454870 >> 172.21.15.31:0/3172454870 conn(0x7fb2a80d1dc0 msgr2=0x7fb2a806f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:55.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.789+0000 7fb2aea00640 1 -- 172.21.15.31:0/3172454870 shutdown_connections 2024-09-17T05:34:55.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.789+0000 7fb2aea00640 1 -- 172.21.15.31:0/3172454870 wait complete. 2024-09-17T05:34:55.811 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:34:55.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.957+0000 7f9b27e00640 1 -- 172.21.15.31:0/77740508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b08004d50 msgr2=0x7f9b080051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:55.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.957+0000 7f9b27e00640 1 --2- 172.21.15.31:0/77740508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b08004d50 0x7f9b080051d0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f9b18009eb0 tx=0x7f9b1801d5d0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.957+0000 7f9b25e00640 1 -- 172.21.15.31:0/77740508 reap_dead start 2024-09-17T05:34:55.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.957+0000 7f9b27e00640 1 -- 172.21.15.31:0/77740508 shutdown_connections 2024-09-17T05:34:55.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.957+0000 7f9b27e00640 1 -- 172.21.15.31:0/77740508 >> 172.21.15.31:0/77740508 conn(0x7f9b200d0c90 msgr2=0x7f9b200d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:55.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.957+0000 7f9b27e00640 1 -- 172.21.15.31:0/77740508 shutdown_connections 2024-09-17T05:34:55.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.957+0000 7f9b27e00640 1 -- 172.21.15.31:0/77740508 wait complete. 2024-09-17T05:34:55.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.957+0000 7f9b27e00640 1 Processor -- start 2024-09-17T05:34:55.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.957+0000 7f9b27e00640 1 -- start start 2024-09-17T05:34:55.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b27e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b08004d50 0x7f9b200c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:55.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b27e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b200a09e0 0x7f9b200a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:55.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b27e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b201570e0 0x7f9b20157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:55.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b27e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9b200709b0 con 0x7f9b08004d50 2024-09-17T05:34:55.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b27e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9b200cbe90 con 0x7f9b201570e0 2024-09-17T05:34:55.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b27e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9b20070b30 con 0x7f9b200a09e0 2024-09-17T05:34:55.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b25400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b08004d50 0x7f9b200c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:55.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b25400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b08004d50 0x7f9b200c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39770/0 (socket says 172.21.15.31:39770) 2024-09-17T05:34:55.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b25400640 1 -- 172.21.15.31:0/3853654384 learned_addr learned my addr 172.21.15.31:0/3853654384 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:55.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b25e00640 1 --2- 172.21.15.31:0/3853654384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b201570e0 0x7f9b20157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:55.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b24a00640 1 --2- 172.21.15.31:0/3853654384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b200a09e0 0x7f9b200a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:55.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b25400640 1 -- 172.21.15.31:0/3853654384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b200a09e0 msgr2=0x7f9b200a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:55.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b25400640 1 --2- 172.21.15.31:0/3853654384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b200a09e0 0x7f9b200a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b25400640 1 -- 172.21.15.31:0/3853654384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b201570e0 msgr2=0x7f9b20157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:55.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b25400640 1 --2- 172.21.15.31:0/3853654384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b201570e0 0x7f9b20157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:55.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b25400640 1 -- 172.21.15.31:0/3853654384 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2009eec0 con 0x7f9b08004d50 2024-09-17T05:34:55.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b25400640 1 --2- 172.21.15.31:0/3853654384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b08004d50 0x7f9b200c6170 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f9b14001870 tx=0x7f9b1400e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:55.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b1d600640 1 -- 172.21.15.31:0/3853654384 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14012850 con 0x7f9b08004d50 2024-09-17T05:34:55.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b1d600640 1 -- 172.21.15.31:0/3853654384 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b14012ae0 con 0x7f9b08004d50 2024-09-17T05:34:55.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b1d600640 1 -- 172.21.15.31:0/3853654384 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1401a400 con 0x7f9b08004d50 2024-09-17T05:34:55.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b27e00640 1 -- 172.21.15.31:0/3853654384 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b2009f1a0 con 0x7f9b08004d50 2024-09-17T05:34:55.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b27e00640 1 -- 172.21.15.31:0/3853654384 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b200c6c40 con 0x7f9b08004d50 2024-09-17T05:34:55.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.961+0000 7f9b27e00640 1 -- 172.21.15.31:0/3853654384 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b200737c0 con 0x7f9b08004d50 2024-09-17T05:34:55.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.965+0000 7f9b1d600640 1 -- 172.21.15.31:0/3853654384 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f9b1400d030 con 0x7f9b08004d50 2024-09-17T05:34:55.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.965+0000 7f9b1d600640 1 --2- 172.21.15.31:0/3853654384 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9b00073830 0x7f9b00075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:55.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.965+0000 7f9b1d600640 1 -- 172.21.15.31:0/3853654384 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5851+0+0 (secure 0 0 0) 0x7f9b14098080 con 0x7f9b08004d50 2024-09-17T05:34:55.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.965+0000 7f9b24a00640 1 --2- 172.21.15.31:0/3853654384 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9b00073830 0x7f9b00075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:55.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.965+0000 7f9b24a00640 1 --2- 172.21.15.31:0/3853654384 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9b00073830 0x7f9b00075cf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9b200cf9f0 tx=0x7f9b0c006c80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:55.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:55.969+0000 7f9b1d600640 1 -- 172.21.15.31:0/3853654384 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9b14016030 con 0x7f9b08004d50 2024-09-17T05:34:56.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.185+0000 7f9b27e00640 1 -- 172.21.15.31:0/3853654384 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b200ce9b0 con 0x7f9b08004d50 2024-09-17T05:34:56.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.185+0000 7f9b1d600640 1 -- 172.21.15.31:0/3853654384 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5222 (secure 0 0 0) 0x7f9b14065480 con 0x7f9b08004d50 2024-09-17T05:34:56.189 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:56.189 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":82,"btime":"2024-09-17T05:34:47:801172+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6398,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/296432902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":296432902},{"type":"v1","addr":"172.21.15.31:6834","nonce":296432902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/951265381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":951265381},{"type":"v1","addr":"172.21.15.155:6809","nonce":951265381}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/119812259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":119812259},{"type":"v1","addr":"172.21.15.155:6835","nonce":119812259}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:34:33.468561+0000","modified":"2024-09-17T05:34:36.465649+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7416},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7416":{"gid":7416,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/1466764013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1466764013},{"type":"v1","addr":"172.21.15.31:6835","nonce":1466764013}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7416,"qdb_cluster":[7416]},"id":9}]} 2024-09-17T05:34:56.190 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 82 2024-09-17T05:34:56.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.189+0000 7f9b27e00640 1 -- 172.21.15.31:0/3853654384 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9b00073830 msgr2=0x7f9b00075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:56.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.189+0000 7f9b27e00640 1 --2- 172.21.15.31:0/3853654384 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9b00073830 0x7f9b00075cf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9b200cf9f0 tx=0x7f9b0c006c80 comp rx=0 tx=0).stop 2024-09-17T05:34:56.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.189+0000 7f9b27e00640 1 -- 172.21.15.31:0/3853654384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b08004d50 msgr2=0x7f9b200c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:56.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.189+0000 7f9b27e00640 1 --2- 172.21.15.31:0/3853654384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b08004d50 0x7f9b200c6170 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f9b14001870 tx=0x7f9b1400e770 comp rx=0 tx=0).stop 2024-09-17T05:34:56.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.189+0000 7f9b27e00640 1 -- 172.21.15.31:0/3853654384 shutdown_connections 2024-09-17T05:34:56.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.189+0000 7f9b27e00640 1 --2- 172.21.15.31:0/3853654384 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9b00073830 0x7f9b00075cf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.189+0000 7f9b27e00640 1 --2- 172.21.15.31:0/3853654384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b201570e0 0x7f9b20157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.189+0000 7f9b27e00640 1 --2- 172.21.15.31:0/3853654384 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b200a09e0 0x7f9b200a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.189+0000 7f9b27e00640 1 --2- 172.21.15.31:0/3853654384 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b08004d50 0x7f9b200c6170 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.189+0000 7f9b27e00640 1 -- 172.21.15.31:0/3853654384 >> 172.21.15.31:0/3853654384 conn(0x7f9b200d0c90 msgr2=0x7f9b20158440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:56.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.189+0000 7f9b27e00640 1 -- 172.21.15.31:0/3853654384 shutdown_connections 2024-09-17T05:34:56.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.189+0000 7f9b27e00640 1 -- 172.21.15.31:0/3853654384 wait complete. 2024-09-17T05:34:56.209 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:34:56.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.353+0000 7fa45da00640 1 -- 172.21.15.31:0/4092015924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4580cdb30 msgr2=0x7fa4580aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:56.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.353+0000 7fa45da00640 1 --2- 172.21.15.31:0/4092015924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4580cdb30 0x7fa4580aeef0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fa450009bc0 tx=0x7fa45001cba0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.353+0000 7fa45da00640 1 -- 172.21.15.31:0/4092015924 shutdown_connections 2024-09-17T05:34:56.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.353+0000 7fa45da00640 1 --2- 172.21.15.31:0/4092015924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4580cdb30 0x7fa4580aeef0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.353+0000 7fa45da00640 1 --2- 172.21.15.31:0/4092015924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4580ced80 0x7fa4580ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.353+0000 7fa45da00640 1 -- 172.21.15.31:0/4092015924 >> 172.21.15.31:0/4092015924 conn(0x7fa4580d1dc0 msgr2=0x7fa4580d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:56.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.353+0000 7fa45da00640 1 -- 172.21.15.31:0/4092015924 shutdown_connections 2024-09-17T05:34:56.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.353+0000 7fa45da00640 1 -- 172.21.15.31:0/4092015924 wait complete. 2024-09-17T05:34:56.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa45da00640 1 Processor -- start 2024-09-17T05:34:56.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa45da00640 1 -- start start 2024-09-17T05:34:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa45da00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4580cdb30 0x7fa458157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa45da00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4580ced80 0x7fa4580b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa45da00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45815bea0 0x7fa45815af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa45da00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa458169340 con 0x7fa4580cdb30 2024-09-17T05:34:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa45da00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa4581691c0 con 0x7fa45815bea0 2024-09-17T05:34:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa45da00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa4581694c0 con 0x7fa4580ced80 2024-09-17T05:34:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa456a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4580cdb30 0x7fa458157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa456a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4580cdb30 0x7fa458157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39792/0 (socket says 172.21.15.31:39792) 2024-09-17T05:34:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa456a00640 1 -- 172.21.15.31:0/2892975662 learned_addr learned my addr 172.21.15.31:0/2892975662 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa457400640 1 --2- 172.21.15.31:0/2892975662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45815bea0 0x7fa45815af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:56.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa44fe00640 1 --2- 172.21.15.31:0/2892975662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4580ced80 0x7fa4580b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:56.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa456a00640 1 -- 172.21.15.31:0/2892975662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4580ced80 msgr2=0x7fa4580b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:56.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa456a00640 1 --2- 172.21.15.31:0/2892975662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4580ced80 0x7fa4580b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa456a00640 1 -- 172.21.15.31:0/2892975662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45815bea0 msgr2=0x7fa45815af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:56.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa456a00640 1 --2- 172.21.15.31:0/2892975662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45815bea0 0x7fa45815af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa456a00640 1 -- 172.21.15.31:0/2892975662 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4580b66b0 con 0x7fa4580cdb30 2024-09-17T05:34:56.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa44fe00640 1 --2- 172.21.15.31:0/2892975662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4580ced80 0x7fa4580b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:56.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa457400640 1 --2- 172.21.15.31:0/2892975662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45815bea0 0x7fa45815af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:56.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa456a00640 1 --2- 172.21.15.31:0/2892975662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4580cdb30 0x7fa458157860 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fa44800c400 tx=0x7fa44800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:56.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa44ea00640 1 -- 172.21.15.31:0/2892975662 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448011790 con 0x7fa4580cdb30 2024-09-17T05:34:56.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa44ea00640 1 -- 172.21.15.31:0/2892975662 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa448017070 con 0x7fa4580cdb30 2024-09-17T05:34:56.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa44ea00640 1 -- 172.21.15.31:0/2892975662 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448011cc0 con 0x7fa4580cdb30 2024-09-17T05:34:56.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa45da00640 1 -- 172.21.15.31:0/2892975662 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4581f8e20 con 0x7fa4580cdb30 2024-09-17T05:34:56.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.357+0000 7fa45da00640 1 -- 172.21.15.31:0/2892975662 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4581f93e0 con 0x7fa4580cdb30 2024-09-17T05:34:56.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.361+0000 7fa45da00640 1 -- 172.21.15.31:0/2892975662 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4580ce670 con 0x7fa4580cdb30 2024-09-17T05:34:56.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.361+0000 7fa44ea00640 1 -- 172.21.15.31:0/2892975662 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fa44801c460 con 0x7fa4580cdb30 2024-09-17T05:34:56.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.361+0000 7fa44ea00640 1 --2- 172.21.15.31:0/2892975662 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa434073860 0x7fa434075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:56.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.361+0000 7fa44ea00640 1 -- 172.21.15.31:0/2892975662 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5851+0+0 (secure 0 0 0) 0x7fa448094cb0 con 0x7fa4580cdb30 2024-09-17T05:34:56.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.361+0000 7fa44fe00640 1 --2- 172.21.15.31:0/2892975662 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa434073860 0x7fa434075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:56.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.361+0000 7fa44fe00640 1 --2- 172.21.15.31:0/2892975662 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa434073860 0x7fa434075d20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa4400058d0 tx=0x7fa440005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:56.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.365+0000 7fa44ea00640 1 -- 172.21.15.31:0/2892975662 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa44805f240 con 0x7fa4580cdb30 2024-09-17T05:34:56.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.541+0000 7fa45da00640 1 -- 172.21.15.31:0/2892975662 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4580b3f00 con 0x7fa4580cdb30 2024-09-17T05:34:56.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.541+0000 7fa44ea00640 1 -- 172.21.15.31:0/2892975662 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16959 (secure 0 0 0) 0x7fa44805eb40 con 0x7fa4580cdb30 2024-09-17T05:34:56.544 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:56.545 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":118,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:34:52.826843+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:34:31.156126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T05:34:32.412462+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":118,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.7","mappings":[{"from":2,"to":0}]},{"pgid":"19.e","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:34:56.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.545+0000 7fa45da00640 1 -- 172.21.15.31:0/2892975662 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa434073860 msgr2=0x7fa434075d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:56.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.545+0000 7fa45da00640 1 --2- 172.21.15.31:0/2892975662 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa434073860 0x7fa434075d20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa4400058d0 tx=0x7fa440005860 comp rx=0 tx=0).stop 2024-09-17T05:34:56.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.545+0000 7fa45da00640 1 -- 172.21.15.31:0/2892975662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4580cdb30 msgr2=0x7fa458157860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:56.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.545+0000 7fa45da00640 1 --2- 172.21.15.31:0/2892975662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4580cdb30 0x7fa458157860 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fa44800c400 tx=0x7fa44800c8c0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.545+0000 7fa45da00640 1 -- 172.21.15.31:0/2892975662 shutdown_connections 2024-09-17T05:34:56.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.545+0000 7fa45da00640 1 --2- 172.21.15.31:0/2892975662 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa434073860 0x7fa434075d20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.545+0000 7fa45da00640 1 --2- 172.21.15.31:0/2892975662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa45815bea0 0x7fa45815af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.545+0000 7fa45da00640 1 --2- 172.21.15.31:0/2892975662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4580ced80 0x7fa4580b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.545+0000 7fa45da00640 1 --2- 172.21.15.31:0/2892975662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4580cdb30 0x7fa458157860 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.545+0000 7fa45da00640 1 -- 172.21.15.31:0/2892975662 >> 172.21.15.31:0/2892975662 conn(0x7fa4580d1dc0 msgr2=0x7fa4580d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:56.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.545+0000 7fa45da00640 1 -- 172.21.15.31:0/2892975662 shutdown_connections 2024-09-17T05:34:56.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.545+0000 7fa45da00640 1 -- 172.21.15.31:0/2892975662 wait complete. 2024-09-17T05:34:56.566 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:34:56.566 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:34:56.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd411a00640 1 -- 172.21.15.31:0/3601621469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f00051d0 msgr2=0x7fd3f000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:56.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd411a00640 1 --2- 172.21.15.31:0/3601621469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f00051d0 0x7fd3f000b9d0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0caa20 tx=0x7fd40401cad0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd411a00640 1 -- 172.21.15.31:0/3601621469 shutdown_connections 2024-09-17T05:34:56.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd411a00640 1 --2- 172.21.15.31:0/3601621469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd3f00051d0 0x7fd3f000b9d0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd411a00640 1 -- 172.21.15.31:0/3601621469 >> 172.21.15.31:0/3601621469 conn(0x7fd40c0b1f10 msgr2=0x7fd40c0b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:56.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd411a00640 1 -- 172.21.15.31:0/3601621469 shutdown_connections 2024-09-17T05:34:56.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd411a00640 1 -- 172.21.15.31:0/3601621469 wait complete. 2024-09-17T05:34:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd411a00640 1 Processor -- start 2024-09-17T05:34:56.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd411a00640 1 -- start start 2024-09-17T05:34:56.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd411a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3f00051d0 0x7fd40c0b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:56.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd411a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd40c15c3a0 0x7fd40c14f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:56.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd411a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd40c1f83e0 0x7fd40c1f8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:56.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd411a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c068fd0 con 0x7fd40c15c3a0 2024-09-17T05:34:56.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd411a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c068e50 con 0x7fd40c1f83e0 2024-09-17T05:34:56.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd411a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd40c0b0760 con 0x7fd3f00051d0 2024-09-17T05:34:56.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd40a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd40c15c3a0 0x7fd40c14f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:56.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd40a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd40c15c3a0 0x7fd40c14f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39814/0 (socket says 172.21.15.31:39814) 2024-09-17T05:34:56.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd40a000640 1 -- 172.21.15.31:0/4240554239 learned_addr learned my addr 172.21.15.31:0/4240554239 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:56.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd40aa00640 1 --2- 172.21.15.31:0/4240554239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3f00051d0 0x7fd40c0b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:56.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd40b400640 1 --2- 172.21.15.31:0/4240554239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd40c1f83e0 0x7fd40c1f8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:56.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd40a000640 1 -- 172.21.15.31:0/4240554239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3f00051d0 msgr2=0x7fd40c0b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:56.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd40a000640 1 --2- 172.21.15.31:0/4240554239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3f00051d0 0x7fd40c0b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd40a000640 1 -- 172.21.15.31:0/4240554239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd40c1f83e0 msgr2=0x7fd40c1f8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:56.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd40a000640 1 --2- 172.21.15.31:0/4240554239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd40c1f83e0 0x7fd40c1f8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd40a000640 1 -- 172.21.15.31:0/4240554239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40c0b5b40 con 0x7fd40c15c3a0 2024-09-17T05:34:56.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.713+0000 7fd40b400640 1 --2- 172.21.15.31:0/4240554239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd40c1f83e0 0x7fd40c1f8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:56.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.717+0000 7fd40a000640 1 --2- 172.21.15.31:0/4240554239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd40c15c3a0 0x7fd40c14f060 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800e600 tx=0x7fd3f800eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.717+0000 7fd402a00640 1 -- 172.21.15.31:0/4240554239 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8015020 con 0x7fd40c15c3a0 2024-09-17T05:34:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.717+0000 7fd402a00640 1 -- 172.21.15.31:0/4240554239 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3f800ca30 con 0x7fd40c15c3a0 2024-09-17T05:34:56.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.717+0000 7fd402a00640 1 -- 172.21.15.31:0/4240554239 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f800ce80 con 0x7fd40c15c3a0 2024-09-17T05:34:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.717+0000 7fd411a00640 1 -- 172.21.15.31:0/4240554239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd40c0b5e20 con 0x7fd40c15c3a0 2024-09-17T05:34:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.717+0000 7fd411a00640 1 -- 172.21.15.31:0/4240554239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd40c0b5850 con 0x7fd40c15c3a0 2024-09-17T05:34:56.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.717+0000 7fd411a00640 1 -- 172.21.15.31:0/4240554239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd40c1f7cb0 con 0x7fd40c15c3a0 2024-09-17T05:34:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.717+0000 7fd402a00640 1 -- 172.21.15.31:0/4240554239 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fd3f8018020 con 0x7fd40c15c3a0 2024-09-17T05:34:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.717+0000 7fd402a00640 1 --2- 172.21.15.31:0/4240554239 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd3ec073830 0x7fd3ec075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.717+0000 7fd402a00640 1 -- 172.21.15.31:0/4240554239 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5851+0+0 (secure 0 0 0) 0x7fd3f80953a0 con 0x7fd40c15c3a0 2024-09-17T05:34:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.717+0000 7fd40aa00640 1 --2- 172.21.15.31:0/4240554239 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd3ec073830 0x7fd3ec075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:56.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.721+0000 7fd40aa00640 1 --2- 172.21.15.31:0/4240554239 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd3ec073830 0x7fd3ec075cf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009ae0 tx=0x7fd3fc0091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:56.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.721+0000 7fd402a00640 1 -- 172.21.15.31:0/4240554239 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd3f801f020 con 0x7fd40c15c3a0 2024-09-17T05:34:56.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.937+0000 7fd411a00640 1 -- 172.21.15.31:0/4240554239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd40c0cdff0 con 0x7fd40c15c3a0 2024-09-17T05:34:56.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.937+0000 7fd402a00640 1 -- 172.21.15.31:0/4240554239 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5222 (secure 0 0 0) 0x7fd3f805f9c0 con 0x7fd40c15c3a0 2024-09-17T05:34:56.939 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:56.939 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":82,"btime":"2024-09-17T05:34:47:801172+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6398,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/296432902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":296432902},{"type":"v1","addr":"172.21.15.31:6834","nonce":296432902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/951265381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":951265381},{"type":"v1","addr":"172.21.15.155:6809","nonce":951265381}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/119812259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":119812259},{"type":"v1","addr":"172.21.15.155:6835","nonce":119812259}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:34:33.468561+0000","modified":"2024-09-17T05:34:36.465649+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7416},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7416":{"gid":7416,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/1466764013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1466764013},{"type":"v1","addr":"172.21.15.31:6835","nonce":1466764013}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7416,"qdb_cluster":[7416]},"id":9}]} 2024-09-17T05:34:56.939 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 82 2024-09-17T05:34:56.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.937+0000 7fd411a00640 1 -- 172.21.15.31:0/4240554239 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd3ec073830 msgr2=0x7fd3ec075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:56.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.937+0000 7fd411a00640 1 --2- 172.21.15.31:0/4240554239 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd3ec073830 0x7fd3ec075cf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009ae0 tx=0x7fd3fc0091e0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.937+0000 7fd411a00640 1 -- 172.21.15.31:0/4240554239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd40c15c3a0 msgr2=0x7fd40c14f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:56.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.937+0000 7fd411a00640 1 --2- 172.21.15.31:0/4240554239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd40c15c3a0 0x7fd40c14f060 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800e600 tx=0x7fd3f800eac0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.937+0000 7fd411a00640 1 -- 172.21.15.31:0/4240554239 shutdown_connections 2024-09-17T05:34:56.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.937+0000 7fd411a00640 1 --2- 172.21.15.31:0/4240554239 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd3ec073830 0x7fd3ec075cf0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.937+0000 7fd411a00640 1 --2- 172.21.15.31:0/4240554239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd40c1f83e0 0x7fd40c1f8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.937+0000 7fd411a00640 1 --2- 172.21.15.31:0/4240554239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd40c15c3a0 0x7fd40c14f060 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.937+0000 7fd411a00640 1 --2- 172.21.15.31:0/4240554239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3f00051d0 0x7fd40c0b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:56.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.937+0000 7fd411a00640 1 -- 172.21.15.31:0/4240554239 >> 172.21.15.31:0/4240554239 conn(0x7fd40c0b1f10 msgr2=0x7fd40c06f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:56.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.937+0000 7fd411a00640 1 -- 172.21.15.31:0/4240554239 shutdown_connections 2024-09-17T05:34:56.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:56.937+0000 7fd411a00640 1 -- 172.21.15.31:0/4240554239 wait complete. 2024-09-17T05:34:56.960 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:34:57.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4ffe00640 1 -- 172.21.15.31:0/3346611557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4e0004810 msgr2=0x7fd4e0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:57.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4ffe00640 1 --2- 172.21.15.31:0/3346611557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4e0004810 0x7fd4e0004c90 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4009b60 tx=0x7fd4e401d270 comp rx=0 tx=0).stop 2024-09-17T05:34:57.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4ffe00640 1 -- 172.21.15.31:0/3346611557 shutdown_connections 2024-09-17T05:34:57.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4ffe00640 1 --2- 172.21.15.31:0/3346611557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4e0004810 0x7fd4e0004c90 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4ffe00640 1 -- 172.21.15.31:0/3346611557 >> 172.21.15.31:0/3346611557 conn(0x7fd4f80d1dc0 msgr2=0x7fd4f80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:57.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4ffe00640 1 -- 172.21.15.31:0/3346611557 shutdown_connections 2024-09-17T05:34:57.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4ffe00640 1 -- 172.21.15.31:0/3346611557 wait complete. 2024-09-17T05:34:57.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4ffe00640 1 Processor -- start 2024-09-17T05:34:57.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4ffe00640 1 -- start start 2024-09-17T05:34:57.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4ffe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e0004810 0x7fd4f815d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:57.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4ffe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4f80ca8f0 0x7fd4f809f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:57.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4ffe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4f815eef0 0x7fd4f815f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:57.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4ffe00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f80ce670 con 0x7fd4f80ca8f0 2024-09-17T05:34:57.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4ffe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f80d2af0 con 0x7fd4e0004810 2024-09-17T05:34:57.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4ffe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f80ce7f0 con 0x7fd4f815eef0 2024-09-17T05:34:57.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4fca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4f80ca8f0 0x7fd4f809f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:57.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4fca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4f80ca8f0 0x7fd4f809f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39836/0 (socket says 172.21.15.31:39836) 2024-09-17T05:34:57.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4fca00640 1 -- 172.21.15.31:0/1119529266 learned_addr learned my addr 172.21.15.31:0/1119529266 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:57.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4fd400640 1 --2- 172.21.15.31:0/1119529266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e0004810 0x7fd4f815d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:57.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4fde00640 1 --2- 172.21.15.31:0/1119529266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4f815eef0 0x7fd4f815f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:57.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4fca00640 1 -- 172.21.15.31:0/1119529266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4f815eef0 msgr2=0x7fd4f815f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:57.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4fca00640 1 --2- 172.21.15.31:0/1119529266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4f815eef0 0x7fd4f815f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4fca00640 1 -- 172.21.15.31:0/1119529266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e0004810 msgr2=0x7fd4f815d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:57.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4fca00640 1 --2- 172.21.15.31:0/1119529266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e0004810 0x7fd4f815d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4fca00640 1 -- 172.21.15.31:0/1119529266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f806dd30 con 0x7fd4f80ca8f0 2024-09-17T05:34:57.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4fd400640 1 --2- 172.21.15.31:0/1119529266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e0004810 0x7fd4f815d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:57.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.109+0000 7fd4fca00640 1 --2- 172.21.15.31:0/1119529266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4f80ca8f0 0x7fd4f809f2a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40af040 tx=0x7fd4e40055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:57.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.113+0000 7fd4f5600640 1 -- 172.21.15.31:0/1119529266 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e40b1040 con 0x7fd4f80ca8f0 2024-09-17T05:34:57.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.113+0000 7fd4f5600640 1 -- 172.21.15.31:0/1119529266 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4e40bb070 con 0x7fd4f80ca8f0 2024-09-17T05:34:57.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.113+0000 7fd4f5600640 1 -- 172.21.15.31:0/1119529266 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4004290 con 0x7fd4f80ca8f0 2024-09-17T05:34:57.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.113+0000 7fd4ffe00640 1 -- 172.21.15.31:0/1119529266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f80cb140 con 0x7fd4f80ca8f0 2024-09-17T05:34:57.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.113+0000 7fd4ffe00640 1 -- 172.21.15.31:0/1119529266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f80cb700 con 0x7fd4f80ca8f0 2024-09-17T05:34:57.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.113+0000 7fd4ffe00640 1 -- 172.21.15.31:0/1119529266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f80cc9d0 con 0x7fd4f80ca8f0 2024-09-17T05:34:57.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.113+0000 7fd4f5600640 1 -- 172.21.15.31:0/1119529266 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fd4e40046d0 con 0x7fd4f80ca8f0 2024-09-17T05:34:57.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.113+0000 7fd4f5600640 1 --2- 172.21.15.31:0/1119529266 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd4d8073860 0x7fd4d8075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:57.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.113+0000 7fd4f5600640 1 -- 172.21.15.31:0/1119529266 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5851+0+0 (secure 0 0 0) 0x7fd4e412fd00 con 0x7fd4f80ca8f0 2024-09-17T05:34:57.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.113+0000 7fd4fd400640 1 --2- 172.21.15.31:0/1119529266 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd4d8073860 0x7fd4d8075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:57.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.117+0000 7fd4fd400640 1 --2- 172.21.15.31:0/1119529266 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd4d8073860 0x7fd4d8075d20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8052940 tx=0x7fd4ec006b70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:57.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.117+0000 7fd4f5600640 1 -- 172.21.15.31:0/1119529266 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd4e4016f80 con 0x7fd4f80ca8f0 2024-09-17T05:34:57.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.329+0000 7fd4ffe00640 1 -- 172.21.15.31:0/1119529266 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4f80aff10 con 0x7fd4f80ca8f0 2024-09-17T05:34:57.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.329+0000 7fd4f5600640 1 -- 172.21.15.31:0/1119529266 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5222 (secure 0 0 0) 0x7fd4e40fa400 con 0x7fd4f80ca8f0 2024-09-17T05:34:57.332 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:57.333 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":82,"btime":"2024-09-17T05:34:47:801172+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6398,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/296432902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":296432902},{"type":"v1","addr":"172.21.15.31:6834","nonce":296432902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/951265381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":951265381},{"type":"v1","addr":"172.21.15.155:6809","nonce":951265381}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/119812259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":119812259},{"type":"v1","addr":"172.21.15.155:6835","nonce":119812259}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:34:33.468561+0000","modified":"2024-09-17T05:34:36.465649+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7416},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7416":{"gid":7416,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":4,"addr":"172.21.15.31:6835/1466764013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1466764013},{"type":"v1","addr":"172.21.15.31:6835","nonce":1466764013}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7416,"qdb_cluster":[7416]},"id":9}]} 2024-09-17T05:34:57.333 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 82 2024-09-17T05:34:57.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.333+0000 7fd4ffe00640 1 -- 172.21.15.31:0/1119529266 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd4d8073860 msgr2=0x7fd4d8075d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:57.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.333+0000 7fd4ffe00640 1 --2- 172.21.15.31:0/1119529266 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd4d8073860 0x7fd4d8075d20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8052940 tx=0x7fd4ec006b70 comp rx=0 tx=0).stop 2024-09-17T05:34:57.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.333+0000 7fd4ffe00640 1 -- 172.21.15.31:0/1119529266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4f80ca8f0 msgr2=0x7fd4f809f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:57.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.333+0000 7fd4ffe00640 1 --2- 172.21.15.31:0/1119529266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4f80ca8f0 0x7fd4f809f2a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40af040 tx=0x7fd4e40055d0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.333+0000 7fd4ffe00640 1 -- 172.21.15.31:0/1119529266 shutdown_connections 2024-09-17T05:34:57.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.333+0000 7fd4ffe00640 1 --2- 172.21.15.31:0/1119529266 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd4d8073860 0x7fd4d8075d20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.333+0000 7fd4ffe00640 1 --2- 172.21.15.31:0/1119529266 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4f815eef0 0x7fd4f815f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.333+0000 7fd4ffe00640 1 --2- 172.21.15.31:0/1119529266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4f80ca8f0 0x7fd4f809f2a0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.333+0000 7fd4ffe00640 1 --2- 172.21.15.31:0/1119529266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e0004810 0x7fd4f815d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.333+0000 7fd4ffe00640 1 -- 172.21.15.31:0/1119529266 >> 172.21.15.31:0/1119529266 conn(0x7fd4f80d1dc0 msgr2=0x7fd4f80b5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:57.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.333+0000 7fd4ffe00640 1 -- 172.21.15.31:0/1119529266 shutdown_connections 2024-09-17T05:34:57.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.333+0000 7fd4ffe00640 1 -- 172.21.15.31:0/1119529266 wait complete. 2024-09-17T05:34:57.355 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:34:57.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc25200640 1 -- 172.21.15.31:0/1185802646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc2015bea0 msgr2=0x7efc200ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:57.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc25200640 1 --2- 172.21.15.31:0/1185802646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc2015bea0 0x7efc200ce670 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7efc20073d10 tx=0x7efc1001c8c0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc25200640 1 -- 172.21.15.31:0/1185802646 shutdown_connections 2024-09-17T05:34:57.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc25200640 1 --2- 172.21.15.31:0/1185802646 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc200d28e0 0x7efc200cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc25200640 1 --2- 172.21.15.31:0/1185802646 >> v2:172.21.15.155:3300/0 conn(0x7efc200cdb30 0x7efc200cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc25200640 1 --2- 172.21.15.31:0/1185802646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc2015bea0 0x7efc200ce670 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc25200640 1 -- 172.21.15.31:0/1185802646 >> 172.21.15.31:0/1185802646 conn(0x7efc200d1dc0 msgr2=0x7efc200d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:57.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc25200640 1 -- 172.21.15.31:0/1185802646 shutdown_connections 2024-09-17T05:34:57.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc25200640 1 -- 172.21.15.31:0/1185802646 wait complete. 2024-09-17T05:34:57.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc25200640 1 Processor -- start 2024-09-17T05:34:57.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc25200640 1 -- start start 2024-09-17T05:34:57.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc25200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc200cdb30 0x7efc200b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:57.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc25200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc200d28e0 0x7efc20071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:57.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc25200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc2015bea0 0x7efc200722a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:57.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc25200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efc200af010 con 0x7efc2015bea0 2024-09-17T05:34:57.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc25200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efc200aee90 con 0x7efc200cdb30 2024-09-17T05:34:57.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc25200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efc200af190 con 0x7efc200d28e0 2024-09-17T05:34:57.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc1e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc2015bea0 0x7efc200722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:57.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc1e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc2015bea0 0x7efc200722a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39860/0 (socket says 172.21.15.31:39860) 2024-09-17T05:34:57.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc1e800640 1 -- 172.21.15.31:0/2213100695 learned_addr learned my addr 172.21.15.31:0/2213100695 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:57.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc1de00640 1 --2- 172.21.15.31:0/2213100695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc200cdb30 0x7efc200b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:57.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.501+0000 7efc17e00640 1 --2- 172.21.15.31:0/2213100695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc200d28e0 0x7efc20071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:57.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.505+0000 7efc1e800640 1 -- 172.21.15.31:0/2213100695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc200d28e0 msgr2=0x7efc20071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:57.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.505+0000 7efc1e800640 1 --2- 172.21.15.31:0/2213100695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc200d28e0 0x7efc20071d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.505+0000 7efc1e800640 1 -- 172.21.15.31:0/2213100695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc200cdb30 msgr2=0x7efc200b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:57.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.505+0000 7efc1e800640 1 --2- 172.21.15.31:0/2213100695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc200cdb30 0x7efc200b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.505+0000 7efc1e800640 1 -- 172.21.15.31:0/2213100695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc200b3b60 con 0x7efc2015bea0 2024-09-17T05:34:57.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.505+0000 7efc1e800640 1 --2- 172.21.15.31:0/2213100695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc2015bea0 0x7efc200722a0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7efc1800ea20 tx=0x7efc1800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:57.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.505+0000 7efc16000640 1 -- 172.21.15.31:0/2213100695 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1800cde0 con 0x7efc2015bea0 2024-09-17T05:34:57.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.505+0000 7efc16000640 1 -- 172.21.15.31:0/2213100695 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc18004c40 con 0x7efc2015bea0 2024-09-17T05:34:57.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.505+0000 7efc16000640 1 -- 172.21.15.31:0/2213100695 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18005280 con 0x7efc2015bea0 2024-09-17T05:34:57.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.505+0000 7efc25200640 1 -- 172.21.15.31:0/2213100695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc201fc0a0 con 0x7efc2015bea0 2024-09-17T05:34:57.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.505+0000 7efc25200640 1 -- 172.21.15.31:0/2213100695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc2014e610 con 0x7efc2015bea0 2024-09-17T05:34:57.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.505+0000 7efc25200640 1 -- 172.21.15.31:0/2213100695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc200c53b0 con 0x7efc2015bea0 2024-09-17T05:34:57.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.505+0000 7efc16000640 1 -- 172.21.15.31:0/2213100695 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7efc18005420 con 0x7efc2015bea0 2024-09-17T05:34:57.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.505+0000 7efc16000640 1 --2- 172.21.15.31:0/2213100695 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efbfc073830 0x7efbfc075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:57.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.509+0000 7efc16000640 1 -- 172.21.15.31:0/2213100695 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5851+0+0 (secure 0 0 0) 0x7efc180956e0 con 0x7efc2015bea0 2024-09-17T05:34:57.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.509+0000 7efc1de00640 1 --2- 172.21.15.31:0/2213100695 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efbfc073830 0x7efbfc075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:57.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.509+0000 7efc1de00640 1 --2- 172.21.15.31:0/2213100695 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efbfc073830 0x7efbfc075cf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efc100af000 tx=0x7efc1001b100 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:57.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.513+0000 7efc16000640 1 -- 172.21.15.31:0/2213100695 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7efc200c53b0 con 0x7efc2015bea0 2024-09-17T05:34:57.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.689+0000 7efc25200640 1 -- 172.21.15.31:0/2213100695 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc200cc9d0 con 0x7efc2015bea0 2024-09-17T05:34:57.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.689+0000 7efc16000640 1 -- 172.21.15.31:0/2213100695 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16959 (secure 0 0 0) 0x7efc18016030 con 0x7efc2015bea0 2024-09-17T05:34:57.693 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:34:57.693 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":118,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:34:52.826843+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:34:31.156126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T05:34:32.412462+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":118,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.7","mappings":[{"from":2,"to":0}]},{"pgid":"19.e","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:34:57.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.693+0000 7efc25200640 1 -- 172.21.15.31:0/2213100695 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efbfc073830 msgr2=0x7efbfc075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:57.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.693+0000 7efc25200640 1 --2- 172.21.15.31:0/2213100695 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efbfc073830 0x7efbfc075cf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efc100af000 tx=0x7efc1001b100 comp rx=0 tx=0).stop 2024-09-17T05:34:57.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.693+0000 7efc25200640 1 -- 172.21.15.31:0/2213100695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc2015bea0 msgr2=0x7efc200722a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:57.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.693+0000 7efc25200640 1 --2- 172.21.15.31:0/2213100695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc2015bea0 0x7efc200722a0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7efc1800ea20 tx=0x7efc1800eee0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.693+0000 7efc25200640 1 -- 172.21.15.31:0/2213100695 shutdown_connections 2024-09-17T05:34:57.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.693+0000 7efc25200640 1 --2- 172.21.15.31:0/2213100695 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efbfc073830 0x7efbfc075cf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.693+0000 7efc25200640 1 --2- 172.21.15.31:0/2213100695 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc2015bea0 0x7efc200722a0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.693+0000 7efc25200640 1 --2- 172.21.15.31:0/2213100695 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc200d28e0 0x7efc20071d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.693+0000 7efc25200640 1 --2- 172.21.15.31:0/2213100695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc200cdb30 0x7efc200b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.693+0000 7efc25200640 1 -- 172.21.15.31:0/2213100695 >> 172.21.15.31:0/2213100695 conn(0x7efc200d1dc0 msgr2=0x7efc200d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:57.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.693+0000 7efc25200640 1 -- 172.21.15.31:0/2213100695 shutdown_connections 2024-09-17T05:34:57.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.693+0000 7efc25200640 1 -- 172.21.15.31:0/2213100695 wait complete. 2024-09-17T05:34:57.715 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:34:57.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.861+0000 7f4157600640 1 -- 172.21.15.31:0/1235611946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41500ced80 msgr2=0x7f41500ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:57.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.861+0000 7f4157600640 1 --2- 172.21.15.31:0/1235611946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41500ced80 0x7f41500ae9b0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f413c009840 tx=0x7f413c01c820 comp rx=0 tx=0).stop 2024-09-17T05:34:57.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.861+0000 7f4157600640 1 -- 172.21.15.31:0/1235611946 shutdown_connections 2024-09-17T05:34:57.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.861+0000 7f4157600640 1 --2- 172.21.15.31:0/1235611946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41500cdb30 0x7f41500aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.861+0000 7f4157600640 1 --2- 172.21.15.31:0/1235611946 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41500ced80 0x7f41500ae9b0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.861+0000 7f4157600640 1 -- 172.21.15.31:0/1235611946 >> 172.21.15.31:0/1235611946 conn(0x7f41500d1dc0 msgr2=0x7f41500d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:57.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.861+0000 7f4157600640 1 -- 172.21.15.31:0/1235611946 shutdown_connections 2024-09-17T05:34:57.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.861+0000 7f4157600640 1 -- 172.21.15.31:0/1235611946 wait complete. 2024-09-17T05:34:57.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f4157600640 1 Processor -- start 2024-09-17T05:34:57.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f4157600640 1 -- start start 2024-09-17T05:34:57.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f4157600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41500cdb30 0x7f415014dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:57.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f4157600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41500ced80 0x7f41500b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:57.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f4157600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f415015bea0 0x7f415014d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:57.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f4157600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4150169340 con 0x7f41500ced80 2024-09-17T05:34:57.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f4157600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f41501691c0 con 0x7f41500cdb30 2024-09-17T05:34:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f4157600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f41501694c0 con 0x7f415015bea0 2024-09-17T05:34:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f414fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41500ced80 0x7f41500b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f414fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41500ced80 0x7f41500b6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39888/0 (socket says 172.21.15.31:39888) 2024-09-17T05:34:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f414fe00640 1 -- 172.21.15.31:0/3556709764 learned_addr learned my addr 172.21.15.31:0/3556709764 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f4154c00640 1 --2- 172.21.15.31:0/3556709764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41500cdb30 0x7f415014dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f4155600640 1 --2- 172.21.15.31:0/3556709764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f415015bea0 0x7f415014d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f414fe00640 1 -- 172.21.15.31:0/3556709764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f415015bea0 msgr2=0x7f415014d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f414fe00640 1 --2- 172.21.15.31:0/3556709764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f415015bea0 0x7f415014d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f414fe00640 1 -- 172.21.15.31:0/3556709764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41500cdb30 msgr2=0x7f415014dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f414fe00640 1 --2- 172.21.15.31:0/3556709764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41500cdb30 0x7f415014dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f414fe00640 1 -- 172.21.15.31:0/3556709764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41500b76e0 con 0x7f41500ced80 2024-09-17T05:34:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f4155600640 1 --2- 172.21.15.31:0/3556709764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f415015bea0 0x7f415014d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f4154c00640 1 --2- 172.21.15.31:0/3556709764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41500cdb30 0x7f415014dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:34:57.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f414fe00640 1 --2- 172.21.15.31:0/3556709764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41500ced80 0x7f41500b6fb0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f413c009790 tx=0x7f413c0a5640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:57.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f414cc00640 1 -- 172.21.15.31:0/3556709764 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c0b2040 con 0x7f41500ced80 2024-09-17T05:34:57.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f414cc00640 1 -- 172.21.15.31:0/3556709764 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f413c004430 con 0x7f41500ced80 2024-09-17T05:34:57.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f4157600640 1 -- 172.21.15.31:0/3556709764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41500b79c0 con 0x7f41500ced80 2024-09-17T05:34:57.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f414cc00640 1 -- 172.21.15.31:0/3556709764 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c005280 con 0x7f41500ced80 2024-09-17T05:34:57.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f4157600640 1 -- 172.21.15.31:0/3556709764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41500b1aa0 con 0x7f41500ced80 2024-09-17T05:34:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.865+0000 7f4157600640 1 -- 172.21.15.31:0/3556709764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41500ce670 con 0x7f41500ced80 2024-09-17T05:34:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.869+0000 7f414cc00640 1 -- 172.21.15.31:0/3556709764 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f413c0be060 con 0x7f41500ced80 2024-09-17T05:34:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.869+0000 7f414cc00640 1 --2- 172.21.15.31:0/3556709764 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4130073830 0x7f4130075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.869+0000 7f414cc00640 1 -- 172.21.15.31:0/3556709764 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5851+0+0 (secure 0 0 0) 0x7f413c12e720 con 0x7f41500ced80 2024-09-17T05:34:57.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.869+0000 7f4154c00640 1 --2- 172.21.15.31:0/3556709764 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4130073830 0x7f4130075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:57.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.869+0000 7f4154c00640 1 --2- 172.21.15.31:0/3556709764 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4130073830 0x7f4130075cf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f41440016b0 tx=0x7f4144009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:57.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:57.873+0000 7f414cc00640 1 -- 172.21.15.31:0/3556709764 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f413c016410 con 0x7f41500ced80 2024-09-17T05:34:58.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.089+0000 7f4157600640 1 -- 172.21.15.31:0/3556709764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f415015b680 con 0x7f41500ced80 2024-09-17T05:34:58.091 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-09-17T05:34:58.089+0000 7f21d0200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:34:58.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.089+0000 7f414cc00640 1 -- 172.21.15.31:0/3556709764 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v83) ==== 161+0+0 (secure 0 0 0) 0x7f413c0f8cb0 con 0x7f41500ced80 2024-09-17T05:34:58.093 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:34:58.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.093+0000 7f4157600640 1 -- 172.21.15.31:0/3556709764 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4130073830 msgr2=0x7f4130075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:58.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.093+0000 7f4157600640 1 --2- 172.21.15.31:0/3556709764 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4130073830 0x7f4130075cf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f41440016b0 tx=0x7f4144009040 comp rx=0 tx=0).stop 2024-09-17T05:34:58.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.093+0000 7f4157600640 1 -- 172.21.15.31:0/3556709764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41500ced80 msgr2=0x7f41500b6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:58.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.093+0000 7f4157600640 1 --2- 172.21.15.31:0/3556709764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41500ced80 0x7f41500b6fb0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f413c009790 tx=0x7f413c0a5640 comp rx=0 tx=0).stop 2024-09-17T05:34:58.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.093+0000 7f4157600640 1 -- 172.21.15.31:0/3556709764 shutdown_connections 2024-09-17T05:34:58.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.093+0000 7f4157600640 1 --2- 172.21.15.31:0/3556709764 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4130073830 0x7f4130075cf0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:58.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.093+0000 7f4157600640 1 --2- 172.21.15.31:0/3556709764 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f415015bea0 0x7f415014d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:58.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.093+0000 7f4157600640 1 --2- 172.21.15.31:0/3556709764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f41500ced80 0x7f41500b6fb0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:58.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.093+0000 7f4157600640 1 --2- 172.21.15.31:0/3556709764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41500cdb30 0x7f415014dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:58.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.093+0000 7f4157600640 1 -- 172.21.15.31:0/3556709764 >> 172.21.15.31:0/3556709764 conn(0x7f41500d1dc0 msgr2=0x7f41500d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:58.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.093+0000 7f4157600640 1 -- 172.21.15.31:0/3556709764 shutdown_connections 2024-09-17T05:34:58.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.093+0000 7f4157600640 1 -- 172.21.15.31:0/3556709764 wait complete. 2024-09-17T05:34:58.117 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:34:58.161 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-17T05:34:58.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.265+0000 7fd6f7000640 1 -- 172.21.15.31:0/1537654333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6f00d04d0 msgr2=0x7fd6f00af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:58.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.265+0000 7fd6f7000640 1 --2- 172.21.15.31:0/1537654333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6f00d04d0 0x7fd6f00af200 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009c80 tx=0x7fd6e801f5a0 comp rx=0 tx=0).stop 2024-09-17T05:34:58.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.265+0000 7fd6f7000640 1 -- 172.21.15.31:0/1537654333 shutdown_connections 2024-09-17T05:34:58.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.265+0000 7fd6f7000640 1 --2- 172.21.15.31:0/1537654333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6f00d04d0 0x7fd6f00af200 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:58.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.265+0000 7fd6f7000640 1 --2- 172.21.15.31:0/1537654333 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f00d00f0 0x7fd6f00b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:58.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.265+0000 7fd6f7000640 1 -- 172.21.15.31:0/1537654333 >> 172.21.15.31:0/1537654333 conn(0x7fd6f00d1e90 msgr2=0x7fd6f00d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:58.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.265+0000 7fd6f7000640 1 -- 172.21.15.31:0/1537654333 shutdown_connections 2024-09-17T05:34:58.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.265+0000 7fd6f7000640 1 -- 172.21.15.31:0/1537654333 wait complete. 2024-09-17T05:34:58.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.265+0000 7fd6f7000640 1 Processor -- start 2024-09-17T05:34:58.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.265+0000 7fd6f7000640 1 -- start start 2024-09-17T05:34:58.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6f7000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f00d00f0 0x7fd6f01f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:58.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6f7000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6f00d04d0 0x7fd6f0156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:58.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6f7000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6f00d29b0 0x7fd6f0157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:58.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6f7000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f00b0ed0 con 0x7fd6f00d04d0 2024-09-17T05:34:58.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6f7000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f00b0d50 con 0x7fd6f00d29b0 2024-09-17T05:34:58.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6f7000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f00af740 con 0x7fd6f00d00f0 2024-09-17T05:34:58.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6e7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6f00d04d0 0x7fd6f0156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:58.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6e7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6f00d04d0 0x7fd6f0156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39920/0 (socket says 172.21.15.31:39920) 2024-09-17T05:34:58.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6e7e00640 1 -- 172.21.15.31:0/2194142530 learned_addr learned my addr 172.21.15.31:0/2194142530 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:58.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6efe00640 1 --2- 172.21.15.31:0/2194142530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f00d00f0 0x7fd6f01f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:58.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6f5000640 1 --2- 172.21.15.31:0/2194142530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6f00d29b0 0x7fd6f0157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:58.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6e7e00640 1 -- 172.21.15.31:0/2194142530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f00d00f0 msgr2=0x7fd6f01f4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:58.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6e7e00640 1 --2- 172.21.15.31:0/2194142530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f00d00f0 0x7fd6f01f4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:58.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6e7e00640 1 -- 172.21.15.31:0/2194142530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6f00d29b0 msgr2=0x7fd6f0157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:58.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6e7e00640 1 --2- 172.21.15.31:0/2194142530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6f00d29b0 0x7fd6f0157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:58.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6e7e00640 1 -- 172.21.15.31:0/2194142530 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f0159820 con 0x7fd6f00d04d0 2024-09-17T05:34:58.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6e7e00640 1 --2- 172.21.15.31:0/2194142530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6f00d04d0 0x7fd6f0156b00 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800c3f0 tx=0x7fd6d800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:58.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6ecc00640 1 -- 172.21.15.31:0/2194142530 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8017070 con 0x7fd6f00d04d0 2024-09-17T05:34:58.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6ecc00640 1 -- 172.21.15.31:0/2194142530 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6d80053c0 con 0x7fd6f00d04d0 2024-09-17T05:34:58.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6ecc00640 1 -- 172.21.15.31:0/2194142530 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8003860 con 0x7fd6f00d04d0 2024-09-17T05:34:58.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6f7000640 1 -- 172.21.15.31:0/2194142530 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f00c6a10 con 0x7fd6f00d04d0 2024-09-17T05:34:58.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6f7000640 1 -- 172.21.15.31:0/2194142530 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f00c6fd0 con 0x7fd6f00d04d0 2024-09-17T05:34:58.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.269+0000 7fd6f7000640 1 -- 172.21.15.31:0/2194142530 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f00af200 con 0x7fd6f00d04d0 2024-09-17T05:34:58.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.273+0000 7fd6ecc00640 1 -- 172.21.15.31:0/2194142530 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fd6d801a070 con 0x7fd6f00d04d0 2024-09-17T05:34:58.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.273+0000 7fd6ecc00640 1 --2- 172.21.15.31:0/2194142530 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd6cc073830 0x7fd6cc075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:58.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.273+0000 7fd6ecc00640 1 -- 172.21.15.31:0/2194142530 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5909+0+0 (secure 0 0 0) 0x7fd6d80941d0 con 0x7fd6f00d04d0 2024-09-17T05:34:58.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.273+0000 7fd6efe00640 1 --2- 172.21.15.31:0/2194142530 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd6cc073830 0x7fd6cc075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:58.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.273+0000 7fd6efe00640 1 --2- 172.21.15.31:0/2194142530 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd6cc073830 0x7fd6cc075cf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009be0 tx=0x7fd6e00091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:58.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.277+0000 7fd6ecc00640 1 -- 172.21.15.31:0/2194142530 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd6d805e160 con 0x7fd6f00d04d0 2024-09-17T05:34:58.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:58.489+0000 7fd6f7000640 1 -- 172.21.15.31:0/2194142530 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd6f00b1fc0 con 0x7fd6f00d04d0 2024-09-17T05:34:59.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.097+0000 7fd6ecc00640 1 -- 172.21.15.31:0/2194142530 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v84) ==== 104+0+0 (secure 0 0 0) 0x7fd6d8062b90 con 0x7fd6f00d04d0 2024-09-17T05:34:59.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.101+0000 7fd6f7000640 1 -- 172.21.15.31:0/2194142530 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd6cc073830 msgr2=0x7fd6cc075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:59.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.101+0000 7fd6f7000640 1 --2- 172.21.15.31:0/2194142530 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd6cc073830 0x7fd6cc075cf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009be0 tx=0x7fd6e00091e0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.101+0000 7fd6f7000640 1 -- 172.21.15.31:0/2194142530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6f00d04d0 msgr2=0x7fd6f0156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:59.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.101+0000 7fd6f7000640 1 --2- 172.21.15.31:0/2194142530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6f00d04d0 0x7fd6f0156b00 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800c3f0 tx=0x7fd6d800c8b0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.101+0000 7fd6f7000640 1 -- 172.21.15.31:0/2194142530 shutdown_connections 2024-09-17T05:34:59.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.101+0000 7fd6f7000640 1 --2- 172.21.15.31:0/2194142530 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd6cc073830 0x7fd6cc075cf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.101+0000 7fd6f7000640 1 --2- 172.21.15.31:0/2194142530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6f00d29b0 0x7fd6f0157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.101+0000 7fd6f7000640 1 --2- 172.21.15.31:0/2194142530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6f00d04d0 0x7fd6f0156b00 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.101+0000 7fd6f7000640 1 --2- 172.21.15.31:0/2194142530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6f00d00f0 0x7fd6f01f4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.101+0000 7fd6f7000640 1 -- 172.21.15.31:0/2194142530 >> 172.21.15.31:0/2194142530 conn(0x7fd6f00d1e90 msgr2=0x7fd6f0072270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:59.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.101+0000 7fd6f7000640 1 -- 172.21.15.31:0/2194142530 shutdown_connections 2024-09-17T05:34:59.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.101+0000 7fd6f7000640 1 -- 172.21.15.31:0/2194142530 wait complete. 2024-09-17T05:34:59.127 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:34:59.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbaf0a00640 1 -- 172.21.15.31:0/3356126677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaec0af850 msgr2=0x7fbaec0afce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:59.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbaf0a00640 1 --2- 172.21.15.31:0/3356126677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaec0af850 0x7fbaec0afce0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbae4009bc0 tx=0x7fbae401cb70 comp rx=0 tx=0).stop 2024-09-17T05:34:59.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbaf0a00640 1 -- 172.21.15.31:0/3356126677 shutdown_connections 2024-09-17T05:34:59.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbaf0a00640 1 --2- 172.21.15.31:0/3356126677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaec0af850 0x7fbaec0afce0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbaf0a00640 1 --2- 172.21.15.31:0/3356126677 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaec0d28e0 0x7fbaec0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbaf0a00640 1 -- 172.21.15.31:0/3356126677 >> 172.21.15.31:0/3356126677 conn(0x7fbaec0d1dc0 msgr2=0x7fbaec0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:59.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbaf0a00640 1 -- 172.21.15.31:0/3356126677 shutdown_connections 2024-09-17T05:34:59.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbaf0a00640 1 -- 172.21.15.31:0/3356126677 wait complete. 2024-09-17T05:34:59.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbaf0a00640 1 Processor -- start 2024-09-17T05:34:59.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbaf0a00640 1 -- start start 2024-09-17T05:34:59.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbaf0a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbaec0af850 0x7fbaec06f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:59.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbaf0a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaec0d28e0 0x7fbaec149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:59.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbaf0a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaec15f390 0x7fbaec14f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:59.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbaf0a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbaec168ea0 con 0x7fbaec0af850 2024-09-17T05:34:59.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbaf0a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbaec168d20 con 0x7fbaec15f390 2024-09-17T05:34:59.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbaf0a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbaec169020 con 0x7fbaec0d28e0 2024-09-17T05:34:59.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbae9e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbaec0af850 0x7fbaec06f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:59.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbae9e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbaec0af850 0x7fbaec06f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52346/0 (socket says 172.21.15.31:52346) 2024-09-17T05:34:59.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbae9e00640 1 -- 172.21.15.31:0/1745246993 learned_addr learned my addr 172.21.15.31:0/1745246993 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:59.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbae1400640 1 --2- 172.21.15.31:0/1745246993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaec0d28e0 0x7fbaec149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:59.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbaea800640 1 --2- 172.21.15.31:0/1745246993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaec15f390 0x7fbaec14f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:59.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbae9e00640 1 -- 172.21.15.31:0/1745246993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaec0d28e0 msgr2=0x7fbaec149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:59.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbae9e00640 1 --2- 172.21.15.31:0/1745246993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaec0d28e0 0x7fbaec149b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbae9e00640 1 -- 172.21.15.31:0/1745246993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaec15f390 msgr2=0x7fbaec14f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:59.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbae9e00640 1 --2- 172.21.15.31:0/1745246993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaec15f390 0x7fbaec14f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.329+0000 7fbae9e00640 1 -- 172.21.15.31:0/1745246993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaec06fbd0 con 0x7fbaec0af850 2024-09-17T05:34:59.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.333+0000 7fbae9e00640 1 --2- 172.21.15.31:0/1745246993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbaec0af850 0x7fbaec06f5f0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00c430 tx=0x7fbadc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:59.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.333+0000 7fbae2a00640 1 -- 172.21.15.31:0/1745246993 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc017070 con 0x7fbaec0af850 2024-09-17T05:34:59.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.333+0000 7fbae2a00640 1 -- 172.21.15.31:0/1745246993 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbadc0053e0 con 0x7fbaec0af850 2024-09-17T05:34:59.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.333+0000 7fbae2a00640 1 -- 172.21.15.31:0/1745246993 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc003860 con 0x7fbaec0af850 2024-09-17T05:34:59.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.333+0000 7fbaf0a00640 1 -- 172.21.15.31:0/1745246993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaec06dd30 con 0x7fbaec0af850 2024-09-17T05:34:59.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.333+0000 7fbaf0a00640 1 -- 172.21.15.31:0/1745246993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaec06e2f0 con 0x7fbaec0af850 2024-09-17T05:34:59.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.333+0000 7fbaf0a00640 1 -- 172.21.15.31:0/1745246993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaec0afce0 con 0x7fbaec0af850 2024-09-17T05:34:59.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.333+0000 7fbae2a00640 1 -- 172.21.15.31:0/1745246993 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fbadc01a070 con 0x7fbaec0af850 2024-09-17T05:34:59.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.333+0000 7fbae2a00640 1 --2- 172.21.15.31:0/1745246993 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbac8073860 0x7fbac8075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:59.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.333+0000 7fbae2a00640 1 -- 172.21.15.31:0/1745246993 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5909+0+0 (secure 0 0 0) 0x7fbadc094220 con 0x7fbaec0af850 2024-09-17T05:34:59.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.337+0000 7fbae1400640 1 --2- 172.21.15.31:0/1745246993 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbac8073860 0x7fbac8075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:59.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.337+0000 7fbae1400640 1 --2- 172.21.15.31:0/1745246993 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbac8073860 0x7fbac8075d20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbad40096c0 tx=0x7fbad4009260 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:59.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.337+0000 7fbae2a00640 1 -- 172.21.15.31:0/1745246993 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fbadc05e1e0 con 0x7fbaec0af850 2024-09-17T05:34:59.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.513+0000 7fbaf0a00640 1 -- 172.21.15.31:0/1745246993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbaec15db40 con 0x7fbaec0af850 2024-09-17T05:34:59.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.737+0000 7fbae2a00640 1 -- 172.21.15.31:0/1745246993 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) ==== 181+0+0 (secure 0 0 0) 0x7fbadc062c10 con 0x7fbaec0af850 2024-09-17T05:34:59.738 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:34:59.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.741+0000 7fbaf0a00640 1 -- 172.21.15.31:0/1745246993 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbac8073860 msgr2=0x7fbac8075d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:59.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.741+0000 7fbaf0a00640 1 --2- 172.21.15.31:0/1745246993 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbac8073860 0x7fbac8075d20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbad40096c0 tx=0x7fbad4009260 comp rx=0 tx=0).stop 2024-09-17T05:34:59.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.741+0000 7fbaf0a00640 1 -- 172.21.15.31:0/1745246993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbaec0af850 msgr2=0x7fbaec06f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:59.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.741+0000 7fbaf0a00640 1 --2- 172.21.15.31:0/1745246993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbaec0af850 0x7fbaec06f5f0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00c430 tx=0x7fbadc00c8f0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.741+0000 7fbaf0a00640 1 -- 172.21.15.31:0/1745246993 shutdown_connections 2024-09-17T05:34:59.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.741+0000 7fbaf0a00640 1 --2- 172.21.15.31:0/1745246993 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbac8073860 0x7fbac8075d20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.741+0000 7fbaf0a00640 1 --2- 172.21.15.31:0/1745246993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbaec15f390 0x7fbaec14f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.741+0000 7fbaf0a00640 1 --2- 172.21.15.31:0/1745246993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbaec0d28e0 0x7fbaec149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.741+0000 7fbaf0a00640 1 --2- 172.21.15.31:0/1745246993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbaec0af850 0x7fbaec06f5f0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.741+0000 7fbaf0a00640 1 -- 172.21.15.31:0/1745246993 >> 172.21.15.31:0/1745246993 conn(0x7fbaec0d1dc0 msgr2=0x7fbaec15d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:59.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.741+0000 7fbaf0a00640 1 -- 172.21.15.31:0/1745246993 shutdown_connections 2024-09-17T05:34:59.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.741+0000 7fbaf0a00640 1 -- 172.21.15.31:0/1745246993 wait complete. 2024-09-17T05:34:59.765 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:34:59.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.917+0000 7f6175800640 1 -- 172.21.15.31:0/2375159812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617015abc0 msgr2=0x7f61700d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:59.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.917+0000 7f6175800640 1 --2- 172.21.15.31:0/2375159812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617015abc0 0x7f61700d1180 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f61700b4020 tx=0x7f616801cd60 comp rx=0 tx=0).stop 2024-09-17T05:34:59.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.917+0000 7f6175800640 1 -- 172.21.15.31:0/2375159812 shutdown_connections 2024-09-17T05:34:59.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.917+0000 7f6175800640 1 --2- 172.21.15.31:0/2375159812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617015abc0 0x7f61700d1180 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.917+0000 7f6175800640 1 --2- 172.21.15.31:0/2375159812 >> v2:172.21.15.155:3300/0 conn(0x7f61700aea10 0x7f61700d0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.917+0000 7f6175800640 1 --2- 172.21.15.31:0/2375159812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f617015a7e0 0x7f61700ae4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.917+0000 7f6175800640 1 -- 172.21.15.31:0/2375159812 >> 172.21.15.31:0/2375159812 conn(0x7f617006dd30 msgr2=0x7f617006e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:34:59.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.917+0000 7f6175800640 1 -- 172.21.15.31:0/2375159812 shutdown_connections 2024-09-17T05:34:59.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.917+0000 7f6175800640 1 -- 172.21.15.31:0/2375159812 wait complete. 2024-09-17T05:34:59.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f6175800640 1 Processor -- start 2024-09-17T05:34:59.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f6175800640 1 -- start start 2024-09-17T05:34:59.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f6175800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61700aea10 0x7f617015ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:59.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f6175800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f617015a7e0 0x7f61701f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:59.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f6175800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617015abc0 0x7f61701f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:59.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f6175800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f617015eec0 con 0x7f617015abc0 2024-09-17T05:34:59.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f6175800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f617015ed40 con 0x7f617015a7e0 2024-09-17T05:34:59.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f6175800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f617015f040 con 0x7f61700aea10 2024-09-17T05:34:59.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f616f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617015abc0 0x7f61701f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:59.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f616f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617015abc0 0x7f61701f73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52356/0 (socket says 172.21.15.31:52356) 2024-09-17T05:34:59.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f616f400640 1 -- 172.21.15.31:0/1991514949 learned_addr learned my addr 172.21.15.31:0/1991514949 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:34:59.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f616ea00640 1 --2- 172.21.15.31:0/1991514949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61700aea10 0x7f617015ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:59.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f6166000640 1 --2- 172.21.15.31:0/1991514949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f617015a7e0 0x7f61701f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:59.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f616f400640 1 -- 172.21.15.31:0/1991514949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61700aea10 msgr2=0x7f617015ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:59.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f616f400640 1 --2- 172.21.15.31:0/1991514949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61700aea10 0x7f617015ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f616f400640 1 -- 172.21.15.31:0/1991514949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f617015a7e0 msgr2=0x7f61701f6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:34:59.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f616f400640 1 --2- 172.21.15.31:0/1991514949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f617015a7e0 0x7f61701f6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:34:59.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f616f400640 1 -- 172.21.15.31:0/1991514949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61700b27e0 con 0x7f617015abc0 2024-09-17T05:34:59.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f616f400640 1 --2- 172.21.15.31:0/1991514949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617015abc0 0x7f61701f73d0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f616801b410 tx=0x7f61680045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:59.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f6167400640 1 -- 172.21.15.31:0/1991514949 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61680bb070 con 0x7f617015abc0 2024-09-17T05:34:59.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f6167400640 1 -- 172.21.15.31:0/1991514949 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6168003e90 con 0x7f617015abc0 2024-09-17T05:34:59.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f6167400640 1 -- 172.21.15.31:0/1991514949 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61680b2040 con 0x7f617015abc0 2024-09-17T05:34:59.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f6175800640 1 -- 172.21.15.31:0/1991514949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6170154330 con 0x7f617015abc0 2024-09-17T05:34:59.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f6175800640 1 -- 172.21.15.31:0/1991514949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61701548f0 con 0x7f617015abc0 2024-09-17T05:34:59.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.921+0000 7f6175800640 1 -- 172.21.15.31:0/1991514949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61700ae4d0 con 0x7f617015abc0 2024-09-17T05:34:59.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.925+0000 7f6167400640 1 -- 172.21.15.31:0/1991514949 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f61680a5d00 con 0x7f617015abc0 2024-09-17T05:34:59.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.925+0000 7f6167400640 1 --2- 172.21.15.31:0/1991514949 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f614c073830 0x7f614c075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:34:59.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.925+0000 7f6167400640 1 -- 172.21.15.31:0/1991514949 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5471+0+0 (secure 0 0 0) 0x7f616812ee60 con 0x7f617015abc0 2024-09-17T05:34:59.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.925+0000 7f616ea00640 1 --2- 172.21.15.31:0/1991514949 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f614c073830 0x7f614c075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:34:59.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.925+0000 7f616ea00640 1 --2- 172.21.15.31:0/1991514949 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f614c073830 0x7f614c075cf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f61600045b0 tx=0x7f616000b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:34:59.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:34:59.929+0000 7f6167400640 1 -- 172.21.15.31:0/1991514949 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6168016950 con 0x7f617015abc0 2024-09-17T05:35:00.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:00.109+0000 7f6175800640 1 -- 172.21.15.31:0/1991514949 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f61700704e0 con 0x7f617015abc0 2024-09-17T05:35:00.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:00.865+0000 7f6167400640 1 -- 172.21.15.31:0/1991514949 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v121) ==== 169+0+0 (secure 0 0 0) 0x7f61680f8f20 con 0x7f617015abc0 2024-09-17T05:35:00.869 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-09-17T05:35:00.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:00.873+0000 7f6175800640 1 -- 172.21.15.31:0/1991514949 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f614c073830 msgr2=0x7f614c075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:00.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:00.873+0000 7f6175800640 1 --2- 172.21.15.31:0/1991514949 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f614c073830 0x7f614c075cf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f61600045b0 tx=0x7f616000b390 comp rx=0 tx=0).stop 2024-09-17T05:35:00.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:00.873+0000 7f6175800640 1 -- 172.21.15.31:0/1991514949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617015abc0 msgr2=0x7f61701f73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:00.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:00.873+0000 7f6175800640 1 --2- 172.21.15.31:0/1991514949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617015abc0 0x7f61701f73d0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f616801b410 tx=0x7f61680045e0 comp rx=0 tx=0).stop 2024-09-17T05:35:00.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:00.873+0000 7f6175800640 1 -- 172.21.15.31:0/1991514949 shutdown_connections 2024-09-17T05:35:00.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:00.873+0000 7f6175800640 1 --2- 172.21.15.31:0/1991514949 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f614c073830 0x7f614c075cf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:00.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:00.873+0000 7f6175800640 1 --2- 172.21.15.31:0/1991514949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f617015abc0 0x7f61701f73d0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:00.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:00.873+0000 7f6175800640 1 --2- 172.21.15.31:0/1991514949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f617015a7e0 0x7f61701f6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:00.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:00.873+0000 7f6175800640 1 --2- 172.21.15.31:0/1991514949 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61700aea10 0x7f617015ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:00.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:00.873+0000 7f6175800640 1 -- 172.21.15.31:0/1991514949 >> 172.21.15.31:0/1991514949 conn(0x7f617006dd30 msgr2=0x7f617006e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:00.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:00.873+0000 7f6175800640 1 -- 172.21.15.31:0/1991514949 shutdown_connections 2024-09-17T05:35:00.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:00.873+0000 7f6175800640 1 -- 172.21.15.31:0/1991514949 wait complete. 2024-09-17T05:35:00.900 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:35:01.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.053+0000 7fe916400640 1 -- 172.21.15.31:0/1475037115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f4003a60 msgr2=0x7fe8f4003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:01.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.053+0000 7fe916400640 1 --2- 172.21.15.31:0/1475037115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f4003a60 0x7fe8f4003e80 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fe90000c2e0 tx=0x7fe90001cf20 comp rx=0 tx=0).stop 2024-09-17T05:35:01.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.053+0000 7fe916400640 1 -- 172.21.15.31:0/1475037115 shutdown_connections 2024-09-17T05:35:01.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.053+0000 7fe916400640 1 --2- 172.21.15.31:0/1475037115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8f4003a60 0x7fe8f4003e80 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:01.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.053+0000 7fe916400640 1 -- 172.21.15.31:0/1475037115 >> 172.21.15.31:0/1475037115 conn(0x7fe9100d1dc0 msgr2=0x7fe9100d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:01.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.053+0000 7fe916400640 1 -- 172.21.15.31:0/1475037115 shutdown_connections 2024-09-17T05:35:01.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.053+0000 7fe916400640 1 -- 172.21.15.31:0/1475037115 wait complete. 2024-09-17T05:35:01.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe916400640 1 Processor -- start 2024-09-17T05:35:01.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe916400640 1 -- start start 2024-09-17T05:35:01.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe916400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8f4003a60 0x7fe91015c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:01.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe916400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe91015dcf0 0x7fe9100b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:01.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe916400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe91015f180 0x7fe9100b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:01.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe916400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe9100cea80 con 0x7fe91015f180 2024-09-17T05:35:01.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe916400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe9100ce900 con 0x7fe8f4003a60 2024-09-17T05:35:01.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe916400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe9100cec00 con 0x7fe91015dcf0 2024-09-17T05:35:01.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe90f400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8f4003a60 0x7fe91015c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:01.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe90fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe91015f180 0x7fe9100b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:01.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe90f400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8f4003a60 0x7fe91015c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:54332/0 (socket says 172.21.15.31:54332) 2024-09-17T05:35:01.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe90ea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe91015dcf0 0x7fe9100b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:01.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe90f400640 1 -- 172.21.15.31:0/816526617 learned_addr learned my addr 172.21.15.31:0/816526617 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:01.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe90fe00640 1 -- 172.21.15.31:0/816526617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe91015dcf0 msgr2=0x7fe9100b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:01.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe90fe00640 1 --2- 172.21.15.31:0/816526617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe91015dcf0 0x7fe9100b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:01.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe90fe00640 1 -- 172.21.15.31:0/816526617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8f4003a60 msgr2=0x7fe91015c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:01.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe90fe00640 1 --2- 172.21.15.31:0/816526617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8f4003a60 0x7fe91015c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:01.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe90fe00640 1 -- 172.21.15.31:0/816526617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9100cc0f0 con 0x7fe91015f180 2024-09-17T05:35:01.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe90fe00640 1 --2- 172.21.15.31:0/816526617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe91015f180 0x7fe9100b3620 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fe910074010 tx=0x7fe90800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:01.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe907400640 1 -- 172.21.15.31:0/816526617 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe908004b30 con 0x7fe91015f180 2024-09-17T05:35:01.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe907400640 1 -- 172.21.15.31:0/816526617 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe908004cd0 con 0x7fe91015f180 2024-09-17T05:35:01.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.057+0000 7fe907400640 1 -- 172.21.15.31:0/816526617 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe908003be0 con 0x7fe91015f180 2024-09-17T05:35:01.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.061+0000 7fe916400640 1 -- 172.21.15.31:0/816526617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9101f8dc0 con 0x7fe91015f180 2024-09-17T05:35:01.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.061+0000 7fe916400640 1 -- 172.21.15.31:0/816526617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9101f9380 con 0x7fe91015f180 2024-09-17T05:35:01.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.061+0000 7fe916400640 1 -- 172.21.15.31:0/816526617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9100cd4f0 con 0x7fe91015f180 2024-09-17T05:35:01.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.061+0000 7fe907400640 1 -- 172.21.15.31:0/816526617 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fe908004050 con 0x7fe91015f180 2024-09-17T05:35:01.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.061+0000 7fe907400640 1 --2- 172.21.15.31:0/816526617 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe8f0073830 0x7fe8f0075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:01.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.061+0000 7fe907400640 1 -- 172.21.15.31:0/816526617 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4971+0+0 (secure 0 0 0) 0x7fe908095850 con 0x7fe91015f180 2024-09-17T05:35:01.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.065+0000 7fe90f400640 1 --2- 172.21.15.31:0/816526617 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe8f0073830 0x7fe8f0075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:01.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.065+0000 7fe90f400640 1 --2- 172.21.15.31:0/816526617 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe8f0073830 0x7fe8f0075cf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe900000c10 tx=0x7fe900019d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:01.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.065+0000 7fe907400640 1 -- 172.21.15.31:0/816526617 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe90805fb00 con 0x7fe91015f180 2024-09-17T05:35:01.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.245+0000 7fe916400640 1 -- 172.21.15.31:0/816526617 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7fe91015e460 con 0x7fe91015f180 2024-09-17T05:35:01.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.249+0000 7fe907400640 1 -- 172.21.15.31:0/816526617 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v41) ==== 71+0+0 (secure 0 0 0) 0x7fe908064530 con 0x7fe91015f180 2024-09-17T05:35:01.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.249+0000 7fe916400640 1 -- 172.21.15.31:0/816526617 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe8f0073830 msgr2=0x7fe8f0075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:01.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.249+0000 7fe916400640 1 --2- 172.21.15.31:0/816526617 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe8f0073830 0x7fe8f0075cf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe900000c10 tx=0x7fe900019d60 comp rx=0 tx=0).stop 2024-09-17T05:35:01.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.249+0000 7fe916400640 1 -- 172.21.15.31:0/816526617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe91015f180 msgr2=0x7fe9100b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:01.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.249+0000 7fe916400640 1 --2- 172.21.15.31:0/816526617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe91015f180 0x7fe9100b3620 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fe910074010 tx=0x7fe90800f3c0 comp rx=0 tx=0).stop 2024-09-17T05:35:01.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.249+0000 7fe916400640 1 -- 172.21.15.31:0/816526617 shutdown_connections 2024-09-17T05:35:01.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.249+0000 7fe916400640 1 --2- 172.21.15.31:0/816526617 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe8f0073830 0x7fe8f0075cf0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:01.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.249+0000 7fe916400640 1 --2- 172.21.15.31:0/816526617 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe91015f180 0x7fe9100b3620 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:01.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.249+0000 7fe916400640 1 --2- 172.21.15.31:0/816526617 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe91015dcf0 0x7fe9100b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:01.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.249+0000 7fe916400640 1 --2- 172.21.15.31:0/816526617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8f4003a60 0x7fe91015c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:01.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.249+0000 7fe916400640 1 -- 172.21.15.31:0/816526617 >> 172.21.15.31:0/816526617 conn(0x7fe9100d1dc0 msgr2=0x7fe910160330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:01.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.249+0000 7fe916400640 1 -- 172.21.15.31:0/816526617 shutdown_connections 2024-09-17T05:35:01.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.249+0000 7fe916400640 1 -- 172.21.15.31:0/816526617 wait complete. 2024-09-17T05:35:01.271 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2' 2024-09-17T05:35:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.417+0000 7f30a7400640 1 -- 172.21.15.31:0/3081068756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30a00b2e80 msgr2=0x7f30a00b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.417+0000 7f30a7400640 1 --2- 172.21.15.31:0/3081068756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30a00b2e80 0x7f30a00b1a00 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f30a00cfb60 tx=0x7f308c01c830 comp rx=0 tx=0).stop 2024-09-17T05:35:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.417+0000 7f30a7400640 1 -- 172.21.15.31:0/3081068756 shutdown_connections 2024-09-17T05:35:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.417+0000 7f30a7400640 1 --2- 172.21.15.31:0/3081068756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30a00b1f40 0x7f30a00cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.417+0000 7f30a7400640 1 --2- 172.21.15.31:0/3081068756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30a00b2e80 0x7f30a00b1a00 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.417+0000 7f30a7400640 1 --2- 172.21.15.31:0/3081068756 >> v2:172.21.15.155:3300/0 conn(0x7f30a015f490 0x7f30a00b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.417+0000 7f30a7400640 1 -- 172.21.15.31:0/3081068756 >> 172.21.15.31:0/3081068756 conn(0x7f30a00d1e30 msgr2=0x7f30a00d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.417+0000 7f30a7400640 1 -- 172.21.15.31:0/3081068756 shutdown_connections 2024-09-17T05:35:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.417+0000 7f30a7400640 1 -- 172.21.15.31:0/3081068756 wait complete. 2024-09-17T05:35:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.417+0000 7f30a7400640 1 Processor -- start 2024-09-17T05:35:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.417+0000 7f30a7400640 1 -- start start 2024-09-17T05:35:01.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.417+0000 7f30a7400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30a00b1f40 0x7f30a006f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:01.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.417+0000 7f30a7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30a00b2e80 0x7f30a0166560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:01.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.417+0000 7f30a7400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30a015f490 0x7f30a015b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:01.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f30a7400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f30a00b0010 con 0x7f30a00b2e80 2024-09-17T05:35:01.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f30a7400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f30a00afe90 con 0x7f30a00b1f40 2024-09-17T05:35:01.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f30a7400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f30a00b0190 con 0x7f30a015f490 2024-09-17T05:35:01.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f309fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30a00b2e80 0x7f30a0166560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:01.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f30a4a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30a00b1f40 0x7f30a006f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:01.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f309fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30a00b2e80 0x7f30a0166560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52392/0 (socket says 172.21.15.31:52392) 2024-09-17T05:35:01.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f309fe00640 1 -- 172.21.15.31:0/4192591503 learned_addr learned my addr 172.21.15.31:0/4192591503 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:01.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f30a5400640 1 --2- 172.21.15.31:0/4192591503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30a015f490 0x7f30a015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:01.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f309fe00640 1 -- 172.21.15.31:0/4192591503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30a015f490 msgr2=0x7f30a015b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:01.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f309fe00640 1 --2- 172.21.15.31:0/4192591503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30a015f490 0x7f30a015b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:01.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f309fe00640 1 -- 172.21.15.31:0/4192591503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30a00b1f40 msgr2=0x7f30a006f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:01.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f309fe00640 1 --2- 172.21.15.31:0/4192591503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30a00b1f40 0x7f30a006f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:01.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f309fe00640 1 -- 172.21.15.31:0/4192591503 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a0166aa0 con 0x7f30a00b2e80 2024-09-17T05:35:01.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f309fe00640 1 --2- 172.21.15.31:0/4192591503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30a00b2e80 0x7f30a0166560 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f308c0b0040 tx=0x7f308c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:01.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f309cc00640 1 -- 172.21.15.31:0/4192591503 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c0b2040 con 0x7f30a00b2e80 2024-09-17T05:35:01.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f309cc00640 1 -- 172.21.15.31:0/4192591503 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f308c005030 con 0x7f30a00b2e80 2024-09-17T05:35:01.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f30a7400640 1 -- 172.21.15.31:0/4192591503 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a00ca600 con 0x7f30a00b2e80 2024-09-17T05:35:01.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f309cc00640 1 -- 172.21.15.31:0/4192591503 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c005480 con 0x7f30a00b2e80 2024-09-17T05:35:01.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f30a7400640 1 -- 172.21.15.31:0/4192591503 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a00cabc0 con 0x7f30a00b2e80 2024-09-17T05:35:01.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f30a7400640 1 -- 172.21.15.31:0/4192591503 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a00cfda0 con 0x7f30a00b2e80 2024-09-17T05:35:01.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.421+0000 7f309cc00640 1 -- 172.21.15.31:0/4192591503 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f308c0bd060 con 0x7f30a00b2e80 2024-09-17T05:35:01.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.425+0000 7f309cc00640 1 --2- 172.21.15.31:0/4192591503 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3080073830 0x7f3080075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:01.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.425+0000 7f309cc00640 1 -- 172.21.15.31:0/4192591503 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4971+0+0 (secure 0 0 0) 0x7f308c12e0f0 con 0x7f30a00b2e80 2024-09-17T05:35:01.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.425+0000 7f30a4a00640 1 --2- 172.21.15.31:0/4192591503 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3080073830 0x7f3080075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:01.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.425+0000 7f30a4a00640 1 --2- 172.21.15.31:0/4192591503 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3080073830 0x7f3080075cf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f309400ab40 tx=0x7f309400a250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:01.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.429+0000 7f309cc00640 1 -- 172.21.15.31:0/4192591503 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f308c0164b0 con 0x7f30a00b2e80 2024-09-17T05:35:01.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.665+0000 7f30a7400640 1 -- 172.21.15.31:0/4192591503 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]} v 0) -- 0x7f30a00cf290 con 0x7f30a00b2e80 2024-09-17T05:35:01.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.869+0000 7f309cc00640 1 -- 172.21.15.31:0/4192591503 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]}]=0 v349) ==== 148+0+0 (secure 0 0 0) 0x7f308c0f8350 con 0x7f30a00b2e80 2024-09-17T05:35:01.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.873+0000 7f30a7400640 1 -- 172.21.15.31:0/4192591503 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3080073830 msgr2=0x7f3080075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:01.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.873+0000 7f30a7400640 1 --2- 172.21.15.31:0/4192591503 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3080073830 0x7f3080075cf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f309400ab40 tx=0x7f309400a250 comp rx=0 tx=0).stop 2024-09-17T05:35:01.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.873+0000 7f30a7400640 1 -- 172.21.15.31:0/4192591503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30a00b2e80 msgr2=0x7f30a0166560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:01.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.873+0000 7f30a7400640 1 --2- 172.21.15.31:0/4192591503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30a00b2e80 0x7f30a0166560 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f308c0b0040 tx=0x7f308c0040e0 comp rx=0 tx=0).stop 2024-09-17T05:35:01.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.873+0000 7f30a7400640 1 -- 172.21.15.31:0/4192591503 shutdown_connections 2024-09-17T05:35:01.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.873+0000 7f30a7400640 1 --2- 172.21.15.31:0/4192591503 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3080073830 0x7f3080075cf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:01.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.873+0000 7f30a7400640 1 --2- 172.21.15.31:0/4192591503 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30a015f490 0x7f30a015b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:01.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.873+0000 7f30a7400640 1 --2- 172.21.15.31:0/4192591503 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30a00b2e80 0x7f30a0166560 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:01.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.873+0000 7f30a7400640 1 --2- 172.21.15.31:0/4192591503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30a00b1f40 0x7f30a006f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:01.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.873+0000 7f30a7400640 1 -- 172.21.15.31:0/4192591503 >> 172.21.15.31:0/4192591503 conn(0x7f30a00d1e30 msgr2=0x7f30a015e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:01.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.873+0000 7f30a7400640 1 -- 172.21.15.31:0/4192591503 shutdown_connections 2024-09-17T05:35:01.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:01.873+0000 7f30a7400640 1 -- 172.21.15.31:0/4192591503 wait complete. 2024-09-17T05:35:01.894 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- theme continues... ... ok 2024-09-17T05:35:01.894 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_ops_on_nonexistent_vol (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:35:01.895 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:35:02.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8d0e00640 1 -- 172.21.15.31:0/1296925922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8cc0cd100 msgr2=0x7fe8cc06f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:02.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8d0e00640 1 --2- 172.21.15.31:0/1296925922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8cc0cd100 0x7fe8cc06f7b0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0af830 tx=0x7fe8b401dad0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8d0e00640 1 -- 172.21.15.31:0/1296925922 shutdown_connections 2024-09-17T05:35:02.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8d0e00640 1 --2- 172.21.15.31:0/1296925922 >> v2:172.21.15.155:3300/0 conn(0x7fe8cc0b49e0 0x7fe8cc0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8d0e00640 1 --2- 172.21.15.31:0/1296925922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8cc0cd100 0x7fe8cc06f7b0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8d0e00640 1 -- 172.21.15.31:0/1296925922 >> 172.21.15.31:0/1296925922 conn(0x7fe8cc0b18f0 msgr2=0x7fe8cc0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:02.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8d0e00640 1 -- 172.21.15.31:0/1296925922 shutdown_connections 2024-09-17T05:35:02.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8d0e00640 1 -- 172.21.15.31:0/1296925922 wait complete. 2024-09-17T05:35:02.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8d0e00640 1 Processor -- start 2024-09-17T05:35:02.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8d0e00640 1 -- start start 2024-09-17T05:35:02.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8d0e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8cc0b49e0 0x7fe8cc1f8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:02.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8d0e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8cc0cd100 0x7fe8cc1f9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:02.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8d0e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8cc15dae0 0x7fe8cc072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:02.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8d0e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe8cc0cf0f0 con 0x7fe8cc0cd100 2024-09-17T05:35:02.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8d0e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe8cc0cef70 con 0x7fe8cc15dae0 2024-09-17T05:35:02.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8d0e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe8cc0cf270 con 0x7fe8cc0b49e0 2024-09-17T05:35:02.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8c1400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8cc0cd100 0x7fe8cc1f9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:02.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8c1400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8cc0cd100 0x7fe8cc1f9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52416/0 (socket says 172.21.15.31:52416) 2024-09-17T05:35:02.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.041+0000 7fe8c1400640 1 -- 172.21.15.31:0/1384461002 learned_addr learned my addr 172.21.15.31:0/1384461002 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:02.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.045+0000 7fe8c9e00640 1 --2- 172.21.15.31:0/1384461002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8cc0b49e0 0x7fe8cc1f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:02.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.045+0000 7fe8ca800640 1 --2- 172.21.15.31:0/1384461002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8cc15dae0 0x7fe8cc072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:02.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.045+0000 7fe8c1400640 1 -- 172.21.15.31:0/1384461002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8cc0b49e0 msgr2=0x7fe8cc1f8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:02.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.045+0000 7fe8c1400640 1 --2- 172.21.15.31:0/1384461002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8cc0b49e0 0x7fe8cc1f8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.045+0000 7fe8c1400640 1 -- 172.21.15.31:0/1384461002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8cc15dae0 msgr2=0x7fe8cc072f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:02.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.045+0000 7fe8c1400640 1 --2- 172.21.15.31:0/1384461002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8cc15dae0 0x7fe8cc072f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.045+0000 7fe8c1400640 1 -- 172.21.15.31:0/1384461002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8cc1f9a80 con 0x7fe8cc0cd100 2024-09-17T05:35:02.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.045+0000 7fe8c9e00640 1 --2- 172.21.15.31:0/1384461002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8cc0b49e0 0x7fe8cc1f8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:02.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.045+0000 7fe8ca800640 1 --2- 172.21.15.31:0/1384461002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8cc15dae0 0x7fe8cc072f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:02.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.045+0000 7fe8c1400640 1 --2- 172.21.15.31:0/1384461002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8cc0cd100 0x7fe8cc1f9540 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fe8b401a6e0 tx=0x7fe8b40a6800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:02.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.045+0000 7fe8c2a00640 1 -- 172.21.15.31:0/1384461002 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40b3070 con 0x7fe8cc0cd100 2024-09-17T05:35:02.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.045+0000 7fe8c2a00640 1 -- 172.21.15.31:0/1384461002 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8b40055f0 con 0x7fe8cc0cd100 2024-09-17T05:35:02.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.045+0000 7fe8d0e00640 1 -- 172.21.15.31:0/1384461002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8cc1f56a0 con 0x7fe8cc0cd100 2024-09-17T05:35:02.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.045+0000 7fe8c2a00640 1 -- 172.21.15.31:0/1384461002 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4004910 con 0x7fe8cc0cd100 2024-09-17T05:35:02.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.045+0000 7fe8d0e00640 1 -- 172.21.15.31:0/1384461002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8cc1f5c60 con 0x7fe8cc0cd100 2024-09-17T05:35:02.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.045+0000 7fe8d0e00640 1 -- 172.21.15.31:0/1384461002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8cc0acd40 con 0x7fe8cc0cd100 2024-09-17T05:35:02.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.045+0000 7fe8c2a00640 1 -- 172.21.15.31:0/1384461002 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fe8b40be060 con 0x7fe8cc0cd100 2024-09-17T05:35:02.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.049+0000 7fe8c2a00640 1 --2- 172.21.15.31:0/1384461002 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe8a8073860 0x7fe8a8075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:02.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.049+0000 7fe8c2a00640 1 -- 172.21.15.31:0/1384461002 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4971+0+0 (secure 0 0 0) 0x7fe8b412edd0 con 0x7fe8cc0cd100 2024-09-17T05:35:02.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.049+0000 7fe8c9e00640 1 --2- 172.21.15.31:0/1384461002 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe8a8073860 0x7fe8a8075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:02.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.049+0000 7fe8c9e00640 1 --2- 172.21.15.31:0/1384461002 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe8a8073860 0x7fe8a8075d20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0016b0 tx=0x7fe8bc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:02.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.049+0000 7fe8c2a00640 1 -- 172.21.15.31:0/1384461002 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe8cc1f9a80 con 0x7fe8cc0cd100 2024-09-17T05:35:02.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.229+0000 7fe8d0e00640 1 -- 172.21.15.31:0/1384461002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8cc074060 con 0x7fe8cc0cd100 2024-09-17T05:35:02.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.229+0000 7fe8c2a00640 1 -- 172.21.15.31:0/1384461002 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) ==== 74+0+13110 (secure 0 0 0) 0x7fe8b40177e0 con 0x7fe8cc0cd100 2024-09-17T05:35:02.233 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:02.233 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":121,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:35:00.864946+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":116,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6835/1466764013":"2024-09-18T05:34:58.093054+0000","172.21.15.31:6833/1466764013":"2024-09-18T05:34:58.093054+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:35:02.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.233+0000 7fe8d0e00640 1 -- 172.21.15.31:0/1384461002 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe8a8073860 msgr2=0x7fe8a8075d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:02.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.233+0000 7fe8d0e00640 1 --2- 172.21.15.31:0/1384461002 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe8a8073860 0x7fe8a8075d20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0016b0 tx=0x7fe8bc009040 comp rx=0 tx=0).stop 2024-09-17T05:35:02.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.233+0000 7fe8d0e00640 1 -- 172.21.15.31:0/1384461002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8cc0cd100 msgr2=0x7fe8cc1f9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:02.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.233+0000 7fe8d0e00640 1 --2- 172.21.15.31:0/1384461002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8cc0cd100 0x7fe8cc1f9540 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fe8b401a6e0 tx=0x7fe8b40a6800 comp rx=0 tx=0).stop 2024-09-17T05:35:02.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.233+0000 7fe8d0e00640 1 -- 172.21.15.31:0/1384461002 shutdown_connections 2024-09-17T05:35:02.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.233+0000 7fe8d0e00640 1 --2- 172.21.15.31:0/1384461002 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe8a8073860 0x7fe8a8075d20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.233+0000 7fe8d0e00640 1 --2- 172.21.15.31:0/1384461002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8cc15dae0 0x7fe8cc072f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.233+0000 7fe8d0e00640 1 --2- 172.21.15.31:0/1384461002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8cc0cd100 0x7fe8cc1f9540 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.233+0000 7fe8d0e00640 1 --2- 172.21.15.31:0/1384461002 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8cc0b49e0 0x7fe8cc1f8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.233+0000 7fe8d0e00640 1 -- 172.21.15.31:0/1384461002 >> 172.21.15.31:0/1384461002 conn(0x7fe8cc0b18f0 msgr2=0x7fe8cc0b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:02.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.233+0000 7fe8d0e00640 1 -- 172.21.15.31:0/1384461002 shutdown_connections 2024-09-17T05:35:02.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.233+0000 7fe8d0e00640 1 -- 172.21.15.31:0/1384461002 wait complete. 2024-09-17T05:35:02.254 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:28:33.209612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:35:02.254 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:35:02.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.401+0000 7f10bf800640 1 -- 172.21.15.31:0/1493270990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b80b49b0 msgr2=0x7f10b815ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:02.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.401+0000 7f10bf800640 1 --2- 172.21.15.31:0/1493270990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b80b49b0 0x7f10b815ea30 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009900 tx=0x7f10a401c850 comp rx=0 tx=0).stop 2024-09-17T05:35:02.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.401+0000 7f10bf800640 1 -- 172.21.15.31:0/1493270990 shutdown_connections 2024-09-17T05:35:02.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.401+0000 7f10bf800640 1 --2- 172.21.15.31:0/1493270990 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b80703d0 0x7f10b815a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.401+0000 7f10bf800640 1 --2- 172.21.15.31:0/1493270990 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b80b49b0 0x7f10b815ea30 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.401+0000 7f10bf800640 1 -- 172.21.15.31:0/1493270990 >> 172.21.15.31:0/1493270990 conn(0x7f10b80b18f0 msgr2=0x7f10b80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:02.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.401+0000 7f10bf800640 1 -- 172.21.15.31:0/1493270990 shutdown_connections 2024-09-17T05:35:02.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.401+0000 7f10bf800640 1 -- 172.21.15.31:0/1493270990 wait complete. 2024-09-17T05:35:02.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bf800640 1 Processor -- start 2024-09-17T05:35:02.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bf800640 1 -- start start 2024-09-17T05:35:02.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bf800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b80703d0 0x7f10b815cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:02.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bf800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10b80b49b0 0x7f10b80afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:02.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bf800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b815a4d0 0x7f10b81f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:02.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bf800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f10b80ccfe0 con 0x7f10b815a4d0 2024-09-17T05:35:02.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bf800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f10b80cce60 con 0x7f10b80b49b0 2024-09-17T05:35:02.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bf800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f10b8167170 con 0x7f10b80703d0 2024-09-17T05:35:02.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bd800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b815a4d0 0x7f10b81f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:02.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bd800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b815a4d0 0x7f10b81f66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52430/0 (socket says 172.21.15.31:52430) 2024-09-17T05:35:02.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bd800640 1 -- 172.21.15.31:0/2077460693 learned_addr learned my addr 172.21.15.31:0/2077460693 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:02.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bce00640 1 --2- 172.21.15.31:0/2077460693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b80703d0 0x7f10b815cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:02.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10b7e00640 1 --2- 172.21.15.31:0/2077460693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10b80b49b0 0x7f10b80afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:02.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bd800640 1 -- 172.21.15.31:0/2077460693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b80703d0 msgr2=0x7f10b815cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:02.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bd800640 1 --2- 172.21.15.31:0/2077460693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b80703d0 0x7f10b815cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bd800640 1 -- 172.21.15.31:0/2077460693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10b80b49b0 msgr2=0x7f10b80afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:02.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bd800640 1 --2- 172.21.15.31:0/2077460693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10b80b49b0 0x7f10b80afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bd800640 1 -- 172.21.15.31:0/2077460693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b81520d0 con 0x7f10b815a4d0 2024-09-17T05:35:02.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bd800640 1 --2- 172.21.15.31:0/2077460693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b815a4d0 0x7f10b81f66e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f10b000ec90 tx=0x7f10b000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:02.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10b4c00640 1 -- 172.21.15.31:0/2077460693 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b0004d30 con 0x7f10b815a4d0 2024-09-17T05:35:02.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10b4c00640 1 -- 172.21.15.31:0/2077460693 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10b000b570 con 0x7f10b815a4d0 2024-09-17T05:35:02.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10b4c00640 1 -- 172.21.15.31:0/2077460693 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b000b980 con 0x7f10b815a4d0 2024-09-17T05:35:02.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bf800640 1 -- 172.21.15.31:0/2077460693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b815d350 con 0x7f10b815a4d0 2024-09-17T05:35:02.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.405+0000 7f10bf800640 1 -- 172.21.15.31:0/2077460693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b8152650 con 0x7f10b815a4d0 2024-09-17T05:35:02.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.409+0000 7f10bf800640 1 -- 172.21.15.31:0/2077460693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b8069410 con 0x7f10b815a4d0 2024-09-17T05:35:02.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.409+0000 7f10b4c00640 1 -- 172.21.15.31:0/2077460693 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f10b000bb20 con 0x7f10b815a4d0 2024-09-17T05:35:02.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.409+0000 7f10b4c00640 1 --2- 172.21.15.31:0/2077460693 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1098073830 0x7f1098075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:02.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.409+0000 7f10b4c00640 1 -- 172.21.15.31:0/2077460693 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4971+0+0 (secure 0 0 0) 0x7f10b0095770 con 0x7f10b815a4d0 2024-09-17T05:35:02.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.409+0000 7f10bce00640 1 --2- 172.21.15.31:0/2077460693 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1098073830 0x7f1098075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:02.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.409+0000 7f10bce00640 1 --2- 172.21.15.31:0/2077460693 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1098073830 0x7f1098075cf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f10ac001650 tx=0x7f10ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:02.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.413+0000 7f10b4c00640 1 -- 172.21.15.31:0/2077460693 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f10b0060100 con 0x7f10b815a4d0 2024-09-17T05:35:02.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.597+0000 7f10bf800640 1 -- 172.21.15.31:0/2077460693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f10b80af150 con 0x7f10b815a4d0 2024-09-17T05:35:02.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.597+0000 7f10b4c00640 1 -- 172.21.15.31:0/2077460693 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v121) ==== 93+0+10 (secure 0 0 0) 0x7f10b005fa00 con 0x7f10b815a4d0 2024-09-17T05:35:02.599 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-09-17T05:35:02.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.597+0000 7f10bf800640 1 -- 172.21.15.31:0/2077460693 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1098073830 msgr2=0x7f1098075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:02.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.597+0000 7f10bf800640 1 --2- 172.21.15.31:0/2077460693 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1098073830 0x7f1098075cf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f10ac001650 tx=0x7f10ac009040 comp rx=0 tx=0).stop 2024-09-17T05:35:02.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.597+0000 7f10bf800640 1 -- 172.21.15.31:0/2077460693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b815a4d0 msgr2=0x7f10b81f66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:02.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.597+0000 7f10bf800640 1 --2- 172.21.15.31:0/2077460693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b815a4d0 0x7f10b81f66e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f10b000ec90 tx=0x7f10b000c7a0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.597+0000 7f10bf800640 1 -- 172.21.15.31:0/2077460693 shutdown_connections 2024-09-17T05:35:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.597+0000 7f10bf800640 1 --2- 172.21.15.31:0/2077460693 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1098073830 0x7f1098075cf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.597+0000 7f10bf800640 1 --2- 172.21.15.31:0/2077460693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f10b815a4d0 0x7f10b81f66e0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.597+0000 7f10bf800640 1 --2- 172.21.15.31:0/2077460693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10b80b49b0 0x7f10b80afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.597+0000 7f10bf800640 1 --2- 172.21.15.31:0/2077460693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f10b80703d0 0x7f10b815cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.597+0000 7f10bf800640 1 -- 172.21.15.31:0/2077460693 >> 172.21.15.31:0/2077460693 conn(0x7f10b80b18f0 msgr2=0x7f10b806f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.597+0000 7f10bf800640 1 -- 172.21.15.31:0/2077460693 shutdown_connections 2024-09-17T05:35:02.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.597+0000 7f10bf800640 1 -- 172.21.15.31:0/2077460693 wait complete. 2024-09-17T05:35:02.622 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol' 2024-09-17T05:35:02.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.765+0000 7f5180400640 1 -- 172.21.15.31:0/3932901545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f517815c130 msgr2=0x7f51780cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:02.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.765+0000 7f5180400640 1 --2- 172.21.15.31:0/3932901545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f517815c130 0x7f51780cce80 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f5170009bc0 tx=0x7f517001ca80 comp rx=0 tx=0).stop 2024-09-17T05:35:02.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.765+0000 7f5180400640 1 -- 172.21.15.31:0/3932901545 shutdown_connections 2024-09-17T05:35:02.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.765+0000 7f5180400640 1 --2- 172.21.15.31:0/3932901545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f517815c130 0x7f51780cce80 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.765+0000 7f5180400640 1 --2- 172.21.15.31:0/3932901545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f51780cecf0 0x7f51780cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.765+0000 7f5180400640 1 -- 172.21.15.31:0/3932901545 >> 172.21.15.31:0/3932901545 conn(0x7f51780d1ea0 msgr2=0x7f51780d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:02.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.765+0000 7f5180400640 1 -- 172.21.15.31:0/3932901545 shutdown_connections 2024-09-17T05:35:02.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.765+0000 7f5180400640 1 -- 172.21.15.31:0/3932901545 wait complete. 2024-09-17T05:35:02.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f5180400640 1 Processor -- start 2024-09-17T05:35:02.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f5180400640 1 -- start start 2024-09-17T05:35:02.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f5180400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51780cecf0 0x7f51780cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:02.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f5180400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f517815bd50 0x7f51781599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:02.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f5180400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f517815c130 0x7f51781fba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:02.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f5180400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f51781695e0 con 0x7f517815c130 2024-09-17T05:35:02.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f5180400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5178169460 con 0x7f51780cecf0 2024-09-17T05:35:02.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f5180400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5178169760 con 0x7f517815bd50 2024-09-17T05:35:02.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f517e400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f517815c130 0x7f51781fba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:02.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f517e400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f517815c130 0x7f51781fba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52450/0 (socket says 172.21.15.31:52450) 2024-09-17T05:35:02.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f517e400640 1 -- 172.21.15.31:0/1630821486 learned_addr learned my addr 172.21.15.31:0/1630821486 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:02.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f517e400640 1 -- 172.21.15.31:0/1630821486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f517815bd50 msgr2=0x7f51781599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:02.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f517e400640 1 --2- 172.21.15.31:0/1630821486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f517815bd50 0x7f51781599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f517e400640 1 -- 172.21.15.31:0/1630821486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51780cecf0 msgr2=0x7f51780cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:02.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f517e400640 1 --2- 172.21.15.31:0/1630821486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51780cecf0 0x7f51780cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:02.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f517e400640 1 -- 172.21.15.31:0/1630821486 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51780ca770 con 0x7f517815c130 2024-09-17T05:35:02.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f517e400640 1 --2- 172.21.15.31:0/1630821486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f517815c130 0x7f51781fba10 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f517001a6b0 tx=0x7f51700a5ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:02.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f5175600640 1 -- 172.21.15.31:0/1630821486 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51700bb070 con 0x7f517815c130 2024-09-17T05:35:02.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f5180400640 1 -- 172.21.15.31:0/1630821486 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5178159060 con 0x7f517815c130 2024-09-17T05:35:02.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f5175600640 1 -- 172.21.15.31:0/1630821486 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5170004d40 con 0x7f517815c130 2024-09-17T05:35:02.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f5175600640 1 -- 172.21.15.31:0/1630821486 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51700b2040 con 0x7f517815c130 2024-09-17T05:35:02.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.769+0000 7f5180400640 1 -- 172.21.15.31:0/1630821486 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51781fb4f0 con 0x7f517815c130 2024-09-17T05:35:02.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.773+0000 7f5180400640 1 -- 172.21.15.31:0/1630821486 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51780ce5e0 con 0x7f517815c130 2024-09-17T05:35:02.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.773+0000 7f5175600640 1 -- 172.21.15.31:0/1630821486 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f51700be070 con 0x7f517815c130 2024-09-17T05:35:02.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.773+0000 7f5175600640 1 --2- 172.21.15.31:0/1630821486 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5158073830 0x7f5158075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:02.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.773+0000 7f5175600640 1 -- 172.21.15.31:0/1630821486 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4971+0+0 (secure 0 0 0) 0x7f517012ea40 con 0x7f517815c130 2024-09-17T05:35:02.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.773+0000 7f517da00640 1 --2- 172.21.15.31:0/1630821486 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5158073830 0x7f5158075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:02.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.777+0000 7f517da00640 1 --2- 172.21.15.31:0/1630821486 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5158073830 0x7f5158075cf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f51780cecc0 tx=0x7f516c007a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:02.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:02.777+0000 7f5175600640 1 -- 172.21.15.31:0/1630821486 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5170016790 con 0x7f517815c130 2024-09-17T05:35:03.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:03.021+0000 7f5180400640 1 -- 172.21.15.31:0/1630821486 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]} v 0) -- 0x7f5178072620 con 0x7f517815c130 2024-09-17T05:35:03.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:03.877+0000 7f5175600640 1 -- 172.21.15.31:0/1630821486 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]}]=0 v351) ==== 154+0+0 (secure 0 0 0) 0x7f51700f93d0 con 0x7f517815c130 2024-09-17T05:35:03.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:03.881+0000 7f5180400640 1 -- 172.21.15.31:0/1630821486 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5158073830 msgr2=0x7f5158075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:03.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:03.881+0000 7f5180400640 1 --2- 172.21.15.31:0/1630821486 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5158073830 0x7f5158075cf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f51780cecc0 tx=0x7f516c007a40 comp rx=0 tx=0).stop 2024-09-17T05:35:03.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:03.881+0000 7f5180400640 1 -- 172.21.15.31:0/1630821486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f517815c130 msgr2=0x7f51781fba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:03.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:03.881+0000 7f5180400640 1 --2- 172.21.15.31:0/1630821486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f517815c130 0x7f51781fba10 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f517001a6b0 tx=0x7f51700a5ad0 comp rx=0 tx=0).stop 2024-09-17T05:35:03.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:03.881+0000 7f5180400640 1 -- 172.21.15.31:0/1630821486 shutdown_connections 2024-09-17T05:35:03.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:03.881+0000 7f5180400640 1 --2- 172.21.15.31:0/1630821486 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5158073830 0x7f5158075cf0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:03.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:03.881+0000 7f5180400640 1 --2- 172.21.15.31:0/1630821486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f517815c130 0x7f51781fba10 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:03.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:03.881+0000 7f5180400640 1 --2- 172.21.15.31:0/1630821486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f517815bd50 0x7f51781599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:03.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:03.881+0000 7f5180400640 1 --2- 172.21.15.31:0/1630821486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51780cecf0 0x7f51780cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:03.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:03.881+0000 7f5180400640 1 -- 172.21.15.31:0/1630821486 >> 172.21.15.31:0/1630821486 conn(0x7f51780d1ea0 msgr2=0x7f51780c7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:03.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:03.881+0000 7f5180400640 1 -- 172.21.15.31:0/1630821486 shutdown_connections 2024-09-17T05:35:03.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:03.881+0000 7f5180400640 1 -- 172.21.15.31:0/1630821486 wait complete. 2024-09-17T05:35:03.915 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:35:04.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.085+0000 7f0455200640 1 -- 172.21.15.31:0/1033389667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f045015c1c0 msgr2=0x7f045006d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:04.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.085+0000 7f0455200640 1 --2- 172.21.15.31:0/1033389667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f045015c1c0 0x7f045006d000 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0438009840 tx=0x7f043801c710 comp rx=0 tx=0).stop 2024-09-17T05:35:04.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.085+0000 7f0455200640 1 -- 172.21.15.31:0/1033389667 shutdown_connections 2024-09-17T05:35:04.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.085+0000 7f0455200640 1 --2- 172.21.15.31:0/1033389667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f045015c1c0 0x7f045006d000 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:04.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.085+0000 7f0455200640 1 --2- 172.21.15.31:0/1033389667 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f045006cc20 0x7f04500737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:04.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.085+0000 7f0455200640 1 -- 172.21.15.31:0/1033389667 >> 172.21.15.31:0/1033389667 conn(0x7f04500d0c90 msgr2=0x7f04500d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:04.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.085+0000 7f0455200640 1 -- 172.21.15.31:0/1033389667 shutdown_connections 2024-09-17T05:35:04.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.085+0000 7f0455200640 1 -- 172.21.15.31:0/1033389667 wait complete. 2024-09-17T05:35:04.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f0455200640 1 Processor -- start 2024-09-17T05:35:04.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f0455200640 1 -- start start 2024-09-17T05:35:04.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f0455200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f045006cc20 0x7f04500b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:04.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f0455200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f045015c1c0 0x7f04500b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:04.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f0455200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f045015f7b0 0x7f04500b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:04.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f0455200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0450156600 con 0x7f045015f7b0 2024-09-17T05:35:04.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f0455200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0450156480 con 0x7f045006cc20 2024-09-17T05:35:04.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f0455200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0450169360 con 0x7f045015c1c0 2024-09-17T05:35:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f044e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f045015f7b0 0x7f04500b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f044de00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f045006cc20 0x7f04500b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f044e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f045015f7b0 0x7f04500b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52460/0 (socket says 172.21.15.31:52460) 2024-09-17T05:35:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f0445400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f045015c1c0 0x7f04500b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f044e800640 1 -- 172.21.15.31:0/1092052312 learned_addr learned my addr 172.21.15.31:0/1092052312 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f044e800640 1 -- 172.21.15.31:0/1092052312 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f045015c1c0 msgr2=0x7f04500b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f044e800640 1 --2- 172.21.15.31:0/1092052312 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f045015c1c0 0x7f04500b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f044e800640 1 -- 172.21.15.31:0/1092052312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f045006cc20 msgr2=0x7f04500b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f044e800640 1 --2- 172.21.15.31:0/1092052312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f045006cc20 0x7f04500b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f044e800640 1 -- 172.21.15.31:0/1092052312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04500b3100 con 0x7f045015f7b0 2024-09-17T05:35:04.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f044de00640 1 --2- 172.21.15.31:0/1092052312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f045006cc20 0x7f04500b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:35:04.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f044e800640 1 --2- 172.21.15.31:0/1092052312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f045015f7b0 0x7f04500b3ac0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f044800cc50 tx=0x7f044800cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:04.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f0446a00640 1 -- 172.21.15.31:0/1092052312 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0448016020 con 0x7f045015f7b0 2024-09-17T05:35:04.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f0446a00640 1 -- 172.21.15.31:0/1092052312 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f044800ab60 con 0x7f045015f7b0 2024-09-17T05:35:04.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f0455200640 1 -- 172.21.15.31:0/1092052312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04500b33e0 con 0x7f045015f7b0 2024-09-17T05:35:04.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f0446a00640 1 -- 172.21.15.31:0/1092052312 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0448012420 con 0x7f045015f7b0 2024-09-17T05:35:04.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f0455200640 1 -- 172.21.15.31:0/1092052312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04500ceb00 con 0x7f045015f7b0 2024-09-17T05:35:04.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.089+0000 7f0455200640 1 -- 172.21.15.31:0/1092052312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04500b62e0 con 0x7f045015f7b0 2024-09-17T05:35:04.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.093+0000 7f0446a00640 1 -- 172.21.15.31:0/1092052312 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f0448019020 con 0x7f045015f7b0 2024-09-17T05:35:04.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.093+0000 7f0446a00640 1 --2- 172.21.15.31:0/1092052312 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f042c073830 0x7f042c075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:04.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.093+0000 7f0446a00640 1 -- 172.21.15.31:0/1092052312 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4971+0+0 (secure 0 0 0) 0x7f0448094e90 con 0x7f045015f7b0 2024-09-17T05:35:04.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.093+0000 7f044de00640 1 --2- 172.21.15.31:0/1092052312 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f042c073830 0x7f042c075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:04.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.093+0000 7f044de00640 1 --2- 172.21.15.31:0/1092052312 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f042c073830 0x7f042c075cf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0440009fd0 tx=0x7f04400091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:04.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.097+0000 7f0446a00640 1 -- 172.21.15.31:0/1092052312 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0448020020 con 0x7f045015f7b0 2024-09-17T05:35:04.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.277+0000 7f0455200640 1 -- 172.21.15.31:0/1092052312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f04500b60a0 con 0x7f045015f7b0 2024-09-17T05:35:04.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.277+0000 7f0446a00640 1 -- 172.21.15.31:0/1092052312 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v41) ==== 59+0+1998 (secure 0 0 0) 0x7f044805f140 con 0x7f045015f7b0 2024-09-17T05:35:04.279 INFO:teuthology.orchestra.run.smithi031.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:35:04.279 INFO:teuthology.orchestra.run.smithi031.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:35:04.279 INFO:teuthology.orchestra.run.smithi031.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:35:04.279 INFO:teuthology.orchestra.run.smithi031.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:35:04.279 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6159.333103 2024-09-17T05:35:04.279 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4566.558105 2024-09-17T05:35:04.279 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4575.968427 2024-09-17T05:35:04.279 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4702.806393 2024-09-17T05:35:04.279 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4956.728274 2024-09-17T05:35:04.280 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 6604.257199 2024-09-17T05:35:04.280 INFO:teuthology.orchestra.run.smithi031.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4779.165073 2024-09-17T05:35:04.280 INFO:teuthology.orchestra.run.smithi031.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4673.795919 2024-09-17T05:35:04.280 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds 20/20 2024-09-17T05:35:04.280 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:35:04.280 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_ms 2/2 2024-09-17T05:35:04.280 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_frag true 2024-09-17T05:35:04.280 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:35:04.280 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:35:04.280 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_verify_scatter true 2024-09-17T05:35:04.280 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:35:04.280 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:35:04.280 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:35:04.281 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced client_mount_timeout 600 2024-09-17T05:35:04.281 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_client 20/20 2024-09-17T05:35:04.281 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_ms 1/1 2024-09-17T05:35:04.281 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:35:04.281 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:35:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.277+0000 7f0455200640 1 -- 172.21.15.31:0/1092052312 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f042c073830 msgr2=0x7f042c075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.277+0000 7f0455200640 1 --2- 172.21.15.31:0/1092052312 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f042c073830 0x7f042c075cf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0440009fd0 tx=0x7f04400091e0 comp rx=0 tx=0).stop 2024-09-17T05:35:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.277+0000 7f0455200640 1 -- 172.21.15.31:0/1092052312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f045015f7b0 msgr2=0x7f04500b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.277+0000 7f0455200640 1 --2- 172.21.15.31:0/1092052312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f045015f7b0 0x7f04500b3ac0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f044800cc50 tx=0x7f044800cd40 comp rx=0 tx=0).stop 2024-09-17T05:35:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.277+0000 7f0455200640 1 -- 172.21.15.31:0/1092052312 shutdown_connections 2024-09-17T05:35:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.277+0000 7f0455200640 1 --2- 172.21.15.31:0/1092052312 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f042c073830 0x7f042c075cf0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.277+0000 7f0455200640 1 --2- 172.21.15.31:0/1092052312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f045015f7b0 0x7f04500b3ac0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.277+0000 7f0455200640 1 --2- 172.21.15.31:0/1092052312 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f045015c1c0 0x7f04500b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.277+0000 7f0455200640 1 --2- 172.21.15.31:0/1092052312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f045006cc20 0x7f04500b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.277+0000 7f0455200640 1 -- 172.21.15.31:0/1092052312 >> 172.21.15.31:0/1092052312 conn(0x7f04500d0c90 msgr2=0x7f04500cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:04.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.277+0000 7f0455200640 1 -- 172.21.15.31:0/1092052312 shutdown_connections 2024-09-17T05:35:04.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.277+0000 7f0455200640 1 -- 172.21.15.31:0/1092052312 wait complete. 2024-09-17T05:35:04.301 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:35:04.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.449+0000 7f7cc4400640 1 -- 172.21.15.31:0/1591971299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cbc0d07b0 msgr2=0x7f7cbc15fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:04.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.449+0000 7f7cc4400640 1 --2- 172.21.15.31:0/1591971299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cbc0d07b0 0x7f7cbc15fc20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009900 tx=0x7f7ca801f0d0 comp rx=0 tx=0).stop 2024-09-17T05:35:04.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.449+0000 7f7cc4400640 1 -- 172.21.15.31:0/1591971299 shutdown_connections 2024-09-17T05:35:04.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.449+0000 7f7cc4400640 1 --2- 172.21.15.31:0/1591971299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cbc0d07b0 0x7f7cbc15fc20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:04.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.449+0000 7f7cc4400640 1 --2- 172.21.15.31:0/1591971299 >> v2:172.21.15.155:3300/0 conn(0x7f7cbc0cfe90 0x7f7cbc0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:04.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.449+0000 7f7cc4400640 1 -- 172.21.15.31:0/1591971299 >> 172.21.15.31:0/1591971299 conn(0x7f7cbc0d1dc0 msgr2=0x7f7cbc0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:04.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.449+0000 7f7cc4400640 1 -- 172.21.15.31:0/1591971299 shutdown_connections 2024-09-17T05:35:04.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.449+0000 7f7cc4400640 1 -- 172.21.15.31:0/1591971299 wait complete. 2024-09-17T05:35:04.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.449+0000 7f7cc4400640 1 Processor -- start 2024-09-17T05:35:04.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.449+0000 7f7cc4400640 1 -- start start 2024-09-17T05:35:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc4400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cbc0b2cf0 0x7f7cbc155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc4400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cbc0cfe90 0x7f7cbc0b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc4400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cbc0d07b0 0x7f7cbc0ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc4400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc0afb30 con 0x7f7cbc0b2cf0 2024-09-17T05:35:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc4400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc0af9b0 con 0x7f7cbc0d07b0 2024-09-17T05:35:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc4400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7cbc0afcb0 con 0x7f7cbc0cfe90 2024-09-17T05:35:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc1a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cbc0b2cf0 0x7f7cbc155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc1a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cbc0b2cf0 0x7f7cbc155e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52472/0 (socket says 172.21.15.31:52472) 2024-09-17T05:35:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc1a00640 1 -- 172.21.15.31:0/3889284044 learned_addr learned my addr 172.21.15.31:0/3889284044 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc1000640 1 --2- 172.21.15.31:0/3889284044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cbc0cfe90 0x7f7cbc0b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc2400640 1 --2- 172.21.15.31:0/3889284044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cbc0d07b0 0x7f7cbc0ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:04.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc1a00640 1 -- 172.21.15.31:0/3889284044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cbc0cfe90 msgr2=0x7f7cbc0b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:04.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc1a00640 1 --2- 172.21.15.31:0/3889284044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cbc0cfe90 0x7f7cbc0b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:04.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc1a00640 1 -- 172.21.15.31:0/3889284044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cbc0d07b0 msgr2=0x7f7cbc0ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:04.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc1a00640 1 --2- 172.21.15.31:0/3889284044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cbc0d07b0 0x7f7cbc0ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:04.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc1a00640 1 -- 172.21.15.31:0/3889284044 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cbc156cf0 con 0x7f7cbc0b2cf0 2024-09-17T05:35:04.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc1000640 1 --2- 172.21.15.31:0/3889284044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cbc0cfe90 0x7f7cbc0b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:35:04.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc1a00640 1 --2- 172.21.15.31:0/3889284044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cbc0b2cf0 0x7f7cbc155e70 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000ea40 tx=0x7f7cb000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:04.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cb9600640 1 -- 172.21.15.31:0/3889284044 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000ce40 con 0x7f7cbc0b2cf0 2024-09-17T05:35:04.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cb9600640 1 -- 172.21.15.31:0/3889284044 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7cb0004020 con 0x7f7cbc0b2cf0 2024-09-17T05:35:04.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc4400640 1 -- 172.21.15.31:0/3889284044 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cbc156450 con 0x7f7cbc0b2cf0 2024-09-17T05:35:04.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cb9600640 1 -- 172.21.15.31:0/3889284044 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0004470 con 0x7f7cbc0b2cf0 2024-09-17T05:35:04.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc4400640 1 -- 172.21.15.31:0/3889284044 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cbc156a10 con 0x7f7cbc0b2cf0 2024-09-17T05:35:04.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.453+0000 7f7cc4400640 1 -- 172.21.15.31:0/3889284044 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cbc0d0270 con 0x7f7cbc0b2cf0 2024-09-17T05:35:04.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.457+0000 7f7cb9600640 1 -- 172.21.15.31:0/3889284044 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f7cb0003600 con 0x7f7cbc0b2cf0 2024-09-17T05:35:04.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.457+0000 7f7cb9600640 1 --2- 172.21.15.31:0/3889284044 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7c9c073830 0x7f7c9c075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:04.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.457+0000 7f7cb9600640 1 -- 172.21.15.31:0/3889284044 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4971+0+0 (secure 0 0 0) 0x7f7cb0095520 con 0x7f7cbc0b2cf0 2024-09-17T05:35:04.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.457+0000 7f7cc1000640 1 --2- 172.21.15.31:0/3889284044 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7c9c073830 0x7f7c9c075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:04.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.457+0000 7f7cc1000640 1 --2- 172.21.15.31:0/3889284044 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7c9c073830 0x7f7c9c075cf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80b2000 tx=0x7f7ca801d910 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:04.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.461+0000 7f7cb9600640 1 -- 172.21.15.31:0/3889284044 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7cb005f750 con 0x7f7cbc0b2cf0 2024-09-17T05:35:04.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.649+0000 7f7cc4400640 1 -- 172.21.15.31:0/3889284044 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7cbc074c70 con 0x7f7cbc0b2cf0 2024-09-17T05:35:04.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.657+0000 7f7cb9600640 1 -- 172.21.15.31:0/3889284044 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7f7cb0064180 con 0x7f7cbc0b2cf0 2024-09-17T05:35:04.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.657+0000 7f7cc4400640 1 -- 172.21.15.31:0/3889284044 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7c9c073830 msgr2=0x7f7c9c075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:04.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.657+0000 7f7cc4400640 1 --2- 172.21.15.31:0/3889284044 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7c9c073830 0x7f7c9c075cf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80b2000 tx=0x7f7ca801d910 comp rx=0 tx=0).stop 2024-09-17T05:35:04.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.657+0000 7f7cc4400640 1 -- 172.21.15.31:0/3889284044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cbc0b2cf0 msgr2=0x7f7cbc155e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:04.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.657+0000 7f7cc4400640 1 --2- 172.21.15.31:0/3889284044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cbc0b2cf0 0x7f7cbc155e70 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000ea40 tx=0x7f7cb000ef00 comp rx=0 tx=0).stop 2024-09-17T05:35:04.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.657+0000 7f7cc4400640 1 -- 172.21.15.31:0/3889284044 shutdown_connections 2024-09-17T05:35:04.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.657+0000 7f7cc4400640 1 --2- 172.21.15.31:0/3889284044 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7c9c073830 0x7f7c9c075cf0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:04.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.657+0000 7f7cc4400640 1 --2- 172.21.15.31:0/3889284044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cbc0d07b0 0x7f7cbc0ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:04.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.657+0000 7f7cc4400640 1 --2- 172.21.15.31:0/3889284044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cbc0cfe90 0x7f7cbc0b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:04.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.657+0000 7f7cc4400640 1 --2- 172.21.15.31:0/3889284044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cbc0b2cf0 0x7f7cbc155e70 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:04.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.657+0000 7f7cc4400640 1 -- 172.21.15.31:0/3889284044 >> 172.21.15.31:0/3889284044 conn(0x7f7cbc0d1dc0 msgr2=0x7f7cbc072270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:04.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.657+0000 7f7cc4400640 1 -- 172.21.15.31:0/3889284044 shutdown_connections 2024-09-17T05:35:04.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:04.657+0000 7f7cc4400640 1 -- 172.21.15.31:0/3889284044 wait complete. 2024-09-17T05:35:04.681 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:35:04.681 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:35:04.780 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:35:04.876 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:35:04.876 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:35:04.877 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:35:04.886 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:35:04.887 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:35:04.887 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:35:04.897 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:35:04.897 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:35:04.897 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:35:04.937 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:35:04.937 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:35:04.937 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:35:04.953 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:35:04.953 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:35:04.954 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:35:05.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.125+0000 7f5708000640 1 -- 172.21.15.31:0/2796810328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56e8004d50 msgr2=0x7f56e80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:05.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.125+0000 7f5708000640 1 --2- 172.21.15.31:0/2796810328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f56e8004d50 0x7f56e80051d0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f56f800c640 tx=0x7f56f801d260 comp rx=0 tx=0).stop 2024-09-17T05:35:05.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.125+0000 7f5706000640 1 -- 172.21.15.31:0/2796810328 reap_dead start 2024-09-17T05:35:05.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.125+0000 7f5708000640 1 -- 172.21.15.31:0/2796810328 shutdown_connections 2024-09-17T05:35:05.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.125+0000 7f5708000640 1 -- 172.21.15.31:0/2796810328 >> 172.21.15.31:0/2796810328 conn(0x7f57000d1dc0 msgr2=0x7f57000d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:05.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.125+0000 7f5708000640 1 -- 172.21.15.31:0/2796810328 shutdown_connections 2024-09-17T05:35:05.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.125+0000 7f5708000640 1 -- 172.21.15.31:0/2796810328 wait complete. 2024-09-17T05:35:05.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5708000640 1 Processor -- start 2024-09-17T05:35:05.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5708000640 1 -- start start 2024-09-17T05:35:05.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5708000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56e8004d50 0x7f57001607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:05.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5708000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f570015c260 0x7f570009dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:05.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5708000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5700160d10 0x7f570009e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:05.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5708000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f57000d12c0 con 0x7f570015c260 2024-09-17T05:35:05.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5708000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f57000d1140 con 0x7f56e8004d50 2024-09-17T05:35:05.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5708000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f57000d1440 con 0x7f5700160d10 2024-09-17T05:35:05.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5704c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f570015c260 0x7f570009dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:05.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5704c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f570015c260 0x7f570009dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52482/0 (socket says 172.21.15.31:52482) 2024-09-17T05:35:05.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5704c00640 1 -- 172.21.15.31:0/1589182137 learned_addr learned my addr 172.21.15.31:0/1589182137 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:05.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5705600640 1 --2- 172.21.15.31:0/1589182137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56e8004d50 0x7f57001607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:05.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5706000640 1 --2- 172.21.15.31:0/1589182137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5700160d10 0x7f570009e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:05.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5704c00640 1 -- 172.21.15.31:0/1589182137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5700160d10 msgr2=0x7f570009e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:05.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5704c00640 1 --2- 172.21.15.31:0/1589182137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5700160d10 0x7f570009e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:05.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5704c00640 1 -- 172.21.15.31:0/1589182137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56e8004d50 msgr2=0x7f57001607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:05.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5704c00640 1 --2- 172.21.15.31:0/1589182137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56e8004d50 0x7f57001607d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:05.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5704c00640 1 -- 172.21.15.31:0/1589182137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5700161290 con 0x7f570015c260 2024-09-17T05:35:05.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5704c00640 1 --2- 172.21.15.31:0/1589182137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f570015c260 0x7f570009dd00 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f56ec011650 tx=0x7f56ec011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:05.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f56fd600640 1 -- 172.21.15.31:0/1589182137 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec013720 con 0x7f570015c260 2024-09-17T05:35:05.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f56fd600640 1 -- 172.21.15.31:0/1589182137 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56ec0138e0 con 0x7f570015c260 2024-09-17T05:35:05.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f56fd600640 1 -- 172.21.15.31:0/1589182137 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec013d30 con 0x7f570015c260 2024-09-17T05:35:05.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5708000640 1 -- 172.21.15.31:0/1589182137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57001f79e0 con 0x7f570015c260 2024-09-17T05:35:05.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.129+0000 7f5708000640 1 -- 172.21.15.31:0/1589182137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57001f7fa0 con 0x7f570015c260 2024-09-17T05:35:05.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.133+0000 7f5708000640 1 -- 172.21.15.31:0/1589182137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f570006e990 con 0x7f570015c260 2024-09-17T05:35:05.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.133+0000 7f56fd600640 1 -- 172.21.15.31:0/1589182137 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f56ec024440 con 0x7f570015c260 2024-09-17T05:35:05.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.133+0000 7f56fd600640 1 --2- 172.21.15.31:0/1589182137 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f56e0073860 0x7f56e0075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:05.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.133+0000 7f56fd600640 1 -- 172.21.15.31:0/1589182137 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4971+0+0 (secure 0 0 0) 0x7f56ec0982d0 con 0x7f570015c260 2024-09-17T05:35:05.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.133+0000 7f5705600640 1 --2- 172.21.15.31:0/1589182137 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f56e0073860 0x7f56e0075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:05.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.133+0000 7f5705600640 1 --2- 172.21.15.31:0/1589182137 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f56e0073860 0x7f56e0075d20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f57000afdb0 tx=0x7f56f40091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:05.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.137+0000 7f56fd600640 1 -- 172.21.15.31:0/1589182137 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f56ec017070 con 0x7f570015c260 2024-09-17T05:35:05.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.349+0000 7f5708000640 1 -- 172.21.15.31:0/1589182137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57000b1d40 con 0x7f570015c260 2024-09-17T05:35:05.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.349+0000 7f56fd600640 1 -- 172.21.15.31:0/1589182137 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+3905 (secure 0 0 0) 0x7f56ec062d10 con 0x7f570015c260 2024-09-17T05:35:05.353 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:05.354 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":84,"btime":"2024-09-17T05:34:59:095702+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6398,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/296432902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":296432902},{"type":"v1","addr":"172.21.15.31:6834","nonce":296432902}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":6404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/951265381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":951265381},{"type":"v1","addr":"172.21.15.155:6809","nonce":951265381}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/119812259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":119812259},{"type":"v1","addr":"172.21.15.155:6835","nonce":119812259}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7761,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/249519600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":249519600},{"type":"v1","addr":"172.21.15.31:6835","nonce":249519600}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[]} 2024-09-17T05:35:05.354 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 84 2024-09-17T05:35:05.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.353+0000 7f5708000640 1 -- 172.21.15.31:0/1589182137 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f56e0073860 msgr2=0x7f56e0075d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:05.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.353+0000 7f5708000640 1 --2- 172.21.15.31:0/1589182137 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f56e0073860 0x7f56e0075d20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f57000afdb0 tx=0x7f56f40091e0 comp rx=0 tx=0).stop 2024-09-17T05:35:05.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.353+0000 7f5708000640 1 -- 172.21.15.31:0/1589182137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f570015c260 msgr2=0x7f570009dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:05.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.353+0000 7f5708000640 1 --2- 172.21.15.31:0/1589182137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f570015c260 0x7f570009dd00 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f56ec011650 tx=0x7f56ec011a50 comp rx=0 tx=0).stop 2024-09-17T05:35:05.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.353+0000 7f5708000640 1 -- 172.21.15.31:0/1589182137 shutdown_connections 2024-09-17T05:35:05.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.353+0000 7f5708000640 1 --2- 172.21.15.31:0/1589182137 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f56e0073860 0x7f56e0075d20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:05.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.353+0000 7f5708000640 1 --2- 172.21.15.31:0/1589182137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5700160d10 0x7f570009e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:05.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.353+0000 7f5708000640 1 --2- 172.21.15.31:0/1589182137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f570015c260 0x7f570009dd00 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:05.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.353+0000 7f5708000640 1 --2- 172.21.15.31:0/1589182137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f56e8004d50 0x7f57001607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:05.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.353+0000 7f5708000640 1 -- 172.21.15.31:0/1589182137 >> 172.21.15.31:0/1589182137 conn(0x7f57000d1dc0 msgr2=0x7f57000b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:05.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.353+0000 7f5708000640 1 -- 172.21.15.31:0/1589182137 shutdown_connections 2024-09-17T05:35:05.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.353+0000 7f5708000640 1 -- 172.21.15.31:0/1589182137 wait complete. 2024-09-17T05:35:05.374 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:35:05.374 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:35:05.375 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:35:05.375 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:35:05.375 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:35:05.375 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:35:05.375 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:35:05.375 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:35:05.376 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:35:05.376 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:35:05.376 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:35:05.376 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:35:05.376 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:35:05.376 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:35:05.376 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:35:05.377 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:35:05.389 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:35:05.389 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:35:05.390 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:35:05.390 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:35:05.394 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:35:05.394 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:35:05.395 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:35:05.395 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:35:05.435 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:35:05.436 DEBUG:teuthology.parallel:result is None 2024-09-17T05:35:05.437 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:35:05.437 DEBUG:teuthology.parallel:result is None 2024-09-17T05:35:05.440 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:35:05.441 DEBUG:teuthology.parallel:result is None 2024-09-17T05:35:05.442 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:35:05.443 DEBUG:teuthology.parallel:result is None 2024-09-17T05:35:05.443 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:35:05.523 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-17T05:35:05.523 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-17T05:35:05.524 INFO:tasks.ceph.mds.a.smithi031.stderr:2024-09-17T05:35:05.521+0000 7f422a000640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-17T05:35:05.533 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-17T05:35:05.533 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-17T05:35:05.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e4a000640 1 -- 172.21.15.31:0/436328964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e4415bea0 msgr2=0x7f7e440ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:05.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e4a000640 1 --2- 172.21.15.31:0/436328964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e4415bea0 0x7f7e440ce670 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f7e44073d10 tx=0x7f7e3401c830 comp rx=0 tx=0).stop 2024-09-17T05:35:05.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e4a000640 1 -- 172.21.15.31:0/436328964 shutdown_connections 2024-09-17T05:35:05.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e4a000640 1 --2- 172.21.15.31:0/436328964 >> v2:172.21.15.155:3300/0 conn(0x7f7e440cdb30 0x7f7e440cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:05.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e4a000640 1 --2- 172.21.15.31:0/436328964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e4415bea0 0x7f7e440ce670 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:05.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e4a000640 1 -- 172.21.15.31:0/436328964 >> 172.21.15.31:0/436328964 conn(0x7f7e440d1dc0 msgr2=0x7f7e440d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:05.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e4a000640 1 -- 172.21.15.31:0/436328964 shutdown_connections 2024-09-17T05:35:05.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e4a000640 1 -- 172.21.15.31:0/436328964 wait complete. 2024-09-17T05:35:05.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e4a000640 1 Processor -- start 2024-09-17T05:35:05.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e4a000640 1 -- start start 2024-09-17T05:35:05.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e4a000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e440cdb30 0x7f7e4415a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:05.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e4a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e440d28e0 0x7f7e44144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:05.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e4a000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e4415bea0 0x7f7e440b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:05.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e4a000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7e44168fc0 con 0x7f7e440d28e0 2024-09-17T05:35:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e4a000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7e44168e40 con 0x7f7e4415bea0 2024-09-17T05:35:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e4a000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7e44169140 con 0x7f7e440cdb30 2024-09-17T05:35:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e3aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e440d28e0 0x7f7e44144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e3aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e440d28e0 0x7f7e44144d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52536/0 (socket says 172.21.15.31:52536) 2024-09-17T05:35:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e3aa00640 1 -- 172.21.15.31:0/1776440894 learned_addr learned my addr 172.21.15.31:0/1776440894 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e43400640 1 --2- 172.21.15.31:0/1776440894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e440cdb30 0x7f7e4415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.593+0000 7f7e43e00640 1 --2- 172.21.15.31:0/1776440894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e4415bea0 0x7f7e440b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.597+0000 7f7e3aa00640 1 -- 172.21.15.31:0/1776440894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e440cdb30 msgr2=0x7f7e4415a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.597+0000 7f7e3aa00640 1 --2- 172.21.15.31:0/1776440894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e440cdb30 0x7f7e4415a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.597+0000 7f7e3aa00640 1 -- 172.21.15.31:0/1776440894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e4415bea0 msgr2=0x7f7e440b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.597+0000 7f7e3aa00640 1 --2- 172.21.15.31:0/1776440894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e4415bea0 0x7f7e440b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.597+0000 7f7e3aa00640 1 -- 172.21.15.31:0/1776440894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4415a8a0 con 0x7f7e440d28e0 2024-09-17T05:35:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.597+0000 7f7e43e00640 1 --2- 172.21.15.31:0/1776440894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e4415bea0 0x7f7e440b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:05.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.597+0000 7f7e3aa00640 1 --2- 172.21.15.31:0/1776440894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e440d28e0 0x7f7e44144d30 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00ea20 tx=0x7f7e2c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:05.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.597+0000 7f7e3be00640 1 -- 172.21.15.31:0/1776440894 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c00cd80 con 0x7f7e440d28e0 2024-09-17T05:35:05.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.597+0000 7f7e3be00640 1 -- 172.21.15.31:0/1776440894 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e2c010430 con 0x7f7e440d28e0 2024-09-17T05:35:05.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.597+0000 7f7e3be00640 1 -- 172.21.15.31:0/1776440894 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c010860 con 0x7f7e440d28e0 2024-09-17T05:35:05.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.597+0000 7f7e4a000640 1 -- 172.21.15.31:0/1776440894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e44147970 con 0x7f7e440d28e0 2024-09-17T05:35:05.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.597+0000 7f7e4a000640 1 -- 172.21.15.31:0/1776440894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e44147f30 con 0x7f7e440d28e0 2024-09-17T05:35:05.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.597+0000 7f7e4a000640 1 -- 172.21.15.31:0/1776440894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e440cc9d0 con 0x7f7e440d28e0 2024-09-17T05:35:05.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.597+0000 7f7e3be00640 1 -- 172.21.15.31:0/1776440894 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f7e2c010a00 con 0x7f7e440d28e0 2024-09-17T05:35:05.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.597+0000 7f7e3be00640 1 --2- 172.21.15.31:0/1776440894 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7e20073830 0x7f7e20075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:05.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.601+0000 7f7e3be00640 1 -- 172.21.15.31:0/1776440894 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4971+0+0 (secure 0 0 0) 0x7f7e2c095680 con 0x7f7e440d28e0 2024-09-17T05:35:05.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.601+0000 7f7e43400640 1 --2- 172.21.15.31:0/1776440894 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7e20073830 0x7f7e20075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:05.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.601+0000 7f7e43400640 1 --2- 172.21.15.31:0/1776440894 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7e20073830 0x7f7e20075cf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7e340af000 tx=0x7f7e340a7040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:05.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.601+0000 7f7e3be00640 1 -- 172.21.15.31:0/1776440894 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7e2c05f930 con 0x7f7e440d28e0 2024-09-17T05:35:05.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:05.793+0000 7f7e4a000640 1 -- 172.21.15.31:0/1776440894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7e440b60f0 con 0x7f7e440d28e0 2024-09-17T05:35:06.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.673+0000 7f7e3be00640 1 -- 172.21.15.31:0/1776440894 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v126) ==== 97+0+0 (secure 0 0 0) 0x7f7e2c064360 con 0x7f7e440d28e0 2024-09-17T05:35:06.677 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2024-09-17T05:35:06.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.677+0000 7f7e4a000640 1 -- 172.21.15.31:0/1776440894 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7e20073830 msgr2=0x7f7e20075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:06.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.677+0000 7f7e4a000640 1 --2- 172.21.15.31:0/1776440894 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7e20073830 0x7f7e20075cf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7e340af000 tx=0x7f7e340a7040 comp rx=0 tx=0).stop 2024-09-17T05:35:06.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.677+0000 7f7e4a000640 1 -- 172.21.15.31:0/1776440894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e440d28e0 msgr2=0x7f7e44144d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:06.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.677+0000 7f7e4a000640 1 --2- 172.21.15.31:0/1776440894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e440d28e0 0x7f7e44144d30 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c00ea20 tx=0x7f7e2c00eee0 comp rx=0 tx=0).stop 2024-09-17T05:35:06.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.677+0000 7f7e4a000640 1 -- 172.21.15.31:0/1776440894 shutdown_connections 2024-09-17T05:35:06.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.677+0000 7f7e4a000640 1 --2- 172.21.15.31:0/1776440894 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7e20073830 0x7f7e20075cf0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:06.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.677+0000 7f7e4a000640 1 --2- 172.21.15.31:0/1776440894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e4415bea0 0x7f7e440b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:06.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.677+0000 7f7e4a000640 1 --2- 172.21.15.31:0/1776440894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e440d28e0 0x7f7e44144d30 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:06.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.677+0000 7f7e4a000640 1 --2- 172.21.15.31:0/1776440894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e440cdb30 0x7f7e4415a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:06.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.677+0000 7f7e4a000640 1 -- 172.21.15.31:0/1776440894 >> 172.21.15.31:0/1776440894 conn(0x7f7e440d1dc0 msgr2=0x7f7e4406f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:06.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.677+0000 7f7e4a000640 1 -- 172.21.15.31:0/1776440894 shutdown_connections 2024-09-17T05:35:06.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.677+0000 7f7e4a000640 1 -- 172.21.15.31:0/1776440894 wait complete. 2024-09-17T05:35:06.703 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:35:06.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.853+0000 7f3cb6800640 1 -- 172.21.15.31:0/2145621214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb00ced80 msgr2=0x7f3cb00ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:06.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.853+0000 7f3cb6800640 1 --2- 172.21.15.31:0/2145621214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb00ced80 0x7f3cb00ae9b0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009900 tx=0x7f3c9801c8e0 comp rx=0 tx=0).stop 2024-09-17T05:35:06.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.853+0000 7f3cb6800640 1 -- 172.21.15.31:0/2145621214 shutdown_connections 2024-09-17T05:35:06.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.853+0000 7f3cb6800640 1 --2- 172.21.15.31:0/2145621214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb00ced80 0x7f3cb00ae9b0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:06.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.853+0000 7f3cb6800640 1 -- 172.21.15.31:0/2145621214 >> 172.21.15.31:0/2145621214 conn(0x7f3cb00d1dc0 msgr2=0x7f3cb00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:06.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.853+0000 7f3cb6800640 1 -- 172.21.15.31:0/2145621214 shutdown_connections 2024-09-17T05:35:06.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.853+0000 7f3cb6800640 1 -- 172.21.15.31:0/2145621214 wait complete. 2024-09-17T05:35:06.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.853+0000 7f3cb6800640 1 Processor -- start 2024-09-17T05:35:06.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.853+0000 7f3cb6800640 1 -- start start 2024-09-17T05:35:06.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3cb6800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cb00cdb30 0x7f3cb01670c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:06.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3cb6800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb00ced80 0x7f3cb00b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:06.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3cb6800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cb015bea0 0x7f3cb00b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:06.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3cb6800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb016a840 con 0x7f3cb00ced80 2024-09-17T05:35:06.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3cb6800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb016a6c0 con 0x7f3cb015bea0 2024-09-17T05:35:06.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3cb6800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb016a9c0 con 0x7f3cb00cdb30 2024-09-17T05:35:06.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3ca6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb00ced80 0x7f3cb00b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:06.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3ca6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb00ced80 0x7f3cb00b1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52564/0 (socket says 172.21.15.31:52564) 2024-09-17T05:35:06.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3ca6a00640 1 -- 172.21.15.31:0/288823305 learned_addr learned my addr 172.21.15.31:0/288823305 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:06.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3caf400640 1 --2- 172.21.15.31:0/288823305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cb00cdb30 0x7f3cb01670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:06.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3cafe00640 1 --2- 172.21.15.31:0/288823305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cb015bea0 0x7f3cb00b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:06.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3ca6a00640 1 -- 172.21.15.31:0/288823305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cb00cdb30 msgr2=0x7f3cb01670c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:06.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3ca6a00640 1 --2- 172.21.15.31:0/288823305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cb00cdb30 0x7f3cb01670c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:06.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3ca6a00640 1 -- 172.21.15.31:0/288823305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cb015bea0 msgr2=0x7f3cb00b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:06.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3ca6a00640 1 --2- 172.21.15.31:0/288823305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cb015bea0 0x7f3cb00b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:06.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3ca6a00640 1 -- 172.21.15.31:0/288823305 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb00cb850 con 0x7f3cb00ced80 2024-09-17T05:35:06.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3ca6a00640 1 --2- 172.21.15.31:0/288823305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb00ced80 0x7f3cb00b1fd0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009850 tx=0x7f3c980040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:06.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3ca7e00640 1 -- 172.21.15.31:0/288823305 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c980bc020 con 0x7f3cb00ced80 2024-09-17T05:35:06.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3ca7e00640 1 -- 172.21.15.31:0/288823305 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c98003600 con 0x7f3cb00ced80 2024-09-17T05:35:06.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3cb6800640 1 -- 172.21.15.31:0/288823305 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb0167600 con 0x7f3cb00ced80 2024-09-17T05:35:06.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3ca7e00640 1 -- 172.21.15.31:0/288823305 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c980b2040 con 0x7f3cb00ced80 2024-09-17T05:35:06.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3cb6800640 1 -- 172.21.15.31:0/288823305 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb00cafb0 con 0x7f3cb00ced80 2024-09-17T05:35:06.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.857+0000 7f3cb6800640 1 -- 172.21.15.31:0/288823305 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb00ce670 con 0x7f3cb00ced80 2024-09-17T05:35:06.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.861+0000 7f3ca7e00640 1 -- 172.21.15.31:0/288823305 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f3c980bf070 con 0x7f3cb00ced80 2024-09-17T05:35:06.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.861+0000 7f3ca7e00640 1 --2- 172.21.15.31:0/288823305 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3c8c073830 0x7f3c8c075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:06.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.861+0000 7f3ca7e00640 1 -- 172.21.15.31:0/288823305 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 4885+0+0 (secure 0 0 0) 0x7f3c9812e9e0 con 0x7f3cb00ced80 2024-09-17T05:35:06.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.861+0000 7f3caf400640 1 --2- 172.21.15.31:0/288823305 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3c8c073830 0x7f3c8c075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:06.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.861+0000 7f3caf400640 1 --2- 172.21.15.31:0/288823305 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3c8c073830 0x7f3c8c075cf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00098e0 tx=0x7f3ca0009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:06.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:06.865+0000 7f3ca7e00640 1 -- 172.21.15.31:0/288823305 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f3cb0167600 con 0x7f3cb00ced80 2024-09-17T05:35:07.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.105+0000 7f3cb6800640 1 -- 172.21.15.31:0/288823305 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f3cb006e270 con 0x7f3cb00ced80 2024-09-17T05:35:07.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.105+0000 7f3ca7e00640 1 -- 172.21.15.31:0/288823305 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) ==== 80+0+5304 (secure 0 0 0) 0x7f3c980164d0 con 0x7f3cb00ced80 2024-09-17T05:35:07.106 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:07.106 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:35:07.107 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2024-09-17T05:35:07.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.107 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2024-09-17T05:35:07.107 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmoloQARAAbTcR/1F1qz7Crjdu1NPSgw==", 2024-09-17T05:35:07.107 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.107 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:35:07.107 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:35:07.107 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:35:07.107 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:07.107 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:07.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.107 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2024-09-17T05:35:07.108 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmYrdRDRAAkaDz03U3lMZlkLEVFYlTaw==", 2024-09-17T05:35:07.108 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.108 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:35:07.108 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:35:07.108 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:35:07.108 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:07.108 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:07.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.108 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2024-09-17T05:35:07.108 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmpFRCCBAAZRsuAVwSxuMGDeoYCwWFeg==", 2024-09-17T05:35:07.109 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.109 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:35:07.109 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:35:07.109 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:35:07.109 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:07.109 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:07.109 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.109 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2024-09-17T05:35:07.109 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lm23PSFBAAuO+k0kWY28PN7+pEtlUniQ==", 2024-09-17T05:35:07.109 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.109 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:35:07.109 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:35:07.110 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:35:07.110 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:07.110 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:07.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.110 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2024-09-17T05:35:07.110 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBTE+lm0miKHxAA2C1pfwBxJtKQhu4xuPumxg==", 2024-09-17T05:35:07.110 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.110 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:35:07.110 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:35:07.110 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:07.110 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:07.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.111 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2024-09-17T05:35:07.111 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBWE+lmdQi7NRAA2v4ETg4jynbPF0K4E73KAA==", 2024-09-17T05:35:07.111 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.111 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:35:07.111 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:35:07.111 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:07.111 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:07.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.111 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2024-09-17T05:35:07.112 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBaE+lm18eUEBAA8gAhUx9UNa2Lk4uyFBd7Nw==", 2024-09-17T05:35:07.112 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.112 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:35:07.112 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:35:07.112 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:07.112 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:07.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.112 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2024-09-17T05:35:07.112 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBdE+lm00moJBAAizrxOP4rI4fGR91dYzlEkw==", 2024-09-17T05:35:07.112 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.112 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:35:07.112 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:35:07.113 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:07.113 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:07.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.113 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2024-09-17T05:35:07.113 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBjE+lmhdtUJhAA7+KM8DwQriFwMbpqXAPTuA==", 2024-09-17T05:35:07.113 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.113 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:35:07.113 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:35:07.113 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:07.113 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:07.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.114 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2024-09-17T05:35:07.114 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBmE+lm5cByOhAAiMnQIv2O41am/3E+0dp4sg==", 2024-09-17T05:35:07.114 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.114 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:35:07.114 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:35:07.114 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:07.114 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:07.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.114 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2024-09-17T05:35:07.114 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBqE+lm19FhExAAo/Sfj2SX5+Y2/Fxz8mbiNQ==", 2024-09-17T05:35:07.114 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.115 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:35:07.115 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:35:07.115 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:07.115 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:07.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.115 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2024-09-17T05:35:07.115 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBtE+lmISDbKBAAapUBS+t+N1vUcCbdJic8Dw==", 2024-09-17T05:35:07.115 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.115 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:35:07.115 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:35:07.115 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:07.116 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:07.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.116 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2024-09-17T05:35:07.116 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw==", 2024-09-17T05:35:07.116 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.116 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:35:07.116 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2024-09-17T05:35:07.116 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:35:07.116 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:07.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.116 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2024-09-17T05:35:07.117 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmb2pmIhAA7p+G+WnB7ujZZdSlaossYg==", 2024-09-17T05:35:07.117 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.117 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:35:07.117 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:35:07.117 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:35:07.117 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:35:07.117 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:07.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.117 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2024-09-17T05:35:07.117 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmAPPaHhAAyz/gKunaNFyrdkAUy50qmQ==", 2024-09-17T05:35:07.117 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.117 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:35:07.118 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:35:07.118 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:35:07.118 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:35:07.118 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:07.118 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.118 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2024-09-17T05:35:07.118 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lml72BKBAAgAji5TWedU7azT5oQz3fYg==", 2024-09-17T05:35:07.118 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.118 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:35:07.118 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:35:07.118 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:35:07.119 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:35:07.119 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:07.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.119 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2024-09-17T05:35:07.119 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmtgltIRAAeTv/U/vZ9ZIuGN4JXTHD0A==", 2024-09-17T05:35:07.119 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.119 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:35:07.119 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:35:07.119 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:35:07.119 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:07.119 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:07.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.120 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2024-09-17T05:35:07.120 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmTt2oOBAAmR5ykU4WbEzlKFiwI7sMdg==", 2024-09-17T05:35:07.120 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.120 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:35:07.120 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:35:07.120 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:07.120 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:07.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.120 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2024-09-17T05:35:07.120 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmKILYNBAAojM8RIq92dO2DQyXppReIw==", 2024-09-17T05:35:07.120 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:07.121 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:35:07.121 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:35:07.121 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:07.121 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.121 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.121 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:35:07.121 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:35:07.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.105+0000 7f3cb6800640 1 -- 172.21.15.31:0/288823305 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3c8c073830 msgr2=0x7f3c8c075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:07.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.105+0000 7f3cb6800640 1 --2- 172.21.15.31:0/288823305 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3c8c073830 0x7f3c8c075cf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00098e0 tx=0x7f3ca0009060 comp rx=0 tx=0).stop 2024-09-17T05:35:07.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.105+0000 7f3cb6800640 1 -- 172.21.15.31:0/288823305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb00ced80 msgr2=0x7f3cb00b1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:07.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.105+0000 7f3cb6800640 1 --2- 172.21.15.31:0/288823305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb00ced80 0x7f3cb00b1fd0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009850 tx=0x7f3c980040c0 comp rx=0 tx=0).stop 2024-09-17T05:35:07.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.105+0000 7f3cb6800640 1 -- 172.21.15.31:0/288823305 shutdown_connections 2024-09-17T05:35:07.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.105+0000 7f3cb6800640 1 --2- 172.21.15.31:0/288823305 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3c8c073830 0x7f3c8c075cf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:07.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.105+0000 7f3cb6800640 1 --2- 172.21.15.31:0/288823305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cb015bea0 0x7f3cb00b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:07.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.105+0000 7f3cb6800640 1 --2- 172.21.15.31:0/288823305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3cb00ced80 0x7f3cb00b1fd0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:07.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.105+0000 7f3cb6800640 1 --2- 172.21.15.31:0/288823305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cb00cdb30 0x7f3cb01670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:07.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.105+0000 7f3cb6800640 1 -- 172.21.15.31:0/288823305 >> 172.21.15.31:0/288823305 conn(0x7f3cb00d1dc0 msgr2=0x7f3cb00b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:07.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.105+0000 7f3cb6800640 1 -- 172.21.15.31:0/288823305 shutdown_connections 2024-09-17T05:35:07.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.105+0000 7f3cb6800640 1 -- 172.21.15.31:0/288823305 wait complete. 2024-09-17T05:35:07.128 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:35:07.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.273+0000 7feb7a600640 1 -- 172.21.15.31:0/4016847220 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb58004810 msgr2=0x7feb58004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:07.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.273+0000 7feb7a600640 1 --2- 172.21.15.31:0/4016847220 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb58004810 0x7feb58004c90 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7feb6000c2e0 tx=0x7feb6001f700 comp rx=0 tx=0).stop 2024-09-17T05:35:07.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.273+0000 7feb73e00640 1 -- 172.21.15.31:0/4016847220 reap_dead start 2024-09-17T05:35:07.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.273+0000 7feb7a600640 1 -- 172.21.15.31:0/4016847220 shutdown_connections 2024-09-17T05:35:07.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.273+0000 7feb7a600640 1 -- 172.21.15.31:0/4016847220 >> 172.21.15.31:0/4016847220 conn(0x7feb740d1dc0 msgr2=0x7feb740d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:07.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.273+0000 7feb7a600640 1 -- 172.21.15.31:0/4016847220 shutdown_connections 2024-09-17T05:35:07.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.273+0000 7feb7a600640 1 -- 172.21.15.31:0/4016847220 wait complete. 2024-09-17T05:35:07.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb7a600640 1 Processor -- start 2024-09-17T05:35:07.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb7a600640 1 -- start start 2024-09-17T05:35:07.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb7a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb58004810 0x7feb7415c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:07.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb7a600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb740c5570 0x7feb741f1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:07.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb7a600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb741f2490 0x7feb740b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:07.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb7a600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7feb740cebb0 con 0x7feb58004810 2024-09-17T05:35:07.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb7a600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feb7415c490 con 0x7feb740c5570 2024-09-17T05:35:07.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb7a600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feb740ced30 con 0x7feb741f2490 2024-09-17T05:35:07.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb73400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb58004810 0x7feb7415c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:07.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb73400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb58004810 0x7feb7415c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52582/0 (socket says 172.21.15.31:52582) 2024-09-17T05:35:07.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb73400640 1 -- 172.21.15.31:0/784073924 learned_addr learned my addr 172.21.15.31:0/784073924 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:07.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb73e00640 1 --2- 172.21.15.31:0/784073924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb741f2490 0x7feb740b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:07.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb72a00640 1 --2- 172.21.15.31:0/784073924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb740c5570 0x7feb741f1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:07.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb73400640 1 -- 172.21.15.31:0/784073924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb741f2490 msgr2=0x7feb740b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:07.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb73400640 1 --2- 172.21.15.31:0/784073924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb741f2490 0x7feb740b2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:07.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb73400640 1 -- 172.21.15.31:0/784073924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb740c5570 msgr2=0x7feb741f1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:07.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb73400640 1 --2- 172.21.15.31:0/784073924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb740c5570 0x7feb741f1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:07.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb73400640 1 -- 172.21.15.31:0/784073924 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb740c5ac0 con 0x7feb58004810 2024-09-17T05:35:07.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb72a00640 1 --2- 172.21.15.31:0/784073924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb740c5570 0x7feb741f1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:07.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb73e00640 1 --2- 172.21.15.31:0/784073924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb741f2490 0x7feb740b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:07.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb73400640 1 --2- 172.21.15.31:0/784073924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb58004810 0x7feb7415c610 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7feb64011ab0 tx=0x7feb64011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:07.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb6b400640 1 -- 172.21.15.31:0/784073924 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6401e070 con 0x7feb58004810 2024-09-17T05:35:07.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb6b400640 1 -- 172.21.15.31:0/784073924 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb6400fc50 con 0x7feb58004810 2024-09-17T05:35:07.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb6b400640 1 -- 172.21.15.31:0/784073924 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb64019410 con 0x7feb58004810 2024-09-17T05:35:07.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb7a600640 1 -- 172.21.15.31:0/784073924 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb740c5da0 con 0x7feb58004810 2024-09-17T05:35:07.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.277+0000 7feb7a600640 1 -- 172.21.15.31:0/784073924 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb740c6640 con 0x7feb58004810 2024-09-17T05:35:07.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.281+0000 7feb7a600640 1 -- 172.21.15.31:0/784073924 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb740ce670 con 0x7feb58004810 2024-09-17T05:35:07.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.281+0000 7feb6b400640 1 -- 172.21.15.31:0/784073924 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7feb64021070 con 0x7feb58004810 2024-09-17T05:35:07.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.281+0000 7feb6b400640 1 --2- 172.21.15.31:0/784073924 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7feb54073830 0x7feb54075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:07.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.281+0000 7feb6b400640 1 -- 172.21.15.31:0/784073924 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 4885+0+0 (secure 0 0 0) 0x7feb64095300 con 0x7feb58004810 2024-09-17T05:35:07.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.281+0000 7feb72a00640 1 --2- 172.21.15.31:0/784073924 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7feb54073830 0x7feb54075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:07.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.281+0000 7feb72a00640 1 --2- 172.21.15.31:0/784073924 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7feb54073830 0x7feb54075cf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7feb600b0000 tx=0x7feb6001c540 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:07.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.285+0000 7feb6b400640 1 -- 172.21.15.31:0/784073924 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7feb6405f6c0 con 0x7feb58004810 2024-09-17T05:35:07.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.461+0000 7feb7a600640 1 -- 172.21.15.31:0/784073924 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7feb740c5f70 con 0x7feb58004810 2024-09-17T05:35:07.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.461+0000 7feb6b400640 1 -- 172.21.15.31:0/784073924 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v126) ==== 84+0+65 (secure 0 0 0) 0x7feb64095120 con 0x7feb58004810 2024-09-17T05:35:07.465 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:07.465 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:35:07.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:07.465 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-09-17T05:35:07.465 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-09-17T05:35:07.465 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:07.465 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:35:07.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.465+0000 7feb7a600640 1 -- 172.21.15.31:0/784073924 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7feb54073830 msgr2=0x7feb54075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:07.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.465+0000 7feb7a600640 1 --2- 172.21.15.31:0/784073924 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7feb54073830 0x7feb54075cf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7feb600b0000 tx=0x7feb6001c540 comp rx=0 tx=0).stop 2024-09-17T05:35:07.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.465+0000 7feb7a600640 1 -- 172.21.15.31:0/784073924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb58004810 msgr2=0x7feb7415c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:07.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.465+0000 7feb7a600640 1 --2- 172.21.15.31:0/784073924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb58004810 0x7feb7415c610 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7feb64011ab0 tx=0x7feb64011f70 comp rx=0 tx=0).stop 2024-09-17T05:35:07.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.465+0000 7feb7a600640 1 -- 172.21.15.31:0/784073924 shutdown_connections 2024-09-17T05:35:07.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.465+0000 7feb7a600640 1 --2- 172.21.15.31:0/784073924 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7feb54073830 0x7feb54075cf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:07.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.465+0000 7feb7a600640 1 --2- 172.21.15.31:0/784073924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feb741f2490 0x7feb740b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:07.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.465+0000 7feb7a600640 1 --2- 172.21.15.31:0/784073924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb740c5570 0x7feb741f1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:07.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.465+0000 7feb7a600640 1 --2- 172.21.15.31:0/784073924 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb58004810 0x7feb7415c610 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:07.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.465+0000 7feb7a600640 1 -- 172.21.15.31:0/784073924 >> 172.21.15.31:0/784073924 conn(0x7feb740d1dc0 msgr2=0x7feb740b5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:07.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.465+0000 7feb7a600640 1 -- 172.21.15.31:0/784073924 shutdown_connections 2024-09-17T05:35:07.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.465+0000 7feb7a600640 1 -- 172.21.15.31:0/784073924 wait complete. 2024-09-17T05:35:07.487 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:35:07.487 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:35:07.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc7a400640 1 -- 172.21.15.31:0/3791646836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc7415be10 msgr2=0x7fdc740ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:07.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc7a400640 1 --2- 172.21.15.31:0/3791646836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc7415be10 0x7fdc740ce700 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fdc740746b0 tx=0x7fdc6401f0b0 comp rx=0 tx=0).stop 2024-09-17T05:35:07.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc7a400640 1 -- 172.21.15.31:0/3791646836 shutdown_connections 2024-09-17T05:35:07.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc7a400640 1 --2- 172.21.15.31:0/3791646836 >> v2:172.21.15.155:3300/0 conn(0x7fdc7415c1f0 0x7fdc740cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:07.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc7a400640 1 --2- 172.21.15.31:0/3791646836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc7415be10 0x7fdc740ce700 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:07.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc7a400640 1 -- 172.21.15.31:0/3791646836 >> 172.21.15.31:0/3791646836 conn(0x7fdc740d1da0 msgr2=0x7fdc740d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:07.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc7a400640 1 -- 172.21.15.31:0/3791646836 shutdown_connections 2024-09-17T05:35:07.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc7a400640 1 -- 172.21.15.31:0/3791646836 wait complete. 2024-09-17T05:35:07.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc7a400640 1 Processor -- start 2024-09-17T05:35:07.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc7a400640 1 -- start start 2024-09-17T05:35:07.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc7a400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc740b0b60 0x7fdc74156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:07.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc7a400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc7415be10 0x7fdc740ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:07.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc7a400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7415c1f0 0x7fdc740b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:07.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc7a400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdc740cf510 con 0x7fdc7415be10 2024-09-17T05:35:07.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc7a400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdc740cf390 con 0x7fdc7415c1f0 2024-09-17T05:35:07.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc7a400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdc74160290 con 0x7fdc740b0b60 2024-09-17T05:35:07.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc6be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc7415be10 0x7fdc740ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc6be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc7415be10 0x7fdc740ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:52606/0 (socket says 172.21.15.31:52606) 2024-09-17T05:35:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.637+0000 7fdc6be00640 1 -- 172.21.15.31:0/2406718713 learned_addr learned my addr 172.21.15.31:0/2406718713 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.641+0000 7fdc73e00640 1 --2- 172.21.15.31:0/2406718713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7415c1f0 0x7fdc740b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.641+0000 7fdc73400640 1 --2- 172.21.15.31:0/2406718713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc740b0b60 0x7fdc74156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.641+0000 7fdc6be00640 1 -- 172.21.15.31:0/2406718713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc740b0b60 msgr2=0x7fdc74156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.641+0000 7fdc6be00640 1 --2- 172.21.15.31:0/2406718713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc740b0b60 0x7fdc74156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.641+0000 7fdc6be00640 1 -- 172.21.15.31:0/2406718713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7415c1f0 msgr2=0x7fdc740b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.641+0000 7fdc6be00640 1 --2- 172.21.15.31:0/2406718713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7415c1f0 0x7fdc740b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.641+0000 7fdc6be00640 1 -- 172.21.15.31:0/2406718713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc740c9010 con 0x7fdc7415be10 2024-09-17T05:35:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.641+0000 7fdc73400640 1 --2- 172.21.15.31:0/2406718713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc740b0b60 0x7fdc74156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.641+0000 7fdc6be00640 1 --2- 172.21.15.31:0/2406718713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc7415be10 0x7fdc740ca730 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0058d0 tx=0x7fdc5c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.641+0000 7fdc6b400640 1 -- 172.21.15.31:0/2406718713 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c017070 con 0x7fdc7415be10 2024-09-17T05:35:07.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.641+0000 7fdc6b400640 1 -- 172.21.15.31:0/2406718713 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc5c009d20 con 0x7fdc7415be10 2024-09-17T05:35:07.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.641+0000 7fdc7a400640 1 -- 172.21.15.31:0/2406718713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc740c92f0 con 0x7fdc7415be10 2024-09-17T05:35:07.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.641+0000 7fdc6b400640 1 -- 172.21.15.31:0/2406718713 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c0106c0 con 0x7fdc7415be10 2024-09-17T05:35:07.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.641+0000 7fdc7a400640 1 -- 172.21.15.31:0/2406718713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc740c98b0 con 0x7fdc7415be10 2024-09-17T05:35:07.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.641+0000 7fdc7a400640 1 -- 172.21.15.31:0/2406718713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc741607b0 con 0x7fdc7415be10 2024-09-17T05:35:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.641+0000 7fdc6b400640 1 -- 172.21.15.31:0/2406718713 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fdc5c01a070 con 0x7fdc7415be10 2024-09-17T05:35:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.641+0000 7fdc6b400640 1 --2- 172.21.15.31:0/2406718713 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdc50073830 0x7fdc50075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.645+0000 7fdc6b400640 1 -- 172.21.15.31:0/2406718713 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 4885+0+0 (secure 0 0 0) 0x7fdc5c094d80 con 0x7fdc7415be10 2024-09-17T05:35:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.645+0000 7fdc73400640 1 --2- 172.21.15.31:0/2406718713 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdc50073830 0x7fdc50075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.645+0000 7fdc73400640 1 --2- 172.21.15.31:0/2406718713 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdc50073830 0x7fdc50075cf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdc640b2000 tx=0x7fdc6401d8f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:07.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.649+0000 7fdc6b400640 1 -- 172.21.15.31:0/2406718713 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fdc5c05f6d0 con 0x7fdc7415be10 2024-09-17T05:35:07.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:07.825+0000 7fdc7a400640 1 -- 172.21.15.31:0/2406718713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fdc74070350 con 0x7fdc7415be10 2024-09-17T05:35:08.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.677+0000 7fdc6b400640 1 -- 172.21.15.31:0/2406718713 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v127) ==== 138+0+0 (secure 0 0 0) 0x7fdc5c05efd0 con 0x7fdc7415be10 2024-09-17T05:35:08.681 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-09-17T05:35:08.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.681+0000 7fdc7a400640 1 -- 172.21.15.31:0/2406718713 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdc50073830 msgr2=0x7fdc50075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:08.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.681+0000 7fdc7a400640 1 --2- 172.21.15.31:0/2406718713 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdc50073830 0x7fdc50075cf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdc640b2000 tx=0x7fdc6401d8f0 comp rx=0 tx=0).stop 2024-09-17T05:35:08.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.681+0000 7fdc7a400640 1 -- 172.21.15.31:0/2406718713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc7415be10 msgr2=0x7fdc740ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:08.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.681+0000 7fdc7a400640 1 --2- 172.21.15.31:0/2406718713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc7415be10 0x7fdc740ca730 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0058d0 tx=0x7fdc5c00dde0 comp rx=0 tx=0).stop 2024-09-17T05:35:08.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.681+0000 7fdc7a400640 1 -- 172.21.15.31:0/2406718713 shutdown_connections 2024-09-17T05:35:08.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.681+0000 7fdc7a400640 1 --2- 172.21.15.31:0/2406718713 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdc50073830 0x7fdc50075cf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:08.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.681+0000 7fdc7a400640 1 --2- 172.21.15.31:0/2406718713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc7415c1f0 0x7fdc740b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:08.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.681+0000 7fdc7a400640 1 --2- 172.21.15.31:0/2406718713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc7415be10 0x7fdc740ca730 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:08.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.681+0000 7fdc7a400640 1 --2- 172.21.15.31:0/2406718713 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc740b0b60 0x7fdc74156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:08.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.681+0000 7fdc7a400640 1 -- 172.21.15.31:0/2406718713 >> 172.21.15.31:0/2406718713 conn(0x7fdc740d1da0 msgr2=0x7fdc74070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:08.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.681+0000 7fdc7a400640 1 -- 172.21.15.31:0/2406718713 shutdown_connections 2024-09-17T05:35:08.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.681+0000 7fdc7a400640 1 -- 172.21.15.31:0/2406718713 wait complete. 2024-09-17T05:35:08.713 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:35:08.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.869+0000 7f0db1600640 1 -- 172.21.15.31:0/1477629337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0dac0b1650 msgr2=0x7f0dac0b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:08.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.869+0000 7f0db1600640 1 --2- 172.21.15.31:0/1477629337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0dac0b1650 0x7f0dac0b1a30 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0754a0 tx=0x7f0d9401c8c0 comp rx=0 tx=0).stop 2024-09-17T05:35:08.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.869+0000 7f0db1600640 1 -- 172.21.15.31:0/1477629337 shutdown_connections 2024-09-17T05:35:08.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.869+0000 7f0db1600640 1 --2- 172.21.15.31:0/1477629337 >> v2:172.21.15.155:3300/0 conn(0x7f0dac0afb10 0x7f0dac0affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:08.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.869+0000 7f0db1600640 1 --2- 172.21.15.31:0/1477629337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0dac0b1650 0x7f0dac0b1a30 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:08.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.869+0000 7f0db1600640 1 -- 172.21.15.31:0/1477629337 >> 172.21.15.31:0/1477629337 conn(0x7f0dac0d1dd0 msgr2=0x7f0dac0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:08.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.869+0000 7f0db1600640 1 -- 172.21.15.31:0/1477629337 shutdown_connections 2024-09-17T05:35:08.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.869+0000 7f0db1600640 1 -- 172.21.15.31:0/1477629337 wait complete. 2024-09-17T05:35:08.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0db1600640 1 Processor -- start 2024-09-17T05:35:08.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0db1600640 1 -- start start 2024-09-17T05:35:08.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0db1600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dac0afb10 0x7f0dac15a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:08.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0db1600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0dac0b1650 0x7f0dac06dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:08.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0db1600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dac1605d0 0x7f0dac157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:08.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0db1600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0dac169540 con 0x7f0dac0b1650 2024-09-17T05:35:08.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0db1600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0dac0b1430 con 0x7f0dac1605d0 2024-09-17T05:35:08.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0db1600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0dac1696c0 con 0x7f0dac0afb10 2024-09-17T05:35:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0da2000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0dac0b1650 0x7f0dac06dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0da2000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0dac0b1650 0x7f0dac06dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54052/0 (socket says 172.21.15.31:54052) 2024-09-17T05:35:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0da2000640 1 -- 172.21.15.31:0/3708984997 learned_addr learned my addr 172.21.15.31:0/3708984997 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0daaa00640 1 --2- 172.21.15.31:0/3708984997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dac0afb10 0x7f0dac15a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0dab400640 1 --2- 172.21.15.31:0/3708984997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dac1605d0 0x7f0dac157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0da2000640 1 -- 172.21.15.31:0/3708984997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dac0afb10 msgr2=0x7f0dac15a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0da2000640 1 --2- 172.21.15.31:0/3708984997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dac0afb10 0x7f0dac15a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0da2000640 1 -- 172.21.15.31:0/3708984997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dac1605d0 msgr2=0x7f0dac157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0da2000640 1 --2- 172.21.15.31:0/3708984997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dac1605d0 0x7f0dac157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:08.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0da2000640 1 -- 172.21.15.31:0/3708984997 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dac1588b0 con 0x7f0dac0b1650 2024-09-17T05:35:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0da2000640 1 --2- 172.21.15.31:0/3708984997 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0dac0b1650 0x7f0dac06dd30 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f0d940b0040 tx=0x7f0d940a55c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0da3400640 1 -- 172.21.15.31:0/3708984997 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d940b2040 con 0x7f0dac0b1650 2024-09-17T05:35:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0da3400640 1 -- 172.21.15.31:0/3708984997 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d940043b0 con 0x7f0dac0b1650 2024-09-17T05:35:08.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0da3400640 1 -- 172.21.15.31:0/3708984997 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d940052d0 con 0x7f0dac0b1650 2024-09-17T05:35:08.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0db1600640 1 -- 172.21.15.31:0/3708984997 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dac158b70 con 0x7f0dac0b1650 2024-09-17T05:35:08.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.873+0000 7f0db1600640 1 -- 172.21.15.31:0/3708984997 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dac1518c0 con 0x7f0dac0b1650 2024-09-17T05:35:08.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.877+0000 7f0db1600640 1 -- 172.21.15.31:0/3708984997 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dac0affc0 con 0x7f0dac0b1650 2024-09-17T05:35:08.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.877+0000 7f0da3400640 1 -- 172.21.15.31:0/3708984997 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f0d94005470 con 0x7f0dac0b1650 2024-09-17T05:35:08.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.877+0000 7f0da3400640 1 --2- 172.21.15.31:0/3708984997 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d88073830 0x7f0d88075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:08.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.877+0000 7f0da3400640 1 -- 172.21.15.31:0/3708984997 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5255+0+0 (secure 0 0 0) 0x7f0d9412e350 con 0x7f0dac0b1650 2024-09-17T05:35:08.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.877+0000 7f0daaa00640 1 --2- 172.21.15.31:0/3708984997 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d88073830 0x7f0d88075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:08.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.881+0000 7f0daaa00640 1 --2- 172.21.15.31:0/3708984997 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d88073830 0x7f0d88075cf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00b450 tx=0x7f0d9c00d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:08.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:08.881+0000 7f0da3400640 1 -- 172.21.15.31:0/3708984997 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0d940164b0 con 0x7f0dac0b1650 2024-09-17T05:35:09.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.057+0000 7f0db1600640 1 -- 172.21.15.31:0/3708984997 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0dac0d1080 con 0x7f0dac0b1650 2024-09-17T05:35:09.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.685+0000 7f0da3400640 1 -- 172.21.15.31:0/3708984997 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v128) ==== 170+0+0 (secure 0 0 0) 0x7f0d9412ce20 con 0x7f0dac0b1650 2024-09-17T05:35:09.689 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-09-17T05:35:09.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.689+0000 7f0db1600640 1 -- 172.21.15.31:0/3708984997 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d88073830 msgr2=0x7f0d88075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:09.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.689+0000 7f0db1600640 1 --2- 172.21.15.31:0/3708984997 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d88073830 0x7f0d88075cf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00b450 tx=0x7f0d9c00d040 comp rx=0 tx=0).stop 2024-09-17T05:35:09.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.689+0000 7f0db1600640 1 -- 172.21.15.31:0/3708984997 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0dac0b1650 msgr2=0x7f0dac06dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:09.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.689+0000 7f0db1600640 1 --2- 172.21.15.31:0/3708984997 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0dac0b1650 0x7f0dac06dd30 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f0d940b0040 tx=0x7f0d940a55c0 comp rx=0 tx=0).stop 2024-09-17T05:35:09.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.689+0000 7f0db1600640 1 -- 172.21.15.31:0/3708984997 shutdown_connections 2024-09-17T05:35:09.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.689+0000 7f0db1600640 1 --2- 172.21.15.31:0/3708984997 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0d88073830 0x7f0d88075cf0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:09.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.689+0000 7f0db1600640 1 --2- 172.21.15.31:0/3708984997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dac1605d0 0x7f0dac157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:09.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.689+0000 7f0db1600640 1 --2- 172.21.15.31:0/3708984997 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0dac0b1650 0x7f0dac06dd30 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:09.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.689+0000 7f0db1600640 1 --2- 172.21.15.31:0/3708984997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0dac0afb10 0x7f0dac15a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:09.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.689+0000 7f0db1600640 1 -- 172.21.15.31:0/3708984997 >> 172.21.15.31:0/3708984997 conn(0x7f0dac0d1dd0 msgr2=0x7f0dac15caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:09.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.689+0000 7f0db1600640 1 -- 172.21.15.31:0/3708984997 shutdown_connections 2024-09-17T05:35:09.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.689+0000 7f0db1600640 1 -- 172.21.15.31:0/3708984997 wait complete. 2024-09-17T05:35:09.731 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:35:09.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.881+0000 7f5f4f400640 1 -- 172.21.15.31:0/4280890432 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f4815f640 msgr2=0x7f5f480cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:09.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.881+0000 7f5f4f400640 1 --2- 172.21.15.31:0/4280890432 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f4815f640 0x7f5f480cd510 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009840 tx=0x7f5f3c01c720 comp rx=0 tx=0).stop 2024-09-17T05:35:09.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.881+0000 7f5f4f400640 1 -- 172.21.15.31:0/4280890432 shutdown_connections 2024-09-17T05:35:09.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.881+0000 7f5f4f400640 1 --2- 172.21.15.31:0/4280890432 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f4815f640 0x7f5f480cd510 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:09.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.881+0000 7f5f4f400640 1 -- 172.21.15.31:0/4280890432 >> 172.21.15.31:0/4280890432 conn(0x7f5f480d1e30 msgr2=0x7f5f480d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:09.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.881+0000 7f5f4f400640 1 -- 172.21.15.31:0/4280890432 shutdown_connections 2024-09-17T05:35:09.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.881+0000 7f5f4f400640 1 -- 172.21.15.31:0/4280890432 wait complete. 2024-09-17T05:35:09.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.881+0000 7f5f4f400640 1 Processor -- start 2024-09-17T05:35:09.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.881+0000 7f5f4f400640 1 -- start start 2024-09-17T05:35:09.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.881+0000 7f5f4f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f480ce7f0 0x7f5f4814cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:09.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.881+0000 7f5f4f400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f4815f640 0x7f5f4815a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:09.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.881+0000 7f5f4f400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f4815a6f0 0x7f5f48151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:09.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.881+0000 7f5f4f400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4816a840 con 0x7f5f480ce7f0 2024-09-17T05:35:09.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.881+0000 7f5f4f400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4816a6c0 con 0x7f5f4815f640 2024-09-17T05:35:09.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.881+0000 7f5f4f400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5f4816a9c0 con 0x7f5f4815a6f0 2024-09-17T05:35:09.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.881+0000 7f5f4ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f480ce7f0 0x7f5f4814cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:09.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.885+0000 7f5f4ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f480ce7f0 0x7f5f4814cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54068/0 (socket says 172.21.15.31:54068) 2024-09-17T05:35:09.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.885+0000 7f5f4ca00640 1 -- 172.21.15.31:0/559179071 learned_addr learned my addr 172.21.15.31:0/559179071 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:09.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.885+0000 7f5f47e00640 1 --2- 172.21.15.31:0/559179071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f4815f640 0x7f5f4815a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:09.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.885+0000 7f5f4d400640 1 --2- 172.21.15.31:0/559179071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f4815a6f0 0x7f5f48151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:09.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.885+0000 7f5f4ca00640 1 -- 172.21.15.31:0/559179071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f4815a6f0 msgr2=0x7f5f48151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:09.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.885+0000 7f5f4ca00640 1 --2- 172.21.15.31:0/559179071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f4815a6f0 0x7f5f48151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:09.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.885+0000 7f5f4ca00640 1 -- 172.21.15.31:0/559179071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f4815f640 msgr2=0x7f5f4815a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:09.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.885+0000 7f5f4ca00640 1 --2- 172.21.15.31:0/559179071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f4815f640 0x7f5f4815a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:09.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.885+0000 7f5f4ca00640 1 -- 172.21.15.31:0/559179071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4815ac70 con 0x7f5f480ce7f0 2024-09-17T05:35:09.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.885+0000 7f5f4ca00640 1 --2- 172.21.15.31:0/559179071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f480ce7f0 0x7f5f4814cb60 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c019330 tx=0x7f5f3c003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:09.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.885+0000 7f5f44c00640 1 -- 172.21.15.31:0/559179071 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c005c40 con 0x7f5f480ce7f0 2024-09-17T05:35:09.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.885+0000 7f5f44c00640 1 -- 172.21.15.31:0/559179071 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f3c004120 con 0x7f5f480ce7f0 2024-09-17T05:35:09.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.885+0000 7f5f44c00640 1 -- 172.21.15.31:0/559179071 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c005050 con 0x7f5f480ce7f0 2024-09-17T05:35:09.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.885+0000 7f5f4f400640 1 -- 172.21.15.31:0/559179071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f4815af50 con 0x7f5f480ce7f0 2024-09-17T05:35:09.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.885+0000 7f5f4f400640 1 -- 172.21.15.31:0/559179071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f4815b510 con 0x7f5f480ce7f0 2024-09-17T05:35:09.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.885+0000 7f5f4f400640 1 -- 172.21.15.31:0/559179071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f480cd510 con 0x7f5f480ce7f0 2024-09-17T05:35:09.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.885+0000 7f5f44c00640 1 -- 172.21.15.31:0/559179071 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f5f3c0be020 con 0x7f5f480ce7f0 2024-09-17T05:35:09.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.889+0000 7f5f44c00640 1 --2- 172.21.15.31:0/559179071 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5f28073860 0x7f5f28075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:09.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.889+0000 7f5f44c00640 1 -- 172.21.15.31:0/559179071 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5637+0+0 (secure 0 0 0) 0x7f5f3c12f110 con 0x7f5f480ce7f0 2024-09-17T05:35:09.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.889+0000 7f5f47e00640 1 --2- 172.21.15.31:0/559179071 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5f28073860 0x7f5f28075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:09.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.889+0000 7f5f47e00640 1 --2- 172.21.15.31:0/559179071 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5f28073860 0x7f5f28075d20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5f481f9350 tx=0x7f5f34009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:09.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:09.893+0000 7f5f44c00640 1 -- 172.21.15.31:0/559179071 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5f3c016430 con 0x7f5f480ce7f0 2024-09-17T05:35:10.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.105+0000 7f5f4f400640 1 -- 172.21.15.31:0/559179071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f5f480afc40 con 0x7f5f480ce7f0 2024-09-17T05:35:10.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.689+0000 7f5f44c00640 1 -- 172.21.15.31:0/559179071 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v86) ==== 174+0+0 (secure 0 0 0) 0x7f5f3c0f97f0 con 0x7f5f480ce7f0 2024-09-17T05:35:10.691 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 20 and data pool 21 2024-09-17T05:35:10.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.693+0000 7f5f4f400640 1 -- 172.21.15.31:0/559179071 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5f28073860 msgr2=0x7f5f28075d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:10.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.693+0000 7f5f4f400640 1 --2- 172.21.15.31:0/559179071 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5f28073860 0x7f5f28075d20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5f481f9350 tx=0x7f5f34009040 comp rx=0 tx=0).stop 2024-09-17T05:35:10.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.693+0000 7f5f4f400640 1 -- 172.21.15.31:0/559179071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f480ce7f0 msgr2=0x7f5f4814cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:10.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.693+0000 7f5f4f400640 1 --2- 172.21.15.31:0/559179071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f480ce7f0 0x7f5f4814cb60 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c019330 tx=0x7f5f3c003ca0 comp rx=0 tx=0).stop 2024-09-17T05:35:10.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.693+0000 7f5f4f400640 1 -- 172.21.15.31:0/559179071 shutdown_connections 2024-09-17T05:35:10.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.693+0000 7f5f4f400640 1 --2- 172.21.15.31:0/559179071 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5f28073860 0x7f5f28075d20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:10.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.693+0000 7f5f4f400640 1 --2- 172.21.15.31:0/559179071 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f4815a6f0 0x7f5f48151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:10.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.693+0000 7f5f4f400640 1 --2- 172.21.15.31:0/559179071 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f4815f640 0x7f5f4815a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:10.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.693+0000 7f5f4f400640 1 --2- 172.21.15.31:0/559179071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f480ce7f0 0x7f5f4814cb60 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:10.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.693+0000 7f5f4f400640 1 -- 172.21.15.31:0/559179071 >> 172.21.15.31:0/559179071 conn(0x7f5f480d1e30 msgr2=0x7f5f480b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:10.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.693+0000 7f5f4f400640 1 -- 172.21.15.31:0/559179071 shutdown_connections 2024-09-17T05:35:10.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.693+0000 7f5f4f400640 1 -- 172.21.15.31:0/559179071 wait complete. 2024-09-17T05:35:10.735 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:35:10.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.881+0000 7fb5d7e00640 1 -- 172.21.15.31:0/2688812296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5d815f000 msgr2=0x7fb5d80d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:10.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.881+0000 7fb5d7e00640 1 --2- 172.21.15.31:0/2688812296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5d815f000 0x7fb5d80d01b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009840 tx=0x7fb5c801c790 comp rx=0 tx=0).stop 2024-09-17T05:35:10.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.881+0000 7fb5d7e00640 1 -- 172.21.15.31:0/2688812296 shutdown_connections 2024-09-17T05:35:10.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.881+0000 7fb5d7e00640 1 --2- 172.21.15.31:0/2688812296 >> v2:172.21.15.155:3300/0 conn(0x7fb5d80b2590 0x7fb5d80b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:10.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.881+0000 7fb5d7e00640 1 --2- 172.21.15.31:0/2688812296 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5d815f000 0x7fb5d80d01b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:10.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.881+0000 7fb5d7e00640 1 -- 172.21.15.31:0/2688812296 >> 172.21.15.31:0/2688812296 conn(0x7fb5d809aa10 msgr2=0x7fb5d809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:10.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.881+0000 7fb5d7e00640 1 -- 172.21.15.31:0/2688812296 shutdown_connections 2024-09-17T05:35:10.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.881+0000 7fb5d7e00640 1 -- 172.21.15.31:0/2688812296 wait complete. 2024-09-17T05:35:10.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.881+0000 7fb5d7e00640 1 Processor -- start 2024-09-17T05:35:10.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.881+0000 7fb5d7e00640 1 -- start start 2024-09-17T05:35:10.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d7e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5d80b2590 0x7fb5d80c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:10.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d7e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5d80cefb0 0x7fb5d814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:10.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5d815f000 0x7fb5d815db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:10.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d7e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d8168eb0 con 0x7fb5d815f000 2024-09-17T05:35:10.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d7e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d8168d30 con 0x7fb5d80cefb0 2024-09-17T05:35:10.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d7e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d8169030 con 0x7fb5d80b2590 2024-09-17T05:35:10.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5d815f000 0x7fb5d815db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:10.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d6a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5d80b2590 0x7fb5d80c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:10.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d6a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5d80b2590 0x7fb5d80c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:36604/0 (socket says 172.21.15.31:36604) 2024-09-17T05:35:10.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d6a00640 1 -- 172.21.15.31:0/44282176 learned_addr learned my addr 172.21.15.31:0/44282176 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:10.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5cfe00640 1 --2- 172.21.15.31:0/44282176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5d80cefb0 0x7fb5d814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:10.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d7400640 1 -- 172.21.15.31:0/44282176 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5d80b2590 msgr2=0x7fb5d80c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:10.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d7400640 1 --2- 172.21.15.31:0/44282176 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5d80b2590 0x7fb5d80c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:10.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d7400640 1 -- 172.21.15.31:0/44282176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5d80cefb0 msgr2=0x7fb5d814d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:10.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d7400640 1 --2- 172.21.15.31:0/44282176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5d80cefb0 0x7fb5d814d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:10.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d7400640 1 -- 172.21.15.31:0/44282176 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d80ce040 con 0x7fb5d815f000 2024-09-17T05:35:10.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d7400640 1 --2- 172.21.15.31:0/44282176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5d815f000 0x7fb5d815db90 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000ec80 tx=0x7fb5d000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:10.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5cea00640 1 -- 172.21.15.31:0/44282176 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0003b80 con 0x7fb5d815f000 2024-09-17T05:35:10.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5cea00640 1 -- 172.21.15.31:0/44282176 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5d000ee90 con 0x7fb5d815f000 2024-09-17T05:35:10.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d7e00640 1 -- 172.21.15.31:0/44282176 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d81fb3b0 con 0x7fb5d815f000 2024-09-17T05:35:10.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5cea00640 1 -- 172.21.15.31:0/44282176 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0004020 con 0x7fb5d815f000 2024-09-17T05:35:10.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d7e00640 1 -- 172.21.15.31:0/44282176 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d81fb970 con 0x7fb5d815f000 2024-09-17T05:35:10.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5d7e00640 1 -- 172.21.15.31:0/44282176 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5d80d0480 con 0x7fb5d815f000 2024-09-17T05:35:10.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.885+0000 7fb5cea00640 1 -- 172.21.15.31:0/44282176 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fb5d00041c0 con 0x7fb5d815f000 2024-09-17T05:35:10.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.889+0000 7fb5cea00640 1 --2- 172.21.15.31:0/44282176 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb5b4073830 0x7fb5b4075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:10.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.889+0000 7fb5cea00640 1 -- 172.21.15.31:0/44282176 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7fb5d0095a60 con 0x7fb5d815f000 2024-09-17T05:35:10.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.889+0000 7fb5d6a00640 1 --2- 172.21.15.31:0/44282176 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb5b4073830 0x7fb5b4075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:10.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.889+0000 7fb5d6a00640 1 --2- 172.21.15.31:0/44282176 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb5b4073830 0x7fb5b4075cf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb5c801ae40 tx=0x7fb5c80aa040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:10.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:10.893+0000 7fb5cea00640 1 -- 172.21.15.31:0/44282176 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb5d005f990 con 0x7fb5d815f000 2024-09-17T05:35:11.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.069+0000 7fb5d7e00640 1 -- 172.21.15.31:0/44282176 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5d8075940 con 0x7fb5d815f000 2024-09-17T05:35:11.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.069+0000 7fb5cea00640 1 -- 172.21.15.31:0/44282176 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+16820 (secure 0 0 0) 0x7fb5d00643c0 con 0x7fb5d815f000 2024-09-17T05:35:11.073 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:11.073 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":129,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:35:10.110328+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:35:07.839243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T05:35:09.071831+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:35:11.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.073+0000 7fb5d7e00640 1 -- 172.21.15.31:0/44282176 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb5b4073830 msgr2=0x7fb5b4075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:11.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.073+0000 7fb5d7e00640 1 --2- 172.21.15.31:0/44282176 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb5b4073830 0x7fb5b4075cf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb5c801ae40 tx=0x7fb5c80aa040 comp rx=0 tx=0).stop 2024-09-17T05:35:11.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.073+0000 7fb5d7e00640 1 -- 172.21.15.31:0/44282176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5d815f000 msgr2=0x7fb5d815db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:11.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.073+0000 7fb5d7e00640 1 --2- 172.21.15.31:0/44282176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5d815f000 0x7fb5d815db90 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000ec80 tx=0x7fb5d000c6a0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.073+0000 7fb5d7e00640 1 -- 172.21.15.31:0/44282176 shutdown_connections 2024-09-17T05:35:11.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.073+0000 7fb5d7e00640 1 --2- 172.21.15.31:0/44282176 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb5b4073830 0x7fb5b4075cf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.073+0000 7fb5d7e00640 1 --2- 172.21.15.31:0/44282176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb5d815f000 0x7fb5d815db90 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.073+0000 7fb5d7e00640 1 --2- 172.21.15.31:0/44282176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5d80cefb0 0x7fb5d814d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.073+0000 7fb5d7e00640 1 --2- 172.21.15.31:0/44282176 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb5d80b2590 0x7fb5d80c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.073+0000 7fb5d7e00640 1 -- 172.21.15.31:0/44282176 >> 172.21.15.31:0/44282176 conn(0x7fb5d809aa10 msgr2=0x7fb5d806dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:11.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.073+0000 7fb5d7e00640 1 -- 172.21.15.31:0/44282176 shutdown_connections 2024-09-17T05:35:11.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.073+0000 7fb5d7e00640 1 -- 172.21.15.31:0/44282176 wait complete. 2024-09-17T05:35:11.095 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:35:11.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f0590000640 1 -- 172.21.15.31:0/2354811119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05880cd100 msgr2=0x7f05880b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:11.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f0590000640 1 --2- 172.21.15.31:0/2354811119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05880cd100 0x7f05880b42d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f057400a950 tx=0x7f057401dae0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f0590000640 1 -- 172.21.15.31:0/2354811119 shutdown_connections 2024-09-17T05:35:11.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f0590000640 1 --2- 172.21.15.31:0/2354811119 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05880cd100 0x7f05880b42d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f0590000640 1 --2- 172.21.15.31:0/2354811119 >> v2:172.21.15.155:3300/0 conn(0x7f058815dae0 0x7f05880acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f0590000640 1 -- 172.21.15.31:0/2354811119 >> 172.21.15.31:0/2354811119 conn(0x7f05880b18f0 msgr2=0x7f05880b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:11.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f0590000640 1 -- 172.21.15.31:0/2354811119 shutdown_connections 2024-09-17T05:35:11.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f0590000640 1 -- 172.21.15.31:0/2354811119 wait complete. 2024-09-17T05:35:11.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f0590000640 1 Processor -- start 2024-09-17T05:35:11.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f0590000640 1 -- start start 2024-09-17T05:35:11.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f0590000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05880b4810 0x7f05881643c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:11.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f0590000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05880cd100 0x7f05881502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:11.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f0590000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f058815dae0 0x7f05880cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:11.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f0590000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f05881674b0 con 0x7f05880cd100 2024-09-17T05:35:11.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f0590000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0588167330 con 0x7f058815dae0 2024-09-17T05:35:11.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f0590000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0588167630 con 0x7f05880b4810 2024-09-17T05:35:11.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f058cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05880cd100 0x7f05881502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:11.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f058cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05880cd100 0x7f05881502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54088/0 (socket says 172.21.15.31:54088) 2024-09-17T05:35:11.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.241+0000 7f058cc00640 1 -- 172.21.15.31:0/4227929700 learned_addr learned my addr 172.21.15.31:0/4227929700 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:11.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.245+0000 7f058e000640 1 --2- 172.21.15.31:0/4227929700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f058815dae0 0x7f05880cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:11.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.245+0000 7f058cc00640 1 -- 172.21.15.31:0/4227929700 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05880b4810 msgr2=0x7f05881643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:11.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.245+0000 7f058cc00640 1 --2- 172.21.15.31:0/4227929700 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05880b4810 0x7f05881643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.245+0000 7f058cc00640 1 -- 172.21.15.31:0/4227929700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f058815dae0 msgr2=0x7f05880cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:11.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.245+0000 7f058cc00640 1 --2- 172.21.15.31:0/4227929700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f058815dae0 0x7f05880cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.245+0000 7f058cc00640 1 -- 172.21.15.31:0/4227929700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058815a1c0 con 0x7f05880cd100 2024-09-17T05:35:11.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.245+0000 7f058e000640 1 --2- 172.21.15.31:0/4227929700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f058815dae0 0x7f05880cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:11.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.245+0000 7f058cc00640 1 --2- 172.21.15.31:0/4227929700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05880cd100 0x7f05881502a0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f057400a8a0 tx=0x7f0574005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:11.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.245+0000 7f0585600640 1 -- 172.21.15.31:0/4227929700 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05740b3040 con 0x7f05880cd100 2024-09-17T05:35:11.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.245+0000 7f0585600640 1 -- 172.21.15.31:0/4227929700 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0574005220 con 0x7f05880cd100 2024-09-17T05:35:11.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.245+0000 7f0585600640 1 -- 172.21.15.31:0/4227929700 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05740046d0 con 0x7f05880cd100 2024-09-17T05:35:11.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.245+0000 7f0590000640 1 -- 172.21.15.31:0/4227929700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05881595c0 con 0x7f05880cd100 2024-09-17T05:35:11.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.245+0000 7f0590000640 1 -- 172.21.15.31:0/4227929700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0588156240 con 0x7f05880cd100 2024-09-17T05:35:11.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.245+0000 7f0590000640 1 -- 172.21.15.31:0/4227929700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0588069410 con 0x7f05880cd100 2024-09-17T05:35:11.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.245+0000 7f0585600640 1 -- 172.21.15.31:0/4227929700 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f0574004870 con 0x7f05880cd100 2024-09-17T05:35:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.245+0000 7f0585600640 1 --2- 172.21.15.31:0/4227929700 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0568073830 0x7f0568075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.249+0000 7f0585600640 1 -- 172.21.15.31:0/4227929700 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f057412f7e0 con 0x7f05880cd100 2024-09-17T05:35:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.249+0000 7f058d600640 1 --2- 172.21.15.31:0/4227929700 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0568073830 0x7f0568075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:11.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.249+0000 7f058d600640 1 --2- 172.21.15.31:0/4227929700 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0568073830 0x7f0568075cf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f057c0058d0 tx=0x7f057c005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:11.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.249+0000 7f0585600640 1 -- 172.21.15.31:0/4227929700 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0574017760 con 0x7f05880cd100 2024-09-17T05:35:11.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.425+0000 7f0590000640 1 -- 172.21.15.31:0/4227929700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05880b42d0 con 0x7f05880cd100 2024-09-17T05:35:11.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.429+0000 7f0585600640 1 -- 172.21.15.31:0/4227929700 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+16820 (secure 0 0 0) 0x7f05740f9e30 con 0x7f05880cd100 2024-09-17T05:35:11.430 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:11.430 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":129,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:35:10.110328+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:35:07.839243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T05:35:09.071831+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:35:11.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.429+0000 7f0590000640 1 -- 172.21.15.31:0/4227929700 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0568073830 msgr2=0x7f0568075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:11.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.429+0000 7f0590000640 1 --2- 172.21.15.31:0/4227929700 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0568073830 0x7f0568075cf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f057c0058d0 tx=0x7f057c005860 comp rx=0 tx=0).stop 2024-09-17T05:35:11.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.429+0000 7f0590000640 1 -- 172.21.15.31:0/4227929700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05880cd100 msgr2=0x7f05881502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:11.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.429+0000 7f0590000640 1 --2- 172.21.15.31:0/4227929700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05880cd100 0x7f05881502a0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f057400a8a0 tx=0x7f0574005d20 comp rx=0 tx=0).stop 2024-09-17T05:35:11.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.429+0000 7f0590000640 1 -- 172.21.15.31:0/4227929700 shutdown_connections 2024-09-17T05:35:11.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.429+0000 7f0590000640 1 --2- 172.21.15.31:0/4227929700 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0568073830 0x7f0568075cf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.429+0000 7f0590000640 1 --2- 172.21.15.31:0/4227929700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f058815dae0 0x7f05880cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.429+0000 7f0590000640 1 --2- 172.21.15.31:0/4227929700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f05880cd100 0x7f05881502a0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.429+0000 7f0590000640 1 --2- 172.21.15.31:0/4227929700 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05880b4810 0x7f05881643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.429+0000 7f0590000640 1 -- 172.21.15.31:0/4227929700 >> 172.21.15.31:0/4227929700 conn(0x7f05880b18f0 msgr2=0x7f0588164970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:11.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.429+0000 7f0590000640 1 -- 172.21.15.31:0/4227929700 shutdown_connections 2024-09-17T05:35:11.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.429+0000 7f0590000640 1 -- 172.21.15.31:0/4227929700 wait complete. 2024-09-17T05:35:11.453 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:35:11.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.601+0000 7f74ebe00640 1 -- 172.21.15.31:0/2790850099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74ec0b0d10 msgr2=0x7f74ec0d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:11.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.601+0000 7f74ebe00640 1 --2- 172.21.15.31:0/2790850099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74ec0b0d10 0x7f74ec0d1bb0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f74ec0cf780 tx=0x7f74d401c8c0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.601+0000 7f74ebe00640 1 -- 172.21.15.31:0/2790850099 shutdown_connections 2024-09-17T05:35:11.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.601+0000 7f74ebe00640 1 --2- 172.21.15.31:0/2790850099 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74ec0b0d10 0x7f74ec0d1bb0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.601+0000 7f74ebe00640 1 --2- 172.21.15.31:0/2790850099 >> v2:172.21.15.155:3300/0 conn(0x7f74ec15bd40 0x7f74ec0d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.601+0000 7f74ebe00640 1 -- 172.21.15.31:0/2790850099 >> 172.21.15.31:0/2790850099 conn(0x7f74ec09aa10 msgr2=0x7f74ec09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:11.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.601+0000 7f74ebe00640 1 -- 172.21.15.31:0/2790850099 shutdown_connections 2024-09-17T05:35:11.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.601+0000 7f74ebe00640 1 -- 172.21.15.31:0/2790850099 wait complete. 2024-09-17T05:35:11.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.601+0000 7f74ebe00640 1 Processor -- start 2024-09-17T05:35:11.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.601+0000 7f74ebe00640 1 -- start start 2024-09-17T05:35:11.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74ebe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74ec0b0d10 0x7f74ec159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:11.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74ebe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74ec0d20f0 0x7f74ec148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:11.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74ebe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74ec15bd40 0x7f74ec1fb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:11.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74ebe00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec168cb0 con 0x7f74ec15bd40 2024-09-17T05:35:11.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74ebe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec168b30 con 0x7f74ec0b0d10 2024-09-17T05:35:11.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74ebe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f74ec168e30 con 0x7f74ec0d20f0 2024-09-17T05:35:11.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74eb400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74ec15bd40 0x7f74ec1fb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:11.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74eb400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74ec15bd40 0x7f74ec1fb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54100/0 (socket says 172.21.15.31:54100) 2024-09-17T05:35:11.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74eb400640 1 -- 172.21.15.31:0/4183376752 learned_addr learned my addr 172.21.15.31:0/4183376752 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:11.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74e2000640 1 --2- 172.21.15.31:0/4183376752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74ec0d20f0 0x7f74ec148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:11.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74eaa00640 1 --2- 172.21.15.31:0/4183376752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74ec0b0d10 0x7f74ec159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:11.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74eb400640 1 -- 172.21.15.31:0/4183376752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74ec0d20f0 msgr2=0x7f74ec148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:11.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74eb400640 1 --2- 172.21.15.31:0/4183376752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74ec0d20f0 0x7f74ec148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74eb400640 1 -- 172.21.15.31:0/4183376752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74ec0b0d10 msgr2=0x7f74ec159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:11.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74eb400640 1 --2- 172.21.15.31:0/4183376752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74ec0b0d10 0x7f74ec159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:11.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74eb400640 1 -- 172.21.15.31:0/4183376752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74ec1496b0 con 0x7f74ec15bd40 2024-09-17T05:35:11.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74eb400640 1 --2- 172.21.15.31:0/4183376752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74ec15bd40 0x7f74ec1fb610 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f74e400c7c0 tx=0x7f74e400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:11.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74e3400640 1 -- 172.21.15.31:0/4183376752 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e4003b80 con 0x7f74ec15bd40 2024-09-17T05:35:11.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74e3400640 1 -- 172.21.15.31:0/4183376752 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74e4003d20 con 0x7f74ec15bd40 2024-09-17T05:35:11.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74e3400640 1 -- 172.21.15.31:0/4183376752 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e400aab0 con 0x7f74ec15bd40 2024-09-17T05:35:11.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74ebe00640 1 -- 172.21.15.31:0/4183376752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74ec163fb0 con 0x7f74ec15bd40 2024-09-17T05:35:11.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74ebe00640 1 -- 172.21.15.31:0/4183376752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74ec164570 con 0x7f74ec15bd40 2024-09-17T05:35:11.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.605+0000 7f74ebe00640 1 -- 172.21.15.31:0/4183376752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74ec0d1bb0 con 0x7f74ec15bd40 2024-09-17T05:35:11.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.609+0000 7f74e3400640 1 -- 172.21.15.31:0/4183376752 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f74e400ac50 con 0x7f74ec15bd40 2024-09-17T05:35:11.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.609+0000 7f74e3400640 1 --2- 172.21.15.31:0/4183376752 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f74c8073830 0x7f74c8075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:11.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.609+0000 7f74e3400640 1 -- 172.21.15.31:0/4183376752 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5737+0+0 (secure 0 0 0) 0x7f74e4094bf0 con 0x7f74ec15bd40 2024-09-17T05:35:11.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.609+0000 7f74eaa00640 1 --2- 172.21.15.31:0/4183376752 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f74c8073830 0x7f74c8075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:11.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.609+0000 7f74eaa00640 1 --2- 172.21.15.31:0/4183376752 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f74c8073830 0x7f74c8075cf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f74dc009b40 tx=0x7f74dc0091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:11.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.613+0000 7f74e3400640 1 -- 172.21.15.31:0/4183376752 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f74e405eba0 con 0x7f74ec15bd40 2024-09-17T05:35:11.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:11.829+0000 7f74ebe00640 1 -- 172.21.15.31:0/4183376752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f74ec1647b0 con 0x7f74ec15bd40 2024-09-17T05:35:12.584 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:35:12.587 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:35:12.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.705+0000 7f74e3400640 1 -- 172.21.15.31:0/4183376752 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v89) ==== 118+0+0 (secure 0 0 0) 0x7f74e40635d0 con 0x7f74ec15bd40 2024-09-17T05:35:12.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.709+0000 7f74ebe00640 1 -- 172.21.15.31:0/4183376752 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f74c8073830 msgr2=0x7f74c8075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:12.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.709+0000 7f74ebe00640 1 --2- 172.21.15.31:0/4183376752 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f74c8073830 0x7f74c8075cf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f74dc009b40 tx=0x7f74dc0091e0 comp rx=0 tx=0).stop 2024-09-17T05:35:12.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.709+0000 7f74ebe00640 1 -- 172.21.15.31:0/4183376752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74ec15bd40 msgr2=0x7f74ec1fb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:12.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.709+0000 7f74ebe00640 1 --2- 172.21.15.31:0/4183376752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74ec15bd40 0x7f74ec1fb610 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f74e400c7c0 tx=0x7f74e400cc80 comp rx=0 tx=0).stop 2024-09-17T05:35:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.709+0000 7f74ebe00640 1 -- 172.21.15.31:0/4183376752 shutdown_connections 2024-09-17T05:35:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.709+0000 7f74ebe00640 1 --2- 172.21.15.31:0/4183376752 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f74c8073830 0x7f74c8075cf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.709+0000 7f74ebe00640 1 --2- 172.21.15.31:0/4183376752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74ec15bd40 0x7f74ec1fb610 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.709+0000 7f74ebe00640 1 --2- 172.21.15.31:0/4183376752 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74ec0d20f0 0x7f74ec148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.709+0000 7f74ebe00640 1 --2- 172.21.15.31:0/4183376752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74ec0b0d10 0x7f74ec159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.709+0000 7f74ebe00640 1 -- 172.21.15.31:0/4183376752 >> 172.21.15.31:0/4183376752 conn(0x7f74ec09aa10 msgr2=0x7f74ec0707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.709+0000 7f74ebe00640 1 -- 172.21.15.31:0/4183376752 shutdown_connections 2024-09-17T05:35:12.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.709+0000 7f74ebe00640 1 -- 172.21.15.31:0/4183376752 wait complete. 2024-09-17T05:35:12.738 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:35:12.738 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:35:12.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.893+0000 7fa3b3400640 1 -- 172.21.15.31:0/2284665038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3ac0aeb00 msgr2=0x7fa3ac0aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:12.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.893+0000 7fa3b3400640 1 --2- 172.21.15.31:0/2284665038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3ac0aeb00 0x7fa3ac0aefb0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac073d00 tx=0x7fa3a401cd60 comp rx=0 tx=0).stop 2024-09-17T05:35:12.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.893+0000 7fa3b3400640 1 -- 172.21.15.31:0/2284665038 shutdown_connections 2024-09-17T05:35:12.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.893+0000 7fa3b3400640 1 --2- 172.21.15.31:0/2284665038 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3ac0aeb00 0x7fa3ac0aefb0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:12.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.893+0000 7fa3b3400640 1 --2- 172.21.15.31:0/2284665038 >> v2:172.21.15.155:3300/0 conn(0x7fa3ac0b1650 0x7fa3ac0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:12.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.893+0000 7fa3b3400640 1 --2- 172.21.15.31:0/2284665038 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3ac1605d0 0x7fa3ac0d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:12.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.893+0000 7fa3b3400640 1 -- 172.21.15.31:0/2284665038 >> 172.21.15.31:0/2284665038 conn(0x7fa3ac0d1dd0 msgr2=0x7fa3ac0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:12.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.893+0000 7fa3b3400640 1 -- 172.21.15.31:0/2284665038 shutdown_connections 2024-09-17T05:35:12.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.893+0000 7fa3b3400640 1 -- 172.21.15.31:0/2284665038 wait complete. 2024-09-17T05:35:12.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.893+0000 7fa3b3400640 1 Processor -- start 2024-09-17T05:35:12.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.893+0000 7fa3b3400640 1 -- start start 2024-09-17T05:35:12.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3ac0aeb00 0x7fa3ac1f8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:12.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b3400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3ac0b1650 0x7fa3ac0cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:12.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b3400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3ac1605d0 0x7fa3ac0b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:12.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b3400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac0b13a0 con 0x7fa3ac0aeb00 2024-09-17T05:35:12.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b3400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac0b1220 con 0x7fa3ac1605d0 2024-09-17T05:35:12.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b3400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa3ac0afd00 con 0x7fa3ac0b1650 2024-09-17T05:35:12.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b0a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3ac0aeb00 0x7fa3ac1f8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:12.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b0a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3ac0aeb00 0x7fa3ac1f8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54126/0 (socket says 172.21.15.31:54126) 2024-09-17T05:35:12.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b0a00640 1 -- 172.21.15.31:0/3938612343 learned_addr learned my addr 172.21.15.31:0/3938612343 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3a3e00640 1 --2- 172.21.15.31:0/3938612343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3ac0b1650 0x7fa3ac0cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b1400640 1 --2- 172.21.15.31:0/3938612343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3ac1605d0 0x7fa3ac0b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b0a00640 1 -- 172.21.15.31:0/3938612343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3ac0b1650 msgr2=0x7fa3ac0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b0a00640 1 --2- 172.21.15.31:0/3938612343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3ac0b1650 0x7fa3ac0cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b0a00640 1 -- 172.21.15.31:0/3938612343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3ac1605d0 msgr2=0x7fa3ac0b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b0a00640 1 --2- 172.21.15.31:0/3938612343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3ac1605d0 0x7fa3ac0b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b0a00640 1 -- 172.21.15.31:0/3938612343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3ac165000 con 0x7fa3ac0aeb00 2024-09-17T05:35:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b1400640 1 --2- 172.21.15.31:0/3938612343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3ac1605d0 0x7fa3ac0b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b0a00640 1 --2- 172.21.15.31:0/3938612343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3ac0aeb00 0x7fa3ac1f8740 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00e7c0 tx=0x7fa39c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3a9600640 1 -- 172.21.15.31:0/3938612343 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c00ccc0 con 0x7fa3ac0aeb00 2024-09-17T05:35:12.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3a9600640 1 -- 172.21.15.31:0/3938612343 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa39c00ce80 con 0x7fa3ac0aeb00 2024-09-17T05:35:12.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3a9600640 1 -- 172.21.15.31:0/3938612343 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c005280 con 0x7fa3ac0aeb00 2024-09-17T05:35:12.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b3400640 1 -- 172.21.15.31:0/3938612343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3ac1652e0 con 0x7fa3ac0aeb00 2024-09-17T05:35:12.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b3400640 1 -- 172.21.15.31:0/3938612343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3ac1658a0 con 0x7fa3ac0aeb00 2024-09-17T05:35:12.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3b3400640 1 -- 172.21.15.31:0/3938612343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3ac0b1a30 con 0x7fa3ac0aeb00 2024-09-17T05:35:12.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.897+0000 7fa3a9600640 1 -- 172.21.15.31:0/3938612343 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fa39c005420 con 0x7fa3ac0aeb00 2024-09-17T05:35:12.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.901+0000 7fa3a9600640 1 --2- 172.21.15.31:0/3938612343 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa388073860 0x7fa388075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:12.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.901+0000 7fa3a9600640 1 -- 172.21.15.31:0/3938612343 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7fa39c095690 con 0x7fa3ac0aeb00 2024-09-17T05:35:12.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.901+0000 7fa3a3e00640 1 --2- 172.21.15.31:0/3938612343 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa388073860 0x7fa388075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:12.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.901+0000 7fa3a3e00640 1 --2- 172.21.15.31:0/3938612343 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa388073860 0x7fa388075d20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0b2340 tx=0x7fa3940091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:12.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:12.905+0000 7fa3a9600640 1 -- 172.21.15.31:0/3938612343 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa39c05fe20 con 0x7fa3ac0aeb00 2024-09-17T05:35:13.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.117+0000 7fa3b3400640 1 -- 172.21.15.31:0/3938612343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa3ac0d1080 con 0x7fa3ac0aeb00 2024-09-17T05:35:13.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.721+0000 7fa3a9600640 1 -- 172.21.15.31:0/3938612343 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v90) ==== 122+0+0 (secure 0 0 0) 0x7fa39c05f720 con 0x7fa3ac0aeb00 2024-09-17T05:35:13.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.725+0000 7fa3b3400640 1 -- 172.21.15.31:0/3938612343 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa388073860 msgr2=0x7fa388075d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:13.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.725+0000 7fa3b3400640 1 --2- 172.21.15.31:0/3938612343 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa388073860 0x7fa388075d20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0b2340 tx=0x7fa3940091e0 comp rx=0 tx=0).stop 2024-09-17T05:35:13.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.725+0000 7fa3b3400640 1 -- 172.21.15.31:0/3938612343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3ac0aeb00 msgr2=0x7fa3ac1f8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:13.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.725+0000 7fa3b3400640 1 --2- 172.21.15.31:0/3938612343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3ac0aeb00 0x7fa3ac1f8740 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00e7c0 tx=0x7fa39c00ec80 comp rx=0 tx=0).stop 2024-09-17T05:35:13.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.725+0000 7fa3b3400640 1 -- 172.21.15.31:0/3938612343 shutdown_connections 2024-09-17T05:35:13.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.725+0000 7fa3b3400640 1 --2- 172.21.15.31:0/3938612343 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa388073860 0x7fa388075d20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:13.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.725+0000 7fa3b3400640 1 --2- 172.21.15.31:0/3938612343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3ac1605d0 0x7fa3ac0b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:13.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.725+0000 7fa3b3400640 1 --2- 172.21.15.31:0/3938612343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa3ac0b1650 0x7fa3ac0cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:13.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.725+0000 7fa3b3400640 1 --2- 172.21.15.31:0/3938612343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3ac0aeb00 0x7fa3ac1f8740 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:13.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.725+0000 7fa3b3400640 1 -- 172.21.15.31:0/3938612343 >> 172.21.15.31:0/3938612343 conn(0x7fa3ac0d1dd0 msgr2=0x7fa3ac0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:13.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.725+0000 7fa3b3400640 1 -- 172.21.15.31:0/3938612343 shutdown_connections 2024-09-17T05:35:13.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.725+0000 7fa3b3400640 1 -- 172.21.15.31:0/3938612343 wait complete. 2024-09-17T05:35:13.751 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:35:13.752 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:35:13.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.905+0000 7f08a2800640 1 -- 172.21.15.31:0/2497011239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0880004d50 msgr2=0x7f08800051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:13.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.905+0000 7f08a2800640 1 --2- 172.21.15.31:0/2497011239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0880004d50 0x7f08800051d0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f0894006f90 tx=0x7f089401f660 comp rx=0 tx=0).stop 2024-09-17T05:35:13.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f089be00640 1 -- 172.21.15.31:0/2497011239 reap_dead start 2024-09-17T05:35:13.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f08a2800640 1 -- 172.21.15.31:0/2497011239 shutdown_connections 2024-09-17T05:35:13.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f08a2800640 1 -- 172.21.15.31:0/2497011239 >> 172.21.15.31:0/2497011239 conn(0x7f089c0d1dc0 msgr2=0x7f089c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:13.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f08a2800640 1 -- 172.21.15.31:0/2497011239 shutdown_connections 2024-09-17T05:35:13.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f08a2800640 1 -- 172.21.15.31:0/2497011239 wait complete. 2024-09-17T05:35:13.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f08a2800640 1 Processor -- start 2024-09-17T05:35:13.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f08a2800640 1 -- start start 2024-09-17T05:35:13.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f08a2800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f089c155100 0x7f089c1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:13.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f08a2800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f089c1f8130 0x7f089c09be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:13.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f08a2800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f089c071ac0 0x7f089c071f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:13.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f08a2800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f089c15c400 con 0x7f089c1f8130 2024-09-17T05:35:13.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f08a2800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f089c15c280 con 0x7f089c071ac0 2024-09-17T05:35:13.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f08a2800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f089c0ce670 con 0x7f089c155100 2024-09-17T05:35:13.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f089aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f089c1f8130 0x7f089c09be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:13.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f089aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f089c1f8130 0x7f089c09be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54140/0 (socket says 172.21.15.31:54140) 2024-09-17T05:35:13.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f089aa00640 1 -- 172.21.15.31:0/1507426701 learned_addr learned my addr 172.21.15.31:0/1507426701 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:13.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f089be00640 1 --2- 172.21.15.31:0/1507426701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f089c071ac0 0x7f089c071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:13.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f089b400640 1 --2- 172.21.15.31:0/1507426701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f089c155100 0x7f089c1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:13.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f089aa00640 1 -- 172.21.15.31:0/1507426701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f089c155100 msgr2=0x7f089c1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:13.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f089aa00640 1 --2- 172.21.15.31:0/1507426701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f089c155100 0x7f089c1554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:13.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f089aa00640 1 -- 172.21.15.31:0/1507426701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f089c071ac0 msgr2=0x7f089c071f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:13.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f089aa00640 1 --2- 172.21.15.31:0/1507426701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f089c071ac0 0x7f089c071f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:13.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f089aa00640 1 -- 172.21.15.31:0/1507426701 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f089c1f86a0 con 0x7f089c1f8130 2024-09-17T05:35:13.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.909+0000 7f089aa00640 1 --2- 172.21.15.31:0/1507426701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f089c1f8130 0x7f089c09be40 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f0888006630 tx=0x7f08880018d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:13.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.913+0000 7f0893400640 1 -- 172.21.15.31:0/1507426701 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0888015070 con 0x7f089c1f8130 2024-09-17T05:35:13.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.913+0000 7f0893400640 1 -- 172.21.15.31:0/1507426701 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f088800f980 con 0x7f089c1f8130 2024-09-17T05:35:13.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.913+0000 7f0893400640 1 -- 172.21.15.31:0/1507426701 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f088800fdd0 con 0x7f089c1f8130 2024-09-17T05:35:13.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.913+0000 7f08a2800640 1 -- 172.21.15.31:0/1507426701 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f089c1f8980 con 0x7f089c1f8130 2024-09-17T05:35:13.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.913+0000 7f08a2800640 1 -- 172.21.15.31:0/1507426701 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f089c1f8f40 con 0x7f089c1f8130 2024-09-17T05:35:13.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.913+0000 7f08a2800640 1 -- 172.21.15.31:0/1507426701 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f089c0cec00 con 0x7f089c1f8130 2024-09-17T05:35:13.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.913+0000 7f0893400640 1 -- 172.21.15.31:0/1507426701 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f0888011430 con 0x7f089c1f8130 2024-09-17T05:35:13.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.913+0000 7f0893400640 1 --2- 172.21.15.31:0/1507426701 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f087c073830 0x7f087c075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:13.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.913+0000 7f0893400640 1 -- 172.21.15.31:0/1507426701 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f0888095bb0 con 0x7f089c1f8130 2024-09-17T05:35:13.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.913+0000 7f089b400640 1 --2- 172.21.15.31:0/1507426701 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f087c073830 0x7f087c075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:13.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.917+0000 7f089b400640 1 --2- 172.21.15.31:0/1507426701 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f087c073830 0x7f087c075cf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f089c0cc100 tx=0x7f088c009500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:13.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:13.917+0000 7f0893400640 1 -- 172.21.15.31:0/1507426701 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0888060240 con 0x7f089c1f8130 2024-09-17T05:35:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.129+0000 7f08a2800640 1 -- 172.21.15.31:0/1507426701 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f089c0712c0 con 0x7f089c1f8130 2024-09-17T05:35:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.129+0000 7f0893400640 1 -- 172.21.15.31:0/1507426701 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5233 (secure 0 0 0) 0x7f088805fb40 con 0x7f089c1f8130 2024-09-17T05:35:14.131 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:14.131 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":90,"btime":"2024-09-17T05:35:13:718188+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7456,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/2107257547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107257547},{"type":"v1","addr":"172.21.15.155:6834","nonce":2107257547}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1645548958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1645548958},{"type":"v1","addr":"172.21.15.31:6834","nonce":1645548958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7836,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1284373927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1284373927},{"type":"v1","addr":"172.21.15.31:6835","nonce":1284373927}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:35:10.110294+0000","modified":"2024-09-17T05:35:13.121372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7848},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7848":{"gid":7848,"name":"b","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1879117968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1879117968},{"type":"v1","addr":"172.21.15.155:6835","nonce":1879117968}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7848,"qdb_cluster":[7848]},"id":10}]} 2024-09-17T05:35:14.131 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 90 2024-09-17T05:35:14.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.129+0000 7f08a2800640 1 -- 172.21.15.31:0/1507426701 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f087c073830 msgr2=0x7f087c075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:14.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.129+0000 7f08a2800640 1 --2- 172.21.15.31:0/1507426701 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f087c073830 0x7f087c075cf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f089c0cc100 tx=0x7f088c009500 comp rx=0 tx=0).stop 2024-09-17T05:35:14.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.129+0000 7f08a2800640 1 -- 172.21.15.31:0/1507426701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f089c1f8130 msgr2=0x7f089c09be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:14.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.129+0000 7f08a2800640 1 --2- 172.21.15.31:0/1507426701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f089c1f8130 0x7f089c09be40 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f0888006630 tx=0x7f08880018d0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.129+0000 7f08a2800640 1 -- 172.21.15.31:0/1507426701 shutdown_connections 2024-09-17T05:35:14.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.129+0000 7f08a2800640 1 --2- 172.21.15.31:0/1507426701 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f087c073830 0x7f087c075cf0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.129+0000 7f08a2800640 1 --2- 172.21.15.31:0/1507426701 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f089c071ac0 0x7f089c071f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.129+0000 7f08a2800640 1 --2- 172.21.15.31:0/1507426701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f089c1f8130 0x7f089c09be40 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.129+0000 7f08a2800640 1 --2- 172.21.15.31:0/1507426701 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f089c155100 0x7f089c1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.129+0000 7f08a2800640 1 -- 172.21.15.31:0/1507426701 >> 172.21.15.31:0/1507426701 conn(0x7f089c0d1dc0 msgr2=0x7f089c0b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:14.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.129+0000 7f08a2800640 1 -- 172.21.15.31:0/1507426701 shutdown_connections 2024-09-17T05:35:14.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.129+0000 7f08a2800640 1 -- 172.21.15.31:0/1507426701 wait complete. 2024-09-17T05:35:14.153 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:35:14.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.297+0000 7f60de400640 1 -- 172.21.15.31:0/2773455054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d81603e0 msgr2=0x7f60d80affe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:14.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.297+0000 7f60de400640 1 --2- 172.21.15.31:0/2773455054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d81603e0 0x7f60d80affe0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009840 tx=0x7f60c401c7f0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.297+0000 7f60de400640 1 -- 172.21.15.31:0/2773455054 shutdown_connections 2024-09-17T05:35:14.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.297+0000 7f60de400640 1 --2- 172.21.15.31:0/2773455054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d81603e0 0x7f60d80affe0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.297+0000 7f60de400640 1 -- 172.21.15.31:0/2773455054 >> 172.21.15.31:0/2773455054 conn(0x7f60d806dd30 msgr2=0x7f60d806e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:14.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.297+0000 7f60de400640 1 -- 172.21.15.31:0/2773455054 shutdown_connections 2024-09-17T05:35:14.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.297+0000 7f60de400640 1 -- 172.21.15.31:0/2773455054 wait complete. 2024-09-17T05:35:14.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.297+0000 7f60de400640 1 Processor -- start 2024-09-17T05:35:14.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.297+0000 7f60de400640 1 -- start start 2024-09-17T05:35:14.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60de400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60d806cc20 0x7f60d81414f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:14.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60de400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60d8152c10 0x7f60d80b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:14.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60de400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d81603e0 0x7f60d8141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:14.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60de400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f60d8169cb0 con 0x7f60d81603e0 2024-09-17T05:35:14.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60de400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f60d8169b30 con 0x7f60d8152c10 2024-09-17T05:35:14.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60de400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f60d8169e30 con 0x7f60d806cc20 2024-09-17T05:35:14.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60d7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d81603e0 0x7f60d8141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:14.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60d7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d81603e0 0x7f60d8141be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54150/0 (socket says 172.21.15.31:54150) 2024-09-17T05:35:14.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60d7e00640 1 -- 172.21.15.31:0/2967556170 learned_addr learned my addr 172.21.15.31:0/2967556170 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:14.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60d7400640 1 --2- 172.21.15.31:0/2967556170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60d806cc20 0x7f60d81414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:14.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60d6a00640 1 --2- 172.21.15.31:0/2967556170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60d8152c10 0x7f60d80b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:14.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60d7e00640 1 -- 172.21.15.31:0/2967556170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60d806cc20 msgr2=0x7f60d81414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:14.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60d7e00640 1 --2- 172.21.15.31:0/2967556170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60d806cc20 0x7f60d81414f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60d7e00640 1 -- 172.21.15.31:0/2967556170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60d8152c10 msgr2=0x7f60d80b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:14.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60d7e00640 1 --2- 172.21.15.31:0/2967556170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60d8152c10 0x7f60d80b2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60d7e00640 1 -- 172.21.15.31:0/2967556170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d80b2370 con 0x7f60d81603e0 2024-09-17T05:35:14.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60d6a00640 1 --2- 172.21.15.31:0/2967556170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60d8152c10 0x7f60d80b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:14.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60d7e00640 1 --2- 172.21.15.31:0/2967556170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d81603e0 0x7f60d8141be0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f60d000cb10 tx=0x7f60d000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:14.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60cf400640 1 -- 172.21.15.31:0/2967556170 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d0016020 con 0x7f60d81603e0 2024-09-17T05:35:14.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60cf400640 1 -- 172.21.15.31:0/2967556170 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60d000ce50 con 0x7f60d81603e0 2024-09-17T05:35:14.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60cf400640 1 -- 172.21.15.31:0/2967556170 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d000ada0 con 0x7f60d81603e0 2024-09-17T05:35:14.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60de400640 1 -- 172.21.15.31:0/2967556170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60d814bf20 con 0x7f60d81603e0 2024-09-17T05:35:14.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60de400640 1 -- 172.21.15.31:0/2967556170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60d80b2610 con 0x7f60d81603e0 2024-09-17T05:35:14.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60de400640 1 -- 172.21.15.31:0/2967556170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60d80affe0 con 0x7f60d81603e0 2024-09-17T05:35:14.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.301+0000 7f60cf400640 1 -- 172.21.15.31:0/2967556170 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f60d0019020 con 0x7f60d81603e0 2024-09-17T05:35:14.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.305+0000 7f60cf400640 1 --2- 172.21.15.31:0/2967556170 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f60b8073830 0x7f60b8075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:14.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.305+0000 7f60cf400640 1 -- 172.21.15.31:0/2967556170 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f60d0094ff0 con 0x7f60d81603e0 2024-09-17T05:35:14.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.305+0000 7f60d7400640 1 --2- 172.21.15.31:0/2967556170 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f60b8073830 0x7f60b8075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:14.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.305+0000 7f60d7400640 1 --2- 172.21.15.31:0/2967556170 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f60b8073830 0x7f60b8075cf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f60c8000c10 tx=0x7f60c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:14.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.309+0000 7f60cf400640 1 -- 172.21.15.31:0/2967556170 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f60d0020020 con 0x7f60d81603e0 2024-09-17T05:35:14.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.485+0000 7f60de400640 1 -- 172.21.15.31:0/2967556170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60d80addf0 con 0x7f60d81603e0 2024-09-17T05:35:14.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.485+0000 7f60cf400640 1 -- 172.21.15.31:0/2967556170 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) ==== 74+0+16807 (secure 0 0 0) 0x7f60d005f5f0 con 0x7f60d81603e0 2024-09-17T05:35:14.489 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:14.489 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":130,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:35:11.693102+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:35:07.839243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T05:35:09.071831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:35:14.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.489+0000 7f60de400640 1 -- 172.21.15.31:0/2967556170 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f60b8073830 msgr2=0x7f60b8075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:14.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.489+0000 7f60de400640 1 --2- 172.21.15.31:0/2967556170 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f60b8073830 0x7f60b8075cf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f60c8000c10 tx=0x7f60c8009040 comp rx=0 tx=0).stop 2024-09-17T05:35:14.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.489+0000 7f60de400640 1 -- 172.21.15.31:0/2967556170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d81603e0 msgr2=0x7f60d8141be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:14.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.489+0000 7f60de400640 1 --2- 172.21.15.31:0/2967556170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d81603e0 0x7f60d8141be0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f60d000cb10 tx=0x7f60d000cc00 comp rx=0 tx=0).stop 2024-09-17T05:35:14.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.489+0000 7f60de400640 1 -- 172.21.15.31:0/2967556170 shutdown_connections 2024-09-17T05:35:14.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.489+0000 7f60de400640 1 --2- 172.21.15.31:0/2967556170 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f60b8073830 0x7f60b8075cf0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.489+0000 7f60de400640 1 --2- 172.21.15.31:0/2967556170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60d81603e0 0x7f60d8141be0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.489+0000 7f60de400640 1 --2- 172.21.15.31:0/2967556170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60d8152c10 0x7f60d80b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.489+0000 7f60de400640 1 --2- 172.21.15.31:0/2967556170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60d806cc20 0x7f60d81414f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.489+0000 7f60de400640 1 -- 172.21.15.31:0/2967556170 >> 172.21.15.31:0/2967556170 conn(0x7f60d806dd30 msgr2=0x7f60d80b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:14.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.489+0000 7f60de400640 1 -- 172.21.15.31:0/2967556170 shutdown_connections 2024-09-17T05:35:14.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.489+0000 7f60de400640 1 -- 172.21.15.31:0/2967556170 wait complete. 2024-09-17T05:35:14.510 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:35:14.510 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:35:14.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.657+0000 7fc50aa00640 1 -- 172.21.15.31:0/3380857331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4e8004810 msgr2=0x7fc4e8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:14.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.657+0000 7fc50aa00640 1 --2- 172.21.15.31:0/3380857331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4e8004810 0x7fc4e8004c90 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec0016f0 tx=0x7fc4ec01c710 comp rx=0 tx=0).stop 2024-09-17T05:35:14.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.657+0000 7fc50aa00640 1 -- 172.21.15.31:0/3380857331 shutdown_connections 2024-09-17T05:35:14.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.657+0000 7fc50aa00640 1 --2- 172.21.15.31:0/3380857331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4e8004810 0x7fc4e8004c90 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.657+0000 7fc50aa00640 1 -- 172.21.15.31:0/3380857331 >> 172.21.15.31:0/3380857331 conn(0x7fc5040b2240 msgr2=0x7fc5040b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:14.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.657+0000 7fc50aa00640 1 -- 172.21.15.31:0/3380857331 shutdown_connections 2024-09-17T05:35:14.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.657+0000 7fc50aa00640 1 -- 172.21.15.31:0/3380857331 wait complete. 2024-09-17T05:35:14.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.657+0000 7fc50aa00640 1 Processor -- start 2024-09-17T05:35:14.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.657+0000 7fc50aa00640 1 -- start start 2024-09-17T05:35:14.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc50aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4e8004810 0x7fc5040c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:14.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc50aa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc50415d980 0x7fc50415a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:14.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc50aa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc50415de00 0x7fc50415a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:14.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc50aa00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc504144160 con 0x7fc4e8004810 2024-09-17T05:35:14.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc50aa00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc504143fe0 con 0x7fc50415d980 2024-09-17T05:35:14.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc50aa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc5041442e0 con 0x7fc50415de00 2024-09-17T05:35:14.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc503e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4e8004810 0x7fc5040c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:14.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc503e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4e8004810 0x7fc5040c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54178/0 (socket says 172.21.15.31:54178) 2024-09-17T05:35:14.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc503e00640 1 -- 172.21.15.31:0/707900552 learned_addr learned my addr 172.21.15.31:0/707900552 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:14.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc503e00640 1 -- 172.21.15.31:0/707900552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc50415de00 msgr2=0x7fc50415a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:14.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc503e00640 1 --2- 172.21.15.31:0/707900552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc50415de00 0x7fc50415a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc503e00640 1 -- 172.21.15.31:0/707900552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc50415d980 msgr2=0x7fc50415a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:14.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc503e00640 1 --2- 172.21.15.31:0/707900552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc50415d980 0x7fc50415a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc503e00640 1 -- 172.21.15.31:0/707900552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50415b3b0 con 0x7fc4e8004810 2024-09-17T05:35:14.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc503e00640 1 --2- 172.21.15.31:0/707900552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4e8004810 0x7fc5040c54b0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4011ae0 tx=0x7fc4f4009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:14.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc500c00640 1 -- 172.21.15.31:0/707900552 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f400fc50 con 0x7fc4e8004810 2024-09-17T05:35:14.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc500c00640 1 -- 172.21.15.31:0/707900552 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4f400fdf0 con 0x7fc4e8004810 2024-09-17T05:35:14.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc500c00640 1 -- 172.21.15.31:0/707900552 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4004280 con 0x7fc4e8004810 2024-09-17T05:35:14.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc50aa00640 1 -- 172.21.15.31:0/707900552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50415b690 con 0x7fc4e8004810 2024-09-17T05:35:14.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc50aa00640 1 -- 172.21.15.31:0/707900552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc50415bc50 con 0x7fc4e8004810 2024-09-17T05:35:14.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc50aa00640 1 -- 172.21.15.31:0/707900552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc50406cf50 con 0x7fc4e8004810 2024-09-17T05:35:14.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.661+0000 7fc500c00640 1 -- 172.21.15.31:0/707900552 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fc4f4003600 con 0x7fc4e8004810 2024-09-17T05:35:14.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.665+0000 7fc500c00640 1 --2- 172.21.15.31:0/707900552 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc4e0073830 0x7fc4e0075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:14.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.665+0000 7fc500c00640 1 -- 172.21.15.31:0/707900552 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7fc4f4095950 con 0x7fc4e8004810 2024-09-17T05:35:14.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.665+0000 7fc4fbe00640 1 --2- 172.21.15.31:0/707900552 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc4e0073830 0x7fc4e0075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:14.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.665+0000 7fc4fbe00640 1 --2- 172.21.15.31:0/707900552 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc4e0073830 0x7fc4e0075cf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec006040 tx=0x7fc4e8005840 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:14.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.669+0000 7fc500c00640 1 -- 172.21.15.31:0/707900552 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc4f405ffe0 con 0x7fc4e8004810 2024-09-17T05:35:14.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.841+0000 7fc50aa00640 1 -- 172.21.15.31:0/707900552 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc5040b2870 con 0x7fc4e0073830 2024-09-17T05:35:14.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.845+0000 7fc500c00640 1 -- 172.21.15.31:0/707900552 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252483 (secure 0 0 0) 0x7fc5040b2870 con 0x7fc4e0073830 2024-09-17T05:35:14.853 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:35:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.849+0000 7fc50aa00640 1 -- 172.21.15.31:0/707900552 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc4e0073830 msgr2=0x7fc4e0075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.849+0000 7fc50aa00640 1 --2- 172.21.15.31:0/707900552 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc4e0073830 0x7fc4e0075cf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec006040 tx=0x7fc4e8005840 comp rx=0 tx=0).stop 2024-09-17T05:35:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.849+0000 7fc50aa00640 1 -- 172.21.15.31:0/707900552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4e8004810 msgr2=0x7fc5040c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.849+0000 7fc50aa00640 1 --2- 172.21.15.31:0/707900552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4e8004810 0x7fc5040c54b0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4011ae0 tx=0x7fc4f4009f20 comp rx=0 tx=0).stop 2024-09-17T05:35:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.849+0000 7fc50aa00640 1 -- 172.21.15.31:0/707900552 shutdown_connections 2024-09-17T05:35:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.849+0000 7fc50aa00640 1 --2- 172.21.15.31:0/707900552 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc4e0073830 0x7fc4e0075cf0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.849+0000 7fc50aa00640 1 --2- 172.21.15.31:0/707900552 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc50415de00 0x7fc50415a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.849+0000 7fc50aa00640 1 --2- 172.21.15.31:0/707900552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc50415d980 0x7fc50415a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.849+0000 7fc50aa00640 1 --2- 172.21.15.31:0/707900552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4e8004810 0x7fc5040c54b0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:14.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.849+0000 7fc50aa00640 1 -- 172.21.15.31:0/707900552 >> 172.21.15.31:0/707900552 conn(0x7fc5040b2240 msgr2=0x7fc5040b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:14.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.849+0000 7fc50aa00640 1 -- 172.21.15.31:0/707900552 shutdown_connections 2024-09-17T05:35:14.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:14.849+0000 7fc50aa00640 1 -- 172.21.15.31:0/707900552 wait complete. 2024-09-17T05:35:14.872 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-09-17T05:35:14.732512+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":263432,"kb_used_data":13896,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711288,"statfs":{"total":773094113280,"available":772824358912,"internally_reserved":0,"allocated":14229504,"data_stored":6906564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001452"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827465+0000","last_change":"2024-09-17T05:35:10.726891+0000","last_active":"2024-09-17T05:35:11.827465+0000","last_peered":"2024-09-17T05:35:11.827465+0000","last_clean":"2024-09-17T05:35:11.827465+0000","last_became_active":"2024-09-17T05:35:10.724562+0000","last_became_peered":"2024-09-17T05:35:10.724562+0000","last_unstale":"2024-09-17T05:35:11.827465+0000","last_undegraded":"2024-09-17T05:35:11.827465+0000","last_fullsized":"2024-09-17T05:35:11.827465+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:52:46.349687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827929+0000","last_change":"2024-09-17T05:35:10.714914+0000","last_active":"2024-09-17T05:35:11.827929+0000","last_peered":"2024-09-17T05:35:11.827929+0000","last_clean":"2024-09-17T05:35:11.827929+0000","last_became_active":"2024-09-17T05:35:10.714656+0000","last_became_peered":"2024-09-17T05:35:10.714656+0000","last_unstale":"2024-09-17T05:35:11.827929+0000","last_undegraded":"2024-09-17T05:35:11.827929+0000","last_fullsized":"2024-09-17T05:35:11.827929+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:17.509666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830955+0000","last_change":"2024-09-17T05:35:10.720249+0000","last_active":"2024-09-17T05:35:11.830955+0000","last_peered":"2024-09-17T05:35:11.830955+0000","last_clean":"2024-09-17T05:35:11.830955+0000","last_became_active":"2024-09-17T05:35:10.719963+0000","last_became_peered":"2024-09-17T05:35:10.719963+0000","last_unstale":"2024-09-17T05:35:11.830955+0000","last_undegraded":"2024-09-17T05:35:11.830955+0000","last_fullsized":"2024-09-17T05:35:11.830955+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:02.434428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.702328+0000","last_change":"2024-09-17T05:35:10.733098+0000","last_active":"2024-09-17T05:35:11.702328+0000","last_peered":"2024-09-17T05:35:11.702328+0000","last_clean":"2024-09-17T05:35:11.702328+0000","last_became_active":"2024-09-17T05:35:10.732844+0000","last_became_peered":"2024-09-17T05:35:10.732844+0000","last_unstale":"2024-09-17T05:35:11.702328+0000","last_undegraded":"2024-09-17T05:35:11.702328+0000","last_fullsized":"2024-09-17T05:35:11.702328+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:10.935979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.702051+0000","last_change":"2024-09-17T05:35:10.728186+0000","last_active":"2024-09-17T05:35:11.702051+0000","last_peered":"2024-09-17T05:35:11.702051+0000","last_clean":"2024-09-17T05:35:11.702051+0000","last_became_active":"2024-09-17T05:35:10.726660+0000","last_became_peered":"2024-09-17T05:35:10.726660+0000","last_unstale":"2024-09-17T05:35:11.702051+0000","last_undegraded":"2024-09-17T05:35:11.702051+0000","last_fullsized":"2024-09-17T05:35:11.702051+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:20.349740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826741+0000","last_change":"2024-09-17T05:35:10.722477+0000","last_active":"2024-09-17T05:35:11.826741+0000","last_peered":"2024-09-17T05:35:11.826741+0000","last_clean":"2024-09-17T05:35:11.826741+0000","last_became_active":"2024-09-17T05:35:10.721313+0000","last_became_peered":"2024-09-17T05:35:10.721313+0000","last_unstale":"2024-09-17T05:35:11.826741+0000","last_undegraded":"2024-09-17T05:35:11.826741+0000","last_fullsized":"2024-09-17T05:35:11.826741+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:27.684920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826539+0000","last_change":"2024-09-17T05:35:10.709064+0000","last_active":"2024-09-17T05:35:11.826539+0000","last_peered":"2024-09-17T05:35:11.826539+0000","last_clean":"2024-09-17T05:35:11.826539+0000","last_became_active":"2024-09-17T05:35:10.708813+0000","last_became_peered":"2024-09-17T05:35:10.708813+0000","last_unstale":"2024-09-17T05:35:11.826539+0000","last_undegraded":"2024-09-17T05:35:11.826539+0000","last_fullsized":"2024-09-17T05:35:11.826539+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:46.946258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826260+0000","last_change":"2024-09-17T05:35:10.723080+0000","last_active":"2024-09-17T05:35:11.826260+0000","last_peered":"2024-09-17T05:35:11.826260+0000","last_clean":"2024-09-17T05:35:11.826260+0000","last_became_active":"2024-09-17T05:35:10.722832+0000","last_became_peered":"2024-09-17T05:35:10.722832+0000","last_unstale":"2024-09-17T05:35:11.826260+0000","last_undegraded":"2024-09-17T05:35:11.826260+0000","last_fullsized":"2024-09-17T05:35:11.826260+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:35.222207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.828411+0000","last_change":"2024-09-17T05:35:10.729957+0000","last_active":"2024-09-17T05:35:11.828411+0000","last_peered":"2024-09-17T05:35:11.828411+0000","last_clean":"2024-09-17T05:35:11.828411+0000","last_became_active":"2024-09-17T05:35:10.729662+0000","last_became_peered":"2024-09-17T05:35:10.729662+0000","last_unstale":"2024-09-17T05:35:11.828411+0000","last_undegraded":"2024-09-17T05:35:11.828411+0000","last_fullsized":"2024-09-17T05:35:11.828411+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:18.162234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830499+0000","last_change":"2024-09-17T05:35:10.740141+0000","last_active":"2024-09-17T05:35:11.830499+0000","last_peered":"2024-09-17T05:35:11.830499+0000","last_clean":"2024-09-17T05:35:11.830499+0000","last_became_active":"2024-09-17T05:35:10.739676+0000","last_became_peered":"2024-09-17T05:35:10.739676+0000","last_unstale":"2024-09-17T05:35:11.830499+0000","last_undegraded":"2024-09-17T05:35:11.830499+0000","last_fullsized":"2024-09-17T05:35:11.830499+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:37.656659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826843+0000","last_change":"2024-09-17T05:35:10.728207+0000","last_active":"2024-09-17T05:35:11.826843+0000","last_peered":"2024-09-17T05:35:11.826843+0000","last_clean":"2024-09-17T05:35:11.826843+0000","last_became_active":"2024-09-17T05:35:10.727945+0000","last_became_peered":"2024-09-17T05:35:10.727945+0000","last_unstale":"2024-09-17T05:35:11.826843+0000","last_undegraded":"2024-09-17T05:35:11.826843+0000","last_fullsized":"2024-09-17T05:35:11.826843+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:00.227587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830041+0000","last_change":"2024-09-17T05:35:10.726213+0000","last_active":"2024-09-17T05:35:11.830041+0000","last_peered":"2024-09-17T05:35:11.830041+0000","last_clean":"2024-09-17T05:35:11.830041+0000","last_became_active":"2024-09-17T05:35:10.725940+0000","last_became_peered":"2024-09-17T05:35:10.725940+0000","last_unstale":"2024-09-17T05:35:11.830041+0000","last_undegraded":"2024-09-17T05:35:11.830041+0000","last_fullsized":"2024-09-17T05:35:11.830041+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:59:34.219452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.702241+0000","last_change":"2024-09-17T05:35:10.726919+0000","last_active":"2024-09-17T05:35:11.702241+0000","last_peered":"2024-09-17T05:35:11.702241+0000","last_clean":"2024-09-17T05:35:11.702241+0000","last_became_active":"2024-09-17T05:35:10.726318+0000","last_became_peered":"2024-09-17T05:35:10.726318+0000","last_unstale":"2024-09-17T05:35:11.702241+0000","last_undegraded":"2024-09-17T05:35:11.702241+0000","last_fullsized":"2024-09-17T05:35:11.702241+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:18.571063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701440+0000","last_change":"2024-09-17T05:35:10.738626+0000","last_active":"2024-09-17T05:35:11.701440+0000","last_peered":"2024-09-17T05:35:11.701440+0000","last_clean":"2024-09-17T05:35:11.701440+0000","last_became_active":"2024-09-17T05:35:10.735090+0000","last_became_peered":"2024-09-17T05:35:10.735090+0000","last_unstale":"2024-09-17T05:35:11.701440+0000","last_undegraded":"2024-09-17T05:35:11.701440+0000","last_fullsized":"2024-09-17T05:35:11.701440+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:57.820824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829745+0000","last_change":"2024-09-17T05:35:10.719039+0000","last_active":"2024-09-17T05:35:11.829745+0000","last_peered":"2024-09-17T05:35:11.829745+0000","last_clean":"2024-09-17T05:35:11.829745+0000","last_became_active":"2024-09-17T05:35:10.718518+0000","last_became_peered":"2024-09-17T05:35:10.718518+0000","last_unstale":"2024-09-17T05:35:11.829745+0000","last_undegraded":"2024-09-17T05:35:11.829745+0000","last_fullsized":"2024-09-17T05:35:11.829745+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:25.768293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697360+0000","last_change":"2024-09-17T05:35:10.715845+0000","last_active":"2024-09-17T05:35:11.697360+0000","last_peered":"2024-09-17T05:35:11.697360+0000","last_clean":"2024-09-17T05:35:11.697360+0000","last_became_active":"2024-09-17T05:35:10.714208+0000","last_became_peered":"2024-09-17T05:35:10.714208+0000","last_unstale":"2024-09-17T05:35:11.697360+0000","last_undegraded":"2024-09-17T05:35:11.697360+0000","last_fullsized":"2024-09-17T05:35:11.697360+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:47.004341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830912+0000","last_change":"2024-09-17T05:35:10.732283+0000","last_active":"2024-09-17T05:35:11.830912+0000","last_peered":"2024-09-17T05:35:11.830912+0000","last_clean":"2024-09-17T05:35:11.830912+0000","last_became_active":"2024-09-17T05:35:10.731804+0000","last_became_peered":"2024-09-17T05:35:10.731804+0000","last_unstale":"2024-09-17T05:35:11.830912+0000","last_undegraded":"2024-09-17T05:35:11.830912+0000","last_fullsized":"2024-09-17T05:35:11.830912+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:27:05.597754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.831219+0000","last_change":"2024-09-17T05:35:10.721141+0000","last_active":"2024-09-17T05:35:11.831219+0000","last_peered":"2024-09-17T05:35:11.831219+0000","last_clean":"2024-09-17T05:35:11.831219+0000","last_became_active":"2024-09-17T05:35:10.720850+0000","last_became_peered":"2024-09-17T05:35:10.720850+0000","last_unstale":"2024-09-17T05:35:11.831219+0000","last_undegraded":"2024-09-17T05:35:11.831219+0000","last_fullsized":"2024-09-17T05:35:11.831219+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:53:37.339573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827258+0000","last_change":"2024-09-17T05:35:10.724368+0000","last_active":"2024-09-17T05:35:11.827258+0000","last_peered":"2024-09-17T05:35:11.827258+0000","last_clean":"2024-09-17T05:35:11.827258+0000","last_became_active":"2024-09-17T05:35:10.723810+0000","last_became_peered":"2024-09-17T05:35:10.723810+0000","last_unstale":"2024-09-17T05:35:11.827258+0000","last_undegraded":"2024-09-17T05:35:11.827258+0000","last_fullsized":"2024-09-17T05:35:11.827258+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:54.274682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697734+0000","last_change":"2024-09-17T05:35:10.712963+0000","last_active":"2024-09-17T05:35:11.697734+0000","last_peered":"2024-09-17T05:35:11.697734+0000","last_clean":"2024-09-17T05:35:11.697734+0000","last_became_active":"2024-09-17T05:35:10.712672+0000","last_became_peered":"2024-09-17T05:35:10.712672+0000","last_unstale":"2024-09-17T05:35:11.697734+0000","last_undegraded":"2024-09-17T05:35:11.697734+0000","last_fullsized":"2024-09-17T05:35:11.697734+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:07.660166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830271+0000","last_change":"2024-09-17T05:35:10.740564+0000","last_active":"2024-09-17T05:35:11.830271+0000","last_peered":"2024-09-17T05:35:11.830271+0000","last_clean":"2024-09-17T05:35:11.830271+0000","last_became_active":"2024-09-17T05:35:10.739992+0000","last_became_peered":"2024-09-17T05:35:10.739992+0000","last_unstale":"2024-09-17T05:35:11.830271+0000","last_undegraded":"2024-09-17T05:35:11.830271+0000","last_fullsized":"2024-09-17T05:35:11.830271+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:40.001869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701507+0000","last_change":"2024-09-17T05:35:10.721896+0000","last_active":"2024-09-17T05:35:11.701507+0000","last_peered":"2024-09-17T05:35:11.701507+0000","last_clean":"2024-09-17T05:35:11.701507+0000","last_became_active":"2024-09-17T05:35:10.721579+0000","last_became_peered":"2024-09-17T05:35:10.721579+0000","last_unstale":"2024-09-17T05:35:11.701507+0000","last_undegraded":"2024-09-17T05:35:11.701507+0000","last_fullsized":"2024-09-17T05:35:11.701507+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:19:28.704304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.702048+0000","last_change":"2024-09-17T05:35:10.711738+0000","last_active":"2024-09-17T05:35:11.702048+0000","last_peered":"2024-09-17T05:35:11.702048+0000","last_clean":"2024-09-17T05:35:11.702048+0000","last_became_active":"2024-09-17T05:35:10.711474+0000","last_became_peered":"2024-09-17T05:35:10.711474+0000","last_unstale":"2024-09-17T05:35:11.702048+0000","last_undegraded":"2024-09-17T05:35:11.702048+0000","last_fullsized":"2024-09-17T05:35:11.702048+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:11.870130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829706+0000","last_change":"2024-09-17T05:35:10.740134+0000","last_active":"2024-09-17T05:35:11.829706+0000","last_peered":"2024-09-17T05:35:11.829706+0000","last_clean":"2024-09-17T05:35:11.829706+0000","last_became_active":"2024-09-17T05:35:10.739819+0000","last_became_peered":"2024-09-17T05:35:10.739819+0000","last_unstale":"2024-09-17T05:35:11.829706+0000","last_undegraded":"2024-09-17T05:35:11.829706+0000","last_fullsized":"2024-09-17T05:35:11.829706+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:44.973761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.698033+0000","last_change":"2024-09-17T05:35:10.727777+0000","last_active":"2024-09-17T05:35:11.698033+0000","last_peered":"2024-09-17T05:35:11.698033+0000","last_clean":"2024-09-17T05:35:11.698033+0000","last_became_active":"2024-09-17T05:35:10.727501+0000","last_became_peered":"2024-09-17T05:35:10.727501+0000","last_unstale":"2024-09-17T05:35:11.698033+0000","last_undegraded":"2024-09-17T05:35:11.698033+0000","last_fullsized":"2024-09-17T05:35:11.698033+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:22.524398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827355+0000","last_change":"2024-09-17T05:35:10.725305+0000","last_active":"2024-09-17T05:35:11.827355+0000","last_peered":"2024-09-17T05:35:11.827355+0000","last_clean":"2024-09-17T05:35:11.827355+0000","last_became_active":"2024-09-17T05:35:10.721594+0000","last_became_peered":"2024-09-17T05:35:10.721594+0000","last_unstale":"2024-09-17T05:35:11.827355+0000","last_undegraded":"2024-09-17T05:35:11.827355+0000","last_fullsized":"2024-09-17T05:35:11.827355+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:46.447885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697536+0000","last_change":"2024-09-17T05:35:10.721866+0000","last_active":"2024-09-17T05:35:11.697536+0000","last_peered":"2024-09-17T05:35:11.697536+0000","last_clean":"2024-09-17T05:35:11.697536+0000","last_became_active":"2024-09-17T05:35:10.721613+0000","last_became_peered":"2024-09-17T05:35:10.721613+0000","last_unstale":"2024-09-17T05:35:11.697536+0000","last_undegraded":"2024-09-17T05:35:11.697536+0000","last_fullsized":"2024-09-17T05:35:11.697536+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:16.179585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.828045+0000","last_change":"2024-09-17T05:35:10.719130+0000","last_active":"2024-09-17T05:35:11.828045+0000","last_peered":"2024-09-17T05:35:11.828045+0000","last_clean":"2024-09-17T05:35:11.828045+0000","last_became_active":"2024-09-17T05:35:10.718820+0000","last_became_peered":"2024-09-17T05:35:10.718820+0000","last_unstale":"2024-09-17T05:35:11.828045+0000","last_undegraded":"2024-09-17T05:35:11.828045+0000","last_fullsized":"2024-09-17T05:35:11.828045+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:05.653657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826970+0000","last_change":"2024-09-17T05:35:10.722169+0000","last_active":"2024-09-17T05:35:11.826970+0000","last_peered":"2024-09-17T05:35:11.826970+0000","last_clean":"2024-09-17T05:35:11.826970+0000","last_became_active":"2024-09-17T05:35:10.721232+0000","last_became_peered":"2024-09-17T05:35:10.721232+0000","last_unstale":"2024-09-17T05:35:11.826970+0000","last_undegraded":"2024-09-17T05:35:11.826970+0000","last_fullsized":"2024-09-17T05:35:11.826970+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:51.126637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701638+0000","last_change":"2024-09-17T05:35:10.738485+0000","last_active":"2024-09-17T05:35:11.701638+0000","last_peered":"2024-09-17T05:35:11.701638+0000","last_clean":"2024-09-17T05:35:11.701638+0000","last_became_active":"2024-09-17T05:35:10.737816+0000","last_became_peered":"2024-09-17T05:35:10.737816+0000","last_unstale":"2024-09-17T05:35:11.701638+0000","last_undegraded":"2024-09-17T05:35:11.701638+0000","last_fullsized":"2024-09-17T05:35:11.701638+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:13.868590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826958+0000","last_change":"2024-09-17T05:35:10.719566+0000","last_active":"2024-09-17T05:35:11.826958+0000","last_peered":"2024-09-17T05:35:11.826958+0000","last_clean":"2024-09-17T05:35:11.826958+0000","last_became_active":"2024-09-17T05:35:10.719285+0000","last_became_peered":"2024-09-17T05:35:10.719285+0000","last_unstale":"2024-09-17T05:35:11.826958+0000","last_undegraded":"2024-09-17T05:35:11.826958+0000","last_fullsized":"2024-09-17T05:35:11.826958+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:36.550207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697424+0000","last_change":"2024-09-17T05:35:10.704953+0000","last_active":"2024-09-17T05:35:11.697424+0000","last_peered":"2024-09-17T05:35:11.697424+0000","last_clean":"2024-09-17T05:35:11.697424+0000","last_became_active":"2024-09-17T05:35:10.704641+0000","last_became_peered":"2024-09-17T05:35:10.704641+0000","last_unstale":"2024-09-17T05:35:11.697424+0000","last_undegraded":"2024-09-17T05:35:11.697424+0000","last_fullsized":"2024-09-17T05:35:11.697424+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:12.685870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830756+0000","last_change":"2024-09-17T05:35:10.725528+0000","last_active":"2024-09-17T05:35:11.830756+0000","last_peered":"2024-09-17T05:35:11.830756+0000","last_clean":"2024-09-17T05:35:11.830756+0000","last_became_active":"2024-09-17T05:35:10.725224+0000","last_became_peered":"2024-09-17T05:35:10.725224+0000","last_unstale":"2024-09-17T05:35:11.830756+0000","last_undegraded":"2024-09-17T05:35:11.830756+0000","last_fullsized":"2024-09-17T05:35:11.830756+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:07.029483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"129'4","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830489+0000","last_change":"2024-09-17T05:35:09.721409+0000","last_active":"2024-09-17T05:35:11.830489+0000","last_peered":"2024-09-17T05:35:11.830489+0000","last_clean":"2024-09-17T05:35:11.830489+0000","last_became_active":"2024-09-17T05:35:09.721060+0000","last_became_peered":"2024-09-17T05:35:09.721060+0000","last_unstale":"2024-09-17T05:35:11.830489+0000","last_undegraded":"2024-09-17T05:35:11.830489+0000","last_fullsized":"2024-09-17T05:35:11.830489+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:44.626846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.828528+0000","last_change":"2024-09-17T05:35:10.722856+0000","last_active":"2024-09-17T05:35:11.828528+0000","last_peered":"2024-09-17T05:35:11.828528+0000","last_clean":"2024-09-17T05:35:11.828528+0000","last_became_active":"2024-09-17T05:35:10.722607+0000","last_became_peered":"2024-09-17T05:35:10.722607+0000","last_unstale":"2024-09-17T05:35:11.828528+0000","last_undegraded":"2024-09-17T05:35:11.828528+0000","last_fullsized":"2024-09-17T05:35:11.828528+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:26.310997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827937+0000","last_change":"2024-09-17T05:35:09.721159+0000","last_active":"2024-09-17T05:35:11.827937+0000","last_peered":"2024-09-17T05:35:11.827937+0000","last_clean":"2024-09-17T05:35:11.827937+0000","last_became_active":"2024-09-17T05:35:09.720892+0000","last_became_peered":"2024-09-17T05:35:09.720892+0000","last_unstale":"2024-09-17T05:35:11.827937+0000","last_undegraded":"2024-09-17T05:35:11.827937+0000","last_fullsized":"2024-09-17T05:35:11.827937+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:26.353291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826933+0000","last_change":"2024-09-17T05:35:10.724724+0000","last_active":"2024-09-17T05:35:11.826933+0000","last_peered":"2024-09-17T05:35:11.826933+0000","last_clean":"2024-09-17T05:35:11.826933+0000","last_became_active":"2024-09-17T05:35:10.723767+0000","last_became_peered":"2024-09-17T05:35:10.723767+0000","last_unstale":"2024-09-17T05:35:11.826933+0000","last_undegraded":"2024-09-17T05:35:11.826933+0000","last_fullsized":"2024-09-17T05:35:11.826933+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:13.707392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701360+0000","last_change":"2024-09-17T05:35:09.716709+0000","last_active":"2024-09-17T05:35:11.701360+0000","last_peered":"2024-09-17T05:35:11.701360+0000","last_clean":"2024-09-17T05:35:11.701360+0000","last_became_active":"2024-09-17T05:35:09.716393+0000","last_became_peered":"2024-09-17T05:35:09.716393+0000","last_unstale":"2024-09-17T05:35:11.701360+0000","last_undegraded":"2024-09-17T05:35:11.701360+0000","last_fullsized":"2024-09-17T05:35:11.701360+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:50.807700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830122+0000","last_change":"2024-09-17T05:35:10.725470+0000","last_active":"2024-09-17T05:35:11.830122+0000","last_peered":"2024-09-17T05:35:11.830122+0000","last_clean":"2024-09-17T05:35:11.830122+0000","last_became_active":"2024-09-17T05:35:10.725153+0000","last_became_peered":"2024-09-17T05:35:10.725153+0000","last_unstale":"2024-09-17T05:35:11.830122+0000","last_undegraded":"2024-09-17T05:35:11.830122+0000","last_fullsized":"2024-09-17T05:35:11.830122+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:40.238306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.702263+0000","last_change":"2024-09-17T05:35:09.715611+0000","last_active":"2024-09-17T05:35:11.702263+0000","last_peered":"2024-09-17T05:35:11.702263+0000","last_clean":"2024-09-17T05:35:11.702263+0000","last_became_active":"2024-09-17T05:35:09.714227+0000","last_became_peered":"2024-09-17T05:35:09.714227+0000","last_unstale":"2024-09-17T05:35:11.702263+0000","last_undegraded":"2024-09-17T05:35:11.702263+0000","last_fullsized":"2024-09-17T05:35:11.702263+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:24.553359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827574+0000","last_change":"2024-09-17T05:35:10.718216+0000","last_active":"2024-09-17T05:35:11.827574+0000","last_peered":"2024-09-17T05:35:11.827574+0000","last_clean":"2024-09-17T05:35:11.827574+0000","last_became_active":"2024-09-17T05:35:10.717962+0000","last_became_peered":"2024-09-17T05:35:10.717962+0000","last_unstale":"2024-09-17T05:35:11.827574+0000","last_undegraded":"2024-09-17T05:35:11.827574+0000","last_fullsized":"2024-09-17T05:35:11.827574+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:19.603814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697504+0000","last_change":"2024-09-17T05:35:09.716452+0000","last_active":"2024-09-17T05:35:11.697504+0000","last_peered":"2024-09-17T05:35:11.697504+0000","last_clean":"2024-09-17T05:35:11.697504+0000","last_became_active":"2024-09-17T05:35:09.716197+0000","last_became_peered":"2024-09-17T05:35:09.716197+0000","last_unstale":"2024-09-17T05:35:11.697504+0000","last_undegraded":"2024-09-17T05:35:11.697504+0000","last_fullsized":"2024-09-17T05:35:11.697504+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:10.819077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701802+0000","last_change":"2024-09-17T05:35:10.736084+0000","last_active":"2024-09-17T05:35:11.701802+0000","last_peered":"2024-09-17T05:35:11.701802+0000","last_clean":"2024-09-17T05:35:11.701802+0000","last_became_active":"2024-09-17T05:35:10.735821+0000","last_became_peered":"2024-09-17T05:35:10.735821+0000","last_unstale":"2024-09-17T05:35:11.701802+0000","last_undegraded":"2024-09-17T05:35:11.701802+0000","last_fullsized":"2024-09-17T05:35:11.701802+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:02.564829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701286+0000","last_change":"2024-09-17T05:35:09.722601+0000","last_active":"2024-09-17T05:35:11.701286+0000","last_peered":"2024-09-17T05:35:11.701286+0000","last_clean":"2024-09-17T05:35:11.701286+0000","last_became_active":"2024-09-17T05:35:09.722096+0000","last_became_peered":"2024-09-17T05:35:09.722096+0000","last_unstale":"2024-09-17T05:35:11.701286+0000","last_undegraded":"2024-09-17T05:35:11.701286+0000","last_fullsized":"2024-09-17T05:35:11.701286+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:11:45.953824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826446+0000","last_change":"2024-09-17T05:35:10.721908+0000","last_active":"2024-09-17T05:35:11.826446+0000","last_peered":"2024-09-17T05:35:11.826446+0000","last_clean":"2024-09-17T05:35:11.826446+0000","last_became_active":"2024-09-17T05:35:10.721643+0000","last_became_peered":"2024-09-17T05:35:10.721643+0000","last_unstale":"2024-09-17T05:35:11.826446+0000","last_undegraded":"2024-09-17T05:35:11.826446+0000","last_fullsized":"2024-09-17T05:35:11.826446+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:12.674959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697354+0000","last_change":"2024-09-17T05:35:09.715752+0000","last_active":"2024-09-17T05:35:11.697354+0000","last_peered":"2024-09-17T05:35:11.697354+0000","last_clean":"2024-09-17T05:35:11.697354+0000","last_became_active":"2024-09-17T05:35:09.715417+0000","last_became_peered":"2024-09-17T05:35:09.715417+0000","last_unstale":"2024-09-17T05:35:11.697354+0000","last_undegraded":"2024-09-17T05:35:11.697354+0000","last_fullsized":"2024-09-17T05:35:11.697354+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:11.126055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701944+0000","last_change":"2024-09-17T05:35:10.725940+0000","last_active":"2024-09-17T05:35:11.701944+0000","last_peered":"2024-09-17T05:35:11.701944+0000","last_clean":"2024-09-17T05:35:11.701944+0000","last_became_active":"2024-09-17T05:35:10.725586+0000","last_became_peered":"2024-09-17T05:35:10.725586+0000","last_unstale":"2024-09-17T05:35:11.701944+0000","last_undegraded":"2024-09-17T05:35:11.701944+0000","last_fullsized":"2024-09-17T05:35:11.701944+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:14.160164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.700996+0000","last_change":"2024-09-17T05:35:09.713201+0000","last_active":"2024-09-17T05:35:11.700996+0000","last_peered":"2024-09-17T05:35:11.700996+0000","last_clean":"2024-09-17T05:35:11.700996+0000","last_became_active":"2024-09-17T05:35:09.712428+0000","last_became_peered":"2024-09-17T05:35:09.712428+0000","last_unstale":"2024-09-17T05:35:11.700996+0000","last_undegraded":"2024-09-17T05:35:11.700996+0000","last_fullsized":"2024-09-17T05:35:11.700996+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:39.165630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701625+0000","last_change":"2024-09-17T05:35:10.719401+0000","last_active":"2024-09-17T05:35:11.701625+0000","last_peered":"2024-09-17T05:35:11.701625+0000","last_clean":"2024-09-17T05:35:11.701625+0000","last_became_active":"2024-09-17T05:35:10.715654+0000","last_became_peered":"2024-09-17T05:35:10.715654+0000","last_unstale":"2024-09-17T05:35:11.701625+0000","last_undegraded":"2024-09-17T05:35:11.701625+0000","last_fullsized":"2024-09-17T05:35:11.701625+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:58.927414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.828472+0000","last_change":"2024-09-17T05:35:09.720620+0000","last_active":"2024-09-17T05:35:11.828472+0000","last_peered":"2024-09-17T05:35:11.828472+0000","last_clean":"2024-09-17T05:35:11.828472+0000","last_became_active":"2024-09-17T05:35:09.720337+0000","last_became_peered":"2024-09-17T05:35:09.720337+0000","last_unstale":"2024-09-17T05:35:11.828472+0000","last_undegraded":"2024-09-17T05:35:11.828472+0000","last_fullsized":"2024-09-17T05:35:11.828472+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:56.817657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830444+0000","last_change":"2024-09-17T05:35:10.731383+0000","last_active":"2024-09-17T05:35:11.830444+0000","last_peered":"2024-09-17T05:35:11.830444+0000","last_clean":"2024-09-17T05:35:11.830444+0000","last_became_active":"2024-09-17T05:35:10.730984+0000","last_became_peered":"2024-09-17T05:35:10.730984+0000","last_unstale":"2024-09-17T05:35:11.830444+0000","last_undegraded":"2024-09-17T05:35:11.830444+0000","last_fullsized":"2024-09-17T05:35:11.830444+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:08.823412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830818+0000","last_change":"2024-09-17T05:35:09.723740+0000","last_active":"2024-09-17T05:35:11.830818+0000","last_peered":"2024-09-17T05:35:11.830818+0000","last_clean":"2024-09-17T05:35:11.830818+0000","last_became_active":"2024-09-17T05:35:09.723423+0000","last_became_peered":"2024-09-17T05:35:09.723423+0000","last_unstale":"2024-09-17T05:35:11.830818+0000","last_undegraded":"2024-09-17T05:35:11.830818+0000","last_fullsized":"2024-09-17T05:35:11.830818+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:11.671792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697880+0000","last_change":"2024-09-17T05:35:10.703303+0000","last_active":"2024-09-17T05:35:11.697880+0000","last_peered":"2024-09-17T05:35:11.697880+0000","last_clean":"2024-09-17T05:35:11.697880+0000","last_became_active":"2024-09-17T05:35:10.703018+0000","last_became_peered":"2024-09-17T05:35:10.703018+0000","last_unstale":"2024-09-17T05:35:11.697880+0000","last_undegraded":"2024-09-17T05:35:11.697880+0000","last_fullsized":"2024-09-17T05:35:11.697880+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:56.342790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"129'6","reported_seq":21,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.828107+0000","last_change":"2024-09-17T05:35:09.712522+0000","last_active":"2024-09-17T05:35:11.828107+0000","last_peered":"2024-09-17T05:35:11.828107+0000","last_clean":"2024-09-17T05:35:11.828107+0000","last_became_active":"2024-09-17T05:35:09.712291+0000","last_became_peered":"2024-09-17T05:35:09.712291+0000","last_unstale":"2024-09-17T05:35:11.828107+0000","last_undegraded":"2024-09-17T05:35:11.828107+0000","last_fullsized":"2024-09-17T05:35:11.828107+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:42.969339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830423+0000","last_change":"2024-09-17T05:35:10.738029+0000","last_active":"2024-09-17T05:35:11.830423+0000","last_peered":"2024-09-17T05:35:11.830423+0000","last_clean":"2024-09-17T05:35:11.830423+0000","last_became_active":"2024-09-17T05:35:10.736206+0000","last_became_peered":"2024-09-17T05:35:10.736206+0000","last_unstale":"2024-09-17T05:35:11.830423+0000","last_undegraded":"2024-09-17T05:35:11.830423+0000","last_fullsized":"2024-09-17T05:35:11.830423+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:20.973429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830321+0000","last_change":"2024-09-17T05:35:09.723126+0000","last_active":"2024-09-17T05:35:11.830321+0000","last_peered":"2024-09-17T05:35:11.830321+0000","last_clean":"2024-09-17T05:35:11.830321+0000","last_became_active":"2024-09-17T05:35:09.722099+0000","last_became_peered":"2024-09-17T05:35:09.722099+0000","last_unstale":"2024-09-17T05:35:11.830321+0000","last_undegraded":"2024-09-17T05:35:11.830321+0000","last_fullsized":"2024-09-17T05:35:11.830321+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:33.360865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827175+0000","last_change":"2024-09-17T05:35:10.716676+0000","last_active":"2024-09-17T05:35:11.827175+0000","last_peered":"2024-09-17T05:35:11.827175+0000","last_clean":"2024-09-17T05:35:11.827175+0000","last_became_active":"2024-09-17T05:35:10.716399+0000","last_became_peered":"2024-09-17T05:35:10.716399+0000","last_unstale":"2024-09-17T05:35:11.827175+0000","last_undegraded":"2024-09-17T05:35:11.827175+0000","last_fullsized":"2024-09-17T05:35:11.827175+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:45.630013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830298+0000","last_change":"2024-09-17T05:35:09.720369+0000","last_active":"2024-09-17T05:35:11.830298+0000","last_peered":"2024-09-17T05:35:11.830298+0000","last_clean":"2024-09-17T05:35:11.830298+0000","last_became_active":"2024-09-17T05:35:09.720071+0000","last_became_peered":"2024-09-17T05:35:09.720071+0000","last_unstale":"2024-09-17T05:35:11.830298+0000","last_undegraded":"2024-09-17T05:35:11.830298+0000","last_fullsized":"2024-09-17T05:35:11.830298+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:58.181490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701382+0000","last_change":"2024-09-17T05:35:10.725262+0000","last_active":"2024-09-17T05:35:11.701382+0000","last_peered":"2024-09-17T05:35:11.701382+0000","last_clean":"2024-09-17T05:35:11.701382+0000","last_became_active":"2024-09-17T05:35:10.724956+0000","last_became_peered":"2024-09-17T05:35:10.724956+0000","last_unstale":"2024-09-17T05:35:11.701382+0000","last_undegraded":"2024-09-17T05:35:11.701382+0000","last_fullsized":"2024-09-17T05:35:11.701382+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:12.357142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826441+0000","last_change":"2024-09-17T05:35:09.711049+0000","last_active":"2024-09-17T05:35:11.826441+0000","last_peered":"2024-09-17T05:35:11.826441+0000","last_clean":"2024-09-17T05:35:11.826441+0000","last_became_active":"2024-09-17T05:35:09.710759+0000","last_became_peered":"2024-09-17T05:35:09.710759+0000","last_unstale":"2024-09-17T05:35:11.826441+0000","last_undegraded":"2024-09-17T05:35:11.826441+0000","last_fullsized":"2024-09-17T05:35:11.826441+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:26.447685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829700+0000","last_change":"2024-09-17T05:35:10.720155+0000","last_active":"2024-09-17T05:35:11.829700+0000","last_peered":"2024-09-17T05:35:11.829700+0000","last_clean":"2024-09-17T05:35:11.829700+0000","last_became_active":"2024-09-17T05:35:10.719833+0000","last_became_peered":"2024-09-17T05:35:10.719833+0000","last_unstale":"2024-09-17T05:35:11.829700+0000","last_undegraded":"2024-09-17T05:35:11.829700+0000","last_fullsized":"2024-09-17T05:35:11.829700+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:44.593633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"129'8","reported_seq":23,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697425+0000","last_change":"2024-09-17T05:35:09.717857+0000","last_active":"2024-09-17T05:35:11.697425+0000","last_peered":"2024-09-17T05:35:11.697425+0000","last_clean":"2024-09-17T05:35:11.697425+0000","last_became_active":"2024-09-17T05:35:09.717598+0000","last_became_peered":"2024-09-17T05:35:09.717598+0000","last_unstale":"2024-09-17T05:35:11.697425+0000","last_undegraded":"2024-09-17T05:35:11.697425+0000","last_fullsized":"2024-09-17T05:35:11.697425+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:38.244832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830693+0000","last_change":"2024-09-17T05:35:10.731923+0000","last_active":"2024-09-17T05:35:11.830693+0000","last_peered":"2024-09-17T05:35:11.830693+0000","last_clean":"2024-09-17T05:35:11.830693+0000","last_became_active":"2024-09-17T05:35:10.731666+0000","last_became_peered":"2024-09-17T05:35:10.731666+0000","last_unstale":"2024-09-17T05:35:11.830693+0000","last_undegraded":"2024-09-17T05:35:11.830693+0000","last_fullsized":"2024-09-17T05:35:11.830693+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:15.066741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701210+0000","last_change":"2024-09-17T05:35:09.718077+0000","last_active":"2024-09-17T05:35:11.701210+0000","last_peered":"2024-09-17T05:35:11.701210+0000","last_clean":"2024-09-17T05:35:11.701210+0000","last_became_active":"2024-09-17T05:35:09.717649+0000","last_became_peered":"2024-09-17T05:35:09.717649+0000","last_unstale":"2024-09-17T05:35:11.701210+0000","last_undegraded":"2024-09-17T05:35:11.701210+0000","last_fullsized":"2024-09-17T05:35:11.701210+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:43.327029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.698224+0000","last_change":"2024-09-17T05:35:10.714794+0000","last_active":"2024-09-17T05:35:11.698224+0000","last_peered":"2024-09-17T05:35:11.698224+0000","last_clean":"2024-09-17T05:35:11.698224+0000","last_became_active":"2024-09-17T05:35:10.714430+0000","last_became_peered":"2024-09-17T05:35:10.714430+0000","last_unstale":"2024-09-17T05:35:11.698224+0000","last_undegraded":"2024-09-17T05:35:11.698224+0000","last_fullsized":"2024-09-17T05:35:11.698224+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:08.619152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827983+0000","last_change":"2024-09-17T05:35:09.719305+0000","last_active":"2024-09-17T05:35:11.827983+0000","last_peered":"2024-09-17T05:35:11.827983+0000","last_clean":"2024-09-17T05:35:11.827983+0000","last_became_active":"2024-09-17T05:35:09.718972+0000","last_became_peered":"2024-09-17T05:35:09.718972+0000","last_unstale":"2024-09-17T05:35:11.827983+0000","last_undegraded":"2024-09-17T05:35:11.827983+0000","last_fullsized":"2024-09-17T05:35:11.827983+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:39.549194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830703+0000","last_change":"2024-09-17T05:35:10.734939+0000","last_active":"2024-09-17T05:35:11.830703+0000","last_peered":"2024-09-17T05:35:11.830703+0000","last_clean":"2024-09-17T05:35:11.830703+0000","last_became_active":"2024-09-17T05:35:10.734619+0000","last_became_peered":"2024-09-17T05:35:10.734619+0000","last_unstale":"2024-09-17T05:35:11.830703+0000","last_undegraded":"2024-09-17T05:35:11.830703+0000","last_fullsized":"2024-09-17T05:35:11.830703+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:56.940784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697907+0000","last_change":"2024-09-17T05:35:09.712803+0000","last_active":"2024-09-17T05:35:11.697907+0000","last_peered":"2024-09-17T05:35:11.697907+0000","last_clean":"2024-09-17T05:35:11.697907+0000","last_became_active":"2024-09-17T05:35:09.712517+0000","last_became_peered":"2024-09-17T05:35:09.712517+0000","last_unstale":"2024-09-17T05:35:11.697907+0000","last_undegraded":"2024-09-17T05:35:11.697907+0000","last_fullsized":"2024-09-17T05:35:11.697907+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:09.310289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827048+0000","last_change":"2024-09-17T05:35:10.721884+0000","last_active":"2024-09-17T05:35:11.827048+0000","last_peered":"2024-09-17T05:35:11.827048+0000","last_clean":"2024-09-17T05:35:11.827048+0000","last_became_active":"2024-09-17T05:35:10.721599+0000","last_became_peered":"2024-09-17T05:35:10.721599+0000","last_unstale":"2024-09-17T05:35:11.827048+0000","last_undegraded":"2024-09-17T05:35:11.827048+0000","last_fullsized":"2024-09-17T05:35:11.827048+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:59.699810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827415+0000","last_change":"2024-09-17T05:35:09.722519+0000","last_active":"2024-09-17T05:35:11.827415+0000","last_peered":"2024-09-17T05:35:11.827415+0000","last_clean":"2024-09-17T05:35:11.827415+0000","last_became_active":"2024-09-17T05:35:09.722252+0000","last_became_peered":"2024-09-17T05:35:09.722252+0000","last_unstale":"2024-09-17T05:35:11.827415+0000","last_undegraded":"2024-09-17T05:35:11.827415+0000","last_fullsized":"2024-09-17T05:35:11.827415+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:05.455707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701693+0000","last_change":"2024-09-17T05:35:10.738071+0000","last_active":"2024-09-17T05:35:11.701693+0000","last_peered":"2024-09-17T05:35:11.701693+0000","last_clean":"2024-09-17T05:35:11.701693+0000","last_became_active":"2024-09-17T05:35:10.737423+0000","last_became_peered":"2024-09-17T05:35:10.737423+0000","last_unstale":"2024-09-17T05:35:11.701693+0000","last_undegraded":"2024-09-17T05:35:11.701693+0000","last_fullsized":"2024-09-17T05:35:11.701693+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:12.545660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827701+0000","last_change":"2024-09-17T05:35:09.714615+0000","last_active":"2024-09-17T05:35:11.827701+0000","last_peered":"2024-09-17T05:35:11.827701+0000","last_clean":"2024-09-17T05:35:11.827701+0000","last_became_active":"2024-09-17T05:35:09.714361+0000","last_became_peered":"2024-09-17T05:35:09.714361+0000","last_unstale":"2024-09-17T05:35:11.827701+0000","last_undegraded":"2024-09-17T05:35:11.827701+0000","last_fullsized":"2024-09-17T05:35:11.827701+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:03.571559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827783+0000","last_change":"2024-09-17T05:35:10.707095+0000","last_active":"2024-09-17T05:35:11.827783+0000","last_peered":"2024-09-17T05:35:11.827783+0000","last_clean":"2024-09-17T05:35:11.827783+0000","last_became_active":"2024-09-17T05:35:10.705640+0000","last_became_peered":"2024-09-17T05:35:10.705640+0000","last_unstale":"2024-09-17T05:35:11.827783+0000","last_undegraded":"2024-09-17T05:35:11.827783+0000","last_fullsized":"2024-09-17T05:35:11.827783+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:50.852737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829893+0000","last_change":"2024-09-17T05:35:09.720566+0000","last_active":"2024-09-17T05:35:11.829893+0000","last_peered":"2024-09-17T05:35:11.829893+0000","last_clean":"2024-09-17T05:35:11.829893+0000","last_became_active":"2024-09-17T05:35:09.720257+0000","last_became_peered":"2024-09-17T05:35:09.720257+0000","last_unstale":"2024-09-17T05:35:11.829893+0000","last_undegraded":"2024-09-17T05:35:11.829893+0000","last_fullsized":"2024-09-17T05:35:11.829893+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:42.345570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701108+0000","last_change":"2024-09-17T05:35:10.711076+0000","last_active":"2024-09-17T05:35:11.701108+0000","last_peered":"2024-09-17T05:35:11.701108+0000","last_clean":"2024-09-17T05:35:11.701108+0000","last_became_active":"2024-09-17T05:35:10.710765+0000","last_became_peered":"2024-09-17T05:35:10.710765+0000","last_unstale":"2024-09-17T05:35:11.701108+0000","last_undegraded":"2024-09-17T05:35:11.701108+0000","last_fullsized":"2024-09-17T05:35:11.701108+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:40.552361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829551+0000","last_change":"2024-09-17T05:35:09.724807+0000","last_active":"2024-09-17T05:35:11.829551+0000","last_peered":"2024-09-17T05:35:11.829551+0000","last_clean":"2024-09-17T05:35:11.829551+0000","last_became_active":"2024-09-17T05:35:09.724511+0000","last_became_peered":"2024-09-17T05:35:09.724511+0000","last_unstale":"2024-09-17T05:35:11.829551+0000","last_undegraded":"2024-09-17T05:35:11.829551+0000","last_fullsized":"2024-09-17T05:35:11.829551+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:35.547041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827103+0000","last_change":"2024-09-17T05:35:10.709083+0000","last_active":"2024-09-17T05:35:11.827103+0000","last_peered":"2024-09-17T05:35:11.827103+0000","last_clean":"2024-09-17T05:35:11.827103+0000","last_became_active":"2024-09-17T05:35:10.708479+0000","last_became_peered":"2024-09-17T05:35:10.708479+0000","last_unstale":"2024-09-17T05:35:11.827103+0000","last_undegraded":"2024-09-17T05:35:11.827103+0000","last_fullsized":"2024-09-17T05:35:11.827103+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:30.398281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829578+0000","last_change":"2024-09-17T05:35:09.720808+0000","last_active":"2024-09-17T05:35:11.829578+0000","last_peered":"2024-09-17T05:35:11.829578+0000","last_clean":"2024-09-17T05:35:11.829578+0000","last_became_active":"2024-09-17T05:35:09.720413+0000","last_became_peered":"2024-09-17T05:35:09.720413+0000","last_unstale":"2024-09-17T05:35:11.829578+0000","last_undegraded":"2024-09-17T05:35:11.829578+0000","last_fullsized":"2024-09-17T05:35:11.829578+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:58.533908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701801+0000","last_change":"2024-09-17T05:35:10.723970+0000","last_active":"2024-09-17T05:35:11.701801+0000","last_peered":"2024-09-17T05:35:11.701801+0000","last_clean":"2024-09-17T05:35:11.701801+0000","last_became_active":"2024-09-17T05:35:10.723691+0000","last_became_peered":"2024-09-17T05:35:10.723691+0000","last_unstale":"2024-09-17T05:35:11.701801+0000","last_undegraded":"2024-09-17T05:35:11.701801+0000","last_fullsized":"2024-09-17T05:35:11.701801+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:19.323320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830603+0000","last_change":"2024-09-17T05:35:09.724881+0000","last_active":"2024-09-17T05:35:11.830603+0000","last_peered":"2024-09-17T05:35:11.830603+0000","last_clean":"2024-09-17T05:35:11.830603+0000","last_became_active":"2024-09-17T05:35:09.724580+0000","last_became_peered":"2024-09-17T05:35:09.724580+0000","last_unstale":"2024-09-17T05:35:11.830603+0000","last_undegraded":"2024-09-17T05:35:11.830603+0000","last_fullsized":"2024-09-17T05:35:11.830603+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:17.130919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.831030+0000","last_change":"2024-09-17T05:35:10.735424+0000","last_active":"2024-09-17T05:35:11.831030+0000","last_peered":"2024-09-17T05:35:11.831030+0000","last_clean":"2024-09-17T05:35:11.831030+0000","last_became_active":"2024-09-17T05:35:10.735119+0000","last_became_peered":"2024-09-17T05:35:10.735119+0000","last_unstale":"2024-09-17T05:35:11.831030+0000","last_undegraded":"2024-09-17T05:35:11.831030+0000","last_fullsized":"2024-09-17T05:35:11.831030+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:48.745909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"130'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827463+0000","last_change":"2024-09-17T05:35:09.708821+0000","last_active":"2024-09-17T05:35:11.827463+0000","last_peered":"2024-09-17T05:35:11.827463+0000","last_clean":"2024-09-17T05:35:11.827463+0000","last_became_active":"2024-09-17T05:35:09.708507+0000","last_became_peered":"2024-09-17T05:35:09.708507+0000","last_unstale":"2024-09-17T05:35:11.827463+0000","last_undegraded":"2024-09-17T05:35:11.827463+0000","last_fullsized":"2024-09-17T05:35:11.827463+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:29.505189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827357+0000","last_change":"2024-09-17T05:35:10.736552+0000","last_active":"2024-09-17T05:35:11.827357+0000","last_peered":"2024-09-17T05:35:11.827357+0000","last_clean":"2024-09-17T05:35:11.827357+0000","last_became_active":"2024-09-17T05:35:10.736221+0000","last_became_peered":"2024-09-17T05:35:10.736221+0000","last_unstale":"2024-09-17T05:35:11.827357+0000","last_undegraded":"2024-09-17T05:35:11.827357+0000","last_fullsized":"2024-09-17T05:35:11.827357+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:18.134086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827319+0000","last_change":"2024-09-17T05:35:09.704879+0000","last_active":"2024-09-17T05:35:11.827319+0000","last_peered":"2024-09-17T05:35:11.827319+0000","last_clean":"2024-09-17T05:35:11.827319+0000","last_became_active":"2024-09-17T05:35:09.704603+0000","last_became_peered":"2024-09-17T05:35:09.704603+0000","last_unstale":"2024-09-17T05:35:11.827319+0000","last_undegraded":"2024-09-17T05:35:11.827319+0000","last_fullsized":"2024-09-17T05:35:11.827319+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:20.402712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.828348+0000","last_change":"2024-09-17T05:35:10.724975+0000","last_active":"2024-09-17T05:35:11.828348+0000","last_peered":"2024-09-17T05:35:11.828348+0000","last_clean":"2024-09-17T05:35:11.828348+0000","last_became_active":"2024-09-17T05:35:10.724723+0000","last_became_peered":"2024-09-17T05:35:10.724723+0000","last_unstale":"2024-09-17T05:35:11.828348+0000","last_undegraded":"2024-09-17T05:35:11.828348+0000","last_fullsized":"2024-09-17T05:35:11.828348+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:38.030801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826989+0000","last_change":"2024-09-17T05:35:09.709621+0000","last_active":"2024-09-17T05:35:11.826989+0000","last_peered":"2024-09-17T05:35:11.826989+0000","last_clean":"2024-09-17T05:35:11.826989+0000","last_became_active":"2024-09-17T05:35:09.709363+0000","last_became_peered":"2024-09-17T05:35:09.709363+0000","last_unstale":"2024-09-17T05:35:11.826989+0000","last_undegraded":"2024-09-17T05:35:11.826989+0000","last_fullsized":"2024-09-17T05:35:11.826989+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:40.353006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697760+0000","last_change":"2024-09-17T05:35:10.714041+0000","last_active":"2024-09-17T05:35:11.697760+0000","last_peered":"2024-09-17T05:35:11.697760+0000","last_clean":"2024-09-17T05:35:11.697760+0000","last_became_active":"2024-09-17T05:35:10.713775+0000","last_became_peered":"2024-09-17T05:35:10.713775+0000","last_unstale":"2024-09-17T05:35:11.697760+0000","last_undegraded":"2024-09-17T05:35:11.697760+0000","last_fullsized":"2024-09-17T05:35:11.697760+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:29.648541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827800+0000","last_change":"2024-09-17T05:35:09.719714+0000","last_active":"2024-09-17T05:35:11.827800+0000","last_peered":"2024-09-17T05:35:11.827800+0000","last_clean":"2024-09-17T05:35:11.827800+0000","last_became_active":"2024-09-17T05:35:09.719287+0000","last_became_peered":"2024-09-17T05:35:09.719287+0000","last_unstale":"2024-09-17T05:35:11.827800+0000","last_undegraded":"2024-09-17T05:35:11.827800+0000","last_fullsized":"2024-09-17T05:35:11.827800+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:53:29.853613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.702311+0000","last_change":"2024-09-17T05:35:10.722898+0000","last_active":"2024-09-17T05:35:11.702311+0000","last_peered":"2024-09-17T05:35:11.702311+0000","last_clean":"2024-09-17T05:35:11.702311+0000","last_became_active":"2024-09-17T05:35:10.722610+0000","last_became_peered":"2024-09-17T05:35:10.722610+0000","last_unstale":"2024-09-17T05:35:11.702311+0000","last_undegraded":"2024-09-17T05:35:11.702311+0000","last_fullsized":"2024-09-17T05:35:11.702311+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:23.935000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829995+0000","last_change":"2024-09-17T05:35:09.719841+0000","last_active":"2024-09-17T05:35:11.829995+0000","last_peered":"2024-09-17T05:35:11.829995+0000","last_clean":"2024-09-17T05:35:11.829995+0000","last_became_active":"2024-09-17T05:35:09.719107+0000","last_became_peered":"2024-09-17T05:35:09.719107+0000","last_unstale":"2024-09-17T05:35:11.829995+0000","last_undegraded":"2024-09-17T05:35:11.829995+0000","last_fullsized":"2024-09-17T05:35:11.829995+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:09:36.271385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829739+0000","last_change":"2024-09-17T05:35:10.725458+0000","last_active":"2024-09-17T05:35:11.829739+0000","last_peered":"2024-09-17T05:35:11.829739+0000","last_clean":"2024-09-17T05:35:11.829739+0000","last_became_active":"2024-09-17T05:35:10.725109+0000","last_became_peered":"2024-09-17T05:35:10.725109+0000","last_unstale":"2024-09-17T05:35:11.829739+0000","last_undegraded":"2024-09-17T05:35:11.829739+0000","last_fullsized":"2024-09-17T05:35:11.829739+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:06.674189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829823+0000","last_change":"2024-09-17T05:35:09.722278+0000","last_active":"2024-09-17T05:35:11.829823+0000","last_peered":"2024-09-17T05:35:11.829823+0000","last_clean":"2024-09-17T05:35:11.829823+0000","last_became_active":"2024-09-17T05:35:09.721961+0000","last_became_peered":"2024-09-17T05:35:09.721961+0000","last_unstale":"2024-09-17T05:35:11.829823+0000","last_undegraded":"2024-09-17T05:35:11.829823+0000","last_fullsized":"2024-09-17T05:35:11.829823+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:18.450244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.702036+0000","last_change":"2024-09-17T05:35:10.717605+0000","last_active":"2024-09-17T05:35:11.702036+0000","last_peered":"2024-09-17T05:35:11.702036+0000","last_clean":"2024-09-17T05:35:11.702036+0000","last_became_active":"2024-09-17T05:35:10.717311+0000","last_became_peered":"2024-09-17T05:35:10.717311+0000","last_unstale":"2024-09-17T05:35:11.702036+0000","last_undegraded":"2024-09-17T05:35:11.702036+0000","last_fullsized":"2024-09-17T05:35:11.702036+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:16.544702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826587+0000","last_change":"2024-09-17T05:35:09.721036+0000","last_active":"2024-09-17T05:35:11.826587+0000","last_peered":"2024-09-17T05:35:11.826587+0000","last_clean":"2024-09-17T05:35:11.826587+0000","last_became_active":"2024-09-17T05:35:09.720616+0000","last_became_peered":"2024-09-17T05:35:09.720616+0000","last_unstale":"2024-09-17T05:35:11.826587+0000","last_undegraded":"2024-09-17T05:35:11.826587+0000","last_fullsized":"2024-09-17T05:35:11.826587+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:29.186473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.828156+0000","last_change":"2024-09-17T05:35:10.708117+0000","last_active":"2024-09-17T05:35:11.828156+0000","last_peered":"2024-09-17T05:35:11.828156+0000","last_clean":"2024-09-17T05:35:11.828156+0000","last_became_active":"2024-09-17T05:35:10.707819+0000","last_became_peered":"2024-09-17T05:35:10.707819+0000","last_unstale":"2024-09-17T05:35:11.828156+0000","last_undegraded":"2024-09-17T05:35:11.828156+0000","last_fullsized":"2024-09-17T05:35:11.828156+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:07.748783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"129'3","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830758+0000","last_change":"2024-09-17T05:35:09.723892+0000","last_active":"2024-09-17T05:35:11.830758+0000","last_peered":"2024-09-17T05:35:11.830758+0000","last_clean":"2024-09-17T05:35:11.830758+0000","last_became_active":"2024-09-17T05:35:09.723512+0000","last_became_peered":"2024-09-17T05:35:09.723512+0000","last_unstale":"2024-09-17T05:35:11.830758+0000","last_undegraded":"2024-09-17T05:35:11.830758+0000","last_fullsized":"2024-09-17T05:35:11.830758+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:59.546025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":339,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829811+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:35:11.829811+0000","last_peered":"2024-09-17T05:35:11.829811+0000","last_clean":"2024-09-17T05:35:11.829811+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:35:11.829811+0000","last_undegraded":"2024-09-17T05:35:11.829811+0000","last_fullsized":"2024-09-17T05:35:11.829811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509523,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33364,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338476,"statfs":{"total":96636764160,"available":96602599424,"internally_reserved":0,"allocated":2224128,"data_stored":1306146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509524,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1634304,"data_stored":715272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542227,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1626112,"data_stored":715148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509524,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1622016,"data_stored":715126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509524,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1626112,"data_stored":715216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509524,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32796,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339044,"statfs":{"total":96636764160,"available":96603181056,"internally_reserved":0,"allocated":1638400,"data_stored":716808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509522,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32784,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339056,"statfs":{"total":96636764160,"available":96603193344,"internally_reserved":0,"allocated":1626112,"data_stored":715708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542226,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33372,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338468,"statfs":{"total":96636764160,"available":96602591232,"internally_reserved":0,"allocated":2232320,"data_stored":1307140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:35:14.876 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:35:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.057+0000 7f46a3600640 1 -- 172.21.15.31:0/4207064910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f469c0ced80 msgr2=0x7f469c0ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.057+0000 7f46a3600640 1 --2- 172.21.15.31:0/4207064910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f469c0ced80 0x7f469c0ae9b0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f469c0cf340 tx=0x7f468401c800 comp rx=0 tx=0).stop 2024-09-17T05:35:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.057+0000 7f46a3600640 1 -- 172.21.15.31:0/4207064910 shutdown_connections 2024-09-17T05:35:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.057+0000 7f46a3600640 1 --2- 172.21.15.31:0/4207064910 >> v2:172.21.15.155:3300/0 conn(0x7f469c0cdb30 0x7f469c0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.057+0000 7f46a3600640 1 --2- 172.21.15.31:0/4207064910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f469c0ced80 0x7f469c0ae9b0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.057+0000 7f46a3600640 1 -- 172.21.15.31:0/4207064910 >> 172.21.15.31:0/4207064910 conn(0x7f469c0d1dc0 msgr2=0x7f469c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.057+0000 7f46a3600640 1 -- 172.21.15.31:0/4207064910 shutdown_connections 2024-09-17T05:35:15.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.057+0000 7f46a3600640 1 -- 172.21.15.31:0/4207064910 wait complete. 2024-09-17T05:35:15.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a3600640 1 Processor -- start 2024-09-17T05:35:15.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a3600640 1 -- start start 2024-09-17T05:35:15.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a3600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f469c0cdb30 0x7f469c1f8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:15.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a3600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f469c0ced80 0x7f469c1515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:15.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a3600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f469c15bea0 0x7f469c156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:15.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a3600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f469c1692f0 con 0x7f469c15bea0 2024-09-17T05:35:15.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a3600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f469c169170 con 0x7f469c0cdb30 2024-09-17T05:35:15.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a3600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f469c169470 con 0x7f469c0ced80 2024-09-17T05:35:15.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a1600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f469c15bea0 0x7f469c156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:15.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a1600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f469c15bea0 0x7f469c156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54196/0 (socket says 172.21.15.31:54196) 2024-09-17T05:35:15.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a1600640 1 -- 172.21.15.31:0/4262767226 learned_addr learned my addr 172.21.15.31:0/4262767226 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:15.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a0c00640 1 --2- 172.21.15.31:0/4262767226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f469c0cdb30 0x7f469c1f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:15.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f4693e00640 1 --2- 172.21.15.31:0/4262767226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f469c0ced80 0x7f469c1515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:15.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a1600640 1 -- 172.21.15.31:0/4262767226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f469c0ced80 msgr2=0x7f469c1515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:15.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a1600640 1 --2- 172.21.15.31:0/4262767226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f469c0ced80 0x7f469c1515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a1600640 1 -- 172.21.15.31:0/4262767226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f469c0cdb30 msgr2=0x7f469c1f8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:15.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a1600640 1 --2- 172.21.15.31:0/4262767226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f469c0cdb30 0x7f469c1f8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a1600640 1 -- 172.21.15.31:0/4262767226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469c157e80 con 0x7f469c15bea0 2024-09-17T05:35:15.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a1600640 1 --2- 172.21.15.31:0/4262767226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f469c15bea0 0x7f469c156ac0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f469400eb50 tx=0x7f469400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:15.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f4699600640 1 -- 172.21.15.31:0/4262767226 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694004d30 con 0x7f469c15bea0 2024-09-17T05:35:15.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f4699600640 1 -- 172.21.15.31:0/4262767226 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f469400ee50 con 0x7f469c15bea0 2024-09-17T05:35:15.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a3600640 1 -- 172.21.15.31:0/4262767226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f469c158160 con 0x7f469c15bea0 2024-09-17T05:35:15.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f4699600640 1 -- 172.21.15.31:0/4262767226 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694005280 con 0x7f469c15bea0 2024-09-17T05:35:15.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a3600640 1 -- 172.21.15.31:0/4262767226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f469c151b30 con 0x7f469c15bea0 2024-09-17T05:35:15.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.061+0000 7f46a3600640 1 -- 172.21.15.31:0/4262767226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f469c0ce670 con 0x7f469c15bea0 2024-09-17T05:35:15.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.065+0000 7f4699600640 1 -- 172.21.15.31:0/4262767226 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f4694005420 con 0x7f469c15bea0 2024-09-17T05:35:15.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.065+0000 7f4699600640 1 --2- 172.21.15.31:0/4262767226 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4678073830 0x7f4678075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:15.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.065+0000 7f4699600640 1 -- 172.21.15.31:0/4262767226 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f4694095c40 con 0x7f469c15bea0 2024-09-17T05:35:15.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.065+0000 7f46a0c00640 1 --2- 172.21.15.31:0/4262767226 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4678073830 0x7f4678075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:15.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.065+0000 7f46a0c00640 1 --2- 172.21.15.31:0/4262767226 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4678073830 0x7f4678075cf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f468c001640 tx=0x7f468c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:15.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.069+0000 7f4699600640 1 -- 172.21.15.31:0/4262767226 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4694060240 con 0x7f469c15bea0 2024-09-17T05:35:15.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.245+0000 7f46a3600640 1 -- 172.21.15.31:0/4262767226 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f469c158330 con 0x7f4678073830 2024-09-17T05:35:15.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.249+0000 7f4699600640 1 -- 172.21.15.31:0/4262767226 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252483 (secure 0 0 0) 0x7f469c158330 con 0x7f4678073830 2024-09-17T05:35:15.253 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:15.254 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:35:15.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.253+0000 7f46a3600640 1 -- 172.21.15.31:0/4262767226 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4678073830 msgr2=0x7f4678075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:15.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.253+0000 7f46a3600640 1 --2- 172.21.15.31:0/4262767226 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4678073830 0x7f4678075cf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f468c001640 tx=0x7f468c009040 comp rx=0 tx=0).stop 2024-09-17T05:35:15.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.253+0000 7f46a3600640 1 -- 172.21.15.31:0/4262767226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f469c15bea0 msgr2=0x7f469c156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:15.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.253+0000 7f46a3600640 1 --2- 172.21.15.31:0/4262767226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f469c15bea0 0x7f469c156ac0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f469400eb50 tx=0x7f469400c6a0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.253+0000 7f46a3600640 1 -- 172.21.15.31:0/4262767226 shutdown_connections 2024-09-17T05:35:15.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.253+0000 7f46a3600640 1 --2- 172.21.15.31:0/4262767226 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4678073830 0x7f4678075cf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.253+0000 7f46a3600640 1 --2- 172.21.15.31:0/4262767226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f469c15bea0 0x7f469c156ac0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.253+0000 7f46a3600640 1 --2- 172.21.15.31:0/4262767226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f469c0ced80 0x7f469c1515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.253+0000 7f46a3600640 1 --2- 172.21.15.31:0/4262767226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f469c0cdb30 0x7f469c1f8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.253+0000 7f46a3600640 1 -- 172.21.15.31:0/4262767226 >> 172.21.15.31:0/4262767226 conn(0x7f469c0d1dc0 msgr2=0x7f469c0d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:15.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.253+0000 7f46a3600640 1 -- 172.21.15.31:0/4262767226 shutdown_connections 2024-09-17T05:35:15.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.253+0000 7f46a3600640 1 -- 172.21.15.31:0/4262767226 wait complete. 2024-09-17T05:35:15.274 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-09-17T05:35:14.732512+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":263432,"kb_used_data":13896,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711288,"statfs":{"total":773094113280,"available":772824358912,"internally_reserved":0,"allocated":14229504,"data_stored":6906564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001452"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827465+0000","last_change":"2024-09-17T05:35:10.726891+0000","last_active":"2024-09-17T05:35:11.827465+0000","last_peered":"2024-09-17T05:35:11.827465+0000","last_clean":"2024-09-17T05:35:11.827465+0000","last_became_active":"2024-09-17T05:35:10.724562+0000","last_became_peered":"2024-09-17T05:35:10.724562+0000","last_unstale":"2024-09-17T05:35:11.827465+0000","last_undegraded":"2024-09-17T05:35:11.827465+0000","last_fullsized":"2024-09-17T05:35:11.827465+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:52:46.349687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827929+0000","last_change":"2024-09-17T05:35:10.714914+0000","last_active":"2024-09-17T05:35:11.827929+0000","last_peered":"2024-09-17T05:35:11.827929+0000","last_clean":"2024-09-17T05:35:11.827929+0000","last_became_active":"2024-09-17T05:35:10.714656+0000","last_became_peered":"2024-09-17T05:35:10.714656+0000","last_unstale":"2024-09-17T05:35:11.827929+0000","last_undegraded":"2024-09-17T05:35:11.827929+0000","last_fullsized":"2024-09-17T05:35:11.827929+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:17.509666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830955+0000","last_change":"2024-09-17T05:35:10.720249+0000","last_active":"2024-09-17T05:35:11.830955+0000","last_peered":"2024-09-17T05:35:11.830955+0000","last_clean":"2024-09-17T05:35:11.830955+0000","last_became_active":"2024-09-17T05:35:10.719963+0000","last_became_peered":"2024-09-17T05:35:10.719963+0000","last_unstale":"2024-09-17T05:35:11.830955+0000","last_undegraded":"2024-09-17T05:35:11.830955+0000","last_fullsized":"2024-09-17T05:35:11.830955+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:02.434428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.702328+0000","last_change":"2024-09-17T05:35:10.733098+0000","last_active":"2024-09-17T05:35:11.702328+0000","last_peered":"2024-09-17T05:35:11.702328+0000","last_clean":"2024-09-17T05:35:11.702328+0000","last_became_active":"2024-09-17T05:35:10.732844+0000","last_became_peered":"2024-09-17T05:35:10.732844+0000","last_unstale":"2024-09-17T05:35:11.702328+0000","last_undegraded":"2024-09-17T05:35:11.702328+0000","last_fullsized":"2024-09-17T05:35:11.702328+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:10.935979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.702051+0000","last_change":"2024-09-17T05:35:10.728186+0000","last_active":"2024-09-17T05:35:11.702051+0000","last_peered":"2024-09-17T05:35:11.702051+0000","last_clean":"2024-09-17T05:35:11.702051+0000","last_became_active":"2024-09-17T05:35:10.726660+0000","last_became_peered":"2024-09-17T05:35:10.726660+0000","last_unstale":"2024-09-17T05:35:11.702051+0000","last_undegraded":"2024-09-17T05:35:11.702051+0000","last_fullsized":"2024-09-17T05:35:11.702051+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:20.349740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826741+0000","last_change":"2024-09-17T05:35:10.722477+0000","last_active":"2024-09-17T05:35:11.826741+0000","last_peered":"2024-09-17T05:35:11.826741+0000","last_clean":"2024-09-17T05:35:11.826741+0000","last_became_active":"2024-09-17T05:35:10.721313+0000","last_became_peered":"2024-09-17T05:35:10.721313+0000","last_unstale":"2024-09-17T05:35:11.826741+0000","last_undegraded":"2024-09-17T05:35:11.826741+0000","last_fullsized":"2024-09-17T05:35:11.826741+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:35:27.684920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826539+0000","last_change":"2024-09-17T05:35:10.709064+0000","last_active":"2024-09-17T05:35:11.826539+0000","last_peered":"2024-09-17T05:35:11.826539+0000","last_clean":"2024-09-17T05:35:11.826539+0000","last_became_active":"2024-09-17T05:35:10.708813+0000","last_became_peered":"2024-09-17T05:35:10.708813+0000","last_unstale":"2024-09-17T05:35:11.826539+0000","last_undegraded":"2024-09-17T05:35:11.826539+0000","last_fullsized":"2024-09-17T05:35:11.826539+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:46.946258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826260+0000","last_change":"2024-09-17T05:35:10.723080+0000","last_active":"2024-09-17T05:35:11.826260+0000","last_peered":"2024-09-17T05:35:11.826260+0000","last_clean":"2024-09-17T05:35:11.826260+0000","last_became_active":"2024-09-17T05:35:10.722832+0000","last_became_peered":"2024-09-17T05:35:10.722832+0000","last_unstale":"2024-09-17T05:35:11.826260+0000","last_undegraded":"2024-09-17T05:35:11.826260+0000","last_fullsized":"2024-09-17T05:35:11.826260+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:35.222207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.828411+0000","last_change":"2024-09-17T05:35:10.729957+0000","last_active":"2024-09-17T05:35:11.828411+0000","last_peered":"2024-09-17T05:35:11.828411+0000","last_clean":"2024-09-17T05:35:11.828411+0000","last_became_active":"2024-09-17T05:35:10.729662+0000","last_became_peered":"2024-09-17T05:35:10.729662+0000","last_unstale":"2024-09-17T05:35:11.828411+0000","last_undegraded":"2024-09-17T05:35:11.828411+0000","last_fullsized":"2024-09-17T05:35:11.828411+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:18.162234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830499+0000","last_change":"2024-09-17T05:35:10.740141+0000","last_active":"2024-09-17T05:35:11.830499+0000","last_peered":"2024-09-17T05:35:11.830499+0000","last_clean":"2024-09-17T05:35:11.830499+0000","last_became_active":"2024-09-17T05:35:10.739676+0000","last_became_peered":"2024-09-17T05:35:10.739676+0000","last_unstale":"2024-09-17T05:35:11.830499+0000","last_undegraded":"2024-09-17T05:35:11.830499+0000","last_fullsized":"2024-09-17T05:35:11.830499+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:37.656659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826843+0000","last_change":"2024-09-17T05:35:10.728207+0000","last_active":"2024-09-17T05:35:11.826843+0000","last_peered":"2024-09-17T05:35:11.826843+0000","last_clean":"2024-09-17T05:35:11.826843+0000","last_became_active":"2024-09-17T05:35:10.727945+0000","last_became_peered":"2024-09-17T05:35:10.727945+0000","last_unstale":"2024-09-17T05:35:11.826843+0000","last_undegraded":"2024-09-17T05:35:11.826843+0000","last_fullsized":"2024-09-17T05:35:11.826843+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:00.227587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830041+0000","last_change":"2024-09-17T05:35:10.726213+0000","last_active":"2024-09-17T05:35:11.830041+0000","last_peered":"2024-09-17T05:35:11.830041+0000","last_clean":"2024-09-17T05:35:11.830041+0000","last_became_active":"2024-09-17T05:35:10.725940+0000","last_became_peered":"2024-09-17T05:35:10.725940+0000","last_unstale":"2024-09-17T05:35:11.830041+0000","last_undegraded":"2024-09-17T05:35:11.830041+0000","last_fullsized":"2024-09-17T05:35:11.830041+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:59:34.219452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.702241+0000","last_change":"2024-09-17T05:35:10.726919+0000","last_active":"2024-09-17T05:35:11.702241+0000","last_peered":"2024-09-17T05:35:11.702241+0000","last_clean":"2024-09-17T05:35:11.702241+0000","last_became_active":"2024-09-17T05:35:10.726318+0000","last_became_peered":"2024-09-17T05:35:10.726318+0000","last_unstale":"2024-09-17T05:35:11.702241+0000","last_undegraded":"2024-09-17T05:35:11.702241+0000","last_fullsized":"2024-09-17T05:35:11.702241+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:18.571063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701440+0000","last_change":"2024-09-17T05:35:10.738626+0000","last_active":"2024-09-17T05:35:11.701440+0000","last_peered":"2024-09-17T05:35:11.701440+0000","last_clean":"2024-09-17T05:35:11.701440+0000","last_became_active":"2024-09-17T05:35:10.735090+0000","last_became_peered":"2024-09-17T05:35:10.735090+0000","last_unstale":"2024-09-17T05:35:11.701440+0000","last_undegraded":"2024-09-17T05:35:11.701440+0000","last_fullsized":"2024-09-17T05:35:11.701440+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:57.820824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829745+0000","last_change":"2024-09-17T05:35:10.719039+0000","last_active":"2024-09-17T05:35:11.829745+0000","last_peered":"2024-09-17T05:35:11.829745+0000","last_clean":"2024-09-17T05:35:11.829745+0000","last_became_active":"2024-09-17T05:35:10.718518+0000","last_became_peered":"2024-09-17T05:35:10.718518+0000","last_unstale":"2024-09-17T05:35:11.829745+0000","last_undegraded":"2024-09-17T05:35:11.829745+0000","last_fullsized":"2024-09-17T05:35:11.829745+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:25.768293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697360+0000","last_change":"2024-09-17T05:35:10.715845+0000","last_active":"2024-09-17T05:35:11.697360+0000","last_peered":"2024-09-17T05:35:11.697360+0000","last_clean":"2024-09-17T05:35:11.697360+0000","last_became_active":"2024-09-17T05:35:10.714208+0000","last_became_peered":"2024-09-17T05:35:10.714208+0000","last_unstale":"2024-09-17T05:35:11.697360+0000","last_undegraded":"2024-09-17T05:35:11.697360+0000","last_fullsized":"2024-09-17T05:35:11.697360+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:47.004341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830912+0000","last_change":"2024-09-17T05:35:10.732283+0000","last_active":"2024-09-17T05:35:11.830912+0000","last_peered":"2024-09-17T05:35:11.830912+0000","last_clean":"2024-09-17T05:35:11.830912+0000","last_became_active":"2024-09-17T05:35:10.731804+0000","last_became_peered":"2024-09-17T05:35:10.731804+0000","last_unstale":"2024-09-17T05:35:11.830912+0000","last_undegraded":"2024-09-17T05:35:11.830912+0000","last_fullsized":"2024-09-17T05:35:11.830912+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:27:05.597754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.831219+0000","last_change":"2024-09-17T05:35:10.721141+0000","last_active":"2024-09-17T05:35:11.831219+0000","last_peered":"2024-09-17T05:35:11.831219+0000","last_clean":"2024-09-17T05:35:11.831219+0000","last_became_active":"2024-09-17T05:35:10.720850+0000","last_became_peered":"2024-09-17T05:35:10.720850+0000","last_unstale":"2024-09-17T05:35:11.831219+0000","last_undegraded":"2024-09-17T05:35:11.831219+0000","last_fullsized":"2024-09-17T05:35:11.831219+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:53:37.339573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827258+0000","last_change":"2024-09-17T05:35:10.724368+0000","last_active":"2024-09-17T05:35:11.827258+0000","last_peered":"2024-09-17T05:35:11.827258+0000","last_clean":"2024-09-17T05:35:11.827258+0000","last_became_active":"2024-09-17T05:35:10.723810+0000","last_became_peered":"2024-09-17T05:35:10.723810+0000","last_unstale":"2024-09-17T05:35:11.827258+0000","last_undegraded":"2024-09-17T05:35:11.827258+0000","last_fullsized":"2024-09-17T05:35:11.827258+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:54.274682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697734+0000","last_change":"2024-09-17T05:35:10.712963+0000","last_active":"2024-09-17T05:35:11.697734+0000","last_peered":"2024-09-17T05:35:11.697734+0000","last_clean":"2024-09-17T05:35:11.697734+0000","last_became_active":"2024-09-17T05:35:10.712672+0000","last_became_peered":"2024-09-17T05:35:10.712672+0000","last_unstale":"2024-09-17T05:35:11.697734+0000","last_undegraded":"2024-09-17T05:35:11.697734+0000","last_fullsized":"2024-09-17T05:35:11.697734+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:07.660166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830271+0000","last_change":"2024-09-17T05:35:10.740564+0000","last_active":"2024-09-17T05:35:11.830271+0000","last_peered":"2024-09-17T05:35:11.830271+0000","last_clean":"2024-09-17T05:35:11.830271+0000","last_became_active":"2024-09-17T05:35:10.739992+0000","last_became_peered":"2024-09-17T05:35:10.739992+0000","last_unstale":"2024-09-17T05:35:11.830271+0000","last_undegraded":"2024-09-17T05:35:11.830271+0000","last_fullsized":"2024-09-17T05:35:11.830271+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:03:40.001869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701507+0000","last_change":"2024-09-17T05:35:10.721896+0000","last_active":"2024-09-17T05:35:11.701507+0000","last_peered":"2024-09-17T05:35:11.701507+0000","last_clean":"2024-09-17T05:35:11.701507+0000","last_became_active":"2024-09-17T05:35:10.721579+0000","last_became_peered":"2024-09-17T05:35:10.721579+0000","last_unstale":"2024-09-17T05:35:11.701507+0000","last_undegraded":"2024-09-17T05:35:11.701507+0000","last_fullsized":"2024-09-17T05:35:11.701507+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:19:28.704304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.702048+0000","last_change":"2024-09-17T05:35:10.711738+0000","last_active":"2024-09-17T05:35:11.702048+0000","last_peered":"2024-09-17T05:35:11.702048+0000","last_clean":"2024-09-17T05:35:11.702048+0000","last_became_active":"2024-09-17T05:35:10.711474+0000","last_became_peered":"2024-09-17T05:35:10.711474+0000","last_unstale":"2024-09-17T05:35:11.702048+0000","last_undegraded":"2024-09-17T05:35:11.702048+0000","last_fullsized":"2024-09-17T05:35:11.702048+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:11.870130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829706+0000","last_change":"2024-09-17T05:35:10.740134+0000","last_active":"2024-09-17T05:35:11.829706+0000","last_peered":"2024-09-17T05:35:11.829706+0000","last_clean":"2024-09-17T05:35:11.829706+0000","last_became_active":"2024-09-17T05:35:10.739819+0000","last_became_peered":"2024-09-17T05:35:10.739819+0000","last_unstale":"2024-09-17T05:35:11.829706+0000","last_undegraded":"2024-09-17T05:35:11.829706+0000","last_fullsized":"2024-09-17T05:35:11.829706+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:44.973761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.698033+0000","last_change":"2024-09-17T05:35:10.727777+0000","last_active":"2024-09-17T05:35:11.698033+0000","last_peered":"2024-09-17T05:35:11.698033+0000","last_clean":"2024-09-17T05:35:11.698033+0000","last_became_active":"2024-09-17T05:35:10.727501+0000","last_became_peered":"2024-09-17T05:35:10.727501+0000","last_unstale":"2024-09-17T05:35:11.698033+0000","last_undegraded":"2024-09-17T05:35:11.698033+0000","last_fullsized":"2024-09-17T05:35:11.698033+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:22.524398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827355+0000","last_change":"2024-09-17T05:35:10.725305+0000","last_active":"2024-09-17T05:35:11.827355+0000","last_peered":"2024-09-17T05:35:11.827355+0000","last_clean":"2024-09-17T05:35:11.827355+0000","last_became_active":"2024-09-17T05:35:10.721594+0000","last_became_peered":"2024-09-17T05:35:10.721594+0000","last_unstale":"2024-09-17T05:35:11.827355+0000","last_undegraded":"2024-09-17T05:35:11.827355+0000","last_fullsized":"2024-09-17T05:35:11.827355+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:46.447885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697536+0000","last_change":"2024-09-17T05:35:10.721866+0000","last_active":"2024-09-17T05:35:11.697536+0000","last_peered":"2024-09-17T05:35:11.697536+0000","last_clean":"2024-09-17T05:35:11.697536+0000","last_became_active":"2024-09-17T05:35:10.721613+0000","last_became_peered":"2024-09-17T05:35:10.721613+0000","last_unstale":"2024-09-17T05:35:11.697536+0000","last_undegraded":"2024-09-17T05:35:11.697536+0000","last_fullsized":"2024-09-17T05:35:11.697536+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:16.179585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.828045+0000","last_change":"2024-09-17T05:35:10.719130+0000","last_active":"2024-09-17T05:35:11.828045+0000","last_peered":"2024-09-17T05:35:11.828045+0000","last_clean":"2024-09-17T05:35:11.828045+0000","last_became_active":"2024-09-17T05:35:10.718820+0000","last_became_peered":"2024-09-17T05:35:10.718820+0000","last_unstale":"2024-09-17T05:35:11.828045+0000","last_undegraded":"2024-09-17T05:35:11.828045+0000","last_fullsized":"2024-09-17T05:35:11.828045+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:05.653657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826970+0000","last_change":"2024-09-17T05:35:10.722169+0000","last_active":"2024-09-17T05:35:11.826970+0000","last_peered":"2024-09-17T05:35:11.826970+0000","last_clean":"2024-09-17T05:35:11.826970+0000","last_became_active":"2024-09-17T05:35:10.721232+0000","last_became_peered":"2024-09-17T05:35:10.721232+0000","last_unstale":"2024-09-17T05:35:11.826970+0000","last_undegraded":"2024-09-17T05:35:11.826970+0000","last_fullsized":"2024-09-17T05:35:11.826970+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:51.126637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701638+0000","last_change":"2024-09-17T05:35:10.738485+0000","last_active":"2024-09-17T05:35:11.701638+0000","last_peered":"2024-09-17T05:35:11.701638+0000","last_clean":"2024-09-17T05:35:11.701638+0000","last_became_active":"2024-09-17T05:35:10.737816+0000","last_became_peered":"2024-09-17T05:35:10.737816+0000","last_unstale":"2024-09-17T05:35:11.701638+0000","last_undegraded":"2024-09-17T05:35:11.701638+0000","last_fullsized":"2024-09-17T05:35:11.701638+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:13.868590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826958+0000","last_change":"2024-09-17T05:35:10.719566+0000","last_active":"2024-09-17T05:35:11.826958+0000","last_peered":"2024-09-17T05:35:11.826958+0000","last_clean":"2024-09-17T05:35:11.826958+0000","last_became_active":"2024-09-17T05:35:10.719285+0000","last_became_peered":"2024-09-17T05:35:10.719285+0000","last_unstale":"2024-09-17T05:35:11.826958+0000","last_undegraded":"2024-09-17T05:35:11.826958+0000","last_fullsized":"2024-09-17T05:35:11.826958+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:36.550207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697424+0000","last_change":"2024-09-17T05:35:10.704953+0000","last_active":"2024-09-17T05:35:11.697424+0000","last_peered":"2024-09-17T05:35:11.697424+0000","last_clean":"2024-09-17T05:35:11.697424+0000","last_became_active":"2024-09-17T05:35:10.704641+0000","last_became_peered":"2024-09-17T05:35:10.704641+0000","last_unstale":"2024-09-17T05:35:11.697424+0000","last_undegraded":"2024-09-17T05:35:11.697424+0000","last_fullsized":"2024-09-17T05:35:11.697424+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:12.685870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830756+0000","last_change":"2024-09-17T05:35:10.725528+0000","last_active":"2024-09-17T05:35:11.830756+0000","last_peered":"2024-09-17T05:35:11.830756+0000","last_clean":"2024-09-17T05:35:11.830756+0000","last_became_active":"2024-09-17T05:35:10.725224+0000","last_became_peered":"2024-09-17T05:35:10.725224+0000","last_unstale":"2024-09-17T05:35:11.830756+0000","last_undegraded":"2024-09-17T05:35:11.830756+0000","last_fullsized":"2024-09-17T05:35:11.830756+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:07.029483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"129'4","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830489+0000","last_change":"2024-09-17T05:35:09.721409+0000","last_active":"2024-09-17T05:35:11.830489+0000","last_peered":"2024-09-17T05:35:11.830489+0000","last_clean":"2024-09-17T05:35:11.830489+0000","last_became_active":"2024-09-17T05:35:09.721060+0000","last_became_peered":"2024-09-17T05:35:09.721060+0000","last_unstale":"2024-09-17T05:35:11.830489+0000","last_undegraded":"2024-09-17T05:35:11.830489+0000","last_fullsized":"2024-09-17T05:35:11.830489+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:44.626846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.828528+0000","last_change":"2024-09-17T05:35:10.722856+0000","last_active":"2024-09-17T05:35:11.828528+0000","last_peered":"2024-09-17T05:35:11.828528+0000","last_clean":"2024-09-17T05:35:11.828528+0000","last_became_active":"2024-09-17T05:35:10.722607+0000","last_became_peered":"2024-09-17T05:35:10.722607+0000","last_unstale":"2024-09-17T05:35:11.828528+0000","last_undegraded":"2024-09-17T05:35:11.828528+0000","last_fullsized":"2024-09-17T05:35:11.828528+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:26.310997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827937+0000","last_change":"2024-09-17T05:35:09.721159+0000","last_active":"2024-09-17T05:35:11.827937+0000","last_peered":"2024-09-17T05:35:11.827937+0000","last_clean":"2024-09-17T05:35:11.827937+0000","last_became_active":"2024-09-17T05:35:09.720892+0000","last_became_peered":"2024-09-17T05:35:09.720892+0000","last_unstale":"2024-09-17T05:35:11.827937+0000","last_undegraded":"2024-09-17T05:35:11.827937+0000","last_fullsized":"2024-09-17T05:35:11.827937+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:26.353291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826933+0000","last_change":"2024-09-17T05:35:10.724724+0000","last_active":"2024-09-17T05:35:11.826933+0000","last_peered":"2024-09-17T05:35:11.826933+0000","last_clean":"2024-09-17T05:35:11.826933+0000","last_became_active":"2024-09-17T05:35:10.723767+0000","last_became_peered":"2024-09-17T05:35:10.723767+0000","last_unstale":"2024-09-17T05:35:11.826933+0000","last_undegraded":"2024-09-17T05:35:11.826933+0000","last_fullsized":"2024-09-17T05:35:11.826933+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:13.707392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701360+0000","last_change":"2024-09-17T05:35:09.716709+0000","last_active":"2024-09-17T05:35:11.701360+0000","last_peered":"2024-09-17T05:35:11.701360+0000","last_clean":"2024-09-17T05:35:11.701360+0000","last_became_active":"2024-09-17T05:35:09.716393+0000","last_became_peered":"2024-09-17T05:35:09.716393+0000","last_unstale":"2024-09-17T05:35:11.701360+0000","last_undegraded":"2024-09-17T05:35:11.701360+0000","last_fullsized":"2024-09-17T05:35:11.701360+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:50.807700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830122+0000","last_change":"2024-09-17T05:35:10.725470+0000","last_active":"2024-09-17T05:35:11.830122+0000","last_peered":"2024-09-17T05:35:11.830122+0000","last_clean":"2024-09-17T05:35:11.830122+0000","last_became_active":"2024-09-17T05:35:10.725153+0000","last_became_peered":"2024-09-17T05:35:10.725153+0000","last_unstale":"2024-09-17T05:35:11.830122+0000","last_undegraded":"2024-09-17T05:35:11.830122+0000","last_fullsized":"2024-09-17T05:35:11.830122+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:40.238306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.702263+0000","last_change":"2024-09-17T05:35:09.715611+0000","last_active":"2024-09-17T05:35:11.702263+0000","last_peered":"2024-09-17T05:35:11.702263+0000","last_clean":"2024-09-17T05:35:11.702263+0000","last_became_active":"2024-09-17T05:35:09.714227+0000","last_became_peered":"2024-09-17T05:35:09.714227+0000","last_unstale":"2024-09-17T05:35:11.702263+0000","last_undegraded":"2024-09-17T05:35:11.702263+0000","last_fullsized":"2024-09-17T05:35:11.702263+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:24.553359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827574+0000","last_change":"2024-09-17T05:35:10.718216+0000","last_active":"2024-09-17T05:35:11.827574+0000","last_peered":"2024-09-17T05:35:11.827574+0000","last_clean":"2024-09-17T05:35:11.827574+0000","last_became_active":"2024-09-17T05:35:10.717962+0000","last_became_peered":"2024-09-17T05:35:10.717962+0000","last_unstale":"2024-09-17T05:35:11.827574+0000","last_undegraded":"2024-09-17T05:35:11.827574+0000","last_fullsized":"2024-09-17T05:35:11.827574+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:19.603814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697504+0000","last_change":"2024-09-17T05:35:09.716452+0000","last_active":"2024-09-17T05:35:11.697504+0000","last_peered":"2024-09-17T05:35:11.697504+0000","last_clean":"2024-09-17T05:35:11.697504+0000","last_became_active":"2024-09-17T05:35:09.716197+0000","last_became_peered":"2024-09-17T05:35:09.716197+0000","last_unstale":"2024-09-17T05:35:11.697504+0000","last_undegraded":"2024-09-17T05:35:11.697504+0000","last_fullsized":"2024-09-17T05:35:11.697504+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:10.819077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701802+0000","last_change":"2024-09-17T05:35:10.736084+0000","last_active":"2024-09-17T05:35:11.701802+0000","last_peered":"2024-09-17T05:35:11.701802+0000","last_clean":"2024-09-17T05:35:11.701802+0000","last_became_active":"2024-09-17T05:35:10.735821+0000","last_became_peered":"2024-09-17T05:35:10.735821+0000","last_unstale":"2024-09-17T05:35:11.701802+0000","last_undegraded":"2024-09-17T05:35:11.701802+0000","last_fullsized":"2024-09-17T05:35:11.701802+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:02.564829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701286+0000","last_change":"2024-09-17T05:35:09.722601+0000","last_active":"2024-09-17T05:35:11.701286+0000","last_peered":"2024-09-17T05:35:11.701286+0000","last_clean":"2024-09-17T05:35:11.701286+0000","last_became_active":"2024-09-17T05:35:09.722096+0000","last_became_peered":"2024-09-17T05:35:09.722096+0000","last_unstale":"2024-09-17T05:35:11.701286+0000","last_undegraded":"2024-09-17T05:35:11.701286+0000","last_fullsized":"2024-09-17T05:35:11.701286+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:11:45.953824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826446+0000","last_change":"2024-09-17T05:35:10.721908+0000","last_active":"2024-09-17T05:35:11.826446+0000","last_peered":"2024-09-17T05:35:11.826446+0000","last_clean":"2024-09-17T05:35:11.826446+0000","last_became_active":"2024-09-17T05:35:10.721643+0000","last_became_peered":"2024-09-17T05:35:10.721643+0000","last_unstale":"2024-09-17T05:35:11.826446+0000","last_undegraded":"2024-09-17T05:35:11.826446+0000","last_fullsized":"2024-09-17T05:35:11.826446+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:12.674959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697354+0000","last_change":"2024-09-17T05:35:09.715752+0000","last_active":"2024-09-17T05:35:11.697354+0000","last_peered":"2024-09-17T05:35:11.697354+0000","last_clean":"2024-09-17T05:35:11.697354+0000","last_became_active":"2024-09-17T05:35:09.715417+0000","last_became_peered":"2024-09-17T05:35:09.715417+0000","last_unstale":"2024-09-17T05:35:11.697354+0000","last_undegraded":"2024-09-17T05:35:11.697354+0000","last_fullsized":"2024-09-17T05:35:11.697354+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:11.126055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701944+0000","last_change":"2024-09-17T05:35:10.725940+0000","last_active":"2024-09-17T05:35:11.701944+0000","last_peered":"2024-09-17T05:35:11.701944+0000","last_clean":"2024-09-17T05:35:11.701944+0000","last_became_active":"2024-09-17T05:35:10.725586+0000","last_became_peered":"2024-09-17T05:35:10.725586+0000","last_unstale":"2024-09-17T05:35:11.701944+0000","last_undegraded":"2024-09-17T05:35:11.701944+0000","last_fullsized":"2024-09-17T05:35:11.701944+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:14.160164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.700996+0000","last_change":"2024-09-17T05:35:09.713201+0000","last_active":"2024-09-17T05:35:11.700996+0000","last_peered":"2024-09-17T05:35:11.700996+0000","last_clean":"2024-09-17T05:35:11.700996+0000","last_became_active":"2024-09-17T05:35:09.712428+0000","last_became_peered":"2024-09-17T05:35:09.712428+0000","last_unstale":"2024-09-17T05:35:11.700996+0000","last_undegraded":"2024-09-17T05:35:11.700996+0000","last_fullsized":"2024-09-17T05:35:11.700996+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:39.165630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701625+0000","last_change":"2024-09-17T05:35:10.719401+0000","last_active":"2024-09-17T05:35:11.701625+0000","last_peered":"2024-09-17T05:35:11.701625+0000","last_clean":"2024-09-17T05:35:11.701625+0000","last_became_active":"2024-09-17T05:35:10.715654+0000","last_became_peered":"2024-09-17T05:35:10.715654+0000","last_unstale":"2024-09-17T05:35:11.701625+0000","last_undegraded":"2024-09-17T05:35:11.701625+0000","last_fullsized":"2024-09-17T05:35:11.701625+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:58.927414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.828472+0000","last_change":"2024-09-17T05:35:09.720620+0000","last_active":"2024-09-17T05:35:11.828472+0000","last_peered":"2024-09-17T05:35:11.828472+0000","last_clean":"2024-09-17T05:35:11.828472+0000","last_became_active":"2024-09-17T05:35:09.720337+0000","last_became_peered":"2024-09-17T05:35:09.720337+0000","last_unstale":"2024-09-17T05:35:11.828472+0000","last_undegraded":"2024-09-17T05:35:11.828472+0000","last_fullsized":"2024-09-17T05:35:11.828472+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:56.817657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830444+0000","last_change":"2024-09-17T05:35:10.731383+0000","last_active":"2024-09-17T05:35:11.830444+0000","last_peered":"2024-09-17T05:35:11.830444+0000","last_clean":"2024-09-17T05:35:11.830444+0000","last_became_active":"2024-09-17T05:35:10.730984+0000","last_became_peered":"2024-09-17T05:35:10.730984+0000","last_unstale":"2024-09-17T05:35:11.830444+0000","last_undegraded":"2024-09-17T05:35:11.830444+0000","last_fullsized":"2024-09-17T05:35:11.830444+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:08.823412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830818+0000","last_change":"2024-09-17T05:35:09.723740+0000","last_active":"2024-09-17T05:35:11.830818+0000","last_peered":"2024-09-17T05:35:11.830818+0000","last_clean":"2024-09-17T05:35:11.830818+0000","last_became_active":"2024-09-17T05:35:09.723423+0000","last_became_peered":"2024-09-17T05:35:09.723423+0000","last_unstale":"2024-09-17T05:35:11.830818+0000","last_undegraded":"2024-09-17T05:35:11.830818+0000","last_fullsized":"2024-09-17T05:35:11.830818+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:11.671792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697880+0000","last_change":"2024-09-17T05:35:10.703303+0000","last_active":"2024-09-17T05:35:11.697880+0000","last_peered":"2024-09-17T05:35:11.697880+0000","last_clean":"2024-09-17T05:35:11.697880+0000","last_became_active":"2024-09-17T05:35:10.703018+0000","last_became_peered":"2024-09-17T05:35:10.703018+0000","last_unstale":"2024-09-17T05:35:11.697880+0000","last_undegraded":"2024-09-17T05:35:11.697880+0000","last_fullsized":"2024-09-17T05:35:11.697880+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:56.342790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"129'6","reported_seq":21,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.828107+0000","last_change":"2024-09-17T05:35:09.712522+0000","last_active":"2024-09-17T05:35:11.828107+0000","last_peered":"2024-09-17T05:35:11.828107+0000","last_clean":"2024-09-17T05:35:11.828107+0000","last_became_active":"2024-09-17T05:35:09.712291+0000","last_became_peered":"2024-09-17T05:35:09.712291+0000","last_unstale":"2024-09-17T05:35:11.828107+0000","last_undegraded":"2024-09-17T05:35:11.828107+0000","last_fullsized":"2024-09-17T05:35:11.828107+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:42.969339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830423+0000","last_change":"2024-09-17T05:35:10.738029+0000","last_active":"2024-09-17T05:35:11.830423+0000","last_peered":"2024-09-17T05:35:11.830423+0000","last_clean":"2024-09-17T05:35:11.830423+0000","last_became_active":"2024-09-17T05:35:10.736206+0000","last_became_peered":"2024-09-17T05:35:10.736206+0000","last_unstale":"2024-09-17T05:35:11.830423+0000","last_undegraded":"2024-09-17T05:35:11.830423+0000","last_fullsized":"2024-09-17T05:35:11.830423+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:20.973429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830321+0000","last_change":"2024-09-17T05:35:09.723126+0000","last_active":"2024-09-17T05:35:11.830321+0000","last_peered":"2024-09-17T05:35:11.830321+0000","last_clean":"2024-09-17T05:35:11.830321+0000","last_became_active":"2024-09-17T05:35:09.722099+0000","last_became_peered":"2024-09-17T05:35:09.722099+0000","last_unstale":"2024-09-17T05:35:11.830321+0000","last_undegraded":"2024-09-17T05:35:11.830321+0000","last_fullsized":"2024-09-17T05:35:11.830321+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:33.360865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827175+0000","last_change":"2024-09-17T05:35:10.716676+0000","last_active":"2024-09-17T05:35:11.827175+0000","last_peered":"2024-09-17T05:35:11.827175+0000","last_clean":"2024-09-17T05:35:11.827175+0000","last_became_active":"2024-09-17T05:35:10.716399+0000","last_became_peered":"2024-09-17T05:35:10.716399+0000","last_unstale":"2024-09-17T05:35:11.827175+0000","last_undegraded":"2024-09-17T05:35:11.827175+0000","last_fullsized":"2024-09-17T05:35:11.827175+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:45.630013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830298+0000","last_change":"2024-09-17T05:35:09.720369+0000","last_active":"2024-09-17T05:35:11.830298+0000","last_peered":"2024-09-17T05:35:11.830298+0000","last_clean":"2024-09-17T05:35:11.830298+0000","last_became_active":"2024-09-17T05:35:09.720071+0000","last_became_peered":"2024-09-17T05:35:09.720071+0000","last_unstale":"2024-09-17T05:35:11.830298+0000","last_undegraded":"2024-09-17T05:35:11.830298+0000","last_fullsized":"2024-09-17T05:35:11.830298+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:58.181490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701382+0000","last_change":"2024-09-17T05:35:10.725262+0000","last_active":"2024-09-17T05:35:11.701382+0000","last_peered":"2024-09-17T05:35:11.701382+0000","last_clean":"2024-09-17T05:35:11.701382+0000","last_became_active":"2024-09-17T05:35:10.724956+0000","last_became_peered":"2024-09-17T05:35:10.724956+0000","last_unstale":"2024-09-17T05:35:11.701382+0000","last_undegraded":"2024-09-17T05:35:11.701382+0000","last_fullsized":"2024-09-17T05:35:11.701382+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:12.357142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826441+0000","last_change":"2024-09-17T05:35:09.711049+0000","last_active":"2024-09-17T05:35:11.826441+0000","last_peered":"2024-09-17T05:35:11.826441+0000","last_clean":"2024-09-17T05:35:11.826441+0000","last_became_active":"2024-09-17T05:35:09.710759+0000","last_became_peered":"2024-09-17T05:35:09.710759+0000","last_unstale":"2024-09-17T05:35:11.826441+0000","last_undegraded":"2024-09-17T05:35:11.826441+0000","last_fullsized":"2024-09-17T05:35:11.826441+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:26.447685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829700+0000","last_change":"2024-09-17T05:35:10.720155+0000","last_active":"2024-09-17T05:35:11.829700+0000","last_peered":"2024-09-17T05:35:11.829700+0000","last_clean":"2024-09-17T05:35:11.829700+0000","last_became_active":"2024-09-17T05:35:10.719833+0000","last_became_peered":"2024-09-17T05:35:10.719833+0000","last_unstale":"2024-09-17T05:35:11.829700+0000","last_undegraded":"2024-09-17T05:35:11.829700+0000","last_fullsized":"2024-09-17T05:35:11.829700+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:44.593633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"129'8","reported_seq":23,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697425+0000","last_change":"2024-09-17T05:35:09.717857+0000","last_active":"2024-09-17T05:35:11.697425+0000","last_peered":"2024-09-17T05:35:11.697425+0000","last_clean":"2024-09-17T05:35:11.697425+0000","last_became_active":"2024-09-17T05:35:09.717598+0000","last_became_peered":"2024-09-17T05:35:09.717598+0000","last_unstale":"2024-09-17T05:35:11.697425+0000","last_undegraded":"2024-09-17T05:35:11.697425+0000","last_fullsized":"2024-09-17T05:35:11.697425+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:38.244832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830693+0000","last_change":"2024-09-17T05:35:10.731923+0000","last_active":"2024-09-17T05:35:11.830693+0000","last_peered":"2024-09-17T05:35:11.830693+0000","last_clean":"2024-09-17T05:35:11.830693+0000","last_became_active":"2024-09-17T05:35:10.731666+0000","last_became_peered":"2024-09-17T05:35:10.731666+0000","last_unstale":"2024-09-17T05:35:11.830693+0000","last_undegraded":"2024-09-17T05:35:11.830693+0000","last_fullsized":"2024-09-17T05:35:11.830693+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:15.066741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701210+0000","last_change":"2024-09-17T05:35:09.718077+0000","last_active":"2024-09-17T05:35:11.701210+0000","last_peered":"2024-09-17T05:35:11.701210+0000","last_clean":"2024-09-17T05:35:11.701210+0000","last_became_active":"2024-09-17T05:35:09.717649+0000","last_became_peered":"2024-09-17T05:35:09.717649+0000","last_unstale":"2024-09-17T05:35:11.701210+0000","last_undegraded":"2024-09-17T05:35:11.701210+0000","last_fullsized":"2024-09-17T05:35:11.701210+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:43.327029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.698224+0000","last_change":"2024-09-17T05:35:10.714794+0000","last_active":"2024-09-17T05:35:11.698224+0000","last_peered":"2024-09-17T05:35:11.698224+0000","last_clean":"2024-09-17T05:35:11.698224+0000","last_became_active":"2024-09-17T05:35:10.714430+0000","last_became_peered":"2024-09-17T05:35:10.714430+0000","last_unstale":"2024-09-17T05:35:11.698224+0000","last_undegraded":"2024-09-17T05:35:11.698224+0000","last_fullsized":"2024-09-17T05:35:11.698224+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:08.619152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827983+0000","last_change":"2024-09-17T05:35:09.719305+0000","last_active":"2024-09-17T05:35:11.827983+0000","last_peered":"2024-09-17T05:35:11.827983+0000","last_clean":"2024-09-17T05:35:11.827983+0000","last_became_active":"2024-09-17T05:35:09.718972+0000","last_became_peered":"2024-09-17T05:35:09.718972+0000","last_unstale":"2024-09-17T05:35:11.827983+0000","last_undegraded":"2024-09-17T05:35:11.827983+0000","last_fullsized":"2024-09-17T05:35:11.827983+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:39.549194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830703+0000","last_change":"2024-09-17T05:35:10.734939+0000","last_active":"2024-09-17T05:35:11.830703+0000","last_peered":"2024-09-17T05:35:11.830703+0000","last_clean":"2024-09-17T05:35:11.830703+0000","last_became_active":"2024-09-17T05:35:10.734619+0000","last_became_peered":"2024-09-17T05:35:10.734619+0000","last_unstale":"2024-09-17T05:35:11.830703+0000","last_undegraded":"2024-09-17T05:35:11.830703+0000","last_fullsized":"2024-09-17T05:35:11.830703+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:56.940784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"129'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697907+0000","last_change":"2024-09-17T05:35:09.712803+0000","last_active":"2024-09-17T05:35:11.697907+0000","last_peered":"2024-09-17T05:35:11.697907+0000","last_clean":"2024-09-17T05:35:11.697907+0000","last_became_active":"2024-09-17T05:35:09.712517+0000","last_became_peered":"2024-09-17T05:35:09.712517+0000","last_unstale":"2024-09-17T05:35:11.697907+0000","last_undegraded":"2024-09-17T05:35:11.697907+0000","last_fullsized":"2024-09-17T05:35:11.697907+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:09.310289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827048+0000","last_change":"2024-09-17T05:35:10.721884+0000","last_active":"2024-09-17T05:35:11.827048+0000","last_peered":"2024-09-17T05:35:11.827048+0000","last_clean":"2024-09-17T05:35:11.827048+0000","last_became_active":"2024-09-17T05:35:10.721599+0000","last_became_peered":"2024-09-17T05:35:10.721599+0000","last_unstale":"2024-09-17T05:35:11.827048+0000","last_undegraded":"2024-09-17T05:35:11.827048+0000","last_fullsized":"2024-09-17T05:35:11.827048+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:59.699810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827415+0000","last_change":"2024-09-17T05:35:09.722519+0000","last_active":"2024-09-17T05:35:11.827415+0000","last_peered":"2024-09-17T05:35:11.827415+0000","last_clean":"2024-09-17T05:35:11.827415+0000","last_became_active":"2024-09-17T05:35:09.722252+0000","last_became_peered":"2024-09-17T05:35:09.722252+0000","last_unstale":"2024-09-17T05:35:11.827415+0000","last_undegraded":"2024-09-17T05:35:11.827415+0000","last_fullsized":"2024-09-17T05:35:11.827415+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:05.455707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701693+0000","last_change":"2024-09-17T05:35:10.738071+0000","last_active":"2024-09-17T05:35:11.701693+0000","last_peered":"2024-09-17T05:35:11.701693+0000","last_clean":"2024-09-17T05:35:11.701693+0000","last_became_active":"2024-09-17T05:35:10.737423+0000","last_became_peered":"2024-09-17T05:35:10.737423+0000","last_unstale":"2024-09-17T05:35:11.701693+0000","last_undegraded":"2024-09-17T05:35:11.701693+0000","last_fullsized":"2024-09-17T05:35:11.701693+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:12.545660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827701+0000","last_change":"2024-09-17T05:35:09.714615+0000","last_active":"2024-09-17T05:35:11.827701+0000","last_peered":"2024-09-17T05:35:11.827701+0000","last_clean":"2024-09-17T05:35:11.827701+0000","last_became_active":"2024-09-17T05:35:09.714361+0000","last_became_peered":"2024-09-17T05:35:09.714361+0000","last_unstale":"2024-09-17T05:35:11.827701+0000","last_undegraded":"2024-09-17T05:35:11.827701+0000","last_fullsized":"2024-09-17T05:35:11.827701+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:03.571559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827783+0000","last_change":"2024-09-17T05:35:10.707095+0000","last_active":"2024-09-17T05:35:11.827783+0000","last_peered":"2024-09-17T05:35:11.827783+0000","last_clean":"2024-09-17T05:35:11.827783+0000","last_became_active":"2024-09-17T05:35:10.705640+0000","last_became_peered":"2024-09-17T05:35:10.705640+0000","last_unstale":"2024-09-17T05:35:11.827783+0000","last_undegraded":"2024-09-17T05:35:11.827783+0000","last_fullsized":"2024-09-17T05:35:11.827783+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:50.852737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829893+0000","last_change":"2024-09-17T05:35:09.720566+0000","last_active":"2024-09-17T05:35:11.829893+0000","last_peered":"2024-09-17T05:35:11.829893+0000","last_clean":"2024-09-17T05:35:11.829893+0000","last_became_active":"2024-09-17T05:35:09.720257+0000","last_became_peered":"2024-09-17T05:35:09.720257+0000","last_unstale":"2024-09-17T05:35:11.829893+0000","last_undegraded":"2024-09-17T05:35:11.829893+0000","last_fullsized":"2024-09-17T05:35:11.829893+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:42.345570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701108+0000","last_change":"2024-09-17T05:35:10.711076+0000","last_active":"2024-09-17T05:35:11.701108+0000","last_peered":"2024-09-17T05:35:11.701108+0000","last_clean":"2024-09-17T05:35:11.701108+0000","last_became_active":"2024-09-17T05:35:10.710765+0000","last_became_peered":"2024-09-17T05:35:10.710765+0000","last_unstale":"2024-09-17T05:35:11.701108+0000","last_undegraded":"2024-09-17T05:35:11.701108+0000","last_fullsized":"2024-09-17T05:35:11.701108+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:40.552361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829551+0000","last_change":"2024-09-17T05:35:09.724807+0000","last_active":"2024-09-17T05:35:11.829551+0000","last_peered":"2024-09-17T05:35:11.829551+0000","last_clean":"2024-09-17T05:35:11.829551+0000","last_became_active":"2024-09-17T05:35:09.724511+0000","last_became_peered":"2024-09-17T05:35:09.724511+0000","last_unstale":"2024-09-17T05:35:11.829551+0000","last_undegraded":"2024-09-17T05:35:11.829551+0000","last_fullsized":"2024-09-17T05:35:11.829551+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:35.547041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827103+0000","last_change":"2024-09-17T05:35:10.709083+0000","last_active":"2024-09-17T05:35:11.827103+0000","last_peered":"2024-09-17T05:35:11.827103+0000","last_clean":"2024-09-17T05:35:11.827103+0000","last_became_active":"2024-09-17T05:35:10.708479+0000","last_became_peered":"2024-09-17T05:35:10.708479+0000","last_unstale":"2024-09-17T05:35:11.827103+0000","last_undegraded":"2024-09-17T05:35:11.827103+0000","last_fullsized":"2024-09-17T05:35:11.827103+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:30.398281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829578+0000","last_change":"2024-09-17T05:35:09.720808+0000","last_active":"2024-09-17T05:35:11.829578+0000","last_peered":"2024-09-17T05:35:11.829578+0000","last_clean":"2024-09-17T05:35:11.829578+0000","last_became_active":"2024-09-17T05:35:09.720413+0000","last_became_peered":"2024-09-17T05:35:09.720413+0000","last_unstale":"2024-09-17T05:35:11.829578+0000","last_undegraded":"2024-09-17T05:35:11.829578+0000","last_fullsized":"2024-09-17T05:35:11.829578+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:58.533908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.701801+0000","last_change":"2024-09-17T05:35:10.723970+0000","last_active":"2024-09-17T05:35:11.701801+0000","last_peered":"2024-09-17T05:35:11.701801+0000","last_clean":"2024-09-17T05:35:11.701801+0000","last_became_active":"2024-09-17T05:35:10.723691+0000","last_became_peered":"2024-09-17T05:35:10.723691+0000","last_unstale":"2024-09-17T05:35:11.701801+0000","last_undegraded":"2024-09-17T05:35:11.701801+0000","last_fullsized":"2024-09-17T05:35:11.701801+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:19.323320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"129'2","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830603+0000","last_change":"2024-09-17T05:35:09.724881+0000","last_active":"2024-09-17T05:35:11.830603+0000","last_peered":"2024-09-17T05:35:11.830603+0000","last_clean":"2024-09-17T05:35:11.830603+0000","last_became_active":"2024-09-17T05:35:09.724580+0000","last_became_peered":"2024-09-17T05:35:09.724580+0000","last_unstale":"2024-09-17T05:35:11.830603+0000","last_undegraded":"2024-09-17T05:35:11.830603+0000","last_fullsized":"2024-09-17T05:35:11.830603+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:17.130919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.831030+0000","last_change":"2024-09-17T05:35:10.735424+0000","last_active":"2024-09-17T05:35:11.831030+0000","last_peered":"2024-09-17T05:35:11.831030+0000","last_clean":"2024-09-17T05:35:11.831030+0000","last_became_active":"2024-09-17T05:35:10.735119+0000","last_became_peered":"2024-09-17T05:35:10.735119+0000","last_unstale":"2024-09-17T05:35:11.831030+0000","last_undegraded":"2024-09-17T05:35:11.831030+0000","last_fullsized":"2024-09-17T05:35:11.831030+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:48.745909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"130'1","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827463+0000","last_change":"2024-09-17T05:35:09.708821+0000","last_active":"2024-09-17T05:35:11.827463+0000","last_peered":"2024-09-17T05:35:11.827463+0000","last_clean":"2024-09-17T05:35:11.827463+0000","last_became_active":"2024-09-17T05:35:09.708507+0000","last_became_peered":"2024-09-17T05:35:09.708507+0000","last_unstale":"2024-09-17T05:35:11.827463+0000","last_undegraded":"2024-09-17T05:35:11.827463+0000","last_fullsized":"2024-09-17T05:35:11.827463+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:05:29.505189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827357+0000","last_change":"2024-09-17T05:35:10.736552+0000","last_active":"2024-09-17T05:35:11.827357+0000","last_peered":"2024-09-17T05:35:11.827357+0000","last_clean":"2024-09-17T05:35:11.827357+0000","last_became_active":"2024-09-17T05:35:10.736221+0000","last_became_peered":"2024-09-17T05:35:10.736221+0000","last_unstale":"2024-09-17T05:35:11.827357+0000","last_undegraded":"2024-09-17T05:35:11.827357+0000","last_fullsized":"2024-09-17T05:35:11.827357+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:18.134086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827319+0000","last_change":"2024-09-17T05:35:09.704879+0000","last_active":"2024-09-17T05:35:11.827319+0000","last_peered":"2024-09-17T05:35:11.827319+0000","last_clean":"2024-09-17T05:35:11.827319+0000","last_became_active":"2024-09-17T05:35:09.704603+0000","last_became_peered":"2024-09-17T05:35:09.704603+0000","last_unstale":"2024-09-17T05:35:11.827319+0000","last_undegraded":"2024-09-17T05:35:11.827319+0000","last_fullsized":"2024-09-17T05:35:11.827319+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:20.402712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.828348+0000","last_change":"2024-09-17T05:35:10.724975+0000","last_active":"2024-09-17T05:35:11.828348+0000","last_peered":"2024-09-17T05:35:11.828348+0000","last_clean":"2024-09-17T05:35:11.828348+0000","last_became_active":"2024-09-17T05:35:10.724723+0000","last_became_peered":"2024-09-17T05:35:10.724723+0000","last_unstale":"2024-09-17T05:35:11.828348+0000","last_undegraded":"2024-09-17T05:35:11.828348+0000","last_fullsized":"2024-09-17T05:35:11.828348+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:38.030801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826989+0000","last_change":"2024-09-17T05:35:09.709621+0000","last_active":"2024-09-17T05:35:11.826989+0000","last_peered":"2024-09-17T05:35:11.826989+0000","last_clean":"2024-09-17T05:35:11.826989+0000","last_became_active":"2024-09-17T05:35:09.709363+0000","last_became_peered":"2024-09-17T05:35:09.709363+0000","last_unstale":"2024-09-17T05:35:11.826989+0000","last_undegraded":"2024-09-17T05:35:11.826989+0000","last_fullsized":"2024-09-17T05:35:11.826989+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:55:40.353006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.697760+0000","last_change":"2024-09-17T05:35:10.714041+0000","last_active":"2024-09-17T05:35:11.697760+0000","last_peered":"2024-09-17T05:35:11.697760+0000","last_clean":"2024-09-17T05:35:11.697760+0000","last_became_active":"2024-09-17T05:35:10.713775+0000","last_became_peered":"2024-09-17T05:35:10.713775+0000","last_unstale":"2024-09-17T05:35:11.697760+0000","last_undegraded":"2024-09-17T05:35:11.697760+0000","last_fullsized":"2024-09-17T05:35:11.697760+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:23:29.648541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.827800+0000","last_change":"2024-09-17T05:35:09.719714+0000","last_active":"2024-09-17T05:35:11.827800+0000","last_peered":"2024-09-17T05:35:11.827800+0000","last_clean":"2024-09-17T05:35:11.827800+0000","last_became_active":"2024-09-17T05:35:09.719287+0000","last_became_peered":"2024-09-17T05:35:09.719287+0000","last_unstale":"2024-09-17T05:35:11.827800+0000","last_undegraded":"2024-09-17T05:35:11.827800+0000","last_fullsized":"2024-09-17T05:35:11.827800+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:53:29.853613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.702311+0000","last_change":"2024-09-17T05:35:10.722898+0000","last_active":"2024-09-17T05:35:11.702311+0000","last_peered":"2024-09-17T05:35:11.702311+0000","last_clean":"2024-09-17T05:35:11.702311+0000","last_became_active":"2024-09-17T05:35:10.722610+0000","last_became_peered":"2024-09-17T05:35:10.722610+0000","last_unstale":"2024-09-17T05:35:11.702311+0000","last_undegraded":"2024-09-17T05:35:11.702311+0000","last_fullsized":"2024-09-17T05:35:11.702311+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:23.935000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829995+0000","last_change":"2024-09-17T05:35:09.719841+0000","last_active":"2024-09-17T05:35:11.829995+0000","last_peered":"2024-09-17T05:35:11.829995+0000","last_clean":"2024-09-17T05:35:11.829995+0000","last_became_active":"2024-09-17T05:35:09.719107+0000","last_became_peered":"2024-09-17T05:35:09.719107+0000","last_unstale":"2024-09-17T05:35:11.829995+0000","last_undegraded":"2024-09-17T05:35:11.829995+0000","last_fullsized":"2024-09-17T05:35:11.829995+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:09:36.271385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829739+0000","last_change":"2024-09-17T05:35:10.725458+0000","last_active":"2024-09-17T05:35:11.829739+0000","last_peered":"2024-09-17T05:35:11.829739+0000","last_clean":"2024-09-17T05:35:11.829739+0000","last_became_active":"2024-09-17T05:35:10.725109+0000","last_became_peered":"2024-09-17T05:35:10.725109+0000","last_unstale":"2024-09-17T05:35:11.829739+0000","last_undegraded":"2024-09-17T05:35:11.829739+0000","last_fullsized":"2024-09-17T05:35:11.829739+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:06.674189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829823+0000","last_change":"2024-09-17T05:35:09.722278+0000","last_active":"2024-09-17T05:35:11.829823+0000","last_peered":"2024-09-17T05:35:11.829823+0000","last_clean":"2024-09-17T05:35:11.829823+0000","last_became_active":"2024-09-17T05:35:09.721961+0000","last_became_peered":"2024-09-17T05:35:09.721961+0000","last_unstale":"2024-09-17T05:35:11.829823+0000","last_undegraded":"2024-09-17T05:35:11.829823+0000","last_fullsized":"2024-09-17T05:35:11.829823+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:18.450244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.702036+0000","last_change":"2024-09-17T05:35:10.717605+0000","last_active":"2024-09-17T05:35:11.702036+0000","last_peered":"2024-09-17T05:35:11.702036+0000","last_clean":"2024-09-17T05:35:11.702036+0000","last_became_active":"2024-09-17T05:35:10.717311+0000","last_became_peered":"2024-09-17T05:35:10.717311+0000","last_unstale":"2024-09-17T05:35:11.702036+0000","last_undegraded":"2024-09-17T05:35:11.702036+0000","last_fullsized":"2024-09-17T05:35:11.702036+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:16.544702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.826587+0000","last_change":"2024-09-17T05:35:09.721036+0000","last_active":"2024-09-17T05:35:11.826587+0000","last_peered":"2024-09-17T05:35:11.826587+0000","last_clean":"2024-09-17T05:35:11.826587+0000","last_became_active":"2024-09-17T05:35:09.720616+0000","last_became_peered":"2024-09-17T05:35:09.720616+0000","last_unstale":"2024-09-17T05:35:11.826587+0000","last_undegraded":"2024-09-17T05:35:11.826587+0000","last_fullsized":"2024-09-17T05:35:11.826587+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:29.186473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":13,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.828156+0000","last_change":"2024-09-17T05:35:10.708117+0000","last_active":"2024-09-17T05:35:11.828156+0000","last_peered":"2024-09-17T05:35:11.828156+0000","last_clean":"2024-09-17T05:35:11.828156+0000","last_became_active":"2024-09-17T05:35:10.707819+0000","last_became_peered":"2024-09-17T05:35:10.707819+0000","last_unstale":"2024-09-17T05:35:11.828156+0000","last_undegraded":"2024-09-17T05:35:11.828156+0000","last_fullsized":"2024-09-17T05:35:11.828156+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:09.682926+0000","last_clean_scrub_stamp":"2024-09-17T05:35:09.682926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:07.748783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"129'3","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.830758+0000","last_change":"2024-09-17T05:35:09.723892+0000","last_active":"2024-09-17T05:35:11.830758+0000","last_peered":"2024-09-17T05:35:11.830758+0000","last_clean":"2024-09-17T05:35:11.830758+0000","last_became_active":"2024-09-17T05:35:09.723512+0000","last_became_peered":"2024-09-17T05:35:09.723512+0000","last_unstale":"2024-09-17T05:35:11.830758+0000","last_undegraded":"2024-09-17T05:35:11.830758+0000","last_fullsized":"2024-09-17T05:35:11.830758+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:08.679759+0000","last_clean_scrub_stamp":"2024-09-17T05:35:08.679759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:59.546025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":339,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-17T05:35:11.829811+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:35:11.829811+0000","last_peered":"2024-09-17T05:35:11.829811+0000","last_clean":"2024-09-17T05:35:11.829811+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:35:11.829811+0000","last_undegraded":"2024-09-17T05:35:11.829811+0000","last_fullsized":"2024-09-17T05:35:11.829811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509523,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33364,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338476,"statfs":{"total":96636764160,"available":96602599424,"internally_reserved":0,"allocated":2224128,"data_stored":1306146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509524,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1634304,"data_stored":715272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542227,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1626112,"data_stored":715148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509524,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1622016,"data_stored":715126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509524,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1626112,"data_stored":715216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509524,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32796,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339044,"statfs":{"total":96636764160,"available":96603181056,"internally_reserved":0,"allocated":1638400,"data_stored":716808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509522,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32784,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339056,"statfs":{"total":96636764160,"available":96603193344,"internally_reserved":0,"allocated":1626112,"data_stored":715708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542226,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33372,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338468,"statfs":{"total":96636764160,"available":96602591232,"internally_reserved":0,"allocated":2232320,"data_stored":1307140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:35:15.279 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:35:15.279 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:35:15.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.469+0000 7ff959e00640 1 -- 172.21.15.31:0/323247339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff938004810 msgr2=0x7ff938004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:15.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.469+0000 7ff959e00640 1 --2- 172.21.15.31:0/323247339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff938004810 0x7ff938004c90 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00c3f0 tx=0x7ff93c01cee0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.469+0000 7ff953400640 1 -- 172.21.15.31:0/323247339 reap_dead start 2024-09-17T05:35:15.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.469+0000 7ff959e00640 1 -- 172.21.15.31:0/323247339 shutdown_connections 2024-09-17T05:35:15.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.469+0000 7ff959e00640 1 -- 172.21.15.31:0/323247339 >> 172.21.15.31:0/323247339 conn(0x7ff9540cd740 msgr2=0x7ff9540cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:15.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.469+0000 7ff959e00640 1 -- 172.21.15.31:0/323247339 shutdown_connections 2024-09-17T05:35:15.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.469+0000 7ff959e00640 1 -- 172.21.15.31:0/323247339 wait complete. 2024-09-17T05:35:15.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.469+0000 7ff959e00640 1 Processor -- start 2024-09-17T05:35:15.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff959e00640 1 -- start start 2024-09-17T05:35:15.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff959e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff938004810 0x7ff9540b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:15.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff959e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff95415db60 0x7ff9540c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:15.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff959e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff95415d440 0x7ff9540ce540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:15.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff959e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff9541639b0 con 0x7ff938004810 2024-09-17T05:35:15.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff959e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff954163b30 con 0x7ff95415d440 2024-09-17T05:35:15.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff959e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff954163cb0 con 0x7ff95415db60 2024-09-17T05:35:15.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff952a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff938004810 0x7ff9540b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:15.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff952a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff938004810 0x7ff9540b1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54208/0 (socket says 172.21.15.31:54208) 2024-09-17T05:35:15.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff952a00640 1 -- 172.21.15.31:0/477968630 learned_addr learned my addr 172.21.15.31:0/477968630 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:15.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff94a000640 1 --2- 172.21.15.31:0/477968630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff95415db60 0x7ff9540c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:15.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff953400640 1 --2- 172.21.15.31:0/477968630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff95415d440 0x7ff9540ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:15.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff952a00640 1 -- 172.21.15.31:0/477968630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff95415db60 msgr2=0x7ff9540c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:15.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff952a00640 1 --2- 172.21.15.31:0/477968630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff95415db60 0x7ff9540c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff952a00640 1 -- 172.21.15.31:0/477968630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff95415d440 msgr2=0x7ff9540ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:15.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff952a00640 1 --2- 172.21.15.31:0/477968630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff95415d440 0x7ff9540ce540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff952a00640 1 -- 172.21.15.31:0/477968630 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9540c6080 con 0x7ff938004810 2024-09-17T05:35:15.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff94a000640 1 --2- 172.21.15.31:0/477968630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff95415db60 0x7ff9540c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:15.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff953400640 1 --2- 172.21.15.31:0/477968630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff95415d440 0x7ff9540ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:15.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff952a00640 1 --2- 172.21.15.31:0/477968630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff938004810 0x7ff9540b1aa0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7ff94400af80 tx=0x7ff94400e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:15.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff94be00640 1 -- 172.21.15.31:0/477968630 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9440062e0 con 0x7ff938004810 2024-09-17T05:35:15.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff94be00640 1 -- 172.21.15.31:0/477968630 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff944017020 con 0x7ff938004810 2024-09-17T05:35:15.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff94be00640 1 -- 172.21.15.31:0/477968630 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff944003840 con 0x7ff938004810 2024-09-17T05:35:15.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff959e00640 1 -- 172.21.15.31:0/477968630 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9540c6360 con 0x7ff938004810 2024-09-17T05:35:15.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff959e00640 1 -- 172.21.15.31:0/477968630 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9540c6920 con 0x7ff938004810 2024-09-17T05:35:15.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.473+0000 7ff959e00640 1 -- 172.21.15.31:0/477968630 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9540b2740 con 0x7ff938004810 2024-09-17T05:35:15.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.477+0000 7ff94be00640 1 -- 172.21.15.31:0/477968630 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7ff94400d070 con 0x7ff938004810 2024-09-17T05:35:15.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.477+0000 7ff94be00640 1 --2- 172.21.15.31:0/477968630 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff930073830 0x7ff930075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:15.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.477+0000 7ff94be00640 1 -- 172.21.15.31:0/477968630 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7ff9440989e0 con 0x7ff938004810 2024-09-17T05:35:15.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.477+0000 7ff94a000640 1 --2- 172.21.15.31:0/477968630 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff930073830 0x7ff930075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:15.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.477+0000 7ff94a000640 1 --2- 172.21.15.31:0/477968630 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff930073830 0x7ff930075cf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0ac000 tx=0x7ff93c019d20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:15.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.481+0000 7ff94be00640 1 -- 172.21.15.31:0/477968630 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff944021020 con 0x7ff938004810 2024-09-17T05:35:15.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.717+0000 7ff959e00640 1 -- 172.21.15.31:0/477968630 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff9540c4590 con 0x7ff938004810 2024-09-17T05:35:15.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.721+0000 7ff94be00640 1 -- 172.21.15.31:0/477968630 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) ==== 190+0+147 (secure 0 0 0) 0x7ff944063020 con 0x7ff938004810 2024-09-17T05:35:15.724 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-09-17T05:35:15.724 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw== 2024-09-17T05:35:15.724 INFO:teuthology.orchestra.run.smithi031.stdout: caps mds = "allow" 2024-09-17T05:35:15.724 INFO:teuthology.orchestra.run.smithi031.stdout: caps mon = "allow r" 2024-09-17T05:35:15.724 INFO:teuthology.orchestra.run.smithi031.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:35:15.724 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2024-09-17T05:35:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.725+0000 7ff959e00640 1 -- 172.21.15.31:0/477968630 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff930073830 msgr2=0x7ff930075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.725+0000 7ff959e00640 1 --2- 172.21.15.31:0/477968630 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff930073830 0x7ff930075cf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0ac000 tx=0x7ff93c019d20 comp rx=0 tx=0).stop 2024-09-17T05:35:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.725+0000 7ff959e00640 1 -- 172.21.15.31:0/477968630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff938004810 msgr2=0x7ff9540b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.725+0000 7ff959e00640 1 --2- 172.21.15.31:0/477968630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff938004810 0x7ff9540b1aa0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7ff94400af80 tx=0x7ff94400e770 comp rx=0 tx=0).stop 2024-09-17T05:35:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.725+0000 7ff959e00640 1 -- 172.21.15.31:0/477968630 shutdown_connections 2024-09-17T05:35:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.725+0000 7ff959e00640 1 --2- 172.21.15.31:0/477968630 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff930073830 0x7ff930075cf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.725+0000 7ff959e00640 1 --2- 172.21.15.31:0/477968630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff95415d440 0x7ff9540ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.725+0000 7ff959e00640 1 --2- 172.21.15.31:0/477968630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff95415db60 0x7ff9540c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.725+0000 7ff959e00640 1 --2- 172.21.15.31:0/477968630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff938004810 0x7ff9540b1aa0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.725+0000 7ff959e00640 1 -- 172.21.15.31:0/477968630 >> 172.21.15.31:0/477968630 conn(0x7ff9540cd740 msgr2=0x7ff954158df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:15.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.725+0000 7ff959e00640 1 -- 172.21.15.31:0/477968630 shutdown_connections 2024-09-17T05:35:15.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.725+0000 7ff959e00640 1 -- 172.21.15.31:0/477968630 wait complete. 2024-09-17T05:35:15.748 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:35:15.892 INFO:tasks.ceph.mds.b.smithi155.stderr:2024-09-17T05:35:15.891+0000 7f3872200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:35:15.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.893+0000 7fe237400640 1 -- 172.21.15.31:0/1601293480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2300b4270 msgr2=0x7fe230068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:15.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.893+0000 7fe237400640 1 --2- 172.21.15.31:0/1601293480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2300b4270 0x7fe230068c00 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fe228009c80 tx=0x7fe22801cda0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.893+0000 7fe237400640 1 -- 172.21.15.31:0/1601293480 shutdown_connections 2024-09-17T05:35:15.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.893+0000 7fe237400640 1 --2- 172.21.15.31:0/1601293480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2300b4270 0x7fe230068c00 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.893+0000 7fe237400640 1 -- 172.21.15.31:0/1601293480 >> 172.21.15.31:0/1601293480 conn(0x7fe2300b2240 msgr2=0x7fe2300b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:15.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.893+0000 7fe237400640 1 -- 172.21.15.31:0/1601293480 shutdown_connections 2024-09-17T05:35:15.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.893+0000 7fe237400640 1 -- 172.21.15.31:0/1601293480 wait complete. 2024-09-17T05:35:15.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.893+0000 7fe237400640 1 Processor -- start 2024-09-17T05:35:15.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.893+0000 7fe237400640 1 -- start start 2024-09-17T05:35:15.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe237400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2300b4270 0x7fe230155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:15.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe237400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2300d0af0 0x7fe23015daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:15.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe237400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe23015bde0 0x7fe230156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe237400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe23016a650 con 0x7fe2300b4270 2024-09-17T05:35:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe237400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe23016a4d0 con 0x7fe2300d0af0 2024-09-17T05:35:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe237400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe23016a7d0 con 0x7fe23015bde0 2024-09-17T05:35:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe234a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2300b4270 0x7fe230155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe234a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2300b4270 0x7fe230155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54228/0 (socket says 172.21.15.31:54228) 2024-09-17T05:35:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe234a00640 1 -- 172.21.15.31:0/2065626853 learned_addr learned my addr 172.21.15.31:0/2065626853 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe235400640 1 --2- 172.21.15.31:0/2065626853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe23015bde0 0x7fe230156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe227e00640 1 --2- 172.21.15.31:0/2065626853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2300d0af0 0x7fe23015daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe234a00640 1 -- 172.21.15.31:0/2065626853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe23015bde0 msgr2=0x7fe230156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe234a00640 1 --2- 172.21.15.31:0/2065626853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe23015bde0 0x7fe230156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe234a00640 1 -- 172.21.15.31:0/2065626853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2300d0af0 msgr2=0x7fe23015daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe234a00640 1 --2- 172.21.15.31:0/2065626853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2300d0af0 0x7fe23015daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:15.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe234a00640 1 -- 172.21.15.31:0/2065626853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2301558f0 con 0x7fe2300b4270 2024-09-17T05:35:15.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe234a00640 1 --2- 172.21.15.31:0/2065626853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2300b4270 0x7fe230155210 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fe22000b440 tx=0x7fe22000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:15.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe22d600640 1 -- 172.21.15.31:0/2065626853 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe220015020 con 0x7fe2300b4270 2024-09-17T05:35:15.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe22d600640 1 -- 172.21.15.31:0/2065626853 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe220011980 con 0x7fe2300b4270 2024-09-17T05:35:15.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe22d600640 1 -- 172.21.15.31:0/2065626853 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe220011dd0 con 0x7fe2300b4270 2024-09-17T05:35:15.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe237400640 1 -- 172.21.15.31:0/2065626853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe230155bd0 con 0x7fe2300b4270 2024-09-17T05:35:15.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe237400640 1 -- 172.21.15.31:0/2065626853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe230156190 con 0x7fe2300b4270 2024-09-17T05:35:15.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.897+0000 7fe237400640 1 -- 172.21.15.31:0/2065626853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2301565d0 con 0x7fe2300b4270 2024-09-17T05:35:15.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.901+0000 7fe22d600640 1 -- 172.21.15.31:0/2065626853 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fe220018020 con 0x7fe2300b4270 2024-09-17T05:35:15.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.901+0000 7fe22d600640 1 --2- 172.21.15.31:0/2065626853 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe20c073860 0x7fe20c075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:15.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.901+0000 7fe22d600640 1 -- 172.21.15.31:0/2065626853 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7fe220094d70 con 0x7fe2300b4270 2024-09-17T05:35:15.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.901+0000 7fe227e00640 1 --2- 172.21.15.31:0/2065626853 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe20c073860 0x7fe20c075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:15.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.901+0000 7fe227e00640 1 --2- 172.21.15.31:0/2065626853 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe20c073860 0x7fe20c075d20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe23014e860 tx=0x7fe218009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:15.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:15.905+0000 7fe22d600640 1 -- 172.21.15.31:0/2065626853 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe22001f030 con 0x7fe2300b4270 2024-09-17T05:35:16.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.117+0000 7fe237400640 1 -- 172.21.15.31:0/2065626853 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe230068c00 con 0x7fe2300b4270 2024-09-17T05:35:16.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.117+0000 7fe22d600640 1 -- 172.21.15.31:0/2065626853 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5233 (secure 0 0 0) 0x7fe22000d040 con 0x7fe2300b4270 2024-09-17T05:35:16.118 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:16.118 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":90,"btime":"2024-09-17T05:35:13:718188+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7456,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/2107257547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107257547},{"type":"v1","addr":"172.21.15.155:6834","nonce":2107257547}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1645548958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1645548958},{"type":"v1","addr":"172.21.15.31:6834","nonce":1645548958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7836,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1284373927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1284373927},{"type":"v1","addr":"172.21.15.31:6835","nonce":1284373927}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:35:10.110294+0000","modified":"2024-09-17T05:35:13.121372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7848},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7848":{"gid":7848,"name":"b","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1879117968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1879117968},{"type":"v1","addr":"172.21.15.155:6835","nonce":1879117968}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7848,"qdb_cluster":[7848]},"id":10}]} 2024-09-17T05:35:16.119 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 90 2024-09-17T05:35:16.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.117+0000 7fe237400640 1 -- 172.21.15.31:0/2065626853 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe20c073860 msgr2=0x7fe20c075d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:16.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.117+0000 7fe237400640 1 --2- 172.21.15.31:0/2065626853 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe20c073860 0x7fe20c075d20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe23014e860 tx=0x7fe218009040 comp rx=0 tx=0).stop 2024-09-17T05:35:16.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.117+0000 7fe237400640 1 -- 172.21.15.31:0/2065626853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2300b4270 msgr2=0x7fe230155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:16.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.117+0000 7fe237400640 1 --2- 172.21.15.31:0/2065626853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2300b4270 0x7fe230155210 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fe22000b440 tx=0x7fe22000b900 comp rx=0 tx=0).stop 2024-09-17T05:35:16.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.117+0000 7fe237400640 1 -- 172.21.15.31:0/2065626853 shutdown_connections 2024-09-17T05:35:16.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.117+0000 7fe237400640 1 --2- 172.21.15.31:0/2065626853 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe20c073860 0x7fe20c075d20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.117+0000 7fe237400640 1 --2- 172.21.15.31:0/2065626853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe23015bde0 0x7fe230156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.117+0000 7fe237400640 1 --2- 172.21.15.31:0/2065626853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2300d0af0 0x7fe23015daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.117+0000 7fe237400640 1 --2- 172.21.15.31:0/2065626853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe2300b4270 0x7fe230155210 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.117+0000 7fe237400640 1 -- 172.21.15.31:0/2065626853 >> 172.21.15.31:0/2065626853 conn(0x7fe2300b2240 msgr2=0x7fe2300d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:16.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.117+0000 7fe237400640 1 -- 172.21.15.31:0/2065626853 shutdown_connections 2024-09-17T05:35:16.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.117+0000 7fe237400640 1 -- 172.21.15.31:0/2065626853 wait complete. 2024-09-17T05:35:16.543 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 90, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:35:10.110294+0000', 'modified': '2024-09-17T05:35:13.121372+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7848}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7848': {'gid': 7848, 'name': 'b', 'rank': 0, 'incarnation': 86, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6835/1879117968', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6809', 'nonce': 1879117968}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 1879117968}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7848, 'qdb_cluster': [7848]} 2024-09-17T05:35:16.543 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:35:16.543 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T05:35:16.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa720000640 1 -- 172.21.15.31:0/622988881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa71815bd50 msgr2=0x7fa7180ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:16.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa720000640 1 --2- 172.21.15.31:0/622988881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa71815bd50 0x7fa7180ce5e0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fa7180d0f60 tx=0x7fa70c01c7a0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa720000640 1 -- 172.21.15.31:0/622988881 shutdown_connections 2024-09-17T05:35:16.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa720000640 1 --2- 172.21.15.31:0/622988881 >> v2:172.21.15.155:3300/0 conn(0x7fa7180cf4e0 0x7fa7180cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa720000640 1 --2- 172.21.15.31:0/622988881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa71815bd50 0x7fa7180ce5e0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa720000640 1 -- 172.21.15.31:0/622988881 >> 172.21.15.31:0/622988881 conn(0x7fa7180d1ea0 msgr2=0x7fa7180d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:16.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa720000640 1 -- 172.21.15.31:0/622988881 shutdown_connections 2024-09-17T05:35:16.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa720000640 1 -- 172.21.15.31:0/622988881 wait complete. 2024-09-17T05:35:16.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa720000640 1 Processor -- start 2024-09-17T05:35:16.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa720000640 1 -- start start 2024-09-17T05:35:16.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa720000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7180cf4e0 0x7fa7181f7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa720000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71815bd50 0x7fa7181fa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa720000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa71815c130 0x7fa7181fb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa720000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa718168e50 con 0x7fa7180cf4e0 2024-09-17T05:35:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa720000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa718168cd0 con 0x7fa71815c130 2024-09-17T05:35:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa720000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa718168fd0 con 0x7fa71815bd50 2024-09-17T05:35:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa71d600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7180cf4e0 0x7fa7181f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa71d600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7180cf4e0 0x7fa7181f7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54252/0 (socket says 172.21.15.31:54252) 2024-09-17T05:35:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa71d600640 1 -- 172.21.15.31:0/2950431239 learned_addr learned my addr 172.21.15.31:0/2950431239 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa71cc00640 1 --2- 172.21.15.31:0/2950431239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71815bd50 0x7fa7181fa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa71e000640 1 --2- 172.21.15.31:0/2950431239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa71815c130 0x7fa7181fb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa71d600640 1 -- 172.21.15.31:0/2950431239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71815bd50 msgr2=0x7fa7181fa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa71d600640 1 --2- 172.21.15.31:0/2950431239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71815bd50 0x7fa7181fa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa71d600640 1 -- 172.21.15.31:0/2950431239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa71815c130 msgr2=0x7fa7181fb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:16.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa71d600640 1 --2- 172.21.15.31:0/2950431239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa71815c130 0x7fa7181fb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa71d600640 1 -- 172.21.15.31:0/2950431239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7181f7fb0 con 0x7fa7180cf4e0 2024-09-17T05:35:16.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.697+0000 7fa71d600640 1 --2- 172.21.15.31:0/2950431239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7180cf4e0 0x7fa7181f7990 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0b0040 tx=0x7fa70c0a55f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:16.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.701+0000 7fa715600640 1 -- 172.21.15.31:0/2950431239 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70c0b2040 con 0x7fa7180cf4e0 2024-09-17T05:35:16.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.701+0000 7fa715600640 1 -- 172.21.15.31:0/2950431239 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa70c004490 con 0x7fa7180cf4e0 2024-09-17T05:35:16.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.701+0000 7fa715600640 1 -- 172.21.15.31:0/2950431239 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70c005280 con 0x7fa7180cf4e0 2024-09-17T05:35:16.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.701+0000 7fa720000640 1 -- 172.21.15.31:0/2950431239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7181f8290 con 0x7fa7180cf4e0 2024-09-17T05:35:16.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.701+0000 7fa720000640 1 -- 172.21.15.31:0/2950431239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7181f8850 con 0x7fa7180cf4e0 2024-09-17T05:35:16.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.701+0000 7fa715600640 1 -- 172.21.15.31:0/2950431239 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fa70c005420 con 0x7fa7180cf4e0 2024-09-17T05:35:16.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.701+0000 7fa715600640 1 --2- 172.21.15.31:0/2950431239 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa6f8073830 0x7fa6f8075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.701+0000 7fa723368000 1 Processor -- start 2024-09-17T05:35:16.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.701+0000 7fa715600640 1 -- 172.21.15.31:0/2950431239 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7fa70c12e9c0 con 0x7fa7180cf4e0 2024-09-17T05:35:16.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.701+0000 7fa723368000 1 -- start start 2024-09-17T05:35:16.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.701+0000 7fa71cc00640 1 --2- 172.21.15.31:0/2950431239 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa6f8073830 0x7fa6f8075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa71cc00640 1 --2- 172.21.15.31:0/2950431239 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa6f8073830 0x7fa6f8075cf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa718152070 tx=0x7fa704009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:16.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa723368000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a7ba9d0 0x56420a7badb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa723368000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a7bb2f0 0x56420a76e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa723368000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a76ee10 0x56420a76f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa723368000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56420a68f3f0 con 0x56420a76ee10 2024-09-17T05:35:16.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa723368000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56420a5ccb20 con 0x56420a7bb2f0 2024-09-17T05:35:16.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa723368000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x56420a5bbf50 con 0x56420a7ba9d0 2024-09-17T05:35:16.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa71e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a76ee10 0x56420a76f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa71e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a76ee10 0x56420a76f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54260/0 (socket says 172.21.15.31:54260) 2024-09-17T05:35:16.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa71e000640 1 -- 172.21.15.31:0/2491973597 learned_addr learned my addr 172.21.15.31:0/2491973597 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:16.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa71cc00640 1 --2- 172.21.15.31:0/2491973597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a7bb2f0 0x56420a76e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa71d600640 1 --2- 172.21.15.31:0/2491973597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a7ba9d0 0x56420a7badb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa71e000640 1 -- 172.21.15.31:0/2491973597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a7ba9d0 msgr2=0x56420a7badb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:35:16.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa71e000640 1 --2- 172.21.15.31:0/2491973597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a7ba9d0 0x56420a7badb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa71e000640 1 -- 172.21.15.31:0/2491973597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a7bb2f0 msgr2=0x56420a76e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:35:16.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa71e000640 1 --2- 172.21.15.31:0/2491973597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a7bb2f0 0x56420a76e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa71e000640 1 -- 172.21.15.31:0/2491973597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56420a583590 con 0x56420a76ee10 2024-09-17T05:35:16.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa71e000640 1 --2- 172.21.15.31:0/2491973597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a76ee10 0x56420a76f1f0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fa710009f10 tx=0x7fa710010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db65d95489a9bc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:16.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa70a000640 1 -- 172.21.15.31:0/2491973597 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa710016070 con 0x56420a76ee10 2024-09-17T05:35:16.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa70a000640 1 -- 172.21.15.31:0/2491973597 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa71001b750 con 0x56420a76ee10 2024-09-17T05:35:16.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa70a000640 1 -- 172.21.15.31:0/2491973597 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71001bb40 con 0x56420a76ee10 2024-09-17T05:35:16.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa723368000 1 -- 172.21.15.31:0/2491973597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a76ee10 msgr2=0x56420a76f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:16.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa723368000 1 --2- 172.21.15.31:0/2491973597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a76ee10 0x56420a76f1f0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fa710009f10 tx=0x7fa710010740 comp rx=0 tx=0).stop 2024-09-17T05:35:16.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa723368000 1 -- 172.21.15.31:0/2491973597 shutdown_connections 2024-09-17T05:35:16.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa723368000 1 --2- 172.21.15.31:0/2491973597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a76ee10 0x56420a76f1f0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa723368000 1 --2- 172.21.15.31:0/2491973597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a7bb2f0 0x56420a76e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa723368000 1 --2- 172.21.15.31:0/2491973597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a7ba9d0 0x56420a7badb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa723368000 1 -- 172.21.15.31:0/2491973597 >> 172.21.15.31:0/2491973597 conn(0x56420a658130 msgr2=0x56420a79de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:16.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa723368000 1 -- 172.21.15.31:0/2491973597 shutdown_connections 2024-09-17T05:35:16.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa723368000 1 -- 172.21.15.31:0/2491973597 wait complete. 2024-09-17T05:35:16.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa723368000 1 -- start start 2024-09-17T05:35:16.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.705+0000 7fa723368000 1 Processor -- start 2024-09-17T05:35:16.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa723368000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a76ee10 0x56420a79b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa723368000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a7ba9d0 0x56420a79be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa723368000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7bb2f0 0x56420a79c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa723368000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56420a5565d0 con 0x56420a7bb2f0 2024-09-17T05:35:16.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa723368000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56420a5bfd60 con 0x56420a7ba9d0 2024-09-17T05:35:16.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa723368000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x56420a562500 con 0x56420a76ee10 2024-09-17T05:35:16.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa723368000 10 client.0 _ll_register_callbacks cb 0x56420a566810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:35:16.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa71e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7bb2f0 0x56420a79c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa71e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7bb2f0 0x56420a79c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54264/0 (socket says 172.21.15.31:54264) 2024-09-17T05:35:16.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa71e000640 1 -- 172.21.15.31:0/2328358427 learned_addr learned my addr 172.21.15.31:0/2328358427 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:16.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa71cc00640 1 --2- 172.21.15.31:0/2328358427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a7ba9d0 0x56420a79be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa71d600640 1 --2- 172.21.15.31:0/2328358427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a76ee10 0x56420a79b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa71e000640 1 -- 172.21.15.31:0/2328358427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a76ee10 msgr2=0x56420a79b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:35:16.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa71e000640 1 --2- 172.21.15.31:0/2328358427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a76ee10 0x56420a79b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa71e000640 1 -- 172.21.15.31:0/2328358427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a7ba9d0 msgr2=0x56420a79be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:35:16.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa71e000640 1 --2- 172.21.15.31:0/2328358427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a7ba9d0 0x56420a79be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa71e000640 1 -- 172.21.15.31:0/2328358427 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56420a55a170 con 0x56420a7bb2f0 2024-09-17T05:35:16.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa71e000640 1 --2- 172.21.15.31:0/2328358427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7bb2f0 0x56420a79c3b0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x56420a56d130 tx=0x7fa71001b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d45ac075d2d5969 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:16.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa6fea00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:35:16.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa6fea00640 1 -- 172.21.15.31:0/2328358427 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa710016040 con 0x56420a7bb2f0 2024-09-17T05:35:16.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa723368000 1 -- 172.21.15.31:0/2328358427 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56420a5540f0 con 0x56420a7bb2f0 2024-09-17T05:35:16.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa6fea00640 1 -- 172.21.15.31:0/2328358427 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7fa71001bc90 con 0x56420a7bb2f0 2024-09-17T05:35:16.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa6fea00640 1 -- 172.21.15.31:0/2328358427 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fa71002e050 con 0x56420a7bb2f0 2024-09-17T05:35:16.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa723368000 10 client.7968 fetch_fsmap learned FSMap version 90 2024-09-17T05:35:16.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa723368000 1 -- 172.21.15.31:0/2328358427 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) -- 0x56420a640ef0 con 0x56420a7bb2f0 2024-09-17T05:35:16.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa6fea00640 1 -- 172.21.15.31:0/2328358427 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x56420a5540f0 con 0x56420a7bb2f0 2024-09-17T05:35:16.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa6fea00640 1 -- 172.21.15.31:0/2328358427 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 90) ==== 3502+0+0 (secure 0 0 0) 0x7fa710031020 con 0x56420a7bb2f0 2024-09-17T05:35:16.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa723368000 10 client.7968 fetch_fsmap finished waiting for FSMap version 90 2024-09-17T05:35:16.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa723368000 10 client.7968 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T05:35:16.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa723368000 20 client.7968 populate_metadata read hostname 'smithi031' 2024-09-17T05:35:16.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa723368000 1 --2- 172.21.15.31:0/2328358427 >> [v2:172.21.15.155:6809/1879117968,v1:172.21.15.155:6835/1879117968] conn(0x56420a79d060 0x56420a79d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa723368000 4 client.7968 mds_command: new command op to 7848 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:35:16.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa723368000 1 -- 172.21.15.31:0/2328358427 --> [v2:172.21.15.155:6809/1879117968,v1:172.21.15.155:6835/1879117968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56420a5cea70 con 0x56420a79d060 2024-09-17T05:35:16.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.709+0000 7fa71d600640 1 --2- 172.21.15.31:0/2328358427 >> [v2:172.21.15.155:6809/1879117968,v1:172.21.15.155:6835/1879117968] conn(0x56420a79d060 0x56420a79d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.713+0000 7fa71d600640 1 --2- 172.21.15.31:0/2328358427 >> [v2:172.21.15.155:6809/1879117968,v1:172.21.15.155:6835/1879117968] conn(0x56420a79d060 0x56420a79d440 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c1b5505fc69fa66 server_cookie=10727e66d7c7914c in_seq=0 out_seq=0 2024-09-17T05:35:16.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.713+0000 7fa6fea00640 10 client.7968 ms_handle_connect on v2:172.21.15.155:6809/1879117968 2024-09-17T05:35:16.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.713+0000 7fa6fea00640 1 -- 172.21.15.31:0/2328358427 <== mds.0 v2:172.21.15.155:6809/1879117968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56420a5cea70 con 0x56420a79d060 2024-09-17T05:35:16.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.713+0000 7fa6fea00640 10 client.7968 handle_command_reply: tid=0 2024-09-17T05:35:16.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.713+0000 7fa723368000 1 client.7968 shutdown 2024-09-17T05:35:16.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.713+0000 7fa723368000 1 -- 172.21.15.31:0/2328358427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7bb2f0 msgr2=0x56420a79c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:16.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.713+0000 7fa723368000 1 --2- 172.21.15.31:0/2328358427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7bb2f0 0x56420a79c3b0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x56420a56d130 tx=0x7fa71001b690 comp rx=0 tx=0).stop 2024-09-17T05:35:16.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.713+0000 7fa723368000 1 -- 172.21.15.31:0/2328358427 shutdown_connections 2024-09-17T05:35:16.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.713+0000 7fa723368000 1 --2- 172.21.15.31:0/2328358427 >> [v2:172.21.15.155:6809/1879117968,v1:172.21.15.155:6835/1879117968] conn(0x56420a79d060 0x56420a79d440 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.713+0000 7fa723368000 1 --2- 172.21.15.31:0/2328358427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7bb2f0 0x56420a79c3b0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.713+0000 7fa723368000 1 --2- 172.21.15.31:0/2328358427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a7ba9d0 0x56420a79be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.713+0000 7fa6fea00640 0 client.7968 ms_handle_reset on v2:172.21.15.155:6809/1879117968 2024-09-17T05:35:16.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.713+0000 7fa723368000 1 --2- 172.21.15.31:0/2328358427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a76ee10 0x56420a79b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.713+0000 7fa723368000 1 -- 172.21.15.31:0/2328358427 >> 172.21.15.31:0/2328358427 conn(0x56420a658130 msgr2=0x56420a76dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:16.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.713+0000 7fa723368000 1 -- 172.21.15.31:0/2328358427 shutdown_connections 2024-09-17T05:35:16.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.713+0000 7fa723368000 1 -- 172.21.15.31:0/2328358427 wait complete. 2024-09-17T05:35:16.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.713+0000 7fa723368000 20 client.7968 trim_cache size 0 max 16384 2024-09-17T05:35:16.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa723368000 1 Processor -- start 2024-09-17T05:35:16.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa723368000 1 -- start start 2024-09-17T05:35:16.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa723368000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a76ee10 0x56420a76e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa723368000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7ba9d0 0x56420a76e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa723368000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a7bb2f0 0x56420a7ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa723368000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa7182042e0 con 0x56420a7ba9d0 2024-09-17T05:35:16.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa723368000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa718203330 con 0x56420a7bb2f0 2024-09-17T05:35:16.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa723368000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa7180c7e40 con 0x56420a76ee10 2024-09-17T05:35:16.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa71cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7ba9d0 0x56420a76e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa71cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7ba9d0 0x56420a76e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54278/0 (socket says 172.21.15.31:54278) 2024-09-17T05:35:16.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa71cc00640 1 -- 172.21.15.31:0/182054910 learned_addr learned my addr 172.21.15.31:0/182054910 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:16.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa71d600640 1 --2- 172.21.15.31:0/182054910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a76ee10 0x56420a76e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa71e000640 1 --2- 172.21.15.31:0/182054910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a7bb2f0 0x56420a7ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa71cc00640 1 -- 172.21.15.31:0/182054910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a76ee10 msgr2=0x56420a76e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:35:16.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa71cc00640 1 --2- 172.21.15.31:0/182054910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a76ee10 0x56420a76e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa71cc00640 1 -- 172.21.15.31:0/182054910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a7bb2f0 msgr2=0x56420a7ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:35:16.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa71cc00640 1 --2- 172.21.15.31:0/182054910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a7bb2f0 0x56420a7ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa71cc00640 1 -- 172.21.15.31:0/182054910 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56420a617d90 con 0x56420a7ba9d0 2024-09-17T05:35:16.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.733+0000 7fa71cc00640 1 --2- 172.21.15.31:0/182054910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7ba9d0 0x56420a76e5f0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fa704005230 tx=0x7fa704012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c29f73ebda82ac2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:16.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa709600640 1 -- 172.21.15.31:0/182054910 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa704028070 con 0x56420a7ba9d0 2024-09-17T05:35:16.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa709600640 1 -- 172.21.15.31:0/182054910 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa704023560 con 0x56420a7ba9d0 2024-09-17T05:35:16.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa709600640 1 -- 172.21.15.31:0/182054910 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa704023770 con 0x56420a7ba9d0 2024-09-17T05:35:16.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa723368000 1 -- 172.21.15.31:0/182054910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7ba9d0 msgr2=0x56420a76e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:16.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa723368000 1 --2- 172.21.15.31:0/182054910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7ba9d0 0x56420a76e5f0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fa704005230 tx=0x7fa704012000 comp rx=0 tx=0).stop 2024-09-17T05:35:16.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa723368000 1 -- 172.21.15.31:0/182054910 shutdown_connections 2024-09-17T05:35:16.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa723368000 1 --2- 172.21.15.31:0/182054910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a7bb2f0 0x56420a7ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa723368000 1 --2- 172.21.15.31:0/182054910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7ba9d0 0x56420a76e5f0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa723368000 1 --2- 172.21.15.31:0/182054910 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a76ee10 0x56420a76e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa723368000 1 -- 172.21.15.31:0/182054910 >> 172.21.15.31:0/182054910 conn(0x56420a658130 msgr2=0x56420a776240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:16.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa723368000 1 -- 172.21.15.31:0/182054910 shutdown_connections 2024-09-17T05:35:16.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa723368000 1 -- 172.21.15.31:0/182054910 wait complete. 2024-09-17T05:35:16.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa723368000 1 -- start start 2024-09-17T05:35:16.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa723368000 1 Processor -- start 2024-09-17T05:35:16.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa723368000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a76ee10 0x56420a830ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa723368000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7ba9d0 0x56420a831020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa723368000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a7bb2f0 0x56420a831560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa723368000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56420a587ec0 con 0x56420a7ba9d0 2024-09-17T05:35:16.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa723368000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa7180cb790 con 0x56420a76ee10 2024-09-17T05:35:16.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa723368000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x56420a5751c0 con 0x56420a7bb2f0 2024-09-17T05:35:16.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa723368000 10 client.0 _ll_register_callbacks cb 0x7fa710009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:35:16.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa71cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7ba9d0 0x56420a831020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa71cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7ba9d0 0x56420a831020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54280/0 (socket says 172.21.15.31:54280) 2024-09-17T05:35:16.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa71cc00640 1 -- 172.21.15.31:0/279921768 learned_addr learned my addr 172.21.15.31:0/279921768 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:16.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa71d600640 1 --2- 172.21.15.31:0/279921768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a76ee10 0x56420a830ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.737+0000 7fa71e000640 1 --2- 172.21.15.31:0/279921768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a7bb2f0 0x56420a831560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa71cc00640 1 -- 172.21.15.31:0/279921768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a7bb2f0 msgr2=0x56420a831560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:35:16.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa71cc00640 1 --2- 172.21.15.31:0/279921768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a7bb2f0 0x56420a831560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa71cc00640 1 -- 172.21.15.31:0/279921768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a76ee10 msgr2=0x56420a830ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:35:16.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa71cc00640 1 --2- 172.21.15.31:0/279921768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a76ee10 0x56420a830ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa71cc00640 1 -- 172.21.15.31:0/279921768 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56420a582a90 con 0x56420a7ba9d0 2024-09-17T05:35:16.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa71cc00640 1 --2- 172.21.15.31:0/279921768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7ba9d0 0x56420a831020 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x56420a650a10 tx=0x7fa7040249b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e7591d4b7d48fb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:16.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa6fea00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:35:16.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa6fea00640 1 -- 172.21.15.31:0/279921768 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa704028070 con 0x56420a7ba9d0 2024-09-17T05:35:16.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa6fea00640 1 -- 172.21.15.31:0/279921768 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7fa70402dad0 con 0x56420a7ba9d0 2024-09-17T05:35:16.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 1 -- 172.21.15.31:0/279921768 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa704023560 con 0x56420a7ba9d0 2024-09-17T05:35:16.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa6fea00640 1 -- 172.21.15.31:0/279921768 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fa70402dcd0 con 0x56420a7ba9d0 2024-09-17T05:35:16.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 10 client.7974 fetch_fsmap learned FSMap version 90 2024-09-17T05:35:16.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 1 -- 172.21.15.31:0/279921768 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) -- 0x56420a561050 con 0x56420a7ba9d0 2024-09-17T05:35:16.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa6fea00640 1 -- 172.21.15.31:0/279921768 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa704023560 con 0x56420a7ba9d0 2024-09-17T05:35:16.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa6fea00640 1 -- 172.21.15.31:0/279921768 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 90) ==== 3502+0+0 (secure 0 0 0) 0x7fa70400e6c0 con 0x56420a7ba9d0 2024-09-17T05:35:16.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 10 client.7974 fetch_fsmap finished waiting for FSMap version 90 2024-09-17T05:35:16.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 10 client.7974 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T05:35:16.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 20 client.7974 populate_metadata read hostname 'smithi031' 2024-09-17T05:35:16.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 1 --2- 172.21.15.31:0/279921768 >> [v2:172.21.15.155:6809/1879117968,v1:172.21.15.155:6835/1879117968] conn(0x56420a7d0d90 0x56420a7cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 4 client.7974 mds_command: new command op to 7848 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:35:16.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 1 -- 172.21.15.31:0/279921768 --> [v2:172.21.15.155:6809/1879117968,v1:172.21.15.155:6835/1879117968] -- command(tid 0: {"prefix": "status"}) -- 0x56420a5ca520 con 0x56420a7d0d90 2024-09-17T05:35:16.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa71d600640 1 --2- 172.21.15.31:0/279921768 >> [v2:172.21.15.155:6809/1879117968,v1:172.21.15.155:6835/1879117968] conn(0x56420a7d0d90 0x56420a7cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa71d600640 1 --2- 172.21.15.31:0/279921768 >> [v2:172.21.15.155:6809/1879117968,v1:172.21.15.155:6835/1879117968] conn(0x56420a7d0d90 0x56420a7cff20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e1309aa2f74d45a server_cookie=5664a86cfb49d5b9 in_seq=0 out_seq=0 2024-09-17T05:35:16.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa6fea00640 10 client.7974 ms_handle_connect on v2:172.21.15.155:6809/1879117968 2024-09-17T05:35:16.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa6fea00640 1 -- 172.21.15.31:0/279921768 <== mds.0 v2:172.21.15.155:6809/1879117968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x56420a5ca520 con 0x56420a7d0d90 2024-09-17T05:35:16.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa6fea00640 10 client.7974 handle_command_reply: tid=0 2024-09-17T05:35:16.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 1 client.7974 shutdown 2024-09-17T05:35:16.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 1 -- 172.21.15.31:0/279921768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7ba9d0 msgr2=0x56420a831020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:16.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 1 --2- 172.21.15.31:0/279921768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7ba9d0 0x56420a831020 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x56420a650a10 tx=0x7fa7040249b0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 1 -- 172.21.15.31:0/279921768 shutdown_connections 2024-09-17T05:35:16.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 1 --2- 172.21.15.31:0/279921768 >> [v2:172.21.15.155:6809/1879117968,v1:172.21.15.155:6835/1879117968] conn(0x56420a7d0d90 0x56420a7cff20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 1 --2- 172.21.15.31:0/279921768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x56420a7bb2f0 0x56420a831560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 1 --2- 172.21.15.31:0/279921768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x56420a7ba9d0 0x56420a831020 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa6fea00640 0 client.7974 ms_handle_reset on v2:172.21.15.155:6809/1879117968 2024-09-17T05:35:16.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 1 --2- 172.21.15.31:0/279921768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56420a76ee10 0x56420a830ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 1 -- 172.21.15.31:0/279921768 >> 172.21.15.31:0/279921768 conn(0x56420a658130 msgr2=0x56420a776b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:16.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 1 -- 172.21.15.31:0/279921768 shutdown_connections 2024-09-17T05:35:16.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 1 -- 172.21.15.31:0/279921768 wait complete. 2024-09-17T05:35:16.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.741+0000 7fa723368000 20 client.7974 trim_cache size 0 max 16384 2024-09-17T05:35:16.749 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:35:16.749 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "b668cd1d-3036-4a29-9e5a-69d0df5776a8", 2024-09-17T05:35:16.749 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-17T05:35:16.749 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 7848, 2024-09-17T05:35:16.749 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-09-17T05:35:16.749 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-09-17T05:35:16.749 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-17T05:35:16.749 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 6.0520945230000001, 2024-09-17T05:35:16.749 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 90, 2024-09-17T05:35:16.749 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 130, 2024-09-17T05:35:16.750 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 130, 2024-09-17T05:35:16.750 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 11.208407297999999 2024-09-17T05:35:16.750 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:35:16.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.745+0000 7fa720000640 1 -- 172.21.15.31:0/2950431239 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa6f8073830 msgr2=0x7fa6f8075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:16.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.745+0000 7fa720000640 1 --2- 172.21.15.31:0/2950431239 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa6f8073830 0x7fa6f8075cf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa718152070 tx=0x7fa704009040 comp rx=0 tx=0).stop 2024-09-17T05:35:16.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.745+0000 7fa720000640 1 -- 172.21.15.31:0/2950431239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7180cf4e0 msgr2=0x7fa7181f7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:16.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.745+0000 7fa720000640 1 --2- 172.21.15.31:0/2950431239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7180cf4e0 0x7fa7181f7990 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0b0040 tx=0x7fa70c0a55f0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.745+0000 7fa720000640 1 -- 172.21.15.31:0/2950431239 shutdown_connections 2024-09-17T05:35:16.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.745+0000 7fa720000640 1 --2- 172.21.15.31:0/2950431239 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa6f8073830 0x7fa6f8075cf0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.745+0000 7fa720000640 1 --2- 172.21.15.31:0/2950431239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa71815c130 0x7fa7181fb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.745+0000 7fa720000640 1 --2- 172.21.15.31:0/2950431239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa71815bd50 0x7fa7181fa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.745+0000 7fa720000640 1 --2- 172.21.15.31:0/2950431239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7180cf4e0 0x7fa7181f7990 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.745+0000 7fa720000640 1 -- 172.21.15.31:0/2950431239 >> 172.21.15.31:0/2950431239 conn(0x7fa7180d1ea0 msgr2=0x7fa7180d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:16.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.745+0000 7fa720000640 1 -- 172.21.15.31:0/2950431239 shutdown_connections 2024-09-17T05:35:16.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.745+0000 7fa720000640 1 -- 172.21.15.31:0/2950431239 wait complete. 2024-09-17T05:35:16.766 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:35:16.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b86c00640 1 -- 172.21.15.31:0/2367018402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b8006e740 msgr2=0x7f0b800cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:16.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b86c00640 1 --2- 172.21.15.31:0/2367018402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b8006e740 0x7f0b800cee30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009840 tx=0x7f0b6c01c820 comp rx=0 tx=0).stop 2024-09-17T05:35:16.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b86c00640 1 -- 172.21.15.31:0/2367018402 shutdown_connections 2024-09-17T05:35:16.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b86c00640 1 --2- 172.21.15.31:0/2367018402 >> v2:172.21.15.155:3300/0 conn(0x7f0b800cd150 0x7f0b800cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b86c00640 1 --2- 172.21.15.31:0/2367018402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b8006e740 0x7f0b800cee30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b86c00640 1 -- 172.21.15.31:0/2367018402 >> 172.21.15.31:0/2367018402 conn(0x7f0b800d1ea0 msgr2=0x7f0b800d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:16.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b86c00640 1 -- 172.21.15.31:0/2367018402 shutdown_connections 2024-09-17T05:35:16.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b86c00640 1 -- 172.21.15.31:0/2367018402 wait complete. 2024-09-17T05:35:16.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b86c00640 1 Processor -- start 2024-09-17T05:35:16.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b86c00640 1 -- start start 2024-09-17T05:35:16.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b86c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b8006e740 0x7f0b80152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b86c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b800cd150 0x7f0b800cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b86c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b8015e130 0x7f0b800c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b86c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8016b010 con 0x7f0b800cd150 2024-09-17T05:35:16.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b86c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8016ae90 con 0x7f0b8006e740 2024-09-17T05:35:16.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b86c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0b8016b190 con 0x7f0b8015e130 2024-09-17T05:35:16.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b7f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b800cd150 0x7f0b800cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b7f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b800cd150 0x7f0b800cb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54290/0 (socket says 172.21.15.31:54290) 2024-09-17T05:35:16.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b7f400640 1 -- 172.21.15.31:0/1564934601 learned_addr learned my addr 172.21.15.31:0/1564934601 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:16.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.913+0000 7f0b7fe00640 1 --2- 172.21.15.31:0/1564934601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b8006e740 0x7f0b80152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.917+0000 7f0b84c00640 1 --2- 172.21.15.31:0/1564934601 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b8015e130 0x7f0b800c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.917+0000 7f0b7f400640 1 -- 172.21.15.31:0/1564934601 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b8015e130 msgr2=0x7f0b800c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:16.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.917+0000 7f0b7f400640 1 --2- 172.21.15.31:0/1564934601 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b8015e130 0x7f0b800c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.917+0000 7f0b7f400640 1 -- 172.21.15.31:0/1564934601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b8006e740 msgr2=0x7f0b80152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:16.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.917+0000 7f0b7f400640 1 --2- 172.21.15.31:0/1564934601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b8006e740 0x7f0b80152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:16.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.917+0000 7f0b7f400640 1 -- 172.21.15.31:0/1564934601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b80154760 con 0x7f0b800cd150 2024-09-17T05:35:16.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.917+0000 7f0b7f400640 1 --2- 172.21.15.31:0/1564934601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b800cd150 0x7f0b800cb890 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009790 tx=0x7f0b6c0a57f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:16.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.917+0000 7f0b77e00640 1 -- 172.21.15.31:0/1564934601 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c0b2040 con 0x7f0b800cd150 2024-09-17T05:35:16.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.917+0000 7f0b77e00640 1 -- 172.21.15.31:0/1564934601 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b6c004430 con 0x7f0b800cd150 2024-09-17T05:35:16.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.917+0000 7f0b77e00640 1 -- 172.21.15.31:0/1564934601 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c005280 con 0x7f0b800cd150 2024-09-17T05:35:16.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.917+0000 7f0b86c00640 1 -- 172.21.15.31:0/1564934601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b80155e20 con 0x7f0b800cd150 2024-09-17T05:35:16.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.917+0000 7f0b86c00640 1 -- 172.21.15.31:0/1564934601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b800cbdd0 con 0x7f0b800cd150 2024-09-17T05:35:16.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.917+0000 7f0b86c00640 1 -- 172.21.15.31:0/1564934601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b80156430 con 0x7f0b800cd150 2024-09-17T05:35:16.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.917+0000 7f0b77e00640 1 -- 172.21.15.31:0/1564934601 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f0b6c0be060 con 0x7f0b800cd150 2024-09-17T05:35:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.921+0000 7f0b77e00640 1 --2- 172.21.15.31:0/1564934601 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0b60073830 0x7f0b60075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.921+0000 7f0b77e00640 1 -- 172.21.15.31:0/1564934601 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f0b6c12e590 con 0x7f0b800cd150 2024-09-17T05:35:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.921+0000 7f0b7fe00640 1 --2- 172.21.15.31:0/1564934601 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0b60073830 0x7f0b60075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:16.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.921+0000 7f0b7fe00640 1 --2- 172.21.15.31:0/1564934601 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0b60073830 0x7f0b60075cf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0b70007d70 tx=0x7f0b70007d00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:16.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:16.925+0000 7f0b77e00640 1 -- 172.21.15.31:0/1564934601 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0b6c016410 con 0x7f0b800cd150 2024-09-17T05:35:17.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:17.137+0000 7f0b86c00640 1 -- 172.21.15.31:0/1564934601 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0b800cd600 con 0x7f0b800cd150 2024-09-17T05:35:17.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:17.137+0000 7f0b77e00640 1 -- 172.21.15.31:0/1564934601 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v90) ==== 53+0+73 (secure 0 0 0) 0x7f0b6c0f8ba0 con 0x7f0b800cd150 2024-09-17T05:35:17.141 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:35:17.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:17.141+0000 7f0b86c00640 1 -- 172.21.15.31:0/1564934601 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0b60073830 msgr2=0x7f0b60075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:17.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:17.141+0000 7f0b86c00640 1 --2- 172.21.15.31:0/1564934601 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0b60073830 0x7f0b60075cf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0b70007d70 tx=0x7f0b70007d00 comp rx=0 tx=0).stop 2024-09-17T05:35:17.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:17.141+0000 7f0b86c00640 1 -- 172.21.15.31:0/1564934601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b800cd150 msgr2=0x7f0b800cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:17.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:17.141+0000 7f0b86c00640 1 --2- 172.21.15.31:0/1564934601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b800cd150 0x7f0b800cb890 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009790 tx=0x7f0b6c0a57f0 comp rx=0 tx=0).stop 2024-09-17T05:35:17.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:17.141+0000 7f0b86c00640 1 -- 172.21.15.31:0/1564934601 shutdown_connections 2024-09-17T05:35:17.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:17.141+0000 7f0b86c00640 1 --2- 172.21.15.31:0/1564934601 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0b60073830 0x7f0b60075cf0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:17.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:17.141+0000 7f0b86c00640 1 --2- 172.21.15.31:0/1564934601 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0b8015e130 0x7f0b800c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:17.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:17.141+0000 7f0b86c00640 1 --2- 172.21.15.31:0/1564934601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0b800cd150 0x7f0b800cb890 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:17.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:17.141+0000 7f0b86c00640 1 --2- 172.21.15.31:0/1564934601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b8006e740 0x7f0b80152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:17.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:17.141+0000 7f0b86c00640 1 -- 172.21.15.31:0/1564934601 >> 172.21.15.31:0/1564934601 conn(0x7f0b800d1ea0 msgr2=0x7f0b800d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:17.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:17.141+0000 7f0b86c00640 1 -- 172.21.15.31:0/1564934601 shutdown_connections 2024-09-17T05:35:17.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:17.141+0000 7f0b86c00640 1 -- 172.21.15.31:0/1564934601 wait complete. 2024-09-17T05:35:17.162 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:35:17.162 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:35:17.163 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-17T05:35:17.163 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:35:17.163 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:35:17.163 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:35:17.163 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:35:17.163 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:35:17.163 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:35:17.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:17.164 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-17T05:35:17.173 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:35:17.174 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:35:17.174 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:35:17.174 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:17.174 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-17T05:35:17.174 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:17.174 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:35:17.174 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:17.174 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-17T05:35:17.174 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:35:17.174 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:17.174 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-17T05:35:17.175 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:35:17.175 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:17.175 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-17T05:35:17.175 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:35:17.175 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42035sec preferred_lft 42035sec 2024-09-17T05:35:17.175 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-17T05:35:17.175 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:17.175 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:35:17.175 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:17.175 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-17T05:35:17.175 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:35:17.175 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:fe:f3:3e:aa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:17.175 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:35:17.176 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:17.176 INFO:teuthology.orchestra.run.smithi031.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:35:17.176 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:17.176 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:35:17.176 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:17.176 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:35:17.176 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:17.176 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:35:17.176 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:35:17.176 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:35:17.177 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:17.177 INFO:teuthology.orchestra.run.smithi031.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:35:17.177 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:35:17.177 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:35:17.177 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:17.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:17.178 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:35:17.236 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-17T05:35:17.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:17.238 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-17T05:35:17.290 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-17T05:35:17.291 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:35:17.291 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:35:17.291 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:35:17.291 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:35:17.292 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:35:17.292 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:35:17.292 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:35:17.293 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:35:17.293 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:35:17.293 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:35:17.293 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:35:17.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:35:17.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:35:17.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:17.430 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T05:35:17.439 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:35:17.440 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:35:17.440 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:35:17.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:17.440 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-09-17T05:35:17.502 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:35:17.502 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:35:17.553 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:35:17.553 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:35:17.553 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:35:17.604 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-17T05:35:17.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:17.605 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:35:17.695 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:35:17.695 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:35:17.711 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:35:17.711 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:35:17.711 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:35:17.711 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:35:17.711 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:35:17.716 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:35:17.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:17.716 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:35:17.737 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:35:17.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:35:17.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:35:17.849 INFO:teuthology.orchestra.run.smithi031.stdout:client7582 2024-09-17T05:35:17.849 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:35:17.849 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:35:17.859 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:35:18.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.045+0000 7ff00d000640 1 -- 172.21.15.31:0/2776421080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0080ced80 msgr2=0x7ff0080ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:18.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.045+0000 7ff00d000640 1 --2- 172.21.15.31:0/2776421080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0080ced80 0x7ff0080ae9b0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7ff0080cf340 tx=0x7feff401c800 comp rx=0 tx=0).stop 2024-09-17T05:35:18.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.045+0000 7ff00d000640 1 -- 172.21.15.31:0/2776421080 shutdown_connections 2024-09-17T05:35:18.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.045+0000 7ff00d000640 1 --2- 172.21.15.31:0/2776421080 >> v2:172.21.15.155:3300/0 conn(0x7ff0080cdb30 0x7ff0080aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:18.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.045+0000 7ff00d000640 1 --2- 172.21.15.31:0/2776421080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0080ced80 0x7ff0080ae9b0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:18.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.045+0000 7ff00d000640 1 -- 172.21.15.31:0/2776421080 >> 172.21.15.31:0/2776421080 conn(0x7ff0080d1dc0 msgr2=0x7ff0080d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:18.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.045+0000 7ff00d000640 1 -- 172.21.15.31:0/2776421080 shutdown_connections 2024-09-17T05:35:18.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.045+0000 7ff00d000640 1 -- 172.21.15.31:0/2776421080 wait complete. 2024-09-17T05:35:18.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.045+0000 7ff00d000640 1 Processor -- start 2024-09-17T05:35:18.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.045+0000 7ff00d000640 1 -- start start 2024-09-17T05:35:18.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff00d000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0080cdb30 0x7ff0080b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:18.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff00d000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0080ced80 0x7ff008166260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:18.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff00d000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff00815bea0 0x7ff008163ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:18.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff00d000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff008169240 con 0x7ff0080ced80 2024-09-17T05:35:18.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff00d000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff0081690c0 con 0x7ff00815bea0 2024-09-17T05:35:18.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff00d000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff0081693c0 con 0x7ff0080cdb30 2024-09-17T05:35:18.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff005400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0080ced80 0x7ff008166260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:18.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff005400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0080ced80 0x7ff008166260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54304/0 (socket says 172.21.15.31:54304) 2024-09-17T05:35:18.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff005400640 1 -- 172.21.15.31:0/4198632501 learned_addr learned my addr 172.21.15.31:0/4198632501 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:18.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff006800640 1 --2- 172.21.15.31:0/4198632501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff00815bea0 0x7ff008163ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:18.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff005e00640 1 --2- 172.21.15.31:0/4198632501 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0080cdb30 0x7ff0080b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:18.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff005400640 1 -- 172.21.15.31:0/4198632501 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0080cdb30 msgr2=0x7ff0080b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:18.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff005400640 1 --2- 172.21.15.31:0/4198632501 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0080cdb30 0x7ff0080b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:18.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff005400640 1 -- 172.21.15.31:0/4198632501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff00815bea0 msgr2=0x7ff008163ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:18.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff005400640 1 --2- 172.21.15.31:0/4198632501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff00815bea0 0x7ff008163ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:18.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff005400640 1 -- 172.21.15.31:0/4198632501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0081508e0 con 0x7ff0080ced80 2024-09-17T05:35:18.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff006800640 1 --2- 172.21.15.31:0/4198632501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff00815bea0 0x7ff008163ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:18.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff005e00640 1 --2- 172.21.15.31:0/4198632501 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0080cdb30 0x7ff0080b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:18.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff005400640 1 --2- 172.21.15.31:0/4198632501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0080ced80 0x7ff008166260 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7feff4098230 tx=0x7feff40a5590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:18.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7feffe000640 1 -- 172.21.15.31:0/4198632501 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff40b2040 con 0x7ff0080ced80 2024-09-17T05:35:18.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7feffe000640 1 -- 172.21.15.31:0/4198632501 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feff40bb070 con 0x7ff0080ced80 2024-09-17T05:35:18.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7feffe000640 1 -- 172.21.15.31:0/4198632501 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff4003600 con 0x7ff0080ced80 2024-09-17T05:35:18.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff00d000640 1 -- 172.21.15.31:0/4198632501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff00806f2b0 con 0x7ff0080ced80 2024-09-17T05:35:18.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff00d000640 1 -- 172.21.15.31:0/4198632501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff00815c630 con 0x7ff0080ced80 2024-09-17T05:35:18.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.049+0000 7ff00d000640 1 -- 172.21.15.31:0/4198632501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0080ce670 con 0x7ff0080ced80 2024-09-17T05:35:18.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.053+0000 7feffe000640 1 -- 172.21.15.31:0/4198632501 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7feff40037a0 con 0x7ff0080ced80 2024-09-17T05:35:18.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.053+0000 7feffe000640 1 --2- 172.21.15.31:0/4198632501 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fefe8073830 0x7fefe8075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:18.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.053+0000 7feffe000640 1 -- 172.21.15.31:0/4198632501 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7feff412f360 con 0x7ff0080ced80 2024-09-17T05:35:18.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.053+0000 7ff005e00640 1 --2- 172.21.15.31:0/4198632501 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fefe8073830 0x7fefe8075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:18.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.053+0000 7ff005e00640 1 --2- 172.21.15.31:0/4198632501 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fefe8073830 0x7fefe8075cf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feff8000f70 tx=0x7feff8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:18.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.057+0000 7feffe000640 1 -- 172.21.15.31:0/4198632501 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7feff40163f0 con 0x7ff0080ced80 2024-09-17T05:35:18.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.273+0000 7ff00d000640 1 -- 172.21.15.31:0/4198632501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff0080b0e80 con 0x7ff0080ced80 2024-09-17T05:35:18.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.273+0000 7feffe000640 1 -- 172.21.15.31:0/4198632501 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v90) ==== 53+0+73 (secure 0 0 0) 0x7feff40f99b0 con 0x7ff0080ced80 2024-09-17T05:35:18.275 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:35:18.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.273+0000 7ff00d000640 1 -- 172.21.15.31:0/4198632501 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fefe8073830 msgr2=0x7fefe8075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:18.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.273+0000 7ff00d000640 1 --2- 172.21.15.31:0/4198632501 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fefe8073830 0x7fefe8075cf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feff8000f70 tx=0x7feff8009040 comp rx=0 tx=0).stop 2024-09-17T05:35:18.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.273+0000 7ff00d000640 1 -- 172.21.15.31:0/4198632501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0080ced80 msgr2=0x7ff008166260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:18.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.273+0000 7ff00d000640 1 --2- 172.21.15.31:0/4198632501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0080ced80 0x7ff008166260 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7feff4098230 tx=0x7feff40a5590 comp rx=0 tx=0).stop 2024-09-17T05:35:18.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.273+0000 7ff00d000640 1 -- 172.21.15.31:0/4198632501 shutdown_connections 2024-09-17T05:35:18.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.273+0000 7ff00d000640 1 --2- 172.21.15.31:0/4198632501 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fefe8073830 0x7fefe8075cf0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:18.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.273+0000 7ff00d000640 1 --2- 172.21.15.31:0/4198632501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff00815bea0 0x7ff008163ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:18.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.273+0000 7ff00d000640 1 --2- 172.21.15.31:0/4198632501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff0080ced80 0x7ff008166260 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:18.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.273+0000 7ff00d000640 1 --2- 172.21.15.31:0/4198632501 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0080cdb30 0x7ff0080b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:18.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.273+0000 7ff00d000640 1 -- 172.21.15.31:0/4198632501 >> 172.21.15.31:0/4198632501 conn(0x7ff0080d1dc0 msgr2=0x7ff008072090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:18.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.273+0000 7ff00d000640 1 -- 172.21.15.31:0/4198632501 shutdown_connections 2024-09-17T05:35:18.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:18.277+0000 7ff00d000640 1 -- 172.21.15.31:0/4198632501 wait complete. 2024-09-17T05:35:18.296 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:35:18.296 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:35:18.296 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-09-17T05:35:18.296 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:35:18.297 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:35:18.297 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:35:18.297 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:35:18.297 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:35:18.297 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:35:18.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:18.297 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-09-17T05:35:18.307 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:35:18.307 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:35:18.307 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:35:18.308 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:18.308 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-17T05:35:18.308 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:18.308 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:35:18.308 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:18.308 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-09-17T05:35:18.308 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:35:18.308 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:18.308 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-09-17T05:35:18.308 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:35:18.308 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:18.308 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:35:18.309 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:18.309 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-17T05:35:18.309 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42037sec preferred_lft 42037sec 2024-09-17T05:35:18.309 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-09-17T05:35:18.309 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:18.309 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:35:18.309 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:84:cd:fc:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:18.309 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:35:18.309 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:18.309 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:35:18.309 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:18.309 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:35:18.310 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:18.310 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:35:18.310 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:18.310 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:35:18.310 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:35:18.310 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:35:18.310 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:18.310 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:35:18.310 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:35:18.310 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:35:18.310 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:18.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:18.311 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:35:18.372 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-17T05:35:18.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:18.375 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-09-17T05:35:18.429 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-09-17T05:35:18.430 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:35:18.430 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-17T05:35:18.430 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:35:18.430 INFO:teuthology.orchestra.run.smithi155.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-17T05:35:18.430 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:35:18.430 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:35:18.430 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:35:18.430 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:35:18.430 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:35:18.431 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:35:18.431 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:35:18.431 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:35:18.431 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:35:18.431 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:35:18.431 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:35:18.432 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:35:18.525 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:35:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:35:18.569 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:35:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:35:18.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:18.576 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-17T05:35:18.585 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:35:18.585 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:35:18.586 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:35:18.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:18.587 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-09-17T05:35:18.649 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:35:18.649 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:35:18.705 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:35:18.706 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:35:18.706 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:35:18.760 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-17T05:35:18.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:18.761 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:35:18.856 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:35:18.857 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:35:18.869 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:35:18.870 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:35:18.870 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:35:18.870 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:35:18.870 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:35:18.873 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:35:18.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:18.874 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:35:18.940 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:35:19.027 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:35:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:35:19.030 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:35:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:35:19.036 INFO:teuthology.orchestra.run.smithi155.stdout:client7585 2024-09-17T05:35:19.037 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:35:19.037 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:35:19.046 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:35:19.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.205+0000 7f3fdea00640 1 -- 172.21.15.31:0/1457505636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd80af330 msgr2=0x7f3fd80cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:19.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.205+0000 7f3fdea00640 1 --2- 172.21.15.31:0/1457505636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd80af330 0x7f3fd80cdac0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009c80 tx=0x7f3fd001cd10 comp rx=0 tx=0).stop 2024-09-17T05:35:19.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.205+0000 7f3fdea00640 1 -- 172.21.15.31:0/1457505636 shutdown_connections 2024-09-17T05:35:19.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.205+0000 7f3fdea00640 1 --2- 172.21.15.31:0/1457505636 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd80af330 0x7f3fd80cdac0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:19.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.205+0000 7f3fdea00640 1 --2- 172.21.15.31:0/1457505636 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd80b5170 0x7f3fd80aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:19.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.205+0000 7f3fdea00640 1 -- 172.21.15.31:0/1457505636 >> 172.21.15.31:0/1457505636 conn(0x7f3fd80cfbc0 msgr2=0x7f3fd80cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:19.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.205+0000 7f3fdea00640 1 -- 172.21.15.31:0/1457505636 shutdown_connections 2024-09-17T05:35:19.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.205+0000 7f3fdea00640 1 -- 172.21.15.31:0/1457505636 wait complete. 2024-09-17T05:35:19.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fdea00640 1 Processor -- start 2024-09-17T05:35:19.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fdea00640 1 -- start start 2024-09-17T05:35:19.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fdea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fd80af330 0x7f3fd8153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:19.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fdea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd80b5170 0x7f3fd806f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:19.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fdea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd815bf60 0x7f3fd806fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:19.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fdea00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd8169240 con 0x7f3fd80b5170 2024-09-17T05:35:19.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fdea00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd81690c0 con 0x7f3fd80af330 2024-09-17T05:35:19.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fdea00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3fd81693c0 con 0x7f3fd815bf60 2024-09-17T05:35:19.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fcfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd80b5170 0x7f3fd806f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:19.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fcfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd80b5170 0x7f3fd806f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37646/0 (socket says 172.21.15.31:37646) 2024-09-17T05:35:19.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fcfe00640 1 -- 172.21.15.31:0/289488528 learned_addr learned my addr 172.21.15.31:0/289488528 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:19.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fdca00640 1 --2- 172.21.15.31:0/289488528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd815bf60 0x7f3fd806fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:19.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fd7e00640 1 --2- 172.21.15.31:0/289488528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fd80af330 0x7f3fd8153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:19.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fcfe00640 1 -- 172.21.15.31:0/289488528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd815bf60 msgr2=0x7f3fd806fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:19.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fcfe00640 1 --2- 172.21.15.31:0/289488528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd815bf60 0x7f3fd806fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:19.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fcfe00640 1 -- 172.21.15.31:0/289488528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fd80af330 msgr2=0x7f3fd8153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:19.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fcfe00640 1 --2- 172.21.15.31:0/289488528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fd80af330 0x7f3fd8153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:19.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fcfe00640 1 -- 172.21.15.31:0/289488528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd81f8f10 con 0x7f3fd80b5170 2024-09-17T05:35:19.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fcfe00640 1 --2- 172.21.15.31:0/289488528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd80b5170 0x7f3fd806f640 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000ea20 tx=0x7f3fc000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:19.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fd4c00640 1 -- 172.21.15.31:0/289488528 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc000cd80 con 0x7f3fd80b5170 2024-09-17T05:35:19.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fd4c00640 1 -- 172.21.15.31:0/289488528 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fc0010430 con 0x7f3fd80b5170 2024-09-17T05:35:19.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fd4c00640 1 -- 172.21.15.31:0/289488528 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0010860 con 0x7f3fd80b5170 2024-09-17T05:35:19.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fdea00640 1 -- 172.21.15.31:0/289488528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd80701a0 con 0x7f3fd80b5170 2024-09-17T05:35:19.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.209+0000 7f3fdea00640 1 -- 172.21.15.31:0/289488528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd81f8430 con 0x7f3fd80b5170 2024-09-17T05:35:19.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.213+0000 7f3fdea00640 1 -- 172.21.15.31:0/289488528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fd8069410 con 0x7f3fd80b5170 2024-09-17T05:35:19.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.213+0000 7f3fd4c00640 1 -- 172.21.15.31:0/289488528 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f3fc0010a00 con 0x7f3fd80b5170 2024-09-17T05:35:19.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.213+0000 7f3fd4c00640 1 --2- 172.21.15.31:0/289488528 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3fb4073830 0x7f3fb4075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:19.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.213+0000 7f3fd4c00640 1 -- 172.21.15.31:0/289488528 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f3fc0095980 con 0x7f3fd80b5170 2024-09-17T05:35:19.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.213+0000 7f3fd7e00640 1 --2- 172.21.15.31:0/289488528 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3fb4073830 0x7f3fb4075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:19.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.213+0000 7f3fd7e00640 1 --2- 172.21.15.31:0/289488528 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3fb4073830 0x7f3fb4075cf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8007fd0 tx=0x7f3fc8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:19.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.217+0000 7f3fd4c00640 1 -- 172.21.15.31:0/289488528 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f3fc005f930 con 0x7f3fd80b5170 2024-09-17T05:35:19.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.429+0000 7f3fdea00640 1 -- 172.21.15.31:0/289488528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f3fd80cdac0 con 0x7f3fd80b5170 2024-09-17T05:35:19.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.753+0000 7f3fd4c00640 1 -- 172.21.15.31:0/289488528 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v91) ==== 136+0+0 (secure 0 0 0) 0x7f3fc0064360 con 0x7f3fd80b5170 2024-09-17T05:35:19.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.757+0000 7f3fdea00640 1 -- 172.21.15.31:0/289488528 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3fb4073830 msgr2=0x7f3fb4075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:19.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.757+0000 7f3fdea00640 1 --2- 172.21.15.31:0/289488528 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3fb4073830 0x7f3fb4075cf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8007fd0 tx=0x7f3fc8009040 comp rx=0 tx=0).stop 2024-09-17T05:35:19.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.757+0000 7f3fdea00640 1 -- 172.21.15.31:0/289488528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd80b5170 msgr2=0x7f3fd806f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:19.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.757+0000 7f3fdea00640 1 --2- 172.21.15.31:0/289488528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd80b5170 0x7f3fd806f640 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000ea20 tx=0x7f3fc000eee0 comp rx=0 tx=0).stop 2024-09-17T05:35:19.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.757+0000 7f3fdea00640 1 -- 172.21.15.31:0/289488528 shutdown_connections 2024-09-17T05:35:19.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.757+0000 7f3fdea00640 1 --2- 172.21.15.31:0/289488528 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3fb4073830 0x7f3fb4075cf0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:19.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.757+0000 7f3fdea00640 1 --2- 172.21.15.31:0/289488528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fd815bf60 0x7f3fd806fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:19.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.757+0000 7f3fdea00640 1 --2- 172.21.15.31:0/289488528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fd80b5170 0x7f3fd806f640 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:19.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.757+0000 7f3fdea00640 1 --2- 172.21.15.31:0/289488528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fd80af330 0x7f3fd8153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:19.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.757+0000 7f3fdea00640 1 -- 172.21.15.31:0/289488528 >> 172.21.15.31:0/289488528 conn(0x7f3fd80cfbc0 msgr2=0x7f3fd80b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:19.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.757+0000 7f3fdea00640 1 -- 172.21.15.31:0/289488528 shutdown_connections 2024-09-17T05:35:19.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.757+0000 7f3fdea00640 1 -- 172.21.15.31:0/289488528 wait complete. 2024-09-17T05:35:19.779 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:35:19.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.925+0000 7f2bd9800640 1 -- 172.21.15.31:0/1800714901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bd415bea0 msgr2=0x7f2bd40ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:19.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.925+0000 7f2bd9800640 1 --2- 172.21.15.31:0/1800714901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bd415bea0 0x7f2bd40ce670 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4073d10 tx=0x7f2bc401c830 comp rx=0 tx=0).stop 2024-09-17T05:35:19.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.925+0000 7f2bd9800640 1 -- 172.21.15.31:0/1800714901 shutdown_connections 2024-09-17T05:35:19.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.925+0000 7f2bd9800640 1 --2- 172.21.15.31:0/1800714901 >> v2:172.21.15.155:3300/0 conn(0x7f2bd40cdb30 0x7f2bd40cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:19.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.925+0000 7f2bd9800640 1 --2- 172.21.15.31:0/1800714901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bd415bea0 0x7f2bd40ce670 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:19.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.925+0000 7f2bd9800640 1 -- 172.21.15.31:0/1800714901 >> 172.21.15.31:0/1800714901 conn(0x7f2bd40d1dc0 msgr2=0x7f2bd40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:19.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.925+0000 7f2bd9800640 1 -- 172.21.15.31:0/1800714901 shutdown_connections 2024-09-17T05:35:19.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.925+0000 7f2bd9800640 1 -- 172.21.15.31:0/1800714901 wait complete. 2024-09-17T05:35:19.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd9800640 1 Processor -- start 2024-09-17T05:35:19.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd9800640 1 -- start start 2024-09-17T05:35:19.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd9800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bd40cdb30 0x7f2bd41575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:19.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd9800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd40d28e0 0x7f2bd40b6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:19.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd9800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bd415bea0 0x7f2bd41fac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:19.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd9800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4168fc0 con 0x7f2bd415bea0 2024-09-17T05:35:19.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd9800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4168e40 con 0x7f2bd40d28e0 2024-09-17T05:35:19.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd9800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2bd4169140 con 0x7f2bd40cdb30 2024-09-17T05:35:19.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bd415bea0 0x7f2bd41fac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:19.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bd415bea0 0x7f2bd41fac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37660/0 (socket says 172.21.15.31:37660) 2024-09-17T05:35:19.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd3400640 1 -- 172.21.15.31:0/3569687138 learned_addr learned my addr 172.21.15.31:0/3569687138 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:19.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd3400640 1 -- 172.21.15.31:0/3569687138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bd40cdb30 msgr2=0x7f2bd41575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:19.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd3400640 1 --2- 172.21.15.31:0/3569687138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bd40cdb30 0x7f2bd41575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:19.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd3400640 1 -- 172.21.15.31:0/3569687138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd40d28e0 msgr2=0x7f2bd40b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:19.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bca000640 1 --2- 172.21.15.31:0/3569687138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd40d28e0 0x7f2bd40b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:19.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd3400640 1 --2- 172.21.15.31:0/3569687138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd40d28e0 0x7f2bd40b6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:19.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd3400640 1 -- 172.21.15.31:0/3569687138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd406fd70 con 0x7f2bd415bea0 2024-09-17T05:35:19.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bca000640 1 --2- 172.21.15.31:0/3569687138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd40d28e0 0x7f2bd40b6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:19.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd3400640 1 --2- 172.21.15.31:0/3569687138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bd415bea0 0x7f2bd41fac20 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00c7c0 tx=0x7f2bcc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:19.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bcb400640 1 -- 172.21.15.31:0/3569687138 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc003b80 con 0x7f2bd415bea0 2024-09-17T05:35:19.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bcb400640 1 -- 172.21.15.31:0/3569687138 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2bcc003d20 con 0x7f2bd415bea0 2024-09-17T05:35:19.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd9800640 1 -- 172.21.15.31:0/3569687138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd41fba30 con 0x7f2bd415bea0 2024-09-17T05:35:19.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bcb400640 1 -- 172.21.15.31:0/3569687138 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc00aab0 con 0x7f2bd415bea0 2024-09-17T05:35:19.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd9800640 1 -- 172.21.15.31:0/3569687138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd406f290 con 0x7f2bd415bea0 2024-09-17T05:35:19.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.929+0000 7f2bd9800640 1 -- 172.21.15.31:0/3569687138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bd40cc9d0 con 0x7f2bd415bea0 2024-09-17T05:35:19.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.933+0000 7f2bcb400640 1 -- 172.21.15.31:0/3569687138 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f2bcc00ac50 con 0x7f2bd415bea0 2024-09-17T05:35:19.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.933+0000 7f2bcb400640 1 --2- 172.21.15.31:0/3569687138 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2bb0073830 0x7f2bb0075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:19.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.933+0000 7f2bcb400640 1 -- 172.21.15.31:0/3569687138 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f2bcc094d10 con 0x7f2bd415bea0 2024-09-17T05:35:19.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.933+0000 7f2bd2a00640 1 --2- 172.21.15.31:0/3569687138 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2bb0073830 0x7f2bb0075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:19.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.933+0000 7f2bd2a00640 1 --2- 172.21.15.31:0/3569687138 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2bb0073830 0x7f2bb0075cf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40af000 tx=0x7f2bc40195d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:19.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:19.937+0000 7f2bcb400640 1 -- 172.21.15.31:0/3569687138 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2bcc05f350 con 0x7f2bd415bea0 2024-09-17T05:35:20.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.133+0000 7f2bd9800640 1 -- 172.21.15.31:0/3569687138 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f2bd40b7820 con 0x7f2bb0073830 2024-09-17T05:35:20.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.137+0000 7f2bcb400640 1 -- 172.21.15.31:0/3569687138 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f2bd40b7820 con 0x7f2bb0073830 2024-09-17T05:35:20.138 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:35:20.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:20.139 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephfs" 2024-09-17T05:35:20.139 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:20.139 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:35:20.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.137+0000 7f2bd9800640 1 -- 172.21.15.31:0/3569687138 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2bb0073830 msgr2=0x7f2bb0075cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:20.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.137+0000 7f2bd9800640 1 --2- 172.21.15.31:0/3569687138 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2bb0073830 0x7f2bb0075cf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40af000 tx=0x7f2bc40195d0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.137+0000 7f2bd9800640 1 -- 172.21.15.31:0/3569687138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bd415bea0 msgr2=0x7f2bd41fac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:20.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.137+0000 7f2bd9800640 1 --2- 172.21.15.31:0/3569687138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bd415bea0 0x7f2bd41fac20 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00c7c0 tx=0x7f2bcc00cc80 comp rx=0 tx=0).stop 2024-09-17T05:35:20.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.137+0000 7f2bd9800640 1 -- 172.21.15.31:0/3569687138 shutdown_connections 2024-09-17T05:35:20.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.137+0000 7f2bd9800640 1 --2- 172.21.15.31:0/3569687138 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2bb0073830 0x7f2bb0075cf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.137+0000 7f2bd9800640 1 --2- 172.21.15.31:0/3569687138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2bd415bea0 0x7f2bd41fac20 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.137+0000 7f2bd9800640 1 --2- 172.21.15.31:0/3569687138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd40d28e0 0x7f2bd40b6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.137+0000 7f2bd9800640 1 --2- 172.21.15.31:0/3569687138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bd40cdb30 0x7f2bd41575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.137+0000 7f2bd9800640 1 -- 172.21.15.31:0/3569687138 >> 172.21.15.31:0/3569687138 conn(0x7f2bd40d1dc0 msgr2=0x7f2bd4158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:20.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.137+0000 7f2bd9800640 1 -- 172.21.15.31:0/3569687138 shutdown_connections 2024-09-17T05:35:20.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.137+0000 7f2bd9800640 1 -- 172.21.15.31:0/3569687138 wait complete. 2024-09-17T05:35:20.162 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:35:20.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.309+0000 7f3fad000640 1 -- 172.21.15.31:0/2829711481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa80b2d80 msgr2=0x7f3fa80d0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:20.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.309+0000 7f3fad000640 1 --2- 172.21.15.31:0/2829711481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa80b2d80 0x7f3fa80d0840 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f3fa806d870 tx=0x7f3f9001f0b0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.309+0000 7f3fad000640 1 -- 172.21.15.31:0/2829711481 shutdown_connections 2024-09-17T05:35:20.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.309+0000 7f3fad000640 1 --2- 172.21.15.31:0/2829711481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa80b2d80 0x7f3fa80d0840 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.309+0000 7f3fad000640 1 --2- 172.21.15.31:0/2829711481 >> v2:172.21.15.155:3300/0 conn(0x7f3fa80cff20 0x7f3fa80d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.309+0000 7f3fad000640 1 -- 172.21.15.31:0/2829711481 >> 172.21.15.31:0/2829711481 conn(0x7f3fa80d1dc0 msgr2=0x7f3fa80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:20.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.309+0000 7f3fad000640 1 -- 172.21.15.31:0/2829711481 shutdown_connections 2024-09-17T05:35:20.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.309+0000 7f3fad000640 1 -- 172.21.15.31:0/2829711481 wait complete. 2024-09-17T05:35:20.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.309+0000 7f3fad000640 1 Processor -- start 2024-09-17T05:35:20.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fad000640 1 -- start start 2024-09-17T05:35:20.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fad000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa80b14c0 0x7f3fa81f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:20.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fad000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa80b2d80 0x7f3fa81552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:20.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fad000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa80cff20 0x7f3fa80ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:20.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fad000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa80af810 con 0x7f3fa80cff20 2024-09-17T05:35:20.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fad000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa80af690 con 0x7f3fa80b2d80 2024-09-17T05:35:20.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fad000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa80af990 con 0x7f3fa80b14c0 2024-09-17T05:35:20.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fa6800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa80cff20 0x7f3fa80ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:20.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fa6800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa80cff20 0x7f3fa80ce410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37678/0 (socket says 172.21.15.31:37678) 2024-09-17T05:35:20.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fa6800640 1 -- 172.21.15.31:0/3788024625 learned_addr learned my addr 172.21.15.31:0/3788024625 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:20.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3f9fe00640 1 --2- 172.21.15.31:0/3788024625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa80b2d80 0x7f3fa81552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:20.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fa5e00640 1 --2- 172.21.15.31:0/3788024625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa80b14c0 0x7f3fa81f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:20.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fa6800640 1 -- 172.21.15.31:0/3788024625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa80b14c0 msgr2=0x7f3fa81f2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:20.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fa6800640 1 --2- 172.21.15.31:0/3788024625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa80b14c0 0x7f3fa81f2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fa6800640 1 -- 172.21.15.31:0/3788024625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa80b2d80 msgr2=0x7f3fa81552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:20.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fa6800640 1 --2- 172.21.15.31:0/3788024625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa80b2d80 0x7f3fa81552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fa6800640 1 -- 172.21.15.31:0/3788024625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa81f3440 con 0x7f3fa80cff20 2024-09-17T05:35:20.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3f9fe00640 1 --2- 172.21.15.31:0/3788024625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa80b2d80 0x7f3fa81552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:20.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fa5e00640 1 --2- 172.21.15.31:0/3788024625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa80b14c0 0x7f3fa81f2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:20.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fa6800640 1 --2- 172.21.15.31:0/3788024625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa80cff20 0x7f3fa80ce410 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000c770 tx=0x7f3fa000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:20.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3f9e000640 1 -- 172.21.15.31:0/3788024625 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0017070 con 0x7f3fa80cff20 2024-09-17T05:35:20.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3f9e000640 1 -- 172.21.15.31:0/3788024625 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3fa0005070 con 0x7f3fa80cff20 2024-09-17T05:35:20.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3f9e000640 1 -- 172.21.15.31:0/3788024625 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa00054c0 con 0x7f3fa80cff20 2024-09-17T05:35:20.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fad000640 1 -- 172.21.15.31:0/3788024625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa80c90e0 con 0x7f3fa80cff20 2024-09-17T05:35:20.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fad000640 1 -- 172.21.15.31:0/3788024625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa80c96a0 con 0x7f3fa80cff20 2024-09-17T05:35:20.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.313+0000 7f3fad000640 1 -- 172.21.15.31:0/3788024625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa80b1950 con 0x7f3fa80cff20 2024-09-17T05:35:20.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.317+0000 7f3f9e000640 1 -- 172.21.15.31:0/3788024625 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f3fa001a070 con 0x7f3fa80cff20 2024-09-17T05:35:20.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.317+0000 7f3f9e000640 1 --2- 172.21.15.31:0/3788024625 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3f84073860 0x7f3f84075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:20.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.317+0000 7f3f9e000640 1 -- 172.21.15.31:0/3788024625 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f3fa0094470 con 0x7f3fa80cff20 2024-09-17T05:35:20.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.317+0000 7f3fa5e00640 1 --2- 172.21.15.31:0/3788024625 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3f84073860 0x7f3f84075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:20.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.317+0000 7f3fa5e00640 1 --2- 172.21.15.31:0/3788024625 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3f84073860 0x7f3f84075d20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3f98005fd0 tx=0x7f3f98005dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:20.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.321+0000 7f3f9e000640 1 -- 172.21.15.31:0/3788024625 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f3fa005eb00 con 0x7f3fa80cff20 2024-09-17T05:35:20.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.497+0000 7f3fad000640 1 -- 172.21.15.31:0/3788024625 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f3fa8155830 con 0x7f3fa80cff20 2024-09-17T05:35:20.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.497+0000 7f3f9e000640 1 -- 172.21.15.31:0/3788024625 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7f3fa005e400 con 0x7f3fa80cff20 2024-09-17T05:35:20.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.501+0000 7f3fad000640 1 -- 172.21.15.31:0/3788024625 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3f84073860 msgr2=0x7f3f84075d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:20.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.501+0000 7f3fad000640 1 --2- 172.21.15.31:0/3788024625 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3f84073860 0x7f3f84075d20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3f98005fd0 tx=0x7f3f98005dc0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.501+0000 7f3fad000640 1 -- 172.21.15.31:0/3788024625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa80cff20 msgr2=0x7f3fa80ce410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:20.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.501+0000 7f3fad000640 1 --2- 172.21.15.31:0/3788024625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa80cff20 0x7f3fa80ce410 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000c770 tx=0x7f3fa000cc30 comp rx=0 tx=0).stop 2024-09-17T05:35:20.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.501+0000 7f3fad000640 1 -- 172.21.15.31:0/3788024625 shutdown_connections 2024-09-17T05:35:20.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.501+0000 7f3fad000640 1 --2- 172.21.15.31:0/3788024625 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3f84073860 0x7f3f84075d20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.501+0000 7f3fad000640 1 --2- 172.21.15.31:0/3788024625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3fa80cff20 0x7f3fa80ce410 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.501+0000 7f3fad000640 1 --2- 172.21.15.31:0/3788024625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3fa80b2d80 0x7f3fa81552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.501+0000 7f3fad000640 1 --2- 172.21.15.31:0/3788024625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3fa80b14c0 0x7f3fa81f2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.501+0000 7f3fad000640 1 -- 172.21.15.31:0/3788024625 >> 172.21.15.31:0/3788024625 conn(0x7f3fa80d1dc0 msgr2=0x7f3fa8070a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:20.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.501+0000 7f3fad000640 1 -- 172.21.15.31:0/3788024625 shutdown_connections 2024-09-17T05:35:20.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.501+0000 7f3fad000640 1 -- 172.21.15.31:0/3788024625 wait complete. 2024-09-17T05:35:20.522 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create non_existent_subvolume subvolume_1 2024-09-17T05:35:20.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.669+0000 7fea83000640 1 -- 172.21.15.31:0/3018749757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea7c0b0450 msgr2=0x7fea7c160490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:20.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.669+0000 7fea83000640 1 --2- 172.21.15.31:0/3018749757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea7c0b0450 0x7fea7c160490 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fea74009bc0 tx=0x7fea7401f2d0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.669+0000 7fea83000640 1 -- 172.21.15.31:0/3018749757 shutdown_connections 2024-09-17T05:35:20.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.669+0000 7fea83000640 1 --2- 172.21.15.31:0/3018749757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea7c0b0450 0x7fea7c160490 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.669+0000 7fea83000640 1 -- 172.21.15.31:0/3018749757 >> 172.21.15.31:0/3018749757 conn(0x7fea7c0d1dc0 msgr2=0x7fea7c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:20.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.669+0000 7fea83000640 1 -- 172.21.15.31:0/3018749757 shutdown_connections 2024-09-17T05:35:20.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.669+0000 7fea83000640 1 -- 172.21.15.31:0/3018749757 wait complete. 2024-09-17T05:35:20.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea83000640 1 Processor -- start 2024-09-17T05:35:20.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea83000640 1 -- start start 2024-09-17T05:35:20.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea83000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea7c0b0450 0x7fea7c14d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:20.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea83000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea7c0b2d80 0x7fea7c0cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:20.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea83000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea7c0cff20 0x7fea7c0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:20.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea83000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c167040 con 0x7fea7c0b0450 2024-09-17T05:35:20.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea83000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c1671c0 con 0x7fea7c0cff20 2024-09-17T05:35:20.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea83000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fea7c167340 con 0x7fea7c0b2d80 2024-09-17T05:35:20.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea7be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea7c0b0450 0x7fea7c14d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:20.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea7be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea7c0b0450 0x7fea7c14d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37680/0 (socket says 172.21.15.31:37680) 2024-09-17T05:35:20.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea7be00640 1 -- 172.21.15.31:0/3215528835 learned_addr learned my addr 172.21.15.31:0/3215528835 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:20.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea73400640 1 --2- 172.21.15.31:0/3215528835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea7c0b2d80 0x7fea7c0cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:20.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea81000640 1 --2- 172.21.15.31:0/3215528835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea7c0cff20 0x7fea7c0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:20.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea7be00640 1 -- 172.21.15.31:0/3215528835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea7c0b2d80 msgr2=0x7fea7c0cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:20.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea7be00640 1 --2- 172.21.15.31:0/3215528835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea7c0b2d80 0x7fea7c0cb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea7be00640 1 -- 172.21.15.31:0/3215528835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea7c0cff20 msgr2=0x7fea7c0cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:20.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea7be00640 1 --2- 172.21.15.31:0/3215528835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea7c0cff20 0x7fea7c0cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:20.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea7be00640 1 -- 172.21.15.31:0/3215528835 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7c0cb180 con 0x7fea7c0b0450 2024-09-17T05:35:20.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea81000640 1 --2- 172.21.15.31:0/3215528835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea7c0cff20 0x7fea7c0cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:20.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea7be00640 1 --2- 172.21.15.31:0/3215528835 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea7c0b0450 0x7fea7c14d0b0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00c460 tx=0x7fea6c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:20.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea78c00640 1 -- 172.21.15.31:0/3215528835 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c0052d0 con 0x7fea7c0b0450 2024-09-17T05:35:20.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea78c00640 1 -- 172.21.15.31:0/3215528835 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea6c005470 con 0x7fea7c0b0450 2024-09-17T05:35:20.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea83000640 1 -- 172.21.15.31:0/3215528835 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea7c15ff30 con 0x7fea7c0b0450 2024-09-17T05:35:20.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea78c00640 1 -- 172.21.15.31:0/3215528835 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c012870 con 0x7fea7c0b0450 2024-09-17T05:35:20.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.673+0000 7fea83000640 1 -- 172.21.15.31:0/3215528835 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea7c1604f0 con 0x7fea7c0b0450 2024-09-17T05:35:20.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.677+0000 7fea83000640 1 -- 172.21.15.31:0/3215528835 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea7c0d0300 con 0x7fea7c0b0450 2024-09-17T05:35:20.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.677+0000 7fea78c00640 1 -- 172.21.15.31:0/3215528835 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fea6c012a10 con 0x7fea7c0b0450 2024-09-17T05:35:20.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.677+0000 7fea78c00640 1 --2- 172.21.15.31:0/3215528835 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fea58073860 0x7fea58075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:20.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.677+0000 7fea78c00640 1 -- 172.21.15.31:0/3215528835 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7fea6c094960 con 0x7fea7c0b0450 2024-09-17T05:35:20.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.677+0000 7fea73400640 1 --2- 172.21.15.31:0/3215528835 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fea58073860 0x7fea58075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:20.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.677+0000 7fea73400640 1 --2- 172.21.15.31:0/3215528835 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fea58073860 0x7fea58075d20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0b7c30 tx=0x7fea64009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:20.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.681+0000 7fea78c00640 1 -- 172.21.15.31:0/3215528835 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fea6c05ef60 con 0x7fea7c0b0450 2024-09-17T05:35:20.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.889+0000 7fea83000640 1 -- 172.21.15.31:0/3215528835 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7fea7c071090 con 0x7fea58073860 2024-09-17T05:35:20.893 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:20.893+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:20.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:20.893+0000 7fea78c00640 1 -- 172.21.15.31:0/3215528835 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fea7c071090 con 0x7fea58073860 2024-09-17T05:35:20.893 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:20.903 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:20.904 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm non_existent_subvolume subvolume_1 2024-09-17T05:35:21.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.053+0000 7f12aa400640 1 -- 172.21.15.31:0/3508753121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1288005920 msgr2=0x7f1288005da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:21.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.053+0000 7f12aa400640 1 --2- 172.21.15.31:0/3508753121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1288005920 0x7f1288005da0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f128c009b60 tx=0x7f128c01d270 comp rx=0 tx=0).stop 2024-09-17T05:35:21.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.053+0000 7f12aa400640 1 -- 172.21.15.31:0/3508753121 shutdown_connections 2024-09-17T05:35:21.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.053+0000 7f12aa400640 1 --2- 172.21.15.31:0/3508753121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1288005920 0x7f1288005da0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:21.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.053+0000 7f12aa400640 1 -- 172.21.15.31:0/3508753121 >> 172.21.15.31:0/3508753121 conn(0x7f12a40b18f0 msgr2=0x7f12a40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:21.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.053+0000 7f12aa400640 1 -- 172.21.15.31:0/3508753121 shutdown_connections 2024-09-17T05:35:21.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.053+0000 7f12aa400640 1 -- 172.21.15.31:0/3508753121 wait complete. 2024-09-17T05:35:21.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.053+0000 7f12aa400640 1 Processor -- start 2024-09-17T05:35:21.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.053+0000 7f12aa400640 1 -- start start 2024-09-17T05:35:21.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.053+0000 7f12aa400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1288005920 0x7f12a415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:21.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.053+0000 7f12aa400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12a415b030 0x7f12a415b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:21.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.053+0000 7f12aa400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12a41544c0 0x7f12a4154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:21.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.053+0000 7f12aa400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f12a40ced70 con 0x7f12a41544c0 2024-09-17T05:35:21.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.053+0000 7f12aa400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f12a40cebf0 con 0x7f12a415b030 2024-09-17T05:35:21.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.053+0000 7f12aa400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f12a40ceef0 con 0x7f1288005920 2024-09-17T05:35:21.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.057+0000 7f12a3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12a41544c0 0x7f12a4154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:21.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.057+0000 7f12a3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12a41544c0 0x7f12a4154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37688/0 (socket says 172.21.15.31:37688) 2024-09-17T05:35:21.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.057+0000 7f12a3e00640 1 -- 172.21.15.31:0/920775585 learned_addr learned my addr 172.21.15.31:0/920775585 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:21.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.057+0000 7f12a3400640 1 --2- 172.21.15.31:0/920775585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1288005920 0x7f12a415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:21.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.057+0000 7f129be00640 1 --2- 172.21.15.31:0/920775585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12a415b030 0x7f12a415b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:21.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.057+0000 7f12a3e00640 1 -- 172.21.15.31:0/920775585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1288005920 msgr2=0x7f12a415a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:21.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.057+0000 7f12a3e00640 1 --2- 172.21.15.31:0/920775585 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1288005920 0x7f12a415a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:21.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.057+0000 7f12a3e00640 1 -- 172.21.15.31:0/920775585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12a415b030 msgr2=0x7f12a415b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:21.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.057+0000 7f12a3e00640 1 --2- 172.21.15.31:0/920775585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12a415b030 0x7f12a415b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:21.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.057+0000 7f12a3e00640 1 -- 172.21.15.31:0/920775585 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a415bab0 con 0x7f12a41544c0 2024-09-17T05:35:21.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.057+0000 7f12a3e00640 1 --2- 172.21.15.31:0/920775585 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12a41544c0 0x7f12a4154940 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f12a40b2860 tx=0x7f129c0019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:21.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.057+0000 7f129b400640 1 -- 172.21.15.31:0/920775585 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c015020 con 0x7f12a41544c0 2024-09-17T05:35:21.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.057+0000 7f129b400640 1 -- 172.21.15.31:0/920775585 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f129c011960 con 0x7f12a41544c0 2024-09-17T05:35:21.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.057+0000 7f12aa400640 1 -- 172.21.15.31:0/920775585 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a415bd90 con 0x7f12a41544c0 2024-09-17T05:35:21.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.057+0000 7f129b400640 1 -- 172.21.15.31:0/920775585 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c011d90 con 0x7f12a41544c0 2024-09-17T05:35:21.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.057+0000 7f12aa400640 1 -- 172.21.15.31:0/920775585 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a415c350 con 0x7f12a41544c0 2024-09-17T05:35:21.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.057+0000 7f12aa400640 1 -- 172.21.15.31:0/920775585 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a4069410 con 0x7f12a41544c0 2024-09-17T05:35:21.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.057+0000 7f129b400640 1 -- 172.21.15.31:0/920775585 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f129c018020 con 0x7f12a41544c0 2024-09-17T05:35:21.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.061+0000 7f129b400640 1 --2- 172.21.15.31:0/920775585 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1280073860 0x7f1280075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:21.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.061+0000 7f129b400640 1 -- 172.21.15.31:0/920775585 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f129c095620 con 0x7f12a41544c0 2024-09-17T05:35:21.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.061+0000 7f12a3400640 1 --2- 172.21.15.31:0/920775585 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1280073860 0x7f1280075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:21.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.061+0000 7f12a3400640 1 --2- 172.21.15.31:0/920775585 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1280073860 0x7f1280075d20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1294000fc0 tx=0x7f1294001590 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:21.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.065+0000 7f129b400640 1 -- 172.21.15.31:0/920775585 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f129c01f030 con 0x7f12a41544c0 2024-09-17T05:35:21.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.265+0000 7f12aa400640 1 -- 172.21.15.31:0/920775585 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7f12a41e6050 con 0x7f1280073860 2024-09-17T05:35:21.269 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:21.269+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:21.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.269+0000 7f129b400640 1 -- 172.21.15.31:0/920775585 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f12a41e6050 con 0x7f1280073860 2024-09-17T05:35:21.270 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:21.278 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:21.279 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath non_existent_subvolume subvolume_1 2024-09-17T05:35:21.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.425+0000 7fb64d600640 1 -- 172.21.15.31:0/1693700187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb64815dae0 msgr2=0x7fb6480acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:21.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.425+0000 7fb64d600640 1 --2- 172.21.15.31:0/1693700187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb64815dae0 0x7fb6480acd40 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fb63800a950 tx=0x7fb63801da50 comp rx=0 tx=0).stop 2024-09-17T05:35:21.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb64d600640 1 -- 172.21.15.31:0/1693700187 shutdown_connections 2024-09-17T05:35:21.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb64d600640 1 --2- 172.21.15.31:0/1693700187 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb64815dae0 0x7fb6480acd40 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:21.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb64d600640 1 -- 172.21.15.31:0/1693700187 >> 172.21.15.31:0/1693700187 conn(0x7fb6480b18f0 msgr2=0x7fb6480b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:21.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb64d600640 1 -- 172.21.15.31:0/1693700187 shutdown_connections 2024-09-17T05:35:21.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb64d600640 1 -- 172.21.15.31:0/1693700187 wait complete. 2024-09-17T05:35:21.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb64d600640 1 Processor -- start 2024-09-17T05:35:21.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb64d600640 1 -- start start 2024-09-17T05:35:21.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb64d600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6480b49e0 0x7fb64809d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:21.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb64d600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6480cd100 0x7fb648157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:21.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb64d600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb64815dae0 0x7fb648158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:21.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb64d600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb6481685d0 con 0x7fb64815dae0 2024-09-17T05:35:21.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb64d600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb648168450 con 0x7fb6480cd100 2024-09-17T05:35:21.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb64d600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb648168750 con 0x7fb6480b49e0 2024-09-17T05:35:21.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb647400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb64815dae0 0x7fb648158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:21.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb647400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb64815dae0 0x7fb648158080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37696/0 (socket says 172.21.15.31:37696) 2024-09-17T05:35:21.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb647400640 1 -- 172.21.15.31:0/4222577977 learned_addr learned my addr 172.21.15.31:0/4222577977 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:21.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb63fe00640 1 --2- 172.21.15.31:0/4222577977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6480cd100 0x7fb648157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:21.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb646a00640 1 --2- 172.21.15.31:0/4222577977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6480b49e0 0x7fb64809d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:21.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb647400640 1 -- 172.21.15.31:0/4222577977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6480b49e0 msgr2=0x7fb64809d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:21.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb647400640 1 --2- 172.21.15.31:0/4222577977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6480b49e0 0x7fb64809d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:21.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb647400640 1 -- 172.21.15.31:0/4222577977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6480cd100 msgr2=0x7fb648157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:21.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb647400640 1 --2- 172.21.15.31:0/4222577977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6480cd100 0x7fb648157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:21.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb647400640 1 -- 172.21.15.31:0/4222577977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6481586e0 con 0x7fb64815dae0 2024-09-17T05:35:21.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.429+0000 7fb647400640 1 --2- 172.21.15.31:0/4222577977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb64815dae0 0x7fb648158080 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fb64000cbc0 tx=0x7fb64000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:21.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.433+0000 7fb63ea00640 1 -- 172.21.15.31:0/4222577977 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb640016020 con 0x7fb64815dae0 2024-09-17T05:35:21.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.433+0000 7fb63ea00640 1 -- 172.21.15.31:0/4222577977 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb64000ab40 con 0x7fb64815dae0 2024-09-17T05:35:21.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.433+0000 7fb64d600640 1 -- 172.21.15.31:0/4222577977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6481589c0 con 0x7fb64815dae0 2024-09-17T05:35:21.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.433+0000 7fb63ea00640 1 -- 172.21.15.31:0/4222577977 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb640012420 con 0x7fb64815dae0 2024-09-17T05:35:21.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.433+0000 7fb64d600640 1 -- 172.21.15.31:0/4222577977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb648158f80 con 0x7fb64815dae0 2024-09-17T05:35:21.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.433+0000 7fb64d600640 1 -- 172.21.15.31:0/4222577977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb648069410 con 0x7fb64815dae0 2024-09-17T05:35:21.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.433+0000 7fb63ea00640 1 -- 172.21.15.31:0/4222577977 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fb640019020 con 0x7fb64815dae0 2024-09-17T05:35:21.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.433+0000 7fb63ea00640 1 --2- 172.21.15.31:0/4222577977 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb624073830 0x7fb624075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:21.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.433+0000 7fb63ea00640 1 -- 172.21.15.31:0/4222577977 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7fb640094de0 con 0x7fb64815dae0 2024-09-17T05:35:21.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.433+0000 7fb646a00640 1 --2- 172.21.15.31:0/4222577977 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb624073830 0x7fb624075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:21.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.437+0000 7fb646a00640 1 --2- 172.21.15.31:0/4222577977 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb624073830 0x7fb624075cf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb6380b0000 tx=0x7fb63801c290 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:21.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.437+0000 7fb63ea00640 1 -- 172.21.15.31:0/4222577977 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb64009b080 con 0x7fb64815dae0 2024-09-17T05:35:21.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.641+0000 7fb64d600640 1 -- 172.21.15.31:0/4222577977 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7fb6481564e0 con 0x7fb624073830 2024-09-17T05:35:21.644 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:21.641+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:21.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.641+0000 7fb63ea00640 1 -- 172.21.15.31:0/4222577977 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fb6481564e0 con 0x7fb624073830 2024-09-17T05:35:21.645 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:21.654 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:21.654 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info non_existent_subvolume subvolume_1 2024-09-17T05:35:21.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.801+0000 7f3f27e00640 1 -- 172.21.15.31:0/1088029961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f20071060 msgr2=0x7f3f200afa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:21.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.801+0000 7f3f27e00640 1 --2- 172.21.15.31:0/1088029961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f20071060 0x7f3f200afa10 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f3f14009900 tx=0x7f3f1401c7c0 comp rx=0 tx=0).stop 2024-09-17T05:35:21.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.801+0000 7f3f27e00640 1 -- 172.21.15.31:0/1088029961 shutdown_connections 2024-09-17T05:35:21.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.801+0000 7f3f27e00640 1 --2- 172.21.15.31:0/1088029961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f20071060 0x7f3f200afa10 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:21.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.801+0000 7f3f27e00640 1 -- 172.21.15.31:0/1088029961 >> 172.21.15.31:0/1088029961 conn(0x7f3f200b2060 msgr2=0x7f3f200b2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:21.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.801+0000 7f3f27e00640 1 -- 172.21.15.31:0/1088029961 shutdown_connections 2024-09-17T05:35:21.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.801+0000 7f3f27e00640 1 -- 172.21.15.31:0/1088029961 wait complete. 2024-09-17T05:35:21.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f27e00640 1 Processor -- start 2024-09-17T05:35:21.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f27e00640 1 -- start start 2024-09-17T05:35:21.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f27e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f20071060 0x7f3f20149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:21.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f27e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f200cd650 0x7f3f2015d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:21.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f27e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f2015e910 0x7f3f2015d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:21.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f27e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3f20068ee0 con 0x7f3f2015e910 2024-09-17T05:35:21.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f27e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3f20068d60 con 0x7f3f20071060 2024-09-17T05:35:21.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f27e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3f2015c580 con 0x7f3f200cd650 2024-09-17T05:35:21.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f25e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f2015e910 0x7f3f2015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:21.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f25e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f2015e910 0x7f3f2015d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37700/0 (socket says 172.21.15.31:37700) 2024-09-17T05:35:21.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f25e00640 1 -- 172.21.15.31:0/4187630024 learned_addr learned my addr 172.21.15.31:0/4187630024 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:21.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f25400640 1 --2- 172.21.15.31:0/4187630024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f20071060 0x7f3f20149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:21.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f24a00640 1 --2- 172.21.15.31:0/4187630024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f200cd650 0x7f3f2015d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:21.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f25e00640 1 -- 172.21.15.31:0/4187630024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f200cd650 msgr2=0x7f3f2015d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:21.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f25e00640 1 --2- 172.21.15.31:0/4187630024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f200cd650 0x7f3f2015d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:21.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f25e00640 1 -- 172.21.15.31:0/4187630024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f20071060 msgr2=0x7f3f20149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:21.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f25e00640 1 --2- 172.21.15.31:0/4187630024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f20071060 0x7f3f20149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:21.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f25e00640 1 -- 172.21.15.31:0/4187630024 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2015bc50 con 0x7f3f2015e910 2024-09-17T05:35:21.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f24a00640 1 --2- 172.21.15.31:0/4187630024 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f200cd650 0x7f3f2015d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:21.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f25e00640 1 --2- 172.21.15.31:0/4187630024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f2015e910 0x7f3f2015d660 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800c790 tx=0x7f3f1800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:21.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f1d600640 1 -- 172.21.15.31:0/4187630024 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18003bd0 con 0x7f3f2015e910 2024-09-17T05:35:21.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f1d600640 1 -- 172.21.15.31:0/4187630024 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f18003d70 con 0x7f3f2015e910 2024-09-17T05:35:21.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f1d600640 1 -- 172.21.15.31:0/4187630024 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1800aa90 con 0x7f3f2015e910 2024-09-17T05:35:21.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f27e00640 1 -- 172.21.15.31:0/4187630024 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f2015bf30 con 0x7f3f2015e910 2024-09-17T05:35:21.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.805+0000 7f3f27e00640 1 -- 172.21.15.31:0/4187630024 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f2015ca10 con 0x7f3f2015e910 2024-09-17T05:35:21.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.809+0000 7f3f27e00640 1 -- 172.21.15.31:0/4187630024 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f200afa10 con 0x7f3f2015e910 2024-09-17T05:35:21.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.809+0000 7f3f1d600640 1 -- 172.21.15.31:0/4187630024 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f3f1800ac30 con 0x7f3f2015e910 2024-09-17T05:35:21.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.809+0000 7f3f1d600640 1 --2- 172.21.15.31:0/4187630024 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3f00073830 0x7f3f00075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:21.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.809+0000 7f3f1d600640 1 -- 172.21.15.31:0/4187630024 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f3f18094c90 con 0x7f3f2015e910 2024-09-17T05:35:21.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.809+0000 7f3f25400640 1 --2- 172.21.15.31:0/4187630024 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3f00073830 0x7f3f00075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:21.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.809+0000 7f3f25400640 1 --2- 172.21.15.31:0/4187630024 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3f00073830 0x7f3f00075cf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3f140ae000 tx=0x7f3f1401b000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:21.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:21.813+0000 7f3f1d600640 1 -- 172.21.15.31:0/4187630024 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f3f1805f290 con 0x7f3f2015e910 2024-09-17T05:35:22.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.017+0000 7f3f27e00640 1 -- 172.21.15.31:0/4187630024 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7f3f200b64b0 con 0x7f3f00073830 2024-09-17T05:35:22.019 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:22.017+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:22.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.017+0000 7f3f1d600640 1 -- 172.21.15.31:0/4187630024 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f3f200b64b0 con 0x7f3f00073830 2024-09-17T05:35:22.019 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:22.029 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:22.030 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume resize non_existent_subvolume subvolname_1 inf 2024-09-17T05:35:22.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.177+0000 7f1687a00640 1 -- 172.21.15.31:0/2368840404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16800aef60 msgr2=0x7f16800ae660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:22.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.177+0000 7f1687a00640 1 --2- 172.21.15.31:0/2368840404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16800aef60 0x7f16800ae660 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f166c009840 tx=0x7f166c01c6b0 comp rx=0 tx=0).stop 2024-09-17T05:35:22.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.177+0000 7f1687a00640 1 -- 172.21.15.31:0/2368840404 shutdown_connections 2024-09-17T05:35:22.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.177+0000 7f1687a00640 1 --2- 172.21.15.31:0/2368840404 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f168015e740 0x7f168015ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:22.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.177+0000 7f1687a00640 1 --2- 172.21.15.31:0/2368840404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16800aef60 0x7f16800ae660 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:22.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.177+0000 7f1687a00640 1 -- 172.21.15.31:0/2368840404 >> 172.21.15.31:0/2368840404 conn(0x7f16800cfbc0 msgr2=0x7f16800cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:22.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.177+0000 7f1687a00640 1 -- 172.21.15.31:0/2368840404 shutdown_connections 2024-09-17T05:35:22.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.177+0000 7f1687a00640 1 -- 172.21.15.31:0/2368840404 wait complete. 2024-09-17T05:35:22.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1687a00640 1 Processor -- start 2024-09-17T05:35:22.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1687a00640 1 -- start start 2024-09-17T05:35:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1687a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16800aef60 0x7f16801fae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1687a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f168015e360 0x7f1680159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1687a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f168015e740 0x7f168014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1687a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f16801680b0 con 0x7f168015e740 2024-09-17T05:35:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1687a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1680167f30 con 0x7f168015e360 2024-09-17T05:35:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1687a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1680168230 con 0x7f16800aef60 2024-09-17T05:35:22.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1685a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f168015e740 0x7f168014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1685a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f168015e740 0x7f168014acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37714/0 (socket says 172.21.15.31:37714) 2024-09-17T05:35:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1685a00640 1 -- 172.21.15.31:0/342310499 learned_addr learned my addr 172.21.15.31:0/342310499 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f167fe00640 1 --2- 172.21.15.31:0/342310499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f168015e360 0x7f1680159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1685000640 1 --2- 172.21.15.31:0/342310499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16800aef60 0x7f16801fae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1685a00640 1 -- 172.21.15.31:0/342310499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16800aef60 msgr2=0x7f16801fae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1685a00640 1 --2- 172.21.15.31:0/342310499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16800aef60 0x7f16801fae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1685a00640 1 -- 172.21.15.31:0/342310499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f168015e360 msgr2=0x7f1680159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1685a00640 1 --2- 172.21.15.31:0/342310499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f168015e360 0x7f1680159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1685a00640 1 -- 172.21.15.31:0/342310499 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16801fb4a0 con 0x7f168015e740 2024-09-17T05:35:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1685000640 1 --2- 172.21.15.31:0/342310499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16800aef60 0x7f16801fae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1685a00640 1 --2- 172.21.15.31:0/342310499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f168015e740 0x7f168014acb0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f167800ea80 tx=0x7f167800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f167cc00640 1 -- 172.21.15.31:0/342310499 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1678004b30 con 0x7f168015e740 2024-09-17T05:35:22.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f167cc00640 1 -- 172.21.15.31:0/342310499 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1678004cf0 con 0x7f168015e740 2024-09-17T05:35:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f1687a00640 1 -- 172.21.15.31:0/342310499 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16801fb780 con 0x7f168015e740 2024-09-17T05:35:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.181+0000 7f167cc00640 1 -- 172.21.15.31:0/342310499 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1678005280 con 0x7f168015e740 2024-09-17T05:35:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.185+0000 7f1687a00640 1 -- 172.21.15.31:0/342310499 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1680158420 con 0x7f168015e740 2024-09-17T05:35:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.185+0000 7f1687a00640 1 -- 172.21.15.31:0/342310499 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1680069410 con 0x7f168015e740 2024-09-17T05:35:22.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.185+0000 7f167cc00640 1 -- 172.21.15.31:0/342310499 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f1678005420 con 0x7f168015e740 2024-09-17T05:35:22.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.185+0000 7f167cc00640 1 --2- 172.21.15.31:0/342310499 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1660073830 0x7f1660075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:22.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.185+0000 7f167cc00640 1 -- 172.21.15.31:0/342310499 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f1678095ab0 con 0x7f168015e740 2024-09-17T05:35:22.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.185+0000 7f1685000640 1 --2- 172.21.15.31:0/342310499 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1660073830 0x7f1660075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:22.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.189+0000 7f1685000640 1 --2- 172.21.15.31:0/342310499 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1660073830 0x7f1660075cf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1674001ec0 tx=0x7f1674009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:22.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.189+0000 7f167cc00640 1 -- 172.21.15.31:0/342310499 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f1678060100 con 0x7f168015e740 2024-09-17T05:35:22.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.401+0000 7f1687a00640 1 -- 172.21.15.31:0/342310499 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume resize", "vol_name": "non_existent_subvolume", "sub_name": "subvolname_1", "new_size": "inf", "target": ["mon-mgr", ""]}) -- 0x7f16800d0850 con 0x7f1660073830 2024-09-17T05:35:22.405 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:22.401+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:22.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.401+0000 7f167cc00640 1 -- 172.21.15.31:0/342310499 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f16800d0850 con 0x7f1660073830 2024-09-17T05:35:22.405 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:22.413 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:22.413 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume pin non_existent_subvolume subvolname_1 export 1 2024-09-17T05:35:22.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.565+0000 7f8519000640 1 -- 172.21.15.31:0/2630222701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84f8004810 msgr2=0x7f84f8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:22.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.565+0000 7f8519000640 1 --2- 172.21.15.31:0/2630222701 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84f8004810 0x7f84f8004c90 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f84fc001770 tx=0x7f84fc01c860 comp rx=0 tx=0).stop 2024-09-17T05:35:22.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.565+0000 7f8512800640 1 -- 172.21.15.31:0/2630222701 reap_dead start 2024-09-17T05:35:22.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.565+0000 7f8519000640 1 -- 172.21.15.31:0/2630222701 shutdown_connections 2024-09-17T05:35:22.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.565+0000 7f8519000640 1 -- 172.21.15.31:0/2630222701 >> 172.21.15.31:0/2630222701 conn(0x7f85140d1da0 msgr2=0x7f85140d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:22.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.565+0000 7f8519000640 1 -- 172.21.15.31:0/2630222701 shutdown_connections 2024-09-17T05:35:22.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.565+0000 7f8519000640 1 -- 172.21.15.31:0/2630222701 wait complete. 2024-09-17T05:35:22.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.565+0000 7f8519000640 1 Processor -- start 2024-09-17T05:35:22.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.565+0000 7f8519000640 1 -- start start 2024-09-17T05:35:22.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f8519000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84f8004810 0x7f85141f96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:22.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f8519000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8514147d40 0x7f85141f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:22.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f8519000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85141f5bc0 0x7f851414b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:22.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f8519000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8514167d20 con 0x7f8514147d40 2024-09-17T05:35:22.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f8519000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8514167ba0 con 0x7f85141f5bc0 2024-09-17T05:35:22.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f8519000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8514167ea0 con 0x7f84f8004810 2024-09-17T05:35:22.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f850be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8514147d40 0x7f85141f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:22.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f850be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8514147d40 0x7f85141f5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37718/0 (socket says 172.21.15.31:37718) 2024-09-17T05:35:22.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f850be00640 1 -- 172.21.15.31:0/3984271590 learned_addr learned my addr 172.21.15.31:0/3984271590 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:22.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f8511e00640 1 --2- 172.21.15.31:0/3984271590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84f8004810 0x7f85141f96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:22.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f8512800640 1 --2- 172.21.15.31:0/3984271590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85141f5bc0 0x7f851414b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:22.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f850be00640 1 -- 172.21.15.31:0/3984271590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84f8004810 msgr2=0x7f85141f96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:22.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f850be00640 1 --2- 172.21.15.31:0/3984271590 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84f8004810 0x7f85141f96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:22.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f850be00640 1 -- 172.21.15.31:0/3984271590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85141f5bc0 msgr2=0x7f851414b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:22.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f850be00640 1 --2- 172.21.15.31:0/3984271590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85141f5bc0 0x7f851414b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:22.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f850be00640 1 -- 172.21.15.31:0/3984271590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85141f8c50 con 0x7f8514147d40 2024-09-17T05:35:22.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f850be00640 1 --2- 172.21.15.31:0/3984271590 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8514147d40 0x7f85141f5680 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f84fc01cd40 tx=0x7f84fc006600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:22.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f850a000640 1 -- 172.21.15.31:0/3984271590 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc003800 con 0x7f8514147d40 2024-09-17T05:35:22.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f850a000640 1 -- 172.21.15.31:0/3984271590 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84fc0b6030 con 0x7f8514147d40 2024-09-17T05:35:22.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f8519000640 1 -- 172.21.15.31:0/3984271590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85141f6170 con 0x7f8514147d40 2024-09-17T05:35:22.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f850a000640 1 -- 172.21.15.31:0/3984271590 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc003cd0 con 0x7f8514147d40 2024-09-17T05:35:22.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f8519000640 1 -- 172.21.15.31:0/3984271590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85141f8ef0 con 0x7f8514147d40 2024-09-17T05:35:22.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f8519000640 1 -- 172.21.15.31:0/3984271590 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85140ce700 con 0x7f8514147d40 2024-09-17T05:35:22.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.569+0000 7f850a000640 1 -- 172.21.15.31:0/3984271590 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f84fc0a7430 con 0x7f8514147d40 2024-09-17T05:35:22.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.573+0000 7f850a000640 1 --2- 172.21.15.31:0/3984271590 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f84f0073860 0x7f84f0075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:22.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.573+0000 7f850a000640 1 -- 172.21.15.31:0/3984271590 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f84fc12f0c0 con 0x7f8514147d40 2024-09-17T05:35:22.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.573+0000 7f8511e00640 1 --2- 172.21.15.31:0/3984271590 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f84f0073860 0x7f84f0075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:22.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.573+0000 7f8511e00640 1 --2- 172.21.15.31:0/3984271590 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f84f0073860 0x7f84f0075d20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8504001870 tx=0x7f8504006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:22.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.577+0000 7f850a000640 1 -- 172.21.15.31:0/3984271590 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f84fc016570 con 0x7f8514147d40 2024-09-17T05:35:22.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.785+0000 7f8519000640 1 -- 172.21.15.31:0/3984271590 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume pin", "vol_name": "non_existent_subvolume", "sub_name": "subvolname_1", "pin_type": "export", "pin_setting": "1", "target": ["mon-mgr", ""]}) -- 0x7f85141512e0 con 0x7f84f0073860 2024-09-17T05:35:22.789 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:22.789+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:22.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.789+0000 7f850a000640 1 -- 172.21.15.31:0/3984271590 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f85141512e0 con 0x7f84f0073860 2024-09-17T05:35:22.790 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:22.799 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:22.799 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls non_existent_subvolume 2024-09-17T05:35:22.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd6a200640 1 -- 172.21.15.31:0/4264542960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd640d20f0 msgr2=0x7fcd640cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:22.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd6a200640 1 --2- 172.21.15.31:0/4264542960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd640d20f0 0x7fcd640cc620 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009bc0 tx=0x7fcd5c01cba0 comp rx=0 tx=0).stop 2024-09-17T05:35:22.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd6a200640 1 -- 172.21.15.31:0/4264542960 shutdown_connections 2024-09-17T05:35:22.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd6a200640 1 --2- 172.21.15.31:0/4264542960 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd640d20f0 0x7fcd640cc620 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:22.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd6a200640 1 --2- 172.21.15.31:0/4264542960 >> v2:172.21.15.155:3300/0 conn(0x7fcd640b0d10 0x7fcd640d1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:22.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd6a200640 1 -- 172.21.15.31:0/4264542960 >> 172.21.15.31:0/4264542960 conn(0x7fcd6409aa10 msgr2=0x7fcd6409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:22.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd6a200640 1 -- 172.21.15.31:0/4264542960 shutdown_connections 2024-09-17T05:35:22.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd6a200640 1 -- 172.21.15.31:0/4264542960 wait complete. 2024-09-17T05:35:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd6a200640 1 Processor -- start 2024-09-17T05:35:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd6a200640 1 -- start start 2024-09-17T05:35:22.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd6a200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd640b0d10 0x7fcd6415ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:22.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd6a200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd640d20f0 0x7fcd64150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:22.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd6a200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd6415bd40 0x7fcd640b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:22.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd6a200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcd64168d10 con 0x7fcd640d20f0 2024-09-17T05:35:22.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd6a200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcd64168b90 con 0x7fcd640b0d10 2024-09-17T05:35:22.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd6a200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcd64168e90 con 0x7fcd6415bd40 2024-09-17T05:35:22.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd5be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd640d20f0 0x7fcd64150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:22.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd5be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd640d20f0 0x7fcd64150800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37730/0 (socket says 172.21.15.31:37730) 2024-09-17T05:35:22.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd5be00640 1 -- 172.21.15.31:0/2610643359 learned_addr learned my addr 172.21.15.31:0/2610643359 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:22.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd69800640 1 --2- 172.21.15.31:0/2610643359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd6415bd40 0x7fcd640b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:22.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd68e00640 1 --2- 172.21.15.31:0/2610643359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd640b0d10 0x7fcd6415ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:22.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd5be00640 1 -- 172.21.15.31:0/2610643359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd6415bd40 msgr2=0x7fcd640b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:22.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd5be00640 1 --2- 172.21.15.31:0/2610643359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd6415bd40 0x7fcd640b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:22.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd5be00640 1 -- 172.21.15.31:0/2610643359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd640b0d10 msgr2=0x7fcd6415ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:22.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd5be00640 1 --2- 172.21.15.31:0/2610643359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd640b0d10 0x7fcd6415ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:22.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.949+0000 7fcd5be00640 1 -- 172.21.15.31:0/2610643359 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd6415d500 con 0x7fcd640d20f0 2024-09-17T05:35:22.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.953+0000 7fcd5be00640 1 --2- 172.21.15.31:0/2610643359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd640d20f0 0x7fcd64150800 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00e9d0 tx=0x7fcd4c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:22.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.953+0000 7fcd61600640 1 -- 172.21.15.31:0/2610643359 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c00cde0 con 0x7fcd640d20f0 2024-09-17T05:35:22.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.953+0000 7fcd61600640 1 -- 172.21.15.31:0/2610643359 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd4c004020 con 0x7fcd640d20f0 2024-09-17T05:35:22.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.953+0000 7fcd61600640 1 -- 172.21.15.31:0/2610643359 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c004450 con 0x7fcd640d20f0 2024-09-17T05:35:22.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.953+0000 7fcd6a200640 1 -- 172.21.15.31:0/2610643359 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd6415d7e0 con 0x7fcd640d20f0 2024-09-17T05:35:22.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.953+0000 7fcd6a200640 1 -- 172.21.15.31:0/2610643359 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd6415e080 con 0x7fcd640d20f0 2024-09-17T05:35:22.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.953+0000 7fcd6a200640 1 -- 172.21.15.31:0/2610643359 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd640d1bb0 con 0x7fcd640d20f0 2024-09-17T05:35:22.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.953+0000 7fcd61600640 1 -- 172.21.15.31:0/2610643359 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fcd4c003600 con 0x7fcd640d20f0 2024-09-17T05:35:22.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.953+0000 7fcd61600640 1 --2- 172.21.15.31:0/2610643359 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcd40073860 0x7fcd40075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:22.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.953+0000 7fcd61600640 1 -- 172.21.15.31:0/2610643359 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7fcd4c0956a0 con 0x7fcd640d20f0 2024-09-17T05:35:22.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.953+0000 7fcd68e00640 1 --2- 172.21.15.31:0/2610643359 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcd40073860 0x7fcd40075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:22.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.957+0000 7fcd68e00640 1 --2- 172.21.15.31:0/2610643359 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcd40073860 0x7fcd40075d20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcd54007fd0 tx=0x7fcd54009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:22.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:22.957+0000 7fcd61600640 1 -- 172.21.15.31:0/2610643359 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fcd4c05f710 con 0x7fcd640d20f0 2024-09-17T05:35:23.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.161+0000 7fcd6a200640 1 -- 172.21.15.31:0/2610643359 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "non_existent_subvolume", "target": ["mon-mgr", ""]}) -- 0x7fcd64069e30 con 0x7fcd40073860 2024-09-17T05:35:23.164 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:23.161+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:23.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.161+0000 7fcd61600640 1 -- 172.21.15.31:0/2610643359 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fcd54001d20 con 0x7fcd40073860 2024-09-17T05:35:23.164 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:23.172 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:23.173 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create non_existent_subvolume subvolume_1 snapshot_1 2024-09-17T05:35:23.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.321+0000 7fb6d0a00640 1 -- 172.21.15.31:0/3744664332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6cc0b0b60 msgr2=0x7fb6cc166eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:23.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.321+0000 7fb6d0a00640 1 --2- 172.21.15.31:0/3744664332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6cc0b0b60 0x7fb6cc166eb0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4009bc0 tx=0x7fb6c401f3b0 comp rx=0 tx=0).stop 2024-09-17T05:35:23.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.321+0000 7fb6d0a00640 1 -- 172.21.15.31:0/3744664332 shutdown_connections 2024-09-17T05:35:23.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.321+0000 7fb6d0a00640 1 --2- 172.21.15.31:0/3744664332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6cc0b0b60 0x7fb6cc166eb0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:23.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.321+0000 7fb6d0a00640 1 -- 172.21.15.31:0/3744664332 >> 172.21.15.31:0/3744664332 conn(0x7fb6cc0d1da0 msgr2=0x7fb6cc0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:23.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.321+0000 7fb6d0a00640 1 -- 172.21.15.31:0/3744664332 shutdown_connections 2024-09-17T05:35:23.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.321+0000 7fb6d0a00640 1 -- 172.21.15.31:0/3744664332 wait complete. 2024-09-17T05:35:23.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6d0a00640 1 Processor -- start 2024-09-17T05:35:23.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6d0a00640 1 -- start start 2024-09-17T05:35:23.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6d0a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6cc0b0b60 0x7fb6cc06f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:23.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6d0a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6cc15be10 0x7fb6cc150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:23.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6d0a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6cc15c1f0 0x7fb6cc151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:23.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6d0a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc167570 con 0x7fb6cc15c1f0 2024-09-17T05:35:23.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6d0a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc1673f0 con 0x7fb6cc0b0b60 2024-09-17T05:35:23.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6d0a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb6cc1676f0 con 0x7fb6cc15be10 2024-09-17T05:35:23.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6ca800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6cc15c1f0 0x7fb6cc151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:23.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6ca800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6cc15c1f0 0x7fb6cc151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37742/0 (socket says 172.21.15.31:37742) 2024-09-17T05:35:23.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6ca800640 1 -- 172.21.15.31:0/2154836033 learned_addr learned my addr 172.21.15.31:0/2154836033 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:23.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6c9400640 1 --2- 172.21.15.31:0/2154836033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6cc15be10 0x7fb6cc150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:23.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6c9e00640 1 --2- 172.21.15.31:0/2154836033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6cc0b0b60 0x7fb6cc06f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:23.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6ca800640 1 -- 172.21.15.31:0/2154836033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6cc15be10 msgr2=0x7fb6cc150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:23.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6ca800640 1 --2- 172.21.15.31:0/2154836033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6cc15be10 0x7fb6cc150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:23.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6ca800640 1 -- 172.21.15.31:0/2154836033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6cc0b0b60 msgr2=0x7fb6cc06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:23.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6ca800640 1 --2- 172.21.15.31:0/2154836033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6cc0b0b60 0x7fb6cc06f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:23.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6ca800640 1 -- 172.21.15.31:0/2154836033 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6cc166560 con 0x7fb6cc15c1f0 2024-09-17T05:35:23.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6c9400640 1 --2- 172.21.15.31:0/2154836033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6cc15be10 0x7fb6cc150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:23.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6c9e00640 1 --2- 172.21.15.31:0/2154836033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6cc0b0b60 0x7fb6cc06f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:23.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6ca800640 1 --2- 172.21.15.31:0/2154836033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6cc15c1f0 0x7fb6cc151be0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fb6c401bfc0 tx=0x7fb6c40af580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:23.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6c2000640 1 -- 172.21.15.31:0/2154836033 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40b4040 con 0x7fb6cc15c1f0 2024-09-17T05:35:23.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6c2000640 1 -- 172.21.15.31:0/2154836033 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6c40bf070 con 0x7fb6cc15c1f0 2024-09-17T05:35:23.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6c2000640 1 -- 172.21.15.31:0/2154836033 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40b09b0 con 0x7fb6cc15c1f0 2024-09-17T05:35:23.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6d0a00640 1 -- 172.21.15.31:0/2154836033 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6cc166840 con 0x7fb6cc15c1f0 2024-09-17T05:35:23.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.325+0000 7fb6d0a00640 1 -- 172.21.15.31:0/2154836033 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6cc06fcf0 con 0x7fb6cc15c1f0 2024-09-17T05:35:23.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.329+0000 7fb6d0a00640 1 -- 172.21.15.31:0/2154836033 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6cc0ce700 con 0x7fb6cc15c1f0 2024-09-17T05:35:23.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.329+0000 7fb6c2000640 1 -- 172.21.15.31:0/2154836033 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fb6c40b0b70 con 0x7fb6cc15c1f0 2024-09-17T05:35:23.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.329+0000 7fb6c2000640 1 --2- 172.21.15.31:0/2154836033 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb6ac073830 0x7fb6ac075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:23.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.329+0000 7fb6c2000640 1 -- 172.21.15.31:0/2154836033 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7fb6c4132f80 con 0x7fb6cc15c1f0 2024-09-17T05:35:23.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.329+0000 7fb6c9e00640 1 --2- 172.21.15.31:0/2154836033 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb6ac073830 0x7fb6ac075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:23.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.329+0000 7fb6c9e00640 1 --2- 172.21.15.31:0/2154836033 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb6ac073830 0x7fb6ac075cf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0046c0 tx=0x7fb6bc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:23.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.333+0000 7fb6c2000640 1 -- 172.21.15.31:0/2154836033 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb6c4018f10 con 0x7fb6cc15c1f0 2024-09-17T05:35:23.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.541+0000 7fb6d0a00640 1 -- 172.21.15.31:0/2154836033 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7fb6cc070350 con 0x7fb6ac073830 2024-09-17T05:35:23.543 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:23.541+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:23.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.541+0000 7fb6c2000640 1 -- 172.21.15.31:0/2154836033 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fb6cc070350 con 0x7fb6ac073830 2024-09-17T05:35:23.543 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:23.551 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:23.552 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm non_existent_subvolume subvolume_1 snapshot_1 2024-09-17T05:35:23.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.701+0000 7f532e400640 1 -- 172.21.15.31:0/3642172207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53280cf440 msgr2=0x7f53280ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:23.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.701+0000 7f532e400640 1 --2- 172.21.15.31:0/3642172207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53280cf440 0x7f53280ce350 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f5328051480 tx=0x7f531001c7d0 comp rx=0 tx=0).stop 2024-09-17T05:35:23.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.701+0000 7f532e400640 1 -- 172.21.15.31:0/3642172207 shutdown_connections 2024-09-17T05:35:23.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.701+0000 7f532e400640 1 --2- 172.21.15.31:0/3642172207 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53280cf440 0x7f53280ce350 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:23.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.701+0000 7f532e400640 1 --2- 172.21.15.31:0/3642172207 >> v2:172.21.15.155:3300/0 conn(0x7f53280734f0 0x7f532815a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:23.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.701+0000 7f532e400640 1 -- 172.21.15.31:0/3642172207 >> 172.21.15.31:0/3642172207 conn(0x7f53280cfbc0 msgr2=0x7f53280cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:23.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.701+0000 7f532e400640 1 -- 172.21.15.31:0/3642172207 shutdown_connections 2024-09-17T05:35:23.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.701+0000 7f532e400640 1 -- 172.21.15.31:0/3642172207 wait complete. 2024-09-17T05:35:23.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f532e400640 1 Processor -- start 2024-09-17T05:35:23.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f532e400640 1 -- start start 2024-09-17T05:35:23.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f532e400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53280734f0 0x7f532809c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:23.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f532e400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53280ce890 0x7f53280ae820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:23.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f532e400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53280cf440 0x7f53280b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:23.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f532e400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f532815ece0 con 0x7f53280cf440 2024-09-17T05:35:23.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f532e400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f532815eb60 con 0x7f53280734f0 2024-09-17T05:35:23.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f532e400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5328167360 con 0x7f53280ce890 2024-09-17T05:35:23.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f5327e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53280cf440 0x7f53280b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:23.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f5327400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53280734f0 0x7f532809c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:23.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f5327e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53280cf440 0x7f53280b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37754/0 (socket says 172.21.15.31:37754) 2024-09-17T05:35:23.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f5327e00640 1 -- 172.21.15.31:0/1094285710 learned_addr learned my addr 172.21.15.31:0/1094285710 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:23.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f531ea00640 1 --2- 172.21.15.31:0/1094285710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53280ce890 0x7f53280ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:23.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f5327e00640 1 -- 172.21.15.31:0/1094285710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53280ce890 msgr2=0x7f53280ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:23.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f5327e00640 1 --2- 172.21.15.31:0/1094285710 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f53280ce890 0x7f53280ae820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:23.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f5327e00640 1 -- 172.21.15.31:0/1094285710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53280734f0 msgr2=0x7f532809c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:23.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f5327e00640 1 --2- 172.21.15.31:0/1094285710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53280734f0 0x7f532809c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:23.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f5327e00640 1 -- 172.21.15.31:0/1094285710 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53280aed60 con 0x7f53280cf440 2024-09-17T05:35:23.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f5327e00640 1 --2- 172.21.15.31:0/1094285710 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f53280cf440 0x7f53280b5110 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f532000c770 tx=0x7f532000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:23.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f531fe00640 1 -- 172.21.15.31:0/1094285710 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5320017070 con 0x7f53280cf440 2024-09-17T05:35:23.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f531fe00640 1 -- 172.21.15.31:0/1094285710 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5320005070 con 0x7f53280cf440 2024-09-17T05:35:23.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f531fe00640 1 -- 172.21.15.31:0/1094285710 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53200054c0 con 0x7f53280cf440 2024-09-17T05:35:23.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f532e400640 1 -- 172.21.15.31:0/1094285710 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f532809cd80 con 0x7f53280cf440 2024-09-17T05:35:23.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.705+0000 7f532e400640 1 -- 172.21.15.31:0/1094285710 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53280b2c90 con 0x7f53280cf440 2024-09-17T05:35:23.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.709+0000 7f532e400640 1 -- 172.21.15.31:0/1094285710 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5328069410 con 0x7f53280cf440 2024-09-17T05:35:23.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.709+0000 7f531fe00640 1 -- 172.21.15.31:0/1094285710 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f532001a070 con 0x7f53280cf440 2024-09-17T05:35:23.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.709+0000 7f531fe00640 1 --2- 172.21.15.31:0/1094285710 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5304073830 0x7f5304075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:23.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.709+0000 7f531fe00640 1 -- 172.21.15.31:0/1094285710 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f53200944a0 con 0x7f53280cf440 2024-09-17T05:35:23.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.709+0000 7f5327400640 1 --2- 172.21.15.31:0/1094285710 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5304073830 0x7f5304075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:23.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.709+0000 7f5327400640 1 --2- 172.21.15.31:0/1094285710 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5304073830 0x7f5304075cf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f531800bd00 tx=0x7f531800b490 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:23.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.713+0000 7f531fe00640 1 -- 172.21.15.31:0/1094285710 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f53280aed60 con 0x7f53280cf440 2024-09-17T05:35:23.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.921+0000 7f532e400640 1 -- 172.21.15.31:0/1094285710 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f532815a9d0 con 0x7f5304073830 2024-09-17T05:35:23.925 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:23.925+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:23.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:23.925+0000 7f531fe00640 1 -- 172.21.15.31:0/1094285710 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f532815a9d0 con 0x7f5304073830 2024-09-17T05:35:23.926 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:23.935 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:23.936 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot info non_existent_subvolume subvolume_1 snapshot_1 2024-09-17T05:35:24.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.085+0000 7f1f9b600640 1 -- 172.21.15.31:0/906130203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f940b0b60 msgr2=0x7f1f940ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:24.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.085+0000 7f1f9b600640 1 --2- 172.21.15.31:0/906130203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f940b0b60 0x7f1f940ccbd0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f1f94073e00 tx=0x7f1f8c01f580 comp rx=0 tx=0).stop 2024-09-17T05:35:24.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.085+0000 7f1f9b600640 1 -- 172.21.15.31:0/906130203 shutdown_connections 2024-09-17T05:35:24.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.085+0000 7f1f9b600640 1 --2- 172.21.15.31:0/906130203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f940b0b60 0x7f1f940ccbd0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:24.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.085+0000 7f1f9b600640 1 --2- 172.21.15.31:0/906130203 >> v2:172.21.15.155:3300/0 conn(0x7f1f9415be10 0x7f1f940ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:24.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.085+0000 7f1f9b600640 1 -- 172.21.15.31:0/906130203 >> 172.21.15.31:0/906130203 conn(0x7f1f940d1da0 msgr2=0x7f1f940d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:24.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f9b600640 1 -- 172.21.15.31:0/906130203 shutdown_connections 2024-09-17T05:35:24.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f9b600640 1 -- 172.21.15.31:0/906130203 wait complete. 2024-09-17T05:35:24.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f9b600640 1 Processor -- start 2024-09-17T05:35:24.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f9b600640 1 -- start start 2024-09-17T05:35:24.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f9b600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f940b0b60 0x7f1f940cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:24.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f9b600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f9415be10 0x7f1f940c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:24.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f9b600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f9415c1f0 0x7f1f94150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:24.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f9b600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1f940cd4a0 con 0x7f1f9415c1f0 2024-09-17T05:35:24.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f9b600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1f940cd320 con 0x7f1f940b0b60 2024-09-17T05:35:24.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f9b600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1f940cd620 con 0x7f1f9415be10 2024-09-17T05:35:24.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f99600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f9415c1f0 0x7f1f94150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:24.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f99600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f9415c1f0 0x7f1f94150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37776/0 (socket says 172.21.15.31:37776) 2024-09-17T05:35:24.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f99600640 1 -- 172.21.15.31:0/414749871 learned_addr learned my addr 172.21.15.31:0/414749871 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:24.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f98c00640 1 --2- 172.21.15.31:0/414749871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f940b0b60 0x7f1f940cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:24.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f8be00640 1 --2- 172.21.15.31:0/414749871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f9415be10 0x7f1f940c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:24.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f99600640 1 -- 172.21.15.31:0/414749871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f9415be10 msgr2=0x7f1f940c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:24.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f99600640 1 --2- 172.21.15.31:0/414749871 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f9415be10 0x7f1f940c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:24.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f99600640 1 -- 172.21.15.31:0/414749871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f940b0b60 msgr2=0x7f1f940cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:24.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f99600640 1 --2- 172.21.15.31:0/414749871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f940b0b60 0x7f1f940cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:24.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f99600640 1 -- 172.21.15.31:0/414749871 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f940cb8e0 con 0x7f1f9415c1f0 2024-09-17T05:35:24.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f99600640 1 --2- 172.21.15.31:0/414749871 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f9415c1f0 0x7f1f94150280 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c0b3040 tx=0x7f1f8c0093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:24.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f91600640 1 -- 172.21.15.31:0/414749871 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c0bf070 con 0x7f1f9415c1f0 2024-09-17T05:35:24.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f91600640 1 -- 172.21.15.31:0/414749871 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f8c004b40 con 0x7f1f9415c1f0 2024-09-17T05:35:24.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f9b600640 1 -- 172.21.15.31:0/414749871 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f940cbbc0 con 0x7f1f9415c1f0 2024-09-17T05:35:24.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.089+0000 7f1f91600640 1 -- 172.21.15.31:0/414749871 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c0b5040 con 0x7f1f9415c1f0 2024-09-17T05:35:24.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.093+0000 7f1f9b600640 1 -- 172.21.15.31:0/414749871 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f941507c0 con 0x7f1f9415c1f0 2024-09-17T05:35:24.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.093+0000 7f1f9b600640 1 -- 172.21.15.31:0/414749871 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f940ce360 con 0x7f1f9415c1f0 2024-09-17T05:35:24.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.093+0000 7f1f91600640 1 -- 172.21.15.31:0/414749871 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f1f8c0c2070 con 0x7f1f9415c1f0 2024-09-17T05:35:24.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.093+0000 7f1f91600640 1 --2- 172.21.15.31:0/414749871 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1f70073830 0x7f1f70075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:24.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.093+0000 7f1f91600640 1 -- 172.21.15.31:0/414749871 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f1f8c131f10 con 0x7f1f9415c1f0 2024-09-17T05:35:24.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.093+0000 7f1f98c00640 1 --2- 172.21.15.31:0/414749871 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1f70073830 0x7f1f70075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:24.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.093+0000 7f1f98c00640 1 --2- 172.21.15.31:0/414749871 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1f70073830 0x7f1f70075cf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1f84006fd0 tx=0x7f1f84008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:24.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.097+0000 7f1f91600640 1 -- 172.21.15.31:0/414749871 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f1f8c0190e0 con 0x7f1f9415c1f0 2024-09-17T05:35:24.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.305+0000 7f1f9b600640 1 -- 172.21.15.31:0/414749871 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot info", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f1f940cbd90 con 0x7f1f70073830 2024-09-17T05:35:24.309 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:24.309+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:24.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.309+0000 7f1f91600640 1 -- 172.21.15.31:0/414749871 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f1f940cbd90 con 0x7f1f70073830 2024-09-17T05:35:24.309 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:24.318 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:24.319 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot protect non_existent_subvolume subvolume_1 snapshot_1 2024-09-17T05:35:24.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.469+0000 7f6e7e800640 1 -- 172.21.15.31:0/1592467509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e5c003a90 msgr2=0x7f6e5c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:24.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.469+0000 7f6e7e800640 1 --2- 172.21.15.31:0/1592467509 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e5c003a90 0x7f6e5c003eb0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f6e68006fa0 tx=0x7f6e6801cec0 comp rx=0 tx=0).stop 2024-09-17T05:35:24.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.469+0000 7f6e77e00640 1 -- 172.21.15.31:0/1592467509 reap_dead start 2024-09-17T05:35:24.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.469+0000 7f6e7e800640 1 -- 172.21.15.31:0/1592467509 shutdown_connections 2024-09-17T05:35:24.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.469+0000 7f6e7e800640 1 -- 172.21.15.31:0/1592467509 >> 172.21.15.31:0/1592467509 conn(0x7f6e7806dd30 msgr2=0x7f6e7806e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:24.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.469+0000 7f6e7e800640 1 -- 172.21.15.31:0/1592467509 shutdown_connections 2024-09-17T05:35:24.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.469+0000 7f6e7e800640 1 -- 172.21.15.31:0/1592467509 wait complete. 2024-09-17T05:35:24.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e7e800640 1 Processor -- start 2024-09-17T05:35:24.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e7e800640 1 -- start start 2024-09-17T05:35:24.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e7e800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e5c003a90 0x7f6e780b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:24.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e7e800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e78147f90 0x7f6e7815b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:24.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e7e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e78148410 0x7f6e78154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:24.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e7e800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6e78166e10 con 0x7f6e78148410 2024-09-17T05:35:24.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e7e800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6e78166c90 con 0x7f6e78147f90 2024-09-17T05:35:24.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e7e800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6e78166f90 con 0x7f6e5c003a90 2024-09-17T05:35:24.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e77e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e78148410 0x7f6e78154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:24.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e77e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e78148410 0x7f6e78154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37800/0 (socket says 172.21.15.31:37800) 2024-09-17T05:35:24.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e77e00640 1 -- 172.21.15.31:0/955716919 learned_addr learned my addr 172.21.15.31:0/955716919 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:24.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e77400640 1 --2- 172.21.15.31:0/955716919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e5c003a90 0x7f6e780b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:24.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e6fe00640 1 --2- 172.21.15.31:0/955716919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e78147f90 0x7f6e7815b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:24.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e77e00640 1 -- 172.21.15.31:0/955716919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e5c003a90 msgr2=0x7f6e780b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:24.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e77e00640 1 --2- 172.21.15.31:0/955716919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e5c003a90 0x7f6e780b2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:24.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e77e00640 1 -- 172.21.15.31:0/955716919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e78147f90 msgr2=0x7f6e7815b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:24.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e77e00640 1 --2- 172.21.15.31:0/955716919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e78147f90 0x7f6e7815b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:24.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e77e00640 1 -- 172.21.15.31:0/955716919 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e781573c0 con 0x7f6e78148410 2024-09-17T05:35:24.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e77e00640 1 --2- 172.21.15.31:0/955716919 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6e78148410 0x7f6e78154fe0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f6e780b0840 tx=0x7f6e700019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:24.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e6f400640 1 -- 172.21.15.31:0/955716919 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e70015020 con 0x7f6e78148410 2024-09-17T05:35:24.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e6f400640 1 -- 172.21.15.31:0/955716919 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e70011980 con 0x7f6e78148410 2024-09-17T05:35:24.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e6f400640 1 -- 172.21.15.31:0/955716919 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e70011dd0 con 0x7f6e78148410 2024-09-17T05:35:24.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e7e800640 1 -- 172.21.15.31:0/955716919 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e781576a0 con 0x7f6e78148410 2024-09-17T05:35:24.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e7e800640 1 -- 172.21.15.31:0/955716919 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e78157c60 con 0x7f6e78148410 2024-09-17T05:35:24.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.473+0000 7f6e7e800640 1 -- 172.21.15.31:0/955716919 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e780b48f0 con 0x7f6e78148410 2024-09-17T05:35:24.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.477+0000 7f6e6f400640 1 -- 172.21.15.31:0/955716919 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f6e70018020 con 0x7f6e78148410 2024-09-17T05:35:24.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.477+0000 7f6e6f400640 1 --2- 172.21.15.31:0/955716919 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6e54073860 0x7f6e54075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:24.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.477+0000 7f6e6f400640 1 -- 172.21.15.31:0/955716919 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f6e700956c0 con 0x7f6e78148410 2024-09-17T05:35:24.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.477+0000 7f6e77400640 1 --2- 172.21.15.31:0/955716919 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6e54073860 0x7f6e54075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:24.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.477+0000 7f6e77400640 1 --2- 172.21.15.31:0/955716919 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6e54073860 0x7f6e54075d20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6e680ab000 tx=0x7f6e68019d00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:24.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.481+0000 7f6e6f400640 1 -- 172.21.15.31:0/955716919 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6e7001f020 con 0x7f6e78148410 2024-09-17T05:35:24.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.685+0000 7f6e7e800640 1 -- 172.21.15.31:0/955716919 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot protect", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f6e780b2060 con 0x7f6e54073860 2024-09-17T05:35:24.690 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:24.689+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:24.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.689+0000 7f6e6f400640 1 -- 172.21.15.31:0/955716919 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f6e780b2060 con 0x7f6e54073860 2024-09-17T05:35:24.691 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:24.700 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:24.701 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot unprotect non_existent_subvolume subvolume_1 snapshot_1 2024-09-17T05:35:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.853+0000 7f8cc6a00640 1 -- 172.21.15.31:0/1961129300 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ca4004810 msgr2=0x7f8ca4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.853+0000 7f8cc6a00640 1 --2- 172.21.15.31:0/1961129300 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ca4004810 0x7f8ca4004c90 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009b60 tx=0x7f8ca801d2b0 comp rx=0 tx=0).stop 2024-09-17T05:35:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.853+0000 7f8cc4a00640 1 -- 172.21.15.31:0/1961129300 reap_dead start 2024-09-17T05:35:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.853+0000 7f8cc6a00640 1 -- 172.21.15.31:0/1961129300 shutdown_connections 2024-09-17T05:35:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.853+0000 7f8cc6a00640 1 -- 172.21.15.31:0/1961129300 >> 172.21.15.31:0/1961129300 conn(0x7f8cc00d1da0 msgr2=0x7f8cc00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.853+0000 7f8cc6a00640 1 -- 172.21.15.31:0/1961129300 shutdown_connections 2024-09-17T05:35:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.853+0000 7f8cc6a00640 1 -- 172.21.15.31:0/1961129300 wait complete. 2024-09-17T05:35:24.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.853+0000 7f8cc6a00640 1 Processor -- start 2024-09-17T05:35:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.853+0000 7f8cc6a00640 1 -- start start 2024-09-17T05:35:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cc6a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ca4004810 0x7f8cc01514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cc6a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cc006f120 0x7f8cc0158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cc6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8cc015ae60 0x7f8cc0159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cc6a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc00cea90 con 0x7f8cc015ae60 2024-09-17T05:35:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cc6a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc00ce910 con 0x7f8ca4004810 2024-09-17T05:35:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cc6a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8cc00cf180 con 0x7f8cc006f120 2024-09-17T05:35:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cc4a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8cc015ae60 0x7f8cc0159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cc4a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8cc015ae60 0x7f8cc0159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37824/0 (socket says 172.21.15.31:37824) 2024-09-17T05:35:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cc4a00640 1 -- 172.21.15.31:0/1653027239 learned_addr learned my addr 172.21.15.31:0/1653027239 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cb7e00640 1 --2- 172.21.15.31:0/1653027239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cc006f120 0x7f8cc0158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:24.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cbfe00640 1 --2- 172.21.15.31:0/1653027239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ca4004810 0x7f8cc01514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cc4a00640 1 -- 172.21.15.31:0/1653027239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cc006f120 msgr2=0x7f8cc0158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cc4a00640 1 --2- 172.21.15.31:0/1653027239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8cc006f120 0x7f8cc0158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cc4a00640 1 -- 172.21.15.31:0/1653027239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ca4004810 msgr2=0x7f8cc01514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cc4a00640 1 --2- 172.21.15.31:0/1653027239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ca4004810 0x7f8cc01514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cc4a00640 1 -- 172.21.15.31:0/1653027239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc006f5f0 con 0x7f8cc015ae60 2024-09-17T05:35:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cbfe00640 1 --2- 172.21.15.31:0/1653027239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ca4004810 0x7f8cc01514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cc4a00640 1 --2- 172.21.15.31:0/1653027239 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8cc015ae60 0x7f8cc0159350 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f8cc015c5d0 tx=0x7f8cb800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cbcc00640 1 -- 172.21.15.31:0/1653027239 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb800cba0 con 0x7f8cc015ae60 2024-09-17T05:35:24.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cbcc00640 1 -- 172.21.15.31:0/1653027239 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cb8018070 con 0x7f8cc015ae60 2024-09-17T05:35:24.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cbcc00640 1 -- 172.21.15.31:0/1653027239 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb80116c0 con 0x7f8cc015ae60 2024-09-17T05:35:24.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cc6a00640 1 -- 172.21.15.31:0/1653027239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc006f8d0 con 0x7f8cc015ae60 2024-09-17T05:35:24.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cc6a00640 1 -- 172.21.15.31:0/1653027239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc00b60a0 con 0x7f8cc015ae60 2024-09-17T05:35:24.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cc6a00640 1 -- 172.21.15.31:0/1653027239 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cc00cec10 con 0x7f8cc015ae60 2024-09-17T05:35:24.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.857+0000 7f8cbcc00640 1 -- 172.21.15.31:0/1653027239 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f8cb8011860 con 0x7f8cc015ae60 2024-09-17T05:35:24.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.861+0000 7f8cbcc00640 1 --2- 172.21.15.31:0/1653027239 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8c9c073860 0x7f8c9c075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:24.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.861+0000 7f8cbcc00640 1 -- 172.21.15.31:0/1653027239 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f8cb80953b0 con 0x7f8cc015ae60 2024-09-17T05:35:24.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.861+0000 7f8cbfe00640 1 --2- 172.21.15.31:0/1653027239 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8c9c073860 0x7f8c9c075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:24.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.861+0000 7f8cbfe00640 1 --2- 172.21.15.31:0/1653027239 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8c9c073860 0x7f8c9c075d20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8cc006df90 tx=0x7f8cb00091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:24.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:24.865+0000 7f8cbcc00640 1 -- 172.21.15.31:0/1653027239 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8cb805f9b0 con 0x7f8cc015ae60 2024-09-17T05:35:25.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.073+0000 7f8cc6a00640 1 -- 172.21.15.31:0/1653027239 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot unprotect", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f8cc0070350 con 0x7f8c9c073860 2024-09-17T05:35:25.076 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:25.073+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:25.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.073+0000 7f8cbcc00640 1 -- 172.21.15.31:0/1653027239 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f8cc0070350 con 0x7f8c9c073860 2024-09-17T05:35:25.077 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:25.086 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:25.087 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls non_existent_subvolume subvolume_1 2024-09-17T05:35:25.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.237+0000 7f864f600640 1 -- 172.21.15.31:0/1502598334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f864806fbf0 msgr2=0x7f864815b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:25.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.237+0000 7f864f600640 1 --2- 172.21.15.31:0/1502598334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f864806fbf0 0x7f864815b270 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f86480b3740 tx=0x7f863001c8c0 comp rx=0 tx=0).stop 2024-09-17T05:35:25.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.237+0000 7f864f600640 1 -- 172.21.15.31:0/1502598334 shutdown_connections 2024-09-17T05:35:25.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.237+0000 7f864f600640 1 --2- 172.21.15.31:0/1502598334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f864806fbf0 0x7f864815b270 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:25.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.237+0000 7f864f600640 1 --2- 172.21.15.31:0/1502598334 >> v2:172.21.15.155:3300/0 conn(0x7f86480c7740 0x7f864806f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:25.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.237+0000 7f864f600640 1 -- 172.21.15.31:0/1502598334 >> 172.21.15.31:0/1502598334 conn(0x7f86480b2900 msgr2=0x7f86480b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:25.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.237+0000 7f864f600640 1 -- 172.21.15.31:0/1502598334 shutdown_connections 2024-09-17T05:35:25.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.237+0000 7f864f600640 1 -- 172.21.15.31:0/1502598334 wait complete. 2024-09-17T05:35:25.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.237+0000 7f864f600640 1 Processor -- start 2024-09-17T05:35:25.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.237+0000 7f864f600640 1 -- start start 2024-09-17T05:35:25.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864f600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f864806fbf0 0x7f864813bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:25.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864f600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86480c7740 0x7f86481fb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:25.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864f600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f864815b7b0 0x7f8648153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:25.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864f600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f86481680b0 con 0x7f864806fbf0 2024-09-17T05:35:25.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864f600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8648167f30 con 0x7f864815b7b0 2024-09-17T05:35:25.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864f600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8648168230 con 0x7f86480c7740 2024-09-17T05:35:25.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f864806fbf0 0x7f864813bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:25.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f864806fbf0 0x7f864813bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37850/0 (socket says 172.21.15.31:37850) 2024-09-17T05:35:25.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864cc00640 1 -- 172.21.15.31:0/3727466671 learned_addr learned my addr 172.21.15.31:0/3727466671 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:25.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864d600640 1 --2- 172.21.15.31:0/3727466671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f864815b7b0 0x7f8648153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:25.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f863fe00640 1 --2- 172.21.15.31:0/3727466671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86480c7740 0x7f86481fb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:25.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864cc00640 1 -- 172.21.15.31:0/3727466671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86480c7740 msgr2=0x7f86481fb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:25.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864cc00640 1 --2- 172.21.15.31:0/3727466671 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86480c7740 0x7f86481fb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:25.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864cc00640 1 -- 172.21.15.31:0/3727466671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f864815b7b0 msgr2=0x7f8648153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:25.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864cc00640 1 --2- 172.21.15.31:0/3727466671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f864815b7b0 0x7f8648153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:25.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864cc00640 1 -- 172.21.15.31:0/3727466671 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86480b3e50 con 0x7f864806fbf0 2024-09-17T05:35:25.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864d600640 1 --2- 172.21.15.31:0/3727466671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f864815b7b0 0x7f8648153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:25.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864cc00640 1 --2- 172.21.15.31:0/3727466671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f864806fbf0 0x7f864813bed0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f863800e940 tx=0x7f863800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:25.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f8645600640 1 -- 172.21.15.31:0/3727466671 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863800cd80 con 0x7f864806fbf0 2024-09-17T05:35:25.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f8645600640 1 -- 172.21.15.31:0/3727466671 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8638005020 con 0x7f864806fbf0 2024-09-17T05:35:25.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f8645600640 1 -- 172.21.15.31:0/3727466671 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8638005450 con 0x7f864806fbf0 2024-09-17T05:35:25.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864f600640 1 -- 172.21.15.31:0/3727466671 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86481526c0 con 0x7f864806fbf0 2024-09-17T05:35:25.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864f600640 1 -- 172.21.15.31:0/3727466671 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86481529a0 con 0x7f864806fbf0 2024-09-17T05:35:25.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.241+0000 7f864f600640 1 -- 172.21.15.31:0/3727466671 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f864815b270 con 0x7f864806fbf0 2024-09-17T05:35:25.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.245+0000 7f8645600640 1 -- 172.21.15.31:0/3727466671 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f86380047b0 con 0x7f864806fbf0 2024-09-17T05:35:25.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.245+0000 7f8645600640 1 --2- 172.21.15.31:0/3727466671 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8624073830 0x7f8624075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:25.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.245+0000 7f8645600640 1 -- 172.21.15.31:0/3727466671 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f86380957f0 con 0x7f864806fbf0 2024-09-17T05:35:25.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.245+0000 7f863fe00640 1 --2- 172.21.15.31:0/3727466671 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8624073830 0x7f8624075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:25.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.245+0000 7f863fe00640 1 --2- 172.21.15.31:0/3727466671 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8624073830 0x7f8624075cf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f86300af000 tx=0x7f863001b100 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:25.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.249+0000 7f8645600640 1 -- 172.21.15.31:0/3727466671 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f863805fec0 con 0x7f864806fbf0 2024-09-17T05:35:25.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.461+0000 7f864f600640 1 -- 172.21.15.31:0/3727466671 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7f864806f850 con 0x7f8624073830 2024-09-17T05:35:25.464 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:25.461+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:25.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.461+0000 7f8645600640 1 -- 172.21.15.31:0/3727466671 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f864806f850 con 0x7f8624073830 2024-09-17T05:35:25.465 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:25.473 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:25.474 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone non_existent_subvolume subvolume_1 snapshot_1 clone_1 2024-09-17T05:35:25.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.625+0000 7f9d18c00640 1 -- 172.21.15.31:0/4233553484 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d1415f340 msgr2=0x7f9d140b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:25.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.625+0000 7f9d18c00640 1 --2- 172.21.15.31:0/4233553484 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d1415f340 0x7f9d140b34a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9d04009900 tx=0x7f9d0401c8b0 comp rx=0 tx=0).stop 2024-09-17T05:35:25.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.625+0000 7f9d18c00640 1 -- 172.21.15.31:0/4233553484 shutdown_connections 2024-09-17T05:35:25.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.625+0000 7f9d18c00640 1 --2- 172.21.15.31:0/4233553484 >> v2:172.21.15.155:3300/0 conn(0x7f9d140b2a00 0x7f9d140b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:25.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.625+0000 7f9d18c00640 1 --2- 172.21.15.31:0/4233553484 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d1415f340 0x7f9d140b34a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:25.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.625+0000 7f9d18c00640 1 -- 172.21.15.31:0/4233553484 >> 172.21.15.31:0/4233553484 conn(0x7f9d140d1e00 msgr2=0x7f9d140d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:25.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.625+0000 7f9d18c00640 1 -- 172.21.15.31:0/4233553484 shutdown_connections 2024-09-17T05:35:25.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.625+0000 7f9d18c00640 1 -- 172.21.15.31:0/4233553484 wait complete. 2024-09-17T05:35:25.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.625+0000 7f9d18c00640 1 Processor -- start 2024-09-17T05:35:25.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d18c00640 1 -- start start 2024-09-17T05:35:25.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d18c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d140b2a00 0x7f9d140b6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:25.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d18c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d140ccf10 0x7f9d1415a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:25.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d18c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d1415f340 0x7f9d1415b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:25.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d18c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9d14169040 con 0x7f9d140ccf10 2024-09-17T05:35:25.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d18c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9d14168ec0 con 0x7f9d1415f340 2024-09-17T05:35:25.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d18c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9d141691c0 con 0x7f9d140b2a00 2024-09-17T05:35:25.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d11400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d140ccf10 0x7f9d1415a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:25.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d11400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d140ccf10 0x7f9d1415a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37864/0 (socket says 172.21.15.31:37864) 2024-09-17T05:35:25.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d11400640 1 -- 172.21.15.31:0/248755029 learned_addr learned my addr 172.21.15.31:0/248755029 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:25.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d11e00640 1 --2- 172.21.15.31:0/248755029 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d140b2a00 0x7f9d140b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:25.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d12800640 1 --2- 172.21.15.31:0/248755029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d1415f340 0x7f9d1415b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:25.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d11400640 1 -- 172.21.15.31:0/248755029 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d140b2a00 msgr2=0x7f9d140b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:25.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d11400640 1 --2- 172.21.15.31:0/248755029 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d140b2a00 0x7f9d140b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:25.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d11400640 1 -- 172.21.15.31:0/248755029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d1415f340 msgr2=0x7f9d1415b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:25.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d11400640 1 --2- 172.21.15.31:0/248755029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d1415f340 0x7f9d1415b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:25.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d11400640 1 -- 172.21.15.31:0/248755029 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d141574e0 con 0x7f9d140ccf10 2024-09-17T05:35:25.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d11400640 1 --2- 172.21.15.31:0/248755029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d140ccf10 0x7f9d1415a900 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000e9c0 tx=0x7f9d0000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:25.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d0a000640 1 -- 172.21.15.31:0/248755029 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0000cd80 con 0x7f9d140ccf10 2024-09-17T05:35:25.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d0a000640 1 -- 172.21.15.31:0/248755029 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9d00004020 con 0x7f9d140ccf10 2024-09-17T05:35:25.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d0a000640 1 -- 172.21.15.31:0/248755029 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00004450 con 0x7f9d140ccf10 2024-09-17T05:35:25.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d18c00640 1 -- 172.21.15.31:0/248755029 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d1414ded0 con 0x7f9d140ccf10 2024-09-17T05:35:25.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d18c00640 1 -- 172.21.15.31:0/248755029 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d1414e490 con 0x7f9d140ccf10 2024-09-17T05:35:25.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.629+0000 7f9d18c00640 1 -- 172.21.15.31:0/248755029 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d140d0160 con 0x7f9d140ccf10 2024-09-17T05:35:25.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.633+0000 7f9d0a000640 1 -- 172.21.15.31:0/248755029 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f9d00003600 con 0x7f9d140ccf10 2024-09-17T05:35:25.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.633+0000 7f9d0a000640 1 --2- 172.21.15.31:0/248755029 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9cf4073830 0x7f9cf4075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:25.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.633+0000 7f9d0a000640 1 -- 172.21.15.31:0/248755029 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f9d00095860 con 0x7f9d140ccf10 2024-09-17T05:35:25.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.633+0000 7f9d11e00640 1 --2- 172.21.15.31:0/248755029 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9cf4073830 0x7f9cf4075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:25.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.633+0000 7f9d11e00640 1 --2- 172.21.15.31:0/248755029 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9cf4073830 0x7f9cf4075cf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9d040af000 tx=0x7f9d0401b0f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:25.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.637+0000 7f9d0a000640 1 -- 172.21.15.31:0/248755029 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9d0005fef0 con 0x7f9d140ccf10 2024-09-17T05:35:25.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.845+0000 7f9d18c00640 1 -- 172.21.15.31:0/248755029 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target_sub_name": "clone_1", "target": ["mon-mgr", ""]}) -- 0x7f9d140cd3a0 con 0x7f9cf4073830 2024-09-17T05:35:25.855 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:25.853+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:35:25.855 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:25.853+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:35:25.855 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:25.853+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:35:25.855 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:25.853+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:35:25.856 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:25.853+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:35:25.862 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:25.861+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:25.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:25.861+0000 7f9d0a000640 1 -- 172.21.15.31:0/248755029 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f9d140cd3a0 con 0x7f9cf4073830 2024-09-17T05:35:25.862 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:25.872 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:25.872 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status non_existent_subvolume clone_1 2024-09-17T05:35:26.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.021+0000 7ff720400640 1 -- 172.21.15.31:0/3227878012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff700004d50 msgr2=0x7ff7000051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:26.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.021+0000 7ff720400640 1 --2- 172.21.15.31:0/3227878012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff700004d50 0x7ff7000051d0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7ff71000c640 tx=0x7ff71001d320 comp rx=0 tx=0).stop 2024-09-17T05:35:26.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.021+0000 7ff71e400640 1 -- 172.21.15.31:0/3227878012 reap_dead start 2024-09-17T05:35:26.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.021+0000 7ff720400640 1 -- 172.21.15.31:0/3227878012 shutdown_connections 2024-09-17T05:35:26.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.021+0000 7ff720400640 1 -- 172.21.15.31:0/3227878012 >> 172.21.15.31:0/3227878012 conn(0x7ff7180d1dd0 msgr2=0x7ff7180d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:26.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.021+0000 7ff720400640 1 -- 172.21.15.31:0/3227878012 shutdown_connections 2024-09-17T05:35:26.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.021+0000 7ff720400640 1 -- 172.21.15.31:0/3227878012 wait complete. 2024-09-17T05:35:26.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff720400640 1 Processor -- start 2024-09-17T05:35:26.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff720400640 1 -- start start 2024-09-17T05:35:26.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff720400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff700004d50 0x7ff71815f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:26.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff720400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff71806dd30 0x7ff71806f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:26.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff720400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7180b76c0 0x7ff7180b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:26.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff720400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff7180b06d0 con 0x7ff700004d50 2024-09-17T05:35:26.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff720400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff7180b2b90 con 0x7ff7180b76c0 2024-09-17T05:35:26.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff720400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff7180b0cd0 con 0x7ff71806dd30 2024-09-17T05:35:26.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff71da00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff700004d50 0x7ff71815f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:26.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff71da00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff700004d50 0x7ff71815f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37898/0 (socket says 172.21.15.31:37898) 2024-09-17T05:35:26.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff71da00640 1 -- 172.21.15.31:0/1199204472 learned_addr learned my addr 172.21.15.31:0/1199204472 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:26.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff71da00640 1 -- 172.21.15.31:0/1199204472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff71806dd30 msgr2=0x7ff71806f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:26.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff71da00640 1 --2- 172.21.15.31:0/1199204472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff71806dd30 0x7ff71806f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:26.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff71da00640 1 -- 172.21.15.31:0/1199204472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7180b76c0 msgr2=0x7ff7180b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:26.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff71da00640 1 --2- 172.21.15.31:0/1199204472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7180b76c0 0x7ff7180b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:26.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff71da00640 1 -- 172.21.15.31:0/1199204472 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71806e230 con 0x7ff700004d50 2024-09-17T05:35:26.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff71da00640 1 --2- 172.21.15.31:0/1199204472 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff700004d50 0x7ff71815f5d0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7ff70c011ae0 tx=0x7ff70c009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:26.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff715600640 1 -- 172.21.15.31:0/1199204472 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c00fc50 con 0x7ff700004d50 2024-09-17T05:35:26.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff715600640 1 -- 172.21.15.31:0/1199204472 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff70c00fdf0 con 0x7ff700004d50 2024-09-17T05:35:26.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff720400640 1 -- 172.21.15.31:0/1199204472 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff71806e510 con 0x7ff700004d50 2024-09-17T05:35:26.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff715600640 1 -- 172.21.15.31:0/1199204472 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c004280 con 0x7ff700004d50 2024-09-17T05:35:26.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff720400640 1 -- 172.21.15.31:0/1199204472 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff71806ead0 con 0x7ff700004d50 2024-09-17T05:35:26.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.025+0000 7ff720400640 1 -- 172.21.15.31:0/1199204472 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7180b1220 con 0x7ff700004d50 2024-09-17T05:35:26.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.029+0000 7ff715600640 1 -- 172.21.15.31:0/1199204472 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7ff70c003600 con 0x7ff700004d50 2024-09-17T05:35:26.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.029+0000 7ff715600640 1 --2- 172.21.15.31:0/1199204472 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff6f8073860 0x7ff6f8075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:26.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.029+0000 7ff715600640 1 -- 172.21.15.31:0/1199204472 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7ff70c095900 con 0x7ff700004d50 2024-09-17T05:35:26.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.029+0000 7ff71d000640 1 --2- 172.21.15.31:0/1199204472 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff6f8073860 0x7ff6f8075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:26.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.029+0000 7ff71d000640 1 --2- 172.21.15.31:0/1199204472 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff6f8073860 0x7ff6f8075d20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff71815fb10 tx=0x7ff704009670 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:26.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.033+0000 7ff715600640 1 -- 172.21.15.31:0/1199204472 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff70c05ff10 con 0x7ff700004d50 2024-09-17T05:35:26.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.241+0000 7ff720400640 1 -- 172.21.15.31:0/1199204472 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "non_existent_subvolume", "clone_name": "clone_1", "target": ["mon-mgr", ""]}) -- 0x7ff7180d1080 con 0x7ff6f8073860 2024-09-17T05:35:26.246 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:26.245+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:26.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.245+0000 7ff715600640 1 -- 172.21.15.31:0/1199204472 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7ff7180d1080 con 0x7ff6f8073860 2024-09-17T05:35:26.246 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:26.255 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:26.255 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create non_existent_subvolume group_1 2024-09-17T05:35:26.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f1ca00640 1 -- 172.21.15.31:0/122736268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f180cce50 msgr2=0x7f9f18164fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:26.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f1ca00640 1 --2- 172.21.15.31:0/122736268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f180cce50 0x7f9f18164fd0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f9f18074ca0 tx=0x7f9f1001ccf0 comp rx=0 tx=0).stop 2024-09-17T05:35:26.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f1ca00640 1 -- 172.21.15.31:0/122736268 shutdown_connections 2024-09-17T05:35:26.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f1ca00640 1 --2- 172.21.15.31:0/122736268 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f180cce50 0x7f9f18164fd0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:26.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f1ca00640 1 --2- 172.21.15.31:0/122736268 >> v2:172.21.15.155:3300/0 conn(0x7f9f18070960 0x7f9f1806f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:26.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f1ca00640 1 -- 172.21.15.31:0/122736268 >> 172.21.15.31:0/122736268 conn(0x7f9f180b18f0 msgr2=0x7f9f180b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:26.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f1ca00640 1 -- 172.21.15.31:0/122736268 shutdown_connections 2024-09-17T05:35:26.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f1ca00640 1 -- 172.21.15.31:0/122736268 wait complete. 2024-09-17T05:35:26.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f1ca00640 1 Processor -- start 2024-09-17T05:35:26.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f1ca00640 1 -- start start 2024-09-17T05:35:26.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f1ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1806fe00 0x7f9f181640a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:26.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f1ca00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f18070960 0x7f9f1814dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:26.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f1ca00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f180cce50 0x7f9f181f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:26.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f1ca00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9f181680c0 con 0x7f9f1806fe00 2024-09-17T05:35:26.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f1ca00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9f18167f40 con 0x7f9f18070960 2024-09-17T05:35:26.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f1ca00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9f18168240 con 0x7f9f180cce50 2024-09-17T05:35:26.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f15e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1806fe00 0x7f9f181640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:26.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f15e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1806fe00 0x7f9f181640a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37908/0 (socket says 172.21.15.31:37908) 2024-09-17T05:35:26.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f15e00640 1 -- 172.21.15.31:0/788352328 learned_addr learned my addr 172.21.15.31:0/788352328 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:26.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f0fe00640 1 --2- 172.21.15.31:0/788352328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f18070960 0x7f9f1814dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:26.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.405+0000 7f9f16800640 1 --2- 172.21.15.31:0/788352328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f180cce50 0x7f9f181f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:26.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.409+0000 7f9f15e00640 1 -- 172.21.15.31:0/788352328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f180cce50 msgr2=0x7f9f181f81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:26.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.409+0000 7f9f15e00640 1 --2- 172.21.15.31:0/788352328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f180cce50 0x7f9f181f81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:26.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.409+0000 7f9f15e00640 1 -- 172.21.15.31:0/788352328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f18070960 msgr2=0x7f9f1814dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:26.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.409+0000 7f9f15e00640 1 --2- 172.21.15.31:0/788352328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f18070960 0x7f9f1814dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:26.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.409+0000 7f9f15e00640 1 -- 172.21.15.31:0/788352328 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f181f8720 con 0x7f9f1806fe00 2024-09-17T05:35:26.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.409+0000 7f9f0fe00640 1 --2- 172.21.15.31:0/788352328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f18070960 0x7f9f1814dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:26.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.409+0000 7f9f16800640 1 --2- 172.21.15.31:0/788352328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9f180cce50 0x7f9f181f81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:26.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.409+0000 7f9f15e00640 1 --2- 172.21.15.31:0/788352328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9f1806fe00 0x7f9f181640a0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800d980 tx=0x7f9f0800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:26.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.409+0000 7f9f0e000640 1 -- 172.21.15.31:0/788352328 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f08017070 con 0x7f9f1806fe00 2024-09-17T05:35:26.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.409+0000 7f9f0e000640 1 -- 172.21.15.31:0/788352328 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f08004310 con 0x7f9f1806fe00 2024-09-17T05:35:26.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.409+0000 7f9f1ca00640 1 -- 172.21.15.31:0/788352328 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f18163320 con 0x7f9f1806fe00 2024-09-17T05:35:26.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.409+0000 7f9f0e000640 1 -- 172.21.15.31:0/788352328 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f08009c30 con 0x7f9f1806fe00 2024-09-17T05:35:26.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.409+0000 7f9f1ca00640 1 -- 172.21.15.31:0/788352328 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f181638a0 con 0x7f9f1806fe00 2024-09-17T05:35:26.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.409+0000 7f9f1ca00640 1 -- 172.21.15.31:0/788352328 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f18069410 con 0x7f9f1806fe00 2024-09-17T05:35:26.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.409+0000 7f9f0e000640 1 -- 172.21.15.31:0/788352328 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7f9f08003600 con 0x7f9f1806fe00 2024-09-17T05:35:26.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.409+0000 7f9f0e000640 1 --2- 172.21.15.31:0/788352328 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9ef4073830 0x7f9ef4075cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:26.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.409+0000 7f9f0e000640 1 -- 172.21.15.31:0/788352328 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f9f08094fa0 con 0x7f9f1806fe00 2024-09-17T05:35:26.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.413+0000 7f9f0fe00640 1 --2- 172.21.15.31:0/788352328 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9ef4073830 0x7f9ef4075cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:26.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.413+0000 7f9f0fe00640 1 --2- 172.21.15.31:0/788352328 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9ef4073830 0x7f9ef4075cf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9f180729d0 tx=0x7f9f00009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:26.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.413+0000 7f9f0e000640 1 -- 172.21.15.31:0/788352328 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9f181f8720 con 0x7f9f1806fe00 2024-09-17T05:35:26.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.613+0000 7f9f1ca00640 1 -- 172.21.15.31:0/788352328 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7f9f180cd3d0 con 0x7f9ef4073830 2024-09-17T05:35:26.617 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:26.613+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:26.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.617+0000 7f9f0e000640 1 -- 172.21.15.31:0/788352328 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f9f180cd3d0 con 0x7f9ef4073830 2024-09-17T05:35:26.617 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:26.626 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:26.626 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm non_existent_subvolume group_1 2024-09-17T05:35:26.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.777+0000 7fe241c00640 1 -- 172.21.15.31:0/1959534238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23c15bd40 msgr2=0x7fe23c0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:26.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.777+0000 7fe241c00640 1 --2- 172.21.15.31:0/1959534238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23c15bd40 0x7fe23c0d0240 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fe22c009840 tx=0x7fe22c01c820 comp rx=0 tx=0).stop 2024-09-17T05:35:26.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.777+0000 7fe241c00640 1 -- 172.21.15.31:0/1959534238 shutdown_connections 2024-09-17T05:35:26.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.777+0000 7fe241c00640 1 --2- 172.21.15.31:0/1959534238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe23c0b0d10 0x7fe23c0d1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:26.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.777+0000 7fe241c00640 1 --2- 172.21.15.31:0/1959534238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23c15bd40 0x7fe23c0d0240 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:26.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.777+0000 7fe241c00640 1 -- 172.21.15.31:0/1959534238 >> 172.21.15.31:0/1959534238 conn(0x7fe23c09aa10 msgr2=0x7fe23c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:26.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.777+0000 7fe241c00640 1 -- 172.21.15.31:0/1959534238 shutdown_connections 2024-09-17T05:35:26.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.777+0000 7fe241c00640 1 -- 172.21.15.31:0/1959534238 wait complete. 2024-09-17T05:35:26.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.777+0000 7fe241c00640 1 Processor -- start 2024-09-17T05:35:26.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.777+0000 7fe241c00640 1 -- start start 2024-09-17T05:35:26.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.777+0000 7fe241c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe23c0b0d10 0x7fe23c0c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:26.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.777+0000 7fe241c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23c0d20f0 0x7fe23c151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:26.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.777+0000 7fe241c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe23c15bd40 0x7fe23c150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:26.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.777+0000 7fe241c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe23c168d60 con 0x7fe23c0d20f0 2024-09-17T05:35:26.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.777+0000 7fe241c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe23c168be0 con 0x7fe23c15bd40 2024-09-17T05:35:26.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.777+0000 7fe241c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe23c168ee0 con 0x7fe23c0b0d10 2024-09-17T05:35:26.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.781+0000 7fe233e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23c0d20f0 0x7fe23c151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:26.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.781+0000 7fe233e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23c0d20f0 0x7fe23c151930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37932/0 (socket says 172.21.15.31:37932) 2024-09-17T05:35:26.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.781+0000 7fe233e00640 1 -- 172.21.15.31:0/1503529973 learned_addr learned my addr 172.21.15.31:0/1503529973 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:26.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.781+0000 7fe23be00640 1 --2- 172.21.15.31:0/1503529973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe23c0b0d10 0x7fe23c0c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:26.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.781+0000 7fe241200640 1 --2- 172.21.15.31:0/1503529973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe23c15bd40 0x7fe23c150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:26.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.781+0000 7fe233e00640 1 -- 172.21.15.31:0/1503529973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe23c0b0d10 msgr2=0x7fe23c0c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:26.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.781+0000 7fe233e00640 1 --2- 172.21.15.31:0/1503529973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe23c0b0d10 0x7fe23c0c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:26.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.781+0000 7fe233e00640 1 -- 172.21.15.31:0/1503529973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe23c15bd40 msgr2=0x7fe23c150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:26.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.781+0000 7fe233e00640 1 --2- 172.21.15.31:0/1503529973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe23c15bd40 0x7fe23c150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:26.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.781+0000 7fe233e00640 1 -- 172.21.15.31:0/1503529973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe23c0c8530 con 0x7fe23c0d20f0 2024-09-17T05:35:26.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.781+0000 7fe233e00640 1 --2- 172.21.15.31:0/1503529973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23c0d20f0 0x7fe23c151930 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fe22400c970 tx=0x7fe22400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:26.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.785+0000 7fe238c00640 1 -- 172.21.15.31:0/1503529973 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224007c70 con 0x7fe23c0d20f0 2024-09-17T05:35:26.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.785+0000 7fe238c00640 1 -- 172.21.15.31:0/1503529973 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe22400f450 con 0x7fe23c0d20f0 2024-09-17T05:35:26.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.785+0000 7fe238c00640 1 -- 172.21.15.31:0/1503529973 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22400f8a0 con 0x7fe23c0d20f0 2024-09-17T05:35:26.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.785+0000 7fe241c00640 1 -- 172.21.15.31:0/1503529973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe23c0b5cd0 con 0x7fe23c0d20f0 2024-09-17T05:35:26.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.785+0000 7fe241c00640 1 -- 172.21.15.31:0/1503529973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe23c0b6290 con 0x7fe23c0d20f0 2024-09-17T05:35:26.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.785+0000 7fe241c00640 1 -- 172.21.15.31:0/1503529973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe23c0b6490 con 0x7fe23c0d20f0 2024-09-17T05:35:26.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.785+0000 7fe238c00640 1 -- 172.21.15.31:0/1503529973 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 22) ==== 97795+0+0 (secure 0 0 0) 0x7fe22400fa40 con 0x7fe23c0d20f0 2024-09-17T05:35:26.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.785+0000 7fe238c00640 1 --2- 172.21.15.31:0/1503529973 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe218073860 0x7fe218075d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:26.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.785+0000 7fe238c00640 1 -- 172.21.15.31:0/1503529973 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7fe224095640 con 0x7fe23c0d20f0 2024-09-17T05:35:26.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.789+0000 7fe23be00640 1 --2- 172.21.15.31:0/1503529973 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe218073860 0x7fe218075d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:26.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.789+0000 7fe23be00640 1 --2- 172.21.15.31:0/1503529973 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe218073860 0x7fe218075d20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0ae000 tx=0x7fe22c01b060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:26.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.793+0000 7fe238c00640 1 -- 172.21.15.31:0/1503529973 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe23c0b6490 con 0x7fe23c0d20f0 2024-09-17T05:35:26.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.797+0000 7fe238c00640 1 -- 172.21.15.31:0/1503529973 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7fe22405b7c0 con 0x7fe23c0d20f0 2024-09-17T05:35:26.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.997+0000 7fe241c00640 1 -- 172.21.15.31:0/1503529973 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7fe23c0d1bb0 con 0x7fe218073860 2024-09-17T05:35:26.998 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:26.997+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:26.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:26.997+0000 7fe238c00640 1 -- 172.21.15.31:0/1503529973 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fe23c0d1bb0 con 0x7fe218073860 2024-09-17T05:35:26.999 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:27.008 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:27.009 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup getpath non_existent_subvolume group_1 2024-09-17T05:35:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.157+0000 7ff1b7800640 1 -- 172.21.15.31:0/2541668653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1b01605d0 msgr2=0x7ff1b00d0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.157+0000 7ff1b7800640 1 --2- 172.21.15.31:0/2541668653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1b01605d0 0x7ff1b00d0690 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009840 tx=0x7ff1a001c820 comp rx=0 tx=0).stop 2024-09-17T05:35:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.157+0000 7ff1b7800640 1 -- 172.21.15.31:0/2541668653 shutdown_connections 2024-09-17T05:35:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.157+0000 7ff1b7800640 1 --2- 172.21.15.31:0/2541668653 >> v2:172.21.15.155:3300/0 conn(0x7ff1b00afb10 0x7ff1b00affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.157+0000 7ff1b7800640 1 --2- 172.21.15.31:0/2541668653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1b01605d0 0x7ff1b00d0690 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.157+0000 7ff1b7800640 1 -- 172.21.15.31:0/2541668653 >> 172.21.15.31:0/2541668653 conn(0x7ff1b00d1dd0 msgr2=0x7ff1b00d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.157+0000 7ff1b7800640 1 -- 172.21.15.31:0/2541668653 shutdown_connections 2024-09-17T05:35:27.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.157+0000 7ff1b7800640 1 -- 172.21.15.31:0/2541668653 wait complete. 2024-09-17T05:35:27.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b7800640 1 Processor -- start 2024-09-17T05:35:27.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b7800640 1 -- start start 2024-09-17T05:35:27.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b7800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1b00afb10 0x7ff1b00b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b7800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1b00b1650 0x7ff1b00b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b7800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1b01605d0 0x7ff1b00b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b7800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b00b13a0 con 0x7ff1b01605d0 2024-09-17T05:35:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b7800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b00b1220 con 0x7ff1b00b1650 2024-09-17T05:35:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b7800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b0169540 con 0x7ff1b00afb10 2024-09-17T05:35:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b5800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1b01605d0 0x7ff1b00b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b5800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1b01605d0 0x7ff1b00b5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37942/0 (socket says 172.21.15.31:37942) 2024-09-17T05:35:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b5800640 1 -- 172.21.15.31:0/2568959839 learned_addr learned my addr 172.21.15.31:0/2568959839 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b4e00640 1 --2- 172.21.15.31:0/2568959839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1b00afb10 0x7ff1b00b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:27.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1a7e00640 1 --2- 172.21.15.31:0/2568959839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1b00b1650 0x7ff1b00b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:27.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b5800640 1 -- 172.21.15.31:0/2568959839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1b00afb10 msgr2=0x7ff1b00b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:27.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b5800640 1 --2- 172.21.15.31:0/2568959839 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1b00afb10 0x7ff1b00b68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:27.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b5800640 1 -- 172.21.15.31:0/2568959839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1b00b1650 msgr2=0x7ff1b00b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:27.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b5800640 1 --2- 172.21.15.31:0/2568959839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1b00b1650 0x7ff1b00b5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:27.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b5800640 1 -- 172.21.15.31:0/2568959839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b0153170 con 0x7ff1b01605d0 2024-09-17T05:35:27.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b5800640 1 --2- 172.21.15.31:0/2568959839 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1b01605d0 0x7ff1b00b5c70 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800efd0 tx=0x7ff1a800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:27.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1ad600640 1 -- 172.21.15.31:0/2568959839 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8003b80 con 0x7ff1b01605d0 2024-09-17T05:35:27.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1ad600640 1 -- 172.21.15.31:0/2568959839 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1a8003d20 con 0x7ff1b01605d0 2024-09-17T05:35:27.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1ad600640 1 -- 172.21.15.31:0/2568959839 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8004280 con 0x7ff1b01605d0 2024-09-17T05:35:27.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b7800640 1 -- 172.21.15.31:0/2568959839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b0155720 con 0x7ff1b01605d0 2024-09-17T05:35:27.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.161+0000 7ff1b7800640 1 -- 172.21.15.31:0/2568959839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b0155440 con 0x7ff1b01605d0 2024-09-17T05:35:27.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.165+0000 7ff1b7800640 1 -- 172.21.15.31:0/2568959839 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1b00affc0 con 0x7ff1b01605d0 2024-09-17T05:35:27.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.165+0000 7ff1ad600640 1 -- 172.21.15.31:0/2568959839 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7ff1a8004420 con 0x7ff1b01605d0 2024-09-17T05:35:27.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.165+0000 7ff1ad600640 1 --2- 172.21.15.31:0/2568959839 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff18c0738c0 0x7ff18c075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:27.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.165+0000 7ff1ad600640 1 -- 172.21.15.31:0/2568959839 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7ff1a8095ae0 con 0x7ff1b01605d0 2024-09-17T05:35:27.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.165+0000 7ff1b4e00640 1 --2- 172.21.15.31:0/2568959839 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff18c0738c0 0x7ff18c075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:27.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.165+0000 7ff1b4e00640 1 --2- 172.21.15.31:0/2568959839 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff18c0738c0 0x7ff18c075d80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00af000 tx=0x7ff1a001b060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:27.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.169+0000 7ff1ad600640 1 -- 172.21.15.31:0/2568959839 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff1a805fb40 con 0x7ff1b01605d0 2024-09-17T05:35:27.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.373+0000 7ff1b7800640 1 -- 172.21.15.31:0/2568959839 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup getpath", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7ff1b00d1080 con 0x7ff18c0738c0 2024-09-17T05:35:27.376 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:27.373+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:27.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.373+0000 7ff1ad600640 1 -- 172.21.15.31:0/2568959839 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7ff1b00d1080 con 0x7ff18c0738c0 2024-09-17T05:35:27.376 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:27.384 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:27.385 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup pin non_existent_subvolume group_1 export 0 2024-09-17T05:35:27.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.533+0000 7f078d600640 1 -- 172.21.15.31:0/2387775359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f078815a7e0 msgr2=0x7f07880ae4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:27.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.533+0000 7f078d600640 1 --2- 172.21.15.31:0/2387775359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f078815a7e0 0x7f07880ae4d0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f0778009900 tx=0x7f077801c8e0 comp rx=0 tx=0).stop 2024-09-17T05:35:27.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.533+0000 7f078d600640 1 -- 172.21.15.31:0/2387775359 shutdown_connections 2024-09-17T05:35:27.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.533+0000 7f078d600640 1 --2- 172.21.15.31:0/2387775359 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07880d1350 0x7f07880b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:27.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.533+0000 7f078d600640 1 --2- 172.21.15.31:0/2387775359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f078815a7e0 0x7f07880ae4d0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:27.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.533+0000 7f078d600640 1 -- 172.21.15.31:0/2387775359 >> 172.21.15.31:0/2387775359 conn(0x7f078806dd30 msgr2=0x7f078806e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:27.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.533+0000 7f078d600640 1 -- 172.21.15.31:0/2387775359 shutdown_connections 2024-09-17T05:35:27.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.533+0000 7f078d600640 1 -- 172.21.15.31:0/2387775359 wait complete. 2024-09-17T05:35:27.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f078d600640 1 Processor -- start 2024-09-17T05:35:27.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f078d600640 1 -- start start 2024-09-17T05:35:27.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f078d600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07880aea10 0x7f0788145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:27.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f078d600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07880d1350 0x7f0788164440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:27.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f078d600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f078815a7e0 0x7f0788164980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:27.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f078d600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f07881680a0 con 0x7f07880d1350 2024-09-17T05:35:27.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f078d600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0788167f20 con 0x7f078815a7e0 2024-09-17T05:35:27.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f078d600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0788168220 con 0x7f07880aea10 2024-09-17T05:35:27.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f077e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07880d1350 0x7f0788164440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:27.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f077e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07880d1350 0x7f0788164440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37958/0 (socket says 172.21.15.31:37958) 2024-09-17T05:35:27.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f077e000640 1 -- 172.21.15.31:0/332640050 learned_addr learned my addr 172.21.15.31:0/332640050 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:27.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f0786a00640 1 --2- 172.21.15.31:0/332640050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07880aea10 0x7f0788145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:27.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f0787400640 1 --2- 172.21.15.31:0/332640050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f078815a7e0 0x7f0788164980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:27.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f077e000640 1 -- 172.21.15.31:0/332640050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07880aea10 msgr2=0x7f0788145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:27.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f077e000640 1 --2- 172.21.15.31:0/332640050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07880aea10 0x7f0788145ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:27.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f077e000640 1 -- 172.21.15.31:0/332640050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f078815a7e0 msgr2=0x7f0788164980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:27.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f077e000640 1 --2- 172.21.15.31:0/332640050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f078815a7e0 0x7f0788164980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:27.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f077e000640 1 -- 172.21.15.31:0/332640050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0788146010 con 0x7f07880d1350 2024-09-17T05:35:27.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f077e000640 1 --2- 172.21.15.31:0/332640050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07880d1350 0x7f0788164440 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f077000c500 tx=0x7f077000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:27.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f077f400640 1 -- 172.21.15.31:0/332640050 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770017070 con 0x7f07880d1350 2024-09-17T05:35:27.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f077f400640 1 -- 172.21.15.31:0/332640050 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07700053c0 con 0x7f07880d1350 2024-09-17T05:35:27.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f077f400640 1 -- 172.21.15.31:0/332640050 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770012890 con 0x7f07880d1350 2024-09-17T05:35:27.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f078d600640 1 -- 172.21.15.31:0/332640050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0788146580 con 0x7f07880d1350 2024-09-17T05:35:27.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.537+0000 7f078d600640 1 -- 172.21.15.31:0/332640050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0788146b40 con 0x7f07880d1350 2024-09-17T05:35:27.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.541+0000 7f078d600640 1 -- 172.21.15.31:0/332640050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07880b48f0 con 0x7f07880d1350 2024-09-17T05:35:27.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.541+0000 7f077f400640 1 -- 172.21.15.31:0/332640050 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f077001a070 con 0x7f07880d1350 2024-09-17T05:35:27.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.541+0000 7f077f400640 1 --2- 172.21.15.31:0/332640050 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f07640738c0 0x7f0764075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:27.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.541+0000 7f077f400640 1 -- 172.21.15.31:0/332640050 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f0770094240 con 0x7f07880d1350 2024-09-17T05:35:27.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.541+0000 7f0786a00640 1 --2- 172.21.15.31:0/332640050 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f07640738c0 0x7f0764075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:27.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.541+0000 7f0786a00640 1 --2- 172.21.15.31:0/332640050 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f07640738c0 0x7f0764075d80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f07780af000 tx=0x7f077801b120 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:27.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.545+0000 7f077f400640 1 -- 172.21.15.31:0/332640050 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f077005e120 con 0x7f07880d1350 2024-09-17T05:35:27.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.749+0000 7f078d600640 1 -- 172.21.15.31:0/332640050 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "non_existent_subvolume", "group_name": "group_1", "pin_type": "export", "pin_setting": "0", "target": ["mon-mgr", ""]}) -- 0x7f078806d760 con 0x7f07640738c0 2024-09-17T05:35:27.750 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:27.749+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:27.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.749+0000 7f077f400640 1 -- 172.21.15.31:0/332640050 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f078806d760 con 0x7f07640738c0 2024-09-17T05:35:27.751 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:27.760 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:27.760 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup ls non_existent_subvolume 2024-09-17T05:35:27.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.909+0000 7fa091a00640 1 -- 172.21.15.31:0/1664329558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa08c0cadf0 msgr2=0x7fa08c074050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:27.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.909+0000 7fa091a00640 1 --2- 172.21.15.31:0/1664329558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa08c0cadf0 0x7fa08c074050 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fa074009840 tx=0x7fa07401c820 comp rx=0 tx=0).stop 2024-09-17T05:35:27.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.909+0000 7fa091a00640 1 -- 172.21.15.31:0/1664329558 shutdown_connections 2024-09-17T05:35:27.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.909+0000 7fa091a00640 1 --2- 172.21.15.31:0/1664329558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa08c074590 0x7fa08c0cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:27.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.909+0000 7fa091a00640 1 --2- 172.21.15.31:0/1664329558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa08c0cadf0 0x7fa08c074050 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:27.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.909+0000 7fa091a00640 1 -- 172.21.15.31:0/1664329558 >> 172.21.15.31:0/1664329558 conn(0x7fa08c0cfc20 msgr2=0x7fa08c0d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:27.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.909+0000 7fa091a00640 1 -- 172.21.15.31:0/1664329558 shutdown_connections 2024-09-17T05:35:27.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.909+0000 7fa091a00640 1 -- 172.21.15.31:0/1664329558 wait complete. 2024-09-17T05:35:27.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.909+0000 7fa091a00640 1 Processor -- start 2024-09-17T05:35:27.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.909+0000 7fa091a00640 1 -- start start 2024-09-17T05:35:27.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.909+0000 7fa091a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa08c074590 0x7fa08c14fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:27.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.909+0000 7fa091a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa08c0cadf0 0x7fa08c155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:27.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.909+0000 7fa091a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa08c1564d0 0x7fa08c1484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:27.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.909+0000 7fa091a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c0cec00 con 0x7fa08c1564d0 2024-09-17T05:35:27.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.909+0000 7fa091a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c0cea80 con 0x7fa08c0cadf0 2024-09-17T05:35:27.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.909+0000 7fa091a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa08c0ced80 con 0x7fa08c074590 2024-09-17T05:35:27.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa08b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa08c1564d0 0x7fa08c1484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:27.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa083e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa08c0cadf0 0x7fa08c155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:27.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa08b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa08c1564d0 0x7fa08c1484e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37966/0 (socket says 172.21.15.31:37966) 2024-09-17T05:35:27.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa083e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa08c0cadf0 0x7fa08c155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:36758/0 (socket says 172.21.15.31:36758) 2024-09-17T05:35:27.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa08b400640 1 -- 172.21.15.31:0/1239586425 learned_addr learned my addr 172.21.15.31:0/1239586425 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:27.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa08aa00640 1 --2- 172.21.15.31:0/1239586425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa08c074590 0x7fa08c14fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:27.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa08b400640 1 -- 172.21.15.31:0/1239586425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa08c074590 msgr2=0x7fa08c14fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:27.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa08b400640 1 --2- 172.21.15.31:0/1239586425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa08c074590 0x7fa08c14fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:27.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa08b400640 1 -- 172.21.15.31:0/1239586425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa08c0cadf0 msgr2=0x7fa08c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:27.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa08b400640 1 --2- 172.21.15.31:0/1239586425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa08c0cadf0 0x7fa08c155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:27.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa08b400640 1 -- 172.21.15.31:0/1239586425 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08c14a450 con 0x7fa08c1564d0 2024-09-17T05:35:27.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa08b400640 1 --2- 172.21.15.31:0/1239586425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa08c1564d0 0x7fa08c1484e0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fa08400ea20 tx=0x7fa08400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:27.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa082a00640 1 -- 172.21.15.31:0/1239586425 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08400cde0 con 0x7fa08c1564d0 2024-09-17T05:35:27.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa082a00640 1 -- 172.21.15.31:0/1239586425 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa084004c40 con 0x7fa08c1564d0 2024-09-17T05:35:27.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa082a00640 1 -- 172.21.15.31:0/1239586425 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084005280 con 0x7fa08c1564d0 2024-09-17T05:35:27.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa091a00640 1 -- 172.21.15.31:0/1239586425 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08c15d800 con 0x7fa08c1564d0 2024-09-17T05:35:27.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa091a00640 1 -- 172.21.15.31:0/1239586425 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa08c14a170 con 0x7fa08c1564d0 2024-09-17T05:35:27.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa091a00640 1 -- 172.21.15.31:0/1239586425 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa08c15d9d0 con 0x7fa08c1564d0 2024-09-17T05:35:27.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.913+0000 7fa082a00640 1 -- 172.21.15.31:0/1239586425 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7fa084005420 con 0x7fa08c1564d0 2024-09-17T05:35:27.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.917+0000 7fa082a00640 1 --2- 172.21.15.31:0/1239586425 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa0680738c0 0x7fa068075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:27.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.917+0000 7fa082a00640 1 -- 172.21.15.31:0/1239586425 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7fa084095d20 con 0x7fa08c1564d0 2024-09-17T05:35:27.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.917+0000 7fa08aa00640 1 --2- 172.21.15.31:0/1239586425 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa0680738c0 0x7fa068075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:27.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.917+0000 7fa08aa00640 1 --2- 172.21.15.31:0/1239586425 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa0680738c0 0x7fa068075d80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0af830 tx=0x7fa07c0013a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:27.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:27.917+0000 7fa082a00640 1 -- 172.21.15.31:0/1239586425 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa084016030 con 0x7fa08c1564d0 2024-09-17T05:35:28.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.117+0000 7fa091a00640 1 -- 172.21.15.31:0/1239586425 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup ls", "vol_name": "non_existent_subvolume", "target": ["mon-mgr", ""]}) -- 0x7fa08c0cb8b0 con 0x7fa0680738c0 2024-09-17T05:35:28.120 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:28.117+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:28.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.117+0000 7fa082a00640 1 -- 172.21.15.31:0/1239586425 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fa08c0cb8b0 con 0x7fa0680738c0 2024-09-17T05:35:28.120 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:28.129 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:28.130 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot create non_existent_subvolume group_1 snapshot_1 2024-09-17T05:35:28.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586f800640 1 -- 172.21.15.31:0/2129405795 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5868070580 msgr2=0x7f586806ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:28.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586f800640 1 --2- 172.21.15.31:0/2129405795 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5868070580 0x7f586806ef10 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f5860009840 tx=0x7f586001c790 comp rx=0 tx=0).stop 2024-09-17T05:35:28.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586f800640 1 -- 172.21.15.31:0/2129405795 shutdown_connections 2024-09-17T05:35:28.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586f800640 1 --2- 172.21.15.31:0/2129405795 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5868070580 0x7f586806ef10 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:28.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586f800640 1 -- 172.21.15.31:0/2129405795 >> 172.21.15.31:0/2129405795 conn(0x7f58680d0000 msgr2=0x7f58680d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:28.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586f800640 1 -- 172.21.15.31:0/2129405795 shutdown_connections 2024-09-17T05:35:28.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586f800640 1 -- 172.21.15.31:0/2129405795 wait complete. 2024-09-17T05:35:28.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586f800640 1 Processor -- start 2024-09-17T05:35:28.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586f800640 1 -- start start 2024-09-17T05:35:28.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586f800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5868070580 0x7f58680c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:28.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586f800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58680cb250 0x7f58680c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:28.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586f800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f586815f890 0x7f58680c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:28.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586f800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f58681698a0 con 0x7f586815f890 2024-09-17T05:35:28.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586f800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5868169720 con 0x7f58680cb250 2024-09-17T05:35:28.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586f800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5868169a20 con 0x7f5868070580 2024-09-17T05:35:28.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586d800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f586815f890 0x7f58680c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:28.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586d800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f586815f890 0x7f58680c3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37986/0 (socket says 172.21.15.31:37986) 2024-09-17T05:35:28.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586d800640 1 -- 172.21.15.31:0/2751600746 learned_addr learned my addr 172.21.15.31:0/2751600746 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:28.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586ce00640 1 --2- 172.21.15.31:0/2751600746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5868070580 0x7f58680c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:28.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f5867e00640 1 --2- 172.21.15.31:0/2751600746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58680cb250 0x7f58680c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:28.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586d800640 1 -- 172.21.15.31:0/2751600746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5868070580 msgr2=0x7f58680c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:28.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586d800640 1 --2- 172.21.15.31:0/2751600746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5868070580 0x7f58680c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:28.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586d800640 1 -- 172.21.15.31:0/2751600746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58680cb250 msgr2=0x7f58680c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:28.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586d800640 1 --2- 172.21.15.31:0/2751600746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f58680cb250 0x7f58680c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:28.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586d800640 1 -- 172.21.15.31:0/2751600746 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58680c7950 con 0x7f586815f890 2024-09-17T05:35:28.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.281+0000 7f586ce00640 1 --2- 172.21.15.31:0/2751600746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5868070580 0x7f58680c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:28.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.285+0000 7f586d800640 1 --2- 172.21.15.31:0/2751600746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f586815f890 0x7f58680c3b30 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f586001a3c0 tx=0x7f58600a56c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:28.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.285+0000 7f5864c00640 1 -- 172.21.15.31:0/2751600746 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58600bb070 con 0x7f586815f890 2024-09-17T05:35:28.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.285+0000 7f5864c00640 1 -- 172.21.15.31:0/2751600746 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5860005030 con 0x7f586815f890 2024-09-17T05:35:28.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.285+0000 7f5864c00640 1 -- 172.21.15.31:0/2751600746 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58600b2040 con 0x7f586815f890 2024-09-17T05:35:28.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.285+0000 7f586f800640 1 -- 172.21.15.31:0/2751600746 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58680c4070 con 0x7f586815f890 2024-09-17T05:35:28.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.285+0000 7f586f800640 1 -- 172.21.15.31:0/2751600746 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58680afef0 con 0x7f586815f890 2024-09-17T05:35:28.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.285+0000 7f586f800640 1 -- 172.21.15.31:0/2751600746 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58680d0d00 con 0x7f586815f890 2024-09-17T05:35:28.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.285+0000 7f5864c00640 1 -- 172.21.15.31:0/2751600746 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f58600be070 con 0x7f586815f890 2024-09-17T05:35:28.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.285+0000 7f5864c00640 1 --2- 172.21.15.31:0/2751600746 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f58480738c0 0x7f5848075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:28.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.285+0000 7f5864c00640 1 -- 172.21.15.31:0/2751600746 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f586012e6b0 con 0x7f586815f890 2024-09-17T05:35:28.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.285+0000 7f586ce00640 1 --2- 172.21.15.31:0/2751600746 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f58480738c0 0x7f5848075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:28.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.289+0000 7f586ce00640 1 --2- 172.21.15.31:0/2751600746 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f58480738c0 0x7f5848075d80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f585c0045c0 tx=0x7f585c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:28.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.289+0000 7f5864c00640 1 -- 172.21.15.31:0/2751600746 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f58680c4070 con 0x7f586815f890 2024-09-17T05:35:28.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.493+0000 7f586f800640 1 -- 172.21.15.31:0/2751600746 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot create", "vol_name": "non_existent_subvolume", "group_name": "group_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f586806eef0 con 0x7f58480738c0 2024-09-17T05:35:28.496 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:28.493+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:28.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.493+0000 7f5864c00640 1 -- 172.21.15.31:0/2751600746 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f586806eef0 con 0x7f58480738c0 2024-09-17T05:35:28.497 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:28.506 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:28.506 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot rm non_existent_subvolume group_1 snapshot_1 2024-09-17T05:35:28.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d5b600640 1 -- 172.21.15.31:0/1220611781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d540b0b60 msgr2=0x7f6d54166eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:28.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d5b600640 1 --2- 172.21.15.31:0/1220611781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d540b0b60 0x7f6d54166eb0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009c80 tx=0x7f6d4c01f5a0 comp rx=0 tx=0).stop 2024-09-17T05:35:28.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d5b600640 1 -- 172.21.15.31:0/1220611781 shutdown_connections 2024-09-17T05:35:28.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d5b600640 1 --2- 172.21.15.31:0/1220611781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d540b0b60 0x7f6d54166eb0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:28.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d5b600640 1 -- 172.21.15.31:0/1220611781 >> 172.21.15.31:0/1220611781 conn(0x7f6d540d1da0 msgr2=0x7f6d540d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:28.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d5b600640 1 -- 172.21.15.31:0/1220611781 shutdown_connections 2024-09-17T05:35:28.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d5b600640 1 -- 172.21.15.31:0/1220611781 wait complete. 2024-09-17T05:35:28.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d5b600640 1 Processor -- start 2024-09-17T05:35:28.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d5b600640 1 -- start start 2024-09-17T05:35:28.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d5b600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d540b0b60 0x7f6d541505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:28.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d5b600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d5415be10 0x7f6d5406f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:28.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d5b600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d5415c1f0 0x7f6d540b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:28.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d5b600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6d541673f0 con 0x7f6d540b0b60 2024-09-17T05:35:28.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d5b600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6d540cddf0 con 0x7f6d5415be10 2024-09-17T05:35:28.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d5b600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6d54167570 con 0x7f6d5415c1f0 2024-09-17T05:35:28.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d58c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d540b0b60 0x7f6d541505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:28.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d58c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d540b0b60 0x7f6d541505b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41800/0 (socket says 172.21.15.31:41800) 2024-09-17T05:35:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d58c00640 1 -- 172.21.15.31:0/3845589959 learned_addr learned my addr 172.21.15.31:0/3845589959 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.657+0000 7f6d53e00640 1 --2- 172.21.15.31:0/3845589959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d5415be10 0x7f6d5406f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.661+0000 7f6d59600640 1 --2- 172.21.15.31:0/3845589959 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d5415c1f0 0x7f6d540b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.661+0000 7f6d58c00640 1 -- 172.21.15.31:0/3845589959 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d5415c1f0 msgr2=0x7f6d540b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.661+0000 7f6d58c00640 1 --2- 172.21.15.31:0/3845589959 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d5415c1f0 0x7f6d540b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.661+0000 7f6d58c00640 1 -- 172.21.15.31:0/3845589959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d5415be10 msgr2=0x7f6d5406f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.661+0000 7f6d58c00640 1 --2- 172.21.15.31:0/3845589959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d5415be10 0x7f6d5406f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.661+0000 7f6d58c00640 1 -- 172.21.15.31:0/3845589959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5406dd30 con 0x7f6d540b0b60 2024-09-17T05:35:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.661+0000 7f6d53e00640 1 --2- 172.21.15.31:0/3845589959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d5415be10 0x7f6d5406f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.661+0000 7f6d59600640 1 --2- 172.21.15.31:0/3845589959 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d5415c1f0 0x7f6d540b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.661+0000 7f6d58c00640 1 --2- 172.21.15.31:0/3845589959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d540b0b60 0x7f6d541505b0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800c4e0 tx=0x7f6d4800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.661+0000 7f6d50c00640 1 -- 172.21.15.31:0/3845589959 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d480052d0 con 0x7f6d540b0b60 2024-09-17T05:35:28.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.661+0000 7f6d50c00640 1 -- 172.21.15.31:0/3845589959 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d48005470 con 0x7f6d540b0b60 2024-09-17T05:35:28.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.661+0000 7f6d5b600640 1 -- 172.21.15.31:0/3845589959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d5414ef70 con 0x7f6d540b0b60 2024-09-17T05:35:28.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.661+0000 7f6d50c00640 1 -- 172.21.15.31:0/3845589959 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48012890 con 0x7f6d540b0b60 2024-09-17T05:35:28.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.661+0000 7f6d5b600640 1 -- 172.21.15.31:0/3845589959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d5406e2b0 con 0x7f6d540b0b60 2024-09-17T05:35:28.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.661+0000 7f6d5b600640 1 -- 172.21.15.31:0/3845589959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d540ce700 con 0x7f6d540b0b60 2024-09-17T05:35:28.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.661+0000 7f6d50c00640 1 -- 172.21.15.31:0/3845589959 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f6d48003600 con 0x7f6d540b0b60 2024-09-17T05:35:28.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.661+0000 7f6d50c00640 1 --2- 172.21.15.31:0/3845589959 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d340738c0 0x7f6d34075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:28.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.665+0000 7f6d50c00640 1 -- 172.21.15.31:0/3845589959 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f6d48094980 con 0x7f6d540b0b60 2024-09-17T05:35:28.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.665+0000 7f6d53e00640 1 --2- 172.21.15.31:0/3845589959 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d340738c0 0x7f6d34075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.665+0000 7f6d53e00640 1 --2- 172.21.15.31:0/3845589959 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d340738c0 0x7f6d34075d80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6d541582a0 tx=0x7f6d40009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:28.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.665+0000 7f6d50c00640 1 -- 172.21.15.31:0/3845589959 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6d4805f0c0 con 0x7f6d540b0b60 2024-09-17T05:35:28.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.869+0000 7f6d5b600640 1 -- 172.21.15.31:0/3845589959 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot rm", "vol_name": "non_existent_subvolume", "group_name": "group_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f6d5406e7d0 con 0x7f6d340738c0 2024-09-17T05:35:28.873 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:28.873+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:28.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:28.873+0000 7f6d50c00640 1 -- 172.21.15.31:0/3845589959 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f6d40001310 con 0x7f6d340738c0 2024-09-17T05:35:28.874 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:28.882 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:28.883 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot ls non_existent_subvolume group_1 2024-09-17T05:35:29.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.033+0000 7f6dde000640 1 -- 172.21.15.31:0/860636478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dd80cff00 msgr2=0x7f6dd80d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:29.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.033+0000 7f6dde000640 1 --2- 172.21.15.31:0/860636478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dd80cff00 0x7f6dd80d28c0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f6dd806dc00 tx=0x7f6dcc01c890 comp rx=0 tx=0).stop 2024-09-17T05:35:29.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.033+0000 7f6dde000640 1 -- 172.21.15.31:0/860636478 shutdown_connections 2024-09-17T05:35:29.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.033+0000 7f6dde000640 1 --2- 172.21.15.31:0/860636478 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd815eff0 0x7f6dd815f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:29.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.033+0000 7f6dde000640 1 --2- 172.21.15.31:0/860636478 >> v2:172.21.15.155:3300/0 conn(0x7f6dd80d02e0 0x7f6dd80d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:29.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.033+0000 7f6dde000640 1 --2- 172.21.15.31:0/860636478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dd80cff00 0x7f6dd80d28c0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:29.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.033+0000 7f6dde000640 1 -- 172.21.15.31:0/860636478 >> 172.21.15.31:0/860636478 conn(0x7f6dd80d1da0 msgr2=0x7f6dd80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:29.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.033+0000 7f6dde000640 1 -- 172.21.15.31:0/860636478 shutdown_connections 2024-09-17T05:35:29.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.033+0000 7f6dde000640 1 -- 172.21.15.31:0/860636478 wait complete. 2024-09-17T05:35:29.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.033+0000 7f6dde000640 1 Processor -- start 2024-09-17T05:35:29.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.033+0000 7f6dde000640 1 -- start start 2024-09-17T05:35:29.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6dde000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dd80cff00 0x7f6dd80ce660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:29.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6dde000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd80d02e0 0x7f6dd81f8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:29.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6dde000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dd815eff0 0x7f6dd81f9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:29.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6dde000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd80afa10 con 0x7f6dd80cff00 2024-09-17T05:35:29.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6dde000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd80b2230 con 0x7f6dd815eff0 2024-09-17T05:35:29.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6dde000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd80afb90 con 0x7f6dd80d02e0 2024-09-17T05:35:29.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6ddcc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dd80cff00 0x7f6dd80ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:29.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6ddcc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dd80cff00 0x7f6dd80ce660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41814/0 (socket says 172.21.15.31:41814) 2024-09-17T05:35:29.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6ddcc00640 1 -- 172.21.15.31:0/4118677784 learned_addr learned my addr 172.21.15.31:0/4118677784 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:29.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6ddcc00640 1 -- 172.21.15.31:0/4118677784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd80d02e0 msgr2=0x7f6dd81f8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:29.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6ddcc00640 1 --2- 172.21.15.31:0/4118677784 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd80d02e0 0x7f6dd81f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:29.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6ddcc00640 1 -- 172.21.15.31:0/4118677784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dd815eff0 msgr2=0x7f6dd81f9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:29.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6ddcc00640 1 --2- 172.21.15.31:0/4118677784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dd815eff0 0x7f6dd81f9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:29.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6ddcc00640 1 -- 172.21.15.31:0/4118677784 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd8150760 con 0x7f6dd80cff00 2024-09-17T05:35:29.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6ddcc00640 1 --2- 172.21.15.31:0/4118677784 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6dd80cff00 0x7f6dd80ce660 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0b0040 tx=0x7f6dcc0041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:29.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6dd4c00640 1 -- 172.21.15.31:0/4118677784 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc0b2040 con 0x7f6dd80cff00 2024-09-17T05:35:29.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6dd4c00640 1 -- 172.21.15.31:0/4118677784 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dcc005030 con 0x7f6dd80cff00 2024-09-17T05:35:29.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6dde000640 1 -- 172.21.15.31:0/4118677784 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd814fec0 con 0x7f6dd80cff00 2024-09-17T05:35:29.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6dd4c00640 1 -- 172.21.15.31:0/4118677784 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc005480 con 0x7f6dd80cff00 2024-09-17T05:35:29.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6dde000640 1 -- 172.21.15.31:0/4118677784 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd8150480 con 0x7f6dd80cff00 2024-09-17T05:35:29.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.037+0000 7f6dde000640 1 -- 172.21.15.31:0/4118677784 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd80d0720 con 0x7f6dd80cff00 2024-09-17T05:35:29.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.041+0000 7f6dd4c00640 1 -- 172.21.15.31:0/4118677784 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f6dcc0bd060 con 0x7f6dd80cff00 2024-09-17T05:35:29.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.041+0000 7f6dd4c00640 1 --2- 172.21.15.31:0/4118677784 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6db80738c0 0x7f6db8075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:29.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.041+0000 7f6dd4c00640 1 -- 172.21.15.31:0/4118677784 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f6dcc12e530 con 0x7f6dd80cff00 2024-09-17T05:35:29.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.041+0000 7f6dd7e00640 1 --2- 172.21.15.31:0/4118677784 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6db80738c0 0x7f6db8075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:29.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.041+0000 7f6dd7e00640 1 --2- 172.21.15.31:0/4118677784 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6db80738c0 0x7f6db8075d80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6dd815c570 tx=0x7f6dc4006ca0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:29.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.045+0000 7f6dd4c00640 1 -- 172.21.15.31:0/4118677784 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6dcc0164b0 con 0x7f6dd80cff00 2024-09-17T05:35:29.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.245+0000 7f6dde000640 1 -- 172.21.15.31:0/4118677784 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot ls", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7f6dd8069e60 con 0x7f6db80738c0 2024-09-17T05:35:29.247 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:29.245+0000 7f46f6e00640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:35:29.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.245+0000 7f6dd4c00640 1 -- 172.21.15.31:0/4118677784 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f6dc4013400 con 0x7f6db80738c0 2024-09-17T05:35:29.248 INFO:teuthology.orchestra.run.smithi031.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:35:29.257 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:35:29.258 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:35:29.258 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:35:29.339 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:35:29.443 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:35:29.444 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:35:29.444 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:35:29.444 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:35:29.453 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:35:29.453 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:35:29.505 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:35:29.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f4a800640 1 -- 172.21.15.31:0/2835509189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f4415bea0 msgr2=0x7f5f440ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:29.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f4a800640 1 --2- 172.21.15.31:0/2835509189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f4415bea0 0x7f5f440ce670 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f5f44073d10 tx=0x7f5f3401c830 comp rx=0 tx=0).stop 2024-09-17T05:35:29.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f4a800640 1 -- 172.21.15.31:0/2835509189 shutdown_connections 2024-09-17T05:35:29.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f4a800640 1 --2- 172.21.15.31:0/2835509189 >> v2:172.21.15.155:3300/0 conn(0x7f5f440cdb30 0x7f5f440cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:29.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f4a800640 1 --2- 172.21.15.31:0/2835509189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f4415bea0 0x7f5f440ce670 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:29.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f4a800640 1 -- 172.21.15.31:0/2835509189 >> 172.21.15.31:0/2835509189 conn(0x7f5f440d1dc0 msgr2=0x7f5f440d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:29.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f4a800640 1 -- 172.21.15.31:0/2835509189 shutdown_connections 2024-09-17T05:35:29.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f4a800640 1 -- 172.21.15.31:0/2835509189 wait complete. 2024-09-17T05:35:29.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f4a800640 1 Processor -- start 2024-09-17T05:35:29.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f4a800640 1 -- start start 2024-09-17T05:35:29.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f4a800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f440cdb30 0x7f5f4409eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f4a800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f440d28e0 0x7f5f440c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f4a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f4415bea0 0x7f5f440b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f4a800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5f44168fc0 con 0x7f5f4415bea0 2024-09-17T05:35:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f4a800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5f44168e40 con 0x7f5f440cdb30 2024-09-17T05:35:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f4a800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5f44169140 con 0x7f5f440d28e0 2024-09-17T05:35:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f43e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f4415bea0 0x7f5f440b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f43e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f4415bea0 0x7f5f440b27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41830/0 (socket says 172.21.15.31:41830) 2024-09-17T05:35:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f43e00640 1 -- 172.21.15.31:0/1183219991 learned_addr learned my addr 172.21.15.31:0/1183219991 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f43e00640 1 -- 172.21.15.31:0/1183219991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f440d28e0 msgr2=0x7f5f440c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f43e00640 1 --2- 172.21.15.31:0/1183219991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f440d28e0 0x7f5f440c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f43400640 1 --2- 172.21.15.31:0/1183219991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f440cdb30 0x7f5f4409eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f43e00640 1 -- 172.21.15.31:0/1183219991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f440cdb30 msgr2=0x7f5f4409eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f43e00640 1 --2- 172.21.15.31:0/1183219991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f440cdb30 0x7f5f4409eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f43e00640 1 -- 172.21.15.31:0/1183219991 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f441f7440 con 0x7f5f4415bea0 2024-09-17T05:35:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.697+0000 7f5f43400640 1 --2- 172.21.15.31:0/1183219991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f440cdb30 0x7f5f4409eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.701+0000 7f5f43e00640 1 --2- 172.21.15.31:0/1183219991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f4415bea0 0x7f5f440b27c0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00c7c0 tx=0x7f5f3c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.701+0000 7f5f3b400640 1 -- 172.21.15.31:0/1183219991 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c003b80 con 0x7f5f4415bea0 2024-09-17T05:35:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.701+0000 7f5f3b400640 1 -- 172.21.15.31:0/1183219991 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f3c003d20 con 0x7f5f4415bea0 2024-09-17T05:35:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.701+0000 7f5f4a800640 1 -- 172.21.15.31:0/1183219991 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f441f81c0 con 0x7f5f4415bea0 2024-09-17T05:35:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.701+0000 7f5f3b400640 1 -- 172.21.15.31:0/1183219991 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c00aab0 con 0x7f5f4415bea0 2024-09-17T05:35:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.701+0000 7f5f4a800640 1 -- 172.21.15.31:0/1183219991 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f441f7ca0 con 0x7f5f4415bea0 2024-09-17T05:35:29.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.701+0000 7f5f4a800640 1 -- 172.21.15.31:0/1183219991 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f441f77f0 con 0x7f5f4415bea0 2024-09-17T05:35:29.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.701+0000 7f5f3b400640 1 -- 172.21.15.31:0/1183219991 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f5f3c00ac50 con 0x7f5f4415bea0 2024-09-17T05:35:29.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.701+0000 7f5f3b400640 1 --2- 172.21.15.31:0/1183219991 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5f200738c0 0x7f5f20075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:29.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.701+0000 7f5f3b400640 1 -- 172.21.15.31:0/1183219991 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f5f3c094cd0 con 0x7f5f4415bea0 2024-09-17T05:35:29.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.701+0000 7f5f43400640 1 --2- 172.21.15.31:0/1183219991 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5f200738c0 0x7f5f20075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:29.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.705+0000 7f5f43400640 1 --2- 172.21.15.31:0/1183219991 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5f200738c0 0x7f5f20075d80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5f340af000 tx=0x7f5f3401b070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:29.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.705+0000 7f5f3b400640 1 -- 172.21.15.31:0/1183219991 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5f3c05f410 con 0x7f5f4415bea0 2024-09-17T05:35:29.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.893+0000 7f5f4a800640 1 -- 172.21.15.31:0/1183219991 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5f440cc9d0 con 0x7f5f4415bea0 2024-09-17T05:35:29.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.893+0000 7f5f3b400640 1 -- 172.21.15.31:0/1183219991 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v130) ==== 80+0+0 (secure 0 0 0) 0x7f5f3c05ed10 con 0x7f5f4415bea0 2024-09-17T05:35:29.896 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:35:29.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.897+0000 7f5f4a800640 1 -- 172.21.15.31:0/1183219991 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5f200738c0 msgr2=0x7f5f20075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:29.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.897+0000 7f5f4a800640 1 --2- 172.21.15.31:0/1183219991 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5f200738c0 0x7f5f20075d80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5f340af000 tx=0x7f5f3401b070 comp rx=0 tx=0).stop 2024-09-17T05:35:29.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.897+0000 7f5f4a800640 1 -- 172.21.15.31:0/1183219991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f4415bea0 msgr2=0x7f5f440b27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:29.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.897+0000 7f5f4a800640 1 --2- 172.21.15.31:0/1183219991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f4415bea0 0x7f5f440b27c0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00c7c0 tx=0x7f5f3c00cc80 comp rx=0 tx=0).stop 2024-09-17T05:35:29.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.897+0000 7f5f4a800640 1 -- 172.21.15.31:0/1183219991 shutdown_connections 2024-09-17T05:35:29.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.897+0000 7f5f4a800640 1 --2- 172.21.15.31:0/1183219991 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5f200738c0 0x7f5f20075d80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:29.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.897+0000 7f5f4a800640 1 --2- 172.21.15.31:0/1183219991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f4415bea0 0x7f5f440b27c0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:29.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.897+0000 7f5f4a800640 1 --2- 172.21.15.31:0/1183219991 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5f440d28e0 0x7f5f440c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:29.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.897+0000 7f5f4a800640 1 --2- 172.21.15.31:0/1183219991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f440cdb30 0x7f5f4409eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:29.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.897+0000 7f5f4a800640 1 -- 172.21.15.31:0/1183219991 >> 172.21.15.31:0/1183219991 conn(0x7f5f440d1dc0 msgr2=0x7f5f440b52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:29.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.897+0000 7f5f4a800640 1 -- 172.21.15.31:0/1183219991 shutdown_connections 2024-09-17T05:35:29.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:29.897+0000 7f5f4a800640 1 -- 172.21.15.31:0/1183219991 wait complete. 2024-09-17T05:35:29.920 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:35:29.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:29.920 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:35:29.947 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:35:29.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:29.947 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:35:30.002 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:35:30.003 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:35:30.003 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:35:30.013 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:35:30.013 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:35:30.066 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:35:30.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.213+0000 7fead7e00640 1 -- 172.21.15.31:0/1274471594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feab8004d50 msgr2=0x7feab80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:30.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.213+0000 7fead7e00640 1 --2- 172.21.15.31:0/1274471594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feab8004d50 0x7feab80051d0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7feac8009ef0 tx=0x7feac801d5f0 comp rx=0 tx=0).stop 2024-09-17T05:35:30.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.213+0000 7fead5e00640 1 -- 172.21.15.31:0/1274471594 reap_dead start 2024-09-17T05:35:30.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.213+0000 7fead7e00640 1 -- 172.21.15.31:0/1274471594 shutdown_connections 2024-09-17T05:35:30.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.213+0000 7fead7e00640 1 -- 172.21.15.31:0/1274471594 >> 172.21.15.31:0/1274471594 conn(0x7fead00d1dc0 msgr2=0x7fead00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:30.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.213+0000 7fead7e00640 1 -- 172.21.15.31:0/1274471594 shutdown_connections 2024-09-17T05:35:30.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.213+0000 7fead7e00640 1 -- 172.21.15.31:0/1274471594 wait complete. 2024-09-17T05:35:30.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.213+0000 7fead7e00640 1 Processor -- start 2024-09-17T05:35:30.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.213+0000 7fead7e00640 1 -- start start 2024-09-17T05:35:30.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead7e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feab8004d50 0x7fead01eb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:30.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead00b7570 0x7fead00b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:30.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead7e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fead00d0d60 0x7fead00d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:30.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead7e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fead00b0770 con 0x7fead00b7570 2024-09-17T05:35:30.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead7e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fead00b05f0 con 0x7fead00d0d60 2024-09-17T05:35:30.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead7e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fead00b08f0 con 0x7feab8004d50 2024-09-17T05:35:30.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead4a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead00b7570 0x7fead00b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:30.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead4a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead00b7570 0x7fead00b6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41860/0 (socket says 172.21.15.31:41860) 2024-09-17T05:35:30.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead4a00640 1 -- 172.21.15.31:0/3363588778 learned_addr learned my addr 172.21.15.31:0/3363588778 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:30.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead5400640 1 --2- 172.21.15.31:0/3363588778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feab8004d50 0x7fead01eb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:30.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead5e00640 1 --2- 172.21.15.31:0/3363588778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fead00d0d60 0x7fead00d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:30.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead4a00640 1 -- 172.21.15.31:0/3363588778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feab8004d50 msgr2=0x7fead01eb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:30.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead4a00640 1 --2- 172.21.15.31:0/3363588778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feab8004d50 0x7fead01eb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:30.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead4a00640 1 -- 172.21.15.31:0/3363588778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fead00d0d60 msgr2=0x7fead00d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:30.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead4a00640 1 --2- 172.21.15.31:0/3363588778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fead00d0d60 0x7fead00d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:30.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead4a00640 1 -- 172.21.15.31:0/3363588778 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead00b6ed0 con 0x7fead00b7570 2024-09-17T05:35:30.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead4a00640 1 --2- 172.21.15.31:0/3363588778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead00b7570 0x7fead00b6990 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7feabc006660 tx=0x7feabc0039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:30.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7feacd600640 1 -- 172.21.15.31:0/3363588778 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc015070 con 0x7fead00b7570 2024-09-17T05:35:30.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7feacd600640 1 -- 172.21.15.31:0/3363588778 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feabc011900 con 0x7fead00b7570 2024-09-17T05:35:30.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7feacd600640 1 -- 172.21.15.31:0/3363588778 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc011d50 con 0x7fead00b7570 2024-09-17T05:35:30.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead7e00640 1 -- 172.21.15.31:0/3363588778 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead01eaba0 con 0x7fead00b7570 2024-09-17T05:35:30.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead7e00640 1 -- 172.21.15.31:0/3363588778 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead01eb160 con 0x7fead00b7570 2024-09-17T05:35:30.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.217+0000 7fead7e00640 1 -- 172.21.15.31:0/3363588778 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fead006ec80 con 0x7fead00b7570 2024-09-17T05:35:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.221+0000 7feacd600640 1 -- 172.21.15.31:0/3363588778 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7feabc018070 con 0x7fead00b7570 2024-09-17T05:35:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.221+0000 7feacd600640 1 --2- 172.21.15.31:0/3363588778 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7feab00738c0 0x7feab0075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.221+0000 7feacd600640 1 -- 172.21.15.31:0/3363588778 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7feabc095c30 con 0x7fead00b7570 2024-09-17T05:35:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.221+0000 7fead5400640 1 --2- 172.21.15.31:0/3363588778 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7feab00738c0 0x7feab0075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:30.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.221+0000 7fead5400640 1 --2- 172.21.15.31:0/3363588778 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7feab00738c0 0x7feab0075d80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feac4009c60 tx=0x7feac40091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:30.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.225+0000 7feacd600640 1 -- 172.21.15.31:0/3363588778 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7feabc05fb90 con 0x7fead00b7570 2024-09-17T05:35:30.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.413+0000 7fead7e00640 1 -- 172.21.15.31:0/3363588778 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fead0163ac0 con 0x7fead00b7570 2024-09-17T05:35:30.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.413+0000 7feacd600640 1 -- 172.21.15.31:0/3363588778 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v130) ==== 80+0+0 (secure 0 0 0) 0x7feabc0645c0 con 0x7fead00b7570 2024-09-17T05:35:30.414 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:35:30.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.413+0000 7fead7e00640 1 -- 172.21.15.31:0/3363588778 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7feab00738c0 msgr2=0x7feab0075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:30.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.413+0000 7fead7e00640 1 --2- 172.21.15.31:0/3363588778 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7feab00738c0 0x7feab0075d80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7feac4009c60 tx=0x7feac40091e0 comp rx=0 tx=0).stop 2024-09-17T05:35:30.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.413+0000 7fead7e00640 1 -- 172.21.15.31:0/3363588778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead00b7570 msgr2=0x7fead00b6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:30.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.413+0000 7fead7e00640 1 --2- 172.21.15.31:0/3363588778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead00b7570 0x7fead00b6990 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7feabc006660 tx=0x7feabc0039d0 comp rx=0 tx=0).stop 2024-09-17T05:35:30.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.413+0000 7fead7e00640 1 -- 172.21.15.31:0/3363588778 shutdown_connections 2024-09-17T05:35:30.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.413+0000 7fead7e00640 1 --2- 172.21.15.31:0/3363588778 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7feab00738c0 0x7feab0075d80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:30.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.413+0000 7fead7e00640 1 --2- 172.21.15.31:0/3363588778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fead00d0d60 0x7fead00d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:30.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.413+0000 7fead7e00640 1 --2- 172.21.15.31:0/3363588778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead00b7570 0x7fead00b6990 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:30.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.413+0000 7fead7e00640 1 --2- 172.21.15.31:0/3363588778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feab8004d50 0x7fead01eb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:30.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.413+0000 7fead7e00640 1 -- 172.21.15.31:0/3363588778 >> 172.21.15.31:0/3363588778 conn(0x7fead00d1dc0 msgr2=0x7fead00715b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:30.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.413+0000 7fead7e00640 1 -- 172.21.15.31:0/3363588778 shutdown_connections 2024-09-17T05:35:30.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.413+0000 7fead7e00640 1 -- 172.21.15.31:0/3363588778 wait complete. 2024-09-17T05:35:30.437 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T05:35:30.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:30.437 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T05:35:30.464 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:35:30.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:30.464 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:35:30.514 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:35:30.514 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:35:30.514 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:35:30.524 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:35:30.524 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:35:30.525 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:35:30.525 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:35:30.570 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:35:30.571 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:35:30.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.717+0000 7ff0bf000640 1 -- 172.21.15.31:0/3889161822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c0051d0 msgr2=0x7ff09c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:30.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.717+0000 7ff0bf000640 1 --2- 172.21.15.31:0/3889161822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c0051d0 0x7ff09c00b9d0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0001dc0 tx=0x7ff0b001cb30 comp rx=0 tx=0).stop 2024-09-17T05:35:30.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.717+0000 7ff0bf000640 1 -- 172.21.15.31:0/3889161822 shutdown_connections 2024-09-17T05:35:30.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.717+0000 7ff0bf000640 1 --2- 172.21.15.31:0/3889161822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c0051d0 0x7ff09c00b9d0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:30.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.717+0000 7ff0bf000640 1 -- 172.21.15.31:0/3889161822 >> 172.21.15.31:0/3889161822 conn(0x7ff0b80d0c90 msgr2=0x7ff0b80d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:30.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.717+0000 7ff0bf000640 1 -- 172.21.15.31:0/3889161822 shutdown_connections 2024-09-17T05:35:30.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.717+0000 7ff0bf000640 1 -- 172.21.15.31:0/3889161822 wait complete. 2024-09-17T05:35:30.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.717+0000 7ff0bf000640 1 Processor -- start 2024-09-17T05:35:30.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.717+0000 7ff0bf000640 1 -- start start 2024-09-17T05:35:30.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.717+0000 7ff0bf000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c0051d0 0x7ff0b81f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:30.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.717+0000 7ff0bf000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b8155bc0 0x7ff0b8156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:30.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.717+0000 7ff0bf000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b8156580 0x7ff0b80a0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:30.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.717+0000 7ff0bf000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b80d0140 con 0x7ff09c0051d0 2024-09-17T05:35:30.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.717+0000 7ff0bf000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b80cffc0 con 0x7ff0b8156580 2024-09-17T05:35:30.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.717+0000 7ff0bf000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b80d02c0 con 0x7ff0b8155bc0 2024-09-17T05:35:30.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0b7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c0051d0 0x7ff0b81f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:30.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0b7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c0051d0 0x7ff0b81f5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41872/0 (socket says 172.21.15.31:41872) 2024-09-17T05:35:30.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0b7e00640 1 -- 172.21.15.31:0/3066920704 learned_addr learned my addr 172.21.15.31:0/3066920704 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:30.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0b7400640 1 --2- 172.21.15.31:0/3066920704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b8155bc0 0x7ff0b8156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:30.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0bd000640 1 --2- 172.21.15.31:0/3066920704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b8156580 0x7ff0b80a0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:30.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0b7e00640 1 -- 172.21.15.31:0/3066920704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b8155bc0 msgr2=0x7ff0b8156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:30.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0b7e00640 1 --2- 172.21.15.31:0/3066920704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b8155bc0 0x7ff0b8156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:30.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0b7e00640 1 -- 172.21.15.31:0/3066920704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b8156580 msgr2=0x7ff0b80a0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:30.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0b7e00640 1 --2- 172.21.15.31:0/3066920704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b8156580 0x7ff0b80a0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:30.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0b7e00640 1 -- 172.21.15.31:0/3066920704 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b81f4f60 con 0x7ff09c0051d0 2024-09-17T05:35:30.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0bd000640 1 --2- 172.21.15.31:0/3066920704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b8156580 0x7ff0b80a0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:30.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0b7e00640 1 --2- 172.21.15.31:0/3066920704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c0051d0 0x7ff0b81f5410 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8011ae0 tx=0x7ff0a8011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:30.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0afe00640 1 -- 172.21.15.31:0/3066920704 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8004440 con 0x7ff09c0051d0 2024-09-17T05:35:30.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0afe00640 1 -- 172.21.15.31:0/3066920704 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0a800f9a0 con 0x7ff09c0051d0 2024-09-17T05:35:30.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0afe00640 1 -- 172.21.15.31:0/3066920704 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a800fdf0 con 0x7ff09c0051d0 2024-09-17T05:35:30.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0bf000640 1 -- 172.21.15.31:0/3066920704 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b80a03e0 con 0x7ff09c0051d0 2024-09-17T05:35:30.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0bf000640 1 -- 172.21.15.31:0/3066920704 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b80a09a0 con 0x7ff09c0051d0 2024-09-17T05:35:30.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0bf000640 1 -- 172.21.15.31:0/3066920704 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0b8073e50 con 0x7ff09c0051d0 2024-09-17T05:35:30.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.721+0000 7ff0afe00640 1 -- 172.21.15.31:0/3066920704 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7ff0a8003600 con 0x7ff09c0051d0 2024-09-17T05:35:30.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.725+0000 7ff0afe00640 1 --2- 172.21.15.31:0/3066920704 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff0980738c0 0x7ff098075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:30.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.725+0000 7ff0afe00640 1 -- 172.21.15.31:0/3066920704 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7ff0a8095e50 con 0x7ff09c0051d0 2024-09-17T05:35:30.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.725+0000 7ff0b7400640 1 --2- 172.21.15.31:0/3066920704 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff0980738c0 0x7ff098075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:30.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.725+0000 7ff0b7400640 1 --2- 172.21.15.31:0/3066920704 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff0980738c0 0x7ff098075d80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4001870 tx=0x7ff0a4006040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:30.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.729+0000 7ff0afe00640 1 -- 172.21.15.31:0/3066920704 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff0a8060500 con 0x7ff09c0051d0 2024-09-17T05:35:30.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.941+0000 7ff0bf000640 1 -- 172.21.15.31:0/3066920704 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0b80a01b0 con 0x7ff09c0051d0 2024-09-17T05:35:30.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.941+0000 7ff0afe00640 1 -- 172.21.15.31:0/3066920704 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5233 (secure 0 0 0) 0x7ff0a805fe00 con 0x7ff09c0051d0 2024-09-17T05:35:30.944 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:30.944 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":91,"btime":"2024-09-17T05:35:19:749695+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7456,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/2107257547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107257547},{"type":"v1","addr":"172.21.15.155:6834","nonce":2107257547}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1645548958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1645548958},{"type":"v1","addr":"172.21.15.31:6834","nonce":1645548958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7836,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1284373927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1284373927},{"type":"v1","addr":"172.21.15.31:6835","nonce":1284373927}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:35:10.110294+0000","modified":"2024-09-17T05:35:13.121372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7848},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7848":{"gid":7848,"name":"b","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1879117968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1879117968},{"type":"v1","addr":"172.21.15.155:6835","nonce":1879117968}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7848,"qdb_cluster":[7848]},"id":10}]} 2024-09-17T05:35:30.945 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 91 2024-09-17T05:35:30.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.945+0000 7ff0bf000640 1 -- 172.21.15.31:0/3066920704 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff0980738c0 msgr2=0x7ff098075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:30.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.945+0000 7ff0bf000640 1 --2- 172.21.15.31:0/3066920704 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff0980738c0 0x7ff098075d80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4001870 tx=0x7ff0a4006040 comp rx=0 tx=0).stop 2024-09-17T05:35:30.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.945+0000 7ff0bf000640 1 -- 172.21.15.31:0/3066920704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c0051d0 msgr2=0x7ff0b81f5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:30.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.945+0000 7ff0bf000640 1 --2- 172.21.15.31:0/3066920704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c0051d0 0x7ff0b81f5410 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8011ae0 tx=0x7ff0a8011ee0 comp rx=0 tx=0).stop 2024-09-17T05:35:30.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.945+0000 7ff0bf000640 1 -- 172.21.15.31:0/3066920704 shutdown_connections 2024-09-17T05:35:30.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.945+0000 7ff0bf000640 1 --2- 172.21.15.31:0/3066920704 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff0980738c0 0x7ff098075d80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:30.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.945+0000 7ff0bf000640 1 --2- 172.21.15.31:0/3066920704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b8156580 0x7ff0b80a0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:30.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.945+0000 7ff0bf000640 1 --2- 172.21.15.31:0/3066920704 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0b8155bc0 0x7ff0b8156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:30.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.945+0000 7ff0bf000640 1 --2- 172.21.15.31:0/3066920704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff09c0051d0 0x7ff0b81f5410 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:30.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.945+0000 7ff0bf000640 1 -- 172.21.15.31:0/3066920704 >> 172.21.15.31:0/3066920704 conn(0x7ff0b80d0c90 msgr2=0x7ff0b8070790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:30.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.945+0000 7ff0bf000640 1 -- 172.21.15.31:0/3066920704 shutdown_connections 2024-09-17T05:35:30.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:30.945+0000 7ff0bf000640 1 -- 172.21.15.31:0/3066920704 wait complete. 2024-09-17T05:35:30.968 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:35:31.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.113+0000 7fddd6600640 1 -- 172.21.15.31:0/1501722945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd015c130 msgr2=0x7fddd00ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:31.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.113+0000 7fddd6600640 1 --2- 172.21.15.31:0/1501722945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd015c130 0x7fddd00ceb20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fddb8009840 tx=0x7fddb801c700 comp rx=0 tx=0).stop 2024-09-17T05:35:31.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.113+0000 7fddd6600640 1 -- 172.21.15.31:0/1501722945 shutdown_connections 2024-09-17T05:35:31.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.113+0000 7fddd6600640 1 --2- 172.21.15.31:0/1501722945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd015c130 0x7fddd00ceb20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.113+0000 7fddd6600640 1 --2- 172.21.15.31:0/1501722945 >> v2:172.21.15.155:3300/0 conn(0x7fddd015bd50 0x7fddd00ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.113+0000 7fddd6600640 1 -- 172.21.15.31:0/1501722945 >> 172.21.15.31:0/1501722945 conn(0x7fddd00d1ea0 msgr2=0x7fddd00d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:31.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.113+0000 7fddd6600640 1 -- 172.21.15.31:0/1501722945 shutdown_connections 2024-09-17T05:35:31.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.113+0000 7fddd6600640 1 -- 172.21.15.31:0/1501722945 wait complete. 2024-09-17T05:35:31.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.113+0000 7fddd6600640 1 Processor -- start 2024-09-17T05:35:31.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.113+0000 7fddd6600640 1 -- start start 2024-09-17T05:35:31.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddd6600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd00cf4e0 0x7fddd0149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:31.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddd6600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddd015bd50 0x7fddd015ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:31.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddd6600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddd015c130 0x7fddd015b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:31.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddd6600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fddd0168e50 con 0x7fddd015bd50 2024-09-17T05:35:31.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddd6600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fddd0168cd0 con 0x7fddd015c130 2024-09-17T05:35:31.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddd6600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fddd0168fd0 con 0x7fddd00cf4e0 2024-09-17T05:35:31.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddc6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddd015bd50 0x7fddd015ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:31.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddc6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddd015bd50 0x7fddd015ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41888/0 (socket says 172.21.15.31:41888) 2024-09-17T05:35:31.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddc6a00640 1 -- 172.21.15.31:0/1893071213 learned_addr learned my addr 172.21.15.31:0/1893071213 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:31.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddcfe00640 1 --2- 172.21.15.31:0/1893071213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddd015c130 0x7fddd015b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:31.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddcf400640 1 --2- 172.21.15.31:0/1893071213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd00cf4e0 0x7fddd0149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:31.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddc6a00640 1 -- 172.21.15.31:0/1893071213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd00cf4e0 msgr2=0x7fddd0149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:31.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddc6a00640 1 --2- 172.21.15.31:0/1893071213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd00cf4e0 0x7fddd0149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddc6a00640 1 -- 172.21.15.31:0/1893071213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddd015c130 msgr2=0x7fddd015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:31.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddc6a00640 1 --2- 172.21.15.31:0/1893071213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddd015c130 0x7fddd015b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddc6a00640 1 -- 172.21.15.31:0/1893071213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd00b7db0 con 0x7fddd015bd50 2024-09-17T05:35:31.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddc6a00640 1 --2- 172.21.15.31:0/1893071213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddd015bd50 0x7fddd015ad90 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fddb8009790 tx=0x7fddb80a6750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:31.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddc7e00640 1 -- 172.21.15.31:0/1893071213 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb8004350 con 0x7fddd015bd50 2024-09-17T05:35:31.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddc7e00640 1 -- 172.21.15.31:0/1893071213 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fddb8003600 con 0x7fddd015bd50 2024-09-17T05:35:31.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddd6600640 1 -- 172.21.15.31:0/1893071213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd01f7770 con 0x7fddd015bd50 2024-09-17T05:35:31.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddc7e00640 1 -- 172.21.15.31:0/1893071213 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb8003a10 con 0x7fddd015bd50 2024-09-17T05:35:31.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddd6600640 1 -- 172.21.15.31:0/1893071213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd01f7a10 con 0x7fddd015bd50 2024-09-17T05:35:31.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.117+0000 7fddd6600640 1 -- 172.21.15.31:0/1893071213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd00c5dd0 con 0x7fddd015bd50 2024-09-17T05:35:31.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.121+0000 7fddc7e00640 1 -- 172.21.15.31:0/1893071213 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7fddb80bf020 con 0x7fddd015bd50 2024-09-17T05:35:31.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.121+0000 7fddc7e00640 1 --2- 172.21.15.31:0/1893071213 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fddac0738c0 0x7fddac075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:31.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.121+0000 7fddc7e00640 1 -- 172.21.15.31:0/1893071213 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7fddb812f6b0 con 0x7fddd015bd50 2024-09-17T05:35:31.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.121+0000 7fddcf400640 1 --2- 172.21.15.31:0/1893071213 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fddac0738c0 0x7fddac075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:31.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.121+0000 7fddcf400640 1 --2- 172.21.15.31:0/1893071213 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fddac0738c0 0x7fddac075d80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fddd009ece0 tx=0x7fddc00091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:31.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.125+0000 7fddc7e00640 1 -- 172.21.15.31:0/1893071213 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fddb80c6020 con 0x7fddd015bd50 2024-09-17T05:35:31.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.337+0000 7fddd6600640 1 -- 172.21.15.31:0/1893071213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddd0076360 con 0x7fddd015bd50 2024-09-17T05:35:31.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.337+0000 7fddc7e00640 1 -- 172.21.15.31:0/1893071213 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5233 (secure 0 0 0) 0x7fddb8016410 con 0x7fddd015bd50 2024-09-17T05:35:31.339 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:31.339 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":91,"btime":"2024-09-17T05:35:19:749695+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7456,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/2107257547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107257547},{"type":"v1","addr":"172.21.15.155:6834","nonce":2107257547}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1645548958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1645548958},{"type":"v1","addr":"172.21.15.31:6834","nonce":1645548958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7836,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1284373927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1284373927},{"type":"v1","addr":"172.21.15.31:6835","nonce":1284373927}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:35:10.110294+0000","modified":"2024-09-17T05:35:13.121372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7848},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7848":{"gid":7848,"name":"b","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1879117968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1879117968},{"type":"v1","addr":"172.21.15.155:6835","nonce":1879117968}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7848,"qdb_cluster":[7848]},"id":10}]} 2024-09-17T05:35:31.340 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 91 2024-09-17T05:35:31.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.337+0000 7fddd6600640 1 -- 172.21.15.31:0/1893071213 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fddac0738c0 msgr2=0x7fddac075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:31.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.337+0000 7fddd6600640 1 --2- 172.21.15.31:0/1893071213 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fddac0738c0 0x7fddac075d80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fddd009ece0 tx=0x7fddc00091e0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.337+0000 7fddd6600640 1 -- 172.21.15.31:0/1893071213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddd015bd50 msgr2=0x7fddd015ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:31.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.337+0000 7fddd6600640 1 --2- 172.21.15.31:0/1893071213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddd015bd50 0x7fddd015ad90 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fddb8009790 tx=0x7fddb80a6750 comp rx=0 tx=0).stop 2024-09-17T05:35:31.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.341+0000 7fddd6600640 1 -- 172.21.15.31:0/1893071213 shutdown_connections 2024-09-17T05:35:31.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.341+0000 7fddd6600640 1 --2- 172.21.15.31:0/1893071213 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fddac0738c0 0x7fddac075d80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.341+0000 7fddd6600640 1 --2- 172.21.15.31:0/1893071213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fddd015c130 0x7fddd015b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.341+0000 7fddd6600640 1 --2- 172.21.15.31:0/1893071213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddd015bd50 0x7fddd015ad90 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.341+0000 7fddd6600640 1 --2- 172.21.15.31:0/1893071213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fddd00cf4e0 0x7fddd0149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.341+0000 7fddd6600640 1 -- 172.21.15.31:0/1893071213 >> 172.21.15.31:0/1893071213 conn(0x7fddd00d1ea0 msgr2=0x7fddd00d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:31.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.341+0000 7fddd6600640 1 -- 172.21.15.31:0/1893071213 shutdown_connections 2024-09-17T05:35:31.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.341+0000 7fddd6600640 1 -- 172.21.15.31:0/1893071213 wait complete. 2024-09-17T05:35:31.362 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:35:31.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28b6e00640 1 -- 172.21.15.31:0/4084071156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b00cd0d0 msgr2=0x7f28b00cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:31.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28b6e00640 1 --2- 172.21.15.31:0/4084071156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b00cd0d0 0x7f28b00cebf0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009c80 tx=0x7f28a801cd70 comp rx=0 tx=0).stop 2024-09-17T05:35:31.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28b6e00640 1 -- 172.21.15.31:0/4084071156 shutdown_connections 2024-09-17T05:35:31.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28b6e00640 1 --2- 172.21.15.31:0/4084071156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b00cd0d0 0x7f28b00cebf0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28b6e00640 1 --2- 172.21.15.31:0/4084071156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28b00b3300 0x7f28b015f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28b6e00640 1 -- 172.21.15.31:0/4084071156 >> 172.21.15.31:0/4084071156 conn(0x7f28b00b18f0 msgr2=0x7f28b00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:31.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28b6e00640 1 -- 172.21.15.31:0/4084071156 shutdown_connections 2024-09-17T05:35:31.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28b6e00640 1 -- 172.21.15.31:0/4084071156 wait complete. 2024-09-17T05:35:31.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28b6e00640 1 Processor -- start 2024-09-17T05:35:31.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28b6e00640 1 -- start start 2024-09-17T05:35:31.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28b6e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b00b3300 0x7f28b0072eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:31.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28b6e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28b00cd0d0 0x7f28b014b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:31.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28b6e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28b015af90 0x7f28b01f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:31.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28b6e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f28b0167d50 con 0x7f28b00b3300 2024-09-17T05:35:31.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28b6e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f28b0167ed0 con 0x7f28b00cd0d0 2024-09-17T05:35:31.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28b6e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f28b0168050 con 0x7f28b015af90 2024-09-17T05:35:31.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28afe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b00b3300 0x7f28b0072eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:31.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28afe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b00b3300 0x7f28b0072eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41916/0 (socket says 172.21.15.31:41916) 2024-09-17T05:35:31.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28afe00640 1 -- 172.21.15.31:0/3389894605 learned_addr learned my addr 172.21.15.31:0/3389894605 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:31.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28a7400640 1 --2- 172.21.15.31:0/3389894605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28b00cd0d0 0x7f28b014b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:31.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28b4e00640 1 --2- 172.21.15.31:0/3389894605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28b015af90 0x7f28b01f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:31.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28afe00640 1 -- 172.21.15.31:0/3389894605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28b015af90 msgr2=0x7f28b01f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:31.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28afe00640 1 --2- 172.21.15.31:0/3389894605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28b015af90 0x7f28b01f6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28afe00640 1 -- 172.21.15.31:0/3389894605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28b00cd0d0 msgr2=0x7f28b014b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:31.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28afe00640 1 --2- 172.21.15.31:0/3389894605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28b00cd0d0 0x7f28b014b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28afe00640 1 -- 172.21.15.31:0/3389894605 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b01f8fd0 con 0x7f28b00b3300 2024-09-17T05:35:31.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.509+0000 7f28a7400640 1 --2- 172.21.15.31:0/3389894605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28b00cd0d0 0x7f28b014b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:31.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.513+0000 7f28afe00640 1 --2- 172.21.15.31:0/3389894605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b00b3300 0x7f28b0072eb0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f28a000b410 tx=0x7f28a000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:31.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.513+0000 7f28acc00640 1 -- 172.21.15.31:0/3389894605 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a0015030 con 0x7f28b00b3300 2024-09-17T05:35:31.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.513+0000 7f28acc00640 1 -- 172.21.15.31:0/3389894605 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28a0004020 con 0x7f28b00b3300 2024-09-17T05:35:31.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.513+0000 7f28b6e00640 1 -- 172.21.15.31:0/3389894605 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b01f9290 con 0x7f28b00b3300 2024-09-17T05:35:31.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.513+0000 7f28acc00640 1 -- 172.21.15.31:0/3389894605 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a0004470 con 0x7f28b00b3300 2024-09-17T05:35:31.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.513+0000 7f28b6e00640 1 -- 172.21.15.31:0/3389894605 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b0150860 con 0x7f28b00b3300 2024-09-17T05:35:31.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.513+0000 7f28b6e00640 1 -- 172.21.15.31:0/3389894605 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28b0069410 con 0x7f28b00b3300 2024-09-17T05:35:31.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.513+0000 7f28acc00640 1 -- 172.21.15.31:0/3389894605 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f28a0018070 con 0x7f28b00b3300 2024-09-17T05:35:31.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.513+0000 7f28acc00640 1 --2- 172.21.15.31:0/3389894605 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f288c0738c0 0x7f288c075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:31.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.513+0000 7f28acc00640 1 -- 172.21.15.31:0/3389894605 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f28a0094ad0 con 0x7f28b00b3300 2024-09-17T05:35:31.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.513+0000 7f28a7400640 1 --2- 172.21.15.31:0/3389894605 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f288c0738c0 0x7f288c075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:31.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.517+0000 7f28a7400640 1 --2- 172.21.15.31:0/3389894605 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f288c0738c0 0x7f288c075d80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f28b009d180 tx=0x7f289800b2c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:31.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.517+0000 7f28acc00640 1 -- 172.21.15.31:0/3389894605 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f28a005f080 con 0x7f28b00b3300 2024-09-17T05:35:31.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.693+0000 7f28b6e00640 1 -- 172.21.15.31:0/3389894605 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28b015f4e0 con 0x7f28b00b3300 2024-09-17T05:35:31.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.697+0000 7f28acc00640 1 -- 172.21.15.31:0/3389894605 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) ==== 74+0+16807 (secure 0 0 0) 0x7f28a005e980 con 0x7f28b00b3300 2024-09-17T05:35:31.697 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:31.697 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":130,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:35:11.693102+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:35:07.839243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T05:35:09.071831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:35:31.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.697+0000 7f28b6e00640 1 -- 172.21.15.31:0/3389894605 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f288c0738c0 msgr2=0x7f288c075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:31.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.697+0000 7f28b6e00640 1 --2- 172.21.15.31:0/3389894605 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f288c0738c0 0x7f288c075d80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f28b009d180 tx=0x7f289800b2c0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.697+0000 7f28b6e00640 1 -- 172.21.15.31:0/3389894605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b00b3300 msgr2=0x7f28b0072eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:31.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.697+0000 7f28b6e00640 1 --2- 172.21.15.31:0/3389894605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b00b3300 0x7f28b0072eb0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f28a000b410 tx=0x7f28a000b8d0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.697+0000 7f28b6e00640 1 -- 172.21.15.31:0/3389894605 shutdown_connections 2024-09-17T05:35:31.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.697+0000 7f28b6e00640 1 --2- 172.21.15.31:0/3389894605 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f288c0738c0 0x7f288c075d80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.697+0000 7f28b6e00640 1 --2- 172.21.15.31:0/3389894605 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28b015af90 0x7f28b01f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.697+0000 7f28b6e00640 1 --2- 172.21.15.31:0/3389894605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28b00cd0d0 0x7f28b014b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.697+0000 7f28b6e00640 1 --2- 172.21.15.31:0/3389894605 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b00b3300 0x7f28b0072eb0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.697+0000 7f28b6e00640 1 -- 172.21.15.31:0/3389894605 >> 172.21.15.31:0/3389894605 conn(0x7f28b00b18f0 msgr2=0x7f28b006f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:31.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.697+0000 7f28b6e00640 1 -- 172.21.15.31:0/3389894605 shutdown_connections 2024-09-17T05:35:31.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.697+0000 7f28b6e00640 1 -- 172.21.15.31:0/3389894605 wait complete. 2024-09-17T05:35:31.719 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:35:31.719 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:35:31.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dca400640 1 -- 172.21.15.31:0/3342016117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dc40cdb30 msgr2=0x7f2dc40af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:31.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dca400640 1 --2- 172.21.15.31:0/3342016117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dc40cdb30 0x7f2dc40af0c0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009c80 tx=0x7f2dbc01cda0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dca400640 1 -- 172.21.15.31:0/3342016117 shutdown_connections 2024-09-17T05:35:31.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dca400640 1 --2- 172.21.15.31:0/3342016117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dc40cdb30 0x7f2dc40af0c0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dca400640 1 -- 172.21.15.31:0/3342016117 >> 172.21.15.31:0/3342016117 conn(0x7f2dc40d1dc0 msgr2=0x7f2dc40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:31.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dca400640 1 -- 172.21.15.31:0/3342016117 shutdown_connections 2024-09-17T05:35:31.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dca400640 1 -- 172.21.15.31:0/3342016117 wait complete. 2024-09-17T05:35:31.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dca400640 1 Processor -- start 2024-09-17T05:35:31.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dca400640 1 -- start start 2024-09-17T05:35:31.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dca400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dc40cdb30 0x7f2dc41520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:31.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dca400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2dc40ced80 0x7f2dc4155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:31.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dca400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dc415bea0 0x7f2dc414f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:31.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dca400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc416a8a0 con 0x7f2dc415bea0 2024-09-17T05:35:31.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dca400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc416a720 con 0x7f2dc40cdb30 2024-09-17T05:35:31.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dca400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2dc416aa20 con 0x7f2dc40ced80 2024-09-17T05:35:31.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dc3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dc415bea0 0x7f2dc414f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:31.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dc3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dc415bea0 0x7f2dc414f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41934/0 (socket says 172.21.15.31:41934) 2024-09-17T05:35:31.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dc3e00640 1 -- 172.21.15.31:0/1813244087 learned_addr learned my addr 172.21.15.31:0/1813244087 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:31.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dbbe00640 1 --2- 172.21.15.31:0/1813244087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2dc40ced80 0x7f2dc4155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:31.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dc3400640 1 --2- 172.21.15.31:0/1813244087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dc40cdb30 0x7f2dc41520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:31.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dc3e00640 1 -- 172.21.15.31:0/1813244087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2dc40ced80 msgr2=0x7f2dc4155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:31.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dc3e00640 1 --2- 172.21.15.31:0/1813244087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2dc40ced80 0x7f2dc4155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dc3e00640 1 -- 172.21.15.31:0/1813244087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dc40cdb30 msgr2=0x7f2dc41520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:31.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dc3e00640 1 --2- 172.21.15.31:0/1813244087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dc40cdb30 0x7f2dc41520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:31.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dc3e00640 1 -- 172.21.15.31:0/1813244087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc4154670 con 0x7f2dc415bea0 2024-09-17T05:35:31.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dc3e00640 1 --2- 172.21.15.31:0/1813244087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dc415bea0 0x7f2dc414f540 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009bd0 tx=0x7f2dbc0a5ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:31.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.865+0000 7f2dbb400640 1 -- 172.21.15.31:0/1813244087 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc0bb070 con 0x7f2dc415bea0 2024-09-17T05:35:31.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.869+0000 7f2dbb400640 1 -- 172.21.15.31:0/1813244087 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2dbc004d40 con 0x7f2dc415bea0 2024-09-17T05:35:31.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.869+0000 7f2dbb400640 1 -- 172.21.15.31:0/1813244087 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc0b2040 con 0x7f2dc415bea0 2024-09-17T05:35:31.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.869+0000 7f2dca400640 1 -- 172.21.15.31:0/1813244087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc415da20 con 0x7f2dc415bea0 2024-09-17T05:35:31.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.869+0000 7f2dca400640 1 -- 172.21.15.31:0/1813244087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc415dfe0 con 0x7f2dc415bea0 2024-09-17T05:35:31.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.869+0000 7f2dca400640 1 -- 172.21.15.31:0/1813244087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc415d7d0 con 0x7f2dc415bea0 2024-09-17T05:35:31.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.869+0000 7f2dbb400640 1 -- 172.21.15.31:0/1813244087 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f2dbc004320 con 0x7f2dc415bea0 2024-09-17T05:35:31.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.869+0000 7f2dbb400640 1 --2- 172.21.15.31:0/1813244087 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2da00738c0 0x7f2da0075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:31.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.869+0000 7f2dbb400640 1 -- 172.21.15.31:0/1813244087 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f2dbc12ee70 con 0x7f2dc415bea0 2024-09-17T05:35:31.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.869+0000 7f2dc3400640 1 --2- 172.21.15.31:0/1813244087 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2da00738c0 0x7f2da0075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:31.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.873+0000 7f2dc3400640 1 --2- 172.21.15.31:0/1813244087 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2da00738c0 0x7f2da0075d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4152d80 tx=0x7f2db4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:31.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:31.873+0000 7f2dbb400640 1 -- 172.21.15.31:0/1813244087 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2dbc016990 con 0x7f2dc415bea0 2024-09-17T05:35:32.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.085+0000 7f2dca400640 1 -- 172.21.15.31:0/1813244087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2dc40762f0 con 0x7f2dc415bea0 2024-09-17T05:35:32.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.085+0000 7f2dbb400640 1 -- 172.21.15.31:0/1813244087 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5233 (secure 0 0 0) 0x7f2dbc0f9520 con 0x7f2dc415bea0 2024-09-17T05:35:32.088 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:32.088 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":91,"btime":"2024-09-17T05:35:19:749695+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7456,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/2107257547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107257547},{"type":"v1","addr":"172.21.15.155:6834","nonce":2107257547}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1645548958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1645548958},{"type":"v1","addr":"172.21.15.31:6834","nonce":1645548958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7836,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1284373927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1284373927},{"type":"v1","addr":"172.21.15.31:6835","nonce":1284373927}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:35:10.110294+0000","modified":"2024-09-17T05:35:13.121372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7848},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7848":{"gid":7848,"name":"b","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1879117968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1879117968},{"type":"v1","addr":"172.21.15.155:6835","nonce":1879117968}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7848,"qdb_cluster":[7848]},"id":10}]} 2024-09-17T05:35:32.088 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 91 2024-09-17T05:35:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.089+0000 7f2dca400640 1 -- 172.21.15.31:0/1813244087 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2da00738c0 msgr2=0x7f2da0075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.089+0000 7f2dca400640 1 --2- 172.21.15.31:0/1813244087 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2da00738c0 0x7f2da0075d80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2dc4152d80 tx=0x7f2db4009040 comp rx=0 tx=0).stop 2024-09-17T05:35:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.089+0000 7f2dca400640 1 -- 172.21.15.31:0/1813244087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dc415bea0 msgr2=0x7f2dc414f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.089+0000 7f2dca400640 1 --2- 172.21.15.31:0/1813244087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dc415bea0 0x7f2dc414f540 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009bd0 tx=0x7f2dbc0a5ba0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.089+0000 7f2dca400640 1 -- 172.21.15.31:0/1813244087 shutdown_connections 2024-09-17T05:35:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.089+0000 7f2dca400640 1 --2- 172.21.15.31:0/1813244087 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2da00738c0 0x7f2da0075d80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.089+0000 7f2dca400640 1 --2- 172.21.15.31:0/1813244087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2dc415bea0 0x7f2dc414f540 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.089+0000 7f2dca400640 1 --2- 172.21.15.31:0/1813244087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2dc40ced80 0x7f2dc4155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.089+0000 7f2dca400640 1 --2- 172.21.15.31:0/1813244087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dc40cdb30 0x7f2dc41520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.089+0000 7f2dca400640 1 -- 172.21.15.31:0/1813244087 >> 172.21.15.31:0/1813244087 conn(0x7f2dc40d1dc0 msgr2=0x7f2dc40d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:32.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.089+0000 7f2dca400640 1 -- 172.21.15.31:0/1813244087 shutdown_connections 2024-09-17T05:35:32.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.089+0000 7f2dca400640 1 -- 172.21.15.31:0/1813244087 wait complete. 2024-09-17T05:35:32.109 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:35:32.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.253+0000 7f62aac00640 1 -- 172.21.15.31:0/1342965195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62a415bea0 msgr2=0x7f62a40ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:32.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.253+0000 7f62aac00640 1 --2- 172.21.15.31:0/1342965195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62a415bea0 0x7f62a40ce670 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f6294009900 tx=0x7f629401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.253+0000 7f62aac00640 1 -- 172.21.15.31:0/1342965195 shutdown_connections 2024-09-17T05:35:32.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.253+0000 7f62aac00640 1 --2- 172.21.15.31:0/1342965195 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62a40cdb30 0x7f62a40cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.253+0000 7f62aac00640 1 --2- 172.21.15.31:0/1342965195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62a415bea0 0x7f62a40ce670 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.253+0000 7f62aac00640 1 -- 172.21.15.31:0/1342965195 >> 172.21.15.31:0/1342965195 conn(0x7f62a40d1dc0 msgr2=0x7f62a40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:32.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.253+0000 7f62aac00640 1 -- 172.21.15.31:0/1342965195 shutdown_connections 2024-09-17T05:35:32.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.253+0000 7f62aac00640 1 -- 172.21.15.31:0/1342965195 wait complete. 2024-09-17T05:35:32.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62aac00640 1 Processor -- start 2024-09-17T05:35:32.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62aac00640 1 -- start start 2024-09-17T05:35:32.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62aac00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62a40cdb30 0x7f62a40b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:32.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62aac00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62a40d28e0 0x7f62a41f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:32.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62aac00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62a415bea0 0x7f62a414cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:32.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62aac00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f62a4168f60 con 0x7f62a40cdb30 2024-09-17T05:35:32.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62aac00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f62a4168de0 con 0x7f62a40d28e0 2024-09-17T05:35:32.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62aac00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f62a41690e0 con 0x7f62a415bea0 2024-09-17T05:35:32.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62a3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62a40cdb30 0x7f62a40b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:32.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62a3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62a40cdb30 0x7f62a40b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41956/0 (socket says 172.21.15.31:41956) 2024-09-17T05:35:32.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62a3e00640 1 -- 172.21.15.31:0/1187627358 learned_addr learned my addr 172.21.15.31:0/1187627358 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:32.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f629be00640 1 --2- 172.21.15.31:0/1187627358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62a40d28e0 0x7f62a41f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:32.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62a8c00640 1 --2- 172.21.15.31:0/1187627358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62a415bea0 0x7f62a414cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:32.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62a3e00640 1 -- 172.21.15.31:0/1187627358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62a415bea0 msgr2=0x7f62a414cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:32.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62a3e00640 1 --2- 172.21.15.31:0/1187627358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62a415bea0 0x7f62a414cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62a3e00640 1 -- 172.21.15.31:0/1187627358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62a40d28e0 msgr2=0x7f62a41f6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:32.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62a3e00640 1 --2- 172.21.15.31:0/1187627358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62a40d28e0 0x7f62a41f6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62a3e00640 1 -- 172.21.15.31:0/1187627358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a40b43d0 con 0x7f62a40cdb30 2024-09-17T05:35:32.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62a8c00640 1 --2- 172.21.15.31:0/1187627358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62a415bea0 0x7f62a414cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:32.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62a3e00640 1 --2- 172.21.15.31:0/1187627358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62a40cdb30 0x7f62a40b3d10 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f6294009850 tx=0x7f62940a56b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:32.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62a0c00640 1 -- 172.21.15.31:0/1187627358 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62940bc070 con 0x7f62a40cdb30 2024-09-17T05:35:32.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62a0c00640 1 -- 172.21.15.31:0/1187627358 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62940043b0 con 0x7f62a40cdb30 2024-09-17T05:35:32.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62a0c00640 1 -- 172.21.15.31:0/1187627358 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62940b2040 con 0x7f62a40cdb30 2024-09-17T05:35:32.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62aac00640 1 -- 172.21.15.31:0/1187627358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a41f9010 con 0x7f62a40cdb30 2024-09-17T05:35:32.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62aac00640 1 -- 172.21.15.31:0/1187627358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a414d0c0 con 0x7f62a40cdb30 2024-09-17T05:35:32.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.257+0000 7f62aac00640 1 -- 172.21.15.31:0/1187627358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62a40cc9d0 con 0x7f62a40cdb30 2024-09-17T05:35:32.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.261+0000 7f62a0c00640 1 -- 172.21.15.31:0/1187627358 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f6294005260 con 0x7f62a40cdb30 2024-09-17T05:35:32.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.261+0000 7f62a0c00640 1 --2- 172.21.15.31:0/1187627358 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f62800738c0 0x7f6280075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:32.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.261+0000 7f62a0c00640 1 -- 172.21.15.31:0/1187627358 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f629412ed10 con 0x7f62a40cdb30 2024-09-17T05:35:32.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.261+0000 7f629be00640 1 --2- 172.21.15.31:0/1187627358 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f62800738c0 0x7f6280075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:32.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.261+0000 7f629be00640 1 --2- 172.21.15.31:0/1187627358 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f62800738c0 0x7f6280075d80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f628c0058d0 tx=0x7f628c005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:32.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.265+0000 7f62a0c00640 1 -- 172.21.15.31:0/1187627358 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f62940164d0 con 0x7f62a40cdb30 2024-09-17T05:35:32.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.473+0000 7f62aac00640 1 -- 172.21.15.31:0/1187627358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62a4071470 con 0x7f62a40cdb30 2024-09-17T05:35:32.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.477+0000 7f62a0c00640 1 -- 172.21.15.31:0/1187627358 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) ==== 94+0+5233 (secure 0 0 0) 0x7f62940f93d0 con 0x7f62a40cdb30 2024-09-17T05:35:32.478 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:32.478 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":91,"btime":"2024-09-17T05:35:19:749695+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7456,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/2107257547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107257547},{"type":"v1","addr":"172.21.15.155:6834","nonce":2107257547}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1645548958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1645548958},{"type":"v1","addr":"172.21.15.31:6834","nonce":1645548958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7836,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1284373927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1284373927},{"type":"v1","addr":"172.21.15.31:6835","nonce":1284373927}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:35:10.110294+0000","modified":"2024-09-17T05:35:13.121372+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7848},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7848":{"gid":7848,"name":"b","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/1879117968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":1879117968},{"type":"v1","addr":"172.21.15.155:6835","nonce":1879117968}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7848,"qdb_cluster":[7848]},"id":10}]} 2024-09-17T05:35:32.478 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 91 2024-09-17T05:35:32.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.477+0000 7f62aac00640 1 -- 172.21.15.31:0/1187627358 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f62800738c0 msgr2=0x7f6280075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:32.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.477+0000 7f62aac00640 1 --2- 172.21.15.31:0/1187627358 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f62800738c0 0x7f6280075d80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f628c0058d0 tx=0x7f628c005860 comp rx=0 tx=0).stop 2024-09-17T05:35:32.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.477+0000 7f62aac00640 1 -- 172.21.15.31:0/1187627358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62a40cdb30 msgr2=0x7f62a40b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:32.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.477+0000 7f62aac00640 1 --2- 172.21.15.31:0/1187627358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62a40cdb30 0x7f62a40b3d10 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f6294009850 tx=0x7f62940a56b0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.477+0000 7f62aac00640 1 -- 172.21.15.31:0/1187627358 shutdown_connections 2024-09-17T05:35:32.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.477+0000 7f62aac00640 1 --2- 172.21.15.31:0/1187627358 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f62800738c0 0x7f6280075d80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.477+0000 7f62aac00640 1 --2- 172.21.15.31:0/1187627358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f62a415bea0 0x7f62a414cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.477+0000 7f62aac00640 1 --2- 172.21.15.31:0/1187627358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62a40d28e0 0x7f62a41f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.477+0000 7f62aac00640 1 --2- 172.21.15.31:0/1187627358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62a40cdb30 0x7f62a40b3d10 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.477+0000 7f62aac00640 1 -- 172.21.15.31:0/1187627358 >> 172.21.15.31:0/1187627358 conn(0x7f62a40d1dc0 msgr2=0x7f62a4071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:32.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.477+0000 7f62aac00640 1 -- 172.21.15.31:0/1187627358 shutdown_connections 2024-09-17T05:35:32.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.477+0000 7f62aac00640 1 -- 172.21.15.31:0/1187627358 wait complete. 2024-09-17T05:35:32.500 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:35:32.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.645+0000 7f7d95600640 1 -- 172.21.15.31:0/2994989560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d900cecf0 msgr2=0x7f7d900cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:32.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.645+0000 7f7d95600640 1 --2- 172.21.15.31:0/2994989560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d900cecf0 0x7f7d900cc940 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7d78009900 tx=0x7f7d7801c7c0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.645+0000 7f7d95600640 1 -- 172.21.15.31:0/2994989560 shutdown_connections 2024-09-17T05:35:32.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.645+0000 7f7d95600640 1 --2- 172.21.15.31:0/2994989560 >> v2:172.21.15.155:3300/0 conn(0x7f7d9015c130 0x7f7d900cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.645+0000 7f7d95600640 1 --2- 172.21.15.31:0/2994989560 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d900cecf0 0x7f7d900cc940 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.645+0000 7f7d95600640 1 -- 172.21.15.31:0/2994989560 >> 172.21.15.31:0/2994989560 conn(0x7f7d900d1ea0 msgr2=0x7f7d900d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:32.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.645+0000 7f7d95600640 1 -- 172.21.15.31:0/2994989560 shutdown_connections 2024-09-17T05:35:32.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.645+0000 7f7d95600640 1 -- 172.21.15.31:0/2994989560 wait complete. 2024-09-17T05:35:32.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.645+0000 7f7d95600640 1 Processor -- start 2024-09-17T05:35:32.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.645+0000 7f7d95600640 1 -- start start 2024-09-17T05:35:32.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d95600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d900cecf0 0x7f7d90150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:32.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d95600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d9015bd50 0x7f7d9014fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:32.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d95600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d9015c130 0x7f7d90153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:32.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d95600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7d90169590 con 0x7f7d9015bd50 2024-09-17T05:35:32.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d95600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7d90169410 con 0x7f7d900cecf0 2024-09-17T05:35:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d95600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7d90169710 con 0x7f7d9015c130 2024-09-17T05:35:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d87e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d9015bd50 0x7f7d9014fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d87e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d9015bd50 0x7f7d9014fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41964/0 (socket says 172.21.15.31:41964) 2024-09-17T05:35:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d87e00640 1 -- 172.21.15.31:0/2360188947 learned_addr learned my addr 172.21.15.31:0/2360188947 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d8f400640 1 --2- 172.21.15.31:0/2360188947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d9015c130 0x7f7d90153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d8ea00640 1 --2- 172.21.15.31:0/2360188947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d900cecf0 0x7f7d90150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d87e00640 1 -- 172.21.15.31:0/2360188947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d9015c130 msgr2=0x7f7d90153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d87e00640 1 --2- 172.21.15.31:0/2360188947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d9015c130 0x7f7d90153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d87e00640 1 -- 172.21.15.31:0/2360188947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d900cecf0 msgr2=0x7f7d90150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d87e00640 1 --2- 172.21.15.31:0/2360188947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d900cecf0 0x7f7d90150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d87e00640 1 -- 172.21.15.31:0/2360188947 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d901513c0 con 0x7f7d9015bd50 2024-09-17T05:35:32.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d8f400640 1 --2- 172.21.15.31:0/2360188947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d9015c130 0x7f7d90153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:32.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d87e00640 1 --2- 172.21.15.31:0/2360188947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d9015bd50 0x7f7d9014fc90 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f7d780b0040 tx=0x7f7d780a5790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:32.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d86a00640 1 -- 172.21.15.31:0/2360188947 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d780b2040 con 0x7f7d9015bd50 2024-09-17T05:35:32.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d86a00640 1 -- 172.21.15.31:0/2360188947 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d78004400 con 0x7f7d9015bd50 2024-09-17T05:35:32.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d86a00640 1 -- 172.21.15.31:0/2360188947 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d780052d0 con 0x7f7d9015bd50 2024-09-17T05:35:32.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d95600640 1 -- 172.21.15.31:0/2360188947 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d901516a0 con 0x7f7d9015bd50 2024-09-17T05:35:32.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d95600640 1 -- 172.21.15.31:0/2360188947 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d901536a0 con 0x7f7d9015bd50 2024-09-17T05:35:32.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d95600640 1 -- 172.21.15.31:0/2360188947 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d900ce5e0 con 0x7f7d9015bd50 2024-09-17T05:35:32.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.649+0000 7f7d86a00640 1 -- 172.21.15.31:0/2360188947 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f7d78005470 con 0x7f7d9015bd50 2024-09-17T05:35:32.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.653+0000 7f7d86a00640 1 --2- 172.21.15.31:0/2360188947 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7d6c0738f0 0x7f7d6c075db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:32.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.653+0000 7f7d86a00640 1 -- 172.21.15.31:0/2360188947 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f7d7812e480 con 0x7f7d9015bd50 2024-09-17T05:35:32.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.653+0000 7f7d8ea00640 1 --2- 172.21.15.31:0/2360188947 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7d6c0738f0 0x7f7d6c075db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:32.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.653+0000 7f7d8ea00640 1 --2- 172.21.15.31:0/2360188947 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7d6c0738f0 0x7f7d6c075db0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7d800016f0 tx=0x7f7d80009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:32.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.657+0000 7f7d86a00640 1 -- 172.21.15.31:0/2360188947 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7d780164d0 con 0x7f7d9015bd50 2024-09-17T05:35:32.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.833+0000 7f7d95600640 1 -- 172.21.15.31:0/2360188947 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d900b2d70 con 0x7f7d9015bd50 2024-09-17T05:35:32.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.837+0000 7f7d86a00640 1 -- 172.21.15.31:0/2360188947 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) ==== 74+0+16807 (secure 0 0 0) 0x7f7d780f8bc0 con 0x7f7d9015bd50 2024-09-17T05:35:32.838 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:32.838 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":130,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:35:11.693102+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:35:07.839243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T05:35:09.071831+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:35:32.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.837+0000 7f7d95600640 1 -- 172.21.15.31:0/2360188947 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7d6c0738f0 msgr2=0x7f7d6c075db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:32.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.837+0000 7f7d95600640 1 --2- 172.21.15.31:0/2360188947 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7d6c0738f0 0x7f7d6c075db0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7d800016f0 tx=0x7f7d80009040 comp rx=0 tx=0).stop 2024-09-17T05:35:32.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.837+0000 7f7d95600640 1 -- 172.21.15.31:0/2360188947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d9015bd50 msgr2=0x7f7d9014fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:32.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.837+0000 7f7d95600640 1 --2- 172.21.15.31:0/2360188947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d9015bd50 0x7f7d9014fc90 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f7d780b0040 tx=0x7f7d780a5790 comp rx=0 tx=0).stop 2024-09-17T05:35:32.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.837+0000 7f7d95600640 1 -- 172.21.15.31:0/2360188947 shutdown_connections 2024-09-17T05:35:32.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.837+0000 7f7d95600640 1 --2- 172.21.15.31:0/2360188947 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7d6c0738f0 0x7f7d6c075db0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.837+0000 7f7d95600640 1 --2- 172.21.15.31:0/2360188947 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7d9015c130 0x7f7d90153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.837+0000 7f7d95600640 1 --2- 172.21.15.31:0/2360188947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d9015bd50 0x7f7d9014fc90 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.837+0000 7f7d95600640 1 --2- 172.21.15.31:0/2360188947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7d900cecf0 0x7f7d90150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:32.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.837+0000 7f7d95600640 1 -- 172.21.15.31:0/2360188947 >> 172.21.15.31:0/2360188947 conn(0x7f7d900d1ea0 msgr2=0x7f7d900711e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:32.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.837+0000 7f7d95600640 1 -- 172.21.15.31:0/2360188947 shutdown_connections 2024-09-17T05:35:32.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:32.837+0000 7f7d95600640 1 -- 172.21.15.31:0/2360188947 wait complete. 2024-09-17T05:35:32.860 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:35:33.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.005+0000 7f9c2c400640 1 -- 172.21.15.31:0/2797436158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c2415bea0 msgr2=0x7f9c240ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:33.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.005+0000 7f9c2c400640 1 --2- 172.21.15.31:0/2797436158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c2415bea0 0x7f9c240ce670 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f9c240745d0 tx=0x7f9c1801c8e0 comp rx=0 tx=0).stop 2024-09-17T05:35:33.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.005+0000 7f9c2c400640 1 -- 172.21.15.31:0/2797436158 shutdown_connections 2024-09-17T05:35:33.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.005+0000 7f9c2c400640 1 --2- 172.21.15.31:0/2797436158 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c240d28e0 0x7f9c240cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:33.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.005+0000 7f9c2c400640 1 --2- 172.21.15.31:0/2797436158 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c2415bea0 0x7f9c240ce670 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:33.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.005+0000 7f9c2c400640 1 -- 172.21.15.31:0/2797436158 >> 172.21.15.31:0/2797436158 conn(0x7f9c240d1dc0 msgr2=0x7f9c240d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:33.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.005+0000 7f9c2c400640 1 -- 172.21.15.31:0/2797436158 shutdown_connections 2024-09-17T05:35:33.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.005+0000 7f9c2c400640 1 -- 172.21.15.31:0/2797436158 wait complete. 2024-09-17T05:35:33.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c2c400640 1 Processor -- start 2024-09-17T05:35:33.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c2c400640 1 -- start start 2024-09-17T05:35:33.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c2c400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c240cdb30 0x7f9c241f88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:33.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c2c400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c240d28e0 0x7f9c240b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:33.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c2c400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c2415bea0 0x7f9c24153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:33.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c2c400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9c24169050 con 0x7f9c240cdb30 2024-09-17T05:35:33.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c2c400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9c24168ed0 con 0x7f9c2415bea0 2024-09-17T05:35:33.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c2c400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9c241691d0 con 0x7f9c240d28e0 2024-09-17T05:35:33.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c29a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c240cdb30 0x7f9c241f88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:33.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c29a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c240cdb30 0x7f9c241f88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41990/0 (socket says 172.21.15.31:41990) 2024-09-17T05:35:33.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c29a00640 1 -- 172.21.15.31:0/2569225006 learned_addr learned my addr 172.21.15.31:0/2569225006 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:33.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c2a400640 1 --2- 172.21.15.31:0/2569225006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c2415bea0 0x7f9c24153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:33.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c29000640 1 --2- 172.21.15.31:0/2569225006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c240d28e0 0x7f9c240b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:33.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c29a00640 1 -- 172.21.15.31:0/2569225006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c240d28e0 msgr2=0x7f9c240b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:33.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c29a00640 1 --2- 172.21.15.31:0/2569225006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c240d28e0 0x7f9c240b2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:33.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c29a00640 1 -- 172.21.15.31:0/2569225006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c2415bea0 msgr2=0x7f9c24153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:33.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c29a00640 1 --2- 172.21.15.31:0/2569225006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c2415bea0 0x7f9c24153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:33.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c29a00640 1 -- 172.21.15.31:0/2569225006 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c24155110 con 0x7f9c240cdb30 2024-09-17T05:35:33.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c29a00640 1 --2- 172.21.15.31:0/2569225006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c240cdb30 0x7f9c241f88c0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f9c180b0040 tx=0x7f9c18005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:33.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c21600640 1 -- 172.21.15.31:0/2569225006 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c180b2040 con 0x7f9c240cdb30 2024-09-17T05:35:33.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c21600640 1 -- 172.21.15.31:0/2569225006 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c180044b0 con 0x7f9c240cdb30 2024-09-17T05:35:33.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c21600640 1 -- 172.21.15.31:0/2569225006 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18003860 con 0x7f9c240cdb30 2024-09-17T05:35:33.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c2c400640 1 -- 172.21.15.31:0/2569225006 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c24153010 con 0x7f9c240cdb30 2024-09-17T05:35:33.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c2c400640 1 -- 172.21.15.31:0/2569225006 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c24154e30 con 0x7f9c240cdb30 2024-09-17T05:35:33.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.009+0000 7f9c2c400640 1 -- 172.21.15.31:0/2569225006 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c24152e00 con 0x7f9c240cdb30 2024-09-17T05:35:33.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.013+0000 7f9c21600640 1 -- 172.21.15.31:0/2569225006 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f9c18003a00 con 0x7f9c240cdb30 2024-09-17T05:35:33.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.013+0000 7f9c21600640 1 --2- 172.21.15.31:0/2569225006 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9c040738c0 0x7f9c04075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:33.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.013+0000 7f9c21600640 1 -- 172.21.15.31:0/2569225006 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5737+0+0 (secure 0 0 0) 0x7f9c1812ecf0 con 0x7f9c240cdb30 2024-09-17T05:35:33.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.013+0000 7f9c29000640 1 --2- 172.21.15.31:0/2569225006 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9c040738c0 0x7f9c04075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:33.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.013+0000 7f9c29000640 1 --2- 172.21.15.31:0/2569225006 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9c040738c0 0x7f9c04075d80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9c24152bf0 tx=0x7f9c10009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:33.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.017+0000 7f9c21600640 1 -- 172.21.15.31:0/2569225006 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9c180bd060 con 0x7f9c240cdb30 2024-09-17T05:35:33.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.229+0000 7f9c2c400640 1 -- 172.21.15.31:0/2569225006 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9c240cc9d0 con 0x7f9c240cdb30 2024-09-17T05:35:33.232 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-09-17T05:35:33.229+0000 7f21d0200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:35:33.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.233+0000 7f9c21600640 1 -- 172.21.15.31:0/2569225006 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v92) ==== 161+0+0 (secure 0 0 0) 0x7f9c180164d0 con 0x7f9c240cdb30 2024-09-17T05:35:33.234 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:35:33.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.233+0000 7f9c2c400640 1 -- 172.21.15.31:0/2569225006 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9c040738c0 msgr2=0x7f9c04075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:33.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.233+0000 7f9c2c400640 1 --2- 172.21.15.31:0/2569225006 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9c040738c0 0x7f9c04075d80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9c24152bf0 tx=0x7f9c10009040 comp rx=0 tx=0).stop 2024-09-17T05:35:33.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.233+0000 7f9c2c400640 1 -- 172.21.15.31:0/2569225006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c240cdb30 msgr2=0x7f9c241f88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:33.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.233+0000 7f9c2c400640 1 --2- 172.21.15.31:0/2569225006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c240cdb30 0x7f9c241f88c0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f9c180b0040 tx=0x7f9c18005770 comp rx=0 tx=0).stop 2024-09-17T05:35:33.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.237+0000 7f9c2c400640 1 -- 172.21.15.31:0/2569225006 shutdown_connections 2024-09-17T05:35:33.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.237+0000 7f9c2c400640 1 --2- 172.21.15.31:0/2569225006 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9c040738c0 0x7f9c04075d80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:33.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.237+0000 7f9c2c400640 1 --2- 172.21.15.31:0/2569225006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c2415bea0 0x7f9c24153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:33.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.237+0000 7f9c2c400640 1 --2- 172.21.15.31:0/2569225006 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c240d28e0 0x7f9c240b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:33.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.237+0000 7f9c2c400640 1 --2- 172.21.15.31:0/2569225006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c240cdb30 0x7f9c241f88c0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:33.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.237+0000 7f9c2c400640 1 -- 172.21.15.31:0/2569225006 >> 172.21.15.31:0/2569225006 conn(0x7f9c240d1dc0 msgr2=0x7f9c24071460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:33.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.237+0000 7f9c2c400640 1 -- 172.21.15.31:0/2569225006 shutdown_connections 2024-09-17T05:35:33.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.237+0000 7f9c2c400640 1 -- 172.21.15.31:0/2569225006 wait complete. 2024-09-17T05:35:33.248 INFO:tasks.ceph.mds.b.smithi155.stderr: -2814> 2024-09-17T05:35:15.891+0000 7f3872200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:35:33.256 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:35:33.294 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-17T05:35:33.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.405+0000 7f4bb5c00640 1 -- 172.21.15.31:0/3005540642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94003c90 msgr2=0x7f4b94004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:33.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.405+0000 7f4bb5c00640 1 --2- 172.21.15.31:0/3005540642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94003c90 0x7f4b94004090 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0001860 tx=0x7f4ba001c810 comp rx=0 tx=0).stop 2024-09-17T05:35:33.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.405+0000 7f4bb5c00640 1 -- 172.21.15.31:0/3005540642 shutdown_connections 2024-09-17T05:35:33.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.405+0000 7f4bb5c00640 1 --2- 172.21.15.31:0/3005540642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94003c90 0x7f4b94004090 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:33.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.405+0000 7f4bb5c00640 1 -- 172.21.15.31:0/3005540642 >> 172.21.15.31:0/3005540642 conn(0x7f4bb00d1e90 msgr2=0x7f4bb00d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:33.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.405+0000 7f4bb5c00640 1 -- 172.21.15.31:0/3005540642 shutdown_connections 2024-09-17T05:35:33.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.405+0000 7f4bb5c00640 1 -- 172.21.15.31:0/3005540642 wait complete. 2024-09-17T05:35:33.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.405+0000 7f4bb5c00640 1 Processor -- start 2024-09-17T05:35:33.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.405+0000 7f4bb5c00640 1 -- start start 2024-09-17T05:35:33.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.405+0000 7f4bb5c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94003c90 0x7f4bb01544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:33.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.405+0000 7f4bb5c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bb00c74b0 0x7f4bb00c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:33.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4bb5c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bb00b3980 0x7f4bb00b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:33.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4bb5c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb015fde0 con 0x7f4b94003c90 2024-09-17T05:35:33.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4bb5c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb00b2190 con 0x7f4bb00c74b0 2024-09-17T05:35:33.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4bb5c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb015ff60 con 0x7f4bb00b3980 2024-09-17T05:35:33.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4baea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94003c90 0x7f4bb01544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:33.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4baea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94003c90 0x7f4bb01544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41996/0 (socket says 172.21.15.31:41996) 2024-09-17T05:35:33.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4baea00640 1 -- 172.21.15.31:0/4084215504 learned_addr learned my addr 172.21.15.31:0/4084215504 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:33.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4ba7e00640 1 --2- 172.21.15.31:0/4084215504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bb00c74b0 0x7f4bb00c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:33.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4baf400640 1 --2- 172.21.15.31:0/4084215504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bb00b3980 0x7f4bb00b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:33.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4baea00640 1 -- 172.21.15.31:0/4084215504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bb00b3980 msgr2=0x7f4bb00b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:33.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4baea00640 1 --2- 172.21.15.31:0/4084215504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bb00b3980 0x7f4bb00b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:33.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4baea00640 1 -- 172.21.15.31:0/4084215504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bb00c74b0 msgr2=0x7f4bb00c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:33.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4baea00640 1 --2- 172.21.15.31:0/4084215504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bb00c74b0 0x7f4bb00c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:33.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4baea00640 1 -- 172.21.15.31:0/4084215504 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb00c59c0 con 0x7f4b94003c90 2024-09-17T05:35:33.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4ba7e00640 1 --2- 172.21.15.31:0/4084215504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bb00c74b0 0x7f4bb00c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:33.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4baf400640 1 --2- 172.21.15.31:0/4084215504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bb00b3980 0x7f4bb00b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:33.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4baea00640 1 --2- 172.21.15.31:0/4084215504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94003c90 0x7f4bb01544d0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f4ba001ccf0 tx=0x7f4ba00a5cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:33.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4ba6a00640 1 -- 172.21.15.31:0/4084215504 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba00068d0 con 0x7f4b94003c90 2024-09-17T05:35:33.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4ba6a00640 1 -- 172.21.15.31:0/4084215504 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ba00b4020 con 0x7f4b94003c90 2024-09-17T05:35:33.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4ba6a00640 1 -- 172.21.15.31:0/4084215504 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0003860 con 0x7f4b94003c90 2024-09-17T05:35:33.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4bb5c00640 1 -- 172.21.15.31:0/4084215504 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb00c5ca0 con 0x7f4b94003c90 2024-09-17T05:35:33.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4bb5c00640 1 -- 172.21.15.31:0/4084215504 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb00c6260 con 0x7f4b94003c90 2024-09-17T05:35:33.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4bb5c00640 1 -- 172.21.15.31:0/4084215504 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb00b4340 con 0x7f4b94003c90 2024-09-17T05:35:33.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.409+0000 7f4ba6a00640 1 -- 172.21.15.31:0/4084215504 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f4ba00062a0 con 0x7f4b94003c90 2024-09-17T05:35:33.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.413+0000 7f4ba6a00640 1 --2- 172.21.15.31:0/4084215504 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4b8c0738c0 0x7f4b8c075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:33.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.413+0000 7f4ba6a00640 1 -- 172.21.15.31:0/4084215504 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5823+0+0 (secure 0 0 0) 0x7f4ba012f3e0 con 0x7f4b94003c90 2024-09-17T05:35:33.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.413+0000 7f4ba7e00640 1 --2- 172.21.15.31:0/4084215504 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4b8c0738c0 0x7f4b8c075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:33.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.413+0000 7f4ba7e00640 1 --2- 172.21.15.31:0/4084215504 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4b8c0738c0 0x7f4b8c075d80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4b980017f0 tx=0x7f4b98001160 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:33.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.417+0000 7f4ba6a00640 1 -- 172.21.15.31:0/4084215504 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4ba00be020 con 0x7f4b94003c90 2024-09-17T05:35:33.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:33.625+0000 7f4bb5c00640 1 -- 172.21.15.31:0/4084215504 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4bb01609b0 con 0x7f4b94003c90 2024-09-17T05:35:34.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.233+0000 7f4ba6a00640 1 -- 172.21.15.31:0/4084215504 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v93) ==== 104+0+0 (secure 0 0 0) 0x7f4ba00165f0 con 0x7f4b94003c90 2024-09-17T05:35:34.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.237+0000 7f4bb5c00640 1 -- 172.21.15.31:0/4084215504 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4b8c0738c0 msgr2=0x7f4b8c075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:34.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.237+0000 7f4bb5c00640 1 --2- 172.21.15.31:0/4084215504 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4b8c0738c0 0x7f4b8c075d80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4b980017f0 tx=0x7f4b98001160 comp rx=0 tx=0).stop 2024-09-17T05:35:34.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.237+0000 7f4bb5c00640 1 -- 172.21.15.31:0/4084215504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94003c90 msgr2=0x7f4bb01544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:34.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.237+0000 7f4bb5c00640 1 --2- 172.21.15.31:0/4084215504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94003c90 0x7f4bb01544d0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f4ba001ccf0 tx=0x7f4ba00a5cd0 comp rx=0 tx=0).stop 2024-09-17T05:35:34.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.237+0000 7f4bb5c00640 1 -- 172.21.15.31:0/4084215504 shutdown_connections 2024-09-17T05:35:34.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.237+0000 7f4bb5c00640 1 --2- 172.21.15.31:0/4084215504 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4b8c0738c0 0x7f4b8c075d80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:34.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.237+0000 7f4bb5c00640 1 --2- 172.21.15.31:0/4084215504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bb00b3980 0x7f4bb00b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:34.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.237+0000 7f4bb5c00640 1 --2- 172.21.15.31:0/4084215504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bb00c74b0 0x7f4bb00c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:34.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.237+0000 7f4bb5c00640 1 --2- 172.21.15.31:0/4084215504 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b94003c90 0x7f4bb01544d0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:34.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.237+0000 7f4bb5c00640 1 -- 172.21.15.31:0/4084215504 >> 172.21.15.31:0/4084215504 conn(0x7f4bb00d1e90 msgr2=0x7f4bb015b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:34.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.237+0000 7f4bb5c00640 1 -- 172.21.15.31:0/4084215504 shutdown_connections 2024-09-17T05:35:34.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.237+0000 7f4bb5c00640 1 -- 172.21.15.31:0/4084215504 wait complete. 2024-09-17T05:35:34.259 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:35:34.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.409+0000 7f2850000640 1 -- 172.21.15.31:0/3382875721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2830004da0 msgr2=0x7f2830005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:34.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.409+0000 7f2850000640 1 --2- 172.21.15.31:0/3382875721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2830004da0 0x7f2830005220 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f2840009e00 tx=0x7f284001d110 comp rx=0 tx=0).stop 2024-09-17T05:35:34.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.409+0000 7f284e000640 1 -- 172.21.15.31:0/3382875721 reap_dead start 2024-09-17T05:35:34.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.409+0000 7f2850000640 1 -- 172.21.15.31:0/3382875721 shutdown_connections 2024-09-17T05:35:34.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.409+0000 7f2850000640 1 -- 172.21.15.31:0/3382875721 >> 172.21.15.31:0/3382875721 conn(0x7f28480d1da0 msgr2=0x7f28480d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:34.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.409+0000 7f2850000640 1 -- 172.21.15.31:0/3382875721 shutdown_connections 2024-09-17T05:35:34.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.409+0000 7f2850000640 1 -- 172.21.15.31:0/3382875721 wait complete. 2024-09-17T05:35:34.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f2850000640 1 Processor -- start 2024-09-17T05:35:34.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f2850000640 1 -- start start 2024-09-17T05:35:34.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f2850000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2830004da0 0x7f28481491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:34.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f2850000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28480b6da0 0x7f28480b7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f2850000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28480c7100 0x7f28480c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f2850000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2848164ea0 con 0x7f28480b6da0 2024-09-17T05:35:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f2850000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f28480cddf0 con 0x7f2830004da0 2024-09-17T05:35:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f2850000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2848165020 con 0x7f28480c7100 2024-09-17T05:35:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f284cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28480b6da0 0x7f28480b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f284cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28480b6da0 0x7f28480b7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42016/0 (socket says 172.21.15.31:42016) 2024-09-17T05:35:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f284cc00640 1 -- 172.21.15.31:0/3293135725 learned_addr learned my addr 172.21.15.31:0/3293135725 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f284e000640 1 --2- 172.21.15.31:0/3293135725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28480c7100 0x7f28480c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f284d600640 1 --2- 172.21.15.31:0/3293135725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2830004da0 0x7f28481491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f284cc00640 1 -- 172.21.15.31:0/3293135725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28480c7100 msgr2=0x7f28480c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f284cc00640 1 --2- 172.21.15.31:0/3293135725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28480c7100 0x7f28480c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f284cc00640 1 -- 172.21.15.31:0/3293135725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2830004da0 msgr2=0x7f28481491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:34.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f284cc00640 1 --2- 172.21.15.31:0/3293135725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2830004da0 0x7f28481491a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:34.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f284cc00640 1 -- 172.21.15.31:0/3293135725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2848072340 con 0x7f28480b6da0 2024-09-17T05:35:34.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f284cc00640 1 --2- 172.21.15.31:0/3293135725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28480b6da0 0x7f28480b7220 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f2834004f10 tx=0x7f2834001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:34.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f2845600640 1 -- 172.21.15.31:0/3293135725 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2834015020 con 0x7f28480b6da0 2024-09-17T05:35:34.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f2845600640 1 -- 172.21.15.31:0/3293135725 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2834011960 con 0x7f28480b6da0 2024-09-17T05:35:34.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f2850000640 1 -- 172.21.15.31:0/3293135725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28480c7dc0 con 0x7f28480b6da0 2024-09-17T05:35:34.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f2845600640 1 -- 172.21.15.31:0/3293135725 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2834011d90 con 0x7f28480b6da0 2024-09-17T05:35:34.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f2850000640 1 -- 172.21.15.31:0/3293135725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28480c8380 con 0x7f28480b6da0 2024-09-17T05:35:34.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.413+0000 7f2850000640 1 -- 172.21.15.31:0/3293135725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28480b7760 con 0x7f28480b6da0 2024-09-17T05:35:34.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.417+0000 7f2845600640 1 -- 172.21.15.31:0/3293135725 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f2834018020 con 0x7f28480b6da0 2024-09-17T05:35:34.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.417+0000 7f2845600640 1 --2- 172.21.15.31:0/3293135725 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f28280738f0 0x7f2828075db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:34.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.417+0000 7f2845600640 1 -- 172.21.15.31:0/3293135725 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5823+0+0 (secure 0 0 0) 0x7f2834095930 con 0x7f28480b6da0 2024-09-17T05:35:34.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.417+0000 7f284d600640 1 --2- 172.21.15.31:0/3293135725 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f28280738f0 0x7f2828075db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:34.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.417+0000 7f284d600640 1 --2- 172.21.15.31:0/3293135725 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f28280738f0 0x7f2828075db0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f283c006c20 tx=0x7f283c0067b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:34.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.421+0000 7f2845600640 1 -- 172.21.15.31:0/3293135725 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f283401f020 con 0x7f28480b6da0 2024-09-17T05:35:34.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:34.597+0000 7f2850000640 1 -- 172.21.15.31:0/3293135725 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2848070350 con 0x7f28480b6da0 2024-09-17T05:35:35.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.241+0000 7f2845600640 1 -- 172.21.15.31:0/3293135725 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v132) ==== 181+0+0 (secure 0 0 0) 0x7f283405f7b0 con 0x7f28480b6da0 2024-09-17T05:35:35.242 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:35:35.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.241+0000 7f2850000640 1 -- 172.21.15.31:0/3293135725 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f28280738f0 msgr2=0x7f2828075db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:35.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.241+0000 7f2850000640 1 --2- 172.21.15.31:0/3293135725 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f28280738f0 0x7f2828075db0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f283c006c20 tx=0x7f283c0067b0 comp rx=0 tx=0).stop 2024-09-17T05:35:35.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.241+0000 7f2850000640 1 -- 172.21.15.31:0/3293135725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28480b6da0 msgr2=0x7f28480b7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:35.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.241+0000 7f2850000640 1 --2- 172.21.15.31:0/3293135725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28480b6da0 0x7f28480b7220 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f2834004f10 tx=0x7f2834001640 comp rx=0 tx=0).stop 2024-09-17T05:35:35.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.245+0000 7f2850000640 1 -- 172.21.15.31:0/3293135725 shutdown_connections 2024-09-17T05:35:35.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.245+0000 7f2850000640 1 --2- 172.21.15.31:0/3293135725 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f28280738f0 0x7f2828075db0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:35.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.245+0000 7f2850000640 1 --2- 172.21.15.31:0/3293135725 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28480c7100 0x7f28480c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:35.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.245+0000 7f2850000640 1 --2- 172.21.15.31:0/3293135725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28480b6da0 0x7f28480b7220 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:35.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.245+0000 7f2850000640 1 --2- 172.21.15.31:0/3293135725 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2830004da0 0x7f28481491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:35.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.245+0000 7f2850000640 1 -- 172.21.15.31:0/3293135725 >> 172.21.15.31:0/3293135725 conn(0x7f28480d1da0 msgr2=0x7f2848071c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:35.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.245+0000 7f2850000640 1 -- 172.21.15.31:0/3293135725 shutdown_connections 2024-09-17T05:35:35.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.245+0000 7f2850000640 1 -- 172.21.15.31:0/3293135725 wait complete. 2024-09-17T05:35:35.270 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:35:35.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.421+0000 7fdee8400640 1 -- 172.21.15.31:0/48031468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee015be10 msgr2=0x7fdee00ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:35.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.421+0000 7fdee8400640 1 --2- 172.21.15.31:0/48031468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee015be10 0x7fdee00ce700 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fded4009840 tx=0x7fded401f010 comp rx=0 tx=0).stop 2024-09-17T05:35:35.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.421+0000 7fdee8400640 1 -- 172.21.15.31:0/48031468 shutdown_connections 2024-09-17T05:35:35.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.421+0000 7fdee8400640 1 --2- 172.21.15.31:0/48031468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee015be10 0x7fdee00ce700 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:35.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.421+0000 7fdee8400640 1 -- 172.21.15.31:0/48031468 >> 172.21.15.31:0/48031468 conn(0x7fdee00d1da0 msgr2=0x7fdee00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:35.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.421+0000 7fdee8400640 1 -- 172.21.15.31:0/48031468 shutdown_connections 2024-09-17T05:35:35.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.421+0000 7fdee8400640 1 -- 172.21.15.31:0/48031468 wait complete. 2024-09-17T05:35:35.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.421+0000 7fdee8400640 1 Processor -- start 2024-09-17T05:35:35.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.421+0000 7fdee8400640 1 -- start start 2024-09-17T05:35:35.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee8400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdee00b0b60 0x7fdee00c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:35.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee8400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdee015be10 0x7fdee01f3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:35.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee8400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee015c1f0 0x7fdee01f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:35.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee8400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdee00cd670 con 0x7fdee015c1f0 2024-09-17T05:35:35.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee8400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdee00cd4f0 con 0x7fdee00b0b60 2024-09-17T05:35:35.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee8400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdee00cd7f0 con 0x7fdee015be10 2024-09-17T05:35:35.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee6400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee015c1f0 0x7fdee01f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:35.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee5a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdee00b0b60 0x7fdee00c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:35.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee6400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee015c1f0 0x7fdee01f3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42040/0 (socket says 172.21.15.31:42040) 2024-09-17T05:35:35.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee6400640 1 -- 172.21.15.31:0/2550219809 learned_addr learned my addr 172.21.15.31:0/2550219809 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:35.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee5000640 1 --2- 172.21.15.31:0/2550219809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdee015be10 0x7fdee01f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:35.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee6400640 1 -- 172.21.15.31:0/2550219809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdee015be10 msgr2=0x7fdee01f3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:35.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee6400640 1 --2- 172.21.15.31:0/2550219809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdee015be10 0x7fdee01f3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:35.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee6400640 1 -- 172.21.15.31:0/2550219809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdee00b0b60 msgr2=0x7fdee00c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:35.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee6400640 1 --2- 172.21.15.31:0/2550219809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdee00b0b60 0x7fdee00c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:35.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee6400640 1 -- 172.21.15.31:0/2550219809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee015acb0 con 0x7fdee015c1f0 2024-09-17T05:35:35.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee6400640 1 --2- 172.21.15.31:0/2550219809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee015c1f0 0x7fdee01f3a90 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fded800cbc0 tx=0x7fded800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:35.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdedd600640 1 -- 172.21.15.31:0/2550219809 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded8016020 con 0x7fdee015c1f0 2024-09-17T05:35:35.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdedd600640 1 -- 172.21.15.31:0/2550219809 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fded800ab40 con 0x7fdee015c1f0 2024-09-17T05:35:35.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdedd600640 1 -- 172.21.15.31:0/2550219809 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded8012420 con 0x7fdee015c1f0 2024-09-17T05:35:35.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee8400640 1 -- 172.21.15.31:0/2550219809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee015b220 con 0x7fdee015c1f0 2024-09-17T05:35:35.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee8400640 1 -- 172.21.15.31:0/2550219809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee00cbf00 con 0x7fdee015c1f0 2024-09-17T05:35:35.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.425+0000 7fdee8400640 1 -- 172.21.15.31:0/2550219809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee00ce460 con 0x7fdee015c1f0 2024-09-17T05:35:35.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.429+0000 7fdedd600640 1 -- 172.21.15.31:0/2550219809 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7fded8019020 con 0x7fdee015c1f0 2024-09-17T05:35:35.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.429+0000 7fdedd600640 1 --2- 172.21.15.31:0/2550219809 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdec00738c0 0x7fdec0075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:35.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.429+0000 7fdedd600640 1 -- 172.21.15.31:0/2550219809 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5385+0+0 (secure 0 0 0) 0x7fded8094bf0 con 0x7fdee015c1f0 2024-09-17T05:35:35.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.429+0000 7fdee5a00640 1 --2- 172.21.15.31:0/2550219809 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdec00738c0 0x7fdec0075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:35.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.429+0000 7fdee5a00640 1 --2- 172.21.15.31:0/2550219809 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdec00738c0 0x7fdec0075d80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fded40b2000 tx=0x7fded401d850 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:35.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.433+0000 7fdedd600640 1 -- 172.21.15.31:0/2550219809 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fded8020030 con 0x7fdee015c1f0 2024-09-17T05:35:35.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:35.609+0000 7fdee8400640 1 -- 172.21.15.31:0/2550219809 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdee0070350 con 0x7fdee015c1f0 2024-09-17T05:35:36.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.241+0000 7fdedd600640 1 -- 172.21.15.31:0/2550219809 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v133) ==== 169+0+0 (secure 0 0 0) 0x7fded805ecf0 con 0x7fdee015c1f0 2024-09-17T05:35:36.244 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-09-17T05:35:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.245+0000 7fdee8400640 1 -- 172.21.15.31:0/2550219809 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdec00738c0 msgr2=0x7fdec0075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.245+0000 7fdee8400640 1 --2- 172.21.15.31:0/2550219809 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdec00738c0 0x7fdec0075d80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fded40b2000 tx=0x7fded401d850 comp rx=0 tx=0).stop 2024-09-17T05:35:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.245+0000 7fdee8400640 1 -- 172.21.15.31:0/2550219809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee015c1f0 msgr2=0x7fdee01f3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.245+0000 7fdee8400640 1 --2- 172.21.15.31:0/2550219809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee015c1f0 0x7fdee01f3a90 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fded800cbc0 tx=0x7fded800ccb0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.245+0000 7fdee8400640 1 -- 172.21.15.31:0/2550219809 shutdown_connections 2024-09-17T05:35:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.245+0000 7fdee8400640 1 --2- 172.21.15.31:0/2550219809 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdec00738c0 0x7fdec0075d80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.245+0000 7fdee8400640 1 --2- 172.21.15.31:0/2550219809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdee015c1f0 0x7fdee01f3a90 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.245+0000 7fdee8400640 1 --2- 172.21.15.31:0/2550219809 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdee015be10 0x7fdee01f3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.245+0000 7fdee8400640 1 --2- 172.21.15.31:0/2550219809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdee00b0b60 0x7fdee00c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.245+0000 7fdee8400640 1 -- 172.21.15.31:0/2550219809 >> 172.21.15.31:0/2550219809 conn(0x7fdee00d1da0 msgr2=0x7fdee0071e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:36.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.245+0000 7fdee8400640 1 -- 172.21.15.31:0/2550219809 shutdown_connections 2024-09-17T05:35:36.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.245+0000 7fdee8400640 1 -- 172.21.15.31:0/2550219809 wait complete. 2024-09-17T05:35:36.270 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:35:36.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.417+0000 7f0efa400640 1 -- 172.21.15.31:0/2437958714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef40d28e0 msgr2=0x7f0ef40cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:36.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.417+0000 7f0efa400640 1 --2- 172.21.15.31:0/2437958714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef40d28e0 0x7f0ef40cebb0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009bc0 tx=0x7f0eec01cba0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.417+0000 7f0efa400640 1 -- 172.21.15.31:0/2437958714 shutdown_connections 2024-09-17T05:35:36.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.417+0000 7f0efa400640 1 --2- 172.21.15.31:0/2437958714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef40d28e0 0x7f0ef40cebb0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.417+0000 7f0efa400640 1 --2- 172.21.15.31:0/2437958714 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef415bea0 0x7f0ef40ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.417+0000 7f0efa400640 1 -- 172.21.15.31:0/2437958714 >> 172.21.15.31:0/2437958714 conn(0x7f0ef40d1dc0 msgr2=0x7f0ef40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:36.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.417+0000 7f0efa400640 1 -- 172.21.15.31:0/2437958714 shutdown_connections 2024-09-17T05:35:36.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.417+0000 7f0efa400640 1 -- 172.21.15.31:0/2437958714 wait complete. 2024-09-17T05:35:36.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.417+0000 7f0efa400640 1 Processor -- start 2024-09-17T05:35:36.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.417+0000 7f0efa400640 1 -- start start 2024-09-17T05:35:36.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0efa400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef40cdb30 0x7f0ef4152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:36.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0efa400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ef40d28e0 0x7f0ef40cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:36.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0efa400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef415bea0 0x7f0ef41fb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:36.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0efa400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef4168f70 con 0x7f0ef415bea0 2024-09-17T05:35:36.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0efa400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef4168df0 con 0x7f0ef40d28e0 2024-09-17T05:35:36.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0efa400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0ef41690f0 con 0x7f0ef40cdb30 2024-09-17T05:35:36.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0ef3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef415bea0 0x7f0ef41fb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:36.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0ef3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef415bea0 0x7f0ef41fb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42044/0 (socket says 172.21.15.31:42044) 2024-09-17T05:35:36.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0ef3e00640 1 -- 172.21.15.31:0/169540025 learned_addr learned my addr 172.21.15.31:0/169540025 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:36.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0ef3400640 1 --2- 172.21.15.31:0/169540025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef40cdb30 0x7f0ef4152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:36.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0ef2a00640 1 --2- 172.21.15.31:0/169540025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ef40d28e0 0x7f0ef40cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:36.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0ef3e00640 1 -- 172.21.15.31:0/169540025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef40cdb30 msgr2=0x7f0ef4152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:36.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0ef3e00640 1 --2- 172.21.15.31:0/169540025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef40cdb30 0x7f0ef4152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0ef3e00640 1 -- 172.21.15.31:0/169540025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ef40d28e0 msgr2=0x7f0ef40cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:36.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0ef3e00640 1 --2- 172.21.15.31:0/169540025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ef40d28e0 0x7f0ef40cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0ef3e00640 1 -- 172.21.15.31:0/169540025 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef40cada0 con 0x7f0ef415bea0 2024-09-17T05:35:36.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0ef2a00640 1 --2- 172.21.15.31:0/169540025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ef40d28e0 0x7f0ef40cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:36.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0ef3e00640 1 --2- 172.21.15.31:0/169540025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef415bea0 0x7f0ef41fb720 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0b0040 tx=0x7f0eec009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:36.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0eeb400640 1 -- 172.21.15.31:0/169540025 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec0b2040 con 0x7f0ef415bea0 2024-09-17T05:35:36.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0eeb400640 1 -- 172.21.15.31:0/169540025 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0eec0bb070 con 0x7f0ef415bea0 2024-09-17T05:35:36.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0eeb400640 1 -- 172.21.15.31:0/169540025 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec0045b0 con 0x7f0ef415bea0 2024-09-17T05:35:36.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0efa400640 1 -- 172.21.15.31:0/169540025 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef40b2040 con 0x7f0ef415bea0 2024-09-17T05:35:36.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0efa400640 1 -- 172.21.15.31:0/169540025 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef40cb320 con 0x7f0ef415bea0 2024-09-17T05:35:36.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.421+0000 7f0efa400640 1 -- 172.21.15.31:0/169540025 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ef40cc9d0 con 0x7f0ef415bea0 2024-09-17T05:35:36.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.425+0000 7f0eeb400640 1 -- 172.21.15.31:0/169540025 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f0eec0c0460 con 0x7f0ef415bea0 2024-09-17T05:35:36.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.425+0000 7f0eeb400640 1 --2- 172.21.15.31:0/169540025 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0ed40738f0 0x7f0ed4075db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:36.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.425+0000 7f0eeb400640 1 -- 172.21.15.31:0/169540025 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4971+0+0 (secure 0 0 0) 0x7f0eec12f3c0 con 0x7f0ef415bea0 2024-09-17T05:35:36.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.425+0000 7f0ef3400640 1 --2- 172.21.15.31:0/169540025 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0ed40738f0 0x7f0ed4075db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:36.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.425+0000 7f0ef3400640 1 --2- 172.21.15.31:0/169540025 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0ed40738f0 0x7f0ed4075db0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400bb50 tx=0x7f0ee400b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:36.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.429+0000 7f0eeb400640 1 -- 172.21.15.31:0/169540025 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0eec0a5e20 con 0x7f0ef415bea0 2024-09-17T05:35:36.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.605+0000 7f0efa400640 1 -- 172.21.15.31:0/169540025 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f0ef40b50c0 con 0x7f0ef415bea0 2024-09-17T05:35:36.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.613+0000 7f0eeb400640 1 -- 172.21.15.31:0/169540025 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v43) ==== 71+0+0 (secure 0 0 0) 0x7f0eec016790 con 0x7f0ef415bea0 2024-09-17T05:35:36.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.613+0000 7f0efa400640 1 -- 172.21.15.31:0/169540025 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0ed40738f0 msgr2=0x7f0ed4075db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:36.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.613+0000 7f0efa400640 1 --2- 172.21.15.31:0/169540025 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0ed40738f0 0x7f0ed4075db0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400bb50 tx=0x7f0ee400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.613+0000 7f0efa400640 1 -- 172.21.15.31:0/169540025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef415bea0 msgr2=0x7f0ef41fb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:36.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.613+0000 7f0efa400640 1 --2- 172.21.15.31:0/169540025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef415bea0 0x7f0ef41fb720 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0b0040 tx=0x7f0eec009280 comp rx=0 tx=0).stop 2024-09-17T05:35:36.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.613+0000 7f0efa400640 1 -- 172.21.15.31:0/169540025 shutdown_connections 2024-09-17T05:35:36.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.613+0000 7f0efa400640 1 --2- 172.21.15.31:0/169540025 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0ed40738f0 0x7f0ed4075db0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.613+0000 7f0efa400640 1 --2- 172.21.15.31:0/169540025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef415bea0 0x7f0ef41fb720 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.613+0000 7f0efa400640 1 --2- 172.21.15.31:0/169540025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0ef40d28e0 0x7f0ef40cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.613+0000 7f0efa400640 1 --2- 172.21.15.31:0/169540025 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0ef40cdb30 0x7f0ef4152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.613+0000 7f0efa400640 1 -- 172.21.15.31:0/169540025 >> 172.21.15.31:0/169540025 conn(0x7f0ef40d1dc0 msgr2=0x7f0ef406f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:36.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.617+0000 7f0efa400640 1 -- 172.21.15.31:0/169540025 shutdown_connections 2024-09-17T05:35:36.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.617+0000 7f0efa400640 1 -- 172.21.15.31:0/169540025 wait complete. 2024-09-17T05:35:36.637 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol' 2024-09-17T05:35:36.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.785+0000 7ff24f200640 1 -- 172.21.15.31:0/2898963515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2500ca950 msgr2=0x7ff25006e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:36.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.785+0000 7ff24f200640 1 --2- 172.21.15.31:0/2898963515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2500ca950 0x7ff25006e960 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7ff2500b2650 tx=0x7ff24001f370 comp rx=0 tx=0).stop 2024-09-17T05:35:36.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.785+0000 7ff24f200640 1 -- 172.21.15.31:0/2898963515 shutdown_connections 2024-09-17T05:35:36.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.785+0000 7ff24f200640 1 --2- 172.21.15.31:0/2898963515 >> v2:172.21.15.155:3300/0 conn(0x7ff2500af120 0x7ff2500cad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.785+0000 7ff24f200640 1 --2- 172.21.15.31:0/2898963515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2500ca950 0x7ff25006e960 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.785+0000 7ff24f200640 1 -- 172.21.15.31:0/2898963515 >> 172.21.15.31:0/2898963515 conn(0x7ff2500cfa30 msgr2=0x7ff2500cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:36.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.785+0000 7ff24f200640 1 -- 172.21.15.31:0/2898963515 shutdown_connections 2024-09-17T05:35:36.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.785+0000 7ff24f200640 1 -- 172.21.15.31:0/2898963515 wait complete. 2024-09-17T05:35:36.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24f200640 1 Processor -- start 2024-09-17T05:35:36.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24f200640 1 -- start start 2024-09-17T05:35:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2500707b0 0x7ff2500b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2500af120 0x7ff2501f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2500ca950 0x7ff2501f2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff2500739f0 con 0x7ff2500af120 2024-09-17T05:35:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24f200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff250073870 con 0x7ff2500707b0 2024-09-17T05:35:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff25015eb30 con 0x7ff2500ca950 2024-09-17T05:35:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2500af120 0x7ff2501f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2500af120 0x7ff2501f23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42066/0 (socket says 172.21.15.31:42066) 2024-09-17T05:35:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24d400640 1 -- 172.21.15.31:0/3160156405 learned_addr learned my addr 172.21.15.31:0/3160156405 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24de00640 1 --2- 172.21.15.31:0/3160156405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2500707b0 0x7ff2500b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24d400640 1 -- 172.21.15.31:0/3160156405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2500ca950 msgr2=0x7ff2501f2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:36.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24d400640 1 --2- 172.21.15.31:0/3160156405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2500ca950 0x7ff2501f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24d400640 1 -- 172.21.15.31:0/3160156405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2500707b0 msgr2=0x7ff2500b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:36.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24d400640 1 --2- 172.21.15.31:0/3160156405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2500707b0 0x7ff2500b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:36.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24d400640 1 -- 172.21.15.31:0/3160156405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2501f2e50 con 0x7ff2500af120 2024-09-17T05:35:36.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24d400640 1 --2- 172.21.15.31:0/3160156405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2500af120 0x7ff2501f23d0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00e9f0 tx=0x7ff23c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:36.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff246000640 1 -- 172.21.15.31:0/3160156405 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c00cd80 con 0x7ff2500af120 2024-09-17T05:35:36.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff246000640 1 -- 172.21.15.31:0/3160156405 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff23c010430 con 0x7ff2500af120 2024-09-17T05:35:36.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24f200640 1 -- 172.21.15.31:0/3160156405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2501f3100 con 0x7ff2500af120 2024-09-17T05:35:36.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff246000640 1 -- 172.21.15.31:0/3160156405 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c010860 con 0x7ff2500af120 2024-09-17T05:35:36.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.789+0000 7ff24f200640 1 -- 172.21.15.31:0/3160156405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2501508e0 con 0x7ff2500af120 2024-09-17T05:35:36.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.793+0000 7ff24f200640 1 -- 172.21.15.31:0/3160156405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff250150190 con 0x7ff2500af120 2024-09-17T05:35:36.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.793+0000 7ff246000640 1 -- 172.21.15.31:0/3160156405 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7ff23c01f020 con 0x7ff2500af120 2024-09-17T05:35:36.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.793+0000 7ff246000640 1 --2- 172.21.15.31:0/3160156405 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff2300738c0 0x7ff230075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:36.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.793+0000 7ff246000640 1 -- 172.21.15.31:0/3160156405 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4971+0+0 (secure 0 0 0) 0x7ff23c0955d0 con 0x7ff2500af120 2024-09-17T05:35:36.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.793+0000 7ff24de00640 1 --2- 172.21.15.31:0/3160156405 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff2300738c0 0x7ff230075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:36.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.793+0000 7ff24de00640 1 --2- 172.21.15.31:0/3160156405 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff2300738c0 0x7ff230075d80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff2400b1000 tx=0x7ff24001dbb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:36.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:36.797+0000 7ff246000640 1 -- 172.21.15.31:0/3160156405 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff23c05fe80 con 0x7ff2500af120 2024-09-17T05:35:37.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.037+0000 7ff24f200640 1 -- 172.21.15.31:0/3160156405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]} v 0) -- 0x7ff2500cad30 con 0x7ff2500af120 2024-09-17T05:35:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.245+0000 7ff246000640 1 -- 172.21.15.31:0/3160156405 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]}]=0 v383) ==== 151+0+0 (secure 0 0 0) 0x7ff23c05f780 con 0x7ff2500af120 2024-09-17T05:35:37.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.245+0000 7ff24f200640 1 -- 172.21.15.31:0/3160156405 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff2300738c0 msgr2=0x7ff230075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:37.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.245+0000 7ff24f200640 1 --2- 172.21.15.31:0/3160156405 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff2300738c0 0x7ff230075d80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff2400b1000 tx=0x7ff24001dbb0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.245+0000 7ff24f200640 1 -- 172.21.15.31:0/3160156405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2500af120 msgr2=0x7ff2501f23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:37.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.245+0000 7ff24f200640 1 --2- 172.21.15.31:0/3160156405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2500af120 0x7ff2501f23d0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00e9f0 tx=0x7ff23c00eeb0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.245+0000 7ff24f200640 1 -- 172.21.15.31:0/3160156405 shutdown_connections 2024-09-17T05:35:37.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.245+0000 7ff24f200640 1 --2- 172.21.15.31:0/3160156405 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff2300738c0 0x7ff230075d80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.245+0000 7ff24f200640 1 --2- 172.21.15.31:0/3160156405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2500ca950 0x7ff2501f2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.245+0000 7ff24f200640 1 --2- 172.21.15.31:0/3160156405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2500af120 0x7ff2501f23d0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.245+0000 7ff24f200640 1 --2- 172.21.15.31:0/3160156405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff2500707b0 0x7ff2500b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.245+0000 7ff24f200640 1 -- 172.21.15.31:0/3160156405 >> 172.21.15.31:0/3160156405 conn(0x7ff2500cfa30 msgr2=0x7ff2500cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:37.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.245+0000 7ff24f200640 1 -- 172.21.15.31:0/3160156405 shutdown_connections 2024-09-17T05:35:37.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.245+0000 7ff24f200640 1 -- 172.21.15.31:0/3160156405 wait complete. 2024-09-17T05:35:37.269 INFO:tasks.cephfs_test_runner:test_subvolume_ops_on_nonexistent_vol (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-09-17T05:35:37.270 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_upgrade_legacy_to_v1 (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- rather than going through a full upgrade cycle, 2024-09-17T05:35:37.270 INFO:tasks.cephfs_test_runner:test_subvolume_upgrade_legacy_to_v1 (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:35:37.271 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:35:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a8ba00640 1 -- 172.21.15.31:0/3973748459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a84158240 msgr2=0x7f3a8415ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a8ba00640 1 --2- 172.21.15.31:0/3973748459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a84158240 0x7f3a8415ede0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f3a840b06a0 tx=0x7f3a7401c890 comp rx=0 tx=0).stop 2024-09-17T05:35:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a8ba00640 1 -- 172.21.15.31:0/3973748459 shutdown_connections 2024-09-17T05:35:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a8ba00640 1 --2- 172.21.15.31:0/3973748459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a84161f70 0x7f3a840cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a8ba00640 1 --2- 172.21.15.31:0/3973748459 >> v2:172.21.15.155:3300/0 conn(0x7f3a84158620 0x7f3a84161a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a8ba00640 1 --2- 172.21.15.31:0/3973748459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a84158240 0x7f3a8415ede0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a8ba00640 1 -- 172.21.15.31:0/3973748459 >> 172.21.15.31:0/3973748459 conn(0x7f3a840d0c90 msgr2=0x7f3a840d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a8ba00640 1 -- 172.21.15.31:0/3973748459 shutdown_connections 2024-09-17T05:35:37.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a8ba00640 1 -- 172.21.15.31:0/3973748459 wait complete. 2024-09-17T05:35:37.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a8ba00640 1 Processor -- start 2024-09-17T05:35:37.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a8ba00640 1 -- start start 2024-09-17T05:35:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a8ba00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a84158240 0x7f3a840a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a8ba00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a84158620 0x7f3a841576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a8ba00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a84161f70 0x7f3a84157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a8ba00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3a840ce860 con 0x7f3a84158240 2024-09-17T05:35:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a8ba00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3a840ce9e0 con 0x7f3a84161f70 2024-09-17T05:35:37.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a8ba00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3a840ceb60 con 0x7f3a84158620 2024-09-17T05:35:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a89000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a84158240 0x7f3a840a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a89000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a84158240 0x7f3a840a1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42086/0 (socket says 172.21.15.31:42086) 2024-09-17T05:35:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a89000640 1 -- 172.21.15.31:0/2900460035 learned_addr learned my addr 172.21.15.31:0/2900460035 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a7be00640 1 --2- 172.21.15.31:0/2900460035 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a84158620 0x7f3a841576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a89a00640 1 --2- 172.21.15.31:0/2900460035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a84161f70 0x7f3a84157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a89000640 1 -- 172.21.15.31:0/2900460035 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a84158620 msgr2=0x7f3a841576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:37.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a89000640 1 --2- 172.21.15.31:0/2900460035 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a84158620 0x7f3a841576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a89000640 1 -- 172.21.15.31:0/2900460035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a84161f70 msgr2=0x7f3a84157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a89000640 1 --2- 172.21.15.31:0/2900460035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a84161f70 0x7f3a84157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a89000640 1 -- 172.21.15.31:0/2900460035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a840b57a0 con 0x7f3a84158240 2024-09-17T05:35:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a89a00640 1 --2- 172.21.15.31:0/2900460035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a84161f70 0x7f3a84157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.417+0000 7f3a7be00640 1 --2- 172.21.15.31:0/2900460035 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a84158620 0x7f3a841576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:37.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.421+0000 7f3a89000640 1 --2- 172.21.15.31:0/2900460035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a84158240 0x7f3a840a1250 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f3a740b0040 tx=0x7f3a740a5890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.421+0000 7f3a81600640 1 -- 172.21.15.31:0/2900460035 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a740b2040 con 0x7f3a84158240 2024-09-17T05:35:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.421+0000 7f3a81600640 1 -- 172.21.15.31:0/2900460035 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a740044a0 con 0x7f3a84158240 2024-09-17T05:35:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.421+0000 7f3a81600640 1 -- 172.21.15.31:0/2900460035 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a74005290 con 0x7f3a84158240 2024-09-17T05:35:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.421+0000 7f3a8ba00640 1 -- 172.21.15.31:0/2900460035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a840b5a80 con 0x7f3a84158240 2024-09-17T05:35:37.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.421+0000 7f3a8ba00640 1 -- 172.21.15.31:0/2900460035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a840b6040 con 0x7f3a84158240 2024-09-17T05:35:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.421+0000 7f3a8ba00640 1 -- 172.21.15.31:0/2900460035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a840cf080 con 0x7f3a84158240 2024-09-17T05:35:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.421+0000 7f3a81600640 1 -- 172.21.15.31:0/2900460035 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f3a74005430 con 0x7f3a84158240 2024-09-17T05:35:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.421+0000 7f3a81600640 1 --2- 172.21.15.31:0/2900460035 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3a600738c0 0x7f3a60075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:37.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.421+0000 7f3a81600640 1 -- 172.21.15.31:0/2900460035 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4971+0+0 (secure 0 0 0) 0x7f3a7412e6f0 con 0x7f3a84158240 2024-09-17T05:35:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.425+0000 7f3a7be00640 1 --2- 172.21.15.31:0/2900460035 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3a600738c0 0x7f3a60075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.425+0000 7f3a7be00640 1 --2- 172.21.15.31:0/2900460035 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3a600738c0 0x7f3a60075d80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c005e10 tx=0x7f3a6c005d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:37.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.425+0000 7f3a81600640 1 -- 172.21.15.31:0/2900460035 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f3a740164b0 con 0x7f3a84158240 2024-09-17T05:35:37.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.605+0000 7f3a8ba00640 1 -- 172.21.15.31:0/2900460035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a84070800 con 0x7f3a84158240 2024-09-17T05:35:37.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.605+0000 7f3a81600640 1 -- 172.21.15.31:0/2900460035 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) ==== 74+0+13112 (secure 0 0 0) 0x7f3a740f9130 con 0x7f3a84158240 2024-09-17T05:35:37.609 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:37.609 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":133,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:35:36.244095+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:6835/1879117968":"2024-09-18T05:35:33.233838+0000","172.21.15.155:6809/1879117968":"2024-09-18T05:35:33.233838+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:35:37.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.609+0000 7f3a8ba00640 1 -- 172.21.15.31:0/2900460035 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3a600738c0 msgr2=0x7f3a60075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:37.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.609+0000 7f3a8ba00640 1 --2- 172.21.15.31:0/2900460035 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3a600738c0 0x7f3a60075d80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c005e10 tx=0x7f3a6c005d60 comp rx=0 tx=0).stop 2024-09-17T05:35:37.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.609+0000 7f3a8ba00640 1 -- 172.21.15.31:0/2900460035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a84158240 msgr2=0x7f3a840a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:37.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.609+0000 7f3a8ba00640 1 --2- 172.21.15.31:0/2900460035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a84158240 0x7f3a840a1250 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f3a740b0040 tx=0x7f3a740a5890 comp rx=0 tx=0).stop 2024-09-17T05:35:37.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.609+0000 7f3a8ba00640 1 -- 172.21.15.31:0/2900460035 shutdown_connections 2024-09-17T05:35:37.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.609+0000 7f3a8ba00640 1 --2- 172.21.15.31:0/2900460035 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3a600738c0 0x7f3a60075d80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.609+0000 7f3a8ba00640 1 --2- 172.21.15.31:0/2900460035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a84161f70 0x7f3a84157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.609+0000 7f3a8ba00640 1 --2- 172.21.15.31:0/2900460035 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3a84158620 0x7f3a841576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.609+0000 7f3a8ba00640 1 --2- 172.21.15.31:0/2900460035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a84158240 0x7f3a840a1250 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.609+0000 7f3a8ba00640 1 -- 172.21.15.31:0/2900460035 >> 172.21.15.31:0/2900460035 conn(0x7f3a840d0c90 msgr2=0x7f3a84161620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:37.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.609+0000 7f3a8ba00640 1 -- 172.21.15.31:0/2900460035 shutdown_connections 2024-09-17T05:35:37.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.609+0000 7f3a8ba00640 1 -- 172.21.15.31:0/2900460035 wait complete. 2024-09-17T05:35:37.632 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:28:33.209612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:35:37.633 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:35:37.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.781+0000 7f3d34600640 1 -- 172.21.15.31:0/1035524863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d2c1605d0 msgr2=0x7f3d2c0d0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:37.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.781+0000 7f3d34600640 1 --2- 172.21.15.31:0/1035524863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d2c1605d0 0x7f3d2c0d0690 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009900 tx=0x7f3d2001c8e0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.781+0000 7f3d34600640 1 -- 172.21.15.31:0/1035524863 shutdown_connections 2024-09-17T05:35:37.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.781+0000 7f3d34600640 1 --2- 172.21.15.31:0/1035524863 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d2c0afb10 0x7f3d2c0affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.781+0000 7f3d34600640 1 --2- 172.21.15.31:0/1035524863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d2c1605d0 0x7f3d2c0d0690 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.781+0000 7f3d34600640 1 -- 172.21.15.31:0/1035524863 >> 172.21.15.31:0/1035524863 conn(0x7f3d2c0d1dd0 msgr2=0x7f3d2c0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:37.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.781+0000 7f3d34600640 1 -- 172.21.15.31:0/1035524863 shutdown_connections 2024-09-17T05:35:37.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.781+0000 7f3d34600640 1 -- 172.21.15.31:0/1035524863 wait complete. 2024-09-17T05:35:37.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.781+0000 7f3d34600640 1 Processor -- start 2024-09-17T05:35:37.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.781+0000 7f3d34600640 1 -- start start 2024-09-17T05:35:37.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.781+0000 7f3d34600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d2c0afb10 0x7f3d2c15be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:37.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.781+0000 7f3d34600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d2c0b1650 0x7f3d2c157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:37.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.781+0000 7f3d34600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d2c1605d0 0x7f3d2c1579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:37.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.781+0000 7f3d34600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2c0b0ec0 con 0x7f3d2c0afb10 2024-09-17T05:35:37.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.781+0000 7f3d34600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2c0b1430 con 0x7f3d2c1605d0 2024-09-17T05:35:37.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.781+0000 7f3d34600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3d2c169540 con 0x7f3d2c0b1650 2024-09-17T05:35:37.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d31c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d2c0afb10 0x7f3d2c15be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:37.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d31c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d2c0afb10 0x7f3d2c15be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42102/0 (socket says 172.21.15.31:42102) 2024-09-17T05:35:37.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d31c00640 1 -- 172.21.15.31:0/3084697274 learned_addr learned my addr 172.21.15.31:0/3084697274 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:37.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d32600640 1 --2- 172.21.15.31:0/3084697274 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d2c1605d0 0x7f3d2c1579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:37.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d31200640 1 --2- 172.21.15.31:0/3084697274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d2c0b1650 0x7f3d2c157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:37.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d31c00640 1 -- 172.21.15.31:0/3084697274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d2c0b1650 msgr2=0x7f3d2c157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:37.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d31c00640 1 --2- 172.21.15.31:0/3084697274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d2c0b1650 0x7f3d2c157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d31c00640 1 -- 172.21.15.31:0/3084697274 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d2c1605d0 msgr2=0x7f3d2c1579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:37.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d31c00640 1 --2- 172.21.15.31:0/3084697274 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d2c1605d0 0x7f3d2c1579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d31c00640 1 -- 172.21.15.31:0/3084697274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2c071ad0 con 0x7f3d2c0afb10 2024-09-17T05:35:37.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d32600640 1 --2- 172.21.15.31:0/3084697274 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d2c1605d0 0x7f3d2c1579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:37.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d31c00640 1 --2- 172.21.15.31:0/3084697274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d2c0afb10 0x7f3d2c15be20 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009850 tx=0x7f3d200a5520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:37.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d29600640 1 -- 172.21.15.31:0/3084697274 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d200b2040 con 0x7f3d2c0afb10 2024-09-17T05:35:37.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d29600640 1 -- 172.21.15.31:0/3084697274 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d200042c0 con 0x7f3d2c0afb10 2024-09-17T05:35:37.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d29600640 1 -- 172.21.15.31:0/3084697274 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d20005020 con 0x7f3d2c0afb10 2024-09-17T05:35:37.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d34600640 1 -- 172.21.15.31:0/3084697274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d2c15cb40 con 0x7f3d2c0afb10 2024-09-17T05:35:37.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d34600640 1 -- 172.21.15.31:0/3084697274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d2c15d100 con 0x7f3d2c0afb10 2024-09-17T05:35:37.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d34600640 1 -- 172.21.15.31:0/3084697274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d2c0affc0 con 0x7f3d2c0afb10 2024-09-17T05:35:37.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.785+0000 7f3d29600640 1 -- 172.21.15.31:0/3084697274 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f3d200051e0 con 0x7f3d2c0afb10 2024-09-17T05:35:37.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.789+0000 7f3d29600640 1 --2- 172.21.15.31:0/3084697274 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3d0c0738f0 0x7f3d0c075db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:37.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.789+0000 7f3d29600640 1 -- 172.21.15.31:0/3084697274 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4971+0+0 (secure 0 0 0) 0x7f3d2012e5a0 con 0x7f3d2c0afb10 2024-09-17T05:35:37.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.789+0000 7f3d31200640 1 --2- 172.21.15.31:0/3084697274 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3d0c0738f0 0x7f3d0c075db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:37.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.789+0000 7f3d31200640 1 --2- 172.21.15.31:0/3084697274 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3d0c0738f0 0x7f3d0c075db0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c15ca00 tx=0x7f3d18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:37.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.793+0000 7f3d29600640 1 -- 172.21.15.31:0/3084697274 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f3d200164d0 con 0x7f3d2c0afb10 2024-09-17T05:35:37.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.965+0000 7f3d34600640 1 -- 172.21.15.31:0/3084697274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3d2c0d1080 con 0x7f3d2c0afb10 2024-09-17T05:35:37.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.965+0000 7f3d29600640 1 -- 172.21.15.31:0/3084697274 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v133) ==== 93+0+10 (secure 0 0 0) 0x7f3d200f9020 con 0x7f3d2c0afb10 2024-09-17T05:35:37.968 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-09-17T05:35:37.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.969+0000 7f3d34600640 1 -- 172.21.15.31:0/3084697274 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3d0c0738f0 msgr2=0x7f3d0c075db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:37.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.969+0000 7f3d34600640 1 --2- 172.21.15.31:0/3084697274 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3d0c0738f0 0x7f3d0c075db0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c15ca00 tx=0x7f3d18009040 comp rx=0 tx=0).stop 2024-09-17T05:35:37.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.969+0000 7f3d34600640 1 -- 172.21.15.31:0/3084697274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d2c0afb10 msgr2=0x7f3d2c15be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:37.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.969+0000 7f3d34600640 1 --2- 172.21.15.31:0/3084697274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d2c0afb10 0x7f3d2c15be20 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009850 tx=0x7f3d200a5520 comp rx=0 tx=0).stop 2024-09-17T05:35:37.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.969+0000 7f3d34600640 1 -- 172.21.15.31:0/3084697274 shutdown_connections 2024-09-17T05:35:37.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.969+0000 7f3d34600640 1 --2- 172.21.15.31:0/3084697274 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3d0c0738f0 0x7f3d0c075db0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.969+0000 7f3d34600640 1 --2- 172.21.15.31:0/3084697274 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3d2c1605d0 0x7f3d2c1579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.969+0000 7f3d34600640 1 --2- 172.21.15.31:0/3084697274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3d2c0b1650 0x7f3d2c157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.969+0000 7f3d34600640 1 --2- 172.21.15.31:0/3084697274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d2c0afb10 0x7f3d2c15be20 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:37.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.969+0000 7f3d34600640 1 -- 172.21.15.31:0/3084697274 >> 172.21.15.31:0/3084697274 conn(0x7f3d2c0d1dd0 msgr2=0x7f3d2c071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:37.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.969+0000 7f3d34600640 1 -- 172.21.15.31:0/3084697274 shutdown_connections 2024-09-17T05:35:37.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:37.969+0000 7f3d34600640 1 -- 172.21.15.31:0/3084697274 wait complete. 2024-09-17T05:35:37.990 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1' 2024-09-17T05:35:38.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.137+0000 7ff4e5c00640 1 -- 172.21.15.31:0/3951216040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4e015dae0 msgr2=0x7ff4e00acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:38.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.137+0000 7ff4e5c00640 1 --2- 172.21.15.31:0/3951216040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4e015dae0 0x7ff4e00acd40 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0009900 tx=0x7ff4d001c7c0 comp rx=0 tx=0).stop 2024-09-17T05:35:38.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.137+0000 7ff4e5c00640 1 -- 172.21.15.31:0/3951216040 shutdown_connections 2024-09-17T05:35:38.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.137+0000 7ff4e5c00640 1 --2- 172.21.15.31:0/3951216040 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4e015dae0 0x7ff4e00acd40 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:38.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.137+0000 7ff4e5c00640 1 -- 172.21.15.31:0/3951216040 >> 172.21.15.31:0/3951216040 conn(0x7ff4e00b18f0 msgr2=0x7ff4e00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:38.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.137+0000 7ff4e5c00640 1 -- 172.21.15.31:0/3951216040 shutdown_connections 2024-09-17T05:35:38.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.137+0000 7ff4e5c00640 1 -- 172.21.15.31:0/3951216040 wait complete. 2024-09-17T05:35:38.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.137+0000 7ff4e5c00640 1 Processor -- start 2024-09-17T05:35:38.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.137+0000 7ff4e5c00640 1 -- start start 2024-09-17T05:35:38.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4e5c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4e00b49e0 0x7ff4e015afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:38.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4e5c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4e00cd100 0x7ff4e00c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:38.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4e5c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4e015dae0 0x7ff4e0152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:38.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4e5c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e0168e60 con 0x7ff4e00cd100 2024-09-17T05:35:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4e5c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e0168ce0 con 0x7ff4e00b49e0 2024-09-17T05:35:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4e5c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff4e0168fe0 con 0x7ff4e015dae0 2024-09-17T05:35:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4d7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4e00cd100 0x7ff4e00c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4d7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4e00cd100 0x7ff4e00c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42114/0 (socket says 172.21.15.31:42114) 2024-09-17T05:35:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4d7e00640 1 -- 172.21.15.31:0/1357861356 learned_addr learned my addr 172.21.15.31:0/1357861356 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4d7e00640 1 -- 172.21.15.31:0/1357861356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4e015dae0 msgr2=0x7ff4e0152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4dea00640 1 --2- 172.21.15.31:0/1357861356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4e00b49e0 0x7ff4e015afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4d7e00640 1 --2- 172.21.15.31:0/1357861356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4e015dae0 0x7ff4e0152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4d7e00640 1 -- 172.21.15.31:0/1357861356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4e00b49e0 msgr2=0x7ff4e015afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4d7e00640 1 --2- 172.21.15.31:0/1357861356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4e00b49e0 0x7ff4e015afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4d7e00640 1 -- 172.21.15.31:0/1357861356 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e00aeef0 con 0x7ff4e00cd100 2024-09-17T05:35:38.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4dea00640 1 --2- 172.21.15.31:0/1357861356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4e00b49e0 0x7ff4e015afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:38.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4d7e00640 1 --2- 172.21.15.31:0/1357861356 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4e00cd100 0x7ff4e00c8f70 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800c4b0 tx=0x7ff4c800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:38.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4d6a00640 1 -- 172.21.15.31:0/1357861356 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80052d0 con 0x7ff4e00cd100 2024-09-17T05:35:38.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4d6a00640 1 -- 172.21.15.31:0/1357861356 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4c8005470 con 0x7ff4e00cd100 2024-09-17T05:35:38.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4d6a00640 1 -- 172.21.15.31:0/1357861356 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8012870 con 0x7ff4e00cd100 2024-09-17T05:35:38.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4e5c00640 1 -- 172.21.15.31:0/1357861356 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e00af1b0 con 0x7ff4e00cd100 2024-09-17T05:35:38.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4e5c00640 1 -- 172.21.15.31:0/1357861356 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e00af770 con 0x7ff4e00cd100 2024-09-17T05:35:38.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.141+0000 7ff4e5c00640 1 -- 172.21.15.31:0/1357861356 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4e0069410 con 0x7ff4e00cd100 2024-09-17T05:35:38.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.145+0000 7ff4d6a00640 1 -- 172.21.15.31:0/1357861356 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7ff4c8003600 con 0x7ff4e00cd100 2024-09-17T05:35:38.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.145+0000 7ff4d6a00640 1 --2- 172.21.15.31:0/1357861356 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff4bc0738c0 0x7ff4bc075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:38.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.145+0000 7ff4d6a00640 1 -- 172.21.15.31:0/1357861356 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4971+0+0 (secure 0 0 0) 0x7ff4c80947a0 con 0x7ff4e00cd100 2024-09-17T05:35:38.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.145+0000 7ff4dea00640 1 --2- 172.21.15.31:0/1357861356 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff4bc0738c0 0x7ff4bc075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:38.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.145+0000 7ff4dea00640 1 --2- 172.21.15.31:0/1357861356 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff4bc0738c0 0x7ff4bc075d80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00af000 tx=0x7ff4d001b000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:38.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.149+0000 7ff4d6a00640 1 -- 172.21.15.31:0/1357861356 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff4c805f0c0 con 0x7ff4e00cd100 2024-09-17T05:35:38.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:38.385+0000 7ff4e5c00640 1 -- 172.21.15.31:0/1357861356 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]} v 0) -- 0x7ff4e01558f0 con 0x7ff4e00cd100 2024-09-17T05:35:39.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.253+0000 7ff4d6a00640 1 -- 172.21.15.31:0/1357861356 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]}]=0 v385) ==== 152+0+0 (secure 0 0 0) 0x7ff4c805e9c0 con 0x7ff4e00cd100 2024-09-17T05:35:39.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.257+0000 7ff4e5c00640 1 -- 172.21.15.31:0/1357861356 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff4bc0738c0 msgr2=0x7ff4bc075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:39.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.257+0000 7ff4e5c00640 1 --2- 172.21.15.31:0/1357861356 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff4bc0738c0 0x7ff4bc075d80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00af000 tx=0x7ff4d001b000 comp rx=0 tx=0).stop 2024-09-17T05:35:39.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.257+0000 7ff4e5c00640 1 -- 172.21.15.31:0/1357861356 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4e00cd100 msgr2=0x7ff4e00c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:39.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.257+0000 7ff4e5c00640 1 --2- 172.21.15.31:0/1357861356 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4e00cd100 0x7ff4e00c8f70 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800c4b0 tx=0x7ff4c800c970 comp rx=0 tx=0).stop 2024-09-17T05:35:39.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.257+0000 7ff4e5c00640 1 -- 172.21.15.31:0/1357861356 shutdown_connections 2024-09-17T05:35:39.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.257+0000 7ff4e5c00640 1 --2- 172.21.15.31:0/1357861356 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff4bc0738c0 0x7ff4bc075d80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.257+0000 7ff4e5c00640 1 --2- 172.21.15.31:0/1357861356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4e015dae0 0x7ff4e0152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.257+0000 7ff4e5c00640 1 --2- 172.21.15.31:0/1357861356 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4e00cd100 0x7ff4e00c8f70 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.257+0000 7ff4e5c00640 1 --2- 172.21.15.31:0/1357861356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4e00b49e0 0x7ff4e015afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.257+0000 7ff4e5c00640 1 -- 172.21.15.31:0/1357861356 >> 172.21.15.31:0/1357861356 conn(0x7ff4e00b18f0 msgr2=0x7ff4e0072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:39.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.257+0000 7ff4e5c00640 1 -- 172.21.15.31:0/1357861356 shutdown_connections 2024-09-17T05:35:39.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.257+0000 7ff4e5c00640 1 -- 172.21.15.31:0/1357861356 wait complete. 2024-09-17T05:35:39.281 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:35:39.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.433+0000 7f52e1000640 1 -- 172.21.15.31:0/3967108222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52dc15f6e0 msgr2=0x7f52dc0d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:39.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.433+0000 7f52e1000640 1 --2- 172.21.15.31:0/3967108222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52dc15f6e0 0x7f52dc0d01e0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009840 tx=0x7f52c401f010 comp rx=0 tx=0).stop 2024-09-17T05:35:39.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.433+0000 7f52e1000640 1 -- 172.21.15.31:0/3967108222 shutdown_connections 2024-09-17T05:35:39.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.433+0000 7f52e1000640 1 --2- 172.21.15.31:0/3967108222 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52dc15f6e0 0x7f52dc0d01e0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.433+0000 7f52e1000640 1 --2- 172.21.15.31:0/3967108222 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52dc15f300 0x7f52dc0cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.433+0000 7f52e1000640 1 -- 172.21.15.31:0/3967108222 >> 172.21.15.31:0/3967108222 conn(0x7f52dc0d1e30 msgr2=0x7f52dc0d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:39.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.433+0000 7f52e1000640 1 -- 172.21.15.31:0/3967108222 shutdown_connections 2024-09-17T05:35:39.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.433+0000 7f52e1000640 1 -- 172.21.15.31:0/3967108222 wait complete. 2024-09-17T05:35:39.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.433+0000 7f52e1000640 1 Processor -- start 2024-09-17T05:35:39.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.433+0000 7f52e1000640 1 -- start start 2024-09-17T05:35:39.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52e1000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52dc0b2d60 0x7f52dc156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:39.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52e1000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52dc15f300 0x7f52dc06dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:39.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52e1000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52dc15f6e0 0x7f52dc15b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:39.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52e1000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f52dc0d0ab0 con 0x7f52dc15f6e0 2024-09-17T05:35:39.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52e1000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f52dc0d0930 con 0x7f52dc0b2d60 2024-09-17T05:35:39.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52e1000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f52dc0b1a80 con 0x7f52dc15f300 2024-09-17T05:35:39.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52da800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52dc15f6e0 0x7f52dc15b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:39.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52da800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52dc15f6e0 0x7f52dc15b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43298/0 (socket says 172.21.15.31:43298) 2024-09-17T05:35:39.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52da800640 1 -- 172.21.15.31:0/1478329660 learned_addr learned my addr 172.21.15.31:0/1478329660 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:39.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52d9e00640 1 --2- 172.21.15.31:0/1478329660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52dc0b2d60 0x7f52dc156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:39.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52d3e00640 1 --2- 172.21.15.31:0/1478329660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52dc15f300 0x7f52dc06dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:39.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52da800640 1 -- 172.21.15.31:0/1478329660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52dc15f300 msgr2=0x7f52dc06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:39.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52da800640 1 --2- 172.21.15.31:0/1478329660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52dc15f300 0x7f52dc06dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52da800640 1 -- 172.21.15.31:0/1478329660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52dc0b2d60 msgr2=0x7f52dc156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:39.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52da800640 1 --2- 172.21.15.31:0/1478329660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52dc0b2d60 0x7f52dc156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52da800640 1 -- 172.21.15.31:0/1478329660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52dc06f020 con 0x7f52dc15f6e0 2024-09-17T05:35:39.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52da800640 1 --2- 172.21.15.31:0/1478329660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52dc15f6e0 0x7f52dc15b220 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f52d400c730 tx=0x7f52d400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:39.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52d2000640 1 -- 172.21.15.31:0/1478329660 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d4003db0 con 0x7f52dc15f6e0 2024-09-17T05:35:39.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52d2000640 1 -- 172.21.15.31:0/1478329660 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52d400ce40 con 0x7f52dc15f6e0 2024-09-17T05:35:39.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52d2000640 1 -- 172.21.15.31:0/1478329660 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d40052d0 con 0x7f52dc15f6e0 2024-09-17T05:35:39.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52e1000640 1 -- 172.21.15.31:0/1478329660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52dc06e780 con 0x7f52dc15f6e0 2024-09-17T05:35:39.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52e1000640 1 -- 172.21.15.31:0/1478329660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52dc06ed40 con 0x7f52dc15f6e0 2024-09-17T05:35:39.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.437+0000 7f52e1000640 1 -- 172.21.15.31:0/1478329660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52dc0b1f30 con 0x7f52dc15f6e0 2024-09-17T05:35:39.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.441+0000 7f52d2000640 1 -- 172.21.15.31:0/1478329660 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f52d4005470 con 0x7f52dc15f6e0 2024-09-17T05:35:39.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.441+0000 7f52d2000640 1 --2- 172.21.15.31:0/1478329660 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f52b80738c0 0x7f52b8075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:39.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.441+0000 7f52d2000640 1 -- 172.21.15.31:0/1478329660 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4971+0+0 (secure 0 0 0) 0x7f52d40947a0 con 0x7f52dc15f6e0 2024-09-17T05:35:39.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.441+0000 7f52d9e00640 1 --2- 172.21.15.31:0/1478329660 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f52b80738c0 0x7f52b8075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:39.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.441+0000 7f52d9e00640 1 --2- 172.21.15.31:0/1478329660 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f52b80738c0 0x7f52b8075d80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f52dc06fed0 tx=0x7f52cc00b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:39.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.445+0000 7f52d2000640 1 -- 172.21.15.31:0/1478329660 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f52d405eb90 con 0x7f52dc15f6e0 2024-09-17T05:35:39.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.625+0000 7f52e1000640 1 -- 172.21.15.31:0/1478329660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f52dc1e8950 con 0x7f52dc15f6e0 2024-09-17T05:35:39.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.625+0000 7f52d2000640 1 -- 172.21.15.31:0/1478329660 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v43) ==== 59+0+1998 (secure 0 0 0) 0x7f52d40635c0 con 0x7f52dc15f6e0 2024-09-17T05:35:39.626 INFO:teuthology.orchestra.run.smithi031.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:35:39.626 INFO:teuthology.orchestra.run.smithi031.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:35:39.627 INFO:teuthology.orchestra.run.smithi031.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:35:39.627 INFO:teuthology.orchestra.run.smithi031.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:35:39.627 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6159.333103 2024-09-17T05:35:39.627 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4566.558105 2024-09-17T05:35:39.627 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4575.968427 2024-09-17T05:35:39.627 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4702.806393 2024-09-17T05:35:39.627 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4956.728274 2024-09-17T05:35:39.627 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 6604.257199 2024-09-17T05:35:39.627 INFO:teuthology.orchestra.run.smithi031.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4779.165073 2024-09-17T05:35:39.627 INFO:teuthology.orchestra.run.smithi031.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4673.795919 2024-09-17T05:35:39.627 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds 20/20 2024-09-17T05:35:39.627 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:35:39.627 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_ms 2/2 2024-09-17T05:35:39.628 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_frag true 2024-09-17T05:35:39.628 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:35:39.628 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:35:39.628 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_verify_scatter true 2024-09-17T05:35:39.628 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:35:39.628 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:35:39.628 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:35:39.628 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced client_mount_timeout 600 2024-09-17T05:35:39.628 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_client 20/20 2024-09-17T05:35:39.628 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_ms 1/1 2024-09-17T05:35:39.628 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:35:39.628 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:35:39.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.625+0000 7f52e1000640 1 -- 172.21.15.31:0/1478329660 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f52b80738c0 msgr2=0x7f52b8075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:39.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.625+0000 7f52e1000640 1 --2- 172.21.15.31:0/1478329660 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f52b80738c0 0x7f52b8075d80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f52dc06fed0 tx=0x7f52cc00b390 comp rx=0 tx=0).stop 2024-09-17T05:35:39.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.625+0000 7f52e1000640 1 -- 172.21.15.31:0/1478329660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52dc15f6e0 msgr2=0x7f52dc15b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:39.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.625+0000 7f52e1000640 1 --2- 172.21.15.31:0/1478329660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52dc15f6e0 0x7f52dc15b220 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f52d400c730 tx=0x7f52d400cbf0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.625+0000 7f52e1000640 1 -- 172.21.15.31:0/1478329660 shutdown_connections 2024-09-17T05:35:39.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.625+0000 7f52e1000640 1 --2- 172.21.15.31:0/1478329660 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f52b80738c0 0x7f52b8075d80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.625+0000 7f52e1000640 1 --2- 172.21.15.31:0/1478329660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f52dc15f6e0 0x7f52dc15b220 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.625+0000 7f52e1000640 1 --2- 172.21.15.31:0/1478329660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52dc15f300 0x7f52dc06dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.625+0000 7f52e1000640 1 --2- 172.21.15.31:0/1478329660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52dc0b2d60 0x7f52dc156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.625+0000 7f52e1000640 1 -- 172.21.15.31:0/1478329660 >> 172.21.15.31:0/1478329660 conn(0x7f52dc0d1e30 msgr2=0x7f52dc0b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:39.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.625+0000 7f52e1000640 1 -- 172.21.15.31:0/1478329660 shutdown_connections 2024-09-17T05:35:39.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.625+0000 7f52e1000640 1 -- 172.21.15.31:0/1478329660 wait complete. 2024-09-17T05:35:39.649 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:35:39.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.797+0000 7fa8a0200640 1 -- 172.21.15.31:0/3028161867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8980b1650 msgr2=0x7fa8980b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:39.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.797+0000 7fa8a0200640 1 --2- 172.21.15.31:0/3028161867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8980b1650 0x7fa8980b1a30 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fa8980754a0 tx=0x7fa88401c8c0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.797+0000 7fa8a0200640 1 -- 172.21.15.31:0/3028161867 shutdown_connections 2024-09-17T05:35:39.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.797+0000 7fa8a0200640 1 --2- 172.21.15.31:0/3028161867 >> v2:172.21.15.155:3300/0 conn(0x7fa8980afb10 0x7fa8980affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.797+0000 7fa8a0200640 1 --2- 172.21.15.31:0/3028161867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8980b1650 0x7fa8980b1a30 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.797+0000 7fa8a0200640 1 -- 172.21.15.31:0/3028161867 >> 172.21.15.31:0/3028161867 conn(0x7fa8980d1dd0 msgr2=0x7fa8980d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:39.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.797+0000 7fa8a0200640 1 -- 172.21.15.31:0/3028161867 shutdown_connections 2024-09-17T05:35:39.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.797+0000 7fa8a0200640 1 -- 172.21.15.31:0/3028161867 wait complete. 2024-09-17T05:35:39.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.797+0000 7fa8a0200640 1 Processor -- start 2024-09-17T05:35:39.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.797+0000 7fa8a0200640 1 -- start start 2024-09-17T05:35:39.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa8a0200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8980afb10 0x7fa898159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:39.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa8a0200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8980b1650 0x7fa89814fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:39.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa8a0200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8981605d0 0x7fa89815c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:39.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa8a0200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa8980b0e60 con 0x7fa8980b1650 2024-09-17T05:35:39.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa8a0200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa8980b1430 con 0x7fa8981605d0 2024-09-17T05:35:39.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa8a0200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa898169540 con 0x7fa8980afb10 2024-09-17T05:35:39.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa89ce00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8980b1650 0x7fa89814fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:39.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa89ce00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8980b1650 0x7fa89814fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43320/0 (socket says 172.21.15.31:43320) 2024-09-17T05:35:39.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa89ce00640 1 -- 172.21.15.31:0/3424750768 learned_addr learned my addr 172.21.15.31:0/3424750768 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:39.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa89d800640 1 --2- 172.21.15.31:0/3424750768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8980afb10 0x7fa898159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:39.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa89e200640 1 --2- 172.21.15.31:0/3424750768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8981605d0 0x7fa89815c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:39.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa89ce00640 1 -- 172.21.15.31:0/3424750768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8980afb10 msgr2=0x7fa898159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:39.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa89ce00640 1 --2- 172.21.15.31:0/3424750768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8980afb10 0x7fa898159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa89ce00640 1 -- 172.21.15.31:0/3424750768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8981605d0 msgr2=0x7fa89815c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:39.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa89ce00640 1 --2- 172.21.15.31:0/3424750768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8981605d0 0x7fa89815c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa89ce00640 1 -- 172.21.15.31:0/3424750768 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa898159900 con 0x7fa8980b1650 2024-09-17T05:35:39.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa89ce00640 1 --2- 172.21.15.31:0/3424750768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8980b1650 0x7fa89814fbc0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fa884009850 tx=0x7fa884005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:39.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa895600640 1 -- 172.21.15.31:0/3424750768 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8840b2040 con 0x7fa8980b1650 2024-09-17T05:35:39.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa895600640 1 -- 172.21.15.31:0/3424750768 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa884004130 con 0x7fa8980b1650 2024-09-17T05:35:39.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa8a0200640 1 -- 172.21.15.31:0/3424750768 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa89815b460 con 0x7fa8980b1650 2024-09-17T05:35:39.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa895600640 1 -- 172.21.15.31:0/3424750768 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa884003600 con 0x7fa8980b1650 2024-09-17T05:35:39.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa8a0200640 1 -- 172.21.15.31:0/3424750768 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa89815ba20 con 0x7fa8980b1650 2024-09-17T05:35:39.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.801+0000 7fa8a0200640 1 -- 172.21.15.31:0/3424750768 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8980affc0 con 0x7fa8980b1650 2024-09-17T05:35:39.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.805+0000 7fa895600640 1 -- 172.21.15.31:0/3424750768 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7fa8840bf020 con 0x7fa8980b1650 2024-09-17T05:35:39.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.805+0000 7fa895600640 1 --2- 172.21.15.31:0/3424750768 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa8780738c0 0x7fa878075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:39.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.805+0000 7fa895600640 1 -- 172.21.15.31:0/3424750768 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4971+0+0 (secure 0 0 0) 0x7fa88412eab0 con 0x7fa8980b1650 2024-09-17T05:35:39.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.805+0000 7fa89d800640 1 --2- 172.21.15.31:0/3424750768 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa8780738c0 0x7fa878075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:39.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.805+0000 7fa89d800640 1 --2- 172.21.15.31:0/3424750768 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa8780738c0 0x7fa878075d80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa88c007fd0 tx=0x7fa88c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:39.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.809+0000 7fa895600640 1 -- 172.21.15.31:0/3424750768 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa8840c6020 con 0x7fa8980b1650 2024-09-17T05:35:39.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.985+0000 7fa8a0200640 1 -- 172.21.15.31:0/3424750768 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa8980d1080 con 0x7fa8980b1650 2024-09-17T05:35:39.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.989+0000 7fa895600640 1 -- 172.21.15.31:0/3424750768 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v44)=0 v44) ==== 122+0+0 (secure 0 0 0) 0x7fa8840164b0 con 0x7fa8980b1650 2024-09-17T05:35:39.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.989+0000 7fa8a0200640 1 -- 172.21.15.31:0/3424750768 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa8780738c0 msgr2=0x7fa878075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:39.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.989+0000 7fa8a0200640 1 --2- 172.21.15.31:0/3424750768 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa8780738c0 0x7fa878075d80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa88c007fd0 tx=0x7fa88c009040 comp rx=0 tx=0).stop 2024-09-17T05:35:39.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.989+0000 7fa8a0200640 1 -- 172.21.15.31:0/3424750768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8980b1650 msgr2=0x7fa89814fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:39.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.989+0000 7fa8a0200640 1 --2- 172.21.15.31:0/3424750768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8980b1650 0x7fa89814fbc0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fa884009850 tx=0x7fa884005e70 comp rx=0 tx=0).stop 2024-09-17T05:35:39.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.989+0000 7fa8a0200640 1 -- 172.21.15.31:0/3424750768 shutdown_connections 2024-09-17T05:35:39.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.989+0000 7fa8a0200640 1 --2- 172.21.15.31:0/3424750768 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa8780738c0 0x7fa878075d80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.989+0000 7fa8a0200640 1 --2- 172.21.15.31:0/3424750768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8981605d0 0x7fa89815c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.989+0000 7fa8a0200640 1 --2- 172.21.15.31:0/3424750768 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8980b1650 0x7fa89814fbc0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.989+0000 7fa8a0200640 1 --2- 172.21.15.31:0/3424750768 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8980afb10 0x7fa898159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:39.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.989+0000 7fa8a0200640 1 -- 172.21.15.31:0/3424750768 >> 172.21.15.31:0/3424750768 conn(0x7fa8980d1dd0 msgr2=0x7fa8980d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:39.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.989+0000 7fa8a0200640 1 -- 172.21.15.31:0/3424750768 shutdown_connections 2024-09-17T05:35:39.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:39.989+0000 7fa8a0200640 1 -- 172.21.15.31:0/3424750768 wait complete. 2024-09-17T05:35:40.013 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:35:40.013 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:35:40.107 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:35:40.216 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:35:40.216 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:35:40.216 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:35:40.225 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:35:40.225 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:35:40.225 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:35:40.234 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:35:40.234 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:35:40.234 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:35:40.281 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:35:40.281 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:35:40.281 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:35:40.291 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:35:40.291 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:35:40.291 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:35:40.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.469+0000 7fee87e00640 1 -- 172.21.15.31:0/1203044440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee880b4d80 msgr2=0x7fee880b11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:40.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.469+0000 7fee87e00640 1 --2- 172.21.15.31:0/1203044440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee880b4d80 0x7fee880b11a0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fee88069e80 tx=0x7fee7801c800 comp rx=0 tx=0).stop 2024-09-17T05:35:40.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.469+0000 7fee87e00640 1 -- 172.21.15.31:0/1203044440 shutdown_connections 2024-09-17T05:35:40.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.469+0000 7fee87e00640 1 --2- 172.21.15.31:0/1203044440 >> v2:172.21.15.155:3300/0 conn(0x7fee880b0ce0 0x7fee880b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:40.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.469+0000 7fee87e00640 1 --2- 172.21.15.31:0/1203044440 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee880b4d80 0x7fee880b11a0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:40.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.469+0000 7fee87e00640 1 -- 172.21.15.31:0/1203044440 >> 172.21.15.31:0/1203044440 conn(0x7fee8809aa10 msgr2=0x7fee8809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:40.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.469+0000 7fee87e00640 1 -- 172.21.15.31:0/1203044440 shutdown_connections 2024-09-17T05:35:40.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.469+0000 7fee87e00640 1 -- 172.21.15.31:0/1203044440 wait complete. 2024-09-17T05:35:40.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.469+0000 7fee87e00640 1 Processor -- start 2024-09-17T05:35:40.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.469+0000 7fee87e00640 1 -- start start 2024-09-17T05:35:40.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee87e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee880b0ce0 0x7fee88158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:40.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee87e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee880b4d80 0x7fee88143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:40.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee87e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee880b56a0 0x7fee881f9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:40.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee87e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fee88168a20 con 0x7fee880b4d80 2024-09-17T05:35:40.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee87e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fee881688a0 con 0x7fee880b0ce0 2024-09-17T05:35:40.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee87e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fee88168ba0 con 0x7fee880b56a0 2024-09-17T05:35:40.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee86000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee880b4d80 0x7fee88143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:40.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee86000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee880b4d80 0x7fee88143fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43340/0 (socket says 172.21.15.31:43340) 2024-09-17T05:35:40.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee86000640 1 -- 172.21.15.31:0/1982378050 learned_addr learned my addr 172.21.15.31:0/1982378050 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:40.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee86a00640 1 --2- 172.21.15.31:0/1982378050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee880b0ce0 0x7fee88158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:40.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee87400640 1 --2- 172.21.15.31:0/1982378050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee880b56a0 0x7fee881f9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:40.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee86000640 1 -- 172.21.15.31:0/1982378050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee880b56a0 msgr2=0x7fee881f9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:40.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee86000640 1 --2- 172.21.15.31:0/1982378050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee880b56a0 0x7fee881f9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:40.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee86000640 1 -- 172.21.15.31:0/1982378050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee880b0ce0 msgr2=0x7fee88158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:40.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee86000640 1 --2- 172.21.15.31:0/1982378050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee880b0ce0 0x7fee88158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:40.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee86000640 1 -- 172.21.15.31:0/1982378050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee88158d00 con 0x7fee880b4d80 2024-09-17T05:35:40.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee86000640 1 --2- 172.21.15.31:0/1982378050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee880b4d80 0x7fee88143fc0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fee7400d980 tx=0x7fee7400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:40.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee7f400640 1 -- 172.21.15.31:0/1982378050 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee74017070 con 0x7fee880b4d80 2024-09-17T05:35:40.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee7f400640 1 -- 172.21.15.31:0/1982378050 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee74009d60 con 0x7fee880b4d80 2024-09-17T05:35:40.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee7f400640 1 -- 172.21.15.31:0/1982378050 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee74005280 con 0x7fee880b4d80 2024-09-17T05:35:40.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee87e00640 1 -- 172.21.15.31:0/1982378050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee88158fe0 con 0x7fee880b4d80 2024-09-17T05:35:40.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee87e00640 1 -- 172.21.15.31:0/1982378050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee881595a0 con 0x7fee880b4d80 2024-09-17T05:35:40.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.473+0000 7fee87e00640 1 -- 172.21.15.31:0/1982378050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee880b5160 con 0x7fee880b4d80 2024-09-17T05:35:40.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.477+0000 7fee7f400640 1 -- 172.21.15.31:0/1982378050 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7fee74005420 con 0x7fee880b4d80 2024-09-17T05:35:40.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.477+0000 7fee7f400640 1 --2- 172.21.15.31:0/1982378050 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee680738c0 0x7fee68075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:40.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.477+0000 7fee7f400640 1 -- 172.21.15.31:0/1982378050 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4971+0+0 (secure 0 0 0) 0x7fee74094e70 con 0x7fee880b4d80 2024-09-17T05:35:40.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.477+0000 7fee86a00640 1 --2- 172.21.15.31:0/1982378050 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee680738c0 0x7fee68075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:40.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.477+0000 7fee86a00640 1 --2- 172.21.15.31:0/1982378050 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee680738c0 0x7fee68075d80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fee780af000 tx=0x7fee7801b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:40.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.481+0000 7fee7f400640 1 -- 172.21.15.31:0/1982378050 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fee7405f040 con 0x7fee880b4d80 2024-09-17T05:35:40.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.689+0000 7fee87e00640 1 -- 172.21.15.31:0/1982378050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee880ce0c0 con 0x7fee880b4d80 2024-09-17T05:35:40.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.689+0000 7fee7f400640 1 -- 172.21.15.31:0/1982378050 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+3917 (secure 0 0 0) 0x7fee74063a70 con 0x7fee880b4d80 2024-09-17T05:35:40.693 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:40.693 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":93,"btime":"2024-09-17T05:35:34:236093+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7456,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/2107257547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107257547},{"type":"v1","addr":"172.21.15.155:6834","nonce":2107257547}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7768,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2551887966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":2551887966},{"type":"v1","addr":"172.21.15.155:6835","nonce":2551887966}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":93},{"gid":7833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1645548958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1645548958},{"type":"v1","addr":"172.21.15.31:6834","nonce":1645548958}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7836,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1284373927","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1284373927},{"type":"v1","addr":"172.21.15.31:6835","nonce":1284373927}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[]} 2024-09-17T05:35:40.693 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 93 2024-09-17T05:35:40.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.693+0000 7fee87e00640 1 -- 172.21.15.31:0/1982378050 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee680738c0 msgr2=0x7fee68075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:40.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.693+0000 7fee87e00640 1 --2- 172.21.15.31:0/1982378050 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee680738c0 0x7fee68075d80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fee780af000 tx=0x7fee7801b040 comp rx=0 tx=0).stop 2024-09-17T05:35:40.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.693+0000 7fee87e00640 1 -- 172.21.15.31:0/1982378050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee880b4d80 msgr2=0x7fee88143fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:40.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.693+0000 7fee87e00640 1 --2- 172.21.15.31:0/1982378050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee880b4d80 0x7fee88143fc0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fee7400d980 tx=0x7fee7400de40 comp rx=0 tx=0).stop 2024-09-17T05:35:40.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.693+0000 7fee87e00640 1 -- 172.21.15.31:0/1982378050 shutdown_connections 2024-09-17T05:35:40.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.693+0000 7fee87e00640 1 --2- 172.21.15.31:0/1982378050 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee680738c0 0x7fee68075d80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:40.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.693+0000 7fee87e00640 1 --2- 172.21.15.31:0/1982378050 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee880b56a0 0x7fee881f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:40.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.693+0000 7fee87e00640 1 --2- 172.21.15.31:0/1982378050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee880b4d80 0x7fee88143fc0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:40.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.693+0000 7fee87e00640 1 --2- 172.21.15.31:0/1982378050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee880b0ce0 0x7fee88158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:40.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.693+0000 7fee87e00640 1 -- 172.21.15.31:0/1982378050 >> 172.21.15.31:0/1982378050 conn(0x7fee8809aa10 msgr2=0x7fee881528f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:40.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.693+0000 7fee87e00640 1 -- 172.21.15.31:0/1982378050 shutdown_connections 2024-09-17T05:35:40.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.693+0000 7fee87e00640 1 -- 172.21.15.31:0/1982378050 wait complete. 2024-09-17T05:35:40.714 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:35:40.714 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:35:40.715 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:35:40.715 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:35:40.715 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:35:40.715 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:35:40.715 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:35:40.715 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:35:40.715 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:35:40.716 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:35:40.716 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:35:40.716 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:35:40.716 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:35:40.716 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:35:40.717 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:35:40.717 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:35:40.733 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:35:40.733 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:35:40.734 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:35:40.734 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:35:40.736 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:35:40.736 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:35:40.737 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:35:40.737 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:35:40.784 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:35:40.784 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:35:40.784 DEBUG:teuthology.parallel:result is None 2024-09-17T05:35:40.785 DEBUG:teuthology.parallel:result is None 2024-09-17T05:35:40.785 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:35:40.785 DEBUG:teuthology.parallel:result is None 2024-09-17T05:35:40.786 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:35:40.786 DEBUG:teuthology.parallel:result is None 2024-09-17T05:35:40.786 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:35:40.873 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-17T05:35:40.874 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-17T05:35:40.877 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-17T05:35:40.877 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-17T05:35:40.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.937+0000 7f95fda00640 1 -- 172.21.15.31:0/1577075598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f815a4d0 msgr2=0x7f95f815ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:40.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.937+0000 7f95fda00640 1 --2- 172.21.15.31:0/1577075598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f815a4d0 0x7f95f815ea30 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f95f809e090 tx=0x7f95e801daa0 comp rx=0 tx=0).stop 2024-09-17T05:35:40.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.937+0000 7f95fda00640 1 -- 172.21.15.31:0/1577075598 shutdown_connections 2024-09-17T05:35:40.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.937+0000 7f95fda00640 1 --2- 172.21.15.31:0/1577075598 >> v2:172.21.15.155:3300/0 conn(0x7f95f80703d0 0x7f95f80b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:40.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.937+0000 7f95fda00640 1 --2- 172.21.15.31:0/1577075598 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f815a4d0 0x7f95f815ea30 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:40.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.937+0000 7f95fda00640 1 -- 172.21.15.31:0/1577075598 >> 172.21.15.31:0/1577075598 conn(0x7f95f80b18f0 msgr2=0x7f95f80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:40.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.937+0000 7f95fda00640 1 -- 172.21.15.31:0/1577075598 shutdown_connections 2024-09-17T05:35:40.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.937+0000 7f95fda00640 1 -- 172.21.15.31:0/1577075598 wait complete. 2024-09-17T05:35:40.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.937+0000 7f95fda00640 1 Processor -- start 2024-09-17T05:35:40.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95fda00640 1 -- start start 2024-09-17T05:35:40.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95fda00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95f80703d0 0x7f95f81f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:40.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95fda00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f80b47e0 0x7f95f813cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:40.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95fda00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f815a4d0 0x7f95f81f8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:40.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95fda00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f95f80cccf0 con 0x7f95f80b47e0 2024-09-17T05:35:40.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95fda00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f95f80ccb70 con 0x7f95f815a4d0 2024-09-17T05:35:40.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95fda00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f95f80cce70 con 0x7f95f80703d0 2024-09-17T05:35:40.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95f6000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f80b47e0 0x7f95f813cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:40.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95f6000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f80b47e0 0x7f95f813cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43390/0 (socket says 172.21.15.31:43390) 2024-09-17T05:35:40.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95f6000640 1 -- 172.21.15.31:0/3381616930 learned_addr learned my addr 172.21.15.31:0/3381616930 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:40.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95f6a00640 1 --2- 172.21.15.31:0/3381616930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95f80703d0 0x7f95f81f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:40.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95f7400640 1 --2- 172.21.15.31:0/3381616930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f815a4d0 0x7f95f81f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:40.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95f6000640 1 -- 172.21.15.31:0/3381616930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95f80703d0 msgr2=0x7f95f81f5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:40.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95f6000640 1 --2- 172.21.15.31:0/3381616930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95f80703d0 0x7f95f81f5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:40.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95f6000640 1 -- 172.21.15.31:0/3381616930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f815a4d0 msgr2=0x7f95f81f8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:40.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95f6000640 1 --2- 172.21.15.31:0/3381616930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f815a4d0 0x7f95f81f8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:40.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95f6000640 1 -- 172.21.15.31:0/3381616930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f81f52d0 con 0x7f95f80b47e0 2024-09-17T05:35:40.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95f6000640 1 --2- 172.21.15.31:0/3381616930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f80b47e0 0x7f95f813cce0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f95e400c970 tx=0x7f95e400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:40.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95eea00640 1 -- 172.21.15.31:0/3381616930 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4007c10 con 0x7f95f80b47e0 2024-09-17T05:35:40.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95eea00640 1 -- 172.21.15.31:0/3381616930 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95e400f450 con 0x7f95f80b47e0 2024-09-17T05:35:40.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95eea00640 1 -- 172.21.15.31:0/3381616930 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e400f8a0 con 0x7f95f80b47e0 2024-09-17T05:35:40.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95fda00640 1 -- 172.21.15.31:0/3381616930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f81f93d0 con 0x7f95f80b47e0 2024-09-17T05:35:40.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95fda00640 1 -- 172.21.15.31:0/3381616930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f81f55a0 con 0x7f95f80b47e0 2024-09-17T05:35:40.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.941+0000 7f95fda00640 1 -- 172.21.15.31:0/3381616930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95f8069410 con 0x7f95f80b47e0 2024-09-17T05:35:40.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.945+0000 7f95eea00640 1 -- 172.21.15.31:0/3381616930 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f95e400fa40 con 0x7f95f80b47e0 2024-09-17T05:35:40.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.945+0000 7f95eea00640 1 --2- 172.21.15.31:0/3381616930 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95d80738c0 0x7f95d8075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:40.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.945+0000 7f95eea00640 1 -- 172.21.15.31:0/3381616930 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4971+0+0 (secure 0 0 0) 0x7f95e4095310 con 0x7f95f80b47e0 2024-09-17T05:35:40.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.945+0000 7f95f6a00640 1 --2- 172.21.15.31:0/3381616930 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95d80738c0 0x7f95d8075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:40.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.945+0000 7f95f6a00640 1 --2- 172.21.15.31:0/3381616930 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95d80738c0 0x7f95d8075d80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f95e80b0000 tx=0x7f95e801c2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:40.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:40.949+0000 7f95eea00640 1 -- 172.21.15.31:0/3381616930 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f95e4014030 con 0x7f95f80b47e0 2024-09-17T05:35:41.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.137+0000 7f95fda00640 1 -- 172.21.15.31:0/3381616930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f95f8072900 con 0x7f95f80b47e0 2024-09-17T05:35:41.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.265+0000 7f95eea00640 1 -- 172.21.15.31:0/3381616930 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v135) ==== 97+0+0 (secure 0 0 0) 0x7f95e405fbc0 con 0x7f95f80b47e0 2024-09-17T05:35:41.267 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2024-09-17T05:35:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.269+0000 7f95fda00640 1 -- 172.21.15.31:0/3381616930 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95d80738c0 msgr2=0x7f95d8075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.269+0000 7f95fda00640 1 --2- 172.21.15.31:0/3381616930 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95d80738c0 0x7f95d8075d80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f95e80b0000 tx=0x7f95e801c2e0 comp rx=0 tx=0).stop 2024-09-17T05:35:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.269+0000 7f95fda00640 1 -- 172.21.15.31:0/3381616930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f80b47e0 msgr2=0x7f95f813cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.269+0000 7f95fda00640 1 --2- 172.21.15.31:0/3381616930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f80b47e0 0x7f95f813cce0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f95e400c970 tx=0x7f95e400ce30 comp rx=0 tx=0).stop 2024-09-17T05:35:41.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.269+0000 7f95fda00640 1 -- 172.21.15.31:0/3381616930 shutdown_connections 2024-09-17T05:35:41.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.269+0000 7f95fda00640 1 --2- 172.21.15.31:0/3381616930 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f95d80738c0 0x7f95d8075d80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:41.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.269+0000 7f95fda00640 1 --2- 172.21.15.31:0/3381616930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95f815a4d0 0x7f95f81f8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:41.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.269+0000 7f95fda00640 1 --2- 172.21.15.31:0/3381616930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95f80b47e0 0x7f95f813cce0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:41.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.269+0000 7f95fda00640 1 --2- 172.21.15.31:0/3381616930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95f80703d0 0x7f95f81f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:41.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.269+0000 7f95fda00640 1 -- 172.21.15.31:0/3381616930 >> 172.21.15.31:0/3381616930 conn(0x7f95f80b18f0 msgr2=0x7f95f806f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:41.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.269+0000 7f95fda00640 1 -- 172.21.15.31:0/3381616930 shutdown_connections 2024-09-17T05:35:41.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.269+0000 7f95fda00640 1 -- 172.21.15.31:0/3381616930 wait complete. 2024-09-17T05:35:41.293 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:35:41.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.437+0000 7f9d08600640 1 -- 172.21.15.31:0/353793660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d000ced80 msgr2=0x7f9d000ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:41.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.437+0000 7f9d08600640 1 --2- 172.21.15.31:0/353793660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d000ced80 0x7f9d000ae9b0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009900 tx=0x7f9cec01c8e0 comp rx=0 tx=0).stop 2024-09-17T05:35:41.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.437+0000 7f9d08600640 1 -- 172.21.15.31:0/353793660 shutdown_connections 2024-09-17T05:35:41.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.437+0000 7f9d08600640 1 --2- 172.21.15.31:0/353793660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d000cdb30 0x7f9d000aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:41.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.437+0000 7f9d08600640 1 --2- 172.21.15.31:0/353793660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d000ced80 0x7f9d000ae9b0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:41.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.437+0000 7f9d08600640 1 -- 172.21.15.31:0/353793660 >> 172.21.15.31:0/353793660 conn(0x7f9d000d1dc0 msgr2=0x7f9d000d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:41.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.437+0000 7f9d08600640 1 -- 172.21.15.31:0/353793660 shutdown_connections 2024-09-17T05:35:41.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.437+0000 7f9d08600640 1 -- 172.21.15.31:0/353793660 wait complete. 2024-09-17T05:35:41.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.437+0000 7f9d08600640 1 Processor -- start 2024-09-17T05:35:41.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d08600640 1 -- start start 2024-09-17T05:35:41.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d08600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d000cdb30 0x7f9d0014c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:41.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d08600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d000ced80 0x7f9d001568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:41.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d08600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d0015bea0 0x7f9d00152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:41.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d08600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9d00169340 con 0x7f9d0015bea0 2024-09-17T05:35:41.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d08600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9d001691c0 con 0x7f9d000cdb30 2024-09-17T05:35:41.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d08600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9d001694c0 con 0x7f9d000ced80 2024-09-17T05:35:41.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d06600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d0015bea0 0x7f9d00152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:41.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d06600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d0015bea0 0x7f9d00152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43406/0 (socket says 172.21.15.31:43406) 2024-09-17T05:35:41.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d06600640 1 -- 172.21.15.31:0/3552823018 learned_addr learned my addr 172.21.15.31:0/3552823018 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:41.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d05c00640 1 --2- 172.21.15.31:0/3552823018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d000cdb30 0x7f9d0014c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:41.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d05200640 1 --2- 172.21.15.31:0/3552823018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d000ced80 0x7f9d001568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:41.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d06600640 1 -- 172.21.15.31:0/3552823018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d000ced80 msgr2=0x7f9d001568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:41.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d06600640 1 --2- 172.21.15.31:0/3552823018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d000ced80 0x7f9d001568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:41.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d06600640 1 -- 172.21.15.31:0/3552823018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d000cdb30 msgr2=0x7f9d0014c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:41.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d06600640 1 --2- 172.21.15.31:0/3552823018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d000cdb30 0x7f9d0014c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:41.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d06600640 1 -- 172.21.15.31:0/3552823018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0014cb30 con 0x7f9d0015bea0 2024-09-17T05:35:41.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d06600640 1 --2- 172.21.15.31:0/3552823018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d0015bea0 0x7f9d00152120 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800cce0 tx=0x7f9cf800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:41.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9cfd600640 1 -- 172.21.15.31:0/3552823018 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf800f450 con 0x7f9d0015bea0 2024-09-17T05:35:41.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9cfd600640 1 -- 172.21.15.31:0/3552823018 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cf800f700 con 0x7f9d0015bea0 2024-09-17T05:35:41.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9cfd600640 1 -- 172.21.15.31:0/3552823018 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf800fb50 con 0x7f9d0015bea0 2024-09-17T05:35:41.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d08600640 1 -- 172.21.15.31:0/3552823018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d00155840 con 0x7f9d0015bea0 2024-09-17T05:35:41.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d08600640 1 -- 172.21.15.31:0/3552823018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d00155e00 con 0x7f9d0015bea0 2024-09-17T05:35:41.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.441+0000 7f9d08600640 1 -- 172.21.15.31:0/3552823018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d000ce670 con 0x7f9d0015bea0 2024-09-17T05:35:41.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.445+0000 7f9cfd600640 1 -- 172.21.15.31:0/3552823018 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f9cf8004b30 con 0x7f9d0015bea0 2024-09-17T05:35:41.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.445+0000 7f9cfd600640 1 --2- 172.21.15.31:0/3552823018 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9ce00738c0 0x7f9ce0075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:41.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.445+0000 7f9cfd600640 1 -- 172.21.15.31:0/3552823018 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 4885+0+0 (secure 0 0 0) 0x7f9cf8095770 con 0x7f9d0015bea0 2024-09-17T05:35:41.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.445+0000 7f9d05c00640 1 --2- 172.21.15.31:0/3552823018 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9ce00738c0 0x7f9ce0075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:41.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.445+0000 7f9d05c00640 1 --2- 172.21.15.31:0/3552823018 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9ce00738c0 0x7f9ce0075d80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9d001594a0 tx=0x7f9cf4009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:41.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.449+0000 7f9cfd600640 1 -- 172.21.15.31:0/3552823018 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9cf8014030 con 0x7f9d0015bea0 2024-09-17T05:35:41.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.681+0000 7f9d08600640 1 -- 172.21.15.31:0/3552823018 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9d000d2340 con 0x7f9d0015bea0 2024-09-17T05:35:41.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.681+0000 7f9cfd600640 1 -- 172.21.15.31:0/3552823018 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) ==== 80+0+5304 (secure 0 0 0) 0x7f9cf8004e20 con 0x7f9d0015bea0 2024-09-17T05:35:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:41.684 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:35:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2024-09-17T05:35:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2024-09-17T05:35:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmoloQARAAbTcR/1F1qz7Crjdu1NPSgw==", 2024-09-17T05:35:41.684 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:35:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:35:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:35:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2024-09-17T05:35:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmYrdRDRAAkaDz03U3lMZlkLEVFYlTaw==", 2024-09-17T05:35:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.685 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:35:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:35:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:35:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2024-09-17T05:35:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmpFRCCBAAZRsuAVwSxuMGDeoYCwWFeg==", 2024-09-17T05:35:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:35:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:35:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:35:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:41.686 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2024-09-17T05:35:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lm23PSFBAAuO+k0kWY28PN7+pEtlUniQ==", 2024-09-17T05:35:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:35:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:35:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:35:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:41.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2024-09-17T05:35:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBTE+lm0miKHxAA2C1pfwBxJtKQhu4xuPumxg==", 2024-09-17T05:35:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:35:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:35:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2024-09-17T05:35:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBWE+lmdQi7NRAA2v4ETg4jynbPF0K4E73KAA==", 2024-09-17T05:35:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.688 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:35:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:35:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2024-09-17T05:35:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBaE+lm18eUEBAA8gAhUx9UNa2Lk4uyFBd7Nw==", 2024-09-17T05:35:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:35:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:35:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2024-09-17T05:35:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBdE+lm00moJBAAizrxOP4rI4fGR91dYzlEkw==", 2024-09-17T05:35:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:35:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:35:41.690 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2024-09-17T05:35:41.691 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBjE+lmhdtUJhAA7+KM8DwQriFwMbpqXAPTuA==", 2024-09-17T05:35:41.692 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.692 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:35:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:35:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2024-09-17T05:35:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBmE+lm5cByOhAAiMnQIv2O41am/3E+0dp4sg==", 2024-09-17T05:35:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:35:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:35:41.693 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2024-09-17T05:35:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBqE+lm19FhExAAo/Sfj2SX5+Y2/Fxz8mbiNQ==", 2024-09-17T05:35:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:35:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:35:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.694 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2024-09-17T05:35:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBtE+lmISDbKBAAapUBS+t+N1vUcCbdJic8Dw==", 2024-09-17T05:35:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:35:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:35:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2024-09-17T05:35:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw==", 2024-09-17T05:35:41.695 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:35:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2024-09-17T05:35:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:35:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2024-09-17T05:35:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmb2pmIhAA7p+G+WnB7ujZZdSlaossYg==", 2024-09-17T05:35:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:35:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:35:41.696 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:35:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:35:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2024-09-17T05:35:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmAPPaHhAAyz/gKunaNFyrdkAUy50qmQ==", 2024-09-17T05:35:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:35:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:35:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:35:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:35:41.697 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2024-09-17T05:35:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lml72BKBAAgAji5TWedU7azT5oQz3fYg==", 2024-09-17T05:35:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:35:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:35:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:35:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:35:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.698 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2024-09-17T05:35:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmtgltIRAAeTv/U/vZ9ZIuGN4JXTHD0A==", 2024-09-17T05:35:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:35:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:35:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:35:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2024-09-17T05:35:41.699 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmTt2oOBAAmR5ykU4WbEzlKFiwI7sMdg==", 2024-09-17T05:35:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:35:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:35:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:35:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2024-09-17T05:35:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmKILYNBAAojM8RIq92dO2DQyXppReIw==", 2024-09-17T05:35:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:35:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:35:41.700 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:35:41.701 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:35:41.701 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.701 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:41.701 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:35:41.701 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:35:41.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.681+0000 7f9d08600640 1 -- 172.21.15.31:0/3552823018 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9ce00738c0 msgr2=0x7f9ce0075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:41.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.681+0000 7f9d08600640 1 --2- 172.21.15.31:0/3552823018 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9ce00738c0 0x7f9ce0075d80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9d001594a0 tx=0x7f9cf4009060 comp rx=0 tx=0).stop 2024-09-17T05:35:41.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.681+0000 7f9d08600640 1 -- 172.21.15.31:0/3552823018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d0015bea0 msgr2=0x7f9d00152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:41.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.681+0000 7f9d08600640 1 --2- 172.21.15.31:0/3552823018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d0015bea0 0x7f9d00152120 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800cce0 tx=0x7f9cf800a620 comp rx=0 tx=0).stop 2024-09-17T05:35:41.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.681+0000 7f9d08600640 1 -- 172.21.15.31:0/3552823018 shutdown_connections 2024-09-17T05:35:41.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.681+0000 7f9d08600640 1 --2- 172.21.15.31:0/3552823018 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9ce00738c0 0x7f9ce0075d80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:41.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.681+0000 7f9d08600640 1 --2- 172.21.15.31:0/3552823018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d0015bea0 0x7f9d00152120 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:41.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.681+0000 7f9d08600640 1 --2- 172.21.15.31:0/3552823018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d000ced80 0x7f9d001568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:41.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.681+0000 7f9d08600640 1 --2- 172.21.15.31:0/3552823018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d000cdb30 0x7f9d0014c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:41.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.681+0000 7f9d08600640 1 -- 172.21.15.31:0/3552823018 >> 172.21.15.31:0/3552823018 conn(0x7f9d000d1dc0 msgr2=0x7f9d00072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:41.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.685+0000 7f9d08600640 1 -- 172.21.15.31:0/3552823018 shutdown_connections 2024-09-17T05:35:41.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.685+0000 7f9d08600640 1 -- 172.21.15.31:0/3552823018 wait complete. 2024-09-17T05:35:41.704 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:35:41.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.849+0000 7f7e1dc00640 1 -- 172.21.15.31:0/171502732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dfc003fe0 msgr2=0x7f7dfc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:41.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.849+0000 7f7e1dc00640 1 --2- 172.21.15.31:0/171502732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dfc003fe0 0x7f7dfc004810 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000c310 tx=0x7f7e0001f720 comp rx=0 tx=0).stop 2024-09-17T05:35:41.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.849+0000 7f7e17400640 1 -- 172.21.15.31:0/171502732 reap_dead start 2024-09-17T05:35:41.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.849+0000 7f7e1dc00640 1 -- 172.21.15.31:0/171502732 shutdown_connections 2024-09-17T05:35:41.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.849+0000 7f7e1dc00640 1 -- 172.21.15.31:0/171502732 >> 172.21.15.31:0/171502732 conn(0x7f7e180d1dc0 msgr2=0x7f7e180d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:41.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.849+0000 7f7e1dc00640 1 -- 172.21.15.31:0/171502732 shutdown_connections 2024-09-17T05:35:41.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.849+0000 7f7e1dc00640 1 -- 172.21.15.31:0/171502732 wait complete. 2024-09-17T05:35:41.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e1dc00640 1 Processor -- start 2024-09-17T05:35:41.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e1dc00640 1 -- start start 2024-09-17T05:35:41.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e1dc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dfc003fe0 0x7f7e181f7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:41.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e1dc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e180b3fe0 0x7f7e180cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:41.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e1dc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e181e1290 0x7f7e181e1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:41.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e1dc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1815c400 con 0x7f7dfc003fe0 2024-09-17T05:35:41.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e1dc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1815c280 con 0x7f7e180b3fe0 2024-09-17T05:35:41.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e1dc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7e180ce670 con 0x7f7e181e1290 2024-09-17T05:35:41.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e16a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dfc003fe0 0x7f7e181f7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:41.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e16a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dfc003fe0 0x7f7e181f7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43418/0 (socket says 172.21.15.31:43418) 2024-09-17T05:35:41.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e16a00640 1 -- 172.21.15.31:0/579263402 learned_addr learned my addr 172.21.15.31:0/579263402 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:41.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e0fe00640 1 --2- 172.21.15.31:0/579263402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e180b3fe0 0x7f7e180cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:41.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e17400640 1 --2- 172.21.15.31:0/579263402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e181e1290 0x7f7e181e1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:41.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e16a00640 1 -- 172.21.15.31:0/579263402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e181e1290 msgr2=0x7f7e181e1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e16a00640 1 --2- 172.21.15.31:0/579263402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e181e1290 0x7f7e181e1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e16a00640 1 -- 172.21.15.31:0/579263402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e180b3fe0 msgr2=0x7f7e180cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e16a00640 1 --2- 172.21.15.31:0/579263402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e180b3fe0 0x7f7e180cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e16a00640 1 -- 172.21.15.31:0/579263402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1815b3a0 con 0x7f7dfc003fe0 2024-09-17T05:35:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e17400640 1 --2- 172.21.15.31:0/579263402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e181e1290 0x7f7e181e1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e0fe00640 1 --2- 172.21.15.31:0/579263402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e180b3fe0 0x7f7e180cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:41.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e16a00640 1 --2- 172.21.15.31:0/579263402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dfc003fe0 0x7f7e181f7d50 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f7e08011b40 tx=0x7f7e08009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:41.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e0ea00640 1 -- 172.21.15.31:0/579263402 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0801e070 con 0x7f7dfc003fe0 2024-09-17T05:35:41.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e0ea00640 1 -- 172.21.15.31:0/579263402 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e08004050 con 0x7f7dfc003fe0 2024-09-17T05:35:41.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e1dc00640 1 -- 172.21.15.31:0/579263402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e181f8bd0 con 0x7f7dfc003fe0 2024-09-17T05:35:41.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e0ea00640 1 -- 172.21.15.31:0/579263402 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0800fea0 con 0x7f7dfc003fe0 2024-09-17T05:35:41.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.853+0000 7f7e1dc00640 1 -- 172.21.15.31:0/579263402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e181f8610 con 0x7f7dfc003fe0 2024-09-17T05:35:41.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.857+0000 7f7e1dc00640 1 -- 172.21.15.31:0/579263402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e180b43c0 con 0x7f7dfc003fe0 2024-09-17T05:35:41.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.857+0000 7f7e0ea00640 1 -- 172.21.15.31:0/579263402 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f7e08021070 con 0x7f7dfc003fe0 2024-09-17T05:35:41.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.857+0000 7f7e0ea00640 1 --2- 172.21.15.31:0/579263402 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7df40738c0 0x7f7df4075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:41.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.857+0000 7f7e0ea00640 1 -- 172.21.15.31:0/579263402 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 4885+0+0 (secure 0 0 0) 0x7f7e08095ec0 con 0x7f7dfc003fe0 2024-09-17T05:35:41.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.857+0000 7f7e0fe00640 1 --2- 172.21.15.31:0/579263402 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7df40738c0 0x7f7df4075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:41.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.861+0000 7f7e0fe00640 1 --2- 172.21.15.31:0/579263402 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7df40738c0 0x7f7df4075d80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7e000af000 tx=0x7f7e0001c560 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:41.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:41.861+0000 7f7e0ea00640 1 -- 172.21.15.31:0/579263402 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7e1815b3a0 con 0x7f7dfc003fe0 2024-09-17T05:35:42.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.037+0000 7f7e1dc00640 1 -- 172.21.15.31:0/579263402 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7e180ceb90 con 0x7f7dfc003fe0 2024-09-17T05:35:42.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.041+0000 7f7e0ea00640 1 -- 172.21.15.31:0/579263402 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v137) ==== 84+0+65 (secure 0 0 0) 0x7f7e08095090 con 0x7f7dfc003fe0 2024-09-17T05:35:42.041 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:42.042 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:35:42.042 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:42.042 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-09-17T05:35:42.042 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-09-17T05:35:42.042 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:42.042 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:35:42.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.041+0000 7f7e1dc00640 1 -- 172.21.15.31:0/579263402 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7df40738c0 msgr2=0x7f7df4075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:42.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.041+0000 7f7e1dc00640 1 --2- 172.21.15.31:0/579263402 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7df40738c0 0x7f7df4075d80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7e000af000 tx=0x7f7e0001c560 comp rx=0 tx=0).stop 2024-09-17T05:35:42.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.041+0000 7f7e1dc00640 1 -- 172.21.15.31:0/579263402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dfc003fe0 msgr2=0x7f7e181f7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:42.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.041+0000 7f7e1dc00640 1 --2- 172.21.15.31:0/579263402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dfc003fe0 0x7f7e181f7d50 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f7e08011b40 tx=0x7f7e08009ea0 comp rx=0 tx=0).stop 2024-09-17T05:35:42.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.041+0000 7f7e1dc00640 1 -- 172.21.15.31:0/579263402 shutdown_connections 2024-09-17T05:35:42.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.041+0000 7f7e1dc00640 1 --2- 172.21.15.31:0/579263402 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7df40738c0 0x7f7df4075d80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:42.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.041+0000 7f7e1dc00640 1 --2- 172.21.15.31:0/579263402 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7e181e1290 0x7f7e181e1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:42.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.041+0000 7f7e1dc00640 1 --2- 172.21.15.31:0/579263402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e180b3fe0 0x7f7e180cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:42.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.041+0000 7f7e1dc00640 1 --2- 172.21.15.31:0/579263402 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7dfc003fe0 0x7f7e181f7d50 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:42.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.041+0000 7f7e1dc00640 1 -- 172.21.15.31:0/579263402 >> 172.21.15.31:0/579263402 conn(0x7f7e180d1dc0 msgr2=0x7f7e18071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:42.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.041+0000 7f7e1dc00640 1 -- 172.21.15.31:0/579263402 shutdown_connections 2024-09-17T05:35:42.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.041+0000 7f7e1dc00640 1 -- 172.21.15.31:0/579263402 wait complete. 2024-09-17T05:35:42.062 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:35:42.063 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:35:42.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.213+0000 7f28a7200640 1 -- 172.21.15.31:0/3938367970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2884004010 msgr2=0x7f2884004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:42.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.213+0000 7f28a7200640 1 --2- 172.21.15.31:0/3938367970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2884004010 0x7f2884004810 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f2888009b60 tx=0x7f288801d270 comp rx=0 tx=0).stop 2024-09-17T05:35:42.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.213+0000 7f28a5200640 1 -- 172.21.15.31:0/3938367970 reap_dead start 2024-09-17T05:35:42.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.213+0000 7f28a7200640 1 -- 172.21.15.31:0/3938367970 shutdown_connections 2024-09-17T05:35:42.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.213+0000 7f28a7200640 1 -- 172.21.15.31:0/3938367970 >> 172.21.15.31:0/3938367970 conn(0x7f28a00d1da0 msgr2=0x7f28a00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:42.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.213+0000 7f28a7200640 1 -- 172.21.15.31:0/3938367970 shutdown_connections 2024-09-17T05:35:42.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.213+0000 7f28a7200640 1 -- 172.21.15.31:0/3938367970 wait complete. 2024-09-17T05:35:42.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f28a7200640 1 Processor -- start 2024-09-17T05:35:42.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f28a7200640 1 -- start start 2024-09-17T05:35:42.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f28a7200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2884004010 0x7f28a00c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:42.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f28a7200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28a00c7fa0 0x7f28a006dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:42.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f28a7200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28a00c8420 0x7f28a006e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:42.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f28a7200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f28a00cf3b0 con 0x7f28a00c7fa0 2024-09-17T05:35:42.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f28a7200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f28a00cf230 con 0x7f2884004010 2024-09-17T05:35:42.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f28a7200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f28a00cf530 con 0x7f28a00c8420 2024-09-17T05:35:42.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f2897e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28a00c7fa0 0x7f28a006dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:42.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f2897e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28a00c7fa0 0x7f28a006dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43428/0 (socket says 172.21.15.31:43428) 2024-09-17T05:35:42.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f2897e00640 1 -- 172.21.15.31:0/1299682231 learned_addr learned my addr 172.21.15.31:0/1299682231 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:42.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f289fe00640 1 --2- 172.21.15.31:0/1299682231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2884004010 0x7f28a00c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:42.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f28a5200640 1 --2- 172.21.15.31:0/1299682231 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28a00c8420 0x7f28a006e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:42.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f2897e00640 1 -- 172.21.15.31:0/1299682231 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28a00c8420 msgr2=0x7f28a006e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:42.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f2897e00640 1 --2- 172.21.15.31:0/1299682231 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28a00c8420 0x7f28a006e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:42.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f2897e00640 1 -- 172.21.15.31:0/1299682231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2884004010 msgr2=0x7f28a00c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:42.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f2897e00640 1 --2- 172.21.15.31:0/1299682231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2884004010 0x7f28a00c5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:42.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f2897e00640 1 -- 172.21.15.31:0/1299682231 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a00c8f90 con 0x7f28a00c7fa0 2024-09-17T05:35:42.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f289fe00640 1 --2- 172.21.15.31:0/1299682231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2884004010 0x7f28a00c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:42.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f28a5200640 1 --2- 172.21.15.31:0/1299682231 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28a00c8420 0x7f28a006e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:42.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f2897e00640 1 --2- 172.21.15.31:0/1299682231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28a00c7fa0 0x7f28a006dd30 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f2888098da0 tx=0x7f2888005560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:42.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f289cc00640 1 -- 172.21.15.31:0/1299682231 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28880b1040 con 0x7f28a00c7fa0 2024-09-17T05:35:42.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f289cc00640 1 -- 172.21.15.31:0/1299682231 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28880bb070 con 0x7f28a00c7fa0 2024-09-17T05:35:42.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f28a7200640 1 -- 172.21.15.31:0/1299682231 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a00c9230 con 0x7f28a00c7fa0 2024-09-17T05:35:42.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f289cc00640 1 -- 172.21.15.31:0/1299682231 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888004290 con 0x7f28a00c7fa0 2024-09-17T05:35:42.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.217+0000 7f28a7200640 1 -- 172.21.15.31:0/1299682231 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a00c77a0 con 0x7f28a00c7fa0 2024-09-17T05:35:42.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.221+0000 7f28a7200640 1 -- 172.21.15.31:0/1299682231 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a00ccbd0 con 0x7f28a00c7fa0 2024-09-17T05:35:42.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.221+0000 7f289cc00640 1 -- 172.21.15.31:0/1299682231 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f28880046d0 con 0x7f28a00c7fa0 2024-09-17T05:35:42.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.221+0000 7f289cc00640 1 --2- 172.21.15.31:0/1299682231 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f287c0738f0 0x7f287c075db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:42.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.221+0000 7f289cc00640 1 -- 172.21.15.31:0/1299682231 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 4885+0+0 (secure 0 0 0) 0x7f288812fa30 con 0x7f28a00c7fa0 2024-09-17T05:35:42.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.221+0000 7f289fe00640 1 --2- 172.21.15.31:0/1299682231 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f287c0738f0 0x7f287c075db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:42.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.221+0000 7f289fe00640 1 --2- 172.21.15.31:0/1299682231 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f287c0738f0 0x7f287c075db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2890000fc0 tx=0x7f28900067b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:42.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.225+0000 7f289cc00640 1 -- 172.21.15.31:0/1299682231 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2888016f80 con 0x7f28a00c7fa0 2024-09-17T05:35:42.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:42.405+0000 7f28a7200640 1 -- 172.21.15.31:0/1299682231 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f28a0070350 con 0x7f28a00c7fa0 2024-09-17T05:35:42.644 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:35:42.647 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:35:43.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.277+0000 7f289cc00640 1 -- 172.21.15.31:0/1299682231 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v138) ==== 138+0+0 (secure 0 0 0) 0x7f28880fa430 con 0x7f28a00c7fa0 2024-09-17T05:35:43.279 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-09-17T05:35:43.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.281+0000 7f28a7200640 1 -- 172.21.15.31:0/1299682231 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f287c0738f0 msgr2=0x7f287c075db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:43.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.281+0000 7f28a7200640 1 --2- 172.21.15.31:0/1299682231 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f287c0738f0 0x7f287c075db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2890000fc0 tx=0x7f28900067b0 comp rx=0 tx=0).stop 2024-09-17T05:35:43.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.281+0000 7f28a7200640 1 -- 172.21.15.31:0/1299682231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28a00c7fa0 msgr2=0x7f28a006dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:43.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.281+0000 7f28a7200640 1 --2- 172.21.15.31:0/1299682231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28a00c7fa0 0x7f28a006dd30 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f2888098da0 tx=0x7f2888005560 comp rx=0 tx=0).stop 2024-09-17T05:35:43.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.281+0000 7f28a7200640 1 -- 172.21.15.31:0/1299682231 shutdown_connections 2024-09-17T05:35:43.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.281+0000 7f28a7200640 1 --2- 172.21.15.31:0/1299682231 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f287c0738f0 0x7f287c075db0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:43.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.281+0000 7f28a7200640 1 --2- 172.21.15.31:0/1299682231 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28a00c8420 0x7f28a006e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:43.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.281+0000 7f28a7200640 1 --2- 172.21.15.31:0/1299682231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28a00c7fa0 0x7f28a006dd30 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:43.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.281+0000 7f28a7200640 1 --2- 172.21.15.31:0/1299682231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2884004010 0x7f28a00c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:43.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.281+0000 7f28a7200640 1 -- 172.21.15.31:0/1299682231 >> 172.21.15.31:0/1299682231 conn(0x7f28a00d1da0 msgr2=0x7f28a0070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:43.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.281+0000 7f28a7200640 1 -- 172.21.15.31:0/1299682231 shutdown_connections 2024-09-17T05:35:43.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.281+0000 7f28a7200640 1 -- 172.21.15.31:0/1299682231 wait complete. 2024-09-17T05:35:43.308 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:35:43.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.465+0000 7ffb65600640 1 -- 172.21.15.31:0/2209723313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb600d2810 msgr2=0x7ffb60160350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:43.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.465+0000 7ffb65600640 1 --2- 172.21.15.31:0/2209723313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb600d2810 0x7ffb60160350 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7ffb600d14c0 tx=0x7ffb4c01c890 comp rx=0 tx=0).stop 2024-09-17T05:35:43.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.465+0000 7ffb65600640 1 -- 172.21.15.31:0/2209723313 shutdown_connections 2024-09-17T05:35:43.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.465+0000 7ffb65600640 1 --2- 172.21.15.31:0/2209723313 >> v2:172.21.15.155:3300/0 conn(0x7ffb600b25e0 0x7ffb600af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:43.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.465+0000 7ffb65600640 1 --2- 172.21.15.31:0/2209723313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb600d2810 0x7ffb60160350 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:43.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.465+0000 7ffb65600640 1 -- 172.21.15.31:0/2209723313 >> 172.21.15.31:0/2209723313 conn(0x7ffb600d1cf0 msgr2=0x7ffb600d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:43.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.465+0000 7ffb65600640 1 -- 172.21.15.31:0/2209723313 shutdown_connections 2024-09-17T05:35:43.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.465+0000 7ffb65600640 1 -- 172.21.15.31:0/2209723313 wait complete. 2024-09-17T05:35:43.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.465+0000 7ffb65600640 1 Processor -- start 2024-09-17T05:35:43.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.465+0000 7ffb65600640 1 -- start start 2024-09-17T05:35:43.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb65600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb600b25e0 0x7ffb600b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:43.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb65600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb600cfd30 0x7ffb600b6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:43.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb65600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb600d2810 0x7ffb600b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:43.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb65600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ffb60168f10 con 0x7ffb600d2810 2024-09-17T05:35:43.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb65600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffb600b07a0 con 0x7ffb600cfd30 2024-09-17T05:35:43.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb65600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffb60169090 con 0x7ffb600b25e0 2024-09-17T05:35:43.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb64c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb600d2810 0x7ffb600b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:43.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb64c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb600d2810 0x7ffb600b67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43440/0 (socket says 172.21.15.31:43440) 2024-09-17T05:35:43.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb64c00640 1 -- 172.21.15.31:0/650186641 learned_addr learned my addr 172.21.15.31:0/650186641 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:43.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb5f400640 1 --2- 172.21.15.31:0/650186641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb600cfd30 0x7ffb600b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:43.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb5fe00640 1 --2- 172.21.15.31:0/650186641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb600b25e0 0x7ffb600b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb64c00640 1 -- 172.21.15.31:0/650186641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb600b25e0 msgr2=0x7ffb600b75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb64c00640 1 --2- 172.21.15.31:0/650186641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb600b25e0 0x7ffb600b75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb64c00640 1 -- 172.21.15.31:0/650186641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb600cfd30 msgr2=0x7ffb600b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb64c00640 1 --2- 172.21.15.31:0/650186641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb600cfd30 0x7ffb600b6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb64c00640 1 -- 172.21.15.31:0/650186641 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6015ca70 con 0x7ffb600d2810 2024-09-17T05:35:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb5fe00640 1 --2- 172.21.15.31:0/650186641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb600b25e0 0x7ffb600b75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb64c00640 1 --2- 172.21.15.31:0/650186641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb600d2810 0x7ffb600b67b0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800ea50 tx=0x7ffb5800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb57e00640 1 -- 172.21.15.31:0/650186641 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5800cdc0 con 0x7ffb600d2810 2024-09-17T05:35:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb57e00640 1 -- 172.21.15.31:0/650186641 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb58004c40 con 0x7ffb600d2810 2024-09-17T05:35:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb57e00640 1 -- 172.21.15.31:0/650186641 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58005280 con 0x7ffb600d2810 2024-09-17T05:35:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb65600640 1 -- 172.21.15.31:0/650186641 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6015cd50 con 0x7ffb600d2810 2024-09-17T05:35:43.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb65600640 1 -- 172.21.15.31:0/650186641 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb600b4bb0 con 0x7ffb600d2810 2024-09-17T05:35:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.469+0000 7ffb65600640 1 -- 172.21.15.31:0/650186641 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb600af540 con 0x7ffb600d2810 2024-09-17T05:35:43.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.473+0000 7ffb57e00640 1 -- 172.21.15.31:0/650186641 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7ffb58005420 con 0x7ffb600d2810 2024-09-17T05:35:43.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.473+0000 7ffb57e00640 1 --2- 172.21.15.31:0/650186641 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ffb400738c0 0x7ffb40075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:43.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.473+0000 7ffb57e00640 1 -- 172.21.15.31:0/650186641 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5255+0+0 (secure 0 0 0) 0x7ffb58095b40 con 0x7ffb600d2810 2024-09-17T05:35:43.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.473+0000 7ffb5fe00640 1 --2- 172.21.15.31:0/650186641 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ffb400738c0 0x7ffb40075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:43.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.473+0000 7ffb5fe00640 1 --2- 172.21.15.31:0/650186641 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ffb400738c0 0x7ffb40075d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ffb601528a0 tx=0x7ffb50009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:43.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.477+0000 7ffb57e00640 1 -- 172.21.15.31:0/650186641 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ffb58016030 con 0x7ffb600d2810 2024-09-17T05:35:43.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:43.649+0000 7ffb65600640 1 -- 172.21.15.31:0/650186641 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ffb600b6cf0 con 0x7ffb600d2810 2024-09-17T05:35:44.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.281+0000 7ffb57e00640 1 -- 172.21.15.31:0/650186641 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v139) ==== 170+0+0 (secure 0 0 0) 0x7ffb5805fc70 con 0x7ffb600d2810 2024-09-17T05:35:44.281 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-09-17T05:35:44.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.281+0000 7ffb65600640 1 -- 172.21.15.31:0/650186641 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ffb400738c0 msgr2=0x7ffb40075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:44.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.281+0000 7ffb65600640 1 --2- 172.21.15.31:0/650186641 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ffb400738c0 0x7ffb40075d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ffb601528a0 tx=0x7ffb50009040 comp rx=0 tx=0).stop 2024-09-17T05:35:44.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.281+0000 7ffb65600640 1 -- 172.21.15.31:0/650186641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb600d2810 msgr2=0x7ffb600b67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:44.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.281+0000 7ffb65600640 1 --2- 172.21.15.31:0/650186641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb600d2810 0x7ffb600b67b0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800ea50 tx=0x7ffb5800ef10 comp rx=0 tx=0).stop 2024-09-17T05:35:44.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.281+0000 7ffb65600640 1 -- 172.21.15.31:0/650186641 shutdown_connections 2024-09-17T05:35:44.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.281+0000 7ffb65600640 1 --2- 172.21.15.31:0/650186641 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ffb400738c0 0x7ffb40075d80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:44.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.281+0000 7ffb65600640 1 --2- 172.21.15.31:0/650186641 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb600d2810 0x7ffb600b67b0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:44.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.281+0000 7ffb65600640 1 --2- 172.21.15.31:0/650186641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb600cfd30 0x7ffb600b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:44.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.281+0000 7ffb65600640 1 --2- 172.21.15.31:0/650186641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffb600b25e0 0x7ffb600b75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:44.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.281+0000 7ffb65600640 1 -- 172.21.15.31:0/650186641 >> 172.21.15.31:0/650186641 conn(0x7ffb600d1cf0 msgr2=0x7ffb6015fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:44.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.281+0000 7ffb65600640 1 -- 172.21.15.31:0/650186641 shutdown_connections 2024-09-17T05:35:44.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.281+0000 7ffb65600640 1 -- 172.21.15.31:0/650186641 wait complete. 2024-09-17T05:35:44.326 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:35:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f9596800640 1 -- 172.21.15.31:0/2638209524 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95900b49e0 msgr2=0x7f959006f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f9596800640 1 --2- 172.21.15.31:0/2638209524 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95900b49e0 0x7f959006f7b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9588009bc0 tx=0x7f958801cb10 comp rx=0 tx=0).stop 2024-09-17T05:35:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f9596800640 1 -- 172.21.15.31:0/2638209524 shutdown_connections 2024-09-17T05:35:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f9596800640 1 --2- 172.21.15.31:0/2638209524 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95900b49e0 0x7f959006f7b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f9596800640 1 --2- 172.21.15.31:0/2638209524 >> v2:172.21.15.155:3300/0 conn(0x7f959015dae0 0x7f95900acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f9596800640 1 -- 172.21.15.31:0/2638209524 >> 172.21.15.31:0/2638209524 conn(0x7f95900b18f0 msgr2=0x7f95900b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f9596800640 1 -- 172.21.15.31:0/2638209524 shutdown_connections 2024-09-17T05:35:44.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f9596800640 1 -- 172.21.15.31:0/2638209524 wait complete. 2024-09-17T05:35:44.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f9596800640 1 Processor -- start 2024-09-17T05:35:44.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f9596800640 1 -- start start 2024-09-17T05:35:44.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f9596800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95900b49e0 0x7f95901563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:44.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f9596800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95900cd100 0x7f95901f9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:44.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f9596800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f959015dae0 0x7f959009d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:44.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f9596800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f95900cf120 con 0x7f95900b49e0 2024-09-17T05:35:44.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f9596800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f95900cefa0 con 0x7f95900cd100 2024-09-17T05:35:44.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f9596800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f95900cf2a0 con 0x7f959015dae0 2024-09-17T05:35:44.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f958f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95900b49e0 0x7f95901563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:44.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f958f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95900b49e0 0x7f95901563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43446/0 (socket says 172.21.15.31:43446) 2024-09-17T05:35:44.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f958f400640 1 -- 172.21.15.31:0/2289100353 learned_addr learned my addr 172.21.15.31:0/2289100353 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:44.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f9587e00640 1 --2- 172.21.15.31:0/2289100353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95900cd100 0x7f95901f9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:44.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f958fe00640 1 --2- 172.21.15.31:0/2289100353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f959015dae0 0x7f959009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:44.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f958f400640 1 -- 172.21.15.31:0/2289100353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f959015dae0 msgr2=0x7f959009d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:44.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f958f400640 1 --2- 172.21.15.31:0/2289100353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f959015dae0 0x7f959009d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:44.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f958f400640 1 -- 172.21.15.31:0/2289100353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95900cd100 msgr2=0x7f95901f9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:44.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f958f400640 1 --2- 172.21.15.31:0/2289100353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95900cd100 0x7f95901f9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:44.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.481+0000 7f958f400640 1 -- 172.21.15.31:0/2289100353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959006fc00 con 0x7f95900b49e0 2024-09-17T05:35:44.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.485+0000 7f958f400640 1 --2- 172.21.15.31:0/2289100353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95900b49e0 0x7f95901563f0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f958000eaf0 tx=0x7f958000c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:44.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.485+0000 7f9587400640 1 -- 172.21.15.31:0/2289100353 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958000ce10 con 0x7f95900b49e0 2024-09-17T05:35:44.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.485+0000 7f9587400640 1 -- 172.21.15.31:0/2289100353 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9580004110 con 0x7f95900b49e0 2024-09-17T05:35:44.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.485+0000 7f9587400640 1 -- 172.21.15.31:0/2289100353 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580003600 con 0x7f95900b49e0 2024-09-17T05:35:44.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.485+0000 7f9596800640 1 -- 172.21.15.31:0/2289100353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959006fee0 con 0x7f95900b49e0 2024-09-17T05:35:44.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.485+0000 7f9596800640 1 -- 172.21.15.31:0/2289100353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95901f8d10 con 0x7f95900b49e0 2024-09-17T05:35:44.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.485+0000 7f9596800640 1 -- 172.21.15.31:0/2289100353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9590069410 con 0x7f95900b49e0 2024-09-17T05:35:44.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.485+0000 7f9587400640 1 -- 172.21.15.31:0/2289100353 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f958001d020 con 0x7f95900b49e0 2024-09-17T05:35:44.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.489+0000 7f9587400640 1 --2- 172.21.15.31:0/2289100353 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f956c0738c0 0x7f956c075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:44.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.489+0000 7f9587400640 1 -- 172.21.15.31:0/2289100353 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5637+0+0 (secure 0 0 0) 0x7f9580095590 con 0x7f95900b49e0 2024-09-17T05:35:44.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.489+0000 7f9587e00640 1 --2- 172.21.15.31:0/2289100353 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f956c0738c0 0x7f956c075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:44.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.489+0000 7f9587e00640 1 --2- 172.21.15.31:0/2289100353 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f956c0738c0 0x7f956c075d80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f959009d300 tx=0x7f9578009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:44.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.493+0000 7f9587400640 1 -- 172.21.15.31:0/2289100353 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f958005f540 con 0x7f95900b49e0 2024-09-17T05:35:44.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:44.705+0000 7f9596800640 1 -- 172.21.15.31:0/2289100353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f95900acd40 con 0x7f95900b49e0 2024-09-17T05:35:45.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.317+0000 7f9587400640 1 -- 172.21.15.31:0/2289100353 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v96) ==== 174+0+0 (secure 0 0 0) 0x7f9580063f70 con 0x7f95900b49e0 2024-09-17T05:35:45.326 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 22 and data pool 23 2024-09-17T05:35:45.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.333+0000 7f9596800640 1 -- 172.21.15.31:0/2289100353 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f956c0738c0 msgr2=0x7f956c075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:45.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.333+0000 7f9596800640 1 --2- 172.21.15.31:0/2289100353 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f956c0738c0 0x7f956c075d80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f959009d300 tx=0x7f9578009040 comp rx=0 tx=0).stop 2024-09-17T05:35:45.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.333+0000 7f9596800640 1 -- 172.21.15.31:0/2289100353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95900b49e0 msgr2=0x7f95901563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:45.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.333+0000 7f9596800640 1 --2- 172.21.15.31:0/2289100353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95900b49e0 0x7f95901563f0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f958000eaf0 tx=0x7f958000c3d0 comp rx=0 tx=0).stop 2024-09-17T05:35:45.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.333+0000 7f9596800640 1 -- 172.21.15.31:0/2289100353 shutdown_connections 2024-09-17T05:35:45.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.333+0000 7f9596800640 1 --2- 172.21.15.31:0/2289100353 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f956c0738c0 0x7f956c075d80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:45.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.333+0000 7f9596800640 1 --2- 172.21.15.31:0/2289100353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f959015dae0 0x7f959009d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:45.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.333+0000 7f9596800640 1 --2- 172.21.15.31:0/2289100353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95900cd100 0x7f95901f9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:45.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.333+0000 7f9596800640 1 --2- 172.21.15.31:0/2289100353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95900b49e0 0x7f95901563f0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:45.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.333+0000 7f9596800640 1 -- 172.21.15.31:0/2289100353 >> 172.21.15.31:0/2289100353 conn(0x7f95900b18f0 msgr2=0x7f95901518c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:45.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.341+0000 7f9596800640 1 -- 172.21.15.31:0/2289100353 shutdown_connections 2024-09-17T05:35:45.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.341+0000 7f9596800640 1 -- 172.21.15.31:0/2289100353 wait complete. 2024-09-17T05:35:45.370 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:35:45.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.517+0000 7f8adde00640 1 -- 172.21.15.31:0/3200038828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8abc003a60 msgr2=0x7f8abc003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:45.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.517+0000 7f8adde00640 1 --2- 172.21.15.31:0/3200038828 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8abc003a60 0x7f8abc003e80 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009b90 tx=0x7f8ac801d270 comp rx=0 tx=0).stop 2024-09-17T05:35:45.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.517+0000 7f8ad7400640 1 -- 172.21.15.31:0/3200038828 reap_dead start 2024-09-17T05:35:45.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.517+0000 7f8adde00640 1 -- 172.21.15.31:0/3200038828 shutdown_connections 2024-09-17T05:35:45.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.517+0000 7f8adde00640 1 -- 172.21.15.31:0/3200038828 >> 172.21.15.31:0/3200038828 conn(0x7f8ad80d1dc0 msgr2=0x7f8ad80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:45.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.517+0000 7f8adde00640 1 -- 172.21.15.31:0/3200038828 shutdown_connections 2024-09-17T05:35:45.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.517+0000 7f8adde00640 1 -- 172.21.15.31:0/3200038828 wait complete. 2024-09-17T05:35:45.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8adde00640 1 Processor -- start 2024-09-17T05:35:45.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8adde00640 1 -- start start 2024-09-17T05:35:45.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8adde00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8abc003a60 0x7f8ad80b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:45.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8adde00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ad8163b20 0x7f8ad81f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:45.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8adde00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ad80cbac0 0x7f8ad8164150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:45.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8adde00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad8166f00 con 0x7f8ad80cbac0 2024-09-17T05:35:45.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8adde00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad8166d80 con 0x7f8ad8163b20 2024-09-17T05:35:45.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8adde00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad8167080 con 0x7f8abc003a60 2024-09-17T05:35:45.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8ad7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ad80cbac0 0x7f8ad8164150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:45.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8ad7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ad80cbac0 0x7f8ad8164150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43476/0 (socket says 172.21.15.31:43476) 2024-09-17T05:35:45.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8ad7400640 1 -- 172.21.15.31:0/2483233856 learned_addr learned my addr 172.21.15.31:0/2483233856 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:45.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8ad6a00640 1 --2- 172.21.15.31:0/2483233856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8abc003a60 0x7f8ad80b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:45.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8acfe00640 1 --2- 172.21.15.31:0/2483233856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ad8163b20 0x7f8ad81f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:45.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8ad7400640 1 -- 172.21.15.31:0/2483233856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8abc003a60 msgr2=0x7f8ad80b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:45.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8ad7400640 1 --2- 172.21.15.31:0/2483233856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8abc003a60 0x7f8ad80b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:45.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8ad7400640 1 -- 172.21.15.31:0/2483233856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ad8163b20 msgr2=0x7f8ad81f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:45.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8ad7400640 1 --2- 172.21.15.31:0/2483233856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ad8163b20 0x7f8ad81f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:45.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8ad7400640 1 -- 172.21.15.31:0/2483233856 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad8162d60 con 0x7f8ad80cbac0 2024-09-17T05:35:45.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8ad7400640 1 --2- 172.21.15.31:0/2483233856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ad80cbac0 0x7f8ad8164150 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80d1d20 tx=0x7f8ad000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:45.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8acf400640 1 -- 172.21.15.31:0/2483233856 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad000eea0 con 0x7f8ad80cbac0 2024-09-17T05:35:45.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8acf400640 1 -- 172.21.15.31:0/2483233856 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ad0015070 con 0x7f8ad80cbac0 2024-09-17T05:35:45.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8acf400640 1 -- 172.21.15.31:0/2483233856 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0004030 con 0x7f8ad80cbac0 2024-09-17T05:35:45.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.521+0000 7f8adde00640 1 -- 172.21.15.31:0/2483233856 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad8163040 con 0x7f8ad80cbac0 2024-09-17T05:35:45.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.525+0000 7f8adde00640 1 -- 172.21.15.31:0/2483233856 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad80cbf40 con 0x7f8ad80cbac0 2024-09-17T05:35:45.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.525+0000 7f8adde00640 1 -- 172.21.15.31:0/2483233856 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad80b4d70 con 0x7f8ad80cbac0 2024-09-17T05:35:45.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.525+0000 7f8acf400640 1 -- 172.21.15.31:0/2483233856 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f8ad00041d0 con 0x7f8ad80cbac0 2024-09-17T05:35:45.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.525+0000 7f8acf400640 1 --2- 172.21.15.31:0/2483233856 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8ab40738c0 0x7f8ab4075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:45.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.525+0000 7f8acf400640 1 -- 172.21.15.31:0/2483233856 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5737+0+0 (secure 0 0 0) 0x7f8ad0095a20 con 0x7f8ad80cbac0 2024-09-17T05:35:45.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.525+0000 7f8ad6a00640 1 --2- 172.21.15.31:0/2483233856 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8ab40738c0 0x7f8ab4075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:45.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.529+0000 7f8ad6a00640 1 --2- 172.21.15.31:0/2483233856 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8ab40738c0 0x7f8ab4075d80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80ae000 tx=0x7f8ac801a010 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:45.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.529+0000 7f8acf400640 1 -- 172.21.15.31:0/2483233856 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8ad005fa80 con 0x7f8ad80cbac0 2024-09-17T05:35:45.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.705+0000 7f8adde00640 1 -- 172.21.15.31:0/2483233856 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ad806df80 con 0x7f8ad80cbac0 2024-09-17T05:35:45.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.705+0000 7f8acf400640 1 -- 172.21.15.31:0/2483233856 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+16812 (secure 0 0 0) 0x7f8ad00644b0 con 0x7f8ad80cbac0 2024-09-17T05:35:45.709 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:45.710 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":140,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:35:44.710573+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:35:42.419622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T05:35:43.665501+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:35:45.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.709+0000 7f8adde00640 1 -- 172.21.15.31:0/2483233856 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8ab40738c0 msgr2=0x7f8ab4075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:45.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.709+0000 7f8adde00640 1 --2- 172.21.15.31:0/2483233856 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8ab40738c0 0x7f8ab4075d80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80ae000 tx=0x7f8ac801a010 comp rx=0 tx=0).stop 2024-09-17T05:35:45.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.709+0000 7f8adde00640 1 -- 172.21.15.31:0/2483233856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ad80cbac0 msgr2=0x7f8ad8164150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:45.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.709+0000 7f8adde00640 1 --2- 172.21.15.31:0/2483233856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ad80cbac0 0x7f8ad8164150 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80d1d20 tx=0x7f8ad000e720 comp rx=0 tx=0).stop 2024-09-17T05:35:45.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.709+0000 7f8adde00640 1 -- 172.21.15.31:0/2483233856 shutdown_connections 2024-09-17T05:35:45.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.709+0000 7f8adde00640 1 --2- 172.21.15.31:0/2483233856 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8ab40738c0 0x7f8ab4075d80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:45.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.709+0000 7f8adde00640 1 --2- 172.21.15.31:0/2483233856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8ad80cbac0 0x7f8ad8164150 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:45.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.709+0000 7f8adde00640 1 --2- 172.21.15.31:0/2483233856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8ad8163b20 0x7f8ad81f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:45.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.709+0000 7f8adde00640 1 --2- 172.21.15.31:0/2483233856 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8abc003a60 0x7f8ad80b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:45.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.709+0000 7f8adde00640 1 -- 172.21.15.31:0/2483233856 >> 172.21.15.31:0/2483233856 conn(0x7f8ad80d1dc0 msgr2=0x7f8ad8165ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:45.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.709+0000 7f8adde00640 1 -- 172.21.15.31:0/2483233856 shutdown_connections 2024-09-17T05:35:45.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.709+0000 7f8adde00640 1 -- 172.21.15.31:0/2483233856 wait complete. 2024-09-17T05:35:45.732 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:35:45.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.877+0000 7f7875000640 1 -- 172.21.15.31:0/2404106033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78700cdb30 msgr2=0x7f78700cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:45.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.877+0000 7f7875000640 1 --2- 172.21.15.31:0/2404106033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78700cdb30 0x7f78700cebb0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f78700745d0 tx=0x7f785801c770 comp rx=0 tx=0).stop 2024-09-17T05:35:45.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.877+0000 7f7875000640 1 -- 172.21.15.31:0/2404106033 shutdown_connections 2024-09-17T05:35:45.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.877+0000 7f7875000640 1 --2- 172.21.15.31:0/2404106033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78700cdb30 0x7f78700cebb0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:45.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.877+0000 7f7875000640 1 --2- 172.21.15.31:0/2404106033 >> v2:172.21.15.155:3300/0 conn(0x7f787015bea0 0x7f78700ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:45.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.877+0000 7f7875000640 1 -- 172.21.15.31:0/2404106033 >> 172.21.15.31:0/2404106033 conn(0x7f78700d1dc0 msgr2=0x7f78700d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:45.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.877+0000 7f7875000640 1 -- 172.21.15.31:0/2404106033 shutdown_connections 2024-09-17T05:35:45.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.877+0000 7f7875000640 1 -- 172.21.15.31:0/2404106033 wait complete. 2024-09-17T05:35:45.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.877+0000 7f7875000640 1 Processor -- start 2024-09-17T05:35:45.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.877+0000 7f7875000640 1 -- start start 2024-09-17T05:35:45.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.877+0000 7f7875000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78700cdb30 0x7f78701566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:45.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.877+0000 7f7875000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78700d28e0 0x7f78700b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:45.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.877+0000 7f7875000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f787015bea0 0x7f78700b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:45.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.877+0000 7f7875000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7870168fc0 con 0x7f78700d28e0 2024-09-17T05:35:45.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.877+0000 7f7875000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7870168e40 con 0x7f78700cdb30 2024-09-17T05:35:45.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.877+0000 7f7875000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7870169140 con 0x7f787015bea0 2024-09-17T05:35:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.881+0000 7f7867e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78700d28e0 0x7f78700b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.881+0000 7f7867e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78700d28e0 0x7f78700b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43500/0 (socket says 172.21.15.31:43500) 2024-09-17T05:35:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.881+0000 7f7867e00640 1 -- 172.21.15.31:0/214608707 learned_addr learned my addr 172.21.15.31:0/214608707 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.881+0000 7f786de00640 1 --2- 172.21.15.31:0/214608707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78700cdb30 0x7f78701566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.881+0000 7f7867e00640 1 -- 172.21.15.31:0/214608707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f787015bea0 msgr2=0x7f78700b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:45.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.881+0000 7f7867e00640 1 --2- 172.21.15.31:0/214608707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f787015bea0 0x7f78700b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:45.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.881+0000 7f7867e00640 1 -- 172.21.15.31:0/214608707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78700cdb30 msgr2=0x7f78701566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:45.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.881+0000 7f7867e00640 1 --2- 172.21.15.31:0/214608707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78700cdb30 0x7f78701566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:45.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.881+0000 7f7867e00640 1 -- 172.21.15.31:0/214608707 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78700ccbe0 con 0x7f78700d28e0 2024-09-17T05:35:45.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.881+0000 7f786de00640 1 --2- 172.21.15.31:0/214608707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78700cdb30 0x7f78701566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:45.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.881+0000 7f7867e00640 1 --2- 172.21.15.31:0/214608707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78700d28e0 0x7f78700b12d0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f7858000c10 tx=0x7f78580a5650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:45.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.881+0000 7f7866000640 1 -- 172.21.15.31:0/214608707 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78580bc070 con 0x7f78700d28e0 2024-09-17T05:35:45.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.881+0000 7f7866000640 1 -- 172.21.15.31:0/214608707 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7858004430 con 0x7f78700d28e0 2024-09-17T05:35:45.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.881+0000 7f7875000640 1 -- 172.21.15.31:0/214608707 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787006dd70 con 0x7f78700d28e0 2024-09-17T05:35:45.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.881+0000 7f7866000640 1 -- 172.21.15.31:0/214608707 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78580b2040 con 0x7f78700d28e0 2024-09-17T05:35:45.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.881+0000 7f7875000640 1 -- 172.21.15.31:0/214608707 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787006e330 con 0x7f78700d28e0 2024-09-17T05:35:45.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.881+0000 7f7875000640 1 -- 172.21.15.31:0/214608707 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78700cc9d0 con 0x7f78700d28e0 2024-09-17T05:35:45.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.881+0000 7f7866000640 1 -- 172.21.15.31:0/214608707 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f78580bf070 con 0x7f78700d28e0 2024-09-17T05:35:45.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.885+0000 7f7866000640 1 --2- 172.21.15.31:0/214608707 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f784c0738c0 0x7f784c075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:45.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.885+0000 7f7866000640 1 -- 172.21.15.31:0/214608707 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5737+0+0 (secure 0 0 0) 0x7f785812e5f0 con 0x7f78700d28e0 2024-09-17T05:35:45.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.885+0000 7f786de00640 1 --2- 172.21.15.31:0/214608707 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f784c0738c0 0x7f784c075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:45.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.885+0000 7f786de00640 1 --2- 172.21.15.31:0/214608707 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f784c0738c0 0x7f784c075d80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7860005fd0 tx=0x7f7860005dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:45.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:45.889+0000 7f7866000640 1 -- 172.21.15.31:0/214608707 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f78580163f0 con 0x7f78700d28e0 2024-09-17T05:35:46.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.065+0000 7f7875000640 1 -- 172.21.15.31:0/214608707 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78700762f0 con 0x7f78700d28e0 2024-09-17T05:35:46.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.065+0000 7f7866000640 1 -- 172.21.15.31:0/214608707 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+16812 (secure 0 0 0) 0x7f78580f8de0 con 0x7f78700d28e0 2024-09-17T05:35:46.066 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:46.067 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":140,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:35:44.710573+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:35:42.419622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T05:35:43.665501+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:35:46.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.065+0000 7f7875000640 1 -- 172.21.15.31:0/214608707 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f784c0738c0 msgr2=0x7f784c075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:46.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.065+0000 7f7875000640 1 --2- 172.21.15.31:0/214608707 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f784c0738c0 0x7f784c075d80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7860005fd0 tx=0x7f7860005dc0 comp rx=0 tx=0).stop 2024-09-17T05:35:46.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.065+0000 7f7875000640 1 -- 172.21.15.31:0/214608707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78700d28e0 msgr2=0x7f78700b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:46.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.065+0000 7f7875000640 1 --2- 172.21.15.31:0/214608707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78700d28e0 0x7f78700b12d0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f7858000c10 tx=0x7f78580a5650 comp rx=0 tx=0).stop 2024-09-17T05:35:46.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.065+0000 7f7875000640 1 -- 172.21.15.31:0/214608707 shutdown_connections 2024-09-17T05:35:46.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.065+0000 7f7875000640 1 --2- 172.21.15.31:0/214608707 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f784c0738c0 0x7f784c075d80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:46.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.065+0000 7f7875000640 1 --2- 172.21.15.31:0/214608707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f787015bea0 0x7f78700b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:46.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.065+0000 7f7875000640 1 --2- 172.21.15.31:0/214608707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78700d28e0 0x7f78700b12d0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:46.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.065+0000 7f7875000640 1 --2- 172.21.15.31:0/214608707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78700cdb30 0x7f78701566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:46.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.065+0000 7f7875000640 1 -- 172.21.15.31:0/214608707 >> 172.21.15.31:0/214608707 conn(0x7f78700d1dc0 msgr2=0x7f78700b7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:46.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.065+0000 7f7875000640 1 -- 172.21.15.31:0/214608707 shutdown_connections 2024-09-17T05:35:46.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.065+0000 7f7875000640 1 -- 172.21.15.31:0/214608707 wait complete. 2024-09-17T05:35:46.090 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:35:46.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.237+0000 7fc33a200640 1 -- 172.21.15.31:0/1978256729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc318004d50 msgr2=0x7fc3180051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:46.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.237+0000 7fc33a200640 1 --2- 172.21.15.31:0/1978256729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc318004d50 0x7fc3180051d0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009ee0 tx=0x7fc32c01d2d0 comp rx=0 tx=0).stop 2024-09-17T05:35:46.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.237+0000 7fc333e00640 1 -- 172.21.15.31:0/1978256729 reap_dead start 2024-09-17T05:35:46.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.237+0000 7fc33a200640 1 -- 172.21.15.31:0/1978256729 shutdown_connections 2024-09-17T05:35:46.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.237+0000 7fc33a200640 1 -- 172.21.15.31:0/1978256729 >> 172.21.15.31:0/1978256729 conn(0x7fc3340d1ea0 msgr2=0x7fc3340d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:46.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.237+0000 7fc33a200640 1 -- 172.21.15.31:0/1978256729 shutdown_connections 2024-09-17T05:35:46.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.237+0000 7fc33a200640 1 -- 172.21.15.31:0/1978256729 wait complete. 2024-09-17T05:35:46.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc33a200640 1 Processor -- start 2024-09-17T05:35:46.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc33a200640 1 -- start start 2024-09-17T05:35:46.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc33a200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc33414c0a0 0x7fc3340c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:46.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc33a200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc33414c870 0x7fc33414d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:46.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc33a200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc334150360 0x7fc3341507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:46.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc33a200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc334167270 con 0x7fc33414c0a0 2024-09-17T05:35:46.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc33a200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc3341670f0 con 0x7fc33414c870 2024-09-17T05:35:46.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc33a200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc3341673f0 con 0x7fc334150360 2024-09-17T05:35:46.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc333400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc33414c0a0 0x7fc3340c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc333400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc33414c0a0 0x7fc3340c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43508/0 (socket says 172.21.15.31:43508) 2024-09-17T05:35:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc333400640 1 -- 172.21.15.31:0/3413053511 learned_addr learned my addr 172.21.15.31:0/3413053511 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc333e00640 1 --2- 172.21.15.31:0/3413053511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc334150360 0x7fc3341507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc32be00640 1 --2- 172.21.15.31:0/3413053511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc33414c870 0x7fc33414d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc333e00640 1 -- 172.21.15.31:0/3413053511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc33414c870 msgr2=0x7fc33414d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc333e00640 1 --2- 172.21.15.31:0/3413053511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc33414c870 0x7fc33414d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc333e00640 1 -- 172.21.15.31:0/3413053511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc33414c0a0 msgr2=0x7fc3340c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc333e00640 1 --2- 172.21.15.31:0/3413053511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc33414c0a0 0x7fc3340c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc333e00640 1 -- 172.21.15.31:0/3413053511 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33414e980 con 0x7fc334150360 2024-09-17T05:35:46.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc333400640 1 --2- 172.21.15.31:0/3413053511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc33414c0a0 0x7fc3340c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:35:46.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc333e00640 1 --2- 172.21.15.31:0/3413053511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc334150360 0x7fc3341507e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0ac000 tx=0x7fc32c0aea20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:46.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc32b400640 1 -- 172.21.15.31:0/3413053511 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0bb070 con 0x7fc334150360 2024-09-17T05:35:46.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc32b400640 1 -- 172.21.15.31:0/3413053511 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc32c0a5900 con 0x7fc334150360 2024-09-17T05:35:46.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc32b400640 1 -- 172.21.15.31:0/3413053511 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0b2040 con 0x7fc334150360 2024-09-17T05:35:46.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.241+0000 7fc33a200640 1 -- 172.21.15.31:0/3413053511 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc33414ec60 con 0x7fc334150360 2024-09-17T05:35:46.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.245+0000 7fc33a200640 1 -- 172.21.15.31:0/3413053511 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc33414cde0 con 0x7fc334150360 2024-09-17T05:35:46.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.245+0000 7fc33a200640 1 -- 172.21.15.31:0/3413053511 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3340d2c60 con 0x7fc334150360 2024-09-17T05:35:46.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.245+0000 7fc32b400640 1 -- 172.21.15.31:0/3413053511 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7fc32c0be070 con 0x7fc334150360 2024-09-17T05:35:46.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.245+0000 7fc32b400640 1 --2- 172.21.15.31:0/3413053511 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc3100738c0 0x7fc310075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:46.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.245+0000 7fc32b400640 1 -- 172.21.15.31:0/3413053511 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(140..140 src has 1..140) ==== 5737+0+0 (secure 0 0 0) 0x7fc32c12e590 con 0x7fc334150360 2024-09-17T05:35:46.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.245+0000 7fc333400640 1 --2- 172.21.15.31:0/3413053511 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc3100738c0 0x7fc310075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:46.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.249+0000 7fc333400640 1 --2- 172.21.15.31:0/3413053511 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc3100738c0 0x7fc310075d80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc324009fd0 tx=0x7fc3240091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:46.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.249+0000 7fc32b400640 1 -- 172.21.15.31:0/3413053511 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc32c017300 con 0x7fc334150360 2024-09-17T05:35:46.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:46.469+0000 7fc33a200640 1 -- 172.21.15.31:0/3413053511 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc334071100 con 0x7fc334150360 2024-09-17T05:35:47.279 INFO:tasks.ceph.mds.c.smithi031.stderr:2024-09-17T05:35:47.277+0000 7f2aaa800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:35:47.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.333+0000 7fc32b400640 1 -- 172.21.15.31:0/3413053511 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v99) ==== 118+0+0 (secure 0 0 0) 0x7fc3340cef30 con 0x7fc334150360 2024-09-17T05:35:47.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.337+0000 7fc33a200640 1 -- 172.21.15.31:0/3413053511 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc3100738c0 msgr2=0x7fc310075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:47.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.337+0000 7fc33a200640 1 --2- 172.21.15.31:0/3413053511 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc3100738c0 0x7fc310075d80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc324009fd0 tx=0x7fc3240091e0 comp rx=0 tx=0).stop 2024-09-17T05:35:47.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.337+0000 7fc33a200640 1 -- 172.21.15.31:0/3413053511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc334150360 msgr2=0x7fc3341507e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:47.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.337+0000 7fc33a200640 1 --2- 172.21.15.31:0/3413053511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc334150360 0x7fc3341507e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0ac000 tx=0x7fc32c0aea20 comp rx=0 tx=0).stop 2024-09-17T05:35:47.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.337+0000 7fc33a200640 1 -- 172.21.15.31:0/3413053511 shutdown_connections 2024-09-17T05:35:47.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.337+0000 7fc33a200640 1 --2- 172.21.15.31:0/3413053511 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc3100738c0 0x7fc310075d80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:47.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.337+0000 7fc33a200640 1 --2- 172.21.15.31:0/3413053511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc334150360 0x7fc3341507e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:47.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.337+0000 7fc33a200640 1 --2- 172.21.15.31:0/3413053511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc33414c870 0x7fc33414d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:47.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.337+0000 7fc33a200640 1 --2- 172.21.15.31:0/3413053511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc33414c0a0 0x7fc3340c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:47.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.337+0000 7fc33a200640 1 -- 172.21.15.31:0/3413053511 >> 172.21.15.31:0/3413053511 conn(0x7fc3340d1ea0 msgr2=0x7fc3340cdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:47.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.337+0000 7fc33a200640 1 -- 172.21.15.31:0/3413053511 shutdown_connections 2024-09-17T05:35:47.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.337+0000 7fc33a200640 1 -- 172.21.15.31:0/3413053511 wait complete. 2024-09-17T05:35:47.363 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:35:47.363 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:35:47.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.517+0000 7f973c200640 1 -- 172.21.15.31:0/1745501582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97340703d0 msgr2=0x7f973415a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:47.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.517+0000 7f973c200640 1 --2- 172.21.15.31:0/1745501582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97340703d0 0x7f973415a8b0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f973409e090 tx=0x7f972c01caf0 comp rx=0 tx=0).stop 2024-09-17T05:35:47.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.517+0000 7f973c200640 1 -- 172.21.15.31:0/1745501582 shutdown_connections 2024-09-17T05:35:47.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.517+0000 7f973c200640 1 --2- 172.21.15.31:0/1745501582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97340703d0 0x7f973415a8b0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:47.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.517+0000 7f973c200640 1 --2- 172.21.15.31:0/1745501582 >> v2:172.21.15.155:3300/0 conn(0x7f97340b49b0 0x7f973415ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:47.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.517+0000 7f973c200640 1 -- 172.21.15.31:0/1745501582 >> 172.21.15.31:0/1745501582 conn(0x7f97340b18f0 msgr2=0x7f97340b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:47.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.517+0000 7f973c200640 1 -- 172.21.15.31:0/1745501582 shutdown_connections 2024-09-17T05:35:47.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.517+0000 7f973c200640 1 -- 172.21.15.31:0/1745501582 wait complete. 2024-09-17T05:35:47.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.517+0000 7f973c200640 1 Processor -- start 2024-09-17T05:35:47.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.517+0000 7f973c200640 1 -- start start 2024-09-17T05:35:47.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f973c200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97340703d0 0x7f9734146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:47.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f973c200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97340b49b0 0x7f973409daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:47.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f973c200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f973415a4d0 0x7f973409ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:47.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f973c200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f97340ccf40 con 0x7f973415a4d0 2024-09-17T05:35:47.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f973c200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f97340ccdc0 con 0x7f97340703d0 2024-09-17T05:35:47.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f973c200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f97340cd0c0 con 0x7f97340b49b0 2024-09-17T05:35:47.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f973a200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f973415a4d0 0x7f973409ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:47.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f973a200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f973415a4d0 0x7f973409ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43532/0 (socket says 172.21.15.31:43532) 2024-09-17T05:35:47.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f973a200640 1 -- 172.21.15.31:0/4278290468 learned_addr learned my addr 172.21.15.31:0/4278290468 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:47.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f9738e00640 1 --2- 172.21.15.31:0/4278290468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97340b49b0 0x7f973409daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:47.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f9739800640 1 --2- 172.21.15.31:0/4278290468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97340703d0 0x7f9734146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:47.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f973a200640 1 -- 172.21.15.31:0/4278290468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97340b49b0 msgr2=0x7f973409daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:47.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f973a200640 1 --2- 172.21.15.31:0/4278290468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97340b49b0 0x7f973409daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:47.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f973a200640 1 -- 172.21.15.31:0/4278290468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97340703d0 msgr2=0x7f9734146290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:47.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f973a200640 1 --2- 172.21.15.31:0/4278290468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97340703d0 0x7f9734146290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:47.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f973a200640 1 -- 172.21.15.31:0/4278290468 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97341fbba0 con 0x7f973415a4d0 2024-09-17T05:35:47.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f9738e00640 1 --2- 172.21.15.31:0/4278290468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97340b49b0 0x7f973409daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:47.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f973a200640 1 --2- 172.21.15.31:0/4278290468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f973415a4d0 0x7f973409ba90 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f972c0b0040 tx=0x7f972c009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:47.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f9731600640 1 -- 172.21.15.31:0/4278290468 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c0b2040 con 0x7f973415a4d0 2024-09-17T05:35:47.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f9731600640 1 -- 172.21.15.31:0/4278290468 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f972c0bb070 con 0x7f973415a4d0 2024-09-17T05:35:47.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f9731600640 1 -- 172.21.15.31:0/4278290468 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c0045b0 con 0x7f973415a4d0 2024-09-17T05:35:47.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f973c200640 1 -- 172.21.15.31:0/4278290468 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9734148af0 con 0x7f973415a4d0 2024-09-17T05:35:47.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f973c200640 1 -- 172.21.15.31:0/4278290468 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97341490b0 con 0x7f973415a4d0 2024-09-17T05:35:47.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f973c200640 1 -- 172.21.15.31:0/4278290468 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9734069410 con 0x7f973415a4d0 2024-09-17T05:35:47.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.521+0000 7f9731600640 1 -- 172.21.15.31:0/4278290468 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f972c0c0460 con 0x7f973415a4d0 2024-09-17T05:35:47.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.525+0000 7f9731600640 1 --2- 172.21.15.31:0/4278290468 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f97140738c0 0x7f9714075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:47.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.525+0000 7f9731600640 1 -- 172.21.15.31:0/4278290468 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f972c12f8c0 con 0x7f973415a4d0 2024-09-17T05:35:47.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.525+0000 7f9739800640 1 --2- 172.21.15.31:0/4278290468 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f97140738c0 0x7f9714075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:47.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.525+0000 7f9739800640 1 --2- 172.21.15.31:0/4278290468 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f97140738c0 0x7f9714075d80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9728000f70 tx=0x7f9728009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:47.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.529+0000 7f9731600640 1 -- 172.21.15.31:0/4278290468 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f972c016770 con 0x7f973415a4d0 2024-09-17T05:35:47.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:47.745+0000 7f973c200640 1 -- 172.21.15.31:0/4278290468 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f973406f4c0 con 0x7f973415a4d0 2024-09-17T05:35:48.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.333+0000 7f9731600640 1 -- 172.21.15.31:0/4278290468 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v100) ==== 122+0+0 (secure 0 0 0) 0x7f972c12f020 con 0x7f973415a4d0 2024-09-17T05:35:48.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.337+0000 7f973c200640 1 -- 172.21.15.31:0/4278290468 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f97140738c0 msgr2=0x7f9714075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:48.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.337+0000 7f973c200640 1 --2- 172.21.15.31:0/4278290468 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f97140738c0 0x7f9714075d80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9728000f70 tx=0x7f9728009040 comp rx=0 tx=0).stop 2024-09-17T05:35:48.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.337+0000 7f973c200640 1 -- 172.21.15.31:0/4278290468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f973415a4d0 msgr2=0x7f973409ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:48.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.337+0000 7f973c200640 1 --2- 172.21.15.31:0/4278290468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f973415a4d0 0x7f973409ba90 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f972c0b0040 tx=0x7f972c009280 comp rx=0 tx=0).stop 2024-09-17T05:35:48.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.337+0000 7f973c200640 1 -- 172.21.15.31:0/4278290468 shutdown_connections 2024-09-17T05:35:48.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.337+0000 7f973c200640 1 --2- 172.21.15.31:0/4278290468 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f97140738c0 0x7f9714075d80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:48.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.337+0000 7f973c200640 1 --2- 172.21.15.31:0/4278290468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f973415a4d0 0x7f973409ba90 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:48.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.337+0000 7f973c200640 1 --2- 172.21.15.31:0/4278290468 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97340b49b0 0x7f973409daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:48.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.337+0000 7f973c200640 1 --2- 172.21.15.31:0/4278290468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97340703d0 0x7f9734146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:48.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.337+0000 7f973c200640 1 -- 172.21.15.31:0/4278290468 >> 172.21.15.31:0/4278290468 conn(0x7f97340b18f0 msgr2=0x7f97340b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:48.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.337+0000 7f973c200640 1 -- 172.21.15.31:0/4278290468 shutdown_connections 2024-09-17T05:35:48.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.337+0000 7f973c200640 1 -- 172.21.15.31:0/4278290468 wait complete. 2024-09-17T05:35:48.361 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:35:48.362 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:35:48.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.509+0000 7fa715c00640 1 -- 172.21.15.31:0/334851553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7100d28e0 msgr2=0x7fa7100cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:48.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.509+0000 7fa715c00640 1 --2- 172.21.15.31:0/334851553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7100d28e0 0x7fa7100cebb0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fa7100745d0 tx=0x7fa70801caf0 comp rx=0 tx=0).stop 2024-09-17T05:35:48.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.509+0000 7fa715c00640 1 -- 172.21.15.31:0/334851553 shutdown_connections 2024-09-17T05:35:48.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.509+0000 7fa715c00640 1 --2- 172.21.15.31:0/334851553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7100d28e0 0x7fa7100cebb0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:48.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.509+0000 7fa715c00640 1 --2- 172.21.15.31:0/334851553 >> v2:172.21.15.155:3300/0 conn(0x7fa71015bea0 0x7fa7100ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:48.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.509+0000 7fa715c00640 1 -- 172.21.15.31:0/334851553 >> 172.21.15.31:0/334851553 conn(0x7fa7100d1dc0 msgr2=0x7fa7100d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:48.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.509+0000 7fa715c00640 1 -- 172.21.15.31:0/334851553 shutdown_connections 2024-09-17T05:35:48.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.509+0000 7fa715c00640 1 -- 172.21.15.31:0/334851553 wait complete. 2024-09-17T05:35:48.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa715c00640 1 Processor -- start 2024-09-17T05:35:48.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa715c00640 1 -- start start 2024-09-17T05:35:48.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa715c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7100cdb30 0x7fa7101660b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:48.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa715c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7100d28e0 0x7fa71006f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:48.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa715c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa71015bea0 0x7fa7100b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:48.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa715c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa710168fc0 con 0x7fa7100cdb30 2024-09-17T05:35:48.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa715c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa710168e40 con 0x7fa71015bea0 2024-09-17T05:35:48.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa715c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa710169140 con 0x7fa7100d28e0 2024-09-17T05:35:48.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa70ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7100cdb30 0x7fa7101660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:48.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa70ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7100cdb30 0x7fa7101660b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43542/0 (socket says 172.21.15.31:43542) 2024-09-17T05:35:48.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa70ea00640 1 -- 172.21.15.31:0/1700000346 learned_addr learned my addr 172.21.15.31:0/1700000346 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:48.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa70f400640 1 --2- 172.21.15.31:0/1700000346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa71015bea0 0x7fa7100b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:48.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa707e00640 1 --2- 172.21.15.31:0/1700000346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7100d28e0 0x7fa71006f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:48.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa70ea00640 1 -- 172.21.15.31:0/1700000346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7100d28e0 msgr2=0x7fa71006f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:48.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa70ea00640 1 --2- 172.21.15.31:0/1700000346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7100d28e0 0x7fa71006f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:48.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa70ea00640 1 -- 172.21.15.31:0/1700000346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa71015bea0 msgr2=0x7fa7100b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa70ea00640 1 --2- 172.21.15.31:0/1700000346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa71015bea0 0x7fa7100b53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa70ea00640 1 -- 172.21.15.31:0/1700000346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71006fab0 con 0x7fa7100cdb30 2024-09-17T05:35:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa707e00640 1 --2- 172.21.15.31:0/1700000346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7100d28e0 0x7fa71006f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:35:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa70ea00640 1 --2- 172.21.15.31:0/1700000346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7100cdb30 0x7fa7101660b0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fa70000e7a0 tx=0x7fa70000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa706a00640 1 -- 172.21.15.31:0/1700000346 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70000ccc0 con 0x7fa7100cdb30 2024-09-17T05:35:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa706a00640 1 -- 172.21.15.31:0/1700000346 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa700010430 con 0x7fa7100cdb30 2024-09-17T05:35:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa706a00640 1 -- 172.21.15.31:0/1700000346 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa700010860 con 0x7fa7100cdb30 2024-09-17T05:35:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa715c00640 1 -- 172.21.15.31:0/1700000346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa71006deb0 con 0x7fa7100cdb30 2024-09-17T05:35:48.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.513+0000 7fa715c00640 1 -- 172.21.15.31:0/1700000346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa71006e470 con 0x7fa7100cdb30 2024-09-17T05:35:48.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.517+0000 7fa715c00640 1 -- 172.21.15.31:0/1700000346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7100b50b0 con 0x7fa7100cdb30 2024-09-17T05:35:48.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.517+0000 7fa706a00640 1 -- 172.21.15.31:0/1700000346 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7fa700010a00 con 0x7fa7100cdb30 2024-09-17T05:35:48.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.517+0000 7fa706a00640 1 --2- 172.21.15.31:0/1700000346 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa6ec0738c0 0x7fa6ec075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:48.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.517+0000 7fa706a00640 1 -- 172.21.15.31:0/1700000346 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7fa7000959b0 con 0x7fa7100cdb30 2024-09-17T05:35:48.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.517+0000 7fa707e00640 1 --2- 172.21.15.31:0/1700000346 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa6ec0738c0 0x7fa6ec075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:48.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.521+0000 7fa707e00640 1 --2- 172.21.15.31:0/1700000346 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa6ec0738c0 0x7fa6ec075d80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa7100b4ca0 tx=0x7fa6f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:48.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.521+0000 7fa706a00640 1 -- 172.21.15.31:0/1700000346 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa70005ff60 con 0x7fa7100cdb30 2024-09-17T05:35:48.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.733+0000 7fa715c00640 1 -- 172.21.15.31:0/1700000346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7100cc990 con 0x7fa7100cdb30 2024-09-17T05:35:48.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.733+0000 7fa706a00640 1 -- 172.21.15.31:0/1700000346 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5235 (secure 0 0 0) 0x7fa70005f860 con 0x7fa7100cdb30 2024-09-17T05:35:48.737 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:48.737 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":100,"btime":"2024-09-17T05:35:48:336086+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3405206397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3405206397},{"type":"v1","addr":"172.21.15.155:6809","nonce":3405206397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6977,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4225787824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4225787824},{"type":"v1","addr":"172.21.15.155:6835","nonce":4225787824}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2838938586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2838938586},{"type":"v1","addr":"172.21.15.31:6834","nonce":2838938586}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:35:44.710527+0000","modified":"2024-09-17T05:35:47.749442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8343":{"gid":8343,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1808209578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1808209578},{"type":"v1","addr":"172.21.15.31:6835","nonce":1808209578}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8343,"qdb_cluster":[8343]},"id":11}]} 2024-09-17T05:35:48.737 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 100 2024-09-17T05:35:48.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.737+0000 7fa715c00640 1 -- 172.21.15.31:0/1700000346 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa6ec0738c0 msgr2=0x7fa6ec075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:48.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.737+0000 7fa715c00640 1 --2- 172.21.15.31:0/1700000346 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa6ec0738c0 0x7fa6ec075d80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa7100b4ca0 tx=0x7fa6f8009040 comp rx=0 tx=0).stop 2024-09-17T05:35:48.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.737+0000 7fa715c00640 1 -- 172.21.15.31:0/1700000346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7100cdb30 msgr2=0x7fa7101660b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:48.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.737+0000 7fa715c00640 1 --2- 172.21.15.31:0/1700000346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7100cdb30 0x7fa7101660b0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fa70000e7a0 tx=0x7fa70000ec60 comp rx=0 tx=0).stop 2024-09-17T05:35:48.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.737+0000 7fa715c00640 1 -- 172.21.15.31:0/1700000346 shutdown_connections 2024-09-17T05:35:48.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.737+0000 7fa715c00640 1 --2- 172.21.15.31:0/1700000346 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa6ec0738c0 0x7fa6ec075d80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:48.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.737+0000 7fa715c00640 1 --2- 172.21.15.31:0/1700000346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa71015bea0 0x7fa7100b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:48.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.737+0000 7fa715c00640 1 --2- 172.21.15.31:0/1700000346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7100d28e0 0x7fa71006f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:48.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.737+0000 7fa715c00640 1 --2- 172.21.15.31:0/1700000346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7100cdb30 0x7fa7101660b0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:48.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.737+0000 7fa715c00640 1 -- 172.21.15.31:0/1700000346 >> 172.21.15.31:0/1700000346 conn(0x7fa7100d1dc0 msgr2=0x7fa7100b6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:48.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.737+0000 7fa715c00640 1 -- 172.21.15.31:0/1700000346 shutdown_connections 2024-09-17T05:35:48.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.737+0000 7fa715c00640 1 -- 172.21.15.31:0/1700000346 wait complete. 2024-09-17T05:35:48.759 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:35:48.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.905+0000 7f97a9000640 1 -- 172.21.15.31:0/3311757766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788004810 msgr2=0x7f9788004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:48.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.905+0000 7f97a9000640 1 --2- 172.21.15.31:0/3311757766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788004810 0x7f9788004c90 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f978c009b60 tx=0x7f978c01d270 comp rx=0 tx=0).stop 2024-09-17T05:35:48.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.905+0000 7f97a9000640 1 -- 172.21.15.31:0/3311757766 shutdown_connections 2024-09-17T05:35:48.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.905+0000 7f97a9000640 1 --2- 172.21.15.31:0/3311757766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788004810 0x7f9788004c90 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:48.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.905+0000 7f97a9000640 1 -- 172.21.15.31:0/3311757766 >> 172.21.15.31:0/3311757766 conn(0x7f97a40d0c90 msgr2=0x7f97a40d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:48.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.905+0000 7f97a9000640 1 -- 172.21.15.31:0/3311757766 shutdown_connections 2024-09-17T05:35:48.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.905+0000 7f97a9000640 1 -- 172.21.15.31:0/3311757766 wait complete. 2024-09-17T05:35:48.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a9000640 1 Processor -- start 2024-09-17T05:35:48.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a9000640 1 -- start start 2024-09-17T05:35:48.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a9000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788004810 0x7f97a40b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:48.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a9000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a409ee20 0x7f97a40c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:48.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a9000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97a409f280 0x7f97a40ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:48.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a9000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f97a415c340 con 0x7f9788004810 2024-09-17T05:35:48.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a9000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f97a415c1c0 con 0x7f97a409f280 2024-09-17T05:35:48.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a9000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f97a415c4c0 con 0x7f97a409ee20 2024-09-17T05:35:48.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788004810 0x7f97a40b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:48.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788004810 0x7f97a40b6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46418/0 (socket says 172.21.15.31:46418) 2024-09-17T05:35:48.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a1e00640 1 -- 172.21.15.31:0/1595729800 learned_addr learned my addr 172.21.15.31:0/1595729800 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:48.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f9799400640 1 --2- 172.21.15.31:0/1595729800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a409ee20 0x7f97a40c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:48.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a2800640 1 --2- 172.21.15.31:0/1595729800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97a409f280 0x7f97a40ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:48.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a1e00640 1 -- 172.21.15.31:0/1595729800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a409ee20 msgr2=0x7f97a40c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:48.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a1e00640 1 --2- 172.21.15.31:0/1595729800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a409ee20 0x7f97a40c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:48.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a1e00640 1 -- 172.21.15.31:0/1595729800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97a409f280 msgr2=0x7f97a40ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:48.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a1e00640 1 --2- 172.21.15.31:0/1595729800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97a409f280 0x7f97a40ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:48.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a1e00640 1 -- 172.21.15.31:0/1595729800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a40b52d0 con 0x7f9788004810 2024-09-17T05:35:48.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a1e00640 1 --2- 172.21.15.31:0/1595729800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788004810 0x7f97a40b6370 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f9794005ea0 tx=0x7f9794005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:48.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f979aa00640 1 -- 172.21.15.31:0/1595729800 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794005320 con 0x7f9788004810 2024-09-17T05:35:48.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f979aa00640 1 -- 172.21.15.31:0/1595729800 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9794018020 con 0x7f9788004810 2024-09-17T05:35:48.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f979aa00640 1 -- 172.21.15.31:0/1595729800 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794003860 con 0x7f9788004810 2024-09-17T05:35:48.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a9000640 1 -- 172.21.15.31:0/1595729800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a40b55b0 con 0x7f9788004810 2024-09-17T05:35:48.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a9000640 1 -- 172.21.15.31:0/1595729800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a40b5b70 con 0x7f9788004810 2024-09-17T05:35:48.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.909+0000 7f97a9000640 1 -- 172.21.15.31:0/1595729800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97a406d0e0 con 0x7f9788004810 2024-09-17T05:35:48.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.913+0000 7f979aa00640 1 -- 172.21.15.31:0/1595729800 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f9794003a00 con 0x7f9788004810 2024-09-17T05:35:48.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.913+0000 7f979aa00640 1 --2- 172.21.15.31:0/1595729800 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f97800738c0 0x7f9780075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:48.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.913+0000 7f979aa00640 1 -- 172.21.15.31:0/1595729800 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f97940986c0 con 0x7f9788004810 2024-09-17T05:35:48.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.913+0000 7f9799400640 1 --2- 172.21.15.31:0/1595729800 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f97800738c0 0x7f9780075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:48.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.913+0000 7f9799400640 1 --2- 172.21.15.31:0/1595729800 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f97800738c0 0x7f9780075d80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f978c0ae000 tx=0x7f978c01a010 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:48.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:48.917+0000 7f979aa00640 1 -- 172.21.15.31:0/1595729800 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9794022020 con 0x7f9788004810 2024-09-17T05:35:49.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.093+0000 7f97a9000640 1 -- 172.21.15.31:0/1595729800 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97a40d0750 con 0x7f9788004810 2024-09-17T05:35:49.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.093+0000 7f979aa00640 1 -- 172.21.15.31:0/1595729800 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) ==== 74+0+16799 (secure 0 0 0) 0x7f9794062d30 con 0x7f9788004810 2024-09-17T05:35:49.097 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:49.097 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":141,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:35:46.306986+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:35:42.419622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T05:35:43.665501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:35:49.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.097+0000 7f97a9000640 1 -- 172.21.15.31:0/1595729800 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f97800738c0 msgr2=0x7f9780075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:49.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.097+0000 7f97a9000640 1 --2- 172.21.15.31:0/1595729800 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f97800738c0 0x7f9780075d80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f978c0ae000 tx=0x7f978c01a010 comp rx=0 tx=0).stop 2024-09-17T05:35:49.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.097+0000 7f97a9000640 1 -- 172.21.15.31:0/1595729800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788004810 msgr2=0x7f97a40b6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:49.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.097+0000 7f97a9000640 1 --2- 172.21.15.31:0/1595729800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788004810 0x7f97a40b6370 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f9794005ea0 tx=0x7f9794005f90 comp rx=0 tx=0).stop 2024-09-17T05:35:49.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.097+0000 7f97a9000640 1 -- 172.21.15.31:0/1595729800 shutdown_connections 2024-09-17T05:35:49.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.097+0000 7f97a9000640 1 --2- 172.21.15.31:0/1595729800 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f97800738c0 0x7f9780075d80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.097+0000 7f97a9000640 1 --2- 172.21.15.31:0/1595729800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97a409f280 0x7f97a40ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.097+0000 7f97a9000640 1 --2- 172.21.15.31:0/1595729800 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a409ee20 0x7f97a40c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.097+0000 7f97a9000640 1 --2- 172.21.15.31:0/1595729800 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9788004810 0x7f97a40b6370 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.097+0000 7f97a9000640 1 -- 172.21.15.31:0/1595729800 >> 172.21.15.31:0/1595729800 conn(0x7f97a40d0c90 msgr2=0x7f97a40b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:49.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.097+0000 7f97a9000640 1 -- 172.21.15.31:0/1595729800 shutdown_connections 2024-09-17T05:35:49.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.097+0000 7f97a9000640 1 -- 172.21.15.31:0/1595729800 wait complete. 2024-09-17T05:35:49.119 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:35:49.119 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:35:49.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d63400640 1 -- 172.21.15.31:0/3614592394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d5c0b2760 msgr2=0x7f6d5c0d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:49.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d63400640 1 --2- 172.21.15.31:0/3614592394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d5c0b2760 0x7f6d5c0d0260 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0b33d0 tx=0x7f6d4801c700 comp rx=0 tx=0).stop 2024-09-17T05:35:49.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d63400640 1 -- 172.21.15.31:0/3614592394 shutdown_connections 2024-09-17T05:35:49.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d63400640 1 --2- 172.21.15.31:0/3614592394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d5c0b2d00 0x7f6d5c1605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d63400640 1 --2- 172.21.15.31:0/3614592394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d5c0b2760 0x7f6d5c0d0260 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d63400640 1 -- 172.21.15.31:0/3614592394 >> 172.21.15.31:0/3614592394 conn(0x7f6d5c0d1e40 msgr2=0x7f6d5c0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:49.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d63400640 1 -- 172.21.15.31:0/3614592394 shutdown_connections 2024-09-17T05:35:49.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d63400640 1 -- 172.21.15.31:0/3614592394 wait complete. 2024-09-17T05:35:49.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d63400640 1 Processor -- start 2024-09-17T05:35:49.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d63400640 1 -- start start 2024-09-17T05:35:49.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d63400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d5c0b2760 0x7f6d5c06e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:49.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d63400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d5c0b2d00 0x7f6d5c1584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:49.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d63400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d5c0cfe80 0x7f6d5c15b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:49.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d63400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5c0b0990 con 0x7f6d5c0b2760 2024-09-17T05:35:49.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d63400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5c0b0810 con 0x7f6d5c0b2d00 2024-09-17T05:35:49.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d63400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6d5c0b0b10 con 0x7f6d5c0cfe80 2024-09-17T05:35:49.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d60a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d5c0b2760 0x7f6d5c06e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:49.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d60a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d5c0b2760 0x7f6d5c06e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46420/0 (socket says 172.21.15.31:46420) 2024-09-17T05:35:49.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.265+0000 7f6d60a00640 1 -- 172.21.15.31:0/2540149394 learned_addr learned my addr 172.21.15.31:0/2540149394 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:49.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.269+0000 7f6d60a00640 1 -- 172.21.15.31:0/2540149394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d5c0cfe80 msgr2=0x7f6d5c15b7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:35:49.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.269+0000 7f6d60a00640 1 --2- 172.21.15.31:0/2540149394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d5c0cfe80 0x7f6d5c15b7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.269+0000 7f6d60a00640 1 -- 172.21.15.31:0/2540149394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d5c0b2d00 msgr2=0x7f6d5c1584c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:35:49.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.269+0000 7f6d60a00640 1 --2- 172.21.15.31:0/2540149394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d5c0b2d00 0x7f6d5c1584c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.269+0000 7f6d60a00640 1 -- 172.21.15.31:0/2540149394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5c06f680 con 0x7f6d5c0b2760 2024-09-17T05:35:49.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.269+0000 7f6d60a00640 1 --2- 172.21.15.31:0/2540149394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d5c0b2760 0x7f6d5c06e740 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000c400 tx=0x7f6d5000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:49.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.269+0000 7f6d58c00640 1 -- 172.21.15.31:0/2540149394 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d50017070 con 0x7f6d5c0b2760 2024-09-17T05:35:49.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.269+0000 7f6d58c00640 1 -- 172.21.15.31:0/2540149394 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d50003600 con 0x7f6d5c0b2760 2024-09-17T05:35:49.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.269+0000 7f6d63400640 1 -- 172.21.15.31:0/2540149394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d5c06f960 con 0x7f6d5c0b2760 2024-09-17T05:35:49.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.269+0000 7f6d58c00640 1 -- 172.21.15.31:0/2540149394 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d50003a50 con 0x7f6d5c0b2760 2024-09-17T05:35:49.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.269+0000 7f6d63400640 1 -- 172.21.15.31:0/2540149394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d5c06f230 con 0x7f6d5c0b2760 2024-09-17T05:35:49.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.269+0000 7f6d63400640 1 -- 172.21.15.31:0/2540149394 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d5c0d0260 con 0x7f6d5c0b2760 2024-09-17T05:35:49.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.269+0000 7f6d58c00640 1 -- 172.21.15.31:0/2540149394 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f6d5001a070 con 0x7f6d5c0b2760 2024-09-17T05:35:49.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.269+0000 7f6d58c00640 1 --2- 172.21.15.31:0/2540149394 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d3c0738c0 0x7f6d3c075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:49.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.273+0000 7f6d58c00640 1 -- 172.21.15.31:0/2540149394 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f6d50094230 con 0x7f6d5c0b2760 2024-09-17T05:35:49.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.273+0000 7f6d5be00640 1 --2- 172.21.15.31:0/2540149394 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d3c0738c0 0x7f6d3c075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:49.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.273+0000 7f6d5be00640 1 --2- 172.21.15.31:0/2540149394 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d3c0738c0 0x7f6d3c075d80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6d480af000 tx=0x7f6d4801af40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:49.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.273+0000 7f6d58c00640 1 -- 172.21.15.31:0/2540149394 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6d5c0d0c80 con 0x7f6d5c0b2760 2024-09-17T05:35:49.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.449+0000 7f6d63400640 1 -- 172.21.15.31:0/2540149394 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6d5c0b3a60 con 0x7f6d3c0738c0 2024-09-17T05:35:49.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.453+0000 7f6d58c00640 1 -- 172.21.15.31:0/2540149394 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252480 (secure 0 0 0) 0x7f6d5c0b3a60 con 0x7f6d3c0738c0 2024-09-17T05:35:49.458 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:49.462 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:35:49.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.457+0000 7f6d63400640 1 -- 172.21.15.31:0/2540149394 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d3c0738c0 msgr2=0x7f6d3c075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:49.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.457+0000 7f6d63400640 1 --2- 172.21.15.31:0/2540149394 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d3c0738c0 0x7f6d3c075d80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6d480af000 tx=0x7f6d4801af40 comp rx=0 tx=0).stop 2024-09-17T05:35:49.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.457+0000 7f6d63400640 1 -- 172.21.15.31:0/2540149394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d5c0b2760 msgr2=0x7f6d5c06e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:49.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.457+0000 7f6d63400640 1 --2- 172.21.15.31:0/2540149394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d5c0b2760 0x7f6d5c06e740 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000c400 tx=0x7f6d5000c8c0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.457+0000 7f6d63400640 1 -- 172.21.15.31:0/2540149394 shutdown_connections 2024-09-17T05:35:49.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.457+0000 7f6d63400640 1 --2- 172.21.15.31:0/2540149394 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d3c0738c0 0x7f6d3c075d80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.457+0000 7f6d63400640 1 --2- 172.21.15.31:0/2540149394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d5c0cfe80 0x7f6d5c15b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.457+0000 7f6d63400640 1 --2- 172.21.15.31:0/2540149394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d5c0b2d00 0x7f6d5c1584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.457+0000 7f6d63400640 1 --2- 172.21.15.31:0/2540149394 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d5c0b2760 0x7f6d5c06e740 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.457+0000 7f6d63400640 1 -- 172.21.15.31:0/2540149394 >> 172.21.15.31:0/2540149394 conn(0x7f6d5c0d1e40 msgr2=0x7f6d5c0b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:49.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.457+0000 7f6d63400640 1 -- 172.21.15.31:0/2540149394 shutdown_connections 2024-09-17T05:35:49.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.457+0000 7f6d63400640 1 -- 172.21.15.31:0/2540149394 wait complete. 2024-09-17T05:35:49.481 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-09-17T05:35:48.739615+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264540,"kb_used_data":15016,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754710180,"statfs":{"total":773094113280,"available":772823224320,"internally_reserved":0,"allocated":15376384,"data_stored":7414628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.458349"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.783688+0000","last_change":"2024-09-17T05:35:45.342164+0000","last_active":"2024-09-17T05:35:46.783688+0000","last_peered":"2024-09-17T05:35:46.783688+0000","last_clean":"2024-09-17T05:35:46.783688+0000","last_became_active":"2024-09-17T05:35:45.341936+0000","last_became_peered":"2024-09-17T05:35:45.341936+0000","last_unstale":"2024-09-17T05:35:46.783688+0000","last_undegraded":"2024-09-17T05:35:46.783688+0000","last_fullsized":"2024-09-17T05:35:46.783688+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:04.806935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.318336+0000","last_change":"2024-09-17T05:35:45.332039+0000","last_active":"2024-09-17T05:35:46.318336+0000","last_peered":"2024-09-17T05:35:46.318336+0000","last_clean":"2024-09-17T05:35:46.318336+0000","last_became_active":"2024-09-17T05:35:45.331776+0000","last_became_peered":"2024-09-17T05:35:45.331776+0000","last_unstale":"2024-09-17T05:35:46.318336+0000","last_undegraded":"2024-09-17T05:35:46.318336+0000","last_fullsized":"2024-09-17T05:35:46.318336+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:00.365801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317319+0000","last_change":"2024-09-17T05:35:45.325452+0000","last_active":"2024-09-17T05:35:46.317319+0000","last_peered":"2024-09-17T05:35:46.317319+0000","last_clean":"2024-09-17T05:35:46.317319+0000","last_became_active":"2024-09-17T05:35:45.324906+0000","last_became_peered":"2024-09-17T05:35:45.324906+0000","last_unstale":"2024-09-17T05:35:46.317319+0000","last_undegraded":"2024-09-17T05:35:46.317319+0000","last_fullsized":"2024-09-17T05:35:46.317319+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:02.364131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780974+0000","last_change":"2024-09-17T05:35:45.338608+0000","last_active":"2024-09-17T05:35:46.780974+0000","last_peered":"2024-09-17T05:35:46.780974+0000","last_clean":"2024-09-17T05:35:46.780974+0000","last_became_active":"2024-09-17T05:35:45.338305+0000","last_became_peered":"2024-09-17T05:35:45.338305+0000","last_unstale":"2024-09-17T05:35:46.780974+0000","last_undegraded":"2024-09-17T05:35:46.780974+0000","last_fullsized":"2024-09-17T05:35:46.780974+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:14.985820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317113+0000","last_change":"2024-09-17T05:35:45.330826+0000","last_active":"2024-09-17T05:35:46.317113+0000","last_peered":"2024-09-17T05:35:46.317113+0000","last_clean":"2024-09-17T05:35:46.317113+0000","last_became_active":"2024-09-17T05:35:45.330444+0000","last_became_peered":"2024-09-17T05:35:45.330444+0000","last_unstale":"2024-09-17T05:35:46.317113+0000","last_undegraded":"2024-09-17T05:35:46.317113+0000","last_fullsized":"2024-09-17T05:35:46.317113+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:06.622847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.311693+0000","last_change":"2024-09-17T05:35:45.333727+0000","last_active":"2024-09-17T05:35:46.311693+0000","last_peered":"2024-09-17T05:35:46.311693+0000","last_clean":"2024-09-17T05:35:46.311693+0000","last_became_active":"2024-09-17T05:35:45.333441+0000","last_became_peered":"2024-09-17T05:35:45.333441+0000","last_unstale":"2024-09-17T05:35:46.311693+0000","last_undegraded":"2024-09-17T05:35:46.311693+0000","last_fullsized":"2024-09-17T05:35:46.311693+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:35.146699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780848+0000","last_change":"2024-09-17T05:35:45.329623+0000","last_active":"2024-09-17T05:35:46.780848+0000","last_peered":"2024-09-17T05:35:46.780848+0000","last_clean":"2024-09-17T05:35:46.780848+0000","last_became_active":"2024-09-17T05:35:45.329214+0000","last_became_peered":"2024-09-17T05:35:45.329214+0000","last_unstale":"2024-09-17T05:35:46.780848+0000","last_undegraded":"2024-09-17T05:35:46.780848+0000","last_fullsized":"2024-09-17T05:35:46.780848+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:01.699346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316418+0000","last_change":"2024-09-17T05:35:45.331442+0000","last_active":"2024-09-17T05:35:46.316418+0000","last_peered":"2024-09-17T05:35:46.316418+0000","last_clean":"2024-09-17T05:35:46.316418+0000","last_became_active":"2024-09-17T05:35:45.330453+0000","last_became_peered":"2024-09-17T05:35:45.330453+0000","last_unstale":"2024-09-17T05:35:46.316418+0000","last_undegraded":"2024-09-17T05:35:46.316418+0000","last_fullsized":"2024-09-17T05:35:46.316418+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:51.407774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317914+0000","last_change":"2024-09-17T05:35:45.331245+0000","last_active":"2024-09-17T05:35:46.317914+0000","last_peered":"2024-09-17T05:35:46.317914+0000","last_clean":"2024-09-17T05:35:46.317914+0000","last_became_active":"2024-09-17T05:35:45.330989+0000","last_became_peered":"2024-09-17T05:35:45.330989+0000","last_unstale":"2024-09-17T05:35:46.317914+0000","last_undegraded":"2024-09-17T05:35:46.317914+0000","last_fullsized":"2024-09-17T05:35:46.317914+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:34.371790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.318390+0000","last_change":"2024-09-17T05:35:45.341313+0000","last_active":"2024-09-17T05:35:46.318390+0000","last_peered":"2024-09-17T05:35:46.318390+0000","last_clean":"2024-09-17T05:35:46.318390+0000","last_became_active":"2024-09-17T05:35:45.340986+0000","last_became_peered":"2024-09-17T05:35:45.340986+0000","last_unstale":"2024-09-17T05:35:46.318390+0000","last_undegraded":"2024-09-17T05:35:46.318390+0000","last_fullsized":"2024-09-17T05:35:46.318390+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:04.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317464+0000","last_change":"2024-09-17T05:35:45.330910+0000","last_active":"2024-09-17T05:35:46.317464+0000","last_peered":"2024-09-17T05:35:46.317464+0000","last_clean":"2024-09-17T05:35:46.317464+0000","last_became_active":"2024-09-17T05:35:45.330378+0000","last_became_peered":"2024-09-17T05:35:45.330378+0000","last_unstale":"2024-09-17T05:35:46.317464+0000","last_undegraded":"2024-09-17T05:35:46.317464+0000","last_fullsized":"2024-09-17T05:35:46.317464+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:14.404416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317418+0000","last_change":"2024-09-17T05:35:45.340401+0000","last_active":"2024-09-17T05:35:46.317418+0000","last_peered":"2024-09-17T05:35:46.317418+0000","last_clean":"2024-09-17T05:35:46.317418+0000","last_became_active":"2024-09-17T05:35:45.340081+0000","last_became_peered":"2024-09-17T05:35:45.340081+0000","last_unstale":"2024-09-17T05:35:46.317418+0000","last_undegraded":"2024-09-17T05:35:46.317418+0000","last_fullsized":"2024-09-17T05:35:46.317418+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:16.579256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316577+0000","last_change":"2024-09-17T05:35:45.328632+0000","last_active":"2024-09-17T05:35:46.316577+0000","last_peered":"2024-09-17T05:35:46.316577+0000","last_clean":"2024-09-17T05:35:46.316577+0000","last_became_active":"2024-09-17T05:35:45.328347+0000","last_became_peered":"2024-09-17T05:35:45.328347+0000","last_unstale":"2024-09-17T05:35:46.316577+0000","last_undegraded":"2024-09-17T05:35:46.316577+0000","last_fullsized":"2024-09-17T05:35:46.316577+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:56.380527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316375+0000","last_change":"2024-09-17T05:35:45.332206+0000","last_active":"2024-09-17T05:35:46.316375+0000","last_peered":"2024-09-17T05:35:46.316375+0000","last_clean":"2024-09-17T05:35:46.316375+0000","last_became_active":"2024-09-17T05:35:45.331877+0000","last_became_peered":"2024-09-17T05:35:45.331877+0000","last_unstale":"2024-09-17T05:35:46.316375+0000","last_undegraded":"2024-09-17T05:35:46.316375+0000","last_fullsized":"2024-09-17T05:35:46.316375+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:59.745915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.783526+0000","last_change":"2024-09-17T05:35:45.343659+0000","last_active":"2024-09-17T05:35:46.783526+0000","last_peered":"2024-09-17T05:35:46.783526+0000","last_clean":"2024-09-17T05:35:46.783526+0000","last_became_active":"2024-09-17T05:35:45.343287+0000","last_became_peered":"2024-09-17T05:35:45.343287+0000","last_unstale":"2024-09-17T05:35:46.783526+0000","last_undegraded":"2024-09-17T05:35:46.783526+0000","last_fullsized":"2024-09-17T05:35:46.783526+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:06.018200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.779540+0000","last_change":"2024-09-17T05:35:45.342648+0000","last_active":"2024-09-17T05:35:46.779540+0000","last_peered":"2024-09-17T05:35:46.779540+0000","last_clean":"2024-09-17T05:35:46.779540+0000","last_became_active":"2024-09-17T05:35:45.329328+0000","last_became_peered":"2024-09-17T05:35:45.329328+0000","last_unstale":"2024-09-17T05:35:46.779540+0000","last_undegraded":"2024-09-17T05:35:46.779540+0000","last_fullsized":"2024-09-17T05:35:46.779540+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:10.446246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.312194+0000","last_change":"2024-09-17T05:35:45.329776+0000","last_active":"2024-09-17T05:35:46.312194+0000","last_peered":"2024-09-17T05:35:46.312194+0000","last_clean":"2024-09-17T05:35:46.312194+0000","last_became_active":"2024-09-17T05:35:45.329511+0000","last_became_peered":"2024-09-17T05:35:45.329511+0000","last_unstale":"2024-09-17T05:35:46.312194+0000","last_undegraded":"2024-09-17T05:35:46.312194+0000","last_fullsized":"2024-09-17T05:35:46.312194+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:26.408374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.779948+0000","last_change":"2024-09-17T05:35:45.322115+0000","last_active":"2024-09-17T05:35:46.779948+0000","last_peered":"2024-09-17T05:35:46.779948+0000","last_clean":"2024-09-17T05:35:46.779948+0000","last_became_active":"2024-09-17T05:35:45.321842+0000","last_became_peered":"2024-09-17T05:35:45.321842+0000","last_unstale":"2024-09-17T05:35:46.779948+0000","last_undegraded":"2024-09-17T05:35:46.779948+0000","last_fullsized":"2024-09-17T05:35:46.779948+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:53.688877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.311995+0000","last_change":"2024-09-17T05:35:45.334012+0000","last_active":"2024-09-17T05:35:46.311995+0000","last_peered":"2024-09-17T05:35:46.311995+0000","last_clean":"2024-09-17T05:35:46.311995+0000","last_became_active":"2024-09-17T05:35:45.333739+0000","last_became_peered":"2024-09-17T05:35:45.333739+0000","last_unstale":"2024-09-17T05:35:46.311995+0000","last_undegraded":"2024-09-17T05:35:46.311995+0000","last_fullsized":"2024-09-17T05:35:46.311995+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:28.463776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316538+0000","last_change":"2024-09-17T05:35:45.332037+0000","last_active":"2024-09-17T05:35:46.316538+0000","last_peered":"2024-09-17T05:35:46.316538+0000","last_clean":"2024-09-17T05:35:46.316538+0000","last_became_active":"2024-09-17T05:35:45.331067+0000","last_became_peered":"2024-09-17T05:35:45.331067+0000","last_unstale":"2024-09-17T05:35:46.316538+0000","last_undegraded":"2024-09-17T05:35:46.316538+0000","last_fullsized":"2024-09-17T05:35:46.316538+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:20.890078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.311673+0000","last_change":"2024-09-17T05:35:45.322911+0000","last_active":"2024-09-17T05:35:46.311673+0000","last_peered":"2024-09-17T05:35:46.311673+0000","last_clean":"2024-09-17T05:35:46.311673+0000","last_became_active":"2024-09-17T05:35:45.322179+0000","last_became_peered":"2024-09-17T05:35:45.322179+0000","last_unstale":"2024-09-17T05:35:46.311673+0000","last_undegraded":"2024-09-17T05:35:46.311673+0000","last_fullsized":"2024-09-17T05:35:46.311673+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:33.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317119+0000","last_change":"2024-09-17T05:35:45.338887+0000","last_active":"2024-09-17T05:35:46.317119+0000","last_peered":"2024-09-17T05:35:46.317119+0000","last_clean":"2024-09-17T05:35:46.317119+0000","last_became_active":"2024-09-17T05:35:45.338068+0000","last_became_peered":"2024-09-17T05:35:45.338068+0000","last_unstale":"2024-09-17T05:35:46.317119+0000","last_undegraded":"2024-09-17T05:35:46.317119+0000","last_fullsized":"2024-09-17T05:35:46.317119+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:00.845061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.311503+0000","last_change":"2024-09-17T05:35:45.327967+0000","last_active":"2024-09-17T05:35:46.311503+0000","last_peered":"2024-09-17T05:35:46.311503+0000","last_clean":"2024-09-17T05:35:46.311503+0000","last_became_active":"2024-09-17T05:35:45.327633+0000","last_became_peered":"2024-09-17T05:35:45.327633+0000","last_unstale":"2024-09-17T05:35:46.311503+0000","last_undegraded":"2024-09-17T05:35:46.311503+0000","last_fullsized":"2024-09-17T05:35:46.311503+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:54.050919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316625+0000","last_change":"2024-09-17T05:35:45.332854+0000","last_active":"2024-09-17T05:35:46.316625+0000","last_peered":"2024-09-17T05:35:46.316625+0000","last_clean":"2024-09-17T05:35:46.316625+0000","last_became_active":"2024-09-17T05:35:45.332566+0000","last_became_peered":"2024-09-17T05:35:45.332566+0000","last_unstale":"2024-09-17T05:35:46.316625+0000","last_undegraded":"2024-09-17T05:35:46.316625+0000","last_fullsized":"2024-09-17T05:35:46.316625+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:59.592008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.318037+0000","last_change":"2024-09-17T05:35:45.325495+0000","last_active":"2024-09-17T05:35:46.318037+0000","last_peered":"2024-09-17T05:35:46.318037+0000","last_clean":"2024-09-17T05:35:46.318037+0000","last_became_active":"2024-09-17T05:35:45.324473+0000","last_became_peered":"2024-09-17T05:35:45.324473+0000","last_unstale":"2024-09-17T05:35:46.318037+0000","last_undegraded":"2024-09-17T05:35:46.318037+0000","last_fullsized":"2024-09-17T05:35:46.318037+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:47.402566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780680+0000","last_change":"2024-09-17T05:35:45.341755+0000","last_active":"2024-09-17T05:35:46.780680+0000","last_peered":"2024-09-17T05:35:46.780680+0000","last_clean":"2024-09-17T05:35:46.780680+0000","last_became_active":"2024-09-17T05:35:45.341182+0000","last_became_peered":"2024-09-17T05:35:45.341182+0000","last_unstale":"2024-09-17T05:35:46.780680+0000","last_undegraded":"2024-09-17T05:35:46.780680+0000","last_fullsized":"2024-09-17T05:35:46.780680+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:12.763256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317508+0000","last_change":"2024-09-17T05:35:45.333206+0000","last_active":"2024-09-17T05:35:46.317508+0000","last_peered":"2024-09-17T05:35:46.317508+0000","last_clean":"2024-09-17T05:35:46.317508+0000","last_became_active":"2024-09-17T05:35:45.332266+0000","last_became_peered":"2024-09-17T05:35:45.332266+0000","last_unstale":"2024-09-17T05:35:46.317508+0000","last_undegraded":"2024-09-17T05:35:46.317508+0000","last_fullsized":"2024-09-17T05:35:46.317508+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:36.229321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781003+0000","last_change":"2024-09-17T05:35:45.336910+0000","last_active":"2024-09-17T05:35:46.781003+0000","last_peered":"2024-09-17T05:35:46.781003+0000","last_clean":"2024-09-17T05:35:46.781003+0000","last_became_active":"2024-09-17T05:35:45.336544+0000","last_became_peered":"2024-09-17T05:35:45.336544+0000","last_unstale":"2024-09-17T05:35:46.781003+0000","last_undegraded":"2024-09-17T05:35:46.781003+0000","last_fullsized":"2024-09-17T05:35:46.781003+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:07.867724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316804+0000","last_change":"2024-09-17T05:35:45.340730+0000","last_active":"2024-09-17T05:35:46.316804+0000","last_peered":"2024-09-17T05:35:46.316804+0000","last_clean":"2024-09-17T05:35:46.316804+0000","last_became_active":"2024-09-17T05:35:45.340429+0000","last_became_peered":"2024-09-17T05:35:45.340429+0000","last_unstale":"2024-09-17T05:35:46.316804+0000","last_undegraded":"2024-09-17T05:35:46.316804+0000","last_fullsized":"2024-09-17T05:35:46.316804+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:06.101772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.336053+0000","last_change":"2024-09-17T05:35:45.331949+0000","last_active":"2024-09-17T05:35:46.336053+0000","last_peered":"2024-09-17T05:35:46.336053+0000","last_clean":"2024-09-17T05:35:46.336053+0000","last_became_active":"2024-09-17T05:35:45.331681+0000","last_became_peered":"2024-09-17T05:35:45.331681+0000","last_unstale":"2024-09-17T05:35:46.336053+0000","last_undegraded":"2024-09-17T05:35:46.336053+0000","last_fullsized":"2024-09-17T05:35:46.336053+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:31.627238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.335886+0000","last_change":"2024-09-17T05:35:45.336860+0000","last_active":"2024-09-17T05:35:46.335886+0000","last_peered":"2024-09-17T05:35:46.335886+0000","last_clean":"2024-09-17T05:35:46.335886+0000","last_became_active":"2024-09-17T05:35:45.336449+0000","last_became_peered":"2024-09-17T05:35:45.336449+0000","last_unstale":"2024-09-17T05:35:46.335886+0000","last_undegraded":"2024-09-17T05:35:46.335886+0000","last_fullsized":"2024-09-17T05:35:46.335886+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:33.067923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780405+0000","last_change":"2024-09-17T05:35:45.320664+0000","last_active":"2024-09-17T05:35:46.780405+0000","last_peered":"2024-09-17T05:35:46.780405+0000","last_clean":"2024-09-17T05:35:46.780405+0000","last_became_active":"2024-09-17T05:35:45.318545+0000","last_became_peered":"2024-09-17T05:35:45.318545+0000","last_unstale":"2024-09-17T05:35:46.780405+0000","last_undegraded":"2024-09-17T05:35:46.780405+0000","last_fullsized":"2024-09-17T05:35:46.780405+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:35.802241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780688+0000","last_change":"2024-09-17T05:35:45.341470+0000","last_active":"2024-09-17T05:35:46.780688+0000","last_peered":"2024-09-17T05:35:46.780688+0000","last_clean":"2024-09-17T05:35:46.780688+0000","last_became_active":"2024-09-17T05:35:45.340828+0000","last_became_peered":"2024-09-17T05:35:45.340828+0000","last_unstale":"2024-09-17T05:35:46.780688+0000","last_undegraded":"2024-09-17T05:35:46.780688+0000","last_fullsized":"2024-09-17T05:35:46.780688+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:12.757520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"140'4","reported_seq":19,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.783628+0000","last_change":"2024-09-17T05:35:44.314155+0000","last_active":"2024-09-17T05:35:46.783628+0000","last_peered":"2024-09-17T05:35:46.783628+0000","last_clean":"2024-09-17T05:35:46.783628+0000","last_became_active":"2024-09-17T05:35:44.313845+0000","last_became_peered":"2024-09-17T05:35:44.313845+0000","last_unstale":"2024-09-17T05:35:46.783628+0000","last_undegraded":"2024-09-17T05:35:46.783628+0000","last_fullsized":"2024-09-17T05:35:46.783628+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:04.497447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.336460+0000","last_change":"2024-09-17T05:35:45.325056+0000","last_active":"2024-09-17T05:35:46.336460+0000","last_peered":"2024-09-17T05:35:46.336460+0000","last_clean":"2024-09-17T05:35:46.336460+0000","last_became_active":"2024-09-17T05:35:45.323822+0000","last_became_peered":"2024-09-17T05:35:45.323822+0000","last_unstale":"2024-09-17T05:35:46.336460+0000","last_undegraded":"2024-09-17T05:35:46.336460+0000","last_fullsized":"2024-09-17T05:35:46.336460+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:49.509786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.336195+0000","last_change":"2024-09-17T05:35:44.311779+0000","last_active":"2024-09-17T05:35:46.336195+0000","last_peered":"2024-09-17T05:35:46.336195+0000","last_clean":"2024-09-17T05:35:46.336195+0000","last_became_active":"2024-09-17T05:35:44.311473+0000","last_became_peered":"2024-09-17T05:35:44.311473+0000","last_unstale":"2024-09-17T05:35:46.336195+0000","last_undegraded":"2024-09-17T05:35:46.336195+0000","last_fullsized":"2024-09-17T05:35:46.336195+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:08.889206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.311936+0000","last_change":"2024-09-17T05:35:45.337870+0000","last_active":"2024-09-17T05:35:46.311936+0000","last_peered":"2024-09-17T05:35:46.311936+0000","last_clean":"2024-09-17T05:35:46.311936+0000","last_became_active":"2024-09-17T05:35:45.336928+0000","last_became_peered":"2024-09-17T05:35:45.336928+0000","last_unstale":"2024-09-17T05:35:46.311936+0000","last_undegraded":"2024-09-17T05:35:46.311936+0000","last_fullsized":"2024-09-17T05:35:46.311936+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:49.248788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781248+0000","last_change":"2024-09-17T05:35:44.307713+0000","last_active":"2024-09-17T05:35:46.781248+0000","last_peered":"2024-09-17T05:35:46.781248+0000","last_clean":"2024-09-17T05:35:46.781248+0000","last_became_active":"2024-09-17T05:35:44.307341+0000","last_became_peered":"2024-09-17T05:35:44.307341+0000","last_unstale":"2024-09-17T05:35:46.781248+0000","last_undegraded":"2024-09-17T05:35:46.781248+0000","last_fullsized":"2024-09-17T05:35:46.781248+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:16.622166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317718+0000","last_change":"2024-09-17T05:35:45.324808+0000","last_active":"2024-09-17T05:35:46.317718+0000","last_peered":"2024-09-17T05:35:46.317718+0000","last_clean":"2024-09-17T05:35:46.317718+0000","last_became_active":"2024-09-17T05:35:45.324465+0000","last_became_peered":"2024-09-17T05:35:45.324465+0000","last_unstale":"2024-09-17T05:35:46.317718+0000","last_undegraded":"2024-09-17T05:35:46.317718+0000","last_fullsized":"2024-09-17T05:35:46.317718+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:07.235760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781079+0000","last_change":"2024-09-17T05:35:44.308378+0000","last_active":"2024-09-17T05:35:46.781079+0000","last_peered":"2024-09-17T05:35:46.781079+0000","last_clean":"2024-09-17T05:35:46.781079+0000","last_became_active":"2024-09-17T05:35:44.306892+0000","last_became_peered":"2024-09-17T05:35:44.306892+0000","last_unstale":"2024-09-17T05:35:46.781079+0000","last_undegraded":"2024-09-17T05:35:46.781079+0000","last_fullsized":"2024-09-17T05:35:46.781079+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:42.028663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780623+0000","last_change":"2024-09-17T05:35:45.331474+0000","last_active":"2024-09-17T05:35:46.780623+0000","last_peered":"2024-09-17T05:35:46.780623+0000","last_clean":"2024-09-17T05:35:46.780623+0000","last_became_active":"2024-09-17T05:35:45.326003+0000","last_became_peered":"2024-09-17T05:35:45.326003+0000","last_unstale":"2024-09-17T05:35:46.780623+0000","last_undegraded":"2024-09-17T05:35:46.780623+0000","last_fullsized":"2024-09-17T05:35:46.780623+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:27:17.278770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316721+0000","last_change":"2024-09-17T05:35:44.303901+0000","last_active":"2024-09-17T05:35:46.316721+0000","last_peered":"2024-09-17T05:35:46.316721+0000","last_clean":"2024-09-17T05:35:46.316721+0000","last_became_active":"2024-09-17T05:35:44.302940+0000","last_became_peered":"2024-09-17T05:35:44.302940+0000","last_unstale":"2024-09-17T05:35:46.316721+0000","last_undegraded":"2024-09-17T05:35:46.316721+0000","last_fullsized":"2024-09-17T05:35:46.316721+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:51.213562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780963+0000","last_change":"2024-09-17T05:35:45.335344+0000","last_active":"2024-09-17T05:35:46.780963+0000","last_peered":"2024-09-17T05:35:46.780963+0000","last_clean":"2024-09-17T05:35:46.780963+0000","last_became_active":"2024-09-17T05:35:45.334976+0000","last_became_peered":"2024-09-17T05:35:45.334976+0000","last_unstale":"2024-09-17T05:35:46.780963+0000","last_undegraded":"2024-09-17T05:35:46.780963+0000","last_fullsized":"2024-09-17T05:35:46.780963+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:05.094169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781139+0000","last_change":"2024-09-17T05:35:44.307184+0000","last_active":"2024-09-17T05:35:46.781139+0000","last_peered":"2024-09-17T05:35:46.781139+0000","last_clean":"2024-09-17T05:35:46.781139+0000","last_became_active":"2024-09-17T05:35:44.306857+0000","last_became_peered":"2024-09-17T05:35:44.306857+0000","last_unstale":"2024-09-17T05:35:46.781139+0000","last_undegraded":"2024-09-17T05:35:46.781139+0000","last_fullsized":"2024-09-17T05:35:46.781139+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:19.111329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.779532+0000","last_change":"2024-09-17T05:35:45.337237+0000","last_active":"2024-09-17T05:35:46.779532+0000","last_peered":"2024-09-17T05:35:46.779532+0000","last_clean":"2024-09-17T05:35:46.779532+0000","last_became_active":"2024-09-17T05:35:45.336976+0000","last_became_peered":"2024-09-17T05:35:45.336976+0000","last_unstale":"2024-09-17T05:35:46.779532+0000","last_undegraded":"2024-09-17T05:35:46.779532+0000","last_fullsized":"2024-09-17T05:35:46.779532+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:55:40.245072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316469+0000","last_change":"2024-09-17T05:35:44.305304+0000","last_active":"2024-09-17T05:35:46.316469+0000","last_peered":"2024-09-17T05:35:46.316469+0000","last_clean":"2024-09-17T05:35:46.316469+0000","last_became_active":"2024-09-17T05:35:44.304781+0000","last_became_peered":"2024-09-17T05:35:44.304781+0000","last_unstale":"2024-09-17T05:35:46.316469+0000","last_undegraded":"2024-09-17T05:35:46.316469+0000","last_fullsized":"2024-09-17T05:35:46.316469+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:16.939371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.311519+0000","last_change":"2024-09-17T05:35:45.333529+0000","last_active":"2024-09-17T05:35:46.311519+0000","last_peered":"2024-09-17T05:35:46.311519+0000","last_clean":"2024-09-17T05:35:46.311519+0000","last_became_active":"2024-09-17T05:35:45.333209+0000","last_became_peered":"2024-09-17T05:35:45.333209+0000","last_unstale":"2024-09-17T05:35:46.311519+0000","last_undegraded":"2024-09-17T05:35:46.311519+0000","last_fullsized":"2024-09-17T05:35:46.311519+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:34.134583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780313+0000","last_change":"2024-09-17T05:35:44.304051+0000","last_active":"2024-09-17T05:35:46.780313+0000","last_peered":"2024-09-17T05:35:46.780313+0000","last_clean":"2024-09-17T05:35:46.780313+0000","last_became_active":"2024-09-17T05:35:44.302042+0000","last_became_peered":"2024-09-17T05:35:44.302042+0000","last_unstale":"2024-09-17T05:35:46.780313+0000","last_undegraded":"2024-09-17T05:35:46.780313+0000","last_fullsized":"2024-09-17T05:35:46.780313+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:49:22.965103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780855+0000","last_change":"2024-09-17T05:35:45.338574+0000","last_active":"2024-09-17T05:35:46.780855+0000","last_peered":"2024-09-17T05:35:46.780855+0000","last_clean":"2024-09-17T05:35:46.780855+0000","last_became_active":"2024-09-17T05:35:45.338308+0000","last_became_peered":"2024-09-17T05:35:45.338308+0000","last_unstale":"2024-09-17T05:35:46.780855+0000","last_undegraded":"2024-09-17T05:35:46.780855+0000","last_fullsized":"2024-09-17T05:35:46.780855+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:43.557187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.312072+0000","last_change":"2024-09-17T05:35:44.299072+0000","last_active":"2024-09-17T05:35:46.312072+0000","last_peered":"2024-09-17T05:35:46.312072+0000","last_clean":"2024-09-17T05:35:46.312072+0000","last_became_active":"2024-09-17T05:35:44.298707+0000","last_became_peered":"2024-09-17T05:35:44.298707+0000","last_unstale":"2024-09-17T05:35:46.312072+0000","last_undegraded":"2024-09-17T05:35:46.312072+0000","last_fullsized":"2024-09-17T05:35:46.312072+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:50.790162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780188+0000","last_change":"2024-09-17T05:35:45.337464+0000","last_active":"2024-09-17T05:35:46.780188+0000","last_peered":"2024-09-17T05:35:46.780188+0000","last_clean":"2024-09-17T05:35:46.780188+0000","last_became_active":"2024-09-17T05:35:45.337159+0000","last_became_peered":"2024-09-17T05:35:45.337159+0000","last_unstale":"2024-09-17T05:35:46.780188+0000","last_undegraded":"2024-09-17T05:35:46.780188+0000","last_fullsized":"2024-09-17T05:35:46.780188+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:16:42.376147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"140'3","reported_seq":18,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.311924+0000","last_change":"2024-09-17T05:35:44.302439+0000","last_active":"2024-09-17T05:35:46.311924+0000","last_peered":"2024-09-17T05:35:46.311924+0000","last_clean":"2024-09-17T05:35:46.311924+0000","last_became_active":"2024-09-17T05:35:44.298979+0000","last_became_peered":"2024-09-17T05:35:44.298979+0000","last_unstale":"2024-09-17T05:35:46.311924+0000","last_undegraded":"2024-09-17T05:35:46.311924+0000","last_fullsized":"2024-09-17T05:35:46.311924+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:53:03.650178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.336499+0000","last_change":"2024-09-17T05:35:45.326264+0000","last_active":"2024-09-17T05:35:46.336499+0000","last_peered":"2024-09-17T05:35:46.336499+0000","last_clean":"2024-09-17T05:35:46.336499+0000","last_became_active":"2024-09-17T05:35:45.325688+0000","last_became_peered":"2024-09-17T05:35:45.325688+0000","last_unstale":"2024-09-17T05:35:46.336499+0000","last_undegraded":"2024-09-17T05:35:46.336499+0000","last_fullsized":"2024-09-17T05:35:46.336499+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:03.503439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"140'6","reported_seq":21,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.335843+0000","last_change":"2024-09-17T05:35:44.307907+0000","last_active":"2024-09-17T05:35:46.335843+0000","last_peered":"2024-09-17T05:35:46.335843+0000","last_clean":"2024-09-17T05:35:46.335843+0000","last_became_active":"2024-09-17T05:35:44.307622+0000","last_became_peered":"2024-09-17T05:35:44.307622+0000","last_unstale":"2024-09-17T05:35:46.335843+0000","last_undegraded":"2024-09-17T05:35:46.335843+0000","last_fullsized":"2024-09-17T05:35:46.335843+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:15.572382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780022+0000","last_change":"2024-09-17T05:35:45.328738+0000","last_active":"2024-09-17T05:35:46.780022+0000","last_peered":"2024-09-17T05:35:46.780022+0000","last_clean":"2024-09-17T05:35:46.780022+0000","last_became_active":"2024-09-17T05:35:45.328386+0000","last_became_peered":"2024-09-17T05:35:45.328386+0000","last_unstale":"2024-09-17T05:35:46.780022+0000","last_undegraded":"2024-09-17T05:35:46.780022+0000","last_fullsized":"2024-09-17T05:35:46.780022+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:27.178443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781041+0000","last_change":"2024-09-17T05:35:44.309052+0000","last_active":"2024-09-17T05:35:46.781041+0000","last_peered":"2024-09-17T05:35:46.781041+0000","last_clean":"2024-09-17T05:35:46.781041+0000","last_became_active":"2024-09-17T05:35:44.308755+0000","last_became_peered":"2024-09-17T05:35:44.308755+0000","last_unstale":"2024-09-17T05:35:46.781041+0000","last_undegraded":"2024-09-17T05:35:46.781041+0000","last_fullsized":"2024-09-17T05:35:46.781041+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:59.574683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780421+0000","last_change":"2024-09-17T05:35:45.333236+0000","last_active":"2024-09-17T05:35:46.780421+0000","last_peered":"2024-09-17T05:35:46.780421+0000","last_clean":"2024-09-17T05:35:46.780421+0000","last_became_active":"2024-09-17T05:35:45.332961+0000","last_became_peered":"2024-09-17T05:35:45.332961+0000","last_unstale":"2024-09-17T05:35:46.780421+0000","last_undegraded":"2024-09-17T05:35:46.780421+0000","last_fullsized":"2024-09-17T05:35:46.780421+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:49.897722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780089+0000","last_change":"2024-09-17T05:35:44.308582+0000","last_active":"2024-09-17T05:35:46.780089+0000","last_peered":"2024-09-17T05:35:46.780089+0000","last_clean":"2024-09-17T05:35:46.780089+0000","last_became_active":"2024-09-17T05:35:44.308166+0000","last_became_peered":"2024-09-17T05:35:44.308166+0000","last_unstale":"2024-09-17T05:35:46.780089+0000","last_undegraded":"2024-09-17T05:35:46.780089+0000","last_fullsized":"2024-09-17T05:35:46.780089+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:54:09.312003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.779656+0000","last_change":"2024-09-17T05:35:45.331760+0000","last_active":"2024-09-17T05:35:46.779656+0000","last_peered":"2024-09-17T05:35:46.779656+0000","last_clean":"2024-09-17T05:35:46.779656+0000","last_became_active":"2024-09-17T05:35:45.331423+0000","last_became_peered":"2024-09-17T05:35:45.331423+0000","last_unstale":"2024-09-17T05:35:46.779656+0000","last_undegraded":"2024-09-17T05:35:46.779656+0000","last_fullsized":"2024-09-17T05:35:46.779656+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:11.781120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780954+0000","last_change":"2024-09-17T05:35:44.309028+0000","last_active":"2024-09-17T05:35:46.780954+0000","last_peered":"2024-09-17T05:35:46.780954+0000","last_clean":"2024-09-17T05:35:46.780954+0000","last_became_active":"2024-09-17T05:35:44.308628+0000","last_became_peered":"2024-09-17T05:35:44.308628+0000","last_unstale":"2024-09-17T05:35:46.780954+0000","last_undegraded":"2024-09-17T05:35:46.780954+0000","last_fullsized":"2024-09-17T05:35:46.780954+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:26.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316532+0000","last_change":"2024-09-17T05:35:45.337987+0000","last_active":"2024-09-17T05:35:46.316532+0000","last_peered":"2024-09-17T05:35:46.316532+0000","last_clean":"2024-09-17T05:35:46.316532+0000","last_became_active":"2024-09-17T05:35:45.337704+0000","last_became_peered":"2024-09-17T05:35:45.337704+0000","last_unstale":"2024-09-17T05:35:46.316532+0000","last_undegraded":"2024-09-17T05:35:46.316532+0000","last_fullsized":"2024-09-17T05:35:46.316532+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:57.203501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"140'8","reported_seq":23,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.335642+0000","last_change":"2024-09-17T05:35:44.308157+0000","last_active":"2024-09-17T05:35:46.335642+0000","last_peered":"2024-09-17T05:35:46.335642+0000","last_clean":"2024-09-17T05:35:46.335642+0000","last_became_active":"2024-09-17T05:35:44.307361+0000","last_became_peered":"2024-09-17T05:35:44.307361+0000","last_unstale":"2024-09-17T05:35:46.335642+0000","last_undegraded":"2024-09-17T05:35:46.335642+0000","last_fullsized":"2024-09-17T05:35:46.335642+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:13.397542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781513+0000","last_change":"2024-09-17T05:35:45.336564+0000","last_active":"2024-09-17T05:35:46.781513+0000","last_peered":"2024-09-17T05:35:46.781513+0000","last_clean":"2024-09-17T05:35:46.781513+0000","last_became_active":"2024-09-17T05:35:45.335760+0000","last_became_peered":"2024-09-17T05:35:45.335760+0000","last_unstale":"2024-09-17T05:35:46.781513+0000","last_undegraded":"2024-09-17T05:35:46.781513+0000","last_fullsized":"2024-09-17T05:35:46.781513+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:00.845061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317995+0000","last_change":"2024-09-17T05:35:44.310973+0000","last_active":"2024-09-17T05:35:46.317995+0000","last_peered":"2024-09-17T05:35:46.317995+0000","last_clean":"2024-09-17T05:35:46.317995+0000","last_became_active":"2024-09-17T05:35:44.310646+0000","last_became_peered":"2024-09-17T05:35:44.310646+0000","last_unstale":"2024-09-17T05:35:46.317995+0000","last_undegraded":"2024-09-17T05:35:46.317995+0000","last_fullsized":"2024-09-17T05:35:46.317995+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:48.849773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781043+0000","last_change":"2024-09-17T05:35:45.316118+0000","last_active":"2024-09-17T05:35:46.781043+0000","last_peered":"2024-09-17T05:35:46.781043+0000","last_clean":"2024-09-17T05:35:46.781043+0000","last_became_active":"2024-09-17T05:35:45.315825+0000","last_became_peered":"2024-09-17T05:35:45.315825+0000","last_unstale":"2024-09-17T05:35:46.781043+0000","last_undegraded":"2024-09-17T05:35:46.781043+0000","last_fullsized":"2024-09-17T05:35:46.781043+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:08.157784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317350+0000","last_change":"2024-09-17T05:35:44.308978+0000","last_active":"2024-09-17T05:35:46.317350+0000","last_peered":"2024-09-17T05:35:46.317350+0000","last_clean":"2024-09-17T05:35:46.317350+0000","last_became_active":"2024-09-17T05:35:44.308579+0000","last_became_peered":"2024-09-17T05:35:44.308579+0000","last_unstale":"2024-09-17T05:35:46.317350+0000","last_undegraded":"2024-09-17T05:35:46.317350+0000","last_fullsized":"2024-09-17T05:35:46.317350+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:58.812502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781206+0000","last_change":"2024-09-17T05:35:45.335350+0000","last_active":"2024-09-17T05:35:46.781206+0000","last_peered":"2024-09-17T05:35:46.781206+0000","last_clean":"2024-09-17T05:35:46.781206+0000","last_became_active":"2024-09-17T05:35:45.335052+0000","last_became_peered":"2024-09-17T05:35:45.335052+0000","last_unstale":"2024-09-17T05:35:46.781206+0000","last_undegraded":"2024-09-17T05:35:46.781206+0000","last_fullsized":"2024-09-17T05:35:46.781206+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:53.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.783641+0000","last_change":"2024-09-17T05:35:44.310086+0000","last_active":"2024-09-17T05:35:46.783641+0000","last_peered":"2024-09-17T05:35:46.783641+0000","last_clean":"2024-09-17T05:35:46.783641+0000","last_became_active":"2024-09-17T05:35:44.309790+0000","last_became_peered":"2024-09-17T05:35:44.309790+0000","last_unstale":"2024-09-17T05:35:46.783641+0000","last_undegraded":"2024-09-17T05:35:46.783641+0000","last_fullsized":"2024-09-17T05:35:46.783641+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:04.884790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781382+0000","last_change":"2024-09-17T05:35:45.334079+0000","last_active":"2024-09-17T05:35:46.781382+0000","last_peered":"2024-09-17T05:35:46.781382+0000","last_clean":"2024-09-17T05:35:46.781382+0000","last_became_active":"2024-09-17T05:35:45.326733+0000","last_became_peered":"2024-09-17T05:35:45.326733+0000","last_unstale":"2024-09-17T05:35:46.781382+0000","last_undegraded":"2024-09-17T05:35:46.781382+0000","last_fullsized":"2024-09-17T05:35:46.781382+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:51.846153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.783837+0000","last_change":"2024-09-17T05:35:44.312651+0000","last_active":"2024-09-17T05:35:46.783837+0000","last_peered":"2024-09-17T05:35:46.783837+0000","last_clean":"2024-09-17T05:35:46.783837+0000","last_became_active":"2024-09-17T05:35:44.312394+0000","last_became_peered":"2024-09-17T05:35:44.312394+0000","last_unstale":"2024-09-17T05:35:46.783837+0000","last_undegraded":"2024-09-17T05:35:46.783837+0000","last_fullsized":"2024-09-17T05:35:46.783837+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:47.934108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316624+0000","last_change":"2024-09-17T05:35:45.328659+0000","last_active":"2024-09-17T05:35:46.316624+0000","last_peered":"2024-09-17T05:35:46.316624+0000","last_clean":"2024-09-17T05:35:46.316624+0000","last_became_active":"2024-09-17T05:35:45.328369+0000","last_became_peered":"2024-09-17T05:35:45.328369+0000","last_unstale":"2024-09-17T05:35:46.316624+0000","last_undegraded":"2024-09-17T05:35:46.316624+0000","last_fullsized":"2024-09-17T05:35:46.316624+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:57.219344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781293+0000","last_change":"2024-09-17T05:35:44.308672+0000","last_active":"2024-09-17T05:35:46.781293+0000","last_peered":"2024-09-17T05:35:46.781293+0000","last_clean":"2024-09-17T05:35:46.781293+0000","last_became_active":"2024-09-17T05:35:44.307232+0000","last_became_peered":"2024-09-17T05:35:44.307232+0000","last_unstale":"2024-09-17T05:35:46.781293+0000","last_undegraded":"2024-09-17T05:35:46.781293+0000","last_fullsized":"2024-09-17T05:35:46.781293+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:59.007736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780594+0000","last_change":"2024-09-17T05:35:45.334092+0000","last_active":"2024-09-17T05:35:46.780594+0000","last_peered":"2024-09-17T05:35:46.780594+0000","last_clean":"2024-09-17T05:35:46.780594+0000","last_became_active":"2024-09-17T05:35:45.332706+0000","last_became_peered":"2024-09-17T05:35:45.332706+0000","last_unstale":"2024-09-17T05:35:46.780594+0000","last_undegraded":"2024-09-17T05:35:46.780594+0000","last_fullsized":"2024-09-17T05:35:46.780594+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:45.782297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.783330+0000","last_change":"2024-09-17T05:35:44.310781+0000","last_active":"2024-09-17T05:35:46.783330+0000","last_peered":"2024-09-17T05:35:46.783330+0000","last_clean":"2024-09-17T05:35:46.783330+0000","last_became_active":"2024-09-17T05:35:44.310430+0000","last_became_peered":"2024-09-17T05:35:44.310430+0000","last_unstale":"2024-09-17T05:35:46.783330+0000","last_undegraded":"2024-09-17T05:35:46.783330+0000","last_fullsized":"2024-09-17T05:35:46.783330+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:20.182494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.783633+0000","last_change":"2024-09-17T05:35:45.340200+0000","last_active":"2024-09-17T05:35:46.783633+0000","last_peered":"2024-09-17T05:35:46.783633+0000","last_clean":"2024-09-17T05:35:46.783633+0000","last_became_active":"2024-09-17T05:35:45.339916+0000","last_became_peered":"2024-09-17T05:35:45.339916+0000","last_unstale":"2024-09-17T05:35:46.783633+0000","last_undegraded":"2024-09-17T05:35:46.783633+0000","last_fullsized":"2024-09-17T05:35:46.783633+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:16.503597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781075+0000","last_change":"2024-09-17T05:35:44.300697+0000","last_active":"2024-09-17T05:35:46.781075+0000","last_peered":"2024-09-17T05:35:46.781075+0000","last_clean":"2024-09-17T05:35:46.781075+0000","last_became_active":"2024-09-17T05:35:44.300414+0000","last_became_peered":"2024-09-17T05:35:44.300414+0000","last_unstale":"2024-09-17T05:35:46.781075+0000","last_undegraded":"2024-09-17T05:35:46.781075+0000","last_fullsized":"2024-09-17T05:35:46.781075+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:46.478281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.311685+0000","last_change":"2024-09-17T05:35:45.328714+0000","last_active":"2024-09-17T05:35:46.311685+0000","last_peered":"2024-09-17T05:35:46.311685+0000","last_clean":"2024-09-17T05:35:46.311685+0000","last_became_active":"2024-09-17T05:35:45.328430+0000","last_became_peered":"2024-09-17T05:35:45.328430+0000","last_unstale":"2024-09-17T05:35:46.311685+0000","last_undegraded":"2024-09-17T05:35:46.311685+0000","last_fullsized":"2024-09-17T05:35:46.311685+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:28.872190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.783433+0000","last_change":"2024-09-17T05:35:44.314421+0000","last_active":"2024-09-17T05:35:46.783433+0000","last_peered":"2024-09-17T05:35:46.783433+0000","last_clean":"2024-09-17T05:35:46.783433+0000","last_became_active":"2024-09-17T05:35:44.314134+0000","last_became_peered":"2024-09-17T05:35:44.314134+0000","last_unstale":"2024-09-17T05:35:46.783433+0000","last_undegraded":"2024-09-17T05:35:46.783433+0000","last_fullsized":"2024-09-17T05:35:46.783433+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:40.509738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780344+0000","last_change":"2024-09-17T05:35:45.337543+0000","last_active":"2024-09-17T05:35:46.780344+0000","last_peered":"2024-09-17T05:35:46.780344+0000","last_clean":"2024-09-17T05:35:46.780344+0000","last_became_active":"2024-09-17T05:35:45.337244+0000","last_became_peered":"2024-09-17T05:35:45.337244+0000","last_unstale":"2024-09-17T05:35:46.780344+0000","last_undegraded":"2024-09-17T05:35:46.780344+0000","last_fullsized":"2024-09-17T05:35:46.780344+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:53.215614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781102+0000","last_change":"2024-09-17T05:35:44.306250+0000","last_active":"2024-09-17T05:35:46.781102+0000","last_peered":"2024-09-17T05:35:46.781102+0000","last_clean":"2024-09-17T05:35:46.781102+0000","last_became_active":"2024-09-17T05:35:44.305636+0000","last_became_peered":"2024-09-17T05:35:44.305636+0000","last_unstale":"2024-09-17T05:35:46.781102+0000","last_undegraded":"2024-09-17T05:35:46.781102+0000","last_fullsized":"2024-09-17T05:35:46.781102+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:00:07.810087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780604+0000","last_change":"2024-09-17T05:35:45.330725+0000","last_active":"2024-09-17T05:35:46.780604+0000","last_peered":"2024-09-17T05:35:46.780604+0000","last_clean":"2024-09-17T05:35:46.780604+0000","last_became_active":"2024-09-17T05:35:45.327179+0000","last_became_peered":"2024-09-17T05:35:45.327179+0000","last_unstale":"2024-09-17T05:35:46.780604+0000","last_undegraded":"2024-09-17T05:35:46.780604+0000","last_fullsized":"2024-09-17T05:35:46.780604+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:52.515512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"141'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317521+0000","last_change":"2024-09-17T05:35:44.301580+0000","last_active":"2024-09-17T05:35:46.317521+0000","last_peered":"2024-09-17T05:35:46.317521+0000","last_clean":"2024-09-17T05:35:46.317521+0000","last_became_active":"2024-09-17T05:35:44.301269+0000","last_became_peered":"2024-09-17T05:35:44.301269+0000","last_unstale":"2024-09-17T05:35:46.317521+0000","last_undegraded":"2024-09-17T05:35:46.317521+0000","last_fullsized":"2024-09-17T05:35:46.317521+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:04.010362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.311955+0000","last_change":"2024-09-17T05:35:45.342129+0000","last_active":"2024-09-17T05:35:46.311955+0000","last_peered":"2024-09-17T05:35:46.311955+0000","last_clean":"2024-09-17T05:35:46.311955+0000","last_became_active":"2024-09-17T05:35:45.341759+0000","last_became_peered":"2024-09-17T05:35:45.341759+0000","last_unstale":"2024-09-17T05:35:46.311955+0000","last_undegraded":"2024-09-17T05:35:46.311955+0000","last_fullsized":"2024-09-17T05:35:46.311955+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:39.278153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317781+0000","last_change":"2024-09-17T05:35:44.309641+0000","last_active":"2024-09-17T05:35:46.317781+0000","last_peered":"2024-09-17T05:35:46.317781+0000","last_clean":"2024-09-17T05:35:46.317781+0000","last_became_active":"2024-09-17T05:35:44.309210+0000","last_became_peered":"2024-09-17T05:35:44.309210+0000","last_unstale":"2024-09-17T05:35:46.317781+0000","last_undegraded":"2024-09-17T05:35:46.317781+0000","last_fullsized":"2024-09-17T05:35:46.317781+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:10.865187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780003+0000","last_change":"2024-09-17T05:35:45.329121+0000","last_active":"2024-09-17T05:35:46.780003+0000","last_peered":"2024-09-17T05:35:46.780003+0000","last_clean":"2024-09-17T05:35:46.780003+0000","last_became_active":"2024-09-17T05:35:45.328861+0000","last_became_peered":"2024-09-17T05:35:45.328861+0000","last_unstale":"2024-09-17T05:35:46.780003+0000","last_undegraded":"2024-09-17T05:35:46.780003+0000","last_fullsized":"2024-09-17T05:35:46.780003+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:58.424019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780191+0000","last_change":"2024-09-17T05:35:44.302990+0000","last_active":"2024-09-17T05:35:46.780191+0000","last_peered":"2024-09-17T05:35:46.780191+0000","last_clean":"2024-09-17T05:35:46.780191+0000","last_became_active":"2024-09-17T05:35:44.301120+0000","last_became_peered":"2024-09-17T05:35:44.301120+0000","last_unstale":"2024-09-17T05:35:46.780191+0000","last_undegraded":"2024-09-17T05:35:46.780191+0000","last_fullsized":"2024-09-17T05:35:46.780191+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:40.264823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780098+0000","last_change":"2024-09-17T05:35:45.324337+0000","last_active":"2024-09-17T05:35:46.780098+0000","last_peered":"2024-09-17T05:35:46.780098+0000","last_clean":"2024-09-17T05:35:46.780098+0000","last_became_active":"2024-09-17T05:35:45.323989+0000","last_became_peered":"2024-09-17T05:35:45.323989+0000","last_unstale":"2024-09-17T05:35:46.780098+0000","last_undegraded":"2024-09-17T05:35:46.780098+0000","last_fullsized":"2024-09-17T05:35:46.780098+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:11.314592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.335975+0000","last_change":"2024-09-17T05:35:44.311766+0000","last_active":"2024-09-17T05:35:46.335975+0000","last_peered":"2024-09-17T05:35:46.335975+0000","last_clean":"2024-09-17T05:35:46.335975+0000","last_became_active":"2024-09-17T05:35:44.311458+0000","last_became_peered":"2024-09-17T05:35:44.311458+0000","last_unstale":"2024-09-17T05:35:46.335975+0000","last_undegraded":"2024-09-17T05:35:46.335975+0000","last_fullsized":"2024-09-17T05:35:46.335975+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:59.358927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.336071+0000","last_change":"2024-09-17T05:35:45.329879+0000","last_active":"2024-09-17T05:35:46.336071+0000","last_peered":"2024-09-17T05:35:46.336071+0000","last_clean":"2024-09-17T05:35:46.336071+0000","last_became_active":"2024-09-17T05:35:45.329541+0000","last_became_peered":"2024-09-17T05:35:45.329541+0000","last_unstale":"2024-09-17T05:35:46.336071+0000","last_undegraded":"2024-09-17T05:35:46.336071+0000","last_fullsized":"2024-09-17T05:35:46.336071+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:05.214281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781248+0000","last_change":"2024-09-17T05:35:44.301181+0000","last_active":"2024-09-17T05:35:46.781248+0000","last_peered":"2024-09-17T05:35:46.781248+0000","last_clean":"2024-09-17T05:35:46.781248+0000","last_became_active":"2024-09-17T05:35:44.300894+0000","last_became_peered":"2024-09-17T05:35:44.300894+0000","last_unstale":"2024-09-17T05:35:46.781248+0000","last_undegraded":"2024-09-17T05:35:46.781248+0000","last_fullsized":"2024-09-17T05:35:46.781248+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:29.587165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.779584+0000","last_change":"2024-09-17T05:35:45.342930+0000","last_active":"2024-09-17T05:35:46.779584+0000","last_peered":"2024-09-17T05:35:46.779584+0000","last_clean":"2024-09-17T05:35:46.779584+0000","last_became_active":"2024-09-17T05:35:45.327472+0000","last_became_peered":"2024-09-17T05:35:45.327472+0000","last_unstale":"2024-09-17T05:35:46.779584+0000","last_undegraded":"2024-09-17T05:35:46.779584+0000","last_fullsized":"2024-09-17T05:35:46.779584+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:42.766747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316670+0000","last_change":"2024-09-17T05:35:44.310164+0000","last_active":"2024-09-17T05:35:46.316670+0000","last_peered":"2024-09-17T05:35:46.316670+0000","last_clean":"2024-09-17T05:35:46.316670+0000","last_became_active":"2024-09-17T05:35:44.309713+0000","last_became_peered":"2024-09-17T05:35:44.309713+0000","last_unstale":"2024-09-17T05:35:46.316670+0000","last_undegraded":"2024-09-17T05:35:46.316670+0000","last_fullsized":"2024-09-17T05:35:46.316670+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:46.265593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316783+0000","last_change":"2024-09-17T05:35:45.324640+0000","last_active":"2024-09-17T05:35:46.316783+0000","last_peered":"2024-09-17T05:35:46.316783+0000","last_clean":"2024-09-17T05:35:46.316783+0000","last_became_active":"2024-09-17T05:35:45.324309+0000","last_became_peered":"2024-09-17T05:35:45.324309+0000","last_unstale":"2024-09-17T05:35:46.316783+0000","last_undegraded":"2024-09-17T05:35:46.316783+0000","last_fullsized":"2024-09-17T05:35:46.316783+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:17.356586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.335807+0000","last_change":"2024-09-17T05:35:44.310901+0000","last_active":"2024-09-17T05:35:46.335807+0000","last_peered":"2024-09-17T05:35:46.335807+0000","last_clean":"2024-09-17T05:35:46.335807+0000","last_became_active":"2024-09-17T05:35:44.307714+0000","last_became_peered":"2024-09-17T05:35:44.307714+0000","last_unstale":"2024-09-17T05:35:46.335807+0000","last_undegraded":"2024-09-17T05:35:46.335807+0000","last_fullsized":"2024-09-17T05:35:46.335807+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:33.364916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780154+0000","last_change":"2024-09-17T05:35:45.337621+0000","last_active":"2024-09-17T05:35:46.780154+0000","last_peered":"2024-09-17T05:35:46.780154+0000","last_clean":"2024-09-17T05:35:46.780154+0000","last_became_active":"2024-09-17T05:35:45.337332+0000","last_became_peered":"2024-09-17T05:35:45.337332+0000","last_unstale":"2024-09-17T05:35:46.780154+0000","last_undegraded":"2024-09-17T05:35:46.780154+0000","last_fullsized":"2024-09-17T05:35:46.780154+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:46.954664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.336335+0000","last_change":"2024-09-17T05:35:44.306383+0000","last_active":"2024-09-17T05:35:46.336335+0000","last_peered":"2024-09-17T05:35:46.336335+0000","last_clean":"2024-09-17T05:35:46.336335+0000","last_became_active":"2024-09-17T05:35:44.306119+0000","last_became_peered":"2024-09-17T05:35:44.306119+0000","last_unstale":"2024-09-17T05:35:46.336335+0000","last_undegraded":"2024-09-17T05:35:46.336335+0000","last_fullsized":"2024-09-17T05:35:46.336335+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:03.908053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":359,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.783568+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:35:46.783568+0000","last_peered":"2024-09-17T05:35:46.783568+0000","last_clean":"2024-09-17T05:35:46.783568+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:35:46.783568+0000","last_undegraded":"2024-09-17T05:35:46.783568+0000","last_fullsized":"2024-09-17T05:35:46.783568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509530,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33516,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338324,"statfs":{"total":96636764160,"available":96602443776,"internally_reserved":0,"allocated":2383872,"data_stored":1371356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509531,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1769472,"data_stored":778656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542234,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1773568,"data_stored":779238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509531,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32928,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338912,"statfs":{"total":96636764160,"available":96603045888,"internally_reserved":0,"allocated":1781760,"data_stored":780316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509531,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1769472,"data_stored":778668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509531,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1769472,"data_stored":778724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509529,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1769472,"data_stored":778668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542233,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33492,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338348,"statfs":{"total":96636764160,"available":96602468352,"internally_reserved":0,"allocated":2359296,"data_stored":1369002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:35:49.486 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:35:49.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.673+0000 7faaf7600640 1 -- 172.21.15.31:0/3808202587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faad8003a10 msgr2=0x7faad8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:49.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.673+0000 7faaf7600640 1 --2- 172.21.15.31:0/3808202587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faad8003a10 0x7faad8003df0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7faae4009b60 tx=0x7faae401d270 comp rx=0 tx=0).stop 2024-09-17T05:35:49.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.673+0000 7faaf7600640 1 -- 172.21.15.31:0/3808202587 shutdown_connections 2024-09-17T05:35:49.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.673+0000 7faaf7600640 1 --2- 172.21.15.31:0/3808202587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faad8003a10 0x7faad8003df0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.673+0000 7faaf7600640 1 -- 172.21.15.31:0/3808202587 >> 172.21.15.31:0/3808202587 conn(0x7faaf00b18f0 msgr2=0x7faaf00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:49.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.673+0000 7faaf7600640 1 -- 172.21.15.31:0/3808202587 shutdown_connections 2024-09-17T05:35:49.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.673+0000 7faaf7600640 1 -- 172.21.15.31:0/3808202587 wait complete. 2024-09-17T05:35:49.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf7600640 1 Processor -- start 2024-09-17T05:35:49.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf7600640 1 -- start start 2024-09-17T05:35:49.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf7600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faad8003a10 0x7faaf009b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:49.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf7600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaf00c5550 0x7faaf00b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:49.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf7600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faaf014f940 0x7faaf014fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:49.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf7600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7faaf00b2fd0 con 0x7faaf014f940 2024-09-17T05:35:49.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf7600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faaf00b2e50 con 0x7faad8003a10 2024-09-17T05:35:49.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf7600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7faaf00b3150 con 0x7faaf00c5550 2024-09-17T05:35:49.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf5600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faaf014f940 0x7faaf014fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:49.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf5600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faaf014f940 0x7faaf014fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46450/0 (socket says 172.21.15.31:46450) 2024-09-17T05:35:49.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf5600640 1 -- 172.21.15.31:0/3263591278 learned_addr learned my addr 172.21.15.31:0/3263591278 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:49.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaefe00640 1 --2- 172.21.15.31:0/3263591278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaf00c5550 0x7faaf00b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:49.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf4c00640 1 --2- 172.21.15.31:0/3263591278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faad8003a10 0x7faaf009b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:49.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf5600640 1 -- 172.21.15.31:0/3263591278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaf00c5550 msgr2=0x7faaf00b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:49.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf5600640 1 --2- 172.21.15.31:0/3263591278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaf00c5550 0x7faaf00b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf5600640 1 -- 172.21.15.31:0/3263591278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faad8003a10 msgr2=0x7faaf009b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:49.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf5600640 1 --2- 172.21.15.31:0/3263591278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faad8003a10 0x7faaf009b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf5600640 1 -- 172.21.15.31:0/3263591278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf0150820 con 0x7faaf014f940 2024-09-17T05:35:49.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf5600640 1 --2- 172.21.15.31:0/3263591278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faaf014f940 0x7faaf014fda0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7faaf00cbe80 tx=0x7faae800e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:49.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaecc00640 1 -- 172.21.15.31:0/3263591278 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8003b80 con 0x7faaf014f940 2024-09-17T05:35:49.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaecc00640 1 -- 172.21.15.31:0/3263591278 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faae8003d20 con 0x7faaf014f940 2024-09-17T05:35:49.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaecc00640 1 -- 172.21.15.31:0/3263591278 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae80062d0 con 0x7faaf014f940 2024-09-17T05:35:49.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf7600640 1 -- 172.21.15.31:0/3263591278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf01502e0 con 0x7faaf014f940 2024-09-17T05:35:49.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.677+0000 7faaf7600640 1 -- 172.21.15.31:0/3263591278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf00c59e0 con 0x7faaf014f940 2024-09-17T05:35:49.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.681+0000 7faaf7600640 1 -- 172.21.15.31:0/3263591278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf015cec0 con 0x7faaf014f940 2024-09-17T05:35:49.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.681+0000 7faaecc00640 1 -- 172.21.15.31:0/3263591278 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7faae800d070 con 0x7faaf014f940 2024-09-17T05:35:49.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.681+0000 7faaecc00640 1 --2- 172.21.15.31:0/3263591278 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7faad00738c0 0x7faad0075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:49.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.681+0000 7faaecc00640 1 -- 172.21.15.31:0/3263591278 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7faae8098330 con 0x7faaf014f940 2024-09-17T05:35:49.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.681+0000 7faaf4c00640 1 --2- 172.21.15.31:0/3263591278 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7faad00738c0 0x7faad0075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:49.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.681+0000 7faaf4c00640 1 --2- 172.21.15.31:0/3263591278 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7faad00738c0 0x7faad0075d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7faae40ae000 tx=0x7faae401a010 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:49.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.685+0000 7faaecc00640 1 -- 172.21.15.31:0/3263591278 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7faaf01502e0 con 0x7faaf014f940 2024-09-17T05:35:49.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.861+0000 7faaf7600640 1 -- 172.21.15.31:0/3263591278 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faaf0074280 con 0x7faad00738c0 2024-09-17T05:35:49.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.865+0000 7faaecc00640 1 -- 172.21.15.31:0/3263591278 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252480 (secure 0 0 0) 0x7faaf0074280 con 0x7faad00738c0 2024-09-17T05:35:49.870 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:49.871 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:35:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.869+0000 7faaf7600640 1 -- 172.21.15.31:0/3263591278 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7faad00738c0 msgr2=0x7faad0075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.869+0000 7faaf7600640 1 --2- 172.21.15.31:0/3263591278 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7faad00738c0 0x7faad0075d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7faae40ae000 tx=0x7faae401a010 comp rx=0 tx=0).stop 2024-09-17T05:35:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.869+0000 7faaf7600640 1 -- 172.21.15.31:0/3263591278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faaf014f940 msgr2=0x7faaf014fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.869+0000 7faaf7600640 1 --2- 172.21.15.31:0/3263591278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faaf014f940 0x7faaf014fda0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7faaf00cbe80 tx=0x7faae800e6b0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.869+0000 7faaf7600640 1 -- 172.21.15.31:0/3263591278 shutdown_connections 2024-09-17T05:35:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.869+0000 7faaf7600640 1 --2- 172.21.15.31:0/3263591278 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7faad00738c0 0x7faad0075d80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.869+0000 7faaf7600640 1 --2- 172.21.15.31:0/3263591278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faaf014f940 0x7faaf014fda0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.869+0000 7faaf7600640 1 --2- 172.21.15.31:0/3263591278 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faaf00c5550 0x7faaf00b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.869+0000 7faaf7600640 1 --2- 172.21.15.31:0/3263591278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faad8003a10 0x7faaf009b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.869+0000 7faaf7600640 1 -- 172.21.15.31:0/3263591278 >> 172.21.15.31:0/3263591278 conn(0x7faaf00b18f0 msgr2=0x7faaf015d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:49.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.869+0000 7faaf7600640 1 -- 172.21.15.31:0/3263591278 shutdown_connections 2024-09-17T05:35:49.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:49.869+0000 7faaf7600640 1 -- 172.21.15.31:0/3263591278 wait complete. 2024-09-17T05:35:49.890 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-09-17T05:35:48.739615+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264540,"kb_used_data":15016,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754710180,"statfs":{"total":773094113280,"available":772823224320,"internally_reserved":0,"allocated":15376384,"data_stored":7414628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.458349"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.783688+0000","last_change":"2024-09-17T05:35:45.342164+0000","last_active":"2024-09-17T05:35:46.783688+0000","last_peered":"2024-09-17T05:35:46.783688+0000","last_clean":"2024-09-17T05:35:46.783688+0000","last_became_active":"2024-09-17T05:35:45.341936+0000","last_became_peered":"2024-09-17T05:35:45.341936+0000","last_unstale":"2024-09-17T05:35:46.783688+0000","last_undegraded":"2024-09-17T05:35:46.783688+0000","last_fullsized":"2024-09-17T05:35:46.783688+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:04.806935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.318336+0000","last_change":"2024-09-17T05:35:45.332039+0000","last_active":"2024-09-17T05:35:46.318336+0000","last_peered":"2024-09-17T05:35:46.318336+0000","last_clean":"2024-09-17T05:35:46.318336+0000","last_became_active":"2024-09-17T05:35:45.331776+0000","last_became_peered":"2024-09-17T05:35:45.331776+0000","last_unstale":"2024-09-17T05:35:46.318336+0000","last_undegraded":"2024-09-17T05:35:46.318336+0000","last_fullsized":"2024-09-17T05:35:46.318336+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:00.365801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317319+0000","last_change":"2024-09-17T05:35:45.325452+0000","last_active":"2024-09-17T05:35:46.317319+0000","last_peered":"2024-09-17T05:35:46.317319+0000","last_clean":"2024-09-17T05:35:46.317319+0000","last_became_active":"2024-09-17T05:35:45.324906+0000","last_became_peered":"2024-09-17T05:35:45.324906+0000","last_unstale":"2024-09-17T05:35:46.317319+0000","last_undegraded":"2024-09-17T05:35:46.317319+0000","last_fullsized":"2024-09-17T05:35:46.317319+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:02.364131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780974+0000","last_change":"2024-09-17T05:35:45.338608+0000","last_active":"2024-09-17T05:35:46.780974+0000","last_peered":"2024-09-17T05:35:46.780974+0000","last_clean":"2024-09-17T05:35:46.780974+0000","last_became_active":"2024-09-17T05:35:45.338305+0000","last_became_peered":"2024-09-17T05:35:45.338305+0000","last_unstale":"2024-09-17T05:35:46.780974+0000","last_undegraded":"2024-09-17T05:35:46.780974+0000","last_fullsized":"2024-09-17T05:35:46.780974+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:14.985820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317113+0000","last_change":"2024-09-17T05:35:45.330826+0000","last_active":"2024-09-17T05:35:46.317113+0000","last_peered":"2024-09-17T05:35:46.317113+0000","last_clean":"2024-09-17T05:35:46.317113+0000","last_became_active":"2024-09-17T05:35:45.330444+0000","last_became_peered":"2024-09-17T05:35:45.330444+0000","last_unstale":"2024-09-17T05:35:46.317113+0000","last_undegraded":"2024-09-17T05:35:46.317113+0000","last_fullsized":"2024-09-17T05:35:46.317113+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:06.622847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.311693+0000","last_change":"2024-09-17T05:35:45.333727+0000","last_active":"2024-09-17T05:35:46.311693+0000","last_peered":"2024-09-17T05:35:46.311693+0000","last_clean":"2024-09-17T05:35:46.311693+0000","last_became_active":"2024-09-17T05:35:45.333441+0000","last_became_peered":"2024-09-17T05:35:45.333441+0000","last_unstale":"2024-09-17T05:35:46.311693+0000","last_undegraded":"2024-09-17T05:35:46.311693+0000","last_fullsized":"2024-09-17T05:35:46.311693+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:35.146699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780848+0000","last_change":"2024-09-17T05:35:45.329623+0000","last_active":"2024-09-17T05:35:46.780848+0000","last_peered":"2024-09-17T05:35:46.780848+0000","last_clean":"2024-09-17T05:35:46.780848+0000","last_became_active":"2024-09-17T05:35:45.329214+0000","last_became_peered":"2024-09-17T05:35:45.329214+0000","last_unstale":"2024-09-17T05:35:46.780848+0000","last_undegraded":"2024-09-17T05:35:46.780848+0000","last_fullsized":"2024-09-17T05:35:46.780848+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:01.699346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316418+0000","last_change":"2024-09-17T05:35:45.331442+0000","last_active":"2024-09-17T05:35:46.316418+0000","last_peered":"2024-09-17T05:35:46.316418+0000","last_clean":"2024-09-17T05:35:46.316418+0000","last_became_active":"2024-09-17T05:35:45.330453+0000","last_became_peered":"2024-09-17T05:35:45.330453+0000","last_unstale":"2024-09-17T05:35:46.316418+0000","last_undegraded":"2024-09-17T05:35:46.316418+0000","last_fullsized":"2024-09-17T05:35:46.316418+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:51.407774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317914+0000","last_change":"2024-09-17T05:35:45.331245+0000","last_active":"2024-09-17T05:35:46.317914+0000","last_peered":"2024-09-17T05:35:46.317914+0000","last_clean":"2024-09-17T05:35:46.317914+0000","last_became_active":"2024-09-17T05:35:45.330989+0000","last_became_peered":"2024-09-17T05:35:45.330989+0000","last_unstale":"2024-09-17T05:35:46.317914+0000","last_undegraded":"2024-09-17T05:35:46.317914+0000","last_fullsized":"2024-09-17T05:35:46.317914+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:34.371790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.318390+0000","last_change":"2024-09-17T05:35:45.341313+0000","last_active":"2024-09-17T05:35:46.318390+0000","last_peered":"2024-09-17T05:35:46.318390+0000","last_clean":"2024-09-17T05:35:46.318390+0000","last_became_active":"2024-09-17T05:35:45.340986+0000","last_became_peered":"2024-09-17T05:35:45.340986+0000","last_unstale":"2024-09-17T05:35:46.318390+0000","last_undegraded":"2024-09-17T05:35:46.318390+0000","last_fullsized":"2024-09-17T05:35:46.318390+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:04.914926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317464+0000","last_change":"2024-09-17T05:35:45.330910+0000","last_active":"2024-09-17T05:35:46.317464+0000","last_peered":"2024-09-17T05:35:46.317464+0000","last_clean":"2024-09-17T05:35:46.317464+0000","last_became_active":"2024-09-17T05:35:45.330378+0000","last_became_peered":"2024-09-17T05:35:45.330378+0000","last_unstale":"2024-09-17T05:35:46.317464+0000","last_undegraded":"2024-09-17T05:35:46.317464+0000","last_fullsized":"2024-09-17T05:35:46.317464+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:14.404416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317418+0000","last_change":"2024-09-17T05:35:45.340401+0000","last_active":"2024-09-17T05:35:46.317418+0000","last_peered":"2024-09-17T05:35:46.317418+0000","last_clean":"2024-09-17T05:35:46.317418+0000","last_became_active":"2024-09-17T05:35:45.340081+0000","last_became_peered":"2024-09-17T05:35:45.340081+0000","last_unstale":"2024-09-17T05:35:46.317418+0000","last_undegraded":"2024-09-17T05:35:46.317418+0000","last_fullsized":"2024-09-17T05:35:46.317418+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:16.579256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316577+0000","last_change":"2024-09-17T05:35:45.328632+0000","last_active":"2024-09-17T05:35:46.316577+0000","last_peered":"2024-09-17T05:35:46.316577+0000","last_clean":"2024-09-17T05:35:46.316577+0000","last_became_active":"2024-09-17T05:35:45.328347+0000","last_became_peered":"2024-09-17T05:35:45.328347+0000","last_unstale":"2024-09-17T05:35:46.316577+0000","last_undegraded":"2024-09-17T05:35:46.316577+0000","last_fullsized":"2024-09-17T05:35:46.316577+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:21:56.380527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316375+0000","last_change":"2024-09-17T05:35:45.332206+0000","last_active":"2024-09-17T05:35:46.316375+0000","last_peered":"2024-09-17T05:35:46.316375+0000","last_clean":"2024-09-17T05:35:46.316375+0000","last_became_active":"2024-09-17T05:35:45.331877+0000","last_became_peered":"2024-09-17T05:35:45.331877+0000","last_unstale":"2024-09-17T05:35:46.316375+0000","last_undegraded":"2024-09-17T05:35:46.316375+0000","last_fullsized":"2024-09-17T05:35:46.316375+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:59.745915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.783526+0000","last_change":"2024-09-17T05:35:45.343659+0000","last_active":"2024-09-17T05:35:46.783526+0000","last_peered":"2024-09-17T05:35:46.783526+0000","last_clean":"2024-09-17T05:35:46.783526+0000","last_became_active":"2024-09-17T05:35:45.343287+0000","last_became_peered":"2024-09-17T05:35:45.343287+0000","last_unstale":"2024-09-17T05:35:46.783526+0000","last_undegraded":"2024-09-17T05:35:46.783526+0000","last_fullsized":"2024-09-17T05:35:46.783526+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:06.018200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.779540+0000","last_change":"2024-09-17T05:35:45.342648+0000","last_active":"2024-09-17T05:35:46.779540+0000","last_peered":"2024-09-17T05:35:46.779540+0000","last_clean":"2024-09-17T05:35:46.779540+0000","last_became_active":"2024-09-17T05:35:45.329328+0000","last_became_peered":"2024-09-17T05:35:45.329328+0000","last_unstale":"2024-09-17T05:35:46.779540+0000","last_undegraded":"2024-09-17T05:35:46.779540+0000","last_fullsized":"2024-09-17T05:35:46.779540+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:10.446246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.312194+0000","last_change":"2024-09-17T05:35:45.329776+0000","last_active":"2024-09-17T05:35:46.312194+0000","last_peered":"2024-09-17T05:35:46.312194+0000","last_clean":"2024-09-17T05:35:46.312194+0000","last_became_active":"2024-09-17T05:35:45.329511+0000","last_became_peered":"2024-09-17T05:35:45.329511+0000","last_unstale":"2024-09-17T05:35:46.312194+0000","last_undegraded":"2024-09-17T05:35:46.312194+0000","last_fullsized":"2024-09-17T05:35:46.312194+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:26.408374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.779948+0000","last_change":"2024-09-17T05:35:45.322115+0000","last_active":"2024-09-17T05:35:46.779948+0000","last_peered":"2024-09-17T05:35:46.779948+0000","last_clean":"2024-09-17T05:35:46.779948+0000","last_became_active":"2024-09-17T05:35:45.321842+0000","last_became_peered":"2024-09-17T05:35:45.321842+0000","last_unstale":"2024-09-17T05:35:46.779948+0000","last_undegraded":"2024-09-17T05:35:46.779948+0000","last_fullsized":"2024-09-17T05:35:46.779948+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:53.688877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.311995+0000","last_change":"2024-09-17T05:35:45.334012+0000","last_active":"2024-09-17T05:35:46.311995+0000","last_peered":"2024-09-17T05:35:46.311995+0000","last_clean":"2024-09-17T05:35:46.311995+0000","last_became_active":"2024-09-17T05:35:45.333739+0000","last_became_peered":"2024-09-17T05:35:45.333739+0000","last_unstale":"2024-09-17T05:35:46.311995+0000","last_undegraded":"2024-09-17T05:35:46.311995+0000","last_fullsized":"2024-09-17T05:35:46.311995+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:28.463776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316538+0000","last_change":"2024-09-17T05:35:45.332037+0000","last_active":"2024-09-17T05:35:46.316538+0000","last_peered":"2024-09-17T05:35:46.316538+0000","last_clean":"2024-09-17T05:35:46.316538+0000","last_became_active":"2024-09-17T05:35:45.331067+0000","last_became_peered":"2024-09-17T05:35:45.331067+0000","last_unstale":"2024-09-17T05:35:46.316538+0000","last_undegraded":"2024-09-17T05:35:46.316538+0000","last_fullsized":"2024-09-17T05:35:46.316538+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:20.890078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.311673+0000","last_change":"2024-09-17T05:35:45.322911+0000","last_active":"2024-09-17T05:35:46.311673+0000","last_peered":"2024-09-17T05:35:46.311673+0000","last_clean":"2024-09-17T05:35:46.311673+0000","last_became_active":"2024-09-17T05:35:45.322179+0000","last_became_peered":"2024-09-17T05:35:45.322179+0000","last_unstale":"2024-09-17T05:35:46.311673+0000","last_undegraded":"2024-09-17T05:35:46.311673+0000","last_fullsized":"2024-09-17T05:35:46.311673+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:33.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317119+0000","last_change":"2024-09-17T05:35:45.338887+0000","last_active":"2024-09-17T05:35:46.317119+0000","last_peered":"2024-09-17T05:35:46.317119+0000","last_clean":"2024-09-17T05:35:46.317119+0000","last_became_active":"2024-09-17T05:35:45.338068+0000","last_became_peered":"2024-09-17T05:35:45.338068+0000","last_unstale":"2024-09-17T05:35:46.317119+0000","last_undegraded":"2024-09-17T05:35:46.317119+0000","last_fullsized":"2024-09-17T05:35:46.317119+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:00.845061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.311503+0000","last_change":"2024-09-17T05:35:45.327967+0000","last_active":"2024-09-17T05:35:46.311503+0000","last_peered":"2024-09-17T05:35:46.311503+0000","last_clean":"2024-09-17T05:35:46.311503+0000","last_became_active":"2024-09-17T05:35:45.327633+0000","last_became_peered":"2024-09-17T05:35:45.327633+0000","last_unstale":"2024-09-17T05:35:46.311503+0000","last_undegraded":"2024-09-17T05:35:46.311503+0000","last_fullsized":"2024-09-17T05:35:46.311503+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:54.050919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316625+0000","last_change":"2024-09-17T05:35:45.332854+0000","last_active":"2024-09-17T05:35:46.316625+0000","last_peered":"2024-09-17T05:35:46.316625+0000","last_clean":"2024-09-17T05:35:46.316625+0000","last_became_active":"2024-09-17T05:35:45.332566+0000","last_became_peered":"2024-09-17T05:35:45.332566+0000","last_unstale":"2024-09-17T05:35:46.316625+0000","last_undegraded":"2024-09-17T05:35:46.316625+0000","last_fullsized":"2024-09-17T05:35:46.316625+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:59.592008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.318037+0000","last_change":"2024-09-17T05:35:45.325495+0000","last_active":"2024-09-17T05:35:46.318037+0000","last_peered":"2024-09-17T05:35:46.318037+0000","last_clean":"2024-09-17T05:35:46.318037+0000","last_became_active":"2024-09-17T05:35:45.324473+0000","last_became_peered":"2024-09-17T05:35:45.324473+0000","last_unstale":"2024-09-17T05:35:46.318037+0000","last_undegraded":"2024-09-17T05:35:46.318037+0000","last_fullsized":"2024-09-17T05:35:46.318037+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:47.402566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780680+0000","last_change":"2024-09-17T05:35:45.341755+0000","last_active":"2024-09-17T05:35:46.780680+0000","last_peered":"2024-09-17T05:35:46.780680+0000","last_clean":"2024-09-17T05:35:46.780680+0000","last_became_active":"2024-09-17T05:35:45.341182+0000","last_became_peered":"2024-09-17T05:35:45.341182+0000","last_unstale":"2024-09-17T05:35:46.780680+0000","last_undegraded":"2024-09-17T05:35:46.780680+0000","last_fullsized":"2024-09-17T05:35:46.780680+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:12.763256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317508+0000","last_change":"2024-09-17T05:35:45.333206+0000","last_active":"2024-09-17T05:35:46.317508+0000","last_peered":"2024-09-17T05:35:46.317508+0000","last_clean":"2024-09-17T05:35:46.317508+0000","last_became_active":"2024-09-17T05:35:45.332266+0000","last_became_peered":"2024-09-17T05:35:45.332266+0000","last_unstale":"2024-09-17T05:35:46.317508+0000","last_undegraded":"2024-09-17T05:35:46.317508+0000","last_fullsized":"2024-09-17T05:35:46.317508+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:36.229321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781003+0000","last_change":"2024-09-17T05:35:45.336910+0000","last_active":"2024-09-17T05:35:46.781003+0000","last_peered":"2024-09-17T05:35:46.781003+0000","last_clean":"2024-09-17T05:35:46.781003+0000","last_became_active":"2024-09-17T05:35:45.336544+0000","last_became_peered":"2024-09-17T05:35:45.336544+0000","last_unstale":"2024-09-17T05:35:46.781003+0000","last_undegraded":"2024-09-17T05:35:46.781003+0000","last_fullsized":"2024-09-17T05:35:46.781003+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:07.867724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316804+0000","last_change":"2024-09-17T05:35:45.340730+0000","last_active":"2024-09-17T05:35:46.316804+0000","last_peered":"2024-09-17T05:35:46.316804+0000","last_clean":"2024-09-17T05:35:46.316804+0000","last_became_active":"2024-09-17T05:35:45.340429+0000","last_became_peered":"2024-09-17T05:35:45.340429+0000","last_unstale":"2024-09-17T05:35:46.316804+0000","last_undegraded":"2024-09-17T05:35:46.316804+0000","last_fullsized":"2024-09-17T05:35:46.316804+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:06.101772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.336053+0000","last_change":"2024-09-17T05:35:45.331949+0000","last_active":"2024-09-17T05:35:46.336053+0000","last_peered":"2024-09-17T05:35:46.336053+0000","last_clean":"2024-09-17T05:35:46.336053+0000","last_became_active":"2024-09-17T05:35:45.331681+0000","last_became_peered":"2024-09-17T05:35:45.331681+0000","last_unstale":"2024-09-17T05:35:46.336053+0000","last_undegraded":"2024-09-17T05:35:46.336053+0000","last_fullsized":"2024-09-17T05:35:46.336053+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:31.627238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.335886+0000","last_change":"2024-09-17T05:35:45.336860+0000","last_active":"2024-09-17T05:35:46.335886+0000","last_peered":"2024-09-17T05:35:46.335886+0000","last_clean":"2024-09-17T05:35:46.335886+0000","last_became_active":"2024-09-17T05:35:45.336449+0000","last_became_peered":"2024-09-17T05:35:45.336449+0000","last_unstale":"2024-09-17T05:35:46.335886+0000","last_undegraded":"2024-09-17T05:35:46.335886+0000","last_fullsized":"2024-09-17T05:35:46.335886+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:33.067923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780405+0000","last_change":"2024-09-17T05:35:45.320664+0000","last_active":"2024-09-17T05:35:46.780405+0000","last_peered":"2024-09-17T05:35:46.780405+0000","last_clean":"2024-09-17T05:35:46.780405+0000","last_became_active":"2024-09-17T05:35:45.318545+0000","last_became_peered":"2024-09-17T05:35:45.318545+0000","last_unstale":"2024-09-17T05:35:46.780405+0000","last_undegraded":"2024-09-17T05:35:46.780405+0000","last_fullsized":"2024-09-17T05:35:46.780405+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:35.802241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780688+0000","last_change":"2024-09-17T05:35:45.341470+0000","last_active":"2024-09-17T05:35:46.780688+0000","last_peered":"2024-09-17T05:35:46.780688+0000","last_clean":"2024-09-17T05:35:46.780688+0000","last_became_active":"2024-09-17T05:35:45.340828+0000","last_became_peered":"2024-09-17T05:35:45.340828+0000","last_unstale":"2024-09-17T05:35:46.780688+0000","last_undegraded":"2024-09-17T05:35:46.780688+0000","last_fullsized":"2024-09-17T05:35:46.780688+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:12.757520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"140'4","reported_seq":19,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.783628+0000","last_change":"2024-09-17T05:35:44.314155+0000","last_active":"2024-09-17T05:35:46.783628+0000","last_peered":"2024-09-17T05:35:46.783628+0000","last_clean":"2024-09-17T05:35:46.783628+0000","last_became_active":"2024-09-17T05:35:44.313845+0000","last_became_peered":"2024-09-17T05:35:44.313845+0000","last_unstale":"2024-09-17T05:35:46.783628+0000","last_undegraded":"2024-09-17T05:35:46.783628+0000","last_fullsized":"2024-09-17T05:35:46.783628+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:04.497447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.336460+0000","last_change":"2024-09-17T05:35:45.325056+0000","last_active":"2024-09-17T05:35:46.336460+0000","last_peered":"2024-09-17T05:35:46.336460+0000","last_clean":"2024-09-17T05:35:46.336460+0000","last_became_active":"2024-09-17T05:35:45.323822+0000","last_became_peered":"2024-09-17T05:35:45.323822+0000","last_unstale":"2024-09-17T05:35:46.336460+0000","last_undegraded":"2024-09-17T05:35:46.336460+0000","last_fullsized":"2024-09-17T05:35:46.336460+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:49.509786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.336195+0000","last_change":"2024-09-17T05:35:44.311779+0000","last_active":"2024-09-17T05:35:46.336195+0000","last_peered":"2024-09-17T05:35:46.336195+0000","last_clean":"2024-09-17T05:35:46.336195+0000","last_became_active":"2024-09-17T05:35:44.311473+0000","last_became_peered":"2024-09-17T05:35:44.311473+0000","last_unstale":"2024-09-17T05:35:46.336195+0000","last_undegraded":"2024-09-17T05:35:46.336195+0000","last_fullsized":"2024-09-17T05:35:46.336195+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:08.889206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.311936+0000","last_change":"2024-09-17T05:35:45.337870+0000","last_active":"2024-09-17T05:35:46.311936+0000","last_peered":"2024-09-17T05:35:46.311936+0000","last_clean":"2024-09-17T05:35:46.311936+0000","last_became_active":"2024-09-17T05:35:45.336928+0000","last_became_peered":"2024-09-17T05:35:45.336928+0000","last_unstale":"2024-09-17T05:35:46.311936+0000","last_undegraded":"2024-09-17T05:35:46.311936+0000","last_fullsized":"2024-09-17T05:35:46.311936+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:49.248788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781248+0000","last_change":"2024-09-17T05:35:44.307713+0000","last_active":"2024-09-17T05:35:46.781248+0000","last_peered":"2024-09-17T05:35:46.781248+0000","last_clean":"2024-09-17T05:35:46.781248+0000","last_became_active":"2024-09-17T05:35:44.307341+0000","last_became_peered":"2024-09-17T05:35:44.307341+0000","last_unstale":"2024-09-17T05:35:46.781248+0000","last_undegraded":"2024-09-17T05:35:46.781248+0000","last_fullsized":"2024-09-17T05:35:46.781248+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:16.622166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317718+0000","last_change":"2024-09-17T05:35:45.324808+0000","last_active":"2024-09-17T05:35:46.317718+0000","last_peered":"2024-09-17T05:35:46.317718+0000","last_clean":"2024-09-17T05:35:46.317718+0000","last_became_active":"2024-09-17T05:35:45.324465+0000","last_became_peered":"2024-09-17T05:35:45.324465+0000","last_unstale":"2024-09-17T05:35:46.317718+0000","last_undegraded":"2024-09-17T05:35:46.317718+0000","last_fullsized":"2024-09-17T05:35:46.317718+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:07.235760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781079+0000","last_change":"2024-09-17T05:35:44.308378+0000","last_active":"2024-09-17T05:35:46.781079+0000","last_peered":"2024-09-17T05:35:46.781079+0000","last_clean":"2024-09-17T05:35:46.781079+0000","last_became_active":"2024-09-17T05:35:44.306892+0000","last_became_peered":"2024-09-17T05:35:44.306892+0000","last_unstale":"2024-09-17T05:35:46.781079+0000","last_undegraded":"2024-09-17T05:35:46.781079+0000","last_fullsized":"2024-09-17T05:35:46.781079+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:42.028663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780623+0000","last_change":"2024-09-17T05:35:45.331474+0000","last_active":"2024-09-17T05:35:46.780623+0000","last_peered":"2024-09-17T05:35:46.780623+0000","last_clean":"2024-09-17T05:35:46.780623+0000","last_became_active":"2024-09-17T05:35:45.326003+0000","last_became_peered":"2024-09-17T05:35:45.326003+0000","last_unstale":"2024-09-17T05:35:46.780623+0000","last_undegraded":"2024-09-17T05:35:46.780623+0000","last_fullsized":"2024-09-17T05:35:46.780623+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:27:17.278770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316721+0000","last_change":"2024-09-17T05:35:44.303901+0000","last_active":"2024-09-17T05:35:46.316721+0000","last_peered":"2024-09-17T05:35:46.316721+0000","last_clean":"2024-09-17T05:35:46.316721+0000","last_became_active":"2024-09-17T05:35:44.302940+0000","last_became_peered":"2024-09-17T05:35:44.302940+0000","last_unstale":"2024-09-17T05:35:46.316721+0000","last_undegraded":"2024-09-17T05:35:46.316721+0000","last_fullsized":"2024-09-17T05:35:46.316721+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:51.213562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780963+0000","last_change":"2024-09-17T05:35:45.335344+0000","last_active":"2024-09-17T05:35:46.780963+0000","last_peered":"2024-09-17T05:35:46.780963+0000","last_clean":"2024-09-17T05:35:46.780963+0000","last_became_active":"2024-09-17T05:35:45.334976+0000","last_became_peered":"2024-09-17T05:35:45.334976+0000","last_unstale":"2024-09-17T05:35:46.780963+0000","last_undegraded":"2024-09-17T05:35:46.780963+0000","last_fullsized":"2024-09-17T05:35:46.780963+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:05.094169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781139+0000","last_change":"2024-09-17T05:35:44.307184+0000","last_active":"2024-09-17T05:35:46.781139+0000","last_peered":"2024-09-17T05:35:46.781139+0000","last_clean":"2024-09-17T05:35:46.781139+0000","last_became_active":"2024-09-17T05:35:44.306857+0000","last_became_peered":"2024-09-17T05:35:44.306857+0000","last_unstale":"2024-09-17T05:35:46.781139+0000","last_undegraded":"2024-09-17T05:35:46.781139+0000","last_fullsized":"2024-09-17T05:35:46.781139+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:19.111329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.779532+0000","last_change":"2024-09-17T05:35:45.337237+0000","last_active":"2024-09-17T05:35:46.779532+0000","last_peered":"2024-09-17T05:35:46.779532+0000","last_clean":"2024-09-17T05:35:46.779532+0000","last_became_active":"2024-09-17T05:35:45.336976+0000","last_became_peered":"2024-09-17T05:35:45.336976+0000","last_unstale":"2024-09-17T05:35:46.779532+0000","last_undegraded":"2024-09-17T05:35:46.779532+0000","last_fullsized":"2024-09-17T05:35:46.779532+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:55:40.245072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316469+0000","last_change":"2024-09-17T05:35:44.305304+0000","last_active":"2024-09-17T05:35:46.316469+0000","last_peered":"2024-09-17T05:35:46.316469+0000","last_clean":"2024-09-17T05:35:46.316469+0000","last_became_active":"2024-09-17T05:35:44.304781+0000","last_became_peered":"2024-09-17T05:35:44.304781+0000","last_unstale":"2024-09-17T05:35:46.316469+0000","last_undegraded":"2024-09-17T05:35:46.316469+0000","last_fullsized":"2024-09-17T05:35:46.316469+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:16.939371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.311519+0000","last_change":"2024-09-17T05:35:45.333529+0000","last_active":"2024-09-17T05:35:46.311519+0000","last_peered":"2024-09-17T05:35:46.311519+0000","last_clean":"2024-09-17T05:35:46.311519+0000","last_became_active":"2024-09-17T05:35:45.333209+0000","last_became_peered":"2024-09-17T05:35:45.333209+0000","last_unstale":"2024-09-17T05:35:46.311519+0000","last_undegraded":"2024-09-17T05:35:46.311519+0000","last_fullsized":"2024-09-17T05:35:46.311519+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:34.134583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780313+0000","last_change":"2024-09-17T05:35:44.304051+0000","last_active":"2024-09-17T05:35:46.780313+0000","last_peered":"2024-09-17T05:35:46.780313+0000","last_clean":"2024-09-17T05:35:46.780313+0000","last_became_active":"2024-09-17T05:35:44.302042+0000","last_became_peered":"2024-09-17T05:35:44.302042+0000","last_unstale":"2024-09-17T05:35:46.780313+0000","last_undegraded":"2024-09-17T05:35:46.780313+0000","last_fullsized":"2024-09-17T05:35:46.780313+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:49:22.965103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780855+0000","last_change":"2024-09-17T05:35:45.338574+0000","last_active":"2024-09-17T05:35:46.780855+0000","last_peered":"2024-09-17T05:35:46.780855+0000","last_clean":"2024-09-17T05:35:46.780855+0000","last_became_active":"2024-09-17T05:35:45.338308+0000","last_became_peered":"2024-09-17T05:35:45.338308+0000","last_unstale":"2024-09-17T05:35:46.780855+0000","last_undegraded":"2024-09-17T05:35:46.780855+0000","last_fullsized":"2024-09-17T05:35:46.780855+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:43.557187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.312072+0000","last_change":"2024-09-17T05:35:44.299072+0000","last_active":"2024-09-17T05:35:46.312072+0000","last_peered":"2024-09-17T05:35:46.312072+0000","last_clean":"2024-09-17T05:35:46.312072+0000","last_became_active":"2024-09-17T05:35:44.298707+0000","last_became_peered":"2024-09-17T05:35:44.298707+0000","last_unstale":"2024-09-17T05:35:46.312072+0000","last_undegraded":"2024-09-17T05:35:46.312072+0000","last_fullsized":"2024-09-17T05:35:46.312072+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:50.790162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780188+0000","last_change":"2024-09-17T05:35:45.337464+0000","last_active":"2024-09-17T05:35:46.780188+0000","last_peered":"2024-09-17T05:35:46.780188+0000","last_clean":"2024-09-17T05:35:46.780188+0000","last_became_active":"2024-09-17T05:35:45.337159+0000","last_became_peered":"2024-09-17T05:35:45.337159+0000","last_unstale":"2024-09-17T05:35:46.780188+0000","last_undegraded":"2024-09-17T05:35:46.780188+0000","last_fullsized":"2024-09-17T05:35:46.780188+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:16:42.376147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"140'3","reported_seq":18,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.311924+0000","last_change":"2024-09-17T05:35:44.302439+0000","last_active":"2024-09-17T05:35:46.311924+0000","last_peered":"2024-09-17T05:35:46.311924+0000","last_clean":"2024-09-17T05:35:46.311924+0000","last_became_active":"2024-09-17T05:35:44.298979+0000","last_became_peered":"2024-09-17T05:35:44.298979+0000","last_unstale":"2024-09-17T05:35:46.311924+0000","last_undegraded":"2024-09-17T05:35:46.311924+0000","last_fullsized":"2024-09-17T05:35:46.311924+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:53:03.650178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.336499+0000","last_change":"2024-09-17T05:35:45.326264+0000","last_active":"2024-09-17T05:35:46.336499+0000","last_peered":"2024-09-17T05:35:46.336499+0000","last_clean":"2024-09-17T05:35:46.336499+0000","last_became_active":"2024-09-17T05:35:45.325688+0000","last_became_peered":"2024-09-17T05:35:45.325688+0000","last_unstale":"2024-09-17T05:35:46.336499+0000","last_undegraded":"2024-09-17T05:35:46.336499+0000","last_fullsized":"2024-09-17T05:35:46.336499+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:03.503439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"140'6","reported_seq":21,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.335843+0000","last_change":"2024-09-17T05:35:44.307907+0000","last_active":"2024-09-17T05:35:46.335843+0000","last_peered":"2024-09-17T05:35:46.335843+0000","last_clean":"2024-09-17T05:35:46.335843+0000","last_became_active":"2024-09-17T05:35:44.307622+0000","last_became_peered":"2024-09-17T05:35:44.307622+0000","last_unstale":"2024-09-17T05:35:46.335843+0000","last_undegraded":"2024-09-17T05:35:46.335843+0000","last_fullsized":"2024-09-17T05:35:46.335843+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:15.572382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780022+0000","last_change":"2024-09-17T05:35:45.328738+0000","last_active":"2024-09-17T05:35:46.780022+0000","last_peered":"2024-09-17T05:35:46.780022+0000","last_clean":"2024-09-17T05:35:46.780022+0000","last_became_active":"2024-09-17T05:35:45.328386+0000","last_became_peered":"2024-09-17T05:35:45.328386+0000","last_unstale":"2024-09-17T05:35:46.780022+0000","last_undegraded":"2024-09-17T05:35:46.780022+0000","last_fullsized":"2024-09-17T05:35:46.780022+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:27.178443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781041+0000","last_change":"2024-09-17T05:35:44.309052+0000","last_active":"2024-09-17T05:35:46.781041+0000","last_peered":"2024-09-17T05:35:46.781041+0000","last_clean":"2024-09-17T05:35:46.781041+0000","last_became_active":"2024-09-17T05:35:44.308755+0000","last_became_peered":"2024-09-17T05:35:44.308755+0000","last_unstale":"2024-09-17T05:35:46.781041+0000","last_undegraded":"2024-09-17T05:35:46.781041+0000","last_fullsized":"2024-09-17T05:35:46.781041+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:41:59.574683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780421+0000","last_change":"2024-09-17T05:35:45.333236+0000","last_active":"2024-09-17T05:35:46.780421+0000","last_peered":"2024-09-17T05:35:46.780421+0000","last_clean":"2024-09-17T05:35:46.780421+0000","last_became_active":"2024-09-17T05:35:45.332961+0000","last_became_peered":"2024-09-17T05:35:45.332961+0000","last_unstale":"2024-09-17T05:35:46.780421+0000","last_undegraded":"2024-09-17T05:35:46.780421+0000","last_fullsized":"2024-09-17T05:35:46.780421+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:49.897722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780089+0000","last_change":"2024-09-17T05:35:44.308582+0000","last_active":"2024-09-17T05:35:46.780089+0000","last_peered":"2024-09-17T05:35:46.780089+0000","last_clean":"2024-09-17T05:35:46.780089+0000","last_became_active":"2024-09-17T05:35:44.308166+0000","last_became_peered":"2024-09-17T05:35:44.308166+0000","last_unstale":"2024-09-17T05:35:46.780089+0000","last_undegraded":"2024-09-17T05:35:46.780089+0000","last_fullsized":"2024-09-17T05:35:46.780089+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:54:09.312003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.779656+0000","last_change":"2024-09-17T05:35:45.331760+0000","last_active":"2024-09-17T05:35:46.779656+0000","last_peered":"2024-09-17T05:35:46.779656+0000","last_clean":"2024-09-17T05:35:46.779656+0000","last_became_active":"2024-09-17T05:35:45.331423+0000","last_became_peered":"2024-09-17T05:35:45.331423+0000","last_unstale":"2024-09-17T05:35:46.779656+0000","last_undegraded":"2024-09-17T05:35:46.779656+0000","last_fullsized":"2024-09-17T05:35:46.779656+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:11.781120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780954+0000","last_change":"2024-09-17T05:35:44.309028+0000","last_active":"2024-09-17T05:35:46.780954+0000","last_peered":"2024-09-17T05:35:46.780954+0000","last_clean":"2024-09-17T05:35:46.780954+0000","last_became_active":"2024-09-17T05:35:44.308628+0000","last_became_peered":"2024-09-17T05:35:44.308628+0000","last_unstale":"2024-09-17T05:35:46.780954+0000","last_undegraded":"2024-09-17T05:35:46.780954+0000","last_fullsized":"2024-09-17T05:35:46.780954+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:26.409177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316532+0000","last_change":"2024-09-17T05:35:45.337987+0000","last_active":"2024-09-17T05:35:46.316532+0000","last_peered":"2024-09-17T05:35:46.316532+0000","last_clean":"2024-09-17T05:35:46.316532+0000","last_became_active":"2024-09-17T05:35:45.337704+0000","last_became_peered":"2024-09-17T05:35:45.337704+0000","last_unstale":"2024-09-17T05:35:46.316532+0000","last_undegraded":"2024-09-17T05:35:46.316532+0000","last_fullsized":"2024-09-17T05:35:46.316532+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:57.203501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"140'8","reported_seq":23,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.335642+0000","last_change":"2024-09-17T05:35:44.308157+0000","last_active":"2024-09-17T05:35:46.335642+0000","last_peered":"2024-09-17T05:35:46.335642+0000","last_clean":"2024-09-17T05:35:46.335642+0000","last_became_active":"2024-09-17T05:35:44.307361+0000","last_became_peered":"2024-09-17T05:35:44.307361+0000","last_unstale":"2024-09-17T05:35:46.335642+0000","last_undegraded":"2024-09-17T05:35:46.335642+0000","last_fullsized":"2024-09-17T05:35:46.335642+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:13.397542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781513+0000","last_change":"2024-09-17T05:35:45.336564+0000","last_active":"2024-09-17T05:35:46.781513+0000","last_peered":"2024-09-17T05:35:46.781513+0000","last_clean":"2024-09-17T05:35:46.781513+0000","last_became_active":"2024-09-17T05:35:45.335760+0000","last_became_peered":"2024-09-17T05:35:45.335760+0000","last_unstale":"2024-09-17T05:35:46.781513+0000","last_undegraded":"2024-09-17T05:35:46.781513+0000","last_fullsized":"2024-09-17T05:35:46.781513+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:00.845061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317995+0000","last_change":"2024-09-17T05:35:44.310973+0000","last_active":"2024-09-17T05:35:46.317995+0000","last_peered":"2024-09-17T05:35:46.317995+0000","last_clean":"2024-09-17T05:35:46.317995+0000","last_became_active":"2024-09-17T05:35:44.310646+0000","last_became_peered":"2024-09-17T05:35:44.310646+0000","last_unstale":"2024-09-17T05:35:46.317995+0000","last_undegraded":"2024-09-17T05:35:46.317995+0000","last_fullsized":"2024-09-17T05:35:46.317995+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:48.849773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781043+0000","last_change":"2024-09-17T05:35:45.316118+0000","last_active":"2024-09-17T05:35:46.781043+0000","last_peered":"2024-09-17T05:35:46.781043+0000","last_clean":"2024-09-17T05:35:46.781043+0000","last_became_active":"2024-09-17T05:35:45.315825+0000","last_became_peered":"2024-09-17T05:35:45.315825+0000","last_unstale":"2024-09-17T05:35:46.781043+0000","last_undegraded":"2024-09-17T05:35:46.781043+0000","last_fullsized":"2024-09-17T05:35:46.781043+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:08.157784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317350+0000","last_change":"2024-09-17T05:35:44.308978+0000","last_active":"2024-09-17T05:35:46.317350+0000","last_peered":"2024-09-17T05:35:46.317350+0000","last_clean":"2024-09-17T05:35:46.317350+0000","last_became_active":"2024-09-17T05:35:44.308579+0000","last_became_peered":"2024-09-17T05:35:44.308579+0000","last_unstale":"2024-09-17T05:35:46.317350+0000","last_undegraded":"2024-09-17T05:35:46.317350+0000","last_fullsized":"2024-09-17T05:35:46.317350+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:58.812502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781206+0000","last_change":"2024-09-17T05:35:45.335350+0000","last_active":"2024-09-17T05:35:46.781206+0000","last_peered":"2024-09-17T05:35:46.781206+0000","last_clean":"2024-09-17T05:35:46.781206+0000","last_became_active":"2024-09-17T05:35:45.335052+0000","last_became_peered":"2024-09-17T05:35:45.335052+0000","last_unstale":"2024-09-17T05:35:46.781206+0000","last_undegraded":"2024-09-17T05:35:46.781206+0000","last_fullsized":"2024-09-17T05:35:46.781206+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:53.594978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"140'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.783641+0000","last_change":"2024-09-17T05:35:44.310086+0000","last_active":"2024-09-17T05:35:46.783641+0000","last_peered":"2024-09-17T05:35:46.783641+0000","last_clean":"2024-09-17T05:35:46.783641+0000","last_became_active":"2024-09-17T05:35:44.309790+0000","last_became_peered":"2024-09-17T05:35:44.309790+0000","last_unstale":"2024-09-17T05:35:46.783641+0000","last_undegraded":"2024-09-17T05:35:46.783641+0000","last_fullsized":"2024-09-17T05:35:46.783641+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:04.884790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781382+0000","last_change":"2024-09-17T05:35:45.334079+0000","last_active":"2024-09-17T05:35:46.781382+0000","last_peered":"2024-09-17T05:35:46.781382+0000","last_clean":"2024-09-17T05:35:46.781382+0000","last_became_active":"2024-09-17T05:35:45.326733+0000","last_became_peered":"2024-09-17T05:35:45.326733+0000","last_unstale":"2024-09-17T05:35:46.781382+0000","last_undegraded":"2024-09-17T05:35:46.781382+0000","last_fullsized":"2024-09-17T05:35:46.781382+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:51.846153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.783837+0000","last_change":"2024-09-17T05:35:44.312651+0000","last_active":"2024-09-17T05:35:46.783837+0000","last_peered":"2024-09-17T05:35:46.783837+0000","last_clean":"2024-09-17T05:35:46.783837+0000","last_became_active":"2024-09-17T05:35:44.312394+0000","last_became_peered":"2024-09-17T05:35:44.312394+0000","last_unstale":"2024-09-17T05:35:46.783837+0000","last_undegraded":"2024-09-17T05:35:46.783837+0000","last_fullsized":"2024-09-17T05:35:46.783837+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:47.934108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316624+0000","last_change":"2024-09-17T05:35:45.328659+0000","last_active":"2024-09-17T05:35:46.316624+0000","last_peered":"2024-09-17T05:35:46.316624+0000","last_clean":"2024-09-17T05:35:46.316624+0000","last_became_active":"2024-09-17T05:35:45.328369+0000","last_became_peered":"2024-09-17T05:35:45.328369+0000","last_unstale":"2024-09-17T05:35:46.316624+0000","last_undegraded":"2024-09-17T05:35:46.316624+0000","last_fullsized":"2024-09-17T05:35:46.316624+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:57.219344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781293+0000","last_change":"2024-09-17T05:35:44.308672+0000","last_active":"2024-09-17T05:35:46.781293+0000","last_peered":"2024-09-17T05:35:46.781293+0000","last_clean":"2024-09-17T05:35:46.781293+0000","last_became_active":"2024-09-17T05:35:44.307232+0000","last_became_peered":"2024-09-17T05:35:44.307232+0000","last_unstale":"2024-09-17T05:35:46.781293+0000","last_undegraded":"2024-09-17T05:35:46.781293+0000","last_fullsized":"2024-09-17T05:35:46.781293+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:59.007736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780594+0000","last_change":"2024-09-17T05:35:45.334092+0000","last_active":"2024-09-17T05:35:46.780594+0000","last_peered":"2024-09-17T05:35:46.780594+0000","last_clean":"2024-09-17T05:35:46.780594+0000","last_became_active":"2024-09-17T05:35:45.332706+0000","last_became_peered":"2024-09-17T05:35:45.332706+0000","last_unstale":"2024-09-17T05:35:46.780594+0000","last_undegraded":"2024-09-17T05:35:46.780594+0000","last_fullsized":"2024-09-17T05:35:46.780594+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:03:45.782297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.783330+0000","last_change":"2024-09-17T05:35:44.310781+0000","last_active":"2024-09-17T05:35:46.783330+0000","last_peered":"2024-09-17T05:35:46.783330+0000","last_clean":"2024-09-17T05:35:46.783330+0000","last_became_active":"2024-09-17T05:35:44.310430+0000","last_became_peered":"2024-09-17T05:35:44.310430+0000","last_unstale":"2024-09-17T05:35:46.783330+0000","last_undegraded":"2024-09-17T05:35:46.783330+0000","last_fullsized":"2024-09-17T05:35:46.783330+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:20.182494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.783633+0000","last_change":"2024-09-17T05:35:45.340200+0000","last_active":"2024-09-17T05:35:46.783633+0000","last_peered":"2024-09-17T05:35:46.783633+0000","last_clean":"2024-09-17T05:35:46.783633+0000","last_became_active":"2024-09-17T05:35:45.339916+0000","last_became_peered":"2024-09-17T05:35:45.339916+0000","last_unstale":"2024-09-17T05:35:46.783633+0000","last_undegraded":"2024-09-17T05:35:46.783633+0000","last_fullsized":"2024-09-17T05:35:46.783633+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:16.503597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781075+0000","last_change":"2024-09-17T05:35:44.300697+0000","last_active":"2024-09-17T05:35:46.781075+0000","last_peered":"2024-09-17T05:35:46.781075+0000","last_clean":"2024-09-17T05:35:46.781075+0000","last_became_active":"2024-09-17T05:35:44.300414+0000","last_became_peered":"2024-09-17T05:35:44.300414+0000","last_unstale":"2024-09-17T05:35:46.781075+0000","last_undegraded":"2024-09-17T05:35:46.781075+0000","last_fullsized":"2024-09-17T05:35:46.781075+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:46.478281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.311685+0000","last_change":"2024-09-17T05:35:45.328714+0000","last_active":"2024-09-17T05:35:46.311685+0000","last_peered":"2024-09-17T05:35:46.311685+0000","last_clean":"2024-09-17T05:35:46.311685+0000","last_became_active":"2024-09-17T05:35:45.328430+0000","last_became_peered":"2024-09-17T05:35:45.328430+0000","last_unstale":"2024-09-17T05:35:46.311685+0000","last_undegraded":"2024-09-17T05:35:46.311685+0000","last_fullsized":"2024-09-17T05:35:46.311685+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:28.872190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.783433+0000","last_change":"2024-09-17T05:35:44.314421+0000","last_active":"2024-09-17T05:35:46.783433+0000","last_peered":"2024-09-17T05:35:46.783433+0000","last_clean":"2024-09-17T05:35:46.783433+0000","last_became_active":"2024-09-17T05:35:44.314134+0000","last_became_peered":"2024-09-17T05:35:44.314134+0000","last_unstale":"2024-09-17T05:35:46.783433+0000","last_undegraded":"2024-09-17T05:35:46.783433+0000","last_fullsized":"2024-09-17T05:35:46.783433+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:40.509738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780344+0000","last_change":"2024-09-17T05:35:45.337543+0000","last_active":"2024-09-17T05:35:46.780344+0000","last_peered":"2024-09-17T05:35:46.780344+0000","last_clean":"2024-09-17T05:35:46.780344+0000","last_became_active":"2024-09-17T05:35:45.337244+0000","last_became_peered":"2024-09-17T05:35:45.337244+0000","last_unstale":"2024-09-17T05:35:46.780344+0000","last_undegraded":"2024-09-17T05:35:46.780344+0000","last_fullsized":"2024-09-17T05:35:46.780344+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:07:53.215614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"140'2","reported_seq":17,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781102+0000","last_change":"2024-09-17T05:35:44.306250+0000","last_active":"2024-09-17T05:35:46.781102+0000","last_peered":"2024-09-17T05:35:46.781102+0000","last_clean":"2024-09-17T05:35:46.781102+0000","last_became_active":"2024-09-17T05:35:44.305636+0000","last_became_peered":"2024-09-17T05:35:44.305636+0000","last_unstale":"2024-09-17T05:35:46.781102+0000","last_undegraded":"2024-09-17T05:35:46.781102+0000","last_fullsized":"2024-09-17T05:35:46.781102+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:00:07.810087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780604+0000","last_change":"2024-09-17T05:35:45.330725+0000","last_active":"2024-09-17T05:35:46.780604+0000","last_peered":"2024-09-17T05:35:46.780604+0000","last_clean":"2024-09-17T05:35:46.780604+0000","last_became_active":"2024-09-17T05:35:45.327179+0000","last_became_peered":"2024-09-17T05:35:45.327179+0000","last_unstale":"2024-09-17T05:35:46.780604+0000","last_undegraded":"2024-09-17T05:35:46.780604+0000","last_fullsized":"2024-09-17T05:35:46.780604+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:52.515512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"141'1","reported_seq":16,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317521+0000","last_change":"2024-09-17T05:35:44.301580+0000","last_active":"2024-09-17T05:35:46.317521+0000","last_peered":"2024-09-17T05:35:46.317521+0000","last_clean":"2024-09-17T05:35:46.317521+0000","last_became_active":"2024-09-17T05:35:44.301269+0000","last_became_peered":"2024-09-17T05:35:44.301269+0000","last_unstale":"2024-09-17T05:35:46.317521+0000","last_undegraded":"2024-09-17T05:35:46.317521+0000","last_fullsized":"2024-09-17T05:35:46.317521+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:04.010362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.311955+0000","last_change":"2024-09-17T05:35:45.342129+0000","last_active":"2024-09-17T05:35:46.311955+0000","last_peered":"2024-09-17T05:35:46.311955+0000","last_clean":"2024-09-17T05:35:46.311955+0000","last_became_active":"2024-09-17T05:35:45.341759+0000","last_became_peered":"2024-09-17T05:35:45.341759+0000","last_unstale":"2024-09-17T05:35:46.311955+0000","last_undegraded":"2024-09-17T05:35:46.311955+0000","last_fullsized":"2024-09-17T05:35:46.311955+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:39.278153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.317781+0000","last_change":"2024-09-17T05:35:44.309641+0000","last_active":"2024-09-17T05:35:46.317781+0000","last_peered":"2024-09-17T05:35:46.317781+0000","last_clean":"2024-09-17T05:35:46.317781+0000","last_became_active":"2024-09-17T05:35:44.309210+0000","last_became_peered":"2024-09-17T05:35:44.309210+0000","last_unstale":"2024-09-17T05:35:46.317781+0000","last_undegraded":"2024-09-17T05:35:46.317781+0000","last_fullsized":"2024-09-17T05:35:46.317781+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:10.865187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780003+0000","last_change":"2024-09-17T05:35:45.329121+0000","last_active":"2024-09-17T05:35:46.780003+0000","last_peered":"2024-09-17T05:35:46.780003+0000","last_clean":"2024-09-17T05:35:46.780003+0000","last_became_active":"2024-09-17T05:35:45.328861+0000","last_became_peered":"2024-09-17T05:35:45.328861+0000","last_unstale":"2024-09-17T05:35:46.780003+0000","last_undegraded":"2024-09-17T05:35:46.780003+0000","last_fullsized":"2024-09-17T05:35:46.780003+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:58.424019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780191+0000","last_change":"2024-09-17T05:35:44.302990+0000","last_active":"2024-09-17T05:35:46.780191+0000","last_peered":"2024-09-17T05:35:46.780191+0000","last_clean":"2024-09-17T05:35:46.780191+0000","last_became_active":"2024-09-17T05:35:44.301120+0000","last_became_peered":"2024-09-17T05:35:44.301120+0000","last_unstale":"2024-09-17T05:35:46.780191+0000","last_undegraded":"2024-09-17T05:35:46.780191+0000","last_fullsized":"2024-09-17T05:35:46.780191+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:23:40.264823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780098+0000","last_change":"2024-09-17T05:35:45.324337+0000","last_active":"2024-09-17T05:35:46.780098+0000","last_peered":"2024-09-17T05:35:46.780098+0000","last_clean":"2024-09-17T05:35:46.780098+0000","last_became_active":"2024-09-17T05:35:45.323989+0000","last_became_peered":"2024-09-17T05:35:45.323989+0000","last_unstale":"2024-09-17T05:35:46.780098+0000","last_undegraded":"2024-09-17T05:35:46.780098+0000","last_fullsized":"2024-09-17T05:35:46.780098+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:11.314592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.335975+0000","last_change":"2024-09-17T05:35:44.311766+0000","last_active":"2024-09-17T05:35:46.335975+0000","last_peered":"2024-09-17T05:35:46.335975+0000","last_clean":"2024-09-17T05:35:46.335975+0000","last_became_active":"2024-09-17T05:35:44.311458+0000","last_became_peered":"2024-09-17T05:35:44.311458+0000","last_unstale":"2024-09-17T05:35:46.335975+0000","last_undegraded":"2024-09-17T05:35:46.335975+0000","last_fullsized":"2024-09-17T05:35:46.335975+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:59.358927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.336071+0000","last_change":"2024-09-17T05:35:45.329879+0000","last_active":"2024-09-17T05:35:46.336071+0000","last_peered":"2024-09-17T05:35:46.336071+0000","last_clean":"2024-09-17T05:35:46.336071+0000","last_became_active":"2024-09-17T05:35:45.329541+0000","last_became_peered":"2024-09-17T05:35:45.329541+0000","last_unstale":"2024-09-17T05:35:46.336071+0000","last_undegraded":"2024-09-17T05:35:46.336071+0000","last_fullsized":"2024-09-17T05:35:46.336071+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:05.214281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.781248+0000","last_change":"2024-09-17T05:35:44.301181+0000","last_active":"2024-09-17T05:35:46.781248+0000","last_peered":"2024-09-17T05:35:46.781248+0000","last_clean":"2024-09-17T05:35:46.781248+0000","last_became_active":"2024-09-17T05:35:44.300894+0000","last_became_peered":"2024-09-17T05:35:44.300894+0000","last_unstale":"2024-09-17T05:35:46.781248+0000","last_undegraded":"2024-09-17T05:35:46.781248+0000","last_fullsized":"2024-09-17T05:35:46.781248+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:29.587165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.779584+0000","last_change":"2024-09-17T05:35:45.342930+0000","last_active":"2024-09-17T05:35:46.779584+0000","last_peered":"2024-09-17T05:35:46.779584+0000","last_clean":"2024-09-17T05:35:46.779584+0000","last_became_active":"2024-09-17T05:35:45.327472+0000","last_became_peered":"2024-09-17T05:35:45.327472+0000","last_unstale":"2024-09-17T05:35:46.779584+0000","last_undegraded":"2024-09-17T05:35:46.779584+0000","last_fullsized":"2024-09-17T05:35:46.779584+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:42.766747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316670+0000","last_change":"2024-09-17T05:35:44.310164+0000","last_active":"2024-09-17T05:35:46.316670+0000","last_peered":"2024-09-17T05:35:46.316670+0000","last_clean":"2024-09-17T05:35:46.316670+0000","last_became_active":"2024-09-17T05:35:44.309713+0000","last_became_peered":"2024-09-17T05:35:44.309713+0000","last_unstale":"2024-09-17T05:35:46.316670+0000","last_undegraded":"2024-09-17T05:35:46.316670+0000","last_fullsized":"2024-09-17T05:35:46.316670+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:46.265593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.316783+0000","last_change":"2024-09-17T05:35:45.324640+0000","last_active":"2024-09-17T05:35:46.316783+0000","last_peered":"2024-09-17T05:35:46.316783+0000","last_clean":"2024-09-17T05:35:46.316783+0000","last_became_active":"2024-09-17T05:35:45.324309+0000","last_became_peered":"2024-09-17T05:35:45.324309+0000","last_unstale":"2024-09-17T05:35:46.316783+0000","last_undegraded":"2024-09-17T05:35:46.316783+0000","last_fullsized":"2024-09-17T05:35:46.316783+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:17.356586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.335807+0000","last_change":"2024-09-17T05:35:44.310901+0000","last_active":"2024-09-17T05:35:46.335807+0000","last_peered":"2024-09-17T05:35:46.335807+0000","last_clean":"2024-09-17T05:35:46.335807+0000","last_became_active":"2024-09-17T05:35:44.307714+0000","last_became_peered":"2024-09-17T05:35:44.307714+0000","last_unstale":"2024-09-17T05:35:46.335807+0000","last_undegraded":"2024-09-17T05:35:46.335807+0000","last_fullsized":"2024-09-17T05:35:46.335807+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:14:33.364916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.780154+0000","last_change":"2024-09-17T05:35:45.337621+0000","last_active":"2024-09-17T05:35:46.780154+0000","last_peered":"2024-09-17T05:35:46.780154+0000","last_clean":"2024-09-17T05:35:46.780154+0000","last_became_active":"2024-09-17T05:35:45.337332+0000","last_became_peered":"2024-09-17T05:35:45.337332+0000","last_unstale":"2024-09-17T05:35:46.780154+0000","last_undegraded":"2024-09-17T05:35:46.780154+0000","last_fullsized":"2024-09-17T05:35:46.780154+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:44.280434+0000","last_clean_scrub_stamp":"2024-09-17T05:35:44.280434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:46.954664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.336335+0000","last_change":"2024-09-17T05:35:44.306383+0000","last_active":"2024-09-17T05:35:46.336335+0000","last_peered":"2024-09-17T05:35:46.336335+0000","last_clean":"2024-09-17T05:35:46.336335+0000","last_became_active":"2024-09-17T05:35:44.306119+0000","last_became_peered":"2024-09-17T05:35:44.306119+0000","last_unstale":"2024-09-17T05:35:46.336335+0000","last_undegraded":"2024-09-17T05:35:46.336335+0000","last_fullsized":"2024-09-17T05:35:46.336335+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:35:43.273561+0000","last_clean_scrub_stamp":"2024-09-17T05:35:43.273561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:03.908053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":359,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-17T05:35:46.783568+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:35:46.783568+0000","last_peered":"2024-09-17T05:35:46.783568+0000","last_clean":"2024-09-17T05:35:46.783568+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:35:46.783568+0000","last_undegraded":"2024-09-17T05:35:46.783568+0000","last_fullsized":"2024-09-17T05:35:46.783568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509530,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33516,"kb_used_data":2328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338324,"statfs":{"total":96636764160,"available":96602443776,"internally_reserved":0,"allocated":2383872,"data_stored":1371356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509531,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1769472,"data_stored":778656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542234,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1773568,"data_stored":779238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509531,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32928,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338912,"statfs":{"total":96636764160,"available":96603045888,"internally_reserved":0,"allocated":1781760,"data_stored":780316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509531,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1769472,"data_stored":778668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509531,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1769472,"data_stored":778724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509529,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1769472,"data_stored":778668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542233,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33492,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338348,"statfs":{"total":96636764160,"available":96602468352,"internally_reserved":0,"allocated":2359296,"data_stored":1369002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:35:49.894 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:35:49.894 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:35:50.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.085+0000 7fc671600640 1 -- 172.21.15.31:0/2249618897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc650004d50 msgr2=0x7fc6500051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:50.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.085+0000 7fc671600640 1 --2- 172.21.15.31:0/2249618897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc650004d50 0x7fc6500051d0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fc664009e30 tx=0x7fc66401d170 comp rx=0 tx=0).stop 2024-09-17T05:35:50.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.085+0000 7fc66b400640 1 -- 172.21.15.31:0/2249618897 reap_dead start 2024-09-17T05:35:50.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.085+0000 7fc671600640 1 -- 172.21.15.31:0/2249618897 shutdown_connections 2024-09-17T05:35:50.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.085+0000 7fc671600640 1 -- 172.21.15.31:0/2249618897 >> 172.21.15.31:0/2249618897 conn(0x7fc66c0cd740 msgr2=0x7fc66c0cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:50.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.085+0000 7fc671600640 1 -- 172.21.15.31:0/2249618897 shutdown_connections 2024-09-17T05:35:50.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.085+0000 7fc671600640 1 -- 172.21.15.31:0/2249618897 wait complete. 2024-09-17T05:35:50.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc671600640 1 Processor -- start 2024-09-17T05:35:50.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc671600640 1 -- start start 2024-09-17T05:35:50.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc671600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc650004d50 0x7fc66c0a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:50.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc671600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc66c0b3af0 0x7fc66c161ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:50.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc671600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc66c0b3f70 0x7fc66c162400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:50.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc671600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c15e770 con 0x7fc66c0b3af0 2024-09-17T05:35:50.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc671600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c15e5f0 con 0x7fc650004d50 2024-09-17T05:35:50.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc671600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc66c15e8f0 con 0x7fc66c0b3f70 2024-09-17T05:35:50.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc663e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc66c0b3af0 0x7fc66c161ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:50.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc66aa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc650004d50 0x7fc66c0a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:50.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc663e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc66c0b3af0 0x7fc66c161ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46476/0 (socket says 172.21.15.31:46476) 2024-09-17T05:35:50.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc663e00640 1 -- 172.21.15.31:0/4091484109 learned_addr learned my addr 172.21.15.31:0/4091484109 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:50.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc66b400640 1 --2- 172.21.15.31:0/4091484109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc66c0b3f70 0x7fc66c162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:50.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc663e00640 1 -- 172.21.15.31:0/4091484109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc66c0b3f70 msgr2=0x7fc66c162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:50.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc663e00640 1 --2- 172.21.15.31:0/4091484109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc66c0b3f70 0x7fc66c162400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:50.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc663e00640 1 -- 172.21.15.31:0/4091484109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc650004d50 msgr2=0x7fc66c0a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:50.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc663e00640 1 --2- 172.21.15.31:0/4091484109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc650004d50 0x7fc66c0a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:50.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc663e00640 1 -- 172.21.15.31:0/4091484109 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66c0cebd0 con 0x7fc66c0b3af0 2024-09-17T05:35:50.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc663e00640 1 --2- 172.21.15.31:0/4091484109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc66c0b3af0 0x7fc66c161ec0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fc654006680 tx=0x7fc6540039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:50.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc662a00640 1 -- 172.21.15.31:0/4091484109 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc654015070 con 0x7fc66c0b3af0 2024-09-17T05:35:50.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc662a00640 1 -- 172.21.15.31:0/4091484109 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc654011900 con 0x7fc66c0b3af0 2024-09-17T05:35:50.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc671600640 1 -- 172.21.15.31:0/4091484109 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66c0ceeb0 con 0x7fc66c0b3af0 2024-09-17T05:35:50.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc662a00640 1 -- 172.21.15.31:0/4091484109 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc654011d50 con 0x7fc66c0b3af0 2024-09-17T05:35:50.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.089+0000 7fc671600640 1 -- 172.21.15.31:0/4091484109 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc66c0a1530 con 0x7fc66c0b3af0 2024-09-17T05:35:50.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.093+0000 7fc671600640 1 -- 172.21.15.31:0/4091484109 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc66c15ee80 con 0x7fc66c0b3af0 2024-09-17T05:35:50.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.093+0000 7fc662a00640 1 -- 172.21.15.31:0/4091484109 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7fc654018070 con 0x7fc66c0b3af0 2024-09-17T05:35:50.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.093+0000 7fc662a00640 1 --2- 172.21.15.31:0/4091484109 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc6480738c0 0x7fc648075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:50.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.093+0000 7fc662a00640 1 -- 172.21.15.31:0/4091484109 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7fc654095be0 con 0x7fc66c0b3af0 2024-09-17T05:35:50.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.093+0000 7fc66aa00640 1 --2- 172.21.15.31:0/4091484109 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc6480738c0 0x7fc648075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:50.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.093+0000 7fc66aa00640 1 --2- 172.21.15.31:0/4091484109 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc6480738c0 0x7fc648075d80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc65c006660 tx=0x7fc65c004110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:50.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.097+0000 7fc662a00640 1 -- 172.21.15.31:0/4091484109 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc66c0cd440 con 0x7fc66c0b3af0 2024-09-17T05:35:50.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.337+0000 7fc671600640 1 -- 172.21.15.31:0/4091484109 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc66c0b0f10 con 0x7fc66c0b3af0 2024-09-17T05:35:50.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.341+0000 7fc662a00640 1 -- 172.21.15.31:0/4091484109 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) ==== 190+0+147 (secure 0 0 0) 0x7fc65405fb40 con 0x7fc66c0b3af0 2024-09-17T05:35:50.342 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-09-17T05:35:50.342 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw== 2024-09-17T05:35:50.342 INFO:teuthology.orchestra.run.smithi031.stdout: caps mds = "allow" 2024-09-17T05:35:50.342 INFO:teuthology.orchestra.run.smithi031.stdout: caps mon = "allow r" 2024-09-17T05:35:50.342 INFO:teuthology.orchestra.run.smithi031.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:35:50.342 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2024-09-17T05:35:50.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.341+0000 7fc671600640 1 -- 172.21.15.31:0/4091484109 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc6480738c0 msgr2=0x7fc648075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:50.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.341+0000 7fc671600640 1 --2- 172.21.15.31:0/4091484109 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc6480738c0 0x7fc648075d80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc65c006660 tx=0x7fc65c004110 comp rx=0 tx=0).stop 2024-09-17T05:35:50.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.341+0000 7fc671600640 1 -- 172.21.15.31:0/4091484109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc66c0b3af0 msgr2=0x7fc66c161ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:50.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.341+0000 7fc671600640 1 --2- 172.21.15.31:0/4091484109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc66c0b3af0 0x7fc66c161ec0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fc654006680 tx=0x7fc6540039d0 comp rx=0 tx=0).stop 2024-09-17T05:35:50.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.341+0000 7fc671600640 1 -- 172.21.15.31:0/4091484109 shutdown_connections 2024-09-17T05:35:50.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.341+0000 7fc671600640 1 --2- 172.21.15.31:0/4091484109 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc6480738c0 0x7fc648075d80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:50.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.341+0000 7fc671600640 1 --2- 172.21.15.31:0/4091484109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc66c0b3f70 0x7fc66c162400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:50.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.341+0000 7fc671600640 1 --2- 172.21.15.31:0/4091484109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc66c0b3af0 0x7fc66c161ec0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:50.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.341+0000 7fc671600640 1 --2- 172.21.15.31:0/4091484109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc650004d50 0x7fc66c0a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:50.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.341+0000 7fc671600640 1 -- 172.21.15.31:0/4091484109 >> 172.21.15.31:0/4091484109 conn(0x7fc66c0cd740 msgr2=0x7fc66c0b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:50.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.341+0000 7fc671600640 1 -- 172.21.15.31:0/4091484109 shutdown_connections 2024-09-17T05:35:50.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.341+0000 7fc671600640 1 -- 172.21.15.31:0/4091484109 wait complete. 2024-09-17T05:35:50.365 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:35:50.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.509+0000 7ff65da00640 1 -- 172.21.15.31:0/2295695253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6580d28e0 msgr2=0x7ff6580cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:50.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.509+0000 7ff65da00640 1 --2- 172.21.15.31:0/2295695253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6580d28e0 0x7ff6580cebb0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7ff650009c80 tx=0x7ff65001cda0 comp rx=0 tx=0).stop 2024-09-17T05:35:50.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.509+0000 7ff65da00640 1 -- 172.21.15.31:0/2295695253 shutdown_connections 2024-09-17T05:35:50.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.509+0000 7ff65da00640 1 --2- 172.21.15.31:0/2295695253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6580d28e0 0x7ff6580cebb0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:50.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.509+0000 7ff65da00640 1 --2- 172.21.15.31:0/2295695253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff65815bea0 0x7ff6580ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:50.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.509+0000 7ff65da00640 1 -- 172.21.15.31:0/2295695253 >> 172.21.15.31:0/2295695253 conn(0x7ff6580d1dc0 msgr2=0x7ff6580d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:50.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff65da00640 1 -- 172.21.15.31:0/2295695253 shutdown_connections 2024-09-17T05:35:50.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff65da00640 1 -- 172.21.15.31:0/2295695253 wait complete. 2024-09-17T05:35:50.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff65da00640 1 Processor -- start 2024-09-17T05:35:50.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff65da00640 1 -- start start 2024-09-17T05:35:50.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff65da00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6580cdb30 0x7ff658154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:50.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff65da00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6580d28e0 0x7ff6580ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:50.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff65da00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65815bea0 0x7ff658158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:50.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff65da00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff658169020 con 0x7ff65815bea0 2024-09-17T05:35:50.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff65da00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff658168ea0 con 0x7ff6580cdb30 2024-09-17T05:35:50.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff65da00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff6581691a0 con 0x7ff6580d28e0 2024-09-17T05:35:50.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff657400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65815bea0 0x7ff658158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:50.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff657400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65815bea0 0x7ff658158570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46488/0 (socket says 172.21.15.31:46488) 2024-09-17T05:35:50.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff657400640 1 -- 172.21.15.31:0/2228781697 learned_addr learned my addr 172.21.15.31:0/2228781697 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:50.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff656a00640 1 --2- 172.21.15.31:0/2228781697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6580cdb30 0x7ff658154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:50.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff64e000640 1 --2- 172.21.15.31:0/2228781697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6580d28e0 0x7ff6580ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:50.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff657400640 1 -- 172.21.15.31:0/2228781697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6580d28e0 msgr2=0x7ff6580ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:50.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff657400640 1 --2- 172.21.15.31:0/2228781697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6580d28e0 0x7ff6580ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:50.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff657400640 1 -- 172.21.15.31:0/2228781697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6580cdb30 msgr2=0x7ff658154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:50.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff657400640 1 --2- 172.21.15.31:0/2228781697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6580cdb30 0x7ff658154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:50.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff657400640 1 -- 172.21.15.31:0/2228781697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6580cb420 con 0x7ff65815bea0 2024-09-17T05:35:50.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff657400640 1 --2- 172.21.15.31:0/2228781697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65815bea0 0x7ff658158570 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7ff650009bd0 tx=0x7ff650009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:50.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff64f400640 1 -- 172.21.15.31:0/2228781697 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6500bb070 con 0x7ff65815bea0 2024-09-17T05:35:50.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff64f400640 1 -- 172.21.15.31:0/2228781697 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff650004e00 con 0x7ff65815bea0 2024-09-17T05:35:50.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff65da00640 1 -- 172.21.15.31:0/2228781697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6580c8e90 con 0x7ff65815bea0 2024-09-17T05:35:50.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.513+0000 7ff64f400640 1 -- 172.21.15.31:0/2228781697 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6500b2040 con 0x7ff65815bea0 2024-09-17T05:35:50.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.517+0000 7ff65da00640 1 -- 172.21.15.31:0/2228781697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6580c9450 con 0x7ff65815bea0 2024-09-17T05:35:50.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.517+0000 7ff65da00640 1 -- 172.21.15.31:0/2228781697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6580cc9d0 con 0x7ff65815bea0 2024-09-17T05:35:50.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.517+0000 7ff64f400640 1 -- 172.21.15.31:0/2228781697 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7ff6500be070 con 0x7ff65815bea0 2024-09-17T05:35:50.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.517+0000 7ff64f400640 1 --2- 172.21.15.31:0/2228781697 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff6340738c0 0x7ff634075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:50.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.517+0000 7ff64f400640 1 -- 172.21.15.31:0/2228781697 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7ff65012eb20 con 0x7ff65815bea0 2024-09-17T05:35:50.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.517+0000 7ff656a00640 1 --2- 172.21.15.31:0/2228781697 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff6340738c0 0x7ff634075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:50.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.521+0000 7ff656a00640 1 --2- 172.21.15.31:0/2228781697 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff6340738c0 0x7ff634075d80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff6580cb720 tx=0x7ff64800b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:50.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.521+0000 7ff64f400640 1 -- 172.21.15.31:0/2228781697 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff650016990 con 0x7ff65815bea0 2024-09-17T05:35:50.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.737+0000 7ff65da00640 1 -- 172.21.15.31:0/2228781697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6580762f0 con 0x7ff65815bea0 2024-09-17T05:35:50.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.737+0000 7ff64f400640 1 -- 172.21.15.31:0/2228781697 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5235 (secure 0 0 0) 0x7ff6500f8c10 con 0x7ff65815bea0 2024-09-17T05:35:50.739 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:35:50.740 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":100,"btime":"2024-09-17T05:35:48:336086+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3405206397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3405206397},{"type":"v1","addr":"172.21.15.155:6809","nonce":3405206397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6977,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4225787824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4225787824},{"type":"v1","addr":"172.21.15.155:6835","nonce":4225787824}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2838938586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2838938586},{"type":"v1","addr":"172.21.15.31:6834","nonce":2838938586}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:35:44.710527+0000","modified":"2024-09-17T05:35:47.749442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8343":{"gid":8343,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1808209578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1808209578},{"type":"v1","addr":"172.21.15.31:6835","nonce":1808209578}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8343,"qdb_cluster":[8343]},"id":11}]} 2024-09-17T05:35:50.740 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 100 2024-09-17T05:35:50.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.741+0000 7ff65da00640 1 -- 172.21.15.31:0/2228781697 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff6340738c0 msgr2=0x7ff634075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:50.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.741+0000 7ff65da00640 1 --2- 172.21.15.31:0/2228781697 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff6340738c0 0x7ff634075d80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff6580cb720 tx=0x7ff64800b2e0 comp rx=0 tx=0).stop 2024-09-17T05:35:50.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.741+0000 7ff65da00640 1 -- 172.21.15.31:0/2228781697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65815bea0 msgr2=0x7ff658158570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:50.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.741+0000 7ff65da00640 1 --2- 172.21.15.31:0/2228781697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65815bea0 0x7ff658158570 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7ff650009bd0 tx=0x7ff650009390 comp rx=0 tx=0).stop 2024-09-17T05:35:50.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.741+0000 7ff65da00640 1 -- 172.21.15.31:0/2228781697 shutdown_connections 2024-09-17T05:35:50.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.741+0000 7ff65da00640 1 --2- 172.21.15.31:0/2228781697 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff6340738c0 0x7ff634075d80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:50.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.741+0000 7ff65da00640 1 --2- 172.21.15.31:0/2228781697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65815bea0 0x7ff658158570 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:50.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.741+0000 7ff65da00640 1 --2- 172.21.15.31:0/2228781697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6580d28e0 0x7ff6580ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:50.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.741+0000 7ff65da00640 1 --2- 172.21.15.31:0/2228781697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6580cdb30 0x7ff658154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:50.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.741+0000 7ff65da00640 1 -- 172.21.15.31:0/2228781697 >> 172.21.15.31:0/2228781697 conn(0x7ff6580d1dc0 msgr2=0x7ff6580b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:50.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.741+0000 7ff65da00640 1 -- 172.21.15.31:0/2228781697 shutdown_connections 2024-09-17T05:35:50.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:50.741+0000 7ff65da00640 1 -- 172.21.15.31:0/2228781697 wait complete. 2024-09-17T05:35:51.164 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 100, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:35:44.710527+0000', 'modified': '2024-09-17T05:35:47.749442+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8343}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8343': {'gid': 8343, 'name': 'c', 'rank': 0, 'incarnation': 96, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/1808209578', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6833', 'nonce': 1808209578}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 1808209578}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8343, 'qdb_cluster': [8343]} 2024-09-17T05:35:51.165 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:35:51.165 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:35:51.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca16200640 1 -- 172.21.15.31:0/806164482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca100b2e80 msgr2=0x7fca100b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca16200640 1 --2- 172.21.15.31:0/806164482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca100b2e80 0x7fca100b1a00 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009900 tx=0x7fc9f801c790 comp rx=0 tx=0).stop 2024-09-17T05:35:51.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca16200640 1 -- 172.21.15.31:0/806164482 shutdown_connections 2024-09-17T05:35:51.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca16200640 1 --2- 172.21.15.31:0/806164482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca100b2e80 0x7fca100b1a00 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca16200640 1 --2- 172.21.15.31:0/806164482 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca1015f490 0x7fca100b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca16200640 1 -- 172.21.15.31:0/806164482 >> 172.21.15.31:0/806164482 conn(0x7fca100d1e30 msgr2=0x7fca100d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca16200640 1 -- 172.21.15.31:0/806164482 shutdown_connections 2024-09-17T05:35:51.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca16200640 1 -- 172.21.15.31:0/806164482 wait complete. 2024-09-17T05:35:51.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca16200640 1 Processor -- start 2024-09-17T05:35:51.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca16200640 1 -- start start 2024-09-17T05:35:51.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca16200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca100b1f40 0x7fca101513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca16200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca100b2e80 0x7fca100cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca16200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca1015f490 0x7fca101506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca16200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fca10168e90 con 0x7fca1015f490 2024-09-17T05:35:51.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca16200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fca1015f9e0 con 0x7fca100b1f40 2024-09-17T05:35:51.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca16200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fca10169010 con 0x7fca100b2e80 2024-09-17T05:35:51.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca1015f490 0x7fca101506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca1015f490 0x7fca101506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46512/0 (socket says 172.21.15.31:46512) 2024-09-17T05:35:51.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca0fe00640 1 -- 172.21.15.31:0/1401429418 learned_addr learned my addr 172.21.15.31:0/1401429418 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:51.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.317+0000 7fca07e00640 1 --2- 172.21.15.31:0/1401429418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca100b2e80 0x7fca100cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.321+0000 7fca0fe00640 1 -- 172.21.15.31:0/1401429418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca100b2e80 msgr2=0x7fca100cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.321+0000 7fca0fe00640 1 --2- 172.21.15.31:0/1401429418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca100b2e80 0x7fca100cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.321+0000 7fca0fe00640 1 -- 172.21.15.31:0/1401429418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca100b1f40 msgr2=0x7fca101513d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:35:51.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.321+0000 7fca0fe00640 1 --2- 172.21.15.31:0/1401429418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca100b1f40 0x7fca101513d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.321+0000 7fca0fe00640 1 -- 172.21.15.31:0/1401429418 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca101fabc0 con 0x7fca1015f490 2024-09-17T05:35:51.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.321+0000 7fca0fe00640 1 --2- 172.21.15.31:0/1401429418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca1015f490 0x7fca101506c0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fca0800c780 tx=0x7fca0800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.321+0000 7fca07400640 1 -- 172.21.15.31:0/1401429418 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08017070 con 0x7fca1015f490 2024-09-17T05:35:51.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.321+0000 7fca07400640 1 -- 172.21.15.31:0/1401429418 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca08005070 con 0x7fca1015f490 2024-09-17T05:35:51.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.321+0000 7fca07400640 1 -- 172.21.15.31:0/1401429418 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08005500 con 0x7fca1015f490 2024-09-17T05:35:51.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.321+0000 7fca16200640 1 -- 172.21.15.31:0/1401429418 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca101faea0 con 0x7fca1015f490 2024-09-17T05:35:51.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.321+0000 7fca16200640 1 -- 172.21.15.31:0/1401429418 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca101fb460 con 0x7fca1015f490 2024-09-17T05:35:51.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.321+0000 7fca07400640 1 -- 172.21.15.31:0/1401429418 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7fca080056a0 con 0x7fca1015f490 2024-09-17T05:35:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.321+0000 7fca07400640 1 --2- 172.21.15.31:0/1401429418 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc9ec0738c0 0x7fc9ec075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.321+0000 7fca1964b000 1 Processor -- start 2024-09-17T05:35:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca07400640 1 -- 172.21.15.31:0/1401429418 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7fca080944d0 con 0x7fca1015f490 2024-09-17T05:35:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca1964b000 1 -- start start 2024-09-17T05:35:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca0f400640 1 --2- 172.21.15.31:0/1401429418 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc9ec0738c0 0x7fc9ec075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca0f400640 1 --2- 172.21.15.31:0/1401429418 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc9ec0738c0 0x7fc9ec075d80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fca00009670 tx=0x7fca00006b90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca1964b000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d74759d0 0x5603d7475db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca1964b000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 0x5603d74298d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca1964b000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d7429e10 0x5603d742a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca1964b000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5603d734a3f0 con 0x5603d74762f0 2024-09-17T05:35:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca1964b000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5603d7287b20 con 0x5603d74759d0 2024-09-17T05:35:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca1964b000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5603d7276f50 con 0x5603d7429e10 2024-09-17T05:35:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca07e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 0x5603d74298d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca07e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 0x5603d74298d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46524/0 (socket says 172.21.15.31:46524) 2024-09-17T05:35:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca07e00640 1 -- 172.21.15.31:0/1243638226 learned_addr learned my addr 172.21.15.31:0/1243638226 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca0fe00640 1 --2- 172.21.15.31:0/1243638226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d7429e10 0x5603d742a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca07e00640 1 -- 172.21.15.31:0/1243638226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d7429e10 msgr2=0x5603d742a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:35:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca07e00640 1 --2- 172.21.15.31:0/1243638226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d7429e10 0x5603d742a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca07e00640 1 -- 172.21.15.31:0/1243638226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d74759d0 msgr2=0x5603d7475db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:35:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca07e00640 1 --2- 172.21.15.31:0/1243638226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d74759d0 0x5603d7475db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca07e00640 1 -- 172.21.15.31:0/1243638226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603d723e590 con 0x5603d74762f0 2024-09-17T05:35:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca0fe00640 1 --2- 172.21.15.31:0/1243638226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d7429e10 0x5603d742a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca07e00640 1 --2- 172.21.15.31:0/1243638226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 0x5603d74298d0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009230 tx=0x7fc9f8019530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763236cd5c90c163 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fc9ffe00640 1 -- 172.21.15.31:0/1243638226 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f80ba070 con 0x5603d74762f0 2024-09-17T05:35:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fc9ffe00640 1 -- 172.21.15.31:0/1243638226 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9f80044b0 con 0x5603d74762f0 2024-09-17T05:35:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fc9ffe00640 1 -- 172.21.15.31:0/1243638226 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f80b2040 con 0x5603d74762f0 2024-09-17T05:35:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca1964b000 1 -- 172.21.15.31:0/1243638226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 msgr2=0x5603d74298d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca1964b000 1 --2- 172.21.15.31:0/1243638226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 0x5603d74298d0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009230 tx=0x7fc9f8019530 comp rx=0 tx=0).stop 2024-09-17T05:35:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca1964b000 1 -- 172.21.15.31:0/1243638226 shutdown_connections 2024-09-17T05:35:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca1964b000 1 --2- 172.21.15.31:0/1243638226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d7429e10 0x5603d742a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca1964b000 1 --2- 172.21.15.31:0/1243638226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 0x5603d74298d0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca1964b000 1 --2- 172.21.15.31:0/1243638226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d74759d0 0x5603d7475db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca1964b000 1 -- 172.21.15.31:0/1243638226 >> 172.21.15.31:0/1243638226 conn(0x5603d7313130 msgr2=0x5603d7458e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca1964b000 1 -- 172.21.15.31:0/1243638226 shutdown_connections 2024-09-17T05:35:51.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca1964b000 1 -- 172.21.15.31:0/1243638226 wait complete. 2024-09-17T05:35:51.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.325+0000 7fca1964b000 1 -- start start 2024-09-17T05:35:51.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca1964b000 1 Processor -- start 2024-09-17T05:35:51.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca1964b000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d7429e10 0x5603d74566a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca1964b000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d74759d0 0x5603d7456e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca1964b000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 0x5603d74573b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca1964b000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5603d72115d0 con 0x5603d74762f0 2024-09-17T05:35:51.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca1964b000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5603d727ad60 con 0x5603d74759d0 2024-09-17T05:35:51.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca1964b000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5603d721d500 con 0x5603d7429e10 2024-09-17T05:35:51.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca1964b000 10 client.0 _ll_register_callbacks cb 0x5603d7221810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:35:51.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 0x5603d74573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 0x5603d74573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46538/0 (socket says 172.21.15.31:46538) 2024-09-17T05:35:51.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca0fe00640 1 -- 172.21.15.31:0/1348448716 learned_addr learned my addr 172.21.15.31:0/1348448716 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:51.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca07e00640 1 --2- 172.21.15.31:0/1348448716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d74759d0 0x5603d7456e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca0f400640 1 --2- 172.21.15.31:0/1348448716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d7429e10 0x5603d74566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca0fe00640 1 -- 172.21.15.31:0/1348448716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d7429e10 msgr2=0x5603d74566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:35:51.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca0fe00640 1 --2- 172.21.15.31:0/1348448716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d7429e10 0x5603d74566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca0fe00640 1 -- 172.21.15.31:0/1348448716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d74759d0 msgr2=0x5603d7456e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:35:51.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca0fe00640 1 --2- 172.21.15.31:0/1348448716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d74759d0 0x5603d7456e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca0fe00640 1 -- 172.21.15.31:0/1348448716 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603d7215170 con 0x5603d74762f0 2024-09-17T05:35:51.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca07e00640 1 --2- 172.21.15.31:0/1348448716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d74759d0 0x5603d7456e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:51.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca0fe00640 1 --2- 172.21.15.31:0/1348448716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 0x5603d74573b0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fca0800a430 tx=0x7fca0805e8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3950473925a7c136 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fc9fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:35:51.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fc9fcc00640 1 -- 172.21.15.31:0/1348448716 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08047e10 con 0x5603d74762f0 2024-09-17T05:35:51.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca1964b000 1 -- 172.21.15.31:0/1348448716 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5603d720f0f0 con 0x5603d74762f0 2024-09-17T05:35:51.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fc9fcc00640 1 -- 172.21.15.31:0/1348448716 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7fca080650c0 con 0x5603d74762f0 2024-09-17T05:35:51.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fc9fcc00640 1 -- 172.21.15.31:0/1348448716 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fca0805de00 con 0x5603d74762f0 2024-09-17T05:35:51.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca1964b000 10 client.8460 fetch_fsmap learned FSMap version 100 2024-09-17T05:35:51.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca1964b000 1 -- 172.21.15.31:0/1348448716 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x5603d72fbef0 con 0x5603d74762f0 2024-09-17T05:35:51.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fc9fcc00640 1 -- 172.21.15.31:0/1348448716 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x5603d720f0f0 con 0x5603d74762f0 2024-09-17T05:35:51.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fc9fcc00640 1 -- 172.21.15.31:0/1348448716 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7fca0805d550 con 0x5603d74762f0 2024-09-17T05:35:51.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca1964b000 10 client.8460 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T05:35:51.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca1964b000 10 client.8460 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:35:51.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca1964b000 20 client.8460 populate_metadata read hostname 'smithi031' 2024-09-17T05:35:51.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca1964b000 1 --2- 172.21.15.31:0/1348448716 >> [v2:172.21.15.31:6833/1808209578,v1:172.21.15.31:6835/1808209578] conn(0x5603d74580f0 0x5603d7487c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca1964b000 4 client.8460 mds_command: new command op to 8343 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:35:51.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca1964b000 1 -- 172.21.15.31:0/1348448716 --> [v2:172.21.15.31:6833/1808209578,v1:172.21.15.31:6835/1808209578] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603d7289a70 con 0x5603d74580f0 2024-09-17T05:35:51.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca0f400640 1 --2- 172.21.15.31:0/1348448716 >> [v2:172.21.15.31:6833/1808209578,v1:172.21.15.31:6835/1808209578] conn(0x5603d74580f0 0x5603d7487c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fc9fcc00640 10 client.8460 ms_handle_connect on v2:172.21.15.31:6833/1808209578 2024-09-17T05:35:51.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.329+0000 7fca0f400640 1 --2- 172.21.15.31:0/1348448716 >> [v2:172.21.15.31:6833/1808209578,v1:172.21.15.31:6835/1808209578] conn(0x5603d74580f0 0x5603d7487c90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14da8eb55e347802 server_cookie=18d06e3cd4a96fbd in_seq=0 out_seq=0 2024-09-17T05:35:51.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.333+0000 7fc9fcc00640 1 -- 172.21.15.31:0/1348448716 <== mds.0 v2:172.21.15.31:6833/1808209578 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5603d7289a70 con 0x5603d74580f0 2024-09-17T05:35:51.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.333+0000 7fc9fcc00640 10 client.8460 handle_command_reply: tid=0 2024-09-17T05:35:51.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.333+0000 7fca1964b000 1 client.8460 shutdown 2024-09-17T05:35:51.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.333+0000 7fca1964b000 1 -- 172.21.15.31:0/1348448716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 msgr2=0x5603d74573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.333+0000 7fca1964b000 1 --2- 172.21.15.31:0/1348448716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 0x5603d74573b0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fca0800a430 tx=0x7fca0805e8c0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.333+0000 7fca1964b000 1 -- 172.21.15.31:0/1348448716 shutdown_connections 2024-09-17T05:35:51.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.333+0000 7fca1964b000 1 --2- 172.21.15.31:0/1348448716 >> [v2:172.21.15.31:6833/1808209578,v1:172.21.15.31:6835/1808209578] conn(0x5603d74580f0 0x5603d7487c90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.333+0000 7fca1964b000 1 --2- 172.21.15.31:0/1348448716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 0x5603d74573b0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.333+0000 7fca1964b000 1 --2- 172.21.15.31:0/1348448716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d74759d0 0x5603d7456e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.333+0000 7fca1964b000 1 --2- 172.21.15.31:0/1348448716 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d7429e10 0x5603d74566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.333+0000 7fc9fcc00640 0 client.8460 ms_handle_reset on v2:172.21.15.31:6833/1808209578 2024-09-17T05:35:51.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.333+0000 7fca1964b000 1 -- 172.21.15.31:0/1348448716 >> 172.21.15.31:0/1348448716 conn(0x5603d7313130 msgr2=0x5603d7428fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.333+0000 7fca1964b000 1 -- 172.21.15.31:0/1348448716 shutdown_connections 2024-09-17T05:35:51.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.333+0000 7fca1964b000 1 -- 172.21.15.31:0/1348448716 wait complete. 2024-09-17T05:35:51.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.333+0000 7fca1964b000 20 client.8460 trim_cache size 0 max 16384 2024-09-17T05:35:51.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca1964b000 1 Processor -- start 2024-09-17T05:35:51.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca1964b000 1 -- start start 2024-09-17T05:35:51.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca1964b000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d7429e10 0x5603d7474dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca1964b000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d74759d0 0x5603d7475310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca1964b000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 0x5603d7487c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca1964b000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fca102041f0 con 0x5603d74762f0 2024-09-17T05:35:51.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca1964b000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fca10203210 con 0x5603d7429e10 2024-09-17T05:35:51.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca1964b000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fca101f7e40 con 0x5603d74759d0 2024-09-17T05:35:51.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 0x5603d7487c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 0x5603d7487c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46548/0 (socket says 172.21.15.31:46548) 2024-09-17T05:35:51.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca0fe00640 1 -- 172.21.15.31:0/440234833 learned_addr learned my addr 172.21.15.31:0/440234833 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:51.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca0f400640 1 --2- 172.21.15.31:0/440234833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d7429e10 0x5603d7474dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca07e00640 1 --2- 172.21.15.31:0/440234833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d74759d0 0x5603d7475310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca0fe00640 1 -- 172.21.15.31:0/440234833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d74759d0 msgr2=0x5603d7475310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:35:51.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca0fe00640 1 --2- 172.21.15.31:0/440234833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d74759d0 0x5603d7475310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca0fe00640 1 -- 172.21.15.31:0/440234833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d7429e10 msgr2=0x5603d7474dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:35:51.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca0fe00640 1 --2- 172.21.15.31:0/440234833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d7429e10 0x5603d7474dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca0fe00640 1 -- 172.21.15.31:0/440234833 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603d72d2d90 con 0x5603d74762f0 2024-09-17T05:35:51.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fca0fe00640 1 --2- 172.21.15.31:0/440234833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 0x5603d7487c90 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fca0805e280 tx=0x7fca0805a220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b18024cfe398e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fc9ff400640 1 -- 172.21.15.31:0/440234833 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0805e9f0 con 0x5603d74762f0 2024-09-17T05:35:51.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fc9ff400640 1 -- 172.21.15.31:0/440234833 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca08047e10 con 0x5603d74762f0 2024-09-17T05:35:51.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.353+0000 7fc9ff400640 1 -- 172.21.15.31:0/440234833 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08065290 con 0x5603d74762f0 2024-09-17T05:35:51.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 -- 172.21.15.31:0/440234833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 msgr2=0x5603d7487c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 --2- 172.21.15.31:0/440234833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 0x5603d7487c90 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fca0805e280 tx=0x7fca0805a220 comp rx=0 tx=0).stop 2024-09-17T05:35:51.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 -- 172.21.15.31:0/440234833 shutdown_connections 2024-09-17T05:35:51.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 --2- 172.21.15.31:0/440234833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d74762f0 0x5603d7487c90 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 --2- 172.21.15.31:0/440234833 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d74759d0 0x5603d7475310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 --2- 172.21.15.31:0/440234833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d7429e10 0x5603d7474dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 -- 172.21.15.31:0/440234833 >> 172.21.15.31:0/440234833 conn(0x5603d7313130 msgr2=0x5603d7482fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 -- 172.21.15.31:0/440234833 shutdown_connections 2024-09-17T05:35:51.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 -- 172.21.15.31:0/440234833 wait complete. 2024-09-17T05:35:51.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 -- start start 2024-09-17T05:35:51.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 Processor -- start 2024-09-17T05:35:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d7429e10 0x5603d74eb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d74759d0 0x5603d74eb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d74762f0 0x5603d74ebeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5603d7336730 con 0x5603d7429e10 2024-09-17T05:35:51.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5603d727f390 con 0x5603d74759d0 2024-09-17T05:35:51.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5603d72868f0 con 0x5603d74762f0 2024-09-17T05:35:51.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 10 client.0 _ll_register_callbacks cb 0x7fca0800cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:35:51.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca0f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d7429e10 0x5603d74eb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca0f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d7429e10 0x5603d74eb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46552/0 (socket says 172.21.15.31:46552) 2024-09-17T05:35:51.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca0f400640 1 -- 172.21.15.31:0/2688578966 learned_addr learned my addr 172.21.15.31:0/2688578966 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:51.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca0fe00640 1 --2- 172.21.15.31:0/2688578966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d74762f0 0x5603d74ebeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca07e00640 1 --2- 172.21.15.31:0/2688578966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d74759d0 0x5603d74eb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca0f400640 1 -- 172.21.15.31:0/2688578966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d74762f0 msgr2=0x5603d74ebeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:35:51.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca0f400640 1 --2- 172.21.15.31:0/2688578966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d74762f0 0x5603d74ebeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca0f400640 1 -- 172.21.15.31:0/2688578966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d74759d0 msgr2=0x5603d74eb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:35:51.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca0f400640 1 --2- 172.21.15.31:0/2688578966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d74759d0 0x5603d74eb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca0f400640 1 -- 172.21.15.31:0/2688578966 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603d723da90 con 0x5603d7429e10 2024-09-17T05:35:51.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca0f400640 1 --2- 172.21.15.31:0/2688578966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d7429e10 0x5603d74eb430 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x5603d732dc20 tx=0x7fca000046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824251e59715eac server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fc9fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:35:51.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fc9fcc00640 1 -- 172.21.15.31:0/2688578966 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca00021aa0 con 0x5603d7429e10 2024-09-17T05:35:51.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fc9fcc00640 1 -- 172.21.15.31:0/2688578966 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7fca00021c40 con 0x5603d7429e10 2024-09-17T05:35:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 -- 172.21.15.31:0/2688578966 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca08047e10 con 0x5603d7429e10 2024-09-17T05:35:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fc9fcc00640 1 -- 172.21.15.31:0/2688578966 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fca00021e40 con 0x5603d7429e10 2024-09-17T05:35:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 10 client.8466 fetch_fsmap learned FSMap version 100 2024-09-17T05:35:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 1 -- 172.21.15.31:0/2688578966 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x5603d721c050 con 0x5603d7429e10 2024-09-17T05:35:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fc9fcc00640 1 -- 172.21.15.31:0/2688578966 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca08047e10 con 0x5603d7429e10 2024-09-17T05:35:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fc9fcc00640 1 -- 172.21.15.31:0/2688578966 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7fca00012070 con 0x5603d7429e10 2024-09-17T05:35:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 10 client.8466 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T05:35:51.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 10 client.8466 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:35:51.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.357+0000 7fca1964b000 20 client.8466 populate_metadata read hostname 'smithi031' 2024-09-17T05:35:51.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca1964b000 1 --2- 172.21.15.31:0/2688578966 >> [v2:172.21.15.31:6833/1808209578,v1:172.21.15.31:6835/1808209578] conn(0x5603d748b8b0 0x5603d74f4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca1964b000 4 client.8466 mds_command: new command op to 8343 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:35:51.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca1964b000 1 -- 172.21.15.31:0/2688578966 --> [v2:172.21.15.31:6833/1808209578,v1:172.21.15.31:6835/1808209578] -- command(tid 0: {"prefix": "status"}) -- 0x5603d7285520 con 0x5603d748b8b0 2024-09-17T05:35:51.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca07e00640 1 --2- 172.21.15.31:0/2688578966 >> [v2:172.21.15.31:6833/1808209578,v1:172.21.15.31:6835/1808209578] conn(0x5603d748b8b0 0x5603d74f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca07e00640 1 --2- 172.21.15.31:0/2688578966 >> [v2:172.21.15.31:6833/1808209578,v1:172.21.15.31:6835/1808209578] conn(0x5603d748b8b0 0x5603d74f4690 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fca942d6a6252c74 server_cookie=4375324cf89f3d0d in_seq=0 out_seq=0 2024-09-17T05:35:51.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fc9fcc00640 10 client.8466 ms_handle_connect on v2:172.21.15.31:6833/1808209578 2024-09-17T05:35:51.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fc9fcc00640 1 -- 172.21.15.31:0/2688578966 <== mds.0 v2:172.21.15.31:6833/1808209578 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x5603d7285520 con 0x5603d748b8b0 2024-09-17T05:35:51.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fc9fcc00640 10 client.8466 handle_command_reply: tid=0 2024-09-17T05:35:51.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca1964b000 1 client.8466 shutdown 2024-09-17T05:35:51.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca1964b000 1 -- 172.21.15.31:0/2688578966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d7429e10 msgr2=0x5603d74eb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca1964b000 1 --2- 172.21.15.31:0/2688578966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d7429e10 0x5603d74eb430 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x5603d732dc20 tx=0x7fca000046d0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca1964b000 1 -- 172.21.15.31:0/2688578966 shutdown_connections 2024-09-17T05:35:51.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca1964b000 1 --2- 172.21.15.31:0/2688578966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5603d74762f0 0x5603d74ebeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca1964b000 1 --2- 172.21.15.31:0/2688578966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603d74759d0 0x5603d74eb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca1964b000 1 --2- 172.21.15.31:0/2688578966 >> [v2:172.21.15.31:6833/1808209578,v1:172.21.15.31:6835/1808209578] conn(0x5603d748b8b0 0x5603d74f4690 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca1964b000 1 --2- 172.21.15.31:0/2688578966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603d7429e10 0x5603d74eb430 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca1964b000 1 -- 172.21.15.31:0/2688578966 >> 172.21.15.31:0/2688578966 conn(0x5603d7313130 msgr2=0x5603d7474dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fc9fcc00640 0 client.8466 ms_handle_reset on v2:172.21.15.31:6833/1808209578 2024-09-17T05:35:51.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca1964b000 1 -- 172.21.15.31:0/2688578966 shutdown_connections 2024-09-17T05:35:51.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca1964b000 1 -- 172.21.15.31:0/2688578966 wait complete. 2024-09-17T05:35:51.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca1964b000 20 client.8466 trim_cache size 0 max 16384 2024-09-17T05:35:51.378 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:35:51.378 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "b668cd1d-3036-4a29-9e5a-69d0df5776a8", 2024-09-17T05:35:51.378 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-17T05:35:51.378 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 8343, 2024-09-17T05:35:51.378 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-09-17T05:35:51.379 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-09-17T05:35:51.379 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-17T05:35:51.379 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 6.0425727949999999, 2024-09-17T05:35:51.379 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 100, 2024-09-17T05:35:51.379 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 141, 2024-09-17T05:35:51.379 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 141, 2024-09-17T05:35:51.379 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 10.483446477999999 2024-09-17T05:35:51.379 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:35:51.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca16200640 1 -- 172.21.15.31:0/1401429418 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc9ec0738c0 msgr2=0x7fc9ec075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca16200640 1 --2- 172.21.15.31:0/1401429418 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc9ec0738c0 0x7fc9ec075d80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fca00009670 tx=0x7fca00006b90 comp rx=0 tx=0).stop 2024-09-17T05:35:51.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca16200640 1 -- 172.21.15.31:0/1401429418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca1015f490 msgr2=0x7fca101506c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca16200640 1 --2- 172.21.15.31:0/1401429418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca1015f490 0x7fca101506c0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fca0800c780 tx=0x7fca0800cc40 comp rx=0 tx=0).stop 2024-09-17T05:35:51.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca16200640 1 -- 172.21.15.31:0/1401429418 shutdown_connections 2024-09-17T05:35:51.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca16200640 1 --2- 172.21.15.31:0/1401429418 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc9ec0738c0 0x7fc9ec075d80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca16200640 1 --2- 172.21.15.31:0/1401429418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca1015f490 0x7fca101506c0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca16200640 1 --2- 172.21.15.31:0/1401429418 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca100b2e80 0x7fca100cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca16200640 1 --2- 172.21.15.31:0/1401429418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca100b1f40 0x7fca101513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca16200640 1 -- 172.21.15.31:0/1401429418 >> 172.21.15.31:0/1401429418 conn(0x7fca100d1e30 msgr2=0x7fca10071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca16200640 1 -- 172.21.15.31:0/1401429418 shutdown_connections 2024-09-17T05:35:51.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.361+0000 7fca16200640 1 -- 172.21.15.31:0/1401429418 wait complete. 2024-09-17T05:35:51.382 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:35:51.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.529+0000 7f946da00640 1 -- 172.21.15.31:0/3342197292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f944c0051d0 msgr2=0x7f944c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.529+0000 7f946da00640 1 --2- 172.21.15.31:0/3342197292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f944c0051d0 0x7f944c00b9d0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f9460009ee0 tx=0x7f946001d630 comp rx=0 tx=0).stop 2024-09-17T05:35:51.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.529+0000 7f946da00640 1 -- 172.21.15.31:0/3342197292 shutdown_connections 2024-09-17T05:35:51.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.529+0000 7f946da00640 1 --2- 172.21.15.31:0/3342197292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f944c0051d0 0x7f944c00b9d0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.529+0000 7f946da00640 1 -- 172.21.15.31:0/3342197292 >> 172.21.15.31:0/3342197292 conn(0x7f94680d1dc0 msgr2=0x7f94680d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.529+0000 7f946da00640 1 -- 172.21.15.31:0/3342197292 shutdown_connections 2024-09-17T05:35:51.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.529+0000 7f946da00640 1 -- 172.21.15.31:0/3342197292 wait complete. 2024-09-17T05:35:51.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.529+0000 7f946da00640 1 Processor -- start 2024-09-17T05:35:51.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.529+0000 7f946da00640 1 -- start start 2024-09-17T05:35:51.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f946da00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f944c0051d0 0x7f94680b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f946da00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f946815cdb0 0x7f94680b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f946da00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94680b6270 0x7f94680b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f946da00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f94680d2a60 con 0x7f946815cdb0 2024-09-17T05:35:51.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f946da00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f94680d28e0 con 0x7f944c0051d0 2024-09-17T05:35:51.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f946da00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f94680d2be0 con 0x7f94680b6270 2024-09-17T05:35:51.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f945e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f946815cdb0 0x7f94680b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f945e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f946815cdb0 0x7f94680b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46572/0 (socket says 172.21.15.31:46572) 2024-09-17T05:35:51.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f945e000640 1 -- 172.21.15.31:0/2849598533 learned_addr learned my addr 172.21.15.31:0/2849598533 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:51.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f9466a00640 1 --2- 172.21.15.31:0/2849598533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f944c0051d0 0x7f94680b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f9467400640 1 --2- 172.21.15.31:0/2849598533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94680b6270 0x7f94680b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f945e000640 1 -- 172.21.15.31:0/2849598533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94680b6270 msgr2=0x7f94680b66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f945e000640 1 --2- 172.21.15.31:0/2849598533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94680b6270 0x7f94680b66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f945e000640 1 -- 172.21.15.31:0/2849598533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f944c0051d0 msgr2=0x7f94680b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f945e000640 1 --2- 172.21.15.31:0/2849598533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f944c0051d0 0x7f94680b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f945e000640 1 -- 172.21.15.31:0/2849598533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946815d230 con 0x7f946815cdb0 2024-09-17T05:35:51.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f9467400640 1 --2- 172.21.15.31:0/2849598533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94680b6270 0x7f94680b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:51.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f9466a00640 1 --2- 172.21.15.31:0/2849598533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f944c0051d0 0x7f94680b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:51.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f945e000640 1 --2- 172.21.15.31:0/2849598533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f946815cdb0 0x7f94680b34b0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f9450004e20 tx=0x7f9450001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f945f400640 1 -- 172.21.15.31:0/2849598533 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94500107d0 con 0x7f946815cdb0 2024-09-17T05:35:51.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f945f400640 1 -- 172.21.15.31:0/2849598533 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9450016070 con 0x7f946815cdb0 2024-09-17T05:35:51.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f946da00640 1 -- 172.21.15.31:0/2849598533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94680b51d0 con 0x7f946815cdb0 2024-09-17T05:35:51.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f945f400640 1 -- 172.21.15.31:0/2849598533 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9450010cc0 con 0x7f946815cdb0 2024-09-17T05:35:51.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f946da00640 1 -- 172.21.15.31:0/2849598533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94680b5790 con 0x7f946815cdb0 2024-09-17T05:35:51.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.533+0000 7f946da00640 1 -- 172.21.15.31:0/2849598533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94680ce910 con 0x7f946815cdb0 2024-09-17T05:35:51.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.537+0000 7f945f400640 1 -- 172.21.15.31:0/2849598533 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f945001b460 con 0x7f946815cdb0 2024-09-17T05:35:51.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.537+0000 7f945f400640 1 --2- 172.21.15.31:0/2849598533 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f94440738f0 0x7f9444075db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:51.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.537+0000 7f945f400640 1 -- 172.21.15.31:0/2849598533 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f9450095590 con 0x7f946815cdb0 2024-09-17T05:35:51.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.537+0000 7f9466a00640 1 --2- 172.21.15.31:0/2849598533 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f94440738f0 0x7f9444075db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:51.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.537+0000 7f9466a00640 1 --2- 172.21.15.31:0/2849598533 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f94440738f0 0x7f9444075db0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9458001870 tx=0x7f94580011c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:51.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.541+0000 7f945f400640 1 -- 172.21.15.31:0/2849598533 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f945005fcd0 con 0x7f946815cdb0 2024-09-17T05:35:51.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.757+0000 7f946da00640 1 -- 172.21.15.31:0/2849598533 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f94680afbd0 con 0x7f946815cdb0 2024-09-17T05:35:51.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.757+0000 7f945f400640 1 -- 172.21.15.31:0/2849598533 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v100) ==== 53+0+73 (secure 0 0 0) 0x7f945005f5d0 con 0x7f946815cdb0 2024-09-17T05:35:51.758 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:35:51.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.757+0000 7f946da00640 1 -- 172.21.15.31:0/2849598533 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f94440738f0 msgr2=0x7f9444075db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.757+0000 7f946da00640 1 --2- 172.21.15.31:0/2849598533 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f94440738f0 0x7f9444075db0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9458001870 tx=0x7f94580011c0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.757+0000 7f946da00640 1 -- 172.21.15.31:0/2849598533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f946815cdb0 msgr2=0x7f94680b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:51.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.757+0000 7f946da00640 1 --2- 172.21.15.31:0/2849598533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f946815cdb0 0x7f94680b34b0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f9450004e20 tx=0x7f9450001640 comp rx=0 tx=0).stop 2024-09-17T05:35:51.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.757+0000 7f946da00640 1 -- 172.21.15.31:0/2849598533 shutdown_connections 2024-09-17T05:35:51.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.757+0000 7f946da00640 1 --2- 172.21.15.31:0/2849598533 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f94440738f0 0x7f9444075db0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.757+0000 7f946da00640 1 --2- 172.21.15.31:0/2849598533 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94680b6270 0x7f94680b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.757+0000 7f946da00640 1 --2- 172.21.15.31:0/2849598533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f946815cdb0 0x7f94680b34b0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.757+0000 7f946da00640 1 --2- 172.21.15.31:0/2849598533 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f944c0051d0 0x7f94680b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:51.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.757+0000 7f946da00640 1 -- 172.21.15.31:0/2849598533 >> 172.21.15.31:0/2849598533 conn(0x7f94680d1dc0 msgr2=0x7f946806eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:51.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.757+0000 7f946da00640 1 -- 172.21.15.31:0/2849598533 shutdown_connections 2024-09-17T05:35:51.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:51.757+0000 7f946da00640 1 -- 172.21.15.31:0/2849598533 wait complete. 2024-09-17T05:35:51.780 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:35:51.780 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:35:51.780 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-17T05:35:51.780 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:35:51.780 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:35:51.780 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:35:51.780 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:35:51.780 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:35:51.780 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:35:51.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:51.781 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-17T05:35:51.791 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:35:51.792 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:35:51.792 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:35:51.792 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:51.792 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-17T05:35:51.793 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:51.793 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:35:51.793 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:51.793 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-17T05:35:51.793 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:35:51.794 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:51.794 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-17T05:35:51.794 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:35:51.794 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:51.794 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-17T05:35:51.794 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:35:51.795 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42001sec preferred_lft 42001sec 2024-09-17T05:35:51.795 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-17T05:35:51.795 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:51.795 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:35:51.795 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:51.795 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-17T05:35:51.796 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:35:51.796 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:fe:f3:3e:aa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:51.796 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:35:51.796 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:51.796 INFO:teuthology.orchestra.run.smithi031.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:35:51.796 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:51.797 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:35:51.797 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:51.797 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:35:51.797 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:51.797 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:35:51.797 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:35:51.798 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:35:51.798 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:51.798 INFO:teuthology.orchestra.run.smithi031.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:35:51.798 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:35:51.798 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:35:51.798 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:51.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:51.799 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:35:51.855 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-17T05:35:51.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:51.857 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-17T05:35:51.911 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-17T05:35:51.911 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:35:51.911 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:35:51.911 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:35:51.911 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:35:51.911 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:35:51.911 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:35:51.912 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:35:51.912 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:35:51.912 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:35:51.912 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:35:51.912 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:35:52.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:35:52.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:35:52.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:52.049 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T05:35:52.058 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:35:52.058 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:35:52.059 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:35:52.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:52.059 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-09-17T05:35:52.121 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:35:52.121 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:35:52.173 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:35:52.173 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:35:52.173 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:35:52.224 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-17T05:35:52.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:52.225 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:35:52.323 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:35:52.323 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:35:52.336 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:35:52.336 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:35:52.336 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:35:52.336 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:35:52.336 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:35:52.339 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:35:52.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:52.340 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:35:52.360 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:35:52.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:35:52.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:35:52.472 INFO:teuthology.orchestra.run.smithi031.stdout:client7960 2024-09-17T05:35:52.472 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:35:52.472 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:35:52.481 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:35:52.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.669+0000 7f5717000640 1 -- 172.21.15.31:0/2619651419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f571015bea0 msgr2=0x7f57100ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.669+0000 7f5717000640 1 --2- 172.21.15.31:0/2619651419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f571015bea0 0x7f57100ce670 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f57100cf310 tx=0x7f570001c8c0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.669+0000 7f5717000640 1 -- 172.21.15.31:0/2619651419 shutdown_connections 2024-09-17T05:35:52.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.669+0000 7f5717000640 1 --2- 172.21.15.31:0/2619651419 >> v2:172.21.15.155:3300/0 conn(0x7f57100d28e0 0x7f57100cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.669+0000 7f5717000640 1 --2- 172.21.15.31:0/2619651419 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57100cdb30 0x7f57100cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.669+0000 7f5717000640 1 --2- 172.21.15.31:0/2619651419 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f571015bea0 0x7f57100ce670 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.669+0000 7f5717000640 1 -- 172.21.15.31:0/2619651419 >> 172.21.15.31:0/2619651419 conn(0x7f57100d1dc0 msgr2=0x7f57100d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:52.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.669+0000 7f5717000640 1 -- 172.21.15.31:0/2619651419 shutdown_connections 2024-09-17T05:35:52.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.669+0000 7f5717000640 1 -- 172.21.15.31:0/2619651419 wait complete. 2024-09-17T05:35:52.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.669+0000 7f5717000640 1 Processor -- start 2024-09-17T05:35:52.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.669+0000 7f5717000640 1 -- start start 2024-09-17T05:35:52.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f5717000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57100cdb30 0x7f57101584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:52.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f5717000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57100d28e0 0x7f57100c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:52.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f5717000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f571015bea0 0x7f5710143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:52.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f5717000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f57100af070 con 0x7f571015bea0 2024-09-17T05:35:52.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f5717000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f57100aeef0 con 0x7f57100d28e0 2024-09-17T05:35:52.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f5717000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f57100af1f0 con 0x7f57100cdb30 2024-09-17T05:35:52.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f5715000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f571015bea0 0x7f5710143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:52.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f570fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57100cdb30 0x7f57101584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:52.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f5715000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f571015bea0 0x7f5710143120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46590/0 (socket says 172.21.15.31:46590) 2024-09-17T05:35:52.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f5715000640 1 -- 172.21.15.31:0/4254079952 learned_addr learned my addr 172.21.15.31:0/4254079952 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:52.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f5715000640 1 -- 172.21.15.31:0/4254079952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57100cdb30 msgr2=0x7f57101584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f5715000640 1 --2- 172.21.15.31:0/4254079952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57100cdb30 0x7f57101584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f5715000640 1 -- 172.21.15.31:0/4254079952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57100d28e0 msgr2=0x7f57100c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f5715000640 1 --2- 172.21.15.31:0/4254079952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57100d28e0 0x7f57100c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f5715000640 1 -- 172.21.15.31:0/4254079952 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57100cb030 con 0x7f571015bea0 2024-09-17T05:35:52.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f5715000640 1 --2- 172.21.15.31:0/4254079952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f571015bea0 0x7f5710143120 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f570800ea50 tx=0x7f570800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:52.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f570cc00640 1 -- 172.21.15.31:0/4254079952 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570800cd60 con 0x7f571015bea0 2024-09-17T05:35:52.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f570cc00640 1 -- 172.21.15.31:0/4254079952 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5708004b30 con 0x7f571015bea0 2024-09-17T05:35:52.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f570cc00640 1 -- 172.21.15.31:0/4254079952 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5708005020 con 0x7f571015bea0 2024-09-17T05:35:52.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f5717000640 1 -- 172.21.15.31:0/4254079952 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57100cb310 con 0x7f571015bea0 2024-09-17T05:35:52.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f5717000640 1 -- 172.21.15.31:0/4254079952 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57100cb8d0 con 0x7f571015bea0 2024-09-17T05:35:52.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.673+0000 7f5717000640 1 -- 172.21.15.31:0/4254079952 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57100cc9d0 con 0x7f571015bea0 2024-09-17T05:35:52.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.677+0000 7f570cc00640 1 -- 172.21.15.31:0/4254079952 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f57080051c0 con 0x7f571015bea0 2024-09-17T05:35:52.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.677+0000 7f570cc00640 1 --2- 172.21.15.31:0/4254079952 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f56ec0738c0 0x7f56ec075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:52.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.677+0000 7f570cc00640 1 -- 172.21.15.31:0/4254079952 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f57080958e0 con 0x7f571015bea0 2024-09-17T05:35:52.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.677+0000 7f570fe00640 1 --2- 172.21.15.31:0/4254079952 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f56ec0738c0 0x7f56ec075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:52.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.677+0000 7f570fe00640 1 --2- 172.21.15.31:0/4254079952 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f56ec0738c0 0x7f56ec075d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f57000af000 tx=0x7f57000a7040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:52.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.681+0000 7f570cc00640 1 -- 172.21.15.31:0/4254079952 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5708016030 con 0x7f571015bea0 2024-09-17T05:35:52.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.897+0000 7f5717000640 1 -- 172.21.15.31:0/4254079952 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5710070e00 con 0x7f571015bea0 2024-09-17T05:35:52.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.897+0000 7f570cc00640 1 -- 172.21.15.31:0/4254079952 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v100) ==== 53+0+73 (secure 0 0 0) 0x7f570805f720 con 0x7f571015bea0 2024-09-17T05:35:52.898 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:35:52.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.897+0000 7f5717000640 1 -- 172.21.15.31:0/4254079952 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f56ec0738c0 msgr2=0x7f56ec075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.897+0000 7f5717000640 1 --2- 172.21.15.31:0/4254079952 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f56ec0738c0 0x7f56ec075d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f57000af000 tx=0x7f57000a7040 comp rx=0 tx=0).stop 2024-09-17T05:35:52.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.897+0000 7f5717000640 1 -- 172.21.15.31:0/4254079952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f571015bea0 msgr2=0x7f5710143120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:52.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.897+0000 7f5717000640 1 --2- 172.21.15.31:0/4254079952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f571015bea0 0x7f5710143120 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f570800ea50 tx=0x7f570800ef10 comp rx=0 tx=0).stop 2024-09-17T05:35:52.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.897+0000 7f5717000640 1 -- 172.21.15.31:0/4254079952 shutdown_connections 2024-09-17T05:35:52.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.897+0000 7f5717000640 1 --2- 172.21.15.31:0/4254079952 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f56ec0738c0 0x7f56ec075d80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.897+0000 7f5717000640 1 --2- 172.21.15.31:0/4254079952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f571015bea0 0x7f5710143120 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.897+0000 7f5717000640 1 --2- 172.21.15.31:0/4254079952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57100d28e0 0x7f57100c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.897+0000 7f5717000640 1 --2- 172.21.15.31:0/4254079952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f57100cdb30 0x7f57101584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:52.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.897+0000 7f5717000640 1 -- 172.21.15.31:0/4254079952 >> 172.21.15.31:0/4254079952 conn(0x7f57100d1dc0 msgr2=0x7f57100721d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:52.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.897+0000 7f5717000640 1 -- 172.21.15.31:0/4254079952 shutdown_connections 2024-09-17T05:35:52.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:52.897+0000 7f5717000640 1 -- 172.21.15.31:0/4254079952 wait complete. 2024-09-17T05:35:52.919 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:35:52.919 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:35:52.919 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-09-17T05:35:52.919 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:35:52.920 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:35:52.920 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:35:52.920 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:35:52.920 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:35:52.920 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:35:52.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:52.920 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-09-17T05:35:52.930 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:35:52.930 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:35:52.931 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:35:52.931 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:52.931 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-17T05:35:52.931 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:52.931 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:35:52.931 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:52.931 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-09-17T05:35:52.931 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:35:52.931 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:52.931 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-09-17T05:35:52.931 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:35:52.932 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:52.932 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:35:52.932 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:52.932 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-17T05:35:52.932 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42003sec preferred_lft 42003sec 2024-09-17T05:35:52.932 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-09-17T05:35:52.932 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:52.932 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:35:52.932 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:84:cd:fc:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:52.932 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:35:52.932 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:52.932 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:35:52.933 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:35:52.933 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:35:52.933 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:52.933 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:35:52.933 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:52.933 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:35:52.933 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:35:52.933 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:35:52.933 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:52.933 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:35:52.933 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:35:52.934 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:35:52.934 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:35:52.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:52.935 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:35:52.996 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-17T05:35:52.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:52.998 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-09-17T05:35:53.053 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-09-17T05:35:53.053 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:35:53.053 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-17T05:35:53.053 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:35:53.053 INFO:teuthology.orchestra.run.smithi155.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-17T05:35:53.053 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:35:53.053 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:35:53.054 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:35:53.054 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:35:53.054 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:35:53.054 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:35:53.054 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:35:53.054 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:35:53.054 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:35:53.054 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:35:53.055 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:35:53.055 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:35:53.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:35:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:35:53.192 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:35:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:35:53.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:53.199 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-17T05:35:53.208 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:35:53.208 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:35:53.209 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:35:53.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:53.209 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-09-17T05:35:53.272 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:35:53.273 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:35:53.330 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:35:53.330 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:35:53.330 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:35:53.380 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-17T05:35:53.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:53.381 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:35:53.477 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:35:53.477 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:35:53.490 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:35:53.490 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:35:53.490 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:35:53.490 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:35:53.490 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:35:53.494 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:35:53.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:53.494 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:35:53.513 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:35:53.607 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:35:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:35:53.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:35:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:35:53.617 INFO:teuthology.orchestra.run.smithi155.stdout:client7067 2024-09-17T05:35:53.618 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:35:53.618 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:35:53.673 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:35:53.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.833+0000 7f5cf3200640 1 -- 172.21.15.31:0/425759625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cec0d1ae0 msgr2=0x7f5cec0d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:53.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.833+0000 7f5cf3200640 1 --2- 172.21.15.31:0/425759625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cec0d1ae0 0x7f5cec0d1280 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009870 tx=0x7f5cdc01c7d0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.833+0000 7f5cf3200640 1 -- 172.21.15.31:0/425759625 shutdown_connections 2024-09-17T05:35:53.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.833+0000 7f5cf3200640 1 --2- 172.21.15.31:0/425759625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cec0d1ae0 0x7f5cec0d1280 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.833+0000 7f5cf3200640 1 -- 172.21.15.31:0/425759625 >> 172.21.15.31:0/425759625 conn(0x7f5cec0d3f10 msgr2=0x7f5cec0d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:53.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.833+0000 7f5cf3200640 1 -- 172.21.15.31:0/425759625 shutdown_connections 2024-09-17T05:35:53.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.833+0000 7f5cf3200640 1 -- 172.21.15.31:0/425759625 wait complete. 2024-09-17T05:35:53.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf3200640 1 Processor -- start 2024-09-17T05:35:53.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf3200640 1 -- start start 2024-09-17T05:35:53.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf3200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cec0d1ae0 0x7f5cec153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:53.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf3200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cec0d24d0 0x7f5cec0b9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:53.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf3200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cec15dff0 0x7f5cec150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:53.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf3200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec16c850 con 0x7f5cec0d1ae0 2024-09-17T05:35:53.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf3200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec16c6d0 con 0x7f5cec15dff0 2024-09-17T05:35:53.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf3200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5cec16c9d0 con 0x7f5cec0d24d0 2024-09-17T05:35:53.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cec0d1ae0 0x7f5cec153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:53.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cec0d1ae0 0x7f5cec153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46606/0 (socket says 172.21.15.31:46606) 2024-09-17T05:35:53.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf1e00640 1 -- 172.21.15.31:0/4016129866 learned_addr learned my addr 172.21.15.31:0/4016129866 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf2800640 1 --2- 172.21.15.31:0/4016129866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cec15dff0 0x7f5cec150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf1400640 1 --2- 172.21.15.31:0/4016129866 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cec0d24d0 0x7f5cec0b9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf1e00640 1 -- 172.21.15.31:0/4016129866 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cec0d24d0 msgr2=0x7f5cec0b9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf1e00640 1 --2- 172.21.15.31:0/4016129866 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cec0d24d0 0x7f5cec0b9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf1e00640 1 -- 172.21.15.31:0/4016129866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cec15dff0 msgr2=0x7f5cec150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf1e00640 1 --2- 172.21.15.31:0/4016129866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cec15dff0 0x7f5cec150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf1e00640 1 -- 172.21.15.31:0/4016129866 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec159e20 con 0x7f5cec0d1ae0 2024-09-17T05:35:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf1e00640 1 --2- 172.21.15.31:0/4016129866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cec0d1ae0 0x7f5cec153070 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000c460 tx=0x7f5ce000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5ce6000640 1 -- 172.21.15.31:0/4016129866 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0016020 con 0x7f5cec0d1ae0 2024-09-17T05:35:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5ce6000640 1 -- 172.21.15.31:0/4016129866 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ce0012a00 con 0x7f5cec0d1ae0 2024-09-17T05:35:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5ce6000640 1 -- 172.21.15.31:0/4016129866 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0012e50 con 0x7f5cec0d1ae0 2024-09-17T05:35:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf3200640 1 -- 172.21.15.31:0/4016129866 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cec159860 con 0x7f5cec0d1ae0 2024-09-17T05:35:53.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.837+0000 7f5cf3200640 1 -- 172.21.15.31:0/4016129866 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cec0b7280 con 0x7f5cec0d1ae0 2024-09-17T05:35:53.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.841+0000 7f5cf3200640 1 -- 172.21.15.31:0/4016129866 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cec0d1280 con 0x7f5cec0d1ae0 2024-09-17T05:35:53.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.841+0000 7f5ce6000640 1 -- 172.21.15.31:0/4016129866 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f5ce0019020 con 0x7f5cec0d1ae0 2024-09-17T05:35:53.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.841+0000 7f5ce6000640 1 --2- 172.21.15.31:0/4016129866 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5cd0073a90 0x7f5cd0075f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:53.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.841+0000 7f5ce6000640 1 -- 172.21.15.31:0/4016129866 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f5ce0094840 con 0x7f5cec0d1ae0 2024-09-17T05:35:53.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.841+0000 7f5cf1400640 1 --2- 172.21.15.31:0/4016129866 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5cd0073a90 0x7f5cd0075f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:53.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.841+0000 7f5cf1400640 1 --2- 172.21.15.31:0/4016129866 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5cd0073a90 0x7f5cd0075f50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc0af000 tx=0x7f5cdc01b010 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:53.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:53.845+0000 7f5ce6000640 1 -- 172.21.15.31:0/4016129866 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5ce0020070 con 0x7f5cec0d1ae0 2024-09-17T05:35:54.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.061+0000 7f5cf3200640 1 -- 172.21.15.31:0/4016129866 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f5cec06def0 con 0x7f5cec0d1ae0 2024-09-17T05:35:54.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.369+0000 7f5ce6000640 1 -- 172.21.15.31:0/4016129866 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v101) ==== 136+0+0 (secure 0 0 0) 0x7f5ce005e690 con 0x7f5cec0d1ae0 2024-09-17T05:35:54.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.369+0000 7f5cf3200640 1 -- 172.21.15.31:0/4016129866 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5cd0073a90 msgr2=0x7f5cd0075f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.369+0000 7f5cf3200640 1 --2- 172.21.15.31:0/4016129866 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5cd0073a90 0x7f5cd0075f50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc0af000 tx=0x7f5cdc01b010 comp rx=0 tx=0).stop 2024-09-17T05:35:54.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.369+0000 7f5cf3200640 1 -- 172.21.15.31:0/4016129866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cec0d1ae0 msgr2=0x7f5cec153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.369+0000 7f5cf3200640 1 --2- 172.21.15.31:0/4016129866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cec0d1ae0 0x7f5cec153070 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000c460 tx=0x7f5ce000c920 comp rx=0 tx=0).stop 2024-09-17T05:35:54.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.369+0000 7f5cf3200640 1 -- 172.21.15.31:0/4016129866 shutdown_connections 2024-09-17T05:35:54.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.369+0000 7f5cf3200640 1 --2- 172.21.15.31:0/4016129866 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5cd0073a90 0x7f5cd0075f50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.369+0000 7f5cf3200640 1 --2- 172.21.15.31:0/4016129866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cec15dff0 0x7f5cec150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.369+0000 7f5cf3200640 1 --2- 172.21.15.31:0/4016129866 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cec0d24d0 0x7f5cec0b9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.369+0000 7f5cf3200640 1 --2- 172.21.15.31:0/4016129866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cec0d1ae0 0x7f5cec153070 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.369+0000 7f5cf3200640 1 -- 172.21.15.31:0/4016129866 >> 172.21.15.31:0/4016129866 conn(0x7f5cec0d3f10 msgr2=0x7f5cec0b5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:54.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.369+0000 7f5cf3200640 1 -- 172.21.15.31:0/4016129866 shutdown_connections 2024-09-17T05:35:54.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.369+0000 7f5cf3200640 1 -- 172.21.15.31:0/4016129866 wait complete. 2024-09-17T05:35:54.394 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:35:54.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.541+0000 7fd4dc200640 1 -- 172.21.15.31:0/2058027688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d415bea0 msgr2=0x7fd4d40ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.541+0000 7fd4dc200640 1 --2- 172.21.15.31:0/2058027688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d415bea0 0x7fd4d40ce670 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4073d10 tx=0x7fd4c801c830 comp rx=0 tx=0).stop 2024-09-17T05:35:54.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.541+0000 7fd4dc200640 1 -- 172.21.15.31:0/2058027688 shutdown_connections 2024-09-17T05:35:54.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.541+0000 7fd4dc200640 1 --2- 172.21.15.31:0/2058027688 >> v2:172.21.15.155:3300/0 conn(0x7fd4d40cdb30 0x7fd4d40cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.541+0000 7fd4dc200640 1 --2- 172.21.15.31:0/2058027688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d415bea0 0x7fd4d40ce670 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.541+0000 7fd4dc200640 1 -- 172.21.15.31:0/2058027688 >> 172.21.15.31:0/2058027688 conn(0x7fd4d40d1dc0 msgr2=0x7fd4d40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:54.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.541+0000 7fd4dc200640 1 -- 172.21.15.31:0/2058027688 shutdown_connections 2024-09-17T05:35:54.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.541+0000 7fd4dc200640 1 -- 172.21.15.31:0/2058027688 wait complete. 2024-09-17T05:35:54.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.541+0000 7fd4dc200640 1 Processor -- start 2024-09-17T05:35:54.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.541+0000 7fd4dc200640 1 -- start start 2024-09-17T05:35:54.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4dc200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4d40cdb30 0x7fd4d4158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4dc200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d40d28e0 0x7fd4d41660a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4dc200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4d415bea0 0x7fd4d40b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4dc200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d4168fc0 con 0x7fd4d40d28e0 2024-09-17T05:35:54.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4dc200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d4168e40 con 0x7fd4d40cdb30 2024-09-17T05:35:54.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4dc200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd4d4169140 con 0x7fd4d415bea0 2024-09-17T05:35:54.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4d8e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d40d28e0 0x7fd4d41660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4d8e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d40d28e0 0x7fd4d41660a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46620/0 (socket says 172.21.15.31:46620) 2024-09-17T05:35:54.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4d8e00640 1 -- 172.21.15.31:0/1645678304 learned_addr learned my addr 172.21.15.31:0/1645678304 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:54.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4d9800640 1 --2- 172.21.15.31:0/1645678304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4d40cdb30 0x7fd4d4158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4da200640 1 --2- 172.21.15.31:0/1645678304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4d415bea0 0x7fd4d40b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4d8e00640 1 -- 172.21.15.31:0/1645678304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4d415bea0 msgr2=0x7fd4d40b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4d8e00640 1 --2- 172.21.15.31:0/1645678304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4d415bea0 0x7fd4d40b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4d8e00640 1 -- 172.21.15.31:0/1645678304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4d40cdb30 msgr2=0x7fd4d4158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4d8e00640 1 --2- 172.21.15.31:0/1645678304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4d40cdb30 0x7fd4d4158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4d8e00640 1 -- 172.21.15.31:0/1645678304 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d40b1160 con 0x7fd4d40d28e0 2024-09-17T05:35:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4d8e00640 1 --2- 172.21.15.31:0/1645678304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d40d28e0 0x7fd4d41660a0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fd4c000d950 tx=0x7fd4c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4d1600640 1 -- 172.21.15.31:0/1645678304 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0017070 con 0x7fd4d40d28e0 2024-09-17T05:35:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4d1600640 1 -- 172.21.15.31:0/1645678304 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4c0009d20 con 0x7fd4d40d28e0 2024-09-17T05:35:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4d1600640 1 -- 172.21.15.31:0/1645678304 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c00106c0 con 0x7fd4d40d28e0 2024-09-17T05:35:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4dc200640 1 -- 172.21.15.31:0/1645678304 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4d40b1440 con 0x7fd4d40d28e0 2024-09-17T05:35:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4dc200640 1 -- 172.21.15.31:0/1645678304 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4d40b1a00 con 0x7fd4d40d28e0 2024-09-17T05:35:54.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4dc200640 1 -- 172.21.15.31:0/1645678304 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4d40cc9d0 con 0x7fd4d40d28e0 2024-09-17T05:35:54.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.545+0000 7fd4d1600640 1 -- 172.21.15.31:0/1645678304 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7fd4c0010860 con 0x7fd4d40d28e0 2024-09-17T05:35:54.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.549+0000 7fd4d1600640 1 --2- 172.21.15.31:0/1645678304 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd4b40738c0 0x7fd4b4075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.549+0000 7fd4d1600640 1 -- 172.21.15.31:0/1645678304 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7fd4c0095240 con 0x7fd4d40d28e0 2024-09-17T05:35:54.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.549+0000 7fd4d9800640 1 --2- 172.21.15.31:0/1645678304 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd4b40738c0 0x7fd4b4075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.549+0000 7fd4d9800640 1 --2- 172.21.15.31:0/1645678304 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd4b40738c0 0x7fd4b4075d80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80af000 tx=0x7fd4c80a7040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:54.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.553+0000 7fd4d1600640 1 -- 172.21.15.31:0/1645678304 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd4c005f1e0 con 0x7fd4d40d28e0 2024-09-17T05:35:54.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.749+0000 7fd4dc200640 1 -- 172.21.15.31:0/1645678304 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fd4d40b7820 con 0x7fd4b40738c0 2024-09-17T05:35:54.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.749+0000 7fd4d1600640 1 -- 172.21.15.31:0/1645678304 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fd4d40b7820 con 0x7fd4b40738c0 2024-09-17T05:35:54.751 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:35:54.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:35:54.751 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephfs" 2024-09-17T05:35:54.751 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:35:54.752 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:35:54.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.749+0000 7fd4dc200640 1 -- 172.21.15.31:0/1645678304 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd4b40738c0 msgr2=0x7fd4b4075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.749+0000 7fd4dc200640 1 --2- 172.21.15.31:0/1645678304 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd4b40738c0 0x7fd4b4075d80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80af000 tx=0x7fd4c80a7040 comp rx=0 tx=0).stop 2024-09-17T05:35:54.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.749+0000 7fd4dc200640 1 -- 172.21.15.31:0/1645678304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d40d28e0 msgr2=0x7fd4d41660a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.749+0000 7fd4dc200640 1 --2- 172.21.15.31:0/1645678304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d40d28e0 0x7fd4d41660a0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fd4c000d950 tx=0x7fd4c000de10 comp rx=0 tx=0).stop 2024-09-17T05:35:54.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.749+0000 7fd4dc200640 1 -- 172.21.15.31:0/1645678304 shutdown_connections 2024-09-17T05:35:54.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.749+0000 7fd4dc200640 1 --2- 172.21.15.31:0/1645678304 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd4b40738c0 0x7fd4b4075d80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.749+0000 7fd4dc200640 1 --2- 172.21.15.31:0/1645678304 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd4d415bea0 0x7fd4d40b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.749+0000 7fd4dc200640 1 --2- 172.21.15.31:0/1645678304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd4d40d28e0 0x7fd4d41660a0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.749+0000 7fd4dc200640 1 --2- 172.21.15.31:0/1645678304 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4d40cdb30 0x7fd4d4158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.749+0000 7fd4dc200640 1 -- 172.21.15.31:0/1645678304 >> 172.21.15.31:0/1645678304 conn(0x7fd4d40d1dc0 msgr2=0x7fd4d40d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:54.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.749+0000 7fd4dc200640 1 -- 172.21.15.31:0/1645678304 shutdown_connections 2024-09-17T05:35:54.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.749+0000 7fd4dc200640 1 -- 172.21.15.31:0/1645678304 wait complete. 2024-09-17T05:35:54.774 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:35:54.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd5be00640 1 -- 172.21.15.31:0/3022836868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd5415f220 msgr2=0x7fdd5415b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd5be00640 1 --2- 172.21.15.31:0/3022836868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd5415f220 0x7fdd5415b010 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009900 tx=0x7fdd4001c8b0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd5be00640 1 -- 172.21.15.31:0/3022836868 shutdown_connections 2024-09-17T05:35:54.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd5be00640 1 --2- 172.21.15.31:0/3022836868 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd5415f220 0x7fdd5415b010 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd5be00640 1 --2- 172.21.15.31:0/3022836868 >> v2:172.21.15.155:3300/0 conn(0x7fdd541584d0 0x7fdd5415c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd5be00640 1 -- 172.21.15.31:0/3022836868 >> 172.21.15.31:0/3022836868 conn(0x7fdd5406ecb0 msgr2=0x7fdd5406f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:54.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd5be00640 1 -- 172.21.15.31:0/3022836868 shutdown_connections 2024-09-17T05:35:54.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd5be00640 1 -- 172.21.15.31:0/3022836868 wait complete. 2024-09-17T05:35:54.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd5be00640 1 Processor -- start 2024-09-17T05:35:54.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd5be00640 1 -- start start 2024-09-17T05:35:54.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd5be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd540740c0 0x7fdd541fbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd5be00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd541584d0 0x7fdd54143b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd5be00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd5415f220 0x7fdd540d0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd5be00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdd54167ff0 con 0x7fdd540740c0 2024-09-17T05:35:54.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd5be00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdd54168170 con 0x7fdd541584d0 2024-09-17T05:35:54.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd5be00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdd541682f0 con 0x7fdd5415f220 2024-09-17T05:35:54.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd59400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd540740c0 0x7fdd541fbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd59400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd540740c0 0x7fdd541fbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46622/0 (socket says 172.21.15.31:46622) 2024-09-17T05:35:54.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd59400640 1 -- 172.21.15.31:0/165258491 learned_addr learned my addr 172.21.15.31:0/165258491 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:54.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd58a00640 1 --2- 172.21.15.31:0/165258491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd541584d0 0x7fdd54143b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.925+0000 7fdd59e00640 1 --2- 172.21.15.31:0/165258491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd5415f220 0x7fdd540d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.929+0000 7fdd59400640 1 -- 172.21.15.31:0/165258491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd5415f220 msgr2=0x7fdd540d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.929+0000 7fdd59400640 1 --2- 172.21.15.31:0/165258491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd5415f220 0x7fdd540d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.929+0000 7fdd59400640 1 -- 172.21.15.31:0/165258491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd541584d0 msgr2=0x7fdd54143b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:54.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.929+0000 7fdd59400640 1 --2- 172.21.15.31:0/165258491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd541584d0 0x7fdd54143b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:54.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.929+0000 7fdd59400640 1 -- 172.21.15.31:0/165258491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd540d0ab0 con 0x7fdd540740c0 2024-09-17T05:35:54.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.929+0000 7fdd58a00640 1 --2- 172.21.15.31:0/165258491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd541584d0 0x7fdd54143b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:35:54.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.929+0000 7fdd59400640 1 --2- 172.21.15.31:0/165258491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd540740c0 0x7fdd541fbee0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800ea40 tx=0x7fdd4800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:54.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.929+0000 7fdd51600640 1 -- 172.21.15.31:0/165258491 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800ce40 con 0x7fdd540740c0 2024-09-17T05:35:54.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.929+0000 7fdd51600640 1 -- 172.21.15.31:0/165258491 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd48004020 con 0x7fdd540740c0 2024-09-17T05:35:54.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.929+0000 7fdd5be00640 1 -- 172.21.15.31:0/165258491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd54157d40 con 0x7fdd540740c0 2024-09-17T05:35:54.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.929+0000 7fdd51600640 1 -- 172.21.15.31:0/165258491 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48004470 con 0x7fdd540740c0 2024-09-17T05:35:54.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.929+0000 7fdd5be00640 1 -- 172.21.15.31:0/165258491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd541fb6e0 con 0x7fdd540740c0 2024-09-17T05:35:54.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.929+0000 7fdd5be00640 1 -- 172.21.15.31:0/165258491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd5415c220 con 0x7fdd540740c0 2024-09-17T05:35:54.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.929+0000 7fdd51600640 1 -- 172.21.15.31:0/165258491 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7fdd48003600 con 0x7fdd540740c0 2024-09-17T05:35:54.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.929+0000 7fdd51600640 1 --2- 172.21.15.31:0/165258491 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdd340738f0 0x7fdd34075db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:54.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.929+0000 7fdd51600640 1 -- 172.21.15.31:0/165258491 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7fdd48095640 con 0x7fdd540740c0 2024-09-17T05:35:54.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.933+0000 7fdd58a00640 1 --2- 172.21.15.31:0/165258491 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdd340738f0 0x7fdd34075db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:54.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.933+0000 7fdd58a00640 1 --2- 172.21.15.31:0/165258491 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdd340738f0 0x7fdd34075db0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdd400af000 tx=0x7fdd400a6f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:54.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:54.937+0000 7fdd51600640 1 -- 172.21.15.31:0/165258491 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fdd4805f6b0 con 0x7fdd540740c0 2024-09-17T05:35:55.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.113+0000 7fdd5be00640 1 -- 172.21.15.31:0/165258491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fdd540b1e80 con 0x7fdd540740c0 2024-09-17T05:35:55.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.113+0000 7fdd51600640 1 -- 172.21.15.31:0/165258491 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v44)=0 v44) ==== 122+0+0 (secure 0 0 0) 0x7fdd480640e0 con 0x7fdd540740c0 2024-09-17T05:35:55.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.113+0000 7fdd5be00640 1 -- 172.21.15.31:0/165258491 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdd340738f0 msgr2=0x7fdd34075db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.113+0000 7fdd5be00640 1 --2- 172.21.15.31:0/165258491 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdd340738f0 0x7fdd34075db0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdd400af000 tx=0x7fdd400a6f90 comp rx=0 tx=0).stop 2024-09-17T05:35:55.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.113+0000 7fdd5be00640 1 -- 172.21.15.31:0/165258491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd540740c0 msgr2=0x7fdd541fbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.113+0000 7fdd5be00640 1 --2- 172.21.15.31:0/165258491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd540740c0 0x7fdd541fbee0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800ea40 tx=0x7fdd4800ef00 comp rx=0 tx=0).stop 2024-09-17T05:35:55.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.113+0000 7fdd5be00640 1 -- 172.21.15.31:0/165258491 shutdown_connections 2024-09-17T05:35:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.113+0000 7fdd5be00640 1 --2- 172.21.15.31:0/165258491 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdd340738f0 0x7fdd34075db0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.113+0000 7fdd5be00640 1 --2- 172.21.15.31:0/165258491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdd5415f220 0x7fdd540d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.113+0000 7fdd5be00640 1 --2- 172.21.15.31:0/165258491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd541584d0 0x7fdd54143b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.113+0000 7fdd5be00640 1 --2- 172.21.15.31:0/165258491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd540740c0 0x7fdd541fbee0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.113+0000 7fdd5be00640 1 -- 172.21.15.31:0/165258491 >> 172.21.15.31:0/165258491 conn(0x7fdd5406ecb0 msgr2=0x7fdd5415d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.113+0000 7fdd5be00640 1 -- 172.21.15.31:0/165258491 shutdown_connections 2024-09-17T05:35:55.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.113+0000 7fdd5be00640 1 -- 172.21.15.31:0/165258491 wait complete. 2024-09-17T05:35:55.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:55.135 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/_nogroup/subvol42630) 2024-09-17T05:35:55.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:55.163 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp13960/subvol36381) 2024-09-17T05:35:55.231 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol42630 2024-09-17T05:35:55.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.421+0000 7f466c200640 1 -- 172.21.15.31:0/3443663699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640cbeb0 msgr2=0x7f46641602f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.421+0000 7f466c200640 1 --2- 172.21.15.31:0/3443663699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640cbeb0 0x7f46641602f0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f4650009900 tx=0x7f465001c8e0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.421+0000 7f466c200640 1 -- 172.21.15.31:0/3443663699 shutdown_connections 2024-09-17T05:35:55.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.421+0000 7f466c200640 1 --2- 172.21.15.31:0/3443663699 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640cbeb0 0x7f46641602f0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.421+0000 7f466c200640 1 -- 172.21.15.31:0/3443663699 >> 172.21.15.31:0/3443663699 conn(0x7f46640cd740 msgr2=0x7f46640cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:55.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.421+0000 7f466c200640 1 -- 172.21.15.31:0/3443663699 shutdown_connections 2024-09-17T05:35:55.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.421+0000 7f466c200640 1 -- 172.21.15.31:0/3443663699 wait complete. 2024-09-17T05:35:55.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.421+0000 7f466c200640 1 Processor -- start 2024-09-17T05:35:55.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.421+0000 7f466c200640 1 -- start start 2024-09-17T05:35:55.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f466c200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f466406cc20 0x7f46641fc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:55.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f466c200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640cbeb0 0x7f46640cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:55.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f466c200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f466415be10 0x7f46640d0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:55.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f466c200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f466416aa30 con 0x7f46640cbeb0 2024-09-17T05:35:55.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f466c200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f466416a8b0 con 0x7f466406cc20 2024-09-17T05:35:55.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f466c200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f466416abb0 con 0x7f466415be10 2024-09-17T05:35:55.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f4668e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640cbeb0 0x7f46640cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:55.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f4668e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640cbeb0 0x7f46640cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46628/0 (socket says 172.21.15.31:46628) 2024-09-17T05:35:55.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f4668e00640 1 -- 172.21.15.31:0/2798223343 learned_addr learned my addr 172.21.15.31:0/2798223343 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:55.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f4669800640 1 --2- 172.21.15.31:0/2798223343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f466406cc20 0x7f46641fc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:55.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f466a200640 1 --2- 172.21.15.31:0/2798223343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f466415be10 0x7f46640d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:55.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f4668e00640 1 -- 172.21.15.31:0/2798223343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f466415be10 msgr2=0x7f46640d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f4668e00640 1 --2- 172.21.15.31:0/2798223343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f466415be10 0x7f46640d0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f4668e00640 1 -- 172.21.15.31:0/2798223343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f466406cc20 msgr2=0x7f46641fc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f4668e00640 1 --2- 172.21.15.31:0/2798223343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f466406cc20 0x7f46641fc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f4668e00640 1 -- 172.21.15.31:0/2798223343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4664200230 con 0x7f46640cbeb0 2024-09-17T05:35:55.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f4669800640 1 --2- 172.21.15.31:0/2798223343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f466406cc20 0x7f46641fc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:35:55.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f4668e00640 1 --2- 172.21.15.31:0/2798223343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640cbeb0 0x7f46640cfcd0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f4650009850 tx=0x7f4650004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:55.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f4661600640 1 -- 172.21.15.31:0/2798223343 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46500b2040 con 0x7f46640cbeb0 2024-09-17T05:35:55.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f4661600640 1 -- 172.21.15.31:0/2798223343 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4650004430 con 0x7f46640cbeb0 2024-09-17T05:35:55.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f4661600640 1 -- 172.21.15.31:0/2798223343 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4650005280 con 0x7f46640cbeb0 2024-09-17T05:35:55.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f466c200640 1 -- 172.21.15.31:0/2798223343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4664153600 con 0x7f46640cbeb0 2024-09-17T05:35:55.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f466c200640 1 -- 172.21.15.31:0/2798223343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46641532b0 con 0x7f46640cbeb0 2024-09-17T05:35:55.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f466c200640 1 -- 172.21.15.31:0/2798223343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4664073a40 con 0x7f46640cbeb0 2024-09-17T05:35:55.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.425+0000 7f4661600640 1 -- 172.21.15.31:0/2798223343 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7f4650005420 con 0x7f46640cbeb0 2024-09-17T05:35:55.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.429+0000 7f4661600640 1 --2- 172.21.15.31:0/2798223343 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f46440738c0 0x7f4644075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:55.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.429+0000 7f4661600640 1 -- 172.21.15.31:0/2798223343 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f465012e8f0 con 0x7f46640cbeb0 2024-09-17T05:35:55.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.429+0000 7f4669800640 1 --2- 172.21.15.31:0/2798223343 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f46440738c0 0x7f4644075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:55.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.429+0000 7f4669800640 1 --2- 172.21.15.31:0/2798223343 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f46440738c0 0x7f4644075d80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f46580098b0 tx=0x7f4658008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:55.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.433+0000 7f4661600640 1 -- 172.21.15.31:0/2798223343 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f46500164d0 con 0x7f46640cbeb0 2024-09-17T05:35:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.637+0000 7f466c200640 1 -- 172.21.15.31:0/2798223343 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol42630", "target": ["mon-mgr", ""]}) -- 0x7f46640b6c40 con 0x7f46440738c0 2024-09-17T05:35:55.644 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:55.641+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:35:55.644 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:55.641+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:35:55.644 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:55.641+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:35:55.644 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:55.641+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:35:55.644 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:35:55.641+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:35:55.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.677+0000 7f4661600640 1 -- 172.21.15.31:0/2798223343 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7f46640b6c40 con 0x7f46440738c0 2024-09-17T05:35:55.678 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/_nogroup/subvol42630 2024-09-17T05:35:55.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.677+0000 7f466c200640 1 -- 172.21.15.31:0/2798223343 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f46440738c0 msgr2=0x7f4644075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.677+0000 7f466c200640 1 --2- 172.21.15.31:0/2798223343 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f46440738c0 0x7f4644075d80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f46580098b0 tx=0x7f4658008040 comp rx=0 tx=0).stop 2024-09-17T05:35:55.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.677+0000 7f466c200640 1 -- 172.21.15.31:0/2798223343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640cbeb0 msgr2=0x7f46640cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.677+0000 7f466c200640 1 --2- 172.21.15.31:0/2798223343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640cbeb0 0x7f46640cfcd0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f4650009850 tx=0x7f4650004040 comp rx=0 tx=0).stop 2024-09-17T05:35:55.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.677+0000 7f466c200640 1 -- 172.21.15.31:0/2798223343 shutdown_connections 2024-09-17T05:35:55.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.677+0000 7f466c200640 1 --2- 172.21.15.31:0/2798223343 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f46440738c0 0x7f4644075d80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.677+0000 7f466c200640 1 --2- 172.21.15.31:0/2798223343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f466415be10 0x7f46640d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.677+0000 7f466c200640 1 --2- 172.21.15.31:0/2798223343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46640cbeb0 0x7f46640cfcd0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.677+0000 7f466c200640 1 --2- 172.21.15.31:0/2798223343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f466406cc20 0x7f46641fc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.677+0000 7f466c200640 1 -- 172.21.15.31:0/2798223343 >> 172.21.15.31:0/2798223343 conn(0x7f46640cd740 msgr2=0x7f46640cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.677+0000 7f466c200640 1 -- 172.21.15.31:0/2798223343 shutdown_connections 2024-09-17T05:35:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.677+0000 7f466c200640 1 -- 172.21.15.31:0/2798223343 wait complete. 2024-09-17T05:35:55.700 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol36381 subvol_grp13960 2024-09-17T05:35:55.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.849+0000 7fee39800640 1 -- 172.21.15.31:0/1944682016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee340d20a0 msgr2=0x7fee340d2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.849+0000 7fee39800640 1 --2- 172.21.15.31:0/1944682016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee340d20a0 0x7fee340d2540 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009c80 tx=0x7fee2c01cda0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.849+0000 7fee39800640 1 -- 172.21.15.31:0/1944682016 shutdown_connections 2024-09-17T05:35:55.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.849+0000 7fee39800640 1 --2- 172.21.15.31:0/1944682016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee340d20a0 0x7fee340d2540 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.849+0000 7fee39800640 1 --2- 172.21.15.31:0/1944682016 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee3415e220 0x7fee340d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.849+0000 7fee39800640 1 -- 172.21.15.31:0/1944682016 >> 172.21.15.31:0/1944682016 conn(0x7fee340d3f90 msgr2=0x7fee340d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:55.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.849+0000 7fee39800640 1 -- 172.21.15.31:0/1944682016 shutdown_connections 2024-09-17T05:35:55.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.849+0000 7fee39800640 1 -- 172.21.15.31:0/1944682016 wait complete. 2024-09-17T05:35:55.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee39800640 1 Processor -- start 2024-09-17T05:35:55.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee39800640 1 -- start start 2024-09-17T05:35:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee39800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee340d20a0 0x7fee340ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee39800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee3415de40 0x7fee341fbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee39800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee3415e220 0x7fee341fc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee39800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fee3416b590 con 0x7fee3415de40 2024-09-17T05:35:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee39800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fee3416b410 con 0x7fee340d20a0 2024-09-17T05:35:55.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee39800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fee3416b710 con 0x7fee3415e220 2024-09-17T05:35:55.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee2a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee3415de40 0x7fee341fbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:55.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee2a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee3415de40 0x7fee341fbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46660/0 (socket says 172.21.15.31:46660) 2024-09-17T05:35:55.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee2a000640 1 -- 172.21.15.31:0/3673299870 learned_addr learned my addr 172.21.15.31:0/3673299870 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:55.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee33400640 1 --2- 172.21.15.31:0/3673299870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee3415e220 0x7fee341fc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:55.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee32a00640 1 --2- 172.21.15.31:0/3673299870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee340d20a0 0x7fee340ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:55.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee2a000640 1 -- 172.21.15.31:0/3673299870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee3415e220 msgr2=0x7fee341fc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee2a000640 1 --2- 172.21.15.31:0/3673299870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee3415e220 0x7fee341fc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee2a000640 1 -- 172.21.15.31:0/3673299870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee340d20a0 msgr2=0x7fee340ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:55.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee2a000640 1 --2- 172.21.15.31:0/3673299870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee340d20a0 0x7fee340ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:55.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee2a000640 1 -- 172.21.15.31:0/3673299870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3406dfd0 con 0x7fee3415de40 2024-09-17T05:35:55.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee2a000640 1 --2- 172.21.15.31:0/3673299870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee3415de40 0x7fee341fbf80 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00d720 tx=0x7fee1c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:55.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee2b400640 1 -- 172.21.15.31:0/3673299870 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c017070 con 0x7fee3415de40 2024-09-17T05:35:55.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee2b400640 1 -- 172.21.15.31:0/3673299870 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee1c005310 con 0x7fee3415de40 2024-09-17T05:35:55.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee2b400640 1 -- 172.21.15.31:0/3673299870 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c009820 con 0x7fee3415de40 2024-09-17T05:35:55.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee39800640 1 -- 172.21.15.31:0/3673299870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee3406e2b0 con 0x7fee3415de40 2024-09-17T05:35:55.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee39800640 1 -- 172.21.15.31:0/3673299870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee34151590 con 0x7fee3415de40 2024-09-17T05:35:55.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.853+0000 7fee39800640 1 -- 172.21.15.31:0/3673299870 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee340d2540 con 0x7fee3415de40 2024-09-17T05:35:55.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.857+0000 7fee2b400640 1 -- 172.21.15.31:0/3673299870 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7fee1c0099c0 con 0x7fee3415de40 2024-09-17T05:35:55.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.857+0000 7fee2b400640 1 --2- 172.21.15.31:0/3673299870 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee100738c0 0x7fee10075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:55.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.857+0000 7fee2b400640 1 -- 172.21.15.31:0/3673299870 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7fee1c095000 con 0x7fee3415de40 2024-09-17T05:35:55.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.857+0000 7fee32a00640 1 --2- 172.21.15.31:0/3673299870 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee100738c0 0x7fee10075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:55.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.857+0000 7fee32a00640 1 --2- 172.21.15.31:0/3673299870 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee100738c0 0x7fee10075d80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fee340d1130 tx=0x7fee24009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:55.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:55.861+0000 7fee2b400640 1 -- 172.21.15.31:0/3673299870 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fee1c05ef60 con 0x7fee3415de40 2024-09-17T05:35:56.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.065+0000 7fee39800640 1 -- 172.21.15.31:0/3673299870 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol36381", "group_name": "subvol_grp13960", "target": ["mon-mgr", ""]}) -- 0x7fee3406add0 con 0x7fee100738c0 2024-09-17T05:35:56.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.085+0000 7fee2b400640 1 -- 172.21.15.31:0/3673299870 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fee3406add0 con 0x7fee100738c0 2024-09-17T05:35:56.085 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/subvol_grp13960/subvol36381 2024-09-17T05:35:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.085+0000 7fee39800640 1 -- 172.21.15.31:0/3673299870 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee100738c0 msgr2=0x7fee10075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.085+0000 7fee39800640 1 --2- 172.21.15.31:0/3673299870 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee100738c0 0x7fee10075d80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fee340d1130 tx=0x7fee24009040 comp rx=0 tx=0).stop 2024-09-17T05:35:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.085+0000 7fee39800640 1 -- 172.21.15.31:0/3673299870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee3415de40 msgr2=0x7fee341fbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.085+0000 7fee39800640 1 --2- 172.21.15.31:0/3673299870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee3415de40 0x7fee341fbf80 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00d720 tx=0x7fee1c00dbe0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.085+0000 7fee39800640 1 -- 172.21.15.31:0/3673299870 shutdown_connections 2024-09-17T05:35:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.085+0000 7fee39800640 1 --2- 172.21.15.31:0/3673299870 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee100738c0 0x7fee10075d80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.085+0000 7fee39800640 1 --2- 172.21.15.31:0/3673299870 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee3415e220 0x7fee341fc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.085+0000 7fee39800640 1 --2- 172.21.15.31:0/3673299870 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee3415de40 0x7fee341fbf80 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.085+0000 7fee39800640 1 --2- 172.21.15.31:0/3673299870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee340d20a0 0x7fee340ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.085+0000 7fee39800640 1 -- 172.21.15.31:0/3673299870 >> 172.21.15.31:0/3673299870 conn(0x7fee340d3f90 msgr2=0x7fee3415b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:56.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.085+0000 7fee39800640 1 -- 172.21.15.31:0/3673299870 shutdown_connections 2024-09-17T05:35:56.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.085+0000 7fee39800640 1 -- 172.21.15.31:0/3673299870 wait complete. 2024-09-17T05:35:56.106 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol42630 2024-09-17T05:35:56.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.253+0000 7fa83f000640 1 -- 172.21.15.31:0/3373809064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8380b4bd0 msgr2=0x7fa8380cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:56.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.253+0000 7fa83f000640 1 --2- 172.21.15.31:0/3373809064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8380b4bd0 0x7fa8380cf130 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fa830009c80 tx=0x7fa83001cda0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.253+0000 7fa83f000640 1 -- 172.21.15.31:0/3373809064 shutdown_connections 2024-09-17T05:35:56.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.253+0000 7fa83f000640 1 --2- 172.21.15.31:0/3373809064 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8380b4bd0 0x7fa8380cf130 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.253+0000 7fa83f000640 1 --2- 172.21.15.31:0/3373809064 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa83815ade0 0x7fa8380cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.253+0000 7fa83f000640 1 -- 172.21.15.31:0/3373809064 >> 172.21.15.31:0/3373809064 conn(0x7fa8380b18f0 msgr2=0x7fa8380b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:56.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.253+0000 7fa83f000640 1 -- 172.21.15.31:0/3373809064 shutdown_connections 2024-09-17T05:35:56.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.253+0000 7fa83f000640 1 -- 172.21.15.31:0/3373809064 wait complete. 2024-09-17T05:35:56.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa83f000640 1 Processor -- start 2024-09-17T05:35:56.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa83f000640 1 -- start start 2024-09-17T05:35:56.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa83f000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa83806e810 0x7fa838155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:56.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa83f000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8380b4bd0 0x7fa83814a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:56.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa83f000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa83815ade0 0x7fa8381fb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:56.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa83f000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa8381680e0 con 0x7fa8380b4bd0 2024-09-17T05:35:56.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa83f000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa838167f60 con 0x7fa83806e810 2024-09-17T05:35:56.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa83f000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa838168260 con 0x7fa83815ade0 2024-09-17T05:35:56.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa82fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8380b4bd0 0x7fa83814a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:56.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa82fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8380b4bd0 0x7fa83814a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46690/0 (socket says 172.21.15.31:46690) 2024-09-17T05:35:56.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa82fe00640 1 -- 172.21.15.31:0/3208692000 learned_addr learned my addr 172.21.15.31:0/3208692000 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:35:56.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa837e00640 1 --2- 172.21.15.31:0/3208692000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa83806e810 0x7fa838155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:56.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa83d000640 1 --2- 172.21.15.31:0/3208692000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa83815ade0 0x7fa8381fb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:56.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa82fe00640 1 -- 172.21.15.31:0/3208692000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa83815ade0 msgr2=0x7fa8381fb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:56.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa82fe00640 1 --2- 172.21.15.31:0/3208692000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa83815ade0 0x7fa8381fb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa82fe00640 1 -- 172.21.15.31:0/3208692000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa83806e810 msgr2=0x7fa838155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:56.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa82fe00640 1 --2- 172.21.15.31:0/3208692000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa83806e810 0x7fa838155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa82fe00640 1 -- 172.21.15.31:0/3208692000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa838155690 con 0x7fa8380b4bd0 2024-09-17T05:35:56.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa82fe00640 1 --2- 172.21.15.31:0/3208692000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8380b4bd0 0x7fa83814a010 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fa82000c3c0 tx=0x7fa82000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:56.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa834c00640 1 -- 172.21.15.31:0/3208692000 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820017070 con 0x7fa8380b4bd0 2024-09-17T05:35:56.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa834c00640 1 -- 172.21.15.31:0/3208692000 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8200053c0 con 0x7fa8380b4bd0 2024-09-17T05:35:56.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa834c00640 1 -- 172.21.15.31:0/3208692000 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820003860 con 0x7fa8380b4bd0 2024-09-17T05:35:56.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa83f000640 1 -- 172.21.15.31:0/3208692000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83814f6d0 con 0x7fa8380b4bd0 2024-09-17T05:35:56.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.257+0000 7fa83f000640 1 -- 172.21.15.31:0/3208692000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa83814fc90 con 0x7fa8380b4bd0 2024-09-17T05:35:56.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.261+0000 7fa83f000640 1 -- 172.21.15.31:0/3208692000 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa83815e900 con 0x7fa8380b4bd0 2024-09-17T05:35:56.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.261+0000 7fa834c00640 1 -- 172.21.15.31:0/3208692000 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 23) ==== 97846+0+0 (secure 0 0 0) 0x7fa82001a070 con 0x7fa8380b4bd0 2024-09-17T05:35:56.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.261+0000 7fa834c00640 1 --2- 172.21.15.31:0/3208692000 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa8140738c0 0x7fa814075d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:35:56.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.261+0000 7fa834c00640 1 -- 172.21.15.31:0/3208692000 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7fa8200942d0 con 0x7fa8380b4bd0 2024-09-17T05:35:56.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.261+0000 7fa837e00640 1 --2- 172.21.15.31:0/3208692000 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa8140738c0 0x7fa814075d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:35:56.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.261+0000 7fa837e00640 1 --2- 172.21.15.31:0/3208692000 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa8140738c0 0x7fa814075d80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa8280058d0 tx=0x7fa828005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:35:56.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.265+0000 7fa834c00640 1 -- 172.21.15.31:0/3208692000 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa82005e7f0 con 0x7fa8380b4bd0 2024-09-17T05:35:56.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.385+0000 7fa834c00640 1 -- 172.21.15.31:0/3208692000 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mgrmap(e 24) ==== 97897+0+0 (secure 0 0 0) 0x7fa82005a360 con 0x7fa8380b4bd0 2024-09-17T05:35:56.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.477+0000 7fa83f000640 1 -- 172.21.15.31:0/3208692000 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol42630", "target": ["mon-mgr", ""]}) -- 0x7fa8380cf720 con 0x7fa8140738c0 2024-09-17T05:35:56.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.481+0000 7fa834c00640 1 -- 172.21.15.31:0/3208692000 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7fa8380cf720 con 0x7fa8140738c0 2024-09-17T05:35:56.483 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/_nogroup/subvol42630 2024-09-17T05:35:56.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.485+0000 7fa83f000640 1 -- 172.21.15.31:0/3208692000 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa8140738c0 msgr2=0x7fa814075d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:56.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.485+0000 7fa83f000640 1 --2- 172.21.15.31:0/3208692000 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa8140738c0 0x7fa814075d80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa8280058d0 tx=0x7fa828005860 comp rx=0 tx=0).stop 2024-09-17T05:35:56.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.485+0000 7fa83f000640 1 -- 172.21.15.31:0/3208692000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8380b4bd0 msgr2=0x7fa83814a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:35:56.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.485+0000 7fa83f000640 1 --2- 172.21.15.31:0/3208692000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8380b4bd0 0x7fa83814a010 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fa82000c3c0 tx=0x7fa82000c880 comp rx=0 tx=0).stop 2024-09-17T05:35:56.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.485+0000 7fa83f000640 1 -- 172.21.15.31:0/3208692000 shutdown_connections 2024-09-17T05:35:56.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.485+0000 7fa83f000640 1 --2- 172.21.15.31:0/3208692000 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa8140738c0 0x7fa814075d80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.485+0000 7fa83f000640 1 --2- 172.21.15.31:0/3208692000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa83815ade0 0x7fa8381fb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.485+0000 7fa83f000640 1 --2- 172.21.15.31:0/3208692000 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8380b4bd0 0x7fa83814a010 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.485+0000 7fa83f000640 1 --2- 172.21.15.31:0/3208692000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa83806e810 0x7fa838155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:35:56.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.485+0000 7fa83f000640 1 -- 172.21.15.31:0/3208692000 >> 172.21.15.31:0/3208692000 conn(0x7fa8380b18f0 msgr2=0x7fa8381572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:35:56.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.485+0000 7fa83f000640 1 -- 172.21.15.31:0/3208692000 shutdown_connections 2024-09-17T05:35:56.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:35:56.485+0000 7fa83f000640 1 -- 172.21.15.31:0/3208692000 wait complete. 2024-09-17T05:35:56.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:35:56.505 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/e582bb2964aba31782e39e2cfca73630.meta) 2024-09-17T05:36:00.892 INFO:teuthology.orchestra.run.smithi031.stdout:[GLOBAL] 2024-09-17T05:36:00.892 INFO:teuthology.orchestra.run.smithi031.stdout:version = 1 2024-09-17T05:36:00.893 INFO:teuthology.orchestra.run.smithi031.stdout:type = subvolume 2024-09-17T05:36:00.893 INFO:teuthology.orchestra.run.smithi031.stdout:path = /volumes/_nogroup/subvol42630 2024-09-17T05:36:00.893 INFO:teuthology.orchestra.run.smithi031.stdout:state = complete 2024-09-17T05:36:00.893 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:00.895 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol36381 subvol_grp13960 2024-09-17T05:36:01.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe7200640 1 -- 172.21.15.31:0/215564316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe80d02e0 msgr2=0x7f6fe80d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:01.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe7200640 1 --2- 172.21.15.31:0/215564316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe80d02e0 0x7f6fe80d0720 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009900 tx=0x7f6fd001c8b0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe7200640 1 -- 172.21.15.31:0/215564316 shutdown_connections 2024-09-17T05:36:01.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe7200640 1 --2- 172.21.15.31:0/215564316 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe80d02e0 0x7f6fe80d0720 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe7200640 1 --2- 172.21.15.31:0/215564316 >> v2:172.21.15.155:3300/0 conn(0x7f6fe80cff00 0x7f6fe80d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe7200640 1 -- 172.21.15.31:0/215564316 >> 172.21.15.31:0/215564316 conn(0x7f6fe80d1da0 msgr2=0x7f6fe80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:01.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe7200640 1 -- 172.21.15.31:0/215564316 shutdown_connections 2024-09-17T05:36:01.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe7200640 1 -- 172.21.15.31:0/215564316 wait complete. 2024-09-17T05:36:01.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe7200640 1 Processor -- start 2024-09-17T05:36:01.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe7200640 1 -- start start 2024-09-17T05:36:01.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe7200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fe80cff00 0x7f6fe80b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:01.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe7200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe80d02e0 0x7f6fe81f8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:01.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe7200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe815eff0 0x7f6fe80b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:01.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe7200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe8169140 con 0x7f6fe815eff0 2024-09-17T05:36:01.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe7200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe8168fc0 con 0x7f6fe80cff00 2024-09-17T05:36:01.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe7200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe81692c0 con 0x7f6fe80d02e0 2024-09-17T05:36:01.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe6800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe815eff0 0x7f6fe80b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:01.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe6800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe815eff0 0x7f6fe80b59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49102/0 (socket says 172.21.15.31:49102) 2024-09-17T05:36:01.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe6800640 1 -- 172.21.15.31:0/4008186858 learned_addr learned my addr 172.21.15.31:0/4008186858 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:01.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fe5e00640 1 --2- 172.21.15.31:0/4008186858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fe80cff00 0x7f6fe80b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:01.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.057+0000 7f6fdfe00640 1 --2- 172.21.15.31:0/4008186858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe80d02e0 0x7f6fe81f8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:01.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.061+0000 7f6fe6800640 1 -- 172.21.15.31:0/4008186858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe80d02e0 msgr2=0x7f6fe81f8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:01.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.061+0000 7f6fe6800640 1 --2- 172.21.15.31:0/4008186858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe80d02e0 0x7f6fe81f8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.061+0000 7f6fe6800640 1 -- 172.21.15.31:0/4008186858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fe80cff00 msgr2=0x7f6fe80b72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:01.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.061+0000 7f6fe6800640 1 --2- 172.21.15.31:0/4008186858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fe80cff00 0x7f6fe80b72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.061+0000 7f6fe6800640 1 -- 172.21.15.31:0/4008186858 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe80b7980 con 0x7f6fe815eff0 2024-09-17T05:36:01.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.061+0000 7f6fe6800640 1 --2- 172.21.15.31:0/4008186858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe815eff0 0x7f6fe80b59b0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000c710 tx=0x7f6fe000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:01.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.061+0000 7f6fde000640 1 -- 172.21.15.31:0/4008186858 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0003b80 con 0x7f6fe815eff0 2024-09-17T05:36:01.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.061+0000 7f6fde000640 1 -- 172.21.15.31:0/4008186858 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6fe0003d20 con 0x7f6fe815eff0 2024-09-17T05:36:01.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.061+0000 7f6fde000640 1 -- 172.21.15.31:0/4008186858 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe000aab0 con 0x7f6fe815eff0 2024-09-17T05:36:01.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.061+0000 7f6fe7200640 1 -- 172.21.15.31:0/4008186858 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe80b4bf0 con 0x7f6fe815eff0 2024-09-17T05:36:01.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.061+0000 7f6fe7200640 1 -- 172.21.15.31:0/4008186858 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe80b51b0 con 0x7f6fe815eff0 2024-09-17T05:36:01.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.061+0000 7f6fe7200640 1 -- 172.21.15.31:0/4008186858 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fe80d28c0 con 0x7f6fe815eff0 2024-09-17T05:36:01.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.061+0000 7f6fde000640 1 -- 172.21.15.31:0/4008186858 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 24) ==== 97897+0+0 (secure 0 0 0) 0x7f6fe000ac50 con 0x7f6fe815eff0 2024-09-17T05:36:01.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.065+0000 7f6fde000640 1 --2- 172.21.15.31:0/4008186858 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6fc4073980 0x7f6fc4075e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:01.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.065+0000 7f6fde000640 1 -- 172.21.15.31:0/4008186858 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f6fe0095190 con 0x7f6fe815eff0 2024-09-17T05:36:01.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.065+0000 7f6fe5e00640 1 --2- 172.21.15.31:0/4008186858 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6fc4073980 0x7f6fc4075e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:01.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.065+0000 7f6fe5e00640 1 --2- 172.21.15.31:0/4008186858 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6fc4073980 0x7f6fc4075e40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8009be0 tx=0x7f6fd80091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:01.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.069+0000 7f6fde000640 1 -- 172.21.15.31:0/4008186858 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6fe000ce20 con 0x7f6fe815eff0 2024-09-17T05:36:01.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.269+0000 7f6fe7200640 1 -- 172.21.15.31:0/4008186858 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol36381", "group_name": "subvol_grp13960", "target": ["mon-mgr", ""]}) -- 0x7f6fe8069e60 con 0x7f6fc4073980 2024-09-17T05:36:01.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.273+0000 7f6fde000640 1 -- 172.21.15.31:0/4008186858 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6fd8004040 con 0x7f6fc4073980 2024-09-17T05:36:01.276 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/subvol_grp13960/subvol36381 2024-09-17T05:36:01.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.277+0000 7f6fe7200640 1 -- 172.21.15.31:0/4008186858 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6fc4073980 msgr2=0x7f6fc4075e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:01.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.277+0000 7f6fe7200640 1 --2- 172.21.15.31:0/4008186858 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6fc4073980 0x7f6fc4075e40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8009be0 tx=0x7f6fd80091e0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.277+0000 7f6fe7200640 1 -- 172.21.15.31:0/4008186858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe815eff0 msgr2=0x7f6fe80b59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:01.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.277+0000 7f6fe7200640 1 --2- 172.21.15.31:0/4008186858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe815eff0 0x7f6fe80b59b0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000c710 tx=0x7f6fe000cbd0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.277+0000 7f6fe7200640 1 -- 172.21.15.31:0/4008186858 shutdown_connections 2024-09-17T05:36:01.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.277+0000 7f6fe7200640 1 --2- 172.21.15.31:0/4008186858 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6fc4073980 0x7f6fc4075e40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.277+0000 7f6fe7200640 1 --2- 172.21.15.31:0/4008186858 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fe815eff0 0x7f6fe80b59b0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.277+0000 7f6fe7200640 1 --2- 172.21.15.31:0/4008186858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fe80d02e0 0x7f6fe81f8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.277+0000 7f6fe7200640 1 --2- 172.21.15.31:0/4008186858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fe80cff00 0x7f6fe80b72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.277+0000 7f6fe7200640 1 -- 172.21.15.31:0/4008186858 >> 172.21.15.31:0/4008186858 conn(0x7f6fe80d1da0 msgr2=0x7f6fe80710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:01.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.277+0000 7f6fe7200640 1 -- 172.21.15.31:0/4008186858 shutdown_connections 2024-09-17T05:36:01.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.277+0000 7f6fe7200640 1 -- 172.21.15.31:0/4008186858 wait complete. 2024-09-17T05:36:01.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:01.299 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/5b27b0c678698fa84e722ef1482736ff.meta) 2024-09-17T05:36:01.325 INFO:teuthology.orchestra.run.smithi031.stdout:[GLOBAL] 2024-09-17T05:36:01.325 INFO:teuthology.orchestra.run.smithi031.stdout:version = 1 2024-09-17T05:36:01.325 INFO:teuthology.orchestra.run.smithi031.stdout:type = subvolume 2024-09-17T05:36:01.325 INFO:teuthology.orchestra.run.smithi031.stdout:path = /volumes/subvol_grp13960/subvol36381 2024-09-17T05:36:01.325 INFO:teuthology.orchestra.run.smithi031.stdout:state = complete 2024-09-17T05:36:01.325 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:01.327 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol42630 2024-09-17T05:36:01.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.517+0000 7f4aa3a00640 1 -- 172.21.15.31:0/2890497513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a84003a60 msgr2=0x7f4a84003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:01.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.517+0000 7f4aa3a00640 1 --2- 172.21.15.31:0/2890497513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a84003a60 0x7f4a84003e80 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f4a90001ec0 tx=0x7f4a9001ce90 comp rx=0 tx=0).stop 2024-09-17T05:36:01.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.517+0000 7f4aa3a00640 1 -- 172.21.15.31:0/2890497513 shutdown_connections 2024-09-17T05:36:01.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.517+0000 7f4aa3a00640 1 --2- 172.21.15.31:0/2890497513 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a84003a60 0x7f4a84003e80 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.517+0000 7f4aa3a00640 1 -- 172.21.15.31:0/2890497513 >> 172.21.15.31:0/2890497513 conn(0x7f4a9c0d1e00 msgr2=0x7f4a9c0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:01.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.517+0000 7f4aa3a00640 1 -- 172.21.15.31:0/2890497513 shutdown_connections 2024-09-17T05:36:01.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.517+0000 7f4aa3a00640 1 -- 172.21.15.31:0/2890497513 wait complete. 2024-09-17T05:36:01.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.517+0000 7f4aa3a00640 1 Processor -- start 2024-09-17T05:36:01.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.517+0000 7f4aa3a00640 1 -- start start 2024-09-17T05:36:01.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.517+0000 7f4aa3a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a84003a60 0x7f4a9c0cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:01.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.517+0000 7f4aa3a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a9c0cbac0 0x7f4a9c0ce880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:01.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.517+0000 7f4aa3a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a9c151510 0x7f4a9c0cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:01.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.517+0000 7f4aa3a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c0cdab0 con 0x7f4a9c0cbac0 2024-09-17T05:36:01.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.517+0000 7f4aa3a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c0cd930 con 0x7f4a9c151510 2024-09-17T05:36:01.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.517+0000 7f4aa3a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4a9c0cdc30 con 0x7f4a84003a60 2024-09-17T05:36:01.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.517+0000 7f4a9be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a9c0cbac0 0x7f4a9c0ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:01.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.517+0000 7f4aa1000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a84003a60 0x7f4a9c0cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:01.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.521+0000 7f4a9be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a9c0cbac0 0x7f4a9c0ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49124/0 (socket says 172.21.15.31:49124) 2024-09-17T05:36:01.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.521+0000 7f4a9be00640 1 -- 172.21.15.31:0/57719583 learned_addr learned my addr 172.21.15.31:0/57719583 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:01.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.521+0000 7f4aa1a00640 1 --2- 172.21.15.31:0/57719583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a9c151510 0x7f4a9c0cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:01.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.521+0000 7f4a9be00640 1 -- 172.21.15.31:0/57719583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a84003a60 msgr2=0x7f4a9c0cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:01.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.521+0000 7f4a9be00640 1 --2- 172.21.15.31:0/57719583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a84003a60 0x7f4a9c0cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.521+0000 7f4a9be00640 1 -- 172.21.15.31:0/57719583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a9c151510 msgr2=0x7f4a9c0cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:01.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.521+0000 7f4a9be00640 1 --2- 172.21.15.31:0/57719583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a9c151510 0x7f4a9c0cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.521+0000 7f4a9be00640 1 -- 172.21.15.31:0/57719583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9c0c58a0 con 0x7f4a9c0cbac0 2024-09-17T05:36:01.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.521+0000 7f4a9be00640 1 --2- 172.21.15.31:0/57719583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a9c0cbac0 0x7f4a9c0ce880 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f4a88004ee0 tx=0x7f4a88001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:01.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.521+0000 7f4a98c00640 1 -- 172.21.15.31:0/57719583 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88015020 con 0x7f4a9c0cbac0 2024-09-17T05:36:01.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.521+0000 7f4a98c00640 1 -- 172.21.15.31:0/57719583 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a88011960 con 0x7f4a9c0cbac0 2024-09-17T05:36:01.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.521+0000 7f4aa3a00640 1 -- 172.21.15.31:0/57719583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9c0c5b80 con 0x7f4a9c0cbac0 2024-09-17T05:36:01.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.521+0000 7f4a98c00640 1 -- 172.21.15.31:0/57719583 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88011d90 con 0x7f4a9c0cbac0 2024-09-17T05:36:01.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.521+0000 7f4aa3a00640 1 -- 172.21.15.31:0/57719583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a9c0c6140 con 0x7f4a9c0cbac0 2024-09-17T05:36:01.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.521+0000 7f4aa3a00640 1 -- 172.21.15.31:0/57719583 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a9c0b1610 con 0x7f4a9c0cbac0 2024-09-17T05:36:01.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.521+0000 7f4a98c00640 1 -- 172.21.15.31:0/57719583 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 24) ==== 97897+0+0 (secure 0 0 0) 0x7f4a88018020 con 0x7f4a9c0cbac0 2024-09-17T05:36:01.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.525+0000 7f4a98c00640 1 --2- 172.21.15.31:0/57719583 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a7c073980 0x7f4a7c075e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:01.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.525+0000 7f4a98c00640 1 -- 172.21.15.31:0/57719583 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f4a88095da0 con 0x7f4a9c0cbac0 2024-09-17T05:36:01.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.525+0000 7f4aa1000640 1 --2- 172.21.15.31:0/57719583 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a7c073980 0x7f4a7c075e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:01.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.525+0000 7f4aa1000640 1 --2- 172.21.15.31:0/57719583 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a7c073980 0x7f4a7c075e40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4a900ac000 tx=0x7f4a90019cd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:01.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.529+0000 7f4a98c00640 1 -- 172.21.15.31:0/57719583 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4a8801f020 con 0x7f4a9c0cbac0 2024-09-17T05:36:01.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.729+0000 7f4aa3a00640 1 -- 172.21.15.31:0/57719583 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol42630", "target": ["mon-mgr", ""]}) -- 0x7f4a9c0710b0 con 0x7f4a7c073980 2024-09-17T05:36:01.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.757+0000 7f4a98c00640 1 -- 172.21.15.31:0/57719583 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4a9c0710b0 con 0x7f4a7c073980 2024-09-17T05:36:01.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.761+0000 7f4aa3a00640 1 -- 172.21.15.31:0/57719583 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a7c073980 msgr2=0x7f4a7c075e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:01.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.761+0000 7f4aa3a00640 1 --2- 172.21.15.31:0/57719583 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a7c073980 0x7f4a7c075e40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4a900ac000 tx=0x7f4a90019cd0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.761+0000 7f4aa3a00640 1 -- 172.21.15.31:0/57719583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a9c0cbac0 msgr2=0x7f4a9c0ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.761+0000 7f4aa3a00640 1 --2- 172.21.15.31:0/57719583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a9c0cbac0 0x7f4a9c0ce880 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f4a88004ee0 tx=0x7f4a88001640 comp rx=0 tx=0).stop 2024-09-17T05:36:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.761+0000 7f4aa3a00640 1 -- 172.21.15.31:0/57719583 shutdown_connections 2024-09-17T05:36:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.761+0000 7f4aa3a00640 1 --2- 172.21.15.31:0/57719583 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a7c073980 0x7f4a7c075e40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.761+0000 7f4aa3a00640 1 --2- 172.21.15.31:0/57719583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a9c151510 0x7f4a9c0cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.761+0000 7f4aa3a00640 1 --2- 172.21.15.31:0/57719583 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a9c0cbac0 0x7f4a9c0ce880 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.761+0000 7f4aa3a00640 1 --2- 172.21.15.31:0/57719583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a84003a60 0x7f4a9c0cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.761+0000 7f4aa3a00640 1 -- 172.21.15.31:0/57719583 >> 172.21.15.31:0/57719583 conn(0x7f4a9c0d1e00 msgr2=0x7f4a9c0affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.761+0000 7f4aa3a00640 1 -- 172.21.15.31:0/57719583 shutdown_connections 2024-09-17T05:36:01.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.761+0000 7f4aa3a00640 1 -- 172.21.15.31:0/57719583 wait complete. 2024-09-17T05:36:01.767 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:01.765+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:01.767 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:01.765+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:01.767 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:01.765+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:01.767 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:01.765+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:01.767 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:01.765+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:01.785 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:01.785+0000 7f46fa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:01.785 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:01.785+0000 7f46fa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:01.785 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:01.785+0000 7f46fa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:01.785 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:01.785+0000 7f46fa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:01.786 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:01.785+0000 7f46fa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:01.787 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol36381 subvol_grp13960 2024-09-17T05:36:01.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.937+0000 7f2b05600640 1 -- 172.21.15.31:0/629672423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b0015c1f0 msgr2=0x7f2b000cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:01.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.937+0000 7f2b05600640 1 --2- 172.21.15.31:0/629672423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b0015c1f0 0x7f2b000cee10 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009840 tx=0x7f2ae801c820 comp rx=0 tx=0).stop 2024-09-17T05:36:01.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.937+0000 7f2b05600640 1 -- 172.21.15.31:0/629672423 shutdown_connections 2024-09-17T05:36:01.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.937+0000 7f2b05600640 1 --2- 172.21.15.31:0/629672423 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b000b0b60 0x7f2b000ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.937+0000 7f2b05600640 1 --2- 172.21.15.31:0/629672423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b0015c1f0 0x7f2b000cee10 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.937+0000 7f2b05600640 1 -- 172.21.15.31:0/629672423 >> 172.21.15.31:0/629672423 conn(0x7f2b000d1da0 msgr2=0x7f2b000d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:01.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.937+0000 7f2b05600640 1 -- 172.21.15.31:0/629672423 shutdown_connections 2024-09-17T05:36:01.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.937+0000 7f2b05600640 1 -- 172.21.15.31:0/629672423 wait complete. 2024-09-17T05:36:01.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2b05600640 1 Processor -- start 2024-09-17T05:36:01.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2b05600640 1 -- start start 2024-09-17T05:36:01.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2b05600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b000b0b60 0x7f2b00150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:01.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2b05600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b0015be10 0x7f2b000af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:01.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2b05600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0015c1f0 0x7f2b001fa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:01.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2b05600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2b00169040 con 0x7f2b0015be10 2024-09-17T05:36:01.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2b05600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2b00168ec0 con 0x7f2b000b0b60 2024-09-17T05:36:01.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2b05600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2b001691c0 con 0x7f2b0015c1f0 2024-09-17T05:36:01.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2af7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b0015be10 0x7f2b000af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:01.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2af7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b0015be10 0x7f2b000af420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49168/0 (socket says 172.21.15.31:49168) 2024-09-17T05:36:01.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2af7e00640 1 -- 172.21.15.31:0/1033866729 learned_addr learned my addr 172.21.15.31:0/1033866729 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:01.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2aff400640 1 --2- 172.21.15.31:0/1033866729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0015c1f0 0x7f2b001fa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:01.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2afea00640 1 --2- 172.21.15.31:0/1033866729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b000b0b60 0x7f2b00150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:01.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2af7e00640 1 -- 172.21.15.31:0/1033866729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0015c1f0 msgr2=0x7f2b001fa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:01.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2af7e00640 1 --2- 172.21.15.31:0/1033866729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0015c1f0 0x7f2b001fa9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2af7e00640 1 -- 172.21.15.31:0/1033866729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b000b0b60 msgr2=0x7f2b00150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:01.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2af7e00640 1 --2- 172.21.15.31:0/1033866729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b000b0b60 0x7f2b00150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:01.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2af7e00640 1 -- 172.21.15.31:0/1033866729 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b000afdd0 con 0x7f2b0015be10 2024-09-17T05:36:01.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2af7e00640 1 --2- 172.21.15.31:0/1033866729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b0015be10 0x7f2b000af420 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009790 tx=0x7f2ae80a56e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:01.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2af6a00640 1 -- 172.21.15.31:0/1033866729 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae80bb070 con 0x7f2b0015be10 2024-09-17T05:36:01.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2af6a00640 1 -- 172.21.15.31:0/1033866729 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2ae8005030 con 0x7f2b0015be10 2024-09-17T05:36:01.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2af6a00640 1 -- 172.21.15.31:0/1033866729 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae80b2040 con 0x7f2b0015be10 2024-09-17T05:36:01.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2b05600640 1 -- 172.21.15.31:0/1033866729 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b000b00b0 con 0x7f2b0015be10 2024-09-17T05:36:01.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.941+0000 7f2b05600640 1 -- 172.21.15.31:0/1033866729 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b000b0670 con 0x7f2b0015be10 2024-09-17T05:36:01.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.945+0000 7f2b05600640 1 -- 172.21.15.31:0/1033866729 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b000ccbd0 con 0x7f2b0015be10 2024-09-17T05:36:01.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.945+0000 7f2af6a00640 1 -- 172.21.15.31:0/1033866729 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 24) ==== 97897+0+0 (secure 0 0 0) 0x7f2ae80be070 con 0x7f2b0015be10 2024-09-17T05:36:01.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.945+0000 7f2af6a00640 1 --2- 172.21.15.31:0/1033866729 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2adc073950 0x7f2adc075e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:01.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.945+0000 7f2af6a00640 1 -- 172.21.15.31:0/1033866729 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f2ae812e6b0 con 0x7f2b0015be10 2024-09-17T05:36:01.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.945+0000 7f2afea00640 1 --2- 172.21.15.31:0/1033866729 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2adc073950 0x7f2adc075e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:01.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.945+0000 7f2afea00640 1 --2- 172.21.15.31:0/1033866729 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2adc073950 0x7f2adc075e10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2af0000f70 tx=0x7f2af0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:01.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:01.949+0000 7f2af6a00640 1 -- 172.21.15.31:0/1033866729 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2ae8016410 con 0x7f2b0015be10 2024-09-17T05:36:02.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.153+0000 7f2b05600640 1 -- 172.21.15.31:0/1033866729 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol36381", "group_name": "subvol_grp13960", "target": ["mon-mgr", ""]}) -- 0x7f2b00070350 con 0x7f2adc073950 2024-09-17T05:36:02.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.177+0000 7f2af6a00640 1 -- 172.21.15.31:0/1033866729 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2b00070350 con 0x7f2adc073950 2024-09-17T05:36:02.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.181+0000 7f2b05600640 1 -- 172.21.15.31:0/1033866729 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2adc073950 msgr2=0x7f2adc075e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:02.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.181+0000 7f2b05600640 1 --2- 172.21.15.31:0/1033866729 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2adc073950 0x7f2adc075e10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2af0000f70 tx=0x7f2af0009040 comp rx=0 tx=0).stop 2024-09-17T05:36:02.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.181+0000 7f2b05600640 1 -- 172.21.15.31:0/1033866729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b0015be10 msgr2=0x7f2b000af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:02.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.181+0000 7f2b05600640 1 --2- 172.21.15.31:0/1033866729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b0015be10 0x7f2b000af420 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009790 tx=0x7f2ae80a56e0 comp rx=0 tx=0).stop 2024-09-17T05:36:02.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.181+0000 7f2b05600640 1 -- 172.21.15.31:0/1033866729 shutdown_connections 2024-09-17T05:36:02.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.181+0000 7f2b05600640 1 --2- 172.21.15.31:0/1033866729 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2adc073950 0x7f2adc075e10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:02.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.181+0000 7f2b05600640 1 --2- 172.21.15.31:0/1033866729 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b0015c1f0 0x7f2b001fa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:02.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.181+0000 7f2b05600640 1 --2- 172.21.15.31:0/1033866729 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b0015be10 0x7f2b000af420 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:02.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.181+0000 7f2b05600640 1 --2- 172.21.15.31:0/1033866729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b000b0b60 0x7f2b00150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:02.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.181+0000 7f2b05600640 1 -- 172.21.15.31:0/1033866729 >> 172.21.15.31:0/1033866729 conn(0x7f2b000d1da0 msgr2=0x7f2b000d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:02.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.181+0000 7f2b05600640 1 -- 172.21.15.31:0/1033866729 shutdown_connections 2024-09-17T05:36:02.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.181+0000 7f2b05600640 1 -- 172.21.15.31:0/1033866729 wait complete. 2024-09-17T05:36:02.205 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:36:02.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:36:02.257 INFO:teuthology.orchestra.run.smithi031.stdout:2 2024-09-17T05:36:02.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:02.264 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp13960 2024-09-17T05:36:02.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.413+0000 7f288f200640 1 -- 172.21.15.31:0/3762456304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f289015acb0 msgr2=0x7f28900ce890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:02.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.413+0000 7f288f200640 1 --2- 172.21.15.31:0/3762456304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f289015acb0 0x7f28900ce890 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f28900cb090 tx=0x7f288001c7d0 comp rx=0 tx=0).stop 2024-09-17T05:36:02.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.413+0000 7f288f200640 1 -- 172.21.15.31:0/3762456304 shutdown_connections 2024-09-17T05:36:02.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.413+0000 7f288f200640 1 --2- 172.21.15.31:0/3762456304 >> v2:172.21.15.155:3300/0 conn(0x7f28900ccc90 0x7f2890073630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:02.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.413+0000 7f288f200640 1 --2- 172.21.15.31:0/3762456304 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f289015acb0 0x7f28900ce890 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:02.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.413+0000 7f288f200640 1 -- 172.21.15.31:0/3762456304 >> 172.21.15.31:0/3762456304 conn(0x7f28900d0ab0 msgr2=0x7f28900d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:02.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.413+0000 7f288f200640 1 -- 172.21.15.31:0/3762456304 shutdown_connections 2024-09-17T05:36:02.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.413+0000 7f288f200640 1 -- 172.21.15.31:0/3762456304 wait complete. 2024-09-17T05:36:02.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.413+0000 7f288f200640 1 Processor -- start 2024-09-17T05:36:02.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.413+0000 7f288f200640 1 -- start start 2024-09-17T05:36:02.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2890073b70 0x7f2890159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:02.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28900ccc90 0x7f28900ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:02.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f289015acb0 0x7f2890153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:02.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2890168570 con 0x7f289015acb0 2024-09-17T05:36:02.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288f200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f28901683f0 con 0x7f28900ccc90 2024-09-17T05:36:02.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f28901686f0 con 0x7f2890073b70 2024-09-17T05:36:02.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f289015acb0 0x7f2890153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:02.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288de00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2890073b70 0x7f2890159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:02.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f289015acb0 0x7f2890153690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49184/0 (socket says 172.21.15.31:49184) 2024-09-17T05:36:02.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288e800640 1 -- 172.21.15.31:0/1635072621 learned_addr learned my addr 172.21.15.31:0/1635072621 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:02.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f2887e00640 1 --2- 172.21.15.31:0/1635072621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28900ccc90 0x7f28900ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:02.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288e800640 1 -- 172.21.15.31:0/1635072621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2890073b70 msgr2=0x7f2890159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:02.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288e800640 1 --2- 172.21.15.31:0/1635072621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2890073b70 0x7f2890159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:02.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288e800640 1 -- 172.21.15.31:0/1635072621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28900ccc90 msgr2=0x7f28900ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:02.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288e800640 1 --2- 172.21.15.31:0/1635072621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28900ccc90 0x7f28900ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:02.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288e800640 1 -- 172.21.15.31:0/1635072621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28900addd0 con 0x7f289015acb0 2024-09-17T05:36:02.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288e800640 1 --2- 172.21.15.31:0/1635072621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f289015acb0 0x7f2890153690 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f288800cb10 tx=0x7f288800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:02.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f2886000640 1 -- 172.21.15.31:0/1635072621 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888016020 con 0x7f289015acb0 2024-09-17T05:36:02.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f2886000640 1 -- 172.21.15.31:0/1635072621 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f288800ce50 con 0x7f289015acb0 2024-09-17T05:36:02.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f2886000640 1 -- 172.21.15.31:0/1635072621 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288800ade0 con 0x7f289015acb0 2024-09-17T05:36:02.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288f200640 1 -- 172.21.15.31:0/1635072621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f289015b320 con 0x7f289015acb0 2024-09-17T05:36:02.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288f200640 1 -- 172.21.15.31:0/1635072621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f289015b8e0 con 0x7f289015acb0 2024-09-17T05:36:02.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f288f200640 1 -- 172.21.15.31:0/1635072621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2890073630 con 0x7f289015acb0 2024-09-17T05:36:02.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.417+0000 7f2886000640 1 -- 172.21.15.31:0/1635072621 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 24) ==== 97897+0+0 (secure 0 0 0) 0x7f2888019020 con 0x7f289015acb0 2024-09-17T05:36:02.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.421+0000 7f2886000640 1 --2- 172.21.15.31:0/1635072621 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f286c073980 0x7f286c075e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:02.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.421+0000 7f2886000640 1 -- 172.21.15.31:0/1635072621 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f2888095560 con 0x7f289015acb0 2024-09-17T05:36:02.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.421+0000 7f288de00640 1 --2- 172.21.15.31:0/1635072621 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f286c073980 0x7f286c075e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:02.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.421+0000 7f288de00640 1 --2- 172.21.15.31:0/1635072621 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f286c073980 0x7f286c075e40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f28800af000 tx=0x7f288001b010 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:02.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.425+0000 7f2886000640 1 -- 172.21.15.31:0/1635072621 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2888020020 con 0x7f289015acb0 2024-09-17T05:36:02.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.621+0000 7f288f200640 1 -- 172.21.15.31:0/1635072621 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp13960", "target": ["mon-mgr", ""]}) -- 0x7f28900d18e0 con 0x7f286c073980 2024-09-17T05:36:02.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.637+0000 7f2886000640 1 -- 172.21.15.31:0/1635072621 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f28900d18e0 con 0x7f286c073980 2024-09-17T05:36:02.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.641+0000 7f288f200640 1 -- 172.21.15.31:0/1635072621 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f286c073980 msgr2=0x7f286c075e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:02.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.641+0000 7f288f200640 1 --2- 172.21.15.31:0/1635072621 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f286c073980 0x7f286c075e40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f28800af000 tx=0x7f288001b010 comp rx=0 tx=0).stop 2024-09-17T05:36:02.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.641+0000 7f288f200640 1 -- 172.21.15.31:0/1635072621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f289015acb0 msgr2=0x7f2890153690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:02.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.641+0000 7f288f200640 1 --2- 172.21.15.31:0/1635072621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f289015acb0 0x7f2890153690 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f288800cb10 tx=0x7f288800cc00 comp rx=0 tx=0).stop 2024-09-17T05:36:02.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.641+0000 7f288f200640 1 -- 172.21.15.31:0/1635072621 shutdown_connections 2024-09-17T05:36:02.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.641+0000 7f288f200640 1 --2- 172.21.15.31:0/1635072621 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f286c073980 0x7f286c075e40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:02.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.641+0000 7f288f200640 1 --2- 172.21.15.31:0/1635072621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f289015acb0 0x7f2890153690 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:02.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.641+0000 7f288f200640 1 --2- 172.21.15.31:0/1635072621 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f28900ccc90 0x7f28900ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:02.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.641+0000 7f288f200640 1 --2- 172.21.15.31:0/1635072621 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2890073b70 0x7f2890159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:02.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.641+0000 7f288f200640 1 -- 172.21.15.31:0/1635072621 >> 172.21.15.31:0/1635072621 conn(0x7f28900d0ab0 msgr2=0x7f289006f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:02.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.641+0000 7f288f200640 1 -- 172.21.15.31:0/1635072621 shutdown_connections 2024-09-17T05:36:02.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:02.641+0000 7f288f200640 1 -- 172.21.15.31:0/1635072621 wait complete. 2024-09-17T05:36:02.662 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:36:02.663 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:36:02.755 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:36:02.860 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:36:02.860 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:36:02.860 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:36:02.860 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:02.870 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:36:02.870 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:02.921 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:36:03.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.113+0000 7f7f2da00640 1 -- 172.21.15.31:0/2011581677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f0c0039f0 msgr2=0x7f7f0c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:03.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.113+0000 7f7f2da00640 1 --2- 172.21.15.31:0/2011581677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f0c0039f0 0x7f7f0c003dd0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800c310 tx=0x7f7f1801cf80 comp rx=0 tx=0).stop 2024-09-17T05:36:03.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.113+0000 7f7f27400640 1 -- 172.21.15.31:0/2011581677 reap_dead start 2024-09-17T05:36:03.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.113+0000 7f7f2da00640 1 -- 172.21.15.31:0/2011581677 shutdown_connections 2024-09-17T05:36:03.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.113+0000 7f7f2da00640 1 -- 172.21.15.31:0/2011581677 >> 172.21.15.31:0/2011581677 conn(0x7f7f280b18f0 msgr2=0x7f7f280b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:03.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.113+0000 7f7f2da00640 1 -- 172.21.15.31:0/2011581677 shutdown_connections 2024-09-17T05:36:03.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.113+0000 7f7f2da00640 1 -- 172.21.15.31:0/2011581677 wait complete. 2024-09-17T05:36:03.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f2da00640 1 Processor -- start 2024-09-17T05:36:03.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f2da00640 1 -- start start 2024-09-17T05:36:03.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f2da00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f0c0039f0 0x7f7f280c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:03.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f2da00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f280ca5f0 0x7f7f281486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:03.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f2da00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f281557f0 0x7f7f281edb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:03.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f2da00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7f28167300 con 0x7f7f0c0039f0 2024-09-17T05:36:03.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f2da00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7f28167180 con 0x7f7f281557f0 2024-09-17T05:36:03.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f2da00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7f28167480 con 0x7f7f280ca5f0 2024-09-17T05:36:03.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f26a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f0c0039f0 0x7f7f280c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:03.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f26a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f0c0039f0 0x7f7f280c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49204/0 (socket says 172.21.15.31:49204) 2024-09-17T05:36:03.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f26a00640 1 -- 172.21.15.31:0/4089655611 learned_addr learned my addr 172.21.15.31:0/4089655611 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:03.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f27400640 1 --2- 172.21.15.31:0/4089655611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f281557f0 0x7f7f281edb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:03.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f26000640 1 --2- 172.21.15.31:0/4089655611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f280ca5f0 0x7f7f281486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:03.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f26a00640 1 -- 172.21.15.31:0/4089655611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f280ca5f0 msgr2=0x7f7f281486e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:03.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f26a00640 1 --2- 172.21.15.31:0/4089655611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f280ca5f0 0x7f7f281486e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f26a00640 1 -- 172.21.15.31:0/4089655611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f281557f0 msgr2=0x7f7f281edb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:03.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f26a00640 1 --2- 172.21.15.31:0/4089655611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f281557f0 0x7f7f281edb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f26a00640 1 -- 172.21.15.31:0/4089655611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f28148c20 con 0x7f7f0c0039f0 2024-09-17T05:36:03.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f27400640 1 --2- 172.21.15.31:0/4089655611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f281557f0 0x7f7f281edb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:36:03.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f26a00640 1 --2- 172.21.15.31:0/4089655611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f0c0039f0 0x7f7f280c8f70 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f7f1801b680 tx=0x7f7f18001d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:03.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f1ea00640 1 -- 172.21.15.31:0/4089655611 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f180014c0 con 0x7f7f0c0039f0 2024-09-17T05:36:03.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f1ea00640 1 -- 172.21.15.31:0/4089655611 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f18001660 con 0x7f7f0c0039f0 2024-09-17T05:36:03.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f1ea00640 1 -- 172.21.15.31:0/4089655611 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f18006330 con 0x7f7f0c0039f0 2024-09-17T05:36:03.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f2da00640 1 -- 172.21.15.31:0/4089655611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f280c9550 con 0x7f7f0c0039f0 2024-09-17T05:36:03.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.117+0000 7f7f2da00640 1 -- 172.21.15.31:0/4089655611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f280c9b10 con 0x7f7f0c0039f0 2024-09-17T05:36:03.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.121+0000 7f7f2da00640 1 -- 172.21.15.31:0/4089655611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f28069410 con 0x7f7f0c0039f0 2024-09-17T05:36:03.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.121+0000 7f7f1ea00640 1 -- 172.21.15.31:0/4089655611 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f7f180b7030 con 0x7f7f0c0039f0 2024-09-17T05:36:03.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.121+0000 7f7f1ea00640 1 --2- 172.21.15.31:0/4089655611 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7f08073a70 0x7f7f08075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:03.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.121+0000 7f7f1ea00640 1 -- 172.21.15.31:0/4089655611 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f7f1812e510 con 0x7f7f0c0039f0 2024-09-17T05:36:03.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.121+0000 7f7f26000640 1 --2- 172.21.15.31:0/4089655611 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7f08073a70 0x7f7f08075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:03.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.121+0000 7f7f26000640 1 --2- 172.21.15.31:0/4089655611 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7f08073a70 0x7f7f08075f30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7f2806ad30 tx=0x7f7f14006b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:03.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.125+0000 7f7f1ea00640 1 -- 172.21.15.31:0/4089655611 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7f18016d30 con 0x7f7f0c0039f0 2024-09-17T05:36:03.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.313+0000 7f7f2da00640 1 -- 172.21.15.31:0/4089655611 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7f280b0a80 con 0x7f7f0c0039f0 2024-09-17T05:36:03.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.313+0000 7f7f1ea00640 1 -- 172.21.15.31:0/4089655611 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v141) ==== 80+0+0 (secure 0 0 0) 0x7f7f180f8330 con 0x7f7f0c0039f0 2024-09-17T05:36:03.313 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:36:03.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.313+0000 7f7f2da00640 1 -- 172.21.15.31:0/4089655611 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7f08073a70 msgr2=0x7f7f08075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:03.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.313+0000 7f7f2da00640 1 --2- 172.21.15.31:0/4089655611 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7f08073a70 0x7f7f08075f30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7f2806ad30 tx=0x7f7f14006b20 comp rx=0 tx=0).stop 2024-09-17T05:36:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.313+0000 7f7f2da00640 1 -- 172.21.15.31:0/4089655611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f0c0039f0 msgr2=0x7f7f280c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.313+0000 7f7f2da00640 1 --2- 172.21.15.31:0/4089655611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f0c0039f0 0x7f7f280c8f70 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f7f1801b680 tx=0x7f7f18001d90 comp rx=0 tx=0).stop 2024-09-17T05:36:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.313+0000 7f7f2da00640 1 -- 172.21.15.31:0/4089655611 shutdown_connections 2024-09-17T05:36:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.313+0000 7f7f2da00640 1 --2- 172.21.15.31:0/4089655611 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7f08073a70 0x7f7f08075f30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.313+0000 7f7f2da00640 1 --2- 172.21.15.31:0/4089655611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f281557f0 0x7f7f281edb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.313+0000 7f7f2da00640 1 --2- 172.21.15.31:0/4089655611 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f280ca5f0 0x7f7f281486e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.313+0000 7f7f2da00640 1 --2- 172.21.15.31:0/4089655611 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f0c0039f0 0x7f7f280c8f70 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.313+0000 7f7f2da00640 1 -- 172.21.15.31:0/4089655611 >> 172.21.15.31:0/4089655611 conn(0x7f7f280b18f0 msgr2=0x7f7f280b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.313+0000 7f7f2da00640 1 -- 172.21.15.31:0/4089655611 shutdown_connections 2024-09-17T05:36:03.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.313+0000 7f7f2da00640 1 -- 172.21.15.31:0/4089655611 wait complete. 2024-09-17T05:36:03.334 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:36:03.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:03.335 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:36:03.362 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:36:03.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:03.362 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:36:03.413 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:36:03.413 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:36:03.413 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:03.423 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:36:03.423 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:03.473 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:36:03.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.617+0000 7fdbd4600640 1 -- 172.21.15.31:0/1821082123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbcc06cc20 msgr2=0x7fdbcc0737c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:03.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.617+0000 7fdbd4600640 1 --2- 172.21.15.31:0/1821082123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbcc06cc20 0x7fdbcc0737c0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc074c20 tx=0x7fdbc001c890 comp rx=0 tx=0).stop 2024-09-17T05:36:03.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd4600640 1 -- 172.21.15.31:0/1821082123 shutdown_connections 2024-09-17T05:36:03.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd4600640 1 --2- 172.21.15.31:0/1821082123 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc15f7b0 0x7fdbcc15fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd4600640 1 --2- 172.21.15.31:0/1821082123 >> v2:172.21.15.155:3300/0 conn(0x7fdbcc15c1c0 0x7fdbcc06d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd4600640 1 --2- 172.21.15.31:0/1821082123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbcc06cc20 0x7fdbcc0737c0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd4600640 1 -- 172.21.15.31:0/1821082123 >> 172.21.15.31:0/1821082123 conn(0x7fdbcc0d0c90 msgr2=0x7fdbcc0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:03.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd4600640 1 -- 172.21.15.31:0/1821082123 shutdown_connections 2024-09-17T05:36:03.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd4600640 1 -- 172.21.15.31:0/1821082123 wait complete. 2024-09-17T05:36:03.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd4600640 1 Processor -- start 2024-09-17T05:36:03.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd4600640 1 -- start start 2024-09-17T05:36:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd4600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc06cc20 0x7fdbcc0c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd4600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc15c1c0 0x7fdbcc156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd4600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbcc15f7b0 0x7fdbcc156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd4600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc0719c0 con 0x7fdbcc15f7b0 2024-09-17T05:36:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd4600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc071840 con 0x7fdbcc15c1c0 2024-09-17T05:36:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd4600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdbcc071b40 con 0x7fdbcc06cc20 2024-09-17T05:36:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd2600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbcc15f7b0 0x7fdbcc156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd2600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbcc15f7b0 0x7fdbcc156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49220/0 (socket says 172.21.15.31:49220) 2024-09-17T05:36:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd2600640 1 -- 172.21.15.31:0/1630795213 learned_addr learned my addr 172.21.15.31:0/1630795213 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd1c00640 1 --2- 172.21.15.31:0/1630795213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc06cc20 0x7fdbcc0c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd1200640 1 --2- 172.21.15.31:0/1630795213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc15c1c0 0x7fdbcc156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd2600640 1 -- 172.21.15.31:0/1630795213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc06cc20 msgr2=0x7fdbcc0c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd2600640 1 --2- 172.21.15.31:0/1630795213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc06cc20 0x7fdbcc0c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd2600640 1 -- 172.21.15.31:0/1630795213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc15c1c0 msgr2=0x7fdbcc156980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd2600640 1 --2- 172.21.15.31:0/1630795213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc15c1c0 0x7fdbcc156980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd2600640 1 -- 172.21.15.31:0/1630795213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbcc0b4720 con 0x7fdbcc15f7b0 2024-09-17T05:36:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd1200640 1 --2- 172.21.15.31:0/1630795213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc15c1c0 0x7fdbcc156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.621+0000 7fdbd2600640 1 --2- 172.21.15.31:0/1630795213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbcc15f7b0 0x7fdbcc156ec0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400cce0 tx=0x7fdbc400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.625+0000 7fdbc9600640 1 -- 172.21.15.31:0/1630795213 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc400f450 con 0x7fdbcc15f7b0 2024-09-17T05:36:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.625+0000 7fdbc9600640 1 -- 172.21.15.31:0/1630795213 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbc400f6e0 con 0x7fdbcc15f7b0 2024-09-17T05:36:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.625+0000 7fdbc9600640 1 -- 172.21.15.31:0/1630795213 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc400fb30 con 0x7fdbcc15f7b0 2024-09-17T05:36:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.625+0000 7fdbd4600640 1 -- 172.21.15.31:0/1630795213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbcc0b4a00 con 0x7fdbcc15f7b0 2024-09-17T05:36:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.625+0000 7fdbd4600640 1 -- 172.21.15.31:0/1630795213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbcc157400 con 0x7fdbcc15f7b0 2024-09-17T05:36:03.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.625+0000 7fdbd4600640 1 -- 172.21.15.31:0/1630795213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbcc0737c0 con 0x7fdbcc15f7b0 2024-09-17T05:36:03.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.625+0000 7fdbc9600640 1 -- 172.21.15.31:0/1630795213 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7fdbc400fcd0 con 0x7fdbcc15f7b0 2024-09-17T05:36:03.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.625+0000 7fdbc9600640 1 --2- 172.21.15.31:0/1630795213 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdbac073a70 0x7fdbac075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:03.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.625+0000 7fdbc9600640 1 -- 172.21.15.31:0/1630795213 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7fdbc4095f80 con 0x7fdbcc15f7b0 2024-09-17T05:36:03.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.625+0000 7fdbd1c00640 1 --2- 172.21.15.31:0/1630795213 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdbac073a70 0x7fdbac075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:03.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.629+0000 7fdbd1c00640 1 --2- 172.21.15.31:0/1630795213 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdbac073a70 0x7fdbac075f30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00af000 tx=0x7fdbc001b0d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:03.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.629+0000 7fdbc9600640 1 -- 172.21.15.31:0/1630795213 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fdbc4014030 con 0x7fdbcc15f7b0 2024-09-17T05:36:03.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.817+0000 7fdbd4600640 1 -- 172.21.15.31:0/1630795213 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdbcc0b6c10 con 0x7fdbcc15f7b0 2024-09-17T05:36:03.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.817+0000 7fdbc9600640 1 -- 172.21.15.31:0/1630795213 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v141) ==== 80+0+0 (secure 0 0 0) 0x7fdbc4060070 con 0x7fdbcc15f7b0 2024-09-17T05:36:03.820 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:36:03.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.821+0000 7fdbd4600640 1 -- 172.21.15.31:0/1630795213 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdbac073a70 msgr2=0x7fdbac075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:03.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.821+0000 7fdbd4600640 1 --2- 172.21.15.31:0/1630795213 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdbac073a70 0x7fdbac075f30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00af000 tx=0x7fdbc001b0d0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.821+0000 7fdbd4600640 1 -- 172.21.15.31:0/1630795213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbcc15f7b0 msgr2=0x7fdbcc156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:03.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.821+0000 7fdbd4600640 1 --2- 172.21.15.31:0/1630795213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbcc15f7b0 0x7fdbcc156ec0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400cce0 tx=0x7fdbc400a620 comp rx=0 tx=0).stop 2024-09-17T05:36:03.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.821+0000 7fdbd4600640 1 -- 172.21.15.31:0/1630795213 shutdown_connections 2024-09-17T05:36:03.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.821+0000 7fdbd4600640 1 --2- 172.21.15.31:0/1630795213 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdbac073a70 0x7fdbac075f30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.821+0000 7fdbd4600640 1 --2- 172.21.15.31:0/1630795213 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbcc15f7b0 0x7fdbcc156ec0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.821+0000 7fdbd4600640 1 --2- 172.21.15.31:0/1630795213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdbcc15c1c0 0x7fdbcc156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.821+0000 7fdbd4600640 1 --2- 172.21.15.31:0/1630795213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdbcc06cc20 0x7fdbcc0c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:03.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.821+0000 7fdbd4600640 1 -- 172.21.15.31:0/1630795213 >> 172.21.15.31:0/1630795213 conn(0x7fdbcc0d0c90 msgr2=0x7fdbcc0c6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:03.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.821+0000 7fdbd4600640 1 -- 172.21.15.31:0/1630795213 shutdown_connections 2024-09-17T05:36:03.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:03.821+0000 7fdbd4600640 1 -- 172.21.15.31:0/1630795213 wait complete. 2024-09-17T05:36:03.841 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T05:36:03.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:03.841 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T05:36:03.871 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:36:03.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:03.871 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:36:03.926 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:36:03.926 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:36:03.926 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:03.936 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:36:03.936 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:36:03.936 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:36:03.936 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:03.977 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:36:03.977 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:04.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.121+0000 7fb0d9000640 1 -- 172.21.15.31:0/3852473845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d415bea0 msgr2=0x7fb0d40ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:04.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.121+0000 7fb0d9000640 1 --2- 172.21.15.31:0/3852473845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d415bea0 0x7fb0d40ce670 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009840 tx=0x7fb0c401c820 comp rx=0 tx=0).stop 2024-09-17T05:36:04.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.121+0000 7fb0d9000640 1 -- 172.21.15.31:0/3852473845 shutdown_connections 2024-09-17T05:36:04.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.121+0000 7fb0d9000640 1 --2- 172.21.15.31:0/3852473845 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0d40d28e0 0x7fb0d40cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.121+0000 7fb0d9000640 1 --2- 172.21.15.31:0/3852473845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d415bea0 0x7fb0d40ce670 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.121+0000 7fb0d9000640 1 -- 172.21.15.31:0/3852473845 >> 172.21.15.31:0/3852473845 conn(0x7fb0d40d1dc0 msgr2=0x7fb0d40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:04.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.121+0000 7fb0d9000640 1 -- 172.21.15.31:0/3852473845 shutdown_connections 2024-09-17T05:36:04.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.121+0000 7fb0d9000640 1 -- 172.21.15.31:0/3852473845 wait complete. 2024-09-17T05:36:04.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d9000640 1 Processor -- start 2024-09-17T05:36:04.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d9000640 1 -- start start 2024-09-17T05:36:04.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d9000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0d40cdb30 0x7fb0d4155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:04.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d9000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0d40d28e0 0x7fb0d40c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:04.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d9000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d415bea0 0x7fb0d4158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:04.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d9000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d4168fc0 con 0x7fb0d415bea0 2024-09-17T05:36:04.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d9000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d4168e40 con 0x7fb0d40cdb30 2024-09-17T05:36:04.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d9000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d4169140 con 0x7fb0d40d28e0 2024-09-17T05:36:04.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d2800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d415bea0 0x7fb0d4158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:04.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d2800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d415bea0 0x7fb0d4158d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49238/0 (socket says 172.21.15.31:49238) 2024-09-17T05:36:04.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d2800640 1 -- 172.21.15.31:0/1309806635 learned_addr learned my addr 172.21.15.31:0/1309806635 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:04.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0cbe00640 1 --2- 172.21.15.31:0/1309806635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0d40d28e0 0x7fb0d40c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:04.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d1e00640 1 --2- 172.21.15.31:0/1309806635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0d40cdb30 0x7fb0d4155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:04.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d2800640 1 -- 172.21.15.31:0/1309806635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0d40d28e0 msgr2=0x7fb0d40c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:04.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d2800640 1 --2- 172.21.15.31:0/1309806635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0d40d28e0 0x7fb0d40c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d2800640 1 -- 172.21.15.31:0/1309806635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0d40cdb30 msgr2=0x7fb0d4155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:04.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d2800640 1 --2- 172.21.15.31:0/1309806635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0d40cdb30 0x7fb0d4155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d2800640 1 -- 172.21.15.31:0/1309806635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d40cc030 con 0x7fb0d415bea0 2024-09-17T05:36:04.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d2800640 1 --2- 172.21.15.31:0/1309806635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d415bea0 0x7fb0d4158d00 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00ea20 tx=0x7fb0cc00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:04.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0ca000640 1 -- 172.21.15.31:0/1309806635 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc00cde0 con 0x7fb0d415bea0 2024-09-17T05:36:04.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0ca000640 1 -- 172.21.15.31:0/1309806635 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0cc004c40 con 0x7fb0d415bea0 2024-09-17T05:36:04.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0ca000640 1 -- 172.21.15.31:0/1309806635 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc005280 con 0x7fb0d415bea0 2024-09-17T05:36:04.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d9000640 1 -- 172.21.15.31:0/1309806635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d4156980 con 0x7fb0d415bea0 2024-09-17T05:36:04.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.125+0000 7fb0d9000640 1 -- 172.21.15.31:0/1309806635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d4156f40 con 0x7fb0d415bea0 2024-09-17T05:36:04.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.129+0000 7fb0d9000640 1 -- 172.21.15.31:0/1309806635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d40cc9d0 con 0x7fb0d415bea0 2024-09-17T05:36:04.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.129+0000 7fb0ca000640 1 -- 172.21.15.31:0/1309806635 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7fb0cc005420 con 0x7fb0d415bea0 2024-09-17T05:36:04.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.129+0000 7fb0ca000640 1 --2- 172.21.15.31:0/1309806635 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb0b0073aa0 0x7fb0b0075f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:04.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.129+0000 7fb0ca000640 1 -- 172.21.15.31:0/1309806635 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7fb0cc095e40 con 0x7fb0d415bea0 2024-09-17T05:36:04.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.129+0000 7fb0d1e00640 1 --2- 172.21.15.31:0/1309806635 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb0b0073aa0 0x7fb0b0075f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:04.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.129+0000 7fb0d1e00640 1 --2- 172.21.15.31:0/1309806635 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb0b0073aa0 0x7fb0b0075f60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40af000 tx=0x7fb0c401b060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:04.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.133+0000 7fb0ca000640 1 -- 172.21.15.31:0/1309806635 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb0cc09c080 con 0x7fb0d415bea0 2024-09-17T05:36:04.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.345+0000 7fb0d9000640 1 -- 172.21.15.31:0/1309806635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0d4070b60 con 0x7fb0d415bea0 2024-09-17T05:36:04.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.345+0000 7fb0ca000640 1 -- 172.21.15.31:0/1309806635 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5235 (secure 0 0 0) 0x7fb0cc016030 con 0x7fb0d415bea0 2024-09-17T05:36:04.347 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:04.347 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":101,"btime":"2024-09-17T05:35:54:363486+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3405206397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3405206397},{"type":"v1","addr":"172.21.15.155:6809","nonce":3405206397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6977,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4225787824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4225787824},{"type":"v1","addr":"172.21.15.155:6835","nonce":4225787824}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2838938586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2838938586},{"type":"v1","addr":"172.21.15.31:6834","nonce":2838938586}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:35:44.710527+0000","modified":"2024-09-17T05:35:47.749442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8343":{"gid":8343,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1808209578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1808209578},{"type":"v1","addr":"172.21.15.31:6835","nonce":1808209578}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8343,"qdb_cluster":[8343]},"id":11}]} 2024-09-17T05:36:04.347 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 101 2024-09-17T05:36:04.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.349+0000 7fb0d9000640 1 -- 172.21.15.31:0/1309806635 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb0b0073aa0 msgr2=0x7fb0b0075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:04.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.349+0000 7fb0d9000640 1 --2- 172.21.15.31:0/1309806635 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb0b0073aa0 0x7fb0b0075f60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40af000 tx=0x7fb0c401b060 comp rx=0 tx=0).stop 2024-09-17T05:36:04.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.349+0000 7fb0d9000640 1 -- 172.21.15.31:0/1309806635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d415bea0 msgr2=0x7fb0d4158d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:04.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.349+0000 7fb0d9000640 1 --2- 172.21.15.31:0/1309806635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d415bea0 0x7fb0d4158d00 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00ea20 tx=0x7fb0cc00eee0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.349+0000 7fb0d9000640 1 -- 172.21.15.31:0/1309806635 shutdown_connections 2024-09-17T05:36:04.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.349+0000 7fb0d9000640 1 --2- 172.21.15.31:0/1309806635 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb0b0073aa0 0x7fb0b0075f60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.349+0000 7fb0d9000640 1 --2- 172.21.15.31:0/1309806635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d415bea0 0x7fb0d4158d00 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.349+0000 7fb0d9000640 1 --2- 172.21.15.31:0/1309806635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0d40d28e0 0x7fb0d40c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.349+0000 7fb0d9000640 1 --2- 172.21.15.31:0/1309806635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb0d40cdb30 0x7fb0d4155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.349+0000 7fb0d9000640 1 -- 172.21.15.31:0/1309806635 >> 172.21.15.31:0/1309806635 conn(0x7fb0d40d1dc0 msgr2=0x7fb0d40b6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:04.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.349+0000 7fb0d9000640 1 -- 172.21.15.31:0/1309806635 shutdown_connections 2024-09-17T05:36:04.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.349+0000 7fb0d9000640 1 -- 172.21.15.31:0/1309806635 wait complete. 2024-09-17T05:36:04.370 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:04.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.513+0000 7f14eb200640 1 -- 172.21.15.31:0/4286239083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14e40b49e0 msgr2=0x7f14e406f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:04.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.513+0000 7f14eb200640 1 --2- 172.21.15.31:0/4286239083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14e40b49e0 0x7f14e406f7b0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f14dc009bc0 tx=0x7f14dc01ca80 comp rx=0 tx=0).stop 2024-09-17T05:36:04.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.513+0000 7f14eb200640 1 -- 172.21.15.31:0/4286239083 shutdown_connections 2024-09-17T05:36:04.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.513+0000 7f14eb200640 1 --2- 172.21.15.31:0/4286239083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14e40b49e0 0x7f14e406f7b0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.513+0000 7f14eb200640 1 -- 172.21.15.31:0/4286239083 >> 172.21.15.31:0/4286239083 conn(0x7f14e40b18f0 msgr2=0x7f14e40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:04.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.513+0000 7f14eb200640 1 -- 172.21.15.31:0/4286239083 shutdown_connections 2024-09-17T05:36:04.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.513+0000 7f14eb200640 1 -- 172.21.15.31:0/4286239083 wait complete. 2024-09-17T05:36:04.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14eb200640 1 Processor -- start 2024-09-17T05:36:04.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14eb200640 1 -- start start 2024-09-17T05:36:04.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14eb200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14e40b49e0 0x7f14e41431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:04.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14eb200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14e40cd100 0x7f14e409c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:04.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14eb200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14e415dae0 0x7f14e409c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:04.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14eb200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f14e40ccc10 con 0x7f14e40b49e0 2024-09-17T05:36:04.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14eb200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f14e40cca90 con 0x7f14e40cd100 2024-09-17T05:36:04.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14eb200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f14e4168940 con 0x7f14e415dae0 2024-09-17T05:36:04.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14e3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14e40b49e0 0x7f14e41431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:04.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14e3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14e40b49e0 0x7f14e41431d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49246/0 (socket says 172.21.15.31:49246) 2024-09-17T05:36:04.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14e3e00640 1 -- 172.21.15.31:0/3729501056 learned_addr learned my addr 172.21.15.31:0/3729501056 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:04.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14e9200640 1 --2- 172.21.15.31:0/3729501056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14e415dae0 0x7f14e409c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:04.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14e3400640 1 --2- 172.21.15.31:0/3729501056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14e40cd100 0x7f14e409c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:04.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14e3e00640 1 -- 172.21.15.31:0/3729501056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14e415dae0 msgr2=0x7f14e409c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:04.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14e3e00640 1 --2- 172.21.15.31:0/3729501056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14e415dae0 0x7f14e409c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14e3e00640 1 -- 172.21.15.31:0/3729501056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14e40cd100 msgr2=0x7f14e409c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:04.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14e3e00640 1 --2- 172.21.15.31:0/3729501056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14e40cd100 0x7f14e409c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14e3e00640 1 -- 172.21.15.31:0/3729501056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e409bc80 con 0x7f14e40b49e0 2024-09-17T05:36:04.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14e3400640 1 --2- 172.21.15.31:0/3729501056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14e40cd100 0x7f14e409c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:04.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14e3e00640 1 --2- 172.21.15.31:0/3729501056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14e40b49e0 0x7f14e41431d0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f14d400c3c0 tx=0x7f14d400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:04.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14dbe00640 1 -- 172.21.15.31:0/3729501056 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d4017070 con 0x7f14e40b49e0 2024-09-17T05:36:04.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14dbe00640 1 -- 172.21.15.31:0/3729501056 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14d40053c0 con 0x7f14e40b49e0 2024-09-17T05:36:04.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14dbe00640 1 -- 172.21.15.31:0/3729501056 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d4003860 con 0x7f14e40b49e0 2024-09-17T05:36:04.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14eb200640 1 -- 172.21.15.31:0/3729501056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e406fe20 con 0x7f14e40b49e0 2024-09-17T05:36:04.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.517+0000 7f14eb200640 1 -- 172.21.15.31:0/3729501056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e409bef0 con 0x7f14e40b49e0 2024-09-17T05:36:04.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.521+0000 7f14eb200640 1 -- 172.21.15.31:0/3729501056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e4069410 con 0x7f14e40b49e0 2024-09-17T05:36:04.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.521+0000 7f14dbe00640 1 -- 172.21.15.31:0/3729501056 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f14d401a070 con 0x7f14e40b49e0 2024-09-17T05:36:04.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.521+0000 7f14dbe00640 1 --2- 172.21.15.31:0/3729501056 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f14c4073a70 0x7f14c4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:04.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.521+0000 7f14dbe00640 1 -- 172.21.15.31:0/3729501056 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f14d40946b0 con 0x7f14e40b49e0 2024-09-17T05:36:04.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.521+0000 7f14e3400640 1 --2- 172.21.15.31:0/3729501056 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f14c4073a70 0x7f14c4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:04.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.521+0000 7f14e3400640 1 --2- 172.21.15.31:0/3729501056 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f14c4073a70 0x7f14c4075f30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f14e4143f40 tx=0x7f14d0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:04.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.525+0000 7f14dbe00640 1 -- 172.21.15.31:0/3729501056 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f14d405e150 con 0x7f14e40b49e0 2024-09-17T05:36:04.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.737+0000 7f14eb200640 1 -- 172.21.15.31:0/3729501056 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14e40ad990 con 0x7f14e40b49e0 2024-09-17T05:36:04.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.737+0000 7f14dbe00640 1 -- 172.21.15.31:0/3729501056 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5235 (secure 0 0 0) 0x7f14d4062b80 con 0x7f14e40b49e0 2024-09-17T05:36:04.796 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:04.796 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":101,"btime":"2024-09-17T05:35:54:363486+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3405206397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3405206397},{"type":"v1","addr":"172.21.15.155:6809","nonce":3405206397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6977,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4225787824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4225787824},{"type":"v1","addr":"172.21.15.155:6835","nonce":4225787824}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2838938586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2838938586},{"type":"v1","addr":"172.21.15.31:6834","nonce":2838938586}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:35:44.710527+0000","modified":"2024-09-17T05:35:47.749442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8343":{"gid":8343,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1808209578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1808209578},{"type":"v1","addr":"172.21.15.31:6835","nonce":1808209578}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8343,"qdb_cluster":[8343]},"id":11}]} 2024-09-17T05:36:04.798 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 101 2024-09-17T05:36:04.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.737+0000 7f14eb200640 1 -- 172.21.15.31:0/3729501056 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f14c4073a70 msgr2=0x7f14c4075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:04.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.737+0000 7f14eb200640 1 --2- 172.21.15.31:0/3729501056 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f14c4073a70 0x7f14c4075f30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f14e4143f40 tx=0x7f14d0009040 comp rx=0 tx=0).stop 2024-09-17T05:36:04.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.737+0000 7f14eb200640 1 -- 172.21.15.31:0/3729501056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14e40b49e0 msgr2=0x7f14e41431d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:04.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.737+0000 7f14eb200640 1 --2- 172.21.15.31:0/3729501056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14e40b49e0 0x7f14e41431d0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f14d400c3c0 tx=0x7f14d400c880 comp rx=0 tx=0).stop 2024-09-17T05:36:04.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.737+0000 7f14eb200640 1 -- 172.21.15.31:0/3729501056 shutdown_connections 2024-09-17T05:36:04.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.737+0000 7f14eb200640 1 --2- 172.21.15.31:0/3729501056 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f14c4073a70 0x7f14c4075f30 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.737+0000 7f14eb200640 1 --2- 172.21.15.31:0/3729501056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14e415dae0 0x7f14e409c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.737+0000 7f14eb200640 1 --2- 172.21.15.31:0/3729501056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14e40cd100 0x7f14e409c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.741+0000 7f14eb200640 1 --2- 172.21.15.31:0/3729501056 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14e40b49e0 0x7f14e41431d0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.741+0000 7f14eb200640 1 -- 172.21.15.31:0/3729501056 >> 172.21.15.31:0/3729501056 conn(0x7f14e40b18f0 msgr2=0x7f14e40aeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:04.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.741+0000 7f14eb200640 1 -- 172.21.15.31:0/3729501056 shutdown_connections 2024-09-17T05:36:04.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.741+0000 7f14eb200640 1 -- 172.21.15.31:0/3729501056 wait complete. 2024-09-17T05:36:04.799 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:04.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.945+0000 7f42ba400640 1 -- 172.21.15.31:0/3303445988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b40cdb30 msgr2=0x7f42b40aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:04.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.945+0000 7f42ba400640 1 --2- 172.21.15.31:0/3303445988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b40cdb30 0x7f42b40aeef0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f42b40cc3a0 tx=0x7f42ac01cd80 comp rx=0 tx=0).stop 2024-09-17T05:36:04.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.945+0000 7f42ba400640 1 -- 172.21.15.31:0/3303445988 shutdown_connections 2024-09-17T05:36:04.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.945+0000 7f42ba400640 1 --2- 172.21.15.31:0/3303445988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b40cdb30 0x7f42b40aeef0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.945+0000 7f42ba400640 1 --2- 172.21.15.31:0/3303445988 >> v2:172.21.15.155:3300/0 conn(0x7f42b40ced80 0x7f42b40ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.945+0000 7f42ba400640 1 -- 172.21.15.31:0/3303445988 >> 172.21.15.31:0/3303445988 conn(0x7f42b40d1dc0 msgr2=0x7f42b40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:04.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.945+0000 7f42ba400640 1 -- 172.21.15.31:0/3303445988 shutdown_connections 2024-09-17T05:36:04.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.945+0000 7f42ba400640 1 -- 172.21.15.31:0/3303445988 wait complete. 2024-09-17T05:36:04.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.945+0000 7f42ba400640 1 Processor -- start 2024-09-17T05:36:04.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.945+0000 7f42ba400640 1 -- start start 2024-09-17T05:36:04.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42ba400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42b40cdb30 0x7f42b4151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:04.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42ba400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b40ced80 0x7f42b4071610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:04.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42ba400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42b415bea0 0x7f42b4071b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:04.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42ba400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f42b41692f0 con 0x7f42b40ced80 2024-09-17T05:36:04.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42ba400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f42b4169170 con 0x7f42b40cdb30 2024-09-17T05:36:04.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42ba400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f42b4169470 con 0x7f42b415bea0 2024-09-17T05:36:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42b2a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b40ced80 0x7f42b4071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42b2a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b40ced80 0x7f42b4071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49252/0 (socket says 172.21.15.31:49252) 2024-09-17T05:36:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42b2a00640 1 -- 172.21.15.31:0/3924295763 learned_addr learned my addr 172.21.15.31:0/3924295763 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42b3400640 1 --2- 172.21.15.31:0/3924295763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42b40cdb30 0x7f42b4151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42b3e00640 1 --2- 172.21.15.31:0/3924295763 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42b415bea0 0x7f42b4071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42b2a00640 1 -- 172.21.15.31:0/3924295763 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42b415bea0 msgr2=0x7f42b4071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42b2a00640 1 --2- 172.21.15.31:0/3924295763 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42b415bea0 0x7f42b4071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42b2a00640 1 -- 172.21.15.31:0/3924295763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42b40cdb30 msgr2=0x7f42b4151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:04.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42b2a00640 1 --2- 172.21.15.31:0/3924295763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42b40cdb30 0x7f42b4151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:04.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42b2a00640 1 -- 172.21.15.31:0/3924295763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b40b1570 con 0x7f42b40ced80 2024-09-17T05:36:04.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42b2a00640 1 --2- 172.21.15.31:0/3924295763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b40ced80 0x7f42b4071610 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f42a000d9b0 tx=0x7f42a000de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:04.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42ab400640 1 -- 172.21.15.31:0/3924295763 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a0017070 con 0x7f42b40ced80 2024-09-17T05:36:04.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42ab400640 1 -- 172.21.15.31:0/3924295763 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42a0009cc0 con 0x7f42b40ced80 2024-09-17T05:36:04.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42ab400640 1 -- 172.21.15.31:0/3924295763 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a0005280 con 0x7f42b40ced80 2024-09-17T05:36:04.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42ba400640 1 -- 172.21.15.31:0/3924295763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b4158330 con 0x7f42b40ced80 2024-09-17T05:36:04.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42ba400640 1 -- 172.21.15.31:0/3924295763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b40b36f0 con 0x7f42b40ced80 2024-09-17T05:36:04.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42ba400640 1 -- 172.21.15.31:0/3924295763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b40ce020 con 0x7f42b40ced80 2024-09-17T05:36:04.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.949+0000 7f42ab400640 1 -- 172.21.15.31:0/3924295763 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f42a0005420 con 0x7f42b40ced80 2024-09-17T05:36:04.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.953+0000 7f42ab400640 1 --2- 172.21.15.31:0/3924295763 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4294073a70 0x7f4294075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:04.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.953+0000 7f42ab400640 1 -- 172.21.15.31:0/3924295763 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f42a00956a0 con 0x7f42b40ced80 2024-09-17T05:36:04.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.953+0000 7f42b3400640 1 --2- 172.21.15.31:0/3924295763 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4294073a70 0x7f4294075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:04.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.953+0000 7f42b3400640 1 --2- 172.21.15.31:0/3924295763 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4294073a70 0x7f4294075f30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f42b40ceba0 tx=0x7f42a4009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:04.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:04.957+0000 7f42ab400640 1 -- 172.21.15.31:0/3924295763 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f42a005f0f0 con 0x7f42b40ced80 2024-09-17T05:36:05.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.133+0000 7f42ba400640 1 -- 172.21.15.31:0/3924295763 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42b40ce620 con 0x7f42b40ced80 2024-09-17T05:36:05.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.137+0000 7f42ab400640 1 -- 172.21.15.31:0/3924295763 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) ==== 74+0+16799 (secure 0 0 0) 0x7f42a0063b20 con 0x7f42b40ced80 2024-09-17T05:36:05.138 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:05.138 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":141,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:35:46.306986+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:35:42.419622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T05:35:43.665501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:05.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.137+0000 7f42ba400640 1 -- 172.21.15.31:0/3924295763 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4294073a70 msgr2=0x7f4294075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:05.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.137+0000 7f42ba400640 1 --2- 172.21.15.31:0/3924295763 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4294073a70 0x7f4294075f30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f42b40ceba0 tx=0x7f42a4009060 comp rx=0 tx=0).stop 2024-09-17T05:36:05.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.137+0000 7f42ba400640 1 -- 172.21.15.31:0/3924295763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b40ced80 msgr2=0x7f42b4071610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:05.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.137+0000 7f42ba400640 1 --2- 172.21.15.31:0/3924295763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b40ced80 0x7f42b4071610 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f42a000d9b0 tx=0x7f42a000de70 comp rx=0 tx=0).stop 2024-09-17T05:36:05.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.137+0000 7f42ba400640 1 -- 172.21.15.31:0/3924295763 shutdown_connections 2024-09-17T05:36:05.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.137+0000 7f42ba400640 1 --2- 172.21.15.31:0/3924295763 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4294073a70 0x7f4294075f30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.137+0000 7f42ba400640 1 --2- 172.21.15.31:0/3924295763 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42b415bea0 0x7f42b4071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.137+0000 7f42ba400640 1 --2- 172.21.15.31:0/3924295763 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b40ced80 0x7f42b4071610 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.137+0000 7f42ba400640 1 --2- 172.21.15.31:0/3924295763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42b40cdb30 0x7f42b4151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.137+0000 7f42ba400640 1 -- 172.21.15.31:0/3924295763 >> 172.21.15.31:0/3924295763 conn(0x7f42b40d1dc0 msgr2=0x7f42b406dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:05.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.137+0000 7f42ba400640 1 -- 172.21.15.31:0/3924295763 shutdown_connections 2024-09-17T05:36:05.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.137+0000 7f42ba400640 1 -- 172.21.15.31:0/3924295763 wait complete. 2024-09-17T05:36:05.159 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:36:05.159 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:05.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f3402200640 1 -- 172.21.15.31:0/1059614089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33fc15e4a0 msgr2=0x7f33fc068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:05.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f3402200640 1 --2- 172.21.15.31:0/1059614089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33fc15e4a0 0x7f33fc068c40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009840 tx=0x7f33ec01c760 comp rx=0 tx=0).stop 2024-09-17T05:36:05.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f3402200640 1 -- 172.21.15.31:0/1059614089 shutdown_connections 2024-09-17T05:36:05.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f3402200640 1 --2- 172.21.15.31:0/1059614089 >> v2:172.21.15.155:3300/0 conn(0x7f33fc0af4f0 0x7f33fc0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f3402200640 1 --2- 172.21.15.31:0/1059614089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33fc15e4a0 0x7f33fc068c40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f3402200640 1 -- 172.21.15.31:0/1059614089 >> 172.21.15.31:0/1059614089 conn(0x7f33fc0b1f10 msgr2=0x7f33fc0b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:05.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f3402200640 1 -- 172.21.15.31:0/1059614089 shutdown_connections 2024-09-17T05:36:05.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f3402200640 1 -- 172.21.15.31:0/1059614089 wait complete. 2024-09-17T05:36:05.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f3402200640 1 Processor -- start 2024-09-17T05:36:05.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f3402200640 1 -- start start 2024-09-17T05:36:05.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f3402200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33fc0af4f0 0x7f33fc1fc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:05.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f3402200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33fc15e4a0 0x7f33fc0ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:05.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f3402200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33fc074920 0x7f33fc074dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:05.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f3402200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc168170 con 0x7f33fc0af4f0 2024-09-17T05:36:05.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f3402200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc167ff0 con 0x7f33fc074920 2024-09-17T05:36:05.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f3402200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f33fc1682f0 con 0x7f33fc15e4a0 2024-09-17T05:36:05.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f33fb400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33fc0af4f0 0x7f33fc1fc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:05.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f33fb400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33fc0af4f0 0x7f33fc1fc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49262/0 (socket says 172.21.15.31:49262) 2024-09-17T05:36:05.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f33fb400640 1 -- 172.21.15.31:0/3313067138 learned_addr learned my addr 172.21.15.31:0/3313067138 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:05.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f33fbe00640 1 --2- 172.21.15.31:0/3313067138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33fc074920 0x7f33fc074dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:05.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.305+0000 7f33f3e00640 1 --2- 172.21.15.31:0/3313067138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33fc15e4a0 0x7f33fc0ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:05.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.309+0000 7f33fb400640 1 -- 172.21.15.31:0/3313067138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33fc15e4a0 msgr2=0x7f33fc0ad110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:05.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.309+0000 7f33fb400640 1 --2- 172.21.15.31:0/3313067138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33fc15e4a0 0x7f33fc0ad110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.309+0000 7f33fb400640 1 -- 172.21.15.31:0/3313067138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33fc074920 msgr2=0x7f33fc074dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:05.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.309+0000 7f33fb400640 1 --2- 172.21.15.31:0/3313067138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33fc074920 0x7f33fc074dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.309+0000 7f33fb400640 1 -- 172.21.15.31:0/3313067138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33fc0b3770 con 0x7f33fc0af4f0 2024-09-17T05:36:05.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.309+0000 7f33fbe00640 1 --2- 172.21.15.31:0/3313067138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33fc074920 0x7f33fc074dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:05.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.309+0000 7f33f3e00640 1 --2- 172.21.15.31:0/3313067138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33fc15e4a0 0x7f33fc0ad110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:05.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.309+0000 7f33fb400640 1 --2- 172.21.15.31:0/3313067138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33fc0af4f0 0x7f33fc1fc0d0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f33ec01ae10 tx=0x7f33ec0a56c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:05.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.309+0000 7f33f3400640 1 -- 172.21.15.31:0/3313067138 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec0bb070 con 0x7f33fc0af4f0 2024-09-17T05:36:05.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.309+0000 7f33f3400640 1 -- 172.21.15.31:0/3313067138 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33ec004470 con 0x7f33fc0af4f0 2024-09-17T05:36:05.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.309+0000 7f33f3400640 1 -- 172.21.15.31:0/3313067138 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec0b2040 con 0x7f33fc0af4f0 2024-09-17T05:36:05.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.309+0000 7f3402200640 1 -- 172.21.15.31:0/3313067138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33fc0b3a50 con 0x7f33fc0af4f0 2024-09-17T05:36:05.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.309+0000 7f3402200640 1 -- 172.21.15.31:0/3313067138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33fc0b4010 con 0x7f33fc0af4f0 2024-09-17T05:36:05.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.309+0000 7f3402200640 1 -- 172.21.15.31:0/3313067138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33fc068c40 con 0x7f33fc0af4f0 2024-09-17T05:36:05.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.309+0000 7f33f3400640 1 -- 172.21.15.31:0/3313067138 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f33ec005290 con 0x7f33fc0af4f0 2024-09-17T05:36:05.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.309+0000 7f33f3400640 1 --2- 172.21.15.31:0/3313067138 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f33d8073aa0 0x7f33d8075f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:05.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.313+0000 7f33f3400640 1 -- 172.21.15.31:0/3313067138 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f33ec12ea10 con 0x7f33fc0af4f0 2024-09-17T05:36:05.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.313+0000 7f33f3e00640 1 --2- 172.21.15.31:0/3313067138 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f33d8073aa0 0x7f33d8075f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:05.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.313+0000 7f33f3e00640 1 --2- 172.21.15.31:0/3313067138 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f33d8073aa0 0x7f33d8075f60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0b13e0 tx=0x7f33e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:05.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.313+0000 7f33f3400640 1 -- 172.21.15.31:0/3313067138 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f33ec016410 con 0x7f33fc0af4f0 2024-09-17T05:36:05.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.529+0000 7f3402200640 1 -- 172.21.15.31:0/3313067138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33fc075310 con 0x7f33fc0af4f0 2024-09-17T05:36:05.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.529+0000 7f33f3400640 1 -- 172.21.15.31:0/3313067138 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5235 (secure 0 0 0) 0x7f33ec0f8e90 con 0x7f33fc0af4f0 2024-09-17T05:36:05.531 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:05.532 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":101,"btime":"2024-09-17T05:35:54:363486+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3405206397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3405206397},{"type":"v1","addr":"172.21.15.155:6809","nonce":3405206397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6977,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4225787824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4225787824},{"type":"v1","addr":"172.21.15.155:6835","nonce":4225787824}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2838938586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2838938586},{"type":"v1","addr":"172.21.15.31:6834","nonce":2838938586}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:35:44.710527+0000","modified":"2024-09-17T05:35:47.749442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8343":{"gid":8343,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1808209578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1808209578},{"type":"v1","addr":"172.21.15.31:6835","nonce":1808209578}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8343,"qdb_cluster":[8343]},"id":11}]} 2024-09-17T05:36:05.532 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 101 2024-09-17T05:36:05.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.533+0000 7f3402200640 1 -- 172.21.15.31:0/3313067138 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f33d8073aa0 msgr2=0x7f33d8075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:05.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.533+0000 7f3402200640 1 --2- 172.21.15.31:0/3313067138 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f33d8073aa0 0x7f33d8075f60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0b13e0 tx=0x7f33e4009040 comp rx=0 tx=0).stop 2024-09-17T05:36:05.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.533+0000 7f3402200640 1 -- 172.21.15.31:0/3313067138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33fc0af4f0 msgr2=0x7f33fc1fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:05.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.533+0000 7f3402200640 1 --2- 172.21.15.31:0/3313067138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33fc0af4f0 0x7f33fc1fc0d0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f33ec01ae10 tx=0x7f33ec0a56c0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.533+0000 7f3402200640 1 -- 172.21.15.31:0/3313067138 shutdown_connections 2024-09-17T05:36:05.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.533+0000 7f3402200640 1 --2- 172.21.15.31:0/3313067138 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f33d8073aa0 0x7f33d8075f60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.533+0000 7f3402200640 1 --2- 172.21.15.31:0/3313067138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33fc074920 0x7f33fc074dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.533+0000 7f3402200640 1 --2- 172.21.15.31:0/3313067138 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33fc15e4a0 0x7f33fc0ad110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.533+0000 7f3402200640 1 --2- 172.21.15.31:0/3313067138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33fc0af4f0 0x7f33fc1fc0d0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.533+0000 7f3402200640 1 -- 172.21.15.31:0/3313067138 >> 172.21.15.31:0/3313067138 conn(0x7f33fc0b1f10 msgr2=0x7f33fc070690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:05.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.533+0000 7f3402200640 1 -- 172.21.15.31:0/3313067138 shutdown_connections 2024-09-17T05:36:05.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.533+0000 7f3402200640 1 -- 172.21.15.31:0/3313067138 wait complete. 2024-09-17T05:36:05.553 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:05.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.697+0000 7f889e400640 1 -- 172.21.15.31:0/3591875670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f887c004810 msgr2=0x7f887c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:05.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.697+0000 7f889e400640 1 --2- 172.21.15.31:0/3591875670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f887c004810 0x7f887c004c90 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f8880009b60 tx=0x7f888001d210 comp rx=0 tx=0).stop 2024-09-17T05:36:05.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.697+0000 7f8897e00640 1 -- 172.21.15.31:0/3591875670 reap_dead start 2024-09-17T05:36:05.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f889e400640 1 -- 172.21.15.31:0/3591875670 shutdown_connections 2024-09-17T05:36:05.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f889e400640 1 -- 172.21.15.31:0/3591875670 >> 172.21.15.31:0/3591875670 conn(0x7f88980d1dc0 msgr2=0x7f88980d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:05.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f889e400640 1 -- 172.21.15.31:0/3591875670 shutdown_connections 2024-09-17T05:36:05.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f889e400640 1 -- 172.21.15.31:0/3591875670 wait complete. 2024-09-17T05:36:05.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f889e400640 1 Processor -- start 2024-09-17T05:36:05.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f889e400640 1 -- start start 2024-09-17T05:36:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f889e400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f887c004810 0x7f8898159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f889e400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88980c8020 0x7f8898071d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f889e400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8898151c30 0x7f88981520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f889e400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f889815c470 con 0x7f88980c8020 2024-09-17T05:36:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f889e400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f88980d2af0 con 0x7f8898151c30 2024-09-17T05:36:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f889e400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f88980ae9b0 con 0x7f887c004810 2024-09-17T05:36:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f888fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88980c8020 0x7f8898071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f888fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88980c8020 0x7f8898071d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49278/0 (socket says 172.21.15.31:49278) 2024-09-17T05:36:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f888fe00640 1 -- 172.21.15.31:0/3656768317 learned_addr learned my addr 172.21.15.31:0/3656768317 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f8897e00640 1 --2- 172.21.15.31:0/3656768317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8898151c30 0x7f88981520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f8897400640 1 --2- 172.21.15.31:0/3656768317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f887c004810 0x7f8898159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f888fe00640 1 -- 172.21.15.31:0/3656768317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f887c004810 msgr2=0x7f8898159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f888fe00640 1 --2- 172.21.15.31:0/3656768317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f887c004810 0x7f8898159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f888fe00640 1 -- 172.21.15.31:0/3656768317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8898151c30 msgr2=0x7f88981520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f888fe00640 1 --2- 172.21.15.31:0/3656768317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8898151c30 0x7f88981520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f888fe00640 1 -- 172.21.15.31:0/3656768317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88981f3170 con 0x7f88980c8020 2024-09-17T05:36:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f8897e00640 1 --2- 172.21.15.31:0/3656768317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8898151c30 0x7f88981520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f8897400640 1 --2- 172.21.15.31:0/3656768317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f887c004810 0x7f8898159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.701+0000 7f888fe00640 1 --2- 172.21.15.31:0/3656768317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88980c8020 0x7f8898071d30 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f88800af040 tx=0x7f8880005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.705+0000 7f888f400640 1 -- 172.21.15.31:0/3656768317 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88800bd070 con 0x7f88980c8020 2024-09-17T05:36:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.705+0000 7f888f400640 1 -- 172.21.15.31:0/3656768317 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88800ac8a0 con 0x7f88980c8020 2024-09-17T05:36:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.705+0000 7f888f400640 1 -- 172.21.15.31:0/3656768317 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88800b1040 con 0x7f88980c8020 2024-09-17T05:36:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.705+0000 7f889e400640 1 -- 172.21.15.31:0/3656768317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88981f23b0 con 0x7f88980c8020 2024-09-17T05:36:05.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.705+0000 7f889e400640 1 -- 172.21.15.31:0/3656768317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88981f2970 con 0x7f88980c8020 2024-09-17T05:36:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.705+0000 7f889e400640 1 -- 172.21.15.31:0/3656768317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88980ce670 con 0x7f88980c8020 2024-09-17T05:36:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.705+0000 7f888f400640 1 -- 172.21.15.31:0/3656768317 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f88800accd0 con 0x7f88980c8020 2024-09-17T05:36:05.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.705+0000 7f888f400640 1 --2- 172.21.15.31:0/3656768317 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8874073aa0 0x7f8874075f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:05.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.705+0000 7f888f400640 1 -- 172.21.15.31:0/3656768317 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f888012cca0 con 0x7f88980c8020 2024-09-17T05:36:05.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.709+0000 7f8897400640 1 --2- 172.21.15.31:0/3656768317 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8874073aa0 0x7f8874075f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:05.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.709+0000 7f8897400640 1 --2- 172.21.15.31:0/3656768317 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8874073aa0 0x7f8874075f60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8888001d60 tx=0x7f8888006c10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:05.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.709+0000 7f888f400640 1 -- 172.21.15.31:0/3656768317 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8880016f80 con 0x7f88980c8020 2024-09-17T05:36:05.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.925+0000 7f889e400640 1 -- 172.21.15.31:0/3656768317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f889815ab20 con 0x7f88980c8020 2024-09-17T05:36:05.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.929+0000 7f888f400640 1 -- 172.21.15.31:0/3656768317 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5235 (secure 0 0 0) 0x7f88800f91b0 con 0x7f88980c8020 2024-09-17T05:36:05.929 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:05.929 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":101,"btime":"2024-09-17T05:35:54:363486+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3405206397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3405206397},{"type":"v1","addr":"172.21.15.155:6809","nonce":3405206397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6977,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4225787824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4225787824},{"type":"v1","addr":"172.21.15.155:6835","nonce":4225787824}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2838938586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2838938586},{"type":"v1","addr":"172.21.15.31:6834","nonce":2838938586}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:35:44.710527+0000","modified":"2024-09-17T05:35:47.749442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8343},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8343":{"gid":8343,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/1808209578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1808209578},{"type":"v1","addr":"172.21.15.31:6835","nonce":1808209578}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8343,"qdb_cluster":[8343]},"id":11}]} 2024-09-17T05:36:05.930 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 101 2024-09-17T05:36:05.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.929+0000 7f889e400640 1 -- 172.21.15.31:0/3656768317 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8874073aa0 msgr2=0x7f8874075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:05.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.929+0000 7f889e400640 1 --2- 172.21.15.31:0/3656768317 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8874073aa0 0x7f8874075f60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8888001d60 tx=0x7f8888006c10 comp rx=0 tx=0).stop 2024-09-17T05:36:05.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.929+0000 7f889e400640 1 -- 172.21.15.31:0/3656768317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88980c8020 msgr2=0x7f8898071d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:05.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.929+0000 7f889e400640 1 --2- 172.21.15.31:0/3656768317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88980c8020 0x7f8898071d30 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f88800af040 tx=0x7f8880005620 comp rx=0 tx=0).stop 2024-09-17T05:36:05.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.929+0000 7f889e400640 1 -- 172.21.15.31:0/3656768317 shutdown_connections 2024-09-17T05:36:05.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.929+0000 7f889e400640 1 --2- 172.21.15.31:0/3656768317 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8874073aa0 0x7f8874075f60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.929+0000 7f889e400640 1 --2- 172.21.15.31:0/3656768317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8898151c30 0x7f88981520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.929+0000 7f889e400640 1 --2- 172.21.15.31:0/3656768317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f88980c8020 0x7f8898071d30 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.929+0000 7f889e400640 1 --2- 172.21.15.31:0/3656768317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f887c004810 0x7f8898159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:05.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.929+0000 7f889e400640 1 -- 172.21.15.31:0/3656768317 >> 172.21.15.31:0/3656768317 conn(0x7f88980d1dc0 msgr2=0x7f8898159d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:05.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.929+0000 7f889e400640 1 -- 172.21.15.31:0/3656768317 shutdown_connections 2024-09-17T05:36:05.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:05.929+0000 7f889e400640 1 -- 172.21.15.31:0/3656768317 wait complete. 2024-09-17T05:36:05.950 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:06.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36f5c00640 1 -- 172.21.15.31:0/4235151554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36d4004dc0 msgr2=0x7f36d4005240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:06.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36f5c00640 1 --2- 172.21.15.31:0/4235151554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36d4004dc0 0x7f36d4005240 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f36e8009ee0 tx=0x7f36e801d5c0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36f5200640 1 -- 172.21.15.31:0/4235151554 reap_dead start 2024-09-17T05:36:06.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36f5c00640 1 -- 172.21.15.31:0/4235151554 shutdown_connections 2024-09-17T05:36:06.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36f5c00640 1 -- 172.21.15.31:0/4235151554 >> 172.21.15.31:0/4235151554 conn(0x7f36f009aa10 msgr2=0x7f36f009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:06.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36f5c00640 1 -- 172.21.15.31:0/4235151554 shutdown_connections 2024-09-17T05:36:06.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36f5c00640 1 -- 172.21.15.31:0/4235151554 wait complete. 2024-09-17T05:36:06.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36f5c00640 1 Processor -- start 2024-09-17T05:36:06.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36f5c00640 1 -- start start 2024-09-17T05:36:06.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36f5c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36d4004dc0 0x7f36f00c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:06.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36f5c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36f00ca9f0 0x7f36f00cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:06.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36f5c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36f00cd990 0x7f36f00b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:06.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36f5c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f36f0169e80 con 0x7f36f00ca9f0 2024-09-17T05:36:06.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36f5c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f36f0169d00 con 0x7f36d4004dc0 2024-09-17T05:36:06.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36f5c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f36f016a000 con 0x7f36f00cd990 2024-09-17T05:36:06.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36e7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36f00ca9f0 0x7f36f00cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:06.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36e7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36f00ca9f0 0x7f36f00cd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49292/0 (socket says 172.21.15.31:49292) 2024-09-17T05:36:06.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36e7e00640 1 -- 172.21.15.31:0/2562607530 learned_addr learned my addr 172.21.15.31:0/2562607530 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:06.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36f5200640 1 --2- 172.21.15.31:0/2562607530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36f00cd990 0x7f36f00b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:06.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36efe00640 1 --2- 172.21.15.31:0/2562607530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36d4004dc0 0x7f36f00c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:06.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36e7e00640 1 -- 172.21.15.31:0/2562607530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36f00cd990 msgr2=0x7f36f00b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:06.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36e7e00640 1 --2- 172.21.15.31:0/2562607530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36f00cd990 0x7f36f00b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36e7e00640 1 -- 172.21.15.31:0/2562607530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36d4004dc0 msgr2=0x7f36f00c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:06.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36e7e00640 1 --2- 172.21.15.31:0/2562607530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36d4004dc0 0x7f36f00c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36e7e00640 1 -- 172.21.15.31:0/2562607530 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f00cae70 con 0x7f36f00ca9f0 2024-09-17T05:36:06.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.097+0000 7f36f5200640 1 --2- 172.21.15.31:0/2562607530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36f00cd990 0x7f36f00b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:06.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.101+0000 7f36e7e00640 1 --2- 172.21.15.31:0/2562607530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36f00ca9f0 0x7f36f00cd450 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f36d800e590 tx=0x7f36d800ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:06.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.101+0000 7f36ecc00640 1 -- 172.21.15.31:0/2562607530 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d8015070 con 0x7f36f00ca9f0 2024-09-17T05:36:06.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.101+0000 7f36ecc00640 1 -- 172.21.15.31:0/2562607530 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f36d8010890 con 0x7f36f00ca9f0 2024-09-17T05:36:06.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.101+0000 7f36f5c00640 1 -- 172.21.15.31:0/2562607530 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f00c8e20 con 0x7f36f00ca9f0 2024-09-17T05:36:06.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.101+0000 7f36ecc00640 1 -- 172.21.15.31:0/2562607530 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d8010ce0 con 0x7f36f00ca9f0 2024-09-17T05:36:06.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.101+0000 7f36f5c00640 1 -- 172.21.15.31:0/2562607530 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f00c93c0 con 0x7f36f00ca9f0 2024-09-17T05:36:06.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.101+0000 7f36f5c00640 1 -- 172.21.15.31:0/2562607530 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f00ce4e0 con 0x7f36f00ca9f0 2024-09-17T05:36:06.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.101+0000 7f36ecc00640 1 -- 172.21.15.31:0/2562607530 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f36d8018070 con 0x7f36f00ca9f0 2024-09-17T05:36:06.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.101+0000 7f36ecc00640 1 --2- 172.21.15.31:0/2562607530 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f36cc073aa0 0x7f36cc075f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:06.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.101+0000 7f36ecc00640 1 -- 172.21.15.31:0/2562607530 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7f36d8095650 con 0x7f36f00ca9f0 2024-09-17T05:36:06.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.105+0000 7f36efe00640 1 --2- 172.21.15.31:0/2562607530 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f36cc073aa0 0x7f36cc075f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:06.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.105+0000 7f36efe00640 1 --2- 172.21.15.31:0/2562607530 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f36cc073aa0 0x7f36cc075f60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f36e0006470 tx=0x7f36e0006bf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:06.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.105+0000 7f36ecc00640 1 -- 172.21.15.31:0/2562607530 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f36f00cae70 con 0x7f36f00ca9f0 2024-09-17T05:36:06.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.285+0000 7f36f5c00640 1 -- 172.21.15.31:0/2562607530 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36f00d1940 con 0x7f36f00ca9f0 2024-09-17T05:36:06.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.285+0000 7f36ecc00640 1 -- 172.21.15.31:0/2562607530 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) ==== 74+0+16799 (secure 0 0 0) 0x7f36d805f0f0 con 0x7f36f00ca9f0 2024-09-17T05:36:06.288 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:06.289 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":141,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:35:46.306986+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:35:42.419622+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T05:35:43.665501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:06.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.289+0000 7f36f5c00640 1 -- 172.21.15.31:0/2562607530 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f36cc073aa0 msgr2=0x7f36cc075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:06.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.289+0000 7f36f5c00640 1 --2- 172.21.15.31:0/2562607530 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f36cc073aa0 0x7f36cc075f60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f36e0006470 tx=0x7f36e0006bf0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.289+0000 7f36f5c00640 1 -- 172.21.15.31:0/2562607530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36f00ca9f0 msgr2=0x7f36f00cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:06.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.289+0000 7f36f5c00640 1 --2- 172.21.15.31:0/2562607530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36f00ca9f0 0x7f36f00cd450 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f36d800e590 tx=0x7f36d800ea50 comp rx=0 tx=0).stop 2024-09-17T05:36:06.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.289+0000 7f36f5c00640 1 -- 172.21.15.31:0/2562607530 shutdown_connections 2024-09-17T05:36:06.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.289+0000 7f36f5c00640 1 --2- 172.21.15.31:0/2562607530 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f36cc073aa0 0x7f36cc075f60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.289+0000 7f36f5c00640 1 --2- 172.21.15.31:0/2562607530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36f00cd990 0x7f36f00b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.289+0000 7f36f5c00640 1 --2- 172.21.15.31:0/2562607530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36f00ca9f0 0x7f36f00cd450 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.289+0000 7f36f5c00640 1 --2- 172.21.15.31:0/2562607530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36d4004dc0 0x7f36f00c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.289+0000 7f36f5c00640 1 -- 172.21.15.31:0/2562607530 >> 172.21.15.31:0/2562607530 conn(0x7f36f009aa10 msgr2=0x7f36f00cc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:06.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.289+0000 7f36f5c00640 1 -- 172.21.15.31:0/2562607530 shutdown_connections 2024-09-17T05:36:06.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.289+0000 7f36f5c00640 1 -- 172.21.15.31:0/2562607530 wait complete. 2024-09-17T05:36:06.311 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:36:06.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.457+0000 7fc867e00640 1 -- 172.21.15.31:0/2379004137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600b0cb0 msgr2=0x7fc8600c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:06.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.457+0000 7fc867e00640 1 --2- 172.21.15.31:0/2379004137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600b0cb0 0x7fc8600c74f0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fc860076280 tx=0x7fc85401eff0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.457+0000 7fc867e00640 1 -- 172.21.15.31:0/2379004137 shutdown_connections 2024-09-17T05:36:06.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.457+0000 7fc867e00640 1 --2- 172.21.15.31:0/2379004137 >> v2:172.21.15.155:3300/0 conn(0x7fc8600b1120 0x7fc860074380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.457+0000 7fc867e00640 1 --2- 172.21.15.31:0/2379004137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600b0cb0 0x7fc8600c74f0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.457+0000 7fc867e00640 1 -- 172.21.15.31:0/2379004137 >> 172.21.15.31:0/2379004137 conn(0x7fc8600b1f10 msgr2=0x7fc8600b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:06.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.457+0000 7fc867e00640 1 -- 172.21.15.31:0/2379004137 shutdown_connections 2024-09-17T05:36:06.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.457+0000 7fc867e00640 1 -- 172.21.15.31:0/2379004137 wait complete. 2024-09-17T05:36:06.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.457+0000 7fc867e00640 1 Processor -- start 2024-09-17T05:36:06.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.457+0000 7fc867e00640 1 -- start start 2024-09-17T05:36:06.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc867e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600b0cb0 0x7fc8601f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:06.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc867e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8600b1120 0x7fc8600afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:06.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc867e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8600b1650 0x7fc8600adc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:06.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc867e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc860074c50 con 0x7fc8600b0cb0 2024-09-17T05:36:06.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc867e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc860074ad0 con 0x7fc8600b1650 2024-09-17T05:36:06.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc867e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc8600cc750 con 0x7fc8600b1120 2024-09-17T05:36:06.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc865400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600b0cb0 0x7fc8601f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:06.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc865400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600b0cb0 0x7fc8601f4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49316/0 (socket says 172.21.15.31:49316) 2024-09-17T05:36:06.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc865400640 1 -- 172.21.15.31:0/1852693114 learned_addr learned my addr 172.21.15.31:0/1852693114 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:06.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc864a00640 1 --2- 172.21.15.31:0/1852693114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8600b1120 0x7fc8600afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:06.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc865e00640 1 --2- 172.21.15.31:0/1852693114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8600b1650 0x7fc8600adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:06.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc865400640 1 -- 172.21.15.31:0/1852693114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8600b1120 msgr2=0x7fc8600afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:06.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc865400640 1 --2- 172.21.15.31:0/1852693114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8600b1120 0x7fc8600afa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc865400640 1 -- 172.21.15.31:0/1852693114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8600b1650 msgr2=0x7fc8600adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:06.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc865400640 1 --2- 172.21.15.31:0/1852693114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8600b1650 0x7fc8600adc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc865400640 1 -- 172.21.15.31:0/1852693114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8601f4be0 con 0x7fc8600b0cb0 2024-09-17T05:36:06.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc865400640 1 --2- 172.21.15.31:0/1852693114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600b0cb0 0x7fc8601f4600 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fc854000c10 tx=0x7fc8540a8ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:06.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc85d600640 1 -- 172.21.15.31:0/1852693114 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8540b5040 con 0x7fc8600b0cb0 2024-09-17T05:36:06.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc85d600640 1 -- 172.21.15.31:0/1852693114 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8540bf070 con 0x7fc8600b0cb0 2024-09-17T05:36:06.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc85d600640 1 -- 172.21.15.31:0/1852693114 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8540b1c50 con 0x7fc8600b0cb0 2024-09-17T05:36:06.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc867e00640 1 -- 172.21.15.31:0/1852693114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8601f4ec0 con 0x7fc8600b0cb0 2024-09-17T05:36:06.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc867e00640 1 -- 172.21.15.31:0/1852693114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8601f5480 con 0x7fc8600b0cb0 2024-09-17T05:36:06.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc867e00640 1 -- 172.21.15.31:0/1852693114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8600c3c70 con 0x7fc8600b0cb0 2024-09-17T05:36:06.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.461+0000 7fc85d600640 1 -- 172.21.15.31:0/1852693114 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7fc854003600 con 0x7fc8600b0cb0 2024-09-17T05:36:06.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.465+0000 7fc85d600640 1 --2- 172.21.15.31:0/1852693114 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc840073a70 0x7fc840075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:06.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.465+0000 7fc85d600640 1 -- 172.21.15.31:0/1852693114 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5737+0+0 (secure 0 0 0) 0x7fc854132ba0 con 0x7fc8600b0cb0 2024-09-17T05:36:06.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.465+0000 7fc864a00640 1 --2- 172.21.15.31:0/1852693114 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc840073a70 0x7fc840075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:06.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.465+0000 7fc864a00640 1 --2- 172.21.15.31:0/1852693114 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc840073a70 0x7fc840075f30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0058d0 tx=0x7fc84c005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:06.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.469+0000 7fc85d600640 1 -- 172.21.15.31:0/1852693114 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc854018b50 con 0x7fc8600b0cb0 2024-09-17T05:36:06.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.685+0000 7fc867e00640 1 -- 172.21.15.31:0/1852693114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc8600c74d0 con 0x7fc8600b0cb0 2024-09-17T05:36:06.686 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-09-17T05:36:06.685+0000 7f21d0200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:36:06.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.685+0000 7fc85d600640 1 -- 172.21.15.31:0/1852693114 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v102) ==== 161+0+0 (secure 0 0 0) 0x7fc8540fd1b0 con 0x7fc8600b0cb0 2024-09-17T05:36:06.689 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:36:06.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.689+0000 7fc867e00640 1 -- 172.21.15.31:0/1852693114 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc840073a70 msgr2=0x7fc840075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:06.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.689+0000 7fc867e00640 1 --2- 172.21.15.31:0/1852693114 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc840073a70 0x7fc840075f30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0058d0 tx=0x7fc84c005860 comp rx=0 tx=0).stop 2024-09-17T05:36:06.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.689+0000 7fc867e00640 1 -- 172.21.15.31:0/1852693114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600b0cb0 msgr2=0x7fc8601f4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:06.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.689+0000 7fc867e00640 1 --2- 172.21.15.31:0/1852693114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600b0cb0 0x7fc8601f4600 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fc854000c10 tx=0x7fc8540a8ca0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.689+0000 7fc867e00640 1 -- 172.21.15.31:0/1852693114 shutdown_connections 2024-09-17T05:36:06.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.689+0000 7fc867e00640 1 --2- 172.21.15.31:0/1852693114 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc840073a70 0x7fc840075f30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.689+0000 7fc867e00640 1 --2- 172.21.15.31:0/1852693114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8600b1650 0x7fc8600adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.689+0000 7fc867e00640 1 --2- 172.21.15.31:0/1852693114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8600b1120 0x7fc8600afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.689+0000 7fc867e00640 1 --2- 172.21.15.31:0/1852693114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8600b0cb0 0x7fc8601f4600 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.689+0000 7fc867e00640 1 -- 172.21.15.31:0/1852693114 >> 172.21.15.31:0/1852693114 conn(0x7fc8600b1f10 msgr2=0x7fc8600b22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:06.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.689+0000 7fc867e00640 1 -- 172.21.15.31:0/1852693114 shutdown_connections 2024-09-17T05:36:06.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.689+0000 7fc867e00640 1 -- 172.21.15.31:0/1852693114 wait complete. 2024-09-17T05:36:06.714 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:36:06.759 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-17T05:36:06.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.865+0000 7fcc24a00640 1 -- 172.21.15.31:0/3929832428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc04004d50 msgr2=0x7fcc040051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:06.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.865+0000 7fcc24a00640 1 --2- 172.21.15.31:0/3929832428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc04004d50 0x7fcc040051d0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009ec0 tx=0x7fcc1801d1b0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.865+0000 7fcc1e800640 1 -- 172.21.15.31:0/3929832428 reap_dead start 2024-09-17T05:36:06.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.865+0000 7fcc24a00640 1 -- 172.21.15.31:0/3929832428 shutdown_connections 2024-09-17T05:36:06.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.865+0000 7fcc24a00640 1 -- 172.21.15.31:0/3929832428 >> 172.21.15.31:0/3929832428 conn(0x7fcc20071420 msgr2=0x7fcc2006cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:06.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.865+0000 7fcc24a00640 1 -- 172.21.15.31:0/3929832428 shutdown_connections 2024-09-17T05:36:06.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.865+0000 7fcc24a00640 1 -- 172.21.15.31:0/3929832428 wait complete. 2024-09-17T05:36:06.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.865+0000 7fcc24a00640 1 Processor -- start 2024-09-17T05:36:06.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc24a00640 1 -- start start 2024-09-17T05:36:06.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc24a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc04004d50 0x7fcc2014d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:06.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc24a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc2014db70 0x7fcc20158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:06.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc24a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc2013aaf0 0x7fcc20159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:06.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc24a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcc20163a50 con 0x7fcc04004d50 2024-09-17T05:36:06.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc24a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcc201638d0 con 0x7fcc2013aaf0 2024-09-17T05:36:06.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc24a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcc20163bd0 con 0x7fcc2014db70 2024-09-17T05:36:06.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc1de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc04004d50 0x7fcc2014d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:06.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc1de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc04004d50 0x7fcc2014d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49364/0 (socket says 172.21.15.31:49364) 2024-09-17T05:36:06.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc1de00640 1 -- 172.21.15.31:0/1379097812 learned_addr learned my addr 172.21.15.31:0/1379097812 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:06.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc17e00640 1 --2- 172.21.15.31:0/1379097812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc2014db70 0x7fcc20158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:06.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc1e800640 1 --2- 172.21.15.31:0/1379097812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc2013aaf0 0x7fcc20159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:06.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc1de00640 1 -- 172.21.15.31:0/1379097812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc2014db70 msgr2=0x7fcc20158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:06.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc1de00640 1 --2- 172.21.15.31:0/1379097812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc2014db70 0x7fcc20158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc1de00640 1 -- 172.21.15.31:0/1379097812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc2013aaf0 msgr2=0x7fcc20159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:06.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc1de00640 1 --2- 172.21.15.31:0/1379097812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc2013aaf0 0x7fcc20159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:06.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc1de00640 1 -- 172.21.15.31:0/1379097812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc201491a0 con 0x7fcc04004d50 2024-09-17T05:36:06.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc1e800640 1 --2- 172.21.15.31:0/1379097812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc2013aaf0 0x7fcc20159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:06.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc1de00640 1 --2- 172.21.15.31:0/1379097812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc04004d50 0x7fcc2014d630 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fcc10006680 tx=0x7fcc10003a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:06.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc16000640 1 -- 172.21.15.31:0/1379097812 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc10015070 con 0x7fcc04004d50 2024-09-17T05:36:06.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc16000640 1 -- 172.21.15.31:0/1379097812 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc1000f940 con 0x7fcc04004d50 2024-09-17T05:36:06.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc24a00640 1 -- 172.21.15.31:0/1379097812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc2014fe40 con 0x7fcc04004d50 2024-09-17T05:36:06.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc16000640 1 -- 172.21.15.31:0/1379097812 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1000fd90 con 0x7fcc04004d50 2024-09-17T05:36:06.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc24a00640 1 -- 172.21.15.31:0/1379097812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc2013a2f0 con 0x7fcc04004d50 2024-09-17T05:36:06.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.869+0000 7fcc24a00640 1 -- 172.21.15.31:0/1379097812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc200703d0 con 0x7fcc04004d50 2024-09-17T05:36:06.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.873+0000 7fcc16000640 1 -- 172.21.15.31:0/1379097812 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7fcc10011430 con 0x7fcc04004d50 2024-09-17T05:36:06.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.873+0000 7fcc16000640 1 --2- 172.21.15.31:0/1379097812 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcbfc073a70 0x7fcbfc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:06.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.873+0000 7fcc16000640 1 -- 172.21.15.31:0/1379097812 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5823+0+0 (secure 0 0 0) 0x7fcc100936a0 con 0x7fcc04004d50 2024-09-17T05:36:06.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.873+0000 7fcc17e00640 1 --2- 172.21.15.31:0/1379097812 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcbfc073a70 0x7fcbfc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:06.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.873+0000 7fcc17e00640 1 --2- 172.21.15.31:0/1379097812 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcbfc073a70 0x7fcbfc075f30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcc200b33c0 tx=0x7fcc08006b80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:06.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:06.877+0000 7fcc16000640 1 -- 172.21.15.31:0/1379097812 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fcc1005fbb0 con 0x7fcc04004d50 2024-09-17T05:36:07.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.089+0000 7fcc24a00640 1 -- 172.21.15.31:0/1379097812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcc2006e2a0 con 0x7fcc04004d50 2024-09-17T05:36:07.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.693+0000 7fcc16000640 1 -- 172.21.15.31:0/1379097812 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v103) ==== 104+0+0 (secure 0 0 0) 0x7fcc100645e0 con 0x7fcc04004d50 2024-09-17T05:36:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.697+0000 7fcc24a00640 1 -- 172.21.15.31:0/1379097812 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcbfc073a70 msgr2=0x7fcbfc075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.697+0000 7fcc24a00640 1 --2- 172.21.15.31:0/1379097812 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcbfc073a70 0x7fcbfc075f30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcc200b33c0 tx=0x7fcc08006b80 comp rx=0 tx=0).stop 2024-09-17T05:36:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.697+0000 7fcc24a00640 1 -- 172.21.15.31:0/1379097812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc04004d50 msgr2=0x7fcc2014d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.697+0000 7fcc24a00640 1 --2- 172.21.15.31:0/1379097812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc04004d50 0x7fcc2014d630 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fcc10006680 tx=0x7fcc10003a90 comp rx=0 tx=0).stop 2024-09-17T05:36:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.697+0000 7fcc24a00640 1 -- 172.21.15.31:0/1379097812 shutdown_connections 2024-09-17T05:36:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.697+0000 7fcc24a00640 1 --2- 172.21.15.31:0/1379097812 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcbfc073a70 0x7fcbfc075f30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.697+0000 7fcc24a00640 1 --2- 172.21.15.31:0/1379097812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc2013aaf0 0x7fcc20159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.697+0000 7fcc24a00640 1 --2- 172.21.15.31:0/1379097812 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcc2014db70 0x7fcc20158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.697+0000 7fcc24a00640 1 --2- 172.21.15.31:0/1379097812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcc04004d50 0x7fcc2014d630 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.697+0000 7fcc24a00640 1 -- 172.21.15.31:0/1379097812 >> 172.21.15.31:0/1379097812 conn(0x7fcc20071420 msgr2=0x7fcc201533c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:07.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.697+0000 7fcc24a00640 1 -- 172.21.15.31:0/1379097812 shutdown_connections 2024-09-17T05:36:07.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.697+0000 7fcc24a00640 1 -- 172.21.15.31:0/1379097812 wait complete. 2024-09-17T05:36:07.726 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:36:07.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.921+0000 7f84aa400640 1 -- 172.21.15.31:0/3599671836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84a40ae9d0 msgr2=0x7f84a4072870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:07.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.921+0000 7f84aa400640 1 --2- 172.21.15.31:0/3599671836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84a40ae9d0 0x7f84a4072870 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f84a4070890 tx=0x7f849c01ca30 comp rx=0 tx=0).stop 2024-09-17T05:36:07.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.921+0000 7f84aa400640 1 -- 172.21.15.31:0/3599671836 shutdown_connections 2024-09-17T05:36:07.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.921+0000 7f84aa400640 1 --2- 172.21.15.31:0/3599671836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84a40ae9d0 0x7f84a4072870 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:07.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.921+0000 7f84aa400640 1 --2- 172.21.15.31:0/3599671836 >> v2:172.21.15.155:3300/0 conn(0x7f84a40aef60 0x7f84a40ae490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:07.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.921+0000 7f84aa400640 1 --2- 172.21.15.31:0/3599671836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84a415e360 0x7f84a40adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:07.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.921+0000 7f84aa400640 1 -- 172.21.15.31:0/3599671836 >> 172.21.15.31:0/3599671836 conn(0x7f84a40cfbc0 msgr2=0x7f84a40cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:07.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.921+0000 7f84aa400640 1 -- 172.21.15.31:0/3599671836 shutdown_connections 2024-09-17T05:36:07.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.921+0000 7f84aa400640 1 -- 172.21.15.31:0/3599671836 wait complete. 2024-09-17T05:36:07.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84aa400640 1 Processor -- start 2024-09-17T05:36:07.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84aa400640 1 -- start start 2024-09-17T05:36:07.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84aa400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84a40ae9d0 0x7f84a415a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:07.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84aa400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84a40aef60 0x7f84a415ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:07.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84aa400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84a415e360 0x7f84a41f8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:07.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84aa400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f84a415eca0 con 0x7f84a415e360 2024-09-17T05:36:07.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84aa400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f84a415eb20 con 0x7f84a40ae9d0 2024-09-17T05:36:07.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84aa400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f84a415ee20 con 0x7f84a40aef60 2024-09-17T05:36:07.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84a3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84a415e360 0x7f84a41f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:07.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84a3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84a415e360 0x7f84a41f8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49378/0 (socket says 172.21.15.31:49378) 2024-09-17T05:36:07.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84a3e00640 1 -- 172.21.15.31:0/564582520 learned_addr learned my addr 172.21.15.31:0/564582520 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:07.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84a3400640 1 --2- 172.21.15.31:0/564582520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84a40ae9d0 0x7f84a415a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:07.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f849be00640 1 --2- 172.21.15.31:0/564582520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84a40aef60 0x7f84a415ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:07.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84a3e00640 1 -- 172.21.15.31:0/564582520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84a40aef60 msgr2=0x7f84a415ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:07.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84a3e00640 1 --2- 172.21.15.31:0/564582520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84a40aef60 0x7f84a415ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:07.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84a3e00640 1 -- 172.21.15.31:0/564582520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84a40ae9d0 msgr2=0x7f84a415a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:07.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84a3e00640 1 --2- 172.21.15.31:0/564582520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84a40ae9d0 0x7f84a415a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:07.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84a3e00640 1 -- 172.21.15.31:0/564582520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a40b3ce0 con 0x7f84a415e360 2024-09-17T05:36:07.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84a3e00640 1 --2- 172.21.15.31:0/564582520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84a415e360 0x7f84a41f8370 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f849c01b0e0 tx=0x7f849c003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:07.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f849b400640 1 -- 172.21.15.31:0/564582520 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c0bb070 con 0x7f84a415e360 2024-09-17T05:36:07.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f849b400640 1 -- 172.21.15.31:0/564582520 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f849c004d40 con 0x7f84a415e360 2024-09-17T05:36:07.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84aa400640 1 -- 172.21.15.31:0/564582520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84a415d820 con 0x7f84a415e360 2024-09-17T05:36:07.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f849b400640 1 -- 172.21.15.31:0/564582520 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c0b2040 con 0x7f84a415e360 2024-09-17T05:36:07.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.925+0000 7f84aa400640 1 -- 172.21.15.31:0/564582520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a40b4230 con 0x7f84a415e360 2024-09-17T05:36:07.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.929+0000 7f84aa400640 1 -- 172.21.15.31:0/564582520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84a4069410 con 0x7f84a415e360 2024-09-17T05:36:07.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.929+0000 7f849b400640 1 -- 172.21.15.31:0/564582520 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f849c0be070 con 0x7f84a415e360 2024-09-17T05:36:07.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.929+0000 7f849b400640 1 --2- 172.21.15.31:0/564582520 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8480073a70 0x7f8480075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:07.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.929+0000 7f849b400640 1 -- 172.21.15.31:0/564582520 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5823+0+0 (secure 0 0 0) 0x7f849c12ec30 con 0x7f84a415e360 2024-09-17T05:36:07.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.929+0000 7f84a3400640 1 --2- 172.21.15.31:0/564582520 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8480073a70 0x7f8480075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:07.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.929+0000 7f84a3400640 1 --2- 172.21.15.31:0/564582520 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8480073a70 0x7f8480075f30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f84a41495d0 tx=0x7f84940091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:07.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:07.933+0000 7f849b400640 1 -- 172.21.15.31:0/564582520 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f849c016970 con 0x7f84a415e360 2024-09-17T05:36:08.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:08.109+0000 7f84aa400640 1 -- 172.21.15.31:0/564582520 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f84a4072870 con 0x7f84a415e360 2024-09-17T05:36:08.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:08.821+0000 7f849b400640 1 -- 172.21.15.31:0/564582520 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v143) ==== 181+0+0 (secure 0 0 0) 0x7f849c0f8a00 con 0x7f84a415e360 2024-09-17T05:36:08.825 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:36:08.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:08.825+0000 7f84aa400640 1 -- 172.21.15.31:0/564582520 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8480073a70 msgr2=0x7f8480075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:08.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:08.825+0000 7f84aa400640 1 --2- 172.21.15.31:0/564582520 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8480073a70 0x7f8480075f30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f84a41495d0 tx=0x7f84940091e0 comp rx=0 tx=0).stop 2024-09-17T05:36:08.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:08.825+0000 7f84aa400640 1 -- 172.21.15.31:0/564582520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84a415e360 msgr2=0x7f84a41f8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:08.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:08.825+0000 7f84aa400640 1 --2- 172.21.15.31:0/564582520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84a415e360 0x7f84a41f8370 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f849c01b0e0 tx=0x7f849c003f60 comp rx=0 tx=0).stop 2024-09-17T05:36:08.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:08.825+0000 7f84aa400640 1 -- 172.21.15.31:0/564582520 shutdown_connections 2024-09-17T05:36:08.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:08.825+0000 7f84aa400640 1 --2- 172.21.15.31:0/564582520 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8480073a70 0x7f8480075f30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:08.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:08.825+0000 7f84aa400640 1 --2- 172.21.15.31:0/564582520 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84a415e360 0x7f84a41f8370 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:08.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:08.825+0000 7f84aa400640 1 --2- 172.21.15.31:0/564582520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84a40aef60 0x7f84a415ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:08.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:08.825+0000 7f84aa400640 1 --2- 172.21.15.31:0/564582520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84a40ae9d0 0x7f84a415a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:08.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:08.825+0000 7f84aa400640 1 -- 172.21.15.31:0/564582520 >> 172.21.15.31:0/564582520 conn(0x7f84a40cfbc0 msgr2=0x7f84a40cce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:08.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:08.825+0000 7f84aa400640 1 -- 172.21.15.31:0/564582520 shutdown_connections 2024-09-17T05:36:08.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:08.829+0000 7f84aa400640 1 -- 172.21.15.31:0/564582520 wait complete. 2024-09-17T05:36:08.854 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:36:09.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.005+0000 7f6fac400640 1 -- 172.21.15.31:0/3775578154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa415a8c0 msgr2=0x7f6fa415f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:09.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.005+0000 7f6fac400640 1 --2- 172.21.15.31:0/3775578154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa415a8c0 0x7f6fa415f100 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f6fa40d02b0 tx=0x7f6f9801c6e0 comp rx=0 tx=0).stop 2024-09-17T05:36:09.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.005+0000 7f6fac400640 1 -- 172.21.15.31:0/3775578154 shutdown_connections 2024-09-17T05:36:09.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.005+0000 7f6fac400640 1 --2- 172.21.15.31:0/3775578154 >> v2:172.21.15.155:3300/0 conn(0x7f6fa4073830 0x7f6fa406fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:09.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.005+0000 7f6fac400640 1 --2- 172.21.15.31:0/3775578154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa415a8c0 0x7f6fa415f100 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:09.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.005+0000 7f6fac400640 1 -- 172.21.15.31:0/3775578154 >> 172.21.15.31:0/3775578154 conn(0x7f6fa40b2140 msgr2=0x7f6fa40b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:09.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.005+0000 7f6fac400640 1 -- 172.21.15.31:0/3775578154 shutdown_connections 2024-09-17T05:36:09.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.005+0000 7f6fac400640 1 -- 172.21.15.31:0/3775578154 wait complete. 2024-09-17T05:36:09.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6fac400640 1 Processor -- start 2024-09-17T05:36:09.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6fac400640 1 -- start start 2024-09-17T05:36:09.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6fac400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa4073830 0x7f6fa414e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:09.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6fac400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fa415a8c0 0x7f6fa40b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:09.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6fac400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa415aca0 0x7f6fa40b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:09.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6fac400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa4167a00 con 0x7f6fa415aca0 2024-09-17T05:36:09.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6fac400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa4167880 con 0x7f6fa415a8c0 2024-09-17T05:36:09.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6fac400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa4167b80 con 0x7f6fa4073830 2024-09-17T05:36:09.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6faa400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa415aca0 0x7f6fa40b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:09.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6faa400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa415aca0 0x7f6fa40b1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36984/0 (socket says 172.21.15.31:36984) 2024-09-17T05:36:09.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6faa400640 1 -- 172.21.15.31:0/2703430261 learned_addr learned my addr 172.21.15.31:0/2703430261 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:09.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6fa9000640 1 --2- 172.21.15.31:0/2703430261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fa415a8c0 0x7f6fa40b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:09.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6fa9a00640 1 --2- 172.21.15.31:0/2703430261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa4073830 0x7f6fa414e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:09.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6faa400640 1 -- 172.21.15.31:0/2703430261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa4073830 msgr2=0x7f6fa414e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:09.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6faa400640 1 --2- 172.21.15.31:0/2703430261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa4073830 0x7f6fa414e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:09.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6faa400640 1 -- 172.21.15.31:0/2703430261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fa415a8c0 msgr2=0x7f6fa40b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:09.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6faa400640 1 --2- 172.21.15.31:0/2703430261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fa415a8c0 0x7f6fa40b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:09.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6faa400640 1 -- 172.21.15.31:0/2703430261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa41f8bd0 con 0x7f6fa415aca0 2024-09-17T05:36:09.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6faa400640 1 --2- 172.21.15.31:0/2703430261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa415aca0 0x7f6fa40b1170 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00ea20 tx=0x7f6f9c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:09.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6fa1600640 1 -- 172.21.15.31:0/2703430261 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c00cde0 con 0x7f6fa415aca0 2024-09-17T05:36:09.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6fa1600640 1 -- 172.21.15.31:0/2703430261 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f9c004c20 con 0x7f6fa415aca0 2024-09-17T05:36:09.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6fac400640 1 -- 172.21.15.31:0/2703430261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa41f8eb0 con 0x7f6fa415aca0 2024-09-17T05:36:09.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6fa1600640 1 -- 172.21.15.31:0/2703430261 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9c005020 con 0x7f6fa415aca0 2024-09-17T05:36:09.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.009+0000 7f6fac400640 1 -- 172.21.15.31:0/2703430261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa41f9470 con 0x7f6fa415aca0 2024-09-17T05:36:09.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.013+0000 7f6fac400640 1 -- 172.21.15.31:0/2703430261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa406fae0 con 0x7f6fa415aca0 2024-09-17T05:36:09.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.013+0000 7f6fa1600640 1 -- 172.21.15.31:0/2703430261 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f6f9c0051c0 con 0x7f6fa415aca0 2024-09-17T05:36:09.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.013+0000 7f6fa1600640 1 --2- 172.21.15.31:0/2703430261 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6f84073aa0 0x7f6f84075f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:09.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.013+0000 7f6fa1600640 1 -- 172.21.15.31:0/2703430261 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5385+0+0 (secure 0 0 0) 0x7f6f9c095cd0 con 0x7f6fa415aca0 2024-09-17T05:36:09.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.013+0000 7f6fa9a00640 1 --2- 172.21.15.31:0/2703430261 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6f84073aa0 0x7f6f84075f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:09.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.013+0000 7f6fa9a00640 1 --2- 172.21.15.31:0/2703430261 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6f84073aa0 0x7f6f84075f60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6f980ae000 tx=0x7f6f9801af20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:09.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.017+0000 7f6fa1600640 1 -- 172.21.15.31:0/2703430261 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6f9c016030 con 0x7f6fa415aca0 2024-09-17T05:36:09.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.193+0000 7f6fac400640 1 -- 172.21.15.31:0/2703430261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6fa40cc870 con 0x7f6fa415aca0 2024-09-17T05:36:09.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.829+0000 7f6fa1600640 1 -- 172.21.15.31:0/2703430261 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v144) ==== 169+0+0 (secure 0 0 0) 0x7f6f9c05fe90 con 0x7f6fa415aca0 2024-09-17T05:36:09.831 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-09-17T05:36:09.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.833+0000 7f6fac400640 1 -- 172.21.15.31:0/2703430261 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6f84073aa0 msgr2=0x7f6f84075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:09.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.833+0000 7f6fac400640 1 --2- 172.21.15.31:0/2703430261 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6f84073aa0 0x7f6f84075f60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6f980ae000 tx=0x7f6f9801af20 comp rx=0 tx=0).stop 2024-09-17T05:36:09.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.833+0000 7f6fac400640 1 -- 172.21.15.31:0/2703430261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa415aca0 msgr2=0x7f6fa40b1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:09.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.833+0000 7f6fac400640 1 --2- 172.21.15.31:0/2703430261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa415aca0 0x7f6fa40b1170 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c00ea20 tx=0x7f6f9c00eee0 comp rx=0 tx=0).stop 2024-09-17T05:36:09.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.833+0000 7f6fac400640 1 -- 172.21.15.31:0/2703430261 shutdown_connections 2024-09-17T05:36:09.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.833+0000 7f6fac400640 1 --2- 172.21.15.31:0/2703430261 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6f84073aa0 0x7f6f84075f60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:09.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.833+0000 7f6fac400640 1 --2- 172.21.15.31:0/2703430261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6fa415aca0 0x7f6fa40b1170 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:09.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.833+0000 7f6fac400640 1 --2- 172.21.15.31:0/2703430261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6fa415a8c0 0x7f6fa40b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:09.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.833+0000 7f6fac400640 1 --2- 172.21.15.31:0/2703430261 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6fa4073830 0x7f6fa414e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:09.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.833+0000 7f6fac400640 1 -- 172.21.15.31:0/2703430261 >> 172.21.15.31:0/2703430261 conn(0x7f6fa40b2140 msgr2=0x7f6fa40b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:09.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.833+0000 7f6fac400640 1 -- 172.21.15.31:0/2703430261 shutdown_connections 2024-09-17T05:36:09.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:09.833+0000 7f6fac400640 1 -- 172.21.15.31:0/2703430261 wait complete. 2024-09-17T05:36:09.858 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:36:10.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.005+0000 7f0cbf400640 1 -- 172.21.15.31:0/2244080263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80cdb30 msgr2=0x7f0cb80aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:10.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.005+0000 7f0cbf400640 1 --2- 172.21.15.31:0/2244080263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80cdb30 0x7f0cb80aeef0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80cc3a0 tx=0x7f0cb001cb80 comp rx=0 tx=0).stop 2024-09-17T05:36:10.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.005+0000 7f0cbf400640 1 -- 172.21.15.31:0/2244080263 shutdown_connections 2024-09-17T05:36:10.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.005+0000 7f0cbf400640 1 --2- 172.21.15.31:0/2244080263 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80cdb30 0x7f0cb80aeef0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.005+0000 7f0cbf400640 1 --2- 172.21.15.31:0/2244080263 >> v2:172.21.15.155:3300/0 conn(0x7f0cb80ced80 0x7f0cb80ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.005+0000 7f0cbf400640 1 -- 172.21.15.31:0/2244080263 >> 172.21.15.31:0/2244080263 conn(0x7f0cb80d1dc0 msgr2=0x7f0cb80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:10.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.005+0000 7f0cbf400640 1 -- 172.21.15.31:0/2244080263 shutdown_connections 2024-09-17T05:36:10.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.005+0000 7f0cbf400640 1 -- 172.21.15.31:0/2244080263 wait complete. 2024-09-17T05:36:10.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.005+0000 7f0cbf400640 1 Processor -- start 2024-09-17T05:36:10.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.005+0000 7f0cbf400640 1 -- start start 2024-09-17T05:36:10.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cbf400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cb80cdb30 0x7f0cb814d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:10.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cbf400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80ced80 0x7f0cb80cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:10.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cbf400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cb815bea0 0x7f0cb80cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:10.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cbf400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb81692f0 con 0x7f0cb80ced80 2024-09-17T05:36:10.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cbf400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb8169170 con 0x7f0cb80cdb30 2024-09-17T05:36:10.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cbf400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0cb8169470 con 0x7f0cb815bea0 2024-09-17T05:36:10.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cb7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80ced80 0x7f0cb80cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:10.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cbca00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cb80cdb30 0x7f0cb814d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:10.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cb7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80ced80 0x7f0cb80cb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37006/0 (socket says 172.21.15.31:37006) 2024-09-17T05:36:10.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cb7e00640 1 -- 172.21.15.31:0/3959898343 learned_addr learned my addr 172.21.15.31:0/3959898343 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:10.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cbd400640 1 --2- 172.21.15.31:0/3959898343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cb815bea0 0x7f0cb80cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:10.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cb7e00640 1 -- 172.21.15.31:0/3959898343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cb815bea0 msgr2=0x7f0cb80cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:10.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cb7e00640 1 --2- 172.21.15.31:0/3959898343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cb815bea0 0x7f0cb80cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cb7e00640 1 -- 172.21.15.31:0/3959898343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cb80cdb30 msgr2=0x7f0cb814d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:10.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cb7e00640 1 --2- 172.21.15.31:0/3959898343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cb80cdb30 0x7f0cb814d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cb7e00640 1 -- 172.21.15.31:0/3959898343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb815a790 con 0x7f0cb80ced80 2024-09-17T05:36:10.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cb7e00640 1 --2- 172.21.15.31:0/3959898343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80ced80 0x7f0cb80cb060 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f0ca400d950 tx=0x7f0ca400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:10.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cb4c00640 1 -- 172.21.15.31:0/3959898343 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4017070 con 0x7f0cb80ced80 2024-09-17T05:36:10.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cb4c00640 1 -- 172.21.15.31:0/3959898343 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ca4009d20 con 0x7f0cb80ced80 2024-09-17T05:36:10.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cbf400640 1 -- 172.21.15.31:0/3959898343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cb81fbcd0 con 0x7f0cb80ced80 2024-09-17T05:36:10.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cb4c00640 1 -- 172.21.15.31:0/3959898343 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca40106c0 con 0x7f0cb80ced80 2024-09-17T05:36:10.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cbf400640 1 -- 172.21.15.31:0/3959898343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cb81f7f80 con 0x7f0cb80ced80 2024-09-17T05:36:10.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.009+0000 7f0cbf400640 1 -- 172.21.15.31:0/3959898343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cb80d2520 con 0x7f0cb80ced80 2024-09-17T05:36:10.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.013+0000 7f0cb4c00640 1 -- 172.21.15.31:0/3959898343 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f0ca4010860 con 0x7f0cb80ced80 2024-09-17T05:36:10.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.013+0000 7f0cb4c00640 1 --2- 172.21.15.31:0/3959898343 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c98073a70 0x7f0c98075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:10.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.013+0000 7f0cb4c00640 1 -- 172.21.15.31:0/3959898343 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 4971+0+0 (secure 0 0 0) 0x7f0ca4095390 con 0x7f0cb80ced80 2024-09-17T05:36:10.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.013+0000 7f0cbca00640 1 --2- 172.21.15.31:0/3959898343 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c98073a70 0x7f0c98075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:10.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.013+0000 7f0cbca00640 1 --2- 172.21.15.31:0/3959898343 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c98073a70 0x7f0c98075f30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0cac007fd0 tx=0x7f0cac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:10.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.017+0000 7f0cb4c00640 1 -- 172.21.15.31:0/3959898343 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0cb815a790 con 0x7f0cb80ced80 2024-09-17T05:36:10.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.193+0000 7f0cbf400640 1 -- 172.21.15.31:0/3959898343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f0cb80d2240 con 0x7f0cb80ced80 2024-09-17T05:36:10.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.197+0000 7f0cb4c00640 1 -- 172.21.15.31:0/3959898343 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v45) ==== 71+0+0 (secure 0 0 0) 0x7f0ca405f270 con 0x7f0cb80ced80 2024-09-17T05:36:10.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.201+0000 7f0cbf400640 1 -- 172.21.15.31:0/3959898343 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c98073a70 msgr2=0x7f0c98075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:10.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.201+0000 7f0cbf400640 1 --2- 172.21.15.31:0/3959898343 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c98073a70 0x7f0c98075f30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0cac007fd0 tx=0x7f0cac009040 comp rx=0 tx=0).stop 2024-09-17T05:36:10.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.201+0000 7f0cbf400640 1 -- 172.21.15.31:0/3959898343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80ced80 msgr2=0x7f0cb80cb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:10.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.201+0000 7f0cbf400640 1 --2- 172.21.15.31:0/3959898343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80ced80 0x7f0cb80cb060 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f0ca400d950 tx=0x7f0ca400de10 comp rx=0 tx=0).stop 2024-09-17T05:36:10.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.201+0000 7f0cbf400640 1 -- 172.21.15.31:0/3959898343 shutdown_connections 2024-09-17T05:36:10.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.201+0000 7f0cbf400640 1 --2- 172.21.15.31:0/3959898343 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c98073a70 0x7f0c98075f30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.201+0000 7f0cbf400640 1 --2- 172.21.15.31:0/3959898343 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0cb815bea0 0x7f0cb80cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.201+0000 7f0cbf400640 1 --2- 172.21.15.31:0/3959898343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cb80ced80 0x7f0cb80cb060 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.201+0000 7f0cbf400640 1 --2- 172.21.15.31:0/3959898343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0cb80cdb30 0x7f0cb814d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.201+0000 7f0cbf400640 1 -- 172.21.15.31:0/3959898343 >> 172.21.15.31:0/3959898343 conn(0x7f0cb80d1dc0 msgr2=0x7f0cb806dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:10.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.201+0000 7f0cbf400640 1 -- 172.21.15.31:0/3959898343 shutdown_connections 2024-09-17T05:36:10.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.201+0000 7f0cbf400640 1 -- 172.21.15.31:0/3959898343 wait complete. 2024-09-17T05:36:10.223 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1' 2024-09-17T05:36:10.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe6a9200640 1 -- 172.21.15.31:0/2005891608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a40cdb30 msgr2=0x7fe6a40aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:10.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe6a9200640 1 --2- 172.21.15.31:0/2005891608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a40cdb30 0x7fe6a40aeef0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009c80 tx=0x7fe69c01cda0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe6a9200640 1 -- 172.21.15.31:0/2005891608 shutdown_connections 2024-09-17T05:36:10.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe6a9200640 1 --2- 172.21.15.31:0/2005891608 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a40cdb30 0x7fe6a40aeef0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe6a9200640 1 --2- 172.21.15.31:0/2005891608 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6a40ced80 0x7fe6a40ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe6a9200640 1 -- 172.21.15.31:0/2005891608 >> 172.21.15.31:0/2005891608 conn(0x7fe6a40d1dc0 msgr2=0x7fe6a40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:10.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe6a9200640 1 -- 172.21.15.31:0/2005891608 shutdown_connections 2024-09-17T05:36:10.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe6a9200640 1 -- 172.21.15.31:0/2005891608 wait complete. 2024-09-17T05:36:10.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe6a9200640 1 Processor -- start 2024-09-17T05:36:10.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe6a9200640 1 -- start start 2024-09-17T05:36:10.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe6a9200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6a40cdb30 0x7fe6a40cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:10.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe6a9200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a40ced80 0x7fe6a40cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:10.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe6a9200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6a415bea0 0x7fe6a4072230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:10.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe6a9200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a4169340 con 0x7fe6a40ced80 2024-09-17T05:36:10.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe6a9200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a41691c0 con 0x7fe6a40cdb30 2024-09-17T05:36:10.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe6a9200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a41694c0 con 0x7fe6a415bea0 2024-09-17T05:36:10.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe69be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a40ced80 0x7fe6a40cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:10.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe69be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a40ced80 0x7fe6a40cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37028/0 (socket says 172.21.15.31:37028) 2024-09-17T05:36:10.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe69be00640 1 -- 172.21.15.31:0/467123571 learned_addr learned my addr 172.21.15.31:0/467123571 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:10.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe6a1e00640 1 --2- 172.21.15.31:0/467123571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6a40cdb30 0x7fe6a40cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:10.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe6a2800640 1 --2- 172.21.15.31:0/467123571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6a415bea0 0x7fe6a4072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:10.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe69be00640 1 -- 172.21.15.31:0/467123571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6a415bea0 msgr2=0x7fe6a4072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:10.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe69be00640 1 --2- 172.21.15.31:0/467123571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6a415bea0 0x7fe6a4072230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe69be00640 1 -- 172.21.15.31:0/467123571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6a40cdb30 msgr2=0x7fe6a40cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:10.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe69be00640 1 --2- 172.21.15.31:0/467123571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6a40cdb30 0x7fe6a40cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.369+0000 7fe69be00640 1 -- 172.21.15.31:0/467123571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a41f7dd0 con 0x7fe6a40ced80 2024-09-17T05:36:10.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.373+0000 7fe69be00640 1 --2- 172.21.15.31:0/467123571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a40ced80 0x7fe6a40cba20 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00c970 tx=0x7fe68c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:10.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.373+0000 7fe69a000640 1 -- 172.21.15.31:0/467123571 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c007c70 con 0x7fe6a40ced80 2024-09-17T05:36:10.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.373+0000 7fe69a000640 1 -- 172.21.15.31:0/467123571 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe68c00f450 con 0x7fe6a40ced80 2024-09-17T05:36:10.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.373+0000 7fe69a000640 1 -- 172.21.15.31:0/467123571 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c00f8a0 con 0x7fe6a40ced80 2024-09-17T05:36:10.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.373+0000 7fe6a9200640 1 -- 172.21.15.31:0/467123571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a41f80b0 con 0x7fe6a40ced80 2024-09-17T05:36:10.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.373+0000 7fe6a9200640 1 -- 172.21.15.31:0/467123571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a41f8670 con 0x7fe6a40ced80 2024-09-17T05:36:10.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.373+0000 7fe6a9200640 1 -- 172.21.15.31:0/467123571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a40ce670 con 0x7fe6a40ced80 2024-09-17T05:36:10.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.373+0000 7fe69a000640 1 -- 172.21.15.31:0/467123571 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7fe68c00fa40 con 0x7fe6a40ced80 2024-09-17T05:36:10.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.373+0000 7fe69a000640 1 --2- 172.21.15.31:0/467123571 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe680073a70 0x7fe680075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:10.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.373+0000 7fe69a000640 1 -- 172.21.15.31:0/467123571 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 4971+0+0 (secure 0 0 0) 0x7fe68c093100 con 0x7fe6a40ced80 2024-09-17T05:36:10.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.373+0000 7fe6a1e00640 1 --2- 172.21.15.31:0/467123571 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe680073a70 0x7fe680075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:10.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.377+0000 7fe6a1e00640 1 --2- 172.21.15.31:0/467123571 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe680073a70 0x7fe680075f30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe6940098e0 tx=0x7fe694009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:10.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.377+0000 7fe69a000640 1 -- 172.21.15.31:0/467123571 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe68c014030 con 0x7fe6a40ced80 2024-09-17T05:36:10.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.617+0000 7fe6a9200640 1 -- 172.21.15.31:0/467123571 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]} v 0) -- 0x7fe6a4070d90 con 0x7fe6a40ced80 2024-09-17T05:36:10.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.829+0000 7fe69a000640 1 -- 172.21.15.31:0/467123571 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]}]=0 v414) ==== 149+0+0 (secure 0 0 0) 0x7fe68c05f610 con 0x7fe6a40ced80 2024-09-17T05:36:10.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.833+0000 7fe6a9200640 1 -- 172.21.15.31:0/467123571 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe680073a70 msgr2=0x7fe680075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:10.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.833+0000 7fe6a9200640 1 --2- 172.21.15.31:0/467123571 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe680073a70 0x7fe680075f30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe6940098e0 tx=0x7fe694009060 comp rx=0 tx=0).stop 2024-09-17T05:36:10.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.833+0000 7fe6a9200640 1 -- 172.21.15.31:0/467123571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a40ced80 msgr2=0x7fe6a40cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:10.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.833+0000 7fe6a9200640 1 --2- 172.21.15.31:0/467123571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a40ced80 0x7fe6a40cba20 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00c970 tx=0x7fe68c00ce30 comp rx=0 tx=0).stop 2024-09-17T05:36:10.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.833+0000 7fe6a9200640 1 -- 172.21.15.31:0/467123571 shutdown_connections 2024-09-17T05:36:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.833+0000 7fe6a9200640 1 --2- 172.21.15.31:0/467123571 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe680073a70 0x7fe680075f30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.833+0000 7fe6a9200640 1 --2- 172.21.15.31:0/467123571 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe6a415bea0 0x7fe6a4072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.833+0000 7fe6a9200640 1 --2- 172.21.15.31:0/467123571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6a40ced80 0x7fe6a40cba20 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.833+0000 7fe6a9200640 1 --2- 172.21.15.31:0/467123571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6a40cdb30 0x7fe6a40cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.833+0000 7fe6a9200640 1 -- 172.21.15.31:0/467123571 >> 172.21.15.31:0/467123571 conn(0x7fe6a40d1dc0 msgr2=0x7fe6a40b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.833+0000 7fe6a9200640 1 -- 172.21.15.31:0/467123571 shutdown_connections 2024-09-17T05:36:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:10.833+0000 7fe6a9200640 1 -- 172.21.15.31:0/467123571 wait complete. 2024-09-17T05:36:10.855 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- rather than going through a full upgrade cycle, ... ok 2024-09-17T05:36:10.855 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- theme continues... 2024-09-17T05:36:10.855 INFO:tasks.cephfs_test_runner:test_subvolume_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:36:10.856 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:11.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.005+0000 7faef2600640 1 -- 172.21.15.31:0/4283366189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeec0d28e0 msgr2=0x7faeec0cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.005+0000 7faef2600640 1 --2- 172.21.15.31:0/4283366189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeec0d28e0 0x7faeec0cebb0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7faeec0745d0 tx=0x7faee401ccf0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.005+0000 7faef2600640 1 -- 172.21.15.31:0/4283366189 shutdown_connections 2024-09-17T05:36:11.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.005+0000 7faef2600640 1 --2- 172.21.15.31:0/4283366189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeec0d28e0 0x7faeec0cebb0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.005+0000 7faef2600640 1 --2- 172.21.15.31:0/4283366189 >> v2:172.21.15.155:3300/0 conn(0x7faeec15bea0 0x7faeec0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.005+0000 7faef2600640 1 -- 172.21.15.31:0/4283366189 >> 172.21.15.31:0/4283366189 conn(0x7faeec0d1dc0 msgr2=0x7faeec0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:11.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.005+0000 7faef2600640 1 -- 172.21.15.31:0/4283366189 shutdown_connections 2024-09-17T05:36:11.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.005+0000 7faef2600640 1 -- 172.21.15.31:0/4283366189 wait complete. 2024-09-17T05:36:11.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.005+0000 7faef2600640 1 Processor -- start 2024-09-17T05:36:11.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.005+0000 7faef2600640 1 -- start start 2024-09-17T05:36:11.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faef2600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faeec0cdb30 0x7faeec0cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:11.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faef2600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faeec0d28e0 0x7faeec0b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:11.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faef2600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeec15bea0 0x7faeec1573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:11.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faef2600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7faeec168fc0 con 0x7faeec15bea0 2024-09-17T05:36:11.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faef2600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faeec168e40 con 0x7faeec0d28e0 2024-09-17T05:36:11.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faef2600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7faeec169140 con 0x7faeec0cdb30 2024-09-17T05:36:11.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faeebe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeec15bea0 0x7faeec1573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:11.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faeebe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeec15bea0 0x7faeec1573d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37040/0 (socket says 172.21.15.31:37040) 2024-09-17T05:36:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faeebe00640 1 -- 172.21.15.31:0/4261846141 learned_addr learned my addr 172.21.15.31:0/4261846141 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faeeaa00640 1 --2- 172.21.15.31:0/4261846141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faeec0d28e0 0x7faeec0b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faeeb400640 1 --2- 172.21.15.31:0/4261846141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faeec0cdb30 0x7faeec0cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faeebe00640 1 -- 172.21.15.31:0/4261846141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faeec0cdb30 msgr2=0x7faeec0cbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faeebe00640 1 --2- 172.21.15.31:0/4261846141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faeec0cdb30 0x7faeec0cbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faeebe00640 1 -- 172.21.15.31:0/4261846141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faeec0d28e0 msgr2=0x7faeec0b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faeebe00640 1 --2- 172.21.15.31:0/4261846141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faeec0d28e0 0x7faeec0b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faeebe00640 1 -- 172.21.15.31:0/4261846141 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeec0ca370 con 0x7faeec15bea0 2024-09-17T05:36:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faeebe00640 1 --2- 172.21.15.31:0/4261846141 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeec15bea0 0x7faeec1573d0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7faee401b3a0 tx=0x7faee4003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faee3400640 1 -- 172.21.15.31:0/4261846141 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee40bb070 con 0x7faeec15bea0 2024-09-17T05:36:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faee3400640 1 -- 172.21.15.31:0/4261846141 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faee4004e00 con 0x7faeec15bea0 2024-09-17T05:36:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faef2600640 1 -- 172.21.15.31:0/4261846141 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeec0ca650 con 0x7faeec15bea0 2024-09-17T05:36:11.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faee3400640 1 -- 172.21.15.31:0/4261846141 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee40b2040 con 0x7faeec15bea0 2024-09-17T05:36:11.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faef2600640 1 -- 172.21.15.31:0/4261846141 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeec0cac10 con 0x7faeec15bea0 2024-09-17T05:36:11.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.009+0000 7faef2600640 1 -- 172.21.15.31:0/4261846141 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeec0cc9d0 con 0x7faeec15bea0 2024-09-17T05:36:11.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.013+0000 7faee3400640 1 -- 172.21.15.31:0/4261846141 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7faee40be070 con 0x7faeec15bea0 2024-09-17T05:36:11.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.013+0000 7faee3400640 1 --2- 172.21.15.31:0/4261846141 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7faecc073a70 0x7faecc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:11.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.013+0000 7faee3400640 1 -- 172.21.15.31:0/4261846141 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 4971+0+0 (secure 0 0 0) 0x7faee412eb80 con 0x7faeec15bea0 2024-09-17T05:36:11.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.013+0000 7faeeb400640 1 --2- 172.21.15.31:0/4261846141 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7faecc073a70 0x7faecc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:11.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.013+0000 7faeeb400640 1 --2- 172.21.15.31:0/4261846141 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7faecc073a70 0x7faecc075f30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7faedc004630 tx=0x7faedc00b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:11.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.017+0000 7faee3400640 1 -- 172.21.15.31:0/4261846141 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7faee4016970 con 0x7faeec15bea0 2024-09-17T05:36:11.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.193+0000 7faef2600640 1 -- 172.21.15.31:0/4261846141 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faeec0b0fa0 con 0x7faeec15bea0 2024-09-17T05:36:11.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.193+0000 7faee3400640 1 -- 172.21.15.31:0/4261846141 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) ==== 74+0+13110 (secure 0 0 0) 0x7faee40f8d30 con 0x7faeec15bea0 2024-09-17T05:36:11.196 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:11.196 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":144,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:36:09.826846+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6835/1808209578":"2024-09-18T05:36:06.688558+0000","172.21.15.31:6833/1808209578":"2024-09-18T05:36:06.688558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:11.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.197+0000 7faef2600640 1 -- 172.21.15.31:0/4261846141 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7faecc073a70 msgr2=0x7faecc075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.197+0000 7faef2600640 1 --2- 172.21.15.31:0/4261846141 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7faecc073a70 0x7faecc075f30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7faedc004630 tx=0x7faedc00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.197+0000 7faef2600640 1 -- 172.21.15.31:0/4261846141 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeec15bea0 msgr2=0x7faeec1573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.197+0000 7faef2600640 1 --2- 172.21.15.31:0/4261846141 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeec15bea0 0x7faeec1573d0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7faee401b3a0 tx=0x7faee4003f60 comp rx=0 tx=0).stop 2024-09-17T05:36:11.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.197+0000 7faef2600640 1 -- 172.21.15.31:0/4261846141 shutdown_connections 2024-09-17T05:36:11.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.197+0000 7faef2600640 1 --2- 172.21.15.31:0/4261846141 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7faecc073a70 0x7faecc075f30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.197+0000 7faef2600640 1 --2- 172.21.15.31:0/4261846141 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faeec15bea0 0x7faeec1573d0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.197+0000 7faef2600640 1 --2- 172.21.15.31:0/4261846141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faeec0d28e0 0x7faeec0b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.197+0000 7faef2600640 1 --2- 172.21.15.31:0/4261846141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faeec0cdb30 0x7faeec0cbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.197+0000 7faef2600640 1 -- 172.21.15.31:0/4261846141 >> 172.21.15.31:0/4261846141 conn(0x7faeec0d1dc0 msgr2=0x7faeec071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:11.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.197+0000 7faef2600640 1 -- 172.21.15.31:0/4261846141 shutdown_connections 2024-09-17T05:36:11.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.197+0000 7faef2600640 1 -- 172.21.15.31:0/4261846141 wait complete. 2024-09-17T05:36:11.220 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:28:33.209612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:36:11.220 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:36:11.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.369+0000 7f016cc00640 1 -- 172.21.15.31:0/2355298716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f014c004810 msgr2=0x7f014c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.369+0000 7f016cc00640 1 --2- 172.21.15.31:0/2355298716 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f014c004810 0x7f014c004c90 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f0150009b60 tx=0x7f015001d270 comp rx=0 tx=0).stop 2024-09-17T05:36:11.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.369+0000 7f0166800640 1 -- 172.21.15.31:0/2355298716 reap_dead start 2024-09-17T05:36:11.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.369+0000 7f016cc00640 1 -- 172.21.15.31:0/2355298716 shutdown_connections 2024-09-17T05:36:11.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.369+0000 7f016cc00640 1 -- 172.21.15.31:0/2355298716 >> 172.21.15.31:0/2355298716 conn(0x7f01680d1dd0 msgr2=0x7f01680d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:11.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.369+0000 7f016cc00640 1 -- 172.21.15.31:0/2355298716 shutdown_connections 2024-09-17T05:36:11.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.369+0000 7f016cc00640 1 -- 172.21.15.31:0/2355298716 wait complete. 2024-09-17T05:36:11.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f016cc00640 1 Processor -- start 2024-09-17T05:36:11.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f016cc00640 1 -- start start 2024-09-17T05:36:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f016cc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f014c004810 0x7f01680b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f016cc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f016815f7b0 0x7f01680c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f016cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01681f2b40 0x7f01680cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f016cc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f01680b0cd0 con 0x7f01681f2b40 2024-09-17T05:36:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f016cc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f01680b06d0 con 0x7f014c004810 2024-09-17T05:36:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f016cc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f01680b0e50 con 0x7f016815f7b0 2024-09-17T05:36:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f0166800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01681f2b40 0x7f01680cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f0166800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01681f2b40 0x7f01680cb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37066/0 (socket says 172.21.15.31:37066) 2024-09-17T05:36:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f0166800640 1 -- 172.21.15.31:0/1267559861 learned_addr learned my addr 172.21.15.31:0/1267559861 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:11.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f015fe00640 1 --2- 172.21.15.31:0/1267559861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f016815f7b0 0x7f01680c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:11.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f0165e00640 1 --2- 172.21.15.31:0/1267559861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f014c004810 0x7f01680b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:11.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f0166800640 1 -- 172.21.15.31:0/1267559861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f016815f7b0 msgr2=0x7f01680c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f0166800640 1 --2- 172.21.15.31:0/1267559861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f016815f7b0 0x7f01680c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f0166800640 1 -- 172.21.15.31:0/1267559861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f014c004810 msgr2=0x7f01680b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f0166800640 1 --2- 172.21.15.31:0/1267559861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f014c004810 0x7f01680b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f0166800640 1 -- 172.21.15.31:0/1267559861 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01680c9f30 con 0x7f01681f2b40 2024-09-17T05:36:11.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f0165e00640 1 --2- 172.21.15.31:0/1267559861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f014c004810 0x7f01680b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:11.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f0166800640 1 --2- 172.21.15.31:0/1267559861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01681f2b40 0x7f01680cb3a0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f01680b1190 tx=0x7f0160006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:11.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f015e000640 1 -- 172.21.15.31:0/1267559861 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0160011900 con 0x7f01681f2b40 2024-09-17T05:36:11.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f015e000640 1 -- 172.21.15.31:0/1267559861 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0160018070 con 0x7f01681f2b40 2024-09-17T05:36:11.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f015e000640 1 -- 172.21.15.31:0/1267559861 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0160011d60 con 0x7f01681f2b40 2024-09-17T05:36:11.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f016cc00640 1 -- 172.21.15.31:0/1267559861 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01681f34b0 con 0x7f01681f2b40 2024-09-17T05:36:11.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f016cc00640 1 -- 172.21.15.31:0/1267559861 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f016815dd40 con 0x7f01681f2b40 2024-09-17T05:36:11.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.373+0000 7f016cc00640 1 -- 172.21.15.31:0/1267559861 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01680b1390 con 0x7f01681f2b40 2024-09-17T05:36:11.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.377+0000 7f015e000640 1 -- 172.21.15.31:0/1267559861 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f016001d460 con 0x7f01681f2b40 2024-09-17T05:36:11.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.377+0000 7f015e000640 1 --2- 172.21.15.31:0/1267559861 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0144073aa0 0x7f0144075f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:11.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.377+0000 7f015e000640 1 -- 172.21.15.31:0/1267559861 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 4971+0+0 (secure 0 0 0) 0x7f0160095a70 con 0x7f01681f2b40 2024-09-17T05:36:11.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.377+0000 7f0165e00640 1 --2- 172.21.15.31:0/1267559861 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0144073aa0 0x7f0144075f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:11.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.377+0000 7f0165e00640 1 --2- 172.21.15.31:0/1267559861 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0144073aa0 0x7f0144075f60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0158000fc0 tx=0x7f01580067b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:11.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.381+0000 7f015e000640 1 -- 172.21.15.31:0/1267559861 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f016005fdd0 con 0x7f01681f2b40 2024-09-17T05:36:11.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.557+0000 7f016cc00640 1 -- 172.21.15.31:0/1267559861 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f01680d1080 con 0x7f01681f2b40 2024-09-17T05:36:11.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.557+0000 7f015e000640 1 -- 172.21.15.31:0/1267559861 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v144) ==== 93+0+10 (secure 0 0 0) 0x7f016005f6d0 con 0x7f01681f2b40 2024-09-17T05:36:11.560 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-09-17T05:36:11.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.561+0000 7f016cc00640 1 -- 172.21.15.31:0/1267559861 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0144073aa0 msgr2=0x7f0144075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.561+0000 7f016cc00640 1 --2- 172.21.15.31:0/1267559861 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0144073aa0 0x7f0144075f60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0158000fc0 tx=0x7f01580067b0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.561+0000 7f016cc00640 1 -- 172.21.15.31:0/1267559861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01681f2b40 msgr2=0x7f01680cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.561+0000 7f016cc00640 1 --2- 172.21.15.31:0/1267559861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01681f2b40 0x7f01680cb3a0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f01680b1190 tx=0x7f0160006430 comp rx=0 tx=0).stop 2024-09-17T05:36:11.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.561+0000 7f016cc00640 1 -- 172.21.15.31:0/1267559861 shutdown_connections 2024-09-17T05:36:11.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.561+0000 7f016cc00640 1 --2- 172.21.15.31:0/1267559861 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0144073aa0 0x7f0144075f60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.561+0000 7f016cc00640 1 --2- 172.21.15.31:0/1267559861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f01681f2b40 0x7f01680cb3a0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.561+0000 7f016cc00640 1 --2- 172.21.15.31:0/1267559861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f016815f7b0 0x7f01680c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.561+0000 7f016cc00640 1 --2- 172.21.15.31:0/1267559861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f014c004810 0x7f01680b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.561+0000 7f016cc00640 1 -- 172.21.15.31:0/1267559861 >> 172.21.15.31:0/1267559861 conn(0x7f01680d1dd0 msgr2=0x7f01680cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:11.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.561+0000 7f016cc00640 1 -- 172.21.15.31:0/1267559861 shutdown_connections 2024-09-17T05:36:11.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.561+0000 7f016cc00640 1 -- 172.21.15.31:0/1267559861 wait complete. 2024-09-17T05:36:11.582 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2' 2024-09-17T05:36:11.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.729+0000 7f2b89000640 1 -- 172.21.15.31:0/2554619053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b68004810 msgr2=0x7f2b68004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.729+0000 7f2b89000640 1 --2- 172.21.15.31:0/2554619053 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b68004810 0x7f2b68004c90 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009b60 tx=0x7f2b6c01cf50 comp rx=0 tx=0).stop 2024-09-17T05:36:11.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.729+0000 7f2b82800640 1 -- 172.21.15.31:0/2554619053 reap_dead start 2024-09-17T05:36:11.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.729+0000 7f2b89000640 1 -- 172.21.15.31:0/2554619053 shutdown_connections 2024-09-17T05:36:11.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.729+0000 7f2b89000640 1 -- 172.21.15.31:0/2554619053 >> 172.21.15.31:0/2554619053 conn(0x7f2b840d1ea0 msgr2=0x7f2b840d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:11.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.729+0000 7f2b89000640 1 -- 172.21.15.31:0/2554619053 shutdown_connections 2024-09-17T05:36:11.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.729+0000 7f2b89000640 1 -- 172.21.15.31:0/2554619053 wait complete. 2024-09-17T05:36:11.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.729+0000 7f2b89000640 1 Processor -- start 2024-09-17T05:36:11.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.729+0000 7f2b89000640 1 -- start start 2024-09-17T05:36:11.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.729+0000 7f2b89000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b68004810 0x7f2b84144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:11.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.729+0000 7f2b89000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b84161f20 0x7f2b841623a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:11.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.729+0000 7f2b89000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b840b3990 0x7f2b840b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:11.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.729+0000 7f2b89000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2b84168320 con 0x7f2b84161f20 2024-09-17T05:36:11.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.729+0000 7f2b89000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2b841681a0 con 0x7f2b68004810 2024-09-17T05:36:11.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.729+0000 7f2b89000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2b841684a0 con 0x7f2b840b3990 2024-09-17T05:36:11.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.729+0000 7f2b79400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b84161f20 0x7f2b841623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:11.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.733+0000 7f2b79400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b84161f20 0x7f2b841623a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37080/0 (socket says 172.21.15.31:37080) 2024-09-17T05:36:11.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.733+0000 7f2b79400640 1 -- 172.21.15.31:0/948688346 learned_addr learned my addr 172.21.15.31:0/948688346 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:11.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.733+0000 7f2b81e00640 1 --2- 172.21.15.31:0/948688346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b68004810 0x7f2b84144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:11.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.733+0000 7f2b82800640 1 --2- 172.21.15.31:0/948688346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b840b3990 0x7f2b840b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:11.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.733+0000 7f2b79400640 1 -- 172.21.15.31:0/948688346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b840b3990 msgr2=0x7f2b840b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.733+0000 7f2b79400640 1 --2- 172.21.15.31:0/948688346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b840b3990 0x7f2b840b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.733+0000 7f2b79400640 1 -- 172.21.15.31:0/948688346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b68004810 msgr2=0x7f2b84144cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:11.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.733+0000 7f2b79400640 1 --2- 172.21.15.31:0/948688346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b68004810 0x7f2b84144cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:11.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.733+0000 7f2b79400640 1 -- 172.21.15.31:0/948688346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b841455e0 con 0x7f2b84161f20 2024-09-17T05:36:11.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.733+0000 7f2b81e00640 1 --2- 172.21.15.31:0/948688346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b68004810 0x7f2b84144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:11.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.733+0000 7f2b79400640 1 --2- 172.21.15.31:0/948688346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b84161f20 0x7f2b841623a0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009a80 tx=0x7f2b6c0a5f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:11.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.733+0000 7f2b7aa00640 1 -- 172.21.15.31:0/948688346 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0bb070 con 0x7f2b84161f20 2024-09-17T05:36:11.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.733+0000 7f2b7aa00640 1 -- 172.21.15.31:0/948688346 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b6c005320 con 0x7f2b84161f20 2024-09-17T05:36:11.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.733+0000 7f2b7aa00640 1 -- 172.21.15.31:0/948688346 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c0b2040 con 0x7f2b84161f20 2024-09-17T05:36:11.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.733+0000 7f2b89000640 1 -- 172.21.15.31:0/948688346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b841458c0 con 0x7f2b84161f20 2024-09-17T05:36:11.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.733+0000 7f2b89000640 1 -- 172.21.15.31:0/948688346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b84145e80 con 0x7f2b84161f20 2024-09-17T05:36:11.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.733+0000 7f2b89000640 1 -- 172.21.15.31:0/948688346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b840d2350 con 0x7f2b84161f20 2024-09-17T05:36:11.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.733+0000 7f2b7aa00640 1 -- 172.21.15.31:0/948688346 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f2b6c0be070 con 0x7f2b84161f20 2024-09-17T05:36:11.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.737+0000 7f2b7aa00640 1 --2- 172.21.15.31:0/948688346 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2b60073aa0 0x7f2b60075f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:11.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.737+0000 7f2b7aa00640 1 -- 172.21.15.31:0/948688346 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 4971+0+0 (secure 0 0 0) 0x7f2b6c12e310 con 0x7f2b84161f20 2024-09-17T05:36:11.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.737+0000 7f2b81e00640 1 --2- 172.21.15.31:0/948688346 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2b60073aa0 0x7f2b60075f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:11.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.737+0000 7f2b81e00640 1 --2- 172.21.15.31:0/948688346 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2b60073aa0 0x7f2b60075f60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2b74006680 tx=0x7f2b740067b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:11.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.737+0000 7f2b7aa00640 1 -- 172.21.15.31:0/948688346 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2b6c016f80 con 0x7f2b84161f20 2024-09-17T05:36:11.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:11.981+0000 7f2b89000640 1 -- 172.21.15.31:0/948688346 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]} v 0) -- 0x7f2b840ce590 con 0x7f2b84161f20 2024-09-17T05:36:12.706 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:36:12.710 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:36:12.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:12.837+0000 7f2b7aa00640 1 -- 172.21.15.31:0/948688346 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]}]=0 v416) ==== 148+0+0 (secure 0 0 0) 0x7f2b6c0f8430 con 0x7f2b84161f20 2024-09-17T05:36:12.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:12.841+0000 7f2b89000640 1 -- 172.21.15.31:0/948688346 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2b60073aa0 msgr2=0x7f2b60075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:12.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:12.841+0000 7f2b89000640 1 --2- 172.21.15.31:0/948688346 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2b60073aa0 0x7f2b60075f60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2b74006680 tx=0x7f2b740067b0 comp rx=0 tx=0).stop 2024-09-17T05:36:12.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:12.841+0000 7f2b89000640 1 -- 172.21.15.31:0/948688346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b84161f20 msgr2=0x7f2b841623a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:12.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:12.841+0000 7f2b89000640 1 --2- 172.21.15.31:0/948688346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b84161f20 0x7f2b841623a0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009a80 tx=0x7f2b6c0a5f70 comp rx=0 tx=0).stop 2024-09-17T05:36:12.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:12.841+0000 7f2b89000640 1 -- 172.21.15.31:0/948688346 shutdown_connections 2024-09-17T05:36:12.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:12.841+0000 7f2b89000640 1 --2- 172.21.15.31:0/948688346 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2b60073aa0 0x7f2b60075f60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:12.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:12.841+0000 7f2b89000640 1 --2- 172.21.15.31:0/948688346 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2b840b3990 0x7f2b840b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:12.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:12.841+0000 7f2b89000640 1 --2- 172.21.15.31:0/948688346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b84161f20 0x7f2b841623a0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:12.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:12.841+0000 7f2b89000640 1 --2- 172.21.15.31:0/948688346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2b68004810 0x7f2b84144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:12.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:12.841+0000 7f2b89000640 1 -- 172.21.15.31:0/948688346 >> 172.21.15.31:0/948688346 conn(0x7f2b840d1ea0 msgr2=0x7f2b840cfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:12.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:12.841+0000 7f2b89000640 1 -- 172.21.15.31:0/948688346 shutdown_connections 2024-09-17T05:36:12.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:12.841+0000 7f2b89000640 1 -- 172.21.15.31:0/948688346 wait complete. 2024-09-17T05:36:12.867 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:36:13.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.017+0000 7fee84400640 1 -- 172.21.15.31:0/3868841334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee64004810 msgr2=0x7fee64004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:13.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.017+0000 7fee84400640 1 --2- 172.21.15.31:0/3868841334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee64004810 0x7fee64004c90 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fee7c161c90 tx=0x7fee6801f610 comp rx=0 tx=0).stop 2024-09-17T05:36:13.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.017+0000 7fee82400640 1 -- 172.21.15.31:0/3868841334 reap_dead start 2024-09-17T05:36:13.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.017+0000 7fee84400640 1 -- 172.21.15.31:0/3868841334 shutdown_connections 2024-09-17T05:36:13.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.017+0000 7fee84400640 1 -- 172.21.15.31:0/3868841334 >> 172.21.15.31:0/3868841334 conn(0x7fee7c0d4060 msgr2=0x7fee7c0d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:13.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee84400640 1 -- 172.21.15.31:0/3868841334 shutdown_connections 2024-09-17T05:36:13.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee84400640 1 -- 172.21.15.31:0/3868841334 wait complete. 2024-09-17T05:36:13.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee84400640 1 Processor -- start 2024-09-17T05:36:13.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee84400640 1 -- start start 2024-09-17T05:36:13.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee84400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee64004810 0x7fee7c09f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:13.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee84400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee7c0c7a90 0x7fee7c1544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:13.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee84400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee7c0c9370 0x7fee7c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:13.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee84400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c0d0bf0 con 0x7fee64004810 2024-09-17T05:36:13.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee84400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c0d0a70 con 0x7fee7c0c9370 2024-09-17T05:36:13.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee84400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fee7c0d0d70 con 0x7fee7c0c7a90 2024-09-17T05:36:13.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee81a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee64004810 0x7fee7c09f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:13.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee81a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee64004810 0x7fee7c09f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37102/0 (socket says 172.21.15.31:37102) 2024-09-17T05:36:13.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee81a00640 1 -- 172.21.15.31:0/3503121993 learned_addr learned my addr 172.21.15.31:0/3503121993 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:13.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee81a00640 1 -- 172.21.15.31:0/3503121993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee7c0c7a90 msgr2=0x7fee7c1544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:13.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee81a00640 1 --2- 172.21.15.31:0/3503121993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee7c0c7a90 0x7fee7c1544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee81a00640 1 -- 172.21.15.31:0/3503121993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee7c0c9370 msgr2=0x7fee7c0b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:13.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee81a00640 1 --2- 172.21.15.31:0/3503121993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee7c0c9370 0x7fee7c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee81a00640 1 -- 172.21.15.31:0/3503121993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7c154a30 con 0x7fee64004810 2024-09-17T05:36:13.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee81a00640 1 --2- 172.21.15.31:0/3503121993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee64004810 0x7fee7c09f1c0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fee70011d00 tx=0x7fee7000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:13.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.021+0000 7fee79600640 1 -- 172.21.15.31:0/3503121993 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7001b670 con 0x7fee64004810 2024-09-17T05:36:13.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.025+0000 7fee79600640 1 -- 172.21.15.31:0/3503121993 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee70016070 con 0x7fee64004810 2024-09-17T05:36:13.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.025+0000 7fee84400640 1 -- 172.21.15.31:0/3503121993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7c0c7ef0 con 0x7fee64004810 2024-09-17T05:36:13.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.025+0000 7fee79600640 1 -- 172.21.15.31:0/3503121993 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7001ba90 con 0x7fee64004810 2024-09-17T05:36:13.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.025+0000 7fee84400640 1 -- 172.21.15.31:0/3503121993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee7c0c84a0 con 0x7fee64004810 2024-09-17T05:36:13.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.025+0000 7fee84400640 1 -- 172.21.15.31:0/3503121993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee7c0b8850 con 0x7fee64004810 2024-09-17T05:36:13.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.025+0000 7fee79600640 1 -- 172.21.15.31:0/3503121993 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7fee7001bc30 con 0x7fee64004810 2024-09-17T05:36:13.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.025+0000 7fee79600640 1 --2- 172.21.15.31:0/3503121993 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee5c073aa0 0x7fee5c075f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:13.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.025+0000 7fee79600640 1 -- 172.21.15.31:0/3503121993 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 4971+0+0 (secure 0 0 0) 0x7fee700960a0 con 0x7fee64004810 2024-09-17T05:36:13.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.029+0000 7fee81000640 1 --2- 172.21.15.31:0/3503121993 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee5c073aa0 0x7fee5c075f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:13.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.029+0000 7fee81000640 1 --2- 172.21.15.31:0/3503121993 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee5c073aa0 0x7fee5c075f60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fee680b0000 tx=0x7fee680b5040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:13.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.029+0000 7fee79600640 1 -- 172.21.15.31:0/3503121993 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fee700608a0 con 0x7fee64004810 2024-09-17T05:36:13.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.205+0000 7fee84400640 1 -- 172.21.15.31:0/3503121993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fee7c0d0850 con 0x7fee64004810 2024-09-17T05:36:13.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.205+0000 7fee79600640 1 -- 172.21.15.31:0/3503121993 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v45) ==== 59+0+1998 (secure 0 0 0) 0x7fee700601a0 con 0x7fee64004810 2024-09-17T05:36:13.208 INFO:teuthology.orchestra.run.smithi031.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:36:13.208 INFO:teuthology.orchestra.run.smithi031.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:36:13.209 INFO:teuthology.orchestra.run.smithi031.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:36:13.209 INFO:teuthology.orchestra.run.smithi031.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:36:13.209 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6159.333103 2024-09-17T05:36:13.209 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4566.558105 2024-09-17T05:36:13.209 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4575.968427 2024-09-17T05:36:13.209 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4702.806393 2024-09-17T05:36:13.209 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4956.728274 2024-09-17T05:36:13.209 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 6604.257199 2024-09-17T05:36:13.209 INFO:teuthology.orchestra.run.smithi031.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4779.165073 2024-09-17T05:36:13.209 INFO:teuthology.orchestra.run.smithi031.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4673.795919 2024-09-17T05:36:13.210 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds 20/20 2024-09-17T05:36:13.210 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:36:13.210 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_ms 2/2 2024-09-17T05:36:13.210 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_frag true 2024-09-17T05:36:13.210 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:36:13.210 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:36:13.210 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_verify_scatter true 2024-09-17T05:36:13.210 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:36:13.210 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:36:13.210 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:36:13.211 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced client_mount_timeout 600 2024-09-17T05:36:13.211 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_client 20/20 2024-09-17T05:36:13.211 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_ms 1/1 2024-09-17T05:36:13.211 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:36:13.211 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:36:13.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.209+0000 7fee84400640 1 -- 172.21.15.31:0/3503121993 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee5c073aa0 msgr2=0x7fee5c075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:13.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.209+0000 7fee84400640 1 --2- 172.21.15.31:0/3503121993 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee5c073aa0 0x7fee5c075f60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fee680b0000 tx=0x7fee680b5040 comp rx=0 tx=0).stop 2024-09-17T05:36:13.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.209+0000 7fee84400640 1 -- 172.21.15.31:0/3503121993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee64004810 msgr2=0x7fee7c09f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:13.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.209+0000 7fee84400640 1 --2- 172.21.15.31:0/3503121993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee64004810 0x7fee7c09f1c0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fee70011d00 tx=0x7fee7000f730 comp rx=0 tx=0).stop 2024-09-17T05:36:13.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.209+0000 7fee84400640 1 -- 172.21.15.31:0/3503121993 shutdown_connections 2024-09-17T05:36:13.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.209+0000 7fee84400640 1 --2- 172.21.15.31:0/3503121993 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee5c073aa0 0x7fee5c075f60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.209+0000 7fee84400640 1 --2- 172.21.15.31:0/3503121993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee7c0c9370 0x7fee7c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.209+0000 7fee84400640 1 --2- 172.21.15.31:0/3503121993 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee7c0c7a90 0x7fee7c1544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.209+0000 7fee84400640 1 --2- 172.21.15.31:0/3503121993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee64004810 0x7fee7c09f1c0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.209+0000 7fee84400640 1 -- 172.21.15.31:0/3503121993 >> 172.21.15.31:0/3503121993 conn(0x7fee7c0d4060 msgr2=0x7fee7c06df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:13.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.209+0000 7fee84400640 1 -- 172.21.15.31:0/3503121993 shutdown_connections 2024-09-17T05:36:13.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.209+0000 7fee84400640 1 -- 172.21.15.31:0/3503121993 wait complete. 2024-09-17T05:36:13.230 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:36:13.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.377+0000 7f97aa400640 1 -- 172.21.15.31:0/1230159210 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97a40d02c0 msgr2=0x7f97a40d06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:13.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.377+0000 7f97aa400640 1 --2- 172.21.15.31:0/1230159210 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97a40d02c0 0x7f97a40d06a0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f97a40cf820 tx=0x7f979401eff0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.377+0000 7f97aa400640 1 -- 172.21.15.31:0/1230159210 shutdown_connections 2024-09-17T05:36:13.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.377+0000 7f97aa400640 1 --2- 172.21.15.31:0/1230159210 >> v2:172.21.15.155:3300/0 conn(0x7f97a40b2ec0 0x7f97a40b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.377+0000 7f97aa400640 1 --2- 172.21.15.31:0/1230159210 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97a40d02c0 0x7f97a40d06a0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.377+0000 7f97aa400640 1 -- 172.21.15.31:0/1230159210 >> 172.21.15.31:0/1230159210 conn(0x7f97a40d1d70 msgr2=0x7f97a40d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:13.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.377+0000 7f97aa400640 1 -- 172.21.15.31:0/1230159210 shutdown_connections 2024-09-17T05:36:13.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.377+0000 7f97aa400640 1 -- 172.21.15.31:0/1230159210 wait complete. 2024-09-17T05:36:13.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97aa400640 1 Processor -- start 2024-09-17T05:36:13.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97aa400640 1 -- start start 2024-09-17T05:36:13.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97aa400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97a40b2900 0x7f97a40cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:13.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97aa400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a40b2ec0 0x7f97a4154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:13.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97aa400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97a40d02c0 0x7f97a41552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:13.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97aa400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f97a40cdc80 con 0x7f97a40d02c0 2024-09-17T05:36:13.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97aa400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f97a40cdb00 con 0x7f97a40b2900 2024-09-17T05:36:13.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97aa400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f97a40d2aa0 con 0x7f97a40b2ec0 2024-09-17T05:36:13.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97a3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97a40d02c0 0x7f97a41552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:13.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97a3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97a40d02c0 0x7f97a41552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37122/0 (socket says 172.21.15.31:37122) 2024-09-17T05:36:13.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97a3e00640 1 -- 172.21.15.31:0/4201383348 learned_addr learned my addr 172.21.15.31:0/4201383348 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:13.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97a3400640 1 --2- 172.21.15.31:0/4201383348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97a40b2900 0x7f97a40cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:13.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f979be00640 1 --2- 172.21.15.31:0/4201383348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a40b2ec0 0x7f97a4154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:13.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97a3e00640 1 -- 172.21.15.31:0/4201383348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a40b2ec0 msgr2=0x7f97a4154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:13.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97a3e00640 1 --2- 172.21.15.31:0/4201383348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a40b2ec0 0x7f97a4154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97a3e00640 1 -- 172.21.15.31:0/4201383348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97a40b2900 msgr2=0x7f97a40cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:13.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97a3e00640 1 --2- 172.21.15.31:0/4201383348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97a40b2900 0x7f97a40cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97a3e00640 1 -- 172.21.15.31:0/4201383348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a40c9b70 con 0x7f97a40d02c0 2024-09-17T05:36:13.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97a3e00640 1 --2- 172.21.15.31:0/4201383348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97a40d02c0 0x7f97a41552e0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f979c00caa0 tx=0x7f979c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:13.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f979b400640 1 -- 172.21.15.31:0/4201383348 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c016020 con 0x7f97a40d02c0 2024-09-17T05:36:13.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f979b400640 1 -- 172.21.15.31:0/4201383348 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f979c00a8d0 con 0x7f97a40d02c0 2024-09-17T05:36:13.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f979b400640 1 -- 172.21.15.31:0/4201383348 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c00ada0 con 0x7f97a40d02c0 2024-09-17T05:36:13.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97aa400640 1 -- 172.21.15.31:0/4201383348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a40c9e50 con 0x7f97a40d02c0 2024-09-17T05:36:13.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.381+0000 7f97aa400640 1 -- 172.21.15.31:0/4201383348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a40ca410 con 0x7f97a40d02c0 2024-09-17T05:36:13.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.385+0000 7f97aa400640 1 -- 172.21.15.31:0/4201383348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97a40c5790 con 0x7f97a40d02c0 2024-09-17T05:36:13.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.385+0000 7f979b400640 1 -- 172.21.15.31:0/4201383348 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f979c019020 con 0x7f97a40d02c0 2024-09-17T05:36:13.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.385+0000 7f979b400640 1 --2- 172.21.15.31:0/4201383348 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9780073a70 0x7f9780075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:13.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.385+0000 7f979b400640 1 -- 172.21.15.31:0/4201383348 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 4971+0+0 (secure 0 0 0) 0x7f979c0953a0 con 0x7f97a40d02c0 2024-09-17T05:36:13.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.385+0000 7f97a3400640 1 --2- 172.21.15.31:0/4201383348 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9780073a70 0x7f9780075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:13.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.385+0000 7f97a3400640 1 --2- 172.21.15.31:0/4201383348 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9780073a70 0x7f9780075f30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f97940b2000 tx=0x7f979401d830 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:13.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.389+0000 7f979b400640 1 -- 172.21.15.31:0/4201383348 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f979c020020 con 0x7f97a40d02c0 2024-09-17T05:36:13.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.565+0000 7f97aa400640 1 -- 172.21.15.31:0/4201383348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f97a415ee20 con 0x7f97a40d02c0 2024-09-17T05:36:13.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.569+0000 7f979b400640 1 -- 172.21.15.31:0/4201383348 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7f97a40cd360 con 0x7f97a40d02c0 2024-09-17T05:36:13.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.569+0000 7f97aa400640 1 -- 172.21.15.31:0/4201383348 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9780073a70 msgr2=0x7f9780075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:13.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.569+0000 7f97aa400640 1 --2- 172.21.15.31:0/4201383348 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9780073a70 0x7f9780075f30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f97940b2000 tx=0x7f979401d830 comp rx=0 tx=0).stop 2024-09-17T05:36:13.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.569+0000 7f97aa400640 1 -- 172.21.15.31:0/4201383348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97a40d02c0 msgr2=0x7f97a41552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:13.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.569+0000 7f97aa400640 1 --2- 172.21.15.31:0/4201383348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97a40d02c0 0x7f97a41552e0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f979c00caa0 tx=0x7f979c00cb90 comp rx=0 tx=0).stop 2024-09-17T05:36:13.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.569+0000 7f97aa400640 1 -- 172.21.15.31:0/4201383348 shutdown_connections 2024-09-17T05:36:13.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.569+0000 7f97aa400640 1 --2- 172.21.15.31:0/4201383348 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9780073a70 0x7f9780075f30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.569+0000 7f97aa400640 1 --2- 172.21.15.31:0/4201383348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97a40d02c0 0x7f97a41552e0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.569+0000 7f97aa400640 1 --2- 172.21.15.31:0/4201383348 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97a40b2ec0 0x7f97a4154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.569+0000 7f97aa400640 1 --2- 172.21.15.31:0/4201383348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97a40b2900 0x7f97a40cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:13.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.569+0000 7f97aa400640 1 -- 172.21.15.31:0/4201383348 >> 172.21.15.31:0/4201383348 conn(0x7f97a40d1d70 msgr2=0x7f97a415cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:13.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.569+0000 7f97aa400640 1 -- 172.21.15.31:0/4201383348 shutdown_connections 2024-09-17T05:36:13.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:13.569+0000 7f97aa400640 1 -- 172.21.15.31:0/4201383348 wait complete. 2024-09-17T05:36:13.593 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:36:13.593 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:36:13.691 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:36:13.779 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:36:13.779 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:36:13.780 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:13.789 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:36:13.789 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:36:13.789 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:13.798 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:36:13.798 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:36:13.798 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:13.840 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:36:13.840 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:36:13.841 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:13.854 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:36:13.854 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:36:13.854 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:14.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.033+0000 7f6aefc00640 1 -- 172.21.15.31:0/1461881018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ae815bea0 msgr2=0x7f6ae80ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:14.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.033+0000 7f6aefc00640 1 --2- 172.21.15.31:0/1461881018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ae815bea0 0x7f6ae80ce670 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009840 tx=0x7f6ad801c790 comp rx=0 tx=0).stop 2024-09-17T05:36:14.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.033+0000 7f6aefc00640 1 -- 172.21.15.31:0/1461881018 shutdown_connections 2024-09-17T05:36:14.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.033+0000 7f6aefc00640 1 --2- 172.21.15.31:0/1461881018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ae815bea0 0x7f6ae80ce670 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.033+0000 7f6aefc00640 1 -- 172.21.15.31:0/1461881018 >> 172.21.15.31:0/1461881018 conn(0x7f6ae80d1dc0 msgr2=0x7f6ae80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:14.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.033+0000 7f6aefc00640 1 -- 172.21.15.31:0/1461881018 shutdown_connections 2024-09-17T05:36:14.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.033+0000 7f6aefc00640 1 -- 172.21.15.31:0/1461881018 wait complete. 2024-09-17T05:36:14.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.033+0000 7f6aefc00640 1 Processor -- start 2024-09-17T05:36:14.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.033+0000 7f6aefc00640 1 -- start start 2024-09-17T05:36:14.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aefc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae80cdb30 0x7f6ae80c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:14.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aefc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ae80d28e0 0x7f6ae8150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:14.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aefc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ae815bea0 0x7f6ae80b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:14.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aefc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae816a930 con 0x7f6ae80cdb30 2024-09-17T05:36:14.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aefc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae816a7b0 con 0x7f6ae80d28e0 2024-09-17T05:36:14.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aefc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae816aab0 con 0x7f6ae815bea0 2024-09-17T05:36:14.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aed200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae80cdb30 0x7f6ae80c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:14.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aed200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae80cdb30 0x7f6ae80c87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37136/0 (socket says 172.21.15.31:37136) 2024-09-17T05:36:14.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aed200640 1 -- 172.21.15.31:0/226522010 learned_addr learned my addr 172.21.15.31:0/226522010 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:14.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6adfe00640 1 --2- 172.21.15.31:0/226522010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ae80d28e0 0x7f6ae8150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:14.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aedc00640 1 --2- 172.21.15.31:0/226522010 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ae815bea0 0x7f6ae80b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:14.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aed200640 1 -- 172.21.15.31:0/226522010 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ae815bea0 msgr2=0x7f6ae80b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:14.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aed200640 1 --2- 172.21.15.31:0/226522010 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ae815bea0 0x7f6ae80b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aed200640 1 -- 172.21.15.31:0/226522010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ae80d28e0 msgr2=0x7f6ae8150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:14.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aed200640 1 --2- 172.21.15.31:0/226522010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ae80d28e0 0x7f6ae8150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aed200640 1 -- 172.21.15.31:0/226522010 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae8150ea0 con 0x7f6ae80cdb30 2024-09-17T05:36:14.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aedc00640 1 --2- 172.21.15.31:0/226522010 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ae815bea0 0x7f6ae80b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:14.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aed200640 1 --2- 172.21.15.31:0/226522010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae80cdb30 0x7f6ae80c87d0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f6ad801cc70 tx=0x7f6ad80a65c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:14.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6ae5600640 1 -- 172.21.15.31:0/226522010 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad80be070 con 0x7f6ae80cdb30 2024-09-17T05:36:14.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6ae5600640 1 -- 172.21.15.31:0/226522010 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ad80a6630 con 0x7f6ae80cdb30 2024-09-17T05:36:14.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aefc00640 1 -- 172.21.15.31:0/226522010 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae81fc320 con 0x7f6ae80cdb30 2024-09-17T05:36:14.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6ae5600640 1 -- 172.21.15.31:0/226522010 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8005260 con 0x7f6ae80cdb30 2024-09-17T05:36:14.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aefc00640 1 -- 172.21.15.31:0/226522010 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae806f400 con 0x7f6ae80cdb30 2024-09-17T05:36:14.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.037+0000 7f6aefc00640 1 -- 172.21.15.31:0/226522010 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae806f5d0 con 0x7f6ae80cdb30 2024-09-17T05:36:14.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.041+0000 7f6ae5600640 1 -- 172.21.15.31:0/226522010 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f6ad8005400 con 0x7f6ae80cdb30 2024-09-17T05:36:14.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.041+0000 7f6ae5600640 1 --2- 172.21.15.31:0/226522010 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6ac4073a70 0x7f6ac4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:14.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.041+0000 7f6ae5600640 1 -- 172.21.15.31:0/226522010 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 4971+0+0 (secure 0 0 0) 0x7f6ad812eb30 con 0x7f6ae80cdb30 2024-09-17T05:36:14.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.041+0000 7f6adfe00640 1 --2- 172.21.15.31:0/226522010 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6ac4073a70 0x7f6ac4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:14.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.041+0000 7f6adfe00640 1 --2- 172.21.15.31:0/226522010 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6ac4073a70 0x7f6ac4075f30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6ae806ee60 tx=0x7f6ad0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:14.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.045+0000 7f6ae5600640 1 -- 172.21.15.31:0/226522010 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6ad80ac030 con 0x7f6ae80cdb30 2024-09-17T05:36:14.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.253+0000 7f6aefc00640 1 -- 172.21.15.31:0/226522010 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ae80ce670 con 0x7f6ae80cdb30 2024-09-17T05:36:14.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.253+0000 7f6ae5600640 1 -- 172.21.15.31:0/226522010 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+3919 (secure 0 0 0) 0x7f6ad8016410 con 0x7f6ae80cdb30 2024-09-17T05:36:14.256 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:14.256 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":103,"btime":"2024-09-17T05:36:07:691335+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6809/3405206397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":3405206397},{"type":"v1","addr":"172.21.15.155:6809","nonce":3405206397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":94},{"gid":6977,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/4225787824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":4225787824},{"type":"v1","addr":"172.21.15.155:6835","nonce":4225787824}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8340,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2838938586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2838938586},{"type":"v1","addr":"172.21.15.31:6834","nonce":2838938586}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":8634,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2987706632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2987706632},{"type":"v1","addr":"172.21.15.31:6835","nonce":2987706632}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":103}],"filesystems":[]} 2024-09-17T05:36:14.256 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 103 2024-09-17T05:36:14.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.257+0000 7f6aefc00640 1 -- 172.21.15.31:0/226522010 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6ac4073a70 msgr2=0x7f6ac4075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:14.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.257+0000 7f6aefc00640 1 --2- 172.21.15.31:0/226522010 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6ac4073a70 0x7f6ac4075f30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6ae806ee60 tx=0x7f6ad0009040 comp rx=0 tx=0).stop 2024-09-17T05:36:14.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.257+0000 7f6aefc00640 1 -- 172.21.15.31:0/226522010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae80cdb30 msgr2=0x7f6ae80c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:14.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.257+0000 7f6aefc00640 1 --2- 172.21.15.31:0/226522010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae80cdb30 0x7f6ae80c87d0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f6ad801cc70 tx=0x7f6ad80a65c0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.257+0000 7f6aefc00640 1 -- 172.21.15.31:0/226522010 shutdown_connections 2024-09-17T05:36:14.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.257+0000 7f6aefc00640 1 --2- 172.21.15.31:0/226522010 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6ac4073a70 0x7f6ac4075f30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.257+0000 7f6aefc00640 1 --2- 172.21.15.31:0/226522010 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6ae815bea0 0x7f6ae80b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.257+0000 7f6aefc00640 1 --2- 172.21.15.31:0/226522010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6ae80d28e0 0x7f6ae8150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.257+0000 7f6aefc00640 1 --2- 172.21.15.31:0/226522010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ae80cdb30 0x7f6ae80c87d0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.257+0000 7f6aefc00640 1 -- 172.21.15.31:0/226522010 >> 172.21.15.31:0/226522010 conn(0x7f6ae80d1dc0 msgr2=0x7f6ae80cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:14.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.257+0000 7f6aefc00640 1 -- 172.21.15.31:0/226522010 shutdown_connections 2024-09-17T05:36:14.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.257+0000 7f6aefc00640 1 -- 172.21.15.31:0/226522010 wait complete. 2024-09-17T05:36:14.278 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:36:14.278 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:36:14.278 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:36:14.278 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:36:14.279 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:36:14.279 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:36:14.279 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:36:14.279 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:36:14.279 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:36:14.279 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:36:14.279 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:36:14.280 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:36:14.280 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:36:14.280 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:36:14.280 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:36:14.280 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:36:14.290 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:36:14.291 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:36:14.292 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:36:14.292 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:36:14.293 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:36:14.293 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:36:14.294 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:36:14.294 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:36:14.334 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:36:14.336 DEBUG:teuthology.parallel:result is None 2024-09-17T05:36:14.338 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:36:14.338 DEBUG:teuthology.parallel:result is None 2024-09-17T05:36:14.339 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:36:14.339 DEBUG:teuthology.parallel:result is None 2024-09-17T05:36:14.341 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:36:14.341 DEBUG:teuthology.parallel:result is None 2024-09-17T05:36:14.341 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:36:14.425 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-17T05:36:14.427 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-17T05:36:14.428 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-17T05:36:14.428 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-17T05:36:14.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.501+0000 7f7536a00640 1 -- 172.21.15.31:0/3930449673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75300cffc0 msgr2=0x7f7530073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:14.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.501+0000 7f7536a00640 1 --2- 172.21.15.31:0/3930449673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75300cffc0 0x7f7530073ed0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7518009840 tx=0x7f751801c710 comp rx=0 tx=0).stop 2024-09-17T05:36:14.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.501+0000 7f7536a00640 1 -- 172.21.15.31:0/3930449673 shutdown_connections 2024-09-17T05:36:14.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.501+0000 7f7536a00640 1 --2- 172.21.15.31:0/3930449673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75300cffc0 0x7f7530073ed0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.501+0000 7f7536a00640 1 -- 172.21.15.31:0/3930449673 >> 172.21.15.31:0/3930449673 conn(0x7f75300d0c90 msgr2=0x7f75300d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:14.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.501+0000 7f7536a00640 1 -- 172.21.15.31:0/3930449673 shutdown_connections 2024-09-17T05:36:14.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.501+0000 7f7536a00640 1 -- 172.21.15.31:0/3930449673 wait complete. 2024-09-17T05:36:14.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f7536a00640 1 Processor -- start 2024-09-17T05:36:14.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f7536a00640 1 -- start start 2024-09-17T05:36:14.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f7536a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f753006f9a0 0x7f7530071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:14.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f7536a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75300cffc0 0x7f75300c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:14.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f7536a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753015af60 0x7f75300b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:14.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f7536a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7530070ad0 con 0x7f753006f9a0 2024-09-17T05:36:14.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f7536a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7530070950 con 0x7f75300cffc0 2024-09-17T05:36:14.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f7536a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7530169560 con 0x7f753015af60 2024-09-17T05:36:14.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f752fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f753006f9a0 0x7f7530071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:14.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f752fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f753006f9a0 0x7f7530071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37170/0 (socket says 172.21.15.31:37170) 2024-09-17T05:36:14.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f752fe00640 1 -- 172.21.15.31:0/1012032012 learned_addr learned my addr 172.21.15.31:0/1012032012 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:14.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f752fe00640 1 -- 172.21.15.31:0/1012032012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753015af60 msgr2=0x7f75300b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:14.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f752fe00640 1 --2- 172.21.15.31:0/1012032012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753015af60 0x7f75300b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f752fe00640 1 -- 172.21.15.31:0/1012032012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75300cffc0 msgr2=0x7f75300c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:14.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f7527e00640 1 --2- 172.21.15.31:0/1012032012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75300cffc0 0x7f75300c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:14.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f752fe00640 1 --2- 172.21.15.31:0/1012032012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75300cffc0 0x7f75300c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f752fe00640 1 -- 172.21.15.31:0/1012032012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75300c8120 con 0x7f753006f9a0 2024-09-17T05:36:14.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f7527e00640 1 --2- 172.21.15.31:0/1012032012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75300cffc0 0x7f75300c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:14.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f752fe00640 1 --2- 172.21.15.31:0/1012032012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f753006f9a0 0x7f7530071e60 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f7520001230 tx=0x7f752000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:14.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f752cc00640 1 -- 172.21.15.31:0/1012032012 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7520016020 con 0x7f753006f9a0 2024-09-17T05:36:14.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f752cc00640 1 -- 172.21.15.31:0/1012032012 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7520012920 con 0x7f753006f9a0 2024-09-17T05:36:14.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f7536a00640 1 -- 172.21.15.31:0/1012032012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75300c8400 con 0x7f753006f9a0 2024-09-17T05:36:14.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f752cc00640 1 -- 172.21.15.31:0/1012032012 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7520012db0 con 0x7f753006f9a0 2024-09-17T05:36:14.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f7536a00640 1 -- 172.21.15.31:0/1012032012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75300c89c0 con 0x7f753006f9a0 2024-09-17T05:36:14.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.505+0000 7f7536a00640 1 -- 172.21.15.31:0/1012032012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f753006fe30 con 0x7f753006f9a0 2024-09-17T05:36:14.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.509+0000 7f752cc00640 1 -- 172.21.15.31:0/1012032012 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f7520019020 con 0x7f753006f9a0 2024-09-17T05:36:14.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.509+0000 7f752cc00640 1 --2- 172.21.15.31:0/1012032012 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f750c073a70 0x7f750c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:14.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.509+0000 7f752cc00640 1 -- 172.21.15.31:0/1012032012 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 4971+0+0 (secure 0 0 0) 0x7f7520095010 con 0x7f753006f9a0 2024-09-17T05:36:14.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.509+0000 7f7527e00640 1 --2- 172.21.15.31:0/1012032012 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f750c073a70 0x7f750c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:14.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.509+0000 7f7527e00640 1 --2- 172.21.15.31:0/1012032012 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f750c073a70 0x7f750c075f30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f75180af000 tx=0x7f751801af50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:14.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.513+0000 7f752cc00640 1 -- 172.21.15.31:0/1012032012 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7520020030 con 0x7f753006f9a0 2024-09-17T05:36:14.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.705+0000 7f7536a00640 1 -- 172.21.15.31:0/1012032012 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7530151ec0 con 0x7f753006f9a0 2024-09-17T05:36:14.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.861+0000 7f752cc00640 1 -- 172.21.15.31:0/1012032012 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v146) ==== 97+0+0 (secure 0 0 0) 0x7f752005f370 con 0x7f753006f9a0 2024-09-17T05:36:14.861 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2024-09-17T05:36:14.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.861+0000 7f7536a00640 1 -- 172.21.15.31:0/1012032012 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f750c073a70 msgr2=0x7f750c075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:14.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.861+0000 7f7536a00640 1 --2- 172.21.15.31:0/1012032012 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f750c073a70 0x7f750c075f30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f75180af000 tx=0x7f751801af50 comp rx=0 tx=0).stop 2024-09-17T05:36:14.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.861+0000 7f7536a00640 1 -- 172.21.15.31:0/1012032012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f753006f9a0 msgr2=0x7f7530071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:14.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.861+0000 7f7536a00640 1 --2- 172.21.15.31:0/1012032012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f753006f9a0 0x7f7530071e60 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f7520001230 tx=0x7f752000c980 comp rx=0 tx=0).stop 2024-09-17T05:36:14.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.861+0000 7f7536a00640 1 -- 172.21.15.31:0/1012032012 shutdown_connections 2024-09-17T05:36:14.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.861+0000 7f7536a00640 1 --2- 172.21.15.31:0/1012032012 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f750c073a70 0x7f750c075f30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.861+0000 7f7536a00640 1 --2- 172.21.15.31:0/1012032012 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f753015af60 0x7f75300b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.861+0000 7f7536a00640 1 --2- 172.21.15.31:0/1012032012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75300cffc0 0x7f75300c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.861+0000 7f7536a00640 1 --2- 172.21.15.31:0/1012032012 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f753006f9a0 0x7f7530071e60 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:14.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.861+0000 7f7536a00640 1 -- 172.21.15.31:0/1012032012 >> 172.21.15.31:0/1012032012 conn(0x7f75300d0c90 msgr2=0x7f75301578d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:14.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.861+0000 7f7536a00640 1 -- 172.21.15.31:0/1012032012 shutdown_connections 2024-09-17T05:36:14.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:14.861+0000 7f7536a00640 1 -- 172.21.15.31:0/1012032012 wait complete. 2024-09-17T05:36:14.886 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:36:15.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.029+0000 7f8c50600640 1 -- 172.21.15.31:0/109068960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c480d28e0 msgr2=0x7f8c480cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:15.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.029+0000 7f8c50600640 1 --2- 172.21.15.31:0/109068960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c480d28e0 0x7f8c480cebb0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f8c480745d0 tx=0x7f8c4001ccf0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.029+0000 7f8c50600640 1 -- 172.21.15.31:0/109068960 shutdown_connections 2024-09-17T05:36:15.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.029+0000 7f8c50600640 1 --2- 172.21.15.31:0/109068960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c480d28e0 0x7f8c480cebb0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.029+0000 7f8c50600640 1 --2- 172.21.15.31:0/109068960 >> v2:172.21.15.155:3300/0 conn(0x7f8c4815bea0 0x7f8c480ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.029+0000 7f8c50600640 1 -- 172.21.15.31:0/109068960 >> 172.21.15.31:0/109068960 conn(0x7f8c480d1dc0 msgr2=0x7f8c480d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:15.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.029+0000 7f8c50600640 1 -- 172.21.15.31:0/109068960 shutdown_connections 2024-09-17T05:36:15.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.029+0000 7f8c50600640 1 -- 172.21.15.31:0/109068960 wait complete. 2024-09-17T05:36:15.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c50600640 1 Processor -- start 2024-09-17T05:36:15.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c50600640 1 -- start start 2024-09-17T05:36:15.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c50600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c480cdb30 0x7f8c4815aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:15.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c50600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c480d28e0 0x7f8c48165ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:15.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c50600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c4815bea0 0x7f8c48071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:15.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c50600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8c48168fc0 con 0x7f8c480cdb30 2024-09-17T05:36:15.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c50600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8c48168e40 con 0x7f8c480d28e0 2024-09-17T05:36:15.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c50600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8c48169140 con 0x7f8c4815bea0 2024-09-17T05:36:15.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c4dc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c480cdb30 0x7f8c4815aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:15.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c4dc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c480cdb30 0x7f8c4815aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37196/0 (socket says 172.21.15.31:37196) 2024-09-17T05:36:15.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c4dc00640 1 -- 172.21.15.31:0/276263589 learned_addr learned my addr 172.21.15.31:0/276263589 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:15.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c4d200640 1 --2- 172.21.15.31:0/276263589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c480d28e0 0x7f8c48165ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:15.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c4e600640 1 --2- 172.21.15.31:0/276263589 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c4815bea0 0x7f8c48071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:15.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c4dc00640 1 -- 172.21.15.31:0/276263589 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c4815bea0 msgr2=0x7f8c48071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:15.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c4dc00640 1 --2- 172.21.15.31:0/276263589 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c4815bea0 0x7f8c48071990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c4dc00640 1 -- 172.21.15.31:0/276263589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c480d28e0 msgr2=0x7f8c48165ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:15.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c4dc00640 1 --2- 172.21.15.31:0/276263589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c480d28e0 0x7f8c48165ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c4dc00640 1 -- 172.21.15.31:0/276263589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c48166660 con 0x7f8c480cdb30 2024-09-17T05:36:15.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c4dc00640 1 --2- 172.21.15.31:0/276263589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c480cdb30 0x7f8c4815aa40 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0058d0 tx=0x7f8c3c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:15.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c45600640 1 -- 172.21.15.31:0/276263589 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c017070 con 0x7f8c480cdb30 2024-09-17T05:36:15.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c45600640 1 -- 172.21.15.31:0/276263589 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c3c009d20 con 0x7f8c480cdb30 2024-09-17T05:36:15.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c45600640 1 -- 172.21.15.31:0/276263589 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c0106c0 con 0x7f8c480cdb30 2024-09-17T05:36:15.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c50600640 1 -- 172.21.15.31:0/276263589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c481fb290 con 0x7f8c480cdb30 2024-09-17T05:36:15.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.033+0000 7f8c50600640 1 -- 172.21.15.31:0/276263589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c4815af80 con 0x7f8c480cdb30 2024-09-17T05:36:15.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.037+0000 7f8c50600640 1 -- 172.21.15.31:0/276263589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c480cc9d0 con 0x7f8c480cdb30 2024-09-17T05:36:15.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.037+0000 7f8c45600640 1 -- 172.21.15.31:0/276263589 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f8c3c01a070 con 0x7f8c480cdb30 2024-09-17T05:36:15.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.037+0000 7f8c45600640 1 --2- 172.21.15.31:0/276263589 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8c28073a70 0x7f8c28075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:15.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.037+0000 7f8c45600640 1 -- 172.21.15.31:0/276263589 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 4885+0+0 (secure 0 0 0) 0x7f8c3c095230 con 0x7f8c480cdb30 2024-09-17T05:36:15.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.037+0000 7f8c4d200640 1 --2- 172.21.15.31:0/276263589 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8c28073a70 0x7f8c28075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:15.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.037+0000 7f8c4d200640 1 --2- 172.21.15.31:0/276263589 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8c28073a70 0x7f8c28075f30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8c480c7220 tx=0x7f8c34009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:15.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.041+0000 7f8c45600640 1 -- 172.21.15.31:0/276263589 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8c3c05f420 con 0x7f8c480cdb30 2024-09-17T05:36:15.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.273+0000 7f8c50600640 1 -- 172.21.15.31:0/276263589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8c480b5550 con 0x7f8c480cdb30 2024-09-17T05:36:15.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.277+0000 7f8c45600640 1 -- 172.21.15.31:0/276263589 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) ==== 80+0+5304 (secure 0 0 0) 0x7f8c3c063e50 con 0x7f8c480cdb30 2024-09-17T05:36:15.277 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:15.277 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:36:15.277 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2024-09-17T05:36:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2024-09-17T05:36:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmoloQARAAbTcR/1F1qz7Crjdu1NPSgw==", 2024-09-17T05:36:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:36:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:36:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:36:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2024-09-17T05:36:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmYrdRDRAAkaDz03U3lMZlkLEVFYlTaw==", 2024-09-17T05:36:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:36:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:36:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:36:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2024-09-17T05:36:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmpFRCCBAAZRsuAVwSxuMGDeoYCwWFeg==", 2024-09-17T05:36:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:36:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:36:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:36:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2024-09-17T05:36:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lm23PSFBAAuO+k0kWY28PN7+pEtlUniQ==", 2024-09-17T05:36:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:36:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:36:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:36:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2024-09-17T05:36:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBTE+lm0miKHxAA2C1pfwBxJtKQhu4xuPumxg==", 2024-09-17T05:36:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:36:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:36:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2024-09-17T05:36:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBWE+lmdQi7NRAA2v4ETg4jynbPF0K4E73KAA==", 2024-09-17T05:36:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:36:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:36:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBaE+lm18eUEBAA8gAhUx9UNa2Lk4uyFBd7Nw==", 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2024-09-17T05:36:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBdE+lm00moJBAAizrxOP4rI4fGR91dYzlEkw==", 2024-09-17T05:36:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:36:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:36:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2024-09-17T05:36:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBjE+lmhdtUJhAA7+KM8DwQriFwMbpqXAPTuA==", 2024-09-17T05:36:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:36:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:36:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2024-09-17T05:36:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBmE+lm5cByOhAAiMnQIv2O41am/3E+0dp4sg==", 2024-09-17T05:36:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:36:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:36:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2024-09-17T05:36:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBqE+lm19FhExAAo/Sfj2SX5+Y2/Fxz8mbiNQ==", 2024-09-17T05:36:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:36:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:36:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2024-09-17T05:36:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBtE+lmISDbKBAAapUBS+t+N1vUcCbdJic8Dw==", 2024-09-17T05:36:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:36:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:36:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2024-09-17T05:36:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw==", 2024-09-17T05:36:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:36:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2024-09-17T05:36:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:36:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2024-09-17T05:36:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmb2pmIhAA7p+G+WnB7ujZZdSlaossYg==", 2024-09-17T05:36:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:36:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:36:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:36:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:36:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2024-09-17T05:36:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmAPPaHhAAyz/gKunaNFyrdkAUy50qmQ==", 2024-09-17T05:36:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:36:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:36:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:36:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:36:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2024-09-17T05:36:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lml72BKBAAgAji5TWedU7azT5oQz3fYg==", 2024-09-17T05:36:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:36:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:36:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:36:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:36:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2024-09-17T05:36:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmtgltIRAAeTv/U/vZ9ZIuGN4JXTHD0A==", 2024-09-17T05:36:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:36:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:36:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:36:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2024-09-17T05:36:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmTt2oOBAAmR5ykU4WbEzlKFiwI7sMdg==", 2024-09-17T05:36:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:36:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:36:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2024-09-17T05:36:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmKILYNBAAojM8RIq92dO2DQyXppReIw==", 2024-09-17T05:36:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:36:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:36:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.293 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.293 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:36:15.293 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:36:15.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.277+0000 7f8c50600640 1 -- 172.21.15.31:0/276263589 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8c28073a70 msgr2=0x7f8c28075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:15.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.277+0000 7f8c50600640 1 --2- 172.21.15.31:0/276263589 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8c28073a70 0x7f8c28075f30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8c480c7220 tx=0x7f8c34009040 comp rx=0 tx=0).stop 2024-09-17T05:36:15.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.277+0000 7f8c50600640 1 -- 172.21.15.31:0/276263589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c480cdb30 msgr2=0x7f8c4815aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:15.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.277+0000 7f8c50600640 1 --2- 172.21.15.31:0/276263589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c480cdb30 0x7f8c4815aa40 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0058d0 tx=0x7f8c3c00dde0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.277+0000 7f8c50600640 1 -- 172.21.15.31:0/276263589 shutdown_connections 2024-09-17T05:36:15.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.277+0000 7f8c50600640 1 --2- 172.21.15.31:0/276263589 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8c28073a70 0x7f8c28075f30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.277+0000 7f8c50600640 1 --2- 172.21.15.31:0/276263589 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8c4815bea0 0x7f8c48071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.277+0000 7f8c50600640 1 --2- 172.21.15.31:0/276263589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c480d28e0 0x7f8c48165ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.277+0000 7f8c50600640 1 --2- 172.21.15.31:0/276263589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c480cdb30 0x7f8c4815aa40 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.277+0000 7f8c50600640 1 -- 172.21.15.31:0/276263589 >> 172.21.15.31:0/276263589 conn(0x7f8c480d1dc0 msgr2=0x7f8c480b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:15.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.277+0000 7f8c50600640 1 -- 172.21.15.31:0/276263589 shutdown_connections 2024-09-17T05:36:15.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.277+0000 7f8c50600640 1 -- 172.21.15.31:0/276263589 wait complete. 2024-09-17T05:36:15.300 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:36:15.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.445+0000 7f167a000640 1 -- 172.21.15.31:0/2158345018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16580039f0 msgr2=0x7f1658003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:15.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.445+0000 7f167a000640 1 --2- 172.21.15.31:0/2158345018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16580039f0 0x7f1658003dd0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f1664001ec0 tx=0x7f166401cf80 comp rx=0 tx=0).stop 2024-09-17T05:36:15.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.445+0000 7f1673e00640 1 -- 172.21.15.31:0/2158345018 reap_dead start 2024-09-17T05:36:15.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.445+0000 7f167a000640 1 -- 172.21.15.31:0/2158345018 shutdown_connections 2024-09-17T05:36:15.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.445+0000 7f167a000640 1 -- 172.21.15.31:0/2158345018 >> 172.21.15.31:0/2158345018 conn(0x7f16740d1dc0 msgr2=0x7f16740d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:15.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.445+0000 7f167a000640 1 -- 172.21.15.31:0/2158345018 shutdown_connections 2024-09-17T05:36:15.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.445+0000 7f167a000640 1 -- 172.21.15.31:0/2158345018 wait complete. 2024-09-17T05:36:15.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f167a000640 1 Processor -- start 2024-09-17T05:36:15.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f167a000640 1 -- start start 2024-09-17T05:36:15.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f167a000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16580039f0 0x7f167415a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:15.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f167a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16740b4120 0x7f16740b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:15.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f167a000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16740b2ae0 0x7f16741fb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:15.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f167a000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1674167f10 con 0x7f16740b4120 2024-09-17T05:36:15.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f167a000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1674167d90 con 0x7f16740b2ae0 2024-09-17T05:36:15.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f167a000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1674168090 con 0x7f16580039f0 2024-09-17T05:36:15.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f166be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16740b4120 0x7f16740b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:15.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f166be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16740b4120 0x7f16740b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37222/0 (socket says 172.21.15.31:37222) 2024-09-17T05:36:15.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f166be00640 1 -- 172.21.15.31:0/333848411 learned_addr learned my addr 172.21.15.31:0/333848411 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:15.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f1673e00640 1 --2- 172.21.15.31:0/333848411 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16740b2ae0 0x7f16741fb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:15.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f1673400640 1 --2- 172.21.15.31:0/333848411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16580039f0 0x7f167415a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f166be00640 1 -- 172.21.15.31:0/333848411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16580039f0 msgr2=0x7f167415a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f166be00640 1 --2- 172.21.15.31:0/333848411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16580039f0 0x7f167415a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f166be00640 1 -- 172.21.15.31:0/333848411 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16740b2ae0 msgr2=0x7f16741fb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f166be00640 1 --2- 172.21.15.31:0/333848411 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16740b2ae0 0x7f16741fb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f166be00640 1 -- 172.21.15.31:0/333848411 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f167415f290 con 0x7f16740b4120 2024-09-17T05:36:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f1673400640 1 --2- 172.21.15.31:0/333848411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16580039f0 0x7f167415a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f166be00640 1 --2- 172.21.15.31:0/333848411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16740b4120 0x7f16740b25a0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f165c004e60 tx=0x7f165c001720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f166b400640 1 -- 172.21.15.31:0/333848411 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c0107d0 con 0x7f16740b4120 2024-09-17T05:36:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f166b400640 1 -- 172.21.15.31:0/333848411 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f165c016070 con 0x7f16740b4120 2024-09-17T05:36:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f167a000640 1 -- 172.21.15.31:0/333848411 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f167415f570 con 0x7f16740b4120 2024-09-17T05:36:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f166b400640 1 -- 172.21.15.31:0/333848411 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c010d40 con 0x7f16740b4120 2024-09-17T05:36:15.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f167a000640 1 -- 172.21.15.31:0/333848411 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16741fb000 con 0x7f16740b4120 2024-09-17T05:36:15.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.449+0000 7f167a000640 1 -- 172.21.15.31:0/333848411 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16740ae9b0 con 0x7f16740b4120 2024-09-17T05:36:15.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.453+0000 7f166b400640 1 -- 172.21.15.31:0/333848411 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f165c01b460 con 0x7f16740b4120 2024-09-17T05:36:15.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.453+0000 7f166b400640 1 --2- 172.21.15.31:0/333848411 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1650073aa0 0x7f1650075f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:15.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.453+0000 7f166b400640 1 -- 172.21.15.31:0/333848411 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 4885+0+0 (secure 0 0 0) 0x7f165c095a30 con 0x7f16740b4120 2024-09-17T05:36:15.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.453+0000 7f1673400640 1 --2- 172.21.15.31:0/333848411 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1650073aa0 0x7f1650075f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:15.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.453+0000 7f1673400640 1 --2- 172.21.15.31:0/333848411 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1650073aa0 0x7f1650075f60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1664001ec0 tx=0x7f16640af040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:15.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.457+0000 7f166b400640 1 -- 172.21.15.31:0/333848411 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f165c05fde0 con 0x7f16740b4120 2024-09-17T05:36:15.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.633+0000 7f167a000640 1 -- 172.21.15.31:0/333848411 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1674165890 con 0x7f16740b4120 2024-09-17T05:36:15.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.633+0000 7f166b400640 1 -- 172.21.15.31:0/333848411 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v148) ==== 84+0+65 (secure 0 0 0) 0x7f165c05f6e0 con 0x7f16740b4120 2024-09-17T05:36:15.635 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:15.635 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:36:15.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:15.635 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-09-17T05:36:15.635 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-09-17T05:36:15.635 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:15.635 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:36:15.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.637+0000 7f167a000640 1 -- 172.21.15.31:0/333848411 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1650073aa0 msgr2=0x7f1650075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:15.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.637+0000 7f167a000640 1 --2- 172.21.15.31:0/333848411 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1650073aa0 0x7f1650075f60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1664001ec0 tx=0x7f16640af040 comp rx=0 tx=0).stop 2024-09-17T05:36:15.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.637+0000 7f167a000640 1 -- 172.21.15.31:0/333848411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16740b4120 msgr2=0x7f16740b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:15.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.637+0000 7f167a000640 1 --2- 172.21.15.31:0/333848411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16740b4120 0x7f16740b25a0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f165c004e60 tx=0x7f165c001720 comp rx=0 tx=0).stop 2024-09-17T05:36:15.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.637+0000 7f167a000640 1 -- 172.21.15.31:0/333848411 shutdown_connections 2024-09-17T05:36:15.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.637+0000 7f167a000640 1 --2- 172.21.15.31:0/333848411 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1650073aa0 0x7f1650075f60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.637+0000 7f167a000640 1 --2- 172.21.15.31:0/333848411 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16740b2ae0 0x7f16741fb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.637+0000 7f167a000640 1 --2- 172.21.15.31:0/333848411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16740b4120 0x7f16740b25a0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.637+0000 7f167a000640 1 --2- 172.21.15.31:0/333848411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16580039f0 0x7f167415a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.637+0000 7f167a000640 1 -- 172.21.15.31:0/333848411 >> 172.21.15.31:0/333848411 conn(0x7f16740d1dc0 msgr2=0x7f16740caea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:15.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.637+0000 7f167a000640 1 -- 172.21.15.31:0/333848411 shutdown_connections 2024-09-17T05:36:15.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.637+0000 7f167a000640 1 -- 172.21.15.31:0/333848411 wait complete. 2024-09-17T05:36:15.657 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:36:15.658 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:36:15.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.809+0000 7f288fe00640 1 -- 172.21.15.31:0/1087633815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28900cff00 msgr2=0x7f28900d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:15.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.809+0000 7f288fe00640 1 --2- 172.21.15.31:0/1087633815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28900cff00 0x7f28900d28c0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f289006dc00 tx=0x7f288001c890 comp rx=0 tx=0).stop 2024-09-17T05:36:15.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.809+0000 7f288fe00640 1 -- 172.21.15.31:0/1087633815 shutdown_connections 2024-09-17T05:36:15.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.809+0000 7f288fe00640 1 --2- 172.21.15.31:0/1087633815 >> v2:172.21.15.155:3300/0 conn(0x7f28900d02e0 0x7f28900d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.809+0000 7f288fe00640 1 --2- 172.21.15.31:0/1087633815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28900cff00 0x7f28900d28c0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.809+0000 7f288fe00640 1 -- 172.21.15.31:0/1087633815 >> 172.21.15.31:0/1087633815 conn(0x7f28900d1da0 msgr2=0x7f28900d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:15.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.809+0000 7f288fe00640 1 -- 172.21.15.31:0/1087633815 shutdown_connections 2024-09-17T05:36:15.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.809+0000 7f288fe00640 1 -- 172.21.15.31:0/1087633815 wait complete. 2024-09-17T05:36:15.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.809+0000 7f288fe00640 1 Processor -- start 2024-09-17T05:36:15.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.809+0000 7f288fe00640 1 -- start start 2024-09-17T05:36:15.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f288fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28900cff00 0x7f289015e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:15.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f288fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28900d02e0 0x7f28900b7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:15.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f288fe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f289015eff0 0x7f2890151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:15.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f288fe00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f28900b0ae0 con 0x7f28900d02e0 2024-09-17T05:36:15.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f288fe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f28900b0960 con 0x7f289015eff0 2024-09-17T05:36:15.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f288fe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f28900b0c60 con 0x7f28900cff00 2024-09-17T05:36:15.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f2887e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28900d02e0 0x7f28900b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:15.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f2887e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28900d02e0 0x7f28900b7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37236/0 (socket says 172.21.15.31:37236) 2024-09-17T05:36:15.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f2887e00640 1 -- 172.21.15.31:0/3607034290 learned_addr learned my addr 172.21.15.31:0/3607034290 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:15.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f288f400640 1 --2- 172.21.15.31:0/3607034290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f289015eff0 0x7f2890151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:15.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f288ea00640 1 --2- 172.21.15.31:0/3607034290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28900cff00 0x7f289015e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:15.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f2887e00640 1 -- 172.21.15.31:0/3607034290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28900cff00 msgr2=0x7f289015e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:15.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f2887e00640 1 --2- 172.21.15.31:0/3607034290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28900cff00 0x7f289015e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f2887e00640 1 -- 172.21.15.31:0/3607034290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f289015eff0 msgr2=0x7f2890151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:15.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f2887e00640 1 --2- 172.21.15.31:0/3607034290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f289015eff0 0x7f2890151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:15.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f2887e00640 1 -- 172.21.15.31:0/3607034290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28901f7f70 con 0x7f28900d02e0 2024-09-17T05:36:15.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f2887e00640 1 --2- 172.21.15.31:0/3607034290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28900d02e0 0x7f28900b7220 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f287800d950 tx=0x7f287800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:15.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f2886a00640 1 -- 172.21.15.31:0/3607034290 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2878017070 con 0x7f28900d02e0 2024-09-17T05:36:15.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f2886a00640 1 -- 172.21.15.31:0/3607034290 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2878009d20 con 0x7f28900d02e0 2024-09-17T05:36:15.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f2886a00640 1 -- 172.21.15.31:0/3607034290 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28780106c0 con 0x7f28900d02e0 2024-09-17T05:36:15.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f288fe00640 1 -- 172.21.15.31:0/3607034290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28901f73f0 con 0x7f28900d02e0 2024-09-17T05:36:15.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f288fe00640 1 -- 172.21.15.31:0/3607034290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28901f79b0 con 0x7f28900d02e0 2024-09-17T05:36:15.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.813+0000 7f288fe00640 1 -- 172.21.15.31:0/3607034290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28900d28c0 con 0x7f28900d02e0 2024-09-17T05:36:15.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.817+0000 7f2886a00640 1 -- 172.21.15.31:0/3607034290 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f2878010860 con 0x7f28900d02e0 2024-09-17T05:36:15.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.817+0000 7f2886a00640 1 --2- 172.21.15.31:0/3607034290 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f286c073aa0 0x7f286c075f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:15.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.817+0000 7f2886a00640 1 -- 172.21.15.31:0/3607034290 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 4885+0+0 (secure 0 0 0) 0x7f28780955c0 con 0x7f28900d02e0 2024-09-17T05:36:15.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.817+0000 7f288ea00640 1 --2- 172.21.15.31:0/3607034290 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f286c073aa0 0x7f286c075f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:15.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.817+0000 7f288ea00640 1 --2- 172.21.15.31:0/3607034290 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f286c073aa0 0x7f286c075f60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f28800af000 tx=0x7f288001b0d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:15.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:15.821+0000 7f2886a00640 1 -- 172.21.15.31:0/3607034290 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f287805f970 con 0x7f28900d02e0 2024-09-17T05:36:16.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:16.005+0000 7f288fe00640 1 -- 172.21.15.31:0/3607034290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2890070c20 con 0x7f28900d02e0 2024-09-17T05:36:16.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:16.869+0000 7f2886a00640 1 -- 172.21.15.31:0/3607034290 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v149) ==== 138+0+0 (secure 0 0 0) 0x7f287805f270 con 0x7f28900d02e0 2024-09-17T05:36:16.870 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-09-17T05:36:16.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:16.873+0000 7f288fe00640 1 -- 172.21.15.31:0/3607034290 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f286c073aa0 msgr2=0x7f286c075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:16.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:16.873+0000 7f288fe00640 1 --2- 172.21.15.31:0/3607034290 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f286c073aa0 0x7f286c075f60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f28800af000 tx=0x7f288001b0d0 comp rx=0 tx=0).stop 2024-09-17T05:36:16.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:16.873+0000 7f288fe00640 1 -- 172.21.15.31:0/3607034290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28900d02e0 msgr2=0x7f28900b7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:16.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:16.873+0000 7f288fe00640 1 --2- 172.21.15.31:0/3607034290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28900d02e0 0x7f28900b7220 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f287800d950 tx=0x7f287800de10 comp rx=0 tx=0).stop 2024-09-17T05:36:16.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:16.873+0000 7f288fe00640 1 -- 172.21.15.31:0/3607034290 shutdown_connections 2024-09-17T05:36:16.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:16.873+0000 7f288fe00640 1 --2- 172.21.15.31:0/3607034290 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f286c073aa0 0x7f286c075f60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:16.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:16.873+0000 7f288fe00640 1 --2- 172.21.15.31:0/3607034290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f289015eff0 0x7f2890151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:16.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:16.873+0000 7f288fe00640 1 --2- 172.21.15.31:0/3607034290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28900d02e0 0x7f28900b7220 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:16.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:16.873+0000 7f288fe00640 1 --2- 172.21.15.31:0/3607034290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f28900cff00 0x7f289015e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:16.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:16.873+0000 7f288fe00640 1 -- 172.21.15.31:0/3607034290 >> 172.21.15.31:0/3607034290 conn(0x7f28900d1da0 msgr2=0x7f289006dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:16.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:16.873+0000 7f288fe00640 1 -- 172.21.15.31:0/3607034290 shutdown_connections 2024-09-17T05:36:16.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:16.873+0000 7f288fe00640 1 -- 172.21.15.31:0/3607034290 wait complete. 2024-09-17T05:36:16.903 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:36:17.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.061+0000 7fd13d200640 1 -- 172.21.15.31:0/4154381957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd13815f340 msgr2=0x7fd1380b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:17.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.061+0000 7fd13d200640 1 --2- 172.21.15.31:0/4154381957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd13815f340 0x7fd1380b34a0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fd1380c57d0 tx=0x7fd12801c8c0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.061+0000 7fd13d200640 1 -- 172.21.15.31:0/4154381957 shutdown_connections 2024-09-17T05:36:17.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.061+0000 7fd13d200640 1 --2- 172.21.15.31:0/4154381957 >> v2:172.21.15.155:3300/0 conn(0x7fd1380b39e0 0x7fd1380b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.061+0000 7fd13d200640 1 --2- 172.21.15.31:0/4154381957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd13815f340 0x7fd1380b34a0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.061+0000 7fd13d200640 1 -- 172.21.15.31:0/4154381957 >> 172.21.15.31:0/4154381957 conn(0x7fd1380d1e00 msgr2=0x7fd1380d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:17.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.061+0000 7fd13d200640 1 -- 172.21.15.31:0/4154381957 shutdown_connections 2024-09-17T05:36:17.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.061+0000 7fd13d200640 1 -- 172.21.15.31:0/4154381957 wait complete. 2024-09-17T05:36:17.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.061+0000 7fd13d200640 1 Processor -- start 2024-09-17T05:36:17.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.061+0000 7fd13d200640 1 -- start start 2024-09-17T05:36:17.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.061+0000 7fd13d200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1380b2a00 0x7fd1381fbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:17.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.061+0000 7fd13d200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1380b39e0 0x7fd1380af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:17.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.061+0000 7fd13d200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd13815f340 0x7fd138156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.061+0000 7fd13d200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd138168cd0 con 0x7fd1380b39e0 2024-09-17T05:36:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.061+0000 7fd13d200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd138168b50 con 0x7fd1380b2a00 2024-09-17T05:36:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.061+0000 7fd13d200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd138168e50 con 0x7fd13815f340 2024-09-17T05:36:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.065+0000 7fd12fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1380b39e0 0x7fd1380af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.065+0000 7fd12fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1380b39e0 0x7fd1380af2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37254/0 (socket says 172.21.15.31:37254) 2024-09-17T05:36:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.065+0000 7fd12fe00640 1 -- 172.21.15.31:0/3974950194 learned_addr learned my addr 172.21.15.31:0/3974950194 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.065+0000 7fd135e00640 1 --2- 172.21.15.31:0/3974950194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1380b2a00 0x7fd1381fbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.065+0000 7fd136800640 1 --2- 172.21.15.31:0/3974950194 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd13815f340 0x7fd138156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.065+0000 7fd12fe00640 1 -- 172.21.15.31:0/3974950194 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd13815f340 msgr2=0x7fd138156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.065+0000 7fd12fe00640 1 --2- 172.21.15.31:0/3974950194 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd13815f340 0x7fd138156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.065+0000 7fd12fe00640 1 -- 172.21.15.31:0/3974950194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1380b2a00 msgr2=0x7fd1381fbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:17.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.065+0000 7fd12fe00640 1 --2- 172.21.15.31:0/3974950194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1380b2a00 0x7fd1381fbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.065+0000 7fd12fe00640 1 -- 172.21.15.31:0/3974950194 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1380c55c0 con 0x7fd1380b39e0 2024-09-17T05:36:17.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.065+0000 7fd12fe00640 1 --2- 172.21.15.31:0/3974950194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1380b39e0 0x7fd1380af2b0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fd12000c500 tx=0x7fd12000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:17.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.065+0000 7fd12e000640 1 -- 172.21.15.31:0/3974950194 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120017070 con 0x7fd1380b39e0 2024-09-17T05:36:17.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.065+0000 7fd12e000640 1 -- 172.21.15.31:0/3974950194 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd1200053c0 con 0x7fd1380b39e0 2024-09-17T05:36:17.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.065+0000 7fd12e000640 1 -- 172.21.15.31:0/3974950194 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd120012890 con 0x7fd1380b39e0 2024-09-17T05:36:17.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.065+0000 7fd13d200640 1 -- 172.21.15.31:0/3974950194 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd13815bbe0 con 0x7fd1380b39e0 2024-09-17T05:36:17.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.065+0000 7fd13d200640 1 -- 172.21.15.31:0/3974950194 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd13815c160 con 0x7fd1380b39e0 2024-09-17T05:36:17.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.065+0000 7fd13d200640 1 -- 172.21.15.31:0/3974950194 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1380b34a0 con 0x7fd1380b39e0 2024-09-17T05:36:17.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.065+0000 7fd12e000640 1 -- 172.21.15.31:0/3974950194 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7fd12001a070 con 0x7fd1380b39e0 2024-09-17T05:36:17.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.069+0000 7fd12e000640 1 --2- 172.21.15.31:0/3974950194 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd114073a70 0x7fd114075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:17.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.069+0000 7fd12e000640 1 -- 172.21.15.31:0/3974950194 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5255+0+0 (secure 0 0 0) 0x7fd120094710 con 0x7fd1380b39e0 2024-09-17T05:36:17.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.069+0000 7fd135e00640 1 --2- 172.21.15.31:0/3974950194 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd114073a70 0x7fd114075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:17.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.069+0000 7fd135e00640 1 --2- 172.21.15.31:0/3974950194 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd114073a70 0x7fd114075f30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd1280af000 tx=0x7fd1280a7040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:17.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.069+0000 7fd12e000640 1 -- 172.21.15.31:0/3974950194 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd120021080 con 0x7fd1380b39e0 2024-09-17T05:36:17.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.245+0000 7fd13d200640 1 -- 172.21.15.31:0/3974950194 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd13806ac10 con 0x7fd1380b39e0 2024-09-17T05:36:17.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.869+0000 7fd12e000640 1 -- 172.21.15.31:0/3974950194 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v150) ==== 170+0+0 (secure 0 0 0) 0x7fd1380d2c90 con 0x7fd1380b39e0 2024-09-17T05:36:17.873 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-09-17T05:36:17.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.873+0000 7fd13d200640 1 -- 172.21.15.31:0/3974950194 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd114073a70 msgr2=0x7fd114075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:17.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.873+0000 7fd13d200640 1 --2- 172.21.15.31:0/3974950194 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd114073a70 0x7fd114075f30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd1280af000 tx=0x7fd1280a7040 comp rx=0 tx=0).stop 2024-09-17T05:36:17.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.873+0000 7fd13d200640 1 -- 172.21.15.31:0/3974950194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1380b39e0 msgr2=0x7fd1380af2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:17.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.873+0000 7fd13d200640 1 --2- 172.21.15.31:0/3974950194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1380b39e0 0x7fd1380af2b0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fd12000c500 tx=0x7fd12000c9c0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.873+0000 7fd13d200640 1 -- 172.21.15.31:0/3974950194 shutdown_connections 2024-09-17T05:36:17.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.873+0000 7fd13d200640 1 --2- 172.21.15.31:0/3974950194 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd114073a70 0x7fd114075f30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.873+0000 7fd13d200640 1 --2- 172.21.15.31:0/3974950194 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd13815f340 0x7fd138156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.873+0000 7fd13d200640 1 --2- 172.21.15.31:0/3974950194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1380b39e0 0x7fd1380af2b0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.873+0000 7fd13d200640 1 --2- 172.21.15.31:0/3974950194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1380b2a00 0x7fd1381fbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.873+0000 7fd13d200640 1 -- 172.21.15.31:0/3974950194 >> 172.21.15.31:0/3974950194 conn(0x7fd1380d1e00 msgr2=0x7fd13815a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.873+0000 7fd13d200640 1 -- 172.21.15.31:0/3974950194 shutdown_connections 2024-09-17T05:36:17.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:17.873+0000 7fd13d200640 1 -- 172.21.15.31:0/3974950194 wait complete. 2024-09-17T05:36:17.917 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:36:18.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.069+0000 7ff97bc00640 1 -- 172.21.15.31:0/3679218881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9740cff20 msgr2=0x7ff9740d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:18.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.069+0000 7ff97bc00640 1 --2- 172.21.15.31:0/3679218881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9740cff20 0x7ff9740d0300 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff968009840 tx=0x7ff96801f010 comp rx=0 tx=0).stop 2024-09-17T05:36:18.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.069+0000 7ff97bc00640 1 -- 172.21.15.31:0/3679218881 shutdown_connections 2024-09-17T05:36:18.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.069+0000 7ff97bc00640 1 --2- 172.21.15.31:0/3679218881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9740cff20 0x7ff9740d0300 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:18.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.069+0000 7ff97bc00640 1 -- 172.21.15.31:0/3679218881 >> 172.21.15.31:0/3679218881 conn(0x7ff9740d1dc0 msgr2=0x7ff9740d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:18.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.069+0000 7ff97bc00640 1 -- 172.21.15.31:0/3679218881 shutdown_connections 2024-09-17T05:36:18.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.069+0000 7ff97bc00640 1 -- 172.21.15.31:0/3679218881 wait complete. 2024-09-17T05:36:18.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.069+0000 7ff97bc00640 1 Processor -- start 2024-09-17T05:36:18.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.069+0000 7ff97bc00640 1 -- start start 2024-09-17T05:36:18.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff97bc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9740b2d80 0x7ff97414f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:18.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff97bc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9740cff20 0x7ff974159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:18.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff97bc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9740d0840 0x7ff974159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:18.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff97bc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff9741671c0 con 0x7ff9740cff20 2024-09-17T05:36:18.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff97bc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff974167040 con 0x7ff9740d0840 2024-09-17T05:36:18.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff97bc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff974167340 con 0x7ff9740b2d80 2024-09-17T05:36:18.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff973e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9740cff20 0x7ff974159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:18.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff973e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9740cff20 0x7ff974159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37260/0 (socket says 172.21.15.31:37260) 2024-09-17T05:36:18.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff973e00640 1 -- 172.21.15.31:0/1302064988 learned_addr learned my addr 172.21.15.31:0/1302064988 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:18.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff979200640 1 --2- 172.21.15.31:0/1302064988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9740b2d80 0x7ff97414f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:18.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff979c00640 1 --2- 172.21.15.31:0/1302064988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9740d0840 0x7ff974159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:18.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff973e00640 1 -- 172.21.15.31:0/1302064988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9740b2d80 msgr2=0x7ff97414f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:18.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff973e00640 1 --2- 172.21.15.31:0/1302064988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9740b2d80 0x7ff97414f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:18.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff973e00640 1 -- 172.21.15.31:0/1302064988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9740d0840 msgr2=0x7ff974159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:18.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff973e00640 1 --2- 172.21.15.31:0/1302064988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9740d0840 0x7ff974159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:18.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff973e00640 1 -- 172.21.15.31:0/1302064988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97414f760 con 0x7ff9740cff20 2024-09-17T05:36:18.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff973e00640 1 --2- 172.21.15.31:0/1302064988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9740cff20 0x7ff974159890 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7ff96000c4e0 tx=0x7ff96000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:18.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff970c00640 1 -- 172.21.15.31:0/1302064988 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9600052d0 con 0x7ff9740cff20 2024-09-17T05:36:18.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff970c00640 1 -- 172.21.15.31:0/1302064988 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff960005470 con 0x7ff9740cff20 2024-09-17T05:36:18.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff97bc00640 1 -- 172.21.15.31:0/1302064988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9740cd280 con 0x7ff9740cff20 2024-09-17T05:36:18.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff970c00640 1 -- 172.21.15.31:0/1302064988 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff960012890 con 0x7ff9740cff20 2024-09-17T05:36:18.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff97bc00640 1 -- 172.21.15.31:0/1302064988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9740cd840 con 0x7ff9740cff20 2024-09-17T05:36:18.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.073+0000 7ff97bc00640 1 -- 172.21.15.31:0/1302064988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9740d0300 con 0x7ff9740cff20 2024-09-17T05:36:18.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.077+0000 7ff970c00640 1 -- 172.21.15.31:0/1302064988 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7ff960003600 con 0x7ff9740cff20 2024-09-17T05:36:18.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.077+0000 7ff970c00640 1 --2- 172.21.15.31:0/1302064988 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff954073a70 0x7ff954075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.077+0000 7ff970c00640 1 -- 172.21.15.31:0/1302064988 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5637+0+0 (secure 0 0 0) 0x7ff960095a30 con 0x7ff9740cff20 2024-09-17T05:36:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.077+0000 7ff979200640 1 --2- 172.21.15.31:0/1302064988 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff954073a70 0x7ff954075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:18.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.077+0000 7ff979200640 1 --2- 172.21.15.31:0/1302064988 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff954073a70 0x7ff954075f30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff9680b2000 tx=0x7ff96801d850 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:18.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.081+0000 7ff970c00640 1 -- 172.21.15.31:0/1302064988 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff96005fc00 con 0x7ff9740cff20 2024-09-17T05:36:18.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.292+0000 7ff97bc00640 1 -- 172.21.15.31:0/1302064988 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff9740aff20 con 0x7ff9740cff20 2024-09-17T05:36:18.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.884+0000 7ff970c00640 1 -- 172.21.15.31:0/1302064988 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v106) ==== 174+0+0 (secure 0 0 0) 0x7ff96005f500 con 0x7ff9740cff20 2024-09-17T05:36:18.889 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 24 and data pool 25 2024-09-17T05:36:18.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.888+0000 7ff97bc00640 1 -- 172.21.15.31:0/1302064988 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff954073a70 msgr2=0x7ff954075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:18.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.888+0000 7ff97bc00640 1 --2- 172.21.15.31:0/1302064988 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff954073a70 0x7ff954075f30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff9680b2000 tx=0x7ff96801d850 comp rx=0 tx=0).stop 2024-09-17T05:36:18.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.888+0000 7ff97bc00640 1 -- 172.21.15.31:0/1302064988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9740cff20 msgr2=0x7ff974159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:18.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.888+0000 7ff97bc00640 1 --2- 172.21.15.31:0/1302064988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9740cff20 0x7ff974159890 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7ff96000c4e0 tx=0x7ff96000c9a0 comp rx=0 tx=0).stop 2024-09-17T05:36:18.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.888+0000 7ff97bc00640 1 -- 172.21.15.31:0/1302064988 shutdown_connections 2024-09-17T05:36:18.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.888+0000 7ff97bc00640 1 --2- 172.21.15.31:0/1302064988 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff954073a70 0x7ff954075f30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:18.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.888+0000 7ff97bc00640 1 --2- 172.21.15.31:0/1302064988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9740d0840 0x7ff974159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:18.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.888+0000 7ff97bc00640 1 --2- 172.21.15.31:0/1302064988 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff9740cff20 0x7ff974159890 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:18.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.888+0000 7ff97bc00640 1 --2- 172.21.15.31:0/1302064988 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9740b2d80 0x7ff97414f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:18.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.888+0000 7ff97bc00640 1 -- 172.21.15.31:0/1302064988 >> 172.21.15.31:0/1302064988 conn(0x7ff9740d1dc0 msgr2=0x7ff9740d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:18.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.888+0000 7ff97bc00640 1 -- 172.21.15.31:0/1302064988 shutdown_connections 2024-09-17T05:36:18.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:18.892+0000 7ff97bc00640 1 -- 172.21.15.31:0/1302064988 wait complete. 2024-09-17T05:36:18.946 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:19.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.092+0000 7f0e6a800640 1 -- 172.21.15.31:0/4033986831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e640d28e0 msgr2=0x7f0e640cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:19.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.092+0000 7f0e6a800640 1 --2- 172.21.15.31:0/4033986831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e640d28e0 0x7f0e640cebb0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f0e640745d0 tx=0x7f0e5c01ccf0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.092+0000 7f0e6a800640 1 -- 172.21.15.31:0/4033986831 shutdown_connections 2024-09-17T05:36:19.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.092+0000 7f0e6a800640 1 --2- 172.21.15.31:0/4033986831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e640d28e0 0x7f0e640cebb0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.092+0000 7f0e6a800640 1 --2- 172.21.15.31:0/4033986831 >> v2:172.21.15.155:3300/0 conn(0x7f0e6415bea0 0x7f0e640ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.092+0000 7f0e6a800640 1 -- 172.21.15.31:0/4033986831 >> 172.21.15.31:0/4033986831 conn(0x7f0e640d1dc0 msgr2=0x7f0e640d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:19.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.092+0000 7f0e6a800640 1 -- 172.21.15.31:0/4033986831 shutdown_connections 2024-09-17T05:36:19.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.092+0000 7f0e6a800640 1 -- 172.21.15.31:0/4033986831 wait complete. 2024-09-17T05:36:19.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e6a800640 1 Processor -- start 2024-09-17T05:36:19.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e6a800640 1 -- start start 2024-09-17T05:36:19.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e6a800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e640cdb30 0x7f0e64158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:19.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e6a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e640d28e0 0x7f0e64158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:19.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e6a800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e6415bea0 0x7f0e640c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:19.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e6a800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0e64168f10 con 0x7f0e640d28e0 2024-09-17T05:36:19.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e6a800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0e64168d90 con 0x7f0e640cdb30 2024-09-17T05:36:19.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e6a800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0e64169090 con 0x7f0e6415bea0 2024-09-17T05:36:19.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e5be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e640d28e0 0x7f0e64158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:19.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e5be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e640d28e0 0x7f0e64158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34590/0 (socket says 172.21.15.31:34590) 2024-09-17T05:36:19.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e5be00640 1 -- 172.21.15.31:0/2316256328 learned_addr learned my addr 172.21.15.31:0/2316256328 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:19.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e63400640 1 --2- 172.21.15.31:0/2316256328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e640cdb30 0x7f0e64158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:19.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e63e00640 1 --2- 172.21.15.31:0/2316256328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e6415bea0 0x7f0e640c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:19.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e5be00640 1 -- 172.21.15.31:0/2316256328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e6415bea0 msgr2=0x7f0e640c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:19.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e5be00640 1 --2- 172.21.15.31:0/2316256328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e6415bea0 0x7f0e640c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e5be00640 1 -- 172.21.15.31:0/2316256328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e640cdb30 msgr2=0x7f0e64158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e5be00640 1 --2- 172.21.15.31:0/2316256328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e640cdb30 0x7f0e64158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e5be00640 1 -- 172.21.15.31:0/2316256328 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e64158c80 con 0x7f0e640d28e0 2024-09-17T05:36:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e5be00640 1 --2- 172.21.15.31:0/2316256328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e640d28e0 0x7f0e64158320 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00c500 tx=0x7f0e4c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e5b400640 1 -- 172.21.15.31:0/2316256328 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c017070 con 0x7f0e640d28e0 2024-09-17T05:36:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e5b400640 1 -- 172.21.15.31:0/2316256328 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e4c003600 con 0x7f0e640d28e0 2024-09-17T05:36:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e6a800640 1 -- 172.21.15.31:0/2316256328 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e640b1e10 con 0x7f0e640d28e0 2024-09-17T05:36:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e5b400640 1 -- 172.21.15.31:0/2316256328 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c003a50 con 0x7f0e640d28e0 2024-09-17T05:36:19.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e6a800640 1 -- 172.21.15.31:0/2316256328 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e64159680 con 0x7f0e640d28e0 2024-09-17T05:36:19.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.096+0000 7f0e6a800640 1 -- 172.21.15.31:0/2316256328 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e640cc9d0 con 0x7f0e640d28e0 2024-09-17T05:36:19.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.100+0000 7f0e5b400640 1 -- 172.21.15.31:0/2316256328 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f0e4c01a070 con 0x7f0e640d28e0 2024-09-17T05:36:19.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.100+0000 7f0e5b400640 1 --2- 172.21.15.31:0/2316256328 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0e40073a70 0x7f0e40075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:19.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.100+0000 7f0e5b400640 1 -- 172.21.15.31:0/2316256328 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5737+0+0 (secure 0 0 0) 0x7f0e4c094870 con 0x7f0e640d28e0 2024-09-17T05:36:19.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.100+0000 7f0e63400640 1 --2- 172.21.15.31:0/2316256328 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0e40073a70 0x7f0e40075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:19.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.100+0000 7f0e63400640 1 --2- 172.21.15.31:0/2316256328 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0e40073a70 0x7f0e40075f30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0e640b6e80 tx=0x7f0e5400b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:19.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.104+0000 7f0e5b400640 1 -- 172.21.15.31:0/2316256328 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0e4c05e3d0 con 0x7f0e640d28e0 2024-09-17T05:36:19.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.280+0000 7f0e6a800640 1 -- 172.21.15.31:0/2316256328 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e640ca570 con 0x7f0e640d28e0 2024-09-17T05:36:19.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.280+0000 7f0e5b400640 1 -- 172.21.15.31:0/2316256328 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) ==== 74+0+16820 (secure 0 0 0) 0x7f0e4c062e00 con 0x7f0e640d28e0 2024-09-17T05:36:19.283 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:19.284 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":151,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:36:18.297482+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:16.018805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:17.260510+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:19.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.284+0000 7f0e6a800640 1 -- 172.21.15.31:0/2316256328 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0e40073a70 msgr2=0x7f0e40075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:19.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.284+0000 7f0e6a800640 1 --2- 172.21.15.31:0/2316256328 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0e40073a70 0x7f0e40075f30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0e640b6e80 tx=0x7f0e5400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.284+0000 7f0e6a800640 1 -- 172.21.15.31:0/2316256328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e640d28e0 msgr2=0x7f0e64158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:19.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.284+0000 7f0e6a800640 1 --2- 172.21.15.31:0/2316256328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e640d28e0 0x7f0e64158320 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00c500 tx=0x7f0e4c00c9c0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.284+0000 7f0e6a800640 1 -- 172.21.15.31:0/2316256328 shutdown_connections 2024-09-17T05:36:19.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.284+0000 7f0e6a800640 1 --2- 172.21.15.31:0/2316256328 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0e40073a70 0x7f0e40075f30 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.284+0000 7f0e6a800640 1 --2- 172.21.15.31:0/2316256328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e6415bea0 0x7f0e640c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.284+0000 7f0e6a800640 1 --2- 172.21.15.31:0/2316256328 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e640d28e0 0x7f0e64158320 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.284+0000 7f0e6a800640 1 --2- 172.21.15.31:0/2316256328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e640cdb30 0x7f0e64158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.284+0000 7f0e6a800640 1 -- 172.21.15.31:0/2316256328 >> 172.21.15.31:0/2316256328 conn(0x7f0e640d1dc0 msgr2=0x7f0e640d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:19.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.284+0000 7f0e6a800640 1 -- 172.21.15.31:0/2316256328 shutdown_connections 2024-09-17T05:36:19.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.284+0000 7f0e6a800640 1 -- 172.21.15.31:0/2316256328 wait complete. 2024-09-17T05:36:19.305 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:19.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.448+0000 7f8bda200640 1 -- 172.21.15.31:0/3470613048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd415bea0 msgr2=0x7f8bd40ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:19.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.448+0000 7f8bda200640 1 --2- 172.21.15.31:0/3470613048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd415bea0 0x7f8bd40ce670 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009840 tx=0x7f8bc401c740 comp rx=0 tx=0).stop 2024-09-17T05:36:19.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.448+0000 7f8bda200640 1 -- 172.21.15.31:0/3470613048 shutdown_connections 2024-09-17T05:36:19.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.448+0000 7f8bda200640 1 --2- 172.21.15.31:0/3470613048 >> v2:172.21.15.155:3300/0 conn(0x7f8bd40cdb30 0x7f8bd40cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.448+0000 7f8bda200640 1 --2- 172.21.15.31:0/3470613048 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd415bea0 0x7f8bd40ce670 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.448+0000 7f8bda200640 1 -- 172.21.15.31:0/3470613048 >> 172.21.15.31:0/3470613048 conn(0x7f8bd40d1dc0 msgr2=0x7f8bd40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:19.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.448+0000 7f8bda200640 1 -- 172.21.15.31:0/3470613048 shutdown_connections 2024-09-17T05:36:19.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.448+0000 7f8bda200640 1 -- 172.21.15.31:0/3470613048 wait complete. 2024-09-17T05:36:19.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bda200640 1 Processor -- start 2024-09-17T05:36:19.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bda200640 1 -- start start 2024-09-17T05:36:19.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bda200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bd40cdb30 0x7f8bd409c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:19.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bda200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd40d28e0 0x7f8bd409d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:19.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bda200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bd415bea0 0x7f8bd414a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:19.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bda200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd4168fc0 con 0x7f8bd40cdb30 2024-09-17T05:36:19.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bda200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd4168e40 con 0x7f8bd415bea0 2024-09-17T05:36:19.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bda200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd4169140 con 0x7f8bd40d28e0 2024-09-17T05:36:19.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bd3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bd40cdb30 0x7f8bd409c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:19.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bd3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bd40cdb30 0x7f8bd409c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34598/0 (socket says 172.21.15.31:34598) 2024-09-17T05:36:19.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bd3400640 1 -- 172.21.15.31:0/603577030 learned_addr learned my addr 172.21.15.31:0/603577030 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:19.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bcbe00640 1 --2- 172.21.15.31:0/603577030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd40d28e0 0x7f8bd409d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:19.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bd3400640 1 -- 172.21.15.31:0/603577030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd40d28e0 msgr2=0x7f8bd409d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:19.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bd3400640 1 --2- 172.21.15.31:0/603577030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd40d28e0 0x7f8bd409d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bd3400640 1 -- 172.21.15.31:0/603577030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bd415bea0 msgr2=0x7f8bd414a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:19.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bd3e00640 1 --2- 172.21.15.31:0/603577030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bd415bea0 0x7f8bd414a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:19.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bd3400640 1 --2- 172.21.15.31:0/603577030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bd415bea0 0x7f8bd414a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bd3400640 1 -- 172.21.15.31:0/603577030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd409ccf0 con 0x7f8bd40cdb30 2024-09-17T05:36:19.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bcbe00640 1 --2- 172.21.15.31:0/603577030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd40d28e0 0x7f8bd409d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:19.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bd3e00640 1 --2- 172.21.15.31:0/603577030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bd415bea0 0x7f8bd414a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:19.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bd3400640 1 --2- 172.21.15.31:0/603577030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bd40cdb30 0x7f8bd409c7b0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009790 tx=0x7f8bc40056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:19.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bcb400640 1 -- 172.21.15.31:0/603577030 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40ac050 con 0x7f8bd40cdb30 2024-09-17T05:36:19.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bcb400640 1 -- 172.21.15.31:0/603577030 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bc4004a40 con 0x7f8bd40cdb30 2024-09-17T05:36:19.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bcb400640 1 -- 172.21.15.31:0/603577030 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4004e50 con 0x7f8bd40cdb30 2024-09-17T05:36:19.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bda200640 1 -- 172.21.15.31:0/603577030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd409e0b0 con 0x7f8bd40cdb30 2024-09-17T05:36:19.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.452+0000 7f8bda200640 1 -- 172.21.15.31:0/603577030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd409bfb0 con 0x7f8bd40cdb30 2024-09-17T05:36:19.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.456+0000 7f8bda200640 1 -- 172.21.15.31:0/603577030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bd40cc9d0 con 0x7f8bd40cdb30 2024-09-17T05:36:19.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.456+0000 7f8bcb400640 1 -- 172.21.15.31:0/603577030 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f8bc40af070 con 0x7f8bd40cdb30 2024-09-17T05:36:19.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.456+0000 7f8bcb400640 1 --2- 172.21.15.31:0/603577030 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8bb0073c10 0x7f8bb00760d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:19.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.456+0000 7f8bcb400640 1 -- 172.21.15.31:0/603577030 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5737+0+0 (secure 0 0 0) 0x7f8bc412f200 con 0x7f8bd40cdb30 2024-09-17T05:36:19.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.456+0000 7f8bcbe00640 1 --2- 172.21.15.31:0/603577030 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8bb0073c10 0x7f8bb00760d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:19.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.456+0000 7f8bcbe00640 1 --2- 172.21.15.31:0/603577030 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8bb0073c10 0x7f8bb00760d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40c8a90 tx=0x7f8bbc0091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:19.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.460+0000 7f8bcb400640 1 -- 172.21.15.31:0/603577030 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f8bc40c2030 con 0x7f8bd40cdb30 2024-09-17T05:36:19.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.636+0000 7f8bda200640 1 -- 172.21.15.31:0/603577030 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8bd40b5070 con 0x7f8bd40cdb30 2024-09-17T05:36:19.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.640+0000 7f8bcb400640 1 -- 172.21.15.31:0/603577030 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) ==== 74+0+16820 (secure 0 0 0) 0x7f8bc4016330 con 0x7f8bd40cdb30 2024-09-17T05:36:19.642 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:19.642 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":151,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:36:18.297482+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:16.018805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:17.260510+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:19.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.640+0000 7f8bda200640 1 -- 172.21.15.31:0/603577030 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8bb0073c10 msgr2=0x7f8bb00760d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:19.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.640+0000 7f8bda200640 1 --2- 172.21.15.31:0/603577030 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8bb0073c10 0x7f8bb00760d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8bd40c8a90 tx=0x7f8bbc0091e0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.640+0000 7f8bda200640 1 -- 172.21.15.31:0/603577030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bd40cdb30 msgr2=0x7f8bd409c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:19.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.640+0000 7f8bda200640 1 --2- 172.21.15.31:0/603577030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bd40cdb30 0x7f8bd409c7b0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009790 tx=0x7f8bc40056e0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.640+0000 7f8bda200640 1 -- 172.21.15.31:0/603577030 shutdown_connections 2024-09-17T05:36:19.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.640+0000 7f8bda200640 1 --2- 172.21.15.31:0/603577030 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8bb0073c10 0x7f8bb00760d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.640+0000 7f8bda200640 1 --2- 172.21.15.31:0/603577030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bd415bea0 0x7f8bd414a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.640+0000 7f8bda200640 1 --2- 172.21.15.31:0/603577030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bd40d28e0 0x7f8bd409d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.640+0000 7f8bda200640 1 --2- 172.21.15.31:0/603577030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8bd40cdb30 0x7f8bd409c7b0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.640+0000 7f8bda200640 1 -- 172.21.15.31:0/603577030 >> 172.21.15.31:0/603577030 conn(0x7f8bd40d1dc0 msgr2=0x7f8bd40caea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.640+0000 7f8bda200640 1 -- 172.21.15.31:0/603577030 shutdown_connections 2024-09-17T05:36:19.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.640+0000 7f8bda200640 1 -- 172.21.15.31:0/603577030 wait complete. 2024-09-17T05:36:19.665 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:36:19.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.812+0000 7f30f1c00640 1 -- 172.21.15.31:0/1882159622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30ec0b3320 msgr2=0x7f30ec0b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:19.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.812+0000 7f30f1c00640 1 --2- 172.21.15.31:0/1882159622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30ec0b3320 0x7f30ec0b3f00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009900 tx=0x7f30d801f0d0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.812+0000 7f30f1c00640 1 -- 172.21.15.31:0/1882159622 shutdown_connections 2024-09-17T05:36:19.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.812+0000 7f30f1c00640 1 --2- 172.21.15.31:0/1882159622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30ec0d00f0 0x7f30ec0ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.812+0000 7f30f1c00640 1 --2- 172.21.15.31:0/1882159622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30ec0b3320 0x7f30ec0b3f00 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.812+0000 7f30f1c00640 1 -- 172.21.15.31:0/1882159622 >> 172.21.15.31:0/1882159622 conn(0x7f30ec0d1d70 msgr2=0x7f30ec0d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:19.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.812+0000 7f30f1c00640 1 -- 172.21.15.31:0/1882159622 shutdown_connections 2024-09-17T05:36:19.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.812+0000 7f30f1c00640 1 -- 172.21.15.31:0/1882159622 wait complete. 2024-09-17T05:36:19.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30f1c00640 1 Processor -- start 2024-09-17T05:36:19.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30f1c00640 1 -- start start 2024-09-17T05:36:19.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30f1c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30ec0b3320 0x7f30ec158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:19.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30f1c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30ec0d00f0 0x7f30ec155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:19.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30f1c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30ec161710 0x7f30ec0c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:19.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30f1c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec0cd880 con 0x7f30ec0b3320 2024-09-17T05:36:19.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30f1c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec0cd700 con 0x7f30ec0d00f0 2024-09-17T05:36:19.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30f1c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f30ec0cda00 con 0x7f30ec161710 2024-09-17T05:36:19.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30eaa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30ec0b3320 0x7f30ec158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:19.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30eaa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30ec0b3320 0x7f30ec158fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34610/0 (socket says 172.21.15.31:34610) 2024-09-17T05:36:19.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30eaa00640 1 -- 172.21.15.31:0/627351717 learned_addr learned my addr 172.21.15.31:0/627351717 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:19.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30ea000640 1 --2- 172.21.15.31:0/627351717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30ec0d00f0 0x7f30ec155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:19.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30eb400640 1 --2- 172.21.15.31:0/627351717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30ec161710 0x7f30ec0c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:19.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30eaa00640 1 -- 172.21.15.31:0/627351717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30ec161710 msgr2=0x7f30ec0c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:19.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30eaa00640 1 --2- 172.21.15.31:0/627351717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30ec161710 0x7f30ec0c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30eaa00640 1 -- 172.21.15.31:0/627351717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30ec0d00f0 msgr2=0x7f30ec155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:19.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30eaa00640 1 --2- 172.21.15.31:0/627351717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30ec0d00f0 0x7f30ec155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:19.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30eaa00640 1 -- 172.21.15.31:0/627351717 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ec0b7ab0 con 0x7f30ec0b3320 2024-09-17T05:36:19.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30eb400640 1 --2- 172.21.15.31:0/627351717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30ec161710 0x7f30ec0c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:19.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30eaa00640 1 --2- 172.21.15.31:0/627351717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30ec0b3320 0x7f30ec158fa0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f30dc00c3c0 tx=0x7f30dc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:19.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30e2a00640 1 -- 172.21.15.31:0/627351717 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc017070 con 0x7f30ec0b3320 2024-09-17T05:36:19.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30e2a00640 1 -- 172.21.15.31:0/627351717 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30dc0053c0 con 0x7f30ec0b3320 2024-09-17T05:36:19.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30f1c00640 1 -- 172.21.15.31:0/627351717 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ec0c9ec0 con 0x7f30ec0b3320 2024-09-17T05:36:19.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30e2a00640 1 -- 172.21.15.31:0/627351717 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc003860 con 0x7f30ec0b3320 2024-09-17T05:36:19.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30f1c00640 1 -- 172.21.15.31:0/627351717 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ec0ca480 con 0x7f30ec0b3320 2024-09-17T05:36:19.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.816+0000 7f30f1c00640 1 -- 172.21.15.31:0/627351717 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30ec0cdf90 con 0x7f30ec0b3320 2024-09-17T05:36:19.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.820+0000 7f30e2a00640 1 -- 172.21.15.31:0/627351717 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f30dc01a070 con 0x7f30ec0b3320 2024-09-17T05:36:19.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.820+0000 7f30e2a00640 1 --2- 172.21.15.31:0/627351717 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f30cc073a70 0x7f30cc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:19.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.820+0000 7f30e2a00640 1 -- 172.21.15.31:0/627351717 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5737+0+0 (secure 0 0 0) 0x7f30dc0948c0 con 0x7f30ec0b3320 2024-09-17T05:36:19.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.820+0000 7f30ea000640 1 --2- 172.21.15.31:0/627351717 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f30cc073a70 0x7f30cc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:19.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.820+0000 7f30ea000640 1 --2- 172.21.15.31:0/627351717 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f30cc073a70 0x7f30cc075f30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f30d80b2000 tx=0x7f30d801d910 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:19.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:19.824+0000 7f30e2a00640 1 -- 172.21.15.31:0/627351717 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f30dc05e920 con 0x7f30ec0b3320 2024-09-17T05:36:20.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:20.040+0000 7f30f1c00640 1 -- 172.21.15.31:0/627351717 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f30ec0c8930 con 0x7f30ec0b3320 2024-09-17T05:36:20.869 INFO:tasks.ceph.mds.a.smithi031.stderr:2024-09-17T05:36:20.868+0000 7fec8a800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:36:20.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:20.912+0000 7f30e2a00640 1 -- 172.21.15.31:0/627351717 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v108) ==== 118+0+0 (secure 0 0 0) 0x7f30dc05e220 con 0x7f30ec0b3320 2024-09-17T05:36:20.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:20.912+0000 7f30f1c00640 1 -- 172.21.15.31:0/627351717 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f30cc073a70 msgr2=0x7f30cc075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:20.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:20.912+0000 7f30f1c00640 1 --2- 172.21.15.31:0/627351717 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f30cc073a70 0x7f30cc075f30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f30d80b2000 tx=0x7f30d801d910 comp rx=0 tx=0).stop 2024-09-17T05:36:20.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:20.912+0000 7f30f1c00640 1 -- 172.21.15.31:0/627351717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30ec0b3320 msgr2=0x7f30ec158fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:20.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:20.912+0000 7f30f1c00640 1 --2- 172.21.15.31:0/627351717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30ec0b3320 0x7f30ec158fa0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f30dc00c3c0 tx=0x7f30dc00c880 comp rx=0 tx=0).stop 2024-09-17T05:36:20.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:20.912+0000 7f30f1c00640 1 -- 172.21.15.31:0/627351717 shutdown_connections 2024-09-17T05:36:20.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:20.912+0000 7f30f1c00640 1 --2- 172.21.15.31:0/627351717 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f30cc073a70 0x7f30cc075f30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:20.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:20.912+0000 7f30f1c00640 1 --2- 172.21.15.31:0/627351717 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30ec161710 0x7f30ec0c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:20.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:20.912+0000 7f30f1c00640 1 --2- 172.21.15.31:0/627351717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30ec0d00f0 0x7f30ec155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:20.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:20.912+0000 7f30f1c00640 1 --2- 172.21.15.31:0/627351717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30ec0b3320 0x7f30ec158fa0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:20.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:20.912+0000 7f30f1c00640 1 -- 172.21.15.31:0/627351717 >> 172.21.15.31:0/627351717 conn(0x7f30ec0d1d70 msgr2=0x7f30ec15eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:20.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:20.912+0000 7f30f1c00640 1 -- 172.21.15.31:0/627351717 shutdown_connections 2024-09-17T05:36:20.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:20.912+0000 7f30f1c00640 1 -- 172.21.15.31:0/627351717 wait complete. 2024-09-17T05:36:20.939 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:36:20.939 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:36:21.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.092+0000 7f9b77800640 1 -- 172.21.15.31:0/4163851570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b7015c130 msgr2=0x7f9b700ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:21.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.092+0000 7f9b77800640 1 --2- 172.21.15.31:0/4163851570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b7015c130 0x7f9b700ceb20 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f9b700d0a60 tx=0x7f9b5c01c780 comp rx=0 tx=0).stop 2024-09-17T05:36:21.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.092+0000 7f9b77800640 1 -- 172.21.15.31:0/4163851570 shutdown_connections 2024-09-17T05:36:21.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.092+0000 7f9b77800640 1 --2- 172.21.15.31:0/4163851570 >> v2:172.21.15.155:3300/0 conn(0x7f9b700cf4e0 0x7f9b700c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.092+0000 7f9b77800640 1 --2- 172.21.15.31:0/4163851570 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b7015c130 0x7f9b700ceb20 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.092+0000 7f9b77800640 1 --2- 172.21.15.31:0/4163851570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b7015bd50 0x7f9b700ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.092+0000 7f9b77800640 1 -- 172.21.15.31:0/4163851570 >> 172.21.15.31:0/4163851570 conn(0x7f9b700d1ea0 msgr2=0x7f9b700d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:21.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.092+0000 7f9b77800640 1 -- 172.21.15.31:0/4163851570 shutdown_connections 2024-09-17T05:36:21.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.092+0000 7f9b77800640 1 -- 172.21.15.31:0/4163851570 wait complete. 2024-09-17T05:36:21.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.092+0000 7f9b77800640 1 Processor -- start 2024-09-17T05:36:21.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.092+0000 7f9b77800640 1 -- start start 2024-09-17T05:36:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b77800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b700cf4e0 0x7f9b701fa690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b77800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b7015bd50 0x7f9b70158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b77800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b7015c130 0x7f9b700cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:21.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b77800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9b700ccac0 con 0x7f9b7015c130 2024-09-17T05:36:21.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b77800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9b700cc940 con 0x7f9b7015bd50 2024-09-17T05:36:21.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b77800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9b700ccc40 con 0x7f9b700cf4e0 2024-09-17T05:36:21.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b75800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b7015c130 0x7f9b700cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:21.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b75800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b7015c130 0x7f9b700cb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34634/0 (socket says 172.21.15.31:34634) 2024-09-17T05:36:21.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b75800640 1 -- 172.21.15.31:0/3984288665 learned_addr learned my addr 172.21.15.31:0/3984288665 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:21.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b6fe00640 1 --2- 172.21.15.31:0/3984288665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b7015bd50 0x7f9b70158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:21.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b74e00640 1 --2- 172.21.15.31:0/3984288665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b700cf4e0 0x7f9b701fa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:21.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b75800640 1 -- 172.21.15.31:0/3984288665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b700cf4e0 msgr2=0x7f9b701fa690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:21.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b75800640 1 --2- 172.21.15.31:0/3984288665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b700cf4e0 0x7f9b701fa690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b75800640 1 -- 172.21.15.31:0/3984288665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b7015bd50 msgr2=0x7f9b70158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:21.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b75800640 1 --2- 172.21.15.31:0/3984288665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b7015bd50 0x7f9b70158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b75800640 1 -- 172.21.15.31:0/3984288665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b701528e0 con 0x7f9b7015c130 2024-09-17T05:36:21.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b6fe00640 1 --2- 172.21.15.31:0/3984288665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b7015bd50 0x7f9b70158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:21.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b75800640 1 --2- 172.21.15.31:0/3984288665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b7015c130 0x7f9b700cb2c0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f9b6800ccb0 tx=0x7f9b6800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:21.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b6cc00640 1 -- 172.21.15.31:0/3984288665 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6800f450 con 0x7f9b7015c130 2024-09-17T05:36:21.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b6cc00640 1 -- 172.21.15.31:0/3984288665 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b6800f700 con 0x7f9b7015c130 2024-09-17T05:36:21.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b6cc00640 1 -- 172.21.15.31:0/3984288665 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6800fb50 con 0x7f9b7015c130 2024-09-17T05:36:21.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b77800640 1 -- 172.21.15.31:0/3984288665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b701fad90 con 0x7f9b7015c130 2024-09-17T05:36:21.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b77800640 1 -- 172.21.15.31:0/3984288665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b701fb350 con 0x7f9b7015c130 2024-09-17T05:36:21.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b77800640 1 -- 172.21.15.31:0/3984288665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b700c5dd0 con 0x7f9b7015c130 2024-09-17T05:36:21.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.096+0000 7f9b6cc00640 1 -- 172.21.15.31:0/3984288665 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f9b6800fcf0 con 0x7f9b7015c130 2024-09-17T05:36:21.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.100+0000 7f9b6cc00640 1 --2- 172.21.15.31:0/3984288665 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9b50073aa0 0x7f9b50075f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:21.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.100+0000 7f9b6cc00640 1 -- 172.21.15.31:0/3984288665 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f9b68095ff0 con 0x7f9b7015c130 2024-09-17T05:36:21.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.100+0000 7f9b74e00640 1 --2- 172.21.15.31:0/3984288665 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9b50073aa0 0x7f9b50075f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:21.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.100+0000 7f9b74e00640 1 --2- 172.21.15.31:0/3984288665 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9b50073aa0 0x7f9b50075f60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9b64005fd0 tx=0x7f9b64005db0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:21.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.104+0000 7f9b6cc00640 1 -- 172.21.15.31:0/3984288665 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9b68014030 con 0x7f9b7015c130 2024-09-17T05:36:21.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.316+0000 7f9b77800640 1 -- 172.21.15.31:0/3984288665 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9b7015b380 con 0x7f9b7015c130 2024-09-17T05:36:21.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.916+0000 7f9b6cc00640 1 -- 172.21.15.31:0/3984288665 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v109) ==== 122+0+0 (secure 0 0 0) 0x7f9b68060050 con 0x7f9b7015c130 2024-09-17T05:36:21.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.916+0000 7f9b77800640 1 -- 172.21.15.31:0/3984288665 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9b50073aa0 msgr2=0x7f9b50075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:21.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.916+0000 7f9b77800640 1 --2- 172.21.15.31:0/3984288665 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9b50073aa0 0x7f9b50075f60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9b64005fd0 tx=0x7f9b64005db0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.916+0000 7f9b77800640 1 -- 172.21.15.31:0/3984288665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b7015c130 msgr2=0x7f9b700cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:21.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.916+0000 7f9b77800640 1 --2- 172.21.15.31:0/3984288665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b7015c130 0x7f9b700cb2c0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f9b6800ccb0 tx=0x7f9b6800a620 comp rx=0 tx=0).stop 2024-09-17T05:36:21.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.916+0000 7f9b77800640 1 -- 172.21.15.31:0/3984288665 shutdown_connections 2024-09-17T05:36:21.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.916+0000 7f9b77800640 1 --2- 172.21.15.31:0/3984288665 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9b50073aa0 0x7f9b50075f60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.916+0000 7f9b77800640 1 --2- 172.21.15.31:0/3984288665 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b7015c130 0x7f9b700cb2c0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.916+0000 7f9b77800640 1 --2- 172.21.15.31:0/3984288665 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b7015bd50 0x7f9b70158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.916+0000 7f9b77800640 1 --2- 172.21.15.31:0/3984288665 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b700cf4e0 0x7f9b701fa690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:21.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.916+0000 7f9b77800640 1 -- 172.21.15.31:0/3984288665 >> 172.21.15.31:0/3984288665 conn(0x7f9b700d1ea0 msgr2=0x7f9b70157c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:21.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.916+0000 7f9b77800640 1 -- 172.21.15.31:0/3984288665 shutdown_connections 2024-09-17T05:36:21.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:21.916+0000 7f9b77800640 1 -- 172.21.15.31:0/3984288665 wait complete. 2024-09-17T05:36:21.942 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:36:21.943 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:22.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.088+0000 7fd951800640 1 -- 172.21.15.31:0/336714660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd94c074330 msgr2=0x7fd94c06f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.088+0000 7fd951800640 1 --2- 172.21.15.31:0/336714660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd94c074330 0x7fd94c06f9a0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fd944009c80 tx=0x7fd94401cd70 comp rx=0 tx=0).stop 2024-09-17T05:36:22.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.088+0000 7fd951800640 1 -- 172.21.15.31:0/336714660 shutdown_connections 2024-09-17T05:36:22.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.088+0000 7fd951800640 1 --2- 172.21.15.31:0/336714660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd94c074330 0x7fd94c06f9a0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.088+0000 7fd951800640 1 --2- 172.21.15.31:0/336714660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd94c15af60 0x7fd94c0cffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.088+0000 7fd951800640 1 -- 172.21.15.31:0/336714660 >> 172.21.15.31:0/336714660 conn(0x7fd94c0d0c90 msgr2=0x7fd94c0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:22.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.088+0000 7fd951800640 1 -- 172.21.15.31:0/336714660 shutdown_connections 2024-09-17T05:36:22.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.088+0000 7fd951800640 1 -- 172.21.15.31:0/336714660 wait complete. 2024-09-17T05:36:22.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd951800640 1 Processor -- start 2024-09-17T05:36:22.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd951800640 1 -- start start 2024-09-17T05:36:22.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd951800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd94c0737c0 0x7fd94c0c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd951800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd94c074330 0x7fd94c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd951800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd94c15af60 0x7fd94c1fb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd951800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c167ab0 con 0x7fd94c0737c0 2024-09-17T05:36:22.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd951800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c167930 con 0x7fd94c074330 2024-09-17T05:36:22.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd951800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd94c167c30 con 0x7fd94c15af60 2024-09-17T05:36:22.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd94aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd94c0737c0 0x7fd94c0c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:22.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd94aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd94c0737c0 0x7fd94c0c9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34660/0 (socket says 172.21.15.31:34660) 2024-09-17T05:36:22.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd94aa00640 1 -- 172.21.15.31:0/1160804372 learned_addr learned my addr 172.21.15.31:0/1160804372 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:22.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd94aa00640 1 -- 172.21.15.31:0/1160804372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd94c15af60 msgr2=0x7fd94c1fb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd94aa00640 1 --2- 172.21.15.31:0/1160804372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd94c15af60 0x7fd94c1fb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd94aa00640 1 -- 172.21.15.31:0/1160804372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd94c074330 msgr2=0x7fd94c154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd94aa00640 1 --2- 172.21.15.31:0/1160804372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd94c074330 0x7fd94c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd94aa00640 1 -- 172.21.15.31:0/1160804372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94c0c9da0 con 0x7fd94c0737c0 2024-09-17T05:36:22.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd94aa00640 1 --2- 172.21.15.31:0/1160804372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd94c0737c0 0x7fd94c0c9710 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00d750 tx=0x7fd93c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:22.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd942a00640 1 -- 172.21.15.31:0/1160804372 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c017070 con 0x7fd94c0737c0 2024-09-17T05:36:22.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd942a00640 1 -- 172.21.15.31:0/1160804372 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd93c009d20 con 0x7fd94c0737c0 2024-09-17T05:36:22.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd942a00640 1 -- 172.21.15.31:0/1160804372 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c005280 con 0x7fd94c0737c0 2024-09-17T05:36:22.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd951800640 1 -- 172.21.15.31:0/1160804372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd94c154150 con 0x7fd94c0737c0 2024-09-17T05:36:22.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd951800640 1 -- 172.21.15.31:0/1160804372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd94c154710 con 0x7fd94c0737c0 2024-09-17T05:36:22.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.092+0000 7fd951800640 1 -- 172.21.15.31:0/1160804372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd94c06f9a0 con 0x7fd94c0737c0 2024-09-17T05:36:22.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.096+0000 7fd942a00640 1 -- 172.21.15.31:0/1160804372 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7fd93c005420 con 0x7fd94c0737c0 2024-09-17T05:36:22.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.096+0000 7fd942a00640 1 --2- 172.21.15.31:0/1160804372 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd928073a70 0x7fd928075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.096+0000 7fd942a00640 1 -- 172.21.15.31:0/1160804372 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fd93c095630 con 0x7fd94c0737c0 2024-09-17T05:36:22.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.096+0000 7fd943e00640 1 --2- 172.21.15.31:0/1160804372 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd928073a70 0x7fd928075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:22.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.096+0000 7fd943e00640 1 --2- 172.21.15.31:0/1160804372 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd928073a70 0x7fd928075f30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0b0190 tx=0x7fd9340079c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:22.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.100+0000 7fd942a00640 1 -- 172.21.15.31:0/1160804372 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd93c00de60 con 0x7fd94c0737c0 2024-09-17T05:36:22.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.312+0000 7fd951800640 1 -- 172.21.15.31:0/1160804372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd94c0d00c0 con 0x7fd94c0737c0 2024-09-17T05:36:22.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.312+0000 7fd942a00640 1 -- 172.21.15.31:0/1160804372 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+5236 (secure 0 0 0) 0x7fd93c05f690 con 0x7fd94c0737c0 2024-09-17T05:36:22.315 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:22.316 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":109,"btime":"2024-09-17T05:36:21:915529+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/188322131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":188322131},{"type":"v1","addr":"172.21.15.155:6834","nonce":188322131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2190232807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":2190232807},{"type":"v1","addr":"172.21.15.155:6835","nonce":2190232807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8724,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/2588830685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2588830685},{"type":"v1","addr":"172.21.15.31:6833","nonce":2588830685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:18.297448+0000","modified":"2024-09-17T05:36:21.321294+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8733":{"gid":8733,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/2117164749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2117164749},{"type":"v1","addr":"172.21.15.31:6835","nonce":2117164749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8733,"qdb_cluster":[8733]},"id":12}]} 2024-09-17T05:36:22.316 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 109 2024-09-17T05:36:22.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.316+0000 7fd951800640 1 -- 172.21.15.31:0/1160804372 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd928073a70 msgr2=0x7fd928075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.316+0000 7fd951800640 1 --2- 172.21.15.31:0/1160804372 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd928073a70 0x7fd928075f30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0b0190 tx=0x7fd9340079c0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.316+0000 7fd951800640 1 -- 172.21.15.31:0/1160804372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd94c0737c0 msgr2=0x7fd94c0c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.316+0000 7fd951800640 1 --2- 172.21.15.31:0/1160804372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd94c0737c0 0x7fd94c0c9710 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00d750 tx=0x7fd93c00dc10 comp rx=0 tx=0).stop 2024-09-17T05:36:22.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.316+0000 7fd951800640 1 -- 172.21.15.31:0/1160804372 shutdown_connections 2024-09-17T05:36:22.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.316+0000 7fd951800640 1 --2- 172.21.15.31:0/1160804372 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd928073a70 0x7fd928075f30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.316+0000 7fd951800640 1 --2- 172.21.15.31:0/1160804372 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd94c15af60 0x7fd94c1fb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.316+0000 7fd951800640 1 --2- 172.21.15.31:0/1160804372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd94c074330 0x7fd94c154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.316+0000 7fd951800640 1 --2- 172.21.15.31:0/1160804372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd94c0737c0 0x7fd94c0c9710 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.316+0000 7fd951800640 1 -- 172.21.15.31:0/1160804372 >> 172.21.15.31:0/1160804372 conn(0x7fd94c0d0c90 msgr2=0x7fd94c071cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:22.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.316+0000 7fd951800640 1 -- 172.21.15.31:0/1160804372 shutdown_connections 2024-09-17T05:36:22.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.316+0000 7fd951800640 1 -- 172.21.15.31:0/1160804372 wait complete. 2024-09-17T05:36:22.338 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:22.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.480+0000 7f2154600640 1 -- 172.21.15.31:0/1357281646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f214c0b2e80 msgr2=0x7f214c0b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.480+0000 7f2154600640 1 --2- 172.21.15.31:0/1357281646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f214c0b2e80 0x7f214c0b1bd0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f2138009840 tx=0x7f213801c760 comp rx=0 tx=0).stop 2024-09-17T05:36:22.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.480+0000 7f2154600640 1 -- 172.21.15.31:0/1357281646 shutdown_connections 2024-09-17T05:36:22.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.480+0000 7f2154600640 1 --2- 172.21.15.31:0/1357281646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f214c0b2e80 0x7f214c0b1bd0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.480+0000 7f2154600640 1 -- 172.21.15.31:0/1357281646 >> 172.21.15.31:0/1357281646 conn(0x7f214c0d1e30 msgr2=0x7f214c0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:22.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.480+0000 7f2154600640 1 -- 172.21.15.31:0/1357281646 shutdown_connections 2024-09-17T05:36:22.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.480+0000 7f2154600640 1 -- 172.21.15.31:0/1357281646 wait complete. 2024-09-17T05:36:22.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2154600640 1 Processor -- start 2024-09-17T05:36:22.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2154600640 1 -- start start 2024-09-17T05:36:22.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2154600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f214c0afca0 0x7f214c1fb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2154600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f214c0b2e80 0x7f214c151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2154600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f214c15f490 0x7f214c15c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2154600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f214c0b2290 con 0x7f214c0b2e80 2024-09-17T05:36:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2154600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f214c0b2110 con 0x7f214c0afca0 2024-09-17T05:36:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2154600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f214c16a4a0 con 0x7f214c15f490 2024-09-17T05:36:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2151200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f214c0b2e80 0x7f214c151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2151200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f214c0b2e80 0x7f214c151990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34664/0 (socket says 172.21.15.31:34664) 2024-09-17T05:36:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2151200640 1 -- 172.21.15.31:0/1574230927 learned_addr learned my addr 172.21.15.31:0/1574230927 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2152600640 1 --2- 172.21.15.31:0/1574230927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f214c15f490 0x7f214c15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2151c00640 1 --2- 172.21.15.31:0/1574230927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f214c0afca0 0x7f214c1fb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2151200640 1 -- 172.21.15.31:0/1574230927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f214c15f490 msgr2=0x7f214c15c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2151200640 1 --2- 172.21.15.31:0/1574230927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f214c15f490 0x7f214c15c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2151200640 1 -- 172.21.15.31:0/1574230927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f214c0afca0 msgr2=0x7f214c1fb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2151200640 1 --2- 172.21.15.31:0/1574230927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f214c0afca0 0x7f214c1fb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2151200640 1 -- 172.21.15.31:0/1574230927 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214c158240 con 0x7f214c0b2e80 2024-09-17T05:36:22.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2151200640 1 --2- 172.21.15.31:0/1574230927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f214c0b2e80 0x7f214c151990 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f2138009790 tx=0x7f21380a57c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:22.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2149600640 1 -- 172.21.15.31:0/1574230927 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21380b2040 con 0x7f214c0b2e80 2024-09-17T05:36:22.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2149600640 1 -- 172.21.15.31:0/1574230927 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21380043c0 con 0x7f214c0b2e80 2024-09-17T05:36:22.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2149600640 1 -- 172.21.15.31:0/1574230927 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138005220 con 0x7f214c0b2e80 2024-09-17T05:36:22.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2154600640 1 -- 172.21.15.31:0/1574230927 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f214c158520 con 0x7f214c0b2e80 2024-09-17T05:36:22.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.484+0000 7f2154600640 1 -- 172.21.15.31:0/1574230927 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f214c152970 con 0x7f214c0b2e80 2024-09-17T05:36:22.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.488+0000 7f2154600640 1 -- 172.21.15.31:0/1574230927 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f214c0b00d0 con 0x7f214c0b2e80 2024-09-17T05:36:22.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.488+0000 7f2149600640 1 -- 172.21.15.31:0/1574230927 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f21380053c0 con 0x7f214c0b2e80 2024-09-17T05:36:22.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.488+0000 7f2149600640 1 --2- 172.21.15.31:0/1574230927 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f212c073a70 0x7f212c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.488+0000 7f2149600640 1 -- 172.21.15.31:0/1574230927 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f213812ec40 con 0x7f214c0b2e80 2024-09-17T05:36:22.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.488+0000 7f2151c00640 1 --2- 172.21.15.31:0/1574230927 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f212c073a70 0x7f212c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:22.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.492+0000 7f2151c00640 1 --2- 172.21.15.31:0/1574230927 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f212c073a70 0x7f212c075f30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f214c0c5700 tx=0x7f2140009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:22.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.492+0000 7f2149600640 1 -- 172.21.15.31:0/1574230927 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2138016410 con 0x7f214c0b2e80 2024-09-17T05:36:22.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.668+0000 7f2154600640 1 -- 172.21.15.31:0/1574230927 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f214c159b70 con 0x7f214c0b2e80 2024-09-17T05:36:22.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.668+0000 7f2149600640 1 -- 172.21.15.31:0/1574230927 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) ==== 74+0+16807 (secure 0 0 0) 0x7f21380f9140 con 0x7f214c0b2e80 2024-09-17T05:36:22.672 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:22.672 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":152,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:36:19.891256+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:16.018805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:17.260510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:22.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.672+0000 7f2154600640 1 -- 172.21.15.31:0/1574230927 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f212c073a70 msgr2=0x7f212c075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.672+0000 7f2154600640 1 --2- 172.21.15.31:0/1574230927 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f212c073a70 0x7f212c075f30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f214c0c5700 tx=0x7f2140009040 comp rx=0 tx=0).stop 2024-09-17T05:36:22.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.672+0000 7f2154600640 1 -- 172.21.15.31:0/1574230927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f214c0b2e80 msgr2=0x7f214c151990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.672+0000 7f2154600640 1 --2- 172.21.15.31:0/1574230927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f214c0b2e80 0x7f214c151990 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f2138009790 tx=0x7f21380a57c0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.672+0000 7f2154600640 1 -- 172.21.15.31:0/1574230927 shutdown_connections 2024-09-17T05:36:22.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.672+0000 7f2154600640 1 --2- 172.21.15.31:0/1574230927 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f212c073a70 0x7f212c075f30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.672+0000 7f2154600640 1 --2- 172.21.15.31:0/1574230927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f214c15f490 0x7f214c15c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.672+0000 7f2154600640 1 --2- 172.21.15.31:0/1574230927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f214c0b2e80 0x7f214c151990 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.672+0000 7f2154600640 1 --2- 172.21.15.31:0/1574230927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f214c0afca0 0x7f214c1fb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.672+0000 7f2154600640 1 -- 172.21.15.31:0/1574230927 >> 172.21.15.31:0/1574230927 conn(0x7f214c0d1e30 msgr2=0x7f214c06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:22.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.672+0000 7f2154600640 1 -- 172.21.15.31:0/1574230927 shutdown_connections 2024-09-17T05:36:22.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.672+0000 7f2154600640 1 -- 172.21.15.31:0/1574230927 wait complete. 2024-09-17T05:36:22.694 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:36:22.694 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:36:22.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.840+0000 7f03ff600640 1 -- 172.21.15.31:0/266411732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03f815dae0 msgr2=0x7f03f80acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.840+0000 7f03ff600640 1 --2- 172.21.15.31:0/266411732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03f815dae0 0x7f03f80acd40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009840 tx=0x7f03ec01c790 comp rx=0 tx=0).stop 2024-09-17T05:36:22.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.840+0000 7f03ff600640 1 -- 172.21.15.31:0/266411732 shutdown_connections 2024-09-17T05:36:22.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.840+0000 7f03ff600640 1 --2- 172.21.15.31:0/266411732 >> v2:172.21.15.155:3300/0 conn(0x7f03f80cd100 0x7f03f80b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.840+0000 7f03ff600640 1 --2- 172.21.15.31:0/266411732 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03f815dae0 0x7f03f80acd40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.840+0000 7f03ff600640 1 -- 172.21.15.31:0/266411732 >> 172.21.15.31:0/266411732 conn(0x7f03f80b18f0 msgr2=0x7f03f80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:22.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.840+0000 7f03ff600640 1 -- 172.21.15.31:0/266411732 shutdown_connections 2024-09-17T05:36:22.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.840+0000 7f03ff600640 1 -- 172.21.15.31:0/266411732 wait complete. 2024-09-17T05:36:22.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.840+0000 7f03ff600640 1 Processor -- start 2024-09-17T05:36:22.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.840+0000 7f03ff600640 1 -- start start 2024-09-17T05:36:22.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.840+0000 7f03ff600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03f80b4810 0x7f03f814e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.840+0000 7f03ff600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03f80cd100 0x7f03f80b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.840+0000 7f03ff600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03f815dae0 0x7f03f8155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.840+0000 7f03ff600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f03f81674b0 con 0x7f03f815dae0 2024-09-17T05:36:22.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.840+0000 7f03ff600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f03f8167330 con 0x7f03f80cd100 2024-09-17T05:36:22.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.840+0000 7f03ff600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f03f8167630 con 0x7f03f80b4810 2024-09-17T05:36:22.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.844+0000 7f03fd600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03f815dae0 0x7f03f8155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:22.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.844+0000 7f03fd600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03f815dae0 0x7f03f8155a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34676/0 (socket says 172.21.15.31:34676) 2024-09-17T05:36:22.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.844+0000 7f03fd600640 1 -- 172.21.15.31:0/3243037630 learned_addr learned my addr 172.21.15.31:0/3243037630 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:22.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.844+0000 7f03f7e00640 1 --2- 172.21.15.31:0/3243037630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03f80cd100 0x7f03f80b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:22.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.844+0000 7f03fcc00640 1 --2- 172.21.15.31:0/3243037630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03f80b4810 0x7f03f814e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:22.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.844+0000 7f03fd600640 1 -- 172.21.15.31:0/3243037630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03f80b4810 msgr2=0x7f03f814e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.844+0000 7f03fd600640 1 --2- 172.21.15.31:0/3243037630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03f80b4810 0x7f03f814e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.844+0000 7f03fd600640 1 -- 172.21.15.31:0/3243037630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03f80cd100 msgr2=0x7f03f80b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:22.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.844+0000 7f03fd600640 1 --2- 172.21.15.31:0/3243037630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03f80cd100 0x7f03f80b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:22.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.844+0000 7f03fd600640 1 -- 172.21.15.31:0/3243037630 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f8157aa0 con 0x7f03f815dae0 2024-09-17T05:36:22.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.844+0000 7f03fd600640 1 --2- 172.21.15.31:0/3243037630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03f815dae0 0x7f03f8155a90 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f03f000c7a0 tx=0x7f03f000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:22.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.844+0000 7f03f4c00640 1 -- 172.21.15.31:0/3243037630 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f0003b80 con 0x7f03f815dae0 2024-09-17T05:36:22.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.844+0000 7f03f4c00640 1 -- 172.21.15.31:0/3243037630 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03f0003d40 con 0x7f03f815dae0 2024-09-17T05:36:22.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.844+0000 7f03f4c00640 1 -- 172.21.15.31:0/3243037630 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f0005330 con 0x7f03f815dae0 2024-09-17T05:36:22.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.844+0000 7f03ff600640 1 -- 172.21.15.31:0/3243037630 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03f80af9e0 con 0x7f03f815dae0 2024-09-17T05:36:22.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.844+0000 7f03ff600640 1 -- 172.21.15.31:0/3243037630 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03f80b1290 con 0x7f03f815dae0 2024-09-17T05:36:22.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.844+0000 7f03ff600640 1 -- 172.21.15.31:0/3243037630 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03f80b1460 con 0x7f03f815dae0 2024-09-17T05:36:22.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.844+0000 7f03f4c00640 1 -- 172.21.15.31:0/3243037630 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f03f00054d0 con 0x7f03f815dae0 2024-09-17T05:36:22.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.848+0000 7f03f4c00640 1 --2- 172.21.15.31:0/3243037630 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f03d8073a70 0x7f03d8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:22.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.848+0000 7f03f4c00640 1 -- 172.21.15.31:0/3243037630 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f03f00951c0 con 0x7f03f815dae0 2024-09-17T05:36:22.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.848+0000 7f03fcc00640 1 --2- 172.21.15.31:0/3243037630 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f03d8073a70 0x7f03d8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:22.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.848+0000 7f03fcc00640 1 --2- 172.21.15.31:0/3243037630 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f03d8073a70 0x7f03d8075f30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f03ec0ae000 tx=0x7f03ec01afd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:22.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:22.852+0000 7f03f4c00640 1 -- 172.21.15.31:0/3243037630 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f03f005f2b0 con 0x7f03f815dae0 2024-09-17T05:36:23.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.028+0000 7f03ff600640 1 -- 172.21.15.31:0/3243037630 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f03f80b0d60 con 0x7f03d8073a70 2024-09-17T05:36:23.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.032+0000 7f03f4c00640 1 -- 172.21.15.31:0/3243037630 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247112 (secure 0 0 0) 0x7f03f80b0d60 con 0x7f03d8073a70 2024-09-17T05:36:23.038 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:23.040 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:36:23.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.036+0000 7f03ff600640 1 -- 172.21.15.31:0/3243037630 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f03d8073a70 msgr2=0x7f03d8075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.036+0000 7f03ff600640 1 --2- 172.21.15.31:0/3243037630 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f03d8073a70 0x7f03d8075f30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f03ec0ae000 tx=0x7f03ec01afd0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.036+0000 7f03ff600640 1 -- 172.21.15.31:0/3243037630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03f815dae0 msgr2=0x7f03f8155a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.036+0000 7f03ff600640 1 --2- 172.21.15.31:0/3243037630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03f815dae0 0x7f03f8155a90 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f03f000c7a0 tx=0x7f03f000cba0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.036+0000 7f03ff600640 1 -- 172.21.15.31:0/3243037630 shutdown_connections 2024-09-17T05:36:23.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.036+0000 7f03ff600640 1 --2- 172.21.15.31:0/3243037630 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f03d8073a70 0x7f03d8075f30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.036+0000 7f03ff600640 1 --2- 172.21.15.31:0/3243037630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03f815dae0 0x7f03f8155a90 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.036+0000 7f03ff600640 1 --2- 172.21.15.31:0/3243037630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03f80cd100 0x7f03f80b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.036+0000 7f03ff600640 1 --2- 172.21.15.31:0/3243037630 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03f80b4810 0x7f03f814e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.036+0000 7f03ff600640 1 -- 172.21.15.31:0/3243037630 >> 172.21.15.31:0/3243037630 conn(0x7f03f80b18f0 msgr2=0x7f03f8164720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:23.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.036+0000 7f03ff600640 1 -- 172.21.15.31:0/3243037630 shutdown_connections 2024-09-17T05:36:23.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.036+0000 7f03ff600640 1 -- 172.21.15.31:0/3243037630 wait complete. 2024-09-17T05:36:23.059 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-09-17T05:36:22.747861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":269568,"kb_used_data":15880,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754705152,"statfs":{"total":773094113280,"available":772818075648,"internally_reserved":0,"allocated":16261120,"data_stored":7812824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.875083"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.889233+0000","last_change":"2024-09-17T05:36:17.889233+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.889233+0000","last_undegraded":"2024-09-17T05:36:17.889233+0000","last_fullsized":"2024-09-17T05:36:17.889233+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.896633+0000","last_change":"2024-09-17T05:36:17.896633+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.896633+0000","last_undegraded":"2024-09-17T05:36:17.896633+0000","last_fullsized":"2024-09-17T05:36:17.896633+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.895608+0000","last_change":"2024-09-17T05:36:17.895608+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.895608+0000","last_undegraded":"2024-09-17T05:36:17.895608+0000","last_fullsized":"2024-09-17T05:36:17.895608+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.896065+0000","last_change":"2024-09-17T05:36:17.896065+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.896065+0000","last_undegraded":"2024-09-17T05:36:17.896065+0000","last_fullsized":"2024-09-17T05:36:17.896065+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.890523+0000","last_change":"2024-09-17T05:36:17.890523+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.890523+0000","last_undegraded":"2024-09-17T05:36:17.890523+0000","last_fullsized":"2024-09-17T05:36:17.890523+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.894650+0000","last_change":"2024-09-17T05:36:17.894650+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.894650+0000","last_undegraded":"2024-09-17T05:36:17.894650+0000","last_fullsized":"2024-09-17T05:36:17.894650+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885424+0000","last_change":"2024-09-17T05:36:17.885424+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885424+0000","last_undegraded":"2024-09-17T05:36:17.885424+0000","last_fullsized":"2024-09-17T05:36:17.885424+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887419+0000","last_change":"2024-09-17T05:36:17.887419+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887419+0000","last_undegraded":"2024-09-17T05:36:17.887419+0000","last_fullsized":"2024-09-17T05:36:17.887419+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886342+0000","last_change":"2024-09-17T05:36:17.886342+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886342+0000","last_undegraded":"2024-09-17T05:36:17.886342+0000","last_fullsized":"2024-09-17T05:36:17.886342+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887831+0000","last_change":"2024-09-17T05:36:17.887831+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887831+0000","last_undegraded":"2024-09-17T05:36:17.887831+0000","last_fullsized":"2024-09-17T05:36:17.887831+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885499+0000","last_change":"2024-09-17T05:36:17.885499+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885499+0000","last_undegraded":"2024-09-17T05:36:17.885499+0000","last_fullsized":"2024-09-17T05:36:17.885499+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.895660+0000","last_change":"2024-09-17T05:36:17.895660+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.895660+0000","last_undegraded":"2024-09-17T05:36:17.895660+0000","last_fullsized":"2024-09-17T05:36:17.895660+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.897723+0000","last_change":"2024-09-17T05:36:17.897723+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.897723+0000","last_undegraded":"2024-09-17T05:36:17.897723+0000","last_fullsized":"2024-09-17T05:36:17.897723+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885231+0000","last_change":"2024-09-17T05:36:17.885231+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885231+0000","last_undegraded":"2024-09-17T05:36:17.885231+0000","last_fullsized":"2024-09-17T05:36:17.885231+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.896078+0000","last_change":"2024-09-17T05:36:17.896078+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.896078+0000","last_undegraded":"2024-09-17T05:36:17.896078+0000","last_fullsized":"2024-09-17T05:36:17.896078+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886983+0000","last_change":"2024-09-17T05:36:17.886983+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886983+0000","last_undegraded":"2024-09-17T05:36:17.886983+0000","last_fullsized":"2024-09-17T05:36:17.886983+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.892630+0000","last_change":"2024-09-17T05:36:17.892630+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.892630+0000","last_undegraded":"2024-09-17T05:36:17.892630+0000","last_fullsized":"2024-09-17T05:36:17.892630+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.888639+0000","last_change":"2024-09-17T05:36:17.888639+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.888639+0000","last_undegraded":"2024-09-17T05:36:17.888639+0000","last_fullsized":"2024-09-17T05:36:17.888639+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886496+0000","last_change":"2024-09-17T05:36:17.886496+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886496+0000","last_undegraded":"2024-09-17T05:36:17.886496+0000","last_fullsized":"2024-09-17T05:36:17.886496+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.890668+0000","last_change":"2024-09-17T05:36:17.890668+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.890668+0000","last_undegraded":"2024-09-17T05:36:17.890668+0000","last_fullsized":"2024-09-17T05:36:17.890668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.888612+0000","last_change":"2024-09-17T05:36:17.888612+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.888612+0000","last_undegraded":"2024-09-17T05:36:17.888612+0000","last_fullsized":"2024-09-17T05:36:17.888612+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886739+0000","last_change":"2024-09-17T05:36:17.886739+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886739+0000","last_undegraded":"2024-09-17T05:36:17.886739+0000","last_fullsized":"2024-09-17T05:36:17.886739+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.893398+0000","last_change":"2024-09-17T05:36:17.893398+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.893398+0000","last_undegraded":"2024-09-17T05:36:17.893398+0000","last_fullsized":"2024-09-17T05:36:17.893398+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886501+0000","last_change":"2024-09-17T05:36:17.886501+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886501+0000","last_undegraded":"2024-09-17T05:36:17.886501+0000","last_fullsized":"2024-09-17T05:36:17.886501+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.894815+0000","last_change":"2024-09-17T05:36:17.894815+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.894815+0000","last_undegraded":"2024-09-17T05:36:17.894815+0000","last_fullsized":"2024-09-17T05:36:17.894815+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885868+0000","last_change":"2024-09-17T05:36:17.885868+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885868+0000","last_undegraded":"2024-09-17T05:36:17.885868+0000","last_fullsized":"2024-09-17T05:36:17.885868+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.894906+0000","last_change":"2024-09-17T05:36:17.894906+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.894906+0000","last_undegraded":"2024-09-17T05:36:17.894906+0000","last_fullsized":"2024-09-17T05:36:17.894906+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.890199+0000","last_change":"2024-09-17T05:36:17.890199+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.890199+0000","last_undegraded":"2024-09-17T05:36:17.890199+0000","last_fullsized":"2024-09-17T05:36:17.890199+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.893664+0000","last_change":"2024-09-17T05:36:17.893664+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.893664+0000","last_undegraded":"2024-09-17T05:36:17.893664+0000","last_fullsized":"2024-09-17T05:36:17.893664+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884646+0000","last_change":"2024-09-17T05:36:17.884646+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884646+0000","last_undegraded":"2024-09-17T05:36:17.884646+0000","last_fullsized":"2024-09-17T05:36:17.884646+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.892901+0000","last_change":"2024-09-17T05:36:17.892901+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.892901+0000","last_undegraded":"2024-09-17T05:36:17.892901+0000","last_fullsized":"2024-09-17T05:36:17.892901+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884789+0000","last_change":"2024-09-17T05:36:17.884789+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884789+0000","last_undegraded":"2024-09-17T05:36:17.884789+0000","last_fullsized":"2024-09-17T05:36:17.884789+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884686+0000","last_change":"2024-09-17T05:36:17.884686+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884686+0000","last_undegraded":"2024-09-17T05:36:17.884686+0000","last_fullsized":"2024-09-17T05:36:17.884686+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904294+0000","last_change":"2024-09-17T05:36:17.897252+0000","last_active":"2024-09-17T05:36:17.904294+0000","last_peered":"2024-09-17T05:36:17.904294+0000","last_clean":"2024-09-17T05:36:17.904294+0000","last_became_active":"2024-09-17T05:36:17.896404+0000","last_became_peered":"2024-09-17T05:36:17.896404+0000","last_unstale":"2024-09-17T05:36:17.904294+0000","last_undegraded":"2024-09-17T05:36:17.904294+0000","last_fullsized":"2024-09-17T05:36:17.904294+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:04.122599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887954+0000","last_change":"2024-09-17T05:36:17.887954+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887954+0000","last_undegraded":"2024-09-17T05:36:17.887954+0000","last_fullsized":"2024-09-17T05:36:17.887954+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.897966+0000","last_change":"2024-09-17T05:36:17.894519+0000","last_active":"2024-09-17T05:36:17.897966+0000","last_peered":"2024-09-17T05:36:17.897966+0000","last_clean":"2024-09-17T05:36:17.897966+0000","last_became_active":"2024-09-17T05:36:17.894226+0000","last_became_peered":"2024-09-17T05:36:17.894226+0000","last_unstale":"2024-09-17T05:36:17.897966+0000","last_undegraded":"2024-09-17T05:36:17.897966+0000","last_fullsized":"2024-09-17T05:36:17.897966+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:42.772544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886288+0000","last_change":"2024-09-17T05:36:17.886288+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886288+0000","last_undegraded":"2024-09-17T05:36:17.886288+0000","last_fullsized":"2024-09-17T05:36:17.886288+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.910462+0000","last_change":"2024-09-17T05:36:17.905621+0000","last_active":"2024-09-17T05:36:17.910462+0000","last_peered":"2024-09-17T05:36:17.910462+0000","last_clean":"2024-09-17T05:36:17.910462+0000","last_became_active":"2024-09-17T05:36:17.905207+0000","last_became_peered":"2024-09-17T05:36:17.905207+0000","last_unstale":"2024-09-17T05:36:17.910462+0000","last_undegraded":"2024-09-17T05:36:17.910462+0000","last_fullsized":"2024-09-17T05:36:17.910462+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:44.838474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885492+0000","last_change":"2024-09-17T05:36:17.885492+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885492+0000","last_undegraded":"2024-09-17T05:36:17.885492+0000","last_fullsized":"2024-09-17T05:36:17.885492+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904651+0000","last_change":"2024-09-17T05:36:17.903329+0000","last_active":"2024-09-17T05:36:17.904651+0000","last_peered":"2024-09-17T05:36:17.904651+0000","last_clean":"2024-09-17T05:36:17.904651+0000","last_became_active":"2024-09-17T05:36:17.903072+0000","last_became_peered":"2024-09-17T05:36:17.903072+0000","last_unstale":"2024-09-17T05:36:17.904651+0000","last_undegraded":"2024-09-17T05:36:17.904651+0000","last_fullsized":"2024-09-17T05:36:17.904651+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:12.779569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886309+0000","last_change":"2024-09-17T05:36:17.886309+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886309+0000","last_undegraded":"2024-09-17T05:36:17.886309+0000","last_fullsized":"2024-09-17T05:36:17.886309+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904961+0000","last_change":"2024-09-17T05:36:17.900853+0000","last_active":"2024-09-17T05:36:17.904961+0000","last_peered":"2024-09-17T05:36:17.904961+0000","last_clean":"2024-09-17T05:36:17.904961+0000","last_became_active":"2024-09-17T05:36:17.898291+0000","last_became_peered":"2024-09-17T05:36:17.898291+0000","last_unstale":"2024-09-17T05:36:17.904961+0000","last_undegraded":"2024-09-17T05:36:17.904961+0000","last_fullsized":"2024-09-17T05:36:17.904961+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:09.616243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886376+0000","last_change":"2024-09-17T05:36:17.886376+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886376+0000","last_undegraded":"2024-09-17T05:36:17.886376+0000","last_fullsized":"2024-09-17T05:36:17.886376+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909516+0000","last_change":"2024-09-17T05:36:17.905265+0000","last_active":"2024-09-17T05:36:17.909516+0000","last_peered":"2024-09-17T05:36:17.909516+0000","last_clean":"2024-09-17T05:36:17.909516+0000","last_became_active":"2024-09-17T05:36:17.901068+0000","last_became_peered":"2024-09-17T05:36:17.901068+0000","last_unstale":"2024-09-17T05:36:17.909516+0000","last_undegraded":"2024-09-17T05:36:17.909516+0000","last_fullsized":"2024-09-17T05:36:17.909516+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:31.985911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884951+0000","last_change":"2024-09-17T05:36:17.884951+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884951+0000","last_undegraded":"2024-09-17T05:36:17.884951+0000","last_fullsized":"2024-09-17T05:36:17.884951+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911186+0000","last_change":"2024-09-17T05:36:17.909883+0000","last_active":"2024-09-17T05:36:17.911186+0000","last_peered":"2024-09-17T05:36:17.911186+0000","last_clean":"2024-09-17T05:36:17.911186+0000","last_became_active":"2024-09-17T05:36:17.909592+0000","last_became_peered":"2024-09-17T05:36:17.909592+0000","last_unstale":"2024-09-17T05:36:17.911186+0000","last_undegraded":"2024-09-17T05:36:17.911186+0000","last_fullsized":"2024-09-17T05:36:17.911186+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:02.007221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.898511+0000","last_change":"2024-09-17T05:36:17.898511+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.898511+0000","last_undegraded":"2024-09-17T05:36:17.898511+0000","last_fullsized":"2024-09-17T05:36:17.898511+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.892532+0000","last_change":"2024-09-17T05:36:17.891610+0000","last_active":"2024-09-17T05:36:17.892532+0000","last_peered":"2024-09-17T05:36:17.892532+0000","last_clean":"2024-09-17T05:36:17.892532+0000","last_became_active":"2024-09-17T05:36:17.891311+0000","last_became_peered":"2024-09-17T05:36:17.891311+0000","last_unstale":"2024-09-17T05:36:17.892532+0000","last_undegraded":"2024-09-17T05:36:17.892532+0000","last_fullsized":"2024-09-17T05:36:17.892532+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:14.454258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884273+0000","last_change":"2024-09-17T05:36:17.884273+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884273+0000","last_undegraded":"2024-09-17T05:36:17.884273+0000","last_fullsized":"2024-09-17T05:36:17.884273+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909079+0000","last_change":"2024-09-17T05:36:17.904403+0000","last_active":"2024-09-17T05:36:17.909079+0000","last_peered":"2024-09-17T05:36:17.909079+0000","last_clean":"2024-09-17T05:36:17.909079+0000","last_became_active":"2024-09-17T05:36:17.904050+0000","last_became_peered":"2024-09-17T05:36:17.904050+0000","last_unstale":"2024-09-17T05:36:17.909079+0000","last_undegraded":"2024-09-17T05:36:17.909079+0000","last_fullsized":"2024-09-17T05:36:17.909079+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:44.521389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885864+0000","last_change":"2024-09-17T05:36:17.885864+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885864+0000","last_undegraded":"2024-09-17T05:36:17.885864+0000","last_fullsized":"2024-09-17T05:36:17.885864+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911272+0000","last_change":"2024-09-17T05:36:17.907774+0000","last_active":"2024-09-17T05:36:17.911272+0000","last_peered":"2024-09-17T05:36:17.911272+0000","last_clean":"2024-09-17T05:36:17.911272+0000","last_became_active":"2024-09-17T05:36:17.907451+0000","last_became_peered":"2024-09-17T05:36:17.907451+0000","last_unstale":"2024-09-17T05:36:17.911272+0000","last_undegraded":"2024-09-17T05:36:17.911272+0000","last_fullsized":"2024-09-17T05:36:17.911272+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:28.237700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886866+0000","last_change":"2024-09-17T05:36:17.886866+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886866+0000","last_undegraded":"2024-09-17T05:36:17.886866+0000","last_fullsized":"2024-09-17T05:36:17.886866+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909346+0000","last_change":"2024-09-17T05:36:17.901928+0000","last_active":"2024-09-17T05:36:17.909346+0000","last_peered":"2024-09-17T05:36:17.909346+0000","last_clean":"2024-09-17T05:36:17.909346+0000","last_became_active":"2024-09-17T05:36:17.901658+0000","last_became_peered":"2024-09-17T05:36:17.901658+0000","last_unstale":"2024-09-17T05:36:17.909346+0000","last_undegraded":"2024-09-17T05:36:17.909346+0000","last_fullsized":"2024-09-17T05:36:17.909346+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:47.183684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.894120+0000","last_change":"2024-09-17T05:36:17.894120+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.894120+0000","last_undegraded":"2024-09-17T05:36:17.894120+0000","last_fullsized":"2024-09-17T05:36:17.894120+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911123+0000","last_change":"2024-09-17T05:36:17.909634+0000","last_active":"2024-09-17T05:36:17.911123+0000","last_peered":"2024-09-17T05:36:17.911123+0000","last_clean":"2024-09-17T05:36:17.911123+0000","last_became_active":"2024-09-17T05:36:17.909283+0000","last_became_peered":"2024-09-17T05:36:17.909283+0000","last_unstale":"2024-09-17T05:36:17.911123+0000","last_undegraded":"2024-09-17T05:36:17.911123+0000","last_fullsized":"2024-09-17T05:36:17.911123+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:04.540111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886723+0000","last_change":"2024-09-17T05:36:17.886723+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886723+0000","last_undegraded":"2024-09-17T05:36:17.886723+0000","last_fullsized":"2024-09-17T05:36:17.886723+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.905270+0000","last_change":"2024-09-17T05:36:17.902030+0000","last_active":"2024-09-17T05:36:17.905270+0000","last_peered":"2024-09-17T05:36:17.905270+0000","last_clean":"2024-09-17T05:36:17.905270+0000","last_became_active":"2024-09-17T05:36:17.901154+0000","last_became_peered":"2024-09-17T05:36:17.901154+0000","last_unstale":"2024-09-17T05:36:17.905270+0000","last_undegraded":"2024-09-17T05:36:17.905270+0000","last_fullsized":"2024-09-17T05:36:17.905270+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:26.536681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885002+0000","last_change":"2024-09-17T05:36:17.885002+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885002+0000","last_undegraded":"2024-09-17T05:36:17.885002+0000","last_fullsized":"2024-09-17T05:36:17.885002+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911207+0000","last_change":"2024-09-17T05:36:17.906929+0000","last_active":"2024-09-17T05:36:17.911207+0000","last_peered":"2024-09-17T05:36:17.911207+0000","last_clean":"2024-09-17T05:36:17.911207+0000","last_became_active":"2024-09-17T05:36:17.906657+0000","last_became_peered":"2024-09-17T05:36:17.906657+0000","last_unstale":"2024-09-17T05:36:17.911207+0000","last_undegraded":"2024-09-17T05:36:17.911207+0000","last_fullsized":"2024-09-17T05:36:17.911207+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:04.425419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884821+0000","last_change":"2024-09-17T05:36:17.884821+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884821+0000","last_undegraded":"2024-09-17T05:36:17.884821+0000","last_fullsized":"2024-09-17T05:36:17.884821+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911164+0000","last_change":"2024-09-17T05:36:17.909786+0000","last_active":"2024-09-17T05:36:17.911164+0000","last_peered":"2024-09-17T05:36:17.911164+0000","last_clean":"2024-09-17T05:36:17.911164+0000","last_became_active":"2024-09-17T05:36:17.909389+0000","last_became_peered":"2024-09-17T05:36:17.909389+0000","last_unstale":"2024-09-17T05:36:17.911164+0000","last_undegraded":"2024-09-17T05:36:17.911164+0000","last_fullsized":"2024-09-17T05:36:17.911164+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:02.011245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887351+0000","last_change":"2024-09-17T05:36:17.887351+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887351+0000","last_undegraded":"2024-09-17T05:36:17.887351+0000","last_fullsized":"2024-09-17T05:36:17.887351+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909507+0000","last_change":"2024-09-17T05:36:17.904457+0000","last_active":"2024-09-17T05:36:17.909507+0000","last_peered":"2024-09-17T05:36:17.909507+0000","last_clean":"2024-09-17T05:36:17.909507+0000","last_became_active":"2024-09-17T05:36:17.904044+0000","last_became_peered":"2024-09-17T05:36:17.904044+0000","last_unstale":"2024-09-17T05:36:17.909507+0000","last_undegraded":"2024-09-17T05:36:17.909507+0000","last_fullsized":"2024-09-17T05:36:17.909507+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:03.142400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884659+0000","last_change":"2024-09-17T05:36:17.884659+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884659+0000","last_undegraded":"2024-09-17T05:36:17.884659+0000","last_fullsized":"2024-09-17T05:36:17.884659+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.900621+0000","last_change":"2024-09-17T05:36:17.889028+0000","last_active":"2024-09-17T05:36:17.900621+0000","last_peered":"2024-09-17T05:36:17.900621+0000","last_clean":"2024-09-17T05:36:17.900621+0000","last_became_active":"2024-09-17T05:36:17.886151+0000","last_became_peered":"2024-09-17T05:36:17.886151+0000","last_unstale":"2024-09-17T05:36:17.900621+0000","last_undegraded":"2024-09-17T05:36:17.900621+0000","last_fullsized":"2024-09-17T05:36:17.900621+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:30.991576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884985+0000","last_change":"2024-09-17T05:36:17.884985+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884985+0000","last_undegraded":"2024-09-17T05:36:17.884985+0000","last_fullsized":"2024-09-17T05:36:17.884985+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.910481+0000","last_change":"2024-09-17T05:36:17.909303+0000","last_active":"2024-09-17T05:36:17.910481+0000","last_peered":"2024-09-17T05:36:17.910481+0000","last_clean":"2024-09-17T05:36:17.910481+0000","last_became_active":"2024-09-17T05:36:17.909058+0000","last_became_peered":"2024-09-17T05:36:17.909058+0000","last_unstale":"2024-09-17T05:36:17.910481+0000","last_undegraded":"2024-09-17T05:36:17.910481+0000","last_fullsized":"2024-09-17T05:36:17.910481+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:13.555451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.897036+0000","last_change":"2024-09-17T05:36:17.897036+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.897036+0000","last_undegraded":"2024-09-17T05:36:17.897036+0000","last_fullsized":"2024-09-17T05:36:17.897036+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.903214+0000","last_change":"2024-09-17T05:36:17.900645+0000","last_active":"2024-09-17T05:36:17.903214+0000","last_peered":"2024-09-17T05:36:17.903214+0000","last_clean":"2024-09-17T05:36:17.903214+0000","last_became_active":"2024-09-17T05:36:17.900338+0000","last_became_peered":"2024-09-17T05:36:17.900338+0000","last_unstale":"2024-09-17T05:36:17.903214+0000","last_undegraded":"2024-09-17T05:36:17.903214+0000","last_fullsized":"2024-09-17T05:36:17.903214+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:49.857913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885882+0000","last_change":"2024-09-17T05:36:17.885882+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885882+0000","last_undegraded":"2024-09-17T05:36:17.885882+0000","last_fullsized":"2024-09-17T05:36:17.885882+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.910360+0000","last_change":"2024-09-17T05:36:17.903150+0000","last_active":"2024-09-17T05:36:17.910360+0000","last_peered":"2024-09-17T05:36:17.910360+0000","last_clean":"2024-09-17T05:36:17.910360+0000","last_became_active":"2024-09-17T05:36:17.902834+0000","last_became_peered":"2024-09-17T05:36:17.902834+0000","last_unstale":"2024-09-17T05:36:17.910360+0000","last_undegraded":"2024-09-17T05:36:17.910360+0000","last_fullsized":"2024-09-17T05:36:17.910360+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:16.005227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.883993+0000","last_change":"2024-09-17T05:36:17.883993+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.883993+0000","last_undegraded":"2024-09-17T05:36:17.883993+0000","last_fullsized":"2024-09-17T05:36:17.883993+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.908976+0000","last_change":"2024-09-17T05:36:17.904001+0000","last_active":"2024-09-17T05:36:17.908976+0000","last_peered":"2024-09-17T05:36:17.908976+0000","last_clean":"2024-09-17T05:36:17.908976+0000","last_became_active":"2024-09-17T05:36:17.900330+0000","last_became_peered":"2024-09-17T05:36:17.900330+0000","last_unstale":"2024-09-17T05:36:17.908976+0000","last_undegraded":"2024-09-17T05:36:17.908976+0000","last_fullsized":"2024-09-17T05:36:17.908976+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:55.927724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.898299+0000","last_change":"2024-09-17T05:36:17.898299+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.898299+0000","last_undegraded":"2024-09-17T05:36:17.898299+0000","last_fullsized":"2024-09-17T05:36:17.898299+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.910474+0000","last_change":"2024-09-17T05:36:17.905019+0000","last_active":"2024-09-17T05:36:17.910474+0000","last_peered":"2024-09-17T05:36:17.910474+0000","last_clean":"2024-09-17T05:36:17.910474+0000","last_became_active":"2024-09-17T05:36:17.903334+0000","last_became_peered":"2024-09-17T05:36:17.903334+0000","last_unstale":"2024-09-17T05:36:17.910474+0000","last_undegraded":"2024-09-17T05:36:17.910474+0000","last_fullsized":"2024-09-17T05:36:17.910474+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:22.248556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885764+0000","last_change":"2024-09-17T05:36:17.885764+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885764+0000","last_undegraded":"2024-09-17T05:36:17.885764+0000","last_fullsized":"2024-09-17T05:36:17.885764+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904722+0000","last_change":"2024-09-17T05:36:17.903608+0000","last_active":"2024-09-17T05:36:17.904722+0000","last_peered":"2024-09-17T05:36:17.904722+0000","last_clean":"2024-09-17T05:36:17.904722+0000","last_became_active":"2024-09-17T05:36:17.903276+0000","last_became_peered":"2024-09-17T05:36:17.903276+0000","last_unstale":"2024-09-17T05:36:17.904722+0000","last_undegraded":"2024-09-17T05:36:17.904722+0000","last_fullsized":"2024-09-17T05:36:17.904722+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:37.580096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.890489+0000","last_change":"2024-09-17T05:36:17.890489+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.890489+0000","last_undegraded":"2024-09-17T05:36:17.890489+0000","last_fullsized":"2024-09-17T05:36:17.890489+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909108+0000","last_change":"2024-09-17T05:36:17.908490+0000","last_active":"2024-09-17T05:36:17.909108+0000","last_peered":"2024-09-17T05:36:17.909108+0000","last_clean":"2024-09-17T05:36:17.909108+0000","last_became_active":"2024-09-17T05:36:17.908181+0000","last_became_peered":"2024-09-17T05:36:17.908181+0000","last_unstale":"2024-09-17T05:36:17.909108+0000","last_undegraded":"2024-09-17T05:36:17.909108+0000","last_fullsized":"2024-09-17T05:36:17.909108+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:58.629626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887331+0000","last_change":"2024-09-17T05:36:17.887331+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887331+0000","last_undegraded":"2024-09-17T05:36:17.887331+0000","last_fullsized":"2024-09-17T05:36:17.887331+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.907739+0000","last_change":"2024-09-17T05:36:17.904703+0000","last_active":"2024-09-17T05:36:17.907739+0000","last_peered":"2024-09-17T05:36:17.907739+0000","last_clean":"2024-09-17T05:36:17.907739+0000","last_became_active":"2024-09-17T05:36:17.903663+0000","last_became_peered":"2024-09-17T05:36:17.903663+0000","last_unstale":"2024-09-17T05:36:17.907739+0000","last_undegraded":"2024-09-17T05:36:17.907739+0000","last_fullsized":"2024-09-17T05:36:17.907739+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:29.342878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885070+0000","last_change":"2024-09-17T05:36:17.885070+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885070+0000","last_undegraded":"2024-09-17T05:36:17.885070+0000","last_fullsized":"2024-09-17T05:36:17.885070+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.907501+0000","last_change":"2024-09-17T05:36:17.903663+0000","last_active":"2024-09-17T05:36:17.907501+0000","last_peered":"2024-09-17T05:36:17.907501+0000","last_clean":"2024-09-17T05:36:17.907501+0000","last_became_active":"2024-09-17T05:36:17.903373+0000","last_became_peered":"2024-09-17T05:36:17.903373+0000","last_unstale":"2024-09-17T05:36:17.907501+0000","last_undegraded":"2024-09-17T05:36:17.907501+0000","last_fullsized":"2024-09-17T05:36:17.907501+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:54.399557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885530+0000","last_change":"2024-09-17T05:36:17.885530+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885530+0000","last_undegraded":"2024-09-17T05:36:17.885530+0000","last_fullsized":"2024-09-17T05:36:17.885530+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.900766+0000","last_change":"2024-09-17T05:36:17.889967+0000","last_active":"2024-09-17T05:36:17.900766+0000","last_peered":"2024-09-17T05:36:17.900766+0000","last_clean":"2024-09-17T05:36:17.900766+0000","last_became_active":"2024-09-17T05:36:17.889687+0000","last_became_peered":"2024-09-17T05:36:17.889687+0000","last_unstale":"2024-09-17T05:36:17.900766+0000","last_undegraded":"2024-09-17T05:36:17.900766+0000","last_fullsized":"2024-09-17T05:36:17.900766+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:52.746071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.888637+0000","last_change":"2024-09-17T05:36:17.888637+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.888637+0000","last_undegraded":"2024-09-17T05:36:17.888637+0000","last_fullsized":"2024-09-17T05:36:17.888637+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904102+0000","last_change":"2024-09-17T05:36:17.901496+0000","last_active":"2024-09-17T05:36:17.904102+0000","last_peered":"2024-09-17T05:36:17.904102+0000","last_clean":"2024-09-17T05:36:17.904102+0000","last_became_active":"2024-09-17T05:36:17.901170+0000","last_became_peered":"2024-09-17T05:36:17.901170+0000","last_unstale":"2024-09-17T05:36:17.904102+0000","last_undegraded":"2024-09-17T05:36:17.904102+0000","last_fullsized":"2024-09-17T05:36:17.904102+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:54.128073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.888619+0000","last_change":"2024-09-17T05:36:17.888619+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.888619+0000","last_undegraded":"2024-09-17T05:36:17.888619+0000","last_fullsized":"2024-09-17T05:36:17.888619+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.897089+0000","last_change":"2024-09-17T05:36:17.894247+0000","last_active":"2024-09-17T05:36:17.897089+0000","last_peered":"2024-09-17T05:36:17.897089+0000","last_clean":"2024-09-17T05:36:17.897089+0000","last_became_active":"2024-09-17T05:36:17.892459+0000","last_became_peered":"2024-09-17T05:36:17.892459+0000","last_unstale":"2024-09-17T05:36:17.897089+0000","last_undegraded":"2024-09-17T05:36:17.897089+0000","last_fullsized":"2024-09-17T05:36:17.897089+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:03.778158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.893917+0000","last_change":"2024-09-17T05:36:17.893917+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.893917+0000","last_undegraded":"2024-09-17T05:36:17.893917+0000","last_fullsized":"2024-09-17T05:36:17.893917+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.902602+0000","last_change":"2024-09-17T05:36:17.900164+0000","last_active":"2024-09-17T05:36:17.902602+0000","last_peered":"2024-09-17T05:36:17.902602+0000","last_clean":"2024-09-17T05:36:17.902602+0000","last_became_active":"2024-09-17T05:36:17.899350+0000","last_became_peered":"2024-09-17T05:36:17.899350+0000","last_unstale":"2024-09-17T05:36:17.902602+0000","last_undegraded":"2024-09-17T05:36:17.902602+0000","last_fullsized":"2024-09-17T05:36:17.902602+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:21:14.211298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885327+0000","last_change":"2024-09-17T05:36:17.885327+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885327+0000","last_undegraded":"2024-09-17T05:36:17.885327+0000","last_fullsized":"2024-09-17T05:36:17.885327+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909253+0000","last_change":"2024-09-17T05:36:17.899163+0000","last_active":"2024-09-17T05:36:17.909253+0000","last_peered":"2024-09-17T05:36:17.909253+0000","last_clean":"2024-09-17T05:36:17.909253+0000","last_became_active":"2024-09-17T05:36:17.898886+0000","last_became_peered":"2024-09-17T05:36:17.898886+0000","last_unstale":"2024-09-17T05:36:17.909253+0000","last_undegraded":"2024-09-17T05:36:17.909253+0000","last_fullsized":"2024-09-17T05:36:17.909253+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:44:47.420121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884877+0000","last_change":"2024-09-17T05:36:17.884877+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884877+0000","last_undegraded":"2024-09-17T05:36:17.884877+0000","last_fullsized":"2024-09-17T05:36:17.884877+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.903707+0000","last_change":"2024-09-17T05:36:17.902499+0000","last_active":"2024-09-17T05:36:17.903707+0000","last_peered":"2024-09-17T05:36:17.903707+0000","last_clean":"2024-09-17T05:36:17.903707+0000","last_became_active":"2024-09-17T05:36:17.902216+0000","last_became_peered":"2024-09-17T05:36:17.902216+0000","last_unstale":"2024-09-17T05:36:17.903707+0000","last_undegraded":"2024-09-17T05:36:17.903707+0000","last_fullsized":"2024-09-17T05:36:17.903707+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:07.872232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":374,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.889922+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:36:17.889922+0000","last_peered":"2024-09-17T05:36:17.889922+0000","last_clean":"2024-09-17T05:36:17.889922+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:36:17.889922+0000","last_undegraded":"2024-09-17T05:36:17.889922+0000","last_fullsized":"2024-09-17T05:36:17.889922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509536,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33612,"kb_used_data":2420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338228,"statfs":{"total":96636764160,"available":96602345472,"internally_reserved":0,"allocated":2478080,"data_stored":1419379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542240,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33028,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509537,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33028,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509535,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542239,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37772,"kb_used_data":2420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334068,"statfs":{"total":96636764160,"available":96598085632,"internally_reserved":0,"allocated":2478080,"data_stored":1419379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:36:23.064 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:36:23.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.244+0000 7fdfc0400640 1 -- 172.21.15.31:0/2476232447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb80b11d0 msgr2=0x7fdfb806ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.244+0000 7fdfc0400640 1 --2- 172.21.15.31:0/2476232447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb80b11d0 0x7fdfb806ec80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009bc0 tx=0x7fdfb001cb10 comp rx=0 tx=0).stop 2024-09-17T05:36:23.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.244+0000 7fdfc0400640 1 -- 172.21.15.31:0/2476232447 shutdown_connections 2024-09-17T05:36:23.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.244+0000 7fdfc0400640 1 --2- 172.21.15.31:0/2476232447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb80b11d0 0x7fdfb806ec80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.244+0000 7fdfc0400640 1 --2- 172.21.15.31:0/2476232447 >> v2:172.21.15.155:3300/0 conn(0x7fdfb815df50 0x7fdfb806e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.244+0000 7fdfc0400640 1 -- 172.21.15.31:0/2476232447 >> 172.21.15.31:0/2476232447 conn(0x7fdfb80d1dc0 msgr2=0x7fdfb80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:23.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.244+0000 7fdfc0400640 1 -- 172.21.15.31:0/2476232447 shutdown_connections 2024-09-17T05:36:23.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.244+0000 7fdfc0400640 1 -- 172.21.15.31:0/2476232447 wait complete. 2024-09-17T05:36:23.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfc0400640 1 Processor -- start 2024-09-17T05:36:23.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfc0400640 1 -- start start 2024-09-17T05:36:23.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfc0400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfb80b11d0 0x7fdfb8157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:23.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfc0400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfb815df50 0x7fdfb80c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:23.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfc0400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb815e330 0x7fdfb815a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:23.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfc0400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb80d08d0 con 0x7fdfb80b11d0 2024-09-17T05:36:23.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfc0400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb80d0750 con 0x7fdfb815df50 2024-09-17T05:36:23.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfc0400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb80d0a50 con 0x7fdfb815e330 2024-09-17T05:36:23.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfbda00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfb80b11d0 0x7fdfb8157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:23.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfbda00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfb80b11d0 0x7fdfb8157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34678/0 (socket says 172.21.15.31:34678) 2024-09-17T05:36:23.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfbda00640 1 -- 172.21.15.31:0/3604367855 learned_addr learned my addr 172.21.15.31:0/3604367855 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:23.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfbd000640 1 --2- 172.21.15.31:0/3604367855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfb815df50 0x7fdfb80c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:23.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfbe400640 1 --2- 172.21.15.31:0/3604367855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb815e330 0x7fdfb815a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:23.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfbda00640 1 -- 172.21.15.31:0/3604367855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb815e330 msgr2=0x7fdfb815a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfbda00640 1 --2- 172.21.15.31:0/3604367855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb815e330 0x7fdfb815a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfbda00640 1 -- 172.21.15.31:0/3604367855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfb815df50 msgr2=0x7fdfb80c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfbda00640 1 --2- 172.21.15.31:0/3604367855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfb815df50 0x7fdfb80c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfbda00640 1 -- 172.21.15.31:0/3604367855 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb8158140 con 0x7fdfb80b11d0 2024-09-17T05:36:23.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfbda00640 1 --2- 172.21.15.31:0/3604367855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfb80b11d0 0x7fdfb8157980 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00ea00 tx=0x7fdfac00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:23.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfb5600640 1 -- 172.21.15.31:0/3604367855 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac00cde0 con 0x7fdfb80b11d0 2024-09-17T05:36:23.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfb5600640 1 -- 172.21.15.31:0/3604367855 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdfac004020 con 0x7fdfb80b11d0 2024-09-17T05:36:23.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfc0400640 1 -- 172.21.15.31:0/3604367855 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb8158420 con 0x7fdfb80b11d0 2024-09-17T05:36:23.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfb5600640 1 -- 172.21.15.31:0/3604367855 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfac004450 con 0x7fdfb80b11d0 2024-09-17T05:36:23.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfc0400640 1 -- 172.21.15.31:0/3604367855 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb81589e0 con 0x7fdfb80b11d0 2024-09-17T05:36:23.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.248+0000 7fdfc0400640 1 -- 172.21.15.31:0/3604367855 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb80afcd0 con 0x7fdfb80b11d0 2024-09-17T05:36:23.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.252+0000 7fdfb5600640 1 -- 172.21.15.31:0/3604367855 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7fdfac003600 con 0x7fdfb80b11d0 2024-09-17T05:36:23.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.252+0000 7fdfb5600640 1 --2- 172.21.15.31:0/3604367855 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdf98073a70 0x7fdf98075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:23.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.252+0000 7fdfb5600640 1 -- 172.21.15.31:0/3604367855 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fdfac095e00 con 0x7fdfb80b11d0 2024-09-17T05:36:23.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.252+0000 7fdfbd000640 1 --2- 172.21.15.31:0/3604367855 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdf98073a70 0x7fdf98075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:23.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.252+0000 7fdfbd000640 1 --2- 172.21.15.31:0/3604367855 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdf98073a70 0x7fdf98075f30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80ce190 tx=0x7fdfa4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:23.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.256+0000 7fdfb5600640 1 -- 172.21.15.31:0/3604367855 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fdfac05f820 con 0x7fdfb80b11d0 2024-09-17T05:36:23.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.428+0000 7fdfc0400640 1 -- 172.21.15.31:0/3604367855 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdfb806ee60 con 0x7fdf98073a70 2024-09-17T05:36:23.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.432+0000 7fdfb5600640 1 -- 172.21.15.31:0/3604367855 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247112 (secure 0 0 0) 0x7fdfb806ee60 con 0x7fdf98073a70 2024-09-17T05:36:23.437 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:23.438 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:36:23.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.436+0000 7fdfc0400640 1 -- 172.21.15.31:0/3604367855 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdf98073a70 msgr2=0x7fdf98075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.436+0000 7fdfc0400640 1 --2- 172.21.15.31:0/3604367855 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdf98073a70 0x7fdf98075f30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80ce190 tx=0x7fdfa4009040 comp rx=0 tx=0).stop 2024-09-17T05:36:23.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.436+0000 7fdfc0400640 1 -- 172.21.15.31:0/3604367855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfb80b11d0 msgr2=0x7fdfb8157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.436+0000 7fdfc0400640 1 --2- 172.21.15.31:0/3604367855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfb80b11d0 0x7fdfb8157980 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00ea00 tx=0x7fdfac00eec0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.436+0000 7fdfc0400640 1 -- 172.21.15.31:0/3604367855 shutdown_connections 2024-09-17T05:36:23.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.436+0000 7fdfc0400640 1 --2- 172.21.15.31:0/3604367855 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdf98073a70 0x7fdf98075f30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.436+0000 7fdfc0400640 1 --2- 172.21.15.31:0/3604367855 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdfb815e330 0x7fdfb815a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.436+0000 7fdfc0400640 1 --2- 172.21.15.31:0/3604367855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfb815df50 0x7fdfb80c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.436+0000 7fdfc0400640 1 --2- 172.21.15.31:0/3604367855 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfb80b11d0 0x7fdfb8157980 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.436+0000 7fdfc0400640 1 -- 172.21.15.31:0/3604367855 >> 172.21.15.31:0/3604367855 conn(0x7fdfb80d1dc0 msgr2=0x7fdfb80719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:23.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.436+0000 7fdfc0400640 1 -- 172.21.15.31:0/3604367855 shutdown_connections 2024-09-17T05:36:23.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.436+0000 7fdfc0400640 1 -- 172.21.15.31:0/3604367855 wait complete. 2024-09-17T05:36:23.458 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-09-17T05:36:22.747861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":269568,"kb_used_data":15880,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754705152,"statfs":{"total":773094113280,"available":772818075648,"internally_reserved":0,"allocated":16261120,"data_stored":7812824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.875083"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.889233+0000","last_change":"2024-09-17T05:36:17.889233+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.889233+0000","last_undegraded":"2024-09-17T05:36:17.889233+0000","last_fullsized":"2024-09-17T05:36:17.889233+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.896633+0000","last_change":"2024-09-17T05:36:17.896633+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.896633+0000","last_undegraded":"2024-09-17T05:36:17.896633+0000","last_fullsized":"2024-09-17T05:36:17.896633+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.895608+0000","last_change":"2024-09-17T05:36:17.895608+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.895608+0000","last_undegraded":"2024-09-17T05:36:17.895608+0000","last_fullsized":"2024-09-17T05:36:17.895608+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.896065+0000","last_change":"2024-09-17T05:36:17.896065+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.896065+0000","last_undegraded":"2024-09-17T05:36:17.896065+0000","last_fullsized":"2024-09-17T05:36:17.896065+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.890523+0000","last_change":"2024-09-17T05:36:17.890523+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.890523+0000","last_undegraded":"2024-09-17T05:36:17.890523+0000","last_fullsized":"2024-09-17T05:36:17.890523+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.894650+0000","last_change":"2024-09-17T05:36:17.894650+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.894650+0000","last_undegraded":"2024-09-17T05:36:17.894650+0000","last_fullsized":"2024-09-17T05:36:17.894650+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885424+0000","last_change":"2024-09-17T05:36:17.885424+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885424+0000","last_undegraded":"2024-09-17T05:36:17.885424+0000","last_fullsized":"2024-09-17T05:36:17.885424+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887419+0000","last_change":"2024-09-17T05:36:17.887419+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887419+0000","last_undegraded":"2024-09-17T05:36:17.887419+0000","last_fullsized":"2024-09-17T05:36:17.887419+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886342+0000","last_change":"2024-09-17T05:36:17.886342+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886342+0000","last_undegraded":"2024-09-17T05:36:17.886342+0000","last_fullsized":"2024-09-17T05:36:17.886342+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887831+0000","last_change":"2024-09-17T05:36:17.887831+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887831+0000","last_undegraded":"2024-09-17T05:36:17.887831+0000","last_fullsized":"2024-09-17T05:36:17.887831+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885499+0000","last_change":"2024-09-17T05:36:17.885499+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885499+0000","last_undegraded":"2024-09-17T05:36:17.885499+0000","last_fullsized":"2024-09-17T05:36:17.885499+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.895660+0000","last_change":"2024-09-17T05:36:17.895660+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.895660+0000","last_undegraded":"2024-09-17T05:36:17.895660+0000","last_fullsized":"2024-09-17T05:36:17.895660+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.897723+0000","last_change":"2024-09-17T05:36:17.897723+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.897723+0000","last_undegraded":"2024-09-17T05:36:17.897723+0000","last_fullsized":"2024-09-17T05:36:17.897723+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885231+0000","last_change":"2024-09-17T05:36:17.885231+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885231+0000","last_undegraded":"2024-09-17T05:36:17.885231+0000","last_fullsized":"2024-09-17T05:36:17.885231+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.896078+0000","last_change":"2024-09-17T05:36:17.896078+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.896078+0000","last_undegraded":"2024-09-17T05:36:17.896078+0000","last_fullsized":"2024-09-17T05:36:17.896078+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886983+0000","last_change":"2024-09-17T05:36:17.886983+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886983+0000","last_undegraded":"2024-09-17T05:36:17.886983+0000","last_fullsized":"2024-09-17T05:36:17.886983+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.892630+0000","last_change":"2024-09-17T05:36:17.892630+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.892630+0000","last_undegraded":"2024-09-17T05:36:17.892630+0000","last_fullsized":"2024-09-17T05:36:17.892630+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.888639+0000","last_change":"2024-09-17T05:36:17.888639+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.888639+0000","last_undegraded":"2024-09-17T05:36:17.888639+0000","last_fullsized":"2024-09-17T05:36:17.888639+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886496+0000","last_change":"2024-09-17T05:36:17.886496+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886496+0000","last_undegraded":"2024-09-17T05:36:17.886496+0000","last_fullsized":"2024-09-17T05:36:17.886496+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.890668+0000","last_change":"2024-09-17T05:36:17.890668+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.890668+0000","last_undegraded":"2024-09-17T05:36:17.890668+0000","last_fullsized":"2024-09-17T05:36:17.890668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.888612+0000","last_change":"2024-09-17T05:36:17.888612+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.888612+0000","last_undegraded":"2024-09-17T05:36:17.888612+0000","last_fullsized":"2024-09-17T05:36:17.888612+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886739+0000","last_change":"2024-09-17T05:36:17.886739+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886739+0000","last_undegraded":"2024-09-17T05:36:17.886739+0000","last_fullsized":"2024-09-17T05:36:17.886739+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.893398+0000","last_change":"2024-09-17T05:36:17.893398+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.893398+0000","last_undegraded":"2024-09-17T05:36:17.893398+0000","last_fullsized":"2024-09-17T05:36:17.893398+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886501+0000","last_change":"2024-09-17T05:36:17.886501+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886501+0000","last_undegraded":"2024-09-17T05:36:17.886501+0000","last_fullsized":"2024-09-17T05:36:17.886501+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.894815+0000","last_change":"2024-09-17T05:36:17.894815+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.894815+0000","last_undegraded":"2024-09-17T05:36:17.894815+0000","last_fullsized":"2024-09-17T05:36:17.894815+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885868+0000","last_change":"2024-09-17T05:36:17.885868+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885868+0000","last_undegraded":"2024-09-17T05:36:17.885868+0000","last_fullsized":"2024-09-17T05:36:17.885868+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.894906+0000","last_change":"2024-09-17T05:36:17.894906+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.894906+0000","last_undegraded":"2024-09-17T05:36:17.894906+0000","last_fullsized":"2024-09-17T05:36:17.894906+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.890199+0000","last_change":"2024-09-17T05:36:17.890199+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.890199+0000","last_undegraded":"2024-09-17T05:36:17.890199+0000","last_fullsized":"2024-09-17T05:36:17.890199+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.893664+0000","last_change":"2024-09-17T05:36:17.893664+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.893664+0000","last_undegraded":"2024-09-17T05:36:17.893664+0000","last_fullsized":"2024-09-17T05:36:17.893664+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884646+0000","last_change":"2024-09-17T05:36:17.884646+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884646+0000","last_undegraded":"2024-09-17T05:36:17.884646+0000","last_fullsized":"2024-09-17T05:36:17.884646+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.892901+0000","last_change":"2024-09-17T05:36:17.892901+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.892901+0000","last_undegraded":"2024-09-17T05:36:17.892901+0000","last_fullsized":"2024-09-17T05:36:17.892901+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884789+0000","last_change":"2024-09-17T05:36:17.884789+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884789+0000","last_undegraded":"2024-09-17T05:36:17.884789+0000","last_fullsized":"2024-09-17T05:36:17.884789+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884686+0000","last_change":"2024-09-17T05:36:17.884686+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884686+0000","last_undegraded":"2024-09-17T05:36:17.884686+0000","last_fullsized":"2024-09-17T05:36:17.884686+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904294+0000","last_change":"2024-09-17T05:36:17.897252+0000","last_active":"2024-09-17T05:36:17.904294+0000","last_peered":"2024-09-17T05:36:17.904294+0000","last_clean":"2024-09-17T05:36:17.904294+0000","last_became_active":"2024-09-17T05:36:17.896404+0000","last_became_peered":"2024-09-17T05:36:17.896404+0000","last_unstale":"2024-09-17T05:36:17.904294+0000","last_undegraded":"2024-09-17T05:36:17.904294+0000","last_fullsized":"2024-09-17T05:36:17.904294+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:04.122599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887954+0000","last_change":"2024-09-17T05:36:17.887954+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887954+0000","last_undegraded":"2024-09-17T05:36:17.887954+0000","last_fullsized":"2024-09-17T05:36:17.887954+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.897966+0000","last_change":"2024-09-17T05:36:17.894519+0000","last_active":"2024-09-17T05:36:17.897966+0000","last_peered":"2024-09-17T05:36:17.897966+0000","last_clean":"2024-09-17T05:36:17.897966+0000","last_became_active":"2024-09-17T05:36:17.894226+0000","last_became_peered":"2024-09-17T05:36:17.894226+0000","last_unstale":"2024-09-17T05:36:17.897966+0000","last_undegraded":"2024-09-17T05:36:17.897966+0000","last_fullsized":"2024-09-17T05:36:17.897966+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:42.772544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886288+0000","last_change":"2024-09-17T05:36:17.886288+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886288+0000","last_undegraded":"2024-09-17T05:36:17.886288+0000","last_fullsized":"2024-09-17T05:36:17.886288+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.910462+0000","last_change":"2024-09-17T05:36:17.905621+0000","last_active":"2024-09-17T05:36:17.910462+0000","last_peered":"2024-09-17T05:36:17.910462+0000","last_clean":"2024-09-17T05:36:17.910462+0000","last_became_active":"2024-09-17T05:36:17.905207+0000","last_became_peered":"2024-09-17T05:36:17.905207+0000","last_unstale":"2024-09-17T05:36:17.910462+0000","last_undegraded":"2024-09-17T05:36:17.910462+0000","last_fullsized":"2024-09-17T05:36:17.910462+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:44.838474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885492+0000","last_change":"2024-09-17T05:36:17.885492+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885492+0000","last_undegraded":"2024-09-17T05:36:17.885492+0000","last_fullsized":"2024-09-17T05:36:17.885492+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904651+0000","last_change":"2024-09-17T05:36:17.903329+0000","last_active":"2024-09-17T05:36:17.904651+0000","last_peered":"2024-09-17T05:36:17.904651+0000","last_clean":"2024-09-17T05:36:17.904651+0000","last_became_active":"2024-09-17T05:36:17.903072+0000","last_became_peered":"2024-09-17T05:36:17.903072+0000","last_unstale":"2024-09-17T05:36:17.904651+0000","last_undegraded":"2024-09-17T05:36:17.904651+0000","last_fullsized":"2024-09-17T05:36:17.904651+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:12.779569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886309+0000","last_change":"2024-09-17T05:36:17.886309+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886309+0000","last_undegraded":"2024-09-17T05:36:17.886309+0000","last_fullsized":"2024-09-17T05:36:17.886309+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904961+0000","last_change":"2024-09-17T05:36:17.900853+0000","last_active":"2024-09-17T05:36:17.904961+0000","last_peered":"2024-09-17T05:36:17.904961+0000","last_clean":"2024-09-17T05:36:17.904961+0000","last_became_active":"2024-09-17T05:36:17.898291+0000","last_became_peered":"2024-09-17T05:36:17.898291+0000","last_unstale":"2024-09-17T05:36:17.904961+0000","last_undegraded":"2024-09-17T05:36:17.904961+0000","last_fullsized":"2024-09-17T05:36:17.904961+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:09.616243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886376+0000","last_change":"2024-09-17T05:36:17.886376+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886376+0000","last_undegraded":"2024-09-17T05:36:17.886376+0000","last_fullsized":"2024-09-17T05:36:17.886376+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909516+0000","last_change":"2024-09-17T05:36:17.905265+0000","last_active":"2024-09-17T05:36:17.909516+0000","last_peered":"2024-09-17T05:36:17.909516+0000","last_clean":"2024-09-17T05:36:17.909516+0000","last_became_active":"2024-09-17T05:36:17.901068+0000","last_became_peered":"2024-09-17T05:36:17.901068+0000","last_unstale":"2024-09-17T05:36:17.909516+0000","last_undegraded":"2024-09-17T05:36:17.909516+0000","last_fullsized":"2024-09-17T05:36:17.909516+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:31.985911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884951+0000","last_change":"2024-09-17T05:36:17.884951+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884951+0000","last_undegraded":"2024-09-17T05:36:17.884951+0000","last_fullsized":"2024-09-17T05:36:17.884951+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911186+0000","last_change":"2024-09-17T05:36:17.909883+0000","last_active":"2024-09-17T05:36:17.911186+0000","last_peered":"2024-09-17T05:36:17.911186+0000","last_clean":"2024-09-17T05:36:17.911186+0000","last_became_active":"2024-09-17T05:36:17.909592+0000","last_became_peered":"2024-09-17T05:36:17.909592+0000","last_unstale":"2024-09-17T05:36:17.911186+0000","last_undegraded":"2024-09-17T05:36:17.911186+0000","last_fullsized":"2024-09-17T05:36:17.911186+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:02.007221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.898511+0000","last_change":"2024-09-17T05:36:17.898511+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.898511+0000","last_undegraded":"2024-09-17T05:36:17.898511+0000","last_fullsized":"2024-09-17T05:36:17.898511+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.892532+0000","last_change":"2024-09-17T05:36:17.891610+0000","last_active":"2024-09-17T05:36:17.892532+0000","last_peered":"2024-09-17T05:36:17.892532+0000","last_clean":"2024-09-17T05:36:17.892532+0000","last_became_active":"2024-09-17T05:36:17.891311+0000","last_became_peered":"2024-09-17T05:36:17.891311+0000","last_unstale":"2024-09-17T05:36:17.892532+0000","last_undegraded":"2024-09-17T05:36:17.892532+0000","last_fullsized":"2024-09-17T05:36:17.892532+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:14.454258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884273+0000","last_change":"2024-09-17T05:36:17.884273+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884273+0000","last_undegraded":"2024-09-17T05:36:17.884273+0000","last_fullsized":"2024-09-17T05:36:17.884273+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909079+0000","last_change":"2024-09-17T05:36:17.904403+0000","last_active":"2024-09-17T05:36:17.909079+0000","last_peered":"2024-09-17T05:36:17.909079+0000","last_clean":"2024-09-17T05:36:17.909079+0000","last_became_active":"2024-09-17T05:36:17.904050+0000","last_became_peered":"2024-09-17T05:36:17.904050+0000","last_unstale":"2024-09-17T05:36:17.909079+0000","last_undegraded":"2024-09-17T05:36:17.909079+0000","last_fullsized":"2024-09-17T05:36:17.909079+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:44.521389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885864+0000","last_change":"2024-09-17T05:36:17.885864+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885864+0000","last_undegraded":"2024-09-17T05:36:17.885864+0000","last_fullsized":"2024-09-17T05:36:17.885864+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911272+0000","last_change":"2024-09-17T05:36:17.907774+0000","last_active":"2024-09-17T05:36:17.911272+0000","last_peered":"2024-09-17T05:36:17.911272+0000","last_clean":"2024-09-17T05:36:17.911272+0000","last_became_active":"2024-09-17T05:36:17.907451+0000","last_became_peered":"2024-09-17T05:36:17.907451+0000","last_unstale":"2024-09-17T05:36:17.911272+0000","last_undegraded":"2024-09-17T05:36:17.911272+0000","last_fullsized":"2024-09-17T05:36:17.911272+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:28.237700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886866+0000","last_change":"2024-09-17T05:36:17.886866+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886866+0000","last_undegraded":"2024-09-17T05:36:17.886866+0000","last_fullsized":"2024-09-17T05:36:17.886866+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909346+0000","last_change":"2024-09-17T05:36:17.901928+0000","last_active":"2024-09-17T05:36:17.909346+0000","last_peered":"2024-09-17T05:36:17.909346+0000","last_clean":"2024-09-17T05:36:17.909346+0000","last_became_active":"2024-09-17T05:36:17.901658+0000","last_became_peered":"2024-09-17T05:36:17.901658+0000","last_unstale":"2024-09-17T05:36:17.909346+0000","last_undegraded":"2024-09-17T05:36:17.909346+0000","last_fullsized":"2024-09-17T05:36:17.909346+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:47.183684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.894120+0000","last_change":"2024-09-17T05:36:17.894120+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.894120+0000","last_undegraded":"2024-09-17T05:36:17.894120+0000","last_fullsized":"2024-09-17T05:36:17.894120+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911123+0000","last_change":"2024-09-17T05:36:17.909634+0000","last_active":"2024-09-17T05:36:17.911123+0000","last_peered":"2024-09-17T05:36:17.911123+0000","last_clean":"2024-09-17T05:36:17.911123+0000","last_became_active":"2024-09-17T05:36:17.909283+0000","last_became_peered":"2024-09-17T05:36:17.909283+0000","last_unstale":"2024-09-17T05:36:17.911123+0000","last_undegraded":"2024-09-17T05:36:17.911123+0000","last_fullsized":"2024-09-17T05:36:17.911123+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:04.540111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886723+0000","last_change":"2024-09-17T05:36:17.886723+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886723+0000","last_undegraded":"2024-09-17T05:36:17.886723+0000","last_fullsized":"2024-09-17T05:36:17.886723+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.905270+0000","last_change":"2024-09-17T05:36:17.902030+0000","last_active":"2024-09-17T05:36:17.905270+0000","last_peered":"2024-09-17T05:36:17.905270+0000","last_clean":"2024-09-17T05:36:17.905270+0000","last_became_active":"2024-09-17T05:36:17.901154+0000","last_became_peered":"2024-09-17T05:36:17.901154+0000","last_unstale":"2024-09-17T05:36:17.905270+0000","last_undegraded":"2024-09-17T05:36:17.905270+0000","last_fullsized":"2024-09-17T05:36:17.905270+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:26.536681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885002+0000","last_change":"2024-09-17T05:36:17.885002+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885002+0000","last_undegraded":"2024-09-17T05:36:17.885002+0000","last_fullsized":"2024-09-17T05:36:17.885002+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911207+0000","last_change":"2024-09-17T05:36:17.906929+0000","last_active":"2024-09-17T05:36:17.911207+0000","last_peered":"2024-09-17T05:36:17.911207+0000","last_clean":"2024-09-17T05:36:17.911207+0000","last_became_active":"2024-09-17T05:36:17.906657+0000","last_became_peered":"2024-09-17T05:36:17.906657+0000","last_unstale":"2024-09-17T05:36:17.911207+0000","last_undegraded":"2024-09-17T05:36:17.911207+0000","last_fullsized":"2024-09-17T05:36:17.911207+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:04.425419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884821+0000","last_change":"2024-09-17T05:36:17.884821+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884821+0000","last_undegraded":"2024-09-17T05:36:17.884821+0000","last_fullsized":"2024-09-17T05:36:17.884821+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911164+0000","last_change":"2024-09-17T05:36:17.909786+0000","last_active":"2024-09-17T05:36:17.911164+0000","last_peered":"2024-09-17T05:36:17.911164+0000","last_clean":"2024-09-17T05:36:17.911164+0000","last_became_active":"2024-09-17T05:36:17.909389+0000","last_became_peered":"2024-09-17T05:36:17.909389+0000","last_unstale":"2024-09-17T05:36:17.911164+0000","last_undegraded":"2024-09-17T05:36:17.911164+0000","last_fullsized":"2024-09-17T05:36:17.911164+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:02.011245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887351+0000","last_change":"2024-09-17T05:36:17.887351+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887351+0000","last_undegraded":"2024-09-17T05:36:17.887351+0000","last_fullsized":"2024-09-17T05:36:17.887351+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909507+0000","last_change":"2024-09-17T05:36:17.904457+0000","last_active":"2024-09-17T05:36:17.909507+0000","last_peered":"2024-09-17T05:36:17.909507+0000","last_clean":"2024-09-17T05:36:17.909507+0000","last_became_active":"2024-09-17T05:36:17.904044+0000","last_became_peered":"2024-09-17T05:36:17.904044+0000","last_unstale":"2024-09-17T05:36:17.909507+0000","last_undegraded":"2024-09-17T05:36:17.909507+0000","last_fullsized":"2024-09-17T05:36:17.909507+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:03.142400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884659+0000","last_change":"2024-09-17T05:36:17.884659+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884659+0000","last_undegraded":"2024-09-17T05:36:17.884659+0000","last_fullsized":"2024-09-17T05:36:17.884659+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.900621+0000","last_change":"2024-09-17T05:36:17.889028+0000","last_active":"2024-09-17T05:36:17.900621+0000","last_peered":"2024-09-17T05:36:17.900621+0000","last_clean":"2024-09-17T05:36:17.900621+0000","last_became_active":"2024-09-17T05:36:17.886151+0000","last_became_peered":"2024-09-17T05:36:17.886151+0000","last_unstale":"2024-09-17T05:36:17.900621+0000","last_undegraded":"2024-09-17T05:36:17.900621+0000","last_fullsized":"2024-09-17T05:36:17.900621+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:30.991576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884985+0000","last_change":"2024-09-17T05:36:17.884985+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884985+0000","last_undegraded":"2024-09-17T05:36:17.884985+0000","last_fullsized":"2024-09-17T05:36:17.884985+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.910481+0000","last_change":"2024-09-17T05:36:17.909303+0000","last_active":"2024-09-17T05:36:17.910481+0000","last_peered":"2024-09-17T05:36:17.910481+0000","last_clean":"2024-09-17T05:36:17.910481+0000","last_became_active":"2024-09-17T05:36:17.909058+0000","last_became_peered":"2024-09-17T05:36:17.909058+0000","last_unstale":"2024-09-17T05:36:17.910481+0000","last_undegraded":"2024-09-17T05:36:17.910481+0000","last_fullsized":"2024-09-17T05:36:17.910481+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:13.555451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.897036+0000","last_change":"2024-09-17T05:36:17.897036+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.897036+0000","last_undegraded":"2024-09-17T05:36:17.897036+0000","last_fullsized":"2024-09-17T05:36:17.897036+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.903214+0000","last_change":"2024-09-17T05:36:17.900645+0000","last_active":"2024-09-17T05:36:17.903214+0000","last_peered":"2024-09-17T05:36:17.903214+0000","last_clean":"2024-09-17T05:36:17.903214+0000","last_became_active":"2024-09-17T05:36:17.900338+0000","last_became_peered":"2024-09-17T05:36:17.900338+0000","last_unstale":"2024-09-17T05:36:17.903214+0000","last_undegraded":"2024-09-17T05:36:17.903214+0000","last_fullsized":"2024-09-17T05:36:17.903214+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:49.857913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885882+0000","last_change":"2024-09-17T05:36:17.885882+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885882+0000","last_undegraded":"2024-09-17T05:36:17.885882+0000","last_fullsized":"2024-09-17T05:36:17.885882+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.910360+0000","last_change":"2024-09-17T05:36:17.903150+0000","last_active":"2024-09-17T05:36:17.910360+0000","last_peered":"2024-09-17T05:36:17.910360+0000","last_clean":"2024-09-17T05:36:17.910360+0000","last_became_active":"2024-09-17T05:36:17.902834+0000","last_became_peered":"2024-09-17T05:36:17.902834+0000","last_unstale":"2024-09-17T05:36:17.910360+0000","last_undegraded":"2024-09-17T05:36:17.910360+0000","last_fullsized":"2024-09-17T05:36:17.910360+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:16.005227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.883993+0000","last_change":"2024-09-17T05:36:17.883993+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.883993+0000","last_undegraded":"2024-09-17T05:36:17.883993+0000","last_fullsized":"2024-09-17T05:36:17.883993+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.908976+0000","last_change":"2024-09-17T05:36:17.904001+0000","last_active":"2024-09-17T05:36:17.908976+0000","last_peered":"2024-09-17T05:36:17.908976+0000","last_clean":"2024-09-17T05:36:17.908976+0000","last_became_active":"2024-09-17T05:36:17.900330+0000","last_became_peered":"2024-09-17T05:36:17.900330+0000","last_unstale":"2024-09-17T05:36:17.908976+0000","last_undegraded":"2024-09-17T05:36:17.908976+0000","last_fullsized":"2024-09-17T05:36:17.908976+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:55.927724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.898299+0000","last_change":"2024-09-17T05:36:17.898299+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.898299+0000","last_undegraded":"2024-09-17T05:36:17.898299+0000","last_fullsized":"2024-09-17T05:36:17.898299+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.910474+0000","last_change":"2024-09-17T05:36:17.905019+0000","last_active":"2024-09-17T05:36:17.910474+0000","last_peered":"2024-09-17T05:36:17.910474+0000","last_clean":"2024-09-17T05:36:17.910474+0000","last_became_active":"2024-09-17T05:36:17.903334+0000","last_became_peered":"2024-09-17T05:36:17.903334+0000","last_unstale":"2024-09-17T05:36:17.910474+0000","last_undegraded":"2024-09-17T05:36:17.910474+0000","last_fullsized":"2024-09-17T05:36:17.910474+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:22.248556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885764+0000","last_change":"2024-09-17T05:36:17.885764+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885764+0000","last_undegraded":"2024-09-17T05:36:17.885764+0000","last_fullsized":"2024-09-17T05:36:17.885764+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904722+0000","last_change":"2024-09-17T05:36:17.903608+0000","last_active":"2024-09-17T05:36:17.904722+0000","last_peered":"2024-09-17T05:36:17.904722+0000","last_clean":"2024-09-17T05:36:17.904722+0000","last_became_active":"2024-09-17T05:36:17.903276+0000","last_became_peered":"2024-09-17T05:36:17.903276+0000","last_unstale":"2024-09-17T05:36:17.904722+0000","last_undegraded":"2024-09-17T05:36:17.904722+0000","last_fullsized":"2024-09-17T05:36:17.904722+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:37.580096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.890489+0000","last_change":"2024-09-17T05:36:17.890489+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.890489+0000","last_undegraded":"2024-09-17T05:36:17.890489+0000","last_fullsized":"2024-09-17T05:36:17.890489+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909108+0000","last_change":"2024-09-17T05:36:17.908490+0000","last_active":"2024-09-17T05:36:17.909108+0000","last_peered":"2024-09-17T05:36:17.909108+0000","last_clean":"2024-09-17T05:36:17.909108+0000","last_became_active":"2024-09-17T05:36:17.908181+0000","last_became_peered":"2024-09-17T05:36:17.908181+0000","last_unstale":"2024-09-17T05:36:17.909108+0000","last_undegraded":"2024-09-17T05:36:17.909108+0000","last_fullsized":"2024-09-17T05:36:17.909108+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:58.629626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887331+0000","last_change":"2024-09-17T05:36:17.887331+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887331+0000","last_undegraded":"2024-09-17T05:36:17.887331+0000","last_fullsized":"2024-09-17T05:36:17.887331+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.907739+0000","last_change":"2024-09-17T05:36:17.904703+0000","last_active":"2024-09-17T05:36:17.907739+0000","last_peered":"2024-09-17T05:36:17.907739+0000","last_clean":"2024-09-17T05:36:17.907739+0000","last_became_active":"2024-09-17T05:36:17.903663+0000","last_became_peered":"2024-09-17T05:36:17.903663+0000","last_unstale":"2024-09-17T05:36:17.907739+0000","last_undegraded":"2024-09-17T05:36:17.907739+0000","last_fullsized":"2024-09-17T05:36:17.907739+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:29.342878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885070+0000","last_change":"2024-09-17T05:36:17.885070+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885070+0000","last_undegraded":"2024-09-17T05:36:17.885070+0000","last_fullsized":"2024-09-17T05:36:17.885070+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.907501+0000","last_change":"2024-09-17T05:36:17.903663+0000","last_active":"2024-09-17T05:36:17.907501+0000","last_peered":"2024-09-17T05:36:17.907501+0000","last_clean":"2024-09-17T05:36:17.907501+0000","last_became_active":"2024-09-17T05:36:17.903373+0000","last_became_peered":"2024-09-17T05:36:17.903373+0000","last_unstale":"2024-09-17T05:36:17.907501+0000","last_undegraded":"2024-09-17T05:36:17.907501+0000","last_fullsized":"2024-09-17T05:36:17.907501+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:54.399557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885530+0000","last_change":"2024-09-17T05:36:17.885530+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885530+0000","last_undegraded":"2024-09-17T05:36:17.885530+0000","last_fullsized":"2024-09-17T05:36:17.885530+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.900766+0000","last_change":"2024-09-17T05:36:17.889967+0000","last_active":"2024-09-17T05:36:17.900766+0000","last_peered":"2024-09-17T05:36:17.900766+0000","last_clean":"2024-09-17T05:36:17.900766+0000","last_became_active":"2024-09-17T05:36:17.889687+0000","last_became_peered":"2024-09-17T05:36:17.889687+0000","last_unstale":"2024-09-17T05:36:17.900766+0000","last_undegraded":"2024-09-17T05:36:17.900766+0000","last_fullsized":"2024-09-17T05:36:17.900766+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:52.746071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.888637+0000","last_change":"2024-09-17T05:36:17.888637+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.888637+0000","last_undegraded":"2024-09-17T05:36:17.888637+0000","last_fullsized":"2024-09-17T05:36:17.888637+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904102+0000","last_change":"2024-09-17T05:36:17.901496+0000","last_active":"2024-09-17T05:36:17.904102+0000","last_peered":"2024-09-17T05:36:17.904102+0000","last_clean":"2024-09-17T05:36:17.904102+0000","last_became_active":"2024-09-17T05:36:17.901170+0000","last_became_peered":"2024-09-17T05:36:17.901170+0000","last_unstale":"2024-09-17T05:36:17.904102+0000","last_undegraded":"2024-09-17T05:36:17.904102+0000","last_fullsized":"2024-09-17T05:36:17.904102+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:54.128073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.888619+0000","last_change":"2024-09-17T05:36:17.888619+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.888619+0000","last_undegraded":"2024-09-17T05:36:17.888619+0000","last_fullsized":"2024-09-17T05:36:17.888619+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.897089+0000","last_change":"2024-09-17T05:36:17.894247+0000","last_active":"2024-09-17T05:36:17.897089+0000","last_peered":"2024-09-17T05:36:17.897089+0000","last_clean":"2024-09-17T05:36:17.897089+0000","last_became_active":"2024-09-17T05:36:17.892459+0000","last_became_peered":"2024-09-17T05:36:17.892459+0000","last_unstale":"2024-09-17T05:36:17.897089+0000","last_undegraded":"2024-09-17T05:36:17.897089+0000","last_fullsized":"2024-09-17T05:36:17.897089+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:03.778158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.893917+0000","last_change":"2024-09-17T05:36:17.893917+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.893917+0000","last_undegraded":"2024-09-17T05:36:17.893917+0000","last_fullsized":"2024-09-17T05:36:17.893917+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.902602+0000","last_change":"2024-09-17T05:36:17.900164+0000","last_active":"2024-09-17T05:36:17.902602+0000","last_peered":"2024-09-17T05:36:17.902602+0000","last_clean":"2024-09-17T05:36:17.902602+0000","last_became_active":"2024-09-17T05:36:17.899350+0000","last_became_peered":"2024-09-17T05:36:17.899350+0000","last_unstale":"2024-09-17T05:36:17.902602+0000","last_undegraded":"2024-09-17T05:36:17.902602+0000","last_fullsized":"2024-09-17T05:36:17.902602+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:21:14.211298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885327+0000","last_change":"2024-09-17T05:36:17.885327+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885327+0000","last_undegraded":"2024-09-17T05:36:17.885327+0000","last_fullsized":"2024-09-17T05:36:17.885327+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909253+0000","last_change":"2024-09-17T05:36:17.899163+0000","last_active":"2024-09-17T05:36:17.909253+0000","last_peered":"2024-09-17T05:36:17.909253+0000","last_clean":"2024-09-17T05:36:17.909253+0000","last_became_active":"2024-09-17T05:36:17.898886+0000","last_became_peered":"2024-09-17T05:36:17.898886+0000","last_unstale":"2024-09-17T05:36:17.909253+0000","last_undegraded":"2024-09-17T05:36:17.909253+0000","last_fullsized":"2024-09-17T05:36:17.909253+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:44:47.420121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884877+0000","last_change":"2024-09-17T05:36:17.884877+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884877+0000","last_undegraded":"2024-09-17T05:36:17.884877+0000","last_fullsized":"2024-09-17T05:36:17.884877+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.903707+0000","last_change":"2024-09-17T05:36:17.902499+0000","last_active":"2024-09-17T05:36:17.903707+0000","last_peered":"2024-09-17T05:36:17.903707+0000","last_clean":"2024-09-17T05:36:17.903707+0000","last_became_active":"2024-09-17T05:36:17.902216+0000","last_became_peered":"2024-09-17T05:36:17.902216+0000","last_unstale":"2024-09-17T05:36:17.903707+0000","last_undegraded":"2024-09-17T05:36:17.903707+0000","last_fullsized":"2024-09-17T05:36:17.903707+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:07.872232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":374,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.889922+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:36:17.889922+0000","last_peered":"2024-09-17T05:36:17.889922+0000","last_clean":"2024-09-17T05:36:17.889922+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:36:17.889922+0000","last_undegraded":"2024-09-17T05:36:17.889922+0000","last_fullsized":"2024-09-17T05:36:17.889922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509536,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33612,"kb_used_data":2420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338228,"statfs":{"total":96636764160,"available":96602345472,"internally_reserved":0,"allocated":2478080,"data_stored":1419379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542240,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33028,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509537,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33028,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509535,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542239,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37772,"kb_used_data":2420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334068,"statfs":{"total":96636764160,"available":96598085632,"internally_reserved":0,"allocated":2478080,"data_stored":1419379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:36:23.462 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:36:23.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.648+0000 7fb609600640 1 -- 172.21.15.31:0/189960690 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb60415bea0 msgr2=0x7fb6040ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.648+0000 7fb609600640 1 --2- 172.21.15.31:0/189960690 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb60415bea0 0x7fb6040ce670 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009840 tx=0x7fb5f401c820 comp rx=0 tx=0).stop 2024-09-17T05:36:23.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.648+0000 7fb609600640 1 -- 172.21.15.31:0/189960690 shutdown_connections 2024-09-17T05:36:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.648+0000 7fb609600640 1 --2- 172.21.15.31:0/189960690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6040cdb30 0x7fb6040cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.648+0000 7fb609600640 1 --2- 172.21.15.31:0/189960690 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb60415bea0 0x7fb6040ce670 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.648+0000 7fb609600640 1 -- 172.21.15.31:0/189960690 >> 172.21.15.31:0/189960690 conn(0x7fb6040d1dc0 msgr2=0x7fb6040d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.648+0000 7fb609600640 1 -- 172.21.15.31:0/189960690 shutdown_connections 2024-09-17T05:36:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.648+0000 7fb609600640 1 -- 172.21.15.31:0/189960690 wait complete. 2024-09-17T05:36:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.648+0000 7fb609600640 1 Processor -- start 2024-09-17T05:36:23.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb609600640 1 -- start start 2024-09-17T05:36:23.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb609600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6040cdb30 0x7fb6040b1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:23.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb609600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6040d28e0 0x7fb6040c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:23.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb609600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb60415bea0 0x7fb6040b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:23.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb609600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb604168fc0 con 0x7fb6040d28e0 2024-09-17T05:36:23.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb609600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb604168e40 con 0x7fb60415bea0 2024-09-17T05:36:23.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb609600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb604169140 con 0x7fb6040cdb30 2024-09-17T05:36:23.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb5fbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6040d28e0 0x7fb6040c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:23.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb5fbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6040d28e0 0x7fb6040c7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34694/0 (socket says 172.21.15.31:34694) 2024-09-17T05:36:23.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb5fbe00640 1 -- 172.21.15.31:0/2648500918 learned_addr learned my addr 172.21.15.31:0/2648500918 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:23.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb602a00640 1 --2- 172.21.15.31:0/2648500918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6040cdb30 0x7fb6040b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:23.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb603400640 1 --2- 172.21.15.31:0/2648500918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb60415bea0 0x7fb6040b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:23.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb5fbe00640 1 -- 172.21.15.31:0/2648500918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6040cdb30 msgr2=0x7fb6040b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb5fbe00640 1 --2- 172.21.15.31:0/2648500918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6040cdb30 0x7fb6040b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb5fbe00640 1 -- 172.21.15.31:0/2648500918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb60415bea0 msgr2=0x7fb6040b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb5fbe00640 1 --2- 172.21.15.31:0/2648500918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb60415bea0 0x7fb6040b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb5fbe00640 1 -- 172.21.15.31:0/2648500918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6040c8210 con 0x7fb6040d28e0 2024-09-17T05:36:23.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb603400640 1 --2- 172.21.15.31:0/2648500918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb60415bea0 0x7fb6040b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:23.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb5fbe00640 1 --2- 172.21.15.31:0/2648500918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6040d28e0 0x7fb6040c7cd0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00c970 tx=0x7fb5ec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:23.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb5faa00640 1 -- 172.21.15.31:0/2648500918 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec007c70 con 0x7fb6040d28e0 2024-09-17T05:36:23.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb5faa00640 1 -- 172.21.15.31:0/2648500918 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5ec00f450 con 0x7fb6040d28e0 2024-09-17T05:36:23.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb5faa00640 1 -- 172.21.15.31:0/2648500918 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec00f8a0 con 0x7fb6040d28e0 2024-09-17T05:36:23.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb609600640 1 -- 172.21.15.31:0/2648500918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6040b5210 con 0x7fb6040d28e0 2024-09-17T05:36:23.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb609600640 1 -- 172.21.15.31:0/2648500918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6040b57a0 con 0x7fb6040d28e0 2024-09-17T05:36:23.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.652+0000 7fb609600640 1 -- 172.21.15.31:0/2648500918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6040cc9d0 con 0x7fb6040d28e0 2024-09-17T05:36:23.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.656+0000 7fb5faa00640 1 -- 172.21.15.31:0/2648500918 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7fb5ec00fa40 con 0x7fb6040d28e0 2024-09-17T05:36:23.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.656+0000 7fb5faa00640 1 --2- 172.21.15.31:0/2648500918 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb5e0073a70 0x7fb5e0075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:23.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.656+0000 7fb5faa00640 1 -- 172.21.15.31:0/2648500918 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fb5ec095d80 con 0x7fb6040d28e0 2024-09-17T05:36:23.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.656+0000 7fb602a00640 1 --2- 172.21.15.31:0/2648500918 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb5e0073a70 0x7fb5e0075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:23.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.656+0000 7fb602a00640 1 --2- 172.21.15.31:0/2648500918 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb5e0073a70 0x7fb5e0075f30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40af000 tx=0x7fb5f401b060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:23.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.660+0000 7fb5faa00640 1 -- 172.21.15.31:0/2648500918 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb5ec014030 con 0x7fb6040d28e0 2024-09-17T05:36:23.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.836+0000 7fb609600640 1 -- 172.21.15.31:0/2648500918 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6040b0660 con 0x7fb5e0073a70 2024-09-17T05:36:23.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.840+0000 7fb5faa00640 1 -- 172.21.15.31:0/2648500918 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247112 (secure 0 0 0) 0x7fb6040b0660 con 0x7fb5e0073a70 2024-09-17T05:36:23.843 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:23.845 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:36:23.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.844+0000 7fb609600640 1 -- 172.21.15.31:0/2648500918 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb5e0073a70 msgr2=0x7fb5e0075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.844+0000 7fb609600640 1 --2- 172.21.15.31:0/2648500918 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb5e0073a70 0x7fb5e0075f30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40af000 tx=0x7fb5f401b060 comp rx=0 tx=0).stop 2024-09-17T05:36:23.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.844+0000 7fb609600640 1 -- 172.21.15.31:0/2648500918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6040d28e0 msgr2=0x7fb6040c7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:23.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.844+0000 7fb609600640 1 --2- 172.21.15.31:0/2648500918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6040d28e0 0x7fb6040c7cd0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00c970 tx=0x7fb5ec00ce30 comp rx=0 tx=0).stop 2024-09-17T05:36:23.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.844+0000 7fb609600640 1 -- 172.21.15.31:0/2648500918 shutdown_connections 2024-09-17T05:36:23.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.844+0000 7fb609600640 1 --2- 172.21.15.31:0/2648500918 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb5e0073a70 0x7fb5e0075f30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.844+0000 7fb609600640 1 --2- 172.21.15.31:0/2648500918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb60415bea0 0x7fb6040b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.844+0000 7fb609600640 1 --2- 172.21.15.31:0/2648500918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6040d28e0 0x7fb6040c7cd0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.844+0000 7fb609600640 1 --2- 172.21.15.31:0/2648500918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6040cdb30 0x7fb6040b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:23.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.844+0000 7fb609600640 1 -- 172.21.15.31:0/2648500918 >> 172.21.15.31:0/2648500918 conn(0x7fb6040d1dc0 msgr2=0x7fb6040cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:23.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.844+0000 7fb609600640 1 -- 172.21.15.31:0/2648500918 shutdown_connections 2024-09-17T05:36:23.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:23.844+0000 7fb609600640 1 -- 172.21.15.31:0/2648500918 wait complete. 2024-09-17T05:36:23.865 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-09-17T05:36:22.747861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":269568,"kb_used_data":15880,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754705152,"statfs":{"total":773094113280,"available":772818075648,"internally_reserved":0,"allocated":16261120,"data_stored":7812824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.875083"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.889233+0000","last_change":"2024-09-17T05:36:17.889233+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.889233+0000","last_undegraded":"2024-09-17T05:36:17.889233+0000","last_fullsized":"2024-09-17T05:36:17.889233+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.896633+0000","last_change":"2024-09-17T05:36:17.896633+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.896633+0000","last_undegraded":"2024-09-17T05:36:17.896633+0000","last_fullsized":"2024-09-17T05:36:17.896633+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.895608+0000","last_change":"2024-09-17T05:36:17.895608+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.895608+0000","last_undegraded":"2024-09-17T05:36:17.895608+0000","last_fullsized":"2024-09-17T05:36:17.895608+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.896065+0000","last_change":"2024-09-17T05:36:17.896065+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.896065+0000","last_undegraded":"2024-09-17T05:36:17.896065+0000","last_fullsized":"2024-09-17T05:36:17.896065+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.890523+0000","last_change":"2024-09-17T05:36:17.890523+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.890523+0000","last_undegraded":"2024-09-17T05:36:17.890523+0000","last_fullsized":"2024-09-17T05:36:17.890523+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.894650+0000","last_change":"2024-09-17T05:36:17.894650+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.894650+0000","last_undegraded":"2024-09-17T05:36:17.894650+0000","last_fullsized":"2024-09-17T05:36:17.894650+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885424+0000","last_change":"2024-09-17T05:36:17.885424+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885424+0000","last_undegraded":"2024-09-17T05:36:17.885424+0000","last_fullsized":"2024-09-17T05:36:17.885424+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887419+0000","last_change":"2024-09-17T05:36:17.887419+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887419+0000","last_undegraded":"2024-09-17T05:36:17.887419+0000","last_fullsized":"2024-09-17T05:36:17.887419+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886342+0000","last_change":"2024-09-17T05:36:17.886342+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886342+0000","last_undegraded":"2024-09-17T05:36:17.886342+0000","last_fullsized":"2024-09-17T05:36:17.886342+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887831+0000","last_change":"2024-09-17T05:36:17.887831+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887831+0000","last_undegraded":"2024-09-17T05:36:17.887831+0000","last_fullsized":"2024-09-17T05:36:17.887831+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885499+0000","last_change":"2024-09-17T05:36:17.885499+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885499+0000","last_undegraded":"2024-09-17T05:36:17.885499+0000","last_fullsized":"2024-09-17T05:36:17.885499+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.895660+0000","last_change":"2024-09-17T05:36:17.895660+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.895660+0000","last_undegraded":"2024-09-17T05:36:17.895660+0000","last_fullsized":"2024-09-17T05:36:17.895660+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.897723+0000","last_change":"2024-09-17T05:36:17.897723+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.897723+0000","last_undegraded":"2024-09-17T05:36:17.897723+0000","last_fullsized":"2024-09-17T05:36:17.897723+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885231+0000","last_change":"2024-09-17T05:36:17.885231+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885231+0000","last_undegraded":"2024-09-17T05:36:17.885231+0000","last_fullsized":"2024-09-17T05:36:17.885231+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.896078+0000","last_change":"2024-09-17T05:36:17.896078+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.896078+0000","last_undegraded":"2024-09-17T05:36:17.896078+0000","last_fullsized":"2024-09-17T05:36:17.896078+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886983+0000","last_change":"2024-09-17T05:36:17.886983+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886983+0000","last_undegraded":"2024-09-17T05:36:17.886983+0000","last_fullsized":"2024-09-17T05:36:17.886983+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.892630+0000","last_change":"2024-09-17T05:36:17.892630+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.892630+0000","last_undegraded":"2024-09-17T05:36:17.892630+0000","last_fullsized":"2024-09-17T05:36:17.892630+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.888639+0000","last_change":"2024-09-17T05:36:17.888639+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.888639+0000","last_undegraded":"2024-09-17T05:36:17.888639+0000","last_fullsized":"2024-09-17T05:36:17.888639+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886496+0000","last_change":"2024-09-17T05:36:17.886496+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886496+0000","last_undegraded":"2024-09-17T05:36:17.886496+0000","last_fullsized":"2024-09-17T05:36:17.886496+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.890668+0000","last_change":"2024-09-17T05:36:17.890668+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.890668+0000","last_undegraded":"2024-09-17T05:36:17.890668+0000","last_fullsized":"2024-09-17T05:36:17.890668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.888612+0000","last_change":"2024-09-17T05:36:17.888612+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.888612+0000","last_undegraded":"2024-09-17T05:36:17.888612+0000","last_fullsized":"2024-09-17T05:36:17.888612+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886739+0000","last_change":"2024-09-17T05:36:17.886739+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886739+0000","last_undegraded":"2024-09-17T05:36:17.886739+0000","last_fullsized":"2024-09-17T05:36:17.886739+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.893398+0000","last_change":"2024-09-17T05:36:17.893398+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.893398+0000","last_undegraded":"2024-09-17T05:36:17.893398+0000","last_fullsized":"2024-09-17T05:36:17.893398+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886501+0000","last_change":"2024-09-17T05:36:17.886501+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886501+0000","last_undegraded":"2024-09-17T05:36:17.886501+0000","last_fullsized":"2024-09-17T05:36:17.886501+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.894815+0000","last_change":"2024-09-17T05:36:17.894815+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.894815+0000","last_undegraded":"2024-09-17T05:36:17.894815+0000","last_fullsized":"2024-09-17T05:36:17.894815+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885868+0000","last_change":"2024-09-17T05:36:17.885868+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885868+0000","last_undegraded":"2024-09-17T05:36:17.885868+0000","last_fullsized":"2024-09-17T05:36:17.885868+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.894906+0000","last_change":"2024-09-17T05:36:17.894906+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.894906+0000","last_undegraded":"2024-09-17T05:36:17.894906+0000","last_fullsized":"2024-09-17T05:36:17.894906+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.890199+0000","last_change":"2024-09-17T05:36:17.890199+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.890199+0000","last_undegraded":"2024-09-17T05:36:17.890199+0000","last_fullsized":"2024-09-17T05:36:17.890199+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.893664+0000","last_change":"2024-09-17T05:36:17.893664+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.893664+0000","last_undegraded":"2024-09-17T05:36:17.893664+0000","last_fullsized":"2024-09-17T05:36:17.893664+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884646+0000","last_change":"2024-09-17T05:36:17.884646+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884646+0000","last_undegraded":"2024-09-17T05:36:17.884646+0000","last_fullsized":"2024-09-17T05:36:17.884646+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.892901+0000","last_change":"2024-09-17T05:36:17.892901+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.892901+0000","last_undegraded":"2024-09-17T05:36:17.892901+0000","last_fullsized":"2024-09-17T05:36:17.892901+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884789+0000","last_change":"2024-09-17T05:36:17.884789+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884789+0000","last_undegraded":"2024-09-17T05:36:17.884789+0000","last_fullsized":"2024-09-17T05:36:17.884789+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884686+0000","last_change":"2024-09-17T05:36:17.884686+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884686+0000","last_undegraded":"2024-09-17T05:36:17.884686+0000","last_fullsized":"2024-09-17T05:36:17.884686+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904294+0000","last_change":"2024-09-17T05:36:17.897252+0000","last_active":"2024-09-17T05:36:17.904294+0000","last_peered":"2024-09-17T05:36:17.904294+0000","last_clean":"2024-09-17T05:36:17.904294+0000","last_became_active":"2024-09-17T05:36:17.896404+0000","last_became_peered":"2024-09-17T05:36:17.896404+0000","last_unstale":"2024-09-17T05:36:17.904294+0000","last_undegraded":"2024-09-17T05:36:17.904294+0000","last_fullsized":"2024-09-17T05:36:17.904294+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:04.122599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887954+0000","last_change":"2024-09-17T05:36:17.887954+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887954+0000","last_undegraded":"2024-09-17T05:36:17.887954+0000","last_fullsized":"2024-09-17T05:36:17.887954+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.897966+0000","last_change":"2024-09-17T05:36:17.894519+0000","last_active":"2024-09-17T05:36:17.897966+0000","last_peered":"2024-09-17T05:36:17.897966+0000","last_clean":"2024-09-17T05:36:17.897966+0000","last_became_active":"2024-09-17T05:36:17.894226+0000","last_became_peered":"2024-09-17T05:36:17.894226+0000","last_unstale":"2024-09-17T05:36:17.897966+0000","last_undegraded":"2024-09-17T05:36:17.897966+0000","last_fullsized":"2024-09-17T05:36:17.897966+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:42.772544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886288+0000","last_change":"2024-09-17T05:36:17.886288+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886288+0000","last_undegraded":"2024-09-17T05:36:17.886288+0000","last_fullsized":"2024-09-17T05:36:17.886288+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.910462+0000","last_change":"2024-09-17T05:36:17.905621+0000","last_active":"2024-09-17T05:36:17.910462+0000","last_peered":"2024-09-17T05:36:17.910462+0000","last_clean":"2024-09-17T05:36:17.910462+0000","last_became_active":"2024-09-17T05:36:17.905207+0000","last_became_peered":"2024-09-17T05:36:17.905207+0000","last_unstale":"2024-09-17T05:36:17.910462+0000","last_undegraded":"2024-09-17T05:36:17.910462+0000","last_fullsized":"2024-09-17T05:36:17.910462+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:44.838474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885492+0000","last_change":"2024-09-17T05:36:17.885492+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885492+0000","last_undegraded":"2024-09-17T05:36:17.885492+0000","last_fullsized":"2024-09-17T05:36:17.885492+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904651+0000","last_change":"2024-09-17T05:36:17.903329+0000","last_active":"2024-09-17T05:36:17.904651+0000","last_peered":"2024-09-17T05:36:17.904651+0000","last_clean":"2024-09-17T05:36:17.904651+0000","last_became_active":"2024-09-17T05:36:17.903072+0000","last_became_peered":"2024-09-17T05:36:17.903072+0000","last_unstale":"2024-09-17T05:36:17.904651+0000","last_undegraded":"2024-09-17T05:36:17.904651+0000","last_fullsized":"2024-09-17T05:36:17.904651+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:12.779569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886309+0000","last_change":"2024-09-17T05:36:17.886309+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886309+0000","last_undegraded":"2024-09-17T05:36:17.886309+0000","last_fullsized":"2024-09-17T05:36:17.886309+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904961+0000","last_change":"2024-09-17T05:36:17.900853+0000","last_active":"2024-09-17T05:36:17.904961+0000","last_peered":"2024-09-17T05:36:17.904961+0000","last_clean":"2024-09-17T05:36:17.904961+0000","last_became_active":"2024-09-17T05:36:17.898291+0000","last_became_peered":"2024-09-17T05:36:17.898291+0000","last_unstale":"2024-09-17T05:36:17.904961+0000","last_undegraded":"2024-09-17T05:36:17.904961+0000","last_fullsized":"2024-09-17T05:36:17.904961+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:09.616243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886376+0000","last_change":"2024-09-17T05:36:17.886376+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886376+0000","last_undegraded":"2024-09-17T05:36:17.886376+0000","last_fullsized":"2024-09-17T05:36:17.886376+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909516+0000","last_change":"2024-09-17T05:36:17.905265+0000","last_active":"2024-09-17T05:36:17.909516+0000","last_peered":"2024-09-17T05:36:17.909516+0000","last_clean":"2024-09-17T05:36:17.909516+0000","last_became_active":"2024-09-17T05:36:17.901068+0000","last_became_peered":"2024-09-17T05:36:17.901068+0000","last_unstale":"2024-09-17T05:36:17.909516+0000","last_undegraded":"2024-09-17T05:36:17.909516+0000","last_fullsized":"2024-09-17T05:36:17.909516+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:31.985911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884951+0000","last_change":"2024-09-17T05:36:17.884951+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884951+0000","last_undegraded":"2024-09-17T05:36:17.884951+0000","last_fullsized":"2024-09-17T05:36:17.884951+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911186+0000","last_change":"2024-09-17T05:36:17.909883+0000","last_active":"2024-09-17T05:36:17.911186+0000","last_peered":"2024-09-17T05:36:17.911186+0000","last_clean":"2024-09-17T05:36:17.911186+0000","last_became_active":"2024-09-17T05:36:17.909592+0000","last_became_peered":"2024-09-17T05:36:17.909592+0000","last_unstale":"2024-09-17T05:36:17.911186+0000","last_undegraded":"2024-09-17T05:36:17.911186+0000","last_fullsized":"2024-09-17T05:36:17.911186+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:02.007221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.898511+0000","last_change":"2024-09-17T05:36:17.898511+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.898511+0000","last_undegraded":"2024-09-17T05:36:17.898511+0000","last_fullsized":"2024-09-17T05:36:17.898511+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.892532+0000","last_change":"2024-09-17T05:36:17.891610+0000","last_active":"2024-09-17T05:36:17.892532+0000","last_peered":"2024-09-17T05:36:17.892532+0000","last_clean":"2024-09-17T05:36:17.892532+0000","last_became_active":"2024-09-17T05:36:17.891311+0000","last_became_peered":"2024-09-17T05:36:17.891311+0000","last_unstale":"2024-09-17T05:36:17.892532+0000","last_undegraded":"2024-09-17T05:36:17.892532+0000","last_fullsized":"2024-09-17T05:36:17.892532+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:14.454258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884273+0000","last_change":"2024-09-17T05:36:17.884273+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884273+0000","last_undegraded":"2024-09-17T05:36:17.884273+0000","last_fullsized":"2024-09-17T05:36:17.884273+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909079+0000","last_change":"2024-09-17T05:36:17.904403+0000","last_active":"2024-09-17T05:36:17.909079+0000","last_peered":"2024-09-17T05:36:17.909079+0000","last_clean":"2024-09-17T05:36:17.909079+0000","last_became_active":"2024-09-17T05:36:17.904050+0000","last_became_peered":"2024-09-17T05:36:17.904050+0000","last_unstale":"2024-09-17T05:36:17.909079+0000","last_undegraded":"2024-09-17T05:36:17.909079+0000","last_fullsized":"2024-09-17T05:36:17.909079+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:44.521389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885864+0000","last_change":"2024-09-17T05:36:17.885864+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885864+0000","last_undegraded":"2024-09-17T05:36:17.885864+0000","last_fullsized":"2024-09-17T05:36:17.885864+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911272+0000","last_change":"2024-09-17T05:36:17.907774+0000","last_active":"2024-09-17T05:36:17.911272+0000","last_peered":"2024-09-17T05:36:17.911272+0000","last_clean":"2024-09-17T05:36:17.911272+0000","last_became_active":"2024-09-17T05:36:17.907451+0000","last_became_peered":"2024-09-17T05:36:17.907451+0000","last_unstale":"2024-09-17T05:36:17.911272+0000","last_undegraded":"2024-09-17T05:36:17.911272+0000","last_fullsized":"2024-09-17T05:36:17.911272+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:28.237700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886866+0000","last_change":"2024-09-17T05:36:17.886866+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886866+0000","last_undegraded":"2024-09-17T05:36:17.886866+0000","last_fullsized":"2024-09-17T05:36:17.886866+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909346+0000","last_change":"2024-09-17T05:36:17.901928+0000","last_active":"2024-09-17T05:36:17.909346+0000","last_peered":"2024-09-17T05:36:17.909346+0000","last_clean":"2024-09-17T05:36:17.909346+0000","last_became_active":"2024-09-17T05:36:17.901658+0000","last_became_peered":"2024-09-17T05:36:17.901658+0000","last_unstale":"2024-09-17T05:36:17.909346+0000","last_undegraded":"2024-09-17T05:36:17.909346+0000","last_fullsized":"2024-09-17T05:36:17.909346+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:47.183684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.894120+0000","last_change":"2024-09-17T05:36:17.894120+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.894120+0000","last_undegraded":"2024-09-17T05:36:17.894120+0000","last_fullsized":"2024-09-17T05:36:17.894120+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911123+0000","last_change":"2024-09-17T05:36:17.909634+0000","last_active":"2024-09-17T05:36:17.911123+0000","last_peered":"2024-09-17T05:36:17.911123+0000","last_clean":"2024-09-17T05:36:17.911123+0000","last_became_active":"2024-09-17T05:36:17.909283+0000","last_became_peered":"2024-09-17T05:36:17.909283+0000","last_unstale":"2024-09-17T05:36:17.911123+0000","last_undegraded":"2024-09-17T05:36:17.911123+0000","last_fullsized":"2024-09-17T05:36:17.911123+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:04.540111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886723+0000","last_change":"2024-09-17T05:36:17.886723+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886723+0000","last_undegraded":"2024-09-17T05:36:17.886723+0000","last_fullsized":"2024-09-17T05:36:17.886723+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.905270+0000","last_change":"2024-09-17T05:36:17.902030+0000","last_active":"2024-09-17T05:36:17.905270+0000","last_peered":"2024-09-17T05:36:17.905270+0000","last_clean":"2024-09-17T05:36:17.905270+0000","last_became_active":"2024-09-17T05:36:17.901154+0000","last_became_peered":"2024-09-17T05:36:17.901154+0000","last_unstale":"2024-09-17T05:36:17.905270+0000","last_undegraded":"2024-09-17T05:36:17.905270+0000","last_fullsized":"2024-09-17T05:36:17.905270+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:26.536681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885002+0000","last_change":"2024-09-17T05:36:17.885002+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885002+0000","last_undegraded":"2024-09-17T05:36:17.885002+0000","last_fullsized":"2024-09-17T05:36:17.885002+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911207+0000","last_change":"2024-09-17T05:36:17.906929+0000","last_active":"2024-09-17T05:36:17.911207+0000","last_peered":"2024-09-17T05:36:17.911207+0000","last_clean":"2024-09-17T05:36:17.911207+0000","last_became_active":"2024-09-17T05:36:17.906657+0000","last_became_peered":"2024-09-17T05:36:17.906657+0000","last_unstale":"2024-09-17T05:36:17.911207+0000","last_undegraded":"2024-09-17T05:36:17.911207+0000","last_fullsized":"2024-09-17T05:36:17.911207+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:04.425419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884821+0000","last_change":"2024-09-17T05:36:17.884821+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884821+0000","last_undegraded":"2024-09-17T05:36:17.884821+0000","last_fullsized":"2024-09-17T05:36:17.884821+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911164+0000","last_change":"2024-09-17T05:36:17.909786+0000","last_active":"2024-09-17T05:36:17.911164+0000","last_peered":"2024-09-17T05:36:17.911164+0000","last_clean":"2024-09-17T05:36:17.911164+0000","last_became_active":"2024-09-17T05:36:17.909389+0000","last_became_peered":"2024-09-17T05:36:17.909389+0000","last_unstale":"2024-09-17T05:36:17.911164+0000","last_undegraded":"2024-09-17T05:36:17.911164+0000","last_fullsized":"2024-09-17T05:36:17.911164+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:02.011245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887351+0000","last_change":"2024-09-17T05:36:17.887351+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887351+0000","last_undegraded":"2024-09-17T05:36:17.887351+0000","last_fullsized":"2024-09-17T05:36:17.887351+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909507+0000","last_change":"2024-09-17T05:36:17.904457+0000","last_active":"2024-09-17T05:36:17.909507+0000","last_peered":"2024-09-17T05:36:17.909507+0000","last_clean":"2024-09-17T05:36:17.909507+0000","last_became_active":"2024-09-17T05:36:17.904044+0000","last_became_peered":"2024-09-17T05:36:17.904044+0000","last_unstale":"2024-09-17T05:36:17.909507+0000","last_undegraded":"2024-09-17T05:36:17.909507+0000","last_fullsized":"2024-09-17T05:36:17.909507+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:03.142400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884659+0000","last_change":"2024-09-17T05:36:17.884659+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884659+0000","last_undegraded":"2024-09-17T05:36:17.884659+0000","last_fullsized":"2024-09-17T05:36:17.884659+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.900621+0000","last_change":"2024-09-17T05:36:17.889028+0000","last_active":"2024-09-17T05:36:17.900621+0000","last_peered":"2024-09-17T05:36:17.900621+0000","last_clean":"2024-09-17T05:36:17.900621+0000","last_became_active":"2024-09-17T05:36:17.886151+0000","last_became_peered":"2024-09-17T05:36:17.886151+0000","last_unstale":"2024-09-17T05:36:17.900621+0000","last_undegraded":"2024-09-17T05:36:17.900621+0000","last_fullsized":"2024-09-17T05:36:17.900621+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:30.991576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884985+0000","last_change":"2024-09-17T05:36:17.884985+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884985+0000","last_undegraded":"2024-09-17T05:36:17.884985+0000","last_fullsized":"2024-09-17T05:36:17.884985+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.910481+0000","last_change":"2024-09-17T05:36:17.909303+0000","last_active":"2024-09-17T05:36:17.910481+0000","last_peered":"2024-09-17T05:36:17.910481+0000","last_clean":"2024-09-17T05:36:17.910481+0000","last_became_active":"2024-09-17T05:36:17.909058+0000","last_became_peered":"2024-09-17T05:36:17.909058+0000","last_unstale":"2024-09-17T05:36:17.910481+0000","last_undegraded":"2024-09-17T05:36:17.910481+0000","last_fullsized":"2024-09-17T05:36:17.910481+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:13.555451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.897036+0000","last_change":"2024-09-17T05:36:17.897036+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.897036+0000","last_undegraded":"2024-09-17T05:36:17.897036+0000","last_fullsized":"2024-09-17T05:36:17.897036+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.903214+0000","last_change":"2024-09-17T05:36:17.900645+0000","last_active":"2024-09-17T05:36:17.903214+0000","last_peered":"2024-09-17T05:36:17.903214+0000","last_clean":"2024-09-17T05:36:17.903214+0000","last_became_active":"2024-09-17T05:36:17.900338+0000","last_became_peered":"2024-09-17T05:36:17.900338+0000","last_unstale":"2024-09-17T05:36:17.903214+0000","last_undegraded":"2024-09-17T05:36:17.903214+0000","last_fullsized":"2024-09-17T05:36:17.903214+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:49.857913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885882+0000","last_change":"2024-09-17T05:36:17.885882+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885882+0000","last_undegraded":"2024-09-17T05:36:17.885882+0000","last_fullsized":"2024-09-17T05:36:17.885882+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.910360+0000","last_change":"2024-09-17T05:36:17.903150+0000","last_active":"2024-09-17T05:36:17.910360+0000","last_peered":"2024-09-17T05:36:17.910360+0000","last_clean":"2024-09-17T05:36:17.910360+0000","last_became_active":"2024-09-17T05:36:17.902834+0000","last_became_peered":"2024-09-17T05:36:17.902834+0000","last_unstale":"2024-09-17T05:36:17.910360+0000","last_undegraded":"2024-09-17T05:36:17.910360+0000","last_fullsized":"2024-09-17T05:36:17.910360+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:16.005227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.883993+0000","last_change":"2024-09-17T05:36:17.883993+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.883993+0000","last_undegraded":"2024-09-17T05:36:17.883993+0000","last_fullsized":"2024-09-17T05:36:17.883993+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.908976+0000","last_change":"2024-09-17T05:36:17.904001+0000","last_active":"2024-09-17T05:36:17.908976+0000","last_peered":"2024-09-17T05:36:17.908976+0000","last_clean":"2024-09-17T05:36:17.908976+0000","last_became_active":"2024-09-17T05:36:17.900330+0000","last_became_peered":"2024-09-17T05:36:17.900330+0000","last_unstale":"2024-09-17T05:36:17.908976+0000","last_undegraded":"2024-09-17T05:36:17.908976+0000","last_fullsized":"2024-09-17T05:36:17.908976+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:55.927724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.898299+0000","last_change":"2024-09-17T05:36:17.898299+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.898299+0000","last_undegraded":"2024-09-17T05:36:17.898299+0000","last_fullsized":"2024-09-17T05:36:17.898299+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.910474+0000","last_change":"2024-09-17T05:36:17.905019+0000","last_active":"2024-09-17T05:36:17.910474+0000","last_peered":"2024-09-17T05:36:17.910474+0000","last_clean":"2024-09-17T05:36:17.910474+0000","last_became_active":"2024-09-17T05:36:17.903334+0000","last_became_peered":"2024-09-17T05:36:17.903334+0000","last_unstale":"2024-09-17T05:36:17.910474+0000","last_undegraded":"2024-09-17T05:36:17.910474+0000","last_fullsized":"2024-09-17T05:36:17.910474+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:22.248556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885764+0000","last_change":"2024-09-17T05:36:17.885764+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885764+0000","last_undegraded":"2024-09-17T05:36:17.885764+0000","last_fullsized":"2024-09-17T05:36:17.885764+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904722+0000","last_change":"2024-09-17T05:36:17.903608+0000","last_active":"2024-09-17T05:36:17.904722+0000","last_peered":"2024-09-17T05:36:17.904722+0000","last_clean":"2024-09-17T05:36:17.904722+0000","last_became_active":"2024-09-17T05:36:17.903276+0000","last_became_peered":"2024-09-17T05:36:17.903276+0000","last_unstale":"2024-09-17T05:36:17.904722+0000","last_undegraded":"2024-09-17T05:36:17.904722+0000","last_fullsized":"2024-09-17T05:36:17.904722+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:37.580096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.890489+0000","last_change":"2024-09-17T05:36:17.890489+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.890489+0000","last_undegraded":"2024-09-17T05:36:17.890489+0000","last_fullsized":"2024-09-17T05:36:17.890489+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909108+0000","last_change":"2024-09-17T05:36:17.908490+0000","last_active":"2024-09-17T05:36:17.909108+0000","last_peered":"2024-09-17T05:36:17.909108+0000","last_clean":"2024-09-17T05:36:17.909108+0000","last_became_active":"2024-09-17T05:36:17.908181+0000","last_became_peered":"2024-09-17T05:36:17.908181+0000","last_unstale":"2024-09-17T05:36:17.909108+0000","last_undegraded":"2024-09-17T05:36:17.909108+0000","last_fullsized":"2024-09-17T05:36:17.909108+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:58.629626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887331+0000","last_change":"2024-09-17T05:36:17.887331+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887331+0000","last_undegraded":"2024-09-17T05:36:17.887331+0000","last_fullsized":"2024-09-17T05:36:17.887331+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.907739+0000","last_change":"2024-09-17T05:36:17.904703+0000","last_active":"2024-09-17T05:36:17.907739+0000","last_peered":"2024-09-17T05:36:17.907739+0000","last_clean":"2024-09-17T05:36:17.907739+0000","last_became_active":"2024-09-17T05:36:17.903663+0000","last_became_peered":"2024-09-17T05:36:17.903663+0000","last_unstale":"2024-09-17T05:36:17.907739+0000","last_undegraded":"2024-09-17T05:36:17.907739+0000","last_fullsized":"2024-09-17T05:36:17.907739+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:29.342878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885070+0000","last_change":"2024-09-17T05:36:17.885070+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885070+0000","last_undegraded":"2024-09-17T05:36:17.885070+0000","last_fullsized":"2024-09-17T05:36:17.885070+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.907501+0000","last_change":"2024-09-17T05:36:17.903663+0000","last_active":"2024-09-17T05:36:17.907501+0000","last_peered":"2024-09-17T05:36:17.907501+0000","last_clean":"2024-09-17T05:36:17.907501+0000","last_became_active":"2024-09-17T05:36:17.903373+0000","last_became_peered":"2024-09-17T05:36:17.903373+0000","last_unstale":"2024-09-17T05:36:17.907501+0000","last_undegraded":"2024-09-17T05:36:17.907501+0000","last_fullsized":"2024-09-17T05:36:17.907501+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:54.399557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885530+0000","last_change":"2024-09-17T05:36:17.885530+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885530+0000","last_undegraded":"2024-09-17T05:36:17.885530+0000","last_fullsized":"2024-09-17T05:36:17.885530+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.900766+0000","last_change":"2024-09-17T05:36:17.889967+0000","last_active":"2024-09-17T05:36:17.900766+0000","last_peered":"2024-09-17T05:36:17.900766+0000","last_clean":"2024-09-17T05:36:17.900766+0000","last_became_active":"2024-09-17T05:36:17.889687+0000","last_became_peered":"2024-09-17T05:36:17.889687+0000","last_unstale":"2024-09-17T05:36:17.900766+0000","last_undegraded":"2024-09-17T05:36:17.900766+0000","last_fullsized":"2024-09-17T05:36:17.900766+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:52.746071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.888637+0000","last_change":"2024-09-17T05:36:17.888637+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.888637+0000","last_undegraded":"2024-09-17T05:36:17.888637+0000","last_fullsized":"2024-09-17T05:36:17.888637+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904102+0000","last_change":"2024-09-17T05:36:17.901496+0000","last_active":"2024-09-17T05:36:17.904102+0000","last_peered":"2024-09-17T05:36:17.904102+0000","last_clean":"2024-09-17T05:36:17.904102+0000","last_became_active":"2024-09-17T05:36:17.901170+0000","last_became_peered":"2024-09-17T05:36:17.901170+0000","last_unstale":"2024-09-17T05:36:17.904102+0000","last_undegraded":"2024-09-17T05:36:17.904102+0000","last_fullsized":"2024-09-17T05:36:17.904102+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:54.128073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.888619+0000","last_change":"2024-09-17T05:36:17.888619+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.888619+0000","last_undegraded":"2024-09-17T05:36:17.888619+0000","last_fullsized":"2024-09-17T05:36:17.888619+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.897089+0000","last_change":"2024-09-17T05:36:17.894247+0000","last_active":"2024-09-17T05:36:17.897089+0000","last_peered":"2024-09-17T05:36:17.897089+0000","last_clean":"2024-09-17T05:36:17.897089+0000","last_became_active":"2024-09-17T05:36:17.892459+0000","last_became_peered":"2024-09-17T05:36:17.892459+0000","last_unstale":"2024-09-17T05:36:17.897089+0000","last_undegraded":"2024-09-17T05:36:17.897089+0000","last_fullsized":"2024-09-17T05:36:17.897089+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:03.778158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.893917+0000","last_change":"2024-09-17T05:36:17.893917+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.893917+0000","last_undegraded":"2024-09-17T05:36:17.893917+0000","last_fullsized":"2024-09-17T05:36:17.893917+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.902602+0000","last_change":"2024-09-17T05:36:17.900164+0000","last_active":"2024-09-17T05:36:17.902602+0000","last_peered":"2024-09-17T05:36:17.902602+0000","last_clean":"2024-09-17T05:36:17.902602+0000","last_became_active":"2024-09-17T05:36:17.899350+0000","last_became_peered":"2024-09-17T05:36:17.899350+0000","last_unstale":"2024-09-17T05:36:17.902602+0000","last_undegraded":"2024-09-17T05:36:17.902602+0000","last_fullsized":"2024-09-17T05:36:17.902602+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:21:14.211298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885327+0000","last_change":"2024-09-17T05:36:17.885327+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885327+0000","last_undegraded":"2024-09-17T05:36:17.885327+0000","last_fullsized":"2024-09-17T05:36:17.885327+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909253+0000","last_change":"2024-09-17T05:36:17.899163+0000","last_active":"2024-09-17T05:36:17.909253+0000","last_peered":"2024-09-17T05:36:17.909253+0000","last_clean":"2024-09-17T05:36:17.909253+0000","last_became_active":"2024-09-17T05:36:17.898886+0000","last_became_peered":"2024-09-17T05:36:17.898886+0000","last_unstale":"2024-09-17T05:36:17.909253+0000","last_undegraded":"2024-09-17T05:36:17.909253+0000","last_fullsized":"2024-09-17T05:36:17.909253+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:44:47.420121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884877+0000","last_change":"2024-09-17T05:36:17.884877+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884877+0000","last_undegraded":"2024-09-17T05:36:17.884877+0000","last_fullsized":"2024-09-17T05:36:17.884877+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.903707+0000","last_change":"2024-09-17T05:36:17.902499+0000","last_active":"2024-09-17T05:36:17.903707+0000","last_peered":"2024-09-17T05:36:17.903707+0000","last_clean":"2024-09-17T05:36:17.903707+0000","last_became_active":"2024-09-17T05:36:17.902216+0000","last_became_peered":"2024-09-17T05:36:17.902216+0000","last_unstale":"2024-09-17T05:36:17.903707+0000","last_undegraded":"2024-09-17T05:36:17.903707+0000","last_fullsized":"2024-09-17T05:36:17.903707+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:07.872232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":374,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.889922+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:36:17.889922+0000","last_peered":"2024-09-17T05:36:17.889922+0000","last_clean":"2024-09-17T05:36:17.889922+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:36:17.889922+0000","last_undegraded":"2024-09-17T05:36:17.889922+0000","last_fullsized":"2024-09-17T05:36:17.889922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509536,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33612,"kb_used_data":2420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338228,"statfs":{"total":96636764160,"available":96602345472,"internally_reserved":0,"allocated":2478080,"data_stored":1419379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542240,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33028,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509537,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33028,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509535,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542239,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37772,"kb_used_data":2420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334068,"statfs":{"total":96636764160,"available":96598085632,"internally_reserved":0,"allocated":2478080,"data_stored":1419379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:36:23.869 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3f is not active+clean 2024-09-17T05:36:23.869 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.889233+0000', 'last_change': '2024-09-17T05:36:17.889233+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.889233+0000', 'last_undegraded': '2024-09-17T05:36:17.889233+0000', 'last_fullsized': '2024-09-17T05:36:17.889233+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:36:23.870 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3e is not active+clean 2024-09-17T05:36:23.870 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.896633+0000', 'last_change': '2024-09-17T05:36:17.896633+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.896633+0000', 'last_undegraded': '2024-09-17T05:36:17.896633+0000', 'last_fullsized': '2024-09-17T05:36:17.896633+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:36:23.870 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3d is not active+clean 2024-09-17T05:36:23.870 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.895608+0000', 'last_change': '2024-09-17T05:36:17.895608+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.895608+0000', 'last_undegraded': '2024-09-17T05:36:17.895608+0000', 'last_fullsized': '2024-09-17T05:36:17.895608+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:36:23.870 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3c is not active+clean 2024-09-17T05:36:23.870 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.896065+0000', 'last_change': '2024-09-17T05:36:17.896065+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.896065+0000', 'last_undegraded': '2024-09-17T05:36:17.896065+0000', 'last_fullsized': '2024-09-17T05:36:17.896065+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:36:23.870 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3b is not active+clean 2024-09-17T05:36:23.870 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.890523+0000', 'last_change': '2024-09-17T05:36:17.890523+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.890523+0000', 'last_undegraded': '2024-09-17T05:36:17.890523+0000', 'last_fullsized': '2024-09-17T05:36:17.890523+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:36:23.870 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3a is not active+clean 2024-09-17T05:36:23.870 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.894650+0000', 'last_change': '2024-09-17T05:36:17.894650+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.894650+0000', 'last_undegraded': '2024-09-17T05:36:17.894650+0000', 'last_fullsized': '2024-09-17T05:36:17.894650+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:36:23.871 INFO:tasks.ceph.ceph_manager.ceph:PG 25.39 is not active+clean 2024-09-17T05:36:23.871 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.885424+0000', 'last_change': '2024-09-17T05:36:17.885424+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.885424+0000', 'last_undegraded': '2024-09-17T05:36:17.885424+0000', 'last_fullsized': '2024-09-17T05:36:17.885424+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:36:23.871 INFO:tasks.ceph.ceph_manager.ceph:PG 25.38 is not active+clean 2024-09-17T05:36:23.871 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.887419+0000', 'last_change': '2024-09-17T05:36:17.887419+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.887419+0000', 'last_undegraded': '2024-09-17T05:36:17.887419+0000', 'last_fullsized': '2024-09-17T05:36:17.887419+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:36:23.871 INFO:tasks.ceph.ceph_manager.ceph:PG 25.37 is not active+clean 2024-09-17T05:36:23.871 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.886342+0000', 'last_change': '2024-09-17T05:36:17.886342+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.886342+0000', 'last_undegraded': '2024-09-17T05:36:17.886342+0000', 'last_fullsized': '2024-09-17T05:36:17.886342+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:36:23.871 INFO:tasks.ceph.ceph_manager.ceph:PG 25.36 is not active+clean 2024-09-17T05:36:23.871 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.887831+0000', 'last_change': '2024-09-17T05:36:17.887831+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.887831+0000', 'last_undegraded': '2024-09-17T05:36:17.887831+0000', 'last_fullsized': '2024-09-17T05:36:17.887831+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:36:23.871 INFO:tasks.ceph.ceph_manager.ceph:PG 25.35 is not active+clean 2024-09-17T05:36:23.871 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.885499+0000', 'last_change': '2024-09-17T05:36:17.885499+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.885499+0000', 'last_undegraded': '2024-09-17T05:36:17.885499+0000', 'last_fullsized': '2024-09-17T05:36:17.885499+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:36:23.872 INFO:tasks.ceph.ceph_manager.ceph:PG 25.34 is not active+clean 2024-09-17T05:36:23.872 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.895660+0000', 'last_change': '2024-09-17T05:36:17.895660+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.895660+0000', 'last_undegraded': '2024-09-17T05:36:17.895660+0000', 'last_fullsized': '2024-09-17T05:36:17.895660+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:36:23.872 INFO:tasks.ceph.ceph_manager.ceph:PG 25.33 is not active+clean 2024-09-17T05:36:23.872 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.897723+0000', 'last_change': '2024-09-17T05:36:17.897723+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.897723+0000', 'last_undegraded': '2024-09-17T05:36:17.897723+0000', 'last_fullsized': '2024-09-17T05:36:17.897723+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:36:23.872 INFO:tasks.ceph.ceph_manager.ceph:PG 25.32 is not active+clean 2024-09-17T05:36:23.872 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.885231+0000', 'last_change': '2024-09-17T05:36:17.885231+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.885231+0000', 'last_undegraded': '2024-09-17T05:36:17.885231+0000', 'last_fullsized': '2024-09-17T05:36:17.885231+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:36:23.872 INFO:tasks.ceph.ceph_manager.ceph:PG 25.31 is not active+clean 2024-09-17T05:36:23.872 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.896078+0000', 'last_change': '2024-09-17T05:36:17.896078+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.896078+0000', 'last_undegraded': '2024-09-17T05:36:17.896078+0000', 'last_fullsized': '2024-09-17T05:36:17.896078+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:36:23.872 INFO:tasks.ceph.ceph_manager.ceph:PG 25.30 is not active+clean 2024-09-17T05:36:23.872 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.886983+0000', 'last_change': '2024-09-17T05:36:17.886983+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.886983+0000', 'last_undegraded': '2024-09-17T05:36:17.886983+0000', 'last_fullsized': '2024-09-17T05:36:17.886983+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:36:23.872 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2f is not active+clean 2024-09-17T05:36:23.873 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.892630+0000', 'last_change': '2024-09-17T05:36:17.892630+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.892630+0000', 'last_undegraded': '2024-09-17T05:36:17.892630+0000', 'last_fullsized': '2024-09-17T05:36:17.892630+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:36:23.873 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2e is not active+clean 2024-09-17T05:36:23.873 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.888639+0000', 'last_change': '2024-09-17T05:36:17.888639+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.888639+0000', 'last_undegraded': '2024-09-17T05:36:17.888639+0000', 'last_fullsized': '2024-09-17T05:36:17.888639+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:36:23.873 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2d is not active+clean 2024-09-17T05:36:23.873 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.886496+0000', 'last_change': '2024-09-17T05:36:17.886496+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.886496+0000', 'last_undegraded': '2024-09-17T05:36:17.886496+0000', 'last_fullsized': '2024-09-17T05:36:17.886496+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:36:23.873 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2c is not active+clean 2024-09-17T05:36:23.873 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.890668+0000', 'last_change': '2024-09-17T05:36:17.890668+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.890668+0000', 'last_undegraded': '2024-09-17T05:36:17.890668+0000', 'last_fullsized': '2024-09-17T05:36:17.890668+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:36:23.873 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2b is not active+clean 2024-09-17T05:36:23.873 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.888612+0000', 'last_change': '2024-09-17T05:36:17.888612+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.888612+0000', 'last_undegraded': '2024-09-17T05:36:17.888612+0000', 'last_fullsized': '2024-09-17T05:36:17.888612+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:36:23.873 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2a is not active+clean 2024-09-17T05:36:23.874 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.886739+0000', 'last_change': '2024-09-17T05:36:17.886739+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.886739+0000', 'last_undegraded': '2024-09-17T05:36:17.886739+0000', 'last_fullsized': '2024-09-17T05:36:17.886739+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:36:23.874 INFO:tasks.ceph.ceph_manager.ceph:PG 25.29 is not active+clean 2024-09-17T05:36:23.874 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.893398+0000', 'last_change': '2024-09-17T05:36:17.893398+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.893398+0000', 'last_undegraded': '2024-09-17T05:36:17.893398+0000', 'last_fullsized': '2024-09-17T05:36:17.893398+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:36:23.874 INFO:tasks.ceph.ceph_manager.ceph:PG 25.28 is not active+clean 2024-09-17T05:36:23.874 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.886501+0000', 'last_change': '2024-09-17T05:36:17.886501+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.886501+0000', 'last_undegraded': '2024-09-17T05:36:17.886501+0000', 'last_fullsized': '2024-09-17T05:36:17.886501+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:36:23.874 INFO:tasks.ceph.ceph_manager.ceph:PG 25.27 is not active+clean 2024-09-17T05:36:23.874 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.894815+0000', 'last_change': '2024-09-17T05:36:17.894815+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.894815+0000', 'last_undegraded': '2024-09-17T05:36:17.894815+0000', 'last_fullsized': '2024-09-17T05:36:17.894815+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:36:23.874 INFO:tasks.ceph.ceph_manager.ceph:PG 25.26 is not active+clean 2024-09-17T05:36:23.874 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.885868+0000', 'last_change': '2024-09-17T05:36:17.885868+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.885868+0000', 'last_undegraded': '2024-09-17T05:36:17.885868+0000', 'last_fullsized': '2024-09-17T05:36:17.885868+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:36:23.874 INFO:tasks.ceph.ceph_manager.ceph:PG 25.25 is not active+clean 2024-09-17T05:36:23.874 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.894906+0000', 'last_change': '2024-09-17T05:36:17.894906+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.894906+0000', 'last_undegraded': '2024-09-17T05:36:17.894906+0000', 'last_fullsized': '2024-09-17T05:36:17.894906+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:36:23.875 INFO:tasks.ceph.ceph_manager.ceph:PG 25.24 is not active+clean 2024-09-17T05:36:23.875 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.890199+0000', 'last_change': '2024-09-17T05:36:17.890199+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.890199+0000', 'last_undegraded': '2024-09-17T05:36:17.890199+0000', 'last_fullsized': '2024-09-17T05:36:17.890199+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:36:23.875 INFO:tasks.ceph.ceph_manager.ceph:PG 25.23 is not active+clean 2024-09-17T05:36:23.875 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.893664+0000', 'last_change': '2024-09-17T05:36:17.893664+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.893664+0000', 'last_undegraded': '2024-09-17T05:36:17.893664+0000', 'last_fullsized': '2024-09-17T05:36:17.893664+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:36:23.875 INFO:tasks.ceph.ceph_manager.ceph:PG 25.22 is not active+clean 2024-09-17T05:36:23.875 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.884646+0000', 'last_change': '2024-09-17T05:36:17.884646+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.884646+0000', 'last_undegraded': '2024-09-17T05:36:17.884646+0000', 'last_fullsized': '2024-09-17T05:36:17.884646+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:36:23.875 INFO:tasks.ceph.ceph_manager.ceph:PG 25.21 is not active+clean 2024-09-17T05:36:23.875 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.892901+0000', 'last_change': '2024-09-17T05:36:17.892901+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.892901+0000', 'last_undegraded': '2024-09-17T05:36:17.892901+0000', 'last_fullsized': '2024-09-17T05:36:17.892901+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:36:23.875 INFO:tasks.ceph.ceph_manager.ceph:PG 25.20 is not active+clean 2024-09-17T05:36:23.875 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.884789+0000', 'last_change': '2024-09-17T05:36:17.884789+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.884789+0000', 'last_undegraded': '2024-09-17T05:36:17.884789+0000', 'last_fullsized': '2024-09-17T05:36:17.884789+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:36:23.875 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1e is not active+clean 2024-09-17T05:36:23.876 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.884686+0000', 'last_change': '2024-09-17T05:36:17.884686+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.884686+0000', 'last_undegraded': '2024-09-17T05:36:17.884686+0000', 'last_fullsized': '2024-09-17T05:36:17.884686+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:36:23.876 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1f is not active+clean 2024-09-17T05:36:23.876 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.887954+0000', 'last_change': '2024-09-17T05:36:17.887954+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.887954+0000', 'last_undegraded': '2024-09-17T05:36:17.887954+0000', 'last_fullsized': '2024-09-17T05:36:17.887954+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:36:23.876 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1c is not active+clean 2024-09-17T05:36:23.876 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.886288+0000', 'last_change': '2024-09-17T05:36:17.886288+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.886288+0000', 'last_undegraded': '2024-09-17T05:36:17.886288+0000', 'last_fullsized': '2024-09-17T05:36:17.886288+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:36:23.876 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1d is not active+clean 2024-09-17T05:36:23.876 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.885492+0000', 'last_change': '2024-09-17T05:36:17.885492+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.885492+0000', 'last_undegraded': '2024-09-17T05:36:17.885492+0000', 'last_fullsized': '2024-09-17T05:36:17.885492+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:36:23.876 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1a is not active+clean 2024-09-17T05:36:23.876 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.886309+0000', 'last_change': '2024-09-17T05:36:17.886309+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.886309+0000', 'last_undegraded': '2024-09-17T05:36:17.886309+0000', 'last_fullsized': '2024-09-17T05:36:17.886309+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:36:23.876 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1b is not active+clean 2024-09-17T05:36:23.877 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.886376+0000', 'last_change': '2024-09-17T05:36:17.886376+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.886376+0000', 'last_undegraded': '2024-09-17T05:36:17.886376+0000', 'last_fullsized': '2024-09-17T05:36:17.886376+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:36:23.877 INFO:tasks.ceph.ceph_manager.ceph:PG 25.19 is not active+clean 2024-09-17T05:36:23.877 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.884951+0000', 'last_change': '2024-09-17T05:36:17.884951+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.884951+0000', 'last_undegraded': '2024-09-17T05:36:17.884951+0000', 'last_fullsized': '2024-09-17T05:36:17.884951+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:36:23.877 INFO:tasks.ceph.ceph_manager.ceph:PG 25.16 is not active+clean 2024-09-17T05:36:23.877 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.898511+0000', 'last_change': '2024-09-17T05:36:17.898511+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.898511+0000', 'last_undegraded': '2024-09-17T05:36:17.898511+0000', 'last_fullsized': '2024-09-17T05:36:17.898511+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:36:23.877 INFO:tasks.ceph.ceph_manager.ceph:PG 25.17 is not active+clean 2024-09-17T05:36:23.877 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.884273+0000', 'last_change': '2024-09-17T05:36:17.884273+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.884273+0000', 'last_undegraded': '2024-09-17T05:36:17.884273+0000', 'last_fullsized': '2024-09-17T05:36:17.884273+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:36:23.877 INFO:tasks.ceph.ceph_manager.ceph:PG 25.14 is not active+clean 2024-09-17T05:36:23.877 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.885864+0000', 'last_change': '2024-09-17T05:36:17.885864+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.885864+0000', 'last_undegraded': '2024-09-17T05:36:17.885864+0000', 'last_fullsized': '2024-09-17T05:36:17.885864+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:36:23.877 INFO:tasks.ceph.ceph_manager.ceph:PG 25.15 is not active+clean 2024-09-17T05:36:23.877 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.886866+0000', 'last_change': '2024-09-17T05:36:17.886866+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.886866+0000', 'last_undegraded': '2024-09-17T05:36:17.886866+0000', 'last_fullsized': '2024-09-17T05:36:17.886866+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:36:23.878 INFO:tasks.ceph.ceph_manager.ceph:PG 25.12 is not active+clean 2024-09-17T05:36:23.878 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.894120+0000', 'last_change': '2024-09-17T05:36:17.894120+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.894120+0000', 'last_undegraded': '2024-09-17T05:36:17.894120+0000', 'last_fullsized': '2024-09-17T05:36:17.894120+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:36:23.878 INFO:tasks.ceph.ceph_manager.ceph:PG 25.13 is not active+clean 2024-09-17T05:36:23.878 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.886723+0000', 'last_change': '2024-09-17T05:36:17.886723+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.886723+0000', 'last_undegraded': '2024-09-17T05:36:17.886723+0000', 'last_fullsized': '2024-09-17T05:36:17.886723+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:36:23.878 INFO:tasks.ceph.ceph_manager.ceph:PG 25.10 is not active+clean 2024-09-17T05:36:23.878 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.885002+0000', 'last_change': '2024-09-17T05:36:17.885002+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.885002+0000', 'last_undegraded': '2024-09-17T05:36:17.885002+0000', 'last_fullsized': '2024-09-17T05:36:17.885002+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:36:23.878 INFO:tasks.ceph.ceph_manager.ceph:PG 25.11 is not active+clean 2024-09-17T05:36:23.878 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.884821+0000', 'last_change': '2024-09-17T05:36:17.884821+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.884821+0000', 'last_undegraded': '2024-09-17T05:36:17.884821+0000', 'last_fullsized': '2024-09-17T05:36:17.884821+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:36:23.878 INFO:tasks.ceph.ceph_manager.ceph:PG 25.e is not active+clean 2024-09-17T05:36:23.878 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.887351+0000', 'last_change': '2024-09-17T05:36:17.887351+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.887351+0000', 'last_undegraded': '2024-09-17T05:36:17.887351+0000', 'last_fullsized': '2024-09-17T05:36:17.887351+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:36:23.879 INFO:tasks.ceph.ceph_manager.ceph:PG 25.f is not active+clean 2024-09-17T05:36:23.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.884659+0000', 'last_change': '2024-09-17T05:36:17.884659+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.884659+0000', 'last_undegraded': '2024-09-17T05:36:17.884659+0000', 'last_fullsized': '2024-09-17T05:36:17.884659+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:36:23.879 INFO:tasks.ceph.ceph_manager.ceph:PG 25.c is not active+clean 2024-09-17T05:36:23.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.884985+0000', 'last_change': '2024-09-17T05:36:17.884985+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.884985+0000', 'last_undegraded': '2024-09-17T05:36:17.884985+0000', 'last_fullsized': '2024-09-17T05:36:17.884985+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:36:23.879 INFO:tasks.ceph.ceph_manager.ceph:PG 25.d is not active+clean 2024-09-17T05:36:23.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.897036+0000', 'last_change': '2024-09-17T05:36:17.897036+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.897036+0000', 'last_undegraded': '2024-09-17T05:36:17.897036+0000', 'last_fullsized': '2024-09-17T05:36:17.897036+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:36:23.879 INFO:tasks.ceph.ceph_manager.ceph:PG 25.a is not active+clean 2024-09-17T05:36:23.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.885882+0000', 'last_change': '2024-09-17T05:36:17.885882+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.885882+0000', 'last_undegraded': '2024-09-17T05:36:17.885882+0000', 'last_fullsized': '2024-09-17T05:36:17.885882+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:36:23.879 INFO:tasks.ceph.ceph_manager.ceph:PG 25.b is not active+clean 2024-09-17T05:36:23.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.883993+0000', 'last_change': '2024-09-17T05:36:17.883993+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.883993+0000', 'last_undegraded': '2024-09-17T05:36:17.883993+0000', 'last_fullsized': '2024-09-17T05:36:17.883993+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:36:23.879 INFO:tasks.ceph.ceph_manager.ceph:PG 25.8 is not active+clean 2024-09-17T05:36:23.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.898299+0000', 'last_change': '2024-09-17T05:36:17.898299+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.898299+0000', 'last_undegraded': '2024-09-17T05:36:17.898299+0000', 'last_fullsized': '2024-09-17T05:36:17.898299+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:36:23.880 INFO:tasks.ceph.ceph_manager.ceph:PG 25.9 is not active+clean 2024-09-17T05:36:23.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.885764+0000', 'last_change': '2024-09-17T05:36:17.885764+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.885764+0000', 'last_undegraded': '2024-09-17T05:36:17.885764+0000', 'last_fullsized': '2024-09-17T05:36:17.885764+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:36:23.880 INFO:tasks.ceph.ceph_manager.ceph:PG 25.6 is not active+clean 2024-09-17T05:36:23.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.890489+0000', 'last_change': '2024-09-17T05:36:17.890489+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.890489+0000', 'last_undegraded': '2024-09-17T05:36:17.890489+0000', 'last_fullsized': '2024-09-17T05:36:17.890489+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:36:23.880 INFO:tasks.ceph.ceph_manager.ceph:PG 25.7 is not active+clean 2024-09-17T05:36:23.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.887331+0000', 'last_change': '2024-09-17T05:36:17.887331+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.887331+0000', 'last_undegraded': '2024-09-17T05:36:17.887331+0000', 'last_fullsized': '2024-09-17T05:36:17.887331+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:36:23.880 INFO:tasks.ceph.ceph_manager.ceph:PG 25.4 is not active+clean 2024-09-17T05:36:23.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.885070+0000', 'last_change': '2024-09-17T05:36:17.885070+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.885070+0000', 'last_undegraded': '2024-09-17T05:36:17.885070+0000', 'last_fullsized': '2024-09-17T05:36:17.885070+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:36:23.880 INFO:tasks.ceph.ceph_manager.ceph:PG 25.5 is not active+clean 2024-09-17T05:36:23.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.885530+0000', 'last_change': '2024-09-17T05:36:17.885530+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.885530+0000', 'last_undegraded': '2024-09-17T05:36:17.885530+0000', 'last_fullsized': '2024-09-17T05:36:17.885530+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:36:23.881 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2 is not active+clean 2024-09-17T05:36:23.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.888637+0000', 'last_change': '2024-09-17T05:36:17.888637+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.888637+0000', 'last_undegraded': '2024-09-17T05:36:17.888637+0000', 'last_fullsized': '2024-09-17T05:36:17.888637+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:36:23.881 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3 is not active+clean 2024-09-17T05:36:23.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.888619+0000', 'last_change': '2024-09-17T05:36:17.888619+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.888619+0000', 'last_undegraded': '2024-09-17T05:36:17.888619+0000', 'last_fullsized': '2024-09-17T05:36:17.888619+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:36:23.881 INFO:tasks.ceph.ceph_manager.ceph:PG 25.0 is not active+clean 2024-09-17T05:36:23.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.893917+0000', 'last_change': '2024-09-17T05:36:17.893917+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.893917+0000', 'last_undegraded': '2024-09-17T05:36:17.893917+0000', 'last_fullsized': '2024-09-17T05:36:17.893917+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:36:23.881 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1 is not active+clean 2024-09-17T05:36:23.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.885327+0000', 'last_change': '2024-09-17T05:36:17.885327+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.885327+0000', 'last_undegraded': '2024-09-17T05:36:17.885327+0000', 'last_fullsized': '2024-09-17T05:36:17.885327+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:36:23.881 INFO:tasks.ceph.ceph_manager.ceph:PG 25.18 is not active+clean 2024-09-17T05:36:23.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 150, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:36:17.884877+0000', 'last_change': '2024-09-17T05:36:17.884877+0000', 'last_active': '2024-09-17T05:36:17.871862+0000', 'last_peered': '2024-09-17T05:36:17.871862+0000', 'last_clean': '2024-09-17T05:36:17.871862+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:36:17.884877+0000', 'last_undegraded': '2024-09-17T05:36:17.884877+0000', 'last_fullsized': '2024-09-17T05:36:17.884877+0000', 'mapping_epoch': 150, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 150, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'last_clean_scrub_stamp': '2024-09-17T05:36:17.871862+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:36:23.882 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:36:24.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.056+0000 7fa80ee00640 1 -- 172.21.15.31:0/223167016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080b2760 msgr2=0x7fa8080d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.056+0000 7fa80ee00640 1 --2- 172.21.15.31:0/223167016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080b2760 0x7fa8080d0260 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fa8080b33d0 tx=0x7fa7f401c5e0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.056+0000 7fa80ee00640 1 -- 172.21.15.31:0/223167016 shutdown_connections 2024-09-17T05:36:24.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.056+0000 7fa80ee00640 1 --2- 172.21.15.31:0/223167016 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8080b2d00 0x7fa8081605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.056+0000 7fa80ee00640 1 --2- 172.21.15.31:0/223167016 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080b2760 0x7fa8080d0260 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.056+0000 7fa80ee00640 1 -- 172.21.15.31:0/223167016 >> 172.21.15.31:0/223167016 conn(0x7fa8080d1e40 msgr2=0x7fa8080d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:24.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.056+0000 7fa80ee00640 1 -- 172.21.15.31:0/223167016 shutdown_connections 2024-09-17T05:36:24.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.056+0000 7fa80ee00640 1 -- 172.21.15.31:0/223167016 wait complete. 2024-09-17T05:36:24.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.056+0000 7fa80ee00640 1 Processor -- start 2024-09-17T05:36:24.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.056+0000 7fa80ee00640 1 -- start start 2024-09-17T05:36:24.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa80ee00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8080b2760 0x7fa808153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa80ee00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8080b2d00 0x7fa8081f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa80ee00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080cfe80 0x7fa8080c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa80ee00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa8080b0940 con 0x7fa8080cfe80 2024-09-17T05:36:24.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa80ee00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa8080b07c0 con 0x7fa8080b2760 2024-09-17T05:36:24.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa80ee00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa8080b0ac0 con 0x7fa8080b2d00 2024-09-17T05:36:24.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa80ce00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080cfe80 0x7fa8080c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa80ce00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080cfe80 0x7fa8080c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34720/0 (socket says 172.21.15.31:34720) 2024-09-17T05:36:24.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa80ce00640 1 -- 172.21.15.31:0/3257246271 learned_addr learned my addr 172.21.15.31:0/3257246271 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:24.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa807400640 1 --2- 172.21.15.31:0/3257246271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8080b2d00 0x7fa8081f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa807e00640 1 --2- 172.21.15.31:0/3257246271 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8080b2760 0x7fa808153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa80ce00640 1 -- 172.21.15.31:0/3257246271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8080b2d00 msgr2=0x7fa8081f60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa80ce00640 1 --2- 172.21.15.31:0/3257246271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8080b2d00 0x7fa8081f60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa80ce00640 1 -- 172.21.15.31:0/3257246271 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8080b2760 msgr2=0x7fa808153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa80ce00640 1 --2- 172.21.15.31:0/3257246271 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8080b2760 0x7fa808153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa80ce00640 1 -- 172.21.15.31:0/3257246271 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa808152490 con 0x7fa8080cfe80 2024-09-17T05:36:24.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa80ce00640 1 --2- 172.21.15.31:0/3257246271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080cfe80 0x7fa8080c8f10 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fa80000ea20 tx=0x7fa80000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:24.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa7ffe00640 1 -- 172.21.15.31:0/3257246271 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80000cde0 con 0x7fa8080cfe80 2024-09-17T05:36:24.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa7ffe00640 1 -- 172.21.15.31:0/3257246271 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa800004c40 con 0x7fa8080cfe80 2024-09-17T05:36:24.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa7ffe00640 1 -- 172.21.15.31:0/3257246271 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa800005280 con 0x7fa8080cfe80 2024-09-17T05:36:24.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa80ee00640 1 -- 172.21.15.31:0/3257246271 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa808152770 con 0x7fa8080cfe80 2024-09-17T05:36:24.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa80ee00640 1 -- 172.21.15.31:0/3257246271 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8080c9cd0 con 0x7fa8080cfe80 2024-09-17T05:36:24.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa80ee00640 1 -- 172.21.15.31:0/3257246271 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8080cba40 con 0x7fa8080cfe80 2024-09-17T05:36:24.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.060+0000 7fa7ffe00640 1 -- 172.21.15.31:0/3257246271 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7fa800005420 con 0x7fa8080cfe80 2024-09-17T05:36:24.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.064+0000 7fa7ffe00640 1 --2- 172.21.15.31:0/3257246271 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa7e8073a70 0x7fa7e8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.064+0000 7fa7ffe00640 1 -- 172.21.15.31:0/3257246271 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fa800095d90 con 0x7fa8080cfe80 2024-09-17T05:36:24.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.064+0000 7fa807e00640 1 --2- 172.21.15.31:0/3257246271 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa7e8073a70 0x7fa7e8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.064+0000 7fa807e00640 1 --2- 172.21.15.31:0/3257246271 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa7e8073a70 0x7fa7e8075f30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa8081670e0 tx=0x7fa7f8009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:24.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.068+0000 7fa7ffe00640 1 -- 172.21.15.31:0/3257246271 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa8080cba40 con 0x7fa8080cfe80 2024-09-17T05:36:24.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.304+0000 7fa80ee00640 1 -- 172.21.15.31:0/3257246271 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa8080d0260 con 0x7fa8080cfe80 2024-09-17T05:36:24.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.304+0000 7fa7ffe00640 1 -- 172.21.15.31:0/3257246271 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1500 (secure 0 0 0) 0x7fa800016030 con 0x7fa8080cfe80 2024-09-17T05:36:24.308 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:24.308 INFO:teuthology.orchestra.run.smithi031.stdout:{"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":484,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":152,"num_osds":8,"num_up_osds":8,"osd_up_since":1726550913,"num_in_osds":8,"osd_in_since":1726550903,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":276037632,"bytes_avail":772818075648,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":109,"btime":"2024-09-17T05:36:21:915529+0000","id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"a","status":"up:active","gid":8733}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2024-09-17T05:36:06.744188+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T05:36:24.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.308+0000 7fa80ee00640 1 -- 172.21.15.31:0/3257246271 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa7e8073a70 msgr2=0x7fa7e8075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.308+0000 7fa80ee00640 1 --2- 172.21.15.31:0/3257246271 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa7e8073a70 0x7fa7e8075f30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa8081670e0 tx=0x7fa7f8009060 comp rx=0 tx=0).stop 2024-09-17T05:36:24.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.308+0000 7fa80ee00640 1 -- 172.21.15.31:0/3257246271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080cfe80 msgr2=0x7fa8080c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.308+0000 7fa80ee00640 1 --2- 172.21.15.31:0/3257246271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080cfe80 0x7fa8080c8f10 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fa80000ea20 tx=0x7fa80000eee0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.308+0000 7fa80ee00640 1 -- 172.21.15.31:0/3257246271 shutdown_connections 2024-09-17T05:36:24.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.308+0000 7fa80ee00640 1 --2- 172.21.15.31:0/3257246271 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa7e8073a70 0x7fa7e8075f30 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.308+0000 7fa80ee00640 1 --2- 172.21.15.31:0/3257246271 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8080cfe80 0x7fa8080c8f10 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.308+0000 7fa80ee00640 1 --2- 172.21.15.31:0/3257246271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa8080b2d00 0x7fa8081f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.308+0000 7fa80ee00640 1 --2- 172.21.15.31:0/3257246271 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8080b2760 0x7fa808153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.308+0000 7fa80ee00640 1 -- 172.21.15.31:0/3257246271 >> 172.21.15.31:0/3257246271 conn(0x7fa8080d1e40 msgr2=0x7fa8080cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:24.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.308+0000 7fa80ee00640 1 -- 172.21.15.31:0/3257246271 shutdown_connections 2024-09-17T05:36:24.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.308+0000 7fa80ee00640 1 -- 172.21.15.31:0/3257246271 wait complete. 2024-09-17T05:36:24.330 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:36:24.330 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:36:24.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e6f000640 1 -- 172.21.15.31:0/1963976769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e680cebf0 msgr2=0x7f2e680cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e6f000640 1 --2- 172.21.15.31:0/1963976769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e680cebf0 0x7f2e680cc8b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2e50009840 tx=0x7f2e5001c740 comp rx=0 tx=0).stop 2024-09-17T05:36:24.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e6f000640 1 -- 172.21.15.31:0/1963976769 shutdown_connections 2024-09-17T05:36:24.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e6f000640 1 --2- 172.21.15.31:0/1963976769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e680cebf0 0x7f2e680cc8b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e6f000640 1 -- 172.21.15.31:0/1963976769 >> 172.21.15.31:0/1963976769 conn(0x7f2e680d1da0 msgr2=0x7f2e680d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:24.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e6f000640 1 -- 172.21.15.31:0/1963976769 shutdown_connections 2024-09-17T05:36:24.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e6f000640 1 -- 172.21.15.31:0/1963976769 wait complete. 2024-09-17T05:36:24.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e6f000640 1 Processor -- start 2024-09-17T05:36:24.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e6f000640 1 -- start start 2024-09-17T05:36:24.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e6f000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e680b6400 0x7f2e681568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e6f000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e680cebf0 0x7f2e680ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e6f000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e6815be80 0x7f2e680b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e6f000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6816a310 con 0x7f2e680cebf0 2024-09-17T05:36:24.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e6f000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6816a190 con 0x7f2e6815be80 2024-09-17T05:36:24.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e6f000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6816a490 con 0x7f2e680b6400 2024-09-17T05:36:24.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e5fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e680cebf0 0x7f2e680ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e5fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e680cebf0 0x7f2e680ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34730/0 (socket says 172.21.15.31:34730) 2024-09-17T05:36:24.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e5fe00640 1 -- 172.21.15.31:0/502802499 learned_addr learned my addr 172.21.15.31:0/502802499 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:24.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e67e00640 1 --2- 172.21.15.31:0/502802499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e680b6400 0x7f2e681568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e6d000640 1 --2- 172.21.15.31:0/502802499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e6815be80 0x7f2e680b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e5fe00640 1 -- 172.21.15.31:0/502802499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e680b6400 msgr2=0x7f2e681568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e5fe00640 1 --2- 172.21.15.31:0/502802499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e680b6400 0x7f2e681568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e5fe00640 1 -- 172.21.15.31:0/502802499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e6815be80 msgr2=0x7f2e680b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e5fe00640 1 --2- 172.21.15.31:0/502802499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e6815be80 0x7f2e680b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e5fe00640 1 -- 172.21.15.31:0/502802499 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e68156e00 con 0x7f2e680cebf0 2024-09-17T05:36:24.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.476+0000 7f2e6d000640 1 --2- 172.21.15.31:0/502802499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e6815be80 0x7f2e680b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:24.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.480+0000 7f2e5fe00640 1 --2- 172.21.15.31:0/502802499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e680cebf0 0x7f2e680ca330 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f2e50009790 tx=0x7f2e50005d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:24.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.480+0000 7f2e64c00640 1 -- 172.21.15.31:0/502802499 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e500ac070 con 0x7f2e680cebf0 2024-09-17T05:36:24.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.480+0000 7f2e64c00640 1 -- 172.21.15.31:0/502802499 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e50004b40 con 0x7f2e680cebf0 2024-09-17T05:36:24.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.480+0000 7f2e64c00640 1 -- 172.21.15.31:0/502802499 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e500a6740 con 0x7f2e680cebf0 2024-09-17T05:36:24.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.480+0000 7f2e6f000640 1 -- 172.21.15.31:0/502802499 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e681f7f70 con 0x7f2e680cebf0 2024-09-17T05:36:24.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.480+0000 7f2e6f000640 1 -- 172.21.15.31:0/502802499 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e681f8530 con 0x7f2e680cebf0 2024-09-17T05:36:24.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.480+0000 7f2e6f000640 1 -- 172.21.15.31:0/502802499 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e680ce4e0 con 0x7f2e680cebf0 2024-09-17T05:36:24.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.480+0000 7f2e64c00640 1 -- 172.21.15.31:0/502802499 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f2e500af070 con 0x7f2e680cebf0 2024-09-17T05:36:24.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.480+0000 7f2e64c00640 1 --2- 172.21.15.31:0/502802499 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2e44073aa0 0x7f2e44075f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:24.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.480+0000 7f2e64c00640 1 -- 172.21.15.31:0/502802499 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f2e5012f170 con 0x7f2e680cebf0 2024-09-17T05:36:24.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.480+0000 7f2e67e00640 1 --2- 172.21.15.31:0/502802499 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2e44073aa0 0x7f2e44075f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:24.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.484+0000 7f2e67e00640 1 --2- 172.21.15.31:0/502802499 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2e44073aa0 0x7f2e44075f60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2e58001ec0 tx=0x7f2e58009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:24.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.484+0000 7f2e64c00640 1 -- 172.21.15.31:0/502802499 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2e500b6070 con 0x7f2e680cebf0 2024-09-17T05:36:24.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.656+0000 7f2e6f000640 1 -- 172.21.15.31:0/502802499 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e681fb160 con 0x7f2e44073aa0 2024-09-17T05:36:24.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.660+0000 7f2e64c00640 1 -- 172.21.15.31:0/502802499 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247112 (secure 0 0 0) 0x7f2e681fb160 con 0x7f2e44073aa0 2024-09-17T05:36:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:24.668 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:36:24.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.664+0000 7f2e6f000640 1 -- 172.21.15.31:0/502802499 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2e44073aa0 msgr2=0x7f2e44075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.664+0000 7f2e6f000640 1 --2- 172.21.15.31:0/502802499 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2e44073aa0 0x7f2e44075f60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2e58001ec0 tx=0x7f2e58009040 comp rx=0 tx=0).stop 2024-09-17T05:36:24.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.664+0000 7f2e6f000640 1 -- 172.21.15.31:0/502802499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e680cebf0 msgr2=0x7f2e680ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:24.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.664+0000 7f2e6f000640 1 --2- 172.21.15.31:0/502802499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e680cebf0 0x7f2e680ca330 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f2e50009790 tx=0x7f2e50005d60 comp rx=0 tx=0).stop 2024-09-17T05:36:24.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.664+0000 7f2e6f000640 1 -- 172.21.15.31:0/502802499 shutdown_connections 2024-09-17T05:36:24.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.664+0000 7f2e6f000640 1 --2- 172.21.15.31:0/502802499 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2e44073aa0 0x7f2e44075f60 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.664+0000 7f2e6f000640 1 --2- 172.21.15.31:0/502802499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e6815be80 0x7f2e680b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.664+0000 7f2e6f000640 1 --2- 172.21.15.31:0/502802499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2e680cebf0 0x7f2e680ca330 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.664+0000 7f2e6f000640 1 --2- 172.21.15.31:0/502802499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e680b6400 0x7f2e681568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:24.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.664+0000 7f2e6f000640 1 -- 172.21.15.31:0/502802499 >> 172.21.15.31:0/502802499 conn(0x7f2e680d1da0 msgr2=0x7f2e680d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:24.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.664+0000 7f2e6f000640 1 -- 172.21.15.31:0/502802499 shutdown_connections 2024-09-17T05:36:24.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:24.664+0000 7f2e6f000640 1 -- 172.21.15.31:0/502802499 wait complete. 2024-09-17T05:36:24.688 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-09-17T05:36:22.747861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":269568,"kb_used_data":15880,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754705152,"statfs":{"total":773094113280,"available":772818075648,"internally_reserved":0,"allocated":16261120,"data_stored":7812824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.875083"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.889233+0000","last_change":"2024-09-17T05:36:17.889233+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.889233+0000","last_undegraded":"2024-09-17T05:36:17.889233+0000","last_fullsized":"2024-09-17T05:36:17.889233+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.896633+0000","last_change":"2024-09-17T05:36:17.896633+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.896633+0000","last_undegraded":"2024-09-17T05:36:17.896633+0000","last_fullsized":"2024-09-17T05:36:17.896633+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.895608+0000","last_change":"2024-09-17T05:36:17.895608+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.895608+0000","last_undegraded":"2024-09-17T05:36:17.895608+0000","last_fullsized":"2024-09-17T05:36:17.895608+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.896065+0000","last_change":"2024-09-17T05:36:17.896065+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.896065+0000","last_undegraded":"2024-09-17T05:36:17.896065+0000","last_fullsized":"2024-09-17T05:36:17.896065+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.890523+0000","last_change":"2024-09-17T05:36:17.890523+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.890523+0000","last_undegraded":"2024-09-17T05:36:17.890523+0000","last_fullsized":"2024-09-17T05:36:17.890523+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.894650+0000","last_change":"2024-09-17T05:36:17.894650+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.894650+0000","last_undegraded":"2024-09-17T05:36:17.894650+0000","last_fullsized":"2024-09-17T05:36:17.894650+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885424+0000","last_change":"2024-09-17T05:36:17.885424+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885424+0000","last_undegraded":"2024-09-17T05:36:17.885424+0000","last_fullsized":"2024-09-17T05:36:17.885424+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887419+0000","last_change":"2024-09-17T05:36:17.887419+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887419+0000","last_undegraded":"2024-09-17T05:36:17.887419+0000","last_fullsized":"2024-09-17T05:36:17.887419+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886342+0000","last_change":"2024-09-17T05:36:17.886342+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886342+0000","last_undegraded":"2024-09-17T05:36:17.886342+0000","last_fullsized":"2024-09-17T05:36:17.886342+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887831+0000","last_change":"2024-09-17T05:36:17.887831+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887831+0000","last_undegraded":"2024-09-17T05:36:17.887831+0000","last_fullsized":"2024-09-17T05:36:17.887831+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885499+0000","last_change":"2024-09-17T05:36:17.885499+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885499+0000","last_undegraded":"2024-09-17T05:36:17.885499+0000","last_fullsized":"2024-09-17T05:36:17.885499+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.895660+0000","last_change":"2024-09-17T05:36:17.895660+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.895660+0000","last_undegraded":"2024-09-17T05:36:17.895660+0000","last_fullsized":"2024-09-17T05:36:17.895660+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.897723+0000","last_change":"2024-09-17T05:36:17.897723+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.897723+0000","last_undegraded":"2024-09-17T05:36:17.897723+0000","last_fullsized":"2024-09-17T05:36:17.897723+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885231+0000","last_change":"2024-09-17T05:36:17.885231+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885231+0000","last_undegraded":"2024-09-17T05:36:17.885231+0000","last_fullsized":"2024-09-17T05:36:17.885231+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.896078+0000","last_change":"2024-09-17T05:36:17.896078+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.896078+0000","last_undegraded":"2024-09-17T05:36:17.896078+0000","last_fullsized":"2024-09-17T05:36:17.896078+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886983+0000","last_change":"2024-09-17T05:36:17.886983+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886983+0000","last_undegraded":"2024-09-17T05:36:17.886983+0000","last_fullsized":"2024-09-17T05:36:17.886983+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.892630+0000","last_change":"2024-09-17T05:36:17.892630+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.892630+0000","last_undegraded":"2024-09-17T05:36:17.892630+0000","last_fullsized":"2024-09-17T05:36:17.892630+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.888639+0000","last_change":"2024-09-17T05:36:17.888639+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.888639+0000","last_undegraded":"2024-09-17T05:36:17.888639+0000","last_fullsized":"2024-09-17T05:36:17.888639+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886496+0000","last_change":"2024-09-17T05:36:17.886496+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886496+0000","last_undegraded":"2024-09-17T05:36:17.886496+0000","last_fullsized":"2024-09-17T05:36:17.886496+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.890668+0000","last_change":"2024-09-17T05:36:17.890668+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.890668+0000","last_undegraded":"2024-09-17T05:36:17.890668+0000","last_fullsized":"2024-09-17T05:36:17.890668+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.888612+0000","last_change":"2024-09-17T05:36:17.888612+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.888612+0000","last_undegraded":"2024-09-17T05:36:17.888612+0000","last_fullsized":"2024-09-17T05:36:17.888612+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886739+0000","last_change":"2024-09-17T05:36:17.886739+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886739+0000","last_undegraded":"2024-09-17T05:36:17.886739+0000","last_fullsized":"2024-09-17T05:36:17.886739+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.893398+0000","last_change":"2024-09-17T05:36:17.893398+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.893398+0000","last_undegraded":"2024-09-17T05:36:17.893398+0000","last_fullsized":"2024-09-17T05:36:17.893398+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886501+0000","last_change":"2024-09-17T05:36:17.886501+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886501+0000","last_undegraded":"2024-09-17T05:36:17.886501+0000","last_fullsized":"2024-09-17T05:36:17.886501+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.894815+0000","last_change":"2024-09-17T05:36:17.894815+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.894815+0000","last_undegraded":"2024-09-17T05:36:17.894815+0000","last_fullsized":"2024-09-17T05:36:17.894815+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885868+0000","last_change":"2024-09-17T05:36:17.885868+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885868+0000","last_undegraded":"2024-09-17T05:36:17.885868+0000","last_fullsized":"2024-09-17T05:36:17.885868+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.894906+0000","last_change":"2024-09-17T05:36:17.894906+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.894906+0000","last_undegraded":"2024-09-17T05:36:17.894906+0000","last_fullsized":"2024-09-17T05:36:17.894906+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.890199+0000","last_change":"2024-09-17T05:36:17.890199+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.890199+0000","last_undegraded":"2024-09-17T05:36:17.890199+0000","last_fullsized":"2024-09-17T05:36:17.890199+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.893664+0000","last_change":"2024-09-17T05:36:17.893664+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.893664+0000","last_undegraded":"2024-09-17T05:36:17.893664+0000","last_fullsized":"2024-09-17T05:36:17.893664+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884646+0000","last_change":"2024-09-17T05:36:17.884646+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884646+0000","last_undegraded":"2024-09-17T05:36:17.884646+0000","last_fullsized":"2024-09-17T05:36:17.884646+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.892901+0000","last_change":"2024-09-17T05:36:17.892901+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.892901+0000","last_undegraded":"2024-09-17T05:36:17.892901+0000","last_fullsized":"2024-09-17T05:36:17.892901+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884789+0000","last_change":"2024-09-17T05:36:17.884789+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884789+0000","last_undegraded":"2024-09-17T05:36:17.884789+0000","last_fullsized":"2024-09-17T05:36:17.884789+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884686+0000","last_change":"2024-09-17T05:36:17.884686+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884686+0000","last_undegraded":"2024-09-17T05:36:17.884686+0000","last_fullsized":"2024-09-17T05:36:17.884686+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904294+0000","last_change":"2024-09-17T05:36:17.897252+0000","last_active":"2024-09-17T05:36:17.904294+0000","last_peered":"2024-09-17T05:36:17.904294+0000","last_clean":"2024-09-17T05:36:17.904294+0000","last_became_active":"2024-09-17T05:36:17.896404+0000","last_became_peered":"2024-09-17T05:36:17.896404+0000","last_unstale":"2024-09-17T05:36:17.904294+0000","last_undegraded":"2024-09-17T05:36:17.904294+0000","last_fullsized":"2024-09-17T05:36:17.904294+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:04.122599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887954+0000","last_change":"2024-09-17T05:36:17.887954+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887954+0000","last_undegraded":"2024-09-17T05:36:17.887954+0000","last_fullsized":"2024-09-17T05:36:17.887954+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.897966+0000","last_change":"2024-09-17T05:36:17.894519+0000","last_active":"2024-09-17T05:36:17.897966+0000","last_peered":"2024-09-17T05:36:17.897966+0000","last_clean":"2024-09-17T05:36:17.897966+0000","last_became_active":"2024-09-17T05:36:17.894226+0000","last_became_peered":"2024-09-17T05:36:17.894226+0000","last_unstale":"2024-09-17T05:36:17.897966+0000","last_undegraded":"2024-09-17T05:36:17.897966+0000","last_fullsized":"2024-09-17T05:36:17.897966+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:42.772544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886288+0000","last_change":"2024-09-17T05:36:17.886288+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886288+0000","last_undegraded":"2024-09-17T05:36:17.886288+0000","last_fullsized":"2024-09-17T05:36:17.886288+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.910462+0000","last_change":"2024-09-17T05:36:17.905621+0000","last_active":"2024-09-17T05:36:17.910462+0000","last_peered":"2024-09-17T05:36:17.910462+0000","last_clean":"2024-09-17T05:36:17.910462+0000","last_became_active":"2024-09-17T05:36:17.905207+0000","last_became_peered":"2024-09-17T05:36:17.905207+0000","last_unstale":"2024-09-17T05:36:17.910462+0000","last_undegraded":"2024-09-17T05:36:17.910462+0000","last_fullsized":"2024-09-17T05:36:17.910462+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:44.838474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885492+0000","last_change":"2024-09-17T05:36:17.885492+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885492+0000","last_undegraded":"2024-09-17T05:36:17.885492+0000","last_fullsized":"2024-09-17T05:36:17.885492+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904651+0000","last_change":"2024-09-17T05:36:17.903329+0000","last_active":"2024-09-17T05:36:17.904651+0000","last_peered":"2024-09-17T05:36:17.904651+0000","last_clean":"2024-09-17T05:36:17.904651+0000","last_became_active":"2024-09-17T05:36:17.903072+0000","last_became_peered":"2024-09-17T05:36:17.903072+0000","last_unstale":"2024-09-17T05:36:17.904651+0000","last_undegraded":"2024-09-17T05:36:17.904651+0000","last_fullsized":"2024-09-17T05:36:17.904651+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:12.779569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886309+0000","last_change":"2024-09-17T05:36:17.886309+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886309+0000","last_undegraded":"2024-09-17T05:36:17.886309+0000","last_fullsized":"2024-09-17T05:36:17.886309+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904961+0000","last_change":"2024-09-17T05:36:17.900853+0000","last_active":"2024-09-17T05:36:17.904961+0000","last_peered":"2024-09-17T05:36:17.904961+0000","last_clean":"2024-09-17T05:36:17.904961+0000","last_became_active":"2024-09-17T05:36:17.898291+0000","last_became_peered":"2024-09-17T05:36:17.898291+0000","last_unstale":"2024-09-17T05:36:17.904961+0000","last_undegraded":"2024-09-17T05:36:17.904961+0000","last_fullsized":"2024-09-17T05:36:17.904961+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:09.616243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886376+0000","last_change":"2024-09-17T05:36:17.886376+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886376+0000","last_undegraded":"2024-09-17T05:36:17.886376+0000","last_fullsized":"2024-09-17T05:36:17.886376+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909516+0000","last_change":"2024-09-17T05:36:17.905265+0000","last_active":"2024-09-17T05:36:17.909516+0000","last_peered":"2024-09-17T05:36:17.909516+0000","last_clean":"2024-09-17T05:36:17.909516+0000","last_became_active":"2024-09-17T05:36:17.901068+0000","last_became_peered":"2024-09-17T05:36:17.901068+0000","last_unstale":"2024-09-17T05:36:17.909516+0000","last_undegraded":"2024-09-17T05:36:17.909516+0000","last_fullsized":"2024-09-17T05:36:17.909516+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:31.985911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884951+0000","last_change":"2024-09-17T05:36:17.884951+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884951+0000","last_undegraded":"2024-09-17T05:36:17.884951+0000","last_fullsized":"2024-09-17T05:36:17.884951+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911186+0000","last_change":"2024-09-17T05:36:17.909883+0000","last_active":"2024-09-17T05:36:17.911186+0000","last_peered":"2024-09-17T05:36:17.911186+0000","last_clean":"2024-09-17T05:36:17.911186+0000","last_became_active":"2024-09-17T05:36:17.909592+0000","last_became_peered":"2024-09-17T05:36:17.909592+0000","last_unstale":"2024-09-17T05:36:17.911186+0000","last_undegraded":"2024-09-17T05:36:17.911186+0000","last_fullsized":"2024-09-17T05:36:17.911186+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:02.007221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.898511+0000","last_change":"2024-09-17T05:36:17.898511+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.898511+0000","last_undegraded":"2024-09-17T05:36:17.898511+0000","last_fullsized":"2024-09-17T05:36:17.898511+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.892532+0000","last_change":"2024-09-17T05:36:17.891610+0000","last_active":"2024-09-17T05:36:17.892532+0000","last_peered":"2024-09-17T05:36:17.892532+0000","last_clean":"2024-09-17T05:36:17.892532+0000","last_became_active":"2024-09-17T05:36:17.891311+0000","last_became_peered":"2024-09-17T05:36:17.891311+0000","last_unstale":"2024-09-17T05:36:17.892532+0000","last_undegraded":"2024-09-17T05:36:17.892532+0000","last_fullsized":"2024-09-17T05:36:17.892532+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:14.454258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884273+0000","last_change":"2024-09-17T05:36:17.884273+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884273+0000","last_undegraded":"2024-09-17T05:36:17.884273+0000","last_fullsized":"2024-09-17T05:36:17.884273+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909079+0000","last_change":"2024-09-17T05:36:17.904403+0000","last_active":"2024-09-17T05:36:17.909079+0000","last_peered":"2024-09-17T05:36:17.909079+0000","last_clean":"2024-09-17T05:36:17.909079+0000","last_became_active":"2024-09-17T05:36:17.904050+0000","last_became_peered":"2024-09-17T05:36:17.904050+0000","last_unstale":"2024-09-17T05:36:17.909079+0000","last_undegraded":"2024-09-17T05:36:17.909079+0000","last_fullsized":"2024-09-17T05:36:17.909079+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:54:44.521389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885864+0000","last_change":"2024-09-17T05:36:17.885864+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885864+0000","last_undegraded":"2024-09-17T05:36:17.885864+0000","last_fullsized":"2024-09-17T05:36:17.885864+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911272+0000","last_change":"2024-09-17T05:36:17.907774+0000","last_active":"2024-09-17T05:36:17.911272+0000","last_peered":"2024-09-17T05:36:17.911272+0000","last_clean":"2024-09-17T05:36:17.911272+0000","last_became_active":"2024-09-17T05:36:17.907451+0000","last_became_peered":"2024-09-17T05:36:17.907451+0000","last_unstale":"2024-09-17T05:36:17.911272+0000","last_undegraded":"2024-09-17T05:36:17.911272+0000","last_fullsized":"2024-09-17T05:36:17.911272+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:28.237700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886866+0000","last_change":"2024-09-17T05:36:17.886866+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886866+0000","last_undegraded":"2024-09-17T05:36:17.886866+0000","last_fullsized":"2024-09-17T05:36:17.886866+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909346+0000","last_change":"2024-09-17T05:36:17.901928+0000","last_active":"2024-09-17T05:36:17.909346+0000","last_peered":"2024-09-17T05:36:17.909346+0000","last_clean":"2024-09-17T05:36:17.909346+0000","last_became_active":"2024-09-17T05:36:17.901658+0000","last_became_peered":"2024-09-17T05:36:17.901658+0000","last_unstale":"2024-09-17T05:36:17.909346+0000","last_undegraded":"2024-09-17T05:36:17.909346+0000","last_fullsized":"2024-09-17T05:36:17.909346+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:47.183684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.894120+0000","last_change":"2024-09-17T05:36:17.894120+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.894120+0000","last_undegraded":"2024-09-17T05:36:17.894120+0000","last_fullsized":"2024-09-17T05:36:17.894120+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911123+0000","last_change":"2024-09-17T05:36:17.909634+0000","last_active":"2024-09-17T05:36:17.911123+0000","last_peered":"2024-09-17T05:36:17.911123+0000","last_clean":"2024-09-17T05:36:17.911123+0000","last_became_active":"2024-09-17T05:36:17.909283+0000","last_became_peered":"2024-09-17T05:36:17.909283+0000","last_unstale":"2024-09-17T05:36:17.911123+0000","last_undegraded":"2024-09-17T05:36:17.911123+0000","last_fullsized":"2024-09-17T05:36:17.911123+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:04.540111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.886723+0000","last_change":"2024-09-17T05:36:17.886723+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.886723+0000","last_undegraded":"2024-09-17T05:36:17.886723+0000","last_fullsized":"2024-09-17T05:36:17.886723+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.905270+0000","last_change":"2024-09-17T05:36:17.902030+0000","last_active":"2024-09-17T05:36:17.905270+0000","last_peered":"2024-09-17T05:36:17.905270+0000","last_clean":"2024-09-17T05:36:17.905270+0000","last_became_active":"2024-09-17T05:36:17.901154+0000","last_became_peered":"2024-09-17T05:36:17.901154+0000","last_unstale":"2024-09-17T05:36:17.905270+0000","last_undegraded":"2024-09-17T05:36:17.905270+0000","last_fullsized":"2024-09-17T05:36:17.905270+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:26.536681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885002+0000","last_change":"2024-09-17T05:36:17.885002+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885002+0000","last_undegraded":"2024-09-17T05:36:17.885002+0000","last_fullsized":"2024-09-17T05:36:17.885002+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911207+0000","last_change":"2024-09-17T05:36:17.906929+0000","last_active":"2024-09-17T05:36:17.911207+0000","last_peered":"2024-09-17T05:36:17.911207+0000","last_clean":"2024-09-17T05:36:17.911207+0000","last_became_active":"2024-09-17T05:36:17.906657+0000","last_became_peered":"2024-09-17T05:36:17.906657+0000","last_unstale":"2024-09-17T05:36:17.911207+0000","last_undegraded":"2024-09-17T05:36:17.911207+0000","last_fullsized":"2024-09-17T05:36:17.911207+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:04.425419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884821+0000","last_change":"2024-09-17T05:36:17.884821+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884821+0000","last_undegraded":"2024-09-17T05:36:17.884821+0000","last_fullsized":"2024-09-17T05:36:17.884821+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.911164+0000","last_change":"2024-09-17T05:36:17.909786+0000","last_active":"2024-09-17T05:36:17.911164+0000","last_peered":"2024-09-17T05:36:17.911164+0000","last_clean":"2024-09-17T05:36:17.911164+0000","last_became_active":"2024-09-17T05:36:17.909389+0000","last_became_peered":"2024-09-17T05:36:17.909389+0000","last_unstale":"2024-09-17T05:36:17.911164+0000","last_undegraded":"2024-09-17T05:36:17.911164+0000","last_fullsized":"2024-09-17T05:36:17.911164+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:02.011245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887351+0000","last_change":"2024-09-17T05:36:17.887351+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887351+0000","last_undegraded":"2024-09-17T05:36:17.887351+0000","last_fullsized":"2024-09-17T05:36:17.887351+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909507+0000","last_change":"2024-09-17T05:36:17.904457+0000","last_active":"2024-09-17T05:36:17.909507+0000","last_peered":"2024-09-17T05:36:17.909507+0000","last_clean":"2024-09-17T05:36:17.909507+0000","last_became_active":"2024-09-17T05:36:17.904044+0000","last_became_peered":"2024-09-17T05:36:17.904044+0000","last_unstale":"2024-09-17T05:36:17.909507+0000","last_undegraded":"2024-09-17T05:36:17.909507+0000","last_fullsized":"2024-09-17T05:36:17.909507+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:03.142400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884659+0000","last_change":"2024-09-17T05:36:17.884659+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884659+0000","last_undegraded":"2024-09-17T05:36:17.884659+0000","last_fullsized":"2024-09-17T05:36:17.884659+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.900621+0000","last_change":"2024-09-17T05:36:17.889028+0000","last_active":"2024-09-17T05:36:17.900621+0000","last_peered":"2024-09-17T05:36:17.900621+0000","last_clean":"2024-09-17T05:36:17.900621+0000","last_became_active":"2024-09-17T05:36:17.886151+0000","last_became_peered":"2024-09-17T05:36:17.886151+0000","last_unstale":"2024-09-17T05:36:17.900621+0000","last_undegraded":"2024-09-17T05:36:17.900621+0000","last_fullsized":"2024-09-17T05:36:17.900621+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:30.991576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884985+0000","last_change":"2024-09-17T05:36:17.884985+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884985+0000","last_undegraded":"2024-09-17T05:36:17.884985+0000","last_fullsized":"2024-09-17T05:36:17.884985+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.910481+0000","last_change":"2024-09-17T05:36:17.909303+0000","last_active":"2024-09-17T05:36:17.910481+0000","last_peered":"2024-09-17T05:36:17.910481+0000","last_clean":"2024-09-17T05:36:17.910481+0000","last_became_active":"2024-09-17T05:36:17.909058+0000","last_became_peered":"2024-09-17T05:36:17.909058+0000","last_unstale":"2024-09-17T05:36:17.910481+0000","last_undegraded":"2024-09-17T05:36:17.910481+0000","last_fullsized":"2024-09-17T05:36:17.910481+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:13.555451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.897036+0000","last_change":"2024-09-17T05:36:17.897036+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.897036+0000","last_undegraded":"2024-09-17T05:36:17.897036+0000","last_fullsized":"2024-09-17T05:36:17.897036+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.903214+0000","last_change":"2024-09-17T05:36:17.900645+0000","last_active":"2024-09-17T05:36:17.903214+0000","last_peered":"2024-09-17T05:36:17.903214+0000","last_clean":"2024-09-17T05:36:17.903214+0000","last_became_active":"2024-09-17T05:36:17.900338+0000","last_became_peered":"2024-09-17T05:36:17.900338+0000","last_unstale":"2024-09-17T05:36:17.903214+0000","last_undegraded":"2024-09-17T05:36:17.903214+0000","last_fullsized":"2024-09-17T05:36:17.903214+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:49.857913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885882+0000","last_change":"2024-09-17T05:36:17.885882+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885882+0000","last_undegraded":"2024-09-17T05:36:17.885882+0000","last_fullsized":"2024-09-17T05:36:17.885882+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.910360+0000","last_change":"2024-09-17T05:36:17.903150+0000","last_active":"2024-09-17T05:36:17.910360+0000","last_peered":"2024-09-17T05:36:17.910360+0000","last_clean":"2024-09-17T05:36:17.910360+0000","last_became_active":"2024-09-17T05:36:17.902834+0000","last_became_peered":"2024-09-17T05:36:17.902834+0000","last_unstale":"2024-09-17T05:36:17.910360+0000","last_undegraded":"2024-09-17T05:36:17.910360+0000","last_fullsized":"2024-09-17T05:36:17.910360+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:16.005227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.883993+0000","last_change":"2024-09-17T05:36:17.883993+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.883993+0000","last_undegraded":"2024-09-17T05:36:17.883993+0000","last_fullsized":"2024-09-17T05:36:17.883993+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.908976+0000","last_change":"2024-09-17T05:36:17.904001+0000","last_active":"2024-09-17T05:36:17.908976+0000","last_peered":"2024-09-17T05:36:17.908976+0000","last_clean":"2024-09-17T05:36:17.908976+0000","last_became_active":"2024-09-17T05:36:17.900330+0000","last_became_peered":"2024-09-17T05:36:17.900330+0000","last_unstale":"2024-09-17T05:36:17.908976+0000","last_undegraded":"2024-09-17T05:36:17.908976+0000","last_fullsized":"2024-09-17T05:36:17.908976+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:55.927724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.898299+0000","last_change":"2024-09-17T05:36:17.898299+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.898299+0000","last_undegraded":"2024-09-17T05:36:17.898299+0000","last_fullsized":"2024-09-17T05:36:17.898299+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.910474+0000","last_change":"2024-09-17T05:36:17.905019+0000","last_active":"2024-09-17T05:36:17.910474+0000","last_peered":"2024-09-17T05:36:17.910474+0000","last_clean":"2024-09-17T05:36:17.910474+0000","last_became_active":"2024-09-17T05:36:17.903334+0000","last_became_peered":"2024-09-17T05:36:17.903334+0000","last_unstale":"2024-09-17T05:36:17.910474+0000","last_undegraded":"2024-09-17T05:36:17.910474+0000","last_fullsized":"2024-09-17T05:36:17.910474+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:22.248556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885764+0000","last_change":"2024-09-17T05:36:17.885764+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885764+0000","last_undegraded":"2024-09-17T05:36:17.885764+0000","last_fullsized":"2024-09-17T05:36:17.885764+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904722+0000","last_change":"2024-09-17T05:36:17.903608+0000","last_active":"2024-09-17T05:36:17.904722+0000","last_peered":"2024-09-17T05:36:17.904722+0000","last_clean":"2024-09-17T05:36:17.904722+0000","last_became_active":"2024-09-17T05:36:17.903276+0000","last_became_peered":"2024-09-17T05:36:17.903276+0000","last_unstale":"2024-09-17T05:36:17.904722+0000","last_undegraded":"2024-09-17T05:36:17.904722+0000","last_fullsized":"2024-09-17T05:36:17.904722+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:37.580096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.890489+0000","last_change":"2024-09-17T05:36:17.890489+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.890489+0000","last_undegraded":"2024-09-17T05:36:17.890489+0000","last_fullsized":"2024-09-17T05:36:17.890489+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909108+0000","last_change":"2024-09-17T05:36:17.908490+0000","last_active":"2024-09-17T05:36:17.909108+0000","last_peered":"2024-09-17T05:36:17.909108+0000","last_clean":"2024-09-17T05:36:17.909108+0000","last_became_active":"2024-09-17T05:36:17.908181+0000","last_became_peered":"2024-09-17T05:36:17.908181+0000","last_unstale":"2024-09-17T05:36:17.909108+0000","last_undegraded":"2024-09-17T05:36:17.909108+0000","last_fullsized":"2024-09-17T05:36:17.909108+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:58.629626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.887331+0000","last_change":"2024-09-17T05:36:17.887331+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.887331+0000","last_undegraded":"2024-09-17T05:36:17.887331+0000","last_fullsized":"2024-09-17T05:36:17.887331+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.907739+0000","last_change":"2024-09-17T05:36:17.904703+0000","last_active":"2024-09-17T05:36:17.907739+0000","last_peered":"2024-09-17T05:36:17.907739+0000","last_clean":"2024-09-17T05:36:17.907739+0000","last_became_active":"2024-09-17T05:36:17.903663+0000","last_became_peered":"2024-09-17T05:36:17.903663+0000","last_unstale":"2024-09-17T05:36:17.907739+0000","last_undegraded":"2024-09-17T05:36:17.907739+0000","last_fullsized":"2024-09-17T05:36:17.907739+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:29.342878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885070+0000","last_change":"2024-09-17T05:36:17.885070+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885070+0000","last_undegraded":"2024-09-17T05:36:17.885070+0000","last_fullsized":"2024-09-17T05:36:17.885070+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.907501+0000","last_change":"2024-09-17T05:36:17.903663+0000","last_active":"2024-09-17T05:36:17.907501+0000","last_peered":"2024-09-17T05:36:17.907501+0000","last_clean":"2024-09-17T05:36:17.907501+0000","last_became_active":"2024-09-17T05:36:17.903373+0000","last_became_peered":"2024-09-17T05:36:17.903373+0000","last_unstale":"2024-09-17T05:36:17.907501+0000","last_undegraded":"2024-09-17T05:36:17.907501+0000","last_fullsized":"2024-09-17T05:36:17.907501+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:54.399557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885530+0000","last_change":"2024-09-17T05:36:17.885530+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885530+0000","last_undegraded":"2024-09-17T05:36:17.885530+0000","last_fullsized":"2024-09-17T05:36:17.885530+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.900766+0000","last_change":"2024-09-17T05:36:17.889967+0000","last_active":"2024-09-17T05:36:17.900766+0000","last_peered":"2024-09-17T05:36:17.900766+0000","last_clean":"2024-09-17T05:36:17.900766+0000","last_became_active":"2024-09-17T05:36:17.889687+0000","last_became_peered":"2024-09-17T05:36:17.889687+0000","last_unstale":"2024-09-17T05:36:17.900766+0000","last_undegraded":"2024-09-17T05:36:17.900766+0000","last_fullsized":"2024-09-17T05:36:17.900766+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:52.746071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.888637+0000","last_change":"2024-09-17T05:36:17.888637+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.888637+0000","last_undegraded":"2024-09-17T05:36:17.888637+0000","last_fullsized":"2024-09-17T05:36:17.888637+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.904102+0000","last_change":"2024-09-17T05:36:17.901496+0000","last_active":"2024-09-17T05:36:17.904102+0000","last_peered":"2024-09-17T05:36:17.904102+0000","last_clean":"2024-09-17T05:36:17.904102+0000","last_became_active":"2024-09-17T05:36:17.901170+0000","last_became_peered":"2024-09-17T05:36:17.901170+0000","last_unstale":"2024-09-17T05:36:17.904102+0000","last_undegraded":"2024-09-17T05:36:17.904102+0000","last_fullsized":"2024-09-17T05:36:17.904102+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:54.128073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.888619+0000","last_change":"2024-09-17T05:36:17.888619+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.888619+0000","last_undegraded":"2024-09-17T05:36:17.888619+0000","last_fullsized":"2024-09-17T05:36:17.888619+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.897089+0000","last_change":"2024-09-17T05:36:17.894247+0000","last_active":"2024-09-17T05:36:17.897089+0000","last_peered":"2024-09-17T05:36:17.897089+0000","last_clean":"2024-09-17T05:36:17.897089+0000","last_became_active":"2024-09-17T05:36:17.892459+0000","last_became_peered":"2024-09-17T05:36:17.892459+0000","last_unstale":"2024-09-17T05:36:17.897089+0000","last_undegraded":"2024-09-17T05:36:17.897089+0000","last_fullsized":"2024-09-17T05:36:17.897089+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:03.778158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.893917+0000","last_change":"2024-09-17T05:36:17.893917+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.893917+0000","last_undegraded":"2024-09-17T05:36:17.893917+0000","last_fullsized":"2024-09-17T05:36:17.893917+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.902602+0000","last_change":"2024-09-17T05:36:17.900164+0000","last_active":"2024-09-17T05:36:17.902602+0000","last_peered":"2024-09-17T05:36:17.902602+0000","last_clean":"2024-09-17T05:36:17.902602+0000","last_became_active":"2024-09-17T05:36:17.899350+0000","last_became_peered":"2024-09-17T05:36:17.899350+0000","last_unstale":"2024-09-17T05:36:17.902602+0000","last_undegraded":"2024-09-17T05:36:17.902602+0000","last_fullsized":"2024-09-17T05:36:17.902602+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:21:14.211298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.885327+0000","last_change":"2024-09-17T05:36:17.885327+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.885327+0000","last_undegraded":"2024-09-17T05:36:17.885327+0000","last_fullsized":"2024-09-17T05:36:17.885327+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.909253+0000","last_change":"2024-09-17T05:36:17.899163+0000","last_active":"2024-09-17T05:36:17.909253+0000","last_peered":"2024-09-17T05:36:17.909253+0000","last_clean":"2024-09-17T05:36:17.909253+0000","last_became_active":"2024-09-17T05:36:17.898886+0000","last_became_peered":"2024-09-17T05:36:17.898886+0000","last_unstale":"2024-09-17T05:36:17.909253+0000","last_undegraded":"2024-09-17T05:36:17.909253+0000","last_fullsized":"2024-09-17T05:36:17.909253+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:44:47.420121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":150,"state":"creating+peering","last_fresh":"2024-09-17T05:36:17.884877+0000","last_change":"2024-09-17T05:36:17.884877+0000","last_active":"2024-09-17T05:36:17.871862+0000","last_peered":"2024-09-17T05:36:17.871862+0000","last_clean":"2024-09-17T05:36:17.871862+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:36:17.884877+0000","last_undegraded":"2024-09-17T05:36:17.884877+0000","last_fullsized":"2024-09-17T05:36:17.884877+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.903707+0000","last_change":"2024-09-17T05:36:17.902499+0000","last_active":"2024-09-17T05:36:17.903707+0000","last_peered":"2024-09-17T05:36:17.903707+0000","last_clean":"2024-09-17T05:36:17.903707+0000","last_became_active":"2024-09-17T05:36:17.902216+0000","last_became_peered":"2024-09-17T05:36:17.902216+0000","last_unstale":"2024-09-17T05:36:17.903707+0000","last_undegraded":"2024-09-17T05:36:17.903707+0000","last_fullsized":"2024-09-17T05:36:17.903707+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:07.872232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":374,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T05:36:17.889922+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:36:17.889922+0000","last_peered":"2024-09-17T05:36:17.889922+0000","last_clean":"2024-09-17T05:36:17.889922+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:36:17.889922+0000","last_undegraded":"2024-09-17T05:36:17.889922+0000","last_fullsized":"2024-09-17T05:36:17.889922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509536,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33612,"kb_used_data":2420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338228,"statfs":{"total":96636764160,"available":96602345472,"internally_reserved":0,"allocated":2478080,"data_stored":1419379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542240,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33028,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509537,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33028,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509535,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":829011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542239,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37772,"kb_used_data":2420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334068,"statfs":{"total":96636764160,"available":96598085632,"internally_reserved":0,"allocated":2478080,"data_stored":1419379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:36:27.693 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:36:27.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.848+0000 7f572c200640 1 -- 172.21.15.31:0/1239346646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57240afca0 msgr2=0x7f57240b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:27.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.848+0000 7f572c200640 1 --2- 172.21.15.31:0/1239346646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57240afca0 0x7f57240b00d0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f57240cfb60 tx=0x7f571c01ccc0 comp rx=0 tx=0).stop 2024-09-17T05:36:27.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.848+0000 7f572c200640 1 -- 172.21.15.31:0/1239346646 shutdown_connections 2024-09-17T05:36:27.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.848+0000 7f572c200640 1 --2- 172.21.15.31:0/1239346646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57240afca0 0x7f57240b00d0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:27.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.848+0000 7f572c200640 1 --2- 172.21.15.31:0/1239346646 >> v2:172.21.15.155:3300/0 conn(0x7f572415f490 0x7f57240b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:27.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.848+0000 7f572c200640 1 -- 172.21.15.31:0/1239346646 >> 172.21.15.31:0/1239346646 conn(0x7f57240d1e30 msgr2=0x7f57240d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:27.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f572c200640 1 -- 172.21.15.31:0/1239346646 shutdown_connections 2024-09-17T05:36:27.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f572c200640 1 -- 172.21.15.31:0/1239346646 wait complete. 2024-09-17T05:36:27.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f572c200640 1 Processor -- start 2024-09-17T05:36:27.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f572c200640 1 -- start start 2024-09-17T05:36:27.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f572c200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57240afca0 0x7f57240c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:27.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f572c200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57240b2e80 0x7f57240ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:27.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f572c200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f572415f490 0x7f5724150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:27.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f572c200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5724168e00 con 0x7f57240afca0 2024-09-17T05:36:27.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f572c200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5724168c80 con 0x7f57240b2e80 2024-09-17T05:36:27.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f572c200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5724168f80 con 0x7f572415f490 2024-09-17T05:36:27.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f5729800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57240afca0 0x7f57240c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:27.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f5729800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57240afca0 0x7f57240c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34744/0 (socket says 172.21.15.31:34744) 2024-09-17T05:36:27.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f5729800640 1 -- 172.21.15.31:0/4164603447 learned_addr learned my addr 172.21.15.31:0/4164603447 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:27.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f5728e00640 1 --2- 172.21.15.31:0/4164603447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57240b2e80 0x7f57240ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:27.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f572a200640 1 --2- 172.21.15.31:0/4164603447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f572415f490 0x7f5724150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:27.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f5729800640 1 -- 172.21.15.31:0/4164603447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f572415f490 msgr2=0x7f5724150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:27.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f5729800640 1 --2- 172.21.15.31:0/4164603447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f572415f490 0x7f5724150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:27.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f5729800640 1 -- 172.21.15.31:0/4164603447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57240b2e80 msgr2=0x7f57240ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:27.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f5729800640 1 --2- 172.21.15.31:0/4164603447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57240b2e80 0x7f57240ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:27.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f5729800640 1 -- 172.21.15.31:0/4164603447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5724150940 con 0x7f57240afca0 2024-09-17T05:36:27.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f572a200640 1 --2- 172.21.15.31:0/4164603447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f572415f490 0x7f5724150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:27.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.852+0000 7f5729800640 1 --2- 172.21.15.31:0/4164603447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57240afca0 0x7f57240c6810 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f571800d750 tx=0x7f571800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:27.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.856+0000 7f5721600640 1 -- 172.21.15.31:0/4164603447 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5718017070 con 0x7f57240afca0 2024-09-17T05:36:27.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.856+0000 7f5721600640 1 -- 172.21.15.31:0/4164603447 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5718009cc0 con 0x7f57240afca0 2024-09-17T05:36:27.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.856+0000 7f572c200640 1 -- 172.21.15.31:0/4164603447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57240cda90 con 0x7f57240afca0 2024-09-17T05:36:27.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.856+0000 7f5721600640 1 -- 172.21.15.31:0/4164603447 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5718005280 con 0x7f57240afca0 2024-09-17T05:36:27.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.856+0000 7f572c200640 1 -- 172.21.15.31:0/4164603447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57240ce050 con 0x7f57240afca0 2024-09-17T05:36:27.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.856+0000 7f572c200640 1 -- 172.21.15.31:0/4164603447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57240b00d0 con 0x7f57240afca0 2024-09-17T05:36:27.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.856+0000 7f5721600640 1 -- 172.21.15.31:0/4164603447 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f5718005420 con 0x7f57240afca0 2024-09-17T05:36:27.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.856+0000 7f5721600640 1 --2- 172.21.15.31:0/4164603447 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5704073a70 0x7f5704075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:27.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.856+0000 7f5721600640 1 -- 172.21.15.31:0/4164603447 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f57180954b0 con 0x7f57240afca0 2024-09-17T05:36:27.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.856+0000 7f5728e00640 1 --2- 172.21.15.31:0/4164603447 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5704073a70 0x7f5704075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:27.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.860+0000 7f5728e00640 1 --2- 172.21.15.31:0/4164603447 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5704073a70 0x7f5704075f30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f57240cf430 tx=0x7f5710009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:27.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:27.860+0000 7f5721600640 1 -- 172.21.15.31:0/4164603447 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f571800de60 con 0x7f57240afca0 2024-09-17T05:36:28.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.032+0000 7f572c200640 1 -- 172.21.15.31:0/4164603447 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f57240d2270 con 0x7f5704073a70 2024-09-17T05:36:28.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.036+0000 7f5721600640 1 -- 172.21.15.31:0/4164603447 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252480 (secure 0 0 0) 0x7f57240d2270 con 0x7f5704073a70 2024-09-17T05:36:28.042 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:28.044 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:36:28.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.040+0000 7f572c200640 1 -- 172.21.15.31:0/4164603447 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5704073a70 msgr2=0x7f5704075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:28.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.040+0000 7f572c200640 1 --2- 172.21.15.31:0/4164603447 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5704073a70 0x7f5704075f30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f57240cf430 tx=0x7f5710009040 comp rx=0 tx=0).stop 2024-09-17T05:36:28.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.040+0000 7f572c200640 1 -- 172.21.15.31:0/4164603447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57240afca0 msgr2=0x7f57240c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:28.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.040+0000 7f572c200640 1 --2- 172.21.15.31:0/4164603447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57240afca0 0x7f57240c6810 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f571800d750 tx=0x7f571800dc10 comp rx=0 tx=0).stop 2024-09-17T05:36:28.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.040+0000 7f572c200640 1 -- 172.21.15.31:0/4164603447 shutdown_connections 2024-09-17T05:36:28.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.040+0000 7f572c200640 1 --2- 172.21.15.31:0/4164603447 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5704073a70 0x7f5704075f30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.040+0000 7f572c200640 1 --2- 172.21.15.31:0/4164603447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f572415f490 0x7f5724150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.040+0000 7f572c200640 1 --2- 172.21.15.31:0/4164603447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57240b2e80 0x7f57240ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.040+0000 7f572c200640 1 --2- 172.21.15.31:0/4164603447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57240afca0 0x7f57240c6810 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.040+0000 7f572c200640 1 -- 172.21.15.31:0/4164603447 >> 172.21.15.31:0/4164603447 conn(0x7f57240d1e30 msgr2=0x7f572406e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:28.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.040+0000 7f572c200640 1 -- 172.21.15.31:0/4164603447 shutdown_connections 2024-09-17T05:36:28.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.040+0000 7f572c200640 1 -- 172.21.15.31:0/4164603447 wait complete. 2024-09-17T05:36:28.064 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2024-09-17T05:36:26.748798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":269824,"kb_used_data":16136,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754704896,"statfs":{"total":773094113280,"available":772817813504,"internally_reserved":0,"allocated":16523264,"data_stored":7922692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001899"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.245362+0000","last_change":"2024-09-17T05:36:18.931432+0000","last_active":"2024-09-17T05:36:20.245362+0000","last_peered":"2024-09-17T05:36:20.245362+0000","last_clean":"2024-09-17T05:36:20.245362+0000","last_became_active":"2024-09-17T05:36:18.931127+0000","last_became_peered":"2024-09-17T05:36:18.931127+0000","last_unstale":"2024-09-17T05:36:20.245362+0000","last_undegraded":"2024-09-17T05:36:20.245362+0000","last_fullsized":"2024-09-17T05:36:20.245362+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:20.607215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.245747+0000","last_change":"2024-09-17T05:36:18.927717+0000","last_active":"2024-09-17T05:36:20.245747+0000","last_peered":"2024-09-17T05:36:20.245747+0000","last_clean":"2024-09-17T05:36:20.245747+0000","last_became_active":"2024-09-17T05:36:18.927414+0000","last_became_peered":"2024-09-17T05:36:18.927414+0000","last_unstale":"2024-09-17T05:36:20.245747+0000","last_undegraded":"2024-09-17T05:36:20.245747+0000","last_fullsized":"2024-09-17T05:36:20.245747+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:39.609628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.899853+0000","last_change":"2024-09-17T05:36:18.925513+0000","last_active":"2024-09-17T05:36:19.899853+0000","last_peered":"2024-09-17T05:36:19.899853+0000","last_clean":"2024-09-17T05:36:19.899853+0000","last_became_active":"2024-09-17T05:36:18.925277+0000","last_became_peered":"2024-09-17T05:36:18.925277+0000","last_unstale":"2024-09-17T05:36:19.899853+0000","last_undegraded":"2024-09-17T05:36:19.899853+0000","last_fullsized":"2024-09-17T05:36:19.899853+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:39.483091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.245591+0000","last_change":"2024-09-17T05:36:18.915608+0000","last_active":"2024-09-17T05:36:20.245591+0000","last_peered":"2024-09-17T05:36:20.245591+0000","last_clean":"2024-09-17T05:36:20.245591+0000","last_became_active":"2024-09-17T05:36:18.915357+0000","last_became_peered":"2024-09-17T05:36:18.915357+0000","last_unstale":"2024-09-17T05:36:20.245591+0000","last_undegraded":"2024-09-17T05:36:20.245591+0000","last_fullsized":"2024-09-17T05:36:20.245591+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:09.879213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.241721+0000","last_change":"2024-09-17T05:36:18.912368+0000","last_active":"2024-09-17T05:36:20.241721+0000","last_peered":"2024-09-17T05:36:20.241721+0000","last_clean":"2024-09-17T05:36:20.241721+0000","last_became_active":"2024-09-17T05:36:18.912089+0000","last_became_peered":"2024-09-17T05:36:18.912089+0000","last_unstale":"2024-09-17T05:36:20.241721+0000","last_undegraded":"2024-09-17T05:36:20.241721+0000","last_fullsized":"2024-09-17T05:36:20.241721+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:48.577248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.899567+0000","last_change":"2024-09-17T05:36:18.928324+0000","last_active":"2024-09-17T05:36:19.899567+0000","last_peered":"2024-09-17T05:36:19.899567+0000","last_clean":"2024-09-17T05:36:19.899567+0000","last_became_active":"2024-09-17T05:36:18.926396+0000","last_became_peered":"2024-09-17T05:36:18.926396+0000","last_unstale":"2024-09-17T05:36:19.899567+0000","last_undegraded":"2024-09-17T05:36:19.899567+0000","last_fullsized":"2024-09-17T05:36:19.899567+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:54.780795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.901365+0000","last_change":"2024-09-17T05:36:18.923531+0000","last_active":"2024-09-17T05:36:19.901365+0000","last_peered":"2024-09-17T05:36:19.901365+0000","last_clean":"2024-09-17T05:36:19.901365+0000","last_became_active":"2024-09-17T05:36:18.923138+0000","last_became_peered":"2024-09-17T05:36:18.923138+0000","last_unstale":"2024-09-17T05:36:19.901365+0000","last_undegraded":"2024-09-17T05:36:19.901365+0000","last_fullsized":"2024-09-17T05:36:19.901365+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:53.753192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.242190+0000","last_change":"2024-09-17T05:36:18.906864+0000","last_active":"2024-09-17T05:36:20.242190+0000","last_peered":"2024-09-17T05:36:20.242190+0000","last_clean":"2024-09-17T05:36:20.242190+0000","last_became_active":"2024-09-17T05:36:18.904814+0000","last_became_peered":"2024-09-17T05:36:18.904814+0000","last_unstale":"2024-09-17T05:36:20.242190+0000","last_undegraded":"2024-09-17T05:36:20.242190+0000","last_fullsized":"2024-09-17T05:36:20.242190+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:58.318936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.904407+0000","last_change":"2024-09-17T05:36:18.912173+0000","last_active":"2024-09-17T05:36:19.904407+0000","last_peered":"2024-09-17T05:36:19.904407+0000","last_clean":"2024-09-17T05:36:19.904407+0000","last_became_active":"2024-09-17T05:36:18.911845+0000","last_became_peered":"2024-09-17T05:36:18.911845+0000","last_unstale":"2024-09-17T05:36:19.904407+0000","last_undegraded":"2024-09-17T05:36:19.904407+0000","last_fullsized":"2024-09-17T05:36:19.904407+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:44:19.167956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.895945+0000","last_change":"2024-09-17T05:36:18.932495+0000","last_active":"2024-09-17T05:36:19.895945+0000","last_peered":"2024-09-17T05:36:19.895945+0000","last_clean":"2024-09-17T05:36:19.895945+0000","last_became_active":"2024-09-17T05:36:18.932208+0000","last_became_peered":"2024-09-17T05:36:18.932208+0000","last_unstale":"2024-09-17T05:36:19.895945+0000","last_undegraded":"2024-09-17T05:36:19.895945+0000","last_fullsized":"2024-09-17T05:36:19.895945+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:25.146879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.901865+0000","last_change":"2024-09-17T05:36:18.915364+0000","last_active":"2024-09-17T05:36:19.901865+0000","last_peered":"2024-09-17T05:36:19.901865+0000","last_clean":"2024-09-17T05:36:19.901865+0000","last_became_active":"2024-09-17T05:36:18.915079+0000","last_became_peered":"2024-09-17T05:36:18.915079+0000","last_unstale":"2024-09-17T05:36:19.901865+0000","last_undegraded":"2024-09-17T05:36:19.901865+0000","last_fullsized":"2024-09-17T05:36:19.901865+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:59.636746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.245620+0000","last_change":"2024-09-17T05:36:18.915608+0000","last_active":"2024-09-17T05:36:20.245620+0000","last_peered":"2024-09-17T05:36:20.245620+0000","last_clean":"2024-09-17T05:36:20.245620+0000","last_became_active":"2024-09-17T05:36:18.915319+0000","last_became_peered":"2024-09-17T05:36:18.915319+0000","last_unstale":"2024-09-17T05:36:20.245620+0000","last_undegraded":"2024-09-17T05:36:20.245620+0000","last_fullsized":"2024-09-17T05:36:20.245620+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:39.483091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.245645+0000","last_change":"2024-09-17T05:36:18.913108+0000","last_active":"2024-09-17T05:36:20.245645+0000","last_peered":"2024-09-17T05:36:20.245645+0000","last_clean":"2024-09-17T05:36:20.245645+0000","last_became_active":"2024-09-17T05:36:18.912396+0000","last_became_peered":"2024-09-17T05:36:18.912396+0000","last_unstale":"2024-09-17T05:36:20.245645+0000","last_undegraded":"2024-09-17T05:36:20.245645+0000","last_fullsized":"2024-09-17T05:36:20.245645+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:12.537571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.903795+0000","last_change":"2024-09-17T05:36:18.924763+0000","last_active":"2024-09-17T05:36:19.903795+0000","last_peered":"2024-09-17T05:36:19.903795+0000","last_clean":"2024-09-17T05:36:19.903795+0000","last_became_active":"2024-09-17T05:36:18.924453+0000","last_became_peered":"2024-09-17T05:36:18.924453+0000","last_unstale":"2024-09-17T05:36:19.903795+0000","last_undegraded":"2024-09-17T05:36:19.903795+0000","last_fullsized":"2024-09-17T05:36:19.903795+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:54.459418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.245995+0000","last_change":"2024-09-17T05:36:18.916683+0000","last_active":"2024-09-17T05:36:20.245995+0000","last_peered":"2024-09-17T05:36:20.245995+0000","last_clean":"2024-09-17T05:36:20.245995+0000","last_became_active":"2024-09-17T05:36:18.916392+0000","last_became_peered":"2024-09-17T05:36:18.916392+0000","last_unstale":"2024-09-17T05:36:20.245995+0000","last_undegraded":"2024-09-17T05:36:20.245995+0000","last_fullsized":"2024-09-17T05:36:20.245995+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:38.398363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.242307+0000","last_change":"2024-09-17T05:36:18.902470+0000","last_active":"2024-09-17T05:36:20.242307+0000","last_peered":"2024-09-17T05:36:20.242307+0000","last_clean":"2024-09-17T05:36:20.242307+0000","last_became_active":"2024-09-17T05:36:18.902165+0000","last_became_peered":"2024-09-17T05:36:18.902165+0000","last_unstale":"2024-09-17T05:36:20.242307+0000","last_undegraded":"2024-09-17T05:36:20.242307+0000","last_fullsized":"2024-09-17T05:36:20.242307+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:53:06.856428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.242023+0000","last_change":"2024-09-17T05:36:18.914197+0000","last_active":"2024-09-17T05:36:20.242023+0000","last_peered":"2024-09-17T05:36:20.242023+0000","last_clean":"2024-09-17T05:36:20.242023+0000","last_became_active":"2024-09-17T05:36:18.913514+0000","last_became_peered":"2024-09-17T05:36:18.913514+0000","last_unstale":"2024-09-17T05:36:20.242023+0000","last_undegraded":"2024-09-17T05:36:20.242023+0000","last_fullsized":"2024-09-17T05:36:20.242023+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:40.214274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.245241+0000","last_change":"2024-09-17T05:36:18.917933+0000","last_active":"2024-09-17T05:36:20.245241+0000","last_peered":"2024-09-17T05:36:20.245241+0000","last_clean":"2024-09-17T05:36:20.245241+0000","last_became_active":"2024-09-17T05:36:18.917655+0000","last_became_peered":"2024-09-17T05:36:18.917655+0000","last_unstale":"2024-09-17T05:36:20.245241+0000","last_undegraded":"2024-09-17T05:36:20.245241+0000","last_fullsized":"2024-09-17T05:36:20.245241+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:02.305295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.896030+0000","last_change":"2024-09-17T05:36:18.919256+0000","last_active":"2024-09-17T05:36:19.896030+0000","last_peered":"2024-09-17T05:36:19.896030+0000","last_clean":"2024-09-17T05:36:19.896030+0000","last_became_active":"2024-09-17T05:36:18.918967+0000","last_became_peered":"2024-09-17T05:36:18.918967+0000","last_unstale":"2024-09-17T05:36:19.896030+0000","last_undegraded":"2024-09-17T05:36:19.896030+0000","last_fullsized":"2024-09-17T05:36:19.896030+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:30.139689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.241752+0000","last_change":"2024-09-17T05:36:18.913632+0000","last_active":"2024-09-17T05:36:20.241752+0000","last_peered":"2024-09-17T05:36:20.241752+0000","last_clean":"2024-09-17T05:36:20.241752+0000","last_became_active":"2024-09-17T05:36:18.913321+0000","last_became_peered":"2024-09-17T05:36:18.913321+0000","last_unstale":"2024-09-17T05:36:20.241752+0000","last_undegraded":"2024-09-17T05:36:20.241752+0000","last_fullsized":"2024-09-17T05:36:20.241752+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:24.999201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.241751+0000","last_change":"2024-09-17T05:36:18.912348+0000","last_active":"2024-09-17T05:36:20.241751+0000","last_peered":"2024-09-17T05:36:20.241751+0000","last_clean":"2024-09-17T05:36:20.241751+0000","last_became_active":"2024-09-17T05:36:18.912043+0000","last_became_peered":"2024-09-17T05:36:18.912043+0000","last_unstale":"2024-09-17T05:36:20.241751+0000","last_undegraded":"2024-09-17T05:36:20.241751+0000","last_fullsized":"2024-09-17T05:36:20.241751+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:56.972116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.895530+0000","last_change":"2024-09-17T05:36:18.917986+0000","last_active":"2024-09-17T05:36:19.895530+0000","last_peered":"2024-09-17T05:36:19.895530+0000","last_clean":"2024-09-17T05:36:19.895530+0000","last_became_active":"2024-09-17T05:36:18.917655+0000","last_became_peered":"2024-09-17T05:36:18.917655+0000","last_unstale":"2024-09-17T05:36:19.895530+0000","last_undegraded":"2024-09-17T05:36:19.895530+0000","last_fullsized":"2024-09-17T05:36:19.895530+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:33:16.823581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.899499+0000","last_change":"2024-09-17T05:36:18.927987+0000","last_active":"2024-09-17T05:36:19.899499+0000","last_peered":"2024-09-17T05:36:19.899499+0000","last_clean":"2024-09-17T05:36:19.899499+0000","last_became_active":"2024-09-17T05:36:18.926879+0000","last_became_peered":"2024-09-17T05:36:18.926879+0000","last_unstale":"2024-09-17T05:36:19.899499+0000","last_undegraded":"2024-09-17T05:36:19.899499+0000","last_fullsized":"2024-09-17T05:36:19.899499+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:15.108040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.242399+0000","last_change":"2024-09-17T05:36:18.927629+0000","last_active":"2024-09-17T05:36:20.242399+0000","last_peered":"2024-09-17T05:36:20.242399+0000","last_clean":"2024-09-17T05:36:20.242399+0000","last_became_active":"2024-09-17T05:36:18.925540+0000","last_became_peered":"2024-09-17T05:36:18.925540+0000","last_unstale":"2024-09-17T05:36:20.242399+0000","last_undegraded":"2024-09-17T05:36:20.242399+0000","last_fullsized":"2024-09-17T05:36:20.242399+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:55.384725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.245725+0000","last_change":"2024-09-17T05:36:18.931508+0000","last_active":"2024-09-17T05:36:20.245725+0000","last_peered":"2024-09-17T05:36:20.245725+0000","last_clean":"2024-09-17T05:36:20.245725+0000","last_became_active":"2024-09-17T05:36:18.931138+0000","last_became_peered":"2024-09-17T05:36:18.931138+0000","last_unstale":"2024-09-17T05:36:20.245725+0000","last_undegraded":"2024-09-17T05:36:20.245725+0000","last_fullsized":"2024-09-17T05:36:20.245725+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:15.557399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.901704+0000","last_change":"2024-09-17T05:36:18.929796+0000","last_active":"2024-09-17T05:36:19.901704+0000","last_peered":"2024-09-17T05:36:19.901704+0000","last_clean":"2024-09-17T05:36:19.901704+0000","last_became_active":"2024-09-17T05:36:18.929408+0000","last_became_peered":"2024-09-17T05:36:18.929408+0000","last_unstale":"2024-09-17T05:36:19.901704+0000","last_undegraded":"2024-09-17T05:36:19.901704+0000","last_fullsized":"2024-09-17T05:36:19.901704+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:11.957237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.899913+0000","last_change":"2024-09-17T05:36:18.924405+0000","last_active":"2024-09-17T05:36:19.899913+0000","last_peered":"2024-09-17T05:36:19.899913+0000","last_clean":"2024-09-17T05:36:19.899913+0000","last_became_active":"2024-09-17T05:36:18.924113+0000","last_became_peered":"2024-09-17T05:36:18.924113+0000","last_unstale":"2024-09-17T05:36:19.899913+0000","last_undegraded":"2024-09-17T05:36:19.899913+0000","last_fullsized":"2024-09-17T05:36:19.899913+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:12.537571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.242053+0000","last_change":"2024-09-17T05:36:18.916681+0000","last_active":"2024-09-17T05:36:20.242053+0000","last_peered":"2024-09-17T05:36:20.242053+0000","last_clean":"2024-09-17T05:36:20.242053+0000","last_became_active":"2024-09-17T05:36:18.916332+0000","last_became_peered":"2024-09-17T05:36:18.916332+0000","last_unstale":"2024-09-17T05:36:20.242053+0000","last_undegraded":"2024-09-17T05:36:20.242053+0000","last_fullsized":"2024-09-17T05:36:20.242053+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:37:43.487508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.245861+0000","last_change":"2024-09-17T05:36:18.916249+0000","last_active":"2024-09-17T05:36:20.245861+0000","last_peered":"2024-09-17T05:36:20.245861+0000","last_clean":"2024-09-17T05:36:20.245861+0000","last_became_active":"2024-09-17T05:36:18.915999+0000","last_became_peered":"2024-09-17T05:36:18.915999+0000","last_unstale":"2024-09-17T05:36:20.245861+0000","last_undegraded":"2024-09-17T05:36:20.245861+0000","last_fullsized":"2024-09-17T05:36:20.245861+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:50.095024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.903836+0000","last_change":"2024-09-17T05:36:18.914644+0000","last_active":"2024-09-17T05:36:19.903836+0000","last_peered":"2024-09-17T05:36:19.903836+0000","last_clean":"2024-09-17T05:36:19.903836+0000","last_became_active":"2024-09-17T05:36:18.914339+0000","last_became_peered":"2024-09-17T05:36:18.914339+0000","last_unstale":"2024-09-17T05:36:19.903836+0000","last_undegraded":"2024-09-17T05:36:19.903836+0000","last_fullsized":"2024-09-17T05:36:19.903836+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:20.367201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.899590+0000","last_change":"2024-09-17T05:36:18.929193+0000","last_active":"2024-09-17T05:36:19.899590+0000","last_peered":"2024-09-17T05:36:19.899590+0000","last_clean":"2024-09-17T05:36:19.899590+0000","last_became_active":"2024-09-17T05:36:18.928947+0000","last_became_peered":"2024-09-17T05:36:18.928947+0000","last_unstale":"2024-09-17T05:36:19.899590+0000","last_undegraded":"2024-09-17T05:36:19.899590+0000","last_fullsized":"2024-09-17T05:36:19.899590+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:22.532409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.241861+0000","last_change":"2024-09-17T05:36:18.912979+0000","last_active":"2024-09-17T05:36:20.241861+0000","last_peered":"2024-09-17T05:36:20.241861+0000","last_clean":"2024-09-17T05:36:20.241861+0000","last_became_active":"2024-09-17T05:36:18.912718+0000","last_became_peered":"2024-09-17T05:36:18.912718+0000","last_unstale":"2024-09-17T05:36:20.241861+0000","last_undegraded":"2024-09-17T05:36:20.241861+0000","last_fullsized":"2024-09-17T05:36:20.241861+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:33.183436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.242894+0000","last_change":"2024-09-17T05:36:18.902075+0000","last_active":"2024-09-17T05:36:20.242894+0000","last_peered":"2024-09-17T05:36:20.242894+0000","last_clean":"2024-09-17T05:36:20.242894+0000","last_became_active":"2024-09-17T05:36:18.901773+0000","last_became_peered":"2024-09-17T05:36:18.901773+0000","last_unstale":"2024-09-17T05:36:20.242894+0000","last_undegraded":"2024-09-17T05:36:20.242894+0000","last_fullsized":"2024-09-17T05:36:20.242894+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:49.715871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"151'4","reported_seq":19,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.241989+0000","last_change":"2024-09-17T05:36:17.897252+0000","last_active":"2024-09-17T05:36:20.241989+0000","last_peered":"2024-09-17T05:36:20.241989+0000","last_clean":"2024-09-17T05:36:20.241989+0000","last_became_active":"2024-09-17T05:36:17.896404+0000","last_became_peered":"2024-09-17T05:36:17.896404+0000","last_unstale":"2024-09-17T05:36:20.241989+0000","last_undegraded":"2024-09-17T05:36:20.241989+0000","last_fullsized":"2024-09-17T05:36:20.241989+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:52.702509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.896280+0000","last_change":"2024-09-17T05:36:18.935053+0000","last_active":"2024-09-17T05:36:19.896280+0000","last_peered":"2024-09-17T05:36:19.896280+0000","last_clean":"2024-09-17T05:36:19.896280+0000","last_became_active":"2024-09-17T05:36:18.934772+0000","last_became_peered":"2024-09-17T05:36:18.934772+0000","last_unstale":"2024-09-17T05:36:19.896280+0000","last_undegraded":"2024-09-17T05:36:19.896280+0000","last_fullsized":"2024-09-17T05:36:19.896280+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:58:15.222452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"151'1","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.904277+0000","last_change":"2024-09-17T05:36:17.894519+0000","last_active":"2024-09-17T05:36:19.904277+0000","last_peered":"2024-09-17T05:36:19.904277+0000","last_clean":"2024-09-17T05:36:19.904277+0000","last_became_active":"2024-09-17T05:36:17.894226+0000","last_became_peered":"2024-09-17T05:36:17.894226+0000","last_unstale":"2024-09-17T05:36:19.904277+0000","last_undegraded":"2024-09-17T05:36:19.904277+0000","last_fullsized":"2024-09-17T05:36:19.904277+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:18.350912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.901675+0000","last_change":"2024-09-17T05:36:18.917514+0000","last_active":"2024-09-17T05:36:19.901675+0000","last_peered":"2024-09-17T05:36:19.901675+0000","last_clean":"2024-09-17T05:36:19.901675+0000","last_became_active":"2024-09-17T05:36:18.917247+0000","last_became_peered":"2024-09-17T05:36:18.917247+0000","last_unstale":"2024-09-17T05:36:19.901675+0000","last_undegraded":"2024-09-17T05:36:19.901675+0000","last_fullsized":"2024-09-17T05:36:19.901675+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:38.523219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"151'2","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.900002+0000","last_change":"2024-09-17T05:36:17.905621+0000","last_active":"2024-09-17T05:36:19.900002+0000","last_peered":"2024-09-17T05:36:19.900002+0000","last_clean":"2024-09-17T05:36:19.900002+0000","last_became_active":"2024-09-17T05:36:17.905207+0000","last_became_peered":"2024-09-17T05:36:17.905207+0000","last_unstale":"2024-09-17T05:36:19.900002+0000","last_undegraded":"2024-09-17T05:36:19.900002+0000","last_fullsized":"2024-09-17T05:36:19.900002+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:12.779569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.904256+0000","last_change":"2024-09-17T05:36:18.907947+0000","last_active":"2024-09-17T05:36:19.904256+0000","last_peered":"2024-09-17T05:36:19.904256+0000","last_clean":"2024-09-17T05:36:19.904256+0000","last_became_active":"2024-09-17T05:36:18.906873+0000","last_became_peered":"2024-09-17T05:36:18.906873+0000","last_unstale":"2024-09-17T05:36:19.904256+0000","last_undegraded":"2024-09-17T05:36:19.904256+0000","last_fullsized":"2024-09-17T05:36:19.904256+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:48.986324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"151'2","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.245791+0000","last_change":"2024-09-17T05:36:17.903329+0000","last_active":"2024-09-17T05:36:20.245791+0000","last_peered":"2024-09-17T05:36:20.245791+0000","last_clean":"2024-09-17T05:36:20.245791+0000","last_became_active":"2024-09-17T05:36:17.903072+0000","last_became_peered":"2024-09-17T05:36:17.903072+0000","last_unstale":"2024-09-17T05:36:20.245791+0000","last_undegraded":"2024-09-17T05:36:20.245791+0000","last_fullsized":"2024-09-17T05:36:20.245791+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:00.140980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.895749+0000","last_change":"2024-09-17T05:36:18.916515+0000","last_active":"2024-09-17T05:36:19.895749+0000","last_peered":"2024-09-17T05:36:19.895749+0000","last_clean":"2024-09-17T05:36:19.895749+0000","last_became_active":"2024-09-17T05:36:18.916197+0000","last_became_peered":"2024-09-17T05:36:18.916197+0000","last_unstale":"2024-09-17T05:36:19.895749+0000","last_undegraded":"2024-09-17T05:36:19.895749+0000","last_fullsized":"2024-09-17T05:36:19.895749+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:54.068282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"151'1","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.241923+0000","last_change":"2024-09-17T05:36:17.900853+0000","last_active":"2024-09-17T05:36:20.241923+0000","last_peered":"2024-09-17T05:36:20.241923+0000","last_clean":"2024-09-17T05:36:20.241923+0000","last_became_active":"2024-09-17T05:36:17.898291+0000","last_became_peered":"2024-09-17T05:36:17.898291+0000","last_unstale":"2024-09-17T05:36:20.241923+0000","last_undegraded":"2024-09-17T05:36:20.241923+0000","last_fullsized":"2024-09-17T05:36:20.241923+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:03.178345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.242553+0000","last_change":"2024-09-17T05:36:18.905715+0000","last_active":"2024-09-17T05:36:20.242553+0000","last_peered":"2024-09-17T05:36:20.242553+0000","last_clean":"2024-09-17T05:36:20.242553+0000","last_became_active":"2024-09-17T05:36:18.901954+0000","last_became_peered":"2024-09-17T05:36:18.901954+0000","last_unstale":"2024-09-17T05:36:20.242553+0000","last_undegraded":"2024-09-17T05:36:20.242553+0000","last_fullsized":"2024-09-17T05:36:20.242553+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:33.119899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"151'1","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.242406+0000","last_change":"2024-09-17T05:36:17.905265+0000","last_active":"2024-09-17T05:36:20.242406+0000","last_peered":"2024-09-17T05:36:20.242406+0000","last_clean":"2024-09-17T05:36:20.242406+0000","last_became_active":"2024-09-17T05:36:17.901068+0000","last_became_peered":"2024-09-17T05:36:17.901068+0000","last_unstale":"2024-09-17T05:36:20.242406+0000","last_undegraded":"2024-09-17T05:36:20.242406+0000","last_fullsized":"2024-09-17T05:36:20.242406+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:07.872232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.901838+0000","last_change":"2024-09-17T05:36:18.916472+0000","last_active":"2024-09-17T05:36:19.901838+0000","last_peered":"2024-09-17T05:36:19.901838+0000","last_clean":"2024-09-17T05:36:19.901838+0000","last_became_active":"2024-09-17T05:36:18.916191+0000","last_became_peered":"2024-09-17T05:36:18.916191+0000","last_unstale":"2024-09-17T05:36:19.901838+0000","last_undegraded":"2024-09-17T05:36:19.901838+0000","last_fullsized":"2024-09-17T05:36:19.901838+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:08.879353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.244666+0000","last_change":"2024-09-17T05:36:17.909883+0000","last_active":"2024-09-17T05:36:20.244666+0000","last_peered":"2024-09-17T05:36:20.244666+0000","last_clean":"2024-09-17T05:36:20.244666+0000","last_became_active":"2024-09-17T05:36:17.909592+0000","last_became_peered":"2024-09-17T05:36:17.909592+0000","last_unstale":"2024-09-17T05:36:20.244666+0000","last_undegraded":"2024-09-17T05:36:20.244666+0000","last_fullsized":"2024-09-17T05:36:20.244666+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:32.163630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.900030+0000","last_change":"2024-09-17T05:36:18.933741+0000","last_active":"2024-09-17T05:36:19.900030+0000","last_peered":"2024-09-17T05:36:19.900030+0000","last_clean":"2024-09-17T05:36:19.900030+0000","last_became_active":"2024-09-17T05:36:18.933381+0000","last_became_peered":"2024-09-17T05:36:18.933381+0000","last_unstale":"2024-09-17T05:36:19.900030+0000","last_undegraded":"2024-09-17T05:36:19.900030+0000","last_fullsized":"2024-09-17T05:36:19.900030+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:27:43.305833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.901600+0000","last_change":"2024-09-17T05:36:17.891610+0000","last_active":"2024-09-17T05:36:19.901600+0000","last_peered":"2024-09-17T05:36:19.901600+0000","last_clean":"2024-09-17T05:36:19.901600+0000","last_became_active":"2024-09-17T05:36:17.891311+0000","last_became_peered":"2024-09-17T05:36:17.891311+0000","last_unstale":"2024-09-17T05:36:19.901600+0000","last_undegraded":"2024-09-17T05:36:19.901600+0000","last_fullsized":"2024-09-17T05:36:19.901600+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:14.100919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.242772+0000","last_change":"2024-09-17T05:36:18.926856+0000","last_active":"2024-09-17T05:36:20.242772+0000","last_peered":"2024-09-17T05:36:20.242772+0000","last_clean":"2024-09-17T05:36:20.242772+0000","last_became_active":"2024-09-17T05:36:18.926579+0000","last_became_peered":"2024-09-17T05:36:18.926579+0000","last_unstale":"2024-09-17T05:36:20.242772+0000","last_undegraded":"2024-09-17T05:36:20.242772+0000","last_fullsized":"2024-09-17T05:36:20.242772+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:34.620296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.241847+0000","last_change":"2024-09-17T05:36:17.904403+0000","last_active":"2024-09-17T05:36:20.241847+0000","last_peered":"2024-09-17T05:36:20.241847+0000","last_clean":"2024-09-17T05:36:20.241847+0000","last_became_active":"2024-09-17T05:36:17.904050+0000","last_became_peered":"2024-09-17T05:36:17.904050+0000","last_unstale":"2024-09-17T05:36:20.241847+0000","last_undegraded":"2024-09-17T05:36:20.241847+0000","last_fullsized":"2024-09-17T05:36:20.241847+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:00.000358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.901613+0000","last_change":"2024-09-17T05:36:18.903856+0000","last_active":"2024-09-17T05:36:19.901613+0000","last_peered":"2024-09-17T05:36:19.901613+0000","last_clean":"2024-09-17T05:36:19.901613+0000","last_became_active":"2024-09-17T05:36:18.903568+0000","last_became_peered":"2024-09-17T05:36:18.903568+0000","last_unstale":"2024-09-17T05:36:19.901613+0000","last_undegraded":"2024-09-17T05:36:19.901613+0000","last_fullsized":"2024-09-17T05:36:19.901613+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:36.609448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"151'3","reported_seq":18,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.242062+0000","last_change":"2024-09-17T05:36:17.907774+0000","last_active":"2024-09-17T05:36:20.242062+0000","last_peered":"2024-09-17T05:36:20.242062+0000","last_clean":"2024-09-17T05:36:20.242062+0000","last_became_active":"2024-09-17T05:36:17.907451+0000","last_became_peered":"2024-09-17T05:36:17.907451+0000","last_unstale":"2024-09-17T05:36:20.242062+0000","last_undegraded":"2024-09-17T05:36:20.242062+0000","last_fullsized":"2024-09-17T05:36:20.242062+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:50.213346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.895818+0000","last_change":"2024-09-17T05:36:18.927626+0000","last_active":"2024-09-17T05:36:19.895818+0000","last_peered":"2024-09-17T05:36:19.895818+0000","last_clean":"2024-09-17T05:36:19.895818+0000","last_became_active":"2024-09-17T05:36:18.927292+0000","last_became_peered":"2024-09-17T05:36:18.927292+0000","last_unstale":"2024-09-17T05:36:19.895818+0000","last_undegraded":"2024-09-17T05:36:19.895818+0000","last_fullsized":"2024-09-17T05:36:19.895818+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:00:22.584103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"151'6","reported_seq":21,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.899757+0000","last_change":"2024-09-17T05:36:17.901928+0000","last_active":"2024-09-17T05:36:19.899757+0000","last_peered":"2024-09-17T05:36:19.899757+0000","last_clean":"2024-09-17T05:36:19.899757+0000","last_became_active":"2024-09-17T05:36:17.901658+0000","last_became_peered":"2024-09-17T05:36:17.901658+0000","last_unstale":"2024-09-17T05:36:19.899757+0000","last_undegraded":"2024-09-17T05:36:19.899757+0000","last_fullsized":"2024-09-17T05:36:19.899757+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:24:47.709738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.899630+0000","last_change":"2024-09-17T05:36:18.928714+0000","last_active":"2024-09-17T05:36:19.899630+0000","last_peered":"2024-09-17T05:36:19.899630+0000","last_clean":"2024-09-17T05:36:19.899630+0000","last_became_active":"2024-09-17T05:36:18.928443+0000","last_became_peered":"2024-09-17T05:36:18.928443+0000","last_unstale":"2024-09-17T05:36:19.899630+0000","last_undegraded":"2024-09-17T05:36:19.899630+0000","last_fullsized":"2024-09-17T05:36:19.899630+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:39.095748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"151'2","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.245066+0000","last_change":"2024-09-17T05:36:17.909634+0000","last_active":"2024-09-17T05:36:20.245066+0000","last_peered":"2024-09-17T05:36:20.245066+0000","last_clean":"2024-09-17T05:36:20.245066+0000","last_became_active":"2024-09-17T05:36:17.909283+0000","last_became_peered":"2024-09-17T05:36:17.909283+0000","last_unstale":"2024-09-17T05:36:20.245066+0000","last_undegraded":"2024-09-17T05:36:20.245066+0000","last_fullsized":"2024-09-17T05:36:20.245066+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:20:13.375192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.901477+0000","last_change":"2024-09-17T05:36:18.923561+0000","last_active":"2024-09-17T05:36:19.901477+0000","last_peered":"2024-09-17T05:36:19.901477+0000","last_clean":"2024-09-17T05:36:19.901477+0000","last_became_active":"2024-09-17T05:36:18.923012+0000","last_became_peered":"2024-09-17T05:36:18.923012+0000","last_unstale":"2024-09-17T05:36:19.901477+0000","last_undegraded":"2024-09-17T05:36:19.901477+0000","last_fullsized":"2024-09-17T05:36:19.901477+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:32.993032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.896135+0000","last_change":"2024-09-17T05:36:17.902030+0000","last_active":"2024-09-17T05:36:19.896135+0000","last_peered":"2024-09-17T05:36:19.896135+0000","last_clean":"2024-09-17T05:36:19.896135+0000","last_became_active":"2024-09-17T05:36:17.901154+0000","last_became_peered":"2024-09-17T05:36:17.901154+0000","last_unstale":"2024-09-17T05:36:19.896135+0000","last_undegraded":"2024-09-17T05:36:19.896135+0000","last_fullsized":"2024-09-17T05:36:19.896135+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:53.982661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.903820+0000","last_change":"2024-09-17T05:36:18.913759+0000","last_active":"2024-09-17T05:36:19.903820+0000","last_peered":"2024-09-17T05:36:19.903820+0000","last_clean":"2024-09-17T05:36:19.903820+0000","last_became_active":"2024-09-17T05:36:18.913309+0000","last_became_peered":"2024-09-17T05:36:18.913309+0000","last_unstale":"2024-09-17T05:36:19.903820+0000","last_undegraded":"2024-09-17T05:36:19.903820+0000","last_fullsized":"2024-09-17T05:36:19.903820+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:37.573639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.242210+0000","last_change":"2024-09-17T05:36:17.906929+0000","last_active":"2024-09-17T05:36:20.242210+0000","last_peered":"2024-09-17T05:36:20.242210+0000","last_clean":"2024-09-17T05:36:20.242210+0000","last_became_active":"2024-09-17T05:36:17.906657+0000","last_became_peered":"2024-09-17T05:36:17.906657+0000","last_unstale":"2024-09-17T05:36:20.242210+0000","last_undegraded":"2024-09-17T05:36:20.242210+0000","last_fullsized":"2024-09-17T05:36:20.242210+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:35.602327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.895740+0000","last_change":"2024-09-17T05:36:18.909924+0000","last_active":"2024-09-17T05:36:19.895740+0000","last_peered":"2024-09-17T05:36:19.895740+0000","last_clean":"2024-09-17T05:36:19.895740+0000","last_became_active":"2024-09-17T05:36:18.908909+0000","last_became_peered":"2024-09-17T05:36:18.908909+0000","last_unstale":"2024-09-17T05:36:19.895740+0000","last_undegraded":"2024-09-17T05:36:19.895740+0000","last_fullsized":"2024-09-17T05:36:19.895740+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:36.972514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"151'8","reported_seq":23,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.244780+0000","last_change":"2024-09-17T05:36:17.909786+0000","last_active":"2024-09-17T05:36:20.244780+0000","last_peered":"2024-09-17T05:36:20.244780+0000","last_clean":"2024-09-17T05:36:20.244780+0000","last_became_active":"2024-09-17T05:36:17.909389+0000","last_became_peered":"2024-09-17T05:36:17.909389+0000","last_unstale":"2024-09-17T05:36:20.244780+0000","last_undegraded":"2024-09-17T05:36:20.244780+0000","last_fullsized":"2024-09-17T05:36:20.244780+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:09:21.430505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.896023+0000","last_change":"2024-09-17T05:36:18.917115+0000","last_active":"2024-09-17T05:36:19.896023+0000","last_peered":"2024-09-17T05:36:19.896023+0000","last_clean":"2024-09-17T05:36:19.896023+0000","last_became_active":"2024-09-17T05:36:18.916808+0000","last_became_peered":"2024-09-17T05:36:18.916808+0000","last_unstale":"2024-09-17T05:36:19.896023+0000","last_undegraded":"2024-09-17T05:36:19.896023+0000","last_fullsized":"2024-09-17T05:36:19.896023+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:53:11.574052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"151'1","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.242131+0000","last_change":"2024-09-17T05:36:17.904457+0000","last_active":"2024-09-17T05:36:20.242131+0000","last_peered":"2024-09-17T05:36:20.242131+0000","last_clean":"2024-09-17T05:36:20.242131+0000","last_became_active":"2024-09-17T05:36:17.904044+0000","last_became_peered":"2024-09-17T05:36:17.904044+0000","last_unstale":"2024-09-17T05:36:20.242131+0000","last_undegraded":"2024-09-17T05:36:20.242131+0000","last_fullsized":"2024-09-17T05:36:20.242131+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:20.069461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.904426+0000","last_change":"2024-09-17T05:36:18.925259+0000","last_active":"2024-09-17T05:36:19.904426+0000","last_peered":"2024-09-17T05:36:19.904426+0000","last_clean":"2024-09-17T05:36:19.904426+0000","last_became_active":"2024-09-17T05:36:18.924995+0000","last_became_peered":"2024-09-17T05:36:18.924995+0000","last_unstale":"2024-09-17T05:36:19.904426+0000","last_undegraded":"2024-09-17T05:36:19.904426+0000","last_fullsized":"2024-09-17T05:36:19.904426+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:12.012850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"151'2","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.242875+0000","last_change":"2024-09-17T05:36:17.889028+0000","last_active":"2024-09-17T05:36:20.242875+0000","last_peered":"2024-09-17T05:36:20.242875+0000","last_clean":"2024-09-17T05:36:20.242875+0000","last_became_active":"2024-09-17T05:36:17.886151+0000","last_became_peered":"2024-09-17T05:36:17.886151+0000","last_unstale":"2024-09-17T05:36:20.242875+0000","last_undegraded":"2024-09-17T05:36:20.242875+0000","last_fullsized":"2024-09-17T05:36:20.242875+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:10.950116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.904152+0000","last_change":"2024-09-17T05:36:18.917021+0000","last_active":"2024-09-17T05:36:19.904152+0000","last_peered":"2024-09-17T05:36:19.904152+0000","last_clean":"2024-09-17T05:36:19.904152+0000","last_became_active":"2024-09-17T05:36:18.916753+0000","last_became_peered":"2024-09-17T05:36:18.916753+0000","last_unstale":"2024-09-17T05:36:19.904152+0000","last_undegraded":"2024-09-17T05:36:19.904152+0000","last_fullsized":"2024-09-17T05:36:19.904152+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:28.460860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"151'1","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.245064+0000","last_change":"2024-09-17T05:36:17.909303+0000","last_active":"2024-09-17T05:36:20.245064+0000","last_peered":"2024-09-17T05:36:20.245064+0000","last_clean":"2024-09-17T05:36:20.245064+0000","last_became_active":"2024-09-17T05:36:17.909058+0000","last_became_peered":"2024-09-17T05:36:17.909058+0000","last_unstale":"2024-09-17T05:36:20.245064+0000","last_undegraded":"2024-09-17T05:36:20.245064+0000","last_fullsized":"2024-09-17T05:36:20.245064+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:06.816946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.245649+0000","last_change":"2024-09-17T05:36:18.920369+0000","last_active":"2024-09-17T05:36:20.245649+0000","last_peered":"2024-09-17T05:36:20.245649+0000","last_clean":"2024-09-17T05:36:20.245649+0000","last_became_active":"2024-09-17T05:36:18.920039+0000","last_became_peered":"2024-09-17T05:36:18.920039+0000","last_unstale":"2024-09-17T05:36:20.245649+0000","last_undegraded":"2024-09-17T05:36:20.245649+0000","last_fullsized":"2024-09-17T05:36:20.245649+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:27:43.305833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.901869+0000","last_change":"2024-09-17T05:36:17.900645+0000","last_active":"2024-09-17T05:36:19.901869+0000","last_peered":"2024-09-17T05:36:19.901869+0000","last_clean":"2024-09-17T05:36:19.901869+0000","last_became_active":"2024-09-17T05:36:17.900338+0000","last_became_peered":"2024-09-17T05:36:17.900338+0000","last_unstale":"2024-09-17T05:36:19.901869+0000","last_undegraded":"2024-09-17T05:36:19.901869+0000","last_fullsized":"2024-09-17T05:36:19.901869+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:53.773674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.895978+0000","last_change":"2024-09-17T05:36:18.929869+0000","last_active":"2024-09-17T05:36:19.895978+0000","last_peered":"2024-09-17T05:36:19.895978+0000","last_clean":"2024-09-17T05:36:19.895978+0000","last_became_active":"2024-09-17T05:36:18.929612+0000","last_became_peered":"2024-09-17T05:36:18.929612+0000","last_unstale":"2024-09-17T05:36:19.895978+0000","last_undegraded":"2024-09-17T05:36:19.895978+0000","last_fullsized":"2024-09-17T05:36:19.895978+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:55.919311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"151'2","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.899590+0000","last_change":"2024-09-17T05:36:17.903150+0000","last_active":"2024-09-17T05:36:19.899590+0000","last_peered":"2024-09-17T05:36:19.899590+0000","last_clean":"2024-09-17T05:36:19.899590+0000","last_became_active":"2024-09-17T05:36:17.902834+0000","last_became_peered":"2024-09-17T05:36:17.902834+0000","last_unstale":"2024-09-17T05:36:19.899590+0000","last_undegraded":"2024-09-17T05:36:19.899590+0000","last_fullsized":"2024-09-17T05:36:19.899590+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:19.523119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.901492+0000","last_change":"2024-09-17T05:36:18.905060+0000","last_active":"2024-09-17T05:36:19.901492+0000","last_peered":"2024-09-17T05:36:19.901492+0000","last_clean":"2024-09-17T05:36:19.901492+0000","last_became_active":"2024-09-17T05:36:18.904122+0000","last_became_peered":"2024-09-17T05:36:18.904122+0000","last_unstale":"2024-09-17T05:36:19.901492+0000","last_undegraded":"2024-09-17T05:36:19.901492+0000","last_fullsized":"2024-09-17T05:36:19.901492+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:05.432540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.241723+0000","last_change":"2024-09-17T05:36:17.904001+0000","last_active":"2024-09-17T05:36:20.241723+0000","last_peered":"2024-09-17T05:36:20.241723+0000","last_clean":"2024-09-17T05:36:20.241723+0000","last_became_active":"2024-09-17T05:36:17.900330+0000","last_became_peered":"2024-09-17T05:36:17.900330+0000","last_unstale":"2024-09-17T05:36:20.241723+0000","last_undegraded":"2024-09-17T05:36:20.241723+0000","last_fullsized":"2024-09-17T05:36:20.241723+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:59.219358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.244998+0000","last_change":"2024-09-17T05:36:18.918696+0000","last_active":"2024-09-17T05:36:20.244998+0000","last_peered":"2024-09-17T05:36:20.244998+0000","last_clean":"2024-09-17T05:36:20.244998+0000","last_became_active":"2024-09-17T05:36:18.915589+0000","last_became_peered":"2024-09-17T05:36:18.915589+0000","last_unstale":"2024-09-17T05:36:20.244998+0000","last_undegraded":"2024-09-17T05:36:20.244998+0000","last_fullsized":"2024-09-17T05:36:20.244998+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:41.749211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.899647+0000","last_change":"2024-09-17T05:36:17.905019+0000","last_active":"2024-09-17T05:36:19.899647+0000","last_peered":"2024-09-17T05:36:19.899647+0000","last_clean":"2024-09-17T05:36:19.899647+0000","last_became_active":"2024-09-17T05:36:17.903334+0000","last_became_peered":"2024-09-17T05:36:17.903334+0000","last_unstale":"2024-09-17T05:36:19.899647+0000","last_undegraded":"2024-09-17T05:36:19.899647+0000","last_fullsized":"2024-09-17T05:36:19.899647+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:00.140980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.241624+0000","last_change":"2024-09-17T05:36:18.930669+0000","last_active":"2024-09-17T05:36:20.241624+0000","last_peered":"2024-09-17T05:36:20.241624+0000","last_clean":"2024-09-17T05:36:20.241624+0000","last_became_active":"2024-09-17T05:36:18.930327+0000","last_became_peered":"2024-09-17T05:36:18.930327+0000","last_unstale":"2024-09-17T05:36:20.241624+0000","last_undegraded":"2024-09-17T05:36:20.241624+0000","last_fullsized":"2024-09-17T05:36:20.241624+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:26.351170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.903803+0000","last_change":"2024-09-17T05:36:17.903608+0000","last_active":"2024-09-17T05:36:19.903803+0000","last_peered":"2024-09-17T05:36:19.903803+0000","last_clean":"2024-09-17T05:36:19.903803+0000","last_became_active":"2024-09-17T05:36:17.903276+0000","last_became_peered":"2024-09-17T05:36:17.903276+0000","last_unstale":"2024-09-17T05:36:19.903803+0000","last_undegraded":"2024-09-17T05:36:19.903803+0000","last_fullsized":"2024-09-17T05:36:19.903803+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:58.034552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.242015+0000","last_change":"2024-09-17T05:36:18.928688+0000","last_active":"2024-09-17T05:36:20.242015+0000","last_peered":"2024-09-17T05:36:20.242015+0000","last_clean":"2024-09-17T05:36:20.242015+0000","last_became_active":"2024-09-17T05:36:18.928427+0000","last_became_peered":"2024-09-17T05:36:18.928427+0000","last_unstale":"2024-09-17T05:36:20.242015+0000","last_undegraded":"2024-09-17T05:36:20.242015+0000","last_fullsized":"2024-09-17T05:36:20.242015+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:50.170684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"151'2","reported_seq":17,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.245330+0000","last_change":"2024-09-17T05:36:17.908490+0000","last_active":"2024-09-17T05:36:20.245330+0000","last_peered":"2024-09-17T05:36:20.245330+0000","last_clean":"2024-09-17T05:36:20.245330+0000","last_became_active":"2024-09-17T05:36:17.908181+0000","last_became_peered":"2024-09-17T05:36:17.908181+0000","last_unstale":"2024-09-17T05:36:20.245330+0000","last_undegraded":"2024-09-17T05:36:20.245330+0000","last_fullsized":"2024-09-17T05:36:20.245330+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:50.728157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.896404+0000","last_change":"2024-09-17T05:36:18.920171+0000","last_active":"2024-09-17T05:36:19.896404+0000","last_peered":"2024-09-17T05:36:19.896404+0000","last_clean":"2024-09-17T05:36:19.896404+0000","last_became_active":"2024-09-17T05:36:18.919831+0000","last_became_peered":"2024-09-17T05:36:18.919831+0000","last_unstale":"2024-09-17T05:36:19.896404+0000","last_undegraded":"2024-09-17T05:36:19.896404+0000","last_fullsized":"2024-09-17T05:36:19.896404+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:38.920513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"152'1","reported_seq":16,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.896151+0000","last_change":"2024-09-17T05:36:17.904703+0000","last_active":"2024-09-17T05:36:19.896151+0000","last_peered":"2024-09-17T05:36:19.896151+0000","last_clean":"2024-09-17T05:36:19.896151+0000","last_became_active":"2024-09-17T05:36:17.903663+0000","last_became_peered":"2024-09-17T05:36:17.903663+0000","last_unstale":"2024-09-17T05:36:19.896151+0000","last_undegraded":"2024-09-17T05:36:19.896151+0000","last_fullsized":"2024-09-17T05:36:19.896151+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:01.914303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.242700+0000","last_change":"2024-09-17T05:36:18.932397+0000","last_active":"2024-09-17T05:36:20.242700+0000","last_peered":"2024-09-17T05:36:20.242700+0000","last_clean":"2024-09-17T05:36:20.242700+0000","last_became_active":"2024-09-17T05:36:18.932122+0000","last_became_peered":"2024-09-17T05:36:18.932122+0000","last_unstale":"2024-09-17T05:36:20.242700+0000","last_undegraded":"2024-09-17T05:36:20.242700+0000","last_fullsized":"2024-09-17T05:36:20.242700+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:50.063451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.896174+0000","last_change":"2024-09-17T05:36:17.903663+0000","last_active":"2024-09-17T05:36:19.896174+0000","last_peered":"2024-09-17T05:36:19.896174+0000","last_clean":"2024-09-17T05:36:19.896174+0000","last_became_active":"2024-09-17T05:36:17.903373+0000","last_became_peered":"2024-09-17T05:36:17.903373+0000","last_unstale":"2024-09-17T05:36:19.896174+0000","last_undegraded":"2024-09-17T05:36:19.896174+0000","last_fullsized":"2024-09-17T05:36:19.896174+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:59.148329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.242825+0000","last_change":"2024-09-17T05:36:18.905517+0000","last_active":"2024-09-17T05:36:20.242825+0000","last_peered":"2024-09-17T05:36:20.242825+0000","last_clean":"2024-09-17T05:36:20.242825+0000","last_became_active":"2024-09-17T05:36:18.904609+0000","last_became_peered":"2024-09-17T05:36:18.904609+0000","last_unstale":"2024-09-17T05:36:20.242825+0000","last_undegraded":"2024-09-17T05:36:20.242825+0000","last_fullsized":"2024-09-17T05:36:20.242825+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:15.858129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.242592+0000","last_change":"2024-09-17T05:36:17.889967+0000","last_active":"2024-09-17T05:36:20.242592+0000","last_peered":"2024-09-17T05:36:20.242592+0000","last_clean":"2024-09-17T05:36:20.242592+0000","last_became_active":"2024-09-17T05:36:17.889687+0000","last_became_peered":"2024-09-17T05:36:17.889687+0000","last_unstale":"2024-09-17T05:36:20.242592+0000","last_undegraded":"2024-09-17T05:36:20.242592+0000","last_fullsized":"2024-09-17T05:36:20.242592+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:37.516098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.245051+0000","last_change":"2024-09-17T05:36:18.930242+0000","last_active":"2024-09-17T05:36:20.245051+0000","last_peered":"2024-09-17T05:36:20.245051+0000","last_clean":"2024-09-17T05:36:20.245051+0000","last_became_active":"2024-09-17T05:36:18.929939+0000","last_became_peered":"2024-09-17T05:36:18.929939+0000","last_unstale":"2024-09-17T05:36:20.245051+0000","last_undegraded":"2024-09-17T05:36:20.245051+0000","last_fullsized":"2024-09-17T05:36:20.245051+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:05.614605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.904064+0000","last_change":"2024-09-17T05:36:17.901496+0000","last_active":"2024-09-17T05:36:19.904064+0000","last_peered":"2024-09-17T05:36:19.904064+0000","last_clean":"2024-09-17T05:36:19.904064+0000","last_became_active":"2024-09-17T05:36:17.901170+0000","last_became_peered":"2024-09-17T05:36:17.901170+0000","last_unstale":"2024-09-17T05:36:19.904064+0000","last_undegraded":"2024-09-17T05:36:19.904064+0000","last_fullsized":"2024-09-17T05:36:19.904064+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:14.930598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.245232+0000","last_change":"2024-09-17T05:36:18.916333+0000","last_active":"2024-09-17T05:36:20.245232+0000","last_peered":"2024-09-17T05:36:20.245232+0000","last_clean":"2024-09-17T05:36:20.245232+0000","last_became_active":"2024-09-17T05:36:18.916061+0000","last_became_peered":"2024-09-17T05:36:18.916061+0000","last_unstale":"2024-09-17T05:36:20.245232+0000","last_undegraded":"2024-09-17T05:36:20.245232+0000","last_fullsized":"2024-09-17T05:36:20.245232+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:11.526167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.904007+0000","last_change":"2024-09-17T05:36:17.894247+0000","last_active":"2024-09-17T05:36:19.904007+0000","last_peered":"2024-09-17T05:36:19.904007+0000","last_clean":"2024-09-17T05:36:19.904007+0000","last_became_active":"2024-09-17T05:36:17.892459+0000","last_became_peered":"2024-09-17T05:36:17.892459+0000","last_unstale":"2024-09-17T05:36:19.904007+0000","last_undegraded":"2024-09-17T05:36:19.904007+0000","last_fullsized":"2024-09-17T05:36:19.904007+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:12.835472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.245252+0000","last_change":"2024-09-17T05:36:18.936949+0000","last_active":"2024-09-17T05:36:20.245252+0000","last_peered":"2024-09-17T05:36:20.245252+0000","last_clean":"2024-09-17T05:36:20.245252+0000","last_became_active":"2024-09-17T05:36:18.936600+0000","last_became_peered":"2024-09-17T05:36:18.936600+0000","last_unstale":"2024-09-17T05:36:20.245252+0000","last_undegraded":"2024-09-17T05:36:20.245252+0000","last_fullsized":"2024-09-17T05:36:20.245252+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:43.568284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.246046+0000","last_change":"2024-09-17T05:36:17.900164+0000","last_active":"2024-09-17T05:36:20.246046+0000","last_peered":"2024-09-17T05:36:20.246046+0000","last_clean":"2024-09-17T05:36:20.246046+0000","last_became_active":"2024-09-17T05:36:17.899350+0000","last_became_peered":"2024-09-17T05:36:17.899350+0000","last_unstale":"2024-09-17T05:36:20.246046+0000","last_undegraded":"2024-09-17T05:36:20.246046+0000","last_fullsized":"2024-09-17T05:36:20.246046+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:19.523119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.241645+0000","last_change":"2024-09-17T05:36:18.915032+0000","last_active":"2024-09-17T05:36:20.241645+0000","last_peered":"2024-09-17T05:36:20.241645+0000","last_clean":"2024-09-17T05:36:20.241645+0000","last_became_active":"2024-09-17T05:36:18.913395+0000","last_became_peered":"2024-09-17T05:36:18.913395+0000","last_unstale":"2024-09-17T05:36:20.241645+0000","last_undegraded":"2024-09-17T05:36:20.241645+0000","last_fullsized":"2024-09-17T05:36:20.241645+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:34.499933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.899467+0000","last_change":"2024-09-17T05:36:17.899163+0000","last_active":"2024-09-17T05:36:19.899467+0000","last_peered":"2024-09-17T05:36:19.899467+0000","last_clean":"2024-09-17T05:36:19.899467+0000","last_became_active":"2024-09-17T05:36:17.898886+0000","last_became_peered":"2024-09-17T05:36:17.898886+0000","last_unstale":"2024-09-17T05:36:19.899467+0000","last_undegraded":"2024-09-17T05:36:19.899467+0000","last_fullsized":"2024-09-17T05:36:19.899467+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:21:14.211298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":13,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:19.895375+0000","last_change":"2024-09-17T05:36:18.908636+0000","last_active":"2024-09-17T05:36:19.895375+0000","last_peered":"2024-09-17T05:36:19.895375+0000","last_clean":"2024-09-17T05:36:19.895375+0000","last_became_active":"2024-09-17T05:36:18.908139+0000","last_became_peered":"2024-09-17T05:36:18.908139+0000","last_unstale":"2024-09-17T05:36:19.895375+0000","last_undegraded":"2024-09-17T05:36:19.895375+0000","last_fullsized":"2024-09-17T05:36:19.895375+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:17.871862+0000","last_clean_scrub_stamp":"2024-09-17T05:36:17.871862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:38.200888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":15,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.244823+0000","last_change":"2024-09-17T05:36:17.902499+0000","last_active":"2024-09-17T05:36:20.244823+0000","last_peered":"2024-09-17T05:36:20.244823+0000","last_clean":"2024-09-17T05:36:20.244823+0000","last_became_active":"2024-09-17T05:36:17.902216+0000","last_became_peered":"2024-09-17T05:36:17.902216+0000","last_unstale":"2024-09-17T05:36:20.244823+0000","last_undegraded":"2024-09-17T05:36:20.244823+0000","last_fullsized":"2024-09-17T05:36:20.244823+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:16.864741+0000","last_clean_scrub_stamp":"2024-09-17T05:36:16.864741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:13.094494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":378,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T05:36:20.244941+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:36:20.244941+0000","last_peered":"2024-09-17T05:36:20.244941+0000","last_clean":"2024-09-17T05:36:20.244941+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:36:20.244941+0000","last_undegraded":"2024-09-17T05:36:20.244941+0000","last_fullsized":"2024-09-17T05:36:20.244941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509537,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33640,"kb_used_data":2452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338200,"statfs":{"total":96636764160,"available":96602316800,"internally_reserved":0,"allocated":2510848,"data_stored":1432614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509538,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33052,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338788,"statfs":{"total":96636764160,"available":96602918912,"internally_reserved":0,"allocated":1908736,"data_stored":842142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542241,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33060,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":1908736,"data_stored":842142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509538,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33068,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1925120,"data_stored":844336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509538,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33072,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338768,"statfs":{"total":96636764160,"available":96602898432,"internally_reserved":0,"allocated":1921024,"data_stored":842336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509538,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33068,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1921024,"data_stored":842836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509536,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33068,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1921024,"data_stored":843754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542240,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37796,"kb_used_data":2448,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334044,"statfs":{"total":96636764160,"available":96598061056,"internally_reserved":0,"allocated":2506752,"data_stored":1432532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:36:28.068 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:36:28.068 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:36:28.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.260+0000 7fa5b8800640 1 -- 172.21.15.31:0/3461519437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5b0161610 msgr2=0x7fa5b00d2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:28.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.260+0000 7fa5b8800640 1 --2- 172.21.15.31:0/3461519437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5b0161610 0x7fa5b00d2030 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4009900 tx=0x7fa5a401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.260+0000 7fa5b8800640 1 -- 172.21.15.31:0/3461519437 shutdown_connections 2024-09-17T05:36:28.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.260+0000 7fa5b8800640 1 --2- 172.21.15.31:0/3461519437 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5b00d4ad0 0x7fa5b00d2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.260+0000 7fa5b8800640 1 --2- 172.21.15.31:0/3461519437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5b0161610 0x7fa5b00d2030 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.260+0000 7fa5b8800640 1 -- 172.21.15.31:0/3461519437 >> 172.21.15.31:0/3461519437 conn(0x7fa5b00d3fb0 msgr2=0x7fa5b00d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:28.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.260+0000 7fa5b8800640 1 -- 172.21.15.31:0/3461519437 shutdown_connections 2024-09-17T05:36:28.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.260+0000 7fa5b8800640 1 -- 172.21.15.31:0/3461519437 wait complete. 2024-09-17T05:36:28.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.260+0000 7fa5b8800640 1 Processor -- start 2024-09-17T05:36:28.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.260+0000 7fa5b8800640 1 -- start start 2024-09-17T05:36:28.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b8800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5b00d2ab0 0x7fa5b014a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:28.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b8800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5b00d4ad0 0x7fa5b00cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:28.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b8800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5b0161610 0x7fa5b00cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:28.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b8800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b016b410 con 0x7fa5b00d4ad0 2024-09-17T05:36:28.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b8800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b016b290 con 0x7fa5b00d2ab0 2024-09-17T05:36:28.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b8800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa5b016b590 con 0x7fa5b0161610 2024-09-17T05:36:28.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5b00d4ad0 0x7fa5b00cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:28.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5b00d4ad0 0x7fa5b00cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34754/0 (socket says 172.21.15.31:34754) 2024-09-17T05:36:28.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b5400640 1 -- 172.21.15.31:0/216285159 learned_addr learned my addr 172.21.15.31:0/216285159 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:28.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b5e00640 1 --2- 172.21.15.31:0/216285159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5b00d2ab0 0x7fa5b014a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:28.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b6800640 1 --2- 172.21.15.31:0/216285159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5b0161610 0x7fa5b00cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:28.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b5400640 1 -- 172.21.15.31:0/216285159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5b0161610 msgr2=0x7fa5b00cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:28.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b5400640 1 --2- 172.21.15.31:0/216285159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5b0161610 0x7fa5b00cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b5400640 1 -- 172.21.15.31:0/216285159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5b00d2ab0 msgr2=0x7fa5b014a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:28.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b5400640 1 --2- 172.21.15.31:0/216285159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5b00d2ab0 0x7fa5b014a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b5400640 1 -- 172.21.15.31:0/216285159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b014aa00 con 0x7fa5b00d4ad0 2024-09-17T05:36:28.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b6800640 1 --2- 172.21.15.31:0/216285159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5b0161610 0x7fa5b00cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:28.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b5400640 1 --2- 172.21.15.31:0/216285159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5b00d4ad0 0x7fa5b00cdc40 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000d770 tx=0x7fa5a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:28.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5aa000640 1 -- 172.21.15.31:0/216285159 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0017020 con 0x7fa5b00d4ad0 2024-09-17T05:36:28.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5aa000640 1 -- 172.21.15.31:0/216285159 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5a0009820 con 0x7fa5b00d4ad0 2024-09-17T05:36:28.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5aa000640 1 -- 172.21.15.31:0/216285159 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0009c50 con 0x7fa5b00d4ad0 2024-09-17T05:36:28.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b8800640 1 -- 172.21.15.31:0/216285159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5b015fa70 con 0x7fa5b00d4ad0 2024-09-17T05:36:28.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b8800640 1 -- 172.21.15.31:0/216285159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5b0160030 con 0x7fa5b00d4ad0 2024-09-17T05:36:28.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5b8800640 1 -- 172.21.15.31:0/216285159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5b00d0760 con 0x7fa5b00d4ad0 2024-09-17T05:36:28.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.264+0000 7fa5aa000640 1 -- 172.21.15.31:0/216285159 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7fa5a001a020 con 0x7fa5b00d4ad0 2024-09-17T05:36:28.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.268+0000 7fa5aa000640 1 --2- 172.21.15.31:0/216285159 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa594073a70 0x7fa594075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:28.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.268+0000 7fa5aa000640 1 -- 172.21.15.31:0/216285159 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fa5a00958c0 con 0x7fa5b00d4ad0 2024-09-17T05:36:28.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.268+0000 7fa5b5e00640 1 --2- 172.21.15.31:0/216285159 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa594073a70 0x7fa594075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:28.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.268+0000 7fa5b5e00640 1 --2- 172.21.15.31:0/216285159 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa594073a70 0x7fa594075f30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40af000 tx=0x7fa5a401b120 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:28.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.272+0000 7fa5aa000640 1 -- 172.21.15.31:0/216285159 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa5a0021020 con 0x7fa5b00d4ad0 2024-09-17T05:36:28.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.512+0000 7fa5b8800640 1 -- 172.21.15.31:0/216285159 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa5b006d930 con 0x7fa5b00d4ad0 2024-09-17T05:36:28.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.512+0000 7fa5aa000640 1 -- 172.21.15.31:0/216285159 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v28) ==== 190+0+147 (secure 0 0 0) 0x7fa5a00950b0 con 0x7fa5b00d4ad0 2024-09-17T05:36:28.516 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-09-17T05:36:28.516 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw== 2024-09-17T05:36:28.516 INFO:teuthology.orchestra.run.smithi031.stdout: caps mds = "allow" 2024-09-17T05:36:28.516 INFO:teuthology.orchestra.run.smithi031.stdout: caps mon = "allow r" 2024-09-17T05:36:28.516 INFO:teuthology.orchestra.run.smithi031.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:36:28.517 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2024-09-17T05:36:28.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.516+0000 7fa5b8800640 1 -- 172.21.15.31:0/216285159 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa594073a70 msgr2=0x7fa594075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:28.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.516+0000 7fa5b8800640 1 --2- 172.21.15.31:0/216285159 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa594073a70 0x7fa594075f30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40af000 tx=0x7fa5a401b120 comp rx=0 tx=0).stop 2024-09-17T05:36:28.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.516+0000 7fa5b8800640 1 -- 172.21.15.31:0/216285159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5b00d4ad0 msgr2=0x7fa5b00cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:28.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.516+0000 7fa5b8800640 1 --2- 172.21.15.31:0/216285159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5b00d4ad0 0x7fa5b00cdc40 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000d770 tx=0x7fa5a000dc30 comp rx=0 tx=0).stop 2024-09-17T05:36:28.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.516+0000 7fa5b8800640 1 -- 172.21.15.31:0/216285159 shutdown_connections 2024-09-17T05:36:28.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.516+0000 7fa5b8800640 1 --2- 172.21.15.31:0/216285159 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa594073a70 0x7fa594075f30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.516+0000 7fa5b8800640 1 --2- 172.21.15.31:0/216285159 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5b0161610 0x7fa5b00cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.516+0000 7fa5b8800640 1 --2- 172.21.15.31:0/216285159 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5b00d4ad0 0x7fa5b00cdc40 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.516+0000 7fa5b8800640 1 --2- 172.21.15.31:0/216285159 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5b00d2ab0 0x7fa5b014a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.516+0000 7fa5b8800640 1 -- 172.21.15.31:0/216285159 >> 172.21.15.31:0/216285159 conn(0x7fa5b00d3fb0 msgr2=0x7fa5b00d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:28.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.516+0000 7fa5b8800640 1 -- 172.21.15.31:0/216285159 shutdown_connections 2024-09-17T05:36:28.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.516+0000 7fa5b8800640 1 -- 172.21.15.31:0/216285159 wait complete. 2024-09-17T05:36:28.539 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:28.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f8505c00640 1 -- 172.21.15.31:0/2213814153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85000cdb30 msgr2=0x7f85000cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:28.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f8505c00640 1 --2- 172.21.15.31:0/2213814153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85000cdb30 0x7f85000cebb0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f85000745d0 tx=0x7f84e801c830 comp rx=0 tx=0).stop 2024-09-17T05:36:28.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f8505c00640 1 -- 172.21.15.31:0/2213814153 shutdown_connections 2024-09-17T05:36:28.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f8505c00640 1 --2- 172.21.15.31:0/2213814153 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85000cdb30 0x7f85000cebb0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f8505c00640 1 --2- 172.21.15.31:0/2213814153 >> v2:172.21.15.155:3300/0 conn(0x7f850015bea0 0x7f85000ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f8505c00640 1 -- 172.21.15.31:0/2213814153 >> 172.21.15.31:0/2213814153 conn(0x7f85000d1dc0 msgr2=0x7f85000d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:28.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f8505c00640 1 -- 172.21.15.31:0/2213814153 shutdown_connections 2024-09-17T05:36:28.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f8505c00640 1 -- 172.21.15.31:0/2213814153 wait complete. 2024-09-17T05:36:28.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f8505c00640 1 Processor -- start 2024-09-17T05:36:28.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f8505c00640 1 -- start start 2024-09-17T05:36:28.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f8505c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85000cdb30 0x7f850014c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:28.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f8505c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85000d28e0 0x7f8500159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:28.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f8505c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f850015bea0 0x7f8500159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:28.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f8505c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8500168fc0 con 0x7f850015bea0 2024-09-17T05:36:28.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f8505c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8500168e40 con 0x7f85000cdb30 2024-09-17T05:36:28.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f8505c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8500169140 con 0x7f85000d28e0 2024-09-17T05:36:28.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f84ff400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f850015bea0 0x7f8500159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:28.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f84ff400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f850015bea0 0x7f8500159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49654/0 (socket says 172.21.15.31:49654) 2024-09-17T05:36:28.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.684+0000 7f84ff400640 1 -- 172.21.15.31:0/2294054410 learned_addr learned my addr 172.21.15.31:0/2294054410 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:28.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.688+0000 7f84f7e00640 1 --2- 172.21.15.31:0/2294054410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85000d28e0 0x7f8500159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:28.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.688+0000 7f84fea00640 1 --2- 172.21.15.31:0/2294054410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85000cdb30 0x7f850014c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:28.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.688+0000 7f84ff400640 1 -- 172.21.15.31:0/2294054410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85000d28e0 msgr2=0x7f8500159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:28.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.688+0000 7f84ff400640 1 --2- 172.21.15.31:0/2294054410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85000d28e0 0x7f8500159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.688+0000 7f84ff400640 1 -- 172.21.15.31:0/2294054410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85000cdb30 msgr2=0x7f850014c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:28.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.688+0000 7f84ff400640 1 --2- 172.21.15.31:0/2294054410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85000cdb30 0x7f850014c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.688+0000 7f84ff400640 1 -- 172.21.15.31:0/2294054410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85000c8f30 con 0x7f850015bea0 2024-09-17T05:36:28.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.688+0000 7f84ff400640 1 --2- 172.21.15.31:0/2294054410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f850015bea0 0x7f8500159840 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f84f800c7c0 tx=0x7f84f800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:28.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.688+0000 7f84f6a00640 1 -- 172.21.15.31:0/2294054410 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f8003b80 con 0x7f850015bea0 2024-09-17T05:36:28.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.688+0000 7f84f6a00640 1 -- 172.21.15.31:0/2294054410 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84f8003d20 con 0x7f850015bea0 2024-09-17T05:36:28.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.688+0000 7f8505c00640 1 -- 172.21.15.31:0/2294054410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85000c9210 con 0x7f850015bea0 2024-09-17T05:36:28.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.688+0000 7f84f6a00640 1 -- 172.21.15.31:0/2294054410 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f800aab0 con 0x7f850015bea0 2024-09-17T05:36:28.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.688+0000 7f8505c00640 1 -- 172.21.15.31:0/2294054410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85000c97d0 con 0x7f850015bea0 2024-09-17T05:36:28.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.688+0000 7f8505c00640 1 -- 172.21.15.31:0/2294054410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85000cc9d0 con 0x7f850015bea0 2024-09-17T05:36:28.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.688+0000 7f84f6a00640 1 -- 172.21.15.31:0/2294054410 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f84f800ac50 con 0x7f850015bea0 2024-09-17T05:36:28.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.692+0000 7f84f6a00640 1 --2- 172.21.15.31:0/2294054410 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f84dc073a70 0x7f84dc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:28.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.692+0000 7f84f6a00640 1 -- 172.21.15.31:0/2294054410 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f84f8095250 con 0x7f850015bea0 2024-09-17T05:36:28.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.692+0000 7f84fea00640 1 --2- 172.21.15.31:0/2294054410 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f84dc073a70 0x7f84dc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:28.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.692+0000 7f84fea00640 1 --2- 172.21.15.31:0/2294054410 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f84dc073a70 0x7f84dc075f30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8500166b40 tx=0x7f84f00091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:28.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.696+0000 7f84f6a00640 1 -- 172.21.15.31:0/2294054410 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f84f805ec60 con 0x7f850015bea0 2024-09-17T05:36:28.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.908+0000 7f8505c00640 1 -- 172.21.15.31:0/2294054410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85000c9c70 con 0x7f850015bea0 2024-09-17T05:36:28.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.908+0000 7f84f6a00640 1 -- 172.21.15.31:0/2294054410 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) ==== 95+0+5236 (secure 0 0 0) 0x7f84f8063690 con 0x7f850015bea0 2024-09-17T05:36:28.910 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:28.910 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":109,"btime":"2024-09-17T05:36:21:915529+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/188322131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":188322131},{"type":"v1","addr":"172.21.15.155:6834","nonce":188322131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2190232807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":2190232807},{"type":"v1","addr":"172.21.15.155:6835","nonce":2190232807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8724,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/2588830685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2588830685},{"type":"v1","addr":"172.21.15.31:6833","nonce":2588830685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:18.297448+0000","modified":"2024-09-17T05:36:21.321294+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8733":{"gid":8733,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/2117164749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2117164749},{"type":"v1","addr":"172.21.15.31:6835","nonce":2117164749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8733,"qdb_cluster":[8733]},"id":12}]} 2024-09-17T05:36:28.910 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 109 2024-09-17T05:36:28.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.908+0000 7f8505c00640 1 -- 172.21.15.31:0/2294054410 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f84dc073a70 msgr2=0x7f84dc075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:28.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.908+0000 7f8505c00640 1 --2- 172.21.15.31:0/2294054410 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f84dc073a70 0x7f84dc075f30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8500166b40 tx=0x7f84f00091e0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.908+0000 7f8505c00640 1 -- 172.21.15.31:0/2294054410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f850015bea0 msgr2=0x7f8500159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:28.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.908+0000 7f8505c00640 1 --2- 172.21.15.31:0/2294054410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f850015bea0 0x7f8500159840 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f84f800c7c0 tx=0x7f84f800cc80 comp rx=0 tx=0).stop 2024-09-17T05:36:28.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.908+0000 7f8505c00640 1 -- 172.21.15.31:0/2294054410 shutdown_connections 2024-09-17T05:36:28.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.908+0000 7f8505c00640 1 --2- 172.21.15.31:0/2294054410 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f84dc073a70 0x7f84dc075f30 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.908+0000 7f8505c00640 1 --2- 172.21.15.31:0/2294054410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f850015bea0 0x7f8500159840 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.908+0000 7f8505c00640 1 --2- 172.21.15.31:0/2294054410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85000d28e0 0x7f8500159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.908+0000 7f8505c00640 1 --2- 172.21.15.31:0/2294054410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85000cdb30 0x7f850014c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:28.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.908+0000 7f8505c00640 1 -- 172.21.15.31:0/2294054410 >> 172.21.15.31:0/2294054410 conn(0x7f85000d1dc0 msgr2=0x7f8500070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:28.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.908+0000 7f8505c00640 1 -- 172.21.15.31:0/2294054410 shutdown_connections 2024-09-17T05:36:28.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:28.908+0000 7f8505c00640 1 -- 172.21.15.31:0/2294054410 wait complete. 2024-09-17T05:36:29.335 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 109, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:36:18.297448+0000', 'modified': '2024-09-17T05:36:21.321294+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8733}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8733': {'gid': 8733, 'name': 'a', 'rank': 0, 'incarnation': 106, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/2117164749', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 2117164749}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 2117164749}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8733, 'qdb_cluster': [8733]} 2024-09-17T05:36:29.336 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:36:29.336 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T05:36:29.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.484+0000 7fef99e00640 1 -- 172.21.15.31:0/714519129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef9415c1c0 msgr2=0x7fef9406d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.484+0000 7fef99e00640 1 --2- 172.21.15.31:0/714519129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef9415c1c0 0x7fef9406d000 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009840 tx=0x7fef7c01c7f0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.484+0000 7fef99e00640 1 -- 172.21.15.31:0/714519129 shutdown_connections 2024-09-17T05:36:29.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.484+0000 7fef99e00640 1 --2- 172.21.15.31:0/714519129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef9415c1c0 0x7fef9406d000 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.484+0000 7fef99e00640 1 --2- 172.21.15.31:0/714519129 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef9406cc20 0x7fef940737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.484+0000 7fef99e00640 1 -- 172.21.15.31:0/714519129 >> 172.21.15.31:0/714519129 conn(0x7fef940d0c90 msgr2=0x7fef940d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:29.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.484+0000 7fef99e00640 1 -- 172.21.15.31:0/714519129 shutdown_connections 2024-09-17T05:36:29.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.484+0000 7fef99e00640 1 -- 172.21.15.31:0/714519129 wait complete. 2024-09-17T05:36:29.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef99e00640 1 Processor -- start 2024-09-17T05:36:29.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef99e00640 1 -- start start 2024-09-17T05:36:29.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef99e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef9406cc20 0x7fef940c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef99e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef9415c1c0 0x7fef940c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef99e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef9415f7b0 0x7fef940ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef99e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fef941694e0 con 0x7fef9415c1c0 2024-09-17T05:36:29.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef99e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fef94169360 con 0x7fef9415f7b0 2024-09-17T05:36:29.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef99e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fef94169660 con 0x7fef9406cc20 2024-09-17T05:36:29.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef8be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef9415c1c0 0x7fef940c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef8be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef9415c1c0 0x7fef940c56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49678/0 (socket says 172.21.15.31:49678) 2024-09-17T05:36:29.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef8be00640 1 -- 172.21.15.31:0/319819548 learned_addr learned my addr 172.21.15.31:0/319819548 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:29.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef92a00640 1 --2- 172.21.15.31:0/319819548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef9406cc20 0x7fef940c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef93400640 1 --2- 172.21.15.31:0/319819548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef9415f7b0 0x7fef940ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef8be00640 1 -- 172.21.15.31:0/319819548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef9406cc20 msgr2=0x7fef940c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef8be00640 1 --2- 172.21.15.31:0/319819548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef9406cc20 0x7fef940c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef8be00640 1 -- 172.21.15.31:0/319819548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef9415f7b0 msgr2=0x7fef940ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef8be00640 1 --2- 172.21.15.31:0/319819548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef9415f7b0 0x7fef940ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef8be00640 1 -- 172.21.15.31:0/319819548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef940c5d10 con 0x7fef9415c1c0 2024-09-17T05:36:29.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef8be00640 1 --2- 172.21.15.31:0/319819548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef9415c1c0 0x7fef940c56e0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009790 tx=0x7fef7c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:29.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef8b400640 1 -- 172.21.15.31:0/319819548 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0b2040 con 0x7fef9415c1c0 2024-09-17T05:36:29.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef8b400640 1 -- 172.21.15.31:0/319819548 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef7c005020 con 0x7fef9415c1c0 2024-09-17T05:36:29.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef8b400640 1 -- 172.21.15.31:0/319819548 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c005450 con 0x7fef9415c1c0 2024-09-17T05:36:29.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef99e00640 1 -- 172.21.15.31:0/319819548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef940c5ff0 con 0x7fef9415c1c0 2024-09-17T05:36:29.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.488+0000 7fef99e00640 1 -- 172.21.15.31:0/319819548 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef940c65b0 con 0x7fef9415c1c0 2024-09-17T05:36:29.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef8b400640 1 -- 172.21.15.31:0/319819548 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7fef7c0be060 con 0x7fef9415c1c0 2024-09-17T05:36:29.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef8b400640 1 --2- 172.21.15.31:0/319819548 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fef70073a70 0x7fef70075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef8b400640 1 -- 172.21.15.31:0/319819548 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fef7c12ea00 con 0x7fef9415c1c0 2024-09-17T05:36:29.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef9d30a000 1 Processor -- start 2024-09-17T05:36:29.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef92a00640 1 --2- 172.21.15.31:0/319819548 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fef70073a70 0x7fef70075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef9d30a000 1 -- start start 2024-09-17T05:36:29.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef92a00640 1 --2- 172.21.15.31:0/319819548 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fef70073a70 0x7fef70075f30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fef84004630 tx=0x7fef8400b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:29.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef9d30a000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecbdc0 0x55b380ecc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef9d30a000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecc6e0 0x55b380e7fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef9d30a000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380e80220 0x55b380e80600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef9d30a000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b380d9c3f0 con 0x55b380ecc6e0 2024-09-17T05:36:29.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef9d30a000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b380cd9b20 con 0x55b380e80220 2024-09-17T05:36:29.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef9d30a000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55b380cc8f50 con 0x55b380ecbdc0 2024-09-17T05:36:29.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef8be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecc6e0 0x55b380e7fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef8be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecc6e0 0x55b380e7fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49680/0 (socket says 172.21.15.31:49680) 2024-09-17T05:36:29.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef8be00640 1 -- 172.21.15.31:0/3700606897 learned_addr learned my addr 172.21.15.31:0/3700606897 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef92a00640 1 --2- 172.21.15.31:0/3700606897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecbdc0 0x55b380ecc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef93400640 1 --2- 172.21.15.31:0/3700606897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380e80220 0x55b380e80600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef8be00640 1 -- 172.21.15.31:0/3700606897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecbdc0 msgr2=0x55b380ecc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef8be00640 1 --2- 172.21.15.31:0/3700606897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecbdc0 0x55b380ecc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef8be00640 1 -- 172.21.15.31:0/3700606897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380e80220 msgr2=0x55b380e80600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef8be00640 1 --2- 172.21.15.31:0/3700606897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380e80220 0x55b380e80600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef8be00640 1 -- 172.21.15.31:0/3700606897 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b380c90590 con 0x55b380ecc6e0 2024-09-17T05:36:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef92a00640 1 --2- 172.21.15.31:0/3700606897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecbdc0 0x55b380ecc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.492+0000 7fef93400640 1 --2- 172.21.15.31:0/3700606897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380e80220 0x55b380e80600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef8be00640 1 --2- 172.21.15.31:0/3700606897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecc6e0 0x55b380e7fce0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fef7c01cd60 tx=0x7fef7c0f4610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f25c2605361f2ff server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef83e00640 1 -- 172.21.15.31:0/3700606897 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0f7ee0 con 0x55b380ecc6e0 2024-09-17T05:36:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef83e00640 1 -- 172.21.15.31:0/3700606897 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef7c0f8e70 con 0x55b380ecc6e0 2024-09-17T05:36:29.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef83e00640 1 -- 172.21.15.31:0/3700606897 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0f8770 con 0x55b380ecc6e0 2024-09-17T05:36:29.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef9d30a000 1 -- 172.21.15.31:0/3700606897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecc6e0 msgr2=0x55b380e7fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef9d30a000 1 --2- 172.21.15.31:0/3700606897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecc6e0 0x55b380e7fce0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fef7c01cd60 tx=0x7fef7c0f4610 comp rx=0 tx=0).stop 2024-09-17T05:36:29.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef9d30a000 1 -- 172.21.15.31:0/3700606897 shutdown_connections 2024-09-17T05:36:29.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef9d30a000 1 --2- 172.21.15.31:0/3700606897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380e80220 0x55b380e80600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef9d30a000 1 --2- 172.21.15.31:0/3700606897 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecc6e0 0x55b380e7fce0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef9d30a000 1 --2- 172.21.15.31:0/3700606897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecbdc0 0x55b380ecc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef9d30a000 1 -- 172.21.15.31:0/3700606897 >> 172.21.15.31:0/3700606897 conn(0x55b380d65130 msgr2=0x55b380eaae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:29.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef9d30a000 1 -- 172.21.15.31:0/3700606897 shutdown_connections 2024-09-17T05:36:29.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef9d30a000 1 -- 172.21.15.31:0/3700606897 wait complete. 2024-09-17T05:36:29.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef9d30a000 1 -- start start 2024-09-17T05:36:29.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef9d30a000 1 Processor -- start 2024-09-17T05:36:29.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef9d30a000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380e80220 0x55b380eb6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef9d30a000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecbdc0 0x55b380eb68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef9d30a000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecc6e0 0x55b380eb6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef9d30a000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b380c635d0 con 0x55b380ecbdc0 2024-09-17T05:36:29.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef9d30a000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b380cccd60 con 0x55b380e80220 2024-09-17T05:36:29.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef9d30a000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55b380c6f500 con 0x55b380ecc6e0 2024-09-17T05:36:29.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef9d30a000 10 client.0 _ll_register_callbacks cb 0x55b380c73810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:36:29.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef8be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecbdc0 0x55b380eb68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef8be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecbdc0 0x55b380eb68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49686/0 (socket says 172.21.15.31:49686) 2024-09-17T05:36:29.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef8be00640 1 -- 172.21.15.31:0/1427664609 learned_addr learned my addr 172.21.15.31:0/1427664609 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:29.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef92a00640 1 --2- 172.21.15.31:0/1427664609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380e80220 0x55b380eb6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef93400640 1 --2- 172.21.15.31:0/1427664609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecc6e0 0x55b380eb6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef8be00640 1 -- 172.21.15.31:0/1427664609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecc6e0 msgr2=0x55b380eb6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:29.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef8be00640 1 --2- 172.21.15.31:0/1427664609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecc6e0 0x55b380eb6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef8be00640 1 -- 172.21.15.31:0/1427664609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380e80220 msgr2=0x55b380eb6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:29.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef8be00640 1 --2- 172.21.15.31:0/1427664609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380e80220 0x55b380eb6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.496+0000 7fef8be00640 1 -- 172.21.15.31:0/1427664609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b380c67170 con 0x55b380ecbdc0 2024-09-17T05:36:29.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef8be00640 1 --2- 172.21.15.31:0/1427664609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecbdc0 0x55b380eb68a0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fef7c01ccd0 tx=0x7fef7c0a5ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1e634be19a512b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:29.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef80c00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:36:29.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef80c00640 1 -- 172.21.15.31:0/1427664609 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0f8280 con 0x55b380ecbdc0 2024-09-17T05:36:29.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef80c00640 1 -- 172.21.15.31:0/1427664609 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fef7c101c70 con 0x55b380ecbdc0 2024-09-17T05:36:29.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 1 -- 172.21.15.31:0/1427664609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b380c610f0 con 0x55b380ecbdc0 2024-09-17T05:36:29.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef80c00640 1 -- 172.21.15.31:0/1427664609 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) ==== 24+0+0 (secure 0 0 0) 0x7fef7c101ef0 con 0x55b380ecbdc0 2024-09-17T05:36:29.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 10 client.8871 fetch_fsmap learned FSMap version 109 2024-09-17T05:36:29.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 1 -- 172.21.15.31:0/1427664609 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) -- 0x55b380d4def0 con 0x55b380ecbdc0 2024-09-17T05:36:29.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef80c00640 1 -- 172.21.15.31:0/1427664609 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55b380c610f0 con 0x55b380ecbdc0 2024-09-17T05:36:29.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef80c00640 1 -- 172.21.15.31:0/1427664609 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 109) ==== 3502+0+0 (secure 0 0 0) 0x7fef7c0b5070 con 0x55b380ecbdc0 2024-09-17T05:36:29.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 10 client.8871 fetch_fsmap finished waiting for FSMap version 109 2024-09-17T05:36:29.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 10 client.8871 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:36:29.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 20 client.8871 populate_metadata read hostname 'smithi031' 2024-09-17T05:36:29.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 1 --2- 172.21.15.31:0/1427664609 >> [v2:172.21.15.31:6834/2117164749,v1:172.21.15.31:6835/2117164749] conn(0x55b380eb77f0 0x55b380edd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 4 client.8871 mds_command: new command op to 8733 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:36:29.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 1 -- 172.21.15.31:0/1427664609 --> [v2:172.21.15.31:6834/2117164749,v1:172.21.15.31:6835/2117164749] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b380cdba70 con 0x55b380eb77f0 2024-09-17T05:36:29.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef92a00640 1 --2- 172.21.15.31:0/1427664609 >> [v2:172.21.15.31:6834/2117164749,v1:172.21.15.31:6835/2117164749] conn(0x55b380eb77f0 0x55b380edd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef92a00640 1 --2- 172.21.15.31:0/1427664609 >> [v2:172.21.15.31:6834/2117164749,v1:172.21.15.31:6835/2117164749] conn(0x55b380eb77f0 0x55b380edd070 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a49090cf8bea15f server_cookie=625cef6c7d636801 in_seq=0 out_seq=0 2024-09-17T05:36:29.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef80c00640 10 client.8871 ms_handle_connect on v2:172.21.15.31:6834/2117164749 2024-09-17T05:36:29.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef80c00640 1 -- 172.21.15.31:0/1427664609 <== mds.0 v2:172.21.15.31:6834/2117164749 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b380cdba70 con 0x55b380eb77f0 2024-09-17T05:36:29.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef80c00640 10 client.8871 handle_command_reply: tid=0 2024-09-17T05:36:29.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 1 client.8871 shutdown 2024-09-17T05:36:29.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 1 -- 172.21.15.31:0/1427664609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecbdc0 msgr2=0x55b380eb68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 1 --2- 172.21.15.31:0/1427664609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecbdc0 0x55b380eb68a0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fef7c01ccd0 tx=0x7fef7c0a5ab0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 1 -- 172.21.15.31:0/1427664609 shutdown_connections 2024-09-17T05:36:29.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 1 --2- 172.21.15.31:0/1427664609 >> [v2:172.21.15.31:6834/2117164749,v1:172.21.15.31:6835/2117164749] conn(0x55b380eb77f0 0x55b380edd070 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 1 --2- 172.21.15.31:0/1427664609 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecc6e0 0x55b380eb6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 1 --2- 172.21.15.31:0/1427664609 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecbdc0 0x55b380eb68a0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 1 --2- 172.21.15.31:0/1427664609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380e80220 0x55b380eb6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef80c00640 0 client.8871 ms_handle_reset on v2:172.21.15.31:6834/2117164749 2024-09-17T05:36:29.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 1 -- 172.21.15.31:0/1427664609 >> 172.21.15.31:0/1427664609 conn(0x55b380d65130 msgr2=0x55b380e7a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:29.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 1 -- 172.21.15.31:0/1427664609 shutdown_connections 2024-09-17T05:36:29.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 1 -- 172.21.15.31:0/1427664609 wait complete. 2024-09-17T05:36:29.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.500+0000 7fef9d30a000 20 client.8871 trim_cache size 0 max 16384 2024-09-17T05:36:29.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.520+0000 7fef9d30a000 1 Processor -- start 2024-09-17T05:36:29.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.520+0000 7fef9d30a000 1 -- start start 2024-09-17T05:36:29.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.520+0000 7fef9d30a000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380e80220 0x55b380ea7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.520+0000 7fef9d30a000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecbdc0 0x55b380ea84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.520+0000 7fef9d30a000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380ecc6e0 0x55b380edd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.520+0000 7fef9d30a000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b380cccd60 con 0x55b380e80220 2024-09-17T05:36:29.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.520+0000 7fef9d30a000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b380c6f500 con 0x55b380ecc6e0 2024-09-17T05:36:29.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.520+0000 7fef9d30a000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55b380d4da60 con 0x55b380ecbdc0 2024-09-17T05:36:29.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.520+0000 7fef92a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380e80220 0x55b380ea7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.520+0000 7fef92a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380e80220 0x55b380ea7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49690/0 (socket says 172.21.15.31:49690) 2024-09-17T05:36:29.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.520+0000 7fef92a00640 1 -- 172.21.15.31:0/722111142 learned_addr learned my addr 172.21.15.31:0/722111142 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:29.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.520+0000 7fef8be00640 1 --2- 172.21.15.31:0/722111142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecbdc0 0x55b380ea84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef93400640 1 --2- 172.21.15.31:0/722111142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380ecc6e0 0x55b380edd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef92a00640 1 -- 172.21.15.31:0/722111142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecbdc0 msgr2=0x55b380ea84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:29.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef92a00640 1 --2- 172.21.15.31:0/722111142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecbdc0 0x55b380ea84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef92a00640 1 -- 172.21.15.31:0/722111142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380ecc6e0 msgr2=0x55b380edd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:29.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef92a00640 1 --2- 172.21.15.31:0/722111142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380ecc6e0 0x55b380edd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef92a00640 1 -- 172.21.15.31:0/722111142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b380d24d90 con 0x55b380e80220 2024-09-17T05:36:29.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef92a00640 1 --2- 172.21.15.31:0/722111142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380e80220 0x55b380ea7f70 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x55b380cd9f20 tx=0x7fef84013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83905746e464a05f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:29.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef83400640 1 -- 172.21.15.31:0/722111142 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef84011e40 con 0x55b380e80220 2024-09-17T05:36:29.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef83400640 1 -- 172.21.15.31:0/722111142 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef84005020 con 0x55b380e80220 2024-09-17T05:36:29.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef83400640 1 -- 172.21.15.31:0/722111142 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef84005410 con 0x55b380e80220 2024-09-17T05:36:29.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef9d30a000 1 -- 172.21.15.31:0/722111142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380e80220 msgr2=0x55b380ea7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef9d30a000 1 --2- 172.21.15.31:0/722111142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380e80220 0x55b380ea7f70 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x55b380cd9f20 tx=0x7fef84013000 comp rx=0 tx=0).stop 2024-09-17T05:36:29.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef9d30a000 1 -- 172.21.15.31:0/722111142 shutdown_connections 2024-09-17T05:36:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef9d30a000 1 --2- 172.21.15.31:0/722111142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380ecc6e0 0x55b380edd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef9d30a000 1 --2- 172.21.15.31:0/722111142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecbdc0 0x55b380ea84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef9d30a000 1 --2- 172.21.15.31:0/722111142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380e80220 0x55b380ea7f70 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef9d30a000 1 -- 172.21.15.31:0/722111142 >> 172.21.15.31:0/722111142 conn(0x55b380d65130 msgr2=0x55b380e89280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef9d30a000 1 -- 172.21.15.31:0/722111142 shutdown_connections 2024-09-17T05:36:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef9d30a000 1 -- 172.21.15.31:0/722111142 wait complete. 2024-09-17T05:36:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef9d30a000 1 -- start start 2024-09-17T05:36:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef9d30a000 1 Processor -- start 2024-09-17T05:36:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef9d30a000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380e80220 0x55b380f42410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef9d30a000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecbdc0 0x55b380f42950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef9d30a000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecc6e0 0x55b380f42e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef9d30a000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55b380d88730 con 0x55b380ecc6e0 2024-09-17T05:36:29.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef9d30a000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b380ccc070 con 0x55b380e80220 2024-09-17T05:36:29.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef9d30a000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55b380c94ec0 con 0x55b380ecbdc0 2024-09-17T05:36:29.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.524+0000 7fef9d30a000 10 client.0 _ll_register_callbacks cb 0x7fef7c0fd050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:36:29.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef93400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecc6e0 0x55b380f42e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef92a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380e80220 0x55b380f42410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef93400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecc6e0 0x55b380f42e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49698/0 (socket says 172.21.15.31:49698) 2024-09-17T05:36:29.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef93400640 1 -- 172.21.15.31:0/1765867518 learned_addr learned my addr 172.21.15.31:0/1765867518 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:29.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef8be00640 1 --2- 172.21.15.31:0/1765867518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecbdc0 0x55b380f42950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef93400640 1 -- 172.21.15.31:0/1765867518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecbdc0 msgr2=0x55b380f42950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:29.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef93400640 1 --2- 172.21.15.31:0/1765867518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecbdc0 0x55b380f42950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef93400640 1 -- 172.21.15.31:0/1765867518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380e80220 msgr2=0x55b380f42410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:29.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef93400640 1 --2- 172.21.15.31:0/1765867518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380e80220 0x55b380f42410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef93400640 1 -- 172.21.15.31:0/1765867518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b380c8fa90 con 0x55b380ecc6e0 2024-09-17T05:36:29.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef93400640 1 --2- 172.21.15.31:0/1765867518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecc6e0 0x55b380f42e90 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0163f0 tx=0x7fef8c0168b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ba281db2595be7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:29.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef80c00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:36:29.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef80c00640 1 -- 172.21.15.31:0/1765867518 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c017700 con 0x55b380ecc6e0 2024-09-17T05:36:29.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef80c00640 1 -- 172.21.15.31:0/1765867518 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fef8c0178a0 con 0x55b380ecc6e0 2024-09-17T05:36:29.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 1 -- 172.21.15.31:0/1765867518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef84005020 con 0x55b380ecc6e0 2024-09-17T05:36:29.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef80c00640 1 -- 172.21.15.31:0/1765867518 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) ==== 24+0+0 (secure 0 0 0) 0x7fef8c028050 con 0x55b380ecc6e0 2024-09-17T05:36:29.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 10 client.8877 fetch_fsmap learned FSMap version 109 2024-09-17T05:36:29.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 1 -- 172.21.15.31:0/1765867518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) -- 0x55b380c6e050 con 0x55b380ecc6e0 2024-09-17T05:36:29.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef80c00640 1 -- 172.21.15.31:0/1765867518 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef84005020 con 0x55b380ecc6e0 2024-09-17T05:36:29.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef80c00640 1 -- 172.21.15.31:0/1765867518 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 109) ==== 3502+0+0 (secure 0 0 0) 0x7fef8c02b020 con 0x55b380ecc6e0 2024-09-17T05:36:29.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 10 client.8877 fetch_fsmap finished waiting for FSMap version 109 2024-09-17T05:36:29.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 10 client.8877 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:36:29.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 20 client.8877 populate_metadata read hostname 'smithi031' 2024-09-17T05:36:29.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 1 --2- 172.21.15.31:0/1765867518 >> [v2:172.21.15.31:6834/2117164749,v1:172.21.15.31:6835/2117164749] conn(0x55b380f49660 0x55b380f4ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 4 client.8877 mds_command: new command op to 8733 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:36:29.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 1 -- 172.21.15.31:0/1765867518 --> [v2:172.21.15.31:6834/2117164749,v1:172.21.15.31:6835/2117164749] -- command(tid 0: {"prefix": "status"}) -- 0x55b380cd7520 con 0x55b380f49660 2024-09-17T05:36:29.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef92a00640 1 --2- 172.21.15.31:0/1765867518 >> [v2:172.21.15.31:6834/2117164749,v1:172.21.15.31:6835/2117164749] conn(0x55b380f49660 0x55b380f4ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef80c00640 10 client.8877 ms_handle_connect on v2:172.21.15.31:6834/2117164749 2024-09-17T05:36:29.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef92a00640 1 --2- 172.21.15.31:0/1765867518 >> [v2:172.21.15.31:6834/2117164749,v1:172.21.15.31:6835/2117164749] conn(0x55b380f49660 0x55b380f4ba50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26ca9a92e3aa50ef server_cookie=2451625ba4dbe980 in_seq=0 out_seq=0 2024-09-17T05:36:29.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef80c00640 1 -- 172.21.15.31:0/1765867518 <== mds.0 v2:172.21.15.31:6834/2117164749 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x55b380cd7520 con 0x55b380f49660 2024-09-17T05:36:29.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef80c00640 10 client.8877 handle_command_reply: tid=0 2024-09-17T05:36:29.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 1 client.8877 shutdown 2024-09-17T05:36:29.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 1 -- 172.21.15.31:0/1765867518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecc6e0 msgr2=0x55b380f42e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 1 --2- 172.21.15.31:0/1765867518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecc6e0 0x55b380f42e90 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0163f0 tx=0x7fef8c0168b0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 1 -- 172.21.15.31:0/1765867518 shutdown_connections 2024-09-17T05:36:29.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 1 --2- 172.21.15.31:0/1765867518 >> [v2:172.21.15.31:6834/2117164749,v1:172.21.15.31:6835/2117164749] conn(0x55b380f49660 0x55b380f4ba50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 1 --2- 172.21.15.31:0/1765867518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55b380ecc6e0 0x55b380f42e90 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 1 --2- 172.21.15.31:0/1765867518 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55b380ecbdc0 0x55b380f42950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 1 --2- 172.21.15.31:0/1765867518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b380e80220 0x55b380f42410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef80c00640 0 client.8877 ms_handle_reset on v2:172.21.15.31:6834/2117164749 2024-09-17T05:36:29.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 1 -- 172.21.15.31:0/1765867518 >> 172.21.15.31:0/1765867518 conn(0x55b380d65130 msgr2=0x55b380ea6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:29.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 1 -- 172.21.15.31:0/1765867518 shutdown_connections 2024-09-17T05:36:29.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 1 -- 172.21.15.31:0/1765867518 wait complete. 2024-09-17T05:36:29.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.528+0000 7fef9d30a000 20 client.8877 trim_cache size 0 max 16384 2024-09-17T05:36:29.539 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:36:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "b668cd1d-3036-4a29-9e5a-69d0df5776a8", 2024-09-17T05:36:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-17T05:36:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 8733, 2024-09-17T05:36:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-09-17T05:36:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-09-17T05:36:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-17T05:36:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 10.641977878000001, 2024-09-17T05:36:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 109, 2024-09-17T05:36:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 152, 2024-09-17T05:36:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 152, 2024-09-17T05:36:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 15.098789906 2024-09-17T05:36:29.541 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:36:29.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.532+0000 7fef99e00640 1 -- 172.21.15.31:0/319819548 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fef70073a70 msgr2=0x7fef70075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.532+0000 7fef99e00640 1 --2- 172.21.15.31:0/319819548 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fef70073a70 0x7fef70075f30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fef84004630 tx=0x7fef8400b390 comp rx=0 tx=0).stop 2024-09-17T05:36:29.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.532+0000 7fef99e00640 1 -- 172.21.15.31:0/319819548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef9415c1c0 msgr2=0x7fef940c56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.532+0000 7fef99e00640 1 --2- 172.21.15.31:0/319819548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef9415c1c0 0x7fef940c56e0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fef7c009790 tx=0x7fef7c0040c0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.532+0000 7fef99e00640 1 -- 172.21.15.31:0/319819548 shutdown_connections 2024-09-17T05:36:29.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.532+0000 7fef99e00640 1 --2- 172.21.15.31:0/319819548 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fef70073a70 0x7fef70075f30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.532+0000 7fef99e00640 1 --2- 172.21.15.31:0/319819548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef9415f7b0 0x7fef940ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.532+0000 7fef99e00640 1 --2- 172.21.15.31:0/319819548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fef9415c1c0 0x7fef940c56e0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.532+0000 7fef99e00640 1 --2- 172.21.15.31:0/319819548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef9406cc20 0x7fef940c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.532+0000 7fef99e00640 1 -- 172.21.15.31:0/319819548 >> 172.21.15.31:0/319819548 conn(0x7fef940d0c90 msgr2=0x7fef94155330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:29.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.532+0000 7fef99e00640 1 -- 172.21.15.31:0/319819548 shutdown_connections 2024-09-17T05:36:29.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.532+0000 7fef99e00640 1 -- 172.21.15.31:0/319819548 wait complete. 2024-09-17T05:36:29.551 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:36:29.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.696+0000 7f0bdde00640 1 -- 172.21.15.31:0/1979419914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bd80b49e0 msgr2=0x7f0bd80acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.696+0000 7f0bdde00640 1 --2- 172.21.15.31:0/1979419914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bd80b49e0 0x7f0bd80acd40 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009bc0 tx=0x7f0bd001cb10 comp rx=0 tx=0).stop 2024-09-17T05:36:29.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.696+0000 7f0bdde00640 1 -- 172.21.15.31:0/1979419914 shutdown_connections 2024-09-17T05:36:29.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.696+0000 7f0bdde00640 1 --2- 172.21.15.31:0/1979419914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bd80b49e0 0x7f0bd80acd40 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.696+0000 7f0bdde00640 1 --2- 172.21.15.31:0/1979419914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bd80cd100 0x7f0bd806f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.696+0000 7f0bdde00640 1 -- 172.21.15.31:0/1979419914 >> 172.21.15.31:0/1979419914 conn(0x7f0bd80b18f0 msgr2=0x7f0bd80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:29.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.696+0000 7f0bdde00640 1 -- 172.21.15.31:0/1979419914 shutdown_connections 2024-09-17T05:36:29.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.696+0000 7f0bdde00640 1 -- 172.21.15.31:0/1979419914 wait complete. 2024-09-17T05:36:29.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.696+0000 7f0bdde00640 1 Processor -- start 2024-09-17T05:36:29.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.696+0000 7f0bdde00640 1 -- start start 2024-09-17T05:36:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.696+0000 7f0bdde00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bd80b49e0 0x7f0bd8149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bdde00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bd80cd100 0x7f0bd81f8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bdde00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bd815dae0 0x7f0bd81640e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bdde00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd80cf100 con 0x7f0bd815dae0 2024-09-17T05:36:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bdde00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd80cef80 con 0x7f0bd80b49e0 2024-09-17T05:36:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bdde00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0bd80cf280 con 0x7f0bd80cd100 2024-09-17T05:36:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bd7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bd815dae0 0x7f0bd81640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bd7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bd815dae0 0x7f0bd81640e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49704/0 (socket says 172.21.15.31:49704) 2024-09-17T05:36:29.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bd7400640 1 -- 172.21.15.31:0/641583190 learned_addr learned my addr 172.21.15.31:0/641583190 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bd6a00640 1 --2- 172.21.15.31:0/641583190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bd80b49e0 0x7f0bd8149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bcfe00640 1 --2- 172.21.15.31:0/641583190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bd80cd100 0x7f0bd81f8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bd7400640 1 -- 172.21.15.31:0/641583190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bd80cd100 msgr2=0x7f0bd81f8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bd7400640 1 --2- 172.21.15.31:0/641583190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bd80cd100 0x7f0bd81f8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bd7400640 1 -- 172.21.15.31:0/641583190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bd80b49e0 msgr2=0x7f0bd8149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bd7400640 1 --2- 172.21.15.31:0/641583190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bd80b49e0 0x7f0bd8149810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bd7400640 1 -- 172.21.15.31:0/641583190 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd8167040 con 0x7f0bd815dae0 2024-09-17T05:36:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bd7400640 1 --2- 172.21.15.31:0/641583190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bd815dae0 0x7f0bd81640e0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00b0040 tx=0x7f0bd0009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bcf400640 1 -- 172.21.15.31:0/641583190 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00b2040 con 0x7f0bd815dae0 2024-09-17T05:36:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bcf400640 1 -- 172.21.15.31:0/641583190 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bd00bb070 con 0x7f0bd815dae0 2024-09-17T05:36:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bcf400640 1 -- 172.21.15.31:0/641583190 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00045b0 con 0x7f0bd815dae0 2024-09-17T05:36:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bdde00640 1 -- 172.21.15.31:0/641583190 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd81625a0 con 0x7f0bd815dae0 2024-09-17T05:36:29.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bdde00640 1 -- 172.21.15.31:0/641583190 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd8166d60 con 0x7f0bd815dae0 2024-09-17T05:36:29.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bdde00640 1 -- 172.21.15.31:0/641583190 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bd80704a0 con 0x7f0bd815dae0 2024-09-17T05:36:29.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.700+0000 7f0bcf400640 1 -- 172.21.15.31:0/641583190 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f0bd00a5990 con 0x7f0bd815dae0 2024-09-17T05:36:29.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.704+0000 7f0bcf400640 1 --2- 172.21.15.31:0/641583190 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0bb4073a70 0x7f0bb4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:29.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.704+0000 7f0bcf400640 1 -- 172.21.15.31:0/641583190 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f0bd012faa0 con 0x7f0bd815dae0 2024-09-17T05:36:29.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.704+0000 7f0bd6a00640 1 --2- 172.21.15.31:0/641583190 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0bb4073a70 0x7f0bb4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:29.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.704+0000 7f0bd6a00640 1 --2- 172.21.15.31:0/641583190 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0bb4073a70 0x7f0bb4075f30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8000f70 tx=0x7f0bc8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:29.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.708+0000 7f0bcf400640 1 -- 172.21.15.31:0/641583190 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0bd0016790 con 0x7f0bd815dae0 2024-09-17T05:36:29.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.924+0000 7f0bdde00640 1 -- 172.21.15.31:0/641583190 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0bd80acd40 con 0x7f0bd815dae0 2024-09-17T05:36:29.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.924+0000 7f0bcf400640 1 -- 172.21.15.31:0/641583190 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v109) ==== 53+0+73 (secure 0 0 0) 0x7f0bd00f9fa0 con 0x7f0bd815dae0 2024-09-17T05:36:29.927 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:36:29.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.924+0000 7f0bdde00640 1 -- 172.21.15.31:0/641583190 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0bb4073a70 msgr2=0x7f0bb4075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.924+0000 7f0bdde00640 1 --2- 172.21.15.31:0/641583190 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0bb4073a70 0x7f0bb4075f30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8000f70 tx=0x7f0bc8009040 comp rx=0 tx=0).stop 2024-09-17T05:36:29.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.924+0000 7f0bdde00640 1 -- 172.21.15.31:0/641583190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bd815dae0 msgr2=0x7f0bd81640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:29.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.924+0000 7f0bdde00640 1 --2- 172.21.15.31:0/641583190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bd815dae0 0x7f0bd81640e0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00b0040 tx=0x7f0bd0009200 comp rx=0 tx=0).stop 2024-09-17T05:36:29.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.928+0000 7f0bdde00640 1 -- 172.21.15.31:0/641583190 shutdown_connections 2024-09-17T05:36:29.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.928+0000 7f0bdde00640 1 --2- 172.21.15.31:0/641583190 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0bb4073a70 0x7f0bb4075f30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.928+0000 7f0bdde00640 1 --2- 172.21.15.31:0/641583190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bd815dae0 0x7f0bd81640e0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.928+0000 7f0bdde00640 1 --2- 172.21.15.31:0/641583190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bd80cd100 0x7f0bd81f8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.928+0000 7f0bdde00640 1 --2- 172.21.15.31:0/641583190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bd80b49e0 0x7f0bd8149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:29.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.928+0000 7f0bdde00640 1 -- 172.21.15.31:0/641583190 >> 172.21.15.31:0/641583190 conn(0x7f0bd80b18f0 msgr2=0x7f0bd80d0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:29.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.928+0000 7f0bdde00640 1 -- 172.21.15.31:0/641583190 shutdown_connections 2024-09-17T05:36:29.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:29.928+0000 7f0bdde00640 1 -- 172.21.15.31:0/641583190 wait complete. 2024-09-17T05:36:29.949 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:36:29.949 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:36:29.949 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-17T05:36:29.949 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:36:29.949 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:36:29.949 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:36:29.949 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:36:29.949 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:36:29.949 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:36:29.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:29.950 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-17T05:36:29.960 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:36:29.960 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:36:29.960 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:36:29.960 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:29.960 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-17T05:36:29.960 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:29.960 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:29.960 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:29.960 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-17T05:36:29.961 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:29.961 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:29.961 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-17T05:36:29.961 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:36:29.961 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:29.961 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-17T05:36:29.961 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:36:29.961 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 41963sec preferred_lft 41963sec 2024-09-17T05:36:29.961 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-17T05:36:29.964 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:29.964 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:29.964 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:29.964 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-17T05:36:29.964 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:36:29.964 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:fe:f3:3e:aa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:29.964 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:36:29.964 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:29.964 INFO:teuthology.orchestra.run.smithi031.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:36:29.965 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:29.965 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:36:29.965 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:29.965 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:36:29.965 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:29.965 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:36:29.965 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:36:29.965 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:36:29.965 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:29.965 INFO:teuthology.orchestra.run.smithi031.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:36:29.965 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:36:29.965 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:36:29.966 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:29.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:29.966 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:36:30.018 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-17T05:36:30.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:30.021 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-17T05:36:30.077 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-17T05:36:30.078 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:36:30.078 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:36:30.078 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:36:30.078 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:36:30.078 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:36:30.078 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:30.078 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:36:30.079 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:36:30.079 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:36:30.079 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:36:30.079 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:36:30.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:30.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:30.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:30.217 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T05:36:30.226 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:36:30.226 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:36:30.227 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:36:30.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:30.227 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-09-17T05:36:30.293 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:36:30.293 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:36:30.348 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:36:30.349 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:36:30.349 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:36:30.400 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-17T05:36:30.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:30.400 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:36:30.498 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:36:30.498 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:36:30.511 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:36:30.511 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:36:30.511 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:36:30.511 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:36:30.512 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:36:30.515 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:36:30.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:30.515 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:36:30.536 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:36:30.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:36:30.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:30.641 INFO:teuthology.orchestra.run.smithi031.stdout:client7328 2024-09-17T05:36:30.641 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:36:30.642 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:30.651 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:36:30.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.836+0000 7eff0ba00640 1 -- 172.21.15.31:0/592760828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff040cdb30 msgr2=0x7eff040af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:30.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.836+0000 7eff0ba00640 1 --2- 172.21.15.31:0/592760828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff040cdb30 0x7eff040af0c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7efefc009bc0 tx=0x7efefc01cac0 comp rx=0 tx=0).stop 2024-09-17T05:36:30.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.836+0000 7eff0ba00640 1 -- 172.21.15.31:0/592760828 shutdown_connections 2024-09-17T05:36:30.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.836+0000 7eff0ba00640 1 --2- 172.21.15.31:0/592760828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff040cdb30 0x7eff040af0c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:30.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.836+0000 7eff0ba00640 1 -- 172.21.15.31:0/592760828 >> 172.21.15.31:0/592760828 conn(0x7eff040d1dc0 msgr2=0x7eff040d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:30.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.836+0000 7eff0ba00640 1 -- 172.21.15.31:0/592760828 shutdown_connections 2024-09-17T05:36:30.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.836+0000 7eff0ba00640 1 -- 172.21.15.31:0/592760828 wait complete. 2024-09-17T05:36:30.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff0ba00640 1 Processor -- start 2024-09-17T05:36:30.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff0ba00640 1 -- start start 2024-09-17T05:36:30.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff0ba00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff040cdb30 0x7eff04154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:30.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff0ba00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff040ced80 0x7eff040c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:30.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff0ba00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff0415bea0 0x7eff041fb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:30.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff0ba00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7eff0416a840 con 0x7eff040cdb30 2024-09-17T05:36:30.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff0ba00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7eff0416a6c0 con 0x7eff040ced80 2024-09-17T05:36:30.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff0ba00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7eff0416a9c0 con 0x7eff0415bea0 2024-09-17T05:36:30.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff09000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff040cdb30 0x7eff04154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:30.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff09000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff040cdb30 0x7eff04154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49708/0 (socket says 172.21.15.31:49708) 2024-09-17T05:36:30.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff09000640 1 -- 172.21.15.31:0/196397788 learned_addr learned my addr 172.21.15.31:0/196397788 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:30.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff03e00640 1 --2- 172.21.15.31:0/196397788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff040ced80 0x7eff040c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:30.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff09a00640 1 --2- 172.21.15.31:0/196397788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff0415bea0 0x7eff041fb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:30.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff09000640 1 -- 172.21.15.31:0/196397788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff0415bea0 msgr2=0x7eff041fb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:30.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff09000640 1 --2- 172.21.15.31:0/196397788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff0415bea0 0x7eff041fb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:30.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff09000640 1 -- 172.21.15.31:0/196397788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff040ced80 msgr2=0x7eff040c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:30.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff09000640 1 --2- 172.21.15.31:0/196397788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff040ced80 0x7eff040c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:30.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff09000640 1 -- 172.21.15.31:0/196397788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff040cebb0 con 0x7eff040cdb30 2024-09-17T05:36:30.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff09a00640 1 --2- 172.21.15.31:0/196397788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff0415bea0 0x7eff041fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:30.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff09000640 1 --2- 172.21.15.31:0/196397788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff040cdb30 0x7eff04154710 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7efef800c420 tx=0x7efef800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:30.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff00c00640 1 -- 172.21.15.31:0/196397788 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8017070 con 0x7eff040cdb30 2024-09-17T05:36:30.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff00c00640 1 -- 172.21.15.31:0/196397788 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efef80053c0 con 0x7eff040cdb30 2024-09-17T05:36:30.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff0ba00640 1 -- 172.21.15.31:0/196397788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff040c81f0 con 0x7eff040cdb30 2024-09-17T05:36:30.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff00c00640 1 -- 172.21.15.31:0/196397788 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8003860 con 0x7eff040cdb30 2024-09-17T05:36:30.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.840+0000 7eff0ba00640 1 -- 172.21.15.31:0/196397788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff04155430 con 0x7eff040cdb30 2024-09-17T05:36:30.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.844+0000 7eff0ba00640 1 -- 172.21.15.31:0/196397788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff04155670 con 0x7eff040cdb30 2024-09-17T05:36:30.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.844+0000 7eff00c00640 1 -- 172.21.15.31:0/196397788 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7efef801a070 con 0x7eff040cdb30 2024-09-17T05:36:30.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.844+0000 7eff00c00640 1 --2- 172.21.15.31:0/196397788 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efee4073aa0 0x7efee4075f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:30.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.844+0000 7eff00c00640 1 -- 172.21.15.31:0/196397788 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7efef8094610 con 0x7eff040cdb30 2024-09-17T05:36:30.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.844+0000 7eff03e00640 1 --2- 172.21.15.31:0/196397788 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efee4073aa0 0x7efee4075f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:30.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.844+0000 7eff03e00640 1 --2- 172.21.15.31:0/196397788 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efee4073aa0 0x7efee4075f60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7eff0415b6a0 tx=0x7efef00016a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:30.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:30.848+0000 7eff00c00640 1 -- 172.21.15.31:0/196397788 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7efef805e1f0 con 0x7eff040cdb30 2024-09-17T05:36:31.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.080+0000 7eff0ba00640 1 -- 172.21.15.31:0/196397788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7eff040ce620 con 0x7eff040cdb30 2024-09-17T05:36:31.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.080+0000 7eff00c00640 1 -- 172.21.15.31:0/196397788 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v109) ==== 53+0+73 (secure 0 0 0) 0x7efef8062c20 con 0x7eff040cdb30 2024-09-17T05:36:31.081 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:36:31.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.080+0000 7eff0ba00640 1 -- 172.21.15.31:0/196397788 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efee4073aa0 msgr2=0x7efee4075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:31.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.080+0000 7eff0ba00640 1 --2- 172.21.15.31:0/196397788 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efee4073aa0 0x7efee4075f60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7eff0415b6a0 tx=0x7efef00016a0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.080+0000 7eff0ba00640 1 -- 172.21.15.31:0/196397788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff040cdb30 msgr2=0x7eff04154710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:31.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.080+0000 7eff0ba00640 1 --2- 172.21.15.31:0/196397788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff040cdb30 0x7eff04154710 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7efef800c420 tx=0x7efef800c8e0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.080+0000 7eff0ba00640 1 -- 172.21.15.31:0/196397788 shutdown_connections 2024-09-17T05:36:31.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.080+0000 7eff0ba00640 1 --2- 172.21.15.31:0/196397788 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efee4073aa0 0x7efee4075f60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.080+0000 7eff0ba00640 1 --2- 172.21.15.31:0/196397788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff0415bea0 0x7eff041fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.080+0000 7eff0ba00640 1 --2- 172.21.15.31:0/196397788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff040ced80 0x7eff040c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.080+0000 7eff0ba00640 1 --2- 172.21.15.31:0/196397788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff040cdb30 0x7eff04154710 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.080+0000 7eff0ba00640 1 -- 172.21.15.31:0/196397788 >> 172.21.15.31:0/196397788 conn(0x7eff040d1dc0 msgr2=0x7eff04072210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:31.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.080+0000 7eff0ba00640 1 -- 172.21.15.31:0/196397788 shutdown_connections 2024-09-17T05:36:31.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.080+0000 7eff0ba00640 1 -- 172.21.15.31:0/196397788 wait complete. 2024-09-17T05:36:31.103 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:36:31.104 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:36:31.104 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-09-17T05:36:31.104 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:36:31.104 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:36:31.104 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:36:31.104 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:36:31.104 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:36:31.104 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:36:31.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:31.104 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-09-17T05:36:31.115 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:36:31.115 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:36:31.115 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:36:31.115 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:31.115 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-17T05:36:31.115 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:31.115 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:31.116 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:31.116 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-09-17T05:36:31.116 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:31.116 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:31.116 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-09-17T05:36:31.116 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:31.116 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:31.117 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:36:31.117 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:31.117 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-17T05:36:31.117 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 41965sec preferred_lft 41965sec 2024-09-17T05:36:31.117 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-09-17T05:36:31.117 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:31.117 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:36:31.117 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:84:cd:fc:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:31.117 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:36:31.117 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:31.117 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:36:31.118 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:31.118 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:36:31.118 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:31.118 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:36:31.118 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:31.118 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:36:31.118 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:36:31.118 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:36:31.118 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:31.118 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:36:31.118 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:36:31.119 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:36:31.119 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:31.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:31.120 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:36:31.180 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-17T05:36:31.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:31.182 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-09-17T05:36:31.236 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-09-17T05:36:31.236 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:36:31.236 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-17T05:36:31.236 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:36:31.236 INFO:teuthology.orchestra.run.smithi155.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-17T05:36:31.236 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:36:31.237 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:36:31.237 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:36:31.237 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:36:31.237 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:36:31.237 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:36:31.237 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:31.237 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:36:31.237 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:36:31.237 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:36:31.238 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:36:31.238 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:36:31.334 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:36:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:31.377 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:36:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:31.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:31.384 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-17T05:36:31.393 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:36:31.396 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:36:31.396 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:36:31.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:31.397 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-09-17T05:36:31.460 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:36:31.460 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:36:31.516 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:36:31.517 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:36:31.517 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:36:31.568 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-17T05:36:31.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:31.568 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:36:31.660 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:36:31.661 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:36:31.675 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:36:31.675 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:36:31.675 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:36:31.675 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:36:31.675 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:36:31.679 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:36:31.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:31.680 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:36:31.698 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:36:31.786 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:36:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:36:31.791 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:36:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:31.797 INFO:teuthology.orchestra.run.smithi155.stdout:client8895 2024-09-17T05:36:31.797 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:36:31.798 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:31.806 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:36:31.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.960+0000 7fe5d0600640 1 -- 172.21.15.31:0/632951004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5c80ce890 msgr2=0x7fe5c806eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:31.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.960+0000 7fe5d0600640 1 --2- 172.21.15.31:0/632951004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5c80ce890 0x7fe5c806eb40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe5c000ad90 tx=0x7fe5c001dcb0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.960+0000 7fe5d0600640 1 -- 172.21.15.31:0/632951004 shutdown_connections 2024-09-17T05:36:31.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.960+0000 7fe5d0600640 1 --2- 172.21.15.31:0/632951004 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5c80ce890 0x7fe5c806eb40 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.960+0000 7fe5d0600640 1 --2- 172.21.15.31:0/632951004 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5c815a9d0 0x7fe5c80ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.960+0000 7fe5d0600640 1 -- 172.21.15.31:0/632951004 >> 172.21.15.31:0/632951004 conn(0x7fe5c80cfbc0 msgr2=0x7fe5c80cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:31.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.960+0000 7fe5d0600640 1 -- 172.21.15.31:0/632951004 shutdown_connections 2024-09-17T05:36:31.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.960+0000 7fe5d0600640 1 -- 172.21.15.31:0/632951004 wait complete. 2024-09-17T05:36:31.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5d0600640 1 Processor -- start 2024-09-17T05:36:31.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5d0600640 1 -- start start 2024-09-17T05:36:31.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5d0600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5c80734f0 0x7fe5c809ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:31.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5d0600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5c80ce890 0x7fe5c8164770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:31.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5d0600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5c815a9d0 0x7fe5c81523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:31.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5d0600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c81674e0 con 0x7fe5c80734f0 2024-09-17T05:36:31.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5d0600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c8167360 con 0x7fe5c815a9d0 2024-09-17T05:36:31.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5d0600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe5c8167660 con 0x7fe5c80ce890 2024-09-17T05:36:31.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5cdc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5c80734f0 0x7fe5c809ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:31.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5cdc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5c80734f0 0x7fe5c809ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49710/0 (socket says 172.21.15.31:49710) 2024-09-17T05:36:31.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5cdc00640 1 -- 172.21.15.31:0/772229864 learned_addr learned my addr 172.21.15.31:0/772229864 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:31.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5cd200640 1 --2- 172.21.15.31:0/772229864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5c80ce890 0x7fe5c8164770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:31.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5ce600640 1 --2- 172.21.15.31:0/772229864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5c815a9d0 0x7fe5c81523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:31.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5cdc00640 1 -- 172.21.15.31:0/772229864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5c80ce890 msgr2=0x7fe5c8164770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:31.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5cdc00640 1 --2- 172.21.15.31:0/772229864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5c80ce890 0x7fe5c8164770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5cdc00640 1 -- 172.21.15.31:0/772229864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5c815a9d0 msgr2=0x7fe5c81523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:31.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5cdc00640 1 --2- 172.21.15.31:0/772229864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5c815a9d0 0x7fe5c81523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:31.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5cdc00640 1 -- 172.21.15.31:0/772229864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c8155210 con 0x7fe5c80734f0 2024-09-17T05:36:31.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5cdc00640 1 --2- 172.21.15.31:0/772229864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5c80734f0 0x7fe5c809ba60 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00c500 tx=0x7fe5bc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:31.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5c5600640 1 -- 172.21.15.31:0/772229864 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc017070 con 0x7fe5c80734f0 2024-09-17T05:36:31.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5c5600640 1 -- 172.21.15.31:0/772229864 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5bc0053c0 con 0x7fe5c80734f0 2024-09-17T05:36:31.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5c5600640 1 -- 172.21.15.31:0/772229864 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc012890 con 0x7fe5c80734f0 2024-09-17T05:36:31.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5d0600640 1 -- 172.21.15.31:0/772229864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c8159960 con 0x7fe5c80734f0 2024-09-17T05:36:31.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5d0600640 1 -- 172.21.15.31:0/772229864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c8164cb0 con 0x7fe5c80734f0 2024-09-17T05:36:31.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.964+0000 7fe5d0600640 1 -- 172.21.15.31:0/772229864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c8069410 con 0x7fe5c80734f0 2024-09-17T05:36:31.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.968+0000 7fe5c5600640 1 -- 172.21.15.31:0/772229864 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7fe5bc01a070 con 0x7fe5c80734f0 2024-09-17T05:36:31.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.968+0000 7fe5c5600640 1 --2- 172.21.15.31:0/772229864 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe5a8073a70 0x7fe5a8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:31.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.968+0000 7fe5c5600640 1 -- 172.21.15.31:0/772229864 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fe5bc094690 con 0x7fe5c80734f0 2024-09-17T05:36:31.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.968+0000 7fe5cd200640 1 --2- 172.21.15.31:0/772229864 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe5a8073a70 0x7fe5a8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:31.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.968+0000 7fe5cd200640 1 --2- 172.21.15.31:0/772229864 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe5a8073a70 0x7fe5a8075f30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80af410 tx=0x7fe5b40091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:31.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:31.972+0000 7fe5c5600640 1 -- 172.21.15.31:0/772229864 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe5bc05e1b0 con 0x7fe5c80734f0 2024-09-17T05:36:32.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:32.184+0000 7fe5d0600640 1 -- 172.21.15.31:0/772229864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fe5c806eb40 con 0x7fe5c80734f0 2024-09-17T05:36:32.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:32.948+0000 7fe5c5600640 1 -- 172.21.15.31:0/772229864 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v110) ==== 136+0+0 (secure 0 0 0) 0x7fe5bc062be0 con 0x7fe5c80734f0 2024-09-17T05:36:32.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:32.952+0000 7fe5d0600640 1 -- 172.21.15.31:0/772229864 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe5a8073a70 msgr2=0x7fe5a8075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:32.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:32.952+0000 7fe5d0600640 1 --2- 172.21.15.31:0/772229864 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe5a8073a70 0x7fe5a8075f30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80af410 tx=0x7fe5b40091e0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:32.952+0000 7fe5d0600640 1 -- 172.21.15.31:0/772229864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5c80734f0 msgr2=0x7fe5c809ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:32.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:32.952+0000 7fe5d0600640 1 --2- 172.21.15.31:0/772229864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5c80734f0 0x7fe5c809ba60 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00c500 tx=0x7fe5bc00c9c0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:32.952+0000 7fe5d0600640 1 -- 172.21.15.31:0/772229864 shutdown_connections 2024-09-17T05:36:32.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:32.952+0000 7fe5d0600640 1 --2- 172.21.15.31:0/772229864 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe5a8073a70 0x7fe5a8075f30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:32.952+0000 7fe5d0600640 1 --2- 172.21.15.31:0/772229864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5c815a9d0 0x7fe5c81523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:32.952+0000 7fe5d0600640 1 --2- 172.21.15.31:0/772229864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe5c80ce890 0x7fe5c8164770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:32.952+0000 7fe5d0600640 1 --2- 172.21.15.31:0/772229864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5c80734f0 0x7fe5c809ba60 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:32.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:32.952+0000 7fe5d0600640 1 -- 172.21.15.31:0/772229864 >> 172.21.15.31:0/772229864 conn(0x7fe5c80cfbc0 msgr2=0x7fe5c815bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:32.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:32.952+0000 7fe5d0600640 1 -- 172.21.15.31:0/772229864 shutdown_connections 2024-09-17T05:36:32.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:32.952+0000 7fe5d0600640 1 -- 172.21.15.31:0/772229864 wait complete. 2024-09-17T05:36:32.980 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:36:33.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.128+0000 7ff210000640 1 -- 172.21.15.31:0/1417460931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2080b1f40 msgr2=0x7ff2080cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.128+0000 7ff210000640 1 --2- 172.21.15.31:0/1417460931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2080b1f40 0x7ff2080cfda0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7ff2080cfb60 tx=0x7ff20001cc30 comp rx=0 tx=0).stop 2024-09-17T05:36:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.128+0000 7ff210000640 1 -- 172.21.15.31:0/1417460931 shutdown_connections 2024-09-17T05:36:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.128+0000 7ff210000640 1 --2- 172.21.15.31:0/1417460931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2080b1f40 0x7ff2080cfda0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.128+0000 7ff210000640 1 --2- 172.21.15.31:0/1417460931 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2080b2e80 0x7ff2080b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.128+0000 7ff210000640 1 --2- 172.21.15.31:0/1417460931 >> v2:172.21.15.155:3300/0 conn(0x7ff20815f490 0x7ff2080b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.128+0000 7ff210000640 1 -- 172.21.15.31:0/1417460931 >> 172.21.15.31:0/1417460931 conn(0x7ff2080d1e30 msgr2=0x7ff2080d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.128+0000 7ff210000640 1 -- 172.21.15.31:0/1417460931 shutdown_connections 2024-09-17T05:36:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.128+0000 7ff210000640 1 -- 172.21.15.31:0/1417460931 wait complete. 2024-09-17T05:36:33.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff210000640 1 Processor -- start 2024-09-17T05:36:33.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff210000640 1 -- start start 2024-09-17T05:36:33.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff210000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2080b1f40 0x7ff2080cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:33.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff210000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2080b2e80 0x7ff2081519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:33.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff210000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff20815f490 0x7ff2080cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:33.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff210000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff2080b0010 con 0x7ff2080b2e80 2024-09-17T05:36:33.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff210000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff2080afe90 con 0x7ff20815f490 2024-09-17T05:36:33.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff210000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff2080b0190 con 0x7ff2080b1f40 2024-09-17T05:36:33.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff20cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2080b2e80 0x7ff2081519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:33.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff20cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2080b2e80 0x7ff2081519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49724/0 (socket says 172.21.15.31:49724) 2024-09-17T05:36:33.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff20cc00640 1 -- 172.21.15.31:0/1956515538 learned_addr learned my addr 172.21.15.31:0/1956515538 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:33.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff20d600640 1 --2- 172.21.15.31:0/1956515538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2080b1f40 0x7ff2080cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:33.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff20e000640 1 --2- 172.21.15.31:0/1956515538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff20815f490 0x7ff2080cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:33.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff20cc00640 1 -- 172.21.15.31:0/1956515538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2080b1f40 msgr2=0x7ff2080cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff20cc00640 1 --2- 172.21.15.31:0/1956515538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2080b1f40 0x7ff2080cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff20cc00640 1 -- 172.21.15.31:0/1956515538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff20815f490 msgr2=0x7ff2080cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff20cc00640 1 --2- 172.21.15.31:0/1956515538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff20815f490 0x7ff2080cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff20cc00640 1 -- 172.21.15.31:0/1956515538 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2080c8fa0 con 0x7ff2080b2e80 2024-09-17T05:36:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff20cc00640 1 --2- 172.21.15.31:0/1956515538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2080b2e80 0x7ff2081519e0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400c940 tx=0x7ff1f400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff205600640 1 -- 172.21.15.31:0/1956515538 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4007b50 con 0x7ff2080b2e80 2024-09-17T05:36:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff205600640 1 -- 172.21.15.31:0/1956515538 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1f4007e00 con 0x7ff2080b2e80 2024-09-17T05:36:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff205600640 1 -- 172.21.15.31:0/1956515538 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f400f6b0 con 0x7ff2080b2e80 2024-09-17T05:36:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff210000640 1 -- 172.21.15.31:0/1956515538 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2080cdf20 con 0x7ff2080b2e80 2024-09-17T05:36:33.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.132+0000 7ff210000640 1 -- 172.21.15.31:0/1956515538 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2080c9210 con 0x7ff2080b2e80 2024-09-17T05:36:33.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.136+0000 7ff210000640 1 -- 172.21.15.31:0/1956515538 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2080cfda0 con 0x7ff2080b2e80 2024-09-17T05:36:33.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.136+0000 7ff205600640 1 -- 172.21.15.31:0/1956515538 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7ff1f400f850 con 0x7ff2080b2e80 2024-09-17T05:36:33.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.136+0000 7ff205600640 1 --2- 172.21.15.31:0/1956515538 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff1e8073a70 0x7ff1e8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:33.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.136+0000 7ff205600640 1 -- 172.21.15.31:0/1956515538 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7ff1f4095c90 con 0x7ff2080b2e80 2024-09-17T05:36:33.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.136+0000 7ff20d600640 1 --2- 172.21.15.31:0/1956515538 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff1e8073a70 0x7ff1e8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:33.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.136+0000 7ff20d600640 1 --2- 172.21.15.31:0/1956515538 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff1e8073a70 0x7ff1e8075f30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00ab40 tx=0x7ff1fc00a250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:33.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.140+0000 7ff205600640 1 -- 172.21.15.31:0/1956515538 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff1f4014030 con 0x7ff2080b2e80 2024-09-17T05:36:33.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.336+0000 7ff210000640 1 -- 172.21.15.31:0/1956515538 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7ff2080763d0 con 0x7ff1e8073a70 2024-09-17T05:36:33.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.340+0000 7ff205600640 1 -- 172.21.15.31:0/1956515538 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7ff2080763d0 con 0x7ff1e8073a70 2024-09-17T05:36:33.342 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:36:33.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:33.342 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephfs" 2024-09-17T05:36:33.342 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:33.342 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:36:33.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.340+0000 7ff210000640 1 -- 172.21.15.31:0/1956515538 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff1e8073a70 msgr2=0x7ff1e8075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.340+0000 7ff210000640 1 --2- 172.21.15.31:0/1956515538 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff1e8073a70 0x7ff1e8075f30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00ab40 tx=0x7ff1fc00a250 comp rx=0 tx=0).stop 2024-09-17T05:36:33.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.340+0000 7ff210000640 1 -- 172.21.15.31:0/1956515538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2080b2e80 msgr2=0x7ff2081519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.340+0000 7ff210000640 1 --2- 172.21.15.31:0/1956515538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2080b2e80 0x7ff2081519e0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400c940 tx=0x7ff1f400ce00 comp rx=0 tx=0).stop 2024-09-17T05:36:33.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.340+0000 7ff210000640 1 -- 172.21.15.31:0/1956515538 shutdown_connections 2024-09-17T05:36:33.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.340+0000 7ff210000640 1 --2- 172.21.15.31:0/1956515538 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff1e8073a70 0x7ff1e8075f30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.340+0000 7ff210000640 1 --2- 172.21.15.31:0/1956515538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff20815f490 0x7ff2080cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.340+0000 7ff210000640 1 --2- 172.21.15.31:0/1956515538 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2080b2e80 0x7ff2081519e0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.340+0000 7ff210000640 1 --2- 172.21.15.31:0/1956515538 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2080b1f40 0x7ff2080cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.340+0000 7ff210000640 1 -- 172.21.15.31:0/1956515538 >> 172.21.15.31:0/1956515538 conn(0x7ff2080d1e30 msgr2=0x7ff20806eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:33.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.340+0000 7ff210000640 1 -- 172.21.15.31:0/1956515538 shutdown_connections 2024-09-17T05:36:33.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.340+0000 7ff210000640 1 -- 172.21.15.31:0/1956515538 wait complete. 2024-09-17T05:36:33.365 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:36:33.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.512+0000 7f1de3000640 1 -- 172.21.15.31:0/3790874434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ddc15e130 msgr2=0x7f1ddc06e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.512+0000 7f1de3000640 1 --2- 172.21.15.31:0/3790874434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ddc15e130 0x7f1ddc06e740 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0d2f30 tx=0x7f1dcc01c890 comp rx=0 tx=0).stop 2024-09-17T05:36:33.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.512+0000 7f1de3000640 1 -- 172.21.15.31:0/3790874434 shutdown_connections 2024-09-17T05:36:33.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.512+0000 7f1de3000640 1 --2- 172.21.15.31:0/3790874434 >> v2:172.21.15.155:3300/0 conn(0x7f1ddc0cf250 0x7f1ddc0cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.512+0000 7f1de3000640 1 --2- 172.21.15.31:0/3790874434 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ddc15e130 0x7f1ddc06e740 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.512+0000 7f1de3000640 1 -- 172.21.15.31:0/3790874434 >> 172.21.15.31:0/3790874434 conn(0x7f1ddc0d1ea0 msgr2=0x7f1ddc0d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:33.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.512+0000 7f1de3000640 1 -- 172.21.15.31:0/3790874434 shutdown_connections 2024-09-17T05:36:33.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.512+0000 7f1de3000640 1 -- 172.21.15.31:0/3790874434 wait complete. 2024-09-17T05:36:33.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.512+0000 7f1de3000640 1 Processor -- start 2024-09-17T05:36:33.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.512+0000 7f1de3000640 1 -- start start 2024-09-17T05:36:33.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1de3000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ddc0ce720 0x7f1ddc1fb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:33.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1de3000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ddc0cf250 0x7f1ddc153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:33.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1de3000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ddc15e130 0x7f1ddc141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:33.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1de3000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc16ae00 con 0x7f1ddc15e130 2024-09-17T05:36:33.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1de3000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc16ac80 con 0x7f1ddc0cf250 2024-09-17T05:36:33.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1de3000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1ddc16af80 con 0x7f1ddc0ce720 2024-09-17T05:36:33.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1de1000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ddc15e130 0x7f1ddc141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:33.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1de1000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ddc15e130 0x7f1ddc141210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49736/0 (socket says 172.21.15.31:49736) 2024-09-17T05:36:33.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1de1000640 1 -- 172.21.15.31:0/3847916355 learned_addr learned my addr 172.21.15.31:0/3847916355 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:33.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1ddb400640 1 --2- 172.21.15.31:0/3847916355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ddc0cf250 0x7f1ddc153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:33.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1ddbe00640 1 --2- 172.21.15.31:0/3847916355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ddc0ce720 0x7f1ddc1fb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:33.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1de1000640 1 -- 172.21.15.31:0/3847916355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ddc0ce720 msgr2=0x7f1ddc1fb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1de1000640 1 --2- 172.21.15.31:0/3847916355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ddc0ce720 0x7f1ddc1fb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1de1000640 1 -- 172.21.15.31:0/3847916355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ddc0cf250 msgr2=0x7f1ddc153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1de1000640 1 --2- 172.21.15.31:0/3847916355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ddc0cf250 0x7f1ddc153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1de1000640 1 -- 172.21.15.31:0/3847916355 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ddc141cd0 con 0x7f1ddc15e130 2024-09-17T05:36:33.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1de1000640 1 --2- 172.21.15.31:0/3847916355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ddc15e130 0x7f1ddc141210 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400cce0 tx=0x7f1dd400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:33.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1dd3e00640 1 -- 172.21.15.31:0/3847916355 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd400f450 con 0x7f1ddc15e130 2024-09-17T05:36:33.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1dd3e00640 1 -- 172.21.15.31:0/3847916355 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1dd400f700 con 0x7f1ddc15e130 2024-09-17T05:36:33.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1dd3e00640 1 -- 172.21.15.31:0/3847916355 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd400fb50 con 0x7f1ddc15e130 2024-09-17T05:36:33.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1de3000640 1 -- 172.21.15.31:0/3847916355 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ddc141fb0 con 0x7f1ddc15e130 2024-09-17T05:36:33.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1de3000640 1 -- 172.21.15.31:0/3847916355 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ddc1fb220 con 0x7f1ddc15e130 2024-09-17T05:36:33.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.516+0000 7f1de3000640 1 -- 172.21.15.31:0/3847916355 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ddc1fb3f0 con 0x7f1ddc15e130 2024-09-17T05:36:33.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.520+0000 7f1dd3e00640 1 -- 172.21.15.31:0/3847916355 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f1dd400fcf0 con 0x7f1ddc15e130 2024-09-17T05:36:33.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.520+0000 7f1dd3e00640 1 --2- 172.21.15.31:0/3847916355 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1dbc073a70 0x7f1dbc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:33.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.520+0000 7f1dd3e00640 1 -- 172.21.15.31:0/3847916355 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f1dd4096110 con 0x7f1ddc15e130 2024-09-17T05:36:33.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.520+0000 7f1ddbe00640 1 --2- 172.21.15.31:0/3847916355 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1dbc073a70 0x7f1dbc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:33.523 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.520+0000 7f1ddbe00640 1 --2- 172.21.15.31:0/3847916355 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1dbc073a70 0x7f1dbc075f30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0af000 tx=0x7f1dcc01b0d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:33.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.524+0000 7f1dd3e00640 1 -- 172.21.15.31:0/3847916355 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f1dd4014030 con 0x7f1ddc15e130 2024-09-17T05:36:33.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.700+0000 7f1de3000640 1 -- 172.21.15.31:0/3847916355 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f1ddc15b060 con 0x7f1ddc15e130 2024-09-17T05:36:33.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.700+0000 7f1dd3e00640 1 -- 172.21.15.31:0/3847916355 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7f1dd405fbb0 con 0x7f1ddc15e130 2024-09-17T05:36:33.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.700+0000 7f1de3000640 1 -- 172.21.15.31:0/3847916355 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1dbc073a70 msgr2=0x7f1dbc075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.700+0000 7f1de3000640 1 --2- 172.21.15.31:0/3847916355 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1dbc073a70 0x7f1dbc075f30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0af000 tx=0x7f1dcc01b0d0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.700+0000 7f1de3000640 1 -- 172.21.15.31:0/3847916355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ddc15e130 msgr2=0x7f1ddc141210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:33.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.700+0000 7f1de3000640 1 --2- 172.21.15.31:0/3847916355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ddc15e130 0x7f1ddc141210 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400cce0 tx=0x7f1dd400a620 comp rx=0 tx=0).stop 2024-09-17T05:36:33.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.700+0000 7f1de3000640 1 -- 172.21.15.31:0/3847916355 shutdown_connections 2024-09-17T05:36:33.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.700+0000 7f1de3000640 1 --2- 172.21.15.31:0/3847916355 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1dbc073a70 0x7f1dbc075f30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.700+0000 7f1de3000640 1 --2- 172.21.15.31:0/3847916355 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ddc15e130 0x7f1ddc141210 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.700+0000 7f1de3000640 1 --2- 172.21.15.31:0/3847916355 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ddc0cf250 0x7f1ddc153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.700+0000 7f1de3000640 1 --2- 172.21.15.31:0/3847916355 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ddc0ce720 0x7f1ddc1fb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:33.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.700+0000 7f1de3000640 1 -- 172.21.15.31:0/3847916355 >> 172.21.15.31:0/3847916355 conn(0x7f1ddc0d1ea0 msgr2=0x7f1ddc071f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:33.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.704+0000 7f1de3000640 1 -- 172.21.15.31:0/3847916355 shutdown_connections 2024-09-17T05:36:33.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:33.704+0000 7f1de3000640 1 -- 172.21.15.31:0/3847916355 wait complete. 2024-09-17T05:36:33.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:33.726 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol93830/985c4d3e-a300-4e85-9488-b5b1b8fec5c7) 2024-09-17T05:36:33.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:33.754 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-17T05:36:33.810 INFO:teuthology.orchestra.run.smithi031.stdout:cephfs_data 2024-09-17T05:36:33.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:33.811 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol93830/985c4d3e-a300-4e85-9488-b5b1b8fec5c7) 2024-09-17T05:36:33.877 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:36:33.877 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol93830/.meta 2024-09-17T05:36:33.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:33.948 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/subvol_grp6480/subvol56731/d96724db-84a3-4d04-8766-9f115c525ab2) 2024-09-17T05:36:34.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:34.017 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-17T05:36:34.070 INFO:teuthology.orchestra.run.smithi031.stdout:cephfs_data 2024-09-17T05:36:34.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:34.070 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/subvol_grp6480/subvol56731/d96724db-84a3-4d04-8766-9f115c525ab2) 2024-09-17T05:36:34.138 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:36:34.138 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/subvol_grp6480/subvol56731/.meta 2024-09-17T05:36:34.201 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol93830 2024-09-17T05:36:34.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.392+0000 7fbd27000640 1 -- 172.21.15.31:0/1784918405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd200d2570 msgr2=0x7fbd200d29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.392+0000 7fbd27000640 1 --2- 172.21.15.31:0/1784918405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd200d2570 0x7fbd200d29e0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fbd2008e220 tx=0x7fbd1801ccc0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.392+0000 7fbd27000640 1 -- 172.21.15.31:0/1784918405 shutdown_connections 2024-09-17T05:36:34.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.392+0000 7fbd27000640 1 --2- 172.21.15.31:0/1784918405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd200d2570 0x7fbd200d29e0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.392+0000 7fbd27000640 1 --2- 172.21.15.31:0/1784918405 >> v2:172.21.15.155:3300/0 conn(0x7fbd200d4ab0 0x7fbd200b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.392+0000 7fbd27000640 1 -- 172.21.15.31:0/1784918405 >> 172.21.15.31:0/1784918405 conn(0x7fbd200d3f90 msgr2=0x7fbd200d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:34.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.392+0000 7fbd27000640 1 -- 172.21.15.31:0/1784918405 shutdown_connections 2024-09-17T05:36:34.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.392+0000 7fbd27000640 1 -- 172.21.15.31:0/1784918405 wait complete. 2024-09-17T05:36:34.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.392+0000 7fbd27000640 1 Processor -- start 2024-09-17T05:36:34.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.392+0000 7fbd27000640 1 -- start start 2024-09-17T05:36:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd27000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd200d2570 0x7fbd201600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd27000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd200d4ab0 0x7fbd201580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd27000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd201614f0 0x7fbd201433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd27000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2016b4c0 con 0x7fbd200d4ab0 2024-09-17T05:36:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd27000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2016b340 con 0x7fbd201614f0 2024-09-17T05:36:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd27000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbd2016b640 con 0x7fbd200d2570 2024-09-17T05:36:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd17e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd200d4ab0 0x7fbd201580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd17e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd200d4ab0 0x7fbd201580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49752/0 (socket says 172.21.15.31:49752) 2024-09-17T05:36:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd17e00640 1 -- 172.21.15.31:0/2031125663 learned_addr learned my addr 172.21.15.31:0/2031125663 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd25000640 1 --2- 172.21.15.31:0/2031125663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd201614f0 0x7fbd201433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd1fe00640 1 --2- 172.21.15.31:0/2031125663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd200d2570 0x7fbd201600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd17e00640 1 -- 172.21.15.31:0/2031125663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd200d2570 msgr2=0x7fbd201600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd17e00640 1 --2- 172.21.15.31:0/2031125663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd200d2570 0x7fbd201600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd17e00640 1 -- 172.21.15.31:0/2031125663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd201614f0 msgr2=0x7fbd201433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd17e00640 1 --2- 172.21.15.31:0/2031125663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd201614f0 0x7fbd201433d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd17e00640 1 -- 172.21.15.31:0/2031125663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd201460b0 con 0x7fbd200d4ab0 2024-09-17T05:36:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd25000640 1 --2- 172.21.15.31:0/2031125663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd201614f0 0x7fbd201433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd17e00640 1 --2- 172.21.15.31:0/2031125663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd200d4ab0 0x7fbd201580f0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800c970 tx=0x7fbd0800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd1cc00640 1 -- 172.21.15.31:0/2031125663 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd08007c70 con 0x7fbd200d4ab0 2024-09-17T05:36:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd1cc00640 1 -- 172.21.15.31:0/2031125663 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd0800f450 con 0x7fbd200d4ab0 2024-09-17T05:36:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd1cc00640 1 -- 172.21.15.31:0/2031125663 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0800f8a0 con 0x7fbd200d4ab0 2024-09-17T05:36:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd27000640 1 -- 172.21.15.31:0/2031125663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd20157610 con 0x7fbd200d4ab0 2024-09-17T05:36:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd27000640 1 -- 172.21.15.31:0/2031125663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd20157bd0 con 0x7fbd200d4ab0 2024-09-17T05:36:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd27000640 1 -- 172.21.15.31:0/2031125663 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd200d29e0 con 0x7fbd200d4ab0 2024-09-17T05:36:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.396+0000 7fbd1cc00640 1 -- 172.21.15.31:0/2031125663 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7fbd0800fa40 con 0x7fbd200d4ab0 2024-09-17T05:36:34.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.400+0000 7fbd1cc00640 1 --2- 172.21.15.31:0/2031125663 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbcfc073a70 0x7fbcfc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:34.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.400+0000 7fbd1cc00640 1 -- 172.21.15.31:0/2031125663 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fbd08095d50 con 0x7fbd200d4ab0 2024-09-17T05:36:34.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.400+0000 7fbd1fe00640 1 --2- 172.21.15.31:0/2031125663 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbcfc073a70 0x7fbcfc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:34.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.400+0000 7fbd1fe00640 1 --2- 172.21.15.31:0/2031125663 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbcfc073a70 0x7fbcfc075f30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbd200cccf0 tx=0x7fbd10009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:34.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.404+0000 7fbd1cc00640 1 -- 172.21.15.31:0/2031125663 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fbd08014030 con 0x7fbd200d4ab0 2024-09-17T05:36:34.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.604+0000 7fbd27000640 1 -- 172.21.15.31:0/2031125663 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol93830", "target": ["mon-mgr", ""]}) -- 0x7fbd20146390 con 0x7fbcfc073a70 2024-09-17T05:36:34.613 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:34.612+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:34.613 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:34.612+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:34.613 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:34.612+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:34.614 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:34.612+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:34.614 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:34.612+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:34.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.660+0000 7fbd1cc00640 1 -- 172.21.15.31:0/2031125663 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7fbd20146390 con 0x7fbcfc073a70 2024-09-17T05:36:34.665 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/_nogroup/subvol93830/985c4d3e-a300-4e85-9488-b5b1b8fec5c7 2024-09-17T05:36:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.664+0000 7fbd27000640 1 -- 172.21.15.31:0/2031125663 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbcfc073a70 msgr2=0x7fbcfc075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.664+0000 7fbd27000640 1 --2- 172.21.15.31:0/2031125663 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbcfc073a70 0x7fbcfc075f30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbd200cccf0 tx=0x7fbd10009040 comp rx=0 tx=0).stop 2024-09-17T05:36:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.664+0000 7fbd27000640 1 -- 172.21.15.31:0/2031125663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd200d4ab0 msgr2=0x7fbd201580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.664+0000 7fbd27000640 1 --2- 172.21.15.31:0/2031125663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd200d4ab0 0x7fbd201580f0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800c970 tx=0x7fbd0800ce30 comp rx=0 tx=0).stop 2024-09-17T05:36:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.664+0000 7fbd27000640 1 -- 172.21.15.31:0/2031125663 shutdown_connections 2024-09-17T05:36:34.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.664+0000 7fbd27000640 1 --2- 172.21.15.31:0/2031125663 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbcfc073a70 0x7fbcfc075f30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.664+0000 7fbd27000640 1 --2- 172.21.15.31:0/2031125663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd201614f0 0x7fbd201433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.664+0000 7fbd27000640 1 --2- 172.21.15.31:0/2031125663 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd200d4ab0 0x7fbd201580f0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.664+0000 7fbd27000640 1 --2- 172.21.15.31:0/2031125663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd200d2570 0x7fbd201600d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.664+0000 7fbd27000640 1 -- 172.21.15.31:0/2031125663 >> 172.21.15.31:0/2031125663 conn(0x7fbd200d3f90 msgr2=0x7fbd2015ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.664+0000 7fbd27000640 1 -- 172.21.15.31:0/2031125663 shutdown_connections 2024-09-17T05:36:34.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.664+0000 7fbd27000640 1 -- 172.21.15.31:0/2031125663 wait complete. 2024-09-17T05:36:34.686 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol56731 subvol_grp6480 2024-09-17T05:36:34.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.836+0000 7fc801a00640 1 -- 172.21.15.31:0/1688917093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7fc0b3410 msgr2=0x7fc7fc0cfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.836+0000 7fc801a00640 1 --2- 172.21.15.31:0/1688917093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7fc0b3410 0x7fc7fc0cfdf0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009900 tx=0x7fc7e401c8e0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.836+0000 7fc801a00640 1 -- 172.21.15.31:0/1688917093 shutdown_connections 2024-09-17T05:36:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.836+0000 7fc801a00640 1 --2- 172.21.15.31:0/1688917093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7fc0b3410 0x7fc7fc0cfdf0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.836+0000 7fc801a00640 1 --2- 172.21.15.31:0/1688917093 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7fc15f600 0x7fc7fc0b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.836+0000 7fc801a00640 1 -- 172.21.15.31:0/1688917093 >> 172.21.15.31:0/1688917093 conn(0x7fc7fc0d1e80 msgr2=0x7fc7fc0d2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.836+0000 7fc801a00640 1 -- 172.21.15.31:0/1688917093 shutdown_connections 2024-09-17T05:36:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.836+0000 7fc801a00640 1 -- 172.21.15.31:0/1688917093 wait complete. 2024-09-17T05:36:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.836+0000 7fc801a00640 1 Processor -- start 2024-09-17T05:36:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.836+0000 7fc801a00640 1 -- start start 2024-09-17T05:36:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc801a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7fc0b3410 0x7fc7fc1411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc801a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7fc0d0330 0x7fc7fc156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc801a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7fc15f600 0x7fc7fc157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc801a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc7fc168dc0 con 0x7fc7fc0b3410 2024-09-17T05:36:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc801a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc7fc168c40 con 0x7fc7fc0d0330 2024-09-17T05:36:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc801a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc7fc168f40 con 0x7fc7fc15f600 2024-09-17T05:36:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc7faa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7fc0b3410 0x7fc7fc1411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc7faa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7fc0b3410 0x7fc7fc1411a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49780/0 (socket says 172.21.15.31:49780) 2024-09-17T05:36:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc7faa00640 1 -- 172.21.15.31:0/2121336782 learned_addr learned my addr 172.21.15.31:0/2121336782 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:34.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc7f3e00640 1 --2- 172.21.15.31:0/2121336782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7fc0d0330 0x7fc7fc156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc7fb400640 1 --2- 172.21.15.31:0/2121336782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7fc15f600 0x7fc7fc157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc7faa00640 1 -- 172.21.15.31:0/2121336782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7fc15f600 msgr2=0x7fc7fc157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc7faa00640 1 --2- 172.21.15.31:0/2121336782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7fc15f600 0x7fc7fc157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc7faa00640 1 -- 172.21.15.31:0/2121336782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7fc0d0330 msgr2=0x7fc7fc156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc7faa00640 1 --2- 172.21.15.31:0/2121336782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7fc0d0330 0x7fc7fc156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc7faa00640 1 -- 172.21.15.31:0/2121336782 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7fc1416e0 con 0x7fc7fc0b3410 2024-09-17T05:36:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc7f3e00640 1 --2- 172.21.15.31:0/2121336782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7fc0d0330 0x7fc7fc156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc7faa00640 1 --2- 172.21.15.31:0/2121336782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7fc0b3410 0x7fc7fc1411a0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00e7d0 tx=0x7fc7ec00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc7f2a00640 1 -- 172.21.15.31:0/2121336782 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec00ccc0 con 0x7fc7fc0b3410 2024-09-17T05:36:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc7f2a00640 1 -- 172.21.15.31:0/2121336782 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7ec010430 con 0x7fc7fc0b3410 2024-09-17T05:36:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc7f2a00640 1 -- 172.21.15.31:0/2121336782 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec010860 con 0x7fc7fc0b3410 2024-09-17T05:36:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc801a00640 1 -- 172.21.15.31:0/2121336782 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7fc14fe70 con 0x7fc7fc0b3410 2024-09-17T05:36:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc801a00640 1 -- 172.21.15.31:0/2121336782 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7fc154870 con 0x7fc7fc0b3410 2024-09-17T05:36:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc801a00640 1 -- 172.21.15.31:0/2121336782 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7fc0cfdf0 con 0x7fc7fc0b3410 2024-09-17T05:36:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.840+0000 7fc7f2a00640 1 -- 172.21.15.31:0/2121336782 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7fc7ec010a00 con 0x7fc7fc0b3410 2024-09-17T05:36:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.844+0000 7fc7f2a00640 1 --2- 172.21.15.31:0/2121336782 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc7d8073a70 0x7fc7d8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.844+0000 7fc7f2a00640 1 -- 172.21.15.31:0/2121336782 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fc7ec095ed0 con 0x7fc7fc0b3410 2024-09-17T05:36:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.844+0000 7fc7f3e00640 1 --2- 172.21.15.31:0/2121336782 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc7d8073a70 0x7fc7d8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.844+0000 7fc7f3e00640 1 --2- 172.21.15.31:0/2121336782 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc7d8073a70 0x7fc7d8075f30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40af000 tx=0x7fc7e401b120 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:34.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:34.848+0000 7fc7f2a00640 1 -- 172.21.15.31:0/2121336782 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc7ec05ffc0 con 0x7fc7fc0b3410 2024-09-17T05:36:35.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.056+0000 7fc801a00640 1 -- 172.21.15.31:0/2121336782 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol56731", "group_name": "subvol_grp6480", "target": ["mon-mgr", ""]}) -- 0x7fc7fc0cef60 con 0x7fc7d8073a70 2024-09-17T05:36:35.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.108+0000 7fc7f2a00640 1 -- 172.21.15.31:0/2121336782 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+73 (secure 0 0 0) 0x7fc7fc0cef60 con 0x7fc7d8073a70 2024-09-17T05:36:35.111 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/subvol_grp6480/subvol56731/d96724db-84a3-4d04-8766-9f115c525ab2 2024-09-17T05:36:35.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.112+0000 7fc801a00640 1 -- 172.21.15.31:0/2121336782 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc7d8073a70 msgr2=0x7fc7d8075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.112+0000 7fc801a00640 1 --2- 172.21.15.31:0/2121336782 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc7d8073a70 0x7fc7d8075f30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40af000 tx=0x7fc7e401b120 comp rx=0 tx=0).stop 2024-09-17T05:36:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.112+0000 7fc801a00640 1 -- 172.21.15.31:0/2121336782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7fc0b3410 msgr2=0x7fc7fc1411a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.112+0000 7fc801a00640 1 --2- 172.21.15.31:0/2121336782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7fc0b3410 0x7fc7fc1411a0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00e7d0 tx=0x7fc7ec00ec90 comp rx=0 tx=0).stop 2024-09-17T05:36:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.112+0000 7fc801a00640 1 -- 172.21.15.31:0/2121336782 shutdown_connections 2024-09-17T05:36:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.112+0000 7fc801a00640 1 --2- 172.21.15.31:0/2121336782 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc7d8073a70 0x7fc7d8075f30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.112+0000 7fc801a00640 1 --2- 172.21.15.31:0/2121336782 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc7fc15f600 0x7fc7fc157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.112+0000 7fc801a00640 1 --2- 172.21.15.31:0/2121336782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7fc0d0330 0x7fc7fc156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.112+0000 7fc801a00640 1 --2- 172.21.15.31:0/2121336782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7fc0b3410 0x7fc7fc1411a0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.112+0000 7fc801a00640 1 -- 172.21.15.31:0/2121336782 >> 172.21.15.31:0/2121336782 conn(0x7fc7fc0d1e80 msgr2=0x7fc7fc0ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:35.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.112+0000 7fc801a00640 1 -- 172.21.15.31:0/2121336782 shutdown_connections 2024-09-17T05:36:35.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.112+0000 7fc801a00640 1 -- 172.21.15.31:0/2121336782 wait complete. 2024-09-17T05:36:35.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:35.132 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol93830/.meta) 2024-09-17T05:36:35.153 INFO:teuthology.orchestra.run.smithi031.stdout:[GLOBAL] 2024-09-17T05:36:35.154 INFO:teuthology.orchestra.run.smithi031.stdout:version = 2 2024-09-17T05:36:35.154 INFO:teuthology.orchestra.run.smithi031.stdout:type = subvolume 2024-09-17T05:36:35.154 INFO:teuthology.orchestra.run.smithi031.stdout:path = /volumes/_nogroup/subvol93830/985c4d3e-a300-4e85-9488-b5b1b8fec5c7 2024-09-17T05:36:35.154 INFO:teuthology.orchestra.run.smithi031.stdout:state = complete 2024-09-17T05:36:35.154 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:35.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:35.156 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/subvol_grp6480/subvol56731/.meta) 2024-09-17T05:36:35.215 INFO:teuthology.orchestra.run.smithi031.stdout:[GLOBAL] 2024-09-17T05:36:35.215 INFO:teuthology.orchestra.run.smithi031.stdout:version = 2 2024-09-17T05:36:35.216 INFO:teuthology.orchestra.run.smithi031.stdout:type = subvolume 2024-09-17T05:36:35.216 INFO:teuthology.orchestra.run.smithi031.stdout:path = /volumes/subvol_grp6480/subvol56731/d96724db-84a3-4d04-8766-9f115c525ab2 2024-09-17T05:36:35.216 INFO:teuthology.orchestra.run.smithi031.stdout:state = complete 2024-09-17T05:36:35.216 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:35.218 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol93830 2024-09-17T05:36:35.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.412+0000 7f7c52000640 1 -- 172.21.15.31:0/1212477987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c30004d50 msgr2=0x7f7c300051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.412+0000 7f7c52000640 1 --2- 172.21.15.31:0/1212477987 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c30004d50 0x7f7c300051d0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009ee0 tx=0x7f7c4401d630 comp rx=0 tx=0).stop 2024-09-17T05:36:35.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.412+0000 7f7c4be00640 1 -- 172.21.15.31:0/1212477987 reap_dead start 2024-09-17T05:36:35.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.412+0000 7f7c52000640 1 -- 172.21.15.31:0/1212477987 shutdown_connections 2024-09-17T05:36:35.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.412+0000 7f7c52000640 1 -- 172.21.15.31:0/1212477987 >> 172.21.15.31:0/1212477987 conn(0x7f7c4c0d1dd0 msgr2=0x7f7c4c0d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:35.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.412+0000 7f7c52000640 1 -- 172.21.15.31:0/1212477987 shutdown_connections 2024-09-17T05:36:35.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.412+0000 7f7c52000640 1 -- 172.21.15.31:0/1212477987 wait complete. 2024-09-17T05:36:35.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.412+0000 7f7c52000640 1 Processor -- start 2024-09-17T05:36:35.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.412+0000 7f7c52000640 1 -- start start 2024-09-17T05:36:35.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.412+0000 7f7c52000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c30004d50 0x7f7c4c0c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.412+0000 7f7c52000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c4c1f2db0 0x7f7c4c0c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.412+0000 7f7c52000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4c158c00 0x7f7c4c159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.412+0000 7f7c52000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c0b0e50 con 0x7f7c4c158c00 2024-09-17T05:36:35.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.412+0000 7f7c52000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c0b0cd0 con 0x7f7c4c1f2db0 2024-09-17T05:36:35.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.412+0000 7f7c52000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7c4c0b1220 con 0x7f7c30004d50 2024-09-17T05:36:35.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.412+0000 7f7c4be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4c158c00 0x7f7c4c159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c4be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4c158c00 0x7f7c4c159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49802/0 (socket says 172.21.15.31:49802) 2024-09-17T05:36:35.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c4be00640 1 -- 172.21.15.31:0/1047732309 learned_addr learned my addr 172.21.15.31:0/1047732309 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:35.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c43e00640 1 --2- 172.21.15.31:0/1047732309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c4c1f2db0 0x7f7c4c0c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c4b400640 1 --2- 172.21.15.31:0/1047732309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c30004d50 0x7f7c4c0c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c4be00640 1 -- 172.21.15.31:0/1047732309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c30004d50 msgr2=0x7f7c4c0c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c4be00640 1 --2- 172.21.15.31:0/1047732309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c30004d50 0x7f7c4c0c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c4be00640 1 -- 172.21.15.31:0/1047732309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c4c1f2db0 msgr2=0x7f7c4c0c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c4be00640 1 --2- 172.21.15.31:0/1047732309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c4c1f2db0 0x7f7c4c0c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c4be00640 1 -- 172.21.15.31:0/1047732309 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c0c69a0 con 0x7f7c4c158c00 2024-09-17T05:36:35.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c4b400640 1 --2- 172.21.15.31:0/1047732309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c30004d50 0x7f7c4c0c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:35.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c4be00640 1 --2- 172.21.15.31:0/1047732309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4c158c00 0x7f7c4c159080 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009ee0 tx=0x7f7c44004f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c43400640 1 -- 172.21.15.31:0/1047732309 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c440ad050 con 0x7f7c4c158c00 2024-09-17T05:36:35.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c43400640 1 -- 172.21.15.31:0/1047732309 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c440a7ad0 con 0x7f7c4c158c00 2024-09-17T05:36:35.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c43400640 1 -- 172.21.15.31:0/1047732309 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c009730 con 0x7f7c4c158c00 2024-09-17T05:36:35.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c52000640 1 -- 172.21.15.31:0/1047732309 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4c0cbcf0 con 0x7f7c4c158c00 2024-09-17T05:36:35.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c52000640 1 -- 172.21.15.31:0/1047732309 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4c0cbf90 con 0x7f7c4c158c00 2024-09-17T05:36:35.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c52000640 1 -- 172.21.15.31:0/1047732309 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4c0d0690 con 0x7f7c4c158c00 2024-09-17T05:36:35.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c43400640 1 -- 172.21.15.31:0/1047732309 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f7c440b0070 con 0x7f7c4c158c00 2024-09-17T05:36:35.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.416+0000 7f7c43400640 1 --2- 172.21.15.31:0/1047732309 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7c28073a70 0x7f7c28075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.420+0000 7f7c43400640 1 -- 172.21.15.31:0/1047732309 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f7c4412fd20 con 0x7f7c4c158c00 2024-09-17T05:36:35.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.420+0000 7f7c4b400640 1 --2- 172.21.15.31:0/1047732309 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7c28073a70 0x7f7c28075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.420+0000 7f7c4b400640 1 --2- 172.21.15.31:0/1047732309 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7c28073a70 0x7f7c28075f30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009d00 tx=0x7f7c3c0091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.420+0000 7f7c43400640 1 -- 172.21.15.31:0/1047732309 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7c44017340 con 0x7f7c4c158c00 2024-09-17T05:36:35.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.624+0000 7f7c52000640 1 -- 172.21.15.31:0/1047732309 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol93830", "target": ["mon-mgr", ""]}) -- 0x7f7c4c0d1080 con 0x7f7c28073a70 2024-09-17T05:36:35.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.636+0000 7f7c43400640 1 -- 172.21.15.31:0/1047732309 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7c4c0d1080 con 0x7f7c28073a70 2024-09-17T05:36:35.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.636+0000 7f7c52000640 1 -- 172.21.15.31:0/1047732309 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7c28073a70 msgr2=0x7f7c28075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.636+0000 7f7c52000640 1 --2- 172.21.15.31:0/1047732309 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7c28073a70 0x7f7c28075f30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009d00 tx=0x7f7c3c0091e0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.636+0000 7f7c52000640 1 -- 172.21.15.31:0/1047732309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4c158c00 msgr2=0x7f7c4c159080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.636+0000 7f7c52000640 1 --2- 172.21.15.31:0/1047732309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4c158c00 0x7f7c4c159080 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009ee0 tx=0x7f7c44004f50 comp rx=0 tx=0).stop 2024-09-17T05:36:35.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.636+0000 7f7c52000640 1 -- 172.21.15.31:0/1047732309 shutdown_connections 2024-09-17T05:36:35.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.636+0000 7f7c52000640 1 --2- 172.21.15.31:0/1047732309 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7c28073a70 0x7f7c28075f30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.636+0000 7f7c52000640 1 --2- 172.21.15.31:0/1047732309 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c4c158c00 0x7f7c4c159080 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.636+0000 7f7c52000640 1 --2- 172.21.15.31:0/1047732309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c4c1f2db0 0x7f7c4c0c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.636+0000 7f7c52000640 1 --2- 172.21.15.31:0/1047732309 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7c30004d50 0x7f7c4c0c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.636+0000 7f7c52000640 1 -- 172.21.15.31:0/1047732309 >> 172.21.15.31:0/1047732309 conn(0x7f7c4c0d1dd0 msgr2=0x7f7c4c0cc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:35.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.636+0000 7f7c52000640 1 -- 172.21.15.31:0/1047732309 shutdown_connections 2024-09-17T05:36:35.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.636+0000 7f7c52000640 1 -- 172.21.15.31:0/1047732309 wait complete. 2024-09-17T05:36:35.643 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:35.640+0000 7f46f9600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:35.643 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:35.640+0000 7f46f9600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:35.644 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:35.640+0000 7f46f9600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:35.644 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:35.640+0000 7f46f9600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:35.644 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:35.640+0000 7f46f9600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:35.660 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:35.656+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:35.661 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:35.656+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:35.661 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:35.656+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:35.661 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:35.656+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:35.661 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:36:35.656+0000 7f46faa00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:36:35.666 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol56731 subvol_grp6480 2024-09-17T05:36:35.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.816+0000 7fcd7fe00640 1 -- 172.21.15.31:0/2843455244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd800d24d0 msgr2=0x7fcd800d2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.816+0000 7fcd7fe00640 1 --2- 172.21.15.31:0/2843455244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd800d24d0 0x7fcd800d2980 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009c80 tx=0x7fcd7801cd10 comp rx=0 tx=0).stop 2024-09-17T05:36:35.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.816+0000 7fcd7fe00640 1 -- 172.21.15.31:0/2843455244 shutdown_connections 2024-09-17T05:36:35.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.816+0000 7fcd7fe00640 1 --2- 172.21.15.31:0/2843455244 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd800d24d0 0x7fcd800d2980 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.816+0000 7fcd7fe00640 1 --2- 172.21.15.31:0/2843455244 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd800d1ae0 0x7fcd800d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.816+0000 7fcd7fe00640 1 -- 172.21.15.31:0/2843455244 >> 172.21.15.31:0/2843455244 conn(0x7fcd800d3f10 msgr2=0x7fcd800d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:35.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.816+0000 7fcd7fe00640 1 -- 172.21.15.31:0/2843455244 shutdown_connections 2024-09-17T05:36:35.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.816+0000 7fcd7fe00640 1 -- 172.21.15.31:0/2843455244 wait complete. 2024-09-17T05:36:35.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.816+0000 7fcd7fe00640 1 Processor -- start 2024-09-17T05:36:35.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.816+0000 7fcd7fe00640 1 -- start start 2024-09-17T05:36:35.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd800d1ae0 0x7fcd800b9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd800d24d0 0x7fcd8015be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7fe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd8015dff0 0x7fcd801f7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7fe00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8016b030 con 0x7fcd800d1ae0 2024-09-17T05:36:35.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7fe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8016aeb0 con 0x7fcd8015dff0 2024-09-17T05:36:35.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7fe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcd8016b1b0 con 0x7fcd800d24d0 2024-09-17T05:36:35.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd800d1ae0 0x7fcd800b9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd800d1ae0 0x7fcd800b9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49866/0 (socket says 172.21.15.31:49866) 2024-09-17T05:36:35.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7ea00640 1 -- 172.21.15.31:0/978601834 learned_addr learned my addr 172.21.15.31:0/978601834 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:35.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7f400640 1 --2- 172.21.15.31:0/978601834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd8015dff0 0x7fcd801f7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd77e00640 1 --2- 172.21.15.31:0/978601834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd800d24d0 0x7fcd8015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7ea00640 1 -- 172.21.15.31:0/978601834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd800d24d0 msgr2=0x7fcd8015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7ea00640 1 --2- 172.21.15.31:0/978601834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd800d24d0 0x7fcd8015be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7ea00640 1 -- 172.21.15.31:0/978601834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd8015dff0 msgr2=0x7fcd801f7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:35.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7ea00640 1 --2- 172.21.15.31:0/978601834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd8015dff0 0x7fcd801f7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:35.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7ea00640 1 -- 172.21.15.31:0/978601834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8015c3b0 con 0x7fcd800d1ae0 2024-09-17T05:36:35.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7ea00640 1 --2- 172.21.15.31:0/978601834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd800d1ae0 0x7fcd800b9820 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000b410 tx=0x7fcd7000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd77400640 1 -- 172.21.15.31:0/978601834 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd70015030 con 0x7fcd800d1ae0 2024-09-17T05:36:35.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd77400640 1 -- 172.21.15.31:0/978601834 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd70004020 con 0x7fcd800d1ae0 2024-09-17T05:36:35.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd77400640 1 -- 172.21.15.31:0/978601834 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd700044b0 con 0x7fcd800d1ae0 2024-09-17T05:36:35.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7fe00640 1 -- 172.21.15.31:0/978601834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8014dcb0 con 0x7fcd800d1ae0 2024-09-17T05:36:35.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7fe00640 1 -- 172.21.15.31:0/978601834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd800b6f90 con 0x7fcd800d1ae0 2024-09-17T05:36:35.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.820+0000 7fcd7fe00640 1 -- 172.21.15.31:0/978601834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd800d1260 con 0x7fcd800d1ae0 2024-09-17T05:36:35.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.824+0000 7fcd77400640 1 -- 172.21.15.31:0/978601834 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7fcd70018070 con 0x7fcd800d1ae0 2024-09-17T05:36:35.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.824+0000 7fcd77400640 1 --2- 172.21.15.31:0/978601834 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcd5c073aa0 0x7fcd5c075f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:35.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.824+0000 7fcd77400640 1 -- 172.21.15.31:0/978601834 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fcd70095260 con 0x7fcd800d1ae0 2024-09-17T05:36:35.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.824+0000 7fcd77e00640 1 --2- 172.21.15.31:0/978601834 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcd5c073aa0 0x7fcd5c075f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:35.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.824+0000 7fcd77e00640 1 --2- 172.21.15.31:0/978601834 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcd5c073aa0 0x7fcd5c075f60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcd68005fd0 tx=0x7fcd68005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:35.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:35.824+0000 7fcd77400640 1 -- 172.21.15.31:0/978601834 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fcd7005f3d0 con 0x7fcd800d1ae0 2024-09-17T05:36:36.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.028+0000 7fcd7fe00640 1 -- 172.21.15.31:0/978601834 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol56731", "group_name": "subvol_grp6480", "target": ["mon-mgr", ""]}) -- 0x7fcd80069e60 con 0x7fcd5c073aa0 2024-09-17T05:36:36.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.044+0000 7fcd77400640 1 -- 172.21.15.31:0/978601834 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcd6800a310 con 0x7fcd5c073aa0 2024-09-17T05:36:36.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.044+0000 7fcd7fe00640 1 -- 172.21.15.31:0/978601834 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcd5c073aa0 msgr2=0x7fcd5c075f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.044+0000 7fcd7fe00640 1 --2- 172.21.15.31:0/978601834 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcd5c073aa0 0x7fcd5c075f60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcd68005fd0 tx=0x7fcd68005860 comp rx=0 tx=0).stop 2024-09-17T05:36:36.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.044+0000 7fcd7fe00640 1 -- 172.21.15.31:0/978601834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd800d1ae0 msgr2=0x7fcd800b9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.044+0000 7fcd7fe00640 1 --2- 172.21.15.31:0/978601834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd800d1ae0 0x7fcd800b9820 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000b410 tx=0x7fcd7000b8d0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.044+0000 7fcd7fe00640 1 -- 172.21.15.31:0/978601834 shutdown_connections 2024-09-17T05:36:36.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.044+0000 7fcd7fe00640 1 --2- 172.21.15.31:0/978601834 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcd5c073aa0 0x7fcd5c075f60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.044+0000 7fcd7fe00640 1 --2- 172.21.15.31:0/978601834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd8015dff0 0x7fcd801f7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.044+0000 7fcd7fe00640 1 --2- 172.21.15.31:0/978601834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd800d24d0 0x7fcd8015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.044+0000 7fcd7fe00640 1 --2- 172.21.15.31:0/978601834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd800d1ae0 0x7fcd800b9820 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.044+0000 7fcd7fe00640 1 -- 172.21.15.31:0/978601834 >> 172.21.15.31:0/978601834 conn(0x7fcd800d3f10 msgr2=0x7fcd8015b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.044+0000 7fcd7fe00640 1 -- 172.21.15.31:0/978601834 shutdown_connections 2024-09-17T05:36:36.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.044+0000 7fcd7fe00640 1 -- 172.21.15.31:0/978601834 wait complete. 2024-09-17T05:36:36.071 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:36:36.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:36:36.127 INFO:teuthology.orchestra.run.smithi031.stdout:2 2024-09-17T05:36:36.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:36.134 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:36:36.134 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:36:36.275 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:36:36.367 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:36:36.367 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:36:36.367 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:36:36.368 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:36.376 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:36:36.376 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:36.429 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:36:36.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.616+0000 7f855c200640 1 -- 172.21.15.31:0/491955514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f855415f9a0 msgr2=0x7f855406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.616+0000 7f855c200640 1 --2- 172.21.15.31:0/491955514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f855415f9a0 0x7f855406e7a0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f8548009840 tx=0x7f854801c7f0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.616+0000 7f855c200640 1 -- 172.21.15.31:0/491955514 shutdown_connections 2024-09-17T05:36:36.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.616+0000 7f855c200640 1 --2- 172.21.15.31:0/491955514 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8554160490 0x7f85540ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.616+0000 7f855c200640 1 --2- 172.21.15.31:0/491955514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f855415f9a0 0x7f855406e7a0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.616+0000 7f855c200640 1 -- 172.21.15.31:0/491955514 >> 172.21.15.31:0/491955514 conn(0x7f85540b18f0 msgr2=0x7f85540b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.616+0000 7f855c200640 1 -- 172.21.15.31:0/491955514 shutdown_connections 2024-09-17T05:36:36.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.616+0000 7f855c200640 1 -- 172.21.15.31:0/491955514 wait complete. 2024-09-17T05:36:36.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855c200640 1 Processor -- start 2024-09-17T05:36:36.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855c200640 1 -- start start 2024-09-17T05:36:36.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855c200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85540cf1d0 0x7f8554141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855c200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f855415f9a0 0x7f855415e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855c200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8554160490 0x7f85541426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855c200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f85541691a0 con 0x7f8554160490 2024-09-17T05:36:36.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855c200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8554169020 con 0x7f85540cf1d0 2024-09-17T05:36:36.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855c200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8554169320 con 0x7f855415f9a0 2024-09-17T05:36:36.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855a200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8554160490 0x7f85541426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855a200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8554160490 0x7f85541426d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49884/0 (socket says 172.21.15.31:49884) 2024-09-17T05:36:36.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855a200640 1 -- 172.21.15.31:0/2571589462 learned_addr learned my addr 172.21.15.31:0/2571589462 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:36.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f8559800640 1 --2- 172.21.15.31:0/2571589462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85540cf1d0 0x7f8554141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f8558e00640 1 --2- 172.21.15.31:0/2571589462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f855415f9a0 0x7f855415e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855a200640 1 -- 172.21.15.31:0/2571589462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f855415f9a0 msgr2=0x7f855415e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855a200640 1 --2- 172.21.15.31:0/2571589462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f855415f9a0 0x7f855415e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855a200640 1 -- 172.21.15.31:0/2571589462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85540cf1d0 msgr2=0x7f8554141f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855a200640 1 --2- 172.21.15.31:0/2571589462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85540cf1d0 0x7f8554141f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855a200640 1 -- 172.21.15.31:0/2571589462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855415edb0 con 0x7f8554160490 2024-09-17T05:36:36.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f8559800640 1 --2- 172.21.15.31:0/2571589462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85540cf1d0 0x7f8554141f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:36.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855a200640 1 --2- 172.21.15.31:0/2571589462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8554160490 0x7f85541426d0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f854c00e970 tx=0x7f854c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:36.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f8551600640 1 -- 172.21.15.31:0/2571589462 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c004d30 con 0x7f8554160490 2024-09-17T05:36:36.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f8551600640 1 -- 172.21.15.31:0/2571589462 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f854c00cac0 con 0x7f8554160490 2024-09-17T05:36:36.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f8551600640 1 -- 172.21.15.31:0/2571589462 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854c005020 con 0x7f8554160490 2024-09-17T05:36:36.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855c200640 1 -- 172.21.15.31:0/2571589462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f855415f090 con 0x7f8554160490 2024-09-17T05:36:36.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.620+0000 7f855c200640 1 -- 172.21.15.31:0/2571589462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f855409cc60 con 0x7f8554160490 2024-09-17T05:36:36.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.624+0000 7f855c200640 1 -- 172.21.15.31:0/2571589462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f855406e7a0 con 0x7f8554160490 2024-09-17T05:36:36.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.624+0000 7f8551600640 1 -- 172.21.15.31:0/2571589462 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 25) ==== 97999+0+0 (secure 0 0 0) 0x7f854c0051c0 con 0x7f8554160490 2024-09-17T05:36:36.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.624+0000 7f8551600640 1 --2- 172.21.15.31:0/2571589462 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8534073a70 0x7f8534075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:36.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.624+0000 7f8551600640 1 -- 172.21.15.31:0/2571589462 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f854c095e50 con 0x7f8554160490 2024-09-17T05:36:36.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.624+0000 7f8559800640 1 --2- 172.21.15.31:0/2571589462 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8534073a70 0x7f8534075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:36.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.624+0000 7f8559800640 1 --2- 172.21.15.31:0/2571589462 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8534073a70 0x7f8534075f30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f85480af000 tx=0x7f8548019590 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:36.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.628+0000 7f8551600640 1 -- 172.21.15.31:0/2571589462 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f854c016030 con 0x7f8554160490 2024-09-17T05:36:36.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.816+0000 7f855c200640 1 -- 172.21.15.31:0/2571589462 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8554070a60 con 0x7f8554160490 2024-09-17T05:36:36.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.816+0000 7f8551600640 1 -- 172.21.15.31:0/2571589462 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v152) ==== 80+0+0 (secure 0 0 0) 0x7f854c05feb0 con 0x7f8554160490 2024-09-17T05:36:36.819 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:36:36.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.820+0000 7f855c200640 1 -- 172.21.15.31:0/2571589462 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8534073a70 msgr2=0x7f8534075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.820+0000 7f855c200640 1 --2- 172.21.15.31:0/2571589462 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8534073a70 0x7f8534075f30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f85480af000 tx=0x7f8548019590 comp rx=0 tx=0).stop 2024-09-17T05:36:36.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.820+0000 7f855c200640 1 -- 172.21.15.31:0/2571589462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8554160490 msgr2=0x7f85541426d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:36.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.820+0000 7f855c200640 1 --2- 172.21.15.31:0/2571589462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8554160490 0x7f85541426d0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f854c00e970 tx=0x7f854c00ee30 comp rx=0 tx=0).stop 2024-09-17T05:36:36.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.820+0000 7f855c200640 1 -- 172.21.15.31:0/2571589462 shutdown_connections 2024-09-17T05:36:36.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.820+0000 7f855c200640 1 --2- 172.21.15.31:0/2571589462 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8534073a70 0x7f8534075f30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.820+0000 7f855c200640 1 --2- 172.21.15.31:0/2571589462 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8554160490 0x7f85541426d0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.820+0000 7f855c200640 1 --2- 172.21.15.31:0/2571589462 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f855415f9a0 0x7f855415e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.820+0000 7f855c200640 1 --2- 172.21.15.31:0/2571589462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85540cf1d0 0x7f8554141f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:36.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.820+0000 7f855c200640 1 -- 172.21.15.31:0/2571589462 >> 172.21.15.31:0/2571589462 conn(0x7f85540b18f0 msgr2=0x7f8554166230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:36.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.820+0000 7f855c200640 1 -- 172.21.15.31:0/2571589462 shutdown_connections 2024-09-17T05:36:36.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:36.820+0000 7f855c200640 1 -- 172.21.15.31:0/2571589462 wait complete. 2024-09-17T05:36:36.841 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:36:36.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:36.841 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:36:36.891 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:36:36.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:36.891 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:36:36.912 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:36:36.912 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:36:36.912 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:36.926 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:36:36.926 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:36.982 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:36:37.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.128+0000 7f9c36000640 1 -- 172.21.15.31:0/2558224853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c300b4a50 msgr2=0x7f9c300acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.128+0000 7f9c36000640 1 --2- 172.21.15.31:0/2558224853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c300b4a50 0x7f9c300acd40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00a980 tx=0x7f9c1c01db00 comp rx=0 tx=0).stop 2024-09-17T05:36:37.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.128+0000 7f9c36000640 1 -- 172.21.15.31:0/2558224853 shutdown_connections 2024-09-17T05:36:37.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.128+0000 7f9c36000640 1 --2- 172.21.15.31:0/2558224853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c300b4a50 0x7f9c300acd40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.128+0000 7f9c36000640 1 -- 172.21.15.31:0/2558224853 >> 172.21.15.31:0/2558224853 conn(0x7f9c300b18f0 msgr2=0x7f9c300b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:37.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.128+0000 7f9c36000640 1 -- 172.21.15.31:0/2558224853 shutdown_connections 2024-09-17T05:36:37.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.128+0000 7f9c36000640 1 -- 172.21.15.31:0/2558224853 wait complete. 2024-09-17T05:36:37.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c36000640 1 Processor -- start 2024-09-17T05:36:37.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c36000640 1 -- start start 2024-09-17T05:36:37.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c36000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c300b4a50 0x7f9c30152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c36000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c300cd100 0x7f9c300acf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c36000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c3015db50 0x7f9c300ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c36000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9c30168130 con 0x7f9c3015db50 2024-09-17T05:36:37.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c36000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9c300cccd0 con 0x7f9c300cd100 2024-09-17T05:36:37.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c36000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9c301682b0 con 0x7f9c300b4a50 2024-09-17T05:36:37.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c2fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c3015db50 0x7f9c300ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c2fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c3015db50 0x7f9c300ad490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49896/0 (socket says 172.21.15.31:49896) 2024-09-17T05:36:37.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c2fe00640 1 -- 172.21.15.31:0/4042835629 learned_addr learned my addr 172.21.15.31:0/4042835629 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:37.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c2ea00640 1 --2- 172.21.15.31:0/4042835629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c300cd100 0x7f9c300acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c2f400640 1 --2- 172.21.15.31:0/4042835629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c300b4a50 0x7f9c30152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c2fe00640 1 -- 172.21.15.31:0/4042835629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c300b4a50 msgr2=0x7f9c30152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c2fe00640 1 --2- 172.21.15.31:0/4042835629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c300b4a50 0x7f9c30152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c2fe00640 1 -- 172.21.15.31:0/4042835629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c300cd100 msgr2=0x7f9c300acf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c2fe00640 1 --2- 172.21.15.31:0/4042835629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c300cd100 0x7f9c300acf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c2fe00640 1 -- 172.21.15.31:0/4042835629 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c300b0870 con 0x7f9c3015db50 2024-09-17T05:36:37.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c2fe00640 1 --2- 172.21.15.31:0/4042835629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c3015db50 0x7f9c300ad490 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800cbc0 tx=0x7f9c2800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:37.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c27400640 1 -- 172.21.15.31:0/4042835629 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28016020 con 0x7f9c3015db50 2024-09-17T05:36:37.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c27400640 1 -- 172.21.15.31:0/4042835629 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c2800ab00 con 0x7f9c3015db50 2024-09-17T05:36:37.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c27400640 1 -- 172.21.15.31:0/4042835629 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28012420 con 0x7f9c3015db50 2024-09-17T05:36:37.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c36000640 1 -- 172.21.15.31:0/4042835629 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c300b0b50 con 0x7f9c3015db50 2024-09-17T05:36:37.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c36000640 1 -- 172.21.15.31:0/4042835629 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c300c9ba0 con 0x7f9c3015db50 2024-09-17T05:36:37.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.132+0000 7f9c36000640 1 -- 172.21.15.31:0/4042835629 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c30069410 con 0x7f9c3015db50 2024-09-17T05:36:37.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.136+0000 7f9c27400640 1 -- 172.21.15.31:0/4042835629 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f9c28019020 con 0x7f9c3015db50 2024-09-17T05:36:37.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.136+0000 7f9c27400640 1 --2- 172.21.15.31:0/4042835629 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9c10073c20 0x7f9c100760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.136+0000 7f9c27400640 1 -- 172.21.15.31:0/4042835629 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f9c28093430 con 0x7f9c3015db50 2024-09-17T05:36:37.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.136+0000 7f9c2f400640 1 --2- 172.21.15.31:0/4042835629 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9c10073c20 0x7f9c100760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.136+0000 7f9c2f400640 1 --2- 172.21.15.31:0/4042835629 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9c10073c20 0x7f9c100760e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9c20007fd0 tx=0x7f9c20009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:37.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.140+0000 7f9c27400640 1 -- 172.21.15.31:0/4042835629 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9c28020020 con 0x7f9c3015db50 2024-09-17T05:36:37.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.332+0000 7f9c36000640 1 -- 172.21.15.31:0/4042835629 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9c3015a3d0 con 0x7f9c3015db50 2024-09-17T05:36:37.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.332+0000 7f9c27400640 1 -- 172.21.15.31:0/4042835629 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v152) ==== 80+0+0 (secure 0 0 0) 0x7f9c2805f6c0 con 0x7f9c3015db50 2024-09-17T05:36:37.333 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:36:37.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.332+0000 7f9c36000640 1 -- 172.21.15.31:0/4042835629 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9c10073c20 msgr2=0x7f9c100760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.332+0000 7f9c36000640 1 --2- 172.21.15.31:0/4042835629 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9c10073c20 0x7f9c100760e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9c20007fd0 tx=0x7f9c20009040 comp rx=0 tx=0).stop 2024-09-17T05:36:37.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.332+0000 7f9c36000640 1 -- 172.21.15.31:0/4042835629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c3015db50 msgr2=0x7f9c300ad490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.332+0000 7f9c36000640 1 --2- 172.21.15.31:0/4042835629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c3015db50 0x7f9c300ad490 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800cbc0 tx=0x7f9c2800ccb0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.332+0000 7f9c36000640 1 -- 172.21.15.31:0/4042835629 shutdown_connections 2024-09-17T05:36:37.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.332+0000 7f9c36000640 1 --2- 172.21.15.31:0/4042835629 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9c10073c20 0x7f9c100760e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.332+0000 7f9c36000640 1 --2- 172.21.15.31:0/4042835629 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c3015db50 0x7f9c300ad490 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.332+0000 7f9c36000640 1 --2- 172.21.15.31:0/4042835629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c300cd100 0x7f9c300acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.332+0000 7f9c36000640 1 --2- 172.21.15.31:0/4042835629 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c300b4a50 0x7f9c30152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.332+0000 7f9c36000640 1 -- 172.21.15.31:0/4042835629 >> 172.21.15.31:0/4042835629 conn(0x7f9c300b18f0 msgr2=0x7f9c300ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:37.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.332+0000 7f9c36000640 1 -- 172.21.15.31:0/4042835629 shutdown_connections 2024-09-17T05:36:37.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.332+0000 7f9c36000640 1 -- 172.21.15.31:0/4042835629 wait complete. 2024-09-17T05:36:37.354 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T05:36:37.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:37.355 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T05:36:37.382 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:36:37.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:37.382 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:36:37.433 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:36:37.433 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:36:37.433 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:37.443 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:36:37.443 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:36:37.443 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:36:37.443 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:37.484 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:36:37.485 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:37.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.632+0000 7f964b600640 1 -- 172.21.15.31:0/4061282054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f962c005220 msgr2=0x7f962c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.632+0000 7f964b600640 1 --2- 172.21.15.31:0/4061282054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f962c005220 0x7f962c00b9d0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f963c00c600 tx=0x7f963c01d220 comp rx=0 tx=0).stop 2024-09-17T05:36:37.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.632+0000 7f964b600640 1 -- 172.21.15.31:0/4061282054 shutdown_connections 2024-09-17T05:36:37.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.632+0000 7f964b600640 1 --2- 172.21.15.31:0/4061282054 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f962c005220 0x7f962c00b9d0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.632+0000 7f964b600640 1 -- 172.21.15.31:0/4061282054 >> 172.21.15.31:0/4061282054 conn(0x7f96440d1dc0 msgr2=0x7f96440d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:37.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.632+0000 7f964b600640 1 -- 172.21.15.31:0/4061282054 shutdown_connections 2024-09-17T05:36:37.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.632+0000 7f964b600640 1 -- 172.21.15.31:0/4061282054 wait complete. 2024-09-17T05:36:37.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.632+0000 7f964b600640 1 Processor -- start 2024-09-17T05:36:37.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f964b600640 1 -- start start 2024-09-17T05:36:37.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f964b600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f962c005220 0x7f96440cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f964b600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96440b4ee0 0x7f96440b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f964b600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f964415df80 0x7f964415e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f964b600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f96440d2a60 con 0x7f96440b4ee0 2024-09-17T05:36:37.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f964b600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f96440d28e0 con 0x7f964415df80 2024-09-17T05:36:37.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f964b600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f96440d2be0 con 0x7f962c005220 2024-09-17T05:36:37.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f9643e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96440b4ee0 0x7f96440b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f9643e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96440b4ee0 0x7f96440b5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49906/0 (socket says 172.21.15.31:49906) 2024-09-17T05:36:37.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f9643e00640 1 -- 172.21.15.31:0/3491631876 learned_addr learned my addr 172.21.15.31:0/3491631876 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:37.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f9648c00640 1 --2- 172.21.15.31:0/3491631876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f962c005220 0x7f96440cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f9649600640 1 --2- 172.21.15.31:0/3491631876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f964415df80 0x7f964415e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f9643e00640 1 -- 172.21.15.31:0/3491631876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f962c005220 msgr2=0x7f96440cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f9643e00640 1 --2- 172.21.15.31:0/3491631876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f962c005220 0x7f96440cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f9643e00640 1 -- 172.21.15.31:0/3491631876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f964415df80 msgr2=0x7f964415e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f9643e00640 1 --2- 172.21.15.31:0/3491631876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f964415df80 0x7f964415e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f9643e00640 1 -- 172.21.15.31:0/3491631876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964415d1c0 con 0x7f96440b4ee0 2024-09-17T05:36:37.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f9643e00640 1 --2- 172.21.15.31:0/3491631876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96440b4ee0 0x7f96440b5360 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f9630011850 tx=0x7f9630011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:37.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f9640c00640 1 -- 172.21.15.31:0/3491631876 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630004460 con 0x7f96440b4ee0 2024-09-17T05:36:37.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f9640c00640 1 -- 172.21.15.31:0/3491631876 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9630016070 con 0x7f96440b4ee0 2024-09-17T05:36:37.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f9640c00640 1 -- 172.21.15.31:0/3491631876 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963000fc50 con 0x7f96440b4ee0 2024-09-17T05:36:37.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f964b600640 1 -- 172.21.15.31:0/3491631876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f964415d4a0 con 0x7f96440b4ee0 2024-09-17T05:36:37.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f964b600640 1 -- 172.21.15.31:0/3491631876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f964415da60 con 0x7f96440b4ee0 2024-09-17T05:36:37.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.636+0000 7f964b600640 1 -- 172.21.15.31:0/3491631876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96440cfd10 con 0x7f96440b4ee0 2024-09-17T05:36:37.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.640+0000 7f9640c00640 1 -- 172.21.15.31:0/3491631876 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f9630003600 con 0x7f96440b4ee0 2024-09-17T05:36:37.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.640+0000 7f9640c00640 1 --2- 172.21.15.31:0/3491631876 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9624073c50 0x7f9624076110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:37.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.640+0000 7f9640c00640 1 -- 172.21.15.31:0/3491631876 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f9630093880 con 0x7f96440b4ee0 2024-09-17T05:36:37.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.640+0000 7f9648c00640 1 --2- 172.21.15.31:0/3491631876 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9624073c50 0x7f9624076110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:37.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.640+0000 7f9648c00640 1 --2- 172.21.15.31:0/3491631876 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9624073c50 0x7f9624076110 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f96440b4740 tx=0x7f9638006b80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:37.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.644+0000 7f9640c00640 1 -- 172.21.15.31:0/3491631876 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f963005fb10 con 0x7f96440b4ee0 2024-09-17T05:36:37.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.856+0000 7f964b600640 1 -- 172.21.15.31:0/3491631876 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96440cbc40 con 0x7f96440b4ee0 2024-09-17T05:36:37.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.856+0000 7f9640c00640 1 -- 172.21.15.31:0/3491631876 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5236 (secure 0 0 0) 0x7f9630064540 con 0x7f96440b4ee0 2024-09-17T05:36:37.859 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:37.859 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":110,"btime":"2024-09-17T05:36:32:948940+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/188322131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":188322131},{"type":"v1","addr":"172.21.15.155:6834","nonce":188322131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2190232807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":2190232807},{"type":"v1","addr":"172.21.15.155:6835","nonce":2190232807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8724,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/2588830685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2588830685},{"type":"v1","addr":"172.21.15.31:6833","nonce":2588830685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:18.297448+0000","modified":"2024-09-17T05:36:21.321294+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8733":{"gid":8733,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/2117164749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2117164749},{"type":"v1","addr":"172.21.15.31:6835","nonce":2117164749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8733,"qdb_cluster":[8733]},"id":12}]} 2024-09-17T05:36:37.860 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 110 2024-09-17T05:36:37.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.860+0000 7f964b600640 1 -- 172.21.15.31:0/3491631876 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9624073c50 msgr2=0x7f9624076110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.860+0000 7f964b600640 1 --2- 172.21.15.31:0/3491631876 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9624073c50 0x7f9624076110 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f96440b4740 tx=0x7f9638006b80 comp rx=0 tx=0).stop 2024-09-17T05:36:37.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.860+0000 7f964b600640 1 -- 172.21.15.31:0/3491631876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96440b4ee0 msgr2=0x7f96440b5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:37.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.860+0000 7f964b600640 1 --2- 172.21.15.31:0/3491631876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96440b4ee0 0x7f96440b5360 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f9630011850 tx=0x7f9630011d10 comp rx=0 tx=0).stop 2024-09-17T05:36:37.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.860+0000 7f964b600640 1 -- 172.21.15.31:0/3491631876 shutdown_connections 2024-09-17T05:36:37.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.860+0000 7f964b600640 1 --2- 172.21.15.31:0/3491631876 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9624073c50 0x7f9624076110 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.860+0000 7f964b600640 1 --2- 172.21.15.31:0/3491631876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f964415df80 0x7f964415e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.860+0000 7f964b600640 1 --2- 172.21.15.31:0/3491631876 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96440b4ee0 0x7f96440b5360 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.860+0000 7f964b600640 1 --2- 172.21.15.31:0/3491631876 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f962c005220 0x7f96440cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:37.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.860+0000 7f964b600640 1 -- 172.21.15.31:0/3491631876 >> 172.21.15.31:0/3491631876 conn(0x7f96440d1dc0 msgr2=0x7f964415b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:37.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.860+0000 7f964b600640 1 -- 172.21.15.31:0/3491631876 shutdown_connections 2024-09-17T05:36:37.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:37.860+0000 7f964b600640 1 -- 172.21.15.31:0/3491631876 wait complete. 2024-09-17T05:36:37.881 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:38.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.028+0000 7fd917c00640 1 -- 172.21.15.31:0/3436256247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8f40051d0 msgr2=0x7fd8f400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.028+0000 7fd917c00640 1 --2- 172.21.15.31:0/3436256247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8f40051d0 0x7fd8f400b9d0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fd908009ee0 tx=0x7fd90801d630 comp rx=0 tx=0).stop 2024-09-17T05:36:38.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.028+0000 7fd917c00640 1 -- 172.21.15.31:0/3436256247 shutdown_connections 2024-09-17T05:36:38.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.028+0000 7fd917c00640 1 --2- 172.21.15.31:0/3436256247 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8f40051d0 0x7fd8f400b9d0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.028+0000 7fd917c00640 1 -- 172.21.15.31:0/3436256247 >> 172.21.15.31:0/3436256247 conn(0x7fd9100d1dc0 msgr2=0x7fd9100d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:38.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.028+0000 7fd917c00640 1 -- 172.21.15.31:0/3436256247 shutdown_connections 2024-09-17T05:36:38.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.028+0000 7fd917c00640 1 -- 172.21.15.31:0/3436256247 wait complete. 2024-09-17T05:36:38.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd917c00640 1 Processor -- start 2024-09-17T05:36:38.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd917c00640 1 -- start start 2024-09-17T05:36:38.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd917c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8f40051d0 0x7fd9101f4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd917c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd910157c30 0x7fd9101f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd917c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd910158400 0x7fd9100ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd917c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd9100d2a60 con 0x7fd910157c30 2024-09-17T05:36:38.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd917c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd9100d28e0 con 0x7fd910158400 2024-09-17T05:36:38.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd917c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd9100d2be0 con 0x7fd8f40051d0 2024-09-17T05:36:38.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd907e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd910157c30 0x7fd9101f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd907e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd910157c30 0x7fd9101f8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49924/0 (socket says 172.21.15.31:49924) 2024-09-17T05:36:38.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd907e00640 1 -- 172.21.15.31:0/317655857 learned_addr learned my addr 172.21.15.31:0/317655857 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:38.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd915200640 1 --2- 172.21.15.31:0/317655857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8f40051d0 0x7fd9101f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd915c00640 1 --2- 172.21.15.31:0/317655857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd910158400 0x7fd9100ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd907e00640 1 -- 172.21.15.31:0/317655857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8f40051d0 msgr2=0x7fd9101f4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd907e00640 1 --2- 172.21.15.31:0/317655857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8f40051d0 0x7fd9101f4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd907e00640 1 -- 172.21.15.31:0/317655857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd910158400 msgr2=0x7fd9100ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd907e00640 1 --2- 172.21.15.31:0/317655857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd910158400 0x7fd9100ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd907e00640 1 -- 172.21.15.31:0/317655857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9101f5e60 con 0x7fd910157c30 2024-09-17T05:36:38.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd915200640 1 --2- 172.21.15.31:0/317655857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8f40051d0 0x7fd9101f4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:38.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd907e00640 1 --2- 172.21.15.31:0/317655857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd910157c30 0x7fd9101f8db0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800e5c0 tx=0x7fd8f800ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:38.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd90d600640 1 -- 172.21.15.31:0/317655857 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8015020 con 0x7fd910157c30 2024-09-17T05:36:38.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd90d600640 1 -- 172.21.15.31:0/317655857 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8f800ca60 con 0x7fd910157c30 2024-09-17T05:36:38.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd90d600640 1 -- 172.21.15.31:0/317655857 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f800ce90 con 0x7fd910157c30 2024-09-17T05:36:38.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd917c00640 1 -- 172.21.15.31:0/317655857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9101f55c0 con 0x7fd910157c30 2024-09-17T05:36:38.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.032+0000 7fd917c00640 1 -- 172.21.15.31:0/317655857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9101f5b80 con 0x7fd910157c30 2024-09-17T05:36:38.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.036+0000 7fd917c00640 1 -- 172.21.15.31:0/317655857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9100ce910 con 0x7fd910157c30 2024-09-17T05:36:38.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.036+0000 7fd90d600640 1 -- 172.21.15.31:0/317655857 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7fd8f8018020 con 0x7fd910157c30 2024-09-17T05:36:38.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.036+0000 7fd90d600640 1 --2- 172.21.15.31:0/317655857 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd8ec073df0 0x7fd8ec0762b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.036+0000 7fd90d600640 1 -- 172.21.15.31:0/317655857 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fd8f80931c0 con 0x7fd910157c30 2024-09-17T05:36:38.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.036+0000 7fd915200640 1 --2- 172.21.15.31:0/317655857 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd8ec073df0 0x7fd8ec0762b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.036+0000 7fd915200640 1 --2- 172.21.15.31:0/317655857 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd8ec073df0 0x7fd8ec0762b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd900000c10 tx=0x7fd900006b80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:38.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.040+0000 7fd90d600640 1 -- 172.21.15.31:0/317655857 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd8f801f020 con 0x7fd910157c30 2024-09-17T05:36:38.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.248+0000 7fd917c00640 1 -- 172.21.15.31:0/317655857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd91006add0 con 0x7fd910157c30 2024-09-17T05:36:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.248+0000 7fd90d600640 1 -- 172.21.15.31:0/317655857 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5236 (secure 0 0 0) 0x7fd8f805fb00 con 0x7fd910157c30 2024-09-17T05:36:38.252 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:38.253 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":110,"btime":"2024-09-17T05:36:32:948940+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/188322131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":188322131},{"type":"v1","addr":"172.21.15.155:6834","nonce":188322131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2190232807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":2190232807},{"type":"v1","addr":"172.21.15.155:6835","nonce":2190232807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8724,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/2588830685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2588830685},{"type":"v1","addr":"172.21.15.31:6833","nonce":2588830685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:18.297448+0000","modified":"2024-09-17T05:36:21.321294+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8733":{"gid":8733,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/2117164749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2117164749},{"type":"v1","addr":"172.21.15.31:6835","nonce":2117164749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8733,"qdb_cluster":[8733]},"id":12}]} 2024-09-17T05:36:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 110 2024-09-17T05:36:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.252+0000 7fd917c00640 1 -- 172.21.15.31:0/317655857 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd8ec073df0 msgr2=0x7fd8ec0762b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.252+0000 7fd917c00640 1 --2- 172.21.15.31:0/317655857 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd8ec073df0 0x7fd8ec0762b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd900000c10 tx=0x7fd900006b80 comp rx=0 tx=0).stop 2024-09-17T05:36:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.252+0000 7fd917c00640 1 -- 172.21.15.31:0/317655857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd910157c30 msgr2=0x7fd9101f8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.252+0000 7fd917c00640 1 --2- 172.21.15.31:0/317655857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd910157c30 0x7fd9101f8db0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800e5c0 tx=0x7fd8f800ea80 comp rx=0 tx=0).stop 2024-09-17T05:36:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.252+0000 7fd917c00640 1 -- 172.21.15.31:0/317655857 shutdown_connections 2024-09-17T05:36:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.252+0000 7fd917c00640 1 --2- 172.21.15.31:0/317655857 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd8ec073df0 0x7fd8ec0762b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.252+0000 7fd917c00640 1 --2- 172.21.15.31:0/317655857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd910158400 0x7fd9100ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.252+0000 7fd917c00640 1 --2- 172.21.15.31:0/317655857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd910157c30 0x7fd9101f8db0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.252+0000 7fd917c00640 1 --2- 172.21.15.31:0/317655857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8f40051d0 0x7fd9101f4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.252+0000 7fd917c00640 1 -- 172.21.15.31:0/317655857 >> 172.21.15.31:0/317655857 conn(0x7fd9100d1dc0 msgr2=0x7fd91006e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.252+0000 7fd917c00640 1 -- 172.21.15.31:0/317655857 shutdown_connections 2024-09-17T05:36:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.252+0000 7fd917c00640 1 -- 172.21.15.31:0/317655857 wait complete. 2024-09-17T05:36:38.274 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:38.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd619200640 1 -- 172.21.15.31:0/4060142117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5f8004810 msgr2=0x7fd5f8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd619200640 1 --2- 172.21.15.31:0/4060142117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5f8004810 0x7fd5f8004c90 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009b70 tx=0x7fd5fc01d290 comp rx=0 tx=0).stop 2024-09-17T05:36:38.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd612800640 1 -- 172.21.15.31:0/4060142117 reap_dead start 2024-09-17T05:36:38.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd619200640 1 -- 172.21.15.31:0/4060142117 shutdown_connections 2024-09-17T05:36:38.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd619200640 1 -- 172.21.15.31:0/4060142117 >> 172.21.15.31:0/4060142117 conn(0x7fd6140d1dc0 msgr2=0x7fd6140d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:38.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd619200640 1 -- 172.21.15.31:0/4060142117 shutdown_connections 2024-09-17T05:36:38.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd619200640 1 -- 172.21.15.31:0/4060142117 wait complete. 2024-09-17T05:36:38.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd619200640 1 Processor -- start 2024-09-17T05:36:38.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd619200640 1 -- start start 2024-09-17T05:36:38.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd619200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5f8004810 0x7fd6141577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd619200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd614157fc0 0x7fd6141f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd619200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6141f8030 0x7fd6140b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd619200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd6140d2a60 con 0x7fd614157fc0 2024-09-17T05:36:38.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd619200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd6140d28e0 con 0x7fd6141f8030 2024-09-17T05:36:38.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd619200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd6140d2be0 con 0x7fd5f8004810 2024-09-17T05:36:38.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd60be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd614157fc0 0x7fd6141f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd60be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd614157fc0 0x7fd6141f5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:49944/0 (socket says 172.21.15.31:49944) 2024-09-17T05:36:38.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd60be00640 1 -- 172.21.15.31:0/2494840739 learned_addr learned my addr 172.21.15.31:0/2494840739 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:38.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd611e00640 1 --2- 172.21.15.31:0/2494840739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5f8004810 0x7fd6141577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd612800640 1 --2- 172.21.15.31:0/2494840739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6141f8030 0x7fd6140b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd60be00640 1 -- 172.21.15.31:0/2494840739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5f8004810 msgr2=0x7fd6141577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd60be00640 1 --2- 172.21.15.31:0/2494840739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5f8004810 0x7fd6141577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd60be00640 1 -- 172.21.15.31:0/2494840739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6141f8030 msgr2=0x7fd6140b7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd60be00640 1 --2- 172.21.15.31:0/2494840739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6141f8030 0x7fd6140b7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd60be00640 1 -- 172.21.15.31:0/2494840739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6141f5990 con 0x7fd614157fc0 2024-09-17T05:36:38.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.420+0000 7fd612800640 1 --2- 172.21.15.31:0/2494840739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6141f8030 0x7fd6140b7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:38.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.424+0000 7fd60be00640 1 --2- 172.21.15.31:0/2494840739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd614157fc0 0x7fd6141f5450 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0ae040 tx=0x7fd5fc0050a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:38.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.424+0000 7fd60a000640 1 -- 172.21.15.31:0/2494840739 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0bb030 con 0x7fd614157fc0 2024-09-17T05:36:38.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.424+0000 7fd60a000640 1 -- 172.21.15.31:0/2494840739 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5fc004a50 con 0x7fd614157fc0 2024-09-17T05:36:38.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.424+0000 7fd619200640 1 -- 172.21.15.31:0/2494840739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6141f89a0 con 0x7fd614157fc0 2024-09-17T05:36:38.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.424+0000 7fd60a000640 1 -- 172.21.15.31:0/2494840739 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc004e60 con 0x7fd614157fc0 2024-09-17T05:36:38.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.424+0000 7fd619200640 1 -- 172.21.15.31:0/2494840739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6141f4c50 con 0x7fd614157fc0 2024-09-17T05:36:38.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.424+0000 7fd619200640 1 -- 172.21.15.31:0/2494840739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6141f8ec0 con 0x7fd614157fc0 2024-09-17T05:36:38.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.424+0000 7fd60a000640 1 -- 172.21.15.31:0/2494840739 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7fd5fc0be030 con 0x7fd614157fc0 2024-09-17T05:36:38.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.424+0000 7fd60a000640 1 --2- 172.21.15.31:0/2494840739 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd5f0073c50 0x7fd5f0076110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.424+0000 7fd60a000640 1 -- 172.21.15.31:0/2494840739 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fd5fc12e2b0 con 0x7fd614157fc0 2024-09-17T05:36:38.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.424+0000 7fd611e00640 1 --2- 172.21.15.31:0/2494840739 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd5f0073c50 0x7fd5f0076110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.428+0000 7fd611e00640 1 --2- 172.21.15.31:0/2494840739 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd5f0073c50 0x7fd5f0076110 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd6141f25a0 tx=0x7fd604001740 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:38.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.428+0000 7fd60a000640 1 -- 172.21.15.31:0/2494840739 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd6141f8ec0 con 0x7fd614157fc0 2024-09-17T05:36:38.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.604+0000 7fd619200640 1 -- 172.21.15.31:0/2494840739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6140ae9b0 con 0x7fd614157fc0 2024-09-17T05:36:38.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.608+0000 7fd60a000640 1 -- 172.21.15.31:0/2494840739 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) ==== 74+0+16807 (secure 0 0 0) 0x7fd6141f5990 con 0x7fd614157fc0 2024-09-17T05:36:38.609 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:38.610 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":152,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:36:19.891256+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:16.018805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:17.260510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:38.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.608+0000 7fd619200640 1 -- 172.21.15.31:0/2494840739 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd5f0073c50 msgr2=0x7fd5f0076110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.608+0000 7fd619200640 1 --2- 172.21.15.31:0/2494840739 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd5f0073c50 0x7fd5f0076110 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd6141f25a0 tx=0x7fd604001740 comp rx=0 tx=0).stop 2024-09-17T05:36:38.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.608+0000 7fd619200640 1 -- 172.21.15.31:0/2494840739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd614157fc0 msgr2=0x7fd6141f5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.608+0000 7fd619200640 1 --2- 172.21.15.31:0/2494840739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd614157fc0 0x7fd6141f5450 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0ae040 tx=0x7fd5fc0050a0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.608+0000 7fd619200640 1 -- 172.21.15.31:0/2494840739 shutdown_connections 2024-09-17T05:36:38.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.608+0000 7fd619200640 1 --2- 172.21.15.31:0/2494840739 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd5f0073c50 0x7fd5f0076110 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.608+0000 7fd619200640 1 --2- 172.21.15.31:0/2494840739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6141f8030 0x7fd6140b7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.608+0000 7fd619200640 1 --2- 172.21.15.31:0/2494840739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd614157fc0 0x7fd6141f5450 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.608+0000 7fd619200640 1 --2- 172.21.15.31:0/2494840739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5f8004810 0x7fd6141577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.608+0000 7fd619200640 1 -- 172.21.15.31:0/2494840739 >> 172.21.15.31:0/2494840739 conn(0x7fd6140d1dc0 msgr2=0x7fd6140d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:38.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.608+0000 7fd619200640 1 -- 172.21.15.31:0/2494840739 shutdown_connections 2024-09-17T05:36:38.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.608+0000 7fd619200640 1 -- 172.21.15.31:0/2494840739 wait complete. 2024-09-17T05:36:38.631 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:36:38.632 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:38.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.776+0000 7f0d25c00640 1 -- 172.21.15.31:0/2714650286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2015f7b0 msgr2=0x7f0d2015fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.776+0000 7f0d25c00640 1 --2- 172.21.15.31:0/2714650286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2015f7b0 0x7f0d2015fc40 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f0d200b3820 tx=0x7f0d1801cd50 comp rx=0 tx=0).stop 2024-09-17T05:36:38.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.776+0000 7f0d25c00640 1 -- 172.21.15.31:0/2714650286 shutdown_connections 2024-09-17T05:36:38.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.776+0000 7f0d25c00640 1 --2- 172.21.15.31:0/2714650286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2015f7b0 0x7f0d2015fc40 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.776+0000 7f0d25c00640 1 --2- 172.21.15.31:0/2714650286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2015c1c0 0x7f0d2006d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.776+0000 7f0d25c00640 1 --2- 172.21.15.31:0/2714650286 >> v2:172.21.15.155:3300/0 conn(0x7f0d2006cc20 0x7f0d200737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.776+0000 7f0d25c00640 1 -- 172.21.15.31:0/2714650286 >> 172.21.15.31:0/2714650286 conn(0x7f0d200d0c90 msgr2=0x7f0d200d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:38.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.776+0000 7f0d25c00640 1 -- 172.21.15.31:0/2714650286 shutdown_connections 2024-09-17T05:36:38.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.776+0000 7f0d25c00640 1 -- 172.21.15.31:0/2714650286 wait complete. 2024-09-17T05:36:38.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d25c00640 1 Processor -- start 2024-09-17T05:36:38.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d25c00640 1 -- start start 2024-09-17T05:36:38.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d25c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2006cc20 0x7f0d200afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d25c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2015c1c0 0x7f0d200caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d25c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2015f7b0 0x7f0d200b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d25c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0d200719c0 con 0x7f0d2015f7b0 2024-09-17T05:36:38.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d25c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0d20071840 con 0x7f0d2006cc20 2024-09-17T05:36:38.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d25c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0d20071b40 con 0x7f0d2015c1c0 2024-09-17T05:36:38.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d1f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2015f7b0 0x7f0d200b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d1f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2015f7b0 0x7f0d200b1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44412/0 (socket says 172.21.15.31:44412) 2024-09-17T05:36:38.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d1f400640 1 -- 172.21.15.31:0/953087337 learned_addr learned my addr 172.21.15.31:0/953087337 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:38.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d17e00640 1 --2- 172.21.15.31:0/953087337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2015c1c0 0x7f0d200caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d1ea00640 1 --2- 172.21.15.31:0/953087337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2006cc20 0x7f0d200afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d1f400640 1 -- 172.21.15.31:0/953087337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2015c1c0 msgr2=0x7f0d200caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d1f400640 1 --2- 172.21.15.31:0/953087337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2015c1c0 0x7f0d200caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d1f400640 1 -- 172.21.15.31:0/953087337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2006cc20 msgr2=0x7f0d200afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:38.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d1f400640 1 --2- 172.21.15.31:0/953087337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2006cc20 0x7f0d200afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:38.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d1f400640 1 -- 172.21.15.31:0/953087337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2015f570 con 0x7f0d2015f7b0 2024-09-17T05:36:38.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d1f400640 1 --2- 172.21.15.31:0/953087337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2015f7b0 0x7f0d200b1740 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009bd0 tx=0x7f0d18005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:38.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d16a00640 1 -- 172.21.15.31:0/953087337 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d180bb070 con 0x7f0d2015f7b0 2024-09-17T05:36:38.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d16a00640 1 -- 172.21.15.31:0/953087337 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d18004b40 con 0x7f0d2015f7b0 2024-09-17T05:36:38.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d16a00640 1 -- 172.21.15.31:0/953087337 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d180b2040 con 0x7f0d2015f7b0 2024-09-17T05:36:38.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d25c00640 1 -- 172.21.15.31:0/953087337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d201f8af0 con 0x7f0d2015f7b0 2024-09-17T05:36:38.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d25c00640 1 -- 172.21.15.31:0/953087337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d201f8810 con 0x7f0d2015f7b0 2024-09-17T05:36:38.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.780+0000 7f0d25c00640 1 -- 172.21.15.31:0/953087337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d201f8600 con 0x7f0d2015f7b0 2024-09-17T05:36:38.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.784+0000 7f0d16a00640 1 -- 172.21.15.31:0/953087337 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f0d180be070 con 0x7f0d2015f7b0 2024-09-17T05:36:38.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.784+0000 7f0d16a00640 1 --2- 172.21.15.31:0/953087337 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0cfc073c20 0x7f0cfc0760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:38.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.784+0000 7f0d16a00640 1 -- 172.21.15.31:0/953087337 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f0d1812c710 con 0x7f0d2015f7b0 2024-09-17T05:36:38.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.784+0000 7f0d1ea00640 1 --2- 172.21.15.31:0/953087337 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0cfc073c20 0x7f0cfc0760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:38.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.784+0000 7f0d1ea00640 1 --2- 172.21.15.31:0/953087337 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0cfc073c20 0x7f0cfc0760e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009b60 tx=0x7f0d100091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:38.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:38.788+0000 7f0d16a00640 1 -- 172.21.15.31:0/953087337 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0d18016970 con 0x7f0d2015f7b0 2024-09-17T05:36:39.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.004+0000 7f0d25c00640 1 -- 172.21.15.31:0/953087337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d200b6c10 con 0x7f0d2015f7b0 2024-09-17T05:36:39.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.004+0000 7f0d16a00640 1 -- 172.21.15.31:0/953087337 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5236 (secure 0 0 0) 0x7f0d180f8a00 con 0x7f0d2015f7b0 2024-09-17T05:36:39.006 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:39.006 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":110,"btime":"2024-09-17T05:36:32:948940+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/188322131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":188322131},{"type":"v1","addr":"172.21.15.155:6834","nonce":188322131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2190232807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":2190232807},{"type":"v1","addr":"172.21.15.155:6835","nonce":2190232807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8724,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/2588830685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2588830685},{"type":"v1","addr":"172.21.15.31:6833","nonce":2588830685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:18.297448+0000","modified":"2024-09-17T05:36:21.321294+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8733":{"gid":8733,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/2117164749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2117164749},{"type":"v1","addr":"172.21.15.31:6835","nonce":2117164749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8733,"qdb_cluster":[8733]},"id":12}]} 2024-09-17T05:36:39.006 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 110 2024-09-17T05:36:39.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.004+0000 7f0d25c00640 1 -- 172.21.15.31:0/953087337 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0cfc073c20 msgr2=0x7f0cfc0760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.004+0000 7f0d25c00640 1 --2- 172.21.15.31:0/953087337 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0cfc073c20 0x7f0cfc0760e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009b60 tx=0x7f0d100091e0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.004+0000 7f0d25c00640 1 -- 172.21.15.31:0/953087337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2015f7b0 msgr2=0x7f0d200b1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.004+0000 7f0d25c00640 1 --2- 172.21.15.31:0/953087337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2015f7b0 0x7f0d200b1740 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009bd0 tx=0x7f0d18005b00 comp rx=0 tx=0).stop 2024-09-17T05:36:39.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.004+0000 7f0d25c00640 1 -- 172.21.15.31:0/953087337 shutdown_connections 2024-09-17T05:36:39.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.004+0000 7f0d25c00640 1 --2- 172.21.15.31:0/953087337 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0cfc073c20 0x7f0cfc0760e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.004+0000 7f0d25c00640 1 --2- 172.21.15.31:0/953087337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d2015f7b0 0x7f0d200b1740 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.004+0000 7f0d25c00640 1 --2- 172.21.15.31:0/953087337 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0d2015c1c0 0x7f0d200caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.004+0000 7f0d25c00640 1 --2- 172.21.15.31:0/953087337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d2006cc20 0x7f0d200afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.004+0000 7f0d25c00640 1 -- 172.21.15.31:0/953087337 >> 172.21.15.31:0/953087337 conn(0x7f0d200d0c90 msgr2=0x7f0d200cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:39.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.004+0000 7f0d25c00640 1 -- 172.21.15.31:0/953087337 shutdown_connections 2024-09-17T05:36:39.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.004+0000 7f0d25c00640 1 -- 172.21.15.31:0/953087337 wait complete. 2024-09-17T05:36:39.029 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:39.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.172+0000 7f583fc00640 1 -- 172.21.15.31:0/3324886829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f583815bea0 msgr2=0x7f58380ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.172+0000 7f583fc00640 1 --2- 172.21.15.31:0/3324886829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f583815bea0 0x7f58380ce670 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f5838073d10 tx=0x7f582801c830 comp rx=0 tx=0).stop 2024-09-17T05:36:39.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.172+0000 7f583fc00640 1 -- 172.21.15.31:0/3324886829 shutdown_connections 2024-09-17T05:36:39.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.172+0000 7f583fc00640 1 --2- 172.21.15.31:0/3324886829 >> v2:172.21.15.155:3300/0 conn(0x7f58380cdb30 0x7f58380cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.172+0000 7f583fc00640 1 --2- 172.21.15.31:0/3324886829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f583815bea0 0x7f58380ce670 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.172+0000 7f583fc00640 1 -- 172.21.15.31:0/3324886829 >> 172.21.15.31:0/3324886829 conn(0x7f58380d1dc0 msgr2=0x7f58380d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:39.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.172+0000 7f583fc00640 1 -- 172.21.15.31:0/3324886829 shutdown_connections 2024-09-17T05:36:39.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.172+0000 7f583fc00640 1 -- 172.21.15.31:0/3324886829 wait complete. 2024-09-17T05:36:39.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f583fc00640 1 Processor -- start 2024-09-17T05:36:39.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f583fc00640 1 -- start start 2024-09-17T05:36:39.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f583fc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58380cdb30 0x7f58380cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f583fc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58380d28e0 0x7f5838158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f583fc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583815bea0 0x7f583815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f583fc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5838168f10 con 0x7f58380d28e0 2024-09-17T05:36:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f583fc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5838168d90 con 0x7f583815bea0 2024-09-17T05:36:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f583fc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5838169090 con 0x7f58380cdb30 2024-09-17T05:36:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f582fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58380d28e0 0x7f5838158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f582fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58380d28e0 0x7f5838158570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44442/0 (socket says 172.21.15.31:44442) 2024-09-17T05:36:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f582fe00640 1 -- 172.21.15.31:0/1472681822 learned_addr learned my addr 172.21.15.31:0/1472681822 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f583d200640 1 --2- 172.21.15.31:0/1472681822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58380cdb30 0x7f58380cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f583dc00640 1 --2- 172.21.15.31:0/1472681822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583815bea0 0x7f583815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f582fe00640 1 -- 172.21.15.31:0/1472681822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58380cdb30 msgr2=0x7f58380cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f582fe00640 1 --2- 172.21.15.31:0/1472681822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58380cdb30 0x7f58380cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f582fe00640 1 -- 172.21.15.31:0/1472681822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583815bea0 msgr2=0x7f583815b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f582fe00640 1 --2- 172.21.15.31:0/1472681822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583815bea0 0x7f583815b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f582fe00640 1 -- 172.21.15.31:0/1472681822 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58380caf20 con 0x7f58380d28e0 2024-09-17T05:36:39.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f582fe00640 1 --2- 172.21.15.31:0/1472681822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58380d28e0 0x7f5838158570 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f582000c970 tx=0x7f582000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:39.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f5835600640 1 -- 172.21.15.31:0/1472681822 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5820007c70 con 0x7f58380d28e0 2024-09-17T05:36:39.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f5835600640 1 -- 172.21.15.31:0/1472681822 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f582000f450 con 0x7f58380d28e0 2024-09-17T05:36:39.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f5835600640 1 -- 172.21.15.31:0/1472681822 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582000f8a0 con 0x7f58380d28e0 2024-09-17T05:36:39.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f583fc00640 1 -- 172.21.15.31:0/1472681822 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f583815ba00 con 0x7f58380d28e0 2024-09-17T05:36:39.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.176+0000 7f583fc00640 1 -- 172.21.15.31:0/1472681822 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58380cb470 con 0x7f58380d28e0 2024-09-17T05:36:39.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.180+0000 7f583fc00640 1 -- 172.21.15.31:0/1472681822 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58380cc9d0 con 0x7f58380d28e0 2024-09-17T05:36:39.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.180+0000 7f5835600640 1 -- 172.21.15.31:0/1472681822 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f582000fa40 con 0x7f58380d28e0 2024-09-17T05:36:39.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.180+0000 7f5835600640 1 --2- 172.21.15.31:0/1472681822 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5814073c20 0x7f58140760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.180+0000 7f5835600640 1 -- 172.21.15.31:0/1472681822 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f58200934c0 con 0x7f58380d28e0 2024-09-17T05:36:39.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.180+0000 7f583d200640 1 --2- 172.21.15.31:0/1472681822 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5814073c20 0x7f58140760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.180+0000 7f583d200640 1 --2- 172.21.15.31:0/1472681822 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5814073c20 0x7f58140760e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f58280af000 tx=0x7f582801b070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:39.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.184+0000 7f5835600640 1 -- 172.21.15.31:0/1472681822 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f583815ba00 con 0x7f58380d28e0 2024-09-17T05:36:39.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.396+0000 7f583fc00640 1 -- 172.21.15.31:0/1472681822 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5838071d60 con 0x7f58380d28e0 2024-09-17T05:36:39.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.396+0000 7f5835600640 1 -- 172.21.15.31:0/1472681822 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5236 (secure 0 0 0) 0x7f5820014030 con 0x7f58380d28e0 2024-09-17T05:36:39.398 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:39.398 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":110,"btime":"2024-09-17T05:36:32:948940+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/188322131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":188322131},{"type":"v1","addr":"172.21.15.155:6834","nonce":188322131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2190232807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":2190232807},{"type":"v1","addr":"172.21.15.155:6835","nonce":2190232807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8724,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/2588830685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2588830685},{"type":"v1","addr":"172.21.15.31:6833","nonce":2588830685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:18.297448+0000","modified":"2024-09-17T05:36:21.321294+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8733":{"gid":8733,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/2117164749","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":2117164749},{"type":"v1","addr":"172.21.15.31:6835","nonce":2117164749}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8733,"qdb_cluster":[8733]},"id":12}]} 2024-09-17T05:36:39.398 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 110 2024-09-17T05:36:39.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.396+0000 7f583fc00640 1 -- 172.21.15.31:0/1472681822 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5814073c20 msgr2=0x7f58140760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.396+0000 7f583fc00640 1 --2- 172.21.15.31:0/1472681822 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5814073c20 0x7f58140760e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f58280af000 tx=0x7f582801b070 comp rx=0 tx=0).stop 2024-09-17T05:36:39.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.396+0000 7f583fc00640 1 -- 172.21.15.31:0/1472681822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58380d28e0 msgr2=0x7f5838158570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.396+0000 7f583fc00640 1 --2- 172.21.15.31:0/1472681822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58380d28e0 0x7f5838158570 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f582000c970 tx=0x7f582000ce30 comp rx=0 tx=0).stop 2024-09-17T05:36:39.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.396+0000 7f583fc00640 1 -- 172.21.15.31:0/1472681822 shutdown_connections 2024-09-17T05:36:39.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.396+0000 7f583fc00640 1 --2- 172.21.15.31:0/1472681822 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5814073c20 0x7f58140760e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.396+0000 7f583fc00640 1 --2- 172.21.15.31:0/1472681822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f583815bea0 0x7f583815b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.396+0000 7f583fc00640 1 --2- 172.21.15.31:0/1472681822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58380d28e0 0x7f5838158570 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.396+0000 7f583fc00640 1 --2- 172.21.15.31:0/1472681822 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f58380cdb30 0x7f58380cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.396+0000 7f583fc00640 1 -- 172.21.15.31:0/1472681822 >> 172.21.15.31:0/1472681822 conn(0x7f58380d1dc0 msgr2=0x7f5838072280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:39.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.396+0000 7f583fc00640 1 -- 172.21.15.31:0/1472681822 shutdown_connections 2024-09-17T05:36:39.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.396+0000 7f583fc00640 1 -- 172.21.15.31:0/1472681822 wait complete. 2024-09-17T05:36:39.419 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:39.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.564+0000 7f1cfb400640 1 -- 172.21.15.31:0/3745092422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cf40ced80 msgr2=0x7f1cf40ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.564+0000 7f1cfb400640 1 --2- 172.21.15.31:0/3745092422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cf40ced80 0x7f1cf40ae9b0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40cf340 tx=0x7f1cdc01c8c0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.564+0000 7f1cfb400640 1 -- 172.21.15.31:0/3745092422 shutdown_connections 2024-09-17T05:36:39.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.564+0000 7f1cfb400640 1 --2- 172.21.15.31:0/3745092422 >> v2:172.21.15.155:3300/0 conn(0x7f1cf40cdb30 0x7f1cf40aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.564+0000 7f1cfb400640 1 --2- 172.21.15.31:0/3745092422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cf40ced80 0x7f1cf40ae9b0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.564+0000 7f1cfb400640 1 -- 172.21.15.31:0/3745092422 >> 172.21.15.31:0/3745092422 conn(0x7f1cf40d1dc0 msgr2=0x7f1cf40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:39.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.564+0000 7f1cfb400640 1 -- 172.21.15.31:0/3745092422 shutdown_connections 2024-09-17T05:36:39.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cfb400640 1 -- 172.21.15.31:0/3745092422 wait complete. 2024-09-17T05:36:39.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cfb400640 1 Processor -- start 2024-09-17T05:36:39.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cfb400640 1 -- start start 2024-09-17T05:36:39.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cfb400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cf40cdb30 0x7f1cf414c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cfb400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf40ced80 0x7f1cf40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cfb400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cf415bea0 0x7f1cf40b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cfb400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf41692f0 con 0x7f1cf40cdb30 2024-09-17T05:36:39.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cfb400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf4169170 con 0x7f1cf415bea0 2024-09-17T05:36:39.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cfb400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1cf4169470 con 0x7f1cf40ced80 2024-09-17T05:36:39.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cf8a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cf40cdb30 0x7f1cf414c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cf8a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cf40cdb30 0x7f1cf414c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44452/0 (socket says 172.21.15.31:44452) 2024-09-17T05:36:39.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cf8a00640 1 -- 172.21.15.31:0/1951356928 learned_addr learned my addr 172.21.15.31:0/1951356928 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:39.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cebe00640 1 --2- 172.21.15.31:0/1951356928 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf40ced80 0x7f1cf40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cf9400640 1 --2- 172.21.15.31:0/1951356928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cf415bea0 0x7f1cf40b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cf8a00640 1 -- 172.21.15.31:0/1951356928 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf40ced80 msgr2=0x7f1cf40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cf8a00640 1 --2- 172.21.15.31:0/1951356928 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf40ced80 0x7f1cf40b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cf8a00640 1 -- 172.21.15.31:0/1951356928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cf415bea0 msgr2=0x7f1cf40b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cf8a00640 1 --2- 172.21.15.31:0/1951356928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cf415bea0 0x7f1cf40b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cf8a00640 1 -- 172.21.15.31:0/1951356928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf4165a10 con 0x7f1cf40cdb30 2024-09-17T05:36:39.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cf9400640 1 --2- 172.21.15.31:0/1951356928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cf415bea0 0x7f1cf40b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:39.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cf8a00640 1 --2- 172.21.15.31:0/1951356928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cf40cdb30 0x7f1cf414c0c0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400b410 tx=0x7f1ce400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:39.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cf1600640 1 -- 172.21.15.31:0/1951356928 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4015030 con 0x7f1cf40cdb30 2024-09-17T05:36:39.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cf1600640 1 -- 172.21.15.31:0/1951356928 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ce4004020 con 0x7f1cf40cdb30 2024-09-17T05:36:39.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.568+0000 7f1cf1600640 1 -- 172.21.15.31:0/1951356928 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce40044b0 con 0x7f1cf40cdb30 2024-09-17T05:36:39.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.572+0000 7f1cfb400640 1 -- 172.21.15.31:0/1951356928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf4164b30 con 0x7f1cf40cdb30 2024-09-17T05:36:39.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.572+0000 7f1cfb400640 1 -- 172.21.15.31:0/1951356928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf4165cd0 con 0x7f1cf40cdb30 2024-09-17T05:36:39.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.572+0000 7f1cfb400640 1 -- 172.21.15.31:0/1951356928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cf40b5af0 con 0x7f1cf40cdb30 2024-09-17T05:36:39.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.572+0000 7f1cf1600640 1 -- 172.21.15.31:0/1951356928 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f1ce4018070 con 0x7f1cf40cdb30 2024-09-17T05:36:39.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.572+0000 7f1cf1600640 1 --2- 172.21.15.31:0/1951356928 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1cd0073c20 0x7f1cd00760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.572+0000 7f1cf1600640 1 -- 172.21.15.31:0/1951356928 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7f1ce4092840 con 0x7f1cf40cdb30 2024-09-17T05:36:39.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.572+0000 7f1cebe00640 1 --2- 172.21.15.31:0/1951356928 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1cd0073c20 0x7f1cd00760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.576+0000 7f1cebe00640 1 --2- 172.21.15.31:0/1951356928 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1cd0073c20 0x7f1cd00760e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0af000 tx=0x7f1cdc01b100 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:39.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.576+0000 7f1cf1600640 1 -- 172.21.15.31:0/1951356928 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f1ce405f120 con 0x7f1cf40cdb30 2024-09-17T05:36:39.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.756+0000 7f1cfb400640 1 -- 172.21.15.31:0/1951356928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1cf40762f0 con 0x7f1cf40cdb30 2024-09-17T05:36:39.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.756+0000 7f1cf1600640 1 -- 172.21.15.31:0/1951356928 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) ==== 74+0+16807 (secure 0 0 0) 0x7f1ce405ea20 con 0x7f1cf40cdb30 2024-09-17T05:36:39.760 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:39.760 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":152,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:36:19.891256+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:16.018805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:17.260510+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:39.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.760+0000 7f1cfb400640 1 -- 172.21.15.31:0/1951356928 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1cd0073c20 msgr2=0x7f1cd00760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.760+0000 7f1cfb400640 1 --2- 172.21.15.31:0/1951356928 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1cd0073c20 0x7f1cd00760e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0af000 tx=0x7f1cdc01b100 comp rx=0 tx=0).stop 2024-09-17T05:36:39.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.760+0000 7f1cfb400640 1 -- 172.21.15.31:0/1951356928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cf40cdb30 msgr2=0x7f1cf414c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.760+0000 7f1cfb400640 1 --2- 172.21.15.31:0/1951356928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cf40cdb30 0x7f1cf414c0c0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400b410 tx=0x7f1ce400b8d0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.760+0000 7f1cfb400640 1 -- 172.21.15.31:0/1951356928 shutdown_connections 2024-09-17T05:36:39.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.760+0000 7f1cfb400640 1 --2- 172.21.15.31:0/1951356928 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1cd0073c20 0x7f1cd00760e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.760+0000 7f1cfb400640 1 --2- 172.21.15.31:0/1951356928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1cf415bea0 0x7f1cf40b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.760+0000 7f1cfb400640 1 --2- 172.21.15.31:0/1951356928 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1cf40ced80 0x7f1cf40b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.760+0000 7f1cfb400640 1 --2- 172.21.15.31:0/1951356928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cf40cdb30 0x7f1cf414c0c0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.760+0000 7f1cfb400640 1 -- 172.21.15.31:0/1951356928 >> 172.21.15.31:0/1951356928 conn(0x7f1cf40d1dc0 msgr2=0x7f1cf40b0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:39.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.760+0000 7f1cfb400640 1 -- 172.21.15.31:0/1951356928 shutdown_connections 2024-09-17T05:36:39.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.760+0000 7f1cfb400640 1 -- 172.21.15.31:0/1951356928 wait complete. 2024-09-17T05:36:39.781 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:36:39.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa481200640 1 -- 172.21.15.31:0/1863934927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa47c15bea0 msgr2=0x7fa47c0ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa481200640 1 --2- 172.21.15.31:0/1863934927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa47c15bea0 0x7fa47c0ce670 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009900 tx=0x7fa46c01c8e0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa481200640 1 -- 172.21.15.31:0/1863934927 shutdown_connections 2024-09-17T05:36:39.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa481200640 1 --2- 172.21.15.31:0/1863934927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47c0cdb30 0x7fa47c0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa481200640 1 --2- 172.21.15.31:0/1863934927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa47c15bea0 0x7fa47c0ce670 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa481200640 1 -- 172.21.15.31:0/1863934927 >> 172.21.15.31:0/1863934927 conn(0x7fa47c0d1dc0 msgr2=0x7fa47c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:39.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa481200640 1 -- 172.21.15.31:0/1863934927 shutdown_connections 2024-09-17T05:36:39.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa481200640 1 -- 172.21.15.31:0/1863934927 wait complete. 2024-09-17T05:36:39.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa481200640 1 Processor -- start 2024-09-17T05:36:39.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa481200640 1 -- start start 2024-09-17T05:36:39.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa481200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa47c0cdb30 0x7fa47c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa481200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa47c0d28e0 0x7fa47c09e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa481200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47c15bea0 0x7fa47c165f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa481200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa47c168fc0 con 0x7fa47c0cdb30 2024-09-17T05:36:39.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa481200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa47c168e40 con 0x7fa47c0d28e0 2024-09-17T05:36:39.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa481200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa47c169140 con 0x7fa47c15bea0 2024-09-17T05:36:39.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa479e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa47c0cdb30 0x7fa47c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa479e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa47c0cdb30 0x7fa47c15a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44462/0 (socket says 172.21.15.31:44462) 2024-09-17T05:36:39.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa479e00640 1 -- 172.21.15.31:0/2824160005 learned_addr learned my addr 172.21.15.31:0/2824160005 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:39.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa473e00640 1 --2- 172.21.15.31:0/2824160005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa47c0d28e0 0x7fa47c09e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa47a800640 1 --2- 172.21.15.31:0/2824160005 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47c15bea0 0x7fa47c165f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa479e00640 1 -- 172.21.15.31:0/2824160005 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47c15bea0 msgr2=0x7fa47c165f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa479e00640 1 --2- 172.21.15.31:0/2824160005 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47c15bea0 0x7fa47c165f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa479e00640 1 -- 172.21.15.31:0/2824160005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa47c0d28e0 msgr2=0x7fa47c09e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:39.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa479e00640 1 --2- 172.21.15.31:0/2824160005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa47c0d28e0 0x7fa47c09e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:39.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa479e00640 1 -- 172.21.15.31:0/2824160005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa47c09f260 con 0x7fa47c0cdb30 2024-09-17T05:36:39.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.928+0000 7fa479e00640 1 --2- 172.21.15.31:0/2824160005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa47c0cdb30 0x7fa47c15a1a0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009850 tx=0x7fa46c0a5730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:39.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.932+0000 7fa472000640 1 -- 172.21.15.31:0/2824160005 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46c0b2040 con 0x7fa47c0cdb30 2024-09-17T05:36:39.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.932+0000 7fa472000640 1 -- 172.21.15.31:0/2824160005 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa46c0042c0 con 0x7fa47c0cdb30 2024-09-17T05:36:39.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.932+0000 7fa481200640 1 -- 172.21.15.31:0/2824160005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa47c09f540 con 0x7fa47c0cdb30 2024-09-17T05:36:39.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.932+0000 7fa472000640 1 -- 172.21.15.31:0/2824160005 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46c005030 con 0x7fa47c0cdb30 2024-09-17T05:36:39.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.932+0000 7fa481200640 1 -- 172.21.15.31:0/2824160005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa47c15a6e0 con 0x7fa47c0cdb30 2024-09-17T05:36:39.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.932+0000 7fa481200640 1 -- 172.21.15.31:0/2824160005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa47c0cc9d0 con 0x7fa47c0cdb30 2024-09-17T05:36:39.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.932+0000 7fa472000640 1 -- 172.21.15.31:0/2824160005 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7fa46c0051d0 con 0x7fa47c0cdb30 2024-09-17T05:36:39.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.932+0000 7fa472000640 1 --2- 172.21.15.31:0/2824160005 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa458073c50 0x7fa458076110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:39.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.932+0000 7fa472000640 1 -- 172.21.15.31:0/2824160005 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5737+0+0 (secure 0 0 0) 0x7fa46c12c7c0 con 0x7fa47c0cdb30 2024-09-17T05:36:39.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.932+0000 7fa473e00640 1 --2- 172.21.15.31:0/2824160005 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa458073c50 0x7fa458076110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:39.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.936+0000 7fa473e00640 1 --2- 172.21.15.31:0/2824160005 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa458073c50 0x7fa458076110 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa47c09c110 tx=0x7fa4640091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:39.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:39.936+0000 7fa472000640 1 -- 172.21.15.31:0/2824160005 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa46c133070 con 0x7fa47c0cdb30 2024-09-17T05:36:40.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.148+0000 7fa481200640 1 -- 172.21.15.31:0/2824160005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa47c071710 con 0x7fa47c0cdb30 2024-09-17T05:36:40.152 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-09-17T05:36:40.148+0000 7f21d0200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:36:40.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.152+0000 7fa472000640 1 -- 172.21.15.31:0/2824160005 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v111) ==== 161+0+0 (secure 0 0 0) 0x7fa46c0164d0 con 0x7fa47c0cdb30 2024-09-17T05:36:40.154 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:36:40.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.156+0000 7fa481200640 1 -- 172.21.15.31:0/2824160005 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa458073c50 msgr2=0x7fa458076110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:40.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.156+0000 7fa481200640 1 --2- 172.21.15.31:0/2824160005 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa458073c50 0x7fa458076110 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa47c09c110 tx=0x7fa4640091e0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.156+0000 7fa481200640 1 -- 172.21.15.31:0/2824160005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa47c0cdb30 msgr2=0x7fa47c15a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:40.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.156+0000 7fa481200640 1 --2- 172.21.15.31:0/2824160005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa47c0cdb30 0x7fa47c15a1a0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fa46c009850 tx=0x7fa46c0a5730 comp rx=0 tx=0).stop 2024-09-17T05:36:40.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.156+0000 7fa481200640 1 -- 172.21.15.31:0/2824160005 shutdown_connections 2024-09-17T05:36:40.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.156+0000 7fa481200640 1 --2- 172.21.15.31:0/2824160005 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa458073c50 0x7fa458076110 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.156+0000 7fa481200640 1 --2- 172.21.15.31:0/2824160005 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47c15bea0 0x7fa47c165f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.156+0000 7fa481200640 1 --2- 172.21.15.31:0/2824160005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa47c0d28e0 0x7fa47c09e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.156+0000 7fa481200640 1 --2- 172.21.15.31:0/2824160005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa47c0cdb30 0x7fa47c15a1a0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.156+0000 7fa481200640 1 -- 172.21.15.31:0/2824160005 >> 172.21.15.31:0/2824160005 conn(0x7fa47c0d1dc0 msgr2=0x7fa47c070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:40.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.156+0000 7fa481200640 1 -- 172.21.15.31:0/2824160005 shutdown_connections 2024-09-17T05:36:40.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.156+0000 7fa481200640 1 -- 172.21.15.31:0/2824160005 wait complete. 2024-09-17T05:36:40.178 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:36:40.224 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-17T05:36:40.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.328+0000 7f3ae9600640 1 -- 172.21.15.31:0/30406500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae40b1190 msgr2=0x7f3ae40ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:40.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.328+0000 7f3ae9600640 1 --2- 172.21.15.31:0/30406500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae40b1190 0x7f3ae40ce270 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009840 tx=0x7f3ad001c7f0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.328+0000 7f3ae9600640 1 -- 172.21.15.31:0/30406500 shutdown_connections 2024-09-17T05:36:40.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.328+0000 7f3ae9600640 1 --2- 172.21.15.31:0/30406500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ae40ce7b0 0x7f3ae40cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.328+0000 7f3ae9600640 1 --2- 172.21.15.31:0/30406500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae40b1190 0x7f3ae40ce270 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.328+0000 7f3ae9600640 1 -- 172.21.15.31:0/30406500 >> 172.21.15.31:0/30406500 conn(0x7f3ae40d1df0 msgr2=0x7f3ae40d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:40.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.328+0000 7f3ae9600640 1 -- 172.21.15.31:0/30406500 shutdown_connections 2024-09-17T05:36:40.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.328+0000 7f3ae9600640 1 -- 172.21.15.31:0/30406500 wait complete. 2024-09-17T05:36:40.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.328+0000 7f3ae9600640 1 Processor -- start 2024-09-17T05:36:40.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae9600640 1 -- start start 2024-09-17T05:36:40.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae9600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ae40b1190 0x7f3ae40cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae9600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae40ce7b0 0x7f3ae41f88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae9600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ae41603f0 0x7f3ae40b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae9600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae40b3410 con 0x7f3ae40ce7b0 2024-09-17T05:36:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae9600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae40b3290 con 0x7f3ae41603f0 2024-09-17T05:36:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae9600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae41694f0 con 0x7f3ae40b1190 2024-09-17T05:36:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae2000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae40ce7b0 0x7f3ae41f88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae2000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae40ce7b0 0x7f3ae41f88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44500/0 (socket says 172.21.15.31:44500) 2024-09-17T05:36:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae2000640 1 -- 172.21.15.31:0/3164785214 learned_addr learned my addr 172.21.15.31:0/3164785214 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae2a00640 1 --2- 172.21.15.31:0/3164785214 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ae40b1190 0x7f3ae40cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae3400640 1 --2- 172.21.15.31:0/3164785214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ae41603f0 0x7f3ae40b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae2000640 1 -- 172.21.15.31:0/3164785214 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ae40b1190 msgr2=0x7f3ae40cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae2000640 1 --2- 172.21.15.31:0/3164785214 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ae40b1190 0x7f3ae40cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae2000640 1 -- 172.21.15.31:0/3164785214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ae41603f0 msgr2=0x7f3ae40b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:40.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae2000640 1 --2- 172.21.15.31:0/3164785214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ae41603f0 0x7f3ae40b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:40.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae2000640 1 -- 172.21.15.31:0/3164785214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae41fb4e0 con 0x7f3ae40ce7b0 2024-09-17T05:36:40.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae2000640 1 --2- 172.21.15.31:0/3164785214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae40ce7b0 0x7f3ae41f88e0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009790 tx=0x7f3ad00040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:40.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3adaa00640 1 -- 172.21.15.31:0/3164785214 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad00b2040 con 0x7f3ae40ce7b0 2024-09-17T05:36:40.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3adaa00640 1 -- 172.21.15.31:0/3164785214 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ad0005020 con 0x7f3ae40ce7b0 2024-09-17T05:36:40.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae9600640 1 -- 172.21.15.31:0/3164785214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae41fb7c0 con 0x7f3ae40ce7b0 2024-09-17T05:36:40.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3adaa00640 1 -- 172.21.15.31:0/3164785214 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0005450 con 0x7f3ae40ce7b0 2024-09-17T05:36:40.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae9600640 1 -- 172.21.15.31:0/3164785214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae41fbd80 con 0x7f3ae40ce7b0 2024-09-17T05:36:40.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.332+0000 7f3ae9600640 1 -- 172.21.15.31:0/3164785214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ae40cf920 con 0x7f3ae40ce7b0 2024-09-17T05:36:40.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.336+0000 7f3adaa00640 1 -- 172.21.15.31:0/3164785214 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f3ad00be060 con 0x7f3ae40ce7b0 2024-09-17T05:36:40.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.336+0000 7f3adaa00640 1 --2- 172.21.15.31:0/3164785214 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3ac4073c20 0x7f3ac40760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:40.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.336+0000 7f3adaa00640 1 -- 172.21.15.31:0/3164785214 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5823+0+0 (secure 0 0 0) 0x7f3ad012c580 con 0x7f3ae40ce7b0 2024-09-17T05:36:40.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.336+0000 7f3ae2a00640 1 --2- 172.21.15.31:0/3164785214 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3ac4073c20 0x7f3ac40760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:40.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.336+0000 7f3ae2a00640 1 --2- 172.21.15.31:0/3164785214 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3ac4073c20 0x7f3ac40760e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4007fd0 tx=0x7f3ad4007ea0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:40.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.340+0000 7f3adaa00640 1 -- 172.21.15.31:0/3164785214 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f3ad0016410 con 0x7f3ae40ce7b0 2024-09-17T05:36:40.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:40.556+0000 7f3ae9600640 1 -- 172.21.15.31:0/3164785214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3ae40ce270 con 0x7f3ae40ce7b0 2024-09-17T05:36:41.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.156+0000 7f3adaa00640 1 -- 172.21.15.31:0/3164785214 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v112) ==== 104+0+0 (secure 0 0 0) 0x7f3ad00f8810 con 0x7f3ae40ce7b0 2024-09-17T05:36:41.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.160+0000 7f3ae9600640 1 -- 172.21.15.31:0/3164785214 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3ac4073c20 msgr2=0x7f3ac40760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:41.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.160+0000 7f3ae9600640 1 --2- 172.21.15.31:0/3164785214 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3ac4073c20 0x7f3ac40760e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4007fd0 tx=0x7f3ad4007ea0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.160+0000 7f3ae9600640 1 -- 172.21.15.31:0/3164785214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae40ce7b0 msgr2=0x7f3ae41f88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:41.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.160+0000 7f3ae9600640 1 --2- 172.21.15.31:0/3164785214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae40ce7b0 0x7f3ae41f88e0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009790 tx=0x7f3ad00040c0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.160+0000 7f3ae9600640 1 -- 172.21.15.31:0/3164785214 shutdown_connections 2024-09-17T05:36:41.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.160+0000 7f3ae9600640 1 --2- 172.21.15.31:0/3164785214 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3ac4073c20 0x7f3ac40760e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.160+0000 7f3ae9600640 1 --2- 172.21.15.31:0/3164785214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ae41603f0 0x7f3ae40b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.160+0000 7f3ae9600640 1 --2- 172.21.15.31:0/3164785214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae40ce7b0 0x7f3ae41f88e0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.160+0000 7f3ae9600640 1 --2- 172.21.15.31:0/3164785214 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ae40b1190 0x7f3ae40cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.160+0000 7f3ae9600640 1 -- 172.21.15.31:0/3164785214 >> 172.21.15.31:0/3164785214 conn(0x7f3ae40d1df0 msgr2=0x7f3ae4165990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:41.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.160+0000 7f3ae9600640 1 -- 172.21.15.31:0/3164785214 shutdown_connections 2024-09-17T05:36:41.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.160+0000 7f3ae9600640 1 -- 172.21.15.31:0/3164785214 wait complete. 2024-09-17T05:36:41.186 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:36:41.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.340+0000 7ff49da00640 1 -- 172.21.15.31:0/2748282775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff49815be10 msgr2=0x7ff4980ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:41.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.340+0000 7ff49da00640 1 --2- 172.21.15.31:0/2748282775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff49815be10 0x7ff4980ce700 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7ff4980b0fb0 tx=0x7ff48801eff0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.340+0000 7ff49da00640 1 -- 172.21.15.31:0/2748282775 shutdown_connections 2024-09-17T05:36:41.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.340+0000 7ff49da00640 1 --2- 172.21.15.31:0/2748282775 >> v2:172.21.15.155:3300/0 conn(0x7ff4980b0b60 0x7ff4980ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.340+0000 7ff49da00640 1 --2- 172.21.15.31:0/2748282775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff49815be10 0x7ff4980ce700 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.340+0000 7ff49da00640 1 -- 172.21.15.31:0/2748282775 >> 172.21.15.31:0/2748282775 conn(0x7ff4980d1da0 msgr2=0x7ff4980d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:41.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.340+0000 7ff49da00640 1 -- 172.21.15.31:0/2748282775 shutdown_connections 2024-09-17T05:36:41.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.340+0000 7ff49da00640 1 -- 172.21.15.31:0/2748282775 wait complete. 2024-09-17T05:36:41.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.340+0000 7ff49da00640 1 Processor -- start 2024-09-17T05:36:41.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.340+0000 7ff49da00640 1 -- start start 2024-09-17T05:36:41.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.340+0000 7ff49da00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4980b0b60 0x7ff4980cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:41.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.340+0000 7ff49da00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff49815be10 0x7ff4981f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:41.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.340+0000 7ff49da00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff49815c1f0 0x7ff4980ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:41.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.340+0000 7ff49da00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff4980cd4a0 con 0x7ff4980b0b60 2024-09-17T05:36:41.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.340+0000 7ff49da00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff4980cd320 con 0x7ff49815be10 2024-09-17T05:36:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.340+0000 7ff49da00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff4980cd620 con 0x7ff49815c1f0 2024-09-17T05:36:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.344+0000 7ff496a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4980b0b60 0x7ff4980cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.344+0000 7ff496a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4980b0b60 0x7ff4980cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44506/0 (socket says 172.21.15.31:44506) 2024-09-17T05:36:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.344+0000 7ff496a00640 1 -- 172.21.15.31:0/3049682427 learned_addr learned my addr 172.21.15.31:0/3049682427 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.344+0000 7ff48fe00640 1 --2- 172.21.15.31:0/3049682427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff49815be10 0x7ff4981f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.344+0000 7ff497400640 1 --2- 172.21.15.31:0/3049682427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff49815c1f0 0x7ff4980ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.344+0000 7ff496a00640 1 -- 172.21.15.31:0/3049682427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff49815c1f0 msgr2=0x7ff4980ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.344+0000 7ff496a00640 1 --2- 172.21.15.31:0/3049682427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff49815c1f0 0x7ff4980ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.344+0000 7ff496a00640 1 -- 172.21.15.31:0/3049682427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff49815be10 msgr2=0x7ff4981f33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.344+0000 7ff496a00640 1 --2- 172.21.15.31:0/3049682427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff49815be10 0x7ff4981f33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.344+0000 7ff496a00640 1 -- 172.21.15.31:0/3049682427 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4980cbe30 con 0x7ff4980b0b60 2024-09-17T05:36:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.344+0000 7ff496a00640 1 --2- 172.21.15.31:0/3049682427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4980b0b60 0x7ff4980cb8f0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7ff488009790 tx=0x7ff4880a8ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.344+0000 7ff48ea00640 1 -- 172.21.15.31:0/3049682427 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4880b5040 con 0x7ff4980b0b60 2024-09-17T05:36:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.344+0000 7ff48ea00640 1 -- 172.21.15.31:0/3049682427 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff4880bf070 con 0x7ff4980b0b60 2024-09-17T05:36:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.344+0000 7ff49da00640 1 -- 172.21.15.31:0/3049682427 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4981f3900 con 0x7ff4980b0b60 2024-09-17T05:36:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.344+0000 7ff48ea00640 1 -- 172.21.15.31:0/3049682427 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4880b1c50 con 0x7ff4980b0b60 2024-09-17T05:36:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.344+0000 7ff49da00640 1 -- 172.21.15.31:0/3049682427 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4980b5db0 con 0x7ff4980b0b60 2024-09-17T05:36:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.344+0000 7ff49da00640 1 -- 172.21.15.31:0/3049682427 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4980cdb40 con 0x7ff4980b0b60 2024-09-17T05:36:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.344+0000 7ff48ea00640 1 -- 172.21.15.31:0/3049682427 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7ff488003600 con 0x7ff4980b0b60 2024-09-17T05:36:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.348+0000 7ff48ea00640 1 --2- 172.21.15.31:0/3049682427 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff474073c20 0x7ff4740760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.348+0000 7ff48ea00640 1 -- 172.21.15.31:0/3049682427 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5823+0+0 (secure 0 0 0) 0x7ff4881306d0 con 0x7ff4980b0b60 2024-09-17T05:36:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.348+0000 7ff48fe00640 1 --2- 172.21.15.31:0/3049682427 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff474073c20 0x7ff4740760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:41.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.348+0000 7ff48fe00640 1 --2- 172.21.15.31:0/3049682427 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff474073c20 0x7ff4740760e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff49809fc70 tx=0x7ff480009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:41.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.352+0000 7ff48ea00640 1 -- 172.21.15.31:0/3049682427 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff488138020 con 0x7ff4980b0b60 2024-09-17T05:36:41.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:41.528+0000 7ff49da00640 1 -- 172.21.15.31:0/3049682427 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff498070350 con 0x7ff4980b0b60 2024-09-17T05:36:42.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.160+0000 7ff48ea00640 1 -- 172.21.15.31:0/3049682427 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v154) ==== 181+0+0 (secure 0 0 0) 0x7ff4880c9020 con 0x7ff4980b0b60 2024-09-17T05:36:42.162 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:36:42.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.160+0000 7ff49da00640 1 -- 172.21.15.31:0/3049682427 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff474073c20 msgr2=0x7ff4740760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:42.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.160+0000 7ff49da00640 1 --2- 172.21.15.31:0/3049682427 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff474073c20 0x7ff4740760e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff49809fc70 tx=0x7ff480009040 comp rx=0 tx=0).stop 2024-09-17T05:36:42.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.160+0000 7ff49da00640 1 -- 172.21.15.31:0/3049682427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4980b0b60 msgr2=0x7ff4980cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:42.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.160+0000 7ff49da00640 1 --2- 172.21.15.31:0/3049682427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4980b0b60 0x7ff4980cb8f0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7ff488009790 tx=0x7ff4880a8ca0 comp rx=0 tx=0).stop 2024-09-17T05:36:42.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.164+0000 7ff49da00640 1 -- 172.21.15.31:0/3049682427 shutdown_connections 2024-09-17T05:36:42.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.164+0000 7ff49da00640 1 --2- 172.21.15.31:0/3049682427 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff474073c20 0x7ff4740760e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:42.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.164+0000 7ff49da00640 1 --2- 172.21.15.31:0/3049682427 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff49815c1f0 0x7ff4980ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:42.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.164+0000 7ff49da00640 1 --2- 172.21.15.31:0/3049682427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff49815be10 0x7ff4981f33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:42.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.164+0000 7ff49da00640 1 --2- 172.21.15.31:0/3049682427 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4980b0b60 0x7ff4980cb8f0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:42.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.164+0000 7ff49da00640 1 -- 172.21.15.31:0/3049682427 >> 172.21.15.31:0/3049682427 conn(0x7ff4980d1da0 msgr2=0x7ff4980cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:42.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.164+0000 7ff49da00640 1 -- 172.21.15.31:0/3049682427 shutdown_connections 2024-09-17T05:36:42.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.164+0000 7ff49da00640 1 -- 172.21.15.31:0/3049682427 wait complete. 2024-09-17T05:36:42.190 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:36:42.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.348+0000 7fbee4a00640 1 -- 172.21.15.31:0/1778908996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbee015be10 msgr2=0x7fbee00ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:42.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.348+0000 7fbee4a00640 1 --2- 172.21.15.31:0/1778908996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbee015be10 0x7fbee00ce700 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009900 tx=0x7fbed001f0d0 comp rx=0 tx=0).stop 2024-09-17T05:36:42.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.348+0000 7fbee4a00640 1 -- 172.21.15.31:0/1778908996 shutdown_connections 2024-09-17T05:36:42.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.348+0000 7fbee4a00640 1 --2- 172.21.15.31:0/1778908996 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbee015c1f0 0x7fbee00cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:42.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.348+0000 7fbee4a00640 1 --2- 172.21.15.31:0/1778908996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbee015be10 0x7fbee00ce700 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:42.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.348+0000 7fbee4a00640 1 -- 172.21.15.31:0/1778908996 >> 172.21.15.31:0/1778908996 conn(0x7fbee00d1da0 msgr2=0x7fbee00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:42.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.348+0000 7fbee4a00640 1 -- 172.21.15.31:0/1778908996 shutdown_connections 2024-09-17T05:36:42.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.348+0000 7fbee4a00640 1 -- 172.21.15.31:0/1778908996 wait complete. 2024-09-17T05:36:42.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.348+0000 7fbee4a00640 1 Processor -- start 2024-09-17T05:36:42.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.348+0000 7fbee4a00640 1 -- start start 2024-09-17T05:36:42.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.348+0000 7fbee4a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbee00b0b60 0x7fbee006e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:42.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.348+0000 7fbee4a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbee015be10 0x7fbee006f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:42.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.348+0000 7fbee4a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbee015c1f0 0x7fbee01f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:42.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.348+0000 7fbee4a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbee00cf510 con 0x7fbee015c1f0 2024-09-17T05:36:42.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.348+0000 7fbee4a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbee00cf390 con 0x7fbee015be10 2024-09-17T05:36:42.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.348+0000 7fbee4a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbee0160290 con 0x7fbee00b0b60 2024-09-17T05:36:42.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.352+0000 7fbede800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbee015c1f0 0x7fbee01f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:42.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.352+0000 7fbed7e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbee015be10 0x7fbee006f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:42.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.352+0000 7fbedde00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbee00b0b60 0x7fbee006e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:42.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.352+0000 7fbede800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbee015c1f0 0x7fbee01f4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44532/0 (socket says 172.21.15.31:44532) 2024-09-17T05:36:42.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.352+0000 7fbede800640 1 -- 172.21.15.31:0/1169500576 learned_addr learned my addr 172.21.15.31:0/1169500576 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:42.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.352+0000 7fbede800640 1 -- 172.21.15.31:0/1169500576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbee00b0b60 msgr2=0x7fbee006e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:42.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.352+0000 7fbede800640 1 --2- 172.21.15.31:0/1169500576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbee00b0b60 0x7fbee006e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:42.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.352+0000 7fbede800640 1 -- 172.21.15.31:0/1169500576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbee015be10 msgr2=0x7fbee006f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:42.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.352+0000 7fbede800640 1 --2- 172.21.15.31:0/1169500576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbee015be10 0x7fbee006f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:42.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.352+0000 7fbede800640 1 -- 172.21.15.31:0/1169500576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee01f4680 con 0x7fbee015c1f0 2024-09-17T05:36:42.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.352+0000 7fbede800640 1 --2- 172.21.15.31:0/1169500576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbee015c1f0 0x7fbee01f4140 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fbed800c7f0 tx=0x7fbed800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:42.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.352+0000 7fbed6000640 1 -- 172.21.15.31:0/1169500576 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed8003b80 con 0x7fbee015c1f0 2024-09-17T05:36:42.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.352+0000 7fbed6000640 1 -- 172.21.15.31:0/1169500576 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbed8003d20 con 0x7fbee015c1f0 2024-09-17T05:36:42.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.352+0000 7fbed6000640 1 -- 172.21.15.31:0/1169500576 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed800aab0 con 0x7fbee015c1f0 2024-09-17T05:36:42.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.352+0000 7fbee4a00640 1 -- 172.21.15.31:0/1169500576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee00b62d0 con 0x7fbee015c1f0 2024-09-17T05:36:42.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.352+0000 7fbee4a00640 1 -- 172.21.15.31:0/1169500576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee00b6890 con 0x7fbee015c1f0 2024-09-17T05:36:42.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.352+0000 7fbee4a00640 1 -- 172.21.15.31:0/1169500576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee0160780 con 0x7fbee015c1f0 2024-09-17T05:36:42.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.352+0000 7fbed6000640 1 -- 172.21.15.31:0/1169500576 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7fbed800ac50 con 0x7fbee015c1f0 2024-09-17T05:36:42.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.356+0000 7fbed6000640 1 --2- 172.21.15.31:0/1169500576 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbebc073c20 0x7fbebc0760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:42.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.356+0000 7fbed6000640 1 -- 172.21.15.31:0/1169500576 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5385+0+0 (secure 0 0 0) 0x7fbed8092a80 con 0x7fbee015c1f0 2024-09-17T05:36:42.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.356+0000 7fbedde00640 1 --2- 172.21.15.31:0/1169500576 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbebc073c20 0x7fbebc0760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.356+0000 7fbedde00640 1 --2- 172.21.15.31:0/1169500576 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbebc073c20 0x7fbebc0760e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbed00b2000 tx=0x7fbed00aa040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.360+0000 7fbed6000640 1 -- 172.21.15.31:0/1169500576 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fbee01f4680 con 0x7fbee015c1f0 2024-09-17T05:36:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:42.536+0000 7fbee4a00640 1 -- 172.21.15.31:0/1169500576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbee0070350 con 0x7fbee015c1f0 2024-09-17T05:36:42.772 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:36:42.775 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:36:43.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.168+0000 7fbed6000640 1 -- 172.21.15.31:0/1169500576 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v155) ==== 169+0+0 (secure 0 0 0) 0x7fbed805ecd0 con 0x7fbee015c1f0 2024-09-17T05:36:43.170 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-09-17T05:36:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.168+0000 7fbee4a00640 1 -- 172.21.15.31:0/1169500576 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbebc073c20 msgr2=0x7fbebc0760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.168+0000 7fbee4a00640 1 --2- 172.21.15.31:0/1169500576 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbebc073c20 0x7fbebc0760e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbed00b2000 tx=0x7fbed00aa040 comp rx=0 tx=0).stop 2024-09-17T05:36:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.168+0000 7fbee4a00640 1 -- 172.21.15.31:0/1169500576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbee015c1f0 msgr2=0x7fbee01f4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.168+0000 7fbee4a00640 1 --2- 172.21.15.31:0/1169500576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbee015c1f0 0x7fbee01f4140 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fbed800c7f0 tx=0x7fbed800ccb0 comp rx=0 tx=0).stop 2024-09-17T05:36:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.168+0000 7fbee4a00640 1 -- 172.21.15.31:0/1169500576 shutdown_connections 2024-09-17T05:36:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.168+0000 7fbee4a00640 1 --2- 172.21.15.31:0/1169500576 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbebc073c20 0x7fbebc0760e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.168+0000 7fbee4a00640 1 --2- 172.21.15.31:0/1169500576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbee015c1f0 0x7fbee01f4140 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.168+0000 7fbee4a00640 1 --2- 172.21.15.31:0/1169500576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbee015be10 0x7fbee006f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.168+0000 7fbee4a00640 1 --2- 172.21.15.31:0/1169500576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbee00b0b60 0x7fbee006e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.168+0000 7fbee4a00640 1 -- 172.21.15.31:0/1169500576 >> 172.21.15.31:0/1169500576 conn(0x7fbee00d1da0 msgr2=0x7fbee00b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:43.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.172+0000 7fbee4a00640 1 -- 172.21.15.31:0/1169500576 shutdown_connections 2024-09-17T05:36:43.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.172+0000 7fbee4a00640 1 -- 172.21.15.31:0/1169500576 wait complete. 2024-09-17T05:36:43.199 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:36:43.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.344+0000 7f1d38800640 1 -- 172.21.15.31:0/72015452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d3015bfa0 msgr2=0x7f1d300cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:43.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.344+0000 7f1d38800640 1 --2- 172.21.15.31:0/72015452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d3015bfa0 0x7f1d300cd000 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009900 tx=0x7f1d2001f090 comp rx=0 tx=0).stop 2024-09-17T05:36:43.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.344+0000 7f1d38800640 1 -- 172.21.15.31:0/72015452 shutdown_connections 2024-09-17T05:36:43.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.344+0000 7f1d38800640 1 --2- 172.21.15.31:0/72015452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d300cd540 0x7f1d3015f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:43.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.344+0000 7f1d38800640 1 --2- 172.21.15.31:0/72015452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d3015bfa0 0x7f1d300cd000 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:43.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.344+0000 7f1d38800640 1 --2- 172.21.15.31:0/72015452 >> v2:172.21.15.155:3300/0 conn(0x7f1d3015c3e0 0x7f1d3015c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:43.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.344+0000 7f1d38800640 1 -- 172.21.15.31:0/72015452 >> 172.21.15.31:0/72015452 conn(0x7f1d300b18f0 msgr2=0x7f1d300b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:43.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.344+0000 7f1d38800640 1 -- 172.21.15.31:0/72015452 shutdown_connections 2024-09-17T05:36:43.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.344+0000 7f1d38800640 1 -- 172.21.15.31:0/72015452 wait complete. 2024-09-17T05:36:43.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d38800640 1 Processor -- start 2024-09-17T05:36:43.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d38800640 1 -- start start 2024-09-17T05:36:43.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d38800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d300cd540 0x7f1d301f8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:43.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d38800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d3015bfa0 0x7f1d300cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:43.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d38800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d3015c3e0 0x7f1d30159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:43.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d38800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3015ffd0 con 0x7f1d3015c3e0 2024-09-17T05:36:43.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d38800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3015fe50 con 0x7f1d3015bfa0 2024-09-17T05:36:43.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d38800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1d30160150 con 0x7f1d300cd540 2024-09-17T05:36:43.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d36800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d3015c3e0 0x7f1d30159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:43.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d35e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d300cd540 0x7f1d301f8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:43.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d36800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d3015c3e0 0x7f1d30159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44558/0 (socket says 172.21.15.31:44558) 2024-09-17T05:36:43.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d36800640 1 -- 172.21.15.31:0/2612253340 learned_addr learned my addr 172.21.15.31:0/2612253340 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:43.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d35400640 1 --2- 172.21.15.31:0/2612253340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d3015bfa0 0x7f1d300cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:43.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d36800640 1 -- 172.21.15.31:0/2612253340 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d300cd540 msgr2=0x7f1d301f8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:43.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d36800640 1 --2- 172.21.15.31:0/2612253340 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d300cd540 0x7f1d301f8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:43.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d36800640 1 -- 172.21.15.31:0/2612253340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d3015bfa0 msgr2=0x7f1d300cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:43.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d36800640 1 --2- 172.21.15.31:0/2612253340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d3015bfa0 0x7f1d300cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:43.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d36800640 1 -- 172.21.15.31:0/2612253340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d300b2f00 con 0x7f1d3015c3e0 2024-09-17T05:36:43.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d36800640 1 --2- 172.21.15.31:0/2612253340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d3015c3e0 0x7f1d30159840 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00ca90 tx=0x7f1d2c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:43.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d2a000640 1 -- 172.21.15.31:0/2612253340 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c007df0 con 0x7f1d3015c3e0 2024-09-17T05:36:43.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d2a000640 1 -- 172.21.15.31:0/2612253340 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d2c00f450 con 0x7f1d3015c3e0 2024-09-17T05:36:43.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d2a000640 1 -- 172.21.15.31:0/2612253340 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c00f8c0 con 0x7f1d3015c3e0 2024-09-17T05:36:43.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d38800640 1 -- 172.21.15.31:0/2612253340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d300b31e0 con 0x7f1d3015c3e0 2024-09-17T05:36:43.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d38800640 1 -- 172.21.15.31:0/2612253340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d30159d80 con 0x7f1d3015c3e0 2024-09-17T05:36:43.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.348+0000 7f1d38800640 1 -- 172.21.15.31:0/2612253340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d30069410 con 0x7f1d3015c3e0 2024-09-17T05:36:43.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.352+0000 7f1d2a000640 1 -- 172.21.15.31:0/2612253340 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f1d2c00fa60 con 0x7f1d3015c3e0 2024-09-17T05:36:43.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.352+0000 7f1d2a000640 1 --2- 172.21.15.31:0/2612253340 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1d14073c50 0x7f1d14076110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:43.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.352+0000 7f1d2a000640 1 -- 172.21.15.31:0/2612253340 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 4971+0+0 (secure 0 0 0) 0x7f1d2c093670 con 0x7f1d3015c3e0 2024-09-17T05:36:43.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.352+0000 7f1d35e00640 1 --2- 172.21.15.31:0/2612253340 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1d14073c50 0x7f1d14076110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:43.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.352+0000 7f1d35e00640 1 --2- 172.21.15.31:0/2612253340 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1d14073c50 0x7f1d14076110 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400ab40 tx=0x7f1d2400a250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:43.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.356+0000 7f1d2a000640 1 -- 172.21.15.31:0/2612253340 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f1d2c014030 con 0x7f1d3015c3e0 2024-09-17T05:36:43.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.532+0000 7f1d38800640 1 -- 172.21.15.31:0/2612253340 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f1d30160630 con 0x7f1d3015c3e0 2024-09-17T05:36:43.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.536+0000 7f1d2a000640 1 -- 172.21.15.31:0/2612253340 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v47) ==== 71+0+0 (secure 0 0 0) 0x7f1d2c05f900 con 0x7f1d3015c3e0 2024-09-17T05:36:43.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.540+0000 7f1d38800640 1 -- 172.21.15.31:0/2612253340 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1d14073c50 msgr2=0x7f1d14076110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:43.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.540+0000 7f1d38800640 1 --2- 172.21.15.31:0/2612253340 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1d14073c50 0x7f1d14076110 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400ab40 tx=0x7f1d2400a250 comp rx=0 tx=0).stop 2024-09-17T05:36:43.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.540+0000 7f1d38800640 1 -- 172.21.15.31:0/2612253340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d3015c3e0 msgr2=0x7f1d30159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:43.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.540+0000 7f1d38800640 1 --2- 172.21.15.31:0/2612253340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d3015c3e0 0x7f1d30159840 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00ca90 tx=0x7f1d2c00cf50 comp rx=0 tx=0).stop 2024-09-17T05:36:43.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.540+0000 7f1d38800640 1 -- 172.21.15.31:0/2612253340 shutdown_connections 2024-09-17T05:36:43.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.540+0000 7f1d38800640 1 --2- 172.21.15.31:0/2612253340 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1d14073c50 0x7f1d14076110 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:43.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.540+0000 7f1d38800640 1 --2- 172.21.15.31:0/2612253340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d3015c3e0 0x7f1d30159840 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:43.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.540+0000 7f1d38800640 1 --2- 172.21.15.31:0/2612253340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d3015bfa0 0x7f1d300cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:43.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.540+0000 7f1d38800640 1 --2- 172.21.15.31:0/2612253340 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d300cd540 0x7f1d301f8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:43.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.540+0000 7f1d38800640 1 -- 172.21.15.31:0/2612253340 >> 172.21.15.31:0/2612253340 conn(0x7f1d300b18f0 msgr2=0x7f1d300b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:43.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.540+0000 7f1d38800640 1 -- 172.21.15.31:0/2612253340 shutdown_connections 2024-09-17T05:36:43.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.540+0000 7f1d38800640 1 -- 172.21.15.31:0/2612253340 wait complete. 2024-09-17T05:36:43.563 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2' 2024-09-17T05:36:43.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.708+0000 7fb49fe00640 1 -- 172.21.15.31:0/3569883083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49815c1c0 msgr2=0x7fb498071740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:43.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.708+0000 7fb49fe00640 1 --2- 172.21.15.31:0/3569883083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49815c1c0 0x7fb498071740 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fb490009bf0 tx=0x7fb49001cba0 comp rx=0 tx=0).stop 2024-09-17T05:36:43.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.708+0000 7fb49fe00640 1 -- 172.21.15.31:0/3569883083 shutdown_connections 2024-09-17T05:36:43.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.708+0000 7fb49fe00640 1 --2- 172.21.15.31:0/3569883083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49815c1c0 0x7fb498071740 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:43.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.708+0000 7fb49fe00640 1 -- 172.21.15.31:0/3569883083 >> 172.21.15.31:0/3569883083 conn(0x7fb4980d0c90 msgr2=0x7fb4980d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:43.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.708+0000 7fb49fe00640 1 -- 172.21.15.31:0/3569883083 shutdown_connections 2024-09-17T05:36:43.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.708+0000 7fb49fe00640 1 -- 172.21.15.31:0/3569883083 wait complete. 2024-09-17T05:36:43.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.708+0000 7fb49fe00640 1 Processor -- start 2024-09-17T05:36:43.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.708+0000 7fb49fe00640 1 -- start start 2024-09-17T05:36:43.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb49806cc20 0x7fb498154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:43.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49fe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4980737c0 0x7fb4980c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:43.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49815c1c0 0x7fb4980b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:43.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49fe00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb49816a900 con 0x7fb49815c1c0 2024-09-17T05:36:43.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49fe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb49816a780 con 0x7fb4980737c0 2024-09-17T05:36:43.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49fe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb49816aa80 con 0x7fb49806cc20 2024-09-17T05:36:43.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49815c1c0 0x7fb4980b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:43.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49815c1c0 0x7fb4980b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44588/0 (socket says 172.21.15.31:44588) 2024-09-17T05:36:43.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49de00640 1 -- 172.21.15.31:0/611983315 learned_addr learned my addr 172.21.15.31:0/611983315 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:43.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49ca00640 1 --2- 172.21.15.31:0/611983315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4980737c0 0x7fb4980c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:43.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49d400640 1 --2- 172.21.15.31:0/611983315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb49806cc20 0x7fb498154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:43.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49de00640 1 -- 172.21.15.31:0/611983315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb49806cc20 msgr2=0x7fb498154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:43.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49de00640 1 --2- 172.21.15.31:0/611983315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb49806cc20 0x7fb498154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:43.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49de00640 1 -- 172.21.15.31:0/611983315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4980737c0 msgr2=0x7fb4980c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:43.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49de00640 1 --2- 172.21.15.31:0/611983315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4980737c0 0x7fb4980c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:43.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49de00640 1 -- 172.21.15.31:0/611983315 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4980c6fc0 con 0x7fb49815c1c0 2024-09-17T05:36:43.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49d400640 1 --2- 172.21.15.31:0/611983315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb49806cc20 0x7fb498154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:43.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49de00640 1 --2- 172.21.15.31:0/611983315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49815c1c0 0x7fb4980b61e0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fb49001c610 tx=0x7fb490005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:43.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb495600640 1 -- 172.21.15.31:0/611983315 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4900b2040 con 0x7fb49815c1c0 2024-09-17T05:36:43.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb495600640 1 -- 172.21.15.31:0/611983315 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4900bb070 con 0x7fb49815c1c0 2024-09-17T05:36:43.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb495600640 1 -- 172.21.15.31:0/611983315 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490004530 con 0x7fb49815c1c0 2024-09-17T05:36:43.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49fe00640 1 -- 172.21.15.31:0/611983315 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4980b2c60 con 0x7fb49815c1c0 2024-09-17T05:36:43.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49fe00640 1 -- 172.21.15.31:0/611983315 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4980b3220 con 0x7fb49815c1c0 2024-09-17T05:36:43.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.712+0000 7fb49fe00640 1 -- 172.21.15.31:0/611983315 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb49806d000 con 0x7fb49815c1c0 2024-09-17T05:36:43.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.716+0000 7fb495600640 1 -- 172.21.15.31:0/611983315 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7fb4900046d0 con 0x7fb49815c1c0 2024-09-17T05:36:43.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.716+0000 7fb495600640 1 --2- 172.21.15.31:0/611983315 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb478073c50 0x7fb478076110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:43.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.716+0000 7fb495600640 1 -- 172.21.15.31:0/611983315 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 4971+0+0 (secure 0 0 0) 0x7fb49012d420 con 0x7fb49815c1c0 2024-09-17T05:36:43.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.716+0000 7fb49d400640 1 --2- 172.21.15.31:0/611983315 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb478073c50 0x7fb478076110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:43.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.716+0000 7fb49d400640 1 --2- 172.21.15.31:0/611983315 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb478073c50 0x7fb478076110 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb48c007a60 tx=0x7fb48c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:43.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.720+0000 7fb495600640 1 -- 172.21.15.31:0/611983315 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb4900a5e20 con 0x7fb49815c1c0 2024-09-17T05:36:43.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:43.956+0000 7fb49fe00640 1 -- 172.21.15.31:0/611983315 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]} v 0) -- 0x7fb4980b6c10 con 0x7fb49815c1c0 2024-09-17T05:36:44.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.168+0000 7fb495600640 1 -- 172.21.15.31:0/611983315 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]}]=0 v445) ==== 145+0+0 (secure 0 0 0) 0x7fb490016790 con 0x7fb49815c1c0 2024-09-17T05:36:44.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.172+0000 7fb49fe00640 1 -- 172.21.15.31:0/611983315 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb478073c50 msgr2=0x7fb478076110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:44.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.172+0000 7fb49fe00640 1 --2- 172.21.15.31:0/611983315 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb478073c50 0x7fb478076110 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb48c007a60 tx=0x7fb48c009040 comp rx=0 tx=0).stop 2024-09-17T05:36:44.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.172+0000 7fb49fe00640 1 -- 172.21.15.31:0/611983315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49815c1c0 msgr2=0x7fb4980b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:44.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.172+0000 7fb49fe00640 1 --2- 172.21.15.31:0/611983315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49815c1c0 0x7fb4980b61e0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fb49001c610 tx=0x7fb490005a60 comp rx=0 tx=0).stop 2024-09-17T05:36:44.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.172+0000 7fb49fe00640 1 -- 172.21.15.31:0/611983315 shutdown_connections 2024-09-17T05:36:44.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.172+0000 7fb49fe00640 1 --2- 172.21.15.31:0/611983315 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb478073c50 0x7fb478076110 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.172+0000 7fb49fe00640 1 --2- 172.21.15.31:0/611983315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb49815c1c0 0x7fb4980b61e0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.172+0000 7fb49fe00640 1 --2- 172.21.15.31:0/611983315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4980737c0 0x7fb4980c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.172+0000 7fb49fe00640 1 --2- 172.21.15.31:0/611983315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb49806cc20 0x7fb498154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.172+0000 7fb49fe00640 1 -- 172.21.15.31:0/611983315 >> 172.21.15.31:0/611983315 conn(0x7fb4980d0c90 msgr2=0x7fb4980ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:44.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.172+0000 7fb49fe00640 1 -- 172.21.15.31:0/611983315 shutdown_connections 2024-09-17T05:36:44.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.172+0000 7fb49fe00640 1 -- 172.21.15.31:0/611983315 wait complete. 2024-09-17T05:36:44.194 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- theme continues... ... ok 2024-09-17T05:36:44.194 INFO:tasks.cephfs_test_runner:Starting test: test_unparseable_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate unparseable text .meta file on legacy subvol root doesn't break the system 2024-09-17T05:36:44.194 INFO:tasks.cephfs_test_runner:test_unparseable_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:36:44.194 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:44.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.344+0000 7f5ade800640 1 -- 172.21.15.31:0/4221909032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ad815bea0 msgr2=0x7f5ad80ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:44.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.344+0000 7f5ade800640 1 --2- 172.21.15.31:0/4221909032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ad815bea0 0x7f5ad80ce670 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009840 tx=0x7f5ac801c820 comp rx=0 tx=0).stop 2024-09-17T05:36:44.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.344+0000 7f5ade800640 1 -- 172.21.15.31:0/4221909032 shutdown_connections 2024-09-17T05:36:44.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.344+0000 7f5ade800640 1 --2- 172.21.15.31:0/4221909032 >> v2:172.21.15.155:3300/0 conn(0x7f5ad80d28e0 0x7f5ad80cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.344+0000 7f5ade800640 1 --2- 172.21.15.31:0/4221909032 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ad815bea0 0x7f5ad80ce670 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.344+0000 7f5ade800640 1 -- 172.21.15.31:0/4221909032 >> 172.21.15.31:0/4221909032 conn(0x7f5ad80d1dc0 msgr2=0x7f5ad80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:44.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.344+0000 7f5ade800640 1 -- 172.21.15.31:0/4221909032 shutdown_connections 2024-09-17T05:36:44.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.344+0000 7f5ade800640 1 -- 172.21.15.31:0/4221909032 wait complete. 2024-09-17T05:36:44.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ade800640 1 Processor -- start 2024-09-17T05:36:44.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ade800640 1 -- start start 2024-09-17T05:36:44.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ade800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ad80cdb30 0x7f5ad8148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:44.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ade800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ad80d28e0 0x7f5ad8158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:44.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ade800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ad815bea0 0x7f5ad8159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:44.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ade800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad8168fc0 con 0x7f5ad80cdb30 2024-09-17T05:36:44.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ade800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad8168e40 con 0x7f5ad815bea0 2024-09-17T05:36:44.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ade800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad8169140 con 0x7f5ad80d28e0 2024-09-17T05:36:44.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ad7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ad80cdb30 0x7f5ad8148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:44.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ad7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ad80cdb30 0x7f5ad8148ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44604/0 (socket says 172.21.15.31:44604) 2024-09-17T05:36:44.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ad7400640 1 -- 172.21.15.31:0/2390672415 learned_addr learned my addr 172.21.15.31:0/2390672415 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:44.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ad7e00640 1 --2- 172.21.15.31:0/2390672415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ad815bea0 0x7f5ad8159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:44.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5acfe00640 1 --2- 172.21.15.31:0/2390672415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ad80d28e0 0x7f5ad8158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:44.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ad7400640 1 -- 172.21.15.31:0/2390672415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ad80d28e0 msgr2=0x7f5ad8158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:44.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ad7400640 1 --2- 172.21.15.31:0/2390672415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ad80d28e0 0x7f5ad8158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ad7400640 1 -- 172.21.15.31:0/2390672415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ad815bea0 msgr2=0x7f5ad8159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:44.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ad7400640 1 --2- 172.21.15.31:0/2390672415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ad815bea0 0x7f5ad8159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ad7400640 1 -- 172.21.15.31:0/2390672415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad8149010 con 0x7f5ad80cdb30 2024-09-17T05:36:44.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ad7400640 1 --2- 172.21.15.31:0/2390672415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ad80cdb30 0x7f5ad8148ad0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009790 tx=0x7f5ac80a5670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:44.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5acf400640 1 -- 172.21.15.31:0/2390672415 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac80bb070 con 0x7f5ad80cdb30 2024-09-17T05:36:44.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5acf400640 1 -- 172.21.15.31:0/2390672415 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ac80043b0 con 0x7f5ad80cdb30 2024-09-17T05:36:44.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5acf400640 1 -- 172.21.15.31:0/2390672415 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac80b2040 con 0x7f5ad80cdb30 2024-09-17T05:36:44.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.348+0000 7f5ade800640 1 -- 172.21.15.31:0/2390672415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad809be60 con 0x7f5ad80cdb30 2024-09-17T05:36:44.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.352+0000 7f5ade800640 1 -- 172.21.15.31:0/2390672415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad81faff0 con 0x7f5ad80cdb30 2024-09-17T05:36:44.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.352+0000 7f5ade800640 1 -- 172.21.15.31:0/2390672415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad80cc9d0 con 0x7f5ad80cdb30 2024-09-17T05:36:44.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.352+0000 7f5acf400640 1 -- 172.21.15.31:0/2390672415 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f5ac8005290 con 0x7f5ad80cdb30 2024-09-17T05:36:44.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.352+0000 7f5acf400640 1 --2- 172.21.15.31:0/2390672415 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5ab4073c20 0x7f5ab40760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:44.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.352+0000 7f5acf400640 1 -- 172.21.15.31:0/2390672415 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 4971+0+0 (secure 0 0 0) 0x7f5ac812c560 con 0x7f5ad80cdb30 2024-09-17T05:36:44.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.352+0000 7f5acfe00640 1 --2- 172.21.15.31:0/2390672415 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5ab4073c20 0x7f5ab40760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:44.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.352+0000 7f5acfe00640 1 --2- 172.21.15.31:0/2390672415 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5ab4073c20 0x7f5ab40760e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80b1180 tx=0x7f5ac0007ea0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:44.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.356+0000 7f5acf400640 1 -- 172.21.15.31:0/2390672415 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5ad8149010 con 0x7f5ad80cdb30 2024-09-17T05:36:44.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.532+0000 7f5ade800640 1 -- 172.21.15.31:0/2390672415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ad809c140 con 0x7f5ad80cdb30 2024-09-17T05:36:44.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.536+0000 7f5acf400640 1 -- 172.21.15.31:0/2390672415 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) ==== 74+0+13110 (secure 0 0 0) 0x7f5ac8016410 con 0x7f5ad80cdb30 2024-09-17T05:36:44.537 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:44.537 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":155,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:36:43.165306+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":150,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6835/2117164749":"2024-09-18T05:36:40.154834+0000","172.21.15.31:6834/2117164749":"2024-09-18T05:36:40.154834+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:44.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.536+0000 7f5ade800640 1 -- 172.21.15.31:0/2390672415 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5ab4073c20 msgr2=0x7f5ab40760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:44.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.536+0000 7f5ade800640 1 --2- 172.21.15.31:0/2390672415 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5ab4073c20 0x7f5ab40760e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80b1180 tx=0x7f5ac0007ea0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.536+0000 7f5ade800640 1 -- 172.21.15.31:0/2390672415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ad80cdb30 msgr2=0x7f5ad8148ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:44.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.536+0000 7f5ade800640 1 --2- 172.21.15.31:0/2390672415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ad80cdb30 0x7f5ad8148ad0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009790 tx=0x7f5ac80a5670 comp rx=0 tx=0).stop 2024-09-17T05:36:44.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.536+0000 7f5ade800640 1 -- 172.21.15.31:0/2390672415 shutdown_connections 2024-09-17T05:36:44.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.536+0000 7f5ade800640 1 --2- 172.21.15.31:0/2390672415 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5ab4073c20 0x7f5ab40760e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.536+0000 7f5ade800640 1 --2- 172.21.15.31:0/2390672415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ad815bea0 0x7f5ad8159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.536+0000 7f5ade800640 1 --2- 172.21.15.31:0/2390672415 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5ad80d28e0 0x7f5ad8158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.536+0000 7f5ade800640 1 --2- 172.21.15.31:0/2390672415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5ad80cdb30 0x7f5ad8148ad0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.536+0000 7f5ade800640 1 -- 172.21.15.31:0/2390672415 >> 172.21.15.31:0/2390672415 conn(0x7f5ad80d1dc0 msgr2=0x7f5ad80b76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:44.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.536+0000 7f5ade800640 1 -- 172.21.15.31:0/2390672415 shutdown_connections 2024-09-17T05:36:44.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.536+0000 7f5ade800640 1 -- 172.21.15.31:0/2390672415 wait complete. 2024-09-17T05:36:44.559 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:28:33.209612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:36:44.559 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:36:44.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.708+0000 7fcd62600640 1 -- 172.21.15.31:0/1634363477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd40004d50 msgr2=0x7fcd400051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:44.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.708+0000 7fcd62600640 1 --2- 172.21.15.31:0/1634363477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd40004d50 0x7fcd400051d0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009eb0 tx=0x7fcd5401d5b0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.708+0000 7fcd5be00640 1 -- 172.21.15.31:0/1634363477 reap_dead start 2024-09-17T05:36:44.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.708+0000 7fcd62600640 1 -- 172.21.15.31:0/1634363477 shutdown_connections 2024-09-17T05:36:44.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.708+0000 7fcd62600640 1 -- 172.21.15.31:0/1634363477 >> 172.21.15.31:0/1634363477 conn(0x7fcd5c0b18f0 msgr2=0x7fcd5c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:44.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.708+0000 7fcd62600640 1 -- 172.21.15.31:0/1634363477 shutdown_connections 2024-09-17T05:36:44.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.708+0000 7fcd62600640 1 -- 172.21.15.31:0/1634363477 wait complete. 2024-09-17T05:36:44.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.708+0000 7fcd62600640 1 Processor -- start 2024-09-17T05:36:44.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.708+0000 7fcd62600640 1 -- start start 2024-09-17T05:36:44.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd62600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd40004d50 0x7fcd5c14f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:44.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd62600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd5c0ae0a0 0x7fcd5c0ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:44.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd62600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd5c15b410 0x7fcd5c15b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:44.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd62600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c06fb40 con 0x7fcd5c15b410 2024-09-17T05:36:44.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd62600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c06f9c0 con 0x7fcd5c0ae0a0 2024-09-17T05:36:44.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd62600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcd5c0cc660 con 0x7fcd40004d50 2024-09-17T05:36:44.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd5be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd5c15b410 0x7fcd5c15b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:44.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd5be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd5c15b410 0x7fcd5c15b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44616/0 (socket says 172.21.15.31:44616) 2024-09-17T05:36:44.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd5be00640 1 -- 172.21.15.31:0/2338068202 learned_addr learned my addr 172.21.15.31:0/2338068202 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:44.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd5b400640 1 --2- 172.21.15.31:0/2338068202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd40004d50 0x7fcd5c14f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:44.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd53e00640 1 --2- 172.21.15.31:0/2338068202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd5c0ae0a0 0x7fcd5c0ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:44.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd5be00640 1 -- 172.21.15.31:0/2338068202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd40004d50 msgr2=0x7fcd5c14f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:44.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd5be00640 1 --2- 172.21.15.31:0/2338068202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd40004d50 0x7fcd5c14f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd5be00640 1 -- 172.21.15.31:0/2338068202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd5c0ae0a0 msgr2=0x7fcd5c0ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:44.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd5be00640 1 --2- 172.21.15.31:0/2338068202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd5c0ae0a0 0x7fcd5c0ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd5be00640 1 -- 172.21.15.31:0/2338068202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd5c1e4b10 con 0x7fcd5c15b410 2024-09-17T05:36:44.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd5be00640 1 --2- 172.21.15.31:0/2338068202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd5c15b410 0x7fcd5c15b870 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fcd54002240 tx=0x7fcd540abdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:44.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd53400640 1 -- 172.21.15.31:0/2338068202 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd54009ab0 con 0x7fcd5c15b410 2024-09-17T05:36:44.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd53400640 1 -- 172.21.15.31:0/2338068202 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd540a94f0 con 0x7fcd5c15b410 2024-09-17T05:36:44.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd53400640 1 -- 172.21.15.31:0/2338068202 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd54009200 con 0x7fcd5c15b410 2024-09-17T05:36:44.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd62600640 1 -- 172.21.15.31:0/2338068202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd5c1e4df0 con 0x7fcd5c15b410 2024-09-17T05:36:44.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd62600640 1 -- 172.21.15.31:0/2338068202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd5c1e53b0 con 0x7fcd5c15b410 2024-09-17T05:36:44.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd62600640 1 -- 172.21.15.31:0/2338068202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd5c069410 con 0x7fcd5c15b410 2024-09-17T05:36:44.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.712+0000 7fcd53400640 1 -- 172.21.15.31:0/2338068202 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7fcd540b9030 con 0x7fcd5c15b410 2024-09-17T05:36:44.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.716+0000 7fcd53400640 1 --2- 172.21.15.31:0/2338068202 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcd38073c20 0x7fcd380760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:44.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.716+0000 7fcd53400640 1 -- 172.21.15.31:0/2338068202 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 4971+0+0 (secure 0 0 0) 0x7fcd5412d810 con 0x7fcd5c15b410 2024-09-17T05:36:44.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.716+0000 7fcd5b400640 1 --2- 172.21.15.31:0/2338068202 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcd38073c20 0x7fcd380760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:44.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.716+0000 7fcd5b400640 1 --2- 172.21.15.31:0/2338068202 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcd38073c20 0x7fcd380760e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00ad50 tx=0x7fcd4c00a2f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:44.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.720+0000 7fcd53400640 1 -- 172.21.15.31:0/2338068202 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fcd540ad030 con 0x7fcd5c15b410 2024-09-17T05:36:44.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.896+0000 7fcd62600640 1 -- 172.21.15.31:0/2338068202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcd5c06f340 con 0x7fcd5c15b410 2024-09-17T05:36:44.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.896+0000 7fcd53400640 1 -- 172.21.15.31:0/2338068202 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v155) ==== 93+0+10 (secure 0 0 0) 0x7fcd540172c0 con 0x7fcd5c15b410 2024-09-17T05:36:44.899 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-09-17T05:36:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.896+0000 7fcd62600640 1 -- 172.21.15.31:0/2338068202 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcd38073c20 msgr2=0x7fcd380760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.896+0000 7fcd62600640 1 --2- 172.21.15.31:0/2338068202 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcd38073c20 0x7fcd380760e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00ad50 tx=0x7fcd4c00a2f0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.896+0000 7fcd62600640 1 -- 172.21.15.31:0/2338068202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd5c15b410 msgr2=0x7fcd5c15b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.896+0000 7fcd62600640 1 --2- 172.21.15.31:0/2338068202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd5c15b410 0x7fcd5c15b870 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fcd54002240 tx=0x7fcd540abdf0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.900+0000 7fcd62600640 1 -- 172.21.15.31:0/2338068202 shutdown_connections 2024-09-17T05:36:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.900+0000 7fcd62600640 1 --2- 172.21.15.31:0/2338068202 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fcd38073c20 0x7fcd380760e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.900+0000 7fcd62600640 1 --2- 172.21.15.31:0/2338068202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd5c15b410 0x7fcd5c15b870 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.900+0000 7fcd62600640 1 --2- 172.21.15.31:0/2338068202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd5c0ae0a0 0x7fcd5c0ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.900+0000 7fcd62600640 1 --2- 172.21.15.31:0/2338068202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcd40004d50 0x7fcd5c14f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:44.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.900+0000 7fcd62600640 1 -- 172.21.15.31:0/2338068202 >> 172.21.15.31:0/2338068202 conn(0x7fcd5c0b18f0 msgr2=0x7fcd5c0ad5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:44.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.900+0000 7fcd62600640 1 -- 172.21.15.31:0/2338068202 shutdown_connections 2024-09-17T05:36:44.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:44.900+0000 7fcd62600640 1 -- 172.21.15.31:0/2338068202 wait complete. 2024-09-17T05:36:44.919 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade' 2024-09-17T05:36:45.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.064+0000 7f1f10200640 1 -- 172.21.15.31:0/263424045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f080d28e0 msgr2=0x7f1f080cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:45.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.064+0000 7f1f10200640 1 --2- 172.21.15.31:0/263424045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f080d28e0 0x7f1f080cebb0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f1f080745d0 tx=0x7f1f0001caf0 comp rx=0 tx=0).stop 2024-09-17T05:36:45.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.064+0000 7f1f10200640 1 -- 172.21.15.31:0/263424045 shutdown_connections 2024-09-17T05:36:45.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.064+0000 7f1f10200640 1 --2- 172.21.15.31:0/263424045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f080d28e0 0x7f1f080cebb0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:45.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.064+0000 7f1f10200640 1 --2- 172.21.15.31:0/263424045 >> v2:172.21.15.155:3300/0 conn(0x7f1f0815bea0 0x7f1f080ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:45.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.064+0000 7f1f10200640 1 -- 172.21.15.31:0/263424045 >> 172.21.15.31:0/263424045 conn(0x7f1f080d1dc0 msgr2=0x7f1f080d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:45.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.064+0000 7f1f10200640 1 -- 172.21.15.31:0/263424045 shutdown_connections 2024-09-17T05:36:45.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.064+0000 7f1f10200640 1 -- 172.21.15.31:0/263424045 wait complete. 2024-09-17T05:36:45.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.064+0000 7f1f10200640 1 Processor -- start 2024-09-17T05:36:45.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f10200640 1 -- start start 2024-09-17T05:36:45.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f10200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f080cdb30 0x7f1f080c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:45.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f10200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f080d28e0 0x7f1f080c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:45.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f10200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f0815bea0 0x7f1f080c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:45.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f10200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1f08168f10 con 0x7f1f0815bea0 2024-09-17T05:36:45.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f10200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1f08168d90 con 0x7f1f080d28e0 2024-09-17T05:36:45.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f10200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1f08169090 con 0x7f1f080cdb30 2024-09-17T05:36:45.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f0e200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f0815bea0 0x7f1f080c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:45.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f0e200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f0815bea0 0x7f1f080c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44630/0 (socket says 172.21.15.31:44630) 2024-09-17T05:36:45.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f0e200640 1 -- 172.21.15.31:0/3523029844 learned_addr learned my addr 172.21.15.31:0/3523029844 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:45.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f0ce00640 1 --2- 172.21.15.31:0/3523029844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f080d28e0 0x7f1f080c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:45.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f0d800640 1 --2- 172.21.15.31:0/3523029844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f080cdb30 0x7f1f080c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:45.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f0e200640 1 -- 172.21.15.31:0/3523029844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f080cdb30 msgr2=0x7f1f080c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:45.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f0e200640 1 --2- 172.21.15.31:0/3523029844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f080cdb30 0x7f1f080c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:45.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f0e200640 1 -- 172.21.15.31:0/3523029844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f080d28e0 msgr2=0x7f1f080c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:45.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f0e200640 1 --2- 172.21.15.31:0/3523029844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f080d28e0 0x7f1f080c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:45.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f0e200640 1 -- 172.21.15.31:0/3523029844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f080c8000 con 0x7f1f0815bea0 2024-09-17T05:36:45.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f0e200640 1 --2- 172.21.15.31:0/3523029844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f0815bea0 0x7f1f080c6100 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f1f0001c560 tx=0x7f1f00005a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:45.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f05600640 1 -- 172.21.15.31:0/3523029844 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f000b2040 con 0x7f1f0815bea0 2024-09-17T05:36:45.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f10200640 1 -- 172.21.15.31:0/3523029844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f080c82e0 con 0x7f1f0815bea0 2024-09-17T05:36:45.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f05600640 1 -- 172.21.15.31:0/3523029844 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f000bb070 con 0x7f1f0815bea0 2024-09-17T05:36:45.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f05600640 1 -- 172.21.15.31:0/3523029844 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f00004330 con 0x7f1f0815bea0 2024-09-17T05:36:45.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f10200640 1 -- 172.21.15.31:0/3523029844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f080c88a0 con 0x7f1f0815bea0 2024-09-17T05:36:45.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.068+0000 7f1f10200640 1 -- 172.21.15.31:0/3523029844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f080cc9d0 con 0x7f1f0815bea0 2024-09-17T05:36:45.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.072+0000 7f1f05600640 1 -- 172.21.15.31:0/3523029844 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f1f000044d0 con 0x7f1f0815bea0 2024-09-17T05:36:45.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.072+0000 7f1f05600640 1 --2- 172.21.15.31:0/3523029844 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1ee8073c20 0x7f1ee80760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:45.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.072+0000 7f1f05600640 1 -- 172.21.15.31:0/3523029844 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 4971+0+0 (secure 0 0 0) 0x7f1f0012d830 con 0x7f1f0815bea0 2024-09-17T05:36:45.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.072+0000 7f1f0d800640 1 --2- 172.21.15.31:0/3523029844 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1ee8073c20 0x7f1ee80760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:45.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.072+0000 7f1f0d800640 1 --2- 172.21.15.31:0/3523029844 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1ee8073c20 0x7f1ee80760e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009ad0 tx=0x7f1efc0091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:45.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.076+0000 7f1f05600640 1 -- 172.21.15.31:0/3523029844 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f1f00016770 con 0x7f1f0815bea0 2024-09-17T05:36:45.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:45.312+0000 7f1f10200640 1 -- 172.21.15.31:0/3523029844 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f1f080762f0 con 0x7f1f0815bea0 2024-09-17T05:36:46.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.180+0000 7f1f05600640 1 -- 172.21.15.31:0/3523029844 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]}]=0 v447) ==== 166+0+0 (secure 0 0 0) 0x7f1f000fa0f0 con 0x7f1f0815bea0 2024-09-17T05:36:46.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.184+0000 7f1f10200640 1 -- 172.21.15.31:0/3523029844 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1ee8073c20 msgr2=0x7f1ee80760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:46.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.184+0000 7f1f10200640 1 --2- 172.21.15.31:0/3523029844 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1ee8073c20 0x7f1ee80760e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009ad0 tx=0x7f1efc0091e0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.184+0000 7f1f10200640 1 -- 172.21.15.31:0/3523029844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f0815bea0 msgr2=0x7f1f080c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:46.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.184+0000 7f1f10200640 1 --2- 172.21.15.31:0/3523029844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f0815bea0 0x7f1f080c6100 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f1f0001c560 tx=0x7f1f00005a80 comp rx=0 tx=0).stop 2024-09-17T05:36:46.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.184+0000 7f1f10200640 1 -- 172.21.15.31:0/3523029844 shutdown_connections 2024-09-17T05:36:46.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.184+0000 7f1f10200640 1 --2- 172.21.15.31:0/3523029844 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1ee8073c20 0x7f1ee80760e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.184+0000 7f1f10200640 1 --2- 172.21.15.31:0/3523029844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f0815bea0 0x7f1f080c6100 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.184+0000 7f1f10200640 1 --2- 172.21.15.31:0/3523029844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f080d28e0 0x7f1f080c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.184+0000 7f1f10200640 1 --2- 172.21.15.31:0/3523029844 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f080cdb30 0x7f1f080c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.184+0000 7f1f10200640 1 -- 172.21.15.31:0/3523029844 >> 172.21.15.31:0/3523029844 conn(0x7f1f080d1dc0 msgr2=0x7f1f080b6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:46.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.184+0000 7f1f10200640 1 -- 172.21.15.31:0/3523029844 shutdown_connections 2024-09-17T05:36:46.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.184+0000 7f1f10200640 1 -- 172.21.15.31:0/3523029844 wait complete. 2024-09-17T05:36:46.209 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:36:46.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8eec00640 1 -- 172.21.15.31:0/223180323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e815f000 msgr2=0x7fc8e80d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:46.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8eec00640 1 --2- 172.21.15.31:0/223180323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e815f000 0x7fc8e80d01b0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc009900 tx=0x7fc8dc01c850 comp rx=0 tx=0).stop 2024-09-17T05:36:46.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8eec00640 1 -- 172.21.15.31:0/223180323 shutdown_connections 2024-09-17T05:36:46.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8eec00640 1 --2- 172.21.15.31:0/223180323 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8e80b2590 0x7fc8e80b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8eec00640 1 --2- 172.21.15.31:0/223180323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e815f000 0x7fc8e80d01b0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8eec00640 1 -- 172.21.15.31:0/223180323 >> 172.21.15.31:0/223180323 conn(0x7fc8e809aa10 msgr2=0x7fc8e809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:46.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8eec00640 1 -- 172.21.15.31:0/223180323 shutdown_connections 2024-09-17T05:36:46.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8eec00640 1 -- 172.21.15.31:0/223180323 wait complete. 2024-09-17T05:36:46.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8eec00640 1 Processor -- start 2024-09-17T05:36:46.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8eec00640 1 -- start start 2024-09-17T05:36:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8eec00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e80b2590 0x7fc8e80c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8eec00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8e80cefb0 0x7fc8e8159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8eec00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8e815f000 0x7fc8e815b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8eec00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e8168f10 con 0x7fc8e80b2590 2024-09-17T05:36:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8eec00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e8168d90 con 0x7fc8e815f000 2024-09-17T05:36:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8eec00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc8e8169090 con 0x7fc8e80cefb0 2024-09-17T05:36:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8ed800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e80b2590 0x7fc8e80c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8ed800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e80b2590 0x7fc8e80c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44642/0 (socket says 172.21.15.31:44642) 2024-09-17T05:36:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8ed800640 1 -- 172.21.15.31:0/96931829 learned_addr learned my addr 172.21.15.31:0/96931829 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8ece00640 1 --2- 172.21.15.31:0/96931829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8e80cefb0 0x7fc8e8159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8ee200640 1 --2- 172.21.15.31:0/96931829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8e815f000 0x7fc8e815b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8ed800640 1 -- 172.21.15.31:0/96931829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8e80cefb0 msgr2=0x7fc8e8159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8ed800640 1 --2- 172.21.15.31:0/96931829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8e80cefb0 0x7fc8e8159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8ed800640 1 -- 172.21.15.31:0/96931829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8e815f000 msgr2=0x7fc8e815b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8ed800640 1 --2- 172.21.15.31:0/96931829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8e815f000 0x7fc8e815b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8ed800640 1 -- 172.21.15.31:0/96931829 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8e81fb720 con 0x7fc8e80b2590 2024-09-17T05:36:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8ee200640 1 --2- 172.21.15.31:0/96931829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8e815f000 0x7fc8e815b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.360+0000 7fc8ed800640 1 --2- 172.21.15.31:0/96931829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e80b2590 0x7fc8e80c5e30 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc009850 tx=0x7fc8dc0a5510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.364+0000 7fc8e5600640 1 -- 172.21.15.31:0/96931829 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc0b2040 con 0x7fc8e80b2590 2024-09-17T05:36:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.364+0000 7fc8e5600640 1 -- 172.21.15.31:0/96931829 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8dc0042c0 con 0x7fc8e80b2590 2024-09-17T05:36:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.364+0000 7fc8e5600640 1 -- 172.21.15.31:0/96931829 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc005020 con 0x7fc8e80b2590 2024-09-17T05:36:46.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.364+0000 7fc8eec00640 1 -- 172.21.15.31:0/96931829 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8e81fba00 con 0x7fc8e80b2590 2024-09-17T05:36:46.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.364+0000 7fc8eec00640 1 -- 172.21.15.31:0/96931829 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8e81fbfc0 con 0x7fc8e80b2590 2024-09-17T05:36:46.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.364+0000 7fc8eec00640 1 -- 172.21.15.31:0/96931829 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8e80b29e0 con 0x7fc8e80b2590 2024-09-17T05:36:46.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.364+0000 7fc8e5600640 1 -- 172.21.15.31:0/96931829 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7fc8dc0051e0 con 0x7fc8e80b2590 2024-09-17T05:36:46.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.364+0000 7fc8e5600640 1 --2- 172.21.15.31:0/96931829 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc8c8073c20 0x7fc8c80760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:46.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.364+0000 7fc8e5600640 1 -- 172.21.15.31:0/96931829 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 4971+0+0 (secure 0 0 0) 0x7fc8dc12c780 con 0x7fc8e80b2590 2024-09-17T05:36:46.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.368+0000 7fc8ece00640 1 --2- 172.21.15.31:0/96931829 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc8c8073c20 0x7fc8c80760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:46.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.368+0000 7fc8ece00640 1 --2- 172.21.15.31:0/96931829 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc8c8073c20 0x7fc8c80760e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc8e815e9c0 tx=0x7fc8d4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:46.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.368+0000 7fc8e5600640 1 -- 172.21.15.31:0/96931829 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc8dc0164d0 con 0x7fc8e80b2590 2024-09-17T05:36:46.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.548+0000 7fc8eec00640 1 -- 172.21.15.31:0/96931829 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fc8e80cde80 con 0x7fc8e80b2590 2024-09-17T05:36:46.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.548+0000 7fc8e5600640 1 -- 172.21.15.31:0/96931829 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v47) ==== 59+0+1998 (secure 0 0 0) 0x7fc8dc0054d0 con 0x7fc8e80b2590 2024-09-17T05:36:46.552 INFO:teuthology.orchestra.run.smithi031.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:36:46.552 INFO:teuthology.orchestra.run.smithi031.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:36:46.553 INFO:teuthology.orchestra.run.smithi031.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:36:46.553 INFO:teuthology.orchestra.run.smithi031.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:36:46.553 INFO:teuthology.orchestra.run.smithi031.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6159.333103 2024-09-17T05:36:46.553 INFO:teuthology.orchestra.run.smithi031.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4566.558105 2024-09-17T05:36:46.553 INFO:teuthology.orchestra.run.smithi031.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4575.968427 2024-09-17T05:36:46.553 INFO:teuthology.orchestra.run.smithi031.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4702.806393 2024-09-17T05:36:46.553 INFO:teuthology.orchestra.run.smithi031.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4956.728274 2024-09-17T05:36:46.553 INFO:teuthology.orchestra.run.smithi031.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 6604.257199 2024-09-17T05:36:46.553 INFO:teuthology.orchestra.run.smithi031.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 4779.165073 2024-09-17T05:36:46.553 INFO:teuthology.orchestra.run.smithi031.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4673.795919 2024-09-17T05:36:46.553 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds 20/20 2024-09-17T05:36:46.553 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:36:46.554 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced debug_ms 2/2 2024-09-17T05:36:46.554 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_frag true 2024-09-17T05:36:46.554 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:36:46.554 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:36:46.554 INFO:teuthology.orchestra.run.smithi031.stdout:mds dev mds_verify_scatter true 2024-09-17T05:36:46.554 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:36:46.554 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:36:46.554 INFO:teuthology.orchestra.run.smithi031.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:36:46.554 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced client_mount_timeout 600 2024-09-17T05:36:46.554 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_client 20/20 2024-09-17T05:36:46.554 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced debug_ms 1/1 2024-09-17T05:36:46.554 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:36:46.555 INFO:teuthology.orchestra.run.smithi031.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:36:46.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.552+0000 7fc8eec00640 1 -- 172.21.15.31:0/96931829 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc8c8073c20 msgr2=0x7fc8c80760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:46.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.552+0000 7fc8eec00640 1 --2- 172.21.15.31:0/96931829 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc8c8073c20 0x7fc8c80760e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc8e815e9c0 tx=0x7fc8d4009040 comp rx=0 tx=0).stop 2024-09-17T05:36:46.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.552+0000 7fc8eec00640 1 -- 172.21.15.31:0/96931829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e80b2590 msgr2=0x7fc8e80c5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:46.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.552+0000 7fc8eec00640 1 --2- 172.21.15.31:0/96931829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e80b2590 0x7fc8e80c5e30 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc009850 tx=0x7fc8dc0a5510 comp rx=0 tx=0).stop 2024-09-17T05:36:46.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.552+0000 7fc8eec00640 1 -- 172.21.15.31:0/96931829 shutdown_connections 2024-09-17T05:36:46.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.552+0000 7fc8eec00640 1 --2- 172.21.15.31:0/96931829 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc8c8073c20 0x7fc8c80760e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.552+0000 7fc8eec00640 1 --2- 172.21.15.31:0/96931829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8e815f000 0x7fc8e815b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.552+0000 7fc8eec00640 1 --2- 172.21.15.31:0/96931829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8e80cefb0 0x7fc8e8159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.552+0000 7fc8eec00640 1 --2- 172.21.15.31:0/96931829 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc8e80b2590 0x7fc8e80c5e30 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.552+0000 7fc8eec00640 1 -- 172.21.15.31:0/96931829 >> 172.21.15.31:0/96931829 conn(0x7fc8e809aa10 msgr2=0x7fc8e815d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:46.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.552+0000 7fc8eec00640 1 -- 172.21.15.31:0/96931829 shutdown_connections 2024-09-17T05:36:46.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.552+0000 7fc8eec00640 1 -- 172.21.15.31:0/96931829 wait complete. 2024-09-17T05:36:46.575 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:36:46.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.720+0000 7ff8cdc00640 1 -- 172.21.15.31:0/2967344063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8c80afb10 msgr2=0x7ff8c80affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:46.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.720+0000 7ff8cdc00640 1 --2- 172.21.15.31:0/2967344063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8c80afb10 0x7ff8c80affc0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0009bc0 tx=0x7ff8c001cba0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.720+0000 7ff8cdc00640 1 -- 172.21.15.31:0/2967344063 shutdown_connections 2024-09-17T05:36:46.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.720+0000 7ff8cdc00640 1 --2- 172.21.15.31:0/2967344063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8c80afb10 0x7ff8c80affc0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.720+0000 7ff8cdc00640 1 --2- 172.21.15.31:0/2967344063 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c81605d0 0x7ff8c80d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.720+0000 7ff8cdc00640 1 -- 172.21.15.31:0/2967344063 >> 172.21.15.31:0/2967344063 conn(0x7ff8c80d1dd0 msgr2=0x7ff8c80d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:46.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.720+0000 7ff8cdc00640 1 -- 172.21.15.31:0/2967344063 shutdown_connections 2024-09-17T05:36:46.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.720+0000 7ff8cdc00640 1 -- 172.21.15.31:0/2967344063 wait complete. 2024-09-17T05:36:46.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8cdc00640 1 Processor -- start 2024-09-17T05:36:46.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8cdc00640 1 -- start start 2024-09-17T05:36:46.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8cdc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c80afb10 0x7ff8c815aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:46.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8cdc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8c80b1650 0x7ff8c815f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:46.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8cdc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8c81605d0 0x7ff8c80c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:46.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8cdc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c8169540 con 0x7ff8c80b1650 2024-09-17T05:36:46.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8cdc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c80b1430 con 0x7ff8c81605d0 2024-09-17T05:36:46.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8cdc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c81696c0 con 0x7ff8c80afb10 2024-09-17T05:36:46.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8bfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8c80b1650 0x7ff8c815f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:46.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8bfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8c80b1650 0x7ff8c815f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44660/0 (socket says 172.21.15.31:44660) 2024-09-17T05:36:46.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8bfe00640 1 -- 172.21.15.31:0/1068151327 learned_addr learned my addr 172.21.15.31:0/1068151327 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:46.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8c6a00640 1 --2- 172.21.15.31:0/1068151327 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c80afb10 0x7ff8c815aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:46.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8c7400640 1 --2- 172.21.15.31:0/1068151327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8c81605d0 0x7ff8c80c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:46.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8bfe00640 1 -- 172.21.15.31:0/1068151327 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c80afb10 msgr2=0x7ff8c815aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:46.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8bfe00640 1 --2- 172.21.15.31:0/1068151327 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c80afb10 0x7ff8c815aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8bfe00640 1 -- 172.21.15.31:0/1068151327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8c81605d0 msgr2=0x7ff8c80c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:46.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8bfe00640 1 --2- 172.21.15.31:0/1068151327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8c81605d0 0x7ff8c80c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8bfe00640 1 -- 172.21.15.31:0/1068151327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c81fbb40 con 0x7ff8c80b1650 2024-09-17T05:36:46.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8c6a00640 1 --2- 172.21.15.31:0/1068151327 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c80afb10 0x7ff8c815aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:46.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8c7400640 1 --2- 172.21.15.31:0/1068151327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8c81605d0 0x7ff8c80c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:46.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8bfe00640 1 --2- 172.21.15.31:0/1068151327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8c80b1650 0x7ff8c815f480 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000c490 tx=0x7ff8b000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:46.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8bea00640 1 -- 172.21.15.31:0/1068151327 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0016020 con 0x7ff8c80b1650 2024-09-17T05:36:46.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8bea00640 1 -- 172.21.15.31:0/1068151327 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8b0012940 con 0x7ff8c80b1650 2024-09-17T05:36:46.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8bea00640 1 -- 172.21.15.31:0/1068151327 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0012d90 con 0x7ff8c80b1650 2024-09-17T05:36:46.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8cdc00640 1 -- 172.21.15.31:0/1068151327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c81fbe20 con 0x7ff8c80b1650 2024-09-17T05:36:46.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8cdc00640 1 -- 172.21.15.31:0/1068151327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c815edd0 con 0x7ff8c80b1650 2024-09-17T05:36:46.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.724+0000 7ff8cdc00640 1 -- 172.21.15.31:0/1068151327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c80affc0 con 0x7ff8c80b1650 2024-09-17T05:36:46.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.728+0000 7ff8bea00640 1 -- 172.21.15.31:0/1068151327 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7ff8b0019020 con 0x7ff8c80b1650 2024-09-17T05:36:46.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.728+0000 7ff8bea00640 1 --2- 172.21.15.31:0/1068151327 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff8a4073c20 0x7ff8a40760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:46.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.728+0000 7ff8bea00640 1 -- 172.21.15.31:0/1068151327 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 4971+0+0 (secure 0 0 0) 0x7ff8b0092db0 con 0x7ff8c80b1650 2024-09-17T05:36:46.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.728+0000 7ff8c6a00640 1 --2- 172.21.15.31:0/1068151327 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff8a4073c20 0x7ff8a40760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:46.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.728+0000 7ff8c6a00640 1 --2- 172.21.15.31:0/1068151327 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff8a4073c20 0x7ff8a40760e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8005fd0 tx=0x7ff8b8005dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:46.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.732+0000 7ff8bea00640 1 -- 172.21.15.31:0/1068151327 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff8b0020020 con 0x7ff8c80b1650 2024-09-17T05:36:46.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.908+0000 7ff8cdc00640 1 -- 172.21.15.31:0/1068151327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff8c80d1080 con 0x7ff8c80b1650 2024-09-17T05:36:46.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.912+0000 7ff8bea00640 1 -- 172.21.15.31:0/1068151327 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v48)=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7ff8b005f6d0 con 0x7ff8c80b1650 2024-09-17T05:36:46.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.916+0000 7ff8cdc00640 1 -- 172.21.15.31:0/1068151327 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff8a4073c20 msgr2=0x7ff8a40760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:46.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.916+0000 7ff8cdc00640 1 --2- 172.21.15.31:0/1068151327 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff8a4073c20 0x7ff8a40760e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8005fd0 tx=0x7ff8b8005dc0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.916+0000 7ff8cdc00640 1 -- 172.21.15.31:0/1068151327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8c80b1650 msgr2=0x7ff8c815f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:46.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.916+0000 7ff8cdc00640 1 --2- 172.21.15.31:0/1068151327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8c80b1650 0x7ff8c815f480 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000c490 tx=0x7ff8b000c950 comp rx=0 tx=0).stop 2024-09-17T05:36:46.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.916+0000 7ff8cdc00640 1 -- 172.21.15.31:0/1068151327 shutdown_connections 2024-09-17T05:36:46.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.916+0000 7ff8cdc00640 1 --2- 172.21.15.31:0/1068151327 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff8a4073c20 0x7ff8a40760e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.916+0000 7ff8cdc00640 1 --2- 172.21.15.31:0/1068151327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8c81605d0 0x7ff8c80c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.916+0000 7ff8cdc00640 1 --2- 172.21.15.31:0/1068151327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff8c80b1650 0x7ff8c815f480 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.916+0000 7ff8cdc00640 1 --2- 172.21.15.31:0/1068151327 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8c80afb10 0x7ff8c815aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:46.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.916+0000 7ff8cdc00640 1 -- 172.21.15.31:0/1068151327 >> 172.21.15.31:0/1068151327 conn(0x7ff8c80d1dd0 msgr2=0x7ff8c815be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:46.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.916+0000 7ff8cdc00640 1 -- 172.21.15.31:0/1068151327 shutdown_connections 2024-09-17T05:36:46.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:46.916+0000 7ff8cdc00640 1 -- 172.21.15.31:0/1068151327 wait complete. 2024-09-17T05:36:46.938 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:36:46.938 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:36:47.031 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:36:47.127 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:36:47.127 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:36:47.127 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:47.136 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:36:47.137 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:36:47.137 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:47.146 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:36:47.146 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:36:47.146 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:47.189 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:36:47.189 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:36:47.189 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:47.201 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:36:47.201 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:36:47.201 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:47.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.376+0000 7f9405e00640 1 -- 172.21.15.31:0/1299577530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94000cdb30 msgr2=0x7f94000cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:47.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.376+0000 7f9405e00640 1 --2- 172.21.15.31:0/1299577530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94000cdb30 0x7f94000cebb0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f94000745d0 tx=0x7f93e801c770 comp rx=0 tx=0).stop 2024-09-17T05:36:47.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.376+0000 7f9405e00640 1 -- 172.21.15.31:0/1299577530 shutdown_connections 2024-09-17T05:36:47.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.376+0000 7f9405e00640 1 --2- 172.21.15.31:0/1299577530 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94000cdb30 0x7f94000cebb0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:47.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.376+0000 7f9405e00640 1 --2- 172.21.15.31:0/1299577530 >> v2:172.21.15.155:3300/0 conn(0x7f940015bea0 0x7f94000ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:47.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.376+0000 7f9405e00640 1 -- 172.21.15.31:0/1299577530 >> 172.21.15.31:0/1299577530 conn(0x7f94000d1dc0 msgr2=0x7f94000d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:47.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.376+0000 7f9405e00640 1 -- 172.21.15.31:0/1299577530 shutdown_connections 2024-09-17T05:36:47.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.376+0000 7f9405e00640 1 -- 172.21.15.31:0/1299577530 wait complete. 2024-09-17T05:36:47.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.376+0000 7f9405e00640 1 Processor -- start 2024-09-17T05:36:47.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.376+0000 7f9405e00640 1 -- start start 2024-09-17T05:36:47.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f9405e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94000cdb30 0x7f940015c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:47.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f9405e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94000d28e0 0x7f9400159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:47.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f9405e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f940015bea0 0x7f94000719d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:47.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f9405e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9400168fc0 con 0x7f94000cdb30 2024-09-17T05:36:47.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f9405e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9400168e40 con 0x7f94000d28e0 2024-09-17T05:36:47.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f9405e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9400169140 con 0x7f940015bea0 2024-09-17T05:36:47.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f93fea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94000cdb30 0x7f940015c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:47.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f93fea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94000cdb30 0x7f940015c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44678/0 (socket says 172.21.15.31:44678) 2024-09-17T05:36:47.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f93fea00640 1 -- 172.21.15.31:0/1539793545 learned_addr learned my addr 172.21.15.31:0/1539793545 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:47.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f93f6000640 1 --2- 172.21.15.31:0/1539793545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94000d28e0 0x7f9400159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:47.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f93ff400640 1 --2- 172.21.15.31:0/1539793545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f940015bea0 0x7f94000719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:47.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f93fea00640 1 -- 172.21.15.31:0/1539793545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f940015bea0 msgr2=0x7f94000719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:47.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f93fea00640 1 --2- 172.21.15.31:0/1539793545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f940015bea0 0x7f94000719d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:47.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f93fea00640 1 -- 172.21.15.31:0/1539793545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94000d28e0 msgr2=0x7f9400159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:47.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f93fea00640 1 --2- 172.21.15.31:0/1539793545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94000d28e0 0x7f9400159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:47.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f93fea00640 1 -- 172.21.15.31:0/1539793545 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940015a240 con 0x7f94000cdb30 2024-09-17T05:36:47.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f93f6000640 1 --2- 172.21.15.31:0/1539793545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94000d28e0 0x7f9400159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:47.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f93ff400640 1 --2- 172.21.15.31:0/1539793545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f940015bea0 0x7f94000719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:47.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f93fea00640 1 --2- 172.21.15.31:0/1539793545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94000cdb30 0x7f940015c630 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f93f000e7a0 tx=0x7f93f000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:47.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f93f7e00640 1 -- 172.21.15.31:0/1539793545 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f000ccc0 con 0x7f94000cdb30 2024-09-17T05:36:47.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f93f7e00640 1 -- 172.21.15.31:0/1539793545 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93f0010430 con 0x7f94000cdb30 2024-09-17T05:36:47.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f9405e00640 1 -- 172.21.15.31:0/1539793545 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9400159fa0 con 0x7f94000cdb30 2024-09-17T05:36:47.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f93f7e00640 1 -- 172.21.15.31:0/1539793545 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0010860 con 0x7f94000cdb30 2024-09-17T05:36:47.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f9405e00640 1 -- 172.21.15.31:0/1539793545 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94000c7460 con 0x7f94000cdb30 2024-09-17T05:36:47.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f9405e00640 1 -- 172.21.15.31:0/1539793545 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94000cc9d0 con 0x7f94000cdb30 2024-09-17T05:36:47.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.380+0000 7f93f7e00640 1 -- 172.21.15.31:0/1539793545 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f93f0010a00 con 0x7f94000cdb30 2024-09-17T05:36:47.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.384+0000 7f93f7e00640 1 --2- 172.21.15.31:0/1539793545 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f93dc073c50 0x7f93dc076110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:47.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.384+0000 7f93f7e00640 1 -- 172.21.15.31:0/1539793545 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 4971+0+0 (secure 0 0 0) 0x7f93f00937a0 con 0x7f94000cdb30 2024-09-17T05:36:47.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.384+0000 7f93f6000640 1 --2- 172.21.15.31:0/1539793545 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f93dc073c50 0x7f93dc076110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:47.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.384+0000 7f93f6000640 1 --2- 172.21.15.31:0/1539793545 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f93dc073c50 0x7f93dc076110 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f93e80af000 tx=0x7f93e801afb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:47.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.388+0000 7f93f7e00640 1 -- 172.21.15.31:0/1539793545 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f93f0060080 con 0x7f94000cdb30 2024-09-17T05:36:47.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.608+0000 7f9405e00640 1 -- 172.21.15.31:0/1539793545 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f940006e850 con 0x7f94000cdb30 2024-09-17T05:36:47.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.608+0000 7f93f7e00640 1 -- 172.21.15.31:0/1539793545 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) ==== 95+0+3919 (secure 0 0 0) 0x7f93f005f980 con 0x7f94000cdb30 2024-09-17T05:36:47.612 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:47.612 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":112,"btime":"2024-09-17T05:36:41:157515+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/188322131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":188322131},{"type":"v1","addr":"172.21.15.155:6834","nonce":188322131}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8164,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2190232807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":2190232807},{"type":"v1","addr":"172.21.15.155:6835","nonce":2190232807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":8724,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/2588830685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2588830685},{"type":"v1","addr":"172.21.15.31:6833","nonce":2588830685}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104},{"gid":9021,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/1969098948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1969098948},{"type":"v1","addr":"172.21.15.31:6835","nonce":1969098948}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":112}],"filesystems":[]} 2024-09-17T05:36:47.612 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 112 2024-09-17T05:36:47.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.612+0000 7f9405e00640 1 -- 172.21.15.31:0/1539793545 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f93dc073c50 msgr2=0x7f93dc076110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:47.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.612+0000 7f9405e00640 1 --2- 172.21.15.31:0/1539793545 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f93dc073c50 0x7f93dc076110 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f93e80af000 tx=0x7f93e801afb0 comp rx=0 tx=0).stop 2024-09-17T05:36:47.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.612+0000 7f9405e00640 1 -- 172.21.15.31:0/1539793545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94000cdb30 msgr2=0x7f940015c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:47.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.612+0000 7f9405e00640 1 --2- 172.21.15.31:0/1539793545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94000cdb30 0x7f940015c630 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f93f000e7a0 tx=0x7f93f000ec60 comp rx=0 tx=0).stop 2024-09-17T05:36:47.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.612+0000 7f9405e00640 1 -- 172.21.15.31:0/1539793545 shutdown_connections 2024-09-17T05:36:47.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.612+0000 7f9405e00640 1 --2- 172.21.15.31:0/1539793545 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f93dc073c50 0x7f93dc076110 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:47.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.612+0000 7f9405e00640 1 --2- 172.21.15.31:0/1539793545 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f940015bea0 0x7f94000719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:47.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.612+0000 7f9405e00640 1 --2- 172.21.15.31:0/1539793545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94000d28e0 0x7f9400159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:47.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.612+0000 7f9405e00640 1 --2- 172.21.15.31:0/1539793545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94000cdb30 0x7f940015c630 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:47.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.612+0000 7f9405e00640 1 -- 172.21.15.31:0/1539793545 >> 172.21.15.31:0/1539793545 conn(0x7f94000d1dc0 msgr2=0x7f940006eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:47.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.612+0000 7f9405e00640 1 -- 172.21.15.31:0/1539793545 shutdown_connections 2024-09-17T05:36:47.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.612+0000 7f9405e00640 1 -- 172.21.15.31:0/1539793545 wait complete. 2024-09-17T05:36:47.635 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:36:47.635 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:36:47.635 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:36:47.635 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:36:47.636 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:36:47.636 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:36:47.636 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:36:47.636 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:36:47.637 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:36:47.637 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:36:47.637 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:36:47.637 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:36:47.638 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:36:47.638 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:36:47.638 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:36:47.639 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:36:47.649 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:36:47.649 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:36:47.650 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:36:47.651 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:36:47.652 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:36:47.652 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:36:47.653 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:36:47.653 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:36:47.698 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:36:47.699 DEBUG:teuthology.parallel:result is None 2024-09-17T05:36:47.701 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:36:47.701 DEBUG:teuthology.parallel:result is None 2024-09-17T05:36:47.702 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:36:47.703 DEBUG:teuthology.parallel:result is None 2024-09-17T05:36:47.705 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:36:47.705 DEBUG:teuthology.parallel:result is None 2024-09-17T05:36:47.705 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:36:47.786 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-17T05:36:47.787 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-17T05:36:47.798 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-17T05:36:47.798 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-17T05:36:47.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.856+0000 7f7420c00640 1 -- 172.21.15.31:0/3086152860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f741c0cdb30 msgr2=0x7f741c0aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:47.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.856+0000 7f7420c00640 1 --2- 172.21.15.31:0/3086152860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f741c0cdb30 0x7f741c0aeef0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f741c0cc3a0 tx=0x7f741401cb80 comp rx=0 tx=0).stop 2024-09-17T05:36:47.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.856+0000 7f7420c00640 1 -- 172.21.15.31:0/3086152860 shutdown_connections 2024-09-17T05:36:47.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.856+0000 7f7420c00640 1 --2- 172.21.15.31:0/3086152860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f741c0cdb30 0x7f741c0aeef0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:47.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.856+0000 7f7420c00640 1 --2- 172.21.15.31:0/3086152860 >> v2:172.21.15.155:3300/0 conn(0x7f741c0ced80 0x7f741c0ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:47.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.856+0000 7f7420c00640 1 -- 172.21.15.31:0/3086152860 >> 172.21.15.31:0/3086152860 conn(0x7f741c0d1dc0 msgr2=0x7f741c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:47.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.856+0000 7f7420c00640 1 -- 172.21.15.31:0/3086152860 shutdown_connections 2024-09-17T05:36:47.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.856+0000 7f7420c00640 1 -- 172.21.15.31:0/3086152860 wait complete. 2024-09-17T05:36:47.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f7420c00640 1 Processor -- start 2024-09-17T05:36:47.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f7420c00640 1 -- start start 2024-09-17T05:36:47.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f7420c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f741c0cdb30 0x7f741c1573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:47.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f7420c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f741c0ced80 0x7f741c09bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:47.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f7420c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f741c15bea0 0x7f741c15ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:47.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f7420c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f741c169240 con 0x7f741c15bea0 2024-09-17T05:36:47.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f7420c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f741c1690c0 con 0x7f741c0ced80 2024-09-17T05:36:47.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f7420c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f741c1693c0 con 0x7f741c0cdb30 2024-09-17T05:36:47.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f741a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f741c15bea0 0x7f741c15ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:47.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f741a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f741c15bea0 0x7f741c15ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44734/0 (socket says 172.21.15.31:44734) 2024-09-17T05:36:47.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f741a800640 1 -- 172.21.15.31:0/3987033843 learned_addr learned my addr 172.21.15.31:0/3987033843 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:47.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f7413e00640 1 --2- 172.21.15.31:0/3987033843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f741c0ced80 0x7f741c09bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:47.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f7419e00640 1 --2- 172.21.15.31:0/3987033843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f741c0cdb30 0x7f741c1573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:47.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f741a800640 1 -- 172.21.15.31:0/3987033843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f741c0cdb30 msgr2=0x7f741c1573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:47.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f741a800640 1 --2- 172.21.15.31:0/3987033843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f741c0cdb30 0x7f741c1573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:47.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f741a800640 1 -- 172.21.15.31:0/3987033843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f741c0ced80 msgr2=0x7f741c09bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:47.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f741a800640 1 --2- 172.21.15.31:0/3987033843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f741c0ced80 0x7f741c09bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:47.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f741a800640 1 -- 172.21.15.31:0/3987033843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741c09c070 con 0x7f741c15bea0 2024-09-17T05:36:47.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f7413e00640 1 --2- 172.21.15.31:0/3987033843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f741c0ced80 0x7f741c09bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:47.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f7419e00640 1 --2- 172.21.15.31:0/3987033843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f741c0cdb30 0x7f741c1573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:47.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f741a800640 1 --2- 172.21.15.31:0/3987033843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f741c15bea0 0x7f741c15ac90 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f741401c5f0 tx=0x7f7414005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:47.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f7412000640 1 -- 172.21.15.31:0/3987033843 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74140b2040 con 0x7f741c15bea0 2024-09-17T05:36:47.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f7412000640 1 -- 172.21.15.31:0/3987033843 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74140bb070 con 0x7f741c15bea0 2024-09-17T05:36:47.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f7420c00640 1 -- 172.21.15.31:0/3987033843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f741c09f320 con 0x7f741c15bea0 2024-09-17T05:36:47.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f7412000640 1 -- 172.21.15.31:0/3987033843 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414004330 con 0x7f741c15bea0 2024-09-17T05:36:47.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f7420c00640 1 -- 172.21.15.31:0/3987033843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f741c09f8e0 con 0x7f741c15bea0 2024-09-17T05:36:47.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.860+0000 7f7420c00640 1 -- 172.21.15.31:0/3987033843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f741c0ce670 con 0x7f741c15bea0 2024-09-17T05:36:47.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.864+0000 7f7412000640 1 -- 172.21.15.31:0/3987033843 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f74140044d0 con 0x7f741c15bea0 2024-09-17T05:36:47.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.864+0000 7f7412000640 1 --2- 172.21.15.31:0/3987033843 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f73f8073c20 0x7f73f80760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:47.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.864+0000 7f7412000640 1 -- 172.21.15.31:0/3987033843 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 4971+0+0 (secure 0 0 0) 0x7f741412d880 con 0x7f741c15bea0 2024-09-17T05:36:47.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.864+0000 7f7419e00640 1 --2- 172.21.15.31:0/3987033843 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f73f8073c20 0x7f73f80760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:47.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.864+0000 7f7419e00640 1 --2- 172.21.15.31:0/3987033843 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f73f8073c20 0x7f73f80760e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f740c000f70 tx=0x7f740c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:47.868+0000 7f7412000640 1 -- 172.21.15.31:0/3987033843 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f7414016770 con 0x7f741c15bea0 2024-09-17T05:36:48.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.056+0000 7f7420c00640 1 -- 172.21.15.31:0/3987033843 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f741c0d23b0 con 0x7f741c15bea0 2024-09-17T05:36:48.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.196+0000 7f7412000640 1 -- 172.21.15.31:0/3987033843 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v157) ==== 97+0+0 (secure 0 0 0) 0x7f74140fa0e0 con 0x7f741c15bea0 2024-09-17T05:36:48.199 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2024-09-17T05:36:48.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.200+0000 7f7420c00640 1 -- 172.21.15.31:0/3987033843 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f73f8073c20 msgr2=0x7f73f80760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:48.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.200+0000 7f7420c00640 1 --2- 172.21.15.31:0/3987033843 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f73f8073c20 0x7f73f80760e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f740c000f70 tx=0x7f740c009040 comp rx=0 tx=0).stop 2024-09-17T05:36:48.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.200+0000 7f7420c00640 1 -- 172.21.15.31:0/3987033843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f741c15bea0 msgr2=0x7f741c15ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:48.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.200+0000 7f7420c00640 1 --2- 172.21.15.31:0/3987033843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f741c15bea0 0x7f741c15ac90 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f741401c5f0 tx=0x7f7414005b00 comp rx=0 tx=0).stop 2024-09-17T05:36:48.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.200+0000 7f7420c00640 1 -- 172.21.15.31:0/3987033843 shutdown_connections 2024-09-17T05:36:48.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.200+0000 7f7420c00640 1 --2- 172.21.15.31:0/3987033843 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f73f8073c20 0x7f73f80760e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.200+0000 7f7420c00640 1 --2- 172.21.15.31:0/3987033843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f741c15bea0 0x7f741c15ac90 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.200+0000 7f7420c00640 1 --2- 172.21.15.31:0/3987033843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f741c0ced80 0x7f741c09bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.200+0000 7f7420c00640 1 --2- 172.21.15.31:0/3987033843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f741c0cdb30 0x7f741c1573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.200+0000 7f7420c00640 1 -- 172.21.15.31:0/3987033843 >> 172.21.15.31:0/3987033843 conn(0x7f741c0d1dc0 msgr2=0x7f741c0cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:48.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.200+0000 7f7420c00640 1 -- 172.21.15.31:0/3987033843 shutdown_connections 2024-09-17T05:36:48.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.200+0000 7f7420c00640 1 -- 172.21.15.31:0/3987033843 wait complete. 2024-09-17T05:36:48.224 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:36:48.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.368+0000 7f4f77200640 1 -- 172.21.15.31:0/3938985194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f700b69b0 msgr2=0x7f4f700aeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:48.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.368+0000 7f4f77200640 1 --2- 172.21.15.31:0/3938985194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f700b69b0 0x7f4f700aeb00 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f4f70072540 tx=0x7f4f6c01f580 comp rx=0 tx=0).stop 2024-09-17T05:36:48.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.368+0000 7f4f77200640 1 -- 172.21.15.31:0/3938985194 shutdown_connections 2024-09-17T05:36:48.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.368+0000 7f4f77200640 1 --2- 172.21.15.31:0/3938985194 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f700b69b0 0x7f4f700aeb00 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.368+0000 7f4f77200640 1 --2- 172.21.15.31:0/3938985194 >> v2:172.21.15.155:3300/0 conn(0x7f4f70071740 0x7f4f700b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.368+0000 7f4f77200640 1 -- 172.21.15.31:0/3938985194 >> 172.21.15.31:0/3938985194 conn(0x7f4f7009aa10 msgr2=0x7f4f7009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:48.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.368+0000 7f4f77200640 1 -- 172.21.15.31:0/3938985194 shutdown_connections 2024-09-17T05:36:48.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.368+0000 7f4f77200640 1 -- 172.21.15.31:0/3938985194 wait complete. 2024-09-17T05:36:48.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.368+0000 7f4f77200640 1 Processor -- start 2024-09-17T05:36:48.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.368+0000 7f4f77200640 1 -- start start 2024-09-17T05:36:48.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f77200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f70071360 0x7f4f701f5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f77200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f70071740 0x7f4f700cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f77200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f700b69b0 0x7f4f700b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f77200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4f700af040 con 0x7f4f700b69b0 2024-09-17T05:36:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f77200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7015e250 con 0x7f4f70071360 2024-09-17T05:36:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f77200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4f700af1c0 con 0x7f4f70071740 2024-09-17T05:36:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f76800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f700b69b0 0x7f4f700b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f75e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f70071360 0x7f4f701f5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f76800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f700b69b0 0x7f4f700b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44764/0 (socket says 172.21.15.31:44764) 2024-09-17T05:36:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f76800640 1 -- 172.21.15.31:0/2791203973 learned_addr learned my addr 172.21.15.31:0/2791203973 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f75400640 1 --2- 172.21.15.31:0/2791203973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f70071740 0x7f4f700cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:48.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f76800640 1 -- 172.21.15.31:0/2791203973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f70071740 msgr2=0x7f4f700cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f76800640 1 --2- 172.21.15.31:0/2791203973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f70071740 0x7f4f700cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f76800640 1 -- 172.21.15.31:0/2791203973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f70071360 msgr2=0x7f4f701f5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f76800640 1 --2- 172.21.15.31:0/2791203973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f70071360 0x7f4f701f5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f76800640 1 -- 172.21.15.31:0/2791203973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f701f46c0 con 0x7f4f700b69b0 2024-09-17T05:36:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f75e00640 1 --2- 172.21.15.31:0/2791203973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f70071360 0x7f4f701f5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:36:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f76800640 1 --2- 172.21.15.31:0/2791203973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f700b69b0 0x7f4f700b60b0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c01c190 tx=0x7f4f6c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f6a000640 1 -- 172.21.15.31:0/2791203973 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c004c50 con 0x7f4f700b69b0 2024-09-17T05:36:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f6a000640 1 -- 172.21.15.31:0/2791203973 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f6c0be030 con 0x7f4f700b69b0 2024-09-17T05:36:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f6a000640 1 -- 172.21.15.31:0/2791203973 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c0afae0 con 0x7f4f700b69b0 2024-09-17T05:36:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f77200640 1 -- 172.21.15.31:0/2791203973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f700cd0b0 con 0x7f4f700b69b0 2024-09-17T05:36:48.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f77200640 1 -- 172.21.15.31:0/2791203973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f700cd390 con 0x7f4f700b69b0 2024-09-17T05:36:48.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.372+0000 7f4f77200640 1 -- 172.21.15.31:0/2791203973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f700aeb00 con 0x7f4f700b69b0 2024-09-17T05:36:48.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.376+0000 7f4f6a000640 1 -- 172.21.15.31:0/2791203973 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f4f6c0afc80 con 0x7f4f700b69b0 2024-09-17T05:36:48.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.376+0000 7f4f6a000640 1 --2- 172.21.15.31:0/2791203973 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4f54073c50 0x7f4f54076110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:48.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.376+0000 7f4f6a000640 1 -- 172.21.15.31:0/2791203973 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 4885+0+0 (secure 0 0 0) 0x7f4f6c1314a0 con 0x7f4f700b69b0 2024-09-17T05:36:48.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.376+0000 7f4f75e00640 1 --2- 172.21.15.31:0/2791203973 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4f54073c50 0x7f4f54076110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:48.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.376+0000 7f4f75e00640 1 --2- 172.21.15.31:0/2791203973 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4f54073c50 0x7f4f54076110 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4f64007fd0 tx=0x7f4f64009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:48.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.380+0000 7f4f6a000640 1 -- 172.21.15.31:0/2791203973 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4f6c0190e0 con 0x7f4f700b69b0 2024-09-17T05:36:48.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.628+0000 7f4f77200640 1 -- 172.21.15.31:0/2791203973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f4f7015c9d0 con 0x7f4f700b69b0 2024-09-17T05:36:48.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.628+0000 7f4f6a000640 1 -- 172.21.15.31:0/2791203973 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v28) ==== 80+0+5304 (secure 0 0 0) 0x7f4f6c0fd790 con 0x7f4f700b69b0 2024-09-17T05:36:48.631 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:48.631 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:36:48.632 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2024-09-17T05:36:48.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.632 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2024-09-17T05:36:48.632 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmoloQARAAbTcR/1F1qz7Crjdu1NPSgw==", 2024-09-17T05:36:48.632 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.632 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:36:48.632 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:36:48.632 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:36:48.632 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:48.632 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:48.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.633 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2024-09-17T05:36:48.633 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmYrdRDRAAkaDz03U3lMZlkLEVFYlTaw==", 2024-09-17T05:36:48.633 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.633 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:36:48.633 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:36:48.633 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:36:48.633 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:48.633 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:48.633 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.633 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2024-09-17T05:36:48.633 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmpFRCCBAAZRsuAVwSxuMGDeoYCwWFeg==", 2024-09-17T05:36:48.634 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.634 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:36:48.634 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:36:48.634 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:36:48.634 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:48.634 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:48.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.634 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2024-09-17T05:36:48.634 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lm23PSFBAAuO+k0kWY28PN7+pEtlUniQ==", 2024-09-17T05:36:48.634 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.634 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:36:48.634 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:36:48.634 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:36:48.635 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:48.635 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:48.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.635 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2024-09-17T05:36:48.635 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBTE+lm0miKHxAA2C1pfwBxJtKQhu4xuPumxg==", 2024-09-17T05:36:48.635 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.635 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:36:48.635 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:36:48.635 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:48.635 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:48.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.636 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2024-09-17T05:36:48.636 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBWE+lmdQi7NRAA2v4ETg4jynbPF0K4E73KAA==", 2024-09-17T05:36:48.636 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.636 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:36:48.636 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:36:48.636 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:48.636 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:48.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.636 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2024-09-17T05:36:48.636 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBaE+lm18eUEBAA8gAhUx9UNa2Lk4uyFBd7Nw==", 2024-09-17T05:36:48.636 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.636 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:36:48.637 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:36:48.637 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:48.637 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:48.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.637 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2024-09-17T05:36:48.637 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBdE+lm00moJBAAizrxOP4rI4fGR91dYzlEkw==", 2024-09-17T05:36:48.637 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.637 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:36:48.637 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:36:48.637 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:48.637 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:48.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.638 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2024-09-17T05:36:48.638 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBjE+lmhdtUJhAA7+KM8DwQriFwMbpqXAPTuA==", 2024-09-17T05:36:48.638 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.638 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:36:48.638 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:36:48.638 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:48.638 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:48.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.638 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2024-09-17T05:36:48.638 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBmE+lm5cByOhAAiMnQIv2O41am/3E+0dp4sg==", 2024-09-17T05:36:48.638 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.638 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:36:48.639 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:36:48.639 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:48.639 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:48.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.639 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2024-09-17T05:36:48.639 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBqE+lm19FhExAAo/Sfj2SX5+Y2/Fxz8mbiNQ==", 2024-09-17T05:36:48.639 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.639 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:36:48.639 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:36:48.639 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:48.639 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:48.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.640 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2024-09-17T05:36:48.640 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBtE+lmISDbKBAAapUBS+t+N1vUcCbdJic8Dw==", 2024-09-17T05:36:48.640 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.640 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-17T05:36:48.640 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-17T05:36:48.640 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:48.640 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.640 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:48.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.640 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2024-09-17T05:36:48.640 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw==", 2024-09-17T05:36:48.641 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.641 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:36:48.641 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2024-09-17T05:36:48.641 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:36:48.641 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:48.641 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.641 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2024-09-17T05:36:48.641 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmb2pmIhAA7p+G+WnB7ujZZdSlaossYg==", 2024-09-17T05:36:48.641 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.641 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:36:48.641 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:36:48.641 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:36:48.642 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:36:48.642 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:48.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.642 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2024-09-17T05:36:48.642 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lmAPPaHhAAyz/gKunaNFyrdkAUy50qmQ==", 2024-09-17T05:36:48.642 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.642 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:36:48.642 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:36:48.642 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:36:48.642 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:36:48.642 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:48.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.643 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2024-09-17T05:36:48.643 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBQE+lml72BKBAAgAji5TWedU7azT5oQz3fYg==", 2024-09-17T05:36:48.643 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.643 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-17T05:36:48.643 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-17T05:36:48.643 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-17T05:36:48.643 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-17T05:36:48.643 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:48.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.643 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2024-09-17T05:36:48.643 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmtgltIRAAeTv/U/vZ9ZIuGN4JXTHD0A==", 2024-09-17T05:36:48.643 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.644 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:36:48.644 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-17T05:36:48.644 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-17T05:36:48.644 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:48.644 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:48.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.644 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2024-09-17T05:36:48.644 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmTt2oOBAAmR5ykU4WbEzlKFiwI7sMdg==", 2024-09-17T05:36:48.644 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.644 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:36:48.644 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:36:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-17T05:36:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2024-09-17T05:36:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBPE+lmKILYNBAAojM8RIq92dO2DQyXppReIw==", 2024-09-17T05:36:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-17T05:36:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-17T05:36:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-17T05:36:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-17T05:36:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.645 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.646 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-17T05:36:48.646 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:36:48.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.632+0000 7f4f77200640 1 -- 172.21.15.31:0/2791203973 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4f54073c50 msgr2=0x7f4f54076110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:48.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.632+0000 7f4f77200640 1 --2- 172.21.15.31:0/2791203973 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4f54073c50 0x7f4f54076110 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4f64007fd0 tx=0x7f4f64009040 comp rx=0 tx=0).stop 2024-09-17T05:36:48.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.632+0000 7f4f77200640 1 -- 172.21.15.31:0/2791203973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f700b69b0 msgr2=0x7f4f700b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:48.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.632+0000 7f4f77200640 1 --2- 172.21.15.31:0/2791203973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f700b69b0 0x7f4f700b60b0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c01c190 tx=0x7f4f6c005b00 comp rx=0 tx=0).stop 2024-09-17T05:36:48.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.632+0000 7f4f77200640 1 -- 172.21.15.31:0/2791203973 shutdown_connections 2024-09-17T05:36:48.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.632+0000 7f4f77200640 1 --2- 172.21.15.31:0/2791203973 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4f54073c50 0x7f4f54076110 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.632+0000 7f4f77200640 1 --2- 172.21.15.31:0/2791203973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f700b69b0 0x7f4f700b60b0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.632+0000 7f4f77200640 1 --2- 172.21.15.31:0/2791203973 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f70071740 0x7f4f700cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.632+0000 7f4f77200640 1 --2- 172.21.15.31:0/2791203973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f70071360 0x7f4f701f5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.632+0000 7f4f77200640 1 -- 172.21.15.31:0/2791203973 >> 172.21.15.31:0/2791203973 conn(0x7f4f7009aa10 msgr2=0x7f4f700b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:48.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.632+0000 7f4f77200640 1 -- 172.21.15.31:0/2791203973 shutdown_connections 2024-09-17T05:36:48.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.632+0000 7f4f77200640 1 -- 172.21.15.31:0/2791203973 wait complete. 2024-09-17T05:36:48.654 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:36:48.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.796+0000 7fee86c00640 1 -- 172.21.15.31:0/3132942166 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee800ced80 msgr2=0x7fee800ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:48.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.796+0000 7fee86c00640 1 --2- 172.21.15.31:0/3132942166 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee800ced80 0x7fee800ae9b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fee68009840 tx=0x7fee6801c820 comp rx=0 tx=0).stop 2024-09-17T05:36:48.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.796+0000 7fee86c00640 1 -- 172.21.15.31:0/3132942166 shutdown_connections 2024-09-17T05:36:48.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.796+0000 7fee86c00640 1 --2- 172.21.15.31:0/3132942166 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee800ced80 0x7fee800ae9b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.796+0000 7fee86c00640 1 -- 172.21.15.31:0/3132942166 >> 172.21.15.31:0/3132942166 conn(0x7fee800d1dc0 msgr2=0x7fee800d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:48.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.796+0000 7fee86c00640 1 -- 172.21.15.31:0/3132942166 shutdown_connections 2024-09-17T05:36:48.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee86c00640 1 -- 172.21.15.31:0/3132942166 wait complete. 2024-09-17T05:36:48.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee86c00640 1 Processor -- start 2024-09-17T05:36:48.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee86c00640 1 -- start start 2024-09-17T05:36:48.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee86c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee800cdb30 0x7fee80154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:48.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee86c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee800ced80 0x7fee801fbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:48.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee86c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee8015bea0 0x7fee80167080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:48.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee86c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fee8016a8a0 con 0x7fee800ced80 2024-09-17T05:36:48.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee86c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fee8016a720 con 0x7fee800cdb30 2024-09-17T05:36:48.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee86c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fee8016aa20 con 0x7fee8015bea0 2024-09-17T05:36:48.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee77e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee800ced80 0x7fee801fbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:48.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee77e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee800ced80 0x7fee801fbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32878/0 (socket says 172.21.15.31:32878) 2024-09-17T05:36:48.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee77e00640 1 -- 172.21.15.31:0/960304728 learned_addr learned my addr 172.21.15.31:0/960304728 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:48.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee7fe00640 1 --2- 172.21.15.31:0/960304728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee800cdb30 0x7fee80154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:48.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee84c00640 1 --2- 172.21.15.31:0/960304728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee8015bea0 0x7fee80167080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:48.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee77e00640 1 -- 172.21.15.31:0/960304728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee8015bea0 msgr2=0x7fee80167080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:48.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee77e00640 1 --2- 172.21.15.31:0/960304728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee8015bea0 0x7fee80167080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee77e00640 1 -- 172.21.15.31:0/960304728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee800cdb30 msgr2=0x7fee80154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:48.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee77e00640 1 --2- 172.21.15.31:0/960304728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee800cdb30 0x7fee80154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee77e00640 1 -- 172.21.15.31:0/960304728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee80152230 con 0x7fee800ced80 2024-09-17T05:36:48.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.800+0000 7fee77e00640 1 --2- 172.21.15.31:0/960304728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee800ced80 0x7fee801fbb20 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fee68009790 tx=0x7fee680a5700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:48.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.804+0000 7fee7cc00640 1 -- 172.21.15.31:0/960304728 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee680b2040 con 0x7fee800ced80 2024-09-17T05:36:48.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.804+0000 7fee7cc00640 1 -- 172.21.15.31:0/960304728 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee68004430 con 0x7fee800ced80 2024-09-17T05:36:48.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.804+0000 7fee86c00640 1 -- 172.21.15.31:0/960304728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee80151f50 con 0x7fee800ced80 2024-09-17T05:36:48.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.804+0000 7fee7cc00640 1 -- 172.21.15.31:0/960304728 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68005280 con 0x7fee800ced80 2024-09-17T05:36:48.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.804+0000 7fee86c00640 1 -- 172.21.15.31:0/960304728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee801fb320 con 0x7fee800ced80 2024-09-17T05:36:48.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.804+0000 7fee86c00640 1 -- 172.21.15.31:0/960304728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee800ce670 con 0x7fee800ced80 2024-09-17T05:36:48.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.804+0000 7fee7cc00640 1 -- 172.21.15.31:0/960304728 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7fee680be060 con 0x7fee800ced80 2024-09-17T05:36:48.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.808+0000 7fee7cc00640 1 --2- 172.21.15.31:0/960304728 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee5c073c20 0x7fee5c0760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:48.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.808+0000 7fee7cc00640 1 -- 172.21.15.31:0/960304728 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 4885+0+0 (secure 0 0 0) 0x7fee6812c9e0 con 0x7fee800ced80 2024-09-17T05:36:48.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.808+0000 7fee7fe00640 1 --2- 172.21.15.31:0/960304728 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee5c073c20 0x7fee5c0760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:48.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.808+0000 7fee7fe00640 1 --2- 172.21.15.31:0/960304728 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee5c073c20 0x7fee5c0760e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fee70000f70 tx=0x7fee70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:48.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.808+0000 7fee7cc00640 1 -- 172.21.15.31:0/960304728 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fee68016410 con 0x7fee800ced80 2024-09-17T05:36:48.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.988+0000 7fee86c00640 1 -- 172.21.15.31:0/960304728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fee8006fcc0 con 0x7fee800ced80 2024-09-17T05:36:48.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.988+0000 7fee7cc00640 1 -- 172.21.15.31:0/960304728 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v159) ==== 84+0+65 (secure 0 0 0) 0x7fee680f9320 con 0x7fee800ced80 2024-09-17T05:36:48.991 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:48.991 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:36:48.991 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:36:48.991 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-09-17T05:36:48.991 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-09-17T05:36:48.992 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:36:48.992 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:36:48.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.992+0000 7fee86c00640 1 -- 172.21.15.31:0/960304728 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee5c073c20 msgr2=0x7fee5c0760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:48.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.992+0000 7fee86c00640 1 --2- 172.21.15.31:0/960304728 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee5c073c20 0x7fee5c0760e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fee70000f70 tx=0x7fee70009040 comp rx=0 tx=0).stop 2024-09-17T05:36:48.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.992+0000 7fee86c00640 1 -- 172.21.15.31:0/960304728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee800ced80 msgr2=0x7fee801fbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:48.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.992+0000 7fee86c00640 1 --2- 172.21.15.31:0/960304728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee800ced80 0x7fee801fbb20 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fee68009790 tx=0x7fee680a5700 comp rx=0 tx=0).stop 2024-09-17T05:36:48.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.992+0000 7fee86c00640 1 -- 172.21.15.31:0/960304728 shutdown_connections 2024-09-17T05:36:48.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.992+0000 7fee86c00640 1 --2- 172.21.15.31:0/960304728 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fee5c073c20 0x7fee5c0760e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.992+0000 7fee86c00640 1 --2- 172.21.15.31:0/960304728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fee8015bea0 0x7fee80167080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.992+0000 7fee86c00640 1 --2- 172.21.15.31:0/960304728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fee800ced80 0x7fee801fbb20 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.992+0000 7fee86c00640 1 --2- 172.21.15.31:0/960304728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee800cdb30 0x7fee80154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:48.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.992+0000 7fee86c00640 1 -- 172.21.15.31:0/960304728 >> 172.21.15.31:0/960304728 conn(0x7fee800d1dc0 msgr2=0x7fee800d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:48.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.992+0000 7fee86c00640 1 -- 172.21.15.31:0/960304728 shutdown_connections 2024-09-17T05:36:48.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:48.992+0000 7fee86c00640 1 -- 172.21.15.31:0/960304728 wait complete. 2024-09-17T05:36:49.012 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:36:49.012 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:36:49.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.160+0000 7feae0c00640 1 -- 172.21.15.31:0/1129703769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feac0003a10 msgr2=0x7feac0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:49.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.160+0000 7feae0c00640 1 --2- 172.21.15.31:0/1129703769 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feac0003a10 0x7feac0003e30 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7feacc00c2e0 tx=0x7feacc01f6e0 comp rx=0 tx=0).stop 2024-09-17T05:36:49.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.160+0000 7feada800640 1 -- 172.21.15.31:0/1129703769 reap_dead start 2024-09-17T05:36:49.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.160+0000 7feae0c00640 1 -- 172.21.15.31:0/1129703769 shutdown_connections 2024-09-17T05:36:49.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.160+0000 7feae0c00640 1 -- 172.21.15.31:0/1129703769 >> 172.21.15.31:0/1129703769 conn(0x7feadc0d1da0 msgr2=0x7feadc0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:49.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.160+0000 7feae0c00640 1 -- 172.21.15.31:0/1129703769 shutdown_connections 2024-09-17T05:36:49.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.160+0000 7feae0c00640 1 -- 172.21.15.31:0/1129703769 wait complete. 2024-09-17T05:36:49.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7feae0c00640 1 Processor -- start 2024-09-17T05:36:49.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7feae0c00640 1 -- start start 2024-09-17T05:36:49.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7feae0c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feac0003a10 0x7feadc15e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:49.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7feae0c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feadc15b860 0x7feadc15a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:49.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7feae0c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feadc15b2f0 0x7feadc0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:49.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7feae0c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7feadc0cc3f0 con 0x7feac0003a10 2024-09-17T05:36:49.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7feae0c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feadc0cf250 con 0x7feadc15b2f0 2024-09-17T05:36:49.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7feae0c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7feadc0cc570 con 0x7feadc15b860 2024-09-17T05:36:49.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7fead9e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feac0003a10 0x7feadc15e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:49.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7fead9e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feac0003a10 0x7feadc15e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32904/0 (socket says 172.21.15.31:32904) 2024-09-17T05:36:49.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7fead9e00640 1 -- 172.21.15.31:0/3445815905 learned_addr learned my addr 172.21.15.31:0/3445815905 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:49.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7feada800640 1 --2- 172.21.15.31:0/3445815905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feadc15b2f0 0x7feadc0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:49.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7fead3e00640 1 --2- 172.21.15.31:0/3445815905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feadc15b860 0x7feadc15a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:49.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7fead9e00640 1 -- 172.21.15.31:0/3445815905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feadc15b860 msgr2=0x7feadc15a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:49.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7fead9e00640 1 --2- 172.21.15.31:0/3445815905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feadc15b860 0x7feadc15a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:49.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7fead9e00640 1 -- 172.21.15.31:0/3445815905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feadc15b2f0 msgr2=0x7feadc0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:49.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7fead9e00640 1 --2- 172.21.15.31:0/3445815905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feadc15b2f0 0x7feadc0b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:49.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7fead9e00640 1 -- 172.21.15.31:0/3445815905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feadc0b7aa0 con 0x7feac0003a10 2024-09-17T05:36:49.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7fead9e00640 1 --2- 172.21.15.31:0/3445815905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feac0003a10 0x7feadc15e6a0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7feacc000c10 tx=0x7feacc001ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:49.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7fead2000640 1 -- 172.21.15.31:0/3445815905 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feacc0b3030 con 0x7feac0003a10 2024-09-17T05:36:49.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7fead2000640 1 -- 172.21.15.31:0/3445815905 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feacc006420 con 0x7feac0003a10 2024-09-17T05:36:49.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7fead2000640 1 -- 172.21.15.31:0/3445815905 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feacc003880 con 0x7feac0003a10 2024-09-17T05:36:49.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7feae0c00640 1 -- 172.21.15.31:0/3445815905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feadc15b0a0 con 0x7feac0003a10 2024-09-17T05:36:49.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.164+0000 7feae0c00640 1 -- 172.21.15.31:0/3445815905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feadc1e7b00 con 0x7feac0003a10 2024-09-17T05:36:49.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.168+0000 7feae0c00640 1 -- 172.21.15.31:0/3445815905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feadc06ecb0 con 0x7feac0003a10 2024-09-17T05:36:49.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.168+0000 7fead2000640 1 -- 172.21.15.31:0/3445815905 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7feacc0c2060 con 0x7feac0003a10 2024-09-17T05:36:49.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.168+0000 7fead2000640 1 --2- 172.21.15.31:0/3445815905 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7feab8073c50 0x7feab8076110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:49.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.168+0000 7fead2000640 1 -- 172.21.15.31:0/3445815905 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 4885+0+0 (secure 0 0 0) 0x7feacc12ff90 con 0x7feac0003a10 2024-09-17T05:36:49.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.168+0000 7fead3e00640 1 --2- 172.21.15.31:0/3445815905 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7feab8073c50 0x7feab8076110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:49.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.168+0000 7fead3e00640 1 --2- 172.21.15.31:0/3445815905 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7feab8073c50 0x7feab8076110 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7feadc15bc60 tx=0x7feac40091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:49.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.172+0000 7fead2000640 1 -- 172.21.15.31:0/3445815905 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7feacc019490 con 0x7feac0003a10 2024-09-17T05:36:49.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:49.348+0000 7feae0c00640 1 -- 172.21.15.31:0/3445815905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7feadc070350 con 0x7feac0003a10 2024-09-17T05:36:50.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.208+0000 7fead2000640 1 -- 172.21.15.31:0/3445815905 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v160) ==== 138+0+0 (secure 0 0 0) 0x7feacc132030 con 0x7feac0003a10 2024-09-17T05:36:50.212 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-09-17T05:36:50.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.212+0000 7feae0c00640 1 -- 172.21.15.31:0/3445815905 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7feab8073c50 msgr2=0x7feab8076110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:50.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.212+0000 7feae0c00640 1 --2- 172.21.15.31:0/3445815905 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7feab8073c50 0x7feab8076110 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7feadc15bc60 tx=0x7feac40091e0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.212+0000 7feae0c00640 1 -- 172.21.15.31:0/3445815905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feac0003a10 msgr2=0x7feadc15e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:50.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.212+0000 7feae0c00640 1 --2- 172.21.15.31:0/3445815905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feac0003a10 0x7feadc15e6a0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7feacc000c10 tx=0x7feacc001ce0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.212+0000 7feae0c00640 1 -- 172.21.15.31:0/3445815905 shutdown_connections 2024-09-17T05:36:50.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.212+0000 7feae0c00640 1 --2- 172.21.15.31:0/3445815905 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7feab8073c50 0x7feab8076110 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.212+0000 7feae0c00640 1 --2- 172.21.15.31:0/3445815905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feadc15b2f0 0x7feadc0b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.212+0000 7feae0c00640 1 --2- 172.21.15.31:0/3445815905 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7feadc15b860 0x7feadc15a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.212+0000 7feae0c00640 1 --2- 172.21.15.31:0/3445815905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feac0003a10 0x7feadc15e6a0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.212+0000 7feae0c00640 1 -- 172.21.15.31:0/3445815905 >> 172.21.15.31:0/3445815905 conn(0x7feadc0d1da0 msgr2=0x7feadc072250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:50.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.216+0000 7feae0c00640 1 -- 172.21.15.31:0/3445815905 shutdown_connections 2024-09-17T05:36:50.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.216+0000 7feae0c00640 1 -- 172.21.15.31:0/3445815905 wait complete. 2024-09-17T05:36:50.243 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:36:50.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.396+0000 7fb366600640 1 -- 172.21.15.31:0/867565556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb36015dae0 msgr2=0x7fb344004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:50.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.396+0000 7fb366600640 1 --2- 172.21.15.31:0/867565556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb36015dae0 0x7fb344004d80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb350009b60 tx=0x7fb35001d2b0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.396+0000 7fb35fe00640 1 -- 172.21.15.31:0/867565556 reap_dead start 2024-09-17T05:36:50.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.396+0000 7fb366600640 1 -- 172.21.15.31:0/867565556 shutdown_connections 2024-09-17T05:36:50.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.396+0000 7fb366600640 1 -- 172.21.15.31:0/867565556 >> 172.21.15.31:0/867565556 conn(0x7fb3600b18f0 msgr2=0x7fb3600b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:50.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.396+0000 7fb366600640 1 -- 172.21.15.31:0/867565556 shutdown_connections 2024-09-17T05:36:50.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.396+0000 7fb366600640 1 -- 172.21.15.31:0/867565556 wait complete. 2024-09-17T05:36:50.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.396+0000 7fb366600640 1 Processor -- start 2024-09-17T05:36:50.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.396+0000 7fb366600640 1 -- start start 2024-09-17T05:36:50.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb366600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb36015dae0 0x7fb3600afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:50.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb366600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb360154d80 0x7fb3601552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:50.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb366600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb360155800 0x7fb360149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:50.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb366600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb3600acd40 con 0x7fb36015dae0 2024-09-17T05:36:50.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb366600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb36006fb60 con 0x7fb360155800 2024-09-17T05:36:50.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb366600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb3600acec0 con 0x7fb360154d80 2024-09-17T05:36:50.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb35f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb36015dae0 0x7fb3600afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:50.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb35f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb36015dae0 0x7fb3600afd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32924/0 (socket says 172.21.15.31:32924) 2024-09-17T05:36:50.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb35f400640 1 -- 172.21.15.31:0/4199366694 learned_addr learned my addr 172.21.15.31:0/4199366694 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:50.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb35f400640 1 -- 172.21.15.31:0/4199366694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb360154d80 msgr2=0x7fb3601552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:50.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb357e00640 1 --2- 172.21.15.31:0/4199366694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb360154d80 0x7fb3601552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:50.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb35fe00640 1 --2- 172.21.15.31:0/4199366694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb360155800 0x7fb360149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:50.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb35f400640 1 --2- 172.21.15.31:0/4199366694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb360154d80 0x7fb3601552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb35f400640 1 -- 172.21.15.31:0/4199366694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb360155800 msgr2=0x7fb360149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:50.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb35f400640 1 --2- 172.21.15.31:0/4199366694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb360155800 0x7fb360149590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:50.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb35f400640 1 -- 172.21.15.31:0/4199366694 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3600ccd20 con 0x7fb36015dae0 2024-09-17T05:36:50.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb35fe00640 1 --2- 172.21.15.31:0/4199366694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb360155800 0x7fb360149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:50.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb357e00640 1 --2- 172.21.15.31:0/4199366694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb360154d80 0x7fb3601552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:50.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb35f400640 1 --2- 172.21.15.31:0/4199366694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb36015dae0 0x7fb3600afd00 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fb35001cd20 tx=0x7fb35001baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:50.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb357400640 1 -- 172.21.15.31:0/4199366694 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3500bd070 con 0x7fb36015dae0 2024-09-17T05:36:50.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb366600640 1 -- 172.21.15.31:0/4199366694 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb360155dc0 con 0x7fb36015dae0 2024-09-17T05:36:50.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb357400640 1 -- 172.21.15.31:0/4199366694 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3500b3040 con 0x7fb36015dae0 2024-09-17T05:36:50.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb357400640 1 -- 172.21.15.31:0/4199366694 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3500b2070 con 0x7fb36015dae0 2024-09-17T05:36:50.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb366600640 1 -- 172.21.15.31:0/4199366694 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3601542a0 con 0x7fb36015dae0 2024-09-17T05:36:50.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.400+0000 7fb366600640 1 -- 172.21.15.31:0/4199366694 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3600cf090 con 0x7fb36015dae0 2024-09-17T05:36:50.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.404+0000 7fb357400640 1 -- 172.21.15.31:0/4199366694 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7fb350004290 con 0x7fb36015dae0 2024-09-17T05:36:50.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.404+0000 7fb357400640 1 --2- 172.21.15.31:0/4199366694 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb33c073c20 0x7fb33c0760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:50.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.404+0000 7fb357400640 1 -- 172.21.15.31:0/4199366694 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5255+0+0 (secure 0 0 0) 0x7fb35012d2c0 con 0x7fb36015dae0 2024-09-17T05:36:50.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.404+0000 7fb357e00640 1 --2- 172.21.15.31:0/4199366694 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb33c073c20 0x7fb33c0760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:50.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.404+0000 7fb357e00640 1 --2- 172.21.15.31:0/4199366694 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb33c073c20 0x7fb33c0760e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb348001170 tx=0x7fb348001df0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:50.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.408+0000 7fb357400640 1 -- 172.21.15.31:0/4199366694 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fb350016fc0 con 0x7fb36015dae0 2024-09-17T05:36:50.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:50.584+0000 7fb366600640 1 -- 172.21.15.31:0/4199366694 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb360074280 con 0x7fb36015dae0 2024-09-17T05:36:51.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.216+0000 7fb357400640 1 -- 172.21.15.31:0/4199366694 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v161) ==== 170+0+0 (secure 0 0 0) 0x7fb3500f9770 con 0x7fb36015dae0 2024-09-17T05:36:51.220 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-09-17T05:36:51.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.220+0000 7fb366600640 1 -- 172.21.15.31:0/4199366694 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb33c073c20 msgr2=0x7fb33c0760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:51.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.220+0000 7fb366600640 1 --2- 172.21.15.31:0/4199366694 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb33c073c20 0x7fb33c0760e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb348001170 tx=0x7fb348001df0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.220+0000 7fb366600640 1 -- 172.21.15.31:0/4199366694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb36015dae0 msgr2=0x7fb3600afd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:51.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.220+0000 7fb366600640 1 --2- 172.21.15.31:0/4199366694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb36015dae0 0x7fb3600afd00 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fb35001cd20 tx=0x7fb35001baf0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.220+0000 7fb366600640 1 -- 172.21.15.31:0/4199366694 shutdown_connections 2024-09-17T05:36:51.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.220+0000 7fb366600640 1 --2- 172.21.15.31:0/4199366694 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fb33c073c20 0x7fb33c0760e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.220+0000 7fb366600640 1 --2- 172.21.15.31:0/4199366694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb360155800 0x7fb360149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.220+0000 7fb366600640 1 --2- 172.21.15.31:0/4199366694 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb360154d80 0x7fb3601552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.220+0000 7fb366600640 1 --2- 172.21.15.31:0/4199366694 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb36015dae0 0x7fb3600afd00 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.220+0000 7fb366600640 1 -- 172.21.15.31:0/4199366694 >> 172.21.15.31:0/4199366694 conn(0x7fb3600b18f0 msgr2=0x7fb360153540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:51.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.224+0000 7fb366600640 1 -- 172.21.15.31:0/4199366694 shutdown_connections 2024-09-17T05:36:51.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.224+0000 7fb366600640 1 -- 172.21.15.31:0/4199366694 wait complete. 2024-09-17T05:36:51.269 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:36:51.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.420+0000 7f127a600640 1 -- 172.21.15.31:0/973314450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12740b1650 msgr2=0x7f12740b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:51.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.420+0000 7f127a600640 1 --2- 172.21.15.31:0/973314450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12740b1650 0x7f12740b1a30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f125c009870 tx=0x7f125c01c860 comp rx=0 tx=0).stop 2024-09-17T05:36:51.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.420+0000 7f127a600640 1 -- 172.21.15.31:0/973314450 shutdown_connections 2024-09-17T05:36:51.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.420+0000 7f127a600640 1 --2- 172.21.15.31:0/973314450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12740b1650 0x7f12740b1a30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.420+0000 7f127a600640 1 -- 172.21.15.31:0/973314450 >> 172.21.15.31:0/973314450 conn(0x7f12740d1dd0 msgr2=0x7f12740d21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:51.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.420+0000 7f127a600640 1 -- 172.21.15.31:0/973314450 shutdown_connections 2024-09-17T05:36:51.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.420+0000 7f127a600640 1 -- 172.21.15.31:0/973314450 wait complete. 2024-09-17T05:36:51.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f127a600640 1 Processor -- start 2024-09-17T05:36:51.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f127a600640 1 -- start start 2024-09-17T05:36:51.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f127a600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12740afb10 0x7f12740cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:51.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f127a600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12740b1650 0x7f12740cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:51.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f127a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12741605d0 0x7f12741664c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:51.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f127a600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f12740b13a0 con 0x7f12741605d0 2024-09-17T05:36:51.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f127a600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f12740b1220 con 0x7f12740b1650 2024-09-17T05:36:51.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f127a600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f127416a550 con 0x7f12740afb10 2024-09-17T05:36:51.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f1273e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12741605d0 0x7f12741664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:51.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f1273e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12741605d0 0x7f12741664c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32938/0 (socket says 172.21.15.31:32938) 2024-09-17T05:36:51.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f1273e00640 1 -- 172.21.15.31:0/1742264109 learned_addr learned my addr 172.21.15.31:0/1742264109 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:51.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f1273400640 1 --2- 172.21.15.31:0/1742264109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12740afb10 0x7f12740cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:51.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f126be00640 1 --2- 172.21.15.31:0/1742264109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12740b1650 0x7f12740cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:51.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f1273e00640 1 -- 172.21.15.31:0/1742264109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12740afb10 msgr2=0x7f12740cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:51.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f1273e00640 1 --2- 172.21.15.31:0/1742264109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12740afb10 0x7f12740cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f1273e00640 1 -- 172.21.15.31:0/1742264109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12740b1650 msgr2=0x7f12740cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:51.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f1273e00640 1 --2- 172.21.15.31:0/1742264109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12740b1650 0x7f12740cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:51.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f1273e00640 1 -- 172.21.15.31:0/1742264109 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12740cc630 con 0x7f12741605d0 2024-09-17T05:36:51.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f1273e00640 1 --2- 172.21.15.31:0/1742264109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12741605d0 0x7f12741664c0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f126c00cbc0 tx=0x7f126c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:51.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f126b400640 1 -- 172.21.15.31:0/1742264109 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c016020 con 0x7f12741605d0 2024-09-17T05:36:51.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f126b400640 1 -- 172.21.15.31:0/1742264109 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f126c00ab00 con 0x7f12741605d0 2024-09-17T05:36:51.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f126b400640 1 -- 172.21.15.31:0/1742264109 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c012420 con 0x7f12741605d0 2024-09-17T05:36:51.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f127a600640 1 -- 172.21.15.31:0/1742264109 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12740ce7d0 con 0x7f12741605d0 2024-09-17T05:36:51.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f127a600640 1 -- 172.21.15.31:0/1742264109 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12740cc8f0 con 0x7f12741605d0 2024-09-17T05:36:51.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.424+0000 7f127a600640 1 -- 172.21.15.31:0/1742264109 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12740affc0 con 0x7f12741605d0 2024-09-17T05:36:51.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.428+0000 7f126b400640 1 -- 172.21.15.31:0/1742264109 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f126c019020 con 0x7f12741605d0 2024-09-17T05:36:51.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.428+0000 7f126b400640 1 --2- 172.21.15.31:0/1742264109 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1250073c20 0x7f12500760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:51.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.428+0000 7f126b400640 1 -- 172.21.15.31:0/1742264109 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 5637+0+0 (secure 0 0 0) 0x7f126c0933f0 con 0x7f12741605d0 2024-09-17T05:36:51.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.428+0000 7f1273400640 1 --2- 172.21.15.31:0/1742264109 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1250073c20 0x7f12500760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:51.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.428+0000 7f1273400640 1 --2- 172.21.15.31:0/1742264109 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1250073c20 0x7f12500760e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1264007fd0 tx=0x7f1264009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:51.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.432+0000 7f126b400640 1 -- 172.21.15.31:0/1742264109 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f126c020020 con 0x7f12741605d0 2024-09-17T05:36:51.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:51.640+0000 7f127a600640 1 -- 172.21.15.31:0/1742264109 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f12740c7280 con 0x7f12741605d0 2024-09-17T05:36:52.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.220+0000 7f126b400640 1 -- 172.21.15.31:0/1742264109 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 26 and data pool 27 v115) ==== 174+0+0 (secure 0 0 0) 0x7f126c05f6c0 con 0x7f12741605d0 2024-09-17T05:36:52.223 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 26 and data pool 27 2024-09-17T05:36:52.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.224+0000 7f127a600640 1 -- 172.21.15.31:0/1742264109 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1250073c20 msgr2=0x7f12500760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.224+0000 7f127a600640 1 --2- 172.21.15.31:0/1742264109 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1250073c20 0x7f12500760e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1264007fd0 tx=0x7f1264009040 comp rx=0 tx=0).stop 2024-09-17T05:36:52.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.224+0000 7f127a600640 1 -- 172.21.15.31:0/1742264109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12741605d0 msgr2=0x7f12741664c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.224+0000 7f127a600640 1 --2- 172.21.15.31:0/1742264109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12741605d0 0x7f12741664c0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f126c00cbc0 tx=0x7f126c00ccb0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.224+0000 7f127a600640 1 -- 172.21.15.31:0/1742264109 shutdown_connections 2024-09-17T05:36:52.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.224+0000 7f127a600640 1 --2- 172.21.15.31:0/1742264109 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1250073c20 0x7f12500760e0 secure :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1264007fd0 tx=0x7f1264009040 comp rx=0 tx=0).stop 2024-09-17T05:36:52.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.224+0000 7f127a600640 1 --2- 172.21.15.31:0/1742264109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f12741605d0 0x7f12741664c0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.224+0000 7f127a600640 1 --2- 172.21.15.31:0/1742264109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12740b1650 0x7f12740cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.224+0000 7f127a600640 1 --2- 172.21.15.31:0/1742264109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12740afb10 0x7f12740cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.224+0000 7f127a600640 1 -- 172.21.15.31:0/1742264109 >> 172.21.15.31:0/1742264109 conn(0x7f12740d1dd0 msgr2=0x7f1274071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:52.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.224+0000 7f127a600640 1 -- 172.21.15.31:0/1742264109 shutdown_connections 2024-09-17T05:36:52.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.224+0000 7f127a600640 1 -- 172.21.15.31:0/1742264109 wait complete. 2024-09-17T05:36:52.271 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:52.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3664a00640 1 -- 172.21.15.31:0/1720763311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36600cfe80 msgr2=0x7f36600d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3664a00640 1 --2- 172.21.15.31:0/1720763311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36600cfe80 0x7f36600d0260 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f3650009840 tx=0x7f365001c790 comp rx=0 tx=0).stop 2024-09-17T05:36:52.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3664a00640 1 -- 172.21.15.31:0/1720763311 shutdown_connections 2024-09-17T05:36:52.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3664a00640 1 --2- 172.21.15.31:0/1720763311 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36600b2760 0x7f36601605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3664a00640 1 --2- 172.21.15.31:0/1720763311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36600cfe80 0x7f36600d0260 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3664a00640 1 -- 172.21.15.31:0/1720763311 >> 172.21.15.31:0/1720763311 conn(0x7f36600d1e40 msgr2=0x7f36600d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:52.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3664a00640 1 -- 172.21.15.31:0/1720763311 shutdown_connections 2024-09-17T05:36:52.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3664a00640 1 -- 172.21.15.31:0/1720763311 wait complete. 2024-09-17T05:36:52.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3664a00640 1 Processor -- start 2024-09-17T05:36:52.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3664a00640 1 -- start start 2024-09-17T05:36:52.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3664a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36600b2760 0x7f3660146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:52.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3664a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36600b2d00 0x7f366006f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:52.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3664a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36600cfe80 0x7f3660071a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:52.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3664a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f36600b0930 con 0x7f36600b2d00 2024-09-17T05:36:52.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3664a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f36600b07b0 con 0x7f36600b2760 2024-09-17T05:36:52.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3664a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f36600b0ab0 con 0x7f36600cfe80 2024-09-17T05:36:52.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3657e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36600b2d00 0x7f366006f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:52.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3657e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36600b2d00 0x7f366006f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32966/0 (socket says 172.21.15.31:32966) 2024-09-17T05:36:52.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3657e00640 1 -- 172.21.15.31:0/3164304150 learned_addr learned my addr 172.21.15.31:0/3164304150 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:52.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f365de00640 1 --2- 172.21.15.31:0/3164304150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36600b2760 0x7f3660146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:52.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f365e800640 1 --2- 172.21.15.31:0/3164304150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36600cfe80 0x7f3660071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:52.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3657e00640 1 -- 172.21.15.31:0/3164304150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36600cfe80 msgr2=0x7f3660071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3657e00640 1 --2- 172.21.15.31:0/3164304150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36600cfe80 0x7f3660071a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3657e00640 1 -- 172.21.15.31:0/3164304150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36600b2760 msgr2=0x7f3660146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3657e00640 1 --2- 172.21.15.31:0/3164304150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36600b2760 0x7f3660146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3657e00640 1 -- 172.21.15.31:0/3164304150 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36601466c0 con 0x7f36600b2d00 2024-09-17T05:36:52.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f365de00640 1 --2- 172.21.15.31:0/3164304150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36600b2760 0x7f3660146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:52.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f365e800640 1 --2- 172.21.15.31:0/3164304150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36600cfe80 0x7f3660071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:52.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.420+0000 7f3657e00640 1 --2- 172.21.15.31:0/3164304150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36600b2d00 0x7f366006f3a0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f364800c730 tx=0x7f364800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:52.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.424+0000 7f3656000640 1 -- 172.21.15.31:0/3164304150 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648016020 con 0x7f36600b2d00 2024-09-17T05:36:52.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.424+0000 7f3656000640 1 -- 172.21.15.31:0/3164304150 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f364800a930 con 0x7f36600b2d00 2024-09-17T05:36:52.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.424+0000 7f3656000640 1 -- 172.21.15.31:0/3164304150 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364800ad80 con 0x7f36600b2d00 2024-09-17T05:36:52.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.424+0000 7f3664a00640 1 -- 172.21.15.31:0/3164304150 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f366015df70 con 0x7f36600b2d00 2024-09-17T05:36:52.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.424+0000 7f3664a00640 1 -- 172.21.15.31:0/3164304150 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f366015e530 con 0x7f36600b2d00 2024-09-17T05:36:52.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.424+0000 7f3664a00640 1 -- 172.21.15.31:0/3164304150 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36600d0260 con 0x7f36600b2d00 2024-09-17T05:36:52.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.424+0000 7f3656000640 1 -- 172.21.15.31:0/3164304150 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f3648019020 con 0x7f36600b2d00 2024-09-17T05:36:52.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.424+0000 7f3656000640 1 --2- 172.21.15.31:0/3164304150 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f363c073c50 0x7f363c076110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:52.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.424+0000 7f3656000640 1 -- 172.21.15.31:0/3164304150 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5737+0+0 (secure 0 0 0) 0x7f3648092d10 con 0x7f36600b2d00 2024-09-17T05:36:52.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.424+0000 7f365de00640 1 --2- 172.21.15.31:0/3164304150 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f363c073c50 0x7f363c076110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:52.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.428+0000 7f365de00640 1 --2- 172.21.15.31:0/3164304150 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f363c073c50 0x7f363c076110 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f36500ae000 tx=0x7f365001afd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:52.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.428+0000 7f3656000640 1 -- 172.21.15.31:0/3164304150 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f3648020020 con 0x7f36600b2d00 2024-09-17T05:36:52.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.616+0000 7f3664a00640 1 -- 172.21.15.31:0/3164304150 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36600cf0a0 con 0x7f36600b2d00 2024-09-17T05:36:52.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.616+0000 7f3656000640 1 -- 172.21.15.31:0/3164304150 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) ==== 74+0+16824 (secure 0 0 0) 0x7f36600d0c80 con 0x7f36600b2d00 2024-09-17T05:36:52.618 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:52.619 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":162,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:36:51.647103+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:49.365706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:50.600939+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:52.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.616+0000 7f3664a00640 1 -- 172.21.15.31:0/3164304150 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f363c073c50 msgr2=0x7f363c076110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.616+0000 7f3664a00640 1 --2- 172.21.15.31:0/3164304150 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f363c073c50 0x7f363c076110 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f36500ae000 tx=0x7f365001afd0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.616+0000 7f3664a00640 1 -- 172.21.15.31:0/3164304150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36600b2d00 msgr2=0x7f366006f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.616+0000 7f3664a00640 1 --2- 172.21.15.31:0/3164304150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36600b2d00 0x7f366006f3a0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f364800c730 tx=0x7f364800cbf0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.616+0000 7f3664a00640 1 -- 172.21.15.31:0/3164304150 shutdown_connections 2024-09-17T05:36:52.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.620+0000 7f3664a00640 1 --2- 172.21.15.31:0/3164304150 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f363c073c50 0x7f363c076110 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.620+0000 7f3664a00640 1 --2- 172.21.15.31:0/3164304150 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36600cfe80 0x7f3660071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.620+0000 7f3664a00640 1 --2- 172.21.15.31:0/3164304150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f36600b2d00 0x7f366006f3a0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.620+0000 7f3664a00640 1 --2- 172.21.15.31:0/3164304150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36600b2760 0x7f3660146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.620+0000 7f3664a00640 1 -- 172.21.15.31:0/3164304150 >> 172.21.15.31:0/3164304150 conn(0x7f36600d1e40 msgr2=0x7f36601594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:52.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.620+0000 7f3664a00640 1 -- 172.21.15.31:0/3164304150 shutdown_connections 2024-09-17T05:36:52.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.620+0000 7f3664a00640 1 -- 172.21.15.31:0/3164304150 wait complete. 2024-09-17T05:36:52.640 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:52.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.784+0000 7f70eca00640 1 -- 172.21.15.31:0/306834303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70e80cdb30 msgr2=0x7f70e80aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.784+0000 7f70eca00640 1 --2- 172.21.15.31:0/306834303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70e80cdb30 0x7f70e80aeef0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f70e80cc3a0 tx=0x7f70e001cd80 comp rx=0 tx=0).stop 2024-09-17T05:36:52.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.784+0000 7f70eca00640 1 -- 172.21.15.31:0/306834303 shutdown_connections 2024-09-17T05:36:52.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.784+0000 7f70eca00640 1 --2- 172.21.15.31:0/306834303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70e80cdb30 0x7f70e80aeef0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.784+0000 7f70eca00640 1 --2- 172.21.15.31:0/306834303 >> v2:172.21.15.155:3300/0 conn(0x7f70e80ced80 0x7f70e80ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.784+0000 7f70eca00640 1 -- 172.21.15.31:0/306834303 >> 172.21.15.31:0/306834303 conn(0x7f70e80d1dc0 msgr2=0x7f70e80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:52.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.784+0000 7f70eca00640 1 -- 172.21.15.31:0/306834303 shutdown_connections 2024-09-17T05:36:52.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.784+0000 7f70eca00640 1 -- 172.21.15.31:0/306834303 wait complete. 2024-09-17T05:36:52.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70eca00640 1 Processor -- start 2024-09-17T05:36:52.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70eca00640 1 -- start start 2024-09-17T05:36:52.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70eca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70e80cdb30 0x7f70e8151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:52.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70eca00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70e80ced80 0x7f70e8071610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:52.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70eca00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70e815bea0 0x7f70e8071b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:52.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70eca00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f70e81692f0 con 0x7f70e80cdb30 2024-09-17T05:36:52.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70eca00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8169170 con 0x7f70e815bea0 2024-09-17T05:36:52.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70eca00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f70e8169470 con 0x7f70e80ced80 2024-09-17T05:36:52.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70e5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70e80cdb30 0x7f70e8151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:52.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70e5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70e80cdb30 0x7f70e8151ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32990/0 (socket says 172.21.15.31:32990) 2024-09-17T05:36:52.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70e5e00640 1 -- 172.21.15.31:0/4010625021 learned_addr learned my addr 172.21.15.31:0/4010625021 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:52.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70e6800640 1 --2- 172.21.15.31:0/4010625021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70e815bea0 0x7f70e8071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:52.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70dd400640 1 --2- 172.21.15.31:0/4010625021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70e80ced80 0x7f70e8071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:52.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70e5e00640 1 -- 172.21.15.31:0/4010625021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70e80ced80 msgr2=0x7f70e8071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70e5e00640 1 --2- 172.21.15.31:0/4010625021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70e80ced80 0x7f70e8071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70e5e00640 1 -- 172.21.15.31:0/4010625021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70e815bea0 msgr2=0x7f70e8071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70e5e00640 1 --2- 172.21.15.31:0/4010625021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70e815bea0 0x7f70e8071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70e5e00640 1 -- 172.21.15.31:0/4010625021 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e80b1570 con 0x7f70e80cdb30 2024-09-17T05:36:52.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70e6800640 1 --2- 172.21.15.31:0/4010625021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70e815bea0 0x7f70e8071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:52.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70e5e00640 1 --2- 172.21.15.31:0/4010625021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70e80cdb30 0x7f70e8151ba0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f70d800b440 tx=0x7f70d800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:52.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70dea00640 1 -- 172.21.15.31:0/4010625021 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8015020 con 0x7f70e80cdb30 2024-09-17T05:36:52.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70dea00640 1 -- 172.21.15.31:0/4010625021 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70d8011980 con 0x7f70e80cdb30 2024-09-17T05:36:52.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70dea00640 1 -- 172.21.15.31:0/4010625021 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8011dd0 con 0x7f70e80cdb30 2024-09-17T05:36:52.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70eca00640 1 -- 172.21.15.31:0/4010625021 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e8158330 con 0x7f70e80cdb30 2024-09-17T05:36:52.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70eca00640 1 -- 172.21.15.31:0/4010625021 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e80b36f0 con 0x7f70e80cdb30 2024-09-17T05:36:52.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.788+0000 7f70eca00640 1 -- 172.21.15.31:0/4010625021 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e80ce020 con 0x7f70e80cdb30 2024-09-17T05:36:52.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.792+0000 7f70dea00640 1 -- 172.21.15.31:0/4010625021 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f70d8018020 con 0x7f70e80cdb30 2024-09-17T05:36:52.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.792+0000 7f70dea00640 1 --2- 172.21.15.31:0/4010625021 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f70c4073c20 0x7f70c40760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:52.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.792+0000 7f70dea00640 1 -- 172.21.15.31:0/4010625021 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5737+0+0 (secure 0 0 0) 0x7f70d8092b70 con 0x7f70e80cdb30 2024-09-17T05:36:52.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.792+0000 7f70dd400640 1 --2- 172.21.15.31:0/4010625021 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f70c4073c20 0x7f70c40760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:52.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.792+0000 7f70dd400640 1 --2- 172.21.15.31:0/4010625021 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f70c4073c20 0x7f70c40760e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f70d00058d0 tx=0x7f70d0005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:52.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.796+0000 7f70dea00640 1 -- 172.21.15.31:0/4010625021 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f70d801f030 con 0x7f70e80cdb30 2024-09-17T05:36:52.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.976+0000 7f70eca00640 1 -- 172.21.15.31:0/4010625021 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70e80ce620 con 0x7f70e80cdb30 2024-09-17T05:36:52.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.976+0000 7f70dea00640 1 -- 172.21.15.31:0/4010625021 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) ==== 74+0+16824 (secure 0 0 0) 0x7f70d800d040 con 0x7f70e80cdb30 2024-09-17T05:36:52.979 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:52.979 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":162,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:36:51.647103+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:49.365706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:50.600939+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:52.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.980+0000 7f70eca00640 1 -- 172.21.15.31:0/4010625021 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f70c4073c20 msgr2=0x7f70c40760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.980+0000 7f70eca00640 1 --2- 172.21.15.31:0/4010625021 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f70c4073c20 0x7f70c40760e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f70d00058d0 tx=0x7f70d0005860 comp rx=0 tx=0).stop 2024-09-17T05:36:52.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.980+0000 7f70eca00640 1 -- 172.21.15.31:0/4010625021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70e80cdb30 msgr2=0x7f70e8151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:52.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.980+0000 7f70eca00640 1 --2- 172.21.15.31:0/4010625021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70e80cdb30 0x7f70e8151ba0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f70d800b440 tx=0x7f70d800b900 comp rx=0 tx=0).stop 2024-09-17T05:36:52.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.980+0000 7f70eca00640 1 -- 172.21.15.31:0/4010625021 shutdown_connections 2024-09-17T05:36:52.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.980+0000 7f70eca00640 1 --2- 172.21.15.31:0/4010625021 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f70c4073c20 0x7f70c40760e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.980+0000 7f70eca00640 1 --2- 172.21.15.31:0/4010625021 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70e815bea0 0x7f70e8071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.980+0000 7f70eca00640 1 --2- 172.21.15.31:0/4010625021 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f70e80ced80 0x7f70e8071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.980+0000 7f70eca00640 1 --2- 172.21.15.31:0/4010625021 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f70e80cdb30 0x7f70e8151ba0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:52.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.980+0000 7f70eca00640 1 -- 172.21.15.31:0/4010625021 >> 172.21.15.31:0/4010625021 conn(0x7f70e80d1dc0 msgr2=0x7f70e806dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:52.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.980+0000 7f70eca00640 1 -- 172.21.15.31:0/4010625021 shutdown_connections 2024-09-17T05:36:52.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:52.980+0000 7f70eca00640 1 -- 172.21.15.31:0/4010625021 wait complete. 2024-09-17T05:36:53.001 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:36:53.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.148+0000 7f33ad200640 1 -- 172.21.15.31:0/3317977045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c004220 msgr2=0x7f338c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:53.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.148+0000 7f33ad200640 1 --2- 172.21.15.31:0/3317977045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c004220 0x7f338c004810 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f339000ac40 tx=0x7f339001e070 comp rx=0 tx=0).stop 2024-09-17T05:36:53.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.148+0000 7f33a6800640 1 -- 172.21.15.31:0/3317977045 reap_dead start 2024-09-17T05:36:53.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.148+0000 7f33ad200640 1 -- 172.21.15.31:0/3317977045 shutdown_connections 2024-09-17T05:36:53.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.148+0000 7f33ad200640 1 -- 172.21.15.31:0/3317977045 >> 172.21.15.31:0/3317977045 conn(0x7f33a80b18f0 msgr2=0x7f33a80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:53.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33ad200640 1 -- 172.21.15.31:0/3317977045 shutdown_connections 2024-09-17T05:36:53.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33ad200640 1 -- 172.21.15.31:0/3317977045 wait complete. 2024-09-17T05:36:53.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33ad200640 1 Processor -- start 2024-09-17T05:36:53.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33ad200640 1 -- start start 2024-09-17T05:36:53.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33ad200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c004220 0x7f33a80b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:53.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33ad200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33a8160090 0x7f33a8158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:53.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33ad200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33a809bbc0 0x7f33a815ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:53.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33ad200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f33a8166120 con 0x7f338c004220 2024-09-17T05:36:53.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33ad200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f33a80ccc80 con 0x7f33a809bbc0 2024-09-17T05:36:53.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33ad200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f33a81662a0 con 0x7f33a8160090 2024-09-17T05:36:53.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33a5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c004220 0x7f33a80b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:53.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33a5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c004220 0x7f33a80b1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33014/0 (socket says 172.21.15.31:33014) 2024-09-17T05:36:53.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33a5e00640 1 -- 172.21.15.31:0/1838532259 learned_addr learned my addr 172.21.15.31:0/1838532259 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:53.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33a6800640 1 --2- 172.21.15.31:0/1838532259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33a809bbc0 0x7f33a815ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:53.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f339fe00640 1 --2- 172.21.15.31:0/1838532259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33a8160090 0x7f33a8158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:53.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33a5e00640 1 -- 172.21.15.31:0/1838532259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33a8160090 msgr2=0x7f33a8158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:53.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33a5e00640 1 --2- 172.21.15.31:0/1838532259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33a8160090 0x7f33a8158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33a5e00640 1 -- 172.21.15.31:0/1838532259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33a809bbc0 msgr2=0x7f33a815ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:53.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33a5e00640 1 --2- 172.21.15.31:0/1838532259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33a809bbc0 0x7f33a815ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:53.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33a5e00640 1 -- 172.21.15.31:0/1838532259 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a815e4f0 con 0x7f338c004220 2024-09-17T05:36:53.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33a5e00640 1 --2- 172.21.15.31:0/1838532259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c004220 0x7f33a80b1180 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f3398003f20 tx=0x7f3398001870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:53.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f339e000640 1 -- 172.21.15.31:0/1838532259 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3398015070 con 0x7f338c004220 2024-09-17T05:36:53.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f339e000640 1 -- 172.21.15.31:0/1838532259 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3398011900 con 0x7f338c004220 2024-09-17T05:36:53.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f339e000640 1 -- 172.21.15.31:0/1838532259 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3398011d50 con 0x7f338c004220 2024-09-17T05:36:53.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.152+0000 7f33ad200640 1 -- 172.21.15.31:0/1838532259 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a8160870 con 0x7f338c004220 2024-09-17T05:36:53.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.156+0000 7f33ad200640 1 -- 172.21.15.31:0/1838532259 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a815e790 con 0x7f338c004220 2024-09-17T05:36:53.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.156+0000 7f33ad200640 1 -- 172.21.15.31:0/1838532259 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a8069410 con 0x7f338c004220 2024-09-17T05:36:53.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.156+0000 7f339e000640 1 -- 172.21.15.31:0/1838532259 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f3398010420 con 0x7f338c004220 2024-09-17T05:36:53.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.156+0000 7f339e000640 1 --2- 172.21.15.31:0/1838532259 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3384073c20 0x7f33840760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:53.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.156+0000 7f339e000640 1 -- 172.21.15.31:0/1838532259 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5737+0+0 (secure 0 0 0) 0x7f33980939b0 con 0x7f338c004220 2024-09-17T05:36:53.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.156+0000 7f339fe00640 1 --2- 172.21.15.31:0/1838532259 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3384073c20 0x7f33840760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:53.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.160+0000 7f339fe00640 1 --2- 172.21.15.31:0/1838532259 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3384073c20 0x7f33840760e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f33900b0000 tx=0x7f339001ae10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:53.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.160+0000 7f339e000640 1 -- 172.21.15.31:0/1838532259 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f339805fca0 con 0x7f338c004220 2024-09-17T05:36:53.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:53.376+0000 7f33ad200640 1 -- 172.21.15.31:0/1838532259 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f33a80b2010 con 0x7f338c004220 2024-09-17T05:36:54.210 INFO:tasks.ceph.mds.b.smithi155.stderr:2024-09-17T05:36:54.214+0000 7faee5000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:36:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.252+0000 7f339e000640 1 -- 172.21.15.31:0/1838532259 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v118) ==== 118+0+0 (secure 0 0 0) 0x7f33980646d0 con 0x7f338c004220 2024-09-17T05:36:54.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.256+0000 7f33ad200640 1 -- 172.21.15.31:0/1838532259 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3384073c20 msgr2=0x7f33840760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:54.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.256+0000 7f33ad200640 1 --2- 172.21.15.31:0/1838532259 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3384073c20 0x7f33840760e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f33900b0000 tx=0x7f339001ae10 comp rx=0 tx=0).stop 2024-09-17T05:36:54.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.256+0000 7f33ad200640 1 -- 172.21.15.31:0/1838532259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c004220 msgr2=0x7f33a80b1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:54.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.256+0000 7f33ad200640 1 --2- 172.21.15.31:0/1838532259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c004220 0x7f33a80b1180 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f3398003f20 tx=0x7f3398001870 comp rx=0 tx=0).stop 2024-09-17T05:36:54.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.256+0000 7f33ad200640 1 -- 172.21.15.31:0/1838532259 shutdown_connections 2024-09-17T05:36:54.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.256+0000 7f33ad200640 1 --2- 172.21.15.31:0/1838532259 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3384073c20 0x7f33840760e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.256+0000 7f33ad200640 1 --2- 172.21.15.31:0/1838532259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33a809bbc0 0x7f33a815ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.256+0000 7f33ad200640 1 --2- 172.21.15.31:0/1838532259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33a8160090 0x7f33a8158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.256+0000 7f33ad200640 1 --2- 172.21.15.31:0/1838532259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f338c004220 0x7f33a80b1180 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.256+0000 7f33ad200640 1 -- 172.21.15.31:0/1838532259 >> 172.21.15.31:0/1838532259 conn(0x7f33a80b18f0 msgr2=0x7f33a80ae550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:54.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.256+0000 7f33ad200640 1 -- 172.21.15.31:0/1838532259 shutdown_connections 2024-09-17T05:36:54.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.256+0000 7f33ad200640 1 -- 172.21.15.31:0/1838532259 wait complete. 2024-09-17T05:36:54.282 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:36:54.283 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:36:54.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.436+0000 7f3721a00640 1 -- 172.21.15.31:0/2789515232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f371c0b0d10 msgr2=0x7f371c0d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:54.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.436+0000 7f3721a00640 1 --2- 172.21.15.31:0/2789515232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f371c0b0d10 0x7f371c0d1bb0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f371c0cf780 tx=0x7f370401c8c0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.436+0000 7f3721a00640 1 -- 172.21.15.31:0/2789515232 shutdown_connections 2024-09-17T05:36:54.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.436+0000 7f3721a00640 1 --2- 172.21.15.31:0/2789515232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f371c0b0d10 0x7f371c0d1bb0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.436+0000 7f3721a00640 1 --2- 172.21.15.31:0/2789515232 >> v2:172.21.15.155:3300/0 conn(0x7f371c15bd40 0x7f371c0d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.436+0000 7f3721a00640 1 -- 172.21.15.31:0/2789515232 >> 172.21.15.31:0/2789515232 conn(0x7f371c09aa10 msgr2=0x7f371c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:54.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.436+0000 7f3721a00640 1 -- 172.21.15.31:0/2789515232 shutdown_connections 2024-09-17T05:36:54.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.436+0000 7f3721a00640 1 -- 172.21.15.31:0/2789515232 wait complete. 2024-09-17T05:36:54.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.436+0000 7f3721a00640 1 Processor -- start 2024-09-17T05:36:54.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.436+0000 7f3721a00640 1 -- start start 2024-09-17T05:36:54.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.436+0000 7f3721a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c0b0d10 0x7f371c1fb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:54.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.436+0000 7f3721a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f371c0d20f0 0x7f371c0cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:54.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.436+0000 7f3721a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f371c15bd40 0x7f371c1449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:54.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.436+0000 7f3721a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f371c168d60 con 0x7f371c15bd40 2024-09-17T05:36:54.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.436+0000 7f3721a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f371c168be0 con 0x7f371c0d20f0 2024-09-17T05:36:54.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.436+0000 7f3721a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f371c168ee0 con 0x7f371c0b0d10 2024-09-17T05:36:54.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.440+0000 7f3721000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f371c15bd40 0x7f371c1449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:54.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.440+0000 7f3721000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f371c15bd40 0x7f371c1449e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33034/0 (socket says 172.21.15.31:33034) 2024-09-17T05:36:54.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.440+0000 7f3721000640 1 -- 172.21.15.31:0/792439780 learned_addr learned my addr 172.21.15.31:0/792439780 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:54.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.440+0000 7f371be00640 1 --2- 172.21.15.31:0/792439780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c0b0d10 0x7f371c1fb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:54.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.440+0000 7f3713400640 1 --2- 172.21.15.31:0/792439780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f371c0d20f0 0x7f371c0cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:54.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.440+0000 7f3721000640 1 -- 172.21.15.31:0/792439780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c0b0d10 msgr2=0x7f371c1fb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:54.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.440+0000 7f3721000640 1 --2- 172.21.15.31:0/792439780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c0b0d10 0x7f371c1fb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.440+0000 7f3721000640 1 -- 172.21.15.31:0/792439780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f371c0d20f0 msgr2=0x7f371c0cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:54.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.440+0000 7f3721000640 1 --2- 172.21.15.31:0/792439780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f371c0d20f0 0x7f371c0cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:54.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.440+0000 7f3721000640 1 -- 172.21.15.31:0/792439780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371c145550 con 0x7f371c15bd40 2024-09-17T05:36:54.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.440+0000 7f3721000640 1 --2- 172.21.15.31:0/792439780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f371c15bd40 0x7f371c1449e0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f371400c780 tx=0x7f371400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:54.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.440+0000 7f3718c00640 1 -- 172.21.15.31:0/792439780 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714004b70 con 0x7f371c15bd40 2024-09-17T05:36:54.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.440+0000 7f3718c00640 1 -- 172.21.15.31:0/792439780 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3714004e00 con 0x7f371c15bd40 2024-09-17T05:36:54.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.440+0000 7f3718c00640 1 -- 172.21.15.31:0/792439780 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371400aa90 con 0x7f371c15bd40 2024-09-17T05:36:54.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.440+0000 7f3721a00640 1 -- 172.21.15.31:0/792439780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f371c145830 con 0x7f371c15bd40 2024-09-17T05:36:54.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.440+0000 7f3721a00640 1 -- 172.21.15.31:0/792439780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f371c0cb190 con 0x7f371c15bd40 2024-09-17T05:36:54.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.440+0000 7f3721a00640 1 -- 172.21.15.31:0/792439780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f371c0d1bb0 con 0x7f371c15bd40 2024-09-17T05:36:54.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.440+0000 7f3718c00640 1 -- 172.21.15.31:0/792439780 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f371400ac30 con 0x7f371c15bd40 2024-09-17T05:36:54.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.444+0000 7f3718c00640 1 --2- 172.21.15.31:0/792439780 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f36f8073c20 0x7f36f80760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:54.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.444+0000 7f3718c00640 1 -- 172.21.15.31:0/792439780 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f3714093050 con 0x7f371c15bd40 2024-09-17T05:36:54.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.444+0000 7f371be00640 1 --2- 172.21.15.31:0/792439780 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f36f8073c20 0x7f36f80760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:54.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.444+0000 7f371be00640 1 --2- 172.21.15.31:0/792439780 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f36f8073c20 0x7f36f80760e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f370c0058d0 tx=0x7f370c005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:54.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.448+0000 7f3718c00640 1 -- 172.21.15.31:0/792439780 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f3714020070 con 0x7f371c15bd40 2024-09-17T05:36:54.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:54.660+0000 7f3721a00640 1 -- 172.21.15.31:0/792439780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f371c071580 con 0x7f371c15bd40 2024-09-17T05:36:55.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.264+0000 7f3718c00640 1 -- 172.21.15.31:0/792439780 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v119) ==== 122+0+0 (secure 0 0 0) 0x7f371405f2e0 con 0x7f371c15bd40 2024-09-17T05:36:55.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.264+0000 7f3721a00640 1 -- 172.21.15.31:0/792439780 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f36f8073c20 msgr2=0x7f36f80760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.264+0000 7f3721a00640 1 --2- 172.21.15.31:0/792439780 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f36f8073c20 0x7f36f80760e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f370c0058d0 tx=0x7f370c005860 comp rx=0 tx=0).stop 2024-09-17T05:36:55.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.264+0000 7f3721a00640 1 -- 172.21.15.31:0/792439780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f371c15bd40 msgr2=0x7f371c1449e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.264+0000 7f3721a00640 1 --2- 172.21.15.31:0/792439780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f371c15bd40 0x7f371c1449e0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f371400c780 tx=0x7f371400cc40 comp rx=0 tx=0).stop 2024-09-17T05:36:55.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.264+0000 7f3721a00640 1 -- 172.21.15.31:0/792439780 shutdown_connections 2024-09-17T05:36:55.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.264+0000 7f3721a00640 1 --2- 172.21.15.31:0/792439780 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f36f8073c20 0x7f36f80760e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.264+0000 7f3721a00640 1 --2- 172.21.15.31:0/792439780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f371c15bd40 0x7f371c1449e0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.264+0000 7f3721a00640 1 --2- 172.21.15.31:0/792439780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f371c0d20f0 0x7f371c0cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.264+0000 7f3721a00640 1 --2- 172.21.15.31:0/792439780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f371c0b0d10 0x7f371c1fb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.264+0000 7f3721a00640 1 -- 172.21.15.31:0/792439780 >> 172.21.15.31:0/792439780 conn(0x7f371c09aa10 msgr2=0x7f371c0707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:55.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.264+0000 7f3721a00640 1 -- 172.21.15.31:0/792439780 shutdown_connections 2024-09-17T05:36:55.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.264+0000 7f3721a00640 1 -- 172.21.15.31:0/792439780 wait complete. 2024-09-17T05:36:55.292 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:36:55.292 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:55.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.440+0000 7f6a68000640 1 -- 172.21.15.31:0/2501788853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a600cdb30 msgr2=0x7f6a600aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.440+0000 7f6a68000640 1 --2- 172.21.15.31:0/2501788853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a600cdb30 0x7f6a600aeef0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009c80 tx=0x7f6a5801cda0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.440+0000 7f6a68000640 1 -- 172.21.15.31:0/2501788853 shutdown_connections 2024-09-17T05:36:55.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.440+0000 7f6a68000640 1 --2- 172.21.15.31:0/2501788853 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a600cdb30 0x7f6a600aeef0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.440+0000 7f6a68000640 1 --2- 172.21.15.31:0/2501788853 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a600ced80 0x7f6a600ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.440+0000 7f6a68000640 1 -- 172.21.15.31:0/2501788853 >> 172.21.15.31:0/2501788853 conn(0x7f6a600d1dc0 msgr2=0x7f6a600d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:55.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.440+0000 7f6a68000640 1 -- 172.21.15.31:0/2501788853 shutdown_connections 2024-09-17T05:36:55.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.440+0000 7f6a68000640 1 -- 172.21.15.31:0/2501788853 wait complete. 2024-09-17T05:36:55.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.440+0000 7f6a68000640 1 Processor -- start 2024-09-17T05:36:55.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a68000640 1 -- start start 2024-09-17T05:36:55.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a68000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a600cdb30 0x7f6a600cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:55.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a68000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a600ced80 0x7f6a600cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:55.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a68000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a6015bea0 0x7f6a60072230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:55.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a68000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6a60169340 con 0x7f6a600cdb30 2024-09-17T05:36:55.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a68000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6a601691c0 con 0x7f6a600ced80 2024-09-17T05:36:55.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a68000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6a601694c0 con 0x7f6a6015bea0 2024-09-17T05:36:55.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a65600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a600cdb30 0x7f6a600cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:55.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a65600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a600cdb30 0x7f6a600cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33050/0 (socket says 172.21.15.31:33050) 2024-09-17T05:36:55.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a65600640 1 -- 172.21.15.31:0/1769090540 learned_addr learned my addr 172.21.15.31:0/1769090540 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:55.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a64c00640 1 --2- 172.21.15.31:0/1769090540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a600ced80 0x7f6a600cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:55.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a66000640 1 --2- 172.21.15.31:0/1769090540 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a6015bea0 0x7f6a60072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:55.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a65600640 1 -- 172.21.15.31:0/1769090540 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a6015bea0 msgr2=0x7f6a60072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a65600640 1 --2- 172.21.15.31:0/1769090540 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a6015bea0 0x7f6a60072230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a65600640 1 -- 172.21.15.31:0/1769090540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a600ced80 msgr2=0x7f6a600cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a65600640 1 --2- 172.21.15.31:0/1769090540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a600ced80 0x7f6a600cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a65600640 1 -- 172.21.15.31:0/1769090540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a601f7dd0 con 0x7f6a600cdb30 2024-09-17T05:36:55.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a64c00640 1 --2- 172.21.15.31:0/1769090540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a600ced80 0x7f6a600cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:55.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a66000640 1 --2- 172.21.15.31:0/1769090540 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a6015bea0 0x7f6a60072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:36:55.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a65600640 1 --2- 172.21.15.31:0/1769090540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a600cdb30 0x7f6a600cad60 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400b410 tx=0x7f6a5400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:55.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a5d600640 1 -- 172.21.15.31:0/1769090540 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54015030 con 0x7f6a600cdb30 2024-09-17T05:36:55.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a5d600640 1 -- 172.21.15.31:0/1769090540 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a54004020 con 0x7f6a600cdb30 2024-09-17T05:36:55.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a5d600640 1 -- 172.21.15.31:0/1769090540 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a540044b0 con 0x7f6a600cdb30 2024-09-17T05:36:55.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a68000640 1 -- 172.21.15.31:0/1769090540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a601f80b0 con 0x7f6a600cdb30 2024-09-17T05:36:55.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a68000640 1 -- 172.21.15.31:0/1769090540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a601f8670 con 0x7f6a600cdb30 2024-09-17T05:36:55.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.444+0000 7f6a68000640 1 -- 172.21.15.31:0/1769090540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a600ce670 con 0x7f6a600cdb30 2024-09-17T05:36:55.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.448+0000 7f6a5d600640 1 -- 172.21.15.31:0/1769090540 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f6a54018070 con 0x7f6a600cdb30 2024-09-17T05:36:55.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.448+0000 7f6a5d600640 1 --2- 172.21.15.31:0/1769090540 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6a40073c20 0x7f6a400760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:55.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.448+0000 7f6a5d600640 1 -- 172.21.15.31:0/1769090540 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f6a54092910 con 0x7f6a600cdb30 2024-09-17T05:36:55.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.448+0000 7f6a64c00640 1 --2- 172.21.15.31:0/1769090540 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6a40073c20 0x7f6a400760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:55.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.448+0000 7f6a64c00640 1 --2- 172.21.15.31:0/1769090540 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6a40073c20 0x7f6a400760e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c005fd0 tx=0x7f6a4c005da0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:55.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.452+0000 7f6a5d600640 1 -- 172.21.15.31:0/1769090540 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6a5405f1f0 con 0x7f6a600cdb30 2024-09-17T05:36:55.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.664+0000 7f6a68000640 1 -- 172.21.15.31:0/1769090540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a60070d90 con 0x7f6a600cdb30 2024-09-17T05:36:55.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.664+0000 7f6a5d600640 1 -- 172.21.15.31:0/1769090540 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+5239 (secure 0 0 0) 0x7f6a5405fe20 con 0x7f6a600cdb30 2024-09-17T05:36:55.668 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:55.668 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":119,"btime":"2024-09-17T05:36:55:259648+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/2639830102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2639830102},{"type":"v1","addr":"172.21.15.155:6834","nonce":2639830102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":9111,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1970430367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1970430367},{"type":"v1","addr":"172.21.15.31:6834","nonce":1970430367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":9114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3317138111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3317138111},{"type":"v1","addr":"172.21.15.31:6835","nonce":3317138111}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:51.647070+0000","modified":"2024-09-17T05:36:54.664417+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9126},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9126":{"gid":9126,"name":"b","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/3913619779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":3913619779},{"type":"v1","addr":"172.21.15.155:6835","nonce":3913619779}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9126,"qdb_cluster":[9126]},"id":13}]} 2024-09-17T05:36:55.669 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 119 2024-09-17T05:36:55.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.668+0000 7f6a68000640 1 -- 172.21.15.31:0/1769090540 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6a40073c20 msgr2=0x7f6a400760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.668+0000 7f6a68000640 1 --2- 172.21.15.31:0/1769090540 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6a40073c20 0x7f6a400760e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c005fd0 tx=0x7f6a4c005da0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.668+0000 7f6a68000640 1 -- 172.21.15.31:0/1769090540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a600cdb30 msgr2=0x7f6a600cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.668+0000 7f6a68000640 1 --2- 172.21.15.31:0/1769090540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a600cdb30 0x7f6a600cad60 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400b410 tx=0x7f6a5400b8d0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.668+0000 7f6a68000640 1 -- 172.21.15.31:0/1769090540 shutdown_connections 2024-09-17T05:36:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.668+0000 7f6a68000640 1 --2- 172.21.15.31:0/1769090540 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6a40073c20 0x7f6a400760e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.668+0000 7f6a68000640 1 --2- 172.21.15.31:0/1769090540 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a6015bea0 0x7f6a60072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.668+0000 7f6a68000640 1 --2- 172.21.15.31:0/1769090540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a600ced80 0x7f6a600cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.668+0000 7f6a68000640 1 --2- 172.21.15.31:0/1769090540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6a600cdb30 0x7f6a600cad60 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.668+0000 7f6a68000640 1 -- 172.21.15.31:0/1769090540 >> 172.21.15.31:0/1769090540 conn(0x7f6a600d1dc0 msgr2=0x7f6a600b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.668+0000 7f6a68000640 1 -- 172.21.15.31:0/1769090540 shutdown_connections 2024-09-17T05:36:55.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.668+0000 7f6a68000640 1 -- 172.21.15.31:0/1769090540 wait complete. 2024-09-17T05:36:55.691 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:36:55.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.836+0000 7fbf63e00640 1 -- 172.21.15.31:0/1125674416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf6415f000 msgr2=0x7fbf640d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.836+0000 7fbf63e00640 1 --2- 172.21.15.31:0/1125674416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf6415f000 0x7fbf640d01b0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fbf54009900 tx=0x7fbf5401c850 comp rx=0 tx=0).stop 2024-09-17T05:36:55.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.836+0000 7fbf63e00640 1 -- 172.21.15.31:0/1125674416 shutdown_connections 2024-09-17T05:36:55.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.836+0000 7fbf63e00640 1 --2- 172.21.15.31:0/1125674416 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf640b2590 0x7fbf640b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.836+0000 7fbf63e00640 1 --2- 172.21.15.31:0/1125674416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf6415f000 0x7fbf640d01b0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.836+0000 7fbf63e00640 1 -- 172.21.15.31:0/1125674416 >> 172.21.15.31:0/1125674416 conn(0x7fbf6409aa10 msgr2=0x7fbf6409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:55.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.836+0000 7fbf63e00640 1 -- 172.21.15.31:0/1125674416 shutdown_connections 2024-09-17T05:36:55.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.836+0000 7fbf63e00640 1 -- 172.21.15.31:0/1125674416 wait complete. 2024-09-17T05:36:55.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.836+0000 7fbf63e00640 1 Processor -- start 2024-09-17T05:36:55.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.836+0000 7fbf63e00640 1 -- start start 2024-09-17T05:36:55.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf63e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf640b2590 0x7fbf64157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:55.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf63e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640cefb0 0x7fbf640cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:55.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf63e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6415f000 0x7fbf640c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:55.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf63e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbf64168f10 con 0x7fbf640cefb0 2024-09-17T05:36:55.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf63e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbf64168d90 con 0x7fbf640b2590 2024-09-17T05:36:55.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf63e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbf64169090 con 0x7fbf6415f000 2024-09-17T05:36:55.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf62000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640cefb0 0x7fbf640cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:55.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf62000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640cefb0 0x7fbf640cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33076/0 (socket says 172.21.15.31:33076) 2024-09-17T05:36:55.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf62000640 1 -- 172.21.15.31:0/3219397133 learned_addr learned my addr 172.21.15.31:0/3219397133 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:55.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf63400640 1 --2- 172.21.15.31:0/3219397133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6415f000 0x7fbf640c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:55.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf62a00640 1 --2- 172.21.15.31:0/3219397133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf640b2590 0x7fbf64157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:55.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf62000640 1 -- 172.21.15.31:0/3219397133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6415f000 msgr2=0x7fbf640c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf62000640 1 --2- 172.21.15.31:0/3219397133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6415f000 0x7fbf640c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf62000640 1 -- 172.21.15.31:0/3219397133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf640b2590 msgr2=0x7fbf64157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:55.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf62000640 1 --2- 172.21.15.31:0/3219397133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf640b2590 0x7fbf64157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:55.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf62000640 1 -- 172.21.15.31:0/3219397133 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf640ca570 con 0x7fbf640cefb0 2024-09-17T05:36:55.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf62000640 1 --2- 172.21.15.31:0/3219397133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640cefb0 0x7fbf640cb330 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000c500 tx=0x7fbf5000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:55.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf5aa00640 1 -- 172.21.15.31:0/3219397133 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf50017070 con 0x7fbf640cefb0 2024-09-17T05:36:55.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf5aa00640 1 -- 172.21.15.31:0/3219397133 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf500053c0 con 0x7fbf640cefb0 2024-09-17T05:36:55.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf63e00640 1 -- 172.21.15.31:0/3219397133 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf640ca850 con 0x7fbf640cefb0 2024-09-17T05:36:55.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf5aa00640 1 -- 172.21.15.31:0/3219397133 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf50012890 con 0x7fbf640cefb0 2024-09-17T05:36:55.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf63e00640 1 -- 172.21.15.31:0/3219397133 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf64157680 con 0x7fbf640cefb0 2024-09-17T05:36:55.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.840+0000 7fbf63e00640 1 -- 172.21.15.31:0/3219397133 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf640cac40 con 0x7fbf640cefb0 2024-09-17T05:36:55.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.844+0000 7fbf5aa00640 1 -- 172.21.15.31:0/3219397133 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7fbf5001a070 con 0x7fbf640cefb0 2024-09-17T05:36:55.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.844+0000 7fbf5aa00640 1 --2- 172.21.15.31:0/3219397133 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbf44073c50 0x7fbf44076110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:55.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.844+0000 7fbf5aa00640 1 -- 172.21.15.31:0/3219397133 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7fbf50091f70 con 0x7fbf640cefb0 2024-09-17T05:36:55.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.844+0000 7fbf62a00640 1 --2- 172.21.15.31:0/3219397133 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbf44073c50 0x7fbf44076110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:55.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.844+0000 7fbf62a00640 1 --2- 172.21.15.31:0/3219397133 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbf44073c50 0x7fbf44076110 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbf540af000 tx=0x7fbf5401b090 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:55.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:55.848+0000 7fbf5aa00640 1 -- 172.21.15.31:0/3219397133 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fbf640cf400 con 0x7fbf640cefb0 2024-09-17T05:36:56.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.024+0000 7fbf63e00640 1 -- 172.21.15.31:0/3219397133 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf640cbcd0 con 0x7fbf640cefb0 2024-09-17T05:36:56.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.028+0000 7fbf5aa00640 1 -- 172.21.15.31:0/3219397133 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) ==== 74+0+16811 (secure 0 0 0) 0x7fbf5005e1e0 con 0x7fbf640cefb0 2024-09-17T05:36:56.029 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:56.029 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":163,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:36:53.238291+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:49.365706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:50.600939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:36:56.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.028+0000 7fbf63e00640 1 -- 172.21.15.31:0/3219397133 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbf44073c50 msgr2=0x7fbf44076110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.028+0000 7fbf63e00640 1 --2- 172.21.15.31:0/3219397133 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbf44073c50 0x7fbf44076110 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbf540af000 tx=0x7fbf5401b090 comp rx=0 tx=0).stop 2024-09-17T05:36:56.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.028+0000 7fbf63e00640 1 -- 172.21.15.31:0/3219397133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640cefb0 msgr2=0x7fbf640cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.028+0000 7fbf63e00640 1 --2- 172.21.15.31:0/3219397133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640cefb0 0x7fbf640cb330 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000c500 tx=0x7fbf5000c9c0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.028+0000 7fbf63e00640 1 -- 172.21.15.31:0/3219397133 shutdown_connections 2024-09-17T05:36:56.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.028+0000 7fbf63e00640 1 --2- 172.21.15.31:0/3219397133 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbf44073c50 0x7fbf44076110 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.028+0000 7fbf63e00640 1 --2- 172.21.15.31:0/3219397133 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf6415f000 0x7fbf640c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.028+0000 7fbf63e00640 1 --2- 172.21.15.31:0/3219397133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640cefb0 0x7fbf640cb330 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.028+0000 7fbf63e00640 1 --2- 172.21.15.31:0/3219397133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf640b2590 0x7fbf64157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.028+0000 7fbf63e00640 1 -- 172.21.15.31:0/3219397133 >> 172.21.15.31:0/3219397133 conn(0x7fbf6409aa10 msgr2=0x7fbf64157900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:56.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.028+0000 7fbf63e00640 1 -- 172.21.15.31:0/3219397133 shutdown_connections 2024-09-17T05:36:56.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.028+0000 7fbf63e00640 1 -- 172.21.15.31:0/3219397133 wait complete. 2024-09-17T05:36:56.052 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:36:56.052 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:36:56.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.196+0000 7f6f88600640 1 -- 172.21.15.31:0/1548089395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f800d28e0 msgr2=0x7f6f800cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.196+0000 7f6f88600640 1 --2- 172.21.15.31:0/1548089395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f800d28e0 0x7f6f800cebb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6f78009bc0 tx=0x7f6f7801cba0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.196+0000 7f6f88600640 1 -- 172.21.15.31:0/1548089395 shutdown_connections 2024-09-17T05:36:56.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.196+0000 7f6f88600640 1 --2- 172.21.15.31:0/1548089395 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f800d28e0 0x7f6f800cebb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.196+0000 7f6f88600640 1 --2- 172.21.15.31:0/1548089395 >> v2:172.21.15.155:3300/0 conn(0x7f6f8015bea0 0x7f6f800ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.196+0000 7f6f88600640 1 -- 172.21.15.31:0/1548089395 >> 172.21.15.31:0/1548089395 conn(0x7f6f800d1dc0 msgr2=0x7f6f800d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:56.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.196+0000 7f6f88600640 1 -- 172.21.15.31:0/1548089395 shutdown_connections 2024-09-17T05:36:56.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.196+0000 7f6f88600640 1 -- 172.21.15.31:0/1548089395 wait complete. 2024-09-17T05:36:56.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f88600640 1 Processor -- start 2024-09-17T05:36:56.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f88600640 1 -- start start 2024-09-17T05:36:56.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f88600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f800cdb30 0x7f6f8006f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:56.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f88600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f800d28e0 0x7f6f8014c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:56.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f88600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f8015bea0 0x7f6f800b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:56.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f88600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6f80168f70 con 0x7f6f800cdb30 2024-09-17T05:36:56.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f88600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6f80168df0 con 0x7f6f800d28e0 2024-09-17T05:36:56.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f88600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6f801690f0 con 0x7f6f8015bea0 2024-09-17T05:36:56.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f85c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f800cdb30 0x7f6f8006f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:56.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f85c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f800cdb30 0x7f6f8006f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33092/0 (socket says 172.21.15.31:33092) 2024-09-17T05:36:56.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f85c00640 1 -- 172.21.15.31:0/1207008491 learned_addr learned my addr 172.21.15.31:0/1207008491 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:56.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f86600640 1 --2- 172.21.15.31:0/1207008491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f8015bea0 0x7f6f800b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:56.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f85200640 1 --2- 172.21.15.31:0/1207008491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f800d28e0 0x7f6f8014c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:56.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f85c00640 1 -- 172.21.15.31:0/1207008491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f8015bea0 msgr2=0x7f6f800b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f85c00640 1 --2- 172.21.15.31:0/1207008491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f8015bea0 0x7f6f800b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f85c00640 1 -- 172.21.15.31:0/1207008491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f800d28e0 msgr2=0x7f6f8014c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f85c00640 1 --2- 172.21.15.31:0/1207008491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f800d28e0 0x7f6f8014c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f85c00640 1 -- 172.21.15.31:0/1207008491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8014c6a0 con 0x7f6f800cdb30 2024-09-17T05:36:56.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f85c00640 1 --2- 172.21.15.31:0/1207008491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f800cdb30 0x7f6f8006f890 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400e7a0 tx=0x7f6f7400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:56.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f7d600640 1 -- 172.21.15.31:0/1207008491 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7400cc60 con 0x7f6f800cdb30 2024-09-17T05:36:56.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f7d600640 1 -- 172.21.15.31:0/1207008491 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f74010430 con 0x7f6f800cdb30 2024-09-17T05:36:56.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f88600640 1 -- 172.21.15.31:0/1207008491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f8006e0a0 con 0x7f6f800cdb30 2024-09-17T05:36:56.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f7d600640 1 -- 172.21.15.31:0/1207008491 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74010880 con 0x7f6f800cdb30 2024-09-17T05:36:56.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f88600640 1 -- 172.21.15.31:0/1207008491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f8006e660 con 0x7f6f800cdb30 2024-09-17T05:36:56.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.200+0000 7f6f88600640 1 -- 172.21.15.31:0/1207008491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f800cc9d0 con 0x7f6f800cdb30 2024-09-17T05:36:56.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.204+0000 7f6f7d600640 1 -- 172.21.15.31:0/1207008491 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f6f7401f020 con 0x7f6f800cdb30 2024-09-17T05:36:56.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.204+0000 7f6f7d600640 1 --2- 172.21.15.31:0/1207008491 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6f60073c20 0x7f6f600760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:56.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.204+0000 7f6f7d600640 1 -- 172.21.15.31:0/1207008491 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f6f74093520 con 0x7f6f800cdb30 2024-09-17T05:36:56.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.204+0000 7f6f85200640 1 --2- 172.21.15.31:0/1207008491 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6f60073c20 0x7f6f600760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:56.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.204+0000 7f6f85200640 1 --2- 172.21.15.31:0/1207008491 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6f60073c20 0x7f6f600760e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6f800b4890 tx=0x7f6f6c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:56.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.208+0000 7f6f7d600640 1 -- 172.21.15.31:0/1207008491 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6f7405fd80 con 0x7f6f800cdb30 2024-09-17T05:36:56.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.388+0000 7f6f88600640 1 -- 172.21.15.31:0/1207008491 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f800b5990 con 0x7f6f60073c20 2024-09-17T05:36:56.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.392+0000 7f6f7d600640 1 -- 172.21.15.31:0/1207008491 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252478 (secure 0 0 0) 0x7f6f800b5990 con 0x7f6f60073c20 2024-09-17T05:36:56.396 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:56.398 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:36:56.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.396+0000 7f6f88600640 1 -- 172.21.15.31:0/1207008491 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6f60073c20 msgr2=0x7f6f600760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.396+0000 7f6f88600640 1 --2- 172.21.15.31:0/1207008491 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6f60073c20 0x7f6f600760e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6f800b4890 tx=0x7f6f6c009040 comp rx=0 tx=0).stop 2024-09-17T05:36:56.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.396+0000 7f6f88600640 1 -- 172.21.15.31:0/1207008491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f800cdb30 msgr2=0x7f6f8006f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.396+0000 7f6f88600640 1 --2- 172.21.15.31:0/1207008491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f800cdb30 0x7f6f8006f890 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400e7a0 tx=0x7f6f7400ec60 comp rx=0 tx=0).stop 2024-09-17T05:36:56.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.396+0000 7f6f88600640 1 -- 172.21.15.31:0/1207008491 shutdown_connections 2024-09-17T05:36:56.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.396+0000 7f6f88600640 1 --2- 172.21.15.31:0/1207008491 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6f60073c20 0x7f6f600760e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.396+0000 7f6f88600640 1 --2- 172.21.15.31:0/1207008491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6f8015bea0 0x7f6f800b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.396+0000 7f6f88600640 1 --2- 172.21.15.31:0/1207008491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f800d28e0 0x7f6f8014c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.396+0000 7f6f88600640 1 --2- 172.21.15.31:0/1207008491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f800cdb30 0x7f6f8006f890 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.396+0000 7f6f88600640 1 -- 172.21.15.31:0/1207008491 >> 172.21.15.31:0/1207008491 conn(0x7f6f800d1dc0 msgr2=0x7f6f800b7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:56.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.396+0000 7f6f88600640 1 -- 172.21.15.31:0/1207008491 shutdown_connections 2024-09-17T05:36:56.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.396+0000 7f6f88600640 1 -- 172.21.15.31:0/1207008491 wait complete. 2024-09-17T05:36:56.417 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2024-09-17T05:36:54.754388+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":157,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":270904,"kb_used_data":17208,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703816,"statfs":{"total":773094113280,"available":772816707584,"internally_reserved":0,"allocated":17620992,"data_stored":8405444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.539294"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.252244+0000","last_change":"2024-09-17T05:36:52.257913+0000","last_active":"2024-09-17T05:36:53.252244+0000","last_peered":"2024-09-17T05:36:53.252244+0000","last_clean":"2024-09-17T05:36:53.252244+0000","last_became_active":"2024-09-17T05:36:52.257628+0000","last_became_peered":"2024-09-17T05:36:52.257628+0000","last_unstale":"2024-09-17T05:36:53.252244+0000","last_undegraded":"2024-09-17T05:36:53.252244+0000","last_fullsized":"2024-09-17T05:36:53.252244+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:10.548156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.255261+0000","last_change":"2024-09-17T05:36:52.247238+0000","last_active":"2024-09-17T05:36:53.255261+0000","last_peered":"2024-09-17T05:36:53.255261+0000","last_clean":"2024-09-17T05:36:53.255261+0000","last_became_active":"2024-09-17T05:36:52.246928+0000","last_became_peered":"2024-09-17T05:36:52.246928+0000","last_unstale":"2024-09-17T05:36:53.255261+0000","last_undegraded":"2024-09-17T05:36:53.255261+0000","last_fullsized":"2024-09-17T05:36:53.255261+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:23.879311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591118+0000","last_change":"2024-09-17T05:36:52.264273+0000","last_active":"2024-09-17T05:36:53.591118+0000","last_peered":"2024-09-17T05:36:53.591118+0000","last_clean":"2024-09-17T05:36:53.591118+0000","last_became_active":"2024-09-17T05:36:52.262624+0000","last_became_peered":"2024-09-17T05:36:52.262624+0000","last_unstale":"2024-09-17T05:36:53.591118+0000","last_undegraded":"2024-09-17T05:36:53.591118+0000","last_fullsized":"2024-09-17T05:36:53.591118+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:56.625716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594557+0000","last_change":"2024-09-17T05:36:52.266060+0000","last_active":"2024-09-17T05:36:53.594557+0000","last_peered":"2024-09-17T05:36:53.594557+0000","last_clean":"2024-09-17T05:36:53.594557+0000","last_became_active":"2024-09-17T05:36:52.265482+0000","last_became_peered":"2024-09-17T05:36:52.265482+0000","last_unstale":"2024-09-17T05:36:53.594557+0000","last_undegraded":"2024-09-17T05:36:53.594557+0000","last_fullsized":"2024-09-17T05:36:53.594557+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:37.567542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590716+0000","last_change":"2024-09-17T05:36:52.264261+0000","last_active":"2024-09-17T05:36:53.590716+0000","last_peered":"2024-09-17T05:36:53.590716+0000","last_clean":"2024-09-17T05:36:53.590716+0000","last_became_active":"2024-09-17T05:36:52.263954+0000","last_became_peered":"2024-09-17T05:36:52.263954+0000","last_unstale":"2024-09-17T05:36:53.590716+0000","last_undegraded":"2024-09-17T05:36:53.590716+0000","last_fullsized":"2024-09-17T05:36:53.590716+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:39.093029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590552+0000","last_change":"2024-09-17T05:36:52.257391+0000","last_active":"2024-09-17T05:36:53.590552+0000","last_peered":"2024-09-17T05:36:53.590552+0000","last_clean":"2024-09-17T05:36:53.590552+0000","last_became_active":"2024-09-17T05:36:52.256818+0000","last_became_peered":"2024-09-17T05:36:52.256818+0000","last_unstale":"2024-09-17T05:36:53.590552+0000","last_undegraded":"2024-09-17T05:36:53.590552+0000","last_fullsized":"2024-09-17T05:36:53.590552+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:32.544851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.251526+0000","last_change":"2024-09-17T05:36:52.247837+0000","last_active":"2024-09-17T05:36:53.251526+0000","last_peered":"2024-09-17T05:36:53.251526+0000","last_clean":"2024-09-17T05:36:53.251526+0000","last_became_active":"2024-09-17T05:36:52.247389+0000","last_became_peered":"2024-09-17T05:36:52.247389+0000","last_unstale":"2024-09-17T05:36:53.251526+0000","last_undegraded":"2024-09-17T05:36:53.251526+0000","last_fullsized":"2024-09-17T05:36:53.251526+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:16.544509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590350+0000","last_change":"2024-09-17T05:36:52.254354+0000","last_active":"2024-09-17T05:36:53.590350+0000","last_peered":"2024-09-17T05:36:53.590350+0000","last_clean":"2024-09-17T05:36:53.590350+0000","last_became_active":"2024-09-17T05:36:52.253736+0000","last_became_peered":"2024-09-17T05:36:52.253736+0000","last_unstale":"2024-09-17T05:36:53.590350+0000","last_undegraded":"2024-09-17T05:36:53.590350+0000","last_fullsized":"2024-09-17T05:36:53.590350+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:23.059204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.255084+0000","last_change":"2024-09-17T05:36:52.262844+0000","last_active":"2024-09-17T05:36:53.255084+0000","last_peered":"2024-09-17T05:36:53.255084+0000","last_clean":"2024-09-17T05:36:53.255084+0000","last_became_active":"2024-09-17T05:36:52.262549+0000","last_became_peered":"2024-09-17T05:36:52.262549+0000","last_unstale":"2024-09-17T05:36:53.255084+0000","last_undegraded":"2024-09-17T05:36:53.255084+0000","last_fullsized":"2024-09-17T05:36:53.255084+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:01.319149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.592099+0000","last_change":"2024-09-17T05:36:52.249717+0000","last_active":"2024-09-17T05:36:53.592099+0000","last_peered":"2024-09-17T05:36:53.592099+0000","last_clean":"2024-09-17T05:36:53.592099+0000","last_became_active":"2024-09-17T05:36:52.249435+0000","last_became_peered":"2024-09-17T05:36:52.249435+0000","last_unstale":"2024-09-17T05:36:53.592099+0000","last_undegraded":"2024-09-17T05:36:53.592099+0000","last_fullsized":"2024-09-17T05:36:53.592099+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:12.023414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591276+0000","last_change":"2024-09-17T05:36:52.264462+0000","last_active":"2024-09-17T05:36:53.591276+0000","last_peered":"2024-09-17T05:36:53.591276+0000","last_clean":"2024-09-17T05:36:53.591276+0000","last_became_active":"2024-09-17T05:36:52.263813+0000","last_became_peered":"2024-09-17T05:36:52.263813+0000","last_unstale":"2024-09-17T05:36:53.591276+0000","last_undegraded":"2024-09-17T05:36:53.591276+0000","last_fullsized":"2024-09-17T05:36:53.591276+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:27.096526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.593695+0000","last_change":"2024-09-17T05:36:52.263864+0000","last_active":"2024-09-17T05:36:53.593695+0000","last_peered":"2024-09-17T05:36:53.593695+0000","last_clean":"2024-09-17T05:36:53.593695+0000","last_became_active":"2024-09-17T05:36:52.263565+0000","last_became_peered":"2024-09-17T05:36:52.263565+0000","last_unstale":"2024-09-17T05:36:53.593695+0000","last_undegraded":"2024-09-17T05:36:53.593695+0000","last_fullsized":"2024-09-17T05:36:53.593695+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:13.878255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.593884+0000","last_change":"2024-09-17T05:36:52.261301+0000","last_active":"2024-09-17T05:36:53.593884+0000","last_peered":"2024-09-17T05:36:53.593884+0000","last_clean":"2024-09-17T05:36:53.593884+0000","last_became_active":"2024-09-17T05:36:52.260847+0000","last_became_peered":"2024-09-17T05:36:52.260847+0000","last_unstale":"2024-09-17T05:36:53.593884+0000","last_undegraded":"2024-09-17T05:36:53.593884+0000","last_fullsized":"2024-09-17T05:36:53.593884+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:41.294320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.251711+0000","last_change":"2024-09-17T05:36:52.253326+0000","last_active":"2024-09-17T05:36:53.251711+0000","last_peered":"2024-09-17T05:36:53.251711+0000","last_clean":"2024-09-17T05:36:53.251711+0000","last_became_active":"2024-09-17T05:36:52.253005+0000","last_became_peered":"2024-09-17T05:36:52.253005+0000","last_unstale":"2024-09-17T05:36:53.251711+0000","last_undegraded":"2024-09-17T05:36:53.251711+0000","last_fullsized":"2024-09-17T05:36:53.251711+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:23.507715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.251604+0000","last_change":"2024-09-17T05:36:52.241875+0000","last_active":"2024-09-17T05:36:53.251604+0000","last_peered":"2024-09-17T05:36:53.251604+0000","last_clean":"2024-09-17T05:36:53.251604+0000","last_became_active":"2024-09-17T05:36:52.241584+0000","last_became_peered":"2024-09-17T05:36:52.241584+0000","last_unstale":"2024-09-17T05:36:53.251604+0000","last_undegraded":"2024-09-17T05:36:53.251604+0000","last_fullsized":"2024-09-17T05:36:53.251604+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:56.646934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591687+0000","last_change":"2024-09-17T05:36:52.254863+0000","last_active":"2024-09-17T05:36:53.591687+0000","last_peered":"2024-09-17T05:36:53.591687+0000","last_clean":"2024-09-17T05:36:53.591687+0000","last_became_active":"2024-09-17T05:36:52.254574+0000","last_became_peered":"2024-09-17T05:36:52.254574+0000","last_unstale":"2024-09-17T05:36:53.591687+0000","last_undegraded":"2024-09-17T05:36:53.591687+0000","last_fullsized":"2024-09-17T05:36:53.591687+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:57.861386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.252316+0000","last_change":"2024-09-17T05:36:52.257730+0000","last_active":"2024-09-17T05:36:53.252316+0000","last_peered":"2024-09-17T05:36:53.252316+0000","last_clean":"2024-09-17T05:36:53.252316+0000","last_became_active":"2024-09-17T05:36:52.257233+0000","last_became_peered":"2024-09-17T05:36:52.257233+0000","last_unstale":"2024-09-17T05:36:53.252316+0000","last_undegraded":"2024-09-17T05:36:53.252316+0000","last_fullsized":"2024-09-17T05:36:53.252316+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:06.711663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.592104+0000","last_change":"2024-09-17T05:36:52.256923+0000","last_active":"2024-09-17T05:36:53.592104+0000","last_peered":"2024-09-17T05:36:53.592104+0000","last_clean":"2024-09-17T05:36:53.592104+0000","last_became_active":"2024-09-17T05:36:52.256606+0000","last_became_peered":"2024-09-17T05:36:52.256606+0000","last_unstale":"2024-09-17T05:36:53.592104+0000","last_undegraded":"2024-09-17T05:36:53.592104+0000","last_fullsized":"2024-09-17T05:36:53.592104+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:07.595563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.592128+0000","last_change":"2024-09-17T05:36:52.246327+0000","last_active":"2024-09-17T05:36:53.592128+0000","last_peered":"2024-09-17T05:36:53.592128+0000","last_clean":"2024-09-17T05:36:53.592128+0000","last_became_active":"2024-09-17T05:36:52.244270+0000","last_became_peered":"2024-09-17T05:36:52.244270+0000","last_unstale":"2024-09-17T05:36:53.592128+0000","last_undegraded":"2024-09-17T05:36:53.592128+0000","last_fullsized":"2024-09-17T05:36:53.592128+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:44.465533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590773+0000","last_change":"2024-09-17T05:36:52.266364+0000","last_active":"2024-09-17T05:36:53.590773+0000","last_peered":"2024-09-17T05:36:53.590773+0000","last_clean":"2024-09-17T05:36:53.590773+0000","last_became_active":"2024-09-17T05:36:52.265832+0000","last_became_peered":"2024-09-17T05:36:52.265832+0000","last_unstale":"2024-09-17T05:36:53.590773+0000","last_undegraded":"2024-09-17T05:36:53.590773+0000","last_fullsized":"2024-09-17T05:36:53.590773+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:11.115663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594395+0000","last_change":"2024-09-17T05:36:52.267172+0000","last_active":"2024-09-17T05:36:53.594395+0000","last_peered":"2024-09-17T05:36:53.594395+0000","last_clean":"2024-09-17T05:36:53.594395+0000","last_became_active":"2024-09-17T05:36:52.266916+0000","last_became_peered":"2024-09-17T05:36:52.266916+0000","last_unstale":"2024-09-17T05:36:53.594395+0000","last_undegraded":"2024-09-17T05:36:53.594395+0000","last_fullsized":"2024-09-17T05:36:53.594395+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:55.759619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.255128+0000","last_change":"2024-09-17T05:36:52.242913+0000","last_active":"2024-09-17T05:36:53.255128+0000","last_peered":"2024-09-17T05:36:53.255128+0000","last_clean":"2024-09-17T05:36:53.255128+0000","last_became_active":"2024-09-17T05:36:52.242550+0000","last_became_peered":"2024-09-17T05:36:52.242550+0000","last_unstale":"2024-09-17T05:36:53.255128+0000","last_undegraded":"2024-09-17T05:36:53.255128+0000","last_fullsized":"2024-09-17T05:36:53.255128+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:26.486750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.253932+0000","last_change":"2024-09-17T05:36:52.253074+0000","last_active":"2024-09-17T05:36:53.253932+0000","last_peered":"2024-09-17T05:36:53.253932+0000","last_clean":"2024-09-17T05:36:53.253932+0000","last_became_active":"2024-09-17T05:36:52.252787+0000","last_became_peered":"2024-09-17T05:36:52.252787+0000","last_unstale":"2024-09-17T05:36:53.253932+0000","last_undegraded":"2024-09-17T05:36:53.253932+0000","last_fullsized":"2024-09-17T05:36:53.253932+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:11.115663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.593956+0000","last_change":"2024-09-17T05:36:52.267492+0000","last_active":"2024-09-17T05:36:53.593956+0000","last_peered":"2024-09-17T05:36:53.593956+0000","last_clean":"2024-09-17T05:36:53.593956+0000","last_became_active":"2024-09-17T05:36:52.267224+0000","last_became_peered":"2024-09-17T05:36:52.267224+0000","last_unstale":"2024-09-17T05:36:53.593956+0000","last_undegraded":"2024-09-17T05:36:53.593956+0000","last_fullsized":"2024-09-17T05:36:53.593956+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:43.546042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254770+0000","last_change":"2024-09-17T05:36:52.258953+0000","last_active":"2024-09-17T05:36:53.254770+0000","last_peered":"2024-09-17T05:36:53.254770+0000","last_clean":"2024-09-17T05:36:53.254770+0000","last_became_active":"2024-09-17T05:36:52.258524+0000","last_became_peered":"2024-09-17T05:36:52.258524+0000","last_unstale":"2024-09-17T05:36:53.254770+0000","last_undegraded":"2024-09-17T05:36:53.254770+0000","last_fullsized":"2024-09-17T05:36:53.254770+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:25.435574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.252303+0000","last_change":"2024-09-17T05:36:52.246488+0000","last_active":"2024-09-17T05:36:53.252303+0000","last_peered":"2024-09-17T05:36:53.252303+0000","last_clean":"2024-09-17T05:36:53.252303+0000","last_became_active":"2024-09-17T05:36:52.246214+0000","last_became_peered":"2024-09-17T05:36:52.246214+0000","last_unstale":"2024-09-17T05:36:53.252303+0000","last_undegraded":"2024-09-17T05:36:53.252303+0000","last_fullsized":"2024-09-17T05:36:53.252303+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:26.450181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594019+0000","last_change":"2024-09-17T05:36:52.265210+0000","last_active":"2024-09-17T05:36:53.594019+0000","last_peered":"2024-09-17T05:36:53.594019+0000","last_clean":"2024-09-17T05:36:53.594019+0000","last_became_active":"2024-09-17T05:36:52.264639+0000","last_became_peered":"2024-09-17T05:36:52.264639+0000","last_unstale":"2024-09-17T05:36:53.594019+0000","last_undegraded":"2024-09-17T05:36:53.594019+0000","last_fullsized":"2024-09-17T05:36:53.594019+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:38.957939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591011+0000","last_change":"2024-09-17T05:36:52.259821+0000","last_active":"2024-09-17T05:36:53.591011+0000","last_peered":"2024-09-17T05:36:53.591011+0000","last_clean":"2024-09-17T05:36:53.591011+0000","last_became_active":"2024-09-17T05:36:52.259488+0000","last_became_peered":"2024-09-17T05:36:52.259488+0000","last_unstale":"2024-09-17T05:36:53.591011+0000","last_undegraded":"2024-09-17T05:36:53.591011+0000","last_fullsized":"2024-09-17T05:36:53.591011+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:28:16.649167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.593724+0000","last_change":"2024-09-17T05:36:52.262067+0000","last_active":"2024-09-17T05:36:53.593724+0000","last_peered":"2024-09-17T05:36:53.593724+0000","last_clean":"2024-09-17T05:36:53.593724+0000","last_became_active":"2024-09-17T05:36:52.261772+0000","last_became_peered":"2024-09-17T05:36:52.261772+0000","last_unstale":"2024-09-17T05:36:53.593724+0000","last_undegraded":"2024-09-17T05:36:53.593724+0000","last_fullsized":"2024-09-17T05:36:53.593724+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:58.193971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.253937+0000","last_change":"2024-09-17T05:36:52.257989+0000","last_active":"2024-09-17T05:36:53.253937+0000","last_peered":"2024-09-17T05:36:53.253937+0000","last_clean":"2024-09-17T05:36:53.253937+0000","last_became_active":"2024-09-17T05:36:52.257707+0000","last_became_peered":"2024-09-17T05:36:52.257707+0000","last_unstale":"2024-09-17T05:36:53.253937+0000","last_undegraded":"2024-09-17T05:36:53.253937+0000","last_fullsized":"2024-09-17T05:36:53.253937+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:36.264757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591414+0000","last_change":"2024-09-17T05:36:52.257926+0000","last_active":"2024-09-17T05:36:53.591414+0000","last_peered":"2024-09-17T05:36:53.591414+0000","last_clean":"2024-09-17T05:36:53.591414+0000","last_became_active":"2024-09-17T05:36:52.257631+0000","last_became_peered":"2024-09-17T05:36:52.257631+0000","last_unstale":"2024-09-17T05:36:53.591414+0000","last_undegraded":"2024-09-17T05:36:53.591414+0000","last_fullsized":"2024-09-17T05:36:53.591414+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:03.753180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.251530+0000","last_change":"2024-09-17T05:36:52.247477+0000","last_active":"2024-09-17T05:36:53.251530+0000","last_peered":"2024-09-17T05:36:53.251530+0000","last_clean":"2024-09-17T05:36:53.251530+0000","last_became_active":"2024-09-17T05:36:52.247197+0000","last_became_peered":"2024-09-17T05:36:52.247197+0000","last_unstale":"2024-09-17T05:36:53.251530+0000","last_undegraded":"2024-09-17T05:36:53.251530+0000","last_fullsized":"2024-09-17T05:36:53.251530+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:19.919329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254607+0000","last_change":"2024-09-17T05:36:52.264095+0000","last_active":"2024-09-17T05:36:53.254607+0000","last_peered":"2024-09-17T05:36:53.254607+0000","last_clean":"2024-09-17T05:36:53.254607+0000","last_became_active":"2024-09-17T05:36:52.259998+0000","last_became_peered":"2024-09-17T05:36:52.259998+0000","last_unstale":"2024-09-17T05:36:53.254607+0000","last_undegraded":"2024-09-17T05:36:53.254607+0000","last_fullsized":"2024-09-17T05:36:53.254607+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:30.748706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"162'4","reported_seq":19,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594142+0000","last_change":"2024-09-17T05:36:51.245269+0000","last_active":"2024-09-17T05:36:53.594142+0000","last_peered":"2024-09-17T05:36:53.594142+0000","last_clean":"2024-09-17T05:36:53.594142+0000","last_became_active":"2024-09-17T05:36:51.244960+0000","last_became_peered":"2024-09-17T05:36:51.244960+0000","last_unstale":"2024-09-17T05:36:53.594142+0000","last_undegraded":"2024-09-17T05:36:53.594142+0000","last_fullsized":"2024-09-17T05:36:53.594142+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:35.354508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.255582+0000","last_change":"2024-09-17T05:36:52.257601+0000","last_active":"2024-09-17T05:36:53.255582+0000","last_peered":"2024-09-17T05:36:53.255582+0000","last_clean":"2024-09-17T05:36:53.255582+0000","last_became_active":"2024-09-17T05:36:52.257308+0000","last_became_peered":"2024-09-17T05:36:52.257308+0000","last_unstale":"2024-09-17T05:36:53.255582+0000","last_undegraded":"2024-09-17T05:36:53.255582+0000","last_fullsized":"2024-09-17T05:36:53.255582+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:07:56.451733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"162'1","reported_seq":16,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254964+0000","last_change":"2024-09-17T05:36:51.241214+0000","last_active":"2024-09-17T05:36:53.254964+0000","last_peered":"2024-09-17T05:36:53.254964+0000","last_clean":"2024-09-17T05:36:53.254964+0000","last_became_active":"2024-09-17T05:36:51.240935+0000","last_became_peered":"2024-09-17T05:36:51.240935+0000","last_unstale":"2024-09-17T05:36:53.254964+0000","last_undegraded":"2024-09-17T05:36:53.254964+0000","last_fullsized":"2024-09-17T05:36:53.254964+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:18.694850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.252137+0000","last_change":"2024-09-17T05:36:52.242813+0000","last_active":"2024-09-17T05:36:53.252137+0000","last_peered":"2024-09-17T05:36:53.252137+0000","last_clean":"2024-09-17T05:36:53.252137+0000","last_became_active":"2024-09-17T05:36:52.242578+0000","last_became_peered":"2024-09-17T05:36:52.242578+0000","last_unstale":"2024-09-17T05:36:53.252137+0000","last_undegraded":"2024-09-17T05:36:53.252137+0000","last_fullsized":"2024-09-17T05:36:53.252137+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:19.680293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"162'2","reported_seq":17,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591230+0000","last_change":"2024-09-17T05:36:51.248163+0000","last_active":"2024-09-17T05:36:53.591230+0000","last_peered":"2024-09-17T05:36:53.591230+0000","last_clean":"2024-09-17T05:36:53.591230+0000","last_became_active":"2024-09-17T05:36:51.247800+0000","last_became_peered":"2024-09-17T05:36:51.247800+0000","last_unstale":"2024-09-17T05:36:53.591230+0000","last_undegraded":"2024-09-17T05:36:53.591230+0000","last_fullsized":"2024-09-17T05:36:53.591230+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:17.024689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591975+0000","last_change":"2024-09-17T05:36:52.257075+0000","last_active":"2024-09-17T05:36:53.591975+0000","last_peered":"2024-09-17T05:36:53.591975+0000","last_clean":"2024-09-17T05:36:53.591975+0000","last_became_active":"2024-09-17T05:36:52.256789+0000","last_became_peered":"2024-09-17T05:36:52.256789+0000","last_unstale":"2024-09-17T05:36:53.591975+0000","last_undegraded":"2024-09-17T05:36:53.591975+0000","last_fullsized":"2024-09-17T05:36:53.591975+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:55.759619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"162'2","reported_seq":17,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594891+0000","last_change":"2024-09-17T05:36:51.249215+0000","last_active":"2024-09-17T05:36:53.594891+0000","last_peered":"2024-09-17T05:36:53.594891+0000","last_clean":"2024-09-17T05:36:53.594891+0000","last_became_active":"2024-09-17T05:36:51.248940+0000","last_became_peered":"2024-09-17T05:36:51.248940+0000","last_unstale":"2024-09-17T05:36:53.594891+0000","last_undegraded":"2024-09-17T05:36:53.594891+0000","last_fullsized":"2024-09-17T05:36:53.594891+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:32:18.332593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594606+0000","last_change":"2024-09-17T05:36:52.264195+0000","last_active":"2024-09-17T05:36:53.594606+0000","last_peered":"2024-09-17T05:36:53.594606+0000","last_clean":"2024-09-17T05:36:53.594606+0000","last_became_active":"2024-09-17T05:36:52.263953+0000","last_became_peered":"2024-09-17T05:36:52.263953+0000","last_unstale":"2024-09-17T05:36:53.594606+0000","last_undegraded":"2024-09-17T05:36:53.594606+0000","last_fullsized":"2024-09-17T05:36:53.594606+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:23.332934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"162'1","reported_seq":16,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590696+0000","last_change":"2024-09-17T05:36:51.244540+0000","last_active":"2024-09-17T05:36:53.590696+0000","last_peered":"2024-09-17T05:36:53.590696+0000","last_clean":"2024-09-17T05:36:53.590696+0000","last_became_active":"2024-09-17T05:36:51.244218+0000","last_became_peered":"2024-09-17T05:36:51.244218+0000","last_unstale":"2024-09-17T05:36:53.590696+0000","last_undegraded":"2024-09-17T05:36:53.590696+0000","last_fullsized":"2024-09-17T05:36:53.590696+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:00.792504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590198+0000","last_change":"2024-09-17T05:36:52.263055+0000","last_active":"2024-09-17T05:36:53.590198+0000","last_peered":"2024-09-17T05:36:53.590198+0000","last_clean":"2024-09-17T05:36:53.590198+0000","last_became_active":"2024-09-17T05:36:52.262779+0000","last_became_peered":"2024-09-17T05:36:52.262779+0000","last_unstale":"2024-09-17T05:36:53.590198+0000","last_undegraded":"2024-09-17T05:36:53.590198+0000","last_fullsized":"2024-09-17T05:36:53.590198+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:35.648629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590260+0000","last_change":"2024-09-17T05:36:51.249062+0000","last_active":"2024-09-17T05:36:53.590260+0000","last_peered":"2024-09-17T05:36:53.590260+0000","last_clean":"2024-09-17T05:36:53.590260+0000","last_became_active":"2024-09-17T05:36:51.247784+0000","last_became_peered":"2024-09-17T05:36:51.247784+0000","last_unstale":"2024-09-17T05:36:53.590260+0000","last_undegraded":"2024-09-17T05:36:53.590260+0000","last_fullsized":"2024-09-17T05:36:53.590260+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:15:32.553107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.593944+0000","last_change":"2024-09-17T05:36:52.264062+0000","last_active":"2024-09-17T05:36:53.593944+0000","last_peered":"2024-09-17T05:36:53.593944+0000","last_clean":"2024-09-17T05:36:53.593944+0000","last_became_active":"2024-09-17T05:36:52.263641+0000","last_became_peered":"2024-09-17T05:36:52.263641+0000","last_unstale":"2024-09-17T05:36:53.593944+0000","last_undegraded":"2024-09-17T05:36:53.593944+0000","last_fullsized":"2024-09-17T05:36:53.593944+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:57.861386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254174+0000","last_change":"2024-09-17T05:36:51.254842+0000","last_active":"2024-09-17T05:36:53.254174+0000","last_peered":"2024-09-17T05:36:53.254174+0000","last_clean":"2024-09-17T05:36:53.254174+0000","last_became_active":"2024-09-17T05:36:51.254467+0000","last_became_peered":"2024-09-17T05:36:51.254467+0000","last_unstale":"2024-09-17T05:36:53.254174+0000","last_undegraded":"2024-09-17T05:36:53.254174+0000","last_fullsized":"2024-09-17T05:36:53.254174+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:01.752259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594794+0000","last_change":"2024-09-17T05:36:52.267171+0000","last_active":"2024-09-17T05:36:53.594794+0000","last_peered":"2024-09-17T05:36:53.594794+0000","last_clean":"2024-09-17T05:36:53.594794+0000","last_became_active":"2024-09-17T05:36:52.266008+0000","last_became_peered":"2024-09-17T05:36:52.266008+0000","last_unstale":"2024-09-17T05:36:53.594794+0000","last_undegraded":"2024-09-17T05:36:53.594794+0000","last_fullsized":"2024-09-17T05:36:53.594794+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:44.465533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590244+0000","last_change":"2024-09-17T05:36:51.245654+0000","last_active":"2024-09-17T05:36:53.590244+0000","last_peered":"2024-09-17T05:36:53.590244+0000","last_clean":"2024-09-17T05:36:53.590244+0000","last_became_active":"2024-09-17T05:36:51.245308+0000","last_became_peered":"2024-09-17T05:36:51.245308+0000","last_unstale":"2024-09-17T05:36:53.590244+0000","last_undegraded":"2024-09-17T05:36:53.590244+0000","last_fullsized":"2024-09-17T05:36:53.590244+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:51.852302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591158+0000","last_change":"2024-09-17T05:36:52.262228+0000","last_active":"2024-09-17T05:36:53.591158+0000","last_peered":"2024-09-17T05:36:53.591158+0000","last_clean":"2024-09-17T05:36:53.591158+0000","last_became_active":"2024-09-17T05:36:52.261952+0000","last_became_peered":"2024-09-17T05:36:52.261952+0000","last_unstale":"2024-09-17T05:36:53.591158+0000","last_undegraded":"2024-09-17T05:36:53.591158+0000","last_fullsized":"2024-09-17T05:36:53.591158+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:05.342031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.255471+0000","last_change":"2024-09-17T05:36:51.243498+0000","last_active":"2024-09-17T05:36:53.255471+0000","last_peered":"2024-09-17T05:36:53.255471+0000","last_clean":"2024-09-17T05:36:53.255471+0000","last_became_active":"2024-09-17T05:36:51.243159+0000","last_became_peered":"2024-09-17T05:36:51.243159+0000","last_unstale":"2024-09-17T05:36:53.255471+0000","last_undegraded":"2024-09-17T05:36:53.255471+0000","last_fullsized":"2024-09-17T05:36:53.255471+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:40.291152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594567+0000","last_change":"2024-09-17T05:36:52.266358+0000","last_active":"2024-09-17T05:36:53.594567+0000","last_peered":"2024-09-17T05:36:53.594567+0000","last_clean":"2024-09-17T05:36:53.594567+0000","last_became_active":"2024-09-17T05:36:52.265807+0000","last_became_peered":"2024-09-17T05:36:52.265807+0000","last_unstale":"2024-09-17T05:36:53.594567+0000","last_undegraded":"2024-09-17T05:36:53.594567+0000","last_fullsized":"2024-09-17T05:36:53.594567+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:01.172059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"162'3","reported_seq":18,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.592152+0000","last_change":"2024-09-17T05:36:51.249130+0000","last_active":"2024-09-17T05:36:53.592152+0000","last_peered":"2024-09-17T05:36:53.592152+0000","last_clean":"2024-09-17T05:36:53.592152+0000","last_became_active":"2024-09-17T05:36:51.248811+0000","last_became_peered":"2024-09-17T05:36:51.248811+0000","last_unstale":"2024-09-17T05:36:53.592152+0000","last_undegraded":"2024-09-17T05:36:53.592152+0000","last_fullsized":"2024-09-17T05:36:53.592152+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:46.140984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.252334+0000","last_change":"2024-09-17T05:36:52.250390+0000","last_active":"2024-09-17T05:36:53.252334+0000","last_peered":"2024-09-17T05:36:53.252334+0000","last_clean":"2024-09-17T05:36:53.252334+0000","last_became_active":"2024-09-17T05:36:52.250134+0000","last_became_peered":"2024-09-17T05:36:52.250134+0000","last_unstale":"2024-09-17T05:36:53.252334+0000","last_undegraded":"2024-09-17T05:36:53.252334+0000","last_fullsized":"2024-09-17T05:36:53.252334+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:48.890563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"162'6","reported_seq":21,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594755+0000","last_change":"2024-09-17T05:36:51.247573+0000","last_active":"2024-09-17T05:36:53.594755+0000","last_peered":"2024-09-17T05:36:53.594755+0000","last_clean":"2024-09-17T05:36:53.594755+0000","last_became_active":"2024-09-17T05:36:51.247225+0000","last_became_peered":"2024-09-17T05:36:51.247225+0000","last_unstale":"2024-09-17T05:36:53.594755+0000","last_undegraded":"2024-09-17T05:36:53.594755+0000","last_fullsized":"2024-09-17T05:36:53.594755+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:12.372923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590575+0000","last_change":"2024-09-17T05:36:52.259641+0000","last_active":"2024-09-17T05:36:53.590575+0000","last_peered":"2024-09-17T05:36:53.590575+0000","last_clean":"2024-09-17T05:36:53.590575+0000","last_became_active":"2024-09-17T05:36:52.259293+0000","last_became_peered":"2024-09-17T05:36:52.259293+0000","last_unstale":"2024-09-17T05:36:53.590575+0000","last_undegraded":"2024-09-17T05:36:53.590575+0000","last_fullsized":"2024-09-17T05:36:53.590575+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:11.194500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"162'2","reported_seq":17,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254340+0000","last_change":"2024-09-17T05:36:51.243141+0000","last_active":"2024-09-17T05:36:53.254340+0000","last_peered":"2024-09-17T05:36:53.254340+0000","last_clean":"2024-09-17T05:36:53.254340+0000","last_became_active":"2024-09-17T05:36:51.242762+0000","last_became_peered":"2024-09-17T05:36:51.242762+0000","last_unstale":"2024-09-17T05:36:53.254340+0000","last_undegraded":"2024-09-17T05:36:53.254340+0000","last_fullsized":"2024-09-17T05:36:53.254340+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:12.875087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591910+0000","last_change":"2024-09-17T05:36:52.244572+0000","last_active":"2024-09-17T05:36:53.591910+0000","last_peered":"2024-09-17T05:36:53.591910+0000","last_clean":"2024-09-17T05:36:53.591910+0000","last_became_active":"2024-09-17T05:36:52.244288+0000","last_became_peered":"2024-09-17T05:36:52.244288+0000","last_unstale":"2024-09-17T05:36:53.591910+0000","last_undegraded":"2024-09-17T05:36:53.591910+0000","last_fullsized":"2024-09-17T05:36:53.591910+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:43.546042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254301+0000","last_change":"2024-09-17T05:36:51.247213+0000","last_active":"2024-09-17T05:36:53.254301+0000","last_peered":"2024-09-17T05:36:53.254301+0000","last_clean":"2024-09-17T05:36:53.254301+0000","last_became_active":"2024-09-17T05:36:51.246941+0000","last_became_peered":"2024-09-17T05:36:51.246941+0000","last_unstale":"2024-09-17T05:36:53.254301+0000","last_undegraded":"2024-09-17T05:36:53.254301+0000","last_fullsized":"2024-09-17T05:36:53.254301+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:57.190804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590119+0000","last_change":"2024-09-17T05:36:52.263121+0000","last_active":"2024-09-17T05:36:53.590119+0000","last_peered":"2024-09-17T05:36:53.590119+0000","last_clean":"2024-09-17T05:36:53.590119+0000","last_became_active":"2024-09-17T05:36:52.262857+0000","last_became_peered":"2024-09-17T05:36:52.262857+0000","last_unstale":"2024-09-17T05:36:53.590119+0000","last_undegraded":"2024-09-17T05:36:53.590119+0000","last_fullsized":"2024-09-17T05:36:53.590119+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:12.439082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591384+0000","last_change":"2024-09-17T05:36:51.246082+0000","last_active":"2024-09-17T05:36:53.591384+0000","last_peered":"2024-09-17T05:36:53.591384+0000","last_clean":"2024-09-17T05:36:53.591384+0000","last_became_active":"2024-09-17T05:36:51.245701+0000","last_became_peered":"2024-09-17T05:36:51.245701+0000","last_unstale":"2024-09-17T05:36:53.591384+0000","last_undegraded":"2024-09-17T05:36:53.591384+0000","last_fullsized":"2024-09-17T05:36:53.591384+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:07:55.448565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.251756+0000","last_change":"2024-09-17T05:36:52.242080+0000","last_active":"2024-09-17T05:36:53.251756+0000","last_peered":"2024-09-17T05:36:53.251756+0000","last_clean":"2024-09-17T05:36:53.251756+0000","last_became_active":"2024-09-17T05:36:52.241786+0000","last_became_peered":"2024-09-17T05:36:52.241786+0000","last_unstale":"2024-09-17T05:36:53.251756+0000","last_undegraded":"2024-09-17T05:36:53.251756+0000","last_fullsized":"2024-09-17T05:36:53.251756+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:33.227064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"162'8","reported_seq":23,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590229+0000","last_change":"2024-09-17T05:36:51.244849+0000","last_active":"2024-09-17T05:36:53.590229+0000","last_peered":"2024-09-17T05:36:53.590229+0000","last_clean":"2024-09-17T05:36:53.590229+0000","last_became_active":"2024-09-17T05:36:51.244443+0000","last_became_peered":"2024-09-17T05:36:51.244443+0000","last_unstale":"2024-09-17T05:36:53.590229+0000","last_undegraded":"2024-09-17T05:36:53.590229+0000","last_fullsized":"2024-09-17T05:36:53.590229+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:55.441379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254826+0000","last_change":"2024-09-17T05:36:52.264298+0000","last_active":"2024-09-17T05:36:53.254826+0000","last_peered":"2024-09-17T05:36:53.254826+0000","last_clean":"2024-09-17T05:36:53.254826+0000","last_became_active":"2024-09-17T05:36:52.264015+0000","last_became_peered":"2024-09-17T05:36:52.264015+0000","last_unstale":"2024-09-17T05:36:53.254826+0000","last_undegraded":"2024-09-17T05:36:53.254826+0000","last_fullsized":"2024-09-17T05:36:53.254826+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:55.811088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"162'1","reported_seq":16,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590349+0000","last_change":"2024-09-17T05:36:51.253562+0000","last_active":"2024-09-17T05:36:53.590349+0000","last_peered":"2024-09-17T05:36:53.590349+0000","last_clean":"2024-09-17T05:36:53.590349+0000","last_became_active":"2024-09-17T05:36:51.252240+0000","last_became_peered":"2024-09-17T05:36:51.252240+0000","last_unstale":"2024-09-17T05:36:53.590349+0000","last_undegraded":"2024-09-17T05:36:53.590349+0000","last_fullsized":"2024-09-17T05:36:53.590349+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:30.659102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254891+0000","last_change":"2024-09-17T05:36:52.250106+0000","last_active":"2024-09-17T05:36:53.254891+0000","last_peered":"2024-09-17T05:36:53.254891+0000","last_clean":"2024-09-17T05:36:53.254891+0000","last_became_active":"2024-09-17T05:36:52.249837+0000","last_became_peered":"2024-09-17T05:36:52.249837+0000","last_unstale":"2024-09-17T05:36:53.254891+0000","last_undegraded":"2024-09-17T05:36:53.254891+0000","last_fullsized":"2024-09-17T05:36:53.254891+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:04.071461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"162'2","reported_seq":17,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.255070+0000","last_change":"2024-09-17T05:36:51.254302+0000","last_active":"2024-09-17T05:36:53.255070+0000","last_peered":"2024-09-17T05:36:53.255070+0000","last_clean":"2024-09-17T05:36:53.255070+0000","last_became_active":"2024-09-17T05:36:51.253998+0000","last_became_peered":"2024-09-17T05:36:51.253998+0000","last_unstale":"2024-09-17T05:36:53.255070+0000","last_undegraded":"2024-09-17T05:36:53.255070+0000","last_fullsized":"2024-09-17T05:36:53.255070+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:18.689113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591099+0000","last_change":"2024-09-17T05:36:52.254835+0000","last_active":"2024-09-17T05:36:53.591099+0000","last_peered":"2024-09-17T05:36:53.591099+0000","last_clean":"2024-09-17T05:36:53.591099+0000","last_became_active":"2024-09-17T05:36:52.254563+0000","last_became_peered":"2024-09-17T05:36:52.254563+0000","last_unstale":"2024-09-17T05:36:53.591099+0000","last_undegraded":"2024-09-17T05:36:53.591099+0000","last_fullsized":"2024-09-17T05:36:53.591099+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:48.900733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"162'1","reported_seq":16,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.592197+0000","last_change":"2024-09-17T05:36:51.248771+0000","last_active":"2024-09-17T05:36:53.592197+0000","last_peered":"2024-09-17T05:36:53.592197+0000","last_clean":"2024-09-17T05:36:53.592197+0000","last_became_active":"2024-09-17T05:36:51.248473+0000","last_became_peered":"2024-09-17T05:36:51.248473+0000","last_unstale":"2024-09-17T05:36:53.592197+0000","last_undegraded":"2024-09-17T05:36:53.592197+0000","last_fullsized":"2024-09-17T05:36:53.592197+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:55.624488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.592029+0000","last_change":"2024-09-17T05:36:52.260456+0000","last_active":"2024-09-17T05:36:53.592029+0000","last_peered":"2024-09-17T05:36:53.592029+0000","last_clean":"2024-09-17T05:36:53.592029+0000","last_became_active":"2024-09-17T05:36:52.260185+0000","last_became_peered":"2024-09-17T05:36:52.260185+0000","last_unstale":"2024-09-17T05:36:53.592029+0000","last_undegraded":"2024-09-17T05:36:53.592029+0000","last_fullsized":"2024-09-17T05:36:53.592029+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:37.567542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591122+0000","last_change":"2024-09-17T05:36:51.249275+0000","last_active":"2024-09-17T05:36:53.591122+0000","last_peered":"2024-09-17T05:36:53.591122+0000","last_clean":"2024-09-17T05:36:53.591122+0000","last_became_active":"2024-09-17T05:36:51.249021+0000","last_became_peered":"2024-09-17T05:36:51.249021+0000","last_unstale":"2024-09-17T05:36:53.591122+0000","last_undegraded":"2024-09-17T05:36:53.591122+0000","last_fullsized":"2024-09-17T05:36:53.591122+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:09.435033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591636+0000","last_change":"2024-09-17T05:36:52.253304+0000","last_active":"2024-09-17T05:36:53.591636+0000","last_peered":"2024-09-17T05:36:53.591636+0000","last_clean":"2024-09-17T05:36:53.591636+0000","last_became_active":"2024-09-17T05:36:52.253002+0000","last_became_peered":"2024-09-17T05:36:52.253002+0000","last_unstale":"2024-09-17T05:36:53.591636+0000","last_undegraded":"2024-09-17T05:36:53.591636+0000","last_fullsized":"2024-09-17T05:36:53.591636+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:07.773701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"162'2","reported_seq":17,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591877+0000","last_change":"2024-09-17T05:36:51.248810+0000","last_active":"2024-09-17T05:36:53.591877+0000","last_peered":"2024-09-17T05:36:53.591877+0000","last_clean":"2024-09-17T05:36:53.591877+0000","last_became_active":"2024-09-17T05:36:51.248521+0000","last_became_peered":"2024-09-17T05:36:51.248521+0000","last_unstale":"2024-09-17T05:36:53.591877+0000","last_undegraded":"2024-09-17T05:36:53.591877+0000","last_fullsized":"2024-09-17T05:36:53.591877+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:47:02.441107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590896+0000","last_change":"2024-09-17T05:36:52.261571+0000","last_active":"2024-09-17T05:36:53.590896+0000","last_peered":"2024-09-17T05:36:53.590896+0000","last_clean":"2024-09-17T05:36:53.590896+0000","last_became_active":"2024-09-17T05:36:52.260710+0000","last_became_peered":"2024-09-17T05:36:52.260710+0000","last_unstale":"2024-09-17T05:36:53.590896+0000","last_undegraded":"2024-09-17T05:36:53.590896+0000","last_fullsized":"2024-09-17T05:36:53.590896+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:45.880905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.251858+0000","last_change":"2024-09-17T05:36:51.232409+0000","last_active":"2024-09-17T05:36:53.251858+0000","last_peered":"2024-09-17T05:36:53.251858+0000","last_clean":"2024-09-17T05:36:53.251858+0000","last_became_active":"2024-09-17T05:36:51.232138+0000","last_became_peered":"2024-09-17T05:36:51.232138+0000","last_unstale":"2024-09-17T05:36:53.251858+0000","last_undegraded":"2024-09-17T05:36:53.251858+0000","last_fullsized":"2024-09-17T05:36:53.251858+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:10.637063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.253704+0000","last_change":"2024-09-17T05:36:52.251061+0000","last_active":"2024-09-17T05:36:53.253704+0000","last_peered":"2024-09-17T05:36:53.253704+0000","last_clean":"2024-09-17T05:36:53.253704+0000","last_became_active":"2024-09-17T05:36:52.250418+0000","last_became_peered":"2024-09-17T05:36:52.250418+0000","last_unstale":"2024-09-17T05:36:53.253704+0000","last_undegraded":"2024-09-17T05:36:53.253704+0000","last_fullsized":"2024-09-17T05:36:53.253704+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:33.498784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.251711+0000","last_change":"2024-09-17T05:36:51.239542+0000","last_active":"2024-09-17T05:36:53.251711+0000","last_peered":"2024-09-17T05:36:53.251711+0000","last_clean":"2024-09-17T05:36:53.251711+0000","last_became_active":"2024-09-17T05:36:51.239254+0000","last_became_peered":"2024-09-17T05:36:51.239254+0000","last_unstale":"2024-09-17T05:36:53.251711+0000","last_undegraded":"2024-09-17T05:36:53.251711+0000","last_fullsized":"2024-09-17T05:36:53.251711+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:58.601946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254901+0000","last_change":"2024-09-17T05:36:52.257726+0000","last_active":"2024-09-17T05:36:53.254901+0000","last_peered":"2024-09-17T05:36:53.254901+0000","last_clean":"2024-09-17T05:36:53.254901+0000","last_became_active":"2024-09-17T05:36:52.257453+0000","last_became_peered":"2024-09-17T05:36:52.257453+0000","last_unstale":"2024-09-17T05:36:53.254901+0000","last_undegraded":"2024-09-17T05:36:53.254901+0000","last_fullsized":"2024-09-17T05:36:53.254901+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:37.073844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590297+0000","last_change":"2024-09-17T05:36:51.253201+0000","last_active":"2024-09-17T05:36:53.590297+0000","last_peered":"2024-09-17T05:36:53.590297+0000","last_clean":"2024-09-17T05:36:53.590297+0000","last_became_active":"2024-09-17T05:36:51.252759+0000","last_became_peered":"2024-09-17T05:36:51.252759+0000","last_unstale":"2024-09-17T05:36:53.590297+0000","last_undegraded":"2024-09-17T05:36:53.590297+0000","last_fullsized":"2024-09-17T05:36:53.590297+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:08.513947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594043+0000","last_change":"2024-09-17T05:36:52.261398+0000","last_active":"2024-09-17T05:36:53.594043+0000","last_peered":"2024-09-17T05:36:53.594043+0000","last_clean":"2024-09-17T05:36:53.594043+0000","last_became_active":"2024-09-17T05:36:52.261067+0000","last_became_peered":"2024-09-17T05:36:52.261067+0000","last_unstale":"2024-09-17T05:36:53.594043+0000","last_undegraded":"2024-09-17T05:36:53.594043+0000","last_fullsized":"2024-09-17T05:36:53.594043+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:44.869501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"162'2","reported_seq":17,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591116+0000","last_change":"2024-09-17T05:36:51.248350+0000","last_active":"2024-09-17T05:36:53.591116+0000","last_peered":"2024-09-17T05:36:53.591116+0000","last_clean":"2024-09-17T05:36:53.591116+0000","last_became_active":"2024-09-17T05:36:51.248046+0000","last_became_peered":"2024-09-17T05:36:51.248046+0000","last_unstale":"2024-09-17T05:36:53.591116+0000","last_undegraded":"2024-09-17T05:36:53.591116+0000","last_fullsized":"2024-09-17T05:36:53.591116+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:14.264256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.252364+0000","last_change":"2024-09-17T05:36:52.255627+0000","last_active":"2024-09-17T05:36:53.252364+0000","last_peered":"2024-09-17T05:36:53.252364+0000","last_clean":"2024-09-17T05:36:53.252364+0000","last_became_active":"2024-09-17T05:36:52.254859+0000","last_became_peered":"2024-09-17T05:36:52.254859+0000","last_unstale":"2024-09-17T05:36:53.252364+0000","last_undegraded":"2024-09-17T05:36:53.252364+0000","last_fullsized":"2024-09-17T05:36:53.252364+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:45.096152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594846+0000","last_change":"2024-09-17T05:36:51.251775+0000","last_active":"2024-09-17T05:36:53.594846+0000","last_peered":"2024-09-17T05:36:53.594846+0000","last_clean":"2024-09-17T05:36:53.594846+0000","last_became_active":"2024-09-17T05:36:51.251412+0000","last_became_peered":"2024-09-17T05:36:51.251412+0000","last_unstale":"2024-09-17T05:36:53.594846+0000","last_undegraded":"2024-09-17T05:36:53.594846+0000","last_fullsized":"2024-09-17T05:36:53.594846+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:40.255706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254354+0000","last_change":"2024-09-17T05:36:52.253459+0000","last_active":"2024-09-17T05:36:53.254354+0000","last_peered":"2024-09-17T05:36:53.254354+0000","last_clean":"2024-09-17T05:36:53.254354+0000","last_became_active":"2024-09-17T05:36:52.251581+0000","last_became_peered":"2024-09-17T05:36:52.251581+0000","last_unstale":"2024-09-17T05:36:53.254354+0000","last_undegraded":"2024-09-17T05:36:53.254354+0000","last_fullsized":"2024-09-17T05:36:53.254354+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:43.174971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590894+0000","last_change":"2024-09-17T05:36:51.251412+0000","last_active":"2024-09-17T05:36:53.590894+0000","last_peered":"2024-09-17T05:36:53.590894+0000","last_clean":"2024-09-17T05:36:53.590894+0000","last_became_active":"2024-09-17T05:36:51.251091+0000","last_became_peered":"2024-09-17T05:36:51.251091+0000","last_unstale":"2024-09-17T05:36:53.590894+0000","last_undegraded":"2024-09-17T05:36:53.590894+0000","last_fullsized":"2024-09-17T05:36:53.590894+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:19.637732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.255384+0000","last_change":"2024-09-17T05:36:52.252425+0000","last_active":"2024-09-17T05:36:53.255384+0000","last_peered":"2024-09-17T05:36:53.255384+0000","last_clean":"2024-09-17T05:36:53.255384+0000","last_became_active":"2024-09-17T05:36:52.252216+0000","last_became_peered":"2024-09-17T05:36:52.252216+0000","last_unstale":"2024-09-17T05:36:53.255384+0000","last_undegraded":"2024-09-17T05:36:53.255384+0000","last_fullsized":"2024-09-17T05:36:53.255384+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:46.619354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591207+0000","last_change":"2024-09-17T05:36:51.247678+0000","last_active":"2024-09-17T05:36:53.591207+0000","last_peered":"2024-09-17T05:36:53.591207+0000","last_clean":"2024-09-17T05:36:53.591207+0000","last_became_active":"2024-09-17T05:36:51.246990+0000","last_became_peered":"2024-09-17T05:36:51.246990+0000","last_unstale":"2024-09-17T05:36:53.591207+0000","last_undegraded":"2024-09-17T05:36:53.591207+0000","last_fullsized":"2024-09-17T05:36:53.591207+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:29.496469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.251876+0000","last_change":"2024-09-17T05:36:52.240380+0000","last_active":"2024-09-17T05:36:53.251876+0000","last_peered":"2024-09-17T05:36:53.251876+0000","last_clean":"2024-09-17T05:36:53.251876+0000","last_became_active":"2024-09-17T05:36:52.239898+0000","last_became_peered":"2024-09-17T05:36:52.239898+0000","last_unstale":"2024-09-17T05:36:53.251876+0000","last_undegraded":"2024-09-17T05:36:53.251876+0000","last_fullsized":"2024-09-17T05:36:53.251876+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:10.323581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594564+0000","last_change":"2024-09-17T05:36:51.248144+0000","last_active":"2024-09-17T05:36:53.594564+0000","last_peered":"2024-09-17T05:36:53.594564+0000","last_clean":"2024-09-17T05:36:53.594564+0000","last_became_active":"2024-09-17T05:36:51.247884+0000","last_became_peered":"2024-09-17T05:36:51.247884+0000","last_unstale":"2024-09-17T05:36:53.594564+0000","last_undegraded":"2024-09-17T05:36:53.594564+0000","last_fullsized":"2024-09-17T05:36:53.594564+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:22.654147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.593626+0000","last_change":"2024-09-17T05:36:52.263967+0000","last_active":"2024-09-17T05:36:53.593626+0000","last_peered":"2024-09-17T05:36:53.593626+0000","last_clean":"2024-09-17T05:36:53.593626+0000","last_became_active":"2024-09-17T05:36:52.263606+0000","last_became_peered":"2024-09-17T05:36:52.263606+0000","last_unstale":"2024-09-17T05:36:53.593626+0000","last_undegraded":"2024-09-17T05:36:53.593626+0000","last_fullsized":"2024-09-17T05:36:53.593626+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:02.755427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590775+0000","last_change":"2024-09-17T05:36:51.252558+0000","last_active":"2024-09-17T05:36:53.590775+0000","last_peered":"2024-09-17T05:36:53.590775+0000","last_clean":"2024-09-17T05:36:53.590775+0000","last_became_active":"2024-09-17T05:36:51.252167+0000","last_became_peered":"2024-09-17T05:36:51.252167+0000","last_unstale":"2024-09-17T05:36:53.590775+0000","last_undegraded":"2024-09-17T05:36:53.590775+0000","last_fullsized":"2024-09-17T05:36:53.590775+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:33.040025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590194+0000","last_change":"2024-09-17T05:36:52.262928+0000","last_active":"2024-09-17T05:36:53.590194+0000","last_peered":"2024-09-17T05:36:53.590194+0000","last_clean":"2024-09-17T05:36:53.590194+0000","last_became_active":"2024-09-17T05:36:52.262526+0000","last_became_peered":"2024-09-17T05:36:52.262526+0000","last_unstale":"2024-09-17T05:36:53.590194+0000","last_undegraded":"2024-09-17T05:36:53.590194+0000","last_fullsized":"2024-09-17T05:36:53.590194+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:12.826425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.255099+0000","last_change":"2024-09-17T05:36:51.241286+0000","last_active":"2024-09-17T05:36:53.255099+0000","last_peered":"2024-09-17T05:36:53.255099+0000","last_clean":"2024-09-17T05:36:53.255099+0000","last_became_active":"2024-09-17T05:36:51.241017+0000","last_became_peered":"2024-09-17T05:36:51.241017+0000","last_unstale":"2024-09-17T05:36:53.255099+0000","last_undegraded":"2024-09-17T05:36:53.255099+0000","last_fullsized":"2024-09-17T05:36:53.255099+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:20:46.722479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.253904+0000","last_change":"2024-09-17T05:36:52.257300+0000","last_active":"2024-09-17T05:36:53.253904+0000","last_peered":"2024-09-17T05:36:53.253904+0000","last_clean":"2024-09-17T05:36:53.253904+0000","last_became_active":"2024-09-17T05:36:52.257009+0000","last_became_peered":"2024-09-17T05:36:52.257009+0000","last_unstale":"2024-09-17T05:36:53.253904+0000","last_undegraded":"2024-09-17T05:36:53.253904+0000","last_fullsized":"2024-09-17T05:36:53.253904+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:28.333115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.593618+0000","last_change":"2024-09-17T05:36:51.243134+0000","last_active":"2024-09-17T05:36:53.593618+0000","last_peered":"2024-09-17T05:36:53.593618+0000","last_clean":"2024-09-17T05:36:53.593618+0000","last_became_active":"2024-09-17T05:36:51.242813+0000","last_became_peered":"2024-09-17T05:36:51.242813+0000","last_unstale":"2024-09-17T05:36:53.593618+0000","last_undegraded":"2024-09-17T05:36:53.593618+0000","last_fullsized":"2024-09-17T05:36:53.593618+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:35.358532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.251754+0000","last_change":"2024-09-17T05:36:52.248088+0000","last_active":"2024-09-17T05:36:53.251754+0000","last_peered":"2024-09-17T05:36:53.251754+0000","last_clean":"2024-09-17T05:36:53.251754+0000","last_became_active":"2024-09-17T05:36:52.247760+0000","last_became_peered":"2024-09-17T05:36:52.247760+0000","last_unstale":"2024-09-17T05:36:53.251754+0000","last_undegraded":"2024-09-17T05:36:53.251754+0000","last_fullsized":"2024-09-17T05:36:53.251754+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:10.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"162'1","reported_seq":16,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.593873+0000","last_change":"2024-09-17T05:36:51.254189+0000","last_active":"2024-09-17T05:36:53.593873+0000","last_peered":"2024-09-17T05:36:53.593873+0000","last_clean":"2024-09-17T05:36:53.593873+0000","last_became_active":"2024-09-17T05:36:51.253873+0000","last_became_peered":"2024-09-17T05:36:51.253873+0000","last_unstale":"2024-09-17T05:36:53.593873+0000","last_undegraded":"2024-09-17T05:36:53.593873+0000","last_fullsized":"2024-09-17T05:36:53.593873+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:37.887398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":399,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594021+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:36:53.594021+0000","last_peered":"2024-09-17T05:36:53.594021+0000","last_clean":"2024-09-17T05:36:53.594021+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:36:53.594021+0000","last_undegraded":"2024-09-17T05:36:53.594021+0000","last_fullsized":"2024-09-17T05:36:53.594021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509543,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33784,"kb_used_data":2596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338056,"statfs":{"total":96636764160,"available":96602169344,"internally_reserved":0,"allocated":2658304,"data_stored":1497630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2043904,"data_stored":899904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542247,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2056192,"data_stored":906232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509544,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33220,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338620,"statfs":{"total":96636764160,"available":96602746880,"internally_reserved":0,"allocated":2072576,"data_stored":907366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2052096,"data_stored":899504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509544,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33180,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338660,"statfs":{"total":96636764160,"available":96602787840,"internally_reserved":0,"allocated":2039808,"data_stored":899322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509542,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2048000,"data_stored":899378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542246,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37936,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333904,"statfs":{"total":96636764160,"available":96597917696,"internally_reserved":0,"allocated":2650112,"data_stored":1496108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:36:56.421 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:36:56.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.604+0000 7f1eb5800640 1 -- 172.21.15.31:0/3837048638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb00b3130 msgr2=0x7f1eb00cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.604+0000 7f1eb5800640 1 --2- 172.21.15.31:0/3837048638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb00b3130 0x7f1eb00cc550 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8009bc0 tx=0x7f1ea801cba0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.604+0000 7f1eb5800640 1 -- 172.21.15.31:0/3837048638 shutdown_connections 2024-09-17T05:36:56.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.604+0000 7f1eb5800640 1 --2- 172.21.15.31:0/3837048638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb00b3130 0x7f1eb00cc550 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.604+0000 7f1eb5800640 1 --2- 172.21.15.31:0/3837048638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1eb00b4bd0 0x7f1eb00b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.604+0000 7f1eb5800640 1 -- 172.21.15.31:0/3837048638 >> 172.21.15.31:0/3837048638 conn(0x7f1eb00b18f0 msgr2=0x7f1eb00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:56.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.604+0000 7f1eb5800640 1 -- 172.21.15.31:0/3837048638 shutdown_connections 2024-09-17T05:36:56.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.604+0000 7f1eb5800640 1 -- 172.21.15.31:0/3837048638 wait complete. 2024-09-17T05:36:56.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eb5800640 1 Processor -- start 2024-09-17T05:36:56.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eb5800640 1 -- start start 2024-09-17T05:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eb5800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1eb00b3130 0x7f1eb01fb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eb5800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb00b4bd0 0x7f1eb009d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eb5800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1eb015b580 0x7f1eb0153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eb5800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb0167b70 con 0x7f1eb00b3130 2024-09-17T05:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eb5800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb00cd570 con 0x7f1eb00b4bd0 2024-09-17T05:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eb5800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1eb0167cf0 con 0x7f1eb015b580 2024-09-17T05:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eaea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1eb00b3130 0x7f1eb01fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eaea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1eb00b3130 0x7f1eb01fb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33096/0 (socket says 172.21.15.31:33096) 2024-09-17T05:36:56.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eaea00640 1 -- 172.21.15.31:0/128684922 learned_addr learned my addr 172.21.15.31:0/128684922 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:56.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1ea6000640 1 --2- 172.21.15.31:0/128684922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb00b4bd0 0x7f1eb009d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:56.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eaf400640 1 --2- 172.21.15.31:0/128684922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1eb015b580 0x7f1eb0153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:56.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eaea00640 1 -- 172.21.15.31:0/128684922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1eb015b580 msgr2=0x7f1eb0153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eaea00640 1 --2- 172.21.15.31:0/128684922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1eb015b580 0x7f1eb0153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eaea00640 1 -- 172.21.15.31:0/128684922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb00b4bd0 msgr2=0x7f1eb009d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eaea00640 1 --2- 172.21.15.31:0/128684922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb00b4bd0 0x7f1eb009d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eaea00640 1 -- 172.21.15.31:0/128684922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb01541d0 con 0x7f1eb00b3130 2024-09-17T05:36:56.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eaf400640 1 --2- 172.21.15.31:0/128684922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1eb015b580 0x7f1eb0153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:56.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eaea00640 1 --2- 172.21.15.31:0/128684922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1eb00b3130 0x7f1eb01fb880 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000c400 tx=0x7f1ea000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:56.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1ea7400640 1 -- 172.21.15.31:0/128684922 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0011790 con 0x7f1eb00b3130 2024-09-17T05:36:56.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1ea7400640 1 -- 172.21.15.31:0/128684922 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ea0017070 con 0x7f1eb00b3130 2024-09-17T05:36:56.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1ea7400640 1 -- 172.21.15.31:0/128684922 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0011cc0 con 0x7f1eb00b3130 2024-09-17T05:36:56.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eb5800640 1 -- 172.21.15.31:0/128684922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb01fada0 con 0x7f1eb00b3130 2024-09-17T05:36:56.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eb5800640 1 -- 172.21.15.31:0/128684922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb01544b0 con 0x7f1eb00b3130 2024-09-17T05:36:56.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.608+0000 7f1eb5800640 1 -- 172.21.15.31:0/128684922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eb0069410 con 0x7f1eb00b3130 2024-09-17T05:36:56.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.612+0000 7f1ea7400640 1 -- 172.21.15.31:0/128684922 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f1ea001c460 con 0x7f1eb00b3130 2024-09-17T05:36:56.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.612+0000 7f1ea7400640 1 --2- 172.21.15.31:0/128684922 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1e8c073c20 0x7f1e8c0760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:56.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.612+0000 7f1ea7400640 1 -- 172.21.15.31:0/128684922 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f1ea00956a0 con 0x7f1eb00b3130 2024-09-17T05:36:56.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.612+0000 7f1ea6000640 1 --2- 172.21.15.31:0/128684922 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1e8c073c20 0x7f1e8c0760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:56.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.612+0000 7f1ea6000640 1 --2- 172.21.15.31:0/128684922 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1e8c073c20 0x7f1e8c0760e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009600 tx=0x7f1e980091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:56.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.616+0000 7f1ea7400640 1 -- 172.21.15.31:0/128684922 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f1ea005f3a0 con 0x7f1eb00b3130 2024-09-17T05:36:56.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.800+0000 7f1eb5800640 1 -- 172.21.15.31:0/128684922 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1eb00cc550 con 0x7f1e8c073c20 2024-09-17T05:36:56.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.804+0000 7f1ea7400640 1 -- 172.21.15.31:0/128684922 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252478 (secure 0 0 0) 0x7f1eb00cc550 con 0x7f1e8c073c20 2024-09-17T05:36:56.809 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:56.810 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:36:56.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.808+0000 7f1eb5800640 1 -- 172.21.15.31:0/128684922 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1e8c073c20 msgr2=0x7f1e8c0760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.808+0000 7f1eb5800640 1 --2- 172.21.15.31:0/128684922 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1e8c073c20 0x7f1e8c0760e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009600 tx=0x7f1e980091e0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.808+0000 7f1eb5800640 1 -- 172.21.15.31:0/128684922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1eb00b3130 msgr2=0x7f1eb01fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:56.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.808+0000 7f1eb5800640 1 --2- 172.21.15.31:0/128684922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1eb00b3130 0x7f1eb01fb880 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000c400 tx=0x7f1ea000c8c0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.808+0000 7f1eb5800640 1 -- 172.21.15.31:0/128684922 shutdown_connections 2024-09-17T05:36:56.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.808+0000 7f1eb5800640 1 --2- 172.21.15.31:0/128684922 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f1e8c073c20 0x7f1e8c0760e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.808+0000 7f1eb5800640 1 --2- 172.21.15.31:0/128684922 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1eb015b580 0x7f1eb0153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.808+0000 7f1eb5800640 1 --2- 172.21.15.31:0/128684922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb00b4bd0 0x7f1eb009d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.808+0000 7f1eb5800640 1 --2- 172.21.15.31:0/128684922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1eb00b3130 0x7f1eb01fb880 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:56.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.808+0000 7f1eb5800640 1 -- 172.21.15.31:0/128684922 >> 172.21.15.31:0/128684922 conn(0x7f1eb00b18f0 msgr2=0x7f1eb00d0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:56.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.808+0000 7f1eb5800640 1 -- 172.21.15.31:0/128684922 shutdown_connections 2024-09-17T05:36:56.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:56.808+0000 7f1eb5800640 1 -- 172.21.15.31:0/128684922 wait complete. 2024-09-17T05:36:56.831 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2024-09-17T05:36:56.754814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":157,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":270904,"kb_used_data":17208,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703816,"statfs":{"total":773094113280,"available":772816707584,"internally_reserved":0,"allocated":17620992,"data_stored":8405444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001112"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.252244+0000","last_change":"2024-09-17T05:36:52.257913+0000","last_active":"2024-09-17T05:36:53.252244+0000","last_peered":"2024-09-17T05:36:53.252244+0000","last_clean":"2024-09-17T05:36:53.252244+0000","last_became_active":"2024-09-17T05:36:52.257628+0000","last_became_peered":"2024-09-17T05:36:52.257628+0000","last_unstale":"2024-09-17T05:36:53.252244+0000","last_undegraded":"2024-09-17T05:36:53.252244+0000","last_fullsized":"2024-09-17T05:36:53.252244+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:10.548156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.255261+0000","last_change":"2024-09-17T05:36:52.247238+0000","last_active":"2024-09-17T05:36:53.255261+0000","last_peered":"2024-09-17T05:36:53.255261+0000","last_clean":"2024-09-17T05:36:53.255261+0000","last_became_active":"2024-09-17T05:36:52.246928+0000","last_became_peered":"2024-09-17T05:36:52.246928+0000","last_unstale":"2024-09-17T05:36:53.255261+0000","last_undegraded":"2024-09-17T05:36:53.255261+0000","last_fullsized":"2024-09-17T05:36:53.255261+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:23.879311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591118+0000","last_change":"2024-09-17T05:36:52.264273+0000","last_active":"2024-09-17T05:36:53.591118+0000","last_peered":"2024-09-17T05:36:53.591118+0000","last_clean":"2024-09-17T05:36:53.591118+0000","last_became_active":"2024-09-17T05:36:52.262624+0000","last_became_peered":"2024-09-17T05:36:52.262624+0000","last_unstale":"2024-09-17T05:36:53.591118+0000","last_undegraded":"2024-09-17T05:36:53.591118+0000","last_fullsized":"2024-09-17T05:36:53.591118+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:41:56.625716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594557+0000","last_change":"2024-09-17T05:36:52.266060+0000","last_active":"2024-09-17T05:36:53.594557+0000","last_peered":"2024-09-17T05:36:53.594557+0000","last_clean":"2024-09-17T05:36:53.594557+0000","last_became_active":"2024-09-17T05:36:52.265482+0000","last_became_peered":"2024-09-17T05:36:52.265482+0000","last_unstale":"2024-09-17T05:36:53.594557+0000","last_undegraded":"2024-09-17T05:36:53.594557+0000","last_fullsized":"2024-09-17T05:36:53.594557+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:37.567542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590716+0000","last_change":"2024-09-17T05:36:52.264261+0000","last_active":"2024-09-17T05:36:53.590716+0000","last_peered":"2024-09-17T05:36:53.590716+0000","last_clean":"2024-09-17T05:36:53.590716+0000","last_became_active":"2024-09-17T05:36:52.263954+0000","last_became_peered":"2024-09-17T05:36:52.263954+0000","last_unstale":"2024-09-17T05:36:53.590716+0000","last_undegraded":"2024-09-17T05:36:53.590716+0000","last_fullsized":"2024-09-17T05:36:53.590716+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:39.093029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590552+0000","last_change":"2024-09-17T05:36:52.257391+0000","last_active":"2024-09-17T05:36:53.590552+0000","last_peered":"2024-09-17T05:36:53.590552+0000","last_clean":"2024-09-17T05:36:53.590552+0000","last_became_active":"2024-09-17T05:36:52.256818+0000","last_became_peered":"2024-09-17T05:36:52.256818+0000","last_unstale":"2024-09-17T05:36:53.590552+0000","last_undegraded":"2024-09-17T05:36:53.590552+0000","last_fullsized":"2024-09-17T05:36:53.590552+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:32.544851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.251526+0000","last_change":"2024-09-17T05:36:52.247837+0000","last_active":"2024-09-17T05:36:53.251526+0000","last_peered":"2024-09-17T05:36:53.251526+0000","last_clean":"2024-09-17T05:36:53.251526+0000","last_became_active":"2024-09-17T05:36:52.247389+0000","last_became_peered":"2024-09-17T05:36:52.247389+0000","last_unstale":"2024-09-17T05:36:53.251526+0000","last_undegraded":"2024-09-17T05:36:53.251526+0000","last_fullsized":"2024-09-17T05:36:53.251526+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:16.544509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590350+0000","last_change":"2024-09-17T05:36:52.254354+0000","last_active":"2024-09-17T05:36:53.590350+0000","last_peered":"2024-09-17T05:36:53.590350+0000","last_clean":"2024-09-17T05:36:53.590350+0000","last_became_active":"2024-09-17T05:36:52.253736+0000","last_became_peered":"2024-09-17T05:36:52.253736+0000","last_unstale":"2024-09-17T05:36:53.590350+0000","last_undegraded":"2024-09-17T05:36:53.590350+0000","last_fullsized":"2024-09-17T05:36:53.590350+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:23.059204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.255084+0000","last_change":"2024-09-17T05:36:52.262844+0000","last_active":"2024-09-17T05:36:53.255084+0000","last_peered":"2024-09-17T05:36:53.255084+0000","last_clean":"2024-09-17T05:36:53.255084+0000","last_became_active":"2024-09-17T05:36:52.262549+0000","last_became_peered":"2024-09-17T05:36:52.262549+0000","last_unstale":"2024-09-17T05:36:53.255084+0000","last_undegraded":"2024-09-17T05:36:53.255084+0000","last_fullsized":"2024-09-17T05:36:53.255084+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:01.319149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.592099+0000","last_change":"2024-09-17T05:36:52.249717+0000","last_active":"2024-09-17T05:36:53.592099+0000","last_peered":"2024-09-17T05:36:53.592099+0000","last_clean":"2024-09-17T05:36:53.592099+0000","last_became_active":"2024-09-17T05:36:52.249435+0000","last_became_peered":"2024-09-17T05:36:52.249435+0000","last_unstale":"2024-09-17T05:36:53.592099+0000","last_undegraded":"2024-09-17T05:36:53.592099+0000","last_fullsized":"2024-09-17T05:36:53.592099+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:12.023414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591276+0000","last_change":"2024-09-17T05:36:52.264462+0000","last_active":"2024-09-17T05:36:53.591276+0000","last_peered":"2024-09-17T05:36:53.591276+0000","last_clean":"2024-09-17T05:36:53.591276+0000","last_became_active":"2024-09-17T05:36:52.263813+0000","last_became_peered":"2024-09-17T05:36:52.263813+0000","last_unstale":"2024-09-17T05:36:53.591276+0000","last_undegraded":"2024-09-17T05:36:53.591276+0000","last_fullsized":"2024-09-17T05:36:53.591276+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:27.096526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.593695+0000","last_change":"2024-09-17T05:36:52.263864+0000","last_active":"2024-09-17T05:36:53.593695+0000","last_peered":"2024-09-17T05:36:53.593695+0000","last_clean":"2024-09-17T05:36:53.593695+0000","last_became_active":"2024-09-17T05:36:52.263565+0000","last_became_peered":"2024-09-17T05:36:52.263565+0000","last_unstale":"2024-09-17T05:36:53.593695+0000","last_undegraded":"2024-09-17T05:36:53.593695+0000","last_fullsized":"2024-09-17T05:36:53.593695+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:13.878255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.593884+0000","last_change":"2024-09-17T05:36:52.261301+0000","last_active":"2024-09-17T05:36:53.593884+0000","last_peered":"2024-09-17T05:36:53.593884+0000","last_clean":"2024-09-17T05:36:53.593884+0000","last_became_active":"2024-09-17T05:36:52.260847+0000","last_became_peered":"2024-09-17T05:36:52.260847+0000","last_unstale":"2024-09-17T05:36:53.593884+0000","last_undegraded":"2024-09-17T05:36:53.593884+0000","last_fullsized":"2024-09-17T05:36:53.593884+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:41.294320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.251711+0000","last_change":"2024-09-17T05:36:52.253326+0000","last_active":"2024-09-17T05:36:53.251711+0000","last_peered":"2024-09-17T05:36:53.251711+0000","last_clean":"2024-09-17T05:36:53.251711+0000","last_became_active":"2024-09-17T05:36:52.253005+0000","last_became_peered":"2024-09-17T05:36:52.253005+0000","last_unstale":"2024-09-17T05:36:53.251711+0000","last_undegraded":"2024-09-17T05:36:53.251711+0000","last_fullsized":"2024-09-17T05:36:53.251711+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:23.507715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.251604+0000","last_change":"2024-09-17T05:36:52.241875+0000","last_active":"2024-09-17T05:36:53.251604+0000","last_peered":"2024-09-17T05:36:53.251604+0000","last_clean":"2024-09-17T05:36:53.251604+0000","last_became_active":"2024-09-17T05:36:52.241584+0000","last_became_peered":"2024-09-17T05:36:52.241584+0000","last_unstale":"2024-09-17T05:36:53.251604+0000","last_undegraded":"2024-09-17T05:36:53.251604+0000","last_fullsized":"2024-09-17T05:36:53.251604+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:10:56.646934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591687+0000","last_change":"2024-09-17T05:36:52.254863+0000","last_active":"2024-09-17T05:36:53.591687+0000","last_peered":"2024-09-17T05:36:53.591687+0000","last_clean":"2024-09-17T05:36:53.591687+0000","last_became_active":"2024-09-17T05:36:52.254574+0000","last_became_peered":"2024-09-17T05:36:52.254574+0000","last_unstale":"2024-09-17T05:36:53.591687+0000","last_undegraded":"2024-09-17T05:36:53.591687+0000","last_fullsized":"2024-09-17T05:36:53.591687+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:57.861386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.252316+0000","last_change":"2024-09-17T05:36:52.257730+0000","last_active":"2024-09-17T05:36:53.252316+0000","last_peered":"2024-09-17T05:36:53.252316+0000","last_clean":"2024-09-17T05:36:53.252316+0000","last_became_active":"2024-09-17T05:36:52.257233+0000","last_became_peered":"2024-09-17T05:36:52.257233+0000","last_unstale":"2024-09-17T05:36:53.252316+0000","last_undegraded":"2024-09-17T05:36:53.252316+0000","last_fullsized":"2024-09-17T05:36:53.252316+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:06.711663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.592104+0000","last_change":"2024-09-17T05:36:52.256923+0000","last_active":"2024-09-17T05:36:53.592104+0000","last_peered":"2024-09-17T05:36:53.592104+0000","last_clean":"2024-09-17T05:36:53.592104+0000","last_became_active":"2024-09-17T05:36:52.256606+0000","last_became_peered":"2024-09-17T05:36:52.256606+0000","last_unstale":"2024-09-17T05:36:53.592104+0000","last_undegraded":"2024-09-17T05:36:53.592104+0000","last_fullsized":"2024-09-17T05:36:53.592104+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:07.595563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.592128+0000","last_change":"2024-09-17T05:36:52.246327+0000","last_active":"2024-09-17T05:36:53.592128+0000","last_peered":"2024-09-17T05:36:53.592128+0000","last_clean":"2024-09-17T05:36:53.592128+0000","last_became_active":"2024-09-17T05:36:52.244270+0000","last_became_peered":"2024-09-17T05:36:52.244270+0000","last_unstale":"2024-09-17T05:36:53.592128+0000","last_undegraded":"2024-09-17T05:36:53.592128+0000","last_fullsized":"2024-09-17T05:36:53.592128+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:44.465533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590773+0000","last_change":"2024-09-17T05:36:52.266364+0000","last_active":"2024-09-17T05:36:53.590773+0000","last_peered":"2024-09-17T05:36:53.590773+0000","last_clean":"2024-09-17T05:36:53.590773+0000","last_became_active":"2024-09-17T05:36:52.265832+0000","last_became_peered":"2024-09-17T05:36:52.265832+0000","last_unstale":"2024-09-17T05:36:53.590773+0000","last_undegraded":"2024-09-17T05:36:53.590773+0000","last_fullsized":"2024-09-17T05:36:53.590773+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:11.115663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594395+0000","last_change":"2024-09-17T05:36:52.267172+0000","last_active":"2024-09-17T05:36:53.594395+0000","last_peered":"2024-09-17T05:36:53.594395+0000","last_clean":"2024-09-17T05:36:53.594395+0000","last_became_active":"2024-09-17T05:36:52.266916+0000","last_became_peered":"2024-09-17T05:36:52.266916+0000","last_unstale":"2024-09-17T05:36:53.594395+0000","last_undegraded":"2024-09-17T05:36:53.594395+0000","last_fullsized":"2024-09-17T05:36:53.594395+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:55.759619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.255128+0000","last_change":"2024-09-17T05:36:52.242913+0000","last_active":"2024-09-17T05:36:53.255128+0000","last_peered":"2024-09-17T05:36:53.255128+0000","last_clean":"2024-09-17T05:36:53.255128+0000","last_became_active":"2024-09-17T05:36:52.242550+0000","last_became_peered":"2024-09-17T05:36:52.242550+0000","last_unstale":"2024-09-17T05:36:53.255128+0000","last_undegraded":"2024-09-17T05:36:53.255128+0000","last_fullsized":"2024-09-17T05:36:53.255128+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:26.486750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.253932+0000","last_change":"2024-09-17T05:36:52.253074+0000","last_active":"2024-09-17T05:36:53.253932+0000","last_peered":"2024-09-17T05:36:53.253932+0000","last_clean":"2024-09-17T05:36:53.253932+0000","last_became_active":"2024-09-17T05:36:52.252787+0000","last_became_peered":"2024-09-17T05:36:52.252787+0000","last_unstale":"2024-09-17T05:36:53.253932+0000","last_undegraded":"2024-09-17T05:36:53.253932+0000","last_fullsized":"2024-09-17T05:36:53.253932+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:11.115663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.593956+0000","last_change":"2024-09-17T05:36:52.267492+0000","last_active":"2024-09-17T05:36:53.593956+0000","last_peered":"2024-09-17T05:36:53.593956+0000","last_clean":"2024-09-17T05:36:53.593956+0000","last_became_active":"2024-09-17T05:36:52.267224+0000","last_became_peered":"2024-09-17T05:36:52.267224+0000","last_unstale":"2024-09-17T05:36:53.593956+0000","last_undegraded":"2024-09-17T05:36:53.593956+0000","last_fullsized":"2024-09-17T05:36:53.593956+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:43.546042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254770+0000","last_change":"2024-09-17T05:36:52.258953+0000","last_active":"2024-09-17T05:36:53.254770+0000","last_peered":"2024-09-17T05:36:53.254770+0000","last_clean":"2024-09-17T05:36:53.254770+0000","last_became_active":"2024-09-17T05:36:52.258524+0000","last_became_peered":"2024-09-17T05:36:52.258524+0000","last_unstale":"2024-09-17T05:36:53.254770+0000","last_undegraded":"2024-09-17T05:36:53.254770+0000","last_fullsized":"2024-09-17T05:36:53.254770+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:25.435574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.252303+0000","last_change":"2024-09-17T05:36:52.246488+0000","last_active":"2024-09-17T05:36:53.252303+0000","last_peered":"2024-09-17T05:36:53.252303+0000","last_clean":"2024-09-17T05:36:53.252303+0000","last_became_active":"2024-09-17T05:36:52.246214+0000","last_became_peered":"2024-09-17T05:36:52.246214+0000","last_unstale":"2024-09-17T05:36:53.252303+0000","last_undegraded":"2024-09-17T05:36:53.252303+0000","last_fullsized":"2024-09-17T05:36:53.252303+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:26.450181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594019+0000","last_change":"2024-09-17T05:36:52.265210+0000","last_active":"2024-09-17T05:36:53.594019+0000","last_peered":"2024-09-17T05:36:53.594019+0000","last_clean":"2024-09-17T05:36:53.594019+0000","last_became_active":"2024-09-17T05:36:52.264639+0000","last_became_peered":"2024-09-17T05:36:52.264639+0000","last_unstale":"2024-09-17T05:36:53.594019+0000","last_undegraded":"2024-09-17T05:36:53.594019+0000","last_fullsized":"2024-09-17T05:36:53.594019+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:38.957939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591011+0000","last_change":"2024-09-17T05:36:52.259821+0000","last_active":"2024-09-17T05:36:53.591011+0000","last_peered":"2024-09-17T05:36:53.591011+0000","last_clean":"2024-09-17T05:36:53.591011+0000","last_became_active":"2024-09-17T05:36:52.259488+0000","last_became_peered":"2024-09-17T05:36:52.259488+0000","last_unstale":"2024-09-17T05:36:53.591011+0000","last_undegraded":"2024-09-17T05:36:53.591011+0000","last_fullsized":"2024-09-17T05:36:53.591011+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:28:16.649167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.593724+0000","last_change":"2024-09-17T05:36:52.262067+0000","last_active":"2024-09-17T05:36:53.593724+0000","last_peered":"2024-09-17T05:36:53.593724+0000","last_clean":"2024-09-17T05:36:53.593724+0000","last_became_active":"2024-09-17T05:36:52.261772+0000","last_became_peered":"2024-09-17T05:36:52.261772+0000","last_unstale":"2024-09-17T05:36:53.593724+0000","last_undegraded":"2024-09-17T05:36:53.593724+0000","last_fullsized":"2024-09-17T05:36:53.593724+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:58.193971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.253937+0000","last_change":"2024-09-17T05:36:52.257989+0000","last_active":"2024-09-17T05:36:53.253937+0000","last_peered":"2024-09-17T05:36:53.253937+0000","last_clean":"2024-09-17T05:36:53.253937+0000","last_became_active":"2024-09-17T05:36:52.257707+0000","last_became_peered":"2024-09-17T05:36:52.257707+0000","last_unstale":"2024-09-17T05:36:53.253937+0000","last_undegraded":"2024-09-17T05:36:53.253937+0000","last_fullsized":"2024-09-17T05:36:53.253937+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:36.264757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591414+0000","last_change":"2024-09-17T05:36:52.257926+0000","last_active":"2024-09-17T05:36:53.591414+0000","last_peered":"2024-09-17T05:36:53.591414+0000","last_clean":"2024-09-17T05:36:53.591414+0000","last_became_active":"2024-09-17T05:36:52.257631+0000","last_became_peered":"2024-09-17T05:36:52.257631+0000","last_unstale":"2024-09-17T05:36:53.591414+0000","last_undegraded":"2024-09-17T05:36:53.591414+0000","last_fullsized":"2024-09-17T05:36:53.591414+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:03.753180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.251530+0000","last_change":"2024-09-17T05:36:52.247477+0000","last_active":"2024-09-17T05:36:53.251530+0000","last_peered":"2024-09-17T05:36:53.251530+0000","last_clean":"2024-09-17T05:36:53.251530+0000","last_became_active":"2024-09-17T05:36:52.247197+0000","last_became_peered":"2024-09-17T05:36:52.247197+0000","last_unstale":"2024-09-17T05:36:53.251530+0000","last_undegraded":"2024-09-17T05:36:53.251530+0000","last_fullsized":"2024-09-17T05:36:53.251530+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:19.919329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254607+0000","last_change":"2024-09-17T05:36:52.264095+0000","last_active":"2024-09-17T05:36:53.254607+0000","last_peered":"2024-09-17T05:36:53.254607+0000","last_clean":"2024-09-17T05:36:53.254607+0000","last_became_active":"2024-09-17T05:36:52.259998+0000","last_became_peered":"2024-09-17T05:36:52.259998+0000","last_unstale":"2024-09-17T05:36:53.254607+0000","last_undegraded":"2024-09-17T05:36:53.254607+0000","last_fullsized":"2024-09-17T05:36:53.254607+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:30.748706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"162'4","reported_seq":19,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594142+0000","last_change":"2024-09-17T05:36:51.245269+0000","last_active":"2024-09-17T05:36:53.594142+0000","last_peered":"2024-09-17T05:36:53.594142+0000","last_clean":"2024-09-17T05:36:53.594142+0000","last_became_active":"2024-09-17T05:36:51.244960+0000","last_became_peered":"2024-09-17T05:36:51.244960+0000","last_unstale":"2024-09-17T05:36:53.594142+0000","last_undegraded":"2024-09-17T05:36:53.594142+0000","last_fullsized":"2024-09-17T05:36:53.594142+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:35.354508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.255582+0000","last_change":"2024-09-17T05:36:52.257601+0000","last_active":"2024-09-17T05:36:53.255582+0000","last_peered":"2024-09-17T05:36:53.255582+0000","last_clean":"2024-09-17T05:36:53.255582+0000","last_became_active":"2024-09-17T05:36:52.257308+0000","last_became_peered":"2024-09-17T05:36:52.257308+0000","last_unstale":"2024-09-17T05:36:53.255582+0000","last_undegraded":"2024-09-17T05:36:53.255582+0000","last_fullsized":"2024-09-17T05:36:53.255582+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:07:56.451733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"162'1","reported_seq":16,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254964+0000","last_change":"2024-09-17T05:36:51.241214+0000","last_active":"2024-09-17T05:36:53.254964+0000","last_peered":"2024-09-17T05:36:53.254964+0000","last_clean":"2024-09-17T05:36:53.254964+0000","last_became_active":"2024-09-17T05:36:51.240935+0000","last_became_peered":"2024-09-17T05:36:51.240935+0000","last_unstale":"2024-09-17T05:36:53.254964+0000","last_undegraded":"2024-09-17T05:36:53.254964+0000","last_fullsized":"2024-09-17T05:36:53.254964+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:18.694850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.252137+0000","last_change":"2024-09-17T05:36:52.242813+0000","last_active":"2024-09-17T05:36:53.252137+0000","last_peered":"2024-09-17T05:36:53.252137+0000","last_clean":"2024-09-17T05:36:53.252137+0000","last_became_active":"2024-09-17T05:36:52.242578+0000","last_became_peered":"2024-09-17T05:36:52.242578+0000","last_unstale":"2024-09-17T05:36:53.252137+0000","last_undegraded":"2024-09-17T05:36:53.252137+0000","last_fullsized":"2024-09-17T05:36:53.252137+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:19.680293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"162'2","reported_seq":17,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591230+0000","last_change":"2024-09-17T05:36:51.248163+0000","last_active":"2024-09-17T05:36:53.591230+0000","last_peered":"2024-09-17T05:36:53.591230+0000","last_clean":"2024-09-17T05:36:53.591230+0000","last_became_active":"2024-09-17T05:36:51.247800+0000","last_became_peered":"2024-09-17T05:36:51.247800+0000","last_unstale":"2024-09-17T05:36:53.591230+0000","last_undegraded":"2024-09-17T05:36:53.591230+0000","last_fullsized":"2024-09-17T05:36:53.591230+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:17.024689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591975+0000","last_change":"2024-09-17T05:36:52.257075+0000","last_active":"2024-09-17T05:36:53.591975+0000","last_peered":"2024-09-17T05:36:53.591975+0000","last_clean":"2024-09-17T05:36:53.591975+0000","last_became_active":"2024-09-17T05:36:52.256789+0000","last_became_peered":"2024-09-17T05:36:52.256789+0000","last_unstale":"2024-09-17T05:36:53.591975+0000","last_undegraded":"2024-09-17T05:36:53.591975+0000","last_fullsized":"2024-09-17T05:36:53.591975+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:55.759619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"162'2","reported_seq":17,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594891+0000","last_change":"2024-09-17T05:36:51.249215+0000","last_active":"2024-09-17T05:36:53.594891+0000","last_peered":"2024-09-17T05:36:53.594891+0000","last_clean":"2024-09-17T05:36:53.594891+0000","last_became_active":"2024-09-17T05:36:51.248940+0000","last_became_peered":"2024-09-17T05:36:51.248940+0000","last_unstale":"2024-09-17T05:36:53.594891+0000","last_undegraded":"2024-09-17T05:36:53.594891+0000","last_fullsized":"2024-09-17T05:36:53.594891+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:32:18.332593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594606+0000","last_change":"2024-09-17T05:36:52.264195+0000","last_active":"2024-09-17T05:36:53.594606+0000","last_peered":"2024-09-17T05:36:53.594606+0000","last_clean":"2024-09-17T05:36:53.594606+0000","last_became_active":"2024-09-17T05:36:52.263953+0000","last_became_peered":"2024-09-17T05:36:52.263953+0000","last_unstale":"2024-09-17T05:36:53.594606+0000","last_undegraded":"2024-09-17T05:36:53.594606+0000","last_fullsized":"2024-09-17T05:36:53.594606+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:23.332934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"162'1","reported_seq":16,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590696+0000","last_change":"2024-09-17T05:36:51.244540+0000","last_active":"2024-09-17T05:36:53.590696+0000","last_peered":"2024-09-17T05:36:53.590696+0000","last_clean":"2024-09-17T05:36:53.590696+0000","last_became_active":"2024-09-17T05:36:51.244218+0000","last_became_peered":"2024-09-17T05:36:51.244218+0000","last_unstale":"2024-09-17T05:36:53.590696+0000","last_undegraded":"2024-09-17T05:36:53.590696+0000","last_fullsized":"2024-09-17T05:36:53.590696+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:00.792504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590198+0000","last_change":"2024-09-17T05:36:52.263055+0000","last_active":"2024-09-17T05:36:53.590198+0000","last_peered":"2024-09-17T05:36:53.590198+0000","last_clean":"2024-09-17T05:36:53.590198+0000","last_became_active":"2024-09-17T05:36:52.262779+0000","last_became_peered":"2024-09-17T05:36:52.262779+0000","last_unstale":"2024-09-17T05:36:53.590198+0000","last_undegraded":"2024-09-17T05:36:53.590198+0000","last_fullsized":"2024-09-17T05:36:53.590198+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:35.648629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590260+0000","last_change":"2024-09-17T05:36:51.249062+0000","last_active":"2024-09-17T05:36:53.590260+0000","last_peered":"2024-09-17T05:36:53.590260+0000","last_clean":"2024-09-17T05:36:53.590260+0000","last_became_active":"2024-09-17T05:36:51.247784+0000","last_became_peered":"2024-09-17T05:36:51.247784+0000","last_unstale":"2024-09-17T05:36:53.590260+0000","last_undegraded":"2024-09-17T05:36:53.590260+0000","last_fullsized":"2024-09-17T05:36:53.590260+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:15:32.553107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.593944+0000","last_change":"2024-09-17T05:36:52.264062+0000","last_active":"2024-09-17T05:36:53.593944+0000","last_peered":"2024-09-17T05:36:53.593944+0000","last_clean":"2024-09-17T05:36:53.593944+0000","last_became_active":"2024-09-17T05:36:52.263641+0000","last_became_peered":"2024-09-17T05:36:52.263641+0000","last_unstale":"2024-09-17T05:36:53.593944+0000","last_undegraded":"2024-09-17T05:36:53.593944+0000","last_fullsized":"2024-09-17T05:36:53.593944+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:57.861386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254174+0000","last_change":"2024-09-17T05:36:51.254842+0000","last_active":"2024-09-17T05:36:53.254174+0000","last_peered":"2024-09-17T05:36:53.254174+0000","last_clean":"2024-09-17T05:36:53.254174+0000","last_became_active":"2024-09-17T05:36:51.254467+0000","last_became_peered":"2024-09-17T05:36:51.254467+0000","last_unstale":"2024-09-17T05:36:53.254174+0000","last_undegraded":"2024-09-17T05:36:53.254174+0000","last_fullsized":"2024-09-17T05:36:53.254174+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:01.752259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594794+0000","last_change":"2024-09-17T05:36:52.267171+0000","last_active":"2024-09-17T05:36:53.594794+0000","last_peered":"2024-09-17T05:36:53.594794+0000","last_clean":"2024-09-17T05:36:53.594794+0000","last_became_active":"2024-09-17T05:36:52.266008+0000","last_became_peered":"2024-09-17T05:36:52.266008+0000","last_unstale":"2024-09-17T05:36:53.594794+0000","last_undegraded":"2024-09-17T05:36:53.594794+0000","last_fullsized":"2024-09-17T05:36:53.594794+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:44.465533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590244+0000","last_change":"2024-09-17T05:36:51.245654+0000","last_active":"2024-09-17T05:36:53.590244+0000","last_peered":"2024-09-17T05:36:53.590244+0000","last_clean":"2024-09-17T05:36:53.590244+0000","last_became_active":"2024-09-17T05:36:51.245308+0000","last_became_peered":"2024-09-17T05:36:51.245308+0000","last_unstale":"2024-09-17T05:36:53.590244+0000","last_undegraded":"2024-09-17T05:36:53.590244+0000","last_fullsized":"2024-09-17T05:36:53.590244+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:51.852302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591158+0000","last_change":"2024-09-17T05:36:52.262228+0000","last_active":"2024-09-17T05:36:53.591158+0000","last_peered":"2024-09-17T05:36:53.591158+0000","last_clean":"2024-09-17T05:36:53.591158+0000","last_became_active":"2024-09-17T05:36:52.261952+0000","last_became_peered":"2024-09-17T05:36:52.261952+0000","last_unstale":"2024-09-17T05:36:53.591158+0000","last_undegraded":"2024-09-17T05:36:53.591158+0000","last_fullsized":"2024-09-17T05:36:53.591158+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:05.342031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.255471+0000","last_change":"2024-09-17T05:36:51.243498+0000","last_active":"2024-09-17T05:36:53.255471+0000","last_peered":"2024-09-17T05:36:53.255471+0000","last_clean":"2024-09-17T05:36:53.255471+0000","last_became_active":"2024-09-17T05:36:51.243159+0000","last_became_peered":"2024-09-17T05:36:51.243159+0000","last_unstale":"2024-09-17T05:36:53.255471+0000","last_undegraded":"2024-09-17T05:36:53.255471+0000","last_fullsized":"2024-09-17T05:36:53.255471+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:40.291152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594567+0000","last_change":"2024-09-17T05:36:52.266358+0000","last_active":"2024-09-17T05:36:53.594567+0000","last_peered":"2024-09-17T05:36:53.594567+0000","last_clean":"2024-09-17T05:36:53.594567+0000","last_became_active":"2024-09-17T05:36:52.265807+0000","last_became_peered":"2024-09-17T05:36:52.265807+0000","last_unstale":"2024-09-17T05:36:53.594567+0000","last_undegraded":"2024-09-17T05:36:53.594567+0000","last_fullsized":"2024-09-17T05:36:53.594567+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:01.172059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"162'3","reported_seq":18,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.592152+0000","last_change":"2024-09-17T05:36:51.249130+0000","last_active":"2024-09-17T05:36:53.592152+0000","last_peered":"2024-09-17T05:36:53.592152+0000","last_clean":"2024-09-17T05:36:53.592152+0000","last_became_active":"2024-09-17T05:36:51.248811+0000","last_became_peered":"2024-09-17T05:36:51.248811+0000","last_unstale":"2024-09-17T05:36:53.592152+0000","last_undegraded":"2024-09-17T05:36:53.592152+0000","last_fullsized":"2024-09-17T05:36:53.592152+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:46.140984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.252334+0000","last_change":"2024-09-17T05:36:52.250390+0000","last_active":"2024-09-17T05:36:53.252334+0000","last_peered":"2024-09-17T05:36:53.252334+0000","last_clean":"2024-09-17T05:36:53.252334+0000","last_became_active":"2024-09-17T05:36:52.250134+0000","last_became_peered":"2024-09-17T05:36:52.250134+0000","last_unstale":"2024-09-17T05:36:53.252334+0000","last_undegraded":"2024-09-17T05:36:53.252334+0000","last_fullsized":"2024-09-17T05:36:53.252334+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:48.890563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"162'6","reported_seq":21,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594755+0000","last_change":"2024-09-17T05:36:51.247573+0000","last_active":"2024-09-17T05:36:53.594755+0000","last_peered":"2024-09-17T05:36:53.594755+0000","last_clean":"2024-09-17T05:36:53.594755+0000","last_became_active":"2024-09-17T05:36:51.247225+0000","last_became_peered":"2024-09-17T05:36:51.247225+0000","last_unstale":"2024-09-17T05:36:53.594755+0000","last_undegraded":"2024-09-17T05:36:53.594755+0000","last_fullsized":"2024-09-17T05:36:53.594755+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:12.372923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590575+0000","last_change":"2024-09-17T05:36:52.259641+0000","last_active":"2024-09-17T05:36:53.590575+0000","last_peered":"2024-09-17T05:36:53.590575+0000","last_clean":"2024-09-17T05:36:53.590575+0000","last_became_active":"2024-09-17T05:36:52.259293+0000","last_became_peered":"2024-09-17T05:36:52.259293+0000","last_unstale":"2024-09-17T05:36:53.590575+0000","last_undegraded":"2024-09-17T05:36:53.590575+0000","last_fullsized":"2024-09-17T05:36:53.590575+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:11.194500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"162'2","reported_seq":17,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254340+0000","last_change":"2024-09-17T05:36:51.243141+0000","last_active":"2024-09-17T05:36:53.254340+0000","last_peered":"2024-09-17T05:36:53.254340+0000","last_clean":"2024-09-17T05:36:53.254340+0000","last_became_active":"2024-09-17T05:36:51.242762+0000","last_became_peered":"2024-09-17T05:36:51.242762+0000","last_unstale":"2024-09-17T05:36:53.254340+0000","last_undegraded":"2024-09-17T05:36:53.254340+0000","last_fullsized":"2024-09-17T05:36:53.254340+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:12.875087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591910+0000","last_change":"2024-09-17T05:36:52.244572+0000","last_active":"2024-09-17T05:36:53.591910+0000","last_peered":"2024-09-17T05:36:53.591910+0000","last_clean":"2024-09-17T05:36:53.591910+0000","last_became_active":"2024-09-17T05:36:52.244288+0000","last_became_peered":"2024-09-17T05:36:52.244288+0000","last_unstale":"2024-09-17T05:36:53.591910+0000","last_undegraded":"2024-09-17T05:36:53.591910+0000","last_fullsized":"2024-09-17T05:36:53.591910+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:43.546042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254301+0000","last_change":"2024-09-17T05:36:51.247213+0000","last_active":"2024-09-17T05:36:53.254301+0000","last_peered":"2024-09-17T05:36:53.254301+0000","last_clean":"2024-09-17T05:36:53.254301+0000","last_became_active":"2024-09-17T05:36:51.246941+0000","last_became_peered":"2024-09-17T05:36:51.246941+0000","last_unstale":"2024-09-17T05:36:53.254301+0000","last_undegraded":"2024-09-17T05:36:53.254301+0000","last_fullsized":"2024-09-17T05:36:53.254301+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:36:57.190804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590119+0000","last_change":"2024-09-17T05:36:52.263121+0000","last_active":"2024-09-17T05:36:53.590119+0000","last_peered":"2024-09-17T05:36:53.590119+0000","last_clean":"2024-09-17T05:36:53.590119+0000","last_became_active":"2024-09-17T05:36:52.262857+0000","last_became_peered":"2024-09-17T05:36:52.262857+0000","last_unstale":"2024-09-17T05:36:53.590119+0000","last_undegraded":"2024-09-17T05:36:53.590119+0000","last_fullsized":"2024-09-17T05:36:53.590119+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:12.439082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591384+0000","last_change":"2024-09-17T05:36:51.246082+0000","last_active":"2024-09-17T05:36:53.591384+0000","last_peered":"2024-09-17T05:36:53.591384+0000","last_clean":"2024-09-17T05:36:53.591384+0000","last_became_active":"2024-09-17T05:36:51.245701+0000","last_became_peered":"2024-09-17T05:36:51.245701+0000","last_unstale":"2024-09-17T05:36:53.591384+0000","last_undegraded":"2024-09-17T05:36:53.591384+0000","last_fullsized":"2024-09-17T05:36:53.591384+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:07:55.448565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.251756+0000","last_change":"2024-09-17T05:36:52.242080+0000","last_active":"2024-09-17T05:36:53.251756+0000","last_peered":"2024-09-17T05:36:53.251756+0000","last_clean":"2024-09-17T05:36:53.251756+0000","last_became_active":"2024-09-17T05:36:52.241786+0000","last_became_peered":"2024-09-17T05:36:52.241786+0000","last_unstale":"2024-09-17T05:36:53.251756+0000","last_undegraded":"2024-09-17T05:36:53.251756+0000","last_fullsized":"2024-09-17T05:36:53.251756+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:33.227064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"162'8","reported_seq":23,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590229+0000","last_change":"2024-09-17T05:36:51.244849+0000","last_active":"2024-09-17T05:36:53.590229+0000","last_peered":"2024-09-17T05:36:53.590229+0000","last_clean":"2024-09-17T05:36:53.590229+0000","last_became_active":"2024-09-17T05:36:51.244443+0000","last_became_peered":"2024-09-17T05:36:51.244443+0000","last_unstale":"2024-09-17T05:36:53.590229+0000","last_undegraded":"2024-09-17T05:36:53.590229+0000","last_fullsized":"2024-09-17T05:36:53.590229+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:55.441379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254826+0000","last_change":"2024-09-17T05:36:52.264298+0000","last_active":"2024-09-17T05:36:53.254826+0000","last_peered":"2024-09-17T05:36:53.254826+0000","last_clean":"2024-09-17T05:36:53.254826+0000","last_became_active":"2024-09-17T05:36:52.264015+0000","last_became_peered":"2024-09-17T05:36:52.264015+0000","last_unstale":"2024-09-17T05:36:53.254826+0000","last_undegraded":"2024-09-17T05:36:53.254826+0000","last_fullsized":"2024-09-17T05:36:53.254826+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:06:55.811088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"162'1","reported_seq":16,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590349+0000","last_change":"2024-09-17T05:36:51.253562+0000","last_active":"2024-09-17T05:36:53.590349+0000","last_peered":"2024-09-17T05:36:53.590349+0000","last_clean":"2024-09-17T05:36:53.590349+0000","last_became_active":"2024-09-17T05:36:51.252240+0000","last_became_peered":"2024-09-17T05:36:51.252240+0000","last_unstale":"2024-09-17T05:36:53.590349+0000","last_undegraded":"2024-09-17T05:36:53.590349+0000","last_fullsized":"2024-09-17T05:36:53.590349+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:30.659102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254891+0000","last_change":"2024-09-17T05:36:52.250106+0000","last_active":"2024-09-17T05:36:53.254891+0000","last_peered":"2024-09-17T05:36:53.254891+0000","last_clean":"2024-09-17T05:36:53.254891+0000","last_became_active":"2024-09-17T05:36:52.249837+0000","last_became_peered":"2024-09-17T05:36:52.249837+0000","last_unstale":"2024-09-17T05:36:53.254891+0000","last_undegraded":"2024-09-17T05:36:53.254891+0000","last_fullsized":"2024-09-17T05:36:53.254891+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:04.071461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"162'2","reported_seq":17,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.255070+0000","last_change":"2024-09-17T05:36:51.254302+0000","last_active":"2024-09-17T05:36:53.255070+0000","last_peered":"2024-09-17T05:36:53.255070+0000","last_clean":"2024-09-17T05:36:53.255070+0000","last_became_active":"2024-09-17T05:36:51.253998+0000","last_became_peered":"2024-09-17T05:36:51.253998+0000","last_unstale":"2024-09-17T05:36:53.255070+0000","last_undegraded":"2024-09-17T05:36:53.255070+0000","last_fullsized":"2024-09-17T05:36:53.255070+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:18.689113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591099+0000","last_change":"2024-09-17T05:36:52.254835+0000","last_active":"2024-09-17T05:36:53.591099+0000","last_peered":"2024-09-17T05:36:53.591099+0000","last_clean":"2024-09-17T05:36:53.591099+0000","last_became_active":"2024-09-17T05:36:52.254563+0000","last_became_peered":"2024-09-17T05:36:52.254563+0000","last_unstale":"2024-09-17T05:36:53.591099+0000","last_undegraded":"2024-09-17T05:36:53.591099+0000","last_fullsized":"2024-09-17T05:36:53.591099+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:48.900733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"162'1","reported_seq":16,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.592197+0000","last_change":"2024-09-17T05:36:51.248771+0000","last_active":"2024-09-17T05:36:53.592197+0000","last_peered":"2024-09-17T05:36:53.592197+0000","last_clean":"2024-09-17T05:36:53.592197+0000","last_became_active":"2024-09-17T05:36:51.248473+0000","last_became_peered":"2024-09-17T05:36:51.248473+0000","last_unstale":"2024-09-17T05:36:53.592197+0000","last_undegraded":"2024-09-17T05:36:53.592197+0000","last_fullsized":"2024-09-17T05:36:53.592197+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:55.624488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.592029+0000","last_change":"2024-09-17T05:36:52.260456+0000","last_active":"2024-09-17T05:36:53.592029+0000","last_peered":"2024-09-17T05:36:53.592029+0000","last_clean":"2024-09-17T05:36:53.592029+0000","last_became_active":"2024-09-17T05:36:52.260185+0000","last_became_peered":"2024-09-17T05:36:52.260185+0000","last_unstale":"2024-09-17T05:36:53.592029+0000","last_undegraded":"2024-09-17T05:36:53.592029+0000","last_fullsized":"2024-09-17T05:36:53.592029+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:37.567542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591122+0000","last_change":"2024-09-17T05:36:51.249275+0000","last_active":"2024-09-17T05:36:53.591122+0000","last_peered":"2024-09-17T05:36:53.591122+0000","last_clean":"2024-09-17T05:36:53.591122+0000","last_became_active":"2024-09-17T05:36:51.249021+0000","last_became_peered":"2024-09-17T05:36:51.249021+0000","last_unstale":"2024-09-17T05:36:53.591122+0000","last_undegraded":"2024-09-17T05:36:53.591122+0000","last_fullsized":"2024-09-17T05:36:53.591122+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:09.435033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591636+0000","last_change":"2024-09-17T05:36:52.253304+0000","last_active":"2024-09-17T05:36:53.591636+0000","last_peered":"2024-09-17T05:36:53.591636+0000","last_clean":"2024-09-17T05:36:53.591636+0000","last_became_active":"2024-09-17T05:36:52.253002+0000","last_became_peered":"2024-09-17T05:36:52.253002+0000","last_unstale":"2024-09-17T05:36:53.591636+0000","last_undegraded":"2024-09-17T05:36:53.591636+0000","last_fullsized":"2024-09-17T05:36:53.591636+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:07.773701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"162'2","reported_seq":17,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591877+0000","last_change":"2024-09-17T05:36:51.248810+0000","last_active":"2024-09-17T05:36:53.591877+0000","last_peered":"2024-09-17T05:36:53.591877+0000","last_clean":"2024-09-17T05:36:53.591877+0000","last_became_active":"2024-09-17T05:36:51.248521+0000","last_became_peered":"2024-09-17T05:36:51.248521+0000","last_unstale":"2024-09-17T05:36:53.591877+0000","last_undegraded":"2024-09-17T05:36:53.591877+0000","last_fullsized":"2024-09-17T05:36:53.591877+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:47:02.441107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590896+0000","last_change":"2024-09-17T05:36:52.261571+0000","last_active":"2024-09-17T05:36:53.590896+0000","last_peered":"2024-09-17T05:36:53.590896+0000","last_clean":"2024-09-17T05:36:53.590896+0000","last_became_active":"2024-09-17T05:36:52.260710+0000","last_became_peered":"2024-09-17T05:36:52.260710+0000","last_unstale":"2024-09-17T05:36:53.590896+0000","last_undegraded":"2024-09-17T05:36:53.590896+0000","last_fullsized":"2024-09-17T05:36:53.590896+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:45.880905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.251858+0000","last_change":"2024-09-17T05:36:51.232409+0000","last_active":"2024-09-17T05:36:53.251858+0000","last_peered":"2024-09-17T05:36:53.251858+0000","last_clean":"2024-09-17T05:36:53.251858+0000","last_became_active":"2024-09-17T05:36:51.232138+0000","last_became_peered":"2024-09-17T05:36:51.232138+0000","last_unstale":"2024-09-17T05:36:53.251858+0000","last_undegraded":"2024-09-17T05:36:53.251858+0000","last_fullsized":"2024-09-17T05:36:53.251858+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:10.637063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.253704+0000","last_change":"2024-09-17T05:36:52.251061+0000","last_active":"2024-09-17T05:36:53.253704+0000","last_peered":"2024-09-17T05:36:53.253704+0000","last_clean":"2024-09-17T05:36:53.253704+0000","last_became_active":"2024-09-17T05:36:52.250418+0000","last_became_peered":"2024-09-17T05:36:52.250418+0000","last_unstale":"2024-09-17T05:36:53.253704+0000","last_undegraded":"2024-09-17T05:36:53.253704+0000","last_fullsized":"2024-09-17T05:36:53.253704+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:33.498784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.251711+0000","last_change":"2024-09-17T05:36:51.239542+0000","last_active":"2024-09-17T05:36:53.251711+0000","last_peered":"2024-09-17T05:36:53.251711+0000","last_clean":"2024-09-17T05:36:53.251711+0000","last_became_active":"2024-09-17T05:36:51.239254+0000","last_became_peered":"2024-09-17T05:36:51.239254+0000","last_unstale":"2024-09-17T05:36:53.251711+0000","last_undegraded":"2024-09-17T05:36:53.251711+0000","last_fullsized":"2024-09-17T05:36:53.251711+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:58.601946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254901+0000","last_change":"2024-09-17T05:36:52.257726+0000","last_active":"2024-09-17T05:36:53.254901+0000","last_peered":"2024-09-17T05:36:53.254901+0000","last_clean":"2024-09-17T05:36:53.254901+0000","last_became_active":"2024-09-17T05:36:52.257453+0000","last_became_peered":"2024-09-17T05:36:52.257453+0000","last_unstale":"2024-09-17T05:36:53.254901+0000","last_undegraded":"2024-09-17T05:36:53.254901+0000","last_fullsized":"2024-09-17T05:36:53.254901+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:37.073844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590297+0000","last_change":"2024-09-17T05:36:51.253201+0000","last_active":"2024-09-17T05:36:53.590297+0000","last_peered":"2024-09-17T05:36:53.590297+0000","last_clean":"2024-09-17T05:36:53.590297+0000","last_became_active":"2024-09-17T05:36:51.252759+0000","last_became_peered":"2024-09-17T05:36:51.252759+0000","last_unstale":"2024-09-17T05:36:53.590297+0000","last_undegraded":"2024-09-17T05:36:53.590297+0000","last_fullsized":"2024-09-17T05:36:53.590297+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:08.513947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594043+0000","last_change":"2024-09-17T05:36:52.261398+0000","last_active":"2024-09-17T05:36:53.594043+0000","last_peered":"2024-09-17T05:36:53.594043+0000","last_clean":"2024-09-17T05:36:53.594043+0000","last_became_active":"2024-09-17T05:36:52.261067+0000","last_became_peered":"2024-09-17T05:36:52.261067+0000","last_unstale":"2024-09-17T05:36:53.594043+0000","last_undegraded":"2024-09-17T05:36:53.594043+0000","last_fullsized":"2024-09-17T05:36:53.594043+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:44.869501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"162'2","reported_seq":17,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591116+0000","last_change":"2024-09-17T05:36:51.248350+0000","last_active":"2024-09-17T05:36:53.591116+0000","last_peered":"2024-09-17T05:36:53.591116+0000","last_clean":"2024-09-17T05:36:53.591116+0000","last_became_active":"2024-09-17T05:36:51.248046+0000","last_became_peered":"2024-09-17T05:36:51.248046+0000","last_unstale":"2024-09-17T05:36:53.591116+0000","last_undegraded":"2024-09-17T05:36:53.591116+0000","last_fullsized":"2024-09-17T05:36:53.591116+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:14.264256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.252364+0000","last_change":"2024-09-17T05:36:52.255627+0000","last_active":"2024-09-17T05:36:53.252364+0000","last_peered":"2024-09-17T05:36:53.252364+0000","last_clean":"2024-09-17T05:36:53.252364+0000","last_became_active":"2024-09-17T05:36:52.254859+0000","last_became_peered":"2024-09-17T05:36:52.254859+0000","last_unstale":"2024-09-17T05:36:53.252364+0000","last_undegraded":"2024-09-17T05:36:53.252364+0000","last_fullsized":"2024-09-17T05:36:53.252364+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:50:45.096152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594846+0000","last_change":"2024-09-17T05:36:51.251775+0000","last_active":"2024-09-17T05:36:53.594846+0000","last_peered":"2024-09-17T05:36:53.594846+0000","last_clean":"2024-09-17T05:36:53.594846+0000","last_became_active":"2024-09-17T05:36:51.251412+0000","last_became_peered":"2024-09-17T05:36:51.251412+0000","last_unstale":"2024-09-17T05:36:53.594846+0000","last_undegraded":"2024-09-17T05:36:53.594846+0000","last_fullsized":"2024-09-17T05:36:53.594846+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:40.255706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.254354+0000","last_change":"2024-09-17T05:36:52.253459+0000","last_active":"2024-09-17T05:36:53.254354+0000","last_peered":"2024-09-17T05:36:53.254354+0000","last_clean":"2024-09-17T05:36:53.254354+0000","last_became_active":"2024-09-17T05:36:52.251581+0000","last_became_peered":"2024-09-17T05:36:52.251581+0000","last_unstale":"2024-09-17T05:36:53.254354+0000","last_undegraded":"2024-09-17T05:36:53.254354+0000","last_fullsized":"2024-09-17T05:36:53.254354+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:43.174971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590894+0000","last_change":"2024-09-17T05:36:51.251412+0000","last_active":"2024-09-17T05:36:53.590894+0000","last_peered":"2024-09-17T05:36:53.590894+0000","last_clean":"2024-09-17T05:36:53.590894+0000","last_became_active":"2024-09-17T05:36:51.251091+0000","last_became_peered":"2024-09-17T05:36:51.251091+0000","last_unstale":"2024-09-17T05:36:53.590894+0000","last_undegraded":"2024-09-17T05:36:53.590894+0000","last_fullsized":"2024-09-17T05:36:53.590894+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:19.637732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.255384+0000","last_change":"2024-09-17T05:36:52.252425+0000","last_active":"2024-09-17T05:36:53.255384+0000","last_peered":"2024-09-17T05:36:53.255384+0000","last_clean":"2024-09-17T05:36:53.255384+0000","last_became_active":"2024-09-17T05:36:52.252216+0000","last_became_peered":"2024-09-17T05:36:52.252216+0000","last_unstale":"2024-09-17T05:36:53.255384+0000","last_undegraded":"2024-09-17T05:36:53.255384+0000","last_fullsized":"2024-09-17T05:36:53.255384+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:32:46.619354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.591207+0000","last_change":"2024-09-17T05:36:51.247678+0000","last_active":"2024-09-17T05:36:53.591207+0000","last_peered":"2024-09-17T05:36:53.591207+0000","last_clean":"2024-09-17T05:36:53.591207+0000","last_became_active":"2024-09-17T05:36:51.246990+0000","last_became_peered":"2024-09-17T05:36:51.246990+0000","last_unstale":"2024-09-17T05:36:53.591207+0000","last_undegraded":"2024-09-17T05:36:53.591207+0000","last_fullsized":"2024-09-17T05:36:53.591207+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:29.496469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.251876+0000","last_change":"2024-09-17T05:36:52.240380+0000","last_active":"2024-09-17T05:36:53.251876+0000","last_peered":"2024-09-17T05:36:53.251876+0000","last_clean":"2024-09-17T05:36:53.251876+0000","last_became_active":"2024-09-17T05:36:52.239898+0000","last_became_peered":"2024-09-17T05:36:52.239898+0000","last_unstale":"2024-09-17T05:36:53.251876+0000","last_undegraded":"2024-09-17T05:36:53.251876+0000","last_fullsized":"2024-09-17T05:36:53.251876+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:10.323581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594564+0000","last_change":"2024-09-17T05:36:51.248144+0000","last_active":"2024-09-17T05:36:53.594564+0000","last_peered":"2024-09-17T05:36:53.594564+0000","last_clean":"2024-09-17T05:36:53.594564+0000","last_became_active":"2024-09-17T05:36:51.247884+0000","last_became_peered":"2024-09-17T05:36:51.247884+0000","last_unstale":"2024-09-17T05:36:53.594564+0000","last_undegraded":"2024-09-17T05:36:53.594564+0000","last_fullsized":"2024-09-17T05:36:53.594564+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:22.654147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.593626+0000","last_change":"2024-09-17T05:36:52.263967+0000","last_active":"2024-09-17T05:36:53.593626+0000","last_peered":"2024-09-17T05:36:53.593626+0000","last_clean":"2024-09-17T05:36:53.593626+0000","last_became_active":"2024-09-17T05:36:52.263606+0000","last_became_peered":"2024-09-17T05:36:52.263606+0000","last_unstale":"2024-09-17T05:36:53.593626+0000","last_undegraded":"2024-09-17T05:36:53.593626+0000","last_fullsized":"2024-09-17T05:36:53.593626+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:02.755427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590775+0000","last_change":"2024-09-17T05:36:51.252558+0000","last_active":"2024-09-17T05:36:53.590775+0000","last_peered":"2024-09-17T05:36:53.590775+0000","last_clean":"2024-09-17T05:36:53.590775+0000","last_became_active":"2024-09-17T05:36:51.252167+0000","last_became_peered":"2024-09-17T05:36:51.252167+0000","last_unstale":"2024-09-17T05:36:53.590775+0000","last_undegraded":"2024-09-17T05:36:53.590775+0000","last_fullsized":"2024-09-17T05:36:53.590775+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:33.040025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.590194+0000","last_change":"2024-09-17T05:36:52.262928+0000","last_active":"2024-09-17T05:36:53.590194+0000","last_peered":"2024-09-17T05:36:53.590194+0000","last_clean":"2024-09-17T05:36:53.590194+0000","last_became_active":"2024-09-17T05:36:52.262526+0000","last_became_peered":"2024-09-17T05:36:52.262526+0000","last_unstale":"2024-09-17T05:36:53.590194+0000","last_undegraded":"2024-09-17T05:36:53.590194+0000","last_fullsized":"2024-09-17T05:36:53.590194+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:12.826425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.255099+0000","last_change":"2024-09-17T05:36:51.241286+0000","last_active":"2024-09-17T05:36:53.255099+0000","last_peered":"2024-09-17T05:36:53.255099+0000","last_clean":"2024-09-17T05:36:53.255099+0000","last_became_active":"2024-09-17T05:36:51.241017+0000","last_became_peered":"2024-09-17T05:36:51.241017+0000","last_unstale":"2024-09-17T05:36:53.255099+0000","last_undegraded":"2024-09-17T05:36:53.255099+0000","last_fullsized":"2024-09-17T05:36:53.255099+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:20:46.722479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.253904+0000","last_change":"2024-09-17T05:36:52.257300+0000","last_active":"2024-09-17T05:36:53.253904+0000","last_peered":"2024-09-17T05:36:53.253904+0000","last_clean":"2024-09-17T05:36:53.253904+0000","last_became_active":"2024-09-17T05:36:52.257009+0000","last_became_peered":"2024-09-17T05:36:52.257009+0000","last_unstale":"2024-09-17T05:36:53.253904+0000","last_undegraded":"2024-09-17T05:36:53.253904+0000","last_fullsized":"2024-09-17T05:36:53.253904+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:28.333115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":15,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.593618+0000","last_change":"2024-09-17T05:36:51.243134+0000","last_active":"2024-09-17T05:36:53.593618+0000","last_peered":"2024-09-17T05:36:53.593618+0000","last_clean":"2024-09-17T05:36:53.593618+0000","last_became_active":"2024-09-17T05:36:51.242813+0000","last_became_peered":"2024-09-17T05:36:51.242813+0000","last_unstale":"2024-09-17T05:36:53.593618+0000","last_undegraded":"2024-09-17T05:36:53.593618+0000","last_fullsized":"2024-09-17T05:36:53.593618+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:35.358532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":13,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.251754+0000","last_change":"2024-09-17T05:36:52.248088+0000","last_active":"2024-09-17T05:36:53.251754+0000","last_peered":"2024-09-17T05:36:53.251754+0000","last_clean":"2024-09-17T05:36:53.251754+0000","last_became_active":"2024-09-17T05:36:52.247760+0000","last_became_peered":"2024-09-17T05:36:52.247760+0000","last_unstale":"2024-09-17T05:36:53.251754+0000","last_undegraded":"2024-09-17T05:36:53.251754+0000","last_fullsized":"2024-09-17T05:36:53.251754+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:51.215196+0000","last_clean_scrub_stamp":"2024-09-17T05:36:51.215196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:28:10.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"162'1","reported_seq":16,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.593873+0000","last_change":"2024-09-17T05:36:51.254189+0000","last_active":"2024-09-17T05:36:53.593873+0000","last_peered":"2024-09-17T05:36:53.593873+0000","last_clean":"2024-09-17T05:36:53.593873+0000","last_became_active":"2024-09-17T05:36:51.253873+0000","last_became_peered":"2024-09-17T05:36:51.253873+0000","last_unstale":"2024-09-17T05:36:53.593873+0000","last_undegraded":"2024-09-17T05:36:53.593873+0000","last_fullsized":"2024-09-17T05:36:53.593873+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:36:50.212028+0000","last_clean_scrub_stamp":"2024-09-17T05:36:50.212028+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:37.887398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"70'79","reported_seq":399,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:36:53.594021+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:36:53.594021+0000","last_peered":"2024-09-17T05:36:53.594021+0000","last_clean":"2024-09-17T05:36:53.594021+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:36:53.594021+0000","last_undegraded":"2024-09-17T05:36:53.594021+0000","last_fullsized":"2024-09-17T05:36:53.594021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509543,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33784,"kb_used_data":2596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338056,"statfs":{"total":96636764160,"available":96602169344,"internally_reserved":0,"allocated":2658304,"data_stored":1497630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2043904,"data_stored":899904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542247,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2056192,"data_stored":906232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509544,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33220,"kb_used_data":2024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338620,"statfs":{"total":96636764160,"available":96602746880,"internally_reserved":0,"allocated":2072576,"data_stored":907366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2052096,"data_stored":899504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509544,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33180,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338660,"statfs":{"total":96636764160,"available":96602787840,"internally_reserved":0,"allocated":2039808,"data_stored":899322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509542,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2048000,"data_stored":899378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542246,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37936,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333904,"statfs":{"total":96636764160,"available":96597917696,"internally_reserved":0,"allocated":2650112,"data_stored":1496108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:36:56.835 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:36:56.835 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:36:57.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2da5800640 1 -- 172.21.15.31:0/1174133633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da015dae0 msgr2=0x7f2da00acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2da5800640 1 --2- 172.21.15.31:0/1174133633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da015dae0 0x7f2da00acd40 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009840 tx=0x7f2d9001c790 comp rx=0 tx=0).stop 2024-09-17T05:36:57.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2da5800640 1 -- 172.21.15.31:0/1174133633 shutdown_connections 2024-09-17T05:36:57.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2da5800640 1 --2- 172.21.15.31:0/1174133633 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2da00cd100 0x7f2da00b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2da5800640 1 --2- 172.21.15.31:0/1174133633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da015dae0 0x7f2da00acd40 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2da5800640 1 -- 172.21.15.31:0/1174133633 >> 172.21.15.31:0/1174133633 conn(0x7f2da00b18f0 msgr2=0x7f2da00b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:57.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2da5800640 1 -- 172.21.15.31:0/1174133633 shutdown_connections 2024-09-17T05:36:57.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2da5800640 1 -- 172.21.15.31:0/1174133633 wait complete. 2024-09-17T05:36:57.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2da5800640 1 Processor -- start 2024-09-17T05:36:57.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2da5800640 1 -- start start 2024-09-17T05:36:57.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2da5800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da00b4810 0x7f2da00c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2da5800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2da00cd100 0x7f2da009d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2da5800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2da015dae0 0x7f2da01f8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2da5800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2da01674b0 con 0x7f2da00b4810 2024-09-17T05:36:57.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2da5800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2da0167330 con 0x7f2da015dae0 2024-09-17T05:36:57.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2da5800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2da0167630 con 0x7f2da00cd100 2024-09-17T05:36:57.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2d9ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da00b4810 0x7f2da00c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:57.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2d9ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da00b4810 0x7f2da00c4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33120/0 (socket says 172.21.15.31:33120) 2024-09-17T05:36:57.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2d9ea00640 1 -- 172.21.15.31:0/2759437660 learned_addr learned my addr 172.21.15.31:0/2759437660 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:57.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2d9ea00640 1 -- 172.21.15.31:0/2759437660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2da00cd100 msgr2=0x7f2da009d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.024+0000 7f2d9ea00640 1 --2- 172.21.15.31:0/2759437660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2da00cd100 0x7f2da009d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.028+0000 7f2d9ea00640 1 -- 172.21.15.31:0/2759437660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2da015dae0 msgr2=0x7f2da01f8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.028+0000 7f2d9ea00640 1 --2- 172.21.15.31:0/2759437660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2da015dae0 0x7f2da01f8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.028+0000 7f2d9ea00640 1 -- 172.21.15.31:0/2759437660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da00c50a0 con 0x7f2da00b4810 2024-09-17T05:36:57.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.028+0000 7f2d9ea00640 1 --2- 172.21.15.31:0/2759437660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da00b4810 0x7f2da00c4b60 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009790 tx=0x7f2d900a64e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:57.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.028+0000 7f2d96a00640 1 -- 172.21.15.31:0/2759437660 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d900ac030 con 0x7f2da00b4810 2024-09-17T05:36:57.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.028+0000 7f2d96a00640 1 -- 172.21.15.31:0/2759437660 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d900a6c70 con 0x7f2da00b4810 2024-09-17T05:36:57.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.028+0000 7f2d96a00640 1 -- 172.21.15.31:0/2759437660 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90003600 con 0x7f2da00b4810 2024-09-17T05:36:57.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.028+0000 7f2da5800640 1 -- 172.21.15.31:0/2759437660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2da009dca0 con 0x7f2da00b4810 2024-09-17T05:36:57.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.028+0000 7f2da5800640 1 -- 172.21.15.31:0/2759437660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2da01f96a0 con 0x7f2da00b4810 2024-09-17T05:36:57.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.028+0000 7f2da5800640 1 -- 172.21.15.31:0/2759437660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2da00b42d0 con 0x7f2da00b4810 2024-09-17T05:36:57.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.028+0000 7f2d96a00640 1 -- 172.21.15.31:0/2759437660 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f2d900af070 con 0x7f2da00b4810 2024-09-17T05:36:57.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.028+0000 7f2d96a00640 1 --2- 172.21.15.31:0/2759437660 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2d7c073c20 0x7f2d7c0760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.028+0000 7f2d96a00640 1 -- 172.21.15.31:0/2759437660 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f2d9012cd80 con 0x7f2da00b4810 2024-09-17T05:36:57.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.028+0000 7f2d97e00640 1 --2- 172.21.15.31:0/2759437660 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2d7c073c20 0x7f2d7c0760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:57.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.032+0000 7f2d97e00640 1 --2- 172.21.15.31:0/2759437660 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2d7c073c20 0x7f2d7c0760e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2da00add20 tx=0x7f2d8800a6b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:57.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.032+0000 7f2d96a00640 1 -- 172.21.15.31:0/2759437660 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f2d90016410 con 0x7f2da00b4810 2024-09-17T05:36:57.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.272+0000 7f2da5800640 1 -- 172.21.15.31:0/2759437660 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f2da00ada70 con 0x7f2da00b4810 2024-09-17T05:36:57.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.276+0000 7f2d96a00640 1 -- 172.21.15.31:0/2759437660 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v29) ==== 190+0+147 (secure 0 0 0) 0x7f2d900f9860 con 0x7f2da00b4810 2024-09-17T05:36:57.278 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-09-17T05:36:57.279 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBQE+lmFJLXGBAAYNOrKIN7pcdhDm2xY2aNFw== 2024-09-17T05:36:57.279 INFO:teuthology.orchestra.run.smithi031.stdout: caps mds = "allow" 2024-09-17T05:36:57.279 INFO:teuthology.orchestra.run.smithi031.stdout: caps mon = "allow r" 2024-09-17T05:36:57.279 INFO:teuthology.orchestra.run.smithi031.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:36:57.279 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2024-09-17T05:36:57.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.276+0000 7f2da5800640 1 -- 172.21.15.31:0/2759437660 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2d7c073c20 msgr2=0x7f2d7c0760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.276+0000 7f2da5800640 1 --2- 172.21.15.31:0/2759437660 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2d7c073c20 0x7f2d7c0760e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2da00add20 tx=0x7f2d8800a6b0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.276+0000 7f2da5800640 1 -- 172.21.15.31:0/2759437660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da00b4810 msgr2=0x7f2da00c4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.276+0000 7f2da5800640 1 --2- 172.21.15.31:0/2759437660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da00b4810 0x7f2da00c4b60 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f2d90009790 tx=0x7f2d900a64e0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.276+0000 7f2da5800640 1 -- 172.21.15.31:0/2759437660 shutdown_connections 2024-09-17T05:36:57.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.276+0000 7f2da5800640 1 --2- 172.21.15.31:0/2759437660 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f2d7c073c20 0x7f2d7c0760e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.276+0000 7f2da5800640 1 --2- 172.21.15.31:0/2759437660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2da015dae0 0x7f2da01f8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.276+0000 7f2da5800640 1 --2- 172.21.15.31:0/2759437660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2da00cd100 0x7f2da009d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.276+0000 7f2da5800640 1 --2- 172.21.15.31:0/2759437660 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2da00b4810 0x7f2da00c4b60 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.276+0000 7f2da5800640 1 -- 172.21.15.31:0/2759437660 >> 172.21.15.31:0/2759437660 conn(0x7f2da00b18f0 msgr2=0x7f2da006fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:57.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.280+0000 7f2da5800640 1 -- 172.21.15.31:0/2759437660 shutdown_connections 2024-09-17T05:36:57.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.280+0000 7f2da5800640 1 -- 172.21.15.31:0/2759437660 wait complete. 2024-09-17T05:36:57.300 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:36:57.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.444+0000 7f78cfc00640 1 -- 172.21.15.31:0/449340587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78c815bea0 msgr2=0x7f78c80ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.444+0000 7f78cfc00640 1 --2- 172.21.15.31:0/449340587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78c815bea0 0x7f78c80ce670 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f78c80cf310 tx=0x7f78bc01c8c0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.444+0000 7f78cfc00640 1 -- 172.21.15.31:0/449340587 shutdown_connections 2024-09-17T05:36:57.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.444+0000 7f78cfc00640 1 --2- 172.21.15.31:0/449340587 >> v2:172.21.15.155:3300/0 conn(0x7f78c80d28e0 0x7f78c80cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.444+0000 7f78cfc00640 1 --2- 172.21.15.31:0/449340587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c80cdb30 0x7f78c80cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.444+0000 7f78cfc00640 1 --2- 172.21.15.31:0/449340587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78c815bea0 0x7f78c80ce670 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.444+0000 7f78cfc00640 1 -- 172.21.15.31:0/449340587 >> 172.21.15.31:0/449340587 conn(0x7f78c80d1dc0 msgr2=0x7f78c80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:57.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.444+0000 7f78cfc00640 1 -- 172.21.15.31:0/449340587 shutdown_connections 2024-09-17T05:36:57.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.444+0000 7f78cfc00640 1 -- 172.21.15.31:0/449340587 wait complete. 2024-09-17T05:36:57.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.444+0000 7f78cfc00640 1 Processor -- start 2024-09-17T05:36:57.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.444+0000 7f78cfc00640 1 -- start start 2024-09-17T05:36:57.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cfc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78c80cdb30 0x7f78c8157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cfc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78c80d28e0 0x7f78c80b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cfc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c815bea0 0x7f78c80b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cfc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f78c80af070 con 0x7f78c80cdb30 2024-09-17T05:36:57.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cfc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f78c80aeef0 con 0x7f78c80d28e0 2024-09-17T05:36:57.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cfc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f78c80af1f0 con 0x7f78c815bea0 2024-09-17T05:36:57.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cd200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78c80cdb30 0x7f78c8157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:57.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cd200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78c80cdb30 0x7f78c8157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33138/0 (socket says 172.21.15.31:33138) 2024-09-17T05:36:57.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cd200640 1 -- 172.21.15.31:0/573761242 learned_addr learned my addr 172.21.15.31:0/573761242 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cdc00640 1 --2- 172.21.15.31:0/573761242 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c815bea0 0x7f78c80b6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78c7e00640 1 --2- 172.21.15.31:0/573761242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78c80d28e0 0x7f78c80b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cd200640 1 -- 172.21.15.31:0/573761242 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c815bea0 msgr2=0x7f78c80b6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cd200640 1 --2- 172.21.15.31:0/573761242 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c815bea0 0x7f78c80b6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cd200640 1 -- 172.21.15.31:0/573761242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78c80d28e0 msgr2=0x7f78c80b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cd200640 1 --2- 172.21.15.31:0/573761242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78c80d28e0 0x7f78c80b3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cd200640 1 -- 172.21.15.31:0/573761242 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78c8156d90 con 0x7f78c80cdb30 2024-09-17T05:36:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cd200640 1 --2- 172.21.15.31:0/573761242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78c80cdb30 0x7f78c8157b20 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f78bc01af70 tx=0x7f78bc0a57b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78c4c00640 1 -- 172.21.15.31:0/573761242 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc0bb070 con 0x7f78c80cdb30 2024-09-17T05:36:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78c4c00640 1 -- 172.21.15.31:0/573761242 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78bc004430 con 0x7f78c80cdb30 2024-09-17T05:36:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78c4c00640 1 -- 172.21.15.31:0/573761242 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc0b2040 con 0x7f78c80cdb30 2024-09-17T05:36:57.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cfc00640 1 -- 172.21.15.31:0/573761242 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78c813bd00 con 0x7f78c80cdb30 2024-09-17T05:36:57.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cfc00640 1 -- 172.21.15.31:0/573761242 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78c813c2c0 con 0x7f78c80cdb30 2024-09-17T05:36:57.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.448+0000 7f78cfc00640 1 -- 172.21.15.31:0/573761242 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78c80cc9d0 con 0x7f78c80cdb30 2024-09-17T05:36:57.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.452+0000 7f78c4c00640 1 -- 172.21.15.31:0/573761242 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f78bc0be070 con 0x7f78c80cdb30 2024-09-17T05:36:57.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.452+0000 7f78c4c00640 1 --2- 172.21.15.31:0/573761242 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f78a8073c20 0x7f78a80760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:57.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.452+0000 7f78c4c00640 1 -- 172.21.15.31:0/573761242 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f78bc12ca30 con 0x7f78c80cdb30 2024-09-17T05:36:57.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.452+0000 7f78c7e00640 1 --2- 172.21.15.31:0/573761242 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f78a8073c20 0x7f78a80760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:57.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.452+0000 7f78c7e00640 1 --2- 172.21.15.31:0/573761242 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f78a8073c20 0x7f78a80760e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f78c80b5d30 tx=0x7f78b400b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:57.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.456+0000 7f78c4c00640 1 -- 172.21.15.31:0/573761242 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f78bc0164b0 con 0x7f78c80cdb30 2024-09-17T05:36:57.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.668+0000 7f78cfc00640 1 -- 172.21.15.31:0/573761242 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78c8158ee0 con 0x7f78c80cdb30 2024-09-17T05:36:57.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.668+0000 7f78c4c00640 1 -- 172.21.15.31:0/573761242 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) ==== 95+0+5239 (secure 0 0 0) 0x7f78bc0f8cc0 con 0x7f78c80cdb30 2024-09-17T05:36:57.673 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:36:57.673 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":119,"btime":"2024-09-17T05:36:55:259648+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/2639830102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2639830102},{"type":"v1","addr":"172.21.15.155:6834","nonce":2639830102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":9111,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1970430367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1970430367},{"type":"v1","addr":"172.21.15.31:6834","nonce":1970430367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":9114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3317138111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3317138111},{"type":"v1","addr":"172.21.15.31:6835","nonce":3317138111}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:51.647070+0000","modified":"2024-09-17T05:36:54.664417+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9126},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9126":{"gid":9126,"name":"b","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/3913619779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":3913619779},{"type":"v1","addr":"172.21.15.155:6835","nonce":3913619779}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9126,"qdb_cluster":[9126]},"id":13}]} 2024-09-17T05:36:57.673 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 119 2024-09-17T05:36:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.672+0000 7f78cfc00640 1 -- 172.21.15.31:0/573761242 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f78a8073c20 msgr2=0x7f78a80760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.672+0000 7f78cfc00640 1 --2- 172.21.15.31:0/573761242 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f78a8073c20 0x7f78a80760e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f78c80b5d30 tx=0x7f78b400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.672+0000 7f78cfc00640 1 -- 172.21.15.31:0/573761242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78c80cdb30 msgr2=0x7f78c8157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.672+0000 7f78cfc00640 1 --2- 172.21.15.31:0/573761242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78c80cdb30 0x7f78c8157b20 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f78bc01af70 tx=0x7f78bc0a57b0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.672+0000 7f78cfc00640 1 -- 172.21.15.31:0/573761242 shutdown_connections 2024-09-17T05:36:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.672+0000 7f78cfc00640 1 --2- 172.21.15.31:0/573761242 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f78a8073c20 0x7f78a80760e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.672+0000 7f78cfc00640 1 --2- 172.21.15.31:0/573761242 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78c815bea0 0x7f78c80b6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.672+0000 7f78cfc00640 1 --2- 172.21.15.31:0/573761242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78c80d28e0 0x7f78c80b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.672+0000 7f78cfc00640 1 --2- 172.21.15.31:0/573761242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f78c80cdb30 0x7f78c8157b20 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:57.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.672+0000 7f78cfc00640 1 -- 172.21.15.31:0/573761242 >> 172.21.15.31:0/573761242 conn(0x7f78c80d1dc0 msgr2=0x7f78c80b4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:57.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.672+0000 7f78cfc00640 1 -- 172.21.15.31:0/573761242 shutdown_connections 2024-09-17T05:36:57.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:57.672+0000 7f78cfc00640 1 -- 172.21.15.31:0/573761242 wait complete. 2024-09-17T05:36:58.097 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 119, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:36:51.647070+0000', 'modified': '2024-09-17T05:36:54.664417+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9126}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9126': {'gid': 9126, 'name': 'b', 'rank': 0, 'incarnation': 115, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6835/3913619779', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6809', 'nonce': 3913619779}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 3913619779}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9126, 'qdb_cluster': [9126]} 2024-09-17T05:36:58.097 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:36:58.097 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T05:36:58.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.244+0000 7f5b38200640 1 -- 172.21.15.31:0/517252067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b3015bd50 msgr2=0x7f5b300ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.244+0000 7f5b38200640 1 --2- 172.21.15.31:0/517252067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b3015bd50 0x7f5b300ce5e0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009900 tx=0x7f5b2401c4a0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.244+0000 7f5b38200640 1 -- 172.21.15.31:0/517252067 shutdown_connections 2024-09-17T05:36:58.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.244+0000 7f5b38200640 1 --2- 172.21.15.31:0/517252067 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b300cf4e0 0x7f5b300cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.244+0000 7f5b38200640 1 --2- 172.21.15.31:0/517252067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b3015bd50 0x7f5b300ce5e0 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.244+0000 7f5b38200640 1 -- 172.21.15.31:0/517252067 >> 172.21.15.31:0/517252067 conn(0x7f5b300d1ea0 msgr2=0x7f5b300d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:58.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.244+0000 7f5b38200640 1 -- 172.21.15.31:0/517252067 shutdown_connections 2024-09-17T05:36:58.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.244+0000 7f5b38200640 1 -- 172.21.15.31:0/517252067 wait complete. 2024-09-17T05:36:58.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b38200640 1 Processor -- start 2024-09-17T05:36:58.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b38200640 1 -- start start 2024-09-17T05:36:58.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b38200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b300cf4e0 0x7f5b30155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b38200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b3015bd50 0x7f5b30157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b38200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b3015c130 0x7f5b30155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b38200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5b30169b80 con 0x7f5b3015bd50 2024-09-17T05:36:58.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b38200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5b30169a00 con 0x7f5b3015c130 2024-09-17T05:36:58.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b38200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5b30169d00 con 0x7f5b300cf4e0 2024-09-17T05:36:58.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b34e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b3015bd50 0x7f5b30157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b34e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b3015bd50 0x7f5b30157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33162/0 (socket says 172.21.15.31:33162) 2024-09-17T05:36:58.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b34e00640 1 -- 172.21.15.31:0/3403162092 learned_addr learned my addr 172.21.15.31:0/3403162092 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:58.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b35800640 1 --2- 172.21.15.31:0/3403162092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b300cf4e0 0x7f5b30155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b36200640 1 --2- 172.21.15.31:0/3403162092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b3015c130 0x7f5b30155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b34e00640 1 -- 172.21.15.31:0/3403162092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b300cf4e0 msgr2=0x7f5b30155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b34e00640 1 --2- 172.21.15.31:0/3403162092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b300cf4e0 0x7f5b30155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b34e00640 1 -- 172.21.15.31:0/3403162092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b3015c130 msgr2=0x7f5b30155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b34e00640 1 --2- 172.21.15.31:0/3403162092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b3015c130 0x7f5b30155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b34e00640 1 -- 172.21.15.31:0/3403162092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b300cce00 con 0x7f5b3015bd50 2024-09-17T05:36:58.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b34e00640 1 --2- 172.21.15.31:0/3403162092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b3015bd50 0x7f5b30157300 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00c430 tx=0x7f5b1c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:58.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b2d600640 1 -- 172.21.15.31:0/3403162092 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c017070 con 0x7f5b3015bd50 2024-09-17T05:36:58.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b2d600640 1 -- 172.21.15.31:0/3403162092 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b1c0053c0 con 0x7f5b3015bd50 2024-09-17T05:36:58.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b2d600640 1 -- 172.21.15.31:0/3403162092 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c003860 con 0x7f5b3015bd50 2024-09-17T05:36:58.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b38200640 1 -- 172.21.15.31:0/3403162092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b30156680 con 0x7f5b3015bd50 2024-09-17T05:36:58.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.248+0000 7f5b38200640 1 -- 172.21.15.31:0/3403162092 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b30156c40 con 0x7f5b3015bd50 2024-09-17T05:36:58.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.252+0000 7f5b2d600640 1 -- 172.21.15.31:0/3403162092 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f5b1c01a070 con 0x7f5b3015bd50 2024-09-17T05:36:58.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.252+0000 7f5b3b66f000 1 Processor -- start 2024-09-17T05:36:58.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.252+0000 7f5b2d600640 1 --2- 172.21.15.31:0/3403162092 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5b10073c20 0x7f5b100760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.252+0000 7f5b3b66f000 1 -- start start 2024-09-17T05:36:58.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.252+0000 7f5b2d600640 1 -- 172.21.15.31:0/3403162092 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f5b1c092050 con 0x7f5b3015bd50 2024-09-17T05:36:58.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.252+0000 7f5b36200640 1 --2- 172.21.15.31:0/3403162092 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5b10073c20 0x7f5b100760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.252+0000 7f5b36200640 1 --2- 172.21.15.31:0/3403162092 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5b10073c20 0x7f5b100760e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5b280092f0 tx=0x7f5b28009650 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:58.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b3b66f000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bc45f00 0x55f84bc462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b3b66f000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc46820 0x55f84bbfbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b3b66f000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bbfc230 0x55f84bbfc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b3b66f000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f84bb163f0 con 0x55f84bbfc230 2024-09-17T05:36:58.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b3b66f000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f84ba53b20 con 0x55f84bc46820 2024-09-17T05:36:58.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b3b66f000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55f84ba42f50 con 0x55f84bc45f00 2024-09-17T05:36:58.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b36200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bbfc230 0x55f84bbfc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b36200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bbfc230 0x55f84bbfc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33170/0 (socket says 172.21.15.31:33170) 2024-09-17T05:36:58.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b36200640 1 -- 172.21.15.31:0/477967508 learned_addr learned my addr 172.21.15.31:0/477967508 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:58.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b35800640 1 --2- 172.21.15.31:0/477967508 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bc45f00 0x55f84bc462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b34e00640 1 --2- 172.21.15.31:0/477967508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc46820 0x55f84bbfbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b36200640 1 -- 172.21.15.31:0/477967508 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bc45f00 msgr2=0x55f84bc462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:58.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b36200640 1 --2- 172.21.15.31:0/477967508 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bc45f00 0x55f84bc462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b36200640 1 -- 172.21.15.31:0/477967508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc46820 msgr2=0x55f84bbfbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:58.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b36200640 1 --2- 172.21.15.31:0/477967508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc46820 0x55f84bbfbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b36200640 1 -- 172.21.15.31:0/477967508 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f84ba0a590 con 0x55f84bbfc230 2024-09-17T05:36:58.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b34e00640 1 --2- 172.21.15.31:0/477967508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc46820 0x55f84bbfbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:58.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b36200640 1 --2- 172.21.15.31:0/477967508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bbfc230 0x55f84bbfc610 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f5b280049e0 tx=0x7f5b28013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a2c121a1e0ae65 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:58.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b22000640 1 -- 172.21.15.31:0/477967508 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2801e620 con 0x55f84bbfc230 2024-09-17T05:36:58.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b22000640 1 -- 172.21.15.31:0/477967508 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b2801e8b0 con 0x55f84bbfc230 2024-09-17T05:36:58.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b22000640 1 -- 172.21.15.31:0/477967508 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2801ec60 con 0x55f84bbfc230 2024-09-17T05:36:58.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b3b66f000 1 -- 172.21.15.31:0/477967508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bbfc230 msgr2=0x55f84bbfc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/477967508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bbfc230 0x55f84bbfc610 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f5b280049e0 tx=0x7f5b28013000 comp rx=0 tx=0).stop 2024-09-17T05:36:58.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b3b66f000 1 -- 172.21.15.31:0/477967508 shutdown_connections 2024-09-17T05:36:58.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/477967508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bbfc230 0x55f84bbfc610 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/477967508 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc46820 0x55f84bbfbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/477967508 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bc45f00 0x55f84bc462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b3b66f000 1 -- 172.21.15.31:0/477967508 >> 172.21.15.31:0/477967508 conn(0x55f84badf130 msgr2=0x55f84bbfde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:58.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b3b66f000 1 -- 172.21.15.31:0/477967508 shutdown_connections 2024-09-17T05:36:58.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b3b66f000 1 -- 172.21.15.31:0/477967508 wait complete. 2024-09-17T05:36:58.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b3b66f000 1 -- start start 2024-09-17T05:36:58.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.256+0000 7f5b3b66f000 1 Processor -- start 2024-09-17T05:36:58.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b3b66f000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bbfc230 0x55f84bc30230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b3b66f000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc45f00 0x55f84bc30d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b3b66f000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bc46820 0x55f84bc312a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b3b66f000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f84b9dd5d0 con 0x55f84bc46820 2024-09-17T05:36:58.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b3b66f000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f84ba46d60 con 0x55f84bc45f00 2024-09-17T05:36:58.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b3b66f000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55f84b9e9500 con 0x55f84bbfc230 2024-09-17T05:36:58.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b3b66f000 10 client.0 _ll_register_callbacks cb 0x55f84b9ed810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:36:58.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b36200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bc46820 0x55f84bc312a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b35800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bbfc230 0x55f84bc30230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b36200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bc46820 0x55f84bc312a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33186/0 (socket says 172.21.15.31:33186) 2024-09-17T05:36:58.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b36200640 1 -- 172.21.15.31:0/649877109 learned_addr learned my addr 172.21.15.31:0/649877109 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:58.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b34e00640 1 --2- 172.21.15.31:0/649877109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc45f00 0x55f84bc30d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b36200640 1 -- 172.21.15.31:0/649877109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bbfc230 msgr2=0x55f84bc30230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:58.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b36200640 1 --2- 172.21.15.31:0/649877109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bbfc230 0x55f84bc30230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b36200640 1 -- 172.21.15.31:0/649877109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc45f00 msgr2=0x55f84bc30d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:58.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b36200640 1 --2- 172.21.15.31:0/649877109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc45f00 0x55f84bc30d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b36200640 1 -- 172.21.15.31:0/649877109 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f84b9e1170 con 0x55f84bc46820 2024-09-17T05:36:58.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b36200640 1 --2- 172.21.15.31:0/649877109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bc46820 0x55f84bc312a0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f5b28011be0 tx=0x7f5b2801e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32c508e380b9dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:58.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b16a00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:36:58.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b16a00640 1 -- 172.21.15.31:0/649877109 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2801ea50 con 0x55f84bc46820 2024-09-17T05:36:58.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b16a00640 1 -- 172.21.15.31:0/649877109 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f5b2801ebf0 con 0x55f84bc46820 2024-09-17T05:36:58.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b3b66f000 1 -- 172.21.15.31:0/649877109 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f84b9db0f0 con 0x55f84bc46820 2024-09-17T05:36:58.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b16a00640 1 -- 172.21.15.31:0/649877109 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=119) ==== 24+0+0 (secure 0 0 0) 0x7f5b28038050 con 0x55f84bc46820 2024-09-17T05:36:58.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b3b66f000 10 client.9237 fetch_fsmap learned FSMap version 119 2024-09-17T05:36:58.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b3b66f000 1 -- 172.21.15.31:0/649877109 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=119,monmap=2+}) -- 0x55f84bac7ef0 con 0x55f84bc46820 2024-09-17T05:36:58.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b16a00640 1 -- 172.21.15.31:0/649877109 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f84b9db0f0 con 0x55f84bc46820 2024-09-17T05:36:58.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b16a00640 1 -- 172.21.15.31:0/649877109 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 119) ==== 3502+0+0 (secure 0 0 0) 0x7f5b2803b020 con 0x55f84bc46820 2024-09-17T05:36:58.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b3b66f000 10 client.9237 fetch_fsmap finished waiting for FSMap version 119 2024-09-17T05:36:58.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b3b66f000 10 client.9237 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T05:36:58.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b3b66f000 20 client.9237 populate_metadata read hostname 'smithi031' 2024-09-17T05:36:58.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/649877109 >> [v2:172.21.15.155:6809/3913619779,v1:172.21.15.155:6835/3913619779] conn(0x55f84bc31cb0 0x55f84bc32090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b3b66f000 4 client.9237 mds_command: new command op to 9126 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:36:58.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b3b66f000 1 -- 172.21.15.31:0/649877109 --> [v2:172.21.15.155:6809/3913619779,v1:172.21.15.155:6835/3913619779] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f84ba55a70 con 0x55f84bc31cb0 2024-09-17T05:36:58.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b35800640 1 --2- 172.21.15.31:0/649877109 >> [v2:172.21.15.155:6809/3913619779,v1:172.21.15.155:6835/3913619779] conn(0x55f84bc31cb0 0x55f84bc32090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b35800640 1 --2- 172.21.15.31:0/649877109 >> [v2:172.21.15.155:6809/3913619779,v1:172.21.15.155:6835/3913619779] conn(0x55f84bc31cb0 0x55f84bc32090 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d61817c7b725a3e9 server_cookie=c34d0ef1e2ef3f20 in_seq=0 out_seq=0 2024-09-17T05:36:58.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.260+0000 7f5b16a00640 10 client.9237 ms_handle_connect on v2:172.21.15.155:6809/3913619779 2024-09-17T05:36:58.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.264+0000 7f5b16a00640 1 -- 172.21.15.31:0/649877109 <== mds.0 v2:172.21.15.155:6809/3913619779 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f84ba55a70 con 0x55f84bc31cb0 2024-09-17T05:36:58.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.264+0000 7f5b16a00640 10 client.9237 handle_command_reply: tid=0 2024-09-17T05:36:58.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.264+0000 7f5b3b66f000 1 client.9237 shutdown 2024-09-17T05:36:58.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.264+0000 7f5b3b66f000 1 -- 172.21.15.31:0/649877109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bc46820 msgr2=0x55f84bc312a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.264+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/649877109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bc46820 0x55f84bc312a0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f5b28011be0 tx=0x7f5b2801e650 comp rx=0 tx=0).stop 2024-09-17T05:36:58.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.264+0000 7f5b3b66f000 1 -- 172.21.15.31:0/649877109 shutdown_connections 2024-09-17T05:36:58.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.264+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/649877109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bc46820 0x55f84bc312a0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.264+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/649877109 >> [v2:172.21.15.155:6809/3913619779,v1:172.21.15.155:6835/3913619779] conn(0x55f84bc31cb0 0x55f84bc32090 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.264+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/649877109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc45f00 0x55f84bc30d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.264+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/649877109 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bbfc230 0x55f84bc30230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.264+0000 7f5b3b66f000 1 -- 172.21.15.31:0/649877109 >> 172.21.15.31:0/649877109 conn(0x55f84badf130 msgr2=0x55f84bbfc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:58.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.264+0000 7f5b16a00640 0 client.9237 ms_handle_reset on v2:172.21.15.155:6809/3913619779 2024-09-17T05:36:58.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.264+0000 7f5b3b66f000 1 -- 172.21.15.31:0/649877109 shutdown_connections 2024-09-17T05:36:58.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.264+0000 7f5b3b66f000 1 -- 172.21.15.31:0/649877109 wait complete. 2024-09-17T05:36:58.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.264+0000 7f5b3b66f000 20 client.9237 trim_cache size 0 max 16384 2024-09-17T05:36:58.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.280+0000 7f5b3b66f000 1 Processor -- start 2024-09-17T05:36:58.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.280+0000 7f5b3b66f000 1 -- start start 2024-09-17T05:36:58.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b3b66f000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bbfc230 0x55f84bc5d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b3b66f000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc45f00 0x55f84bc5db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b3b66f000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bc46820 0x55f84bc43d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b3b66f000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3006f590 con 0x55f84bbfc230 2024-09-17T05:36:58.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b3b66f000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5b300c9f60 con 0x55f84bc45f00 2024-09-17T05:36:58.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b3b66f000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5b3006ef40 con 0x55f84bc46820 2024-09-17T05:36:58.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b35800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bbfc230 0x55f84bc5d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b35800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bbfc230 0x55f84bc5d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33202/0 (socket says 172.21.15.31:33202) 2024-09-17T05:36:58.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b35800640 1 -- 172.21.15.31:0/3387690700 learned_addr learned my addr 172.21.15.31:0/3387690700 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:58.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b34e00640 1 --2- 172.21.15.31:0/3387690700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc45f00 0x55f84bc5db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b36200640 1 --2- 172.21.15.31:0/3387690700 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bc46820 0x55f84bc43d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b35800640 1 -- 172.21.15.31:0/3387690700 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bc46820 msgr2=0x55f84bc43d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:58.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b35800640 1 --2- 172.21.15.31:0/3387690700 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bc46820 0x55f84bc43d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b35800640 1 -- 172.21.15.31:0/3387690700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc45f00 msgr2=0x55f84bc5db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:58.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b35800640 1 --2- 172.21.15.31:0/3387690700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc45f00 0x55f84bc5db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b35800640 1 -- 172.21.15.31:0/3387690700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f84ba9ed90 con 0x55f84bbfc230 2024-09-17T05:36:58.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b34e00640 1 --2- 172.21.15.31:0/3387690700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc45f00 0x55f84bc5db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:36:58.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b35800640 1 --2- 172.21.15.31:0/3387690700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bbfc230 0x55f84bc5d630 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f5b2401cd40 tx=0x7f5b240a5f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c5e6685e1ed639 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:58.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b21600640 1 -- 172.21.15.31:0/3387690700 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b240b1070 con 0x55f84bbfc230 2024-09-17T05:36:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b21600640 1 -- 172.21.15.31:0/3387690700 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b240b2040 con 0x55f84bbfc230 2024-09-17T05:36:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b21600640 1 -- 172.21.15.31:0/3387690700 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b24003600 con 0x55f84bbfc230 2024-09-17T05:36:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b3b66f000 1 -- 172.21.15.31:0/3387690700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bbfc230 msgr2=0x55f84bc5d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/3387690700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bbfc230 0x55f84bc5d630 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f5b2401cd40 tx=0x7f5b240a5f90 comp rx=0 tx=0).stop 2024-09-17T05:36:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b3b66f000 1 -- 172.21.15.31:0/3387690700 shutdown_connections 2024-09-17T05:36:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/3387690700 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bc46820 0x55f84bc43d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/3387690700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc45f00 0x55f84bc5db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/3387690700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bbfc230 0x55f84bc5d630 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b3b66f000 1 -- 172.21.15.31:0/3387690700 >> 172.21.15.31:0/3387690700 conn(0x55f84badf130 msgr2=0x55f84bc52e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b3b66f000 1 -- 172.21.15.31:0/3387690700 shutdown_connections 2024-09-17T05:36:58.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b3b66f000 1 -- 172.21.15.31:0/3387690700 wait complete. 2024-09-17T05:36:58.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b3b66f000 1 -- start start 2024-09-17T05:36:58.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.284+0000 7f5b3b66f000 1 Processor -- start 2024-09-17T05:36:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bbfc230 0x55f84bc44d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bc45f00 0x55f84bc45290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc46820 0x55f84bc5a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55f84ba528f0 con 0x55f84bc45f00 2024-09-17T05:36:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f84ba0eec0 con 0x55f84bc46820 2024-09-17T05:36:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55f84b9fc1c0 con 0x55f84bbfc230 2024-09-17T05:36:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 10 client.0 _ll_register_callbacks cb 0x7f5b24009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:36:58.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b34e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bc45f00 0x55f84bc45290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b34e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bc45f00 0x55f84bc45290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33206/0 (socket says 172.21.15.31:33206) 2024-09-17T05:36:58.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b34e00640 1 -- 172.21.15.31:0/1677039775 learned_addr learned my addr 172.21.15.31:0/1677039775 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:58.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b35800640 1 --2- 172.21.15.31:0/1677039775 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bbfc230 0x55f84bc44d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b36200640 1 --2- 172.21.15.31:0/1677039775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc46820 0x55f84bc5a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b34e00640 1 -- 172.21.15.31:0/1677039775 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bbfc230 msgr2=0x55f84bc44d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:58.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b34e00640 1 --2- 172.21.15.31:0/1677039775 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bbfc230 0x55f84bc44d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b34e00640 1 -- 172.21.15.31:0/1677039775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc46820 msgr2=0x55f84bc5a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:36:58.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b34e00640 1 --2- 172.21.15.31:0/1677039775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc46820 0x55f84bc5a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b34e00640 1 -- 172.21.15.31:0/1677039775 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f84ba09a90 con 0x55f84bc45f00 2024-09-17T05:36:58.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b34e00640 1 --2- 172.21.15.31:0/1677039775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bc45f00 0x55f84bc45290 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c05b550 tx=0x7f5b1c0653a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd38ddfb4c16785 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:58.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b16a00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-17T05:36:58.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b16a00640 1 -- 172.21.15.31:0/1677039775 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c05e2e0 con 0x55f84bc45f00 2024-09-17T05:36:58.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b16a00640 1 -- 172.21.15.31:0/1677039775 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f5b1c079dc0 con 0x55f84bc45f00 2024-09-17T05:36:58.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 1 -- 172.21.15.31:0/1677039775 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b240b2040 con 0x55f84bc45f00 2024-09-17T05:36:58.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b16a00640 1 -- 172.21.15.31:0/1677039775 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=119) ==== 24+0+0 (secure 0 0 0) 0x7f5b1c062d10 con 0x55f84bc45f00 2024-09-17T05:36:58.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 10 client.9243 fetch_fsmap learned FSMap version 119 2024-09-17T05:36:58.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 1 -- 172.21.15.31:0/1677039775 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=119,monmap=2+}) -- 0x55f84b9e8050 con 0x55f84bc45f00 2024-09-17T05:36:58.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b16a00640 1 -- 172.21.15.31:0/1677039775 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b240b2040 con 0x55f84bc45f00 2024-09-17T05:36:58.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b16a00640 1 -- 172.21.15.31:0/1677039775 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 119) ==== 3502+0+0 (secure 0 0 0) 0x7f5b1c059c30 con 0x55f84bc45f00 2024-09-17T05:36:58.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 10 client.9243 fetch_fsmap finished waiting for FSMap version 119 2024-09-17T05:36:58.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 10 client.9243 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T05:36:58.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 20 client.9243 populate_metadata read hostname 'smithi031' 2024-09-17T05:36:58.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/1677039775 >> [v2:172.21.15.155:6809/3913619779,v1:172.21.15.155:6835/3913619779] conn(0x55f84bc5aec0 0x55f84bcbc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 4 client.9243 mds_command: new command op to 9126 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:36:58.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 1 -- 172.21.15.31:0/1677039775 --> [v2:172.21.15.155:6809/3913619779,v1:172.21.15.155:6835/3913619779] -- command(tid 0: {"prefix": "status"}) -- 0x55f84ba51520 con 0x55f84bc5aec0 2024-09-17T05:36:58.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b35800640 1 --2- 172.21.15.31:0/1677039775 >> [v2:172.21.15.155:6809/3913619779,v1:172.21.15.155:6835/3913619779] conn(0x55f84bc5aec0 0x55f84bcbc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b35800640 1 --2- 172.21.15.31:0/1677039775 >> [v2:172.21.15.155:6809/3913619779,v1:172.21.15.155:6835/3913619779] conn(0x55f84bc5aec0 0x55f84bcbc5c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=238436d2ec463813 server_cookie=4826d8103bcbf53b in_seq=0 out_seq=0 2024-09-17T05:36:58.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b16a00640 10 client.9243 ms_handle_connect on v2:172.21.15.155:6809/3913619779 2024-09-17T05:36:58.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b16a00640 1 -- 172.21.15.31:0/1677039775 <== mds.0 v2:172.21.15.155:6809/3913619779 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x55f84ba51520 con 0x55f84bc5aec0 2024-09-17T05:36:58.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b16a00640 10 client.9243 handle_command_reply: tid=0 2024-09-17T05:36:58.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 1 client.9243 shutdown 2024-09-17T05:36:58.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 1 -- 172.21.15.31:0/1677039775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bc45f00 msgr2=0x55f84bc45290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/1677039775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bc45f00 0x55f84bc45290 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c05b550 tx=0x7f5b1c0653a0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 1 -- 172.21.15.31:0/1677039775 shutdown_connections 2024-09-17T05:36:58.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/1677039775 >> [v2:172.21.15.155:6809/3913619779,v1:172.21.15.155:6835/3913619779] conn(0x55f84bc5aec0 0x55f84bcbc5c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/1677039775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f84bc46820 0x55f84bc5a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/1677039775 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55f84bc45f00 0x55f84bc45290 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b3b66f000 1 --2- 172.21.15.31:0/1677039775 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55f84bbfc230 0x55f84bc44d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.292+0000 7f5b3b66f000 1 -- 172.21.15.31:0/1677039775 >> 172.21.15.31:0/1677039775 conn(0x55f84badf130 msgr2=0x55f84bbface0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:58.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.288+0000 7f5b16a00640 0 client.9243 ms_handle_reset on v2:172.21.15.155:6809/3913619779 2024-09-17T05:36:58.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.292+0000 7f5b3b66f000 1 -- 172.21.15.31:0/1677039775 shutdown_connections 2024-09-17T05:36:58.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.292+0000 7f5b3b66f000 1 -- 172.21.15.31:0/1677039775 wait complete. 2024-09-17T05:36:58.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.292+0000 7f5b3b66f000 20 client.9243 trim_cache size 0 max 16384 2024-09-17T05:36:58.297 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:36:58.297 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "b668cd1d-3036-4a29-9e5a-69d0df5776a8", 2024-09-17T05:36:58.297 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-17T05:36:58.297 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 9126, 2024-09-17T05:36:58.297 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-09-17T05:36:58.297 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-09-17T05:36:58.297 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-17T05:36:58.298 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 6.068902757, 2024-09-17T05:36:58.298 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 119, 2024-09-17T05:36:58.298 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 163, 2024-09-17T05:36:58.298 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 163, 2024-09-17T05:36:58.298 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 10.49186929 2024-09-17T05:36:58.298 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:36:58.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.292+0000 7f5b38200640 1 -- 172.21.15.31:0/3403162092 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5b10073c20 msgr2=0x7f5b100760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.292+0000 7f5b38200640 1 --2- 172.21.15.31:0/3403162092 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5b10073c20 0x7f5b100760e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5b280092f0 tx=0x7f5b28009650 comp rx=0 tx=0).stop 2024-09-17T05:36:58.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.292+0000 7f5b38200640 1 -- 172.21.15.31:0/3403162092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b3015bd50 msgr2=0x7f5b30157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.292+0000 7f5b38200640 1 --2- 172.21.15.31:0/3403162092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b3015bd50 0x7f5b30157300 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00c430 tx=0x7f5b1c00c8f0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.292+0000 7f5b38200640 1 -- 172.21.15.31:0/3403162092 shutdown_connections 2024-09-17T05:36:58.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.292+0000 7f5b38200640 1 --2- 172.21.15.31:0/3403162092 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5b10073c20 0x7f5b100760e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.292+0000 7f5b38200640 1 --2- 172.21.15.31:0/3403162092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b3015c130 0x7f5b30155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.292+0000 7f5b38200640 1 --2- 172.21.15.31:0/3403162092 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b3015bd50 0x7f5b30157300 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.292+0000 7f5b38200640 1 --2- 172.21.15.31:0/3403162092 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b300cf4e0 0x7f5b30155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.292+0000 7f5b38200640 1 -- 172.21.15.31:0/3403162092 >> 172.21.15.31:0/3403162092 conn(0x7f5b300d1ea0 msgr2=0x7f5b300d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:58.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.292+0000 7f5b38200640 1 -- 172.21.15.31:0/3403162092 shutdown_connections 2024-09-17T05:36:58.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.292+0000 7f5b38200640 1 -- 172.21.15.31:0/3403162092 wait complete. 2024-09-17T05:36:58.312 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:36:58.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.456+0000 7fea38c00640 1 -- 172.21.15.31:0/684164628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea3415bea0 msgr2=0x7fea340ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.456+0000 7fea38c00640 1 --2- 172.21.15.31:0/684164628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea3415bea0 0x7fea340ce670 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fea24009840 tx=0x7fea2401c820 comp rx=0 tx=0).stop 2024-09-17T05:36:58.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.456+0000 7fea38c00640 1 -- 172.21.15.31:0/684164628 shutdown_connections 2024-09-17T05:36:58.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.456+0000 7fea38c00640 1 --2- 172.21.15.31:0/684164628 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea340d28e0 0x7fea340cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.456+0000 7fea38c00640 1 --2- 172.21.15.31:0/684164628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea3415bea0 0x7fea340ce670 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.456+0000 7fea38c00640 1 -- 172.21.15.31:0/684164628 >> 172.21.15.31:0/684164628 conn(0x7fea340d1dc0 msgr2=0x7fea340d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:58.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.456+0000 7fea38c00640 1 -- 172.21.15.31:0/684164628 shutdown_connections 2024-09-17T05:36:58.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.456+0000 7fea38c00640 1 -- 172.21.15.31:0/684164628 wait complete. 2024-09-17T05:36:58.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea38c00640 1 Processor -- start 2024-09-17T05:36:58.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea38c00640 1 -- start start 2024-09-17T05:36:58.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea38c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea340cdb30 0x7fea34158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea38c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea340d28e0 0x7fea340cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea38c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea3415bea0 0x7fea34159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea38c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fea34168fc0 con 0x7fea3415bea0 2024-09-17T05:36:58.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea38c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fea34168e40 con 0x7fea340cdb30 2024-09-17T05:36:58.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea38c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fea34169140 con 0x7fea340d28e0 2024-09-17T05:36:58.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea32800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea3415bea0 0x7fea34159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea32800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea3415bea0 0x7fea34159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33208/0 (socket says 172.21.15.31:33208) 2024-09-17T05:36:58.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea32800640 1 -- 172.21.15.31:0/1948989783 learned_addr learned my addr 172.21.15.31:0/1948989783 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:58.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea32800640 1 -- 172.21.15.31:0/1948989783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea340d28e0 msgr2=0x7fea340cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea32800640 1 --2- 172.21.15.31:0/1948989783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea340d28e0 0x7fea340cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea32800640 1 -- 172.21.15.31:0/1948989783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea340cdb30 msgr2=0x7fea34158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea32800640 1 --2- 172.21.15.31:0/1948989783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea340cdb30 0x7fea34158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea32800640 1 -- 172.21.15.31:0/1948989783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea3409f9e0 con 0x7fea3415bea0 2024-09-17T05:36:58.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea32800640 1 --2- 172.21.15.31:0/1948989783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea3415bea0 0x7fea34159cc0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00eb20 tx=0x7fea2c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:58.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea2a000640 1 -- 172.21.15.31:0/1948989783 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c004b30 con 0x7fea3415bea0 2024-09-17T05:36:58.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea38c00640 1 -- 172.21.15.31:0/1948989783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea3409f760 con 0x7fea3415bea0 2024-09-17T05:36:58.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea2a000640 1 -- 172.21.15.31:0/1948989783 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea2c004cf0 con 0x7fea3415bea0 2024-09-17T05:36:58.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea2a000640 1 -- 172.21.15.31:0/1948989783 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c005280 con 0x7fea3415bea0 2024-09-17T05:36:58.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea38c00640 1 -- 172.21.15.31:0/1948989783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea34158ad0 con 0x7fea3415bea0 2024-09-17T05:36:58.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.460+0000 7fea38c00640 1 -- 172.21.15.31:0/1948989783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea34158cd0 con 0x7fea3415bea0 2024-09-17T05:36:58.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.464+0000 7fea2a000640 1 -- 172.21.15.31:0/1948989783 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7fea2c005420 con 0x7fea3415bea0 2024-09-17T05:36:58.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.464+0000 7fea2a000640 1 --2- 172.21.15.31:0/1948989783 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fea10073c20 0x7fea100760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:58.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.464+0000 7fea2a000640 1 -- 172.21.15.31:0/1948989783 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7fea2c0966b0 con 0x7fea3415bea0 2024-09-17T05:36:58.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.464+0000 7fea31e00640 1 --2- 172.21.15.31:0/1948989783 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fea10073c20 0x7fea100760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:58.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.464+0000 7fea31e00640 1 --2- 172.21.15.31:0/1948989783 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fea10073c20 0x7fea100760e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fea240af000 tx=0x7fea240195c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:58.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.468+0000 7fea2a000640 1 -- 172.21.15.31:0/1948989783 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fea34158cd0 con 0x7fea3415bea0 2024-09-17T05:36:58.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.684+0000 7fea38c00640 1 -- 172.21.15.31:0/1948989783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fea340cc9d0 con 0x7fea3415bea0 2024-09-17T05:36:58.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.684+0000 7fea2a000640 1 -- 172.21.15.31:0/1948989783 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v119) ==== 53+0+73 (secure 0 0 0) 0x7fea3409f760 con 0x7fea3415bea0 2024-09-17T05:36:58.689 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:36:58.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.688+0000 7fea38c00640 1 -- 172.21.15.31:0/1948989783 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fea10073c20 msgr2=0x7fea100760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.688+0000 7fea38c00640 1 --2- 172.21.15.31:0/1948989783 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fea10073c20 0x7fea100760e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fea240af000 tx=0x7fea240195c0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.688+0000 7fea38c00640 1 -- 172.21.15.31:0/1948989783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea3415bea0 msgr2=0x7fea34159cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:58.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.688+0000 7fea38c00640 1 --2- 172.21.15.31:0/1948989783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea3415bea0 0x7fea34159cc0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00eb20 tx=0x7fea2c00c2d0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.688+0000 7fea38c00640 1 -- 172.21.15.31:0/1948989783 shutdown_connections 2024-09-17T05:36:58.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.688+0000 7fea38c00640 1 --2- 172.21.15.31:0/1948989783 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fea10073c20 0x7fea100760e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.688+0000 7fea38c00640 1 --2- 172.21.15.31:0/1948989783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fea3415bea0 0x7fea34159cc0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.688+0000 7fea38c00640 1 --2- 172.21.15.31:0/1948989783 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fea340d28e0 0x7fea340cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.688+0000 7fea38c00640 1 --2- 172.21.15.31:0/1948989783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea340cdb30 0x7fea34158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:58.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.688+0000 7fea38c00640 1 -- 172.21.15.31:0/1948989783 >> 172.21.15.31:0/1948989783 conn(0x7fea340d1dc0 msgr2=0x7fea340b6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:58.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.688+0000 7fea38c00640 1 -- 172.21.15.31:0/1948989783 shutdown_connections 2024-09-17T05:36:58.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58.688+0000 7fea38c00640 1 -- 172.21.15.31:0/1948989783 wait complete. 2024-09-17T05:36:58.710 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:36:58.710 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:36:58.710 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-17T05:36:58.710 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:36:58.710 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:36:58.710 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:36:58.710 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:36:58.710 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:36:58.710 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:36:58.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:58.711 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-17T05:36:58.720 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:36:58.720 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:36:58.720 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:36:58.720 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:58.720 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-17T05:36:58.721 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:58.721 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:58.721 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:58.721 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-17T05:36:58.721 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:58.721 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:58.721 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-17T05:36:58.721 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:36:58.721 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:58.721 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-17T05:36:58.721 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-17T05:36:58.721 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 41934sec preferred_lft 41934sec 2024-09-17T05:36:58.721 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-17T05:36:58.722 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:58.722 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:58.722 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:58.722 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-17T05:36:58.722 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:36:58.722 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:fe:f3:3e:aa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:58.722 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:36:58.722 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:58.722 INFO:teuthology.orchestra.run.smithi031.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:36:58.722 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:58.722 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:36:58.722 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:58.723 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:36:58.723 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:58.723 INFO:teuthology.orchestra.run.smithi031.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:36:58.723 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:36:58.723 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:36:58.723 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:58.723 INFO:teuthology.orchestra.run.smithi031.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:36:58.723 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:36:58.723 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:36:58.723 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:58.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:58.723 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:36:58.783 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-17T05:36:58.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:58.786 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-17T05:36:58.837 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-17T05:36:58.838 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:36:58.838 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-17T05:36:58.838 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:36:58.838 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-17T05:36:58.838 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:36:58.838 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:58.838 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-17T05:36:58.838 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-17T05:36:58.838 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-17T05:36:58.839 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-17T05:36:58.839 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-17T05:36:58.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:36:58.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:58.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:58.977 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T05:36:58.986 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:36:58.986 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:36:58.986 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:36:58.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:58.987 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-09-17T05:36:59.048 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:36:59.048 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:36:59.100 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:36:59.101 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:36:59.101 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:36:59.151 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-17T05:36:59.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:59.152 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:36:59.242 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:36:59.242 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:36:59.255 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:36:59.255 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:36:59.255 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:36:59.256 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with new device syntax: 0@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:36:59.256 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:36:59.260 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:36:59.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:59.260 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:36:59.281 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:36:59.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:36:59.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:36:59.390 INFO:teuthology.orchestra.run.smithi031.stdout:client9252 2024-09-17T05:36:59.390 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:36:59.390 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:36:59.399 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:36:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.588+0000 7efc42c00640 1 -- 172.21.15.31:0/1534413498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc3c15db50 msgr2=0x7efc3c0acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.588+0000 7efc42c00640 1 --2- 172.21.15.31:0/1534413498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc3c15db50 0x7efc3c0acd40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7efc2c009900 tx=0x7efc2c01c7f0 comp rx=0 tx=0).stop 2024-09-17T05:36:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.588+0000 7efc42c00640 1 -- 172.21.15.31:0/1534413498 shutdown_connections 2024-09-17T05:36:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.588+0000 7efc42c00640 1 --2- 172.21.15.31:0/1534413498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc3c0cd100 0x7efc3c0b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.588+0000 7efc42c00640 1 --2- 172.21.15.31:0/1534413498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc3c15db50 0x7efc3c0acd40 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.588+0000 7efc42c00640 1 -- 172.21.15.31:0/1534413498 >> 172.21.15.31:0/1534413498 conn(0x7efc3c0b18f0 msgr2=0x7efc3c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.588+0000 7efc42c00640 1 -- 172.21.15.31:0/1534413498 shutdown_connections 2024-09-17T05:36:59.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.588+0000 7efc42c00640 1 -- 172.21.15.31:0/1534413498 wait complete. 2024-09-17T05:36:59.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.588+0000 7efc42c00640 1 Processor -- start 2024-09-17T05:36:59.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.588+0000 7efc42c00640 1 -- start start 2024-09-17T05:36:59.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc42c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc3c0b4880 0x7efc3c09b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:59.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc42c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc3c0cd100 0x7efc3c0afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:59.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc42c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c15db50 0x7efc3c073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:59.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc42c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c0cccf0 con 0x7efc3c15db50 2024-09-17T05:36:59.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc42c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c0ccb70 con 0x7efc3c0cd100 2024-09-17T05:36:59.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc42c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efc3c167120 con 0x7efc3c0b4880 2024-09-17T05:36:59.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc40c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c15db50 0x7efc3c073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:59.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc40c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c15db50 0x7efc3c073ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56052/0 (socket says 172.21.15.31:56052) 2024-09-17T05:36:59.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc40c00640 1 -- 172.21.15.31:0/579567200 learned_addr learned my addr 172.21.15.31:0/579567200 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:36:59.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc33e00640 1 --2- 172.21.15.31:0/579567200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc3c0cd100 0x7efc3c0afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:59.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc3be00640 1 --2- 172.21.15.31:0/579567200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc3c0b4880 0x7efc3c09b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:59.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc40c00640 1 -- 172.21.15.31:0/579567200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc3c0b4880 msgr2=0x7efc3c09b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:59.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc40c00640 1 --2- 172.21.15.31:0/579567200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc3c0b4880 0x7efc3c09b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:59.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc40c00640 1 -- 172.21.15.31:0/579567200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc3c0cd100 msgr2=0x7efc3c0afab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:59.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc40c00640 1 --2- 172.21.15.31:0/579567200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc3c0cd100 0x7efc3c0afab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:59.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc40c00640 1 -- 172.21.15.31:0/579567200 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3c1f6920 con 0x7efc3c15db50 2024-09-17T05:36:59.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc40c00640 1 --2- 172.21.15.31:0/579567200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c15db50 0x7efc3c073ba0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7efc3400c7a0 tx=0x7efc3400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:59.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc38c00640 1 -- 172.21.15.31:0/579567200 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34003b80 con 0x7efc3c15db50 2024-09-17T05:36:59.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc38c00640 1 -- 172.21.15.31:0/579567200 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc34003d40 con 0x7efc3c15db50 2024-09-17T05:36:59.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc42c00640 1 -- 172.21.15.31:0/579567200 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc3c1f5e00 con 0x7efc3c15db50 2024-09-17T05:36:59.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc38c00640 1 -- 172.21.15.31:0/579567200 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3400aab0 con 0x7efc3c15db50 2024-09-17T05:36:59.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc42c00640 1 -- 172.21.15.31:0/579567200 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc3c1f6640 con 0x7efc3c15db50 2024-09-17T05:36:59.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.592+0000 7efc42c00640 1 -- 172.21.15.31:0/579567200 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc3c069410 con 0x7efc3c15db50 2024-09-17T05:36:59.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.596+0000 7efc38c00640 1 -- 172.21.15.31:0/579567200 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7efc3400ac50 con 0x7efc3c15db50 2024-09-17T05:36:59.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.596+0000 7efc38c00640 1 --2- 172.21.15.31:0/579567200 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efc18073c20 0x7efc180760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:36:59.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.596+0000 7efc38c00640 1 -- 172.21.15.31:0/579567200 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7efc34093580 con 0x7efc3c15db50 2024-09-17T05:36:59.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.596+0000 7efc3be00640 1 --2- 172.21.15.31:0/579567200 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efc18073c20 0x7efc180760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:36:59.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.596+0000 7efc3be00640 1 --2- 172.21.15.31:0/579567200 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efc18073c20 0x7efc180760e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0af000 tx=0x7efc2c01b090 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:36:59.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.600+0000 7efc38c00640 1 -- 172.21.15.31:0/579567200 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7efc3c1f5e00 con 0x7efc3c15db50 2024-09-17T05:36:59.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.812+0000 7efc42c00640 1 -- 172.21.15.31:0/579567200 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efc3c0ace70 con 0x7efc3c15db50 2024-09-17T05:36:59.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.812+0000 7efc38c00640 1 -- 172.21.15.31:0/579567200 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v119) ==== 53+0+73 (secure 0 0 0) 0x7efc3405f810 con 0x7efc3c15db50 2024-09-17T05:36:59.815 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:36:59.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.816+0000 7efc42c00640 1 -- 172.21.15.31:0/579567200 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efc18073c20 msgr2=0x7efc180760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:59.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.816+0000 7efc42c00640 1 --2- 172.21.15.31:0/579567200 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efc18073c20 0x7efc180760e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0af000 tx=0x7efc2c01b090 comp rx=0 tx=0).stop 2024-09-17T05:36:59.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.816+0000 7efc42c00640 1 -- 172.21.15.31:0/579567200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c15db50 msgr2=0x7efc3c073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:36:59.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.816+0000 7efc42c00640 1 --2- 172.21.15.31:0/579567200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c15db50 0x7efc3c073ba0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7efc3400c7a0 tx=0x7efc3400cc60 comp rx=0 tx=0).stop 2024-09-17T05:36:59.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.816+0000 7efc42c00640 1 -- 172.21.15.31:0/579567200 shutdown_connections 2024-09-17T05:36:59.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.816+0000 7efc42c00640 1 --2- 172.21.15.31:0/579567200 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efc18073c20 0x7efc180760e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:59.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.816+0000 7efc42c00640 1 --2- 172.21.15.31:0/579567200 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc3c15db50 0x7efc3c073ba0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:59.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.816+0000 7efc42c00640 1 --2- 172.21.15.31:0/579567200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efc3c0cd100 0x7efc3c0afab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:59.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.816+0000 7efc42c00640 1 --2- 172.21.15.31:0/579567200 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efc3c0b4880 0x7efc3c09b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:36:59.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.816+0000 7efc42c00640 1 -- 172.21.15.31:0/579567200 >> 172.21.15.31:0/579567200 conn(0x7efc3c0b18f0 msgr2=0x7efc3c156b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:36:59.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.816+0000 7efc42c00640 1 -- 172.21.15.31:0/579567200 shutdown_connections 2024-09-17T05:36:59.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:36:59.816+0000 7efc42c00640 1 -- 172.21.15.31:0/579567200 wait complete. 2024-09-17T05:36:59.837 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T05:36:59.838 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:36:59.838 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-09-17T05:36:59.838 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:36:59.838 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:36:59.838 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T05:36:59.838 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T05:36:59.838 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:36:59.838 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:36:59.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:59.839 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-09-17T05:36:59.849 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:36:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:36:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:36:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-17T05:36:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:59.849 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-09-17T05:36:59.850 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-09-17T05:36:59.850 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-17T05:36:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:59.850 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:36:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-17T05:36:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 41936sec preferred_lft 41936sec 2024-09-17T05:36:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link 2024-09-17T05:36:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:59.850 INFO:teuthology.orchestra.run.smithi155.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-17T05:36:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 02:42:84:cd:fc:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-17T05:36:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:59.851 INFO:teuthology.orchestra.run.smithi155.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:36:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-17T05:36:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:36:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-17T05:36:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:59.851 INFO:teuthology.orchestra.run.smithi155.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:36:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:36:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-17T05:36:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:59.851 INFO:teuthology.orchestra.run.smithi155.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:36:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:36:59.852 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-17T05:36:59.852 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:36:59.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:59.853 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:36:59.916 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-17T05:36:59.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:36:59.919 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-09-17T05:36:59.976 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-09-17T05:36:59.976 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:36:59.977 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-17T05:36:59.977 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:36:59.977 INFO:teuthology.orchestra.run.smithi155.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-17T05:36:59.977 INFO:teuthology.orchestra.run.smithi155.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-17T05:36:59.977 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:36:59.977 INFO:teuthology.orchestra.run.smithi155.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:36:59.977 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:36:59.977 INFO:teuthology.orchestra.run.smithi155.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-17T05:36:59.977 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:36:59.978 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:36:59.978 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-17T05:36:59.978 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:36:59.978 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:36:59.978 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:36:59.978 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-17T05:37:00.072 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:37:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:37:00.115 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:37:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:37:00.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:00.122 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-17T05:37:00.131 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:37:00.131 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:37:00.131 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:37:00.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:00.132 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-09-17T05:37:00.195 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:37:00.196 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:37:00.248 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:37:00.249 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:37:00.249 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:37:00.300 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-17T05:37:00.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:00.300 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:37:00.388 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:37:00.389 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:37:00.401 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-17T05:37:00.401 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-17T05:37:00.401 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-17T05:37:00.401 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@b668cd1d-3036-4a29-9e5a-69d0df5776a8.cephfs=/ 2024-09-17T05:37:00.401 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.31:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-17T05:37:00.405 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T05:37:00.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:00.405 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:37:00.424 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T05:37:00.514 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:37:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:37:00.517 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-17T05:37:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:37:00.523 INFO:teuthology.orchestra.run.smithi155.stdout:client8608 2024-09-17T05:37:00.524 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:37:00.524 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:00.572 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:37:00.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.728+0000 7ffbeb000640 1 -- 172.21.15.31:0/2418238982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe40734f0 msgr2=0x7ffbe415a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:00.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.728+0000 7ffbeb000640 1 --2- 172.21.15.31:0/2418238982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe40734f0 0x7ffbe415a9d0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4072800 tx=0x7ffbd401c800 comp rx=0 tx=0).stop 2024-09-17T05:37:00.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.728+0000 7ffbeb000640 1 -- 172.21.15.31:0/2418238982 shutdown_connections 2024-09-17T05:37:00.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.728+0000 7ffbeb000640 1 --2- 172.21.15.31:0/2418238982 >> v2:172.21.15.155:3300/0 conn(0x7ffbe40cea60 0x7ffbe406eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:00.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.728+0000 7ffbeb000640 1 --2- 172.21.15.31:0/2418238982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe40734f0 0x7ffbe415a9d0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:00.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.728+0000 7ffbeb000640 1 -- 172.21.15.31:0/2418238982 >> 172.21.15.31:0/2418238982 conn(0x7ffbe40cfbc0 msgr2=0x7ffbe40cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:00.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.728+0000 7ffbeb000640 1 -- 172.21.15.31:0/2418238982 shutdown_connections 2024-09-17T05:37:00.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.728+0000 7ffbeb000640 1 -- 172.21.15.31:0/2418238982 wait complete. 2024-09-17T05:37:00.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbeb000640 1 Processor -- start 2024-09-17T05:37:00.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbeb000640 1 -- start start 2024-09-17T05:37:00.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbeb000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbe40734f0 0x7ffbe41f8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:00.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbeb000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe40cea60 0x7ffbe413e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:00.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbeb000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbe40cf440 0x7ffbe41fafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:00.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbeb000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe406faa0 con 0x7ffbe40cea60 2024-09-17T05:37:00.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbeb000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe406f920 con 0x7ffbe40cf440 2024-09-17T05:37:00.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbeb000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffbe406fc20 con 0x7ffbe40734f0 2024-09-17T05:37:00.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbdbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe40cea60 0x7ffbe413e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:00.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbdbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe40cea60 0x7ffbe413e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56072/0 (socket says 172.21.15.31:56072) 2024-09-17T05:37:00.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbdbe00640 1 -- 172.21.15.31:0/1299371977 learned_addr learned my addr 172.21.15.31:0/1299371977 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:00.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbe3e00640 1 --2- 172.21.15.31:0/1299371977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbe40734f0 0x7ffbe41f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:00.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbe9000640 1 --2- 172.21.15.31:0/1299371977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbe40cf440 0x7ffbe41fafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:00.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbdbe00640 1 -- 172.21.15.31:0/1299371977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbe40734f0 msgr2=0x7ffbe41f8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:00.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbdbe00640 1 --2- 172.21.15.31:0/1299371977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbe40734f0 0x7ffbe41f8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:00.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbdbe00640 1 -- 172.21.15.31:0/1299371977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbe40cf440 msgr2=0x7ffbe41fafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:00.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbdbe00640 1 --2- 172.21.15.31:0/1299371977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbe40cf440 0x7ffbe41fafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:00.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbdbe00640 1 -- 172.21.15.31:0/1299371977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe41f8950 con 0x7ffbe40cea60 2024-09-17T05:37:00.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbe9000640 1 --2- 172.21.15.31:0/1299371977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbe40cf440 0x7ffbe41fafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:00.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbdbe00640 1 --2- 172.21.15.31:0/1299371977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe40cea60 0x7ffbe413e6b0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00c3c0 tx=0x7ffbcc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:00.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbe0c00640 1 -- 172.21.15.31:0/1299371977 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc017070 con 0x7ffbe40cea60 2024-09-17T05:37:00.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbe0c00640 1 -- 172.21.15.31:0/1299371977 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffbcc0053c0 con 0x7ffbe40cea60 2024-09-17T05:37:00.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbe0c00640 1 -- 172.21.15.31:0/1299371977 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc003860 con 0x7ffbe40cea60 2024-09-17T05:37:00.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbeb000640 1 -- 172.21.15.31:0/1299371977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe41fb990 con 0x7ffbe40cea60 2024-09-17T05:37:00.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.732+0000 7ffbeb000640 1 -- 172.21.15.31:0/1299371977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe41f7c10 con 0x7ffbe40cea60 2024-09-17T05:37:00.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.736+0000 7ffbeb000640 1 -- 172.21.15.31:0/1299371977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbe4069410 con 0x7ffbe40cea60 2024-09-17T05:37:00.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.736+0000 7ffbe0c00640 1 -- 172.21.15.31:0/1299371977 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7ffbcc01a070 con 0x7ffbe40cea60 2024-09-17T05:37:00.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.736+0000 7ffbe0c00640 1 --2- 172.21.15.31:0/1299371977 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ffbc0073c20 0x7ffbc00760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:00.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.736+0000 7ffbe0c00640 1 -- 172.21.15.31:0/1299371977 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7ffbcc091fa0 con 0x7ffbe40cea60 2024-09-17T05:37:00.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.736+0000 7ffbe3e00640 1 --2- 172.21.15.31:0/1299371977 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ffbc0073c20 0x7ffbc00760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:00.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.736+0000 7ffbe3e00640 1 --2- 172.21.15.31:0/1299371977 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ffbc0073c20 0x7ffbc00760e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40af000 tx=0x7ffbd401b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:00.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.740+0000 7ffbe0c00640 1 -- 172.21.15.31:0/1299371977 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ffbcc05e230 con 0x7ffbe40cea60 2024-09-17T05:37:00.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:00.956+0000 7ffbeb000640 1 -- 172.21.15.31:0/1299371977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7ffbe415a9d0 con 0x7ffbe40cea60 2024-09-17T05:37:01.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.288+0000 7ffbe0c00640 1 -- 172.21.15.31:0/1299371977 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v120) ==== 136+0+0 (secure 0 0 0) 0x7ffbcc062c60 con 0x7ffbe40cea60 2024-09-17T05:37:01.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.288+0000 7ffbeb000640 1 -- 172.21.15.31:0/1299371977 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ffbc0073c20 msgr2=0x7ffbc00760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:01.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.288+0000 7ffbeb000640 1 --2- 172.21.15.31:0/1299371977 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ffbc0073c20 0x7ffbc00760e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40af000 tx=0x7ffbd401b040 comp rx=0 tx=0).stop 2024-09-17T05:37:01.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.288+0000 7ffbeb000640 1 -- 172.21.15.31:0/1299371977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe40cea60 msgr2=0x7ffbe413e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:01.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.288+0000 7ffbeb000640 1 --2- 172.21.15.31:0/1299371977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe40cea60 0x7ffbe413e6b0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00c3c0 tx=0x7ffbcc00c880 comp rx=0 tx=0).stop 2024-09-17T05:37:01.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.288+0000 7ffbeb000640 1 -- 172.21.15.31:0/1299371977 shutdown_connections 2024-09-17T05:37:01.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.288+0000 7ffbeb000640 1 --2- 172.21.15.31:0/1299371977 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ffbc0073c20 0x7ffbc00760e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.288+0000 7ffbeb000640 1 --2- 172.21.15.31:0/1299371977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbe40cf440 0x7ffbe41fafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.288+0000 7ffbeb000640 1 --2- 172.21.15.31:0/1299371977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffbe40cea60 0x7ffbe413e6b0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.288+0000 7ffbeb000640 1 --2- 172.21.15.31:0/1299371977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbe40734f0 0x7ffbe41f8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.288+0000 7ffbeb000640 1 -- 172.21.15.31:0/1299371977 >> 172.21.15.31:0/1299371977 conn(0x7ffbe40cfbc0 msgr2=0x7ffbe40b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:01.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.288+0000 7ffbeb000640 1 -- 172.21.15.31:0/1299371977 shutdown_connections 2024-09-17T05:37:01.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.288+0000 7ffbeb000640 1 -- 172.21.15.31:0/1299371977 wait complete. 2024-09-17T05:37:01.313 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:37:01.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.460+0000 7ff54f400640 1 -- 172.21.15.31:0/1358051568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff530005240 msgr2=0x7ff53000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:01.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.460+0000 7ff54f400640 1 --2- 172.21.15.31:0/1358051568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff530005240 0x7ff53000b9d0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7ff54815c540 tx=0x7ff54001d5d0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.460+0000 7ff54f400640 1 -- 172.21.15.31:0/1358051568 shutdown_connections 2024-09-17T05:37:01.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.460+0000 7ff54f400640 1 --2- 172.21.15.31:0/1358051568 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff530005240 0x7ff53000b9d0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.460+0000 7ff54f400640 1 -- 172.21.15.31:0/1358051568 >> 172.21.15.31:0/1358051568 conn(0x7ff5480d1ea0 msgr2=0x7ff5480d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:01.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.460+0000 7ff54f400640 1 -- 172.21.15.31:0/1358051568 shutdown_connections 2024-09-17T05:37:01.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.460+0000 7ff54f400640 1 -- 172.21.15.31:0/1358051568 wait complete. 2024-09-17T05:37:01.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54f400640 1 Processor -- start 2024-09-17T05:37:01.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54f400640 1 -- start start 2024-09-17T05:37:01.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff530005240 0x7ff54809cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:01.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54f400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5480ca7d0 0x7ff54809ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:01.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54f400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5481f5220 0x7ff54809f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:01.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54f400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff5480ce970 con 0x7ff530005240 2024-09-17T05:37:01.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54f400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff5480ce7f0 con 0x7ff5481f5220 2024-09-17T05:37:01.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54f400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff5480ceaf0 con 0x7ff5480ca7d0 2024-09-17T05:37:01.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff530005240 0x7ff54809cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:01.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff530005240 0x7ff54809cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56084/0 (socket says 172.21.15.31:56084) 2024-09-17T05:37:01.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54ca00640 1 -- 172.21.15.31:0/2233505088 learned_addr learned my addr 172.21.15.31:0/2233505088 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:01.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff547e00640 1 --2- 172.21.15.31:0/2233505088 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5480ca7d0 0x7ff54809ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:01.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54d400640 1 --2- 172.21.15.31:0/2233505088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5481f5220 0x7ff54809f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:01.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54ca00640 1 -- 172.21.15.31:0/2233505088 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5480ca7d0 msgr2=0x7ff54809ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:01.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54ca00640 1 --2- 172.21.15.31:0/2233505088 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5480ca7d0 0x7ff54809ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54ca00640 1 -- 172.21.15.31:0/2233505088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5481f5220 msgr2=0x7ff54809f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:01.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54ca00640 1 --2- 172.21.15.31:0/2233505088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5481f5220 0x7ff54809f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54ca00640 1 -- 172.21.15.31:0/2233505088 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54809d7b0 con 0x7ff530005240 2024-09-17T05:37:01.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54d400640 1 --2- 172.21.15.31:0/2233505088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5481f5220 0x7ff54809f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54ca00640 1 --2- 172.21.15.31:0/2233505088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff530005240 0x7ff54809cf60 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0064a0 tx=0x7ff53c0039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff544c00640 1 -- 172.21.15.31:0/2233505088 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c015070 con 0x7ff530005240 2024-09-17T05:37:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff544c00640 1 -- 172.21.15.31:0/2233505088 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff53c011860 con 0x7ff530005240 2024-09-17T05:37:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff544c00640 1 -- 172.21.15.31:0/2233505088 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c011cb0 con 0x7ff530005240 2024-09-17T05:37:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54f400640 1 -- 172.21.15.31:0/2233505088 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5481f4740 con 0x7ff530005240 2024-09-17T05:37:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.464+0000 7ff54f400640 1 -- 172.21.15.31:0/2233505088 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5481f4d00 con 0x7ff530005240 2024-09-17T05:37:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.468+0000 7ff54f400640 1 -- 172.21.15.31:0/2233505088 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5481f4540 con 0x7ff530005240 2024-09-17T05:37:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.468+0000 7ff544c00640 1 -- 172.21.15.31:0/2233505088 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7ff53c018070 con 0x7ff530005240 2024-09-17T05:37:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.468+0000 7ff544c00640 1 --2- 172.21.15.31:0/2233505088 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff528073c20 0x7ff5280760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.468+0000 7ff544c00640 1 -- 172.21.15.31:0/2233505088 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7ff53c0939b0 con 0x7ff530005240 2024-09-17T05:37:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.468+0000 7ff547e00640 1 --2- 172.21.15.31:0/2233505088 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff528073c20 0x7ff5280760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.468+0000 7ff547e00640 1 --2- 172.21.15.31:0/2233505088 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff528073c20 0x7ff5280760e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff54806f780 tx=0x7ff534006b20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:01.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.472+0000 7ff544c00640 1 -- 172.21.15.31:0/2233505088 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7ff53c060290 con 0x7ff530005240 2024-09-17T05:37:01.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.668+0000 7ff54f400640 1 -- 172.21.15.31:0/2233505088 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7ff54809da90 con 0x7ff528073c20 2024-09-17T05:37:01.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.672+0000 7ff544c00640 1 -- 172.21.15.31:0/2233505088 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7ff54809da90 con 0x7ff528073c20 2024-09-17T05:37:01.674 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-17T05:37:01.674 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-17T05:37:01.674 INFO:teuthology.orchestra.run.smithi031.stdout: "name": "cephfs" 2024-09-17T05:37:01.674 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-17T05:37:01.674 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-17T05:37:01.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.672+0000 7ff54f400640 1 -- 172.21.15.31:0/2233505088 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff528073c20 msgr2=0x7ff5280760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:01.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.672+0000 7ff54f400640 1 --2- 172.21.15.31:0/2233505088 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff528073c20 0x7ff5280760e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff54806f780 tx=0x7ff534006b20 comp rx=0 tx=0).stop 2024-09-17T05:37:01.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.672+0000 7ff54f400640 1 -- 172.21.15.31:0/2233505088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff530005240 msgr2=0x7ff54809cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:01.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.672+0000 7ff54f400640 1 --2- 172.21.15.31:0/2233505088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff530005240 0x7ff54809cf60 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7ff53c0064a0 tx=0x7ff53c0039d0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.672+0000 7ff54f400640 1 -- 172.21.15.31:0/2233505088 shutdown_connections 2024-09-17T05:37:01.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.672+0000 7ff54f400640 1 --2- 172.21.15.31:0/2233505088 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7ff528073c20 0x7ff5280760e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.672+0000 7ff54f400640 1 --2- 172.21.15.31:0/2233505088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff5481f5220 0x7ff54809f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.672+0000 7ff54f400640 1 --2- 172.21.15.31:0/2233505088 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5480ca7d0 0x7ff54809ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.672+0000 7ff54f400640 1 --2- 172.21.15.31:0/2233505088 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff530005240 0x7ff54809cf60 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.672+0000 7ff54f400640 1 -- 172.21.15.31:0/2233505088 >> 172.21.15.31:0/2233505088 conn(0x7ff5480d1ea0 msgr2=0x7ff54815b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:01.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.672+0000 7ff54f400640 1 -- 172.21.15.31:0/2233505088 shutdown_connections 2024-09-17T05:37:01.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.672+0000 7ff54f400640 1 -- 172.21.15.31:0/2233505088 wait complete. 2024-09-17T05:37:01.696 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:37:01.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.844+0000 7f93ff200640 1 -- 172.21.15.31:0/3830541895 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e40051d0 msgr2=0x7f93e400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:01.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.844+0000 7f93ff200640 1 --2- 172.21.15.31:0/3830541895 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e40051d0 0x7f93e400b9d0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f93f8001dc0 tx=0x7f93f801cb30 comp rx=0 tx=0).stop 2024-09-17T05:37:01.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.844+0000 7f93ff200640 1 -- 172.21.15.31:0/3830541895 shutdown_connections 2024-09-17T05:37:01.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.844+0000 7f93ff200640 1 --2- 172.21.15.31:0/3830541895 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e40051d0 0x7f93e400b9d0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.844+0000 7f93ff200640 1 -- 172.21.15.31:0/3830541895 >> 172.21.15.31:0/3830541895 conn(0x7f940009aa10 msgr2=0x7f940009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:01.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.844+0000 7f93ff200640 1 -- 172.21.15.31:0/3830541895 shutdown_connections 2024-09-17T05:37:01.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.844+0000 7f93ff200640 1 -- 172.21.15.31:0/3830541895 wait complete. 2024-09-17T05:37:01.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93ff200640 1 Processor -- start 2024-09-17T05:37:01.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93ff200640 1 -- start start 2024-09-17T05:37:01.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93ff200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e40051d0 0x7f94001526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:01.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93ff200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9400152230 0x7f940014c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:01.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93ff200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94000ca150 0x7f94000c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:01.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93ff200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f94000d03c0 con 0x7f93e40051d0 2024-09-17T05:37:01.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93ff200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f94000d0240 con 0x7f9400152230 2024-09-17T05:37:01.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93ff200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f94000d0540 con 0x7f94000ca150 2024-09-17T05:37:01.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93fde00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e40051d0 0x7f94001526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:01.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93fde00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e40051d0 0x7f94001526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56096/0 (socket says 172.21.15.31:56096) 2024-09-17T05:37:01.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93fde00640 1 -- 172.21.15.31:0/334163376 learned_addr learned my addr 172.21.15.31:0/334163376 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:01.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93fde00640 1 -- 172.21.15.31:0/334163376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94000ca150 msgr2=0x7f94000c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:01.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93fde00640 1 --2- 172.21.15.31:0/334163376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94000ca150 0x7f94000c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93fde00640 1 -- 172.21.15.31:0/334163376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9400152230 msgr2=0x7f940014c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:01.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93fde00640 1 --2- 172.21.15.31:0/334163376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9400152230 0x7f940014c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:01.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93fde00640 1 -- 172.21.15.31:0/334163376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94000cb720 con 0x7f93e40051d0 2024-09-17T05:37:01.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93fde00640 1 --2- 172.21.15.31:0/334163376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e40051d0 0x7f94001526f0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f93f0001bf0 tx=0x7f93f0006740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:01.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93f6000640 1 -- 172.21.15.31:0/334163376 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0015070 con 0x7f93e40051d0 2024-09-17T05:37:01.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93f6000640 1 -- 172.21.15.31:0/334163376 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93f0011920 con 0x7f93e40051d0 2024-09-17T05:37:01.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93f6000640 1 -- 172.21.15.31:0/334163376 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0011d70 con 0x7f93e40051d0 2024-09-17T05:37:01.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93ff200640 1 -- 172.21.15.31:0/334163376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94000ca680 con 0x7f93e40051d0 2024-09-17T05:37:01.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93ff200640 1 -- 172.21.15.31:0/334163376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94000cac40 con 0x7f93e40051d0 2024-09-17T05:37:01.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.848+0000 7f93ff200640 1 -- 172.21.15.31:0/334163376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94000d0aa0 con 0x7f93e40051d0 2024-09-17T05:37:01.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.852+0000 7f93f6000640 1 -- 172.21.15.31:0/334163376 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f93f0018070 con 0x7f93e40051d0 2024-09-17T05:37:01.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.852+0000 7f93f6000640 1 --2- 172.21.15.31:0/334163376 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f93e0073c50 0x7f93e0076110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:01.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.852+0000 7f93f6000640 1 -- 172.21.15.31:0/334163376 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f93f0093d80 con 0x7f93e40051d0 2024-09-17T05:37:01.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.852+0000 7f93fd400640 1 --2- 172.21.15.31:0/334163376 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f93e0073c50 0x7f93e0076110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:01.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.852+0000 7f93fd400640 1 --2- 172.21.15.31:0/334163376 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f93e0073c50 0x7f93e0076110 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f94001599e0 tx=0x7f93ec0093c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:01.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:01.856+0000 7f93f6000640 1 -- 172.21.15.31:0/334163376 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f93f0060660 con 0x7f93e40051d0 2024-09-17T05:37:02.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.032+0000 7f93ff200640 1 -- 172.21.15.31:0/334163376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f9400152d30 con 0x7f93e40051d0 2024-09-17T05:37:02.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.032+0000 7f93f6000640 1 -- 172.21.15.31:0/334163376 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v48)=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7f93f005ff60 con 0x7f93e40051d0 2024-09-17T05:37:02.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.032+0000 7f93ff200640 1 -- 172.21.15.31:0/334163376 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f93e0073c50 msgr2=0x7f93e0076110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:02.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.032+0000 7f93ff200640 1 --2- 172.21.15.31:0/334163376 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f93e0073c50 0x7f93e0076110 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f94001599e0 tx=0x7f93ec0093c0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.036+0000 7f93ff200640 1 -- 172.21.15.31:0/334163376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e40051d0 msgr2=0x7f94001526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:02.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.036+0000 7f93ff200640 1 --2- 172.21.15.31:0/334163376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e40051d0 0x7f94001526f0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f93f0001bf0 tx=0x7f93f0006740 comp rx=0 tx=0).stop 2024-09-17T05:37:02.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.036+0000 7f93ff200640 1 -- 172.21.15.31:0/334163376 shutdown_connections 2024-09-17T05:37:02.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.036+0000 7f93ff200640 1 --2- 172.21.15.31:0/334163376 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f93e0073c50 0x7f93e0076110 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.036+0000 7f93ff200640 1 --2- 172.21.15.31:0/334163376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94000ca150 0x7f94000c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.036+0000 7f93ff200640 1 --2- 172.21.15.31:0/334163376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9400152230 0x7f940014c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.036+0000 7f93ff200640 1 --2- 172.21.15.31:0/334163376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f93e40051d0 0x7f94001526f0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.036+0000 7f93ff200640 1 -- 172.21.15.31:0/334163376 >> 172.21.15.31:0/334163376 conn(0x7f940009aa10 msgr2=0x7f94000707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:02.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.036+0000 7f93ff200640 1 -- 172.21.15.31:0/334163376 shutdown_connections 2024-09-17T05:37:02.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.036+0000 7f93ff200640 1 -- 172.21.15.31:0/334163376 wait complete. 2024-09-17T05:37:02.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:02.057 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp38190/subvol85740) 2024-09-17T05:37:02.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:02.086 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-17T05:37:02.139 INFO:teuthology.orchestra.run.smithi031.stdout:cephfs_data 2024-09-17T05:37:02.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:02.139 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/subvol_grp38190/subvol85740) 2024-09-17T05:37:02.204 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:37:02.205 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/mnt.0/./volumes/subvol_grp38190/subvol85740/.meta 2024-09-17T05:37:02.275 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol85740 subvol_grp38190 2024-09-17T05:37:02.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.464+0000 7f46a9600640 1 -- 172.21.15.31:0/325334208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a415f700 msgr2=0x7f46a40d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:02.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.464+0000 7f46a9600640 1 --2- 172.21.15.31:0/325334208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a415f700 0x7f46a40d0720 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f469c009bc0 tx=0x7f469c01cb70 comp rx=0 tx=0).stop 2024-09-17T05:37:02.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.464+0000 7f46a9600640 1 -- 172.21.15.31:0/325334208 shutdown_connections 2024-09-17T05:37:02.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.464+0000 7f46a9600640 1 --2- 172.21.15.31:0/325334208 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a415f700 0x7f46a40d0720 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.464+0000 7f46a9600640 1 --2- 172.21.15.31:0/325334208 >> v2:172.21.15.155:3300/0 conn(0x7f46a40cff00 0x7f46a40d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.464+0000 7f46a9600640 1 -- 172.21.15.31:0/325334208 >> 172.21.15.31:0/325334208 conn(0x7f46a40d1da0 msgr2=0x7f46a40d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:02.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.464+0000 7f46a9600640 1 -- 172.21.15.31:0/325334208 shutdown_connections 2024-09-17T05:37:02.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.464+0000 7f46a9600640 1 -- 172.21.15.31:0/325334208 wait complete. 2024-09-17T05:37:02.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.464+0000 7f46a9600640 1 Processor -- start 2024-09-17T05:37:02.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f46a9600640 1 -- start start 2024-09-17T05:37:02.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f46a9600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a40cff00 0x7f46a414fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:02.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f46a9600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46a40d02e0 0x7f46a41485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:02.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f46a9600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46a415f700 0x7f46a4149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:02.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f46a9600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f46a40b0c50 con 0x7f46a40d02e0 2024-09-17T05:37:02.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f46a9600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f46a40b0ad0 con 0x7f46a415f700 2024-09-17T05:37:02.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f46a9600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f46a4168bf0 con 0x7f46a40cff00 2024-09-17T05:37:02.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f469be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46a40d02e0 0x7f46a41485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:02.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f469be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46a40d02e0 0x7f46a41485b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56098/0 (socket says 172.21.15.31:56098) 2024-09-17T05:37:02.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f469be00640 1 -- 172.21.15.31:0/550739489 learned_addr learned my addr 172.21.15.31:0/550739489 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:02.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f46a3e00640 1 --2- 172.21.15.31:0/550739489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a40cff00 0x7f46a414fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:02.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f46a8c00640 1 --2- 172.21.15.31:0/550739489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46a415f700 0x7f46a4149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:02.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f469be00640 1 -- 172.21.15.31:0/550739489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a40cff00 msgr2=0x7f46a414fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:02.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f469be00640 1 --2- 172.21.15.31:0/550739489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a40cff00 0x7f46a414fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f469be00640 1 -- 172.21.15.31:0/550739489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46a415f700 msgr2=0x7f46a4149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:02.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f469be00640 1 --2- 172.21.15.31:0/550739489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46a415f700 0x7f46a4149e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f469be00640 1 -- 172.21.15.31:0/550739489 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a4148af0 con 0x7f46a40d02e0 2024-09-17T05:37:02.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f469be00640 1 --2- 172.21.15.31:0/550739489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46a40d02e0 0x7f46a41485b0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f468c00c4d0 tx=0x7f468c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:02.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f46a0c00640 1 -- 172.21.15.31:0/550739489 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c016020 con 0x7f46a40d02e0 2024-09-17T05:37:02.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f46a0c00640 1 -- 172.21.15.31:0/550739489 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f468c012920 con 0x7f46a40d02e0 2024-09-17T05:37:02.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f46a0c00640 1 -- 172.21.15.31:0/550739489 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c012d30 con 0x7f46a40d02e0 2024-09-17T05:37:02.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f46a9600640 1 -- 172.21.15.31:0/550739489 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a4152d50 con 0x7f46a40d02e0 2024-09-17T05:37:02.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f46a9600640 1 -- 172.21.15.31:0/550739489 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a4153010 con 0x7f46a40d02e0 2024-09-17T05:37:02.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.468+0000 7f46a9600640 1 -- 172.21.15.31:0/550739489 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a40d28c0 con 0x7f46a40d02e0 2024-09-17T05:37:02.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.472+0000 7f46a0c00640 1 -- 172.21.15.31:0/550739489 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f468c019020 con 0x7f46a40d02e0 2024-09-17T05:37:02.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.472+0000 7f46a0c00640 1 --2- 172.21.15.31:0/550739489 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4680073c20 0x7f46800760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:02.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.472+0000 7f46a0c00640 1 -- 172.21.15.31:0/550739489 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f468c092bf0 con 0x7f46a40d02e0 2024-09-17T05:37:02.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.472+0000 7f46a3e00640 1 --2- 172.21.15.31:0/550739489 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4680073c20 0x7f46800760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:02.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.472+0000 7f46a3e00640 1 --2- 172.21.15.31:0/550739489 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4680073c20 0x7f46800760e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4694009be0 tx=0x7f46940091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:02.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.476+0000 7f46a0c00640 1 -- 172.21.15.31:0/550739489 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f468c020020 con 0x7f46a40d02e0 2024-09-17T05:37:02.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.680+0000 7f46a9600640 1 -- 172.21.15.31:0/550739489 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol85740", "group_name": "subvol_grp38190", "target": ["mon-mgr", ""]}) -- 0x7f46a4069e60 con 0x7f4680073c20 2024-09-17T05:37:02.688 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:37:02.684+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:37:02.689 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:37:02.684+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:37:02.689 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:37:02.684+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:37:02.689 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:37:02.684+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:37:02.689 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:37:02.684+0000 7f46f6e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:37:02.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.732+0000 7f46a0c00640 1 -- 172.21.15.31:0/550739489 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4694004040 con 0x7f4680073c20 2024-09-17T05:37:02.735 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/subvol_grp38190/subvol85740 2024-09-17T05:37:02.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.732+0000 7f46a9600640 1 -- 172.21.15.31:0/550739489 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4680073c20 msgr2=0x7f46800760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:02.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.732+0000 7f46a9600640 1 --2- 172.21.15.31:0/550739489 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4680073c20 0x7f46800760e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4694009be0 tx=0x7f46940091e0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.736+0000 7f46a9600640 1 -- 172.21.15.31:0/550739489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46a40d02e0 msgr2=0x7f46a41485b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:02.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.736+0000 7f46a9600640 1 --2- 172.21.15.31:0/550739489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46a40d02e0 0x7f46a41485b0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f468c00c4d0 tx=0x7f468c00c990 comp rx=0 tx=0).stop 2024-09-17T05:37:02.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.736+0000 7f46a9600640 1 -- 172.21.15.31:0/550739489 shutdown_connections 2024-09-17T05:37:02.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.736+0000 7f46a9600640 1 --2- 172.21.15.31:0/550739489 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4680073c20 0x7f46800760e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.736+0000 7f46a9600640 1 --2- 172.21.15.31:0/550739489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46a415f700 0x7f46a4149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.736+0000 7f46a9600640 1 --2- 172.21.15.31:0/550739489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46a40d02e0 0x7f46a41485b0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.736+0000 7f46a9600640 1 --2- 172.21.15.31:0/550739489 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a40cff00 0x7f46a414fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.736+0000 7f46a9600640 1 -- 172.21.15.31:0/550739489 >> 172.21.15.31:0/550739489 conn(0x7f46a40d1da0 msgr2=0x7f46a4150de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:02.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.736+0000 7f46a9600640 1 -- 172.21.15.31:0/550739489 shutdown_connections 2024-09-17T05:37:02.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.736+0000 7f46a9600640 1 -- 172.21.15.31:0/550739489 wait complete. 2024-09-17T05:37:02.757 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol85740 subvol_grp38190 2024-09-17T05:37:02.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a9c00640 1 -- 172.21.15.31:0/2911216411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32a40d28e0 msgr2=0x7f32a40d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:02.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a9c00640 1 --2- 172.21.15.31:0/2911216411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32a40d28e0 0x7f32a40d0170 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f328c009840 tx=0x7f328c01c820 comp rx=0 tx=0).stop 2024-09-17T05:37:02.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a9c00640 1 -- 172.21.15.31:0/2911216411 shutdown_connections 2024-09-17T05:37:02.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a9c00640 1 --2- 172.21.15.31:0/2911216411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32a40d28e0 0x7f32a40d0170 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a9c00640 1 --2- 172.21.15.31:0/2911216411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32a415f390 0x7f32a40cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a9c00640 1 -- 172.21.15.31:0/2911216411 >> 172.21.15.31:0/2911216411 conn(0x7f32a40d1dc0 msgr2=0x7f32a40d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:02.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a9c00640 1 -- 172.21.15.31:0/2911216411 shutdown_connections 2024-09-17T05:37:02.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a9c00640 1 -- 172.21.15.31:0/2911216411 wait complete. 2024-09-17T05:37:02.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a9c00640 1 Processor -- start 2024-09-17T05:37:02.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a9c00640 1 -- start start 2024-09-17T05:37:02.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a9c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32a40d06b0 0x7f32a414a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:02.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a9c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32a40d28e0 0x7f32a4070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:02.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a9c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32a415f390 0x7f32a4070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:02.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a9c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f32a41690b0 con 0x7f32a415f390 2024-09-17T05:37:02.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a9c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f32a4168f30 con 0x7f32a40d06b0 2024-09-17T05:37:02.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a9c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f32a4169230 con 0x7f32a40d28e0 2024-09-17T05:37:02.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32a415f390 0x7f32a4070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:02.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32a415f390 0x7f32a4070fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56112/0 (socket says 172.21.15.31:56112) 2024-09-17T05:37:02.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a3400640 1 -- 172.21.15.31:0/2508863696 learned_addr learned my addr 172.21.15.31:0/2508863696 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:02.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f329be00640 1 --2- 172.21.15.31:0/2508863696 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32a40d28e0 0x7f32a4070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:02.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a2a00640 1 --2- 172.21.15.31:0/2508863696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32a40d06b0 0x7f32a414a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:02.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a3400640 1 -- 172.21.15.31:0/2508863696 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32a40d28e0 msgr2=0x7f32a4070a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:02.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a3400640 1 --2- 172.21.15.31:0/2508863696 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32a40d28e0 0x7f32a4070a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a3400640 1 -- 172.21.15.31:0/2508863696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32a40d06b0 msgr2=0x7f32a414a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:02.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a3400640 1 --2- 172.21.15.31:0/2508863696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32a40d06b0 0x7f32a414a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:02.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.908+0000 7f32a3400640 1 -- 172.21.15.31:0/2508863696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a414a9c0 con 0x7f32a415f390 2024-09-17T05:37:02.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.912+0000 7f32a3400640 1 --2- 172.21.15.31:0/2508863696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32a415f390 0x7f32a4070fa0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f329c00c730 tx=0x7f329c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:02.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.912+0000 7f329aa00640 1 -- 172.21.15.31:0/2508863696 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c003db0 con 0x7f32a415f390 2024-09-17T05:37:02.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.912+0000 7f329aa00640 1 -- 172.21.15.31:0/2508863696 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f329c00ce40 con 0x7f32a415f390 2024-09-17T05:37:02.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.912+0000 7f329aa00640 1 -- 172.21.15.31:0/2508863696 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c0052d0 con 0x7f32a415f390 2024-09-17T05:37:02.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.912+0000 7f32a9c00640 1 -- 172.21.15.31:0/2508863696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a40b6a80 con 0x7f32a415f390 2024-09-17T05:37:02.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.912+0000 7f32a9c00640 1 -- 172.21.15.31:0/2508863696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a406ddd0 con 0x7f32a415f390 2024-09-17T05:37:02.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.912+0000 7f32a9c00640 1 -- 172.21.15.31:0/2508863696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a40b1350 con 0x7f32a415f390 2024-09-17T05:37:02.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.912+0000 7f329aa00640 1 -- 172.21.15.31:0/2508863696 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7f329c005470 con 0x7f32a415f390 2024-09-17T05:37:02.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.912+0000 7f329aa00640 1 --2- 172.21.15.31:0/2508863696 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3280073c20 0x7f32800760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:02.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.912+0000 7f329aa00640 1 -- 172.21.15.31:0/2508863696 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f329c095690 con 0x7f32a415f390 2024-09-17T05:37:02.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.912+0000 7f32a2a00640 1 --2- 172.21.15.31:0/2508863696 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3280073c20 0x7f32800760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:02.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.916+0000 7f32a2a00640 1 --2- 172.21.15.31:0/2508863696 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3280073c20 0x7f32800760e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f32a40b2e40 tx=0x7f329400b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:02.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:02.916+0000 7f329aa00640 1 -- 172.21.15.31:0/2508863696 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f329c05ed10 con 0x7f32a415f390 2024-09-17T05:37:03.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.124+0000 7f32a9c00640 1 -- 172.21.15.31:0/2508863696 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol85740", "group_name": "subvol_grp38190", "target": ["mon-mgr", ""]}) -- 0x7f32a4154ae0 con 0x7f3280073c20 2024-09-17T05:37:03.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.128+0000 7f329aa00640 1 -- 172.21.15.31:0/2508863696 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f32a4154ae0 con 0x7f3280073c20 2024-09-17T05:37:03.131 INFO:teuthology.orchestra.run.smithi031.stdout:/volumes/subvol_grp38190/subvol85740 2024-09-17T05:37:03.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.132+0000 7f32a9c00640 1 -- 172.21.15.31:0/2508863696 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3280073c20 msgr2=0x7f32800760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:03.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.132+0000 7f32a9c00640 1 --2- 172.21.15.31:0/2508863696 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3280073c20 0x7f32800760e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f32a40b2e40 tx=0x7f329400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.132+0000 7f32a9c00640 1 -- 172.21.15.31:0/2508863696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32a415f390 msgr2=0x7f32a4070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:03.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.132+0000 7f32a9c00640 1 --2- 172.21.15.31:0/2508863696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32a415f390 0x7f32a4070fa0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f329c00c730 tx=0x7f329c00cbf0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.132+0000 7f32a9c00640 1 -- 172.21.15.31:0/2508863696 shutdown_connections 2024-09-17T05:37:03.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.132+0000 7f32a9c00640 1 --2- 172.21.15.31:0/2508863696 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3280073c20 0x7f32800760e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.132+0000 7f32a9c00640 1 --2- 172.21.15.31:0/2508863696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f32a415f390 0x7f32a4070fa0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.132+0000 7f32a9c00640 1 --2- 172.21.15.31:0/2508863696 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32a40d28e0 0x7f32a4070a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.132+0000 7f32a9c00640 1 --2- 172.21.15.31:0/2508863696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32a40d06b0 0x7f32a414a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.132+0000 7f32a9c00640 1 -- 172.21.15.31:0/2508863696 >> 172.21.15.31:0/2508863696 conn(0x7f32a40d1dc0 msgr2=0x7f32a415b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:03.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.132+0000 7f32a9c00640 1 -- 172.21.15.31:0/2508863696 shutdown_connections 2024-09-17T05:37:03.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.132+0000 7f32a9c00640 1 -- 172.21.15.31:0/2508863696 wait complete. 2024-09-17T05:37:03.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:03.152 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/902f8504fb32b5c62861b0d4925b178d.meta) 2024-09-17T05:37:03.179 INFO:teuthology.orchestra.run.smithi031.stdout:[GLOBAL] 2024-09-17T05:37:03.179 INFO:teuthology.orchestra.run.smithi031.stdout:version = 1 2024-09-17T05:37:03.179 INFO:teuthology.orchestra.run.smithi031.stdout:type = subvolume 2024-09-17T05:37:03.179 INFO:teuthology.orchestra.run.smithi031.stdout:path = /volumes/subvol_grp38190/subvol85740 2024-09-17T05:37:03.179 INFO:teuthology.orchestra.run.smithi031.stdout:state = complete 2024-09-17T05:37:03.179 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:37:03.181 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol85740 subvol_grp38190 2024-09-17T05:37:03.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.372+0000 7efcdde00640 1 -- 172.21.15.31:0/3357395475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcd80aef60 msgr2=0x7efcd80ae660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:03.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.372+0000 7efcdde00640 1 --2- 172.21.15.31:0/3357395475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcd80aef60 0x7efcd80ae660 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7efcd80708c0 tx=0x7efcc001c770 comp rx=0 tx=0).stop 2024-09-17T05:37:03.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.372+0000 7efcdde00640 1 -- 172.21.15.31:0/3357395475 shutdown_connections 2024-09-17T05:37:03.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.372+0000 7efcdde00640 1 --2- 172.21.15.31:0/3357395475 >> v2:172.21.15.155:3300/0 conn(0x7efcd815e740 0x7efcd815ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.372+0000 7efcdde00640 1 --2- 172.21.15.31:0/3357395475 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcd80aef60 0x7efcd80ae660 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.372+0000 7efcdde00640 1 -- 172.21.15.31:0/3357395475 >> 172.21.15.31:0/3357395475 conn(0x7efcd80cfbc0 msgr2=0x7efcd80cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:03.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.372+0000 7efcdde00640 1 -- 172.21.15.31:0/3357395475 shutdown_connections 2024-09-17T05:37:03.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.372+0000 7efcdde00640 1 -- 172.21.15.31:0/3357395475 wait complete. 2024-09-17T05:37:03.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcdde00640 1 Processor -- start 2024-09-17T05:37:03.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcdde00640 1 -- start start 2024-09-17T05:37:03.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcdde00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcd80aef60 0x7efcd814c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:03.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcdde00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcd815e360 0x7efcd809b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:03.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcdde00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcd815e740 0x7efcd8155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:03.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcdde00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efcd81680b0 con 0x7efcd80aef60 2024-09-17T05:37:03.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcdde00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efcd8167f30 con 0x7efcd815e360 2024-09-17T05:37:03.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcdde00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efcd8168230 con 0x7efcd815e740 2024-09-17T05:37:03.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcd6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcd80aef60 0x7efcd814c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:03.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcd6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcd80aef60 0x7efcd814c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56126/0 (socket says 172.21.15.31:56126) 2024-09-17T05:37:03.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcd6a00640 1 -- 172.21.15.31:0/2865353879 learned_addr learned my addr 172.21.15.31:0/2865353879 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:03.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efccfe00640 1 --2- 172.21.15.31:0/2865353879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcd815e360 0x7efcd809b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:03.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcd7400640 1 --2- 172.21.15.31:0/2865353879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcd815e740 0x7efcd8155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:03.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcd6a00640 1 -- 172.21.15.31:0/2865353879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcd815e740 msgr2=0x7efcd8155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:03.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcd6a00640 1 --2- 172.21.15.31:0/2865353879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcd815e740 0x7efcd8155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcd6a00640 1 -- 172.21.15.31:0/2865353879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcd815e360 msgr2=0x7efcd809b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:03.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcd6a00640 1 --2- 172.21.15.31:0/2865353879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcd815e360 0x7efcd809b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcd6a00640 1 -- 172.21.15.31:0/2865353879 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd809bd20 con 0x7efcd80aef60 2024-09-17T05:37:03.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcd7400640 1 --2- 172.21.15.31:0/2865353879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcd815e740 0x7efcd8155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:03.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcd6a00640 1 --2- 172.21.15.31:0/2865353879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcd80aef60 0x7efcd814c700 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7efcc800c500 tx=0x7efcc800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:03.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efccf400640 1 -- 172.21.15.31:0/2865353879 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8017070 con 0x7efcd80aef60 2024-09-17T05:37:03.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efccf400640 1 -- 172.21.15.31:0/2865353879 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efcc8003600 con 0x7efcd80aef60 2024-09-17T05:37:03.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efccf400640 1 -- 172.21.15.31:0/2865353879 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8003a90 con 0x7efcd80aef60 2024-09-17T05:37:03.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcdde00640 1 -- 172.21.15.31:0/2865353879 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd809c000 con 0x7efcd80aef60 2024-09-17T05:37:03.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcdde00640 1 -- 172.21.15.31:0/2865353879 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd809c5c0 con 0x7efcd80aef60 2024-09-17T05:37:03.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.376+0000 7efcdde00640 1 -- 172.21.15.31:0/2865353879 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd8069410 con 0x7efcd80aef60 2024-09-17T05:37:03.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.380+0000 7efccf400640 1 -- 172.21.15.31:0/2865353879 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7efcc801a070 con 0x7efcd80aef60 2024-09-17T05:37:03.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.380+0000 7efccf400640 1 --2- 172.21.15.31:0/2865353879 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efcb4073c50 0x7efcb4076110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:03.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.380+0000 7efccf400640 1 -- 172.21.15.31:0/2865353879 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7efcc80921b0 con 0x7efcd80aef60 2024-09-17T05:37:03.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.380+0000 7efccfe00640 1 --2- 172.21.15.31:0/2865353879 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efcb4073c50 0x7efcb4076110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:03.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.380+0000 7efccfe00640 1 --2- 172.21.15.31:0/2865353879 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efcb4073c50 0x7efcb4076110 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efcc00af000 tx=0x7efcc001afb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:03.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.384+0000 7efccf400640 1 -- 172.21.15.31:0/2865353879 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7efcc805eb50 con 0x7efcd80aef60 2024-09-17T05:37:03.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.588+0000 7efcdde00640 1 -- 172.21.15.31:0/2865353879 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol85740", "group_name": "subvol_grp38190", "target": ["mon-mgr", ""]}) -- 0x7efcd80d0850 con 0x7efcb4073c50 2024-09-17T05:37:03.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.620+0000 7efccf400640 1 -- 172.21.15.31:0/2865353879 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efcd80d0850 con 0x7efcb4073c50 2024-09-17T05:37:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.624+0000 7efcdde00640 1 -- 172.21.15.31:0/2865353879 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efcb4073c50 msgr2=0x7efcb4076110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.624+0000 7efcdde00640 1 --2- 172.21.15.31:0/2865353879 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efcb4073c50 0x7efcb4076110 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efcc00af000 tx=0x7efcc001afb0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.624+0000 7efcdde00640 1 -- 172.21.15.31:0/2865353879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcd80aef60 msgr2=0x7efcd814c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.624+0000 7efcdde00640 1 --2- 172.21.15.31:0/2865353879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcd80aef60 0x7efcd814c700 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7efcc800c500 tx=0x7efcc800c9c0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.624+0000 7efcdde00640 1 -- 172.21.15.31:0/2865353879 shutdown_connections 2024-09-17T05:37:03.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.624+0000 7efcdde00640 1 --2- 172.21.15.31:0/2865353879 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efcb4073c50 0x7efcb4076110 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.624+0000 7efcdde00640 1 --2- 172.21.15.31:0/2865353879 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcd815e740 0x7efcd8155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.624+0000 7efcdde00640 1 --2- 172.21.15.31:0/2865353879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcd815e360 0x7efcd809b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.624+0000 7efcdde00640 1 --2- 172.21.15.31:0/2865353879 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efcd80aef60 0x7efcd814c700 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.624+0000 7efcdde00640 1 -- 172.21.15.31:0/2865353879 >> 172.21.15.31:0/2865353879 conn(0x7efcd80cfbc0 msgr2=0x7efcd8163e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:03.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.624+0000 7efcdde00640 1 -- 172.21.15.31:0/2865353879 shutdown_connections 2024-09-17T05:37:03.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.624+0000 7efcdde00640 1 -- 172.21.15.31:0/2865353879 wait complete. 2024-09-17T05:37:03.629 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:37:03.628+0000 7f46fa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:37:03.629 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:37:03.628+0000 7f46fa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:37:03.629 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:37:03.628+0000 7f46fa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:37:03.630 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:37:03.628+0000 7f46fa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:37:03.630 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:37:03.628+0000 7f46fa000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:37:03.648 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:37:03.644+0000 7f46f9600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:37:03.648 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:37:03.644+0000 7f46f9600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:37:03.648 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:37:03.644+0000 7f46f9600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:37:03.648 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:37:03.644+0000 7f46f9600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:37:03.648 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-17T05:37:03.644+0000 7f46f9600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:37:03.649 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:37:03.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:37:03.722 INFO:teuthology.orchestra.run.smithi031.stdout:2 2024-09-17T05:37:03.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:37:03.730 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp38190 2024-09-17T05:37:03.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7ee000640 1 -- 172.21.15.31:0/2614391006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7e8073f50 msgr2=0x7fd7e815e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:03.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7ee000640 1 --2- 172.21.15.31:0/2614391006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7e8073f50 0x7fd7e815e790 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80cdf00 tx=0x7fd7d001c7e0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7ee000640 1 -- 172.21.15.31:0/2614391006 shutdown_connections 2024-09-17T05:37:03.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7ee000640 1 --2- 172.21.15.31:0/2614391006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7e8073f50 0x7fd7e815e790 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7ee000640 1 --2- 172.21.15.31:0/2614391006 >> v2:172.21.15.155:3300/0 conn(0x7fd7e81585f0 0x7fd7e8073a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7ee000640 1 -- 172.21.15.31:0/2614391006 >> 172.21.15.31:0/2614391006 conn(0x7fd7e80cce90 msgr2=0x7fd7e80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:03.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7ee000640 1 -- 172.21.15.31:0/2614391006 shutdown_connections 2024-09-17T05:37:03.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7ee000640 1 -- 172.21.15.31:0/2614391006 wait complete. 2024-09-17T05:37:03.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7ee000640 1 Processor -- start 2024-09-17T05:37:03.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7ee000640 1 -- start start 2024-09-17T05:37:03.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7ee000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7e8073f50 0x7fd7e80b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:03.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7ee000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7e81585f0 0x7fd7e8155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:03.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7ee000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7e815ecd0 0x7fd7e80b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:03.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7ee000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e8167ec0 con 0x7fd7e815ecd0 2024-09-17T05:37:03.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7ee000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e8167d40 con 0x7fd7e81585f0 2024-09-17T05:37:03.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7ee000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e8168040 con 0x7fd7e8073f50 2024-09-17T05:37:03.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7e7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7e815ecd0 0x7fd7e80b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:03.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7e7400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7e8073f50 0x7fd7e80b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:03.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7e7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7e815ecd0 0x7fd7e80b1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56180/0 (socket says 172.21.15.31:56180) 2024-09-17T05:37:03.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7e7e00640 1 -- 172.21.15.31:0/3685742190 learned_addr learned my addr 172.21.15.31:0/3685742190 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:03.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7dfe00640 1 --2- 172.21.15.31:0/3685742190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7e81585f0 0x7fd7e8155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:03.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7e7e00640 1 -- 172.21.15.31:0/3685742190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7e8073f50 msgr2=0x7fd7e80b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:03.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7e7e00640 1 --2- 172.21.15.31:0/3685742190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7e8073f50 0x7fd7e80b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7e7e00640 1 -- 172.21.15.31:0/3685742190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7e81585f0 msgr2=0x7fd7e8155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:03.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.880+0000 7fd7e7e00640 1 --2- 172.21.15.31:0/3685742190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7e81585f0 0x7fd7e8155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:03.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.884+0000 7fd7e7e00640 1 -- 172.21.15.31:0/3685742190 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e81561a0 con 0x7fd7e815ecd0 2024-09-17T05:37:03.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.884+0000 7fd7e7e00640 1 --2- 172.21.15.31:0/3685742190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7e815ecd0 0x7fd7e80b1450 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fd7e000c760 tx=0x7fd7e000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:03.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.884+0000 7fd7df400640 1 -- 172.21.15.31:0/3685742190 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0003db0 con 0x7fd7e815ecd0 2024-09-17T05:37:03.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.884+0000 7fd7df400640 1 -- 172.21.15.31:0/3685742190 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7e000ce10 con 0x7fd7e815ecd0 2024-09-17T05:37:03.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.884+0000 7fd7df400640 1 -- 172.21.15.31:0/3685742190 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00052d0 con 0x7fd7e815ecd0 2024-09-17T05:37:03.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.884+0000 7fd7ee000640 1 -- 172.21.15.31:0/3685742190 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e8156480 con 0x7fd7e815ecd0 2024-09-17T05:37:03.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.884+0000 7fd7ee000640 1 -- 172.21.15.31:0/3685742190 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e8156a40 con 0x7fd7e815ecd0 2024-09-17T05:37:03.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.884+0000 7fd7ee000640 1 -- 172.21.15.31:0/3685742190 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e815e790 con 0x7fd7e815ecd0 2024-09-17T05:37:03.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.884+0000 7fd7df400640 1 -- 172.21.15.31:0/3685742190 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 26) ==== 98152+0+0 (secure 0 0 0) 0x7fd7e0005470 con 0x7fd7e815ecd0 2024-09-17T05:37:03.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.884+0000 7fd7df400640 1 --2- 172.21.15.31:0/3685742190 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd7c4073c50 0x7fd7c4076110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:03.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.884+0000 7fd7df400640 1 -- 172.21.15.31:0/3685742190 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7fd7e0095670 con 0x7fd7e815ecd0 2024-09-17T05:37:03.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.884+0000 7fd7e7400640 1 --2- 172.21.15.31:0/3685742190 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd7c4073c50 0x7fd7c4076110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:03.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.888+0000 7fd7e7400640 1 --2- 172.21.15.31:0/3685742190 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd7c4073c50 0x7fd7c4076110 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800bc00 tx=0x7fd7d800b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:03.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:03.888+0000 7fd7df400640 1 -- 172.21.15.31:0/3685742190 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fd7e005ece0 con 0x7fd7e815ecd0 2024-09-17T05:37:04.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.088+0000 7fd7ee000640 1 -- 172.21.15.31:0/3685742190 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp38190", "target": ["mon-mgr", ""]}) -- 0x7fd7e8068e70 con 0x7fd7c4073c50 2024-09-17T05:37:04.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.092+0000 7fd7df400640 1 -- 172.21.15.31:0/3685742190 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd7e8068e70 con 0x7fd7c4073c50 2024-09-17T05:37:04.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.096+0000 7fd7ee000640 1 -- 172.21.15.31:0/3685742190 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd7c4073c50 msgr2=0x7fd7c4076110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.096+0000 7fd7ee000640 1 --2- 172.21.15.31:0/3685742190 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd7c4073c50 0x7fd7c4076110 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800bc00 tx=0x7fd7d800b390 comp rx=0 tx=0).stop 2024-09-17T05:37:04.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.096+0000 7fd7ee000640 1 -- 172.21.15.31:0/3685742190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7e815ecd0 msgr2=0x7fd7e80b1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.096+0000 7fd7ee000640 1 --2- 172.21.15.31:0/3685742190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7e815ecd0 0x7fd7e80b1450 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fd7e000c760 tx=0x7fd7e000cc20 comp rx=0 tx=0).stop 2024-09-17T05:37:04.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.096+0000 7fd7ee000640 1 -- 172.21.15.31:0/3685742190 shutdown_connections 2024-09-17T05:37:04.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.096+0000 7fd7ee000640 1 --2- 172.21.15.31:0/3685742190 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd7c4073c50 0x7fd7c4076110 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.096+0000 7fd7ee000640 1 --2- 172.21.15.31:0/3685742190 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7e815ecd0 0x7fd7e80b1450 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.096+0000 7fd7ee000640 1 --2- 172.21.15.31:0/3685742190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7e81585f0 0x7fd7e8155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.096+0000 7fd7ee000640 1 --2- 172.21.15.31:0/3685742190 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd7e8073f50 0x7fd7e80b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.096+0000 7fd7ee000640 1 -- 172.21.15.31:0/3685742190 >> 172.21.15.31:0/3685742190 conn(0x7fd7e80cce90 msgr2=0x7fd7e8153e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:04.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.096+0000 7fd7ee000640 1 -- 172.21.15.31:0/3685742190 shutdown_connections 2024-09-17T05:37:04.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.096+0000 7fd7ee000640 1 -- 172.21.15.31:0/3685742190 wait complete. 2024-09-17T05:37:04.117 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:37:04.117 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:37:04.203 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:37:04.291 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:37:04.292 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:37:04.292 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:37:04.292 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:04.302 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:37:04.302 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:04.353 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:37:04.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.540+0000 7f95a6c00640 1 -- 172.21.15.31:0/3526985093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95a0159990 msgr2=0x7f95a00d0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.540+0000 7f95a6c00640 1 --2- 172.21.15.31:0/3526985093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95a0159990 0x7f95a00d0420 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f9590009900 tx=0x7f959001c8e0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.540+0000 7f95a6c00640 1 -- 172.21.15.31:0/3526985093 shutdown_connections 2024-09-17T05:37:04.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.540+0000 7f95a6c00640 1 --2- 172.21.15.31:0/3526985093 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95a00afac0 0x7f95a00d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.540+0000 7f95a6c00640 1 --2- 172.21.15.31:0/3526985093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95a0159990 0x7f95a00d0420 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.540+0000 7f95a6c00640 1 -- 172.21.15.31:0/3526985093 >> 172.21.15.31:0/3526985093 conn(0x7f95a00b2240 msgr2=0x7f95a00b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:04.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.540+0000 7f95a6c00640 1 -- 172.21.15.31:0/3526985093 shutdown_connections 2024-09-17T05:37:04.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.540+0000 7f95a6c00640 1 -- 172.21.15.31:0/3526985093 wait complete. 2024-09-17T05:37:04.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.540+0000 7f95a6c00640 1 Processor -- start 2024-09-17T05:37:04.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f95a6c00640 1 -- start start 2024-09-17T05:37:04.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f95a6c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95a006f1d0 0x7f95a00b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:04.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f95a6c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95a00afac0 0x7f95a015ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:04.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f95a6c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95a0159990 0x7f95a015f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:04.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f95a6c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f95a01691e0 con 0x7f95a006f1d0 2024-09-17T05:37:04.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f95a6c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f95a0169060 con 0x7f95a0159990 2024-09-17T05:37:04.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f95a6c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f95a0169360 con 0x7f95a00afac0 2024-09-17T05:37:04.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f959fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95a006f1d0 0x7f95a00b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:04.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f959fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95a006f1d0 0x7f95a00b4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56198/0 (socket says 172.21.15.31:56198) 2024-09-17T05:37:04.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f959fe00640 1 -- 172.21.15.31:0/3285356354 learned_addr learned my addr 172.21.15.31:0/3285356354 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:04.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f959fe00640 1 -- 172.21.15.31:0/3285356354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95a00afac0 msgr2=0x7f95a015ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f959fe00640 1 --2- 172.21.15.31:0/3285356354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95a00afac0 0x7f95a015ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f959fe00640 1 -- 172.21.15.31:0/3285356354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95a0159990 msgr2=0x7f95a015f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f959fe00640 1 --2- 172.21.15.31:0/3285356354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95a0159990 0x7f95a015f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f959fe00640 1 -- 172.21.15.31:0/3285356354 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a00ce220 con 0x7f95a006f1d0 2024-09-17T05:37:04.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f959fe00640 1 --2- 172.21.15.31:0/3285356354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95a006f1d0 0x7f95a00b4be0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f95900b0040 tx=0x7f9590004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:04.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f959cc00640 1 -- 172.21.15.31:0/3285356354 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95900b2040 con 0x7f95a006f1d0 2024-09-17T05:37:04.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f959cc00640 1 -- 172.21.15.31:0/3285356354 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9590005030 con 0x7f95a006f1d0 2024-09-17T05:37:04.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f95a6c00640 1 -- 172.21.15.31:0/3285356354 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a00ce500 con 0x7f95a006f1d0 2024-09-17T05:37:04.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f959cc00640 1 -- 172.21.15.31:0/3285356354 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9590005460 con 0x7f95a006f1d0 2024-09-17T05:37:04.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f95a6c00640 1 -- 172.21.15.31:0/3285356354 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a00ceac0 con 0x7f95a006f1d0 2024-09-17T05:37:04.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.544+0000 7f95a6c00640 1 -- 172.21.15.31:0/3285356354 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a006cc20 con 0x7f95a006f1d0 2024-09-17T05:37:04.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.548+0000 7f959cc00640 1 -- 172.21.15.31:0/3285356354 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f95900be060 con 0x7f95a006f1d0 2024-09-17T05:37:04.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.548+0000 7f959cc00640 1 --2- 172.21.15.31:0/3285356354 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f957c073dd0 0x7f957c076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:04.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.548+0000 7f959cc00640 1 -- 172.21.15.31:0/3285356354 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f959012c370 con 0x7f95a006f1d0 2024-09-17T05:37:04.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.548+0000 7f9597e00640 1 --2- 172.21.15.31:0/3285356354 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f957c073dd0 0x7f957c076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:04.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.548+0000 7f9597e00640 1 --2- 172.21.15.31:0/3285356354 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f957c073dd0 0x7f957c076290 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f95a015c1f0 tx=0x7f9588006c90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:04.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.552+0000 7f959cc00640 1 -- 172.21.15.31:0/3285356354 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f95900164d0 con 0x7f95a006f1d0 2024-09-17T05:37:04.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.740+0000 7f95a6c00640 1 -- 172.21.15.31:0/3285356354 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f95a0068a80 con 0x7f95a006f1d0 2024-09-17T05:37:04.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.740+0000 7f959cc00640 1 -- 172.21.15.31:0/3285356354 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v163) ==== 80+0+0 (secure 0 0 0) 0x7f95900f8c10 con 0x7f95a006f1d0 2024-09-17T05:37:04.744 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:37:04.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.744+0000 7f95a6c00640 1 -- 172.21.15.31:0/3285356354 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f957c073dd0 msgr2=0x7f957c076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.744+0000 7f95a6c00640 1 --2- 172.21.15.31:0/3285356354 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f957c073dd0 0x7f957c076290 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f95a015c1f0 tx=0x7f9588006c90 comp rx=0 tx=0).stop 2024-09-17T05:37:04.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.744+0000 7f95a6c00640 1 -- 172.21.15.31:0/3285356354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95a006f1d0 msgr2=0x7f95a00b4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:04.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.744+0000 7f95a6c00640 1 --2- 172.21.15.31:0/3285356354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95a006f1d0 0x7f95a00b4be0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f95900b0040 tx=0x7f9590004040 comp rx=0 tx=0).stop 2024-09-17T05:37:04.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.744+0000 7f95a6c00640 1 -- 172.21.15.31:0/3285356354 shutdown_connections 2024-09-17T05:37:04.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.744+0000 7f95a6c00640 1 --2- 172.21.15.31:0/3285356354 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f957c073dd0 0x7f957c076290 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.744+0000 7f95a6c00640 1 --2- 172.21.15.31:0/3285356354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95a0159990 0x7f95a015f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.744+0000 7f95a6c00640 1 --2- 172.21.15.31:0/3285356354 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95a00afac0 0x7f95a015ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.744+0000 7f95a6c00640 1 --2- 172.21.15.31:0/3285356354 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95a006f1d0 0x7f95a00b4be0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:04.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.744+0000 7f95a6c00640 1 -- 172.21.15.31:0/3285356354 >> 172.21.15.31:0/3285356354 conn(0x7f95a00b2240 msgr2=0x7f95a01552a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:04.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.744+0000 7f95a6c00640 1 -- 172.21.15.31:0/3285356354 shutdown_connections 2024-09-17T05:37:04.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:04.744+0000 7f95a6c00640 1 -- 172.21.15.31:0/3285356354 wait complete. 2024-09-17T05:37:04.765 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T05:37:04.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:04.765 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T05:37:04.817 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:37:04.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:04.818 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:37:04.838 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:37:04.838 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:37:04.838 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:04.848 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:37:04.848 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:04.904 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:37:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8178600640 1 -- 172.21.15.31:0/1687596505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81700cd100 msgr2=0x7f81700b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8178600640 1 --2- 172.21.15.31:0/1687596505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81700cd100 0x7f81700b42d0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f815c00aa10 tx=0x7f815c01dba0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8178600640 1 -- 172.21.15.31:0/1687596505 shutdown_connections 2024-09-17T05:37:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8178600640 1 --2- 172.21.15.31:0/1687596505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81700cd100 0x7f81700b42d0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8178600640 1 --2- 172.21.15.31:0/1687596505 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f817015dae0 0x7f81700acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8178600640 1 -- 172.21.15.31:0/1687596505 >> 172.21.15.31:0/1687596505 conn(0x7f81700b18f0 msgr2=0x7f81700b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8178600640 1 -- 172.21.15.31:0/1687596505 shutdown_connections 2024-09-17T05:37:05.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8178600640 1 -- 172.21.15.31:0/1687596505 wait complete. 2024-09-17T05:37:05.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8178600640 1 Processor -- start 2024-09-17T05:37:05.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8178600640 1 -- start start 2024-09-17T05:37:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8178600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81700b4810 0x7f8170157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8178600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81700cd100 0x7f817014cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8178600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f817015dae0 0x7f817015a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8178600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f81701674b0 con 0x7f81700cd100 2024-09-17T05:37:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8178600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8170167330 con 0x7f817015dae0 2024-09-17T05:37:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8178600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8170167630 con 0x7f81700b4810 2024-09-17T05:37:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8175200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81700cd100 0x7f817014cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8175200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81700cd100 0x7f817014cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56222/0 (socket says 172.21.15.31:56222) 2024-09-17T05:37:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.052+0000 7f8175200640 1 -- 172.21.15.31:0/227442921 learned_addr learned my addr 172.21.15.31:0/227442921 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.056+0000 7f8175c00640 1 --2- 172.21.15.31:0/227442921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81700b4810 0x7f8170157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.056+0000 7f8176600640 1 --2- 172.21.15.31:0/227442921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f817015dae0 0x7f817015a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.056+0000 7f8175200640 1 -- 172.21.15.31:0/227442921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81700b4810 msgr2=0x7f8170157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.056+0000 7f8175200640 1 --2- 172.21.15.31:0/227442921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81700b4810 0x7f8170157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.056+0000 7f8175200640 1 -- 172.21.15.31:0/227442921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f817015dae0 msgr2=0x7f817015a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.056+0000 7f8175200640 1 --2- 172.21.15.31:0/227442921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f817015dae0 0x7f817015a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.056+0000 7f8175200640 1 -- 172.21.15.31:0/227442921 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8170155350 con 0x7f81700cd100 2024-09-17T05:37:05.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.056+0000 7f8175200640 1 --2- 172.21.15.31:0/227442921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81700cd100 0x7f817014cad0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f815c0b1040 tx=0x7f815c0a6860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:05.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.056+0000 7f816d600640 1 -- 172.21.15.31:0/227442921 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c0b3070 con 0x7f81700cd100 2024-09-17T05:37:05.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.056+0000 7f816d600640 1 -- 172.21.15.31:0/227442921 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f815c0055f0 con 0x7f81700cd100 2024-09-17T05:37:05.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.056+0000 7f816d600640 1 -- 172.21.15.31:0/227442921 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c004930 con 0x7f81700cd100 2024-09-17T05:37:05.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.056+0000 7f8178600640 1 -- 172.21.15.31:0/227442921 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81701585d0 con 0x7f81700cd100 2024-09-17T05:37:05.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.056+0000 7f8178600640 1 -- 172.21.15.31:0/227442921 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8170158080 con 0x7f81700cd100 2024-09-17T05:37:05.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.056+0000 7f8178600640 1 -- 172.21.15.31:0/227442921 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8170069410 con 0x7f81700cd100 2024-09-17T05:37:05.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.056+0000 7f816d600640 1 -- 172.21.15.31:0/227442921 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f815c0be060 con 0x7f81700cd100 2024-09-17T05:37:05.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.060+0000 7f816d600640 1 --2- 172.21.15.31:0/227442921 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8150073dd0 0x7f8150076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.060+0000 7f816d600640 1 -- 172.21.15.31:0/227442921 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f815c12d270 con 0x7f81700cd100 2024-09-17T05:37:05.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.060+0000 7f8175c00640 1 --2- 172.21.15.31:0/227442921 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8150073dd0 0x7f8150076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.060+0000 7f8175c00640 1 --2- 172.21.15.31:0/227442921 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8150073dd0 0x7f8150076290 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8164005fd0 tx=0x7f8164005f20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:05.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.060+0000 7f816d600640 1 -- 172.21.15.31:0/227442921 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f815c017820 con 0x7f81700cd100 2024-09-17T05:37:05.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.248+0000 7f8178600640 1 -- 172.21.15.31:0/227442921 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8170156bd0 con 0x7f81700cd100 2024-09-17T05:37:05.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.248+0000 7f816d600640 1 -- 172.21.15.31:0/227442921 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v163) ==== 80+0+0 (secure 0 0 0) 0x7f815c0f9b10 con 0x7f81700cd100 2024-09-17T05:37:05.252 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-17T05:37:05.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.252+0000 7f8178600640 1 -- 172.21.15.31:0/227442921 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8150073dd0 msgr2=0x7f8150076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.252+0000 7f8178600640 1 --2- 172.21.15.31:0/227442921 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8150073dd0 0x7f8150076290 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8164005fd0 tx=0x7f8164005f20 comp rx=0 tx=0).stop 2024-09-17T05:37:05.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.252+0000 7f8178600640 1 -- 172.21.15.31:0/227442921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81700cd100 msgr2=0x7f817014cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.252+0000 7f8178600640 1 --2- 172.21.15.31:0/227442921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81700cd100 0x7f817014cad0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f815c0b1040 tx=0x7f815c0a6860 comp rx=0 tx=0).stop 2024-09-17T05:37:05.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.252+0000 7f8178600640 1 -- 172.21.15.31:0/227442921 shutdown_connections 2024-09-17T05:37:05.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.252+0000 7f8178600640 1 --2- 172.21.15.31:0/227442921 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8150073dd0 0x7f8150076290 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.252+0000 7f8178600640 1 --2- 172.21.15.31:0/227442921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f817015dae0 0x7f817015a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.252+0000 7f8178600640 1 --2- 172.21.15.31:0/227442921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81700cd100 0x7f817014cad0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.252+0000 7f8178600640 1 --2- 172.21.15.31:0/227442921 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81700b4810 0x7f8170157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.252+0000 7f8178600640 1 -- 172.21.15.31:0/227442921 >> 172.21.15.31:0/227442921 conn(0x7f81700b18f0 msgr2=0x7f81701505f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:05.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.252+0000 7f8178600640 1 -- 172.21.15.31:0/227442921 shutdown_connections 2024-09-17T05:37:05.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.252+0000 7f8178600640 1 -- 172.21.15.31:0/227442921 wait complete. 2024-09-17T05:37:05.273 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T05:37:05.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:05.273 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-17T05:37:05.299 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:37:05.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:05.300 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:37:05.353 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:37:05.353 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:37:05.353 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:05.362 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:37:05.362 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:37:05.362 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:37:05.362 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:05.404 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:37:05.404 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:37:05.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.548+0000 7f4e1be00640 1 -- 172.21.15.31:0/1700099101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dfc003c90 msgr2=0x7f4dfc004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.548+0000 7f4e1be00640 1 --2- 172.21.15.31:0/1700099101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dfc003c90 0x7f4dfc004090 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4e08006f30 tx=0x7f4e0801cea0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.548+0000 7f4e1be00640 1 -- 172.21.15.31:0/1700099101 shutdown_connections 2024-09-17T05:37:05.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.548+0000 7f4e1be00640 1 --2- 172.21.15.31:0/1700099101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dfc003c90 0x7f4dfc004090 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.548+0000 7f4e1be00640 1 -- 172.21.15.31:0/1700099101 >> 172.21.15.31:0/1700099101 conn(0x7f4e140d0c90 msgr2=0x7f4e140d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:05.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.548+0000 7f4e1be00640 1 -- 172.21.15.31:0/1700099101 shutdown_connections 2024-09-17T05:37:05.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.548+0000 7f4e1be00640 1 -- 172.21.15.31:0/1700099101 wait complete. 2024-09-17T05:37:05.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e1be00640 1 Processor -- start 2024-09-17T05:37:05.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e1be00640 1 -- start start 2024-09-17T05:37:05.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e1be00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dfc003c90 0x7f4e141f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e1be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e1406f960 0x7f4e14158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e1be00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e1414fe00 0x7f4e14158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e1be00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4e14073940 con 0x7f4e1406f960 2024-09-17T05:37:05.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e1be00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4e140737c0 con 0x7f4dfc003c90 2024-09-17T05:37:05.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e1be00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4e14073ac0 con 0x7f4e1414fe00 2024-09-17T05:37:05.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e18a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e1406f960 0x7f4e14158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e18a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e1406f960 0x7f4e14158440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56232/0 (socket says 172.21.15.31:56232) 2024-09-17T05:37:05.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e18a00640 1 -- 172.21.15.31:0/373970188 learned_addr learned my addr 172.21.15.31:0/373970188 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:05.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e19400640 1 --2- 172.21.15.31:0/373970188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dfc003c90 0x7f4e141f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e19e00640 1 --2- 172.21.15.31:0/373970188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e1414fe00 0x7f4e14158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e18a00640 1 -- 172.21.15.31:0/373970188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e1414fe00 msgr2=0x7f4e14158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e18a00640 1 --2- 172.21.15.31:0/373970188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e1414fe00 0x7f4e14158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e18a00640 1 -- 172.21.15.31:0/373970188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dfc003c90 msgr2=0x7f4e141f2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e18a00640 1 --2- 172.21.15.31:0/373970188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dfc003c90 0x7f4e141f2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e18a00640 1 -- 172.21.15.31:0/373970188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e14155070 con 0x7f4e1406f960 2024-09-17T05:37:05.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e18a00640 1 --2- 172.21.15.31:0/373970188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e1406f960 0x7f4e14158440 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f4e00005f80 tx=0x7f4e00011800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:05.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e11600640 1 -- 172.21.15.31:0/373970188 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e00005320 con 0x7f4e1406f960 2024-09-17T05:37:05.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e11600640 1 -- 172.21.15.31:0/373970188 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e00018020 con 0x7f4e1406f960 2024-09-17T05:37:05.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e1be00640 1 -- 172.21.15.31:0/373970188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e141f0ec0 con 0x7f4e1406f960 2024-09-17T05:37:05.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.552+0000 7f4e11600640 1 -- 172.21.15.31:0/373970188 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e00003860 con 0x7f4e1406f960 2024-09-17T05:37:05.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.556+0000 7f4e1be00640 1 -- 172.21.15.31:0/373970188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e141f3050 con 0x7f4e1406f960 2024-09-17T05:37:05.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.556+0000 7f4e1be00640 1 -- 172.21.15.31:0/373970188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e14074020 con 0x7f4e1406f960 2024-09-17T05:37:05.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.556+0000 7f4e11600640 1 -- 172.21.15.31:0/373970188 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f4e00003a00 con 0x7f4e1406f960 2024-09-17T05:37:05.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.556+0000 7f4e11600640 1 --2- 172.21.15.31:0/373970188 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4df4073dd0 0x7f4df4076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.556+0000 7f4e11600640 1 -- 172.21.15.31:0/373970188 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f4e00096440 con 0x7f4e1406f960 2024-09-17T05:37:05.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.556+0000 7f4e19400640 1 --2- 172.21.15.31:0/373970188 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4df4073dd0 0x7f4df4076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.556+0000 7f4e19400640 1 --2- 172.21.15.31:0/373970188 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4df4073dd0 0x7f4df4076290 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4e080ac000 tx=0x7f4e08019ce0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:05.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.560+0000 7f4e11600640 1 -- 172.21.15.31:0/373970188 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4e00022020 con 0x7f4e1406f960 2024-09-17T05:37:05.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.776+0000 7f4e1be00640 1 -- 172.21.15.31:0/373970188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e14156270 con 0x7f4e1406f960 2024-09-17T05:37:05.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.776+0000 7f4e11600640 1 -- 172.21.15.31:0/373970188 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5239 (secure 0 0 0) 0x7f4e00062860 con 0x7f4e1406f960 2024-09-17T05:37:05.779 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:37:05.779 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":120,"btime":"2024-09-17T05:37:01:286969+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/2639830102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2639830102},{"type":"v1","addr":"172.21.15.155:6834","nonce":2639830102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":9111,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1970430367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1970430367},{"type":"v1","addr":"172.21.15.31:6834","nonce":1970430367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":9114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3317138111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3317138111},{"type":"v1","addr":"172.21.15.31:6835","nonce":3317138111}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:51.647070+0000","modified":"2024-09-17T05:36:54.664417+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9126},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9126":{"gid":9126,"name":"b","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/3913619779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":3913619779},{"type":"v1","addr":"172.21.15.155:6835","nonce":3913619779}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9126,"qdb_cluster":[9126]},"id":13}]} 2024-09-17T05:37:05.779 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 120 2024-09-17T05:37:05.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.780+0000 7f4e1be00640 1 -- 172.21.15.31:0/373970188 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4df4073dd0 msgr2=0x7f4df4076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.780+0000 7f4e1be00640 1 --2- 172.21.15.31:0/373970188 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4df4073dd0 0x7f4df4076290 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4e080ac000 tx=0x7f4e08019ce0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.780+0000 7f4e1be00640 1 -- 172.21.15.31:0/373970188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e1406f960 msgr2=0x7f4e14158440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.780+0000 7f4e1be00640 1 --2- 172.21.15.31:0/373970188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e1406f960 0x7f4e14158440 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f4e00005f80 tx=0x7f4e00011800 comp rx=0 tx=0).stop 2024-09-17T05:37:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.780+0000 7f4e1be00640 1 -- 172.21.15.31:0/373970188 shutdown_connections 2024-09-17T05:37:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.780+0000 7f4e1be00640 1 --2- 172.21.15.31:0/373970188 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4df4073dd0 0x7f4df4076290 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.780+0000 7f4e1be00640 1 --2- 172.21.15.31:0/373970188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4e1414fe00 0x7f4e14158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.780+0000 7f4e1be00640 1 --2- 172.21.15.31:0/373970188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4e1406f960 0x7f4e14158440 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.780+0000 7f4e1be00640 1 --2- 172.21.15.31:0/373970188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4dfc003c90 0x7f4e141f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.780+0000 7f4e1be00640 1 -- 172.21.15.31:0/373970188 >> 172.21.15.31:0/373970188 conn(0x7f4e140d0c90 msgr2=0x7f4e14155720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.780+0000 7f4e1be00640 1 -- 172.21.15.31:0/373970188 shutdown_connections 2024-09-17T05:37:05.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.780+0000 7f4e1be00640 1 -- 172.21.15.31:0/373970188 wait complete. 2024-09-17T05:37:05.801 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:37:05.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81c3200640 1 -- 172.21.15.31:0/340570009 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81bc0cecf0 msgr2=0x7f81bc0cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81c3200640 1 --2- 172.21.15.31:0/340570009 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81bc0cecf0 0x7f81bc0cc940 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009840 tx=0x7f81a401c620 comp rx=0 tx=0).stop 2024-09-17T05:37:05.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81c3200640 1 -- 172.21.15.31:0/340570009 shutdown_connections 2024-09-17T05:37:05.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81c3200640 1 --2- 172.21.15.31:0/340570009 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81bc15c130 0x7f81bc0cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81c3200640 1 --2- 172.21.15.31:0/340570009 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81bc0cecf0 0x7f81bc0cc940 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81c3200640 1 -- 172.21.15.31:0/340570009 >> 172.21.15.31:0/340570009 conn(0x7f81bc0d1ea0 msgr2=0x7f81bc0d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:05.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81c3200640 1 -- 172.21.15.31:0/340570009 shutdown_connections 2024-09-17T05:37:05.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81c3200640 1 -- 172.21.15.31:0/340570009 wait complete. 2024-09-17T05:37:05.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81c3200640 1 Processor -- start 2024-09-17T05:37:05.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81c3200640 1 -- start start 2024-09-17T05:37:05.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81c3200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81bc0cecf0 0x7f81bc06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81c3200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81bc15bd50 0x7f81bc0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81c3200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81bc15c130 0x7f81bc0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81c3200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc169540 con 0x7f81bc15bd50 2024-09-17T05:37:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81c3200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1693c0 con 0x7f81bc15c130 2024-09-17T05:37:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81c3200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f81bc1696c0 con 0x7f81bc0cecf0 2024-09-17T05:37:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81b3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81bc15bd50 0x7f81bc0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81b3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81bc15bd50 0x7f81bc0cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56242/0 (socket says 172.21.15.31:56242) 2024-09-17T05:37:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81b3e00640 1 -- 172.21.15.31:0/1245459914 learned_addr learned my addr 172.21.15.31:0/1245459914 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81bbe00640 1 --2- 172.21.15.31:0/1245459914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81bc0cecf0 0x7f81bc06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.948+0000 7f81c1200640 1 --2- 172.21.15.31:0/1245459914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81bc15c130 0x7f81bc0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.952+0000 7f81b3e00640 1 -- 172.21.15.31:0/1245459914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81bc0cecf0 msgr2=0x7f81bc06e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.952+0000 7f81b3e00640 1 --2- 172.21.15.31:0/1245459914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81bc0cecf0 0x7f81bc06e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.952+0000 7f81b3e00640 1 -- 172.21.15.31:0/1245459914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81bc15c130 msgr2=0x7f81bc0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:05.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.952+0000 7f81b3e00640 1 --2- 172.21.15.31:0/1245459914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81bc15c130 0x7f81bc0cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:05.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.952+0000 7f81b3e00640 1 -- 172.21.15.31:0/1245459914 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81bc06f170 con 0x7f81bc15bd50 2024-09-17T05:37:05.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.952+0000 7f81b3e00640 1 --2- 172.21.15.31:0/1245459914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81bc15bd50 0x7f81bc0cb7f0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f81a401cb00 tx=0x7f81a4005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:05.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.952+0000 7f81b8c00640 1 -- 172.21.15.31:0/1245459914 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a40ac070 con 0x7f81bc15bd50 2024-09-17T05:37:05.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.952+0000 7f81b8c00640 1 -- 172.21.15.31:0/1245459914 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81a40043e0 con 0x7f81bc15bd50 2024-09-17T05:37:05.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.952+0000 7f81c3200640 1 -- 172.21.15.31:0/1245459914 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81bc06f450 con 0x7f81bc15bd50 2024-09-17T05:37:05.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.952+0000 7f81b8c00640 1 -- 172.21.15.31:0/1245459914 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a40048f0 con 0x7f81bc15bd50 2024-09-17T05:37:05.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.952+0000 7f81c3200640 1 -- 172.21.15.31:0/1245459914 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81bc157e80 con 0x7f81bc15bd50 2024-09-17T05:37:05.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.952+0000 7f81c3200640 1 -- 172.21.15.31:0/1245459914 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81bc158050 con 0x7f81bc15bd50 2024-09-17T05:37:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.952+0000 7f81b8c00640 1 -- 172.21.15.31:0/1245459914 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f81a40af070 con 0x7f81bc15bd50 2024-09-17T05:37:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.952+0000 7f81b8c00640 1 --2- 172.21.15.31:0/1245459914 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8198073dd0 0x7f8198076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.956+0000 7f81b8c00640 1 -- 172.21.15.31:0/1245459914 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f81a412cdb0 con 0x7f81bc15bd50 2024-09-17T05:37:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.956+0000 7f81bbe00640 1 --2- 172.21.15.31:0/1245459914 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8198073dd0 0x7f8198076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.956+0000 7f81bbe00640 1 --2- 172.21.15.31:0/1245459914 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8198073dd0 0x7f8198076290 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f81ac007a50 tx=0x7f81ac001e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:05.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:05.956+0000 7f81b8c00640 1 -- 172.21.15.31:0/1245459914 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f81a40c1030 con 0x7f81bc15bd50 2024-09-17T05:37:06.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.168+0000 7f81c3200640 1 -- 172.21.15.31:0/1245459914 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81bc070d60 con 0x7f81bc15bd50 2024-09-17T05:37:06.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.168+0000 7f81b8c00640 1 -- 172.21.15.31:0/1245459914 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5239 (secure 0 0 0) 0x7f81a4016330 con 0x7f81bc15bd50 2024-09-17T05:37:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:37:06.171 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":120,"btime":"2024-09-17T05:37:01:286969+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/2639830102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2639830102},{"type":"v1","addr":"172.21.15.155:6834","nonce":2639830102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":9111,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1970430367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1970430367},{"type":"v1","addr":"172.21.15.31:6834","nonce":1970430367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":9114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3317138111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3317138111},{"type":"v1","addr":"172.21.15.31:6835","nonce":3317138111}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:51.647070+0000","modified":"2024-09-17T05:36:54.664417+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9126},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9126":{"gid":9126,"name":"b","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/3913619779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":3913619779},{"type":"v1","addr":"172.21.15.155:6835","nonce":3913619779}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9126,"qdb_cluster":[9126]},"id":13}]} 2024-09-17T05:37:06.171 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 120 2024-09-17T05:37:06.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.172+0000 7f81c3200640 1 -- 172.21.15.31:0/1245459914 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8198073dd0 msgr2=0x7f8198076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.172+0000 7f81c3200640 1 --2- 172.21.15.31:0/1245459914 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8198073dd0 0x7f8198076290 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f81ac007a50 tx=0x7f81ac001e40 comp rx=0 tx=0).stop 2024-09-17T05:37:06.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.172+0000 7f81c3200640 1 -- 172.21.15.31:0/1245459914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81bc15bd50 msgr2=0x7f81bc0cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.172+0000 7f81c3200640 1 --2- 172.21.15.31:0/1245459914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81bc15bd50 0x7f81bc0cb7f0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f81a401cb00 tx=0x7f81a4005750 comp rx=0 tx=0).stop 2024-09-17T05:37:06.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.172+0000 7f81c3200640 1 -- 172.21.15.31:0/1245459914 shutdown_connections 2024-09-17T05:37:06.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.172+0000 7f81c3200640 1 --2- 172.21.15.31:0/1245459914 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f8198073dd0 0x7f8198076290 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.172+0000 7f81c3200640 1 --2- 172.21.15.31:0/1245459914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81bc15c130 0x7f81bc0cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.172+0000 7f81c3200640 1 --2- 172.21.15.31:0/1245459914 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81bc15bd50 0x7f81bc0cb7f0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.172+0000 7f81c3200640 1 --2- 172.21.15.31:0/1245459914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81bc0cecf0 0x7f81bc06e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.172+0000 7f81c3200640 1 -- 172.21.15.31:0/1245459914 >> 172.21.15.31:0/1245459914 conn(0x7f81bc0d1ea0 msgr2=0x7f81bc0d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:06.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.172+0000 7f81c3200640 1 -- 172.21.15.31:0/1245459914 shutdown_connections 2024-09-17T05:37:06.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.172+0000 7f81c3200640 1 -- 172.21.15.31:0/1245459914 wait complete. 2024-09-17T05:37:06.191 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:37:06.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.336+0000 7f38a2400640 1 -- 172.21.15.31:0/4115103914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f389c0ced80 msgr2=0x7f389c0ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.336+0000 7f38a2400640 1 --2- 172.21.15.31:0/4115103914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f389c0ced80 0x7f389c0ae9b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3884009840 tx=0x7f388401c820 comp rx=0 tx=0).stop 2024-09-17T05:37:06.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.336+0000 7f38a2400640 1 -- 172.21.15.31:0/4115103914 shutdown_connections 2024-09-17T05:37:06.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.336+0000 7f38a2400640 1 --2- 172.21.15.31:0/4115103914 >> v2:172.21.15.155:3300/0 conn(0x7f389c0cdb30 0x7f389c0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.336+0000 7f38a2400640 1 --2- 172.21.15.31:0/4115103914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f389c0ced80 0x7f389c0ae9b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.336+0000 7f38a2400640 1 -- 172.21.15.31:0/4115103914 >> 172.21.15.31:0/4115103914 conn(0x7f389c0d1dc0 msgr2=0x7f389c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:06.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.336+0000 7f38a2400640 1 -- 172.21.15.31:0/4115103914 shutdown_connections 2024-09-17T05:37:06.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.336+0000 7f38a2400640 1 -- 172.21.15.31:0/4115103914 wait complete. 2024-09-17T05:37:06.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f38a2400640 1 Processor -- start 2024-09-17T05:37:06.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f38a2400640 1 -- start start 2024-09-17T05:37:06.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f38a2400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f389c0cdb30 0x7f389c0c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f38a2400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f389c0ced80 0x7f389c157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f38a2400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f389c15bea0 0x7f389c0c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f38a2400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f389c169240 con 0x7f389c0cdb30 2024-09-17T05:37:06.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f38a2400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f389c1690c0 con 0x7f389c0ced80 2024-09-17T05:37:06.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f38a2400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f389c1693c0 con 0x7f389c15bea0 2024-09-17T05:37:06.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f389b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f389c0cdb30 0x7f389c0c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f389b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f389c0cdb30 0x7f389c0c9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56256/0 (socket says 172.21.15.31:56256) 2024-09-17T05:37:06.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f389b400640 1 -- 172.21.15.31:0/1630304587 learned_addr learned my addr 172.21.15.31:0/1630304587 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:06.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f3893e00640 1 --2- 172.21.15.31:0/1630304587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f389c0ced80 0x7f389c157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f389be00640 1 --2- 172.21.15.31:0/1630304587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f389c15bea0 0x7f389c0c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f389b400640 1 -- 172.21.15.31:0/1630304587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f389c15bea0 msgr2=0x7f389c0c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f389b400640 1 --2- 172.21.15.31:0/1630304587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f389c15bea0 0x7f389c0c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f389b400640 1 -- 172.21.15.31:0/1630304587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f389c0ced80 msgr2=0x7f389c157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f389b400640 1 --2- 172.21.15.31:0/1630304587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f389c0ced80 0x7f389c157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f389b400640 1 -- 172.21.15.31:0/1630304587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389c0b5e10 con 0x7f389c0cdb30 2024-09-17T05:37:06.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f389b400640 1 --2- 172.21.15.31:0/1630304587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f389c0cdb30 0x7f389c0c9aa0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f388c00c460 tx=0x7f388c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:06.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f3893400640 1 -- 172.21.15.31:0/1630304587 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c011790 con 0x7f389c0cdb30 2024-09-17T05:37:06.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f3893400640 1 -- 172.21.15.31:0/1630304587 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f388c017070 con 0x7f389c0cdb30 2024-09-17T05:37:06.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f38a2400640 1 -- 172.21.15.31:0/1630304587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f389c0b60f0 con 0x7f389c0cdb30 2024-09-17T05:37:06.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f3893400640 1 -- 172.21.15.31:0/1630304587 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c011ce0 con 0x7f389c0cdb30 2024-09-17T05:37:06.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.340+0000 7f38a2400640 1 -- 172.21.15.31:0/1630304587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f389c0b66b0 con 0x7f389c0cdb30 2024-09-17T05:37:06.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.344+0000 7f38a2400640 1 -- 172.21.15.31:0/1630304587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f389c0ce670 con 0x7f389c0cdb30 2024-09-17T05:37:06.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.344+0000 7f3893400640 1 -- 172.21.15.31:0/1630304587 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f388c01c460 con 0x7f389c0cdb30 2024-09-17T05:37:06.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.344+0000 7f3893400640 1 --2- 172.21.15.31:0/1630304587 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3878073dd0 0x7f3878076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.344+0000 7f3893400640 1 -- 172.21.15.31:0/1630304587 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f388c092a60 con 0x7f389c0cdb30 2024-09-17T05:37:06.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.344+0000 7f3893e00640 1 --2- 172.21.15.31:0/1630304587 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3878073dd0 0x7f3878076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.344+0000 7f3893e00640 1 --2- 172.21.15.31:0/1630304587 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3878073dd0 0x7f3878076290 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f38840af000 tx=0x7f388401b060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:06.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.348+0000 7f3893400640 1 -- 172.21.15.31:0/1630304587 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f388c05f3c0 con 0x7f389c0cdb30 2024-09-17T05:37:06.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.524+0000 7f38a2400640 1 -- 172.21.15.31:0/1630304587 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f389c15b600 con 0x7f389c0cdb30 2024-09-17T05:37:06.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.524+0000 7f3893400640 1 -- 172.21.15.31:0/1630304587 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) ==== 74+0+16811 (secure 0 0 0) 0x7f388c05ecc0 con 0x7f389c0cdb30 2024-09-17T05:37:06.528 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:37:06.528 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":163,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:36:53.238291+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:49.365706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:50.600939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:37:06.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.528+0000 7f38a2400640 1 -- 172.21.15.31:0/1630304587 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3878073dd0 msgr2=0x7f3878076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.528+0000 7f38a2400640 1 --2- 172.21.15.31:0/1630304587 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3878073dd0 0x7f3878076290 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f38840af000 tx=0x7f388401b060 comp rx=0 tx=0).stop 2024-09-17T05:37:06.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.528+0000 7f38a2400640 1 -- 172.21.15.31:0/1630304587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f389c0cdb30 msgr2=0x7f389c0c9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.528+0000 7f38a2400640 1 --2- 172.21.15.31:0/1630304587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f389c0cdb30 0x7f389c0c9aa0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f388c00c460 tx=0x7f388c00c860 comp rx=0 tx=0).stop 2024-09-17T05:37:06.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.528+0000 7f38a2400640 1 -- 172.21.15.31:0/1630304587 shutdown_connections 2024-09-17T05:37:06.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.528+0000 7f38a2400640 1 --2- 172.21.15.31:0/1630304587 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f3878073dd0 0x7f3878076290 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.528+0000 7f38a2400640 1 --2- 172.21.15.31:0/1630304587 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f389c15bea0 0x7f389c0c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.528+0000 7f38a2400640 1 --2- 172.21.15.31:0/1630304587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f389c0ced80 0x7f389c157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.528+0000 7f38a2400640 1 --2- 172.21.15.31:0/1630304587 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f389c0cdb30 0x7f389c0c9aa0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.528+0000 7f38a2400640 1 -- 172.21.15.31:0/1630304587 >> 172.21.15.31:0/1630304587 conn(0x7f389c0d1dc0 msgr2=0x7f389c06e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:06.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.528+0000 7f38a2400640 1 -- 172.21.15.31:0/1630304587 shutdown_connections 2024-09-17T05:37:06.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.528+0000 7f38a2400640 1 -- 172.21.15.31:0/1630304587 wait complete. 2024-09-17T05:37:06.550 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:37:06.550 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:37:06.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.696+0000 7fdf61000640 1 -- 172.21.15.31:0/4229608033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf40004810 msgr2=0x7fdf40004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.696+0000 7fdf61000640 1 --2- 172.21.15.31:0/4229608033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf40004810 0x7fdf40004c90 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009d10 tx=0x7fdf4401d3f0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.696+0000 7fdf61000640 1 -- 172.21.15.31:0/4229608033 shutdown_connections 2024-09-17T05:37:06.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.696+0000 7fdf61000640 1 --2- 172.21.15.31:0/4229608033 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf40004810 0x7fdf40004c90 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.696+0000 7fdf61000640 1 -- 172.21.15.31:0/4229608033 >> 172.21.15.31:0/4229608033 conn(0x7fdf5c0d1dc0 msgr2=0x7fdf5c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:06.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.696+0000 7fdf61000640 1 -- 172.21.15.31:0/4229608033 shutdown_connections 2024-09-17T05:37:06.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.696+0000 7fdf61000640 1 -- 172.21.15.31:0/4229608033 wait complete. 2024-09-17T05:37:06.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf61000640 1 Processor -- start 2024-09-17T05:37:06.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf61000640 1 -- start start 2024-09-17T05:37:06.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf61000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf40004810 0x7fdf5c1f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf61000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf5c0c7bc0 0x7fdf5c06dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf61000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf5c06e270 0x7fdf5c0b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf61000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c15c440 con 0x7fdf5c06e270 2024-09-17T05:37:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf61000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c0d2af0 con 0x7fdf40004810 2024-09-17T05:37:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf61000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdf5c0ce670 con 0x7fdf5c0c7bc0 2024-09-17T05:37:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf59e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf40004810 0x7fdf5c1f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf5a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf5c06e270 0x7fdf5c0b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf59e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf40004810 0x7fdf5c1f5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.31:54562/0 (socket says 172.21.15.31:54562) 2024-09-17T05:37:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf59e00640 1 -- 172.21.15.31:0/2576091101 learned_addr learned my addr 172.21.15.31:0/2576091101 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf53e00640 1 --2- 172.21.15.31:0/2576091101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf5c0c7bc0 0x7fdf5c06dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf5a800640 1 -- 172.21.15.31:0/2576091101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf5c0c7bc0 msgr2=0x7fdf5c06dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf5a800640 1 --2- 172.21.15.31:0/2576091101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf5c0c7bc0 0x7fdf5c06dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf5a800640 1 -- 172.21.15.31:0/2576091101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf40004810 msgr2=0x7fdf5c1f5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf5a800640 1 --2- 172.21.15.31:0/2576091101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf40004810 0x7fdf5c1f5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf5a800640 1 -- 172.21.15.31:0/2576091101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5c06e6f0 con 0x7fdf5c06e270 2024-09-17T05:37:06.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf5a800640 1 --2- 172.21.15.31:0/2576091101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf5c06e270 0x7fdf5c0b3210 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c074010 tx=0x7fdf54012aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:06.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf52000640 1 -- 172.21.15.31:0/2576091101 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54013860 con 0x7fdf5c06e270 2024-09-17T05:37:06.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf52000640 1 -- 172.21.15.31:0/2576091101 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf54013a20 con 0x7fdf5c06e270 2024-09-17T05:37:06.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf52000640 1 -- 172.21.15.31:0/2576091101 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54010480 con 0x7fdf5c06e270 2024-09-17T05:37:06.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.700+0000 7fdf61000640 1 -- 172.21.15.31:0/2576091101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf5c06e9d0 con 0x7fdf5c06e270 2024-09-17T05:37:06.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.704+0000 7fdf61000640 1 -- 172.21.15.31:0/2576091101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf5c153190 con 0x7fdf5c06e270 2024-09-17T05:37:06.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.704+0000 7fdf61000640 1 -- 172.21.15.31:0/2576091101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf5c069b20 con 0x7fdf5c06e270 2024-09-17T05:37:06.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.704+0000 7fdf52000640 1 -- 172.21.15.31:0/2576091101 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7fdf54010620 con 0x7fdf5c06e270 2024-09-17T05:37:06.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.704+0000 7fdf52000640 1 --2- 172.21.15.31:0/2576091101 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdf38073dd0 0x7fdf38076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:06.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.704+0000 7fdf52000640 1 -- 172.21.15.31:0/2576091101 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7fdf54096ab0 con 0x7fdf5c06e270 2024-09-17T05:37:06.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.704+0000 7fdf59e00640 1 --2- 172.21.15.31:0/2576091101 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdf38073dd0 0x7fdf38076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:06.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.708+0000 7fdf59e00640 1 --2- 172.21.15.31:0/2576091101 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdf38073dd0 0x7fdf38076290 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c000c10 tx=0x7fdf4c006b80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:06.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.708+0000 7fdf52000640 1 -- 172.21.15.31:0/2576091101 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fdf54062d00 con 0x7fdf5c06e270 2024-09-17T05:37:06.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.920+0000 7fdf61000640 1 -- 172.21.15.31:0/2576091101 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf5c0ceb60 con 0x7fdf5c06e270 2024-09-17T05:37:06.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.924+0000 7fdf52000640 1 -- 172.21.15.31:0/2576091101 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5239 (secure 0 0 0) 0x7fdf54067730 con 0x7fdf5c06e270 2024-09-17T05:37:06.925 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:37:06.925 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":120,"btime":"2024-09-17T05:37:01:286969+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/2639830102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2639830102},{"type":"v1","addr":"172.21.15.155:6834","nonce":2639830102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":9111,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1970430367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1970430367},{"type":"v1","addr":"172.21.15.31:6834","nonce":1970430367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":9114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3317138111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3317138111},{"type":"v1","addr":"172.21.15.31:6835","nonce":3317138111}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:51.647070+0000","modified":"2024-09-17T05:36:54.664417+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9126},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9126":{"gid":9126,"name":"b","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/3913619779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":3913619779},{"type":"v1","addr":"172.21.15.155:6835","nonce":3913619779}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9126,"qdb_cluster":[9126]},"id":13}]} 2024-09-17T05:37:06.925 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 120 2024-09-17T05:37:06.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.924+0000 7fdf61000640 1 -- 172.21.15.31:0/2576091101 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdf38073dd0 msgr2=0x7fdf38076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.924+0000 7fdf61000640 1 --2- 172.21.15.31:0/2576091101 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdf38073dd0 0x7fdf38076290 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c000c10 tx=0x7fdf4c006b80 comp rx=0 tx=0).stop 2024-09-17T05:37:06.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.924+0000 7fdf61000640 1 -- 172.21.15.31:0/2576091101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf5c06e270 msgr2=0x7fdf5c0b3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:06.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.924+0000 7fdf61000640 1 --2- 172.21.15.31:0/2576091101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf5c06e270 0x7fdf5c0b3210 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c074010 tx=0x7fdf54012aa0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.924+0000 7fdf61000640 1 -- 172.21.15.31:0/2576091101 shutdown_connections 2024-09-17T05:37:06.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.924+0000 7fdf61000640 1 --2- 172.21.15.31:0/2576091101 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fdf38073dd0 0x7fdf38076290 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.924+0000 7fdf61000640 1 --2- 172.21.15.31:0/2576091101 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdf5c06e270 0x7fdf5c0b3210 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.924+0000 7fdf61000640 1 --2- 172.21.15.31:0/2576091101 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdf5c0c7bc0 0x7fdf5c06dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.924+0000 7fdf61000640 1 --2- 172.21.15.31:0/2576091101 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdf40004810 0x7fdf5c1f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:06.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.924+0000 7fdf61000640 1 -- 172.21.15.31:0/2576091101 >> 172.21.15.31:0/2576091101 conn(0x7fdf5c0d1dc0 msgr2=0x7fdf5c0afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:06.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.924+0000 7fdf61000640 1 -- 172.21.15.31:0/2576091101 shutdown_connections 2024-09-17T05:37:06.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:06.924+0000 7fdf61000640 1 -- 172.21.15.31:0/2576091101 wait complete. 2024-09-17T05:37:06.946 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:37:07.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.088+0000 7fe235200640 1 -- 172.21.15.31:0/2408394911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23015bd50 msgr2=0x7fe2300ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:07.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.088+0000 7fe235200640 1 --2- 172.21.15.31:0/2408394911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23015bd50 0x7fe2300ce5e0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fe220009900 tx=0x7fe22001c4a0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.088+0000 7fe235200640 1 -- 172.21.15.31:0/2408394911 shutdown_connections 2024-09-17T05:37:07.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.088+0000 7fe235200640 1 --2- 172.21.15.31:0/2408394911 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2300cf4e0 0x7fe2300cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.088+0000 7fe235200640 1 --2- 172.21.15.31:0/2408394911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23015bd50 0x7fe2300ce5e0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.088+0000 7fe235200640 1 -- 172.21.15.31:0/2408394911 >> 172.21.15.31:0/2408394911 conn(0x7fe2300d1ea0 msgr2=0x7fe2300d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:07.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.088+0000 7fe235200640 1 -- 172.21.15.31:0/2408394911 shutdown_connections 2024-09-17T05:37:07.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.088+0000 7fe235200640 1 -- 172.21.15.31:0/2408394911 wait complete. 2024-09-17T05:37:07.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe235200640 1 Processor -- start 2024-09-17T05:37:07.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe235200640 1 -- start start 2024-09-17T05:37:07.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe235200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2300cf4e0 0x7fe2301564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:07.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe235200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe23015bd50 0x7fe23009bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:07.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe235200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23015c130 0x7fe23009e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:07.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe235200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe230169b80 con 0x7fe23015c130 2024-09-17T05:37:07.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe235200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe230169a00 con 0x7fe2300cf4e0 2024-09-17T05:37:07.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe235200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe230169d00 con 0x7fe23015bd50 2024-09-17T05:37:07.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe22e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23015c130 0x7fe23009e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:07.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe22e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23015c130 0x7fe23009e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56302/0 (socket says 172.21.15.31:56302) 2024-09-17T05:37:07.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe22e800640 1 -- 172.21.15.31:0/831881121 learned_addr learned my addr 172.21.15.31:0/831881121 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:07.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe22de00640 1 --2- 172.21.15.31:0/831881121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2300cf4e0 0x7fe2301564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:07.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe227e00640 1 --2- 172.21.15.31:0/831881121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe23015bd50 0x7fe23009bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:07.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe22e800640 1 -- 172.21.15.31:0/831881121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe23015bd50 msgr2=0x7fe23009bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:07.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe22e800640 1 --2- 172.21.15.31:0/831881121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe23015bd50 0x7fe23009bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe22e800640 1 -- 172.21.15.31:0/831881121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2300cf4e0 msgr2=0x7fe2301564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:07.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe22e800640 1 --2- 172.21.15.31:0/831881121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2300cf4e0 0x7fe2301564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe22e800640 1 -- 172.21.15.31:0/831881121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe230156a30 con 0x7fe23015c130 2024-09-17T05:37:07.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe22e800640 1 --2- 172.21.15.31:0/831881121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23015c130 0x7fe23009e9d0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fe22800ea20 tx=0x7fe22800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:07.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe226000640 1 -- 172.21.15.31:0/831881121 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22800cd80 con 0x7fe23015c130 2024-09-17T05:37:07.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe226000640 1 -- 172.21.15.31:0/831881121 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe228004c40 con 0x7fe23015c130 2024-09-17T05:37:07.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe226000640 1 -- 172.21.15.31:0/831881121 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228005280 con 0x7fe23015c130 2024-09-17T05:37:07.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe235200640 1 -- 172.21.15.31:0/831881121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe23009dc50 con 0x7fe23015c130 2024-09-17T05:37:07.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.092+0000 7fe235200640 1 -- 172.21.15.31:0/831881121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe23009e1d0 con 0x7fe23015c130 2024-09-17T05:37:07.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.096+0000 7fe235200640 1 -- 172.21.15.31:0/831881121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2300ce5e0 con 0x7fe23015c130 2024-09-17T05:37:07.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.096+0000 7fe226000640 1 -- 172.21.15.31:0/831881121 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7fe228005420 con 0x7fe23015c130 2024-09-17T05:37:07.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.096+0000 7fe226000640 1 --2- 172.21.15.31:0/831881121 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe20c073dd0 0x7fe20c076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:07.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.096+0000 7fe226000640 1 -- 172.21.15.31:0/831881121 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7fe228093710 con 0x7fe23015c130 2024-09-17T05:37:07.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.096+0000 7fe22de00640 1 --2- 172.21.15.31:0/831881121 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe20c073dd0 0x7fe20c076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:07.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.100+0000 7fe22de00640 1 --2- 172.21.15.31:0/831881121 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe20c073dd0 0x7fe20c076290 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe2200ae000 tx=0x7fe2200a5f90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:07.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.100+0000 7fe226000640 1 -- 172.21.15.31:0/831881121 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe230156a30 con 0x7fe23015c130 2024-09-17T05:37:07.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.316+0000 7fe235200640 1 -- 172.21.15.31:0/831881121 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2300cdab0 con 0x7fe23015c130 2024-09-17T05:37:07.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.320+0000 7fe226000640 1 -- 172.21.15.31:0/831881121 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5239 (secure 0 0 0) 0x7fe228016030 con 0x7fe23015c130 2024-09-17T05:37:07.322 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:37:07.322 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":120,"btime":"2024-09-17T05:37:01:286969+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/2639830102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2639830102},{"type":"v1","addr":"172.21.15.155:6834","nonce":2639830102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":9111,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1970430367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1970430367},{"type":"v1","addr":"172.21.15.31:6834","nonce":1970430367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":9114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3317138111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3317138111},{"type":"v1","addr":"172.21.15.31:6835","nonce":3317138111}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114}],"filesystems":[{"mdsmap":{"epoch":119,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:36:51.647070+0000","modified":"2024-09-17T05:36:54.664417+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9126},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9126":{"gid":9126,"name":"b","rank":0,"incarnation":115,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6835/3913619779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":3913619779},{"type":"v1","addr":"172.21.15.155:6835","nonce":3913619779}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9126,"qdb_cluster":[9126]},"id":13}]} 2024-09-17T05:37:07.322 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 120 2024-09-17T05:37:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.320+0000 7fe235200640 1 -- 172.21.15.31:0/831881121 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe20c073dd0 msgr2=0x7fe20c076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.320+0000 7fe235200640 1 --2- 172.21.15.31:0/831881121 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe20c073dd0 0x7fe20c076290 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe2200ae000 tx=0x7fe2200a5f90 comp rx=0 tx=0).stop 2024-09-17T05:37:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.320+0000 7fe235200640 1 -- 172.21.15.31:0/831881121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23015c130 msgr2=0x7fe23009e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.320+0000 7fe235200640 1 --2- 172.21.15.31:0/831881121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23015c130 0x7fe23009e9d0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fe22800ea20 tx=0x7fe22800eee0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.324+0000 7fe235200640 1 -- 172.21.15.31:0/831881121 shutdown_connections 2024-09-17T05:37:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.324+0000 7fe235200640 1 --2- 172.21.15.31:0/831881121 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe20c073dd0 0x7fe20c076290 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.324+0000 7fe235200640 1 --2- 172.21.15.31:0/831881121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe23015c130 0x7fe23009e9d0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.324+0000 7fe235200640 1 --2- 172.21.15.31:0/831881121 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe23015bd50 0x7fe23009bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.324+0000 7fe235200640 1 --2- 172.21.15.31:0/831881121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2300cf4e0 0x7fe2301564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.324+0000 7fe235200640 1 -- 172.21.15.31:0/831881121 >> 172.21.15.31:0/831881121 conn(0x7fe2300d1ea0 msgr2=0x7fe2300d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:07.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.324+0000 7fe235200640 1 -- 172.21.15.31:0/831881121 shutdown_connections 2024-09-17T05:37:07.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.324+0000 7fe235200640 1 -- 172.21.15.31:0/831881121 wait complete. 2024-09-17T05:37:07.345 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:37:07.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.488+0000 7f0c60000640 1 -- 172.21.15.31:0/1981358910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c40003c90 msgr2=0x7f0c40004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:07.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.488+0000 7f0c60000640 1 --2- 172.21.15.31:0/1981358910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c40003c90 0x7f0c40004090 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c001860 tx=0x7f0c4c01c8c0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.488+0000 7f0c60000640 1 -- 172.21.15.31:0/1981358910 shutdown_connections 2024-09-17T05:37:07.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.488+0000 7f0c60000640 1 --2- 172.21.15.31:0/1981358910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c40003c90 0x7f0c40004090 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.488+0000 7f0c60000640 1 -- 172.21.15.31:0/1981358910 >> 172.21.15.31:0/1981358910 conn(0x7f0c580d1dc0 msgr2=0x7f0c580d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:07.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.488+0000 7f0c60000640 1 -- 172.21.15.31:0/1981358910 shutdown_connections 2024-09-17T05:37:07.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.488+0000 7f0c60000640 1 -- 172.21.15.31:0/1981358910 wait complete. 2024-09-17T05:37:07.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c60000640 1 Processor -- start 2024-09-17T05:37:07.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c60000640 1 -- start start 2024-09-17T05:37:07.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c60000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c40003c90 0x7f0c5815d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:07.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c60000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c580ca460 0x7f0c5809f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:07.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c60000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c581f5870 0x7f0c581f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:07.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c60000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0c580cea80 con 0x7f0c40003c90 2024-09-17T05:37:07.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c60000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0c580ce900 con 0x7f0c580ca460 2024-09-17T05:37:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c60000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0c580cec00 con 0x7f0c581f5870 2024-09-17T05:37:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c5d600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c40003c90 0x7f0c5815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c5d600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c40003c90 0x7f0c5815d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56330/0 (socket says 172.21.15.31:56330) 2024-09-17T05:37:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c5d600640 1 -- 172.21.15.31:0/136019894 learned_addr learned my addr 172.21.15.31:0/136019894 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c5e000640 1 --2- 172.21.15.31:0/136019894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c581f5870 0x7f0c581f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c5cc00640 1 --2- 172.21.15.31:0/136019894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c580ca460 0x7f0c5809f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c5d600640 1 -- 172.21.15.31:0/136019894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c581f5870 msgr2=0x7f0c581f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c5d600640 1 --2- 172.21.15.31:0/136019894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c581f5870 0x7f0c581f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c5d600640 1 -- 172.21.15.31:0/136019894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c580ca460 msgr2=0x7f0c5809f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c5d600640 1 --2- 172.21.15.31:0/136019894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c580ca460 0x7f0c5809f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c5d600640 1 -- 172.21.15.31:0/136019894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c580caa00 con 0x7f0c40003c90 2024-09-17T05:37:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c5d600640 1 --2- 172.21.15.31:0/136019894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c40003c90 0x7f0c5815d020 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c01afc0 tx=0x7f0c4c0a5d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:07.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c55600640 1 -- 172.21.15.31:0/136019894 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c0068d0 con 0x7f0c40003c90 2024-09-17T05:37:07.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c55600640 1 -- 172.21.15.31:0/136019894 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c4c0b4030 con 0x7f0c40003c90 2024-09-17T05:37:07.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c55600640 1 -- 172.21.15.31:0/136019894 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c001480 con 0x7f0c40003c90 2024-09-17T05:37:07.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c60000640 1 -- 172.21.15.31:0/136019894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c580cace0 con 0x7f0c40003c90 2024-09-17T05:37:07.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.492+0000 7f0c60000640 1 -- 172.21.15.31:0/136019894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c581f8f90 con 0x7f0c40003c90 2024-09-17T05:37:07.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.496+0000 7f0c60000640 1 -- 172.21.15.31:0/136019894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c580cd4f0 con 0x7f0c40003c90 2024-09-17T05:37:07.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.496+0000 7f0c55600640 1 -- 172.21.15.31:0/136019894 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f0c4c003b50 con 0x7f0c40003c90 2024-09-17T05:37:07.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.496+0000 7f0c55600640 1 --2- 172.21.15.31:0/136019894 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c38073e00 0x7f0c380762c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:07.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.496+0000 7f0c55600640 1 -- 172.21.15.31:0/136019894 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f0c4c12ca70 con 0x7f0c40003c90 2024-09-17T05:37:07.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.496+0000 7f0c5cc00640 1 --2- 172.21.15.31:0/136019894 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c38073e00 0x7f0c380762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:07.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.496+0000 7f0c5cc00640 1 --2- 172.21.15.31:0/136019894 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c38073e00 0x7f0c380762c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009ce0 tx=0x7f0c440091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:07.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.500+0000 7f0c55600640 1 -- 172.21.15.31:0/136019894 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f0c4c016670 con 0x7f0c40003c90 2024-09-17T05:37:07.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.676+0000 7f0c60000640 1 -- 172.21.15.31:0/136019894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c580b5000 con 0x7f0c40003c90 2024-09-17T05:37:07.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.680+0000 7f0c55600640 1 -- 172.21.15.31:0/136019894 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) ==== 74+0+16811 (secure 0 0 0) 0x7f0c4c0f9030 con 0x7f0c40003c90 2024-09-17T05:37:07.681 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:37:07.681 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":163,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:36:53.238291+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:36:49.365706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T05:36:50.600939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:37:07.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.680+0000 7f0c60000640 1 -- 172.21.15.31:0/136019894 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c38073e00 msgr2=0x7f0c380762c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:07.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.680+0000 7f0c60000640 1 --2- 172.21.15.31:0/136019894 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c38073e00 0x7f0c380762c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009ce0 tx=0x7f0c440091e0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.680+0000 7f0c60000640 1 -- 172.21.15.31:0/136019894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c40003c90 msgr2=0x7f0c5815d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:07.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.680+0000 7f0c60000640 1 --2- 172.21.15.31:0/136019894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c40003c90 0x7f0c5815d020 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c01afc0 tx=0x7f0c4c0a5d40 comp rx=0 tx=0).stop 2024-09-17T05:37:07.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.680+0000 7f0c60000640 1 -- 172.21.15.31:0/136019894 shutdown_connections 2024-09-17T05:37:07.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.680+0000 7f0c60000640 1 --2- 172.21.15.31:0/136019894 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0c38073e00 0x7f0c380762c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.680+0000 7f0c60000640 1 --2- 172.21.15.31:0/136019894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c581f5870 0x7f0c581f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.680+0000 7f0c60000640 1 --2- 172.21.15.31:0/136019894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c580ca460 0x7f0c5809f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.680+0000 7f0c60000640 1 --2- 172.21.15.31:0/136019894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c40003c90 0x7f0c5815d020 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.680+0000 7f0c60000640 1 -- 172.21.15.31:0/136019894 >> 172.21.15.31:0/136019894 conn(0x7f0c580d1dc0 msgr2=0x7f0c58159920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:07.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.680+0000 7f0c60000640 1 -- 172.21.15.31:0/136019894 shutdown_connections 2024-09-17T05:37:07.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.680+0000 7f0c60000640 1 -- 172.21.15.31:0/136019894 wait complete. 2024-09-17T05:37:07.703 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:37:07.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.848+0000 7f5b85c00640 1 -- 172.21.15.31:0/1774387957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b640052f0 msgr2=0x7f5b6400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:07.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.848+0000 7f5b85c00640 1 --2- 172.21.15.31:0/1774387957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b640052f0 0x7f5b6400b9d0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800c640 tx=0x7f5b7801f9c0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.848+0000 7f5b85c00640 1 -- 172.21.15.31:0/1774387957 shutdown_connections 2024-09-17T05:37:07.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.848+0000 7f5b85c00640 1 --2- 172.21.15.31:0/1774387957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b640052f0 0x7f5b6400b9d0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.848+0000 7f5b85c00640 1 -- 172.21.15.31:0/1774387957 >> 172.21.15.31:0/1774387957 conn(0x7f5b800d1dc0 msgr2=0x7f5b800d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:07.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.848+0000 7f5b85c00640 1 -- 172.21.15.31:0/1774387957 shutdown_connections 2024-09-17T05:37:07.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.848+0000 7f5b85c00640 1 -- 172.21.15.31:0/1774387957 wait complete. 2024-09-17T05:37:07.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b85c00640 1 Processor -- start 2024-09-17T05:37:07.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b85c00640 1 -- start start 2024-09-17T05:37:07.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b85c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b640052f0 0x7f5b800b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:07.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b85c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b8006f830 0x7f5b801f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b85c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b800b1530 0x7f5b801f8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b85c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5b800ce7f0 con 0x7f5b800b1530 2024-09-17T05:37:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b85c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5b800ce670 con 0x7f5b8006f830 2024-09-17T05:37:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b85c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5b800ce970 con 0x7f5b640052f0 2024-09-17T05:37:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b7f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b800b1530 0x7f5b801f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b7f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b800b1530 0x7f5b801f8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56350/0 (socket says 172.21.15.31:56350) 2024-09-17T05:37:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b7f400640 1 -- 172.21.15.31:0/2989122317 learned_addr learned my addr 172.21.15.31:0/2989122317 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b77e00640 1 --2- 172.21.15.31:0/2989122317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b8006f830 0x7f5b801f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b7ea00640 1 --2- 172.21.15.31:0/2989122317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b640052f0 0x7f5b800b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b7f400640 1 -- 172.21.15.31:0/2989122317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b640052f0 msgr2=0x7f5b800b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b7f400640 1 --2- 172.21.15.31:0/2989122317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b640052f0 0x7f5b800b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b7f400640 1 -- 172.21.15.31:0/2989122317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b8006f830 msgr2=0x7f5b801f7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:07.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b7f400640 1 --2- 172.21.15.31:0/2989122317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b8006f830 0x7f5b801f7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:07.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b7f400640 1 -- 172.21.15.31:0/2989122317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b801f8890 con 0x7f5b800b1530 2024-09-17T05:37:07.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b7f400640 1 --2- 172.21.15.31:0/2989122317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b800b1530 0x7f5b801f8050 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800c730 tx=0x7f5b78004f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b76a00640 1 -- 172.21.15.31:0/2989122317 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b78001fe0 con 0x7f5b800b1530 2024-09-17T05:37:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b76a00640 1 -- 172.21.15.31:0/2989122317 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b780b7020 con 0x7f5b800b1530 2024-09-17T05:37:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b85c00640 1 -- 172.21.15.31:0/2989122317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b801e40e0 con 0x7f5b800b1530 2024-09-17T05:37:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b76a00640 1 -- 172.21.15.31:0/2989122317 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b780060d0 con 0x7f5b800b1530 2024-09-17T05:37:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.852+0000 7f5b85c00640 1 -- 172.21.15.31:0/2989122317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b800b45f0 con 0x7f5b800b1530 2024-09-17T05:37:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.856+0000 7f5b85c00640 1 -- 172.21.15.31:0/2989122317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b800cfcb0 con 0x7f5b800b1530 2024-09-17T05:37:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.856+0000 7f5b76a00640 1 -- 172.21.15.31:0/2989122317 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f5b78006270 con 0x7f5b800b1530 2024-09-17T05:37:07.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.856+0000 7f5b76a00640 1 --2- 172.21.15.31:0/2989122317 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5b5c073e00 0x7f5b5c0762c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:07.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.856+0000 7f5b76a00640 1 -- 172.21.15.31:0/2989122317 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5737+0+0 (secure 0 0 0) 0x7f5b7812ffc0 con 0x7f5b800b1530 2024-09-17T05:37:07.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.856+0000 7f5b7ea00640 1 --2- 172.21.15.31:0/2989122317 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5b5c073e00 0x7f5b5c0762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:07.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.856+0000 7f5b7ea00640 1 --2- 172.21.15.31:0/2989122317 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5b5c073e00 0x7f5b5c0762c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5b70009be0 tx=0x7f5b700091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:07.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:07.860+0000 7f5b76a00640 1 -- 172.21.15.31:0/2989122317 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5b780c1030 con 0x7f5b800b1530 2024-09-17T05:37:08.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.076+0000 7f5b85c00640 1 -- 172.21.15.31:0/2989122317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5b800afef0 con 0x7f5b800b1530 2024-09-17T05:37:08.078 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-09-17T05:37:08.076+0000 7f21d0200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:37:08.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.076+0000 7f5b76a00640 1 -- 172.21.15.31:0/2989122317 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v121) ==== 161+0+0 (secure 0 0 0) 0x7f5b78019770 con 0x7f5b800b1530 2024-09-17T05:37:08.080 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:37:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.080+0000 7f5b85c00640 1 -- 172.21.15.31:0/2989122317 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5b5c073e00 msgr2=0x7f5b5c0762c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.080+0000 7f5b85c00640 1 --2- 172.21.15.31:0/2989122317 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5b5c073e00 0x7f5b5c0762c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5b70009be0 tx=0x7f5b700091e0 comp rx=0 tx=0).stop 2024-09-17T05:37:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.080+0000 7f5b85c00640 1 -- 172.21.15.31:0/2989122317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b800b1530 msgr2=0x7f5b801f8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.080+0000 7f5b85c00640 1 --2- 172.21.15.31:0/2989122317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b800b1530 0x7f5b801f8050 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800c730 tx=0x7f5b78004f50 comp rx=0 tx=0).stop 2024-09-17T05:37:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.080+0000 7f5b85c00640 1 -- 172.21.15.31:0/2989122317 shutdown_connections 2024-09-17T05:37:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.080+0000 7f5b85c00640 1 --2- 172.21.15.31:0/2989122317 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5b5c073e00 0x7f5b5c0762c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.080+0000 7f5b85c00640 1 --2- 172.21.15.31:0/2989122317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b800b1530 0x7f5b801f8050 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.080+0000 7f5b85c00640 1 --2- 172.21.15.31:0/2989122317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5b8006f830 0x7f5b801f7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.080+0000 7f5b85c00640 1 --2- 172.21.15.31:0/2989122317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5b640052f0 0x7f5b800b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.080+0000 7f5b85c00640 1 -- 172.21.15.31:0/2989122317 >> 172.21.15.31:0/2989122317 conn(0x7f5b800d1dc0 msgr2=0x7f5b80070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.080+0000 7f5b85c00640 1 -- 172.21.15.31:0/2989122317 shutdown_connections 2024-09-17T05:37:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.080+0000 7f5b85c00640 1 -- 172.21.15.31:0/2989122317 wait complete. 2024-09-17T05:37:08.104 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:37:08.151 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-17T05:37:08.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.252+0000 7f8572a00640 1 -- 172.21.15.31:0/864279297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f856c0d20f0 msgr2=0x7f856c0cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:08.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.252+0000 7f8572a00640 1 --2- 172.21.15.31:0/864279297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f856c0d20f0 0x7f856c0cc620 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f856c073190 tx=0x7f856401cd80 comp rx=0 tx=0).stop 2024-09-17T05:37:08.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.252+0000 7f8572a00640 1 -- 172.21.15.31:0/864279297 shutdown_connections 2024-09-17T05:37:08.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.252+0000 7f8572a00640 1 --2- 172.21.15.31:0/864279297 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f856c0d20f0 0x7f856c0cc620 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:08.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.252+0000 7f8572a00640 1 --2- 172.21.15.31:0/864279297 >> v2:172.21.15.155:3300/0 conn(0x7f856c0b0d10 0x7f856c0d1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:08.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.252+0000 7f8572a00640 1 -- 172.21.15.31:0/864279297 >> 172.21.15.31:0/864279297 conn(0x7f856c09aa10 msgr2=0x7f856c09ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:08.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8572a00640 1 -- 172.21.15.31:0/864279297 shutdown_connections 2024-09-17T05:37:08.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8572a00640 1 -- 172.21.15.31:0/864279297 wait complete. 2024-09-17T05:37:08.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8572a00640 1 Processor -- start 2024-09-17T05:37:08.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8572a00640 1 -- start start 2024-09-17T05:37:08.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8572a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f856c0b0d10 0x7f856c14f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:08.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8572a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f856c0d20f0 0x7f856c0b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:08.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8572a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f856c15bd40 0x7f856c154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8572a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f856c168d00 con 0x7f856c0d20f0 2024-09-17T05:37:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8572a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f856c168b80 con 0x7f856c15bd40 2024-09-17T05:37:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8572a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f856c168e80 con 0x7f856c0b0d10 2024-09-17T05:37:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8570c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f856c0d20f0 0x7f856c0b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8570c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f856c0d20f0 0x7f856c0b54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:56356/0 (socket says 172.21.15.31:56356) 2024-09-17T05:37:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8570c00640 1 -- 172.21.15.31:0/2357308499 learned_addr learned my addr 172.21.15.31:0/2357308499 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8571600640 1 --2- 172.21.15.31:0/2357308499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f856c0b0d10 0x7f856c14f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8572000640 1 --2- 172.21.15.31:0/2357308499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f856c15bd40 0x7f856c154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8570c00640 1 -- 172.21.15.31:0/2357308499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f856c0b0d10 msgr2=0x7f856c14f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8570c00640 1 --2- 172.21.15.31:0/2357308499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f856c0b0d10 0x7f856c14f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8570c00640 1 -- 172.21.15.31:0/2357308499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f856c15bd40 msgr2=0x7f856c154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8570c00640 1 --2- 172.21.15.31:0/2357308499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f856c15bd40 0x7f856c154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:08.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.256+0000 7f8570c00640 1 -- 172.21.15.31:0/2357308499 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856c0cfa10 con 0x7f856c0d20f0 2024-09-17T05:37:08.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.260+0000 7f8570c00640 1 --2- 172.21.15.31:0/2357308499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f856c0d20f0 0x7f856c0b54c0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f855800ea20 tx=0x7f855800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:08.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.260+0000 7f8569600640 1 -- 172.21.15.31:0/2357308499 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855800cd80 con 0x7f856c0d20f0 2024-09-17T05:37:08.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.260+0000 7f8569600640 1 -- 172.21.15.31:0/2357308499 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8558010430 con 0x7f856c0d20f0 2024-09-17T05:37:08.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.260+0000 7f8572a00640 1 -- 172.21.15.31:0/2357308499 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f856c0b52a0 con 0x7f856c0d20f0 2024-09-17T05:37:08.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.260+0000 7f8569600640 1 -- 172.21.15.31:0/2357308499 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8558010860 con 0x7f856c0d20f0 2024-09-17T05:37:08.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.260+0000 7f8572a00640 1 -- 172.21.15.31:0/2357308499 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f856c1fae60 con 0x7f856c0d20f0 2024-09-17T05:37:08.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.260+0000 7f8572a00640 1 -- 172.21.15.31:0/2357308499 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f856c0d1bb0 con 0x7f856c0d20f0 2024-09-17T05:37:08.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.260+0000 7f8569600640 1 -- 172.21.15.31:0/2357308499 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f8558010a00 con 0x7f856c0d20f0 2024-09-17T05:37:08.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.260+0000 7f8569600640 1 --2- 172.21.15.31:0/2357308499 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f854c073e20 0x7f854c0762e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:08.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.260+0000 7f8569600640 1 -- 172.21.15.31:0/2357308499 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5823+0+0 (secure 0 0 0) 0x7f8558093730 con 0x7f856c0d20f0 2024-09-17T05:37:08.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.260+0000 7f8571600640 1 --2- 172.21.15.31:0/2357308499 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f854c073e20 0x7f854c0762e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:08.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.264+0000 7f8571600640 1 --2- 172.21.15.31:0/2357308499 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f854c073e20 0x7f854c0762e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8560007fd0 tx=0x7f8560009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:08.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.264+0000 7f8569600640 1 -- 172.21.15.31:0/2357308499 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f855805fbe0 con 0x7f856c0d20f0 2024-09-17T05:37:08.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:08.480+0000 7f8572a00640 1 -- 172.21.15.31:0/2357308499 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f856c09b200 con 0x7f856c0d20f0 2024-09-17T05:37:09.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.080+0000 7f8569600640 1 -- 172.21.15.31:0/2357308499 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v122) ==== 104+0+0 (secure 0 0 0) 0x7f8558064610 con 0x7f856c0d20f0 2024-09-17T05:37:09.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.084+0000 7f8572a00640 1 -- 172.21.15.31:0/2357308499 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f854c073e20 msgr2=0x7f854c0762e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:09.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.084+0000 7f8572a00640 1 --2- 172.21.15.31:0/2357308499 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f854c073e20 0x7f854c0762e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8560007fd0 tx=0x7f8560009040 comp rx=0 tx=0).stop 2024-09-17T05:37:09.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.084+0000 7f8572a00640 1 -- 172.21.15.31:0/2357308499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f856c0d20f0 msgr2=0x7f856c0b54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:09.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.084+0000 7f8572a00640 1 --2- 172.21.15.31:0/2357308499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f856c0d20f0 0x7f856c0b54c0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f855800ea20 tx=0x7f855800eee0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.084+0000 7f8572a00640 1 -- 172.21.15.31:0/2357308499 shutdown_connections 2024-09-17T05:37:09.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.084+0000 7f8572a00640 1 --2- 172.21.15.31:0/2357308499 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f854c073e20 0x7f854c0762e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.084+0000 7f8572a00640 1 --2- 172.21.15.31:0/2357308499 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f856c15bd40 0x7f856c154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.084+0000 7f8572a00640 1 --2- 172.21.15.31:0/2357308499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f856c0d20f0 0x7f856c0b54c0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.084+0000 7f8572a00640 1 --2- 172.21.15.31:0/2357308499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f856c0b0d10 0x7f856c14f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.084+0000 7f8572a00640 1 -- 172.21.15.31:0/2357308499 >> 172.21.15.31:0/2357308499 conn(0x7f856c09aa10 msgr2=0x7f856c070ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:09.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.084+0000 7f8572a00640 1 -- 172.21.15.31:0/2357308499 shutdown_connections 2024-09-17T05:37:09.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.084+0000 7f8572a00640 1 -- 172.21.15.31:0/2357308499 wait complete. 2024-09-17T05:37:09.111 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:37:09.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.264+0000 7f078c600640 1 -- 172.21.15.31:0/863642738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07840d28e0 msgr2=0x7f07840d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:09.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.264+0000 7f078c600640 1 --2- 172.21.15.31:0/863642738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07840d28e0 0x7f07840d0170 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f07840b0d90 tx=0x7f077001c600 comp rx=0 tx=0).stop 2024-09-17T05:37:09.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.264+0000 7f078c600640 1 -- 172.21.15.31:0/863642738 shutdown_connections 2024-09-17T05:37:09.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.264+0000 7f078c600640 1 --2- 172.21.15.31:0/863642738 >> v2:172.21.15.155:3300/0 conn(0x7f07840d06b0 0x7f07840b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.264+0000 7f078c600640 1 --2- 172.21.15.31:0/863642738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07840d28e0 0x7f07840d0170 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.264+0000 7f078c600640 1 --2- 172.21.15.31:0/863642738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f078415f390 0x7f07840cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.264+0000 7f078c600640 1 -- 172.21.15.31:0/863642738 >> 172.21.15.31:0/863642738 conn(0x7f07840d1dc0 msgr2=0x7f07840d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:09.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.264+0000 7f078c600640 1 -- 172.21.15.31:0/863642738 shutdown_connections 2024-09-17T05:37:09.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.264+0000 7f078c600640 1 -- 172.21.15.31:0/863642738 wait complete. 2024-09-17T05:37:09.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f078c600640 1 Processor -- start 2024-09-17T05:37:09.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f078c600640 1 -- start start 2024-09-17T05:37:09.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f078c600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07840d06b0 0x7f07841593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:09.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f078c600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07840d28e0 0x7f07840c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:09.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f078c600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f078415f390 0x7f0784164eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:09.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f078c600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f07840afee0 con 0x7f078415f390 2024-09-17T05:37:09.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f078c600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f07840afd60 con 0x7f07840d28e0 2024-09-17T05:37:09.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f078c600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f07840b0060 con 0x7f07840d06b0 2024-09-17T05:37:09.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f078a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f078415f390 0x7f0784164eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:09.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f0789c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07840d06b0 0x7f07841593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:09.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f0789200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07840d28e0 0x7f07840c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:09.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f0789c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07840d06b0 0x7f07841593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.31:57232/0 (socket says 172.21.15.31:57232) 2024-09-17T05:37:09.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f0789c00640 1 -- 172.21.15.31:0/3285358043 learned_addr learned my addr 172.21.15.31:0/3285358043 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:09.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f078a600640 1 -- 172.21.15.31:0/3285358043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07840d06b0 msgr2=0x7f07841593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:09.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f078a600640 1 --2- 172.21.15.31:0/3285358043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07840d06b0 0x7f07841593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f078a600640 1 -- 172.21.15.31:0/3285358043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07840d28e0 msgr2=0x7f07840c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:09.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f078a600640 1 --2- 172.21.15.31:0/3285358043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07840d28e0 0x7f07840c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:09.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f078a600640 1 -- 172.21.15.31:0/3285358043 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07840c9800 con 0x7f078415f390 2024-09-17T05:37:09.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f0789200640 1 --2- 172.21.15.31:0/3285358043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07840d28e0 0x7f07840c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:37:09.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f078a600640 1 --2- 172.21.15.31:0/3285358043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f078415f390 0x7f0784164eb0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f077c00e990 tx=0x7f077c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:09.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f0781600640 1 -- 172.21.15.31:0/3285358043 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077c004d30 con 0x7f078415f390 2024-09-17T05:37:09.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f0781600640 1 -- 172.21.15.31:0/3285358043 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f077c00cb00 con 0x7f078415f390 2024-09-17T05:37:09.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f078c600640 1 -- 172.21.15.31:0/3285358043 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07840c9ae0 con 0x7f078415f390 2024-09-17T05:37:09.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f0781600640 1 -- 172.21.15.31:0/3285358043 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077c005020 con 0x7f078415f390 2024-09-17T05:37:09.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f078c600640 1 -- 172.21.15.31:0/3285358043 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07840ca0a0 con 0x7f078415f390 2024-09-17T05:37:09.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.268+0000 7f078c600640 1 -- 172.21.15.31:0/3285358043 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07840b1350 con 0x7f078415f390 2024-09-17T05:37:09.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.272+0000 7f0781600640 1 -- 172.21.15.31:0/3285358043 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f077c0051c0 con 0x7f078415f390 2024-09-17T05:37:09.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.272+0000 7f0781600640 1 --2- 172.21.15.31:0/3285358043 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0764073e00 0x7f07640762c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:09.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.272+0000 7f0781600640 1 -- 172.21.15.31:0/3285358043 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5823+0+0 (secure 0 0 0) 0x7f077c093620 con 0x7f078415f390 2024-09-17T05:37:09.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.272+0000 7f0789c00640 1 --2- 172.21.15.31:0/3285358043 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0764073e00 0x7f07640762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:09.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.272+0000 7f0789c00640 1 --2- 172.21.15.31:0/3285358043 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0764073e00 0x7f07640762c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0784166370 tx=0x7f077800b410 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:09.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.276+0000 7f0781600640 1 -- 172.21.15.31:0/3285358043 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f077c016030 con 0x7f078415f390 2024-09-17T05:37:09.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:09.452+0000 7f078c600640 1 -- 172.21.15.31:0/3285358043 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f07840d2550 con 0x7f078415f390 2024-09-17T05:37:10.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.332+0000 7f0781600640 1 -- 172.21.15.31:0/3285358043 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v165) ==== 181+0+0 (secure 0 0 0) 0x7f077c05f8d0 con 0x7f078415f390 2024-09-17T05:37:10.336 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:37:10.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.336+0000 7f078c600640 1 -- 172.21.15.31:0/3285358043 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0764073e00 msgr2=0x7f07640762c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:10.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.336+0000 7f078c600640 1 --2- 172.21.15.31:0/3285358043 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0764073e00 0x7f07640762c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0784166370 tx=0x7f077800b410 comp rx=0 tx=0).stop 2024-09-17T05:37:10.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.336+0000 7f078c600640 1 -- 172.21.15.31:0/3285358043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f078415f390 msgr2=0x7f0784164eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:10.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.336+0000 7f078c600640 1 --2- 172.21.15.31:0/3285358043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f078415f390 0x7f0784164eb0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f077c00e990 tx=0x7f077c00ee50 comp rx=0 tx=0).stop 2024-09-17T05:37:10.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.336+0000 7f078c600640 1 -- 172.21.15.31:0/3285358043 shutdown_connections 2024-09-17T05:37:10.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.336+0000 7f078c600640 1 --2- 172.21.15.31:0/3285358043 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0764073e00 0x7f07640762c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.336+0000 7f078c600640 1 --2- 172.21.15.31:0/3285358043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f078415f390 0x7f0784164eb0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.336+0000 7f078c600640 1 --2- 172.21.15.31:0/3285358043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f07840d28e0 0x7f07840c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.336+0000 7f078c600640 1 --2- 172.21.15.31:0/3285358043 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07840d06b0 0x7f07841593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.336+0000 7f078c600640 1 -- 172.21.15.31:0/3285358043 >> 172.21.15.31:0/3285358043 conn(0x7f07840d1dc0 msgr2=0x7f078406ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:10.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.340+0000 7f078c600640 1 -- 172.21.15.31:0/3285358043 shutdown_connections 2024-09-17T05:37:10.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.340+0000 7f078c600640 1 -- 172.21.15.31:0/3285358043 wait complete. 2024-09-17T05:37:10.368 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:37:10.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.520+0000 7fe104e00640 1 -- 172.21.15.31:0/3646086918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe10015c1f0 msgr2=0x7fe1000cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:10.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.520+0000 7fe104e00640 1 --2- 172.21.15.31:0/3646086918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe10015c1f0 0x7fe1000cee10 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009900 tx=0x7fe0e801c8e0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.520+0000 7fe104e00640 1 -- 172.21.15.31:0/3646086918 shutdown_connections 2024-09-17T05:37:10.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.520+0000 7fe104e00640 1 --2- 172.21.15.31:0/3646086918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1000b0b60 0x7fe1000ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.520+0000 7fe104e00640 1 --2- 172.21.15.31:0/3646086918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe10015c1f0 0x7fe1000cee10 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.520+0000 7fe104e00640 1 -- 172.21.15.31:0/3646086918 >> 172.21.15.31:0/3646086918 conn(0x7fe1000d1da0 msgr2=0x7fe1000d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:10.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.520+0000 7fe104e00640 1 -- 172.21.15.31:0/3646086918 shutdown_connections 2024-09-17T05:37:10.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe104e00640 1 -- 172.21.15.31:0/3646086918 wait complete. 2024-09-17T05:37:10.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe104e00640 1 Processor -- start 2024-09-17T05:37:10.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe104e00640 1 -- start start 2024-09-17T05:37:10.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe104e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1000b0b60 0x7fe10014e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:10.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe104e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe10015be10 0x7fe10014dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:10.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe104e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe10015c1f0 0x7fe1001f8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:10.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe104e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe100169040 con 0x7fe1000b0b60 2024-09-17T05:37:10.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe104e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe100168ec0 con 0x7fe10015be10 2024-09-17T05:37:10.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe104e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe1001691c0 con 0x7fe10015c1f0 2024-09-17T05:37:10.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe0fde00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1000b0b60 0x7fe10014e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:10.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe0fde00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1000b0b60 0x7fe10014e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59494/0 (socket says 172.21.15.31:59494) 2024-09-17T05:37:10.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe0fe800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe10015c1f0 0x7fe1001f8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:10.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe0fde00640 1 -- 172.21.15.31:0/246589436 learned_addr learned my addr 172.21.15.31:0/246589436 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:10.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe0f7e00640 1 --2- 172.21.15.31:0/246589436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe10015be10 0x7fe10014dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:10.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe0fde00640 1 -- 172.21.15.31:0/246589436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe10015c1f0 msgr2=0x7fe1001f8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:10.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe0fde00640 1 --2- 172.21.15.31:0/246589436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe10015c1f0 0x7fe1001f8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe0fde00640 1 -- 172.21.15.31:0/246589436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe10015be10 msgr2=0x7fe10014dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:10.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe0fde00640 1 --2- 172.21.15.31:0/246589436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe10015be10 0x7fe10014dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:10.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe0fde00640 1 -- 172.21.15.31:0/246589436 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10006f580 con 0x7fe1000b0b60 2024-09-17T05:37:10.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe0fde00640 1 --2- 172.21.15.31:0/246589436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1000b0b60 0x7fe10014e340 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000c500 tx=0x7fe0f000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:10.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe0f6000640 1 -- 172.21.15.31:0/246589436 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0017070 con 0x7fe1000b0b60 2024-09-17T05:37:10.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe0f6000640 1 -- 172.21.15.31:0/246589436 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0f00053c0 con 0x7fe1000b0b60 2024-09-17T05:37:10.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.524+0000 7fe0f6000640 1 -- 172.21.15.31:0/246589436 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0012890 con 0x7fe1000b0b60 2024-09-17T05:37:10.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.528+0000 7fe104e00640 1 -- 172.21.15.31:0/246589436 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe10006f800 con 0x7fe1000b0b60 2024-09-17T05:37:10.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.528+0000 7fe104e00640 1 -- 172.21.15.31:0/246589436 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe10006faa0 con 0x7fe1000b0b60 2024-09-17T05:37:10.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.528+0000 7fe104e00640 1 -- 172.21.15.31:0/246589436 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1000ccbd0 con 0x7fe1000b0b60 2024-09-17T05:37:10.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.528+0000 7fe0f6000640 1 -- 172.21.15.31:0/246589436 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7fe0f001a070 con 0x7fe1000b0b60 2024-09-17T05:37:10.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.528+0000 7fe0f6000640 1 --2- 172.21.15.31:0/246589436 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe0dc073dd0 0x7fe0dc076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:10.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.528+0000 7fe0f6000640 1 -- 172.21.15.31:0/246589436 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5385+0+0 (secure 0 0 0) 0x7fe0f0092180 con 0x7fe1000b0b60 2024-09-17T05:37:10.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.528+0000 7fe0f7e00640 1 --2- 172.21.15.31:0/246589436 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe0dc073dd0 0x7fe0dc076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:10.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.528+0000 7fe0f7e00640 1 --2- 172.21.15.31:0/246589436 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe0dc073dd0 0x7fe0dc076290 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80af000 tx=0x7fe0e801b120 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:10.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.532+0000 7fe0f6000640 1 -- 172.21.15.31:0/246589436 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fe10006f580 con 0x7fe1000b0b60 2024-09-17T05:37:10.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:10.716+0000 7fe104e00640 1 -- 172.21.15.31:0/246589436 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe100070350 con 0x7fe1000b0b60 2024-09-17T05:37:11.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.340+0000 7fe0f6000640 1 -- 172.21.15.31:0/246589436 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v166) ==== 169+0+0 (secure 0 0 0) 0x7fe0f005e350 con 0x7fe1000b0b60 2024-09-17T05:37:11.344 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-09-17T05:37:11.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.348+0000 7fe104e00640 1 -- 172.21.15.31:0/246589436 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe0dc073dd0 msgr2=0x7fe0dc076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:11.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.348+0000 7fe104e00640 1 --2- 172.21.15.31:0/246589436 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe0dc073dd0 0x7fe0dc076290 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80af000 tx=0x7fe0e801b120 comp rx=0 tx=0).stop 2024-09-17T05:37:11.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.348+0000 7fe104e00640 1 -- 172.21.15.31:0/246589436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1000b0b60 msgr2=0x7fe10014e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:11.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.348+0000 7fe104e00640 1 --2- 172.21.15.31:0/246589436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1000b0b60 0x7fe10014e340 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000c500 tx=0x7fe0f000c9c0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.348+0000 7fe104e00640 1 -- 172.21.15.31:0/246589436 shutdown_connections 2024-09-17T05:37:11.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.348+0000 7fe104e00640 1 --2- 172.21.15.31:0/246589436 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fe0dc073dd0 0x7fe0dc076290 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.348+0000 7fe104e00640 1 --2- 172.21.15.31:0/246589436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe10015c1f0 0x7fe1001f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.348+0000 7fe104e00640 1 --2- 172.21.15.31:0/246589436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe10015be10 0x7fe10014dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.348+0000 7fe104e00640 1 --2- 172.21.15.31:0/246589436 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1000b0b60 0x7fe10014e340 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.348+0000 7fe104e00640 1 -- 172.21.15.31:0/246589436 >> 172.21.15.31:0/246589436 conn(0x7fe1000d1da0 msgr2=0x7fe100070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:11.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.348+0000 7fe104e00640 1 -- 172.21.15.31:0/246589436 shutdown_connections 2024-09-17T05:37:11.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.348+0000 7fe104e00640 1 -- 172.21.15.31:0/246589436 wait complete. 2024-09-17T05:37:11.378 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:37:11.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.528+0000 7f6175a00640 1 -- 172.21.15.31:0/3112558733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6154003a60 msgr2=0x7f6154003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:11.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.528+0000 7f6175a00640 1 --2- 172.21.15.31:0/3112558733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6154003a60 0x7f6154003e60 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f6160006fc0 tx=0x7f616001cf40 comp rx=0 tx=0).stop 2024-09-17T05:37:11.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.528+0000 7f6175a00640 1 -- 172.21.15.31:0/3112558733 shutdown_connections 2024-09-17T05:37:11.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.528+0000 7f6175a00640 1 --2- 172.21.15.31:0/3112558733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6154003a60 0x7f6154003e60 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.528+0000 7f6175a00640 1 -- 172.21.15.31:0/3112558733 >> 172.21.15.31:0/3112558733 conn(0x7f61700b18f0 msgr2=0x7f61700b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:11.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.528+0000 7f6175a00640 1 -- 172.21.15.31:0/3112558733 shutdown_connections 2024-09-17T05:37:11.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.528+0000 7f6175a00640 1 -- 172.21.15.31:0/3112558733 wait complete. 2024-09-17T05:37:11.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f6175a00640 1 Processor -- start 2024-09-17T05:37:11.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f6175a00640 1 -- start start 2024-09-17T05:37:11.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f6175a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6154003a60 0x7f61701fc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:11.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f6175a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f617006f480 0x7f6170159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:11.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f6175a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61701ea0c0 0x7f61701ea550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:11.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f6175a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f61700ce810 con 0x7f6154003a60 2024-09-17T05:37:11.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f6175a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61700ad110 con 0x7f617006f480 2024-09-17T05:37:11.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f6175a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f61700ce990 con 0x7f61701ea0c0 2024-09-17T05:37:11.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f616ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6154003a60 0x7f61701fc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f616ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6154003a60 0x7f61701fc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59502/0 (socket says 172.21.15.31:59502) 2024-09-17T05:37:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f616ea00640 1 -- 172.21.15.31:0/3792021188 learned_addr learned my addr 172.21.15.31:0/3792021188 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f616f400640 1 --2- 172.21.15.31:0/3792021188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61701ea0c0 0x7f61701ea550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f6167e00640 1 --2- 172.21.15.31:0/3792021188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f617006f480 0x7f6170159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f616ea00640 1 -- 172.21.15.31:0/3792021188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61701ea0c0 msgr2=0x7f61701ea550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f616ea00640 1 --2- 172.21.15.31:0/3792021188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61701ea0c0 0x7f61701ea550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f616ea00640 1 -- 172.21.15.31:0/3792021188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f617006f480 msgr2=0x7f6170159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f616ea00640 1 --2- 172.21.15.31:0/3792021188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f617006f480 0x7f6170159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f616ea00640 1 -- 172.21.15.31:0/3792021188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61701fb640 con 0x7f6154003a60 2024-09-17T05:37:11.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f616f400640 1 --2- 172.21.15.31:0/3792021188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61701ea0c0 0x7f61701ea550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:11.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f616ea00640 1 --2- 172.21.15.31:0/3792021188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6154003a60 0x7f61701fc0b0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f616001ca00 tx=0x7f6160006c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:11.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f6166a00640 1 -- 172.21.15.31:0/3792021188 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61600060d0 con 0x7f6154003a60 2024-09-17T05:37:11.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f6166a00640 1 -- 172.21.15.31:0/3792021188 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61600064a0 con 0x7f6154003a60 2024-09-17T05:37:11.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f6166a00640 1 -- 172.21.15.31:0/3792021188 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6160001700 con 0x7f6154003a60 2024-09-17T05:37:11.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f6175a00640 1 -- 172.21.15.31:0/3792021188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61701eab80 con 0x7f6154003a60 2024-09-17T05:37:11.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f6175a00640 1 -- 172.21.15.31:0/3792021188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6170159e50 con 0x7f6154003a60 2024-09-17T05:37:11.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.532+0000 7f6175a00640 1 -- 172.21.15.31:0/3792021188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61700ceef0 con 0x7f6154003a60 2024-09-17T05:37:11.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.536+0000 7f6166a00640 1 -- 172.21.15.31:0/3792021188 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f61600a59a0 con 0x7f6154003a60 2024-09-17T05:37:11.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.536+0000 7f6166a00640 1 --2- 172.21.15.31:0/3792021188 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f614c073dd0 0x7f614c076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:11.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.536+0000 7f6166a00640 1 -- 172.21.15.31:0/3792021188 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f616012bd50 con 0x7f6154003a60 2024-09-17T05:37:11.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.536+0000 7f6167e00640 1 --2- 172.21.15.31:0/3792021188 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f614c073dd0 0x7f614c076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:11.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.536+0000 7f6167e00640 1 --2- 172.21.15.31:0/3792021188 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f614c073dd0 0x7f614c076290 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f617009d120 tx=0x7f6158006b80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:11.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.540+0000 7f6166a00640 1 -- 172.21.15.31:0/3792021188 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6160016cf0 con 0x7f6154003a60 2024-09-17T05:37:11.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.728+0000 7f6175a00640 1 -- 172.21.15.31:0/3792021188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f61700b1fb0 con 0x7f6154003a60 2024-09-17T05:37:11.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.732+0000 7f6166a00640 1 -- 172.21.15.31:0/3792021188 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v49) ==== 71+0+0 (secure 0 0 0) 0x7f61600fde20 con 0x7f6154003a60 2024-09-17T05:37:11.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.732+0000 7f6175a00640 1 -- 172.21.15.31:0/3792021188 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f614c073dd0 msgr2=0x7f614c076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:11.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.732+0000 7f6175a00640 1 --2- 172.21.15.31:0/3792021188 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f614c073dd0 0x7f614c076290 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f617009d120 tx=0x7f6158006b80 comp rx=0 tx=0).stop 2024-09-17T05:37:11.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.732+0000 7f6175a00640 1 -- 172.21.15.31:0/3792021188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6154003a60 msgr2=0x7f61701fc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:11.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.732+0000 7f6175a00640 1 --2- 172.21.15.31:0/3792021188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6154003a60 0x7f61701fc0b0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f616001ca00 tx=0x7f6160006c70 comp rx=0 tx=0).stop 2024-09-17T05:37:11.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.732+0000 7f6175a00640 1 -- 172.21.15.31:0/3792021188 shutdown_connections 2024-09-17T05:37:11.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.732+0000 7f6175a00640 1 --2- 172.21.15.31:0/3792021188 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f614c073dd0 0x7f614c076290 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.732+0000 7f6175a00640 1 --2- 172.21.15.31:0/3792021188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61701ea0c0 0x7f61701ea550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.732+0000 7f6175a00640 1 --2- 172.21.15.31:0/3792021188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f617006f480 0x7f6170159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.732+0000 7f6175a00640 1 --2- 172.21.15.31:0/3792021188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6154003a60 0x7f61701fc0b0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.732+0000 7f6175a00640 1 -- 172.21.15.31:0/3792021188 >> 172.21.15.31:0/3792021188 conn(0x7f61700b18f0 msgr2=0x7f617015a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:11.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.732+0000 7f6175a00640 1 -- 172.21.15.31:0/3792021188 shutdown_connections 2024-09-17T05:37:11.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.732+0000 7f6175a00640 1 -- 172.21.15.31:0/3792021188 wait complete. 2024-09-17T05:37:11.755 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade' 2024-09-17T05:37:11.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.900+0000 7f9e6ae00640 1 -- 172.21.15.31:0/1984643326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e6415bea0 msgr2=0x7f9e640ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:11.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.900+0000 7f9e6ae00640 1 --2- 172.21.15.31:0/1984643326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e6415bea0 0x7f9e640ce670 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f9e640cc3a0 tx=0x7f9e5401c830 comp rx=0 tx=0).stop 2024-09-17T05:37:11.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.900+0000 7f9e6ae00640 1 -- 172.21.15.31:0/1984643326 shutdown_connections 2024-09-17T05:37:11.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.900+0000 7f9e6ae00640 1 --2- 172.21.15.31:0/1984643326 >> v2:172.21.15.155:3300/0 conn(0x7f9e640d28e0 0x7f9e640cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.900+0000 7f9e6ae00640 1 --2- 172.21.15.31:0/1984643326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e6415bea0 0x7f9e640ce670 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.900+0000 7f9e6ae00640 1 -- 172.21.15.31:0/1984643326 >> 172.21.15.31:0/1984643326 conn(0x7f9e640d1dc0 msgr2=0x7f9e640d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:11.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.900+0000 7f9e6ae00640 1 -- 172.21.15.31:0/1984643326 shutdown_connections 2024-09-17T05:37:11.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.900+0000 7f9e6ae00640 1 -- 172.21.15.31:0/1984643326 wait complete. 2024-09-17T05:37:11.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.900+0000 7f9e6ae00640 1 Processor -- start 2024-09-17T05:37:11.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.900+0000 7f9e6ae00640 1 -- start start 2024-09-17T05:37:11.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e6ae00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e640cdb30 0x7f9e640ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:11.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e6ae00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e640d28e0 0x7f9e64166140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:11.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e6ae00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e6415bea0 0x7f9e640b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:11.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e6ae00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9e64168fc0 con 0x7f9e640d28e0 2024-09-17T05:37:11.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e6ae00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9e64168e40 con 0x7f9e6415bea0 2024-09-17T05:37:11.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e6ae00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9e64169140 con 0x7f9e640cdb30 2024-09-17T05:37:11.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e63400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e640d28e0 0x7f9e64166140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:11.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e63400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e640d28e0 0x7f9e64166140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59532/0 (socket says 172.21.15.31:59532) 2024-09-17T05:37:11.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e63400640 1 -- 172.21.15.31:0/442334083 learned_addr learned my addr 172.21.15.31:0/442334083 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:11.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e63e00640 1 --2- 172.21.15.31:0/442334083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e640cdb30 0x7f9e640ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:11.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e68e00640 1 --2- 172.21.15.31:0/442334083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e6415bea0 0x7f9e640b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:11.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e63400640 1 -- 172.21.15.31:0/442334083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e640cdb30 msgr2=0x7f9e640ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:11.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e63400640 1 --2- 172.21.15.31:0/442334083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e640cdb30 0x7f9e640ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e63400640 1 -- 172.21.15.31:0/442334083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e6415bea0 msgr2=0x7f9e640b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:11.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e63400640 1 --2- 172.21.15.31:0/442334083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e6415bea0 0x7f9e640b5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:11.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e63400640 1 -- 172.21.15.31:0/442334083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e64159af0 con 0x7f9e640d28e0 2024-09-17T05:37:11.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e63400640 1 --2- 172.21.15.31:0/442334083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e640d28e0 0x7f9e64166140 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f9e5000c480 tx=0x7f9e5000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:11.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e5be00640 1 -- 172.21.15.31:0/442334083 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e50012830 con 0x7f9e640d28e0 2024-09-17T05:37:11.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e5be00640 1 -- 172.21.15.31:0/442334083 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e50017070 con 0x7f9e640d28e0 2024-09-17T05:37:11.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e5be00640 1 -- 172.21.15.31:0/442334083 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e50012d80 con 0x7f9e640d28e0 2024-09-17T05:37:11.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e6ae00640 1 -- 172.21.15.31:0/442334083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e640c6d60 con 0x7f9e640d28e0 2024-09-17T05:37:11.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e6ae00640 1 -- 172.21.15.31:0/442334083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e640c7000 con 0x7f9e640d28e0 2024-09-17T05:37:11.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.904+0000 7f9e6ae00640 1 -- 172.21.15.31:0/442334083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e640cc9d0 con 0x7f9e640d28e0 2024-09-17T05:37:11.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.908+0000 7f9e5be00640 1 -- 172.21.15.31:0/442334083 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f9e5001c460 con 0x7f9e640d28e0 2024-09-17T05:37:11.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.908+0000 7f9e5be00640 1 --2- 172.21.15.31:0/442334083 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9e44073dd0 0x7f9e44076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:11.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.908+0000 7f9e5be00640 1 -- 172.21.15.31:0/442334083 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f9e50092bc0 con 0x7f9e640d28e0 2024-09-17T05:37:11.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.908+0000 7f9e63e00640 1 --2- 172.21.15.31:0/442334083 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9e44073dd0 0x7f9e44076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:11.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.908+0000 7f9e63e00640 1 --2- 172.21.15.31:0/442334083 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9e44073dd0 0x7f9e44076290 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9e540af000 tx=0x7f9e540a7040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:11.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:11.912+0000 7f9e5be00640 1 -- 172.21.15.31:0/442334083 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9e64159af0 con 0x7f9e640d28e0 2024-09-17T05:37:12.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:12.148+0000 7f9e6ae00640 1 -- 172.21.15.31:0/442334083 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f9e640b79e0 con 0x7f9e640d28e0 2024-09-17T05:37:12.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:12.344+0000 7f9e5be00640 1 -- 172.21.15.31:0/442334083 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]}]=0 v473) ==== 163+0+0 (secure 0 0 0) 0x7f9e5005ee10 con 0x7f9e640d28e0 2024-09-17T05:37:12.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:12.344+0000 7f9e6ae00640 1 -- 172.21.15.31:0/442334083 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9e44073dd0 msgr2=0x7f9e44076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:12.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:12.344+0000 7f9e6ae00640 1 --2- 172.21.15.31:0/442334083 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9e44073dd0 0x7f9e44076290 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9e540af000 tx=0x7f9e540a7040 comp rx=0 tx=0).stop 2024-09-17T05:37:12.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:12.344+0000 7f9e6ae00640 1 -- 172.21.15.31:0/442334083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e640d28e0 msgr2=0x7f9e64166140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:12.344+0000 7f9e6ae00640 1 --2- 172.21.15.31:0/442334083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e640d28e0 0x7f9e64166140 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f9e5000c480 tx=0x7f9e5000c940 comp rx=0 tx=0).stop 2024-09-17T05:37:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:12.344+0000 7f9e6ae00640 1 -- 172.21.15.31:0/442334083 shutdown_connections 2024-09-17T05:37:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:12.344+0000 7f9e6ae00640 1 --2- 172.21.15.31:0/442334083 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f9e44073dd0 0x7f9e44076290 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:12.344+0000 7f9e6ae00640 1 --2- 172.21.15.31:0/442334083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e6415bea0 0x7f9e640b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:12.344+0000 7f9e6ae00640 1 --2- 172.21.15.31:0/442334083 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e640d28e0 0x7f9e64166140 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:12.344+0000 7f9e6ae00640 1 --2- 172.21.15.31:0/442334083 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e640cdb30 0x7f9e640ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:12.344+0000 7f9e6ae00640 1 -- 172.21.15.31:0/442334083 >> 172.21.15.31:0/442334083 conn(0x7f9e640d1dc0 msgr2=0x7f9e6415ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:12.348+0000 7f9e6ae00640 1 -- 172.21.15.31:0/442334083 shutdown_connections 2024-09-17T05:37:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:12.348+0000 7f9e6ae00640 1 -- 172.21.15.31:0/442334083 wait complete. 2024-09-17T05:37:12.369 INFO:tasks.cephfs_test_runner:Validate unparseable text .meta file on legacy subvol root doesn't break the system ... ok 2024-09-17T05:37:12.370 INFO:tasks.cephfs_test_runner: 2024-09-17T05:37:12.370 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-17T05:37:12.370 INFO:tasks.cephfs_test_runner:Ran 11 tests in 480.357s 2024-09-17T05:37:12.370 INFO:tasks.cephfs_test_runner: 2024-09-17T05:37:12.370 INFO:tasks.cephfs_test_runner:OK 2024-09-17T05:37:12.370 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-17T05:37:12.380 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-17T05:37:12.406 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-17T05:37:12.406 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:37:12.406 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:12.415 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:37:12.415 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-17T05:37:12.415 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:12.464 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3998 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:37:12.464 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:37:12.464 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:12.474 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:37:12.474 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-17T05:37:12.474 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:37:12.524 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350244k,nr_inodes=4087561,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4506 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:37:12.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:12.525 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T05:37:12.534 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:37:12.534 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:37:12.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:12.534 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:37:12.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:12.596 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:37:12.855 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:37:12.859 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:37:13.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:13.070 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2024-09-17T05:37:13.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:13.207 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-17T05:37:13.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:13.217 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2024-09-17T05:37:13.696 INFO:teuthology.orchestra.run.smithi031.stderr:Cannot find device "ceph-brx" 2024-09-17T05:37:13.698 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:37:13.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:13.699 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-17T05:37:13.709 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:37:13.709 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:37:13.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:13.709 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:37:13.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:13.780 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:37:14.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:14.281 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-09-17T05:37:14.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:14.427 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-17T05:37:14.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:37:14.437 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-09-17T05:37:14.787 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2024-09-17T05:37:14.790 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:37:14.791 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T05:37:14.802 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:37:14.803 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:37:14.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.960+0000 7f6c61600640 1 -- 172.21.15.31:0/1557475335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c40003a60 msgr2=0x7f6c40003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:14.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.960+0000 7f6c61600640 1 --2- 172.21.15.31:0/1557475335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c40003a60 0x7f6c40003e80 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c00c290 tx=0x7f6c4c01cf20 comp rx=0 tx=0).stop 2024-09-17T05:37:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.960+0000 7f6c5b400640 1 -- 172.21.15.31:0/1557475335 reap_dead start 2024-09-17T05:37:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.960+0000 7f6c61600640 1 -- 172.21.15.31:0/1557475335 shutdown_connections 2024-09-17T05:37:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.960+0000 7f6c61600640 1 -- 172.21.15.31:0/1557475335 >> 172.21.15.31:0/1557475335 conn(0x7f6c5c0d1dc0 msgr2=0x7f6c5c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.960+0000 7f6c61600640 1 -- 172.21.15.31:0/1557475335 shutdown_connections 2024-09-17T05:37:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.960+0000 7f6c61600640 1 -- 172.21.15.31:0/1557475335 wait complete. 2024-09-17T05:37:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c61600640 1 Processor -- start 2024-09-17T05:37:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c61600640 1 -- start start 2024-09-17T05:37:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c61600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c40003a60 0x7f6c5c0b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c61600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c5c1fad30 0x7f6c5c14c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c61600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c5c06dd30 0x7f6c5c163ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c61600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5c166cf0 con 0x7f6c40003a60 2024-09-17T05:37:14.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c61600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5c166b70 con 0x7f6c5c1fad30 2024-09-17T05:37:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c61600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6c5c166e70 con 0x7f6c5c06dd30 2024-09-17T05:37:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c5aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c40003a60 0x7f6c5c0b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c5aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c40003a60 0x7f6c5c0b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59554/0 (socket says 172.21.15.31:59554) 2024-09-17T05:37:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c5aa00640 1 -- 172.21.15.31:0/3774071712 learned_addr learned my addr 172.21.15.31:0/3774071712 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c53e00640 1 --2- 172.21.15.31:0/3774071712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c5c1fad30 0x7f6c5c14c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c5b400640 1 --2- 172.21.15.31:0/3774071712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c5c06dd30 0x7f6c5c163ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c5aa00640 1 -- 172.21.15.31:0/3774071712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c5c06dd30 msgr2=0x7f6c5c163ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c5aa00640 1 --2- 172.21.15.31:0/3774071712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c5c06dd30 0x7f6c5c163ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c5aa00640 1 -- 172.21.15.31:0/3774071712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c5c1fad30 msgr2=0x7f6c5c14c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c5aa00640 1 --2- 172.21.15.31:0/3774071712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c5c1fad30 0x7f6c5c14c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c5aa00640 1 -- 172.21.15.31:0/3774071712 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5c157800 con 0x7f6c40003a60 2024-09-17T05:37:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c5aa00640 1 --2- 172.21.15.31:0/3774071712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c40003a60 0x7f6c5c0b3ce0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c01b620 tx=0x7f6c4c001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c52a00640 1 -- 172.21.15.31:0/3774071712 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0a5be0 con 0x7f6c40003a60 2024-09-17T05:37:14.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c52a00640 1 -- 172.21.15.31:0/3774071712 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c4c0013c0 con 0x7f6c40003a60 2024-09-17T05:37:14.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c52a00640 1 -- 172.21.15.31:0/3774071712 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0060d0 con 0x7f6c40003a60 2024-09-17T05:37:14.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.964+0000 7f6c61600640 1 -- 172.21.15.31:0/3774071712 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c5c1fb2a0 con 0x7f6c40003a60 2024-09-17T05:37:14.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.968+0000 7f6c61600640 1 -- 172.21.15.31:0/3774071712 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c5c1fb860 con 0x7f6c40003a60 2024-09-17T05:37:14.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.968+0000 7f6c61600640 1 -- 172.21.15.31:0/3774071712 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c5c0ae9b0 con 0x7f6c40003a60 2024-09-17T05:37:14.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.968+0000 7f6c52a00640 1 -- 172.21.15.31:0/3774071712 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f6c4c0b7030 con 0x7f6c40003a60 2024-09-17T05:37:14.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.968+0000 7f6c52a00640 1 --2- 172.21.15.31:0/3774071712 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6c38073dd0 0x7f6c38076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:14.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.968+0000 7f6c52a00640 1 -- 172.21.15.31:0/3774071712 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f6c4c12bba0 con 0x7f6c40003a60 2024-09-17T05:37:14.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.968+0000 7f6c53e00640 1 --2- 172.21.15.31:0/3774071712 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6c38073dd0 0x7f6c38076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:14.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.972+0000 7f6c53e00640 1 --2- 172.21.15.31:0/3774071712 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6c38073dd0 0x7f6c38076290 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c072650 tx=0x7f6c440091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:14.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:14.972+0000 7f6c52a00640 1 -- 172.21.15.31:0/3774071712 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6c4c016cd0 con 0x7f6c40003a60 2024-09-17T05:37:15.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.144+0000 7f6c61600640 1 -- 172.21.15.31:0/3774071712 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c5c0c85e0 con 0x7f6c38073dd0 2024-09-17T05:37:15.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.144+0000 7f6c52a00640 1 -- 172.21.15.31:0/3774071712 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13501 (secure 0 0 0) 0x7f6c5c0c85e0 con 0x7f6c38073dd0 2024-09-17T05:37:15.148 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:37:15.148 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:37:15.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.148+0000 7f6c61600640 1 -- 172.21.15.31:0/3774071712 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6c38073dd0 msgr2=0x7f6c38076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.148+0000 7f6c61600640 1 --2- 172.21.15.31:0/3774071712 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6c38073dd0 0x7f6c38076290 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c072650 tx=0x7f6c440091e0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.148+0000 7f6c61600640 1 -- 172.21.15.31:0/3774071712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c40003a60 msgr2=0x7f6c5c0b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.148+0000 7f6c61600640 1 --2- 172.21.15.31:0/3774071712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c40003a60 0x7f6c5c0b3ce0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c01b620 tx=0x7f6c4c001c60 comp rx=0 tx=0).stop 2024-09-17T05:37:15.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.148+0000 7f6c61600640 1 -- 172.21.15.31:0/3774071712 shutdown_connections 2024-09-17T05:37:15.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.148+0000 7f6c61600640 1 --2- 172.21.15.31:0/3774071712 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6c38073dd0 0x7f6c38076290 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.148+0000 7f6c61600640 1 --2- 172.21.15.31:0/3774071712 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c5c06dd30 0x7f6c5c163ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.148+0000 7f6c61600640 1 --2- 172.21.15.31:0/3774071712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c5c1fad30 0x7f6c5c14c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.148+0000 7f6c61600640 1 --2- 172.21.15.31:0/3774071712 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6c40003a60 0x7f6c5c0b3ce0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.148+0000 7f6c61600640 1 -- 172.21.15.31:0/3774071712 >> 172.21.15.31:0/3774071712 conn(0x7f6c5c0d1dc0 msgr2=0x7f6c5c0d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:15.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.148+0000 7f6c61600640 1 -- 172.21.15.31:0/3774071712 shutdown_connections 2024-09-17T05:37:15.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.148+0000 7f6c61600640 1 -- 172.21.15.31:0/3774071712 wait complete. 2024-09-17T05:37:15.169 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-09-17T05:37:14.758808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":271224,"kb_used_data":17544,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703496,"statfs":{"total":773094113280,"available":772816379904,"internally_reserved":0,"allocated":17965056,"data_stored":8567800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-43999,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-63,"num_write_kb":-64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.674870"},"pg_stats":[{"pgid":"1.0","version":"70'79","reported_seq":405,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.652439+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:37:11.652439+0000","last_peered":"2024-09-17T05:37:11.652439+0000","last_clean":"2024-09-17T05:37:11.652439+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:37:11.652439+0000","last_undegraded":"2024-09-17T05:37:11.652439+0000","last_fullsized":"2024-09-17T05:37:11.652439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509547,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":2691072,"data_stored":1513751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509548,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33236,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338604,"statfs":{"total":96636764160,"available":96602730496,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542251,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509548,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509548,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509546,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33236,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338604,"statfs":{"total":96636764160,"available":96602730496,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542250,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37976,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333864,"statfs":{"total":96636764160,"available":96597876736,"internally_reserved":0,"allocated":2691072,"data_stored":1513751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:37:15.172 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:37:15.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.316+0000 7fc153e00640 1 -- 172.21.15.31:0/2115601398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc14c06f8c0 msgr2=0x7fc14c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.316+0000 7fc153e00640 1 --2- 172.21.15.31:0/2115601398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc14c06f8c0 0x7fc14c06fca0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fc1400092b0 tx=0x7fc14001c790 comp rx=0 tx=0).stop 2024-09-17T05:37:15.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.316+0000 7fc153e00640 1 -- 172.21.15.31:0/2115601398 shutdown_connections 2024-09-17T05:37:15.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.316+0000 7fc153e00640 1 --2- 172.21.15.31:0/2115601398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc14c06f8c0 0x7fc14c06fca0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.316+0000 7fc153e00640 1 -- 172.21.15.31:0/2115601398 >> 172.21.15.31:0/2115601398 conn(0x7fc14c0b18f0 msgr2=0x7fc14c0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:15.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.316+0000 7fc153e00640 1 -- 172.21.15.31:0/2115601398 shutdown_connections 2024-09-17T05:37:15.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.316+0000 7fc153e00640 1 -- 172.21.15.31:0/2115601398 wait complete. 2024-09-17T05:37:15.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc153e00640 1 Processor -- start 2024-09-17T05:37:15.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc153e00640 1 -- start start 2024-09-17T05:37:15.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc153e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc14c06f8c0 0x7fc14c0af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:15.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc153e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc14c0b3d30 0x7fc14c140150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:15.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc153e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc14c0cc740 0x7fc14c140690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:15.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc153e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c168a10 con 0x7fc14c0cc740 2024-09-17T05:37:15.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc153e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c0b4e80 con 0x7fc14c06f8c0 2024-09-17T05:37:15.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc153e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc14c168b90 con 0x7fc14c0b3d30 2024-09-17T05:37:15.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc151e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc14c0cc740 0x7fc14c140690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:15.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc151e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc14c0cc740 0x7fc14c140690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59580/0 (socket says 172.21.15.31:59580) 2024-09-17T05:37:15.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc151e00640 1 -- 172.21.15.31:0/1370036358 learned_addr learned my addr 172.21.15.31:0/1370036358 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:15.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc151400640 1 --2- 172.21.15.31:0/1370036358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc14c06f8c0 0x7fc14c0af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:15.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc150a00640 1 --2- 172.21.15.31:0/1370036358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc14c0b3d30 0x7fc14c140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:15.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc151e00640 1 -- 172.21.15.31:0/1370036358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc14c0b3d30 msgr2=0x7fc14c140150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc151e00640 1 --2- 172.21.15.31:0/1370036358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc14c0b3d30 0x7fc14c140150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc151e00640 1 -- 172.21.15.31:0/1370036358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc14c06f8c0 msgr2=0x7fc14c0af460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc151e00640 1 --2- 172.21.15.31:0/1370036358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc14c06f8c0 0x7fc14c0af460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc151e00640 1 -- 172.21.15.31:0/1370036358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14c159630 con 0x7fc14c0cc740 2024-09-17T05:37:15.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc151e00640 1 --2- 172.21.15.31:0/1370036358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc14c0cc740 0x7fc14c140690 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fc14400c7c0 tx=0x7fc14400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:15.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc149600640 1 -- 172.21.15.31:0/1370036358 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc144003b80 con 0x7fc14c0cc740 2024-09-17T05:37:15.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc149600640 1 -- 172.21.15.31:0/1370036358 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc144003d20 con 0x7fc14c0cc740 2024-09-17T05:37:15.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc149600640 1 -- 172.21.15.31:0/1370036358 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14400aab0 con 0x7fc14c0cc740 2024-09-17T05:37:15.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc153e00640 1 -- 172.21.15.31:0/1370036358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc14c159910 con 0x7fc14c0cc740 2024-09-17T05:37:15.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc153e00640 1 -- 172.21.15.31:0/1370036358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc14c159ed0 con 0x7fc14c0cc740 2024-09-17T05:37:15.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.320+0000 7fc153e00640 1 -- 172.21.15.31:0/1370036358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc14c0b41c0 con 0x7fc14c0cc740 2024-09-17T05:37:15.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.324+0000 7fc149600640 1 -- 172.21.15.31:0/1370036358 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7fc14400ac50 con 0x7fc14c0cc740 2024-09-17T05:37:15.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.324+0000 7fc149600640 1 --2- 172.21.15.31:0/1370036358 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc12c073dd0 0x7fc12c076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:15.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.324+0000 7fc149600640 1 -- 172.21.15.31:0/1370036358 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7fc144092b80 con 0x7fc14c0cc740 2024-09-17T05:37:15.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.324+0000 7fc151400640 1 --2- 172.21.15.31:0/1370036358 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc12c073dd0 0x7fc12c076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:15.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.324+0000 7fc151400640 1 --2- 172.21.15.31:0/1370036358 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc12c073dd0 0x7fc12c076290 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc1400af000 tx=0x7fc1400b2040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:15.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.328+0000 7fc149600640 1 -- 172.21.15.31:0/1370036358 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc14405edd0 con 0x7fc14c0cc740 2024-09-17T05:37:15.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.504+0000 7fc153e00640 1 -- 172.21.15.31:0/1370036358 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc14c15dd00 con 0x7fc12c073dd0 2024-09-17T05:37:15.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.504+0000 7fc149600640 1 -- 172.21.15.31:0/1370036358 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13501 (secure 0 0 0) 0x7fc14c15dd00 con 0x7fc12c073dd0 2024-09-17T05:37:15.506 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:37:15.506 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:37:15.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.504+0000 7fc153e00640 1 -- 172.21.15.31:0/1370036358 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc12c073dd0 msgr2=0x7fc12c076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.504+0000 7fc153e00640 1 --2- 172.21.15.31:0/1370036358 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc12c073dd0 0x7fc12c076290 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc1400af000 tx=0x7fc1400b2040 comp rx=0 tx=0).stop 2024-09-17T05:37:15.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.504+0000 7fc153e00640 1 -- 172.21.15.31:0/1370036358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc14c0cc740 msgr2=0x7fc14c140690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.504+0000 7fc153e00640 1 --2- 172.21.15.31:0/1370036358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc14c0cc740 0x7fc14c140690 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fc14400c7c0 tx=0x7fc14400cc80 comp rx=0 tx=0).stop 2024-09-17T05:37:15.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.504+0000 7fc153e00640 1 -- 172.21.15.31:0/1370036358 shutdown_connections 2024-09-17T05:37:15.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.504+0000 7fc153e00640 1 --2- 172.21.15.31:0/1370036358 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc12c073dd0 0x7fc12c076290 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.504+0000 7fc153e00640 1 --2- 172.21.15.31:0/1370036358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc14c0cc740 0x7fc14c140690 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.504+0000 7fc153e00640 1 --2- 172.21.15.31:0/1370036358 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc14c0b3d30 0x7fc14c140150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.504+0000 7fc153e00640 1 --2- 172.21.15.31:0/1370036358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc14c06f8c0 0x7fc14c0af460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.504+0000 7fc153e00640 1 -- 172.21.15.31:0/1370036358 >> 172.21.15.31:0/1370036358 conn(0x7fc14c0b18f0 msgr2=0x7fc14c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:15.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.504+0000 7fc153e00640 1 -- 172.21.15.31:0/1370036358 shutdown_connections 2024-09-17T05:37:15.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.504+0000 7fc153e00640 1 -- 172.21.15.31:0/1370036358 wait complete. 2024-09-17T05:37:15.527 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-09-17T05:37:14.758808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":271224,"kb_used_data":17544,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703496,"statfs":{"total":773094113280,"available":772816379904,"internally_reserved":0,"allocated":17965056,"data_stored":8567800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-43999,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-63,"num_write_kb":-64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.674870"},"pg_stats":[{"pgid":"1.0","version":"70'79","reported_seq":405,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.652439+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:37:11.652439+0000","last_peered":"2024-09-17T05:37:11.652439+0000","last_clean":"2024-09-17T05:37:11.652439+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:37:11.652439+0000","last_undegraded":"2024-09-17T05:37:11.652439+0000","last_fullsized":"2024-09-17T05:37:11.652439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509547,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":2691072,"data_stored":1513751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509548,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33236,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338604,"statfs":{"total":96636764160,"available":96602730496,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542251,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509548,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509548,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509546,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33236,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338604,"statfs":{"total":96636764160,"available":96602730496,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542250,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37976,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333864,"statfs":{"total":96636764160,"available":96597876736,"internally_reserved":0,"allocated":2691072,"data_stored":1513751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:37:15.528 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:37:15.528 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:37:15.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.672+0000 7f546c000640 1 -- 172.21.15.31:0/1595797602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f544c004d50 msgr2=0x7f544c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.672+0000 7f546c000640 1 --2- 172.21.15.31:0/1595797602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f544c004d50 0x7f544c0051d0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f545c00c610 tx=0x7f545c01d340 comp rx=0 tx=0).stop 2024-09-17T05:37:15.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.672+0000 7f546a000640 1 -- 172.21.15.31:0/1595797602 reap_dead start 2024-09-17T05:37:15.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.672+0000 7f546c000640 1 -- 172.21.15.31:0/1595797602 shutdown_connections 2024-09-17T05:37:15.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.672+0000 7f546c000640 1 -- 172.21.15.31:0/1595797602 >> 172.21.15.31:0/1595797602 conn(0x7f54640d1dc0 msgr2=0x7f54640d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:15.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.672+0000 7f546c000640 1 -- 172.21.15.31:0/1595797602 shutdown_connections 2024-09-17T05:37:15.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.672+0000 7f546c000640 1 -- 172.21.15.31:0/1595797602 wait complete. 2024-09-17T05:37:15.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f546c000640 1 Processor -- start 2024-09-17T05:37:15.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f546c000640 1 -- start start 2024-09-17T05:37:15.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f546c000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f544c004d50 0x7f5464158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:15.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f546c000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54641e3000 0x7f54640b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:15.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f546c000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54640c81e0 0x7f54640b7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:15.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f546c000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f546415c490 con 0x7f54641e3000 2024-09-17T05:37:15.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f546c000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f54640cebb0 con 0x7f544c004d50 2024-09-17T05:37:15.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f546c000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f54640ced30 con 0x7f54640c81e0 2024-09-17T05:37:15.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f5468c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54641e3000 0x7f54640b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:15.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f5468c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54641e3000 0x7f54640b7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59598/0 (socket says 172.21.15.31:59598) 2024-09-17T05:37:15.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f5468c00640 1 -- 172.21.15.31:0/1419955238 learned_addr learned my addr 172.21.15.31:0/1419955238 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:15.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f546a000640 1 --2- 172.21.15.31:0/1419955238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54640c81e0 0x7f54640b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:15.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f5469600640 1 --2- 172.21.15.31:0/1419955238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f544c004d50 0x7f5464158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:15.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f5468c00640 1 -- 172.21.15.31:0/1419955238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54640c81e0 msgr2=0x7f54640b7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f5468c00640 1 --2- 172.21.15.31:0/1419955238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54640c81e0 0x7f54640b7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f5468c00640 1 -- 172.21.15.31:0/1419955238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f544c004d50 msgr2=0x7f5464158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f5468c00640 1 --2- 172.21.15.31:0/1419955238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f544c004d50 0x7f5464158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f5468c00640 1 -- 172.21.15.31:0/1419955238 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54641e3570 con 0x7f54641e3000 2024-09-17T05:37:15.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f5468c00640 1 --2- 172.21.15.31:0/1419955238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54641e3000 0x7f54640b7230 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f5450011ae0 tx=0x7f5450011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:15.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f5461600640 1 -- 172.21.15.31:0/1419955238 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545000fe70 con 0x7f54641e3000 2024-09-17T05:37:15.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f5461600640 1 -- 172.21.15.31:0/1419955238 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5450004050 con 0x7f54641e3000 2024-09-17T05:37:15.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f5461600640 1 -- 172.21.15.31:0/1419955238 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54500044a0 con 0x7f54641e3000 2024-09-17T05:37:15.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f546c000640 1 -- 172.21.15.31:0/1419955238 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54641e3850 con 0x7f54641e3000 2024-09-17T05:37:15.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f546c000640 1 -- 172.21.15.31:0/1419955238 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5464158fa0 con 0x7f54641e3000 2024-09-17T05:37:15.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.676+0000 7f546c000640 1 -- 172.21.15.31:0/1419955238 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f546415a0b0 con 0x7f54641e3000 2024-09-17T05:37:15.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.680+0000 7f5461600640 1 -- 172.21.15.31:0/1419955238 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f5450003600 con 0x7f54641e3000 2024-09-17T05:37:15.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.680+0000 7f5461600640 1 --2- 172.21.15.31:0/1419955238 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5444073dd0 0x7f5444076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:15.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.680+0000 7f5461600640 1 -- 172.21.15.31:0/1419955238 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f5450093df0 con 0x7f54641e3000 2024-09-17T05:37:15.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.680+0000 7f5469600640 1 --2- 172.21.15.31:0/1419955238 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5444073dd0 0x7f5444076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:15.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.680+0000 7f5469600640 1 --2- 172.21.15.31:0/1419955238 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5444073dd0 0x7f5444076290 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5458009c60 tx=0x7f54580091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:15.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.684+0000 7f5461600640 1 -- 172.21.15.31:0/1419955238 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5450060100 con 0x7f54641e3000 2024-09-17T05:37:15.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.860+0000 7f546c000640 1 -- 172.21.15.31:0/1419955238 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f546406add0 con 0x7f5444073dd0 2024-09-17T05:37:15.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.860+0000 7f5461600640 1 -- 172.21.15.31:0/1419955238 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13501 (secure 0 0 0) 0x7f546406add0 con 0x7f5444073dd0 2024-09-17T05:37:15.862 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:37:15.862 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:37:15.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.860+0000 7f546c000640 1 -- 172.21.15.31:0/1419955238 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5444073dd0 msgr2=0x7f5444076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.860+0000 7f546c000640 1 --2- 172.21.15.31:0/1419955238 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5444073dd0 0x7f5444076290 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5458009c60 tx=0x7f54580091e0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.860+0000 7f546c000640 1 -- 172.21.15.31:0/1419955238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54641e3000 msgr2=0x7f54640b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:15.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.860+0000 7f546c000640 1 --2- 172.21.15.31:0/1419955238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54641e3000 0x7f54640b7230 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f5450011ae0 tx=0x7f5450011ee0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.860+0000 7f546c000640 1 -- 172.21.15.31:0/1419955238 shutdown_connections 2024-09-17T05:37:15.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.860+0000 7f546c000640 1 --2- 172.21.15.31:0/1419955238 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5444073dd0 0x7f5444076290 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.860+0000 7f546c000640 1 --2- 172.21.15.31:0/1419955238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f54640c81e0 0x7f54640b7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.860+0000 7f546c000640 1 --2- 172.21.15.31:0/1419955238 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54641e3000 0x7f54640b7230 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.860+0000 7f546c000640 1 --2- 172.21.15.31:0/1419955238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f544c004d50 0x7f5464158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:15.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.860+0000 7f546c000640 1 -- 172.21.15.31:0/1419955238 >> 172.21.15.31:0/1419955238 conn(0x7f54640d1dc0 msgr2=0x7f54640d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:15.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.860+0000 7f546c000640 1 -- 172.21.15.31:0/1419955238 shutdown_connections 2024-09-17T05:37:15.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:15.860+0000 7f546c000640 1 -- 172.21.15.31:0/1419955238 wait complete. 2024-09-17T05:37:15.884 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-09-17T05:37:14.758808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":271224,"kb_used_data":17544,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703496,"statfs":{"total":773094113280,"available":772816379904,"internally_reserved":0,"allocated":17965056,"data_stored":8567800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-43999,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-63,"num_write_kb":-64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.674870"},"pg_stats":[{"pgid":"1.0","version":"70'79","reported_seq":405,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.652439+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:37:11.652439+0000","last_peered":"2024-09-17T05:37:11.652439+0000","last_clean":"2024-09-17T05:37:11.652439+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:37:11.652439+0000","last_undegraded":"2024-09-17T05:37:11.652439+0000","last_fullsized":"2024-09-17T05:37:11.652439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509547,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":2691072,"data_stored":1513751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509548,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33236,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338604,"statfs":{"total":96636764160,"available":96602730496,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542251,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509548,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509548,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509546,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33236,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338604,"statfs":{"total":96636764160,"available":96602730496,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542250,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37976,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333864,"statfs":{"total":96636764160,"available":96597876736,"internally_reserved":0,"allocated":2691072,"data_stored":1513751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:37:15.884 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:37:16.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.028+0000 7fc623c00640 1 -- 172.21.15.31:0/2722729136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61c073880 msgr2=0x7fc61c073d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.028+0000 7fc623c00640 1 --2- 172.21.15.31:0/2722729136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61c073880 0x7fc61c073d10 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0ae960 tx=0x7fc61401cd80 comp rx=0 tx=0).stop 2024-09-17T05:37:16.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.028+0000 7fc623c00640 1 -- 172.21.15.31:0/2722729136 shutdown_connections 2024-09-17T05:37:16.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.028+0000 7fc623c00640 1 --2- 172.21.15.31:0/2722729136 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61c073880 0x7fc61c073d10 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.028+0000 7fc623c00640 1 --2- 172.21.15.31:0/2722729136 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc61c06cd70 0x7fc61c06d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.028+0000 7fc623c00640 1 --2- 172.21.15.31:0/2722729136 >> v2:172.21.15.155:3300/0 conn(0x7fc61c0add50 0x7fc61c0ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.028+0000 7fc623c00640 1 -- 172.21.15.31:0/2722729136 >> 172.21.15.31:0/2722729136 conn(0x7fc61c0d0d50 msgr2=0x7fc61c0d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:16.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.028+0000 7fc623c00640 1 -- 172.21.15.31:0/2722729136 shutdown_connections 2024-09-17T05:37:16.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.028+0000 7fc623c00640 1 -- 172.21.15.31:0/2722729136 wait complete. 2024-09-17T05:37:16.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc623c00640 1 Processor -- start 2024-09-17T05:37:16.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc623c00640 1 -- start start 2024-09-17T05:37:16.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc623c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc61c06cd70 0x7fc61c09cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc623c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc61c073880 0x7fc61c09aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc623c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61c0add50 0x7fc61c145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc623c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c0700b0 con 0x7fc61c0add50 2024-09-17T05:37:16.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc623c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c06ff30 con 0x7fc61c073880 2024-09-17T05:37:16.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc623c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc61c070230 con 0x7fc61c06cd70 2024-09-17T05:37:16.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc621c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61c0add50 0x7fc61c145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc621c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61c0add50 0x7fc61c145670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59618/0 (socket says 172.21.15.31:59618) 2024-09-17T05:37:16.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc621c00640 1 -- 172.21.15.31:0/1075956363 learned_addr learned my addr 172.21.15.31:0/1075956363 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:16.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc621200640 1 --2- 172.21.15.31:0/1075956363 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc61c06cd70 0x7fc61c09cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc61be00640 1 --2- 172.21.15.31:0/1075956363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc61c073880 0x7fc61c09aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc621c00640 1 -- 172.21.15.31:0/1075956363 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc61c06cd70 msgr2=0x7fc61c09cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc621c00640 1 --2- 172.21.15.31:0/1075956363 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc61c06cd70 0x7fc61c09cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc621c00640 1 -- 172.21.15.31:0/1075956363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc61c073880 msgr2=0x7fc61c09aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc621c00640 1 --2- 172.21.15.31:0/1075956363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc61c073880 0x7fc61c09aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc621c00640 1 -- 172.21.15.31:0/1075956363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61c09d630 con 0x7fc61c0add50 2024-09-17T05:37:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc61be00640 1 --2- 172.21.15.31:0/1075956363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc61c073880 0x7fc61c09aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc621c00640 1 --2- 172.21.15.31:0/1075956363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61c0add50 0x7fc61c145670 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fc61401b430 tx=0x7fc614003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc618c00640 1 -- 172.21.15.31:0/1075956363 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6140bb070 con 0x7fc61c0add50 2024-09-17T05:37:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc618c00640 1 -- 172.21.15.31:0/1075956363 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc614004d40 con 0x7fc61c0add50 2024-09-17T05:37:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc618c00640 1 -- 172.21.15.31:0/1075956363 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6140b2040 con 0x7fc61c0add50 2024-09-17T05:37:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc623c00640 1 -- 172.21.15.31:0/1075956363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61c09d910 con 0x7fc61c0add50 2024-09-17T05:37:16.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc623c00640 1 -- 172.21.15.31:0/1075956363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc61c09ded0 con 0x7fc61c0add50 2024-09-17T05:37:16.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.032+0000 7fc623c00640 1 -- 172.21.15.31:0/1075956363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc61c073d10 con 0x7fc61c0add50 2024-09-17T05:37:16.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.036+0000 7fc618c00640 1 -- 172.21.15.31:0/1075956363 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7fc6140a5bc0 con 0x7fc61c0add50 2024-09-17T05:37:16.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.036+0000 7fc618c00640 1 --2- 172.21.15.31:0/1075956363 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc5fc073e00 0x7fc5fc0762c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:16.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.036+0000 7fc618c00640 1 -- 172.21.15.31:0/1075956363 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7fc61412c970 con 0x7fc61c0add50 2024-09-17T05:37:16.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.036+0000 7fc621200640 1 --2- 172.21.15.31:0/1075956363 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc5fc073e00 0x7fc5fc0762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:16.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.036+0000 7fc621200640 1 --2- 172.21.15.31:0/1075956363 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc5fc073e00 0x7fc5fc0762c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc610009be0 tx=0x7fc6100091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:16.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.040+0000 7fc618c00640 1 -- 172.21.15.31:0/1075956363 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fc614016970 con 0x7fc61c0add50 2024-09-17T05:37:16.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.216+0000 7fc623c00640 1 -- 172.21.15.31:0/1075956363 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc61c09b000 con 0x7fc61c0add50 2024-09-17T05:37:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.216+0000 7fc618c00640 1 -- 172.21.15.31:0/1075956363 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+13112 (secure 0 0 0) 0x7fc6140f8bc0 con 0x7fc61c0add50 2024-09-17T05:37:16.218 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:37:16.218 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":166,"fsid":"b668cd1d-3036-4a29-9e5a-69d0df5776a8","created":"2024-09-17T05:28:19.897623+0000","modified":"2024-09-17T05:37:11.338526+0000","last_up_change":"2024-09-17T05:28:33.567998+0000","last_in_change":"2024-09-17T05:28:23.600114+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:28:33.209612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dd9b9452-0347-4305-a82b-47f49f7f4046","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6801","nonce":2294581293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6803","nonce":2294581293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6807","nonce":2294581293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2294581293},{"type":"v1","addr":"172.21.15.31:6805","nonce":2294581293}]},"public_addr":"172.21.15.31:6801/2294581293","cluster_addr":"172.21.15.31:6803/2294581293","heartbeat_back_addr":"172.21.15.31:6807/2294581293","heartbeat_front_addr":"172.21.15.31:6805/2294581293","state":["exists","up"]},{"osd":1,"uuid":"f364151a-36bb-43b4-b111-e20b1bae8aa1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6810","nonce":2661812175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6814","nonce":2661812175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6823","nonce":2661812175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2661812175},{"type":"v1","addr":"172.21.15.31:6818","nonce":2661812175}]},"public_addr":"172.21.15.31:6810/2661812175","cluster_addr":"172.21.15.31:6814/2661812175","heartbeat_back_addr":"172.21.15.31:6823/2661812175","heartbeat_front_addr":"172.21.15.31:6818/2661812175","state":["exists","up"]},{"osd":2,"uuid":"3267113f-0f31-4343-aea9-685074951354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6825","nonce":1172069379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6827","nonce":1172069379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6831","nonce":1172069379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1172069379},{"type":"v1","addr":"172.21.15.31:6829","nonce":1172069379}]},"public_addr":"172.21.15.31:6825/1172069379","cluster_addr":"172.21.15.31:6827/1172069379","heartbeat_back_addr":"172.21.15.31:6831/1172069379","heartbeat_front_addr":"172.21.15.31:6829/1172069379","state":["exists","up"]},{"osd":3,"uuid":"fc8c4e03-6ab4-4c72-bab3-a01bf64c5f2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6811","nonce":2225281127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6815","nonce":2225281127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6821","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6822","nonce":2225281127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6817","nonce":2225281127},{"type":"v1","addr":"172.21.15.31:6819","nonce":2225281127}]},"public_addr":"172.21.15.31:6811/2225281127","cluster_addr":"172.21.15.31:6815/2225281127","heartbeat_back_addr":"172.21.15.31:6822/2225281127","heartbeat_front_addr":"172.21.15.31:6819/2225281127","state":["exists","up"]},{"osd":4,"uuid":"5a32fddf-47a9-4ccc-b8f0-fe312468709a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6811","nonce":3398816604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6813","nonce":3398816604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6817","nonce":3398816604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":3398816604},{"type":"v1","addr":"172.21.15.155:6815","nonce":3398816604}]},"public_addr":"172.21.15.155:6811/3398816604","cluster_addr":"172.21.15.155:6813/3398816604","heartbeat_back_addr":"172.21.15.155:6817/3398816604","heartbeat_front_addr":"172.21.15.155:6815/3398816604","state":["exists","up"]},{"osd":5,"uuid":"0a6791a2-7e16-4ed2-b3c3-42675a9658e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6801","nonce":4024510825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6803","nonce":4024510825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6807","nonce":4024510825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":4024510825},{"type":"v1","addr":"172.21.15.155:6805","nonce":4024510825}]},"public_addr":"172.21.15.155:6801/4024510825","cluster_addr":"172.21.15.155:6803/4024510825","heartbeat_back_addr":"172.21.15.155:6807/4024510825","heartbeat_front_addr":"172.21.15.155:6805/4024510825","state":["exists","up"]},{"osd":6,"uuid":"6c0198a4-03d8-4180-821e-b15c8b5eed87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6819","nonce":1112531135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6821","nonce":1112531135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6825","nonce":1112531135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":1112531135},{"type":"v1","addr":"172.21.15.155:6823","nonce":1112531135}]},"public_addr":"172.21.15.155:6819/1112531135","cluster_addr":"172.21.15.155:6821/1112531135","heartbeat_back_addr":"172.21.15.155:6825/1112531135","heartbeat_front_addr":"172.21.15.155:6823/1112531135","state":["exists","up"]},{"osd":7,"uuid":"8dacbbb0-2cf9-45ce-8c9e-0743e8f1742c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6827","nonce":4001062257}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6829","nonce":4001062257}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6833","nonce":4001062257}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":4001062257},{"type":"v1","addr":"172.21.15.155:6831","nonce":4001062257}]},"public_addr":"172.21.15.155:6827/4001062257","cluster_addr":"172.21.15.155:6829/4001062257","heartbeat_back_addr":"172.21.15.155:6833/4001062257","heartbeat_front_addr":"172.21.15.155:6831/4001062257","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.396265+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.051977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.949534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.618294+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.389401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:30.969530+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:28:31.052194+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:6835/3913619779":"2024-09-18T05:37:08.080930+0000","172.21.15.155:6809/3913619779":"2024-09-18T05:37:08.080930+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:37:16.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.216+0000 7fc623c00640 1 -- 172.21.15.31:0/1075956363 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc5fc073e00 msgr2=0x7fc5fc0762c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.216+0000 7fc623c00640 1 --2- 172.21.15.31:0/1075956363 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc5fc073e00 0x7fc5fc0762c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc610009be0 tx=0x7fc6100091e0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.216+0000 7fc623c00640 1 -- 172.21.15.31:0/1075956363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61c0add50 msgr2=0x7fc61c145670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:16.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.216+0000 7fc623c00640 1 --2- 172.21.15.31:0/1075956363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61c0add50 0x7fc61c145670 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fc61401b430 tx=0x7fc614003f60 comp rx=0 tx=0).stop 2024-09-17T05:37:16.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.220+0000 7fc623c00640 1 -- 172.21.15.31:0/1075956363 shutdown_connections 2024-09-17T05:37:16.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.220+0000 7fc623c00640 1 --2- 172.21.15.31:0/1075956363 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fc5fc073e00 0x7fc5fc0762c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.220+0000 7fc623c00640 1 --2- 172.21.15.31:0/1075956363 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc61c0add50 0x7fc61c145670 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.220+0000 7fc623c00640 1 --2- 172.21.15.31:0/1075956363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc61c073880 0x7fc61c09aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.220+0000 7fc623c00640 1 --2- 172.21.15.31:0/1075956363 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc61c06cd70 0x7fc61c09cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:16.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.220+0000 7fc623c00640 1 -- 172.21.15.31:0/1075956363 >> 172.21.15.31:0/1075956363 conn(0x7fc61c0d0d50 msgr2=0x7fc61c0ca080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:16.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.220+0000 7fc623c00640 1 -- 172.21.15.31:0/1075956363 shutdown_connections 2024-09-17T05:37:16.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:16.220+0000 7fc623c00640 1 -- 172.21.15.31:0/1075956363 wait complete. 2024-09-17T05:37:17.240 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T05:37:17.241 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:37:17.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.400+0000 7f5cf1200640 1 -- 172.21.15.31:0/1920088238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cec15c1f0 msgr2=0x7f5cec0cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:17.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.400+0000 7f5cf1200640 1 --2- 172.21.15.31:0/1920088238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cec15c1f0 0x7f5cec0cec40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009840 tx=0x7f5cd401f010 comp rx=0 tx=0).stop 2024-09-17T05:37:17.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.400+0000 7f5cf1200640 1 -- 172.21.15.31:0/1920088238 shutdown_connections 2024-09-17T05:37:17.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.400+0000 7f5cf1200640 1 --2- 172.21.15.31:0/1920088238 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cec15c1f0 0x7f5cec0cec40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:17.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.400+0000 7f5cf1200640 1 --2- 172.21.15.31:0/1920088238 >> v2:172.21.15.155:3300/0 conn(0x7f5cec15be10 0x7f5cec0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:17.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.400+0000 7f5cf1200640 1 -- 172.21.15.31:0/1920088238 >> 172.21.15.31:0/1920088238 conn(0x7f5cec0d1da0 msgr2=0x7f5cec0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:17.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.400+0000 7f5cf1200640 1 -- 172.21.15.31:0/1920088238 shutdown_connections 2024-09-17T05:37:17.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.400+0000 7f5cf1200640 1 -- 172.21.15.31:0/1920088238 wait complete. 2024-09-17T05:37:17.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5cf1200640 1 Processor -- start 2024-09-17T05:37:17.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5cf1200640 1 -- start start 2024-09-17T05:37:17.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5cf1200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cec0b0b60 0x7f5cec0c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:17.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5cf1200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cec15be10 0x7f5cec0cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:17.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5cf1200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cec15c1f0 0x7f5cec153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:17.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5cf1200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec0cf390 con 0x7f5cec0b0b60 2024-09-17T05:37:17.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5cf1200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec0cde20 con 0x7f5cec15c1f0 2024-09-17T05:37:17.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5cf1200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5cec0cf510 con 0x7f5cec15be10 2024-09-17T05:37:17.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5ce9e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cec0b0b60 0x7f5cec0c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:17.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5ce9e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cec0b0b60 0x7f5cec0c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59626/0 (socket says 172.21.15.31:59626) 2024-09-17T05:37:17.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5ce9e00640 1 -- 172.21.15.31:0/1279973859 learned_addr learned my addr 172.21.15.31:0/1279973859 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:17.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5ce1400640 1 --2- 172.21.15.31:0/1279973859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cec15be10 0x7f5cec0cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:17.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5cea800640 1 --2- 172.21.15.31:0/1279973859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cec15c1f0 0x7f5cec153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:17.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5ce9e00640 1 -- 172.21.15.31:0/1279973859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cec15be10 msgr2=0x7f5cec0cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:17.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5ce9e00640 1 --2- 172.21.15.31:0/1279973859 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5cec15be10 0x7f5cec0cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:17.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5ce9e00640 1 -- 172.21.15.31:0/1279973859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cec15c1f0 msgr2=0x7f5cec153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:17.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5ce9e00640 1 --2- 172.21.15.31:0/1279973859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cec15c1f0 0x7f5cec153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:17.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5ce9e00640 1 -- 172.21.15.31:0/1279973859 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec0c8530 con 0x7f5cec0b0b60 2024-09-17T05:37:17.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5cea800640 1 --2- 172.21.15.31:0/1279973859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5cec15c1f0 0x7f5cec153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:17.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5ce9e00640 1 --2- 172.21.15.31:0/1279973859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cec0b0b60 0x7f5cec0c9d40 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00ea10 tx=0x7f5cdc00eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:17.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5ce2a00640 1 -- 172.21.15.31:0/1279973859 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc00cde0 con 0x7f5cec0b0b60 2024-09-17T05:37:17.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5ce2a00640 1 -- 172.21.15.31:0/1279973859 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cdc004020 con 0x7f5cec0b0b60 2024-09-17T05:37:17.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5ce2a00640 1 -- 172.21.15.31:0/1279973859 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc004470 con 0x7f5cec0b0b60 2024-09-17T05:37:17.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5cf1200640 1 -- 172.21.15.31:0/1279973859 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cec0ca940 con 0x7f5cec0b0b60 2024-09-17T05:37:17.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.404+0000 7f5cf1200640 1 -- 172.21.15.31:0/1279973859 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cec0ca280 con 0x7f5cec0b0b60 2024-09-17T05:37:17.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.408+0000 7f5cf1200640 1 -- 172.21.15.31:0/1279973859 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5cec1605a0 con 0x7f5cec0b0b60 2024-09-17T05:37:17.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.408+0000 7f5ce2a00640 1 -- 172.21.15.31:0/1279973859 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f5cdc003600 con 0x7f5cec0b0b60 2024-09-17T05:37:17.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.408+0000 7f5ce2a00640 1 --2- 172.21.15.31:0/1279973859 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5cc8073dd0 0x7f5cc8076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:17.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.408+0000 7f5ce2a00640 1 -- 172.21.15.31:0/1279973859 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f5cdc093a10 con 0x7f5cec0b0b60 2024-09-17T05:37:17.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.408+0000 7f5ce1400640 1 --2- 172.21.15.31:0/1279973859 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5cc8073dd0 0x7f5cc8076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:17.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.408+0000 7f5ce2a00640 1 --2- 172.21.15.31:0/1279973859 >> [v2:172.21.15.31:6800/2294581293,v1:172.21.15.31:6801/2294581293] conn(0x7f5cc8079c90 0x7f5cc807c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:17.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.408+0000 7f5ce2a00640 1 -- 172.21.15.31:0/1279973859 --> [v2:172.21.15.31:6800/2294581293,v1:172.21.15.31:6801/2294581293] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5cdc016ec0 con 0x7f5cc8079c90 2024-09-17T05:37:17.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.408+0000 7f5ce2a00640 1 -- 172.21.15.31:0/1279973859 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=166) ==== 24+0+0 (secure 0 0 0) 0x7f5cdc096680 con 0x7f5cec0b0b60 2024-09-17T05:37:17.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.408+0000 7f5cea800640 1 --2- 172.21.15.31:0/1279973859 >> [v2:172.21.15.31:6800/2294581293,v1:172.21.15.31:6801/2294581293] conn(0x7f5cc8079c90 0x7f5cc807c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:17.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.408+0000 7f5ce1400640 1 --2- 172.21.15.31:0/1279973859 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5cc8073dd0 0x7f5cc8076290 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40b2000 tx=0x7f5cd401d850 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:17.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.412+0000 7f5cea800640 1 --2- 172.21.15.31:0/1279973859 >> [v2:172.21.15.31:6800/2294581293,v1:172.21.15.31:6801/2294581293] conn(0x7f5cc8079c90 0x7f5cc807c0b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:17.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.412+0000 7f5ce2a00640 1 -- 172.21.15.31:0/1279973859 <== osd.0 v2:172.21.15.31:6800/2294581293 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5cdc016ec0 con 0x7f5cc8079c90 2024-09-17T05:37:17.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.424+0000 7f5cf1200640 1 -- 172.21.15.31:0/1279973859 --> [v2:172.21.15.31:6800/2294581293,v1:172.21.15.31:6801/2294581293] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5cec070350 con 0x7f5cc8079c90 2024-09-17T05:37:17.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.424+0000 7f5ce2a00640 1 -- 172.21.15.31:0/1279973859 <== osd.0 v2:172.21.15.31:6800/2294581293 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5cec070350 con 0x7f5cc8079c90 2024-09-17T05:37:17.427 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:37:17.427 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:37:17.428 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:37:17.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.424+0000 7f5cf1200640 1 -- 172.21.15.31:0/1279973859 >> [v2:172.21.15.31:6800/2294581293,v1:172.21.15.31:6801/2294581293] conn(0x7f5cc8079c90 msgr2=0x7f5cc807c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:17.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.424+0000 7f5cf1200640 1 --2- 172.21.15.31:0/1279973859 >> [v2:172.21.15.31:6800/2294581293,v1:172.21.15.31:6801/2294581293] conn(0x7f5cc8079c90 0x7f5cc807c0b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:17.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.424+0000 7f5cf1200640 1 -- 172.21.15.31:0/1279973859 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5cc8073dd0 msgr2=0x7f5cc8076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:17.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.424+0000 7f5cf1200640 1 --2- 172.21.15.31:0/1279973859 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5cc8073dd0 0x7f5cc8076290 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40b2000 tx=0x7f5cd401d850 comp rx=0 tx=0).stop 2024-09-17T05:37:17.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.424+0000 7f5cf1200640 1 -- 172.21.15.31:0/1279973859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cec0b0b60 msgr2=0x7f5cec0c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:17.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.424+0000 7f5cf1200640 1 --2- 172.21.15.31:0/1279973859 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cec0b0b60 0x7f5cec0c9d40 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00ea10 tx=0x7f5cdc00eed0 comp rx=0 tx=0).stop 2024-09-17T05:37:17.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.424+0000 7f5cea800640 1 -- 172.21.15.31:0/1279973859 reap_dead start 2024-09-17T05:37:17.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.424+0000 7f5cf1200640 1 -- 172.21.15.31:0/1279973859 shutdown_connections 2024-09-17T05:37:17.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.424+0000 7f5cf1200640 1 -- 172.21.15.31:0/1279973859 >> 172.21.15.31:0/1279973859 conn(0x7f5cec0d1da0 msgr2=0x7f5cec070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:17.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.424+0000 7f5cf1200640 1 -- 172.21.15.31:0/1279973859 shutdown_connections 2024-09-17T05:37:17.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.424+0000 7f5cf1200640 1 -- 172.21.15.31:0/1279973859 wait complete. 2024-09-17T05:37:17.447 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T05:37:17.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.592+0000 7f5bf3c00640 1 -- 172.21.15.31:0/2657092121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bd0004810 msgr2=0x7f5bd0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:17.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.592+0000 7f5bf3c00640 1 --2- 172.21.15.31:0/2657092121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bd0004810 0x7f5bd0004c90 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009b60 tx=0x7f5bd401cf50 comp rx=0 tx=0).stop 2024-09-17T05:37:17.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.592+0000 7f5bf1c00640 1 -- 172.21.15.31:0/2657092121 reap_dead start 2024-09-17T05:37:17.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.592+0000 7f5bf3c00640 1 -- 172.21.15.31:0/2657092121 shutdown_connections 2024-09-17T05:37:17.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.592+0000 7f5bf3c00640 1 -- 172.21.15.31:0/2657092121 >> 172.21.15.31:0/2657092121 conn(0x7f5bec0d1ea0 msgr2=0x7f5bec0d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:17.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.592+0000 7f5bf3c00640 1 -- 172.21.15.31:0/2657092121 shutdown_connections 2024-09-17T05:37:17.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.592+0000 7f5bf3c00640 1 -- 172.21.15.31:0/2657092121 wait complete. 2024-09-17T05:37:17.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.592+0000 7f5bf3c00640 1 Processor -- start 2024-09-17T05:37:17.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf3c00640 1 -- start start 2024-09-17T05:37:17.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf3c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bd0004810 0x7f5bec159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:17.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf3c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bec162220 0x7f5bec1f8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:17.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf3c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bec161140 0x7f5bec1615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:17.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf3c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5bec168280 con 0x7f5bd0004810 2024-09-17T05:37:17.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf3c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5bec168100 con 0x7f5bec161140 2024-09-17T05:37:17.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf3c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5bec168400 con 0x7f5bec162220 2024-09-17T05:37:17.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf1200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bd0004810 0x7f5bec159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:17.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf1200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bd0004810 0x7f5bec159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59642/0 (socket says 172.21.15.31:59642) 2024-09-17T05:37:17.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf1200640 1 -- 172.21.15.31:0/2459398433 learned_addr learned my addr 172.21.15.31:0/2459398433 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:17.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf1c00640 1 --2- 172.21.15.31:0/2459398433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bec161140 0x7f5bec1615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:17.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5be3e00640 1 --2- 172.21.15.31:0/2459398433 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bec162220 0x7f5bec1f8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:17.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf1200640 1 -- 172.21.15.31:0/2459398433 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bec162220 msgr2=0x7f5bec1f8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:17.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf1200640 1 --2- 172.21.15.31:0/2459398433 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bec162220 0x7f5bec1f8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:17.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf1200640 1 -- 172.21.15.31:0/2459398433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bec161140 msgr2=0x7f5bec1615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:17.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf1200640 1 --2- 172.21.15.31:0/2459398433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bec161140 0x7f5bec1615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:17.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf1200640 1 -- 172.21.15.31:0/2459398433 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bec1f90c0 con 0x7f5bd0004810 2024-09-17T05:37:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf1c00640 1 --2- 172.21.15.31:0/2459398433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bec161140 0x7f5bec1615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5be3e00640 1 --2- 172.21.15.31:0/2459398433 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bec162220 0x7f5bec1f8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf1200640 1 --2- 172.21.15.31:0/2459398433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bd0004810 0x7f5bec159310 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc010640 tx=0x7f5bdc010b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5be9600640 1 -- 172.21.15.31:0/2459398433 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc016070 con 0x7f5bd0004810 2024-09-17T05:37:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5be9600640 1 -- 172.21.15.31:0/2459398433 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bdc00e9f0 con 0x7f5bd0004810 2024-09-17T05:37:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5be9600640 1 -- 172.21.15.31:0/2459398433 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00ee00 con 0x7f5bd0004810 2024-09-17T05:37:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf3c00640 1 -- 172.21.15.31:0/2459398433 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bec165d00 con 0x7f5bd0004810 2024-09-17T05:37:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf3c00640 1 -- 172.21.15.31:0/2459398433 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bec1662c0 con 0x7f5bd0004810 2024-09-17T05:37:17.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.596+0000 7f5bf3c00640 1 -- 172.21.15.31:0/2459398433 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bec0cfe80 con 0x7f5bd0004810 2024-09-17T05:37:17.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.600+0000 7f5be9600640 1 -- 172.21.15.31:0/2459398433 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f5bdc019070 con 0x7f5bd0004810 2024-09-17T05:37:17.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.600+0000 7f5be9600640 1 --2- 172.21.15.31:0/2459398433 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5bc8073dd0 0x7f5bc8076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:17.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.600+0000 7f5be9600640 1 -- 172.21.15.31:0/2459398433 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f5bdc094230 con 0x7f5bd0004810 2024-09-17T05:37:17.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.600+0000 7f5be3e00640 1 --2- 172.21.15.31:0/2459398433 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5bc8073dd0 0x7f5bc8076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:17.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.600+0000 7f5be3e00640 1 --2- 172.21.15.31:0/2459398433 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5bc8073dd0 0x7f5bc8076290 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40af000 tx=0x7f5bd401a010 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:17.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.604+0000 7f5be9600640 1 -- 172.21.15.31:0/2459398433 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f5bec1f90c0 con 0x7f5bd0004810 2024-09-17T05:37:17.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.780+0000 7f5bf3c00640 1 -- 172.21.15.31:0/2459398433 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f5bec071220 con 0x7f5bc8073dd0 2024-09-17T05:37:17.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.780+0000 7f5be9600640 1 -- 172.21.15.31:0/2459398433 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5bec071220 con 0x7f5bc8073dd0 2024-09-17T05:37:17.781 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T05:37:17.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.780+0000 7f5bf3c00640 1 -- 172.21.15.31:0/2459398433 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5bc8073dd0 msgr2=0x7f5bc8076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:17.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.780+0000 7f5bf3c00640 1 --2- 172.21.15.31:0/2459398433 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5bc8073dd0 0x7f5bc8076290 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40af000 tx=0x7f5bd401a010 comp rx=0 tx=0).stop 2024-09-17T05:37:17.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.780+0000 7f5bf3c00640 1 -- 172.21.15.31:0/2459398433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bd0004810 msgr2=0x7f5bec159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:17.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.780+0000 7f5bf3c00640 1 --2- 172.21.15.31:0/2459398433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bd0004810 0x7f5bec159310 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc010640 tx=0x7f5bdc010b00 comp rx=0 tx=0).stop 2024-09-17T05:37:17.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.780+0000 7f5bf3c00640 1 -- 172.21.15.31:0/2459398433 shutdown_connections 2024-09-17T05:37:17.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.780+0000 7f5bf3c00640 1 --2- 172.21.15.31:0/2459398433 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f5bc8073dd0 0x7f5bc8076290 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:17.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.780+0000 7f5bf3c00640 1 --2- 172.21.15.31:0/2459398433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5bec161140 0x7f5bec1615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:17.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.780+0000 7f5bf3c00640 1 --2- 172.21.15.31:0/2459398433 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5bec162220 0x7f5bec1f8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:17.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.780+0000 7f5bf3c00640 1 --2- 172.21.15.31:0/2459398433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5bd0004810 0x7f5bec159310 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:17.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.780+0000 7f5bf3c00640 1 -- 172.21.15.31:0/2459398433 >> 172.21.15.31:0/2459398433 conn(0x7f5bec0d1ea0 msgr2=0x7f5bec0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:17.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.780+0000 7f5bf3c00640 1 -- 172.21.15.31:0/2459398433 shutdown_connections 2024-09-17T05:37:17.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.780+0000 7f5bf3c00640 1 -- 172.21.15.31:0/2459398433 wait complete. 2024-09-17T05:37:17.804 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T05:37:17.804 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:37:17.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.952+0000 7f46ee800640 1 -- 172.21.15.31:0/420294954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46cc003c20 msgr2=0x7f46cc004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:17.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.952+0000 7f46ee800640 1 --2- 172.21.15.31:0/420294954 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46cc003c20 0x7f46cc004020 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f46d8009b90 tx=0x7f46d801d270 comp rx=0 tx=0).stop 2024-09-17T05:37:17.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.952+0000 7f46e7e00640 1 -- 172.21.15.31:0/420294954 reap_dead start 2024-09-17T05:37:17.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.952+0000 7f46ee800640 1 -- 172.21.15.31:0/420294954 shutdown_connections 2024-09-17T05:37:17.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.952+0000 7f46ee800640 1 -- 172.21.15.31:0/420294954 >> 172.21.15.31:0/420294954 conn(0x7f46e80d1da0 msgr2=0x7f46e80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:17.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.952+0000 7f46ee800640 1 -- 172.21.15.31:0/420294954 shutdown_connections 2024-09-17T05:37:17.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.952+0000 7f46ee800640 1 -- 172.21.15.31:0/420294954 wait complete. 2024-09-17T05:37:17.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46ee800640 1 Processor -- start 2024-09-17T05:37:17.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46ee800640 1 -- start start 2024-09-17T05:37:17.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46ee800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46cc003c20 0x7f46e80b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:17.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46ee800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46e815af50 0x7f46e81f8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:17.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46ee800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46e80c72c0 0x7f46e80b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:17.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46ee800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f46e80cea90 con 0x7f46e815af50 2024-09-17T05:37:17.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46ee800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f46e80ce910 con 0x7f46e80c72c0 2024-09-17T05:37:17.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46ee800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f46e80cd2e0 con 0x7f46cc003c20 2024-09-17T05:37:17.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46dfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46e815af50 0x7f46e81f8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:17.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46dfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46e815af50 0x7f46e81f8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59652/0 (socket says 172.21.15.31:59652) 2024-09-17T05:37:17.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46dfe00640 1 -- 172.21.15.31:0/1241381814 learned_addr learned my addr 172.21.15.31:0/1241381814 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:17.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46e7e00640 1 --2- 172.21.15.31:0/1241381814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46e80c72c0 0x7f46e80b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:17.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46e7400640 1 --2- 172.21.15.31:0/1241381814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46cc003c20 0x7f46e80b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:17.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46dfe00640 1 -- 172.21.15.31:0/1241381814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46cc003c20 msgr2=0x7f46e80b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:17.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46dfe00640 1 --2- 172.21.15.31:0/1241381814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46cc003c20 0x7f46e80b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:17.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46dfe00640 1 -- 172.21.15.31:0/1241381814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46e80c72c0 msgr2=0x7f46e80b70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:17.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46dfe00640 1 --2- 172.21.15.31:0/1241381814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46e80c72c0 0x7f46e80b70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:17.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46dfe00640 1 -- 172.21.15.31:0/1241381814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e80b5500 con 0x7f46e815af50 2024-09-17T05:37:17.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46e7e00640 1 --2- 172.21.15.31:0/1241381814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46e80c72c0 0x7f46e80b70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:17.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46e7400640 1 --2- 172.21.15.31:0/1241381814 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46cc003c20 0x7f46e80b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:17.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46dfe00640 1 --2- 172.21.15.31:0/1241381814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46e815af50 0x7f46e81f8d20 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f46d000e360 tx=0x7f46d000e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:17.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46df400640 1 -- 172.21.15.31:0/1241381814 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d00062e0 con 0x7f46e815af50 2024-09-17T05:37:17.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46df400640 1 -- 172.21.15.31:0/1241381814 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46d0017020 con 0x7f46e815af50 2024-09-17T05:37:17.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46df400640 1 -- 172.21.15.31:0/1241381814 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d0003860 con 0x7f46e815af50 2024-09-17T05:37:17.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46ee800640 1 -- 172.21.15.31:0/1241381814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e80b57e0 con 0x7f46e815af50 2024-09-17T05:37:17.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46ee800640 1 -- 172.21.15.31:0/1241381814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e81f8520 con 0x7f46e815af50 2024-09-17T05:37:17.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.956+0000 7f46ee800640 1 -- 172.21.15.31:0/1241381814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46e80ccbd0 con 0x7f46e815af50 2024-09-17T05:37:17.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.960+0000 7f46df400640 1 -- 172.21.15.31:0/1241381814 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f46d000d070 con 0x7f46e815af50 2024-09-17T05:37:17.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.960+0000 7f46df400640 1 --2- 172.21.15.31:0/1241381814 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f46c4073e00 0x7f46c40762c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:17.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.960+0000 7f46df400640 1 -- 172.21.15.31:0/1241381814 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f46d0096e50 con 0x7f46e815af50 2024-09-17T05:37:17.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.960+0000 7f46e7400640 1 --2- 172.21.15.31:0/1241381814 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f46c4073e00 0x7f46c40762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:17.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.960+0000 7f46df400640 1 --2- 172.21.15.31:0/1241381814 >> [v2:172.21.15.31:6808/2661812175,v1:172.21.15.31:6810/2661812175] conn(0x7f46c4079cc0 0x7f46c407c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:17.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.960+0000 7f46df400640 1 -- 172.21.15.31:0/1241381814 --> [v2:172.21.15.31:6808/2661812175,v1:172.21.15.31:6810/2661812175] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46d0019e70 con 0x7f46c4079cc0 2024-09-17T05:37:17.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.960+0000 7f46df400640 1 -- 172.21.15.31:0/1241381814 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=166) ==== 24+0+0 (secure 0 0 0) 0x7f46d00996b0 con 0x7f46e815af50 2024-09-17T05:37:17.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.960+0000 7f46e7e00640 1 --2- 172.21.15.31:0/1241381814 >> [v2:172.21.15.31:6808/2661812175,v1:172.21.15.31:6810/2661812175] conn(0x7f46c4079cc0 0x7f46c407c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:17.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.960+0000 7f46e7400640 1 --2- 172.21.15.31:0/1241381814 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f46c4073e00 0x7f46c40762c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f46d80ae000 tx=0x7f46d801a010 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:17.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.960+0000 7f46e7e00640 1 --2- 172.21.15.31:0/1241381814 >> [v2:172.21.15.31:6808/2661812175,v1:172.21.15.31:6810/2661812175] conn(0x7f46c4079cc0 0x7f46c407c0e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:17.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.960+0000 7f46df400640 1 -- 172.21.15.31:0/1241381814 <== osd.1 v2:172.21.15.31:6808/2661812175 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f46d0019e70 con 0x7f46c4079cc0 2024-09-17T05:37:17.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.976+0000 7f46ee800640 1 -- 172.21.15.31:0/1241381814 --> [v2:172.21.15.31:6808/2661812175,v1:172.21.15.31:6810/2661812175] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f46e8070350 con 0x7f46c4079cc0 2024-09-17T05:37:17.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.976+0000 7f46df400640 1 -- 172.21.15.31:0/1241381814 <== osd.1 v2:172.21.15.31:6808/2661812175 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f46e8070350 con 0x7f46c4079cc0 2024-09-17T05:37:17.978 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:37:17.978 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:37:17.978 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:37:17.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.976+0000 7f46ee800640 1 -- 172.21.15.31:0/1241381814 >> [v2:172.21.15.31:6808/2661812175,v1:172.21.15.31:6810/2661812175] conn(0x7f46c4079cc0 msgr2=0x7f46c407c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:17.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.976+0000 7f46ee800640 1 --2- 172.21.15.31:0/1241381814 >> [v2:172.21.15.31:6808/2661812175,v1:172.21.15.31:6810/2661812175] conn(0x7f46c4079cc0 0x7f46c407c0e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:17.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.976+0000 7f46ee800640 1 -- 172.21.15.31:0/1241381814 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f46c4073e00 msgr2=0x7f46c40762c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:17.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.976+0000 7f46ee800640 1 --2- 172.21.15.31:0/1241381814 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f46c4073e00 0x7f46c40762c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f46d80ae000 tx=0x7f46d801a010 comp rx=0 tx=0).stop 2024-09-17T05:37:17.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.976+0000 7f46ee800640 1 -- 172.21.15.31:0/1241381814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46e815af50 msgr2=0x7f46e81f8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:17.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.976+0000 7f46ee800640 1 --2- 172.21.15.31:0/1241381814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46e815af50 0x7f46e81f8d20 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f46d000e360 tx=0x7f46d000e820 comp rx=0 tx=0).stop 2024-09-17T05:37:17.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.976+0000 7f46e7e00640 1 -- 172.21.15.31:0/1241381814 reap_dead start 2024-09-17T05:37:17.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.976+0000 7f46ee800640 1 -- 172.21.15.31:0/1241381814 shutdown_connections 2024-09-17T05:37:17.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.976+0000 7f46ee800640 1 -- 172.21.15.31:0/1241381814 >> 172.21.15.31:0/1241381814 conn(0x7f46e80d1da0 msgr2=0x7f46e8071c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:17.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.976+0000 7f46ee800640 1 -- 172.21.15.31:0/1241381814 shutdown_connections 2024-09-17T05:37:17.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:17.976+0000 7f46ee800640 1 -- 172.21.15.31:0/1241381814 wait complete. 2024-09-17T05:37:17.997 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T05:37:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a7a200640 1 -- 172.21.15.31:0/1107033227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a740ced80 msgr2=0x7f4a740ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a7a200640 1 --2- 172.21.15.31:0/1107033227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a740ced80 0x7f4a740ae9b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c009870 tx=0x7f4a5c01c860 comp rx=0 tx=0).stop 2024-09-17T05:37:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a7a200640 1 -- 172.21.15.31:0/1107033227 shutdown_connections 2024-09-17T05:37:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a7a200640 1 --2- 172.21.15.31:0/1107033227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a740ced80 0x7f4a740ae9b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a7a200640 1 -- 172.21.15.31:0/1107033227 >> 172.21.15.31:0/1107033227 conn(0x7f4a740d1dc0 msgr2=0x7f4a740d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:18.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a7a200640 1 -- 172.21.15.31:0/1107033227 shutdown_connections 2024-09-17T05:37:18.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a7a200640 1 -- 172.21.15.31:0/1107033227 wait complete. 2024-09-17T05:37:18.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a7a200640 1 Processor -- start 2024-09-17T05:37:18.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a7a200640 1 -- start start 2024-09-17T05:37:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a7a200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a740cdb30 0x7f4a74153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a7a200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a740ced80 0x7f4a74154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a7a200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a7415bea0 0x7f4a741f9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a7a200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7416a890 con 0x7f4a740ced80 2024-09-17T05:37:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a7a200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7416a710 con 0x7f4a740cdb30 2024-09-17T05:37:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a7a200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4a7416aa10 con 0x7f4a7415bea0 2024-09-17T05:37:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a6be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a740ced80 0x7f4a74154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:18.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a6be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a740ced80 0x7f4a74154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59654/0 (socket says 172.21.15.31:59654) 2024-09-17T05:37:18.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a6be00640 1 -- 172.21.15.31:0/4027960771 learned_addr learned my addr 172.21.15.31:0/4027960771 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:18.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a73400640 1 --2- 172.21.15.31:0/4027960771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a740cdb30 0x7f4a74153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:18.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.144+0000 7f4a73e00640 1 --2- 172.21.15.31:0/4027960771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a7415bea0 0x7f4a741f9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:18.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.148+0000 7f4a6be00640 1 -- 172.21.15.31:0/4027960771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a7415bea0 msgr2=0x7f4a741f9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.148+0000 7f4a6be00640 1 --2- 172.21.15.31:0/4027960771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a7415bea0 0x7f4a741f9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.148+0000 7f4a6be00640 1 -- 172.21.15.31:0/4027960771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a740cdb30 msgr2=0x7f4a74153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.148+0000 7f4a6be00640 1 --2- 172.21.15.31:0/4027960771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a740cdb30 0x7f4a74153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.148+0000 7f4a6be00640 1 -- 172.21.15.31:0/4027960771 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a74070980 con 0x7f4a740ced80 2024-09-17T05:37:18.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.148+0000 7f4a6be00640 1 --2- 172.21.15.31:0/4027960771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a740ced80 0x7f4a74154430 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c01a490 tx=0x7f4a5c005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:18.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.148+0000 7f4a6b400640 1 -- 172.21.15.31:0/4027960771 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c0b2040 con 0x7f4a740ced80 2024-09-17T05:37:18.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.148+0000 7f4a6b400640 1 -- 172.21.15.31:0/4027960771 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a5c0043e0 con 0x7f4a740ced80 2024-09-17T05:37:18.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.148+0000 7f4a6b400640 1 -- 172.21.15.31:0/4027960771 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c0052d0 con 0x7f4a740ced80 2024-09-17T05:37:18.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.148+0000 7f4a7a200640 1 -- 172.21.15.31:0/4027960771 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a74154e40 con 0x7f4a740ced80 2024-09-17T05:37:18.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.148+0000 7f4a7a200640 1 -- 172.21.15.31:0/4027960771 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a74155400 con 0x7f4a740ced80 2024-09-17T05:37:18.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.148+0000 7f4a7a200640 1 -- 172.21.15.31:0/4027960771 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a740ce670 con 0x7f4a740ced80 2024-09-17T05:37:18.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.148+0000 7f4a6b400640 1 -- 172.21.15.31:0/4027960771 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f4a5c0a57b0 con 0x7f4a740ced80 2024-09-17T05:37:18.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.148+0000 7f4a6b400640 1 --2- 172.21.15.31:0/4027960771 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a50073dd0 0x7f4a50076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:18.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.148+0000 7f4a6b400640 1 -- 172.21.15.31:0/4027960771 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f4a5c12c800 con 0x7f4a740ced80 2024-09-17T05:37:18.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.152+0000 7f4a73400640 1 --2- 172.21.15.31:0/4027960771 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a50073dd0 0x7f4a50076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:18.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.152+0000 7f4a73400640 1 --2- 172.21.15.31:0/4027960771 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a50073dd0 0x7f4a50076290 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4a64007fd0 tx=0x7f4a64009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:18.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.152+0000 7f4a6b400640 1 -- 172.21.15.31:0/4027960771 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4a5c016450 con 0x7f4a740ced80 2024-09-17T05:37:18.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.332+0000 7f4a7a200640 1 -- 172.21.15.31:0/4027960771 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f4a740cbe80 con 0x7f4a50073dd0 2024-09-17T05:37:18.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.332+0000 7f4a6b400640 1 -- 172.21.15.31:0/4027960771 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4a740cbe80 con 0x7f4a50073dd0 2024-09-17T05:37:18.334 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T05:37:18.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.336+0000 7f4a7a200640 1 -- 172.21.15.31:0/4027960771 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a50073dd0 msgr2=0x7f4a50076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.336+0000 7f4a7a200640 1 --2- 172.21.15.31:0/4027960771 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a50073dd0 0x7f4a50076290 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4a64007fd0 tx=0x7f4a64009040 comp rx=0 tx=0).stop 2024-09-17T05:37:18.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.336+0000 7f4a7a200640 1 -- 172.21.15.31:0/4027960771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a740ced80 msgr2=0x7f4a74154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.336+0000 7f4a7a200640 1 --2- 172.21.15.31:0/4027960771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a740ced80 0x7f4a74154430 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c01a490 tx=0x7f4a5c005dd0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.336+0000 7f4a7a200640 1 -- 172.21.15.31:0/4027960771 shutdown_connections 2024-09-17T05:37:18.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.336+0000 7f4a7a200640 1 --2- 172.21.15.31:0/4027960771 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4a50073dd0 0x7f4a50076290 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.336+0000 7f4a7a200640 1 --2- 172.21.15.31:0/4027960771 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4a7415bea0 0x7f4a741f9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.336+0000 7f4a7a200640 1 --2- 172.21.15.31:0/4027960771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a740ced80 0x7f4a74154430 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.336+0000 7f4a7a200640 1 --2- 172.21.15.31:0/4027960771 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a740cdb30 0x7f4a74153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.336+0000 7f4a7a200640 1 -- 172.21.15.31:0/4027960771 >> 172.21.15.31:0/4027960771 conn(0x7f4a740d1dc0 msgr2=0x7f4a740d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:18.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.336+0000 7f4a7a200640 1 -- 172.21.15.31:0/4027960771 shutdown_connections 2024-09-17T05:37:18.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.336+0000 7f4a7a200640 1 -- 172.21.15.31:0/4027960771 wait complete. 2024-09-17T05:37:18.355 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T05:37:18.356 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:37:18.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.504+0000 7f46ae800640 1 -- 172.21.15.31:0/378354326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a80d09f0 msgr2=0x7f46a80d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.504+0000 7f46ae800640 1 --2- 172.21.15.31:0/378354326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a80d09f0 0x7f46a80d28c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4694009870 tx=0x7f469401c750 comp rx=0 tx=0).stop 2024-09-17T05:37:18.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.504+0000 7f46ae800640 1 -- 172.21.15.31:0/378354326 shutdown_connections 2024-09-17T05:37:18.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.504+0000 7f46ae800640 1 --2- 172.21.15.31:0/378354326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a80d09f0 0x7f46a80d28c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.504+0000 7f46ae800640 1 -- 172.21.15.31:0/378354326 >> 172.21.15.31:0/378354326 conn(0x7f46a80d1da0 msgr2=0x7f46a80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:18.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.504+0000 7f46ae800640 1 -- 172.21.15.31:0/378354326 shutdown_connections 2024-09-17T05:37:18.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.504+0000 7f46ae800640 1 -- 172.21.15.31:0/378354326 wait complete. 2024-09-17T05:37:18.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ae800640 1 Processor -- start 2024-09-17T05:37:18.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ae800640 1 -- start start 2024-09-17T05:37:18.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ae800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46a80cff00 0x7f46a81542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:18.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ae800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a815eff0 0x7f46a8071b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:18.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ae800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46a8072090 0x7f46a80cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:18.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ae800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f46a8169f90 con 0x7f46a8072090 2024-09-17T05:37:18.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ae800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f46a8169e10 con 0x7f46a80cff00 2024-09-17T05:37:18.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ae800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f46a816a110 con 0x7f46a815eff0 2024-09-17T05:37:18.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ade00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46a8072090 0x7f46a80cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:18.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ade00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46a8072090 0x7f46a80cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59666/0 (socket says 172.21.15.31:59666) 2024-09-17T05:37:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ade00640 1 -- 172.21.15.31:0/1059130428 learned_addr learned my addr 172.21.15.31:0/1059130428 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46aca00640 1 --2- 172.21.15.31:0/1059130428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a815eff0 0x7f46a8071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ad400640 1 --2- 172.21.15.31:0/1059130428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46a80cff00 0x7f46a81542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ade00640 1 -- 172.21.15.31:0/1059130428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a815eff0 msgr2=0x7f46a8071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ade00640 1 --2- 172.21.15.31:0/1059130428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46a815eff0 0x7f46a8071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ade00640 1 -- 172.21.15.31:0/1059130428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46a80cff00 msgr2=0x7f46a81542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ade00640 1 --2- 172.21.15.31:0/1059130428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46a80cff00 0x7f46a81542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ade00640 1 -- 172.21.15.31:0/1059130428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a8154800 con 0x7f46a8072090 2024-09-17T05:37:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ade00640 1 --2- 172.21.15.31:0/1059130428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46a8072090 0x7f46a80cc8f0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f46a000c730 tx=0x7f46a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46a5600640 1 -- 172.21.15.31:0/1059130428 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0003b80 con 0x7f46a8072090 2024-09-17T05:37:18.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46a5600640 1 -- 172.21.15.31:0/1059130428 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46a0003d40 con 0x7f46a8072090 2024-09-17T05:37:18.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46a5600640 1 -- 172.21.15.31:0/1059130428 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0005330 con 0x7f46a8072090 2024-09-17T05:37:18.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ae800640 1 -- 172.21.15.31:0/1059130428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a8156e00 con 0x7f46a8072090 2024-09-17T05:37:18.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ae800640 1 -- 172.21.15.31:0/1059130428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a81573c0 con 0x7f46a8072090 2024-09-17T05:37:18.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.508+0000 7f46ae800640 1 -- 172.21.15.31:0/1059130428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46a80d28c0 con 0x7f46a8072090 2024-09-17T05:37:18.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.512+0000 7f46a5600640 1 -- 172.21.15.31:0/1059130428 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f46a00056e0 con 0x7f46a8072090 2024-09-17T05:37:18.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.512+0000 7f46a5600640 1 --2- 172.21.15.31:0/1059130428 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4688073dd0 0x7f4688076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:18.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.512+0000 7f46a5600640 1 -- 172.21.15.31:0/1059130428 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f46a0093810 con 0x7f46a8072090 2024-09-17T05:37:18.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.512+0000 7f46ad400640 1 --2- 172.21.15.31:0/1059130428 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4688073dd0 0x7f4688076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:18.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.512+0000 7f46a5600640 1 --2- 172.21.15.31:0/1059130428 >> [v2:172.21.15.31:6824/1172069379,v1:172.21.15.31:6825/1172069379] conn(0x7f4688079c90 0x7f468807c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:18.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.512+0000 7f46a5600640 1 -- 172.21.15.31:0/1059130428 --> [v2:172.21.15.31:6824/1172069379,v1:172.21.15.31:6825/1172069379] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46a0013e70 con 0x7f4688079c90 2024-09-17T05:37:18.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.512+0000 7f46a5600640 1 -- 172.21.15.31:0/1059130428 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=166) ==== 24+0+0 (secure 0 0 0) 0x7f46a0096480 con 0x7f46a8072090 2024-09-17T05:37:18.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.512+0000 7f46aca00640 1 --2- 172.21.15.31:0/1059130428 >> [v2:172.21.15.31:6824/1172069379,v1:172.21.15.31:6825/1172069379] conn(0x7f4688079c90 0x7f468807c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:18.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.512+0000 7f46ad400640 1 --2- 172.21.15.31:0/1059130428 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4688073dd0 0x7f4688076290 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f469c000c10 tx=0x7f469c001730 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:18.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.512+0000 7f46aca00640 1 --2- 172.21.15.31:0/1059130428 >> [v2:172.21.15.31:6824/1172069379,v1:172.21.15.31:6825/1172069379] conn(0x7f4688079c90 0x7f468807c0b0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:18.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.512+0000 7f46a5600640 1 -- 172.21.15.31:0/1059130428 <== osd.2 v2:172.21.15.31:6824/1172069379 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f46a0013e70 con 0x7f4688079c90 2024-09-17T05:37:18.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.528+0000 7f46ae800640 1 -- 172.21.15.31:0/1059130428 --> [v2:172.21.15.31:6824/1172069379,v1:172.21.15.31:6825/1172069379] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f46a8157600 con 0x7f4688079c90 2024-09-17T05:37:18.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.528+0000 7f46a5600640 1 -- 172.21.15.31:0/1059130428 <== osd.2 v2:172.21.15.31:6824/1172069379 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f46a8157600 con 0x7f4688079c90 2024-09-17T05:37:18.530 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:37:18.530 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:37:18.530 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:37:18.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.528+0000 7f46ae800640 1 -- 172.21.15.31:0/1059130428 >> [v2:172.21.15.31:6824/1172069379,v1:172.21.15.31:6825/1172069379] conn(0x7f4688079c90 msgr2=0x7f468807c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.528+0000 7f46ae800640 1 --2- 172.21.15.31:0/1059130428 >> [v2:172.21.15.31:6824/1172069379,v1:172.21.15.31:6825/1172069379] conn(0x7f4688079c90 0x7f468807c0b0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.528+0000 7f46ae800640 1 -- 172.21.15.31:0/1059130428 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4688073dd0 msgr2=0x7f4688076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.528+0000 7f46ae800640 1 --2- 172.21.15.31:0/1059130428 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f4688073dd0 0x7f4688076290 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f469c000c10 tx=0x7f469c001730 comp rx=0 tx=0).stop 2024-09-17T05:37:18.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.528+0000 7f46ae800640 1 -- 172.21.15.31:0/1059130428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46a8072090 msgr2=0x7f46a80cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.528+0000 7f46ae800640 1 --2- 172.21.15.31:0/1059130428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46a8072090 0x7f46a80cc8f0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f46a000c730 tx=0x7f46a000cbf0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.528+0000 7f46ade00640 1 -- 172.21.15.31:0/1059130428 reap_dead start 2024-09-17T05:37:18.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.528+0000 7f46ae800640 1 -- 172.21.15.31:0/1059130428 shutdown_connections 2024-09-17T05:37:18.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.528+0000 7f46ae800640 1 -- 172.21.15.31:0/1059130428 >> 172.21.15.31:0/1059130428 conn(0x7f46a80d1da0 msgr2=0x7f46a80d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:18.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.528+0000 7f46ae800640 1 -- 172.21.15.31:0/1059130428 shutdown_connections 2024-09-17T05:37:18.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.528+0000 7f46ae800640 1 -- 172.21.15.31:0/1059130428 wait complete. 2024-09-17T05:37:18.549 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T05:37:18.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.696+0000 7f1554400640 1 -- 172.21.15.31:0/3725901142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f154c0cdb30 msgr2=0x7f154c0cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.696+0000 7f1554400640 1 --2- 172.21.15.31:0/3725901142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f154c0cdb30 0x7f154c0cebb0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f154c0745d0 tx=0x7f153801c8c0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.696+0000 7f1554400640 1 -- 172.21.15.31:0/3725901142 shutdown_connections 2024-09-17T05:37:18.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.696+0000 7f1554400640 1 --2- 172.21.15.31:0/3725901142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154c0d28e0 0x7f154c0cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.696+0000 7f1554400640 1 --2- 172.21.15.31:0/3725901142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f154c0cdb30 0x7f154c0cebb0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.696+0000 7f1554400640 1 --2- 172.21.15.31:0/3725901142 >> v2:172.21.15.155:3300/0 conn(0x7f154c15bea0 0x7f154c0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.696+0000 7f1554400640 1 -- 172.21.15.31:0/3725901142 >> 172.21.15.31:0/3725901142 conn(0x7f154c0d1dc0 msgr2=0x7f154c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:18.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.696+0000 7f1554400640 1 -- 172.21.15.31:0/3725901142 shutdown_connections 2024-09-17T05:37:18.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.696+0000 7f1554400640 1 -- 172.21.15.31:0/3725901142 wait complete. 2024-09-17T05:37:18.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.696+0000 7f1554400640 1 Processor -- start 2024-09-17T05:37:18.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.696+0000 7f1554400640 1 -- start start 2024-09-17T05:37:18.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.696+0000 7f1554400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154c0cdb30 0x7f154c0b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:18.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.696+0000 7f1554400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f154c0d28e0 0x7f154c15c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:18.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.696+0000 7f1554400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f154c15bea0 0x7f154c15cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:18.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.696+0000 7f1554400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f154c0af070 con 0x7f154c15bea0 2024-09-17T05:37:18.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.696+0000 7f1554400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f154c0aeef0 con 0x7f154c0d28e0 2024-09-17T05:37:18.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.696+0000 7f1554400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f154c0af1f0 con 0x7f154c0cdb30 2024-09-17T05:37:18.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.696+0000 7f1552400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f154c15bea0 0x7f154c15cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:18.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.700+0000 7f1552400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f154c15bea0 0x7f154c15cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46234/0 (socket says 172.21.15.31:46234) 2024-09-17T05:37:18.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.700+0000 7f1552400640 1 -- 172.21.15.31:0/1194202140 learned_addr learned my addr 172.21.15.31:0/1194202140 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:18.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.700+0000 7f1551a00640 1 --2- 172.21.15.31:0/1194202140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154c0cdb30 0x7f154c0b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:18.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.700+0000 7f1551000640 1 --2- 172.21.15.31:0/1194202140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f154c0d28e0 0x7f154c15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:18.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.700+0000 7f1552400640 1 -- 172.21.15.31:0/1194202140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154c0cdb30 msgr2=0x7f154c0b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.700+0000 7f1552400640 1 --2- 172.21.15.31:0/1194202140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154c0cdb30 0x7f154c0b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.700+0000 7f1552400640 1 -- 172.21.15.31:0/1194202140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f154c0d28e0 msgr2=0x7f154c15c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.700+0000 7f1552400640 1 --2- 172.21.15.31:0/1194202140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f154c0d28e0 0x7f154c15c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.700+0000 7f1552400640 1 -- 172.21.15.31:0/1194202140 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f154c0b2710 con 0x7f154c15bea0 2024-09-17T05:37:18.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.700+0000 7f1552400640 1 --2- 172.21.15.31:0/1194202140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f154c15bea0 0x7f154c15cb50 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f154400cce0 tx=0x7f154400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:18.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.700+0000 7f1549600640 1 -- 172.21.15.31:0/1194202140 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154400f450 con 0x7f154c15bea0 2024-09-17T05:37:18.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.700+0000 7f1549600640 1 -- 172.21.15.31:0/1194202140 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f154400f6e0 con 0x7f154c15bea0 2024-09-17T05:37:18.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.700+0000 7f1549600640 1 -- 172.21.15.31:0/1194202140 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154400fb30 con 0x7f154c15bea0 2024-09-17T05:37:18.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.700+0000 7f1554400640 1 -- 172.21.15.31:0/1194202140 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154c0b29f0 con 0x7f154c15bea0 2024-09-17T05:37:18.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.700+0000 7f1554400640 1 -- 172.21.15.31:0/1194202140 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f154c0b2fb0 con 0x7f154c15bea0 2024-09-17T05:37:18.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.700+0000 7f1554400640 1 -- 172.21.15.31:0/1194202140 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f154c0cc9d0 con 0x7f154c15bea0 2024-09-17T05:37:18.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.700+0000 7f1549600640 1 -- 172.21.15.31:0/1194202140 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f154400fcd0 con 0x7f154c15bea0 2024-09-17T05:37:18.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.704+0000 7f1549600640 1 --2- 172.21.15.31:0/1194202140 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f152c073dd0 0x7f152c076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:18.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.704+0000 7f1549600640 1 -- 172.21.15.31:0/1194202140 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f15440935f0 con 0x7f154c15bea0 2024-09-17T05:37:18.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.704+0000 7f1551a00640 1 --2- 172.21.15.31:0/1194202140 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f152c073dd0 0x7f152c076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:18.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.704+0000 7f1551a00640 1 --2- 172.21.15.31:0/1194202140 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f152c073dd0 0x7f152c076290 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f154000bb50 tx=0x7f154000b2e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:18.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.708+0000 7f1549600640 1 -- 172.21.15.31:0/1194202140 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f1544014030 con 0x7f154c15bea0 2024-09-17T05:37:18.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.884+0000 7f1554400640 1 -- 172.21.15.31:0/1194202140 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f154c0d2570 con 0x7f152c073dd0 2024-09-17T05:37:18.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.884+0000 7f1549600640 1 -- 172.21.15.31:0/1194202140 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f154c0d2570 con 0x7f152c073dd0 2024-09-17T05:37:18.887 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T05:37:18.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.888+0000 7f1554400640 1 -- 172.21.15.31:0/1194202140 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f152c073dd0 msgr2=0x7f152c076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.888+0000 7f1554400640 1 --2- 172.21.15.31:0/1194202140 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f152c073dd0 0x7f152c076290 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f154000bb50 tx=0x7f154000b2e0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.888+0000 7f1554400640 1 -- 172.21.15.31:0/1194202140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f154c15bea0 msgr2=0x7f154c15cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:18.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.888+0000 7f1554400640 1 --2- 172.21.15.31:0/1194202140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f154c15bea0 0x7f154c15cb50 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f154400cce0 tx=0x7f154400a620 comp rx=0 tx=0).stop 2024-09-17T05:37:18.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.888+0000 7f1554400640 1 -- 172.21.15.31:0/1194202140 shutdown_connections 2024-09-17T05:37:18.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.888+0000 7f1554400640 1 --2- 172.21.15.31:0/1194202140 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f152c073dd0 0x7f152c076290 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.888+0000 7f1554400640 1 --2- 172.21.15.31:0/1194202140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f154c15bea0 0x7f154c15cb50 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.888+0000 7f1554400640 1 --2- 172.21.15.31:0/1194202140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f154c0d28e0 0x7f154c15c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.888+0000 7f1554400640 1 --2- 172.21.15.31:0/1194202140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f154c0cdb30 0x7f154c0b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:18.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.888+0000 7f1554400640 1 -- 172.21.15.31:0/1194202140 >> 172.21.15.31:0/1194202140 conn(0x7f154c0d1dc0 msgr2=0x7f154c070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:18.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.888+0000 7f1554400640 1 -- 172.21.15.31:0/1194202140 shutdown_connections 2024-09-17T05:37:18.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:18.888+0000 7f1554400640 1 -- 172.21.15.31:0/1194202140 wait complete. 2024-09-17T05:37:18.909 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T05:37:18.909 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:37:19.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.056+0000 7f72b1000640 1 -- 172.21.15.31:0/4029248733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ac15c1f0 msgr2=0x7f72ac0cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.056+0000 7f72b1000640 1 --2- 172.21.15.31:0/4029248733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ac15c1f0 0x7f72ac0cec40 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f72ac073e00 tx=0x7f729401f0b0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.056+0000 7f72b1000640 1 -- 172.21.15.31:0/4029248733 shutdown_connections 2024-09-17T05:37:19.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.056+0000 7f72b1000640 1 --2- 172.21.15.31:0/4029248733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ac15c1f0 0x7f72ac0cec40 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.056+0000 7f72b1000640 1 --2- 172.21.15.31:0/4029248733 >> v2:172.21.15.155:3300/0 conn(0x7f72ac15be10 0x7f72ac0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.056+0000 7f72b1000640 1 -- 172.21.15.31:0/4029248733 >> 172.21.15.31:0/4029248733 conn(0x7f72ac0d1da0 msgr2=0x7f72ac0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:19.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.056+0000 7f72b1000640 1 -- 172.21.15.31:0/4029248733 shutdown_connections 2024-09-17T05:37:19.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.056+0000 7f72b1000640 1 -- 172.21.15.31:0/4029248733 wait complete. 2024-09-17T05:37:19.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72b1000640 1 Processor -- start 2024-09-17T05:37:19.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72b1000640 1 -- start start 2024-09-17T05:37:19.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72b1000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72ac0b0b60 0x7f72ac0cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72b1000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ac15be10 0x7f72ac0c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72b1000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72ac15c1f0 0x7f72ac1f4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72b1000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac0cf510 con 0x7f72ac15be10 2024-09-17T05:37:19.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72b1000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac0cf390 con 0x7f72ac15c1f0 2024-09-17T05:37:19.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72b1000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f72ac160290 con 0x7f72ac0b0b60 2024-09-17T05:37:19.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72a3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ac15be10 0x7f72ac0c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72a3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ac15be10 0x7f72ac0c6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46252/0 (socket says 172.21.15.31:46252) 2024-09-17T05:37:19.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72a9e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72ac0b0b60 0x7f72ac0cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72a3e00640 1 -- 172.21.15.31:0/1746241698 learned_addr learned my addr 172.21.15.31:0/1746241698 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:19.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72aa800640 1 --2- 172.21.15.31:0/1746241698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72ac15c1f0 0x7f72ac1f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72a3e00640 1 -- 172.21.15.31:0/1746241698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72ac0b0b60 msgr2=0x7f72ac0cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72a3e00640 1 --2- 172.21.15.31:0/1746241698 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f72ac0b0b60 0x7f72ac0cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72a3e00640 1 -- 172.21.15.31:0/1746241698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72ac15c1f0 msgr2=0x7f72ac1f4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72a3e00640 1 --2- 172.21.15.31:0/1746241698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72ac15c1f0 0x7f72ac1f4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72a3e00640 1 -- 172.21.15.31:0/1746241698 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ac0c76f0 con 0x7f72ac15be10 2024-09-17T05:37:19.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72a3e00640 1 --2- 172.21.15.31:0/1746241698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ac15be10 0x7f72ac0c6f70 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f729401bcc0 tx=0x7f7294004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:19.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72a2000640 1 -- 172.21.15.31:0/1746241698 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72940be070 con 0x7f72ac15be10 2024-09-17T05:37:19.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72a2000640 1 -- 172.21.15.31:0/1746241698 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72940053e0 con 0x7f72ac15be10 2024-09-17T05:37:19.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72b1000640 1 -- 172.21.15.31:0/1746241698 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72ac0c79b0 con 0x7f72ac15be10 2024-09-17T05:37:19.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.060+0000 7f72a2000640 1 -- 172.21.15.31:0/1746241698 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72940b5040 con 0x7f72ac15be10 2024-09-17T05:37:19.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.064+0000 7f72b1000640 1 -- 172.21.15.31:0/1746241698 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72ac0c7f70 con 0x7f72ac15be10 2024-09-17T05:37:19.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.064+0000 7f72b1000640 1 -- 172.21.15.31:0/1746241698 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f72ac0c8770 con 0x7f72ac15be10 2024-09-17T05:37:19.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.064+0000 7f72a2000640 1 -- 172.21.15.31:0/1746241698 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f72940c1070 con 0x7f72ac15be10 2024-09-17T05:37:19.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.064+0000 7f72a2000640 1 --2- 172.21.15.31:0/1746241698 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7288073dd0 0x7f7288076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.064+0000 7f72a2000640 1 -- 172.21.15.31:0/1746241698 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f729412ffa0 con 0x7f72ac15be10 2024-09-17T05:37:19.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.064+0000 7f72a9e00640 1 --2- 172.21.15.31:0/1746241698 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7288073dd0 0x7f7288076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.064+0000 7f72a2000640 1 --2- 172.21.15.31:0/1746241698 >> [v2:172.21.15.31:6809/2225281127,v1:172.21.15.31:6811/2225281127] conn(0x7f7288079c90 0x7f728807c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.064+0000 7f72a2000640 1 -- 172.21.15.31:0/1746241698 --> [v2:172.21.15.31:6809/2225281127,v1:172.21.15.31:6811/2225281127] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72940c8e50 con 0x7f7288079c90 2024-09-17T05:37:19.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.064+0000 7f72a2000640 1 -- 172.21.15.31:0/1746241698 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=166) ==== 24+0+0 (secure 0 0 0) 0x7f7294132800 con 0x7f72ac15be10 2024-09-17T05:37:19.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.064+0000 7f72aa800640 1 --2- 172.21.15.31:0/1746241698 >> [v2:172.21.15.31:6809/2225281127,v1:172.21.15.31:6811/2225281127] conn(0x7f7288079c90 0x7f728807c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.068+0000 7f72a9e00640 1 --2- 172.21.15.31:0/1746241698 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7288073dd0 0x7f7288076290 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f729c00bc00 tx=0x7f729c00b390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:19.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.068+0000 7f72aa800640 1 --2- 172.21.15.31:0/1746241698 >> [v2:172.21.15.31:6809/2225281127,v1:172.21.15.31:6811/2225281127] conn(0x7f7288079c90 0x7f728807c0b0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:19.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.068+0000 7f72a2000640 1 -- 172.21.15.31:0/1746241698 <== osd.3 v2:172.21.15.31:6809/2225281127 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f72940c8e50 con 0x7f7288079c90 2024-09-17T05:37:19.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.080+0000 7f72b1000640 1 -- 172.21.15.31:0/1746241698 --> [v2:172.21.15.31:6809/2225281127,v1:172.21.15.31:6811/2225281127] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f72ac1607b0 con 0x7f7288079c90 2024-09-17T05:37:19.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.080+0000 7f72a2000640 1 -- 172.21.15.31:0/1746241698 <== osd.3 v2:172.21.15.31:6809/2225281127 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f72ac1607b0 con 0x7f7288079c90 2024-09-17T05:37:19.083 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:37:19.083 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:37:19.083 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:37:19.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.080+0000 7f72b1000640 1 -- 172.21.15.31:0/1746241698 >> [v2:172.21.15.31:6809/2225281127,v1:172.21.15.31:6811/2225281127] conn(0x7f7288079c90 msgr2=0x7f728807c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.080+0000 7f72b1000640 1 --2- 172.21.15.31:0/1746241698 >> [v2:172.21.15.31:6809/2225281127,v1:172.21.15.31:6811/2225281127] conn(0x7f7288079c90 0x7f728807c0b0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.080+0000 7f72b1000640 1 -- 172.21.15.31:0/1746241698 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7288073dd0 msgr2=0x7f7288076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.080+0000 7f72b1000640 1 --2- 172.21.15.31:0/1746241698 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f7288073dd0 0x7f7288076290 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f729c00bc00 tx=0x7f729c00b390 comp rx=0 tx=0).stop 2024-09-17T05:37:19.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.080+0000 7f72b1000640 1 -- 172.21.15.31:0/1746241698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ac15be10 msgr2=0x7f72ac0c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.080+0000 7f72b1000640 1 --2- 172.21.15.31:0/1746241698 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f72ac15be10 0x7f72ac0c6f70 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f729401bcc0 tx=0x7f7294004600 comp rx=0 tx=0).stop 2024-09-17T05:37:19.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.080+0000 7f72aa800640 1 -- 172.21.15.31:0/1746241698 reap_dead start 2024-09-17T05:37:19.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.080+0000 7f72b1000640 1 -- 172.21.15.31:0/1746241698 shutdown_connections 2024-09-17T05:37:19.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.080+0000 7f72b1000640 1 -- 172.21.15.31:0/1746241698 >> 172.21.15.31:0/1746241698 conn(0x7f72ac0d1da0 msgr2=0x7f72ac0b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:19.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.080+0000 7f72b1000640 1 -- 172.21.15.31:0/1746241698 shutdown_connections 2024-09-17T05:37:19.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.080+0000 7f72b1000640 1 -- 172.21.15.31:0/1746241698 wait complete. 2024-09-17T05:37:19.102 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-17T05:37:19.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.248+0000 7f6d24800640 1 -- 172.21.15.31:0/3867028597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1c0b6400 msgr2=0x7f6d1c0ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.248+0000 7f6d24800640 1 --2- 172.21.15.31:0/3867028597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1c0b6400 0x7f6d1c0ccfc0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009bc0 tx=0x7f6d1801cac0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.248+0000 7f6d24800640 1 -- 172.21.15.31:0/3867028597 shutdown_connections 2024-09-17T05:37:19.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.248+0000 7f6d24800640 1 --2- 172.21.15.31:0/3867028597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1c0b6400 0x7f6d1c0ccfc0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.248+0000 7f6d24800640 1 -- 172.21.15.31:0/3867028597 >> 172.21.15.31:0/3867028597 conn(0x7f6d1c0d1da0 msgr2=0x7f6d1c0d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:19.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.248+0000 7f6d24800640 1 -- 172.21.15.31:0/3867028597 shutdown_connections 2024-09-17T05:37:19.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.248+0000 7f6d24800640 1 -- 172.21.15.31:0/3867028597 wait complete. 2024-09-17T05:37:19.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.248+0000 7f6d24800640 1 Processor -- start 2024-09-17T05:37:19.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d24800640 1 -- start start 2024-09-17T05:37:19.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d24800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1c0b6400 0x7f6d1c0b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d24800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d1c0cebf0 0x7f6d1c0b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d24800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d1c15be80 0x7f6d1c157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d24800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c16a360 con 0x7f6d1c15be80 2024-09-17T05:37:19.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d24800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c16a1e0 con 0x7f6d1c0b6400 2024-09-17T05:37:19.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d24800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6d1c16a4e0 con 0x7f6d1c0cebf0 2024-09-17T05:37:19.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d22800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d1c15be80 0x7f6d1c157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d22800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d1c15be80 0x7f6d1c157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46260/0 (socket says 172.21.15.31:46260) 2024-09-17T05:37:19.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d22800640 1 -- 172.21.15.31:0/3691131317 learned_addr learned my addr 172.21.15.31:0/3691131317 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:19.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d21400640 1 --2- 172.21.15.31:0/3691131317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d1c0cebf0 0x7f6d1c0b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d21e00640 1 --2- 172.21.15.31:0/3691131317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1c0b6400 0x7f6d1c0b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d22800640 1 -- 172.21.15.31:0/3691131317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d1c0cebf0 msgr2=0x7f6d1c0b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d22800640 1 --2- 172.21.15.31:0/3691131317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d1c0cebf0 0x7f6d1c0b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d22800640 1 -- 172.21.15.31:0/3691131317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1c0b6400 msgr2=0x7f6d1c0b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d22800640 1 --2- 172.21.15.31:0/3691131317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1c0b6400 0x7f6d1c0b78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d22800640 1 -- 172.21.15.31:0/3691131317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1c158700 con 0x7f6d1c15be80 2024-09-17T05:37:19.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d21400640 1 --2- 172.21.15.31:0/3691131317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d1c0cebf0 0x7f6d1c0b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:19.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d22800640 1 --2- 172.21.15.31:0/3691131317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d1c15be80 0x7f6d1c157e60 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f6d180b0040 tx=0x7f6d18005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:19.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d16000640 1 -- 172.21.15.31:0/3691131317 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d180bb070 con 0x7f6d1c15be80 2024-09-17T05:37:19.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d16000640 1 -- 172.21.15.31:0/3691131317 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d18004a50 con 0x7f6d1c15be80 2024-09-17T05:37:19.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d16000640 1 -- 172.21.15.31:0/3691131317 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d180b2040 con 0x7f6d1c15be80 2024-09-17T05:37:19.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d24800640 1 -- 172.21.15.31:0/3691131317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d1c1589e0 con 0x7f6d1c15be80 2024-09-17T05:37:19.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d24800640 1 -- 172.21.15.31:0/3691131317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d1c158fa0 con 0x7f6d1c15be80 2024-09-17T05:37:19.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.252+0000 7f6d24800640 1 -- 172.21.15.31:0/3691131317 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d1c0ce4e0 con 0x7f6d1c15be80 2024-09-17T05:37:19.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.256+0000 7f6d16000640 1 -- 172.21.15.31:0/3691131317 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f6d180be070 con 0x7f6d1c15be80 2024-09-17T05:37:19.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.256+0000 7f6d16000640 1 --2- 172.21.15.31:0/3691131317 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d00073dd0 0x7f6d00076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.256+0000 7f6d16000640 1 -- 172.21.15.31:0/3691131317 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f6d1812c670 con 0x7f6d1c15be80 2024-09-17T05:37:19.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.256+0000 7f6d21e00640 1 --2- 172.21.15.31:0/3691131317 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d00073dd0 0x7f6d00076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.256+0000 7f6d21e00640 1 --2- 172.21.15.31:0/3691131317 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d00073dd0 0x7f6d00076290 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6d10001a40 tx=0x7f6d10001870 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:19.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.260+0000 7f6d16000640 1 -- 172.21.15.31:0/3691131317 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f6d180166b0 con 0x7f6d1c15be80 2024-09-17T05:37:19.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.432+0000 7f6d24800640 1 -- 172.21.15.31:0/3691131317 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f6d1c06f3b0 con 0x7f6d00073dd0 2024-09-17T05:37:19.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.436+0000 7f6d16000640 1 -- 172.21.15.31:0/3691131317 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6d1c06f3b0 con 0x7f6d00073dd0 2024-09-17T05:37:19.437 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 3 to deep-scrub 2024-09-17T05:37:19.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.436+0000 7f6d24800640 1 -- 172.21.15.31:0/3691131317 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d00073dd0 msgr2=0x7f6d00076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.436+0000 7f6d24800640 1 --2- 172.21.15.31:0/3691131317 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d00073dd0 0x7f6d00076290 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6d10001a40 tx=0x7f6d10001870 comp rx=0 tx=0).stop 2024-09-17T05:37:19.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.436+0000 7f6d24800640 1 -- 172.21.15.31:0/3691131317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d1c15be80 msgr2=0x7f6d1c157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.436+0000 7f6d24800640 1 --2- 172.21.15.31:0/3691131317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d1c15be80 0x7f6d1c157e60 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f6d180b0040 tx=0x7f6d18005b00 comp rx=0 tx=0).stop 2024-09-17T05:37:19.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.436+0000 7f6d24800640 1 -- 172.21.15.31:0/3691131317 shutdown_connections 2024-09-17T05:37:19.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.436+0000 7f6d24800640 1 --2- 172.21.15.31:0/3691131317 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f6d00073dd0 0x7f6d00076290 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.436+0000 7f6d24800640 1 --2- 172.21.15.31:0/3691131317 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6d1c15be80 0x7f6d1c157e60 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.436+0000 7f6d24800640 1 --2- 172.21.15.31:0/3691131317 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6d1c0cebf0 0x7f6d1c0b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.436+0000 7f6d24800640 1 --2- 172.21.15.31:0/3691131317 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d1c0b6400 0x7f6d1c0b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.436+0000 7f6d24800640 1 -- 172.21.15.31:0/3691131317 >> 172.21.15.31:0/3691131317 conn(0x7f6d1c0d1da0 msgr2=0x7f6d1c071180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:19.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.436+0000 7f6d24800640 1 -- 172.21.15.31:0/3691131317 shutdown_connections 2024-09-17T05:37:19.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.436+0000 7f6d24800640 1 -- 172.21.15.31:0/3691131317 wait complete. 2024-09-17T05:37:19.458 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T05:37:19.459 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:37:19.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.604+0000 7f60e5c00640 1 -- 172.21.15.31:0/2316346412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60e015c1f0 msgr2=0x7f60e00cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.604+0000 7f60e5c00640 1 --2- 172.21.15.31:0/2316346412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60e015c1f0 0x7f60e00cec40 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f60e0073e00 tx=0x7f60c801f0b0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.604+0000 7f60e5c00640 1 -- 172.21.15.31:0/2316346412 shutdown_connections 2024-09-17T05:37:19.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.604+0000 7f60e5c00640 1 --2- 172.21.15.31:0/2316346412 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60e015c1f0 0x7f60e00cec40 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60e5c00640 1 --2- 172.21.15.31:0/2316346412 >> v2:172.21.15.155:3300/0 conn(0x7f60e015be10 0x7f60e00ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60e5c00640 1 -- 172.21.15.31:0/2316346412 >> 172.21.15.31:0/2316346412 conn(0x7f60e00d1da0 msgr2=0x7f60e00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:19.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60e5c00640 1 -- 172.21.15.31:0/2316346412 shutdown_connections 2024-09-17T05:37:19.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60e5c00640 1 -- 172.21.15.31:0/2316346412 wait complete. 2024-09-17T05:37:19.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60e5c00640 1 Processor -- start 2024-09-17T05:37:19.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60e5c00640 1 -- start start 2024-09-17T05:37:19.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60e5c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60e00b0b60 0x7f60e01504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60e5c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60e015be10 0x7f60e01f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60e5c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60e015c1f0 0x7f60e01f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60e5c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f60e00cf510 con 0x7f60e015c1f0 2024-09-17T05:37:19.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60e5c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f60e00cf390 con 0x7f60e00b0b60 2024-09-17T05:37:19.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60e5c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f60e0160290 con 0x7f60e015be10 2024-09-17T05:37:19.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60df400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60e015c1f0 0x7f60e01f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60df400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60e015c1f0 0x7f60e01f4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46286/0 (socket says 172.21.15.31:46286) 2024-09-17T05:37:19.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60df400640 1 -- 172.21.15.31:0/3185057490 learned_addr learned my addr 172.21.15.31:0/3185057490 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:19.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60dea00640 1 --2- 172.21.15.31:0/3185057490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60e00b0b60 0x7f60e01504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60d7e00640 1 --2- 172.21.15.31:0/3185057490 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60e015be10 0x7f60e01f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60df400640 1 -- 172.21.15.31:0/3185057490 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60e015be10 msgr2=0x7f60e01f48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60df400640 1 --2- 172.21.15.31:0/3185057490 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60e015be10 0x7f60e01f48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60df400640 1 -- 172.21.15.31:0/3185057490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60e00b0b60 msgr2=0x7f60e01504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60df400640 1 --2- 172.21.15.31:0/3185057490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60e00b0b60 0x7f60e01504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60df400640 1 -- 172.21.15.31:0/3185057490 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e01509e0 con 0x7f60e015c1f0 2024-09-17T05:37:19.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.608+0000 7f60df400640 1 --2- 172.21.15.31:0/3185057490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60e015c1f0 0x7f60e01f4e00 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f60d800c7b0 tx=0x7f60d800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:19.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.612+0000 7f60d6a00640 1 -- 172.21.15.31:0/3185057490 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d8017070 con 0x7f60e015c1f0 2024-09-17T05:37:19.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.612+0000 7f60d6a00640 1 -- 172.21.15.31:0/3185057490 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60d8005070 con 0x7f60e015c1f0 2024-09-17T05:37:19.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.612+0000 7f60e5c00640 1 -- 172.21.15.31:0/3185057490 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e00c5a50 con 0x7f60e015c1f0 2024-09-17T05:37:19.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.612+0000 7f60d6a00640 1 -- 172.21.15.31:0/3185057490 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d80054c0 con 0x7f60e015c1f0 2024-09-17T05:37:19.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.612+0000 7f60e5c00640 1 -- 172.21.15.31:0/3185057490 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e015a930 con 0x7f60e015c1f0 2024-09-17T05:37:19.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.612+0000 7f60e5c00640 1 -- 172.21.15.31:0/3185057490 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f60e00c5e10 con 0x7f60e015c1f0 2024-09-17T05:37:19.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.612+0000 7f60d6a00640 1 -- 172.21.15.31:0/3185057490 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f60d801a070 con 0x7f60e015c1f0 2024-09-17T05:37:19.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.612+0000 7f60d6a00640 1 --2- 172.21.15.31:0/3185057490 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f60bc073dd0 0x7f60bc076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.612+0000 7f60d6a00640 1 -- 172.21.15.31:0/3185057490 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f60d8092ae0 con 0x7f60e015c1f0 2024-09-17T05:37:19.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.612+0000 7f60dea00640 1 --2- 172.21.15.31:0/3185057490 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f60bc073dd0 0x7f60bc076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.612+0000 7f60d6a00640 1 --2- 172.21.15.31:0/3185057490 >> [v2:172.21.15.155:6810/3398816604,v1:172.21.15.155:6811/3398816604] conn(0x7f60bc079c90 0x7f60bc07c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.612+0000 7f60d6a00640 1 -- 172.21.15.31:0/3185057490 --> [v2:172.21.15.155:6810/3398816604,v1:172.21.15.155:6811/3398816604] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f60bc07c780 con 0x7f60bc079c90 2024-09-17T05:37:19.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.612+0000 7f60d6a00640 1 -- 172.21.15.31:0/3185057490 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=166) ==== 24+0+0 (secure 0 0 0) 0x7f60d8095750 con 0x7f60e015c1f0 2024-09-17T05:37:19.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.616+0000 7f60d7e00640 1 --2- 172.21.15.31:0/3185057490 >> [v2:172.21.15.155:6810/3398816604,v1:172.21.15.155:6811/3398816604] conn(0x7f60bc079c90 0x7f60bc07c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.616+0000 7f60dea00640 1 --2- 172.21.15.31:0/3185057490 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f60bc073dd0 0x7f60bc076290 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f60e00afd50 tx=0x7f60d0009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:19.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.616+0000 7f60d7e00640 1 --2- 172.21.15.31:0/3185057490 >> [v2:172.21.15.155:6810/3398816604,v1:172.21.15.155:6811/3398816604] conn(0x7f60bc079c90 0x7f60bc07c0b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:19.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.616+0000 7f60d6a00640 1 -- 172.21.15.31:0/3185057490 <== osd.4 v2:172.21.15.155:6810/3398816604 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f60bc07c780 con 0x7f60bc079c90 2024-09-17T05:37:19.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.628+0000 7f60e5c00640 1 -- 172.21.15.31:0/3185057490 --> [v2:172.21.15.155:6810/3398816604,v1:172.21.15.155:6811/3398816604] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f60e0160810 con 0x7f60bc079c90 2024-09-17T05:37:19.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.628+0000 7f60d6a00640 1 -- 172.21.15.31:0/3185057490 <== osd.4 v2:172.21.15.155:6810/3398816604 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f60e0160810 con 0x7f60bc079c90 2024-09-17T05:37:19.632 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:37:19.632 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:37:19.633 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:37:19.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.628+0000 7f60e5c00640 1 -- 172.21.15.31:0/3185057490 >> [v2:172.21.15.155:6810/3398816604,v1:172.21.15.155:6811/3398816604] conn(0x7f60bc079c90 msgr2=0x7f60bc07c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.628+0000 7f60e5c00640 1 --2- 172.21.15.31:0/3185057490 >> [v2:172.21.15.155:6810/3398816604,v1:172.21.15.155:6811/3398816604] conn(0x7f60bc079c90 0x7f60bc07c0b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.632+0000 7f60e5c00640 1 -- 172.21.15.31:0/3185057490 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f60bc073dd0 msgr2=0x7f60bc076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.632+0000 7f60e5c00640 1 --2- 172.21.15.31:0/3185057490 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f60bc073dd0 0x7f60bc076290 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f60e00afd50 tx=0x7f60d0009110 comp rx=0 tx=0).stop 2024-09-17T05:37:19.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.632+0000 7f60e5c00640 1 -- 172.21.15.31:0/3185057490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60e015c1f0 msgr2=0x7f60e01f4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.632+0000 7f60e5c00640 1 --2- 172.21.15.31:0/3185057490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60e015c1f0 0x7f60e01f4e00 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f60d800c7b0 tx=0x7f60d800cc70 comp rx=0 tx=0).stop 2024-09-17T05:37:19.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.632+0000 7f60df400640 1 -- 172.21.15.31:0/3185057490 reap_dead start 2024-09-17T05:37:19.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.632+0000 7f60e5c00640 1 -- 172.21.15.31:0/3185057490 shutdown_connections 2024-09-17T05:37:19.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.632+0000 7f60e5c00640 1 -- 172.21.15.31:0/3185057490 >> 172.21.15.31:0/3185057490 conn(0x7f60e00d1da0 msgr2=0x7f60e00cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:19.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.632+0000 7f60e5c00640 1 -- 172.21.15.31:0/3185057490 shutdown_connections 2024-09-17T05:37:19.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.632+0000 7f60e5c00640 1 -- 172.21.15.31:0/3185057490 wait complete. 2024-09-17T05:37:19.652 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-17T05:37:19.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.796+0000 7fa29f400640 1 -- 172.21.15.31:0/2384088303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa29815bea0 msgr2=0x7fa2980ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.796+0000 7fa29f400640 1 --2- 172.21.15.31:0/2384088303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa29815bea0 0x7fa2980ce670 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fa298073d10 tx=0x7fa28801c770 comp rx=0 tx=0).stop 2024-09-17T05:37:19.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.796+0000 7fa29f400640 1 -- 172.21.15.31:0/2384088303 shutdown_connections 2024-09-17T05:37:19.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.796+0000 7fa29f400640 1 --2- 172.21.15.31:0/2384088303 >> v2:172.21.15.155:3300/0 conn(0x7fa2980cdb30 0x7fa2980cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.796+0000 7fa29f400640 1 --2- 172.21.15.31:0/2384088303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa29815bea0 0x7fa2980ce670 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.796+0000 7fa29f400640 1 -- 172.21.15.31:0/2384088303 >> 172.21.15.31:0/2384088303 conn(0x7fa2980d1dc0 msgr2=0x7fa2980d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:19.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.796+0000 7fa29f400640 1 -- 172.21.15.31:0/2384088303 shutdown_connections 2024-09-17T05:37:19.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.796+0000 7fa29f400640 1 -- 172.21.15.31:0/2384088303 wait complete. 2024-09-17T05:37:19.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29f400640 1 Processor -- start 2024-09-17T05:37:19.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29f400640 1 -- start start 2024-09-17T05:37:19.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2980cdb30 0x7fa298159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29f400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2980d28e0 0x7fa29814c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29f400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa29815bea0 0x7fa2980c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29f400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa298168fc0 con 0x7fa2980cdb30 2024-09-17T05:37:19.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29f400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa298168e40 con 0x7fa2980d28e0 2024-09-17T05:37:19.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29f400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa298169140 con 0x7fa29815bea0 2024-09-17T05:37:19.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2980cdb30 0x7fa298159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2980cdb30 0x7fa298159490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46298/0 (socket says 172.21.15.31:46298) 2024-09-17T05:37:19.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29ca00640 1 -- 172.21.15.31:0/1613298154 learned_addr learned my addr 172.21.15.31:0/1613298154 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:19.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa28fe00640 1 --2- 172.21.15.31:0/1613298154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2980d28e0 0x7fa29814c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29d400640 1 --2- 172.21.15.31:0/1613298154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa29815bea0 0x7fa2980c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29ca00640 1 -- 172.21.15.31:0/1613298154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa29815bea0 msgr2=0x7fa2980c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29ca00640 1 --2- 172.21.15.31:0/1613298154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa29815bea0 0x7fa2980c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29ca00640 1 -- 172.21.15.31:0/1613298154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2980d28e0 msgr2=0x7fa29814c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29ca00640 1 --2- 172.21.15.31:0/1613298154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2980d28e0 0x7fa29814c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29ca00640 1 -- 172.21.15.31:0/1613298154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2980c7c80 con 0x7fa2980cdb30 2024-09-17T05:37:19.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa28fe00640 1 --2- 172.21.15.31:0/1613298154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2980d28e0 0x7fa29814c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:19.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29ca00640 1 --2- 172.21.15.31:0/1613298154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2980cdb30 0x7fa298159490 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fa288000c10 tx=0x7fa2880a55c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:19.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa295600640 1 -- 172.21.15.31:0/1613298154 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2880bb070 con 0x7fa2980cdb30 2024-09-17T05:37:19.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa295600640 1 -- 172.21.15.31:0/1613298154 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa288004470 con 0x7fa2980cdb30 2024-09-17T05:37:19.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa295600640 1 -- 172.21.15.31:0/1613298154 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2880b2040 con 0x7fa2980cdb30 2024-09-17T05:37:19.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29f400640 1 -- 172.21.15.31:0/1613298154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2980c7ef0 con 0x7fa2980cdb30 2024-09-17T05:37:19.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.800+0000 7fa29f400640 1 -- 172.21.15.31:0/1613298154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2980c84b0 con 0x7fa2980cdb30 2024-09-17T05:37:19.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.804+0000 7fa29f400640 1 -- 172.21.15.31:0/1613298154 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2980cc9d0 con 0x7fa2980cdb30 2024-09-17T05:37:19.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.804+0000 7fa295600640 1 -- 172.21.15.31:0/1613298154 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7fa288005230 con 0x7fa2980cdb30 2024-09-17T05:37:19.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.804+0000 7fa295600640 1 --2- 172.21.15.31:0/1613298154 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa274073dd0 0x7fa274076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:19.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.804+0000 7fa295600640 1 -- 172.21.15.31:0/1613298154 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7fa28812c7c0 con 0x7fa2980cdb30 2024-09-17T05:37:19.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.804+0000 7fa28fe00640 1 --2- 172.21.15.31:0/1613298154 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa274073dd0 0x7fa274076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:19.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.804+0000 7fa28fe00640 1 --2- 172.21.15.31:0/1613298154 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa274073dd0 0x7fa274076290 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa2800058d0 tx=0x7fa280005860 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:19.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.808+0000 7fa295600640 1 -- 172.21.15.31:0/1613298154 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fa2880163f0 con 0x7fa2980cdb30 2024-09-17T05:37:19.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.988+0000 7fa29f400640 1 -- 172.21.15.31:0/1613298154 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fa2980c90e0 con 0x7fa274073dd0 2024-09-17T05:37:19.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.988+0000 7fa295600640 1 -- 172.21.15.31:0/1613298154 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa2980c90e0 con 0x7fa274073dd0 2024-09-17T05:37:19.989 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 4 to deep-scrub 2024-09-17T05:37:19.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.988+0000 7fa29f400640 1 -- 172.21.15.31:0/1613298154 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa274073dd0 msgr2=0x7fa274076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.988+0000 7fa29f400640 1 --2- 172.21.15.31:0/1613298154 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa274073dd0 0x7fa274076290 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa2800058d0 tx=0x7fa280005860 comp rx=0 tx=0).stop 2024-09-17T05:37:19.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.988+0000 7fa29f400640 1 -- 172.21.15.31:0/1613298154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2980cdb30 msgr2=0x7fa298159490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:19.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.988+0000 7fa29f400640 1 --2- 172.21.15.31:0/1613298154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2980cdb30 0x7fa298159490 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fa288000c10 tx=0x7fa2880a55c0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.988+0000 7fa29f400640 1 -- 172.21.15.31:0/1613298154 shutdown_connections 2024-09-17T05:37:19.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.988+0000 7fa29f400640 1 --2- 172.21.15.31:0/1613298154 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fa274073dd0 0x7fa274076290 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.988+0000 7fa29f400640 1 --2- 172.21.15.31:0/1613298154 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa29815bea0 0x7fa2980c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.988+0000 7fa29f400640 1 --2- 172.21.15.31:0/1613298154 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa2980d28e0 0x7fa29814c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.988+0000 7fa29f400640 1 --2- 172.21.15.31:0/1613298154 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2980cdb30 0x7fa298159490 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:19.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.988+0000 7fa29f400640 1 -- 172.21.15.31:0/1613298154 >> 172.21.15.31:0/1613298154 conn(0x7fa2980d1dc0 msgr2=0x7fa29815aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:19.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.988+0000 7fa29f400640 1 -- 172.21.15.31:0/1613298154 shutdown_connections 2024-09-17T05:37:19.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:19.988+0000 7fa29f400640 1 -- 172.21.15.31:0/1613298154 wait complete. 2024-09-17T05:37:20.010 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T05:37:20.010 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:37:20.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.160+0000 7f711b400640 1 -- 172.21.15.31:0/3399565860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f711406fbf0 msgr2=0x7f711415b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.160+0000 7f711b400640 1 --2- 172.21.15.31:0/3399565860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f711406fbf0 0x7f711415b270 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f71140b3740 tx=0x7f710001c8c0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.160+0000 7f711b400640 1 -- 172.21.15.31:0/3399565860 shutdown_connections 2024-09-17T05:37:20.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.160+0000 7f711b400640 1 --2- 172.21.15.31:0/3399565860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f711415b7b0 0x7f71140cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.160+0000 7f711b400640 1 --2- 172.21.15.31:0/3399565860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f711406fbf0 0x7f711415b270 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.160+0000 7f711b400640 1 --2- 172.21.15.31:0/3399565860 >> v2:172.21.15.155:3300/0 conn(0x7f71140c7740 0x7f711406f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.160+0000 7f711b400640 1 -- 172.21.15.31:0/3399565860 >> 172.21.15.31:0/3399565860 conn(0x7f71140b2900 msgr2=0x7f71140b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:20.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.160+0000 7f711b400640 1 -- 172.21.15.31:0/3399565860 shutdown_connections 2024-09-17T05:37:20.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.160+0000 7f711b400640 1 -- 172.21.15.31:0/3399565860 wait complete. 2024-09-17T05:37:20.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.160+0000 7f711b400640 1 Processor -- start 2024-09-17T05:37:20.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.160+0000 7f711b400640 1 -- start start 2024-09-17T05:37:20.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f711b400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f711406fbf0 0x7f711413e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f711b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71140c7740 0x7f711409aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f711b400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f711415b7b0 0x7f711413ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f711b400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7114074210 con 0x7f71140c7740 2024-09-17T05:37:20.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f711b400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7114074090 con 0x7f711415b7b0 2024-09-17T05:37:20.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f711b400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7114074390 con 0x7f711406fbf0 2024-09-17T05:37:20.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f7113e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71140c7740 0x7f711409aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f7113e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71140c7740 0x7f711409aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46324/0 (socket says 172.21.15.31:46324) 2024-09-17T05:37:20.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f7113e00640 1 -- 172.21.15.31:0/4179247860 learned_addr learned my addr 172.21.15.31:0/4179247860 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:20.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f7118a00640 1 --2- 172.21.15.31:0/4179247860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f711406fbf0 0x7f711413e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f7119400640 1 --2- 172.21.15.31:0/4179247860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f711415b7b0 0x7f711413ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f7113e00640 1 -- 172.21.15.31:0/4179247860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f711406fbf0 msgr2=0x7f711413e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f7113e00640 1 --2- 172.21.15.31:0/4179247860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f711406fbf0 0x7f711413e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f7113e00640 1 -- 172.21.15.31:0/4179247860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f711415b7b0 msgr2=0x7f711413ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f7113e00640 1 --2- 172.21.15.31:0/4179247860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f711415b7b0 0x7f711413ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f7113e00640 1 -- 172.21.15.31:0/4179247860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711409af50 con 0x7f71140c7740 2024-09-17T05:37:20.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f7113e00640 1 --2- 172.21.15.31:0/4179247860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71140c7740 0x7f711409aa10 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f71000b0040 tx=0x7f71000a6f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:20.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f7110c00640 1 -- 172.21.15.31:0/4179247860 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71000b2040 con 0x7f71140c7740 2024-09-17T05:37:20.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f7110c00640 1 -- 172.21.15.31:0/4179247860 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71000044a0 con 0x7f71140c7740 2024-09-17T05:37:20.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f7110c00640 1 -- 172.21.15.31:0/4179247860 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71000052b0 con 0x7f71140c7740 2024-09-17T05:37:20.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f711b400640 1 -- 172.21.15.31:0/4179247860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71141f95b0 con 0x7f71140c7740 2024-09-17T05:37:20.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f711b400640 1 -- 172.21.15.31:0/4179247860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71141f9e10 con 0x7f71140c7740 2024-09-17T05:37:20.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f711b400640 1 -- 172.21.15.31:0/4179247860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f71141f9960 con 0x7f71140c7740 2024-09-17T05:37:20.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.164+0000 7f7110c00640 1 -- 172.21.15.31:0/4179247860 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f7100005450 con 0x7f71140c7740 2024-09-17T05:37:20.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.168+0000 7f7110c00640 1 --2- 172.21.15.31:0/4179247860 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f70f4073dd0 0x7f70f4076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.168+0000 7f7110c00640 1 -- 172.21.15.31:0/4179247860 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f710012cb60 con 0x7f71140c7740 2024-09-17T05:37:20.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.168+0000 7f7118a00640 1 --2- 172.21.15.31:0/4179247860 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f70f4073dd0 0x7f70f4076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.168+0000 7f7110c00640 1 --2- 172.21.15.31:0/4179247860 >> [v2:172.21.15.155:6800/4024510825,v1:172.21.15.155:6801/4024510825] conn(0x7f70f4079c90 0x7f70f407c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.168+0000 7f7110c00640 1 -- 172.21.15.31:0/4179247860 --> [v2:172.21.15.155:6800/4024510825,v1:172.21.15.155:6801/4024510825] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7100001d40 con 0x7f70f4079c90 2024-09-17T05:37:20.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.168+0000 7f7110c00640 1 -- 172.21.15.31:0/4179247860 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=166) ==== 24+0+0 (secure 0 0 0) 0x7f710012f3c0 con 0x7f71140c7740 2024-09-17T05:37:20.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.168+0000 7f7119400640 1 --2- 172.21.15.31:0/4179247860 >> [v2:172.21.15.155:6800/4024510825,v1:172.21.15.155:6801/4024510825] conn(0x7f70f4079c90 0x7f70f407c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.168+0000 7f7118a00640 1 --2- 172.21.15.31:0/4179247860 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f70f4073dd0 0x7f70f4076290 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7108005e10 tx=0x7f7108005c60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:20.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.168+0000 7f7119400640 1 --2- 172.21.15.31:0/4179247860 >> [v2:172.21.15.155:6800/4024510825,v1:172.21.15.155:6801/4024510825] conn(0x7f70f4079c90 0x7f70f407c0b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:20.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.168+0000 7f7110c00640 1 -- 172.21.15.31:0/4179247860 <== osd.5 v2:172.21.15.155:6800/4024510825 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7100001d40 con 0x7f70f4079c90 2024-09-17T05:37:20.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.184+0000 7f711b400640 1 -- 172.21.15.31:0/4179247860 --> [v2:172.21.15.155:6800/4024510825,v1:172.21.15.155:6801/4024510825] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f711406f6b0 con 0x7f70f4079c90 2024-09-17T05:37:20.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.184+0000 7f7110c00640 1 -- 172.21.15.31:0/4179247860 <== osd.5 v2:172.21.15.155:6800/4024510825 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f711406f6b0 con 0x7f70f4079c90 2024-09-17T05:37:20.185 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:37:20.186 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:37:20.186 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:37:20.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.184+0000 7f711b400640 1 -- 172.21.15.31:0/4179247860 >> [v2:172.21.15.155:6800/4024510825,v1:172.21.15.155:6801/4024510825] conn(0x7f70f4079c90 msgr2=0x7f70f407c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.184+0000 7f711b400640 1 --2- 172.21.15.31:0/4179247860 >> [v2:172.21.15.155:6800/4024510825,v1:172.21.15.155:6801/4024510825] conn(0x7f70f4079c90 0x7f70f407c0b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.184+0000 7f711b400640 1 -- 172.21.15.31:0/4179247860 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f70f4073dd0 msgr2=0x7f70f4076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.184+0000 7f711b400640 1 --2- 172.21.15.31:0/4179247860 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f70f4073dd0 0x7f70f4076290 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7108005e10 tx=0x7f7108005c60 comp rx=0 tx=0).stop 2024-09-17T05:37:20.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.184+0000 7f711b400640 1 -- 172.21.15.31:0/4179247860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71140c7740 msgr2=0x7f711409aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.184+0000 7f711b400640 1 --2- 172.21.15.31:0/4179247860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71140c7740 0x7f711409aa10 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f71000b0040 tx=0x7f71000a6f60 comp rx=0 tx=0).stop 2024-09-17T05:37:20.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.184+0000 7f7119400640 1 -- 172.21.15.31:0/4179247860 reap_dead start 2024-09-17T05:37:20.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.184+0000 7f711b400640 1 -- 172.21.15.31:0/4179247860 shutdown_connections 2024-09-17T05:37:20.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.184+0000 7f711b400640 1 -- 172.21.15.31:0/4179247860 >> 172.21.15.31:0/4179247860 conn(0x7f71140b2900 msgr2=0x7f711415dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:20.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.184+0000 7f711b400640 1 -- 172.21.15.31:0/4179247860 shutdown_connections 2024-09-17T05:37:20.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.184+0000 7f711b400640 1 -- 172.21.15.31:0/4179247860 wait complete. 2024-09-17T05:37:20.204 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-17T05:37:20.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.348+0000 7f9546a00640 1 -- 172.21.15.31:0/1699223630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95400d28e0 msgr2=0x7f95400cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.348+0000 7f9546a00640 1 --2- 172.21.15.31:0/1699223630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95400d28e0 0x7f95400cebb0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f95400745d0 tx=0x7f953801ccf0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.348+0000 7f9546a00640 1 -- 172.21.15.31:0/1699223630 shutdown_connections 2024-09-17T05:37:20.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.348+0000 7f9546a00640 1 --2- 172.21.15.31:0/1699223630 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95400d28e0 0x7f95400cebb0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.348+0000 7f9546a00640 1 --2- 172.21.15.31:0/1699223630 >> v2:172.21.15.155:3300/0 conn(0x7f954015bea0 0x7f95400ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.348+0000 7f9546a00640 1 -- 172.21.15.31:0/1699223630 >> 172.21.15.31:0/1699223630 conn(0x7f95400d1dc0 msgr2=0x7f95400d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:20.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.348+0000 7f9546a00640 1 -- 172.21.15.31:0/1699223630 shutdown_connections 2024-09-17T05:37:20.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.348+0000 7f9546a00640 1 -- 172.21.15.31:0/1699223630 wait complete. 2024-09-17T05:37:20.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9546a00640 1 Processor -- start 2024-09-17T05:37:20.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9546a00640 1 -- start start 2024-09-17T05:37:20.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9546a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95400cdb30 0x7f95400c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9546a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95400d28e0 0x7f95400b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9546a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f954015bea0 0x7f954006ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9546a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9540168fc0 con 0x7f954015bea0 2024-09-17T05:37:20.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9546a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9540168e40 con 0x7f95400cdb30 2024-09-17T05:37:20.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9546a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9540169140 con 0x7f95400d28e0 2024-09-17T05:37:20.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9544a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f954015bea0 0x7f954006ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9544a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f954015bea0 0x7f954006ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46350/0 (socket says 172.21.15.31:46350) 2024-09-17T05:37:20.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9544a00640 1 -- 172.21.15.31:0/3970889294 learned_addr learned my addr 172.21.15.31:0/3970889294 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:20.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f953fe00640 1 --2- 172.21.15.31:0/3970889294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95400cdb30 0x7f95400c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9537e00640 1 --2- 172.21.15.31:0/3970889294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95400d28e0 0x7f95400b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9544a00640 1 -- 172.21.15.31:0/3970889294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95400d28e0 msgr2=0x7f95400b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9544a00640 1 --2- 172.21.15.31:0/3970889294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95400d28e0 0x7f95400b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9544a00640 1 -- 172.21.15.31:0/3970889294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95400cdb30 msgr2=0x7f95400c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9544a00640 1 --2- 172.21.15.31:0/3970889294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95400cdb30 0x7f95400c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9544a00640 1 -- 172.21.15.31:0/3970889294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95401483c0 con 0x7f954015bea0 2024-09-17T05:37:20.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f953fe00640 1 --2- 172.21.15.31:0/3970889294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95400cdb30 0x7f95400c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:20.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9544a00640 1 --2- 172.21.15.31:0/3970889294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f954015bea0 0x7f954006ed80 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f9538009bd0 tx=0x7f9538003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:20.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f953cc00640 1 -- 172.21.15.31:0/3970889294 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95380bb070 con 0x7f954015bea0 2024-09-17T05:37:20.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f953cc00640 1 -- 172.21.15.31:0/3970889294 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9538004e00 con 0x7f954015bea0 2024-09-17T05:37:20.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f953cc00640 1 -- 172.21.15.31:0/3970889294 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95380b2040 con 0x7f954015bea0 2024-09-17T05:37:20.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9546a00640 1 -- 172.21.15.31:0/3970889294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95401486a0 con 0x7f954015bea0 2024-09-17T05:37:20.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9546a00640 1 -- 172.21.15.31:0/3970889294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9540148c60 con 0x7f954015bea0 2024-09-17T05:37:20.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.352+0000 7f9546a00640 1 -- 172.21.15.31:0/3970889294 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95400cc9d0 con 0x7f954015bea0 2024-09-17T05:37:20.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.356+0000 7f953cc00640 1 -- 172.21.15.31:0/3970889294 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f95380a5c10 con 0x7f954015bea0 2024-09-17T05:37:20.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.356+0000 7f953cc00640 1 --2- 172.21.15.31:0/3970889294 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f951c073dd0 0x7f951c076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.356+0000 7f953cc00640 1 -- 172.21.15.31:0/3970889294 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f953812cd60 con 0x7f954015bea0 2024-09-17T05:37:20.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.356+0000 7f953fe00640 1 --2- 172.21.15.31:0/3970889294 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f951c073dd0 0x7f951c076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.356+0000 7f953fe00640 1 --2- 172.21.15.31:0/3970889294 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f951c073dd0 0x7f951c076290 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f953000bbd0 tx=0x7f953000b5b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:20.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.360+0000 7f953cc00640 1 -- 172.21.15.31:0/3970889294 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f9538016970 con 0x7f954015bea0 2024-09-17T05:37:20.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.532+0000 7f9546a00640 1 -- 172.21.15.31:0/3970889294 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f9540148170 con 0x7f951c073dd0 2024-09-17T05:37:20.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.536+0000 7f953cc00640 1 -- 172.21.15.31:0/3970889294 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9540148170 con 0x7f951c073dd0 2024-09-17T05:37:20.537 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 5 to deep-scrub 2024-09-17T05:37:20.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.536+0000 7f9546a00640 1 -- 172.21.15.31:0/3970889294 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f951c073dd0 msgr2=0x7f951c076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.536+0000 7f9546a00640 1 --2- 172.21.15.31:0/3970889294 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f951c073dd0 0x7f951c076290 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f953000bbd0 tx=0x7f953000b5b0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.536+0000 7f9546a00640 1 -- 172.21.15.31:0/3970889294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f954015bea0 msgr2=0x7f954006ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.536+0000 7f9546a00640 1 --2- 172.21.15.31:0/3970889294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f954015bea0 0x7f954006ed80 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f9538009bd0 tx=0x7f9538003f60 comp rx=0 tx=0).stop 2024-09-17T05:37:20.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.536+0000 7f9546a00640 1 -- 172.21.15.31:0/3970889294 shutdown_connections 2024-09-17T05:37:20.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.536+0000 7f9546a00640 1 --2- 172.21.15.31:0/3970889294 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f951c073dd0 0x7f951c076290 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.536+0000 7f9546a00640 1 --2- 172.21.15.31:0/3970889294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f954015bea0 0x7f954006ed80 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.536+0000 7f9546a00640 1 --2- 172.21.15.31:0/3970889294 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95400d28e0 0x7f95400b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.536+0000 7f9546a00640 1 --2- 172.21.15.31:0/3970889294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95400cdb30 0x7f95400c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.536+0000 7f9546a00640 1 -- 172.21.15.31:0/3970889294 >> 172.21.15.31:0/3970889294 conn(0x7f95400d1dc0 msgr2=0x7f95400b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:20.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.536+0000 7f9546a00640 1 -- 172.21.15.31:0/3970889294 shutdown_connections 2024-09-17T05:37:20.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.536+0000 7f9546a00640 1 -- 172.21.15.31:0/3970889294 wait complete. 2024-09-17T05:37:20.557 INFO:tasks.ceph:Scrubbing osd.6 2024-09-17T05:37:20.557 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:37:20.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.708+0000 7fd499e00640 1 -- 172.21.15.31:0/2806439776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd49415be10 msgr2=0x7fd4940ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.708+0000 7fd499e00640 1 --2- 172.21.15.31:0/2806439776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd49415be10 0x7fd4940ce700 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd484009870 tx=0x7fd48401ef70 comp rx=0 tx=0).stop 2024-09-17T05:37:20.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.708+0000 7fd499e00640 1 -- 172.21.15.31:0/2806439776 shutdown_connections 2024-09-17T05:37:20.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.708+0000 7fd499e00640 1 --2- 172.21.15.31:0/2806439776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd49415be10 0x7fd4940ce700 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.708+0000 7fd499e00640 1 -- 172.21.15.31:0/2806439776 >> 172.21.15.31:0/2806439776 conn(0x7fd4940d1da0 msgr2=0x7fd4940d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:20.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.708+0000 7fd499e00640 1 -- 172.21.15.31:0/2806439776 shutdown_connections 2024-09-17T05:37:20.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.708+0000 7fd499e00640 1 -- 172.21.15.31:0/2806439776 wait complete. 2024-09-17T05:37:20.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.708+0000 7fd499e00640 1 Processor -- start 2024-09-17T05:37:20.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.708+0000 7fd499e00640 1 -- start start 2024-09-17T05:37:20.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.708+0000 7fd499e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4940b0b60 0x7fd4941522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.708+0000 7fd499e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd49415be10 0x7fd49415adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.708+0000 7fd499e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd49415c1f0 0x7fd4940c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.708+0000 7fd499e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd4940cd670 con 0x7fd49415c1f0 2024-09-17T05:37:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.708+0000 7fd499e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd4940cd4f0 con 0x7fd4940b0b60 2024-09-17T05:37:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.708+0000 7fd499e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd4940cd7f0 con 0x7fd49415be10 2024-09-17T05:37:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.708+0000 7fd493400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd49415c1f0 0x7fd4940c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.708+0000 7fd493400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd49415c1f0 0x7fd4940c78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46366/0 (socket says 172.21.15.31:46366) 2024-09-17T05:37:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.708+0000 7fd493400640 1 -- 172.21.15.31:0/4077257376 learned_addr learned my addr 172.21.15.31:0/4077257376 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.712+0000 7fd48be00640 1 --2- 172.21.15.31:0/4077257376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd49415be10 0x7fd49415adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.712+0000 7fd492a00640 1 --2- 172.21.15.31:0/4077257376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4940b0b60 0x7fd4941522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.712+0000 7fd493400640 1 -- 172.21.15.31:0/4077257376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd49415be10 msgr2=0x7fd49415adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.712+0000 7fd493400640 1 --2- 172.21.15.31:0/4077257376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd49415be10 0x7fd49415adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.712+0000 7fd493400640 1 -- 172.21.15.31:0/4077257376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4940b0b60 msgr2=0x7fd4941522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.712+0000 7fd493400640 1 --2- 172.21.15.31:0/4077257376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4940b0b60 0x7fd4941522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.712+0000 7fd493400640 1 -- 172.21.15.31:0/4077257376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4940c8fa0 con 0x7fd49415c1f0 2024-09-17T05:37:20.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.712+0000 7fd493400640 1 --2- 172.21.15.31:0/4077257376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd49415c1f0 0x7fd4940c78e0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fd48c00cfd0 tx=0x7fd48c002000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:20.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.712+0000 7fd48b400640 1 -- 172.21.15.31:0/4077257376 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48c016020 con 0x7fd49415c1f0 2024-09-17T05:37:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.712+0000 7fd48b400640 1 -- 172.21.15.31:0/4077257376 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd48c00ab40 con 0x7fd49415c1f0 2024-09-17T05:37:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.712+0000 7fd499e00640 1 -- 172.21.15.31:0/4077257376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4940c9280 con 0x7fd49415c1f0 2024-09-17T05:37:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.712+0000 7fd48b400640 1 -- 172.21.15.31:0/4077257376 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48c012420 con 0x7fd49415c1f0 2024-09-17T05:37:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.712+0000 7fd499e00640 1 -- 172.21.15.31:0/4077257376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4940c9840 con 0x7fd49415c1f0 2024-09-17T05:37:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.712+0000 7fd499e00640 1 -- 172.21.15.31:0/4077257376 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd4940cdce0 con 0x7fd49415c1f0 2024-09-17T05:37:20.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.712+0000 7fd48b400640 1 -- 172.21.15.31:0/4077257376 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7fd48c019020 con 0x7fd49415c1f0 2024-09-17T05:37:20.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.712+0000 7fd48b400640 1 --2- 172.21.15.31:0/4077257376 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd470073dd0 0x7fd470076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.712+0000 7fd48b400640 1 -- 172.21.15.31:0/4077257376 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7fd48c093880 con 0x7fd49415c1f0 2024-09-17T05:37:20.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.716+0000 7fd492a00640 1 --2- 172.21.15.31:0/4077257376 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd470073dd0 0x7fd470076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.716+0000 7fd48b400640 1 --2- 172.21.15.31:0/4077257376 >> [v2:172.21.15.155:6818/1112531135,v1:172.21.15.155:6819/1112531135] conn(0x7fd470079c90 0x7fd47007c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.716+0000 7fd48b400640 1 -- 172.21.15.31:0/4077257376 --> [v2:172.21.15.155:6818/1112531135,v1:172.21.15.155:6819/1112531135] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd48c019ec0 con 0x7fd470079c90 2024-09-17T05:37:20.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.716+0000 7fd48b400640 1 -- 172.21.15.31:0/4077257376 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=166) ==== 24+0+0 (secure 0 0 0) 0x7fd48c0960e0 con 0x7fd49415c1f0 2024-09-17T05:37:20.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.716+0000 7fd48be00640 1 --2- 172.21.15.31:0/4077257376 >> [v2:172.21.15.155:6818/1112531135,v1:172.21.15.155:6819/1112531135] conn(0x7fd470079c90 0x7fd47007c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.716+0000 7fd492a00640 1 --2- 172.21.15.31:0/4077257376 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd470073dd0 0x7fd470076290 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd4840b2000 tx=0x7fd48401d7b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:20.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.716+0000 7fd48be00640 1 --2- 172.21.15.31:0/4077257376 >> [v2:172.21.15.155:6818/1112531135,v1:172.21.15.155:6819/1112531135] conn(0x7fd470079c90 0x7fd47007c0b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:20.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.716+0000 7fd48b400640 1 -- 172.21.15.31:0/4077257376 <== osd.6 v2:172.21.15.155:6818/1112531135 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd48c019ec0 con 0x7fd470079c90 2024-09-17T05:37:20.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.728+0000 7fd499e00640 1 -- 172.21.15.31:0/4077257376 --> [v2:172.21.15.155:6818/1112531135,v1:172.21.15.155:6819/1112531135] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd494070350 con 0x7fd470079c90 2024-09-17T05:37:20.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.732+0000 7fd48b400640 1 -- 172.21.15.31:0/4077257376 <== osd.6 v2:172.21.15.155:6818/1112531135 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd494070350 con 0x7fd470079c90 2024-09-17T05:37:20.732 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:37:20.733 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:37:20.733 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:37:20.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.732+0000 7fd499e00640 1 -- 172.21.15.31:0/4077257376 >> [v2:172.21.15.155:6818/1112531135,v1:172.21.15.155:6819/1112531135] conn(0x7fd470079c90 msgr2=0x7fd47007c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.732+0000 7fd499e00640 1 --2- 172.21.15.31:0/4077257376 >> [v2:172.21.15.155:6818/1112531135,v1:172.21.15.155:6819/1112531135] conn(0x7fd470079c90 0x7fd47007c0b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.732+0000 7fd499e00640 1 -- 172.21.15.31:0/4077257376 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd470073dd0 msgr2=0x7fd470076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.732+0000 7fd499e00640 1 --2- 172.21.15.31:0/4077257376 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fd470073dd0 0x7fd470076290 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd4840b2000 tx=0x7fd48401d7b0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.732+0000 7fd499e00640 1 -- 172.21.15.31:0/4077257376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd49415c1f0 msgr2=0x7fd4940c78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.732+0000 7fd499e00640 1 --2- 172.21.15.31:0/4077257376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd49415c1f0 0x7fd4940c78e0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fd48c00cfd0 tx=0x7fd48c002000 comp rx=0 tx=0).stop 2024-09-17T05:37:20.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.732+0000 7fd493400640 1 -- 172.21.15.31:0/4077257376 reap_dead start 2024-09-17T05:37:20.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.732+0000 7fd499e00640 1 -- 172.21.15.31:0/4077257376 shutdown_connections 2024-09-17T05:37:20.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.732+0000 7fd499e00640 1 -- 172.21.15.31:0/4077257376 >> 172.21.15.31:0/4077257376 conn(0x7fd4940d1da0 msgr2=0x7fd4940ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:20.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.732+0000 7fd499e00640 1 -- 172.21.15.31:0/4077257376 shutdown_connections 2024-09-17T05:37:20.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.732+0000 7fd499e00640 1 -- 172.21.15.31:0/4077257376 wait complete. 2024-09-17T05:37:20.750 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-17T05:37:20.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.896+0000 7f44a6a00640 1 -- 172.21.15.31:0/3011629978 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4484003a40 msgr2=0x7f4484003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.896+0000 7f44a6a00640 1 --2- 172.21.15.31:0/3011629978 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4484003a40 0x7f4484003e60 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f449000c2e0 tx=0x7f449001cf60 comp rx=0 tx=0).stop 2024-09-17T05:37:20.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.896+0000 7f44a4a00640 1 -- 172.21.15.31:0/3011629978 reap_dead start 2024-09-17T05:37:20.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.896+0000 7f44a6a00640 1 -- 172.21.15.31:0/3011629978 shutdown_connections 2024-09-17T05:37:20.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.896+0000 7f44a6a00640 1 -- 172.21.15.31:0/3011629978 >> 172.21.15.31:0/3011629978 conn(0x7f44a00d1ea0 msgr2=0x7f44a00d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:20.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.896+0000 7f44a6a00640 1 -- 172.21.15.31:0/3011629978 shutdown_connections 2024-09-17T05:37:20.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.896+0000 7f44a6a00640 1 -- 172.21.15.31:0/3011629978 wait complete. 2024-09-17T05:37:20.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f44a6a00640 1 Processor -- start 2024-09-17T05:37:20.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f44a6a00640 1 -- start start 2024-09-17T05:37:20.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f44a6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4484003a40 0x7f44a00b7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f44a6a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44a0071b10 0x7f44a00b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f44a6a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44a0071f70 0x7f44a00c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f44a6a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f44a0168280 con 0x7f4484003a40 2024-09-17T05:37:20.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f44a6a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f44a0168100 con 0x7f44a0071b10 2024-09-17T05:37:20.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f44a6a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f44a0168400 con 0x7f44a0071f70 2024-09-17T05:37:20.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f449fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4484003a40 0x7f44a00b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f449fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4484003a40 0x7f44a00b7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46396/0 (socket says 172.21.15.31:46396) 2024-09-17T05:37:20.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f449fe00640 1 -- 172.21.15.31:0/2894164112 learned_addr learned my addr 172.21.15.31:0/2894164112 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:20.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f4497400640 1 --2- 172.21.15.31:0/2894164112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44a0071b10 0x7f44a00b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f44a4a00640 1 --2- 172.21.15.31:0/2894164112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44a0071f70 0x7f44a00c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f449fe00640 1 -- 172.21.15.31:0/2894164112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44a0071f70 msgr2=0x7f44a00c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f449fe00640 1 --2- 172.21.15.31:0/2894164112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44a0071f70 0x7f44a00c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f449fe00640 1 -- 172.21.15.31:0/2894164112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44a0071b10 msgr2=0x7f44a00b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:20.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f449fe00640 1 --2- 172.21.15.31:0/2894164112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44a0071b10 0x7f44a00b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:20.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f449fe00640 1 -- 172.21.15.31:0/2894164112 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a00b64c0 con 0x7f4484003a40 2024-09-17T05:37:20.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f449fe00640 1 --2- 172.21.15.31:0/2894164112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4484003a40 0x7f44a00b7450 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f449001b660 tx=0x7f4490004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:20.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f449cc00640 1 -- 172.21.15.31:0/2894164112 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490006ca0 con 0x7f4484003a40 2024-09-17T05:37:20.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f449cc00640 1 -- 172.21.15.31:0/2894164112 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4490006090 con 0x7f4484003a40 2024-09-17T05:37:20.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f449cc00640 1 -- 172.21.15.31:0/2894164112 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490004e60 con 0x7f4484003a40 2024-09-17T05:37:20.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f44a6a00640 1 -- 172.21.15.31:0/2894164112 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a00b67a0 con 0x7f4484003a40 2024-09-17T05:37:20.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f44a6a00640 1 -- 172.21.15.31:0/2894164112 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a00b4fb0 con 0x7f4484003a40 2024-09-17T05:37:20.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.900+0000 7f44a6a00640 1 -- 172.21.15.31:0/2894164112 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a00ce5e0 con 0x7f4484003a40 2024-09-17T05:37:20.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.904+0000 7f449cc00640 1 -- 172.21.15.31:0/2894164112 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f44900c1390 con 0x7f4484003a40 2024-09-17T05:37:20.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.904+0000 7f449cc00640 1 --2- 172.21.15.31:0/2894164112 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f447c073dd0 0x7f447c076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:20.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.904+0000 7f449cc00640 1 -- 172.21.15.31:0/2894164112 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f449012d540 con 0x7f4484003a40 2024-09-17T05:37:20.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.904+0000 7f4497400640 1 --2- 172.21.15.31:0/2894164112 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f447c073dd0 0x7f447c076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:20.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.904+0000 7f4497400640 1 --2- 172.21.15.31:0/2894164112 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f447c073dd0 0x7f447c076290 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f44a00b6320 tx=0x7f44880091e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:20.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:20.908+0000 7f449cc00640 1 -- 172.21.15.31:0/2894164112 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f4490016d10 con 0x7f4484003a40 2024-09-17T05:37:21.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.080+0000 7f44a6a00640 1 -- 172.21.15.31:0/2894164112 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f44a00b6970 con 0x7f447c073dd0 2024-09-17T05:37:21.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.084+0000 7f449cc00640 1 -- 172.21.15.31:0/2894164112 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f44a00b6970 con 0x7f447c073dd0 2024-09-17T05:37:21.084 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 6 to deep-scrub 2024-09-17T05:37:21.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.084+0000 7f44a6a00640 1 -- 172.21.15.31:0/2894164112 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f447c073dd0 msgr2=0x7f447c076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:21.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.084+0000 7f44a6a00640 1 --2- 172.21.15.31:0/2894164112 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f447c073dd0 0x7f447c076290 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f44a00b6320 tx=0x7f44880091e0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.084+0000 7f44a6a00640 1 -- 172.21.15.31:0/2894164112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4484003a40 msgr2=0x7f44a00b7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:21.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.084+0000 7f44a6a00640 1 --2- 172.21.15.31:0/2894164112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4484003a40 0x7f44a00b7450 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f449001b660 tx=0x7f4490004c70 comp rx=0 tx=0).stop 2024-09-17T05:37:21.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.084+0000 7f44a6a00640 1 -- 172.21.15.31:0/2894164112 shutdown_connections 2024-09-17T05:37:21.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.084+0000 7f44a6a00640 1 --2- 172.21.15.31:0/2894164112 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f447c073dd0 0x7f447c076290 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.084+0000 7f44a6a00640 1 --2- 172.21.15.31:0/2894164112 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44a0071f70 0x7f44a00c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.084+0000 7f44a6a00640 1 --2- 172.21.15.31:0/2894164112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44a0071b10 0x7f44a00b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.084+0000 7f44a6a00640 1 --2- 172.21.15.31:0/2894164112 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4484003a40 0x7f44a00b7450 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.084+0000 7f44a6a00640 1 -- 172.21.15.31:0/2894164112 >> 172.21.15.31:0/2894164112 conn(0x7f44a00d1ea0 msgr2=0x7f44a00cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:21.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.084+0000 7f44a6a00640 1 -- 172.21.15.31:0/2894164112 shutdown_connections 2024-09-17T05:37:21.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.084+0000 7f44a6a00640 1 -- 172.21.15.31:0/2894164112 wait complete. 2024-09-17T05:37:21.106 INFO:tasks.ceph:Scrubbing osd.7 2024-09-17T05:37:21.106 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:37:21.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff1b200640 1 -- 172.21.15.31:0/1141511672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff1415a9d0 msgr2=0x7eff140ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:21.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff1b200640 1 --2- 172.21.15.31:0/1141511672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff1415a9d0 0x7eff140ce350 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7eff14072800 tx=0x7efefc01c800 comp rx=0 tx=0).stop 2024-09-17T05:37:21.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff1b200640 1 -- 172.21.15.31:0/1141511672 shutdown_connections 2024-09-17T05:37:21.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff1b200640 1 --2- 172.21.15.31:0/1141511672 >> v2:172.21.15.155:3300/0 conn(0x7eff140ce890 0x7eff1406eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff1b200640 1 --2- 172.21.15.31:0/1141511672 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff1415a9d0 0x7eff140ce350 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff1b200640 1 -- 172.21.15.31:0/1141511672 >> 172.21.15.31:0/1141511672 conn(0x7eff140cfbc0 msgr2=0x7eff140cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:21.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff1b200640 1 -- 172.21.15.31:0/1141511672 shutdown_connections 2024-09-17T05:37:21.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff1b200640 1 -- 172.21.15.31:0/1141511672 wait complete. 2024-09-17T05:37:21.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff1b200640 1 Processor -- start 2024-09-17T05:37:21.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff1b200640 1 -- start start 2024-09-17T05:37:21.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff1b200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff140734f0 0x7eff1414ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:21.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff1b200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff140ce890 0x7eff140b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:21.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff1b200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff1415a9d0 0x7eff1414a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:21.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff1b200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7eff1406fac0 con 0x7eff140ce890 2024-09-17T05:37:21.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff1b200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7eff1406f940 con 0x7eff140734f0 2024-09-17T05:37:21.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff1b200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7eff1406fc40 con 0x7eff1415a9d0 2024-09-17T05:37:21.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff0be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff140ce890 0x7eff140b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:21.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff0be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff140ce890 0x7eff140b2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46412/0 (socket says 172.21.15.31:46412) 2024-09-17T05:37:21.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff0be00640 1 -- 172.21.15.31:0/2480124291 learned_addr learned my addr 172.21.15.31:0/2480124291 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:21.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff19200640 1 --2- 172.21.15.31:0/2480124291 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff1415a9d0 0x7eff1414a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:21.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff13e00640 1 --2- 172.21.15.31:0/2480124291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff140734f0 0x7eff1414ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:21.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff0be00640 1 -- 172.21.15.31:0/2480124291 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff1415a9d0 msgr2=0x7eff1414a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:21.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.256+0000 7eff0be00640 1 --2- 172.21.15.31:0/2480124291 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff1415a9d0 0x7eff1414a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.260+0000 7eff0be00640 1 -- 172.21.15.31:0/2480124291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff140734f0 msgr2=0x7eff1414ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:21.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.260+0000 7eff0be00640 1 --2- 172.21.15.31:0/2480124291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff140734f0 0x7eff1414ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.260+0000 7eff0be00640 1 -- 172.21.15.31:0/2480124291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff140b3600 con 0x7eff140ce890 2024-09-17T05:37:21.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.260+0000 7eff13e00640 1 --2- 172.21.15.31:0/2480124291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff140734f0 0x7eff1414ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:21.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.260+0000 7eff0be00640 1 --2- 172.21.15.31:0/2480124291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff140ce890 0x7eff140b2e00 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7efefc000c10 tx=0x7efefc0a6600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:21.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.260+0000 7eff10c00640 1 -- 172.21.15.31:0/2480124291 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc004030 con 0x7eff140ce890 2024-09-17T05:37:21.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.260+0000 7eff10c00640 1 -- 172.21.15.31:0/2480124291 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efefc0041d0 con 0x7eff140ce890 2024-09-17T05:37:21.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.260+0000 7eff10c00640 1 -- 172.21.15.31:0/2480124291 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc005070 con 0x7eff140ce890 2024-09-17T05:37:21.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.260+0000 7eff1b200640 1 -- 172.21.15.31:0/2480124291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff141fbf40 con 0x7eff140ce890 2024-09-17T05:37:21.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.260+0000 7eff1b200640 1 -- 172.21.15.31:0/2480124291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff140b5300 con 0x7eff140ce890 2024-09-17T05:37:21.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.260+0000 7eff1b200640 1 -- 172.21.15.31:0/2480124291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff1406eb40 con 0x7eff140ce890 2024-09-17T05:37:21.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.260+0000 7eff10c00640 1 -- 172.21.15.31:0/2480124291 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7efefc0a67f0 con 0x7eff140ce890 2024-09-17T05:37:21.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.260+0000 7eff10c00640 1 --2- 172.21.15.31:0/2480124291 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efef0073dd0 0x7efef0076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:21.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.264+0000 7eff10c00640 1 -- 172.21.15.31:0/2480124291 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7efefc12d0e0 con 0x7eff140ce890 2024-09-17T05:37:21.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.264+0000 7eff13e00640 1 --2- 172.21.15.31:0/2480124291 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efef0073dd0 0x7efef0076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:21.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.264+0000 7eff10c00640 1 --2- 172.21.15.31:0/2480124291 >> [v2:172.21.15.155:6826/4001062257,v1:172.21.15.155:6827/4001062257] conn(0x7efef0079c90 0x7efef007c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:21.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.264+0000 7eff10c00640 1 -- 172.21.15.31:0/2480124291 --> [v2:172.21.15.155:6826/4001062257,v1:172.21.15.155:6827/4001062257] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efefc0aaec0 con 0x7efef0079c90 2024-09-17T05:37:21.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.264+0000 7eff10c00640 1 -- 172.21.15.31:0/2480124291 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=166) ==== 24+0+0 (secure 0 0 0) 0x7efefc12f950 con 0x7eff140ce890 2024-09-17T05:37:21.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.264+0000 7eff13e00640 1 --2- 172.21.15.31:0/2480124291 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efef0073dd0 0x7efef0076290 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7eff04007a60 tx=0x7eff04009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:21.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.264+0000 7eff19200640 1 --2- 172.21.15.31:0/2480124291 >> [v2:172.21.15.155:6826/4001062257,v1:172.21.15.155:6827/4001062257] conn(0x7efef0079c90 0x7efef007c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:21.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.264+0000 7eff19200640 1 --2- 172.21.15.31:0/2480124291 >> [v2:172.21.15.155:6826/4001062257,v1:172.21.15.155:6827/4001062257] conn(0x7efef0079c90 0x7efef007c0b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:21.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.264+0000 7eff10c00640 1 -- 172.21.15.31:0/2480124291 <== osd.7 v2:172.21.15.155:6826/4001062257 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efefc0aaec0 con 0x7efef0079c90 2024-09-17T05:37:21.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.276+0000 7eff1b200640 1 -- 172.21.15.31:0/2480124291 --> [v2:172.21.15.155:6826/4001062257,v1:172.21.15.155:6827/4001062257] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7eff140b33e0 con 0x7efef0079c90 2024-09-17T05:37:21.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.280+0000 7eff10c00640 1 -- 172.21.15.31:0/2480124291 <== osd.7 v2:172.21.15.155:6826/4001062257 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7eff140b33e0 con 0x7efef0079c90 2024-09-17T05:37:21.281 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-17T05:37:21.281 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:37:21.281 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-17T05:37:21.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.280+0000 7eff1b200640 1 -- 172.21.15.31:0/2480124291 >> [v2:172.21.15.155:6826/4001062257,v1:172.21.15.155:6827/4001062257] conn(0x7efef0079c90 msgr2=0x7efef007c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:21.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.280+0000 7eff1b200640 1 --2- 172.21.15.31:0/2480124291 >> [v2:172.21.15.155:6826/4001062257,v1:172.21.15.155:6827/4001062257] conn(0x7efef0079c90 0x7efef007c0b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.280+0000 7eff1b200640 1 -- 172.21.15.31:0/2480124291 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efef0073dd0 msgr2=0x7efef0076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:21.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.280+0000 7eff1b200640 1 --2- 172.21.15.31:0/2480124291 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7efef0073dd0 0x7efef0076290 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7eff04007a60 tx=0x7eff04009040 comp rx=0 tx=0).stop 2024-09-17T05:37:21.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.280+0000 7eff1b200640 1 -- 172.21.15.31:0/2480124291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff140ce890 msgr2=0x7eff140b2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:21.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.280+0000 7eff1b200640 1 --2- 172.21.15.31:0/2480124291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff140ce890 0x7eff140b2e00 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7efefc000c10 tx=0x7efefc0a6600 comp rx=0 tx=0).stop 2024-09-17T05:37:21.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.280+0000 7eff19200640 1 -- 172.21.15.31:0/2480124291 reap_dead start 2024-09-17T05:37:21.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.280+0000 7eff1b200640 1 -- 172.21.15.31:0/2480124291 shutdown_connections 2024-09-17T05:37:21.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.280+0000 7eff1b200640 1 -- 172.21.15.31:0/2480124291 >> 172.21.15.31:0/2480124291 conn(0x7eff140cfbc0 msgr2=0x7eff1414c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:21.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.280+0000 7eff1b200640 1 -- 172.21.15.31:0/2480124291 shutdown_connections 2024-09-17T05:37:21.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.280+0000 7eff1b200640 1 -- 172.21.15.31:0/2480124291 wait complete. 2024-09-17T05:37:21.299 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-17T05:37:21.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.444+0000 7faed9600640 1 -- 172.21.15.31:0/2921183803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed40b49e0 msgr2=0x7faed40acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:21.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.444+0000 7faed9600640 1 --2- 172.21.15.31:0/2921183803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed40b49e0 0x7faed40acd40 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7faecc00ad90 tx=0x7faecc01dc20 comp rx=0 tx=0).stop 2024-09-17T05:37:21.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.444+0000 7faed9600640 1 -- 172.21.15.31:0/2921183803 shutdown_connections 2024-09-17T05:37:21.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.444+0000 7faed9600640 1 --2- 172.21.15.31:0/2921183803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed40b49e0 0x7faed40acd40 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.444+0000 7faed9600640 1 --2- 172.21.15.31:0/2921183803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faed40cd100 0x7faed406f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.444+0000 7faed9600640 1 -- 172.21.15.31:0/2921183803 >> 172.21.15.31:0/2921183803 conn(0x7faed40b18f0 msgr2=0x7faed40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:21.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.444+0000 7faed9600640 1 -- 172.21.15.31:0/2921183803 shutdown_connections 2024-09-17T05:37:21.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.444+0000 7faed9600640 1 -- 172.21.15.31:0/2921183803 wait complete. 2024-09-17T05:37:21.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.444+0000 7faed9600640 1 Processor -- start 2024-09-17T05:37:21.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.444+0000 7faed9600640 1 -- start start 2024-09-17T05:37:21.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed9600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faed40b49e0 0x7faed409aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:21.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed9600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faed40cd100 0x7faed41586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:21.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed9600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed415dae0 0x7faed409cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:21.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed9600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7faed40cf1a0 con 0x7faed415dae0 2024-09-17T05:37:21.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed9600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faed40cf020 con 0x7faed40b49e0 2024-09-17T05:37:21.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed9600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7faed40cf320 con 0x7faed40cd100 2024-09-17T05:37:21.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed415dae0 0x7faed409cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:21.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed415dae0 0x7faed409cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46444/0 (socket says 172.21.15.31:46444) 2024-09-17T05:37:21.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed2a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faed40b49e0 0x7faed409aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:21.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed3400640 1 -- 172.21.15.31:0/3461496459 learned_addr learned my addr 172.21.15.31:0/3461496459 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:21.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faecbe00640 1 --2- 172.21.15.31:0/3461496459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faed40cd100 0x7faed41586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:21.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed3400640 1 -- 172.21.15.31:0/3461496459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faed40cd100 msgr2=0x7faed41586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:21.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed3400640 1 --2- 172.21.15.31:0/3461496459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faed40cd100 0x7faed41586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed3400640 1 -- 172.21.15.31:0/3461496459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faed40b49e0 msgr2=0x7faed409aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:21.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed3400640 1 --2- 172.21.15.31:0/3461496459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faed40b49e0 0x7faed409aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed3400640 1 -- 172.21.15.31:0/3461496459 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed41f85b0 con 0x7faed415dae0 2024-09-17T05:37:21.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faecbe00640 1 --2- 172.21.15.31:0/3461496459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faed40cd100 0x7faed41586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:21.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed3400640 1 --2- 172.21.15.31:0/3461496459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed415dae0 0x7faed409cdb0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7faecc00ace0 tx=0x7faecc00a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:21.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faecaa00640 1 -- 172.21.15.31:0/3461496459 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc0bb020 con 0x7faed415dae0 2024-09-17T05:37:21.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faecaa00640 1 -- 172.21.15.31:0/3461496459 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faecc004c00 con 0x7faed415dae0 2024-09-17T05:37:21.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faecaa00640 1 -- 172.21.15.31:0/3461496459 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc0b3040 con 0x7faed415dae0 2024-09-17T05:37:21.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed9600640 1 -- 172.21.15.31:0/3461496459 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed41f8890 con 0x7faed415dae0 2024-09-17T05:37:21.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed9600640 1 -- 172.21.15.31:0/3461496459 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed4162730 con 0x7faed415dae0 2024-09-17T05:37:21.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.448+0000 7faed9600640 1 -- 172.21.15.31:0/3461496459 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faed4069410 con 0x7faed415dae0 2024-09-17T05:37:21.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.452+0000 7faecaa00640 1 -- 172.21.15.31:0/3461496459 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7faecc004000 con 0x7faed415dae0 2024-09-17T05:37:21.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.452+0000 7faecaa00640 1 --2- 172.21.15.31:0/3461496459 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7faeb0073dd0 0x7faeb0076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:21.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.452+0000 7faecaa00640 1 -- 172.21.15.31:0/3461496459 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7faecc12d3e0 con 0x7faed415dae0 2024-09-17T05:37:21.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.452+0000 7faed2a00640 1 --2- 172.21.15.31:0/3461496459 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7faeb0073dd0 0x7faeb0076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:21.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.452+0000 7faed2a00640 1 --2- 172.21.15.31:0/3461496459 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7faeb0073dd0 0x7faeb0076290 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7faec4007fd0 tx=0x7faec4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:21.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.456+0000 7faecaa00640 1 -- 172.21.15.31:0/3461496459 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7faecc0c5020 con 0x7faed415dae0 2024-09-17T05:37:21.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.628+0000 7faed9600640 1 -- 172.21.15.31:0/3461496459 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7faed40acd40 con 0x7faeb0073dd0 2024-09-17T05:37:21.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.628+0000 7faecaa00640 1 -- 172.21.15.31:0/3461496459 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faed40acd40 con 0x7faeb0073dd0 2024-09-17T05:37:21.632 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 7 to deep-scrub 2024-09-17T05:37:21.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.632+0000 7faed9600640 1 -- 172.21.15.31:0/3461496459 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7faeb0073dd0 msgr2=0x7faeb0076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:21.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.632+0000 7faed9600640 1 --2- 172.21.15.31:0/3461496459 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7faeb0073dd0 0x7faeb0076290 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7faec4007fd0 tx=0x7faec4009040 comp rx=0 tx=0).stop 2024-09-17T05:37:21.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.632+0000 7faed9600640 1 -- 172.21.15.31:0/3461496459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed415dae0 msgr2=0x7faed409cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:21.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.632+0000 7faed9600640 1 --2- 172.21.15.31:0/3461496459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed415dae0 0x7faed409cdb0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7faecc00ace0 tx=0x7faecc00a4a0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.632+0000 7faed9600640 1 -- 172.21.15.31:0/3461496459 shutdown_connections 2024-09-17T05:37:21.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.632+0000 7faed9600640 1 --2- 172.21.15.31:0/3461496459 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7faeb0073dd0 0x7faeb0076290 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.632+0000 7faed9600640 1 --2- 172.21.15.31:0/3461496459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7faed415dae0 0x7faed409cdb0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.632+0000 7faed9600640 1 --2- 172.21.15.31:0/3461496459 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faed40cd100 0x7faed41586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.632+0000 7faed9600640 1 --2- 172.21.15.31:0/3461496459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faed40b49e0 0x7faed409aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.632+0000 7faed9600640 1 -- 172.21.15.31:0/3461496459 >> 172.21.15.31:0/3461496459 conn(0x7faed40b18f0 msgr2=0x7faed4159920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:21.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.632+0000 7faed9600640 1 -- 172.21.15.31:0/3461496459 shutdown_connections 2024-09-17T05:37:21.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.632+0000 7faed9600640 1 -- 172.21.15.31:0/3461496459 wait complete. 2024-09-17T05:37:21.653 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:37:21.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf68e00640 1 -- 172.21.15.31:0/3673028968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf6415bea0 msgr2=0x7fbf640ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:21.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf68e00640 1 --2- 172.21.15.31:0/3673028968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf6415bea0 0x7fbf640ce670 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fbf64073d10 tx=0x7fbf5401c770 comp rx=0 tx=0).stop 2024-09-17T05:37:21.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf68e00640 1 -- 172.21.15.31:0/3673028968 shutdown_connections 2024-09-17T05:37:21.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf68e00640 1 --2- 172.21.15.31:0/3673028968 >> v2:172.21.15.155:3300/0 conn(0x7fbf640cdb30 0x7fbf640cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf68e00640 1 --2- 172.21.15.31:0/3673028968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf6415bea0 0x7fbf640ce670 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf68e00640 1 -- 172.21.15.31:0/3673028968 >> 172.21.15.31:0/3673028968 conn(0x7fbf640d1dc0 msgr2=0x7fbf640d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:21.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf68e00640 1 -- 172.21.15.31:0/3673028968 shutdown_connections 2024-09-17T05:37:21.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf68e00640 1 -- 172.21.15.31:0/3673028968 wait complete. 2024-09-17T05:37:21.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf68e00640 1 Processor -- start 2024-09-17T05:37:21.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf68e00640 1 -- start start 2024-09-17T05:37:21.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf68e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf640cdb30 0x7fbf64159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:21.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf68e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640d28e0 0x7fbf6414c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:21.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf68e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf6415bea0 0x7fbf640c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:21.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf68e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbf64168fc0 con 0x7fbf640d28e0 2024-09-17T05:37:21.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf68e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbf64168e40 con 0x7fbf6415bea0 2024-09-17T05:37:21.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf68e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbf64169140 con 0x7fbf640cdb30 2024-09-17T05:37:21.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf5be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640d28e0 0x7fbf6414c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:21.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf5be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640d28e0 0x7fbf6414c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46470/0 (socket says 172.21.15.31:46470) 2024-09-17T05:37:21.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.800+0000 7fbf5be00640 1 -- 172.21.15.31:0/1567805930 learned_addr learned my addr 172.21.15.31:0/1567805930 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:21.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.804+0000 7fbf5be00640 1 -- 172.21.15.31:0/1567805930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf640cdb30 msgr2=0x7fbf64159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:21.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.804+0000 7fbf61e00640 1 --2- 172.21.15.31:0/1567805930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf640cdb30 0x7fbf64159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:21.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.804+0000 7fbf62800640 1 --2- 172.21.15.31:0/1567805930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf6415bea0 0x7fbf640c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:21.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.804+0000 7fbf5be00640 1 --2- 172.21.15.31:0/1567805930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf640cdb30 0x7fbf64159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.804+0000 7fbf5be00640 1 -- 172.21.15.31:0/1567805930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf6415bea0 msgr2=0x7fbf640c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:21.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.804+0000 7fbf5be00640 1 --2- 172.21.15.31:0/1567805930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf6415bea0 0x7fbf640c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.804+0000 7fbf5be00640 1 -- 172.21.15.31:0/1567805930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf640c7c80 con 0x7fbf640d28e0 2024-09-17T05:37:21.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.804+0000 7fbf61e00640 1 --2- 172.21.15.31:0/1567805930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf640cdb30 0x7fbf64159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:21.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.804+0000 7fbf62800640 1 --2- 172.21.15.31:0/1567805930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf6415bea0 0x7fbf640c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:21.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.804+0000 7fbf5be00640 1 --2- 172.21.15.31:0/1567805930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640d28e0 0x7fbf6414c2f0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00d950 tx=0x7fbf4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:21.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.804+0000 7fbf5a000640 1 -- 172.21.15.31:0/1567805930 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c017070 con 0x7fbf640d28e0 2024-09-17T05:37:21.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.804+0000 7fbf5a000640 1 -- 172.21.15.31:0/1567805930 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf4c009d20 con 0x7fbf640d28e0 2024-09-17T05:37:21.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.804+0000 7fbf68e00640 1 -- 172.21.15.31:0/1567805930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf640c7ef0 con 0x7fbf640d28e0 2024-09-17T05:37:21.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.804+0000 7fbf5a000640 1 -- 172.21.15.31:0/1567805930 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c0106c0 con 0x7fbf640d28e0 2024-09-17T05:37:21.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.804+0000 7fbf68e00640 1 -- 172.21.15.31:0/1567805930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf640c84b0 con 0x7fbf640d28e0 2024-09-17T05:37:21.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.804+0000 7fbf68e00640 1 -- 172.21.15.31:0/1567805930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf640cc9d0 con 0x7fbf640d28e0 2024-09-17T05:37:21.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.804+0000 7fbf5a000640 1 -- 172.21.15.31:0/1567805930 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7fbf4c010860 con 0x7fbf640d28e0 2024-09-17T05:37:21.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.804+0000 7fbf5a000640 1 --2- 172.21.15.31:0/1567805930 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbf40073dd0 0x7fbf40076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:21.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.808+0000 7fbf5a000640 1 -- 172.21.15.31:0/1567805930 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7fbf4c093210 con 0x7fbf640d28e0 2024-09-17T05:37:21.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.808+0000 7fbf61e00640 1 --2- 172.21.15.31:0/1567805930 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbf40073dd0 0x7fbf40076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:21.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.808+0000 7fbf61e00640 1 --2- 172.21.15.31:0/1567805930 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbf40073dd0 0x7fbf40076290 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbf540af000 tx=0x7fbf5401afb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:21.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.808+0000 7fbf5a000640 1 -- 172.21.15.31:0/1567805930 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7fbf4c05fab0 con 0x7fbf640d28e0 2024-09-17T05:37:21.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.984+0000 7fbf68e00640 1 -- 172.21.15.31:0/1567805930 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf640b7890 con 0x7fbf40073dd0 2024-09-17T05:37:21.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.984+0000 7fbf5a000640 1 -- 172.21.15.31:0/1567805930 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13367 (secure 0 0 0) 0x7fbf640b7890 con 0x7fbf40073dd0 2024-09-17T05:37:21.986 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:37:21.986 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:37:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.984+0000 7fbf68e00640 1 -- 172.21.15.31:0/1567805930 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbf40073dd0 msgr2=0x7fbf40076290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.984+0000 7fbf68e00640 1 --2- 172.21.15.31:0/1567805930 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbf40073dd0 0x7fbf40076290 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbf540af000 tx=0x7fbf5401afb0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.984+0000 7fbf68e00640 1 -- 172.21.15.31:0/1567805930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640d28e0 msgr2=0x7fbf6414c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.984+0000 7fbf68e00640 1 --2- 172.21.15.31:0/1567805930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640d28e0 0x7fbf6414c2f0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00d950 tx=0x7fbf4c00de10 comp rx=0 tx=0).stop 2024-09-17T05:37:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.984+0000 7fbf68e00640 1 -- 172.21.15.31:0/1567805930 shutdown_connections 2024-09-17T05:37:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.984+0000 7fbf68e00640 1 --2- 172.21.15.31:0/1567805930 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7fbf40073dd0 0x7fbf40076290 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.984+0000 7fbf68e00640 1 --2- 172.21.15.31:0/1567805930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf6415bea0 0x7fbf640c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.984+0000 7fbf68e00640 1 --2- 172.21.15.31:0/1567805930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf640d28e0 0x7fbf6414c2f0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.984+0000 7fbf68e00640 1 --2- 172.21.15.31:0/1567805930 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbf640cdb30 0x7fbf64159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:21.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.984+0000 7fbf68e00640 1 -- 172.21.15.31:0/1567805930 >> 172.21.15.31:0/1567805930 conn(0x7fbf640d1dc0 msgr2=0x7fbf6415aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:21.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.984+0000 7fbf68e00640 1 -- 172.21.15.31:0/1567805930 shutdown_connections 2024-09-17T05:37:21.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:21.984+0000 7fbf68e00640 1 -- 172.21.15.31:0/1567805930 wait complete. 2024-09-17T05:37:22.008 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2024-09-17T05:37:20.760074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":271224,"kb_used_data":17544,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703496,"statfs":{"total":773094113280,"available":772816379904,"internally_reserved":0,"allocated":17965056,"data_stored":8567800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-4,"num_write_kb":-2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002094"},"pg_stats":[{"pgid":"1.0","version":"70'79","reported_seq":405,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T05:37:11.652439+0000","last_change":"2024-09-17T05:28:35.402786+0000","last_active":"2024-09-17T05:37:11.652439+0000","last_peered":"2024-09-17T05:37:11.652439+0000","last_clean":"2024-09-17T05:37:11.652439+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:37:11.652439+0000","last_undegraded":"2024-09-17T05:37:11.652439+0000","last_fullsized":"2024-09-17T05:37:11.652439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:28:33.567998+0000","last_clean_scrub_stamp":"2024-09-17T05:28:33.567998+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:39.080345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509548,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":2691072,"data_stored":1513751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509549,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33236,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338604,"statfs":{"total":96636764160,"available":96602730496,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542252,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509549,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509549,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509549,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509547,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33236,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338604,"statfs":{"total":96636764160,"available":96602730496,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542251,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37976,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333864,"statfs":{"total":96636764160,"available":96597876736,"internally_reserved":0,"allocated":2691072,"data_stored":1513751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:37:22.012 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T05:28:33.567998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=5, tm_min=28, tm_sec=33, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=5, tm_min=37, tm_sec=16, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T05:37:22.012 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T05:37:42.013 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:37:42.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.172+0000 7f80ff200640 1 -- 172.21.15.31:0/3766919860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80e4003ab0 msgr2=0x7f80e4003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.172+0000 7f80ff200640 1 --2- 172.21.15.31:0/3766919860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80e4003ab0 0x7f80e4003ed0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f80f00016c0 tx=0x7f80f001c710 comp rx=0 tx=0).stop 2024-09-17T05:37:42.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.172+0000 7f80ff200640 1 -- 172.21.15.31:0/3766919860 shutdown_connections 2024-09-17T05:37:42.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.172+0000 7f80ff200640 1 --2- 172.21.15.31:0/3766919860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f80e4003ab0 0x7f80e4003ed0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.172+0000 7f80ff200640 1 -- 172.21.15.31:0/3766919860 >> 172.21.15.31:0/3766919860 conn(0x7f81000d1bb0 msgr2=0x7f81000d1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:42.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.172+0000 7f80ff200640 1 -- 172.21.15.31:0/3766919860 shutdown_connections 2024-09-17T05:37:42.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.172+0000 7f80ff200640 1 -- 172.21.15.31:0/3766919860 wait complete. 2024-09-17T05:37:42.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.172+0000 7f80ff200640 1 Processor -- start 2024-09-17T05:37:42.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.172+0000 7f80ff200640 1 -- start start 2024-09-17T05:37:42.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.172+0000 7f80ff200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80e4003ab0 0x7f81001f86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.172+0000 7f80ff200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81000b3920 0x7f81001fa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.172+0000 7f80ff200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81000b2060 0x7f81000b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.172+0000 7f80ff200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f81000af530 con 0x7f81000b2060 2024-09-17T05:37:42.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.172+0000 7f80ff200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f81000d0600 con 0x7f81000b3920 2024-09-17T05:37:42.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.172+0000 7f80ff200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f81000af6b0 con 0x7f80e4003ab0 2024-09-17T05:37:42.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.172+0000 7f80fe800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81000b2060 0x7f81000b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:42.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.172+0000 7f80fe800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81000b2060 0x7f81000b24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35884/0 (socket says 172.21.15.31:35884) 2024-09-17T05:37:42.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.172+0000 7f80fe800640 1 -- 172.21.15.31:0/1946680882 learned_addr learned my addr 172.21.15.31:0/1946680882 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:42.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80fde00640 1 --2- 172.21.15.31:0/1946680882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80e4003ab0 0x7f81001f86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:42.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80f7e00640 1 --2- 172.21.15.31:0/1946680882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81000b3920 0x7f81001fa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80fe800640 1 -- 172.21.15.31:0/1946680882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80e4003ab0 msgr2=0x7f81001f86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80fe800640 1 --2- 172.21.15.31:0/1946680882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80e4003ab0 0x7f81001f86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80fe800640 1 -- 172.21.15.31:0/1946680882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81000b3920 msgr2=0x7f81001fa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80fe800640 1 --2- 172.21.15.31:0/1946680882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81000b3920 0x7f81001fa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80fe800640 1 -- 172.21.15.31:0/1946680882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81001fba30 con 0x7f81000b2060 2024-09-17T05:37:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80fde00640 1 --2- 172.21.15.31:0/1946680882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80e4003ab0 0x7f81001f86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80f7e00640 1 --2- 172.21.15.31:0/1946680882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81000b3920 0x7f81001fa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80fe800640 1 --2- 172.21.15.31:0/1946680882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81000b2060 0x7f81000b24e0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f81000747e0 tx=0x7f80f8010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80f6000640 1 -- 172.21.15.31:0/1946680882 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f800ee10 con 0x7f81000b2060 2024-09-17T05:37:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80f6000640 1 -- 172.21.15.31:0/1946680882 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80f8015070 con 0x7f81000b2060 2024-09-17T05:37:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80f6000640 1 -- 172.21.15.31:0/1946680882 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f8003cf0 con 0x7f81000b2060 2024-09-17T05:37:42.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80ff200640 1 -- 172.21.15.31:0/1946680882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81001faeb0 con 0x7f81000b2060 2024-09-17T05:37:42.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80ff200640 1 -- 172.21.15.31:0/1946680882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81001fb470 con 0x7f81000b2060 2024-09-17T05:37:42.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80ff200640 1 -- 172.21.15.31:0/1946680882 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81000d0780 con 0x7f81000b2060 2024-09-17T05:37:42.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80f6000640 1 -- 172.21.15.31:0/1946680882 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f80f8004030 con 0x7f81000b2060 2024-09-17T05:37:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80f6000640 1 --2- 172.21.15.31:0/1946680882 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f80dc073e00 0x7f80dc0762c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.176+0000 7f80f6000640 1 -- 172.21.15.31:0/1946680882 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f80f80935c0 con 0x7f81000b2060 2024-09-17T05:37:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.180+0000 7f80fde00640 1 --2- 172.21.15.31:0/1946680882 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f80dc073e00 0x7f80dc0762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:42.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.180+0000 7f80fde00640 1 --2- 172.21.15.31:0/1946680882 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f80dc073e00 0x7f80dc0762c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f80e4004790 tx=0x7f80f0019500 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:42.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.180+0000 7f80f6000640 1 -- 172.21.15.31:0/1946680882 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f80f80600c0 con 0x7f81000b2060 2024-09-17T05:37:42.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.352+0000 7f80ff200640 1 -- 172.21.15.31:0/1946680882 --> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f810015d910 con 0x7f80dc073e00 2024-09-17T05:37:42.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.352+0000 7f80f6000640 1 -- 172.21.15.31:0/1946680882 <== mgr.4106 v2:172.21.15.31:6836/1644934356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13370 (secure 0 0 0) 0x7f810015d910 con 0x7f80dc073e00 2024-09-17T05:37:42.356 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:37:42.356 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-17T05:37:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.356+0000 7f80ff200640 1 -- 172.21.15.31:0/1946680882 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f80dc073e00 msgr2=0x7f80dc0762c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.356+0000 7f80ff200640 1 --2- 172.21.15.31:0/1946680882 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f80dc073e00 0x7f80dc0762c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f80e4004790 tx=0x7f80f0019500 comp rx=0 tx=0).stop 2024-09-17T05:37:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.356+0000 7f80ff200640 1 -- 172.21.15.31:0/1946680882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81000b2060 msgr2=0x7f81000b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.356+0000 7f80ff200640 1 --2- 172.21.15.31:0/1946680882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81000b2060 0x7f81000b24e0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f81000747e0 tx=0x7f80f8010e90 comp rx=0 tx=0).stop 2024-09-17T05:37:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.356+0000 7f80ff200640 1 -- 172.21.15.31:0/1946680882 shutdown_connections 2024-09-17T05:37:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.356+0000 7f80ff200640 1 --2- 172.21.15.31:0/1946680882 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f80dc073e00 0x7f80dc0762c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.356+0000 7f80ff200640 1 --2- 172.21.15.31:0/1946680882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81000b2060 0x7f81000b24e0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.356+0000 7f80ff200640 1 --2- 172.21.15.31:0/1946680882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81000b3920 0x7f81001fa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.356+0000 7f80ff200640 1 --2- 172.21.15.31:0/1946680882 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80e4003ab0 0x7f81001f86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.356+0000 7f80ff200640 1 -- 172.21.15.31:0/1946680882 >> 172.21.15.31:0/1946680882 conn(0x7f81000d1bb0 msgr2=0x7f8100152de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:42.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.356+0000 7f80ff200640 1 -- 172.21.15.31:0/1946680882 shutdown_connections 2024-09-17T05:37:42.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.356+0000 7f80ff200640 1 -- 172.21.15.31:0/1946680882 wait complete. 2024-09-17T05:37:42.380 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-09-17T05:37:40.765017+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":271216,"kb_used_data":17544,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703504,"statfs":{"total":773094113280,"available":772816388096,"internally_reserved":0,"allocated":17965056,"data_stored":8567800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002921"},"pg_stats":[{"pgid":"1.0","version":"166'81","reported_seq":415,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-17T05:37:21.691194+0000","last_change":"2024-09-17T05:37:21.691194+0000","last_active":"2024-09-17T05:37:21.691194+0000","last_peered":"2024-09-17T05:37:21.691194+0000","last_clean":"2024-09-17T05:37:21.691194+0000","last_became_active":"2024-09-17T05:28:35.401548+0000","last_became_peered":"2024-09-17T05:28:35.401548+0000","last_unstale":"2024-09-17T05:37:21.691194+0000","last_undegraded":"2024-09-17T05:37:21.691194+0000","last_fullsized":"2024-09-17T05:37:21.691194+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"166'81","last_scrub_stamp":"2024-09-17T05:37:21.691077+0000","last_deep_scrub":"166'81","last_deep_scrub_stamp":"2024-09-17T05:37:21.691077+0000","last_clean_scrub_stamp":"2024-09-17T05:37:21.691077+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:11.462517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509552,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":2691072,"data_stored":1513751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33236,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338604,"statfs":{"total":96636764160,"available":96602730496,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542256,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33240,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509551,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33236,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338604,"statfs":{"total":96636764160,"available":96602730496,"internally_reserved":0,"allocated":2097152,"data_stored":923383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542255,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37972,"kb_used_data":2628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333868,"statfs":{"total":96636764160,"available":96597880832,"internally_reserved":0,"allocated":2691072,"data_stored":1513751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:37:42.381 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T05:37:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.524+0000 7f079a800640 1 -- 172.21.15.31:0/3358719449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0778005220 msgr2=0x7f077800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.524+0000 7f079a800640 1 --2- 172.21.15.31:0/3358719449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0778005220 0x7f077800b9d0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f078c001dc0 tx=0x7f078c01cb30 comp rx=0 tx=0).stop 2024-09-17T05:37:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.524+0000 7f079a800640 1 -- 172.21.15.31:0/3358719449 shutdown_connections 2024-09-17T05:37:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.524+0000 7f079a800640 1 --2- 172.21.15.31:0/3358719449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0778005220 0x7f077800b9d0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.524+0000 7f079a800640 1 -- 172.21.15.31:0/3358719449 >> 172.21.15.31:0/3358719449 conn(0x7f07940b18f0 msgr2=0x7f07940b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.524+0000 7f079a800640 1 -- 172.21.15.31:0/3358719449 shutdown_connections 2024-09-17T05:37:42.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.524+0000 7f079a800640 1 -- 172.21.15.31:0/3358719449 wait complete. 2024-09-17T05:37:42.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f079a800640 1 Processor -- start 2024-09-17T05:37:42.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f079a800640 1 -- start start 2024-09-17T05:37:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f079a800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0778005220 0x7f0794153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f079a800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f079409b3f0 0x7f079415b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f079a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f079415b890 0x7f07941f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f079a800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f07940b4bd0 con 0x7f079415b890 2024-09-17T05:37:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f079a800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0794070310 con 0x7f0778005220 2024-09-17T05:37:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f079a800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f07940b4d50 con 0x7f079409b3f0 2024-09-17T05:37:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f0793e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f079415b890 0x7f07941f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f0793e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f079415b890 0x7f07941f39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35904/0 (socket says 172.21.15.31:35904) 2024-09-17T05:37:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f0793e00640 1 -- 172.21.15.31:0/863177162 learned_addr learned my addr 172.21.15.31:0/863177162 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f0793400640 1 --2- 172.21.15.31:0/863177162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0778005220 0x7f0794153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:42.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f0793e00640 1 -- 172.21.15.31:0/863177162 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f079409b3f0 msgr2=0x7f079415b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f078be00640 1 --2- 172.21.15.31:0/863177162 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f079409b3f0 0x7f079415b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:42.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f0793e00640 1 --2- 172.21.15.31:0/863177162 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f079409b3f0 0x7f079415b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f0793e00640 1 -- 172.21.15.31:0/863177162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0778005220 msgr2=0x7f0794153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f0793e00640 1 --2- 172.21.15.31:0/863177162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0778005220 0x7f0794153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f0793e00640 1 -- 172.21.15.31:0/863177162 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f079415d9c0 con 0x7f079415b890 2024-09-17T05:37:42.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f078be00640 1 --2- 172.21.15.31:0/863177162 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f079409b3f0 0x7f079415b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:37:42.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f0793400640 1 --2- 172.21.15.31:0/863177162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0778005220 0x7f0794153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:37:42.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f0793e00640 1 --2- 172.21.15.31:0/863177162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f079415b890 0x7f07941f39d0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f078c01b230 tx=0x7f078c004fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:42.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f078b400640 1 -- 172.21.15.31:0/863177162 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c0019f0 con 0x7f079415b890 2024-09-17T05:37:42.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f078b400640 1 -- 172.21.15.31:0/863177162 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f078c0b5070 con 0x7f079415b890 2024-09-17T05:37:42.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f078b400640 1 -- 172.21.15.31:0/863177162 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c006650 con 0x7f079415b890 2024-09-17T05:37:42.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f079a800640 1 -- 172.21.15.31:0/863177162 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f079415dc80 con 0x7f079415b890 2024-09-17T05:37:42.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.528+0000 7f079a800640 1 -- 172.21.15.31:0/863177162 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f079409c2b0 con 0x7f079415b890 2024-09-17T05:37:42.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.532+0000 7f079a800640 1 -- 172.21.15.31:0/863177162 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0794069410 con 0x7f079415b890 2024-09-17T05:37:42.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.532+0000 7f078b400640 1 -- 172.21.15.31:0/863177162 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f078c0ba470 con 0x7f079415b890 2024-09-17T05:37:42.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.532+0000 7f078b400640 1 --2- 172.21.15.31:0/863177162 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0770073e00 0x7f07700762c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.532+0000 7f078b400640 1 -- 172.21.15.31:0/863177162 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f078c12d660 con 0x7f079415b890 2024-09-17T05:37:42.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.532+0000 7f0793400640 1 --2- 172.21.15.31:0/863177162 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0770073e00 0x7f07700762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:42.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.536+0000 7f0793400640 1 --2- 172.21.15.31:0/863177162 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0770073e00 0x7f07700762c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0784000fc0 tx=0x7f07840067b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:42.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.536+0000 7f078b400640 1 -- 172.21.15.31:0/863177162 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f078c0c1030 con 0x7f079415b890 2024-09-17T05:37:42.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.712+0000 7f079a800640 1 -- 172.21.15.31:0/863177162 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f079415ea70 con 0x7f079415b890 2024-09-17T05:37:42.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.716+0000 7f078b400640 1 -- 172.21.15.31:0/863177162 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v50)=0 v50) ==== 123+0+0 (secure 0 0 0) 0x7f078c016890 con 0x7f079415b890 2024-09-17T05:37:42.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.716+0000 7f078b400640 1 -- 172.21.15.31:0/863177162 <== mon.0 v2:172.21.15.31:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f078c135080 con 0x7f079415b890 2024-09-17T05:37:42.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.720+0000 7f079a800640 1 -- 172.21.15.31:0/863177162 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0770073e00 msgr2=0x7f07700762c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.720+0000 7f079a800640 1 --2- 172.21.15.31:0/863177162 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0770073e00 0x7f07700762c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0784000fc0 tx=0x7f07840067b0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.720+0000 7f079a800640 1 -- 172.21.15.31:0/863177162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f079415b890 msgr2=0x7f07941f39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.720+0000 7f079a800640 1 --2- 172.21.15.31:0/863177162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f079415b890 0x7f07941f39d0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f078c01b230 tx=0x7f078c004fd0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.720+0000 7f079a800640 1 -- 172.21.15.31:0/863177162 shutdown_connections 2024-09-17T05:37:42.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.720+0000 7f079a800640 1 --2- 172.21.15.31:0/863177162 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f0770073e00 0x7f07700762c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.720+0000 7f079a800640 1 --2- 172.21.15.31:0/863177162 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f079415b890 0x7f07941f39d0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.720+0000 7f079a800640 1 --2- 172.21.15.31:0/863177162 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f079409b3f0 0x7f079415b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.720+0000 7f079a800640 1 --2- 172.21.15.31:0/863177162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0778005220 0x7f0794153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.720+0000 7f079a800640 1 -- 172.21.15.31:0/863177162 >> 172.21.15.31:0/863177162 conn(0x7f07940b18f0 msgr2=0x7f07940afa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:42.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.720+0000 7f079a800640 1 -- 172.21.15.31:0/863177162 shutdown_connections 2024-09-17T05:37:42.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.720+0000 7f079a800640 1 -- 172.21.15.31:0/863177162 wait complete. 2024-09-17T05:37:42.742 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:37:42.743 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:37:42.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98fca00640 1 -- 172.21.15.31:0/3993497405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98f815bd50 msgr2=0x7f98f80ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98fca00640 1 --2- 172.21.15.31:0/3993497405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98f815bd50 0x7f98f80ce5e0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009900 tx=0x7f98e801c4a0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98fca00640 1 -- 172.21.15.31:0/3993497405 shutdown_connections 2024-09-17T05:37:42.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98fca00640 1 --2- 172.21.15.31:0/3993497405 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98f80cf4e0 0x7f98f80cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98fca00640 1 --2- 172.21.15.31:0/3993497405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98f815bd50 0x7f98f80ce5e0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98fca00640 1 -- 172.21.15.31:0/3993497405 >> 172.21.15.31:0/3993497405 conn(0x7f98f80d1ea0 msgr2=0x7f98f80d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:42.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98fca00640 1 -- 172.21.15.31:0/3993497405 shutdown_connections 2024-09-17T05:37:42.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98fca00640 1 -- 172.21.15.31:0/3993497405 wait complete. 2024-09-17T05:37:42.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98fca00640 1 Processor -- start 2024-09-17T05:37:42.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98fca00640 1 -- start start 2024-09-17T05:37:42.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98fca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98f80cf4e0 0x7f98f80cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98fca00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98f815bd50 0x7f98f8159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98fca00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98f815c130 0x7f98f81580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98fca00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f98f8169c30 con 0x7f98f80cf4e0 2024-09-17T05:37:42.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98fca00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f98f8169ab0 con 0x7f98f815c130 2024-09-17T05:37:42.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98fca00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f98f8169db0 con 0x7f98f815bd50 2024-09-17T05:37:42.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98f5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98f80cf4e0 0x7f98f80cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:42.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98f5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98f80cf4e0 0x7f98f80cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35914/0 (socket says 172.21.15.31:35914) 2024-09-17T05:37:42.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98f5e00640 1 -- 172.21.15.31:0/2840670398 learned_addr learned my addr 172.21.15.31:0/2840670398 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-17T05:37:42.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98f5e00640 1 -- 172.21.15.31:0/2840670398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98f815bd50 msgr2=0x7f98f8159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98f5e00640 1 --2- 172.21.15.31:0/2840670398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98f815bd50 0x7f98f8159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98f5e00640 1 -- 172.21.15.31:0/2840670398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98f815c130 msgr2=0x7f98f81580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:42.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98f5e00640 1 --2- 172.21.15.31:0/2840670398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98f815c130 0x7f98f81580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:42.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.888+0000 7f98f5e00640 1 -- 172.21.15.31:0/2840670398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f809bbb0 con 0x7f98f80cf4e0 2024-09-17T05:37:42.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.892+0000 7f98f5e00640 1 --2- 172.21.15.31:0/2840670398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98f80cf4e0 0x7f98f80cbec0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009850 tx=0x7f98e80a4b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:42.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.892+0000 7f98ee000640 1 -- 172.21.15.31:0/2840670398 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e80b1040 con 0x7f98f80cf4e0 2024-09-17T05:37:42.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.892+0000 7f98ee000640 1 -- 172.21.15.31:0/2840670398 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f98e8005340 con 0x7f98f80cf4e0 2024-09-17T05:37:42.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.892+0000 7f98ee000640 1 -- 172.21.15.31:0/2840670398 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e80046d0 con 0x7f98f80cf4e0 2024-09-17T05:37:42.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.892+0000 7f98fca00640 1 -- 172.21.15.31:0/2840670398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f809be50 con 0x7f98f80cf4e0 2024-09-17T05:37:42.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.892+0000 7f98fca00640 1 -- 172.21.15.31:0/2840670398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f8158d20 con 0x7f98f80cf4e0 2024-09-17T05:37:42.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.892+0000 7f98fca00640 1 -- 172.21.15.31:0/2840670398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f80cd990 con 0x7f98f80cf4e0 2024-09-17T05:37:42.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.892+0000 7f98ee000640 1 -- 172.21.15.31:0/2840670398 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 27) ==== 98305+0+0 (secure 0 0 0) 0x7f98e8004890 con 0x7f98f80cf4e0 2024-09-17T05:37:42.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.892+0000 7f98ee000640 1 --2- 172.21.15.31:0/2840670398 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f98d4073e00 0x7f98d40762c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:37:42.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.896+0000 7f98ee000640 1 -- 172.21.15.31:0/2840670398 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 4971+0+0 (secure 0 0 0) 0x7f98e812c130 con 0x7f98f80cf4e0 2024-09-17T05:37:42.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.896+0000 7f98efe00640 1 --2- 172.21.15.31:0/2840670398 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f98d4073e00 0x7f98d40762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:37:42.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.896+0000 7f98efe00640 1 --2- 172.21.15.31:0/2840670398 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f98d4073e00 0x7f98d40762c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f98e0000f70 tx=0x7f98e00079c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:37:42.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:42.896+0000 7f98ee000640 1 -- 172.21.15.31:0/2840670398 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188675 (secure 0 0 0) 0x7f98e80164d0 con 0x7f98f80cf4e0 2024-09-17T05:37:43.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:43.112+0000 7f98fca00640 1 -- 172.21.15.31:0/2840670398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98f809c020 con 0x7f98f80cf4e0 2024-09-17T05:37:43.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:43.112+0000 7f98ee000640 1 -- 172.21.15.31:0/2840670398 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 122 v122) ==== 95+0+3922 (secure 0 0 0) 0x7f98e80f8950 con 0x7f98f80cf4e0 2024-09-17T05:37:43.113 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-17T05:37:43.113 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":122,"btime":"2024-09-17T05:37:09:083086+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6834/2639830102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2639830102},{"type":"v1","addr":"172.21.15.155:6834","nonce":2639830102}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114},{"gid":8722,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2208176532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":2208176532},{"type":"v1","addr":"172.21.15.155:6835","nonce":2208176532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":122},{"gid":9111,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1970430367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":1970430367},{"type":"v1","addr":"172.21.15.31:6834","nonce":1970430367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":113},{"gid":9114,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3317138111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3317138111},{"type":"v1","addr":"172.21.15.31:6835","nonce":3317138111}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":114}],"filesystems":[]} 2024-09-17T05:37:43.114 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 122 2024-09-17T05:37:43.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:43.112+0000 7f98fca00640 1 -- 172.21.15.31:0/2840670398 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f98d4073e00 msgr2=0x7f98d40762c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:43.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:43.112+0000 7f98fca00640 1 --2- 172.21.15.31:0/2840670398 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f98d4073e00 0x7f98d40762c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f98e0000f70 tx=0x7f98e00079c0 comp rx=0 tx=0).stop 2024-09-17T05:37:43.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:43.112+0000 7f98fca00640 1 -- 172.21.15.31:0/2840670398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98f80cf4e0 msgr2=0x7f98f80cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:37:43.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:43.112+0000 7f98fca00640 1 --2- 172.21.15.31:0/2840670398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98f80cf4e0 0x7f98f80cbec0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009850 tx=0x7f98e80a4b60 comp rx=0 tx=0).stop 2024-09-17T05:37:43.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:43.112+0000 7f98fca00640 1 -- 172.21.15.31:0/2840670398 shutdown_connections 2024-09-17T05:37:43.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:43.112+0000 7f98fca00640 1 --2- 172.21.15.31:0/2840670398 >> [v2:172.21.15.31:6836/1644934356,v1:172.21.15.31:6837/1644934356] conn(0x7f98d4073e00 0x7f98d40762c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:43.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:43.112+0000 7f98fca00640 1 --2- 172.21.15.31:0/2840670398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98f815c130 0x7f98f81580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:43.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:43.112+0000 7f98fca00640 1 --2- 172.21.15.31:0/2840670398 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98f815bd50 0x7f98f8159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:43.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:43.112+0000 7f98fca00640 1 --2- 172.21.15.31:0/2840670398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f98f80cf4e0 0x7f98f80cbec0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:37:43.116 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:43.112+0000 7f98fca00640 1 -- 172.21.15.31:0/2840670398 >> 172.21.15.31:0/2840670398 conn(0x7f98f80d1ea0 msgr2=0x7f98f80d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:37:43.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:43.112+0000 7f98fca00640 1 -- 172.21.15.31:0/2840670398 shutdown_connections 2024-09-17T05:37:43.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-17T05:37:43.112+0000 7f98fca00640 1 -- 172.21.15.31:0/2840670398 wait complete. 2024-09-17T05:37:43.117 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:37:43.120 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:37:43.136 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-17T05:37:43.137 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T05:37:43.137 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:37:43.137 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:43.181 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:37:43.182 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:37:43.182 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:43.235 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:37:43.235 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:37:43.235 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:43.251 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:37:43.251 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:37:43.251 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:43.306 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:37:43.307 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T05:37:43.307 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T05:37:43.307 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:46.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-17T05:37:49.409 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T05:37:49.409 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T05:37:49.410 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:49.470 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T05:37:49.470 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T05:37:49.470 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:49.559 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T05:37:49.560 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T05:37:49.560 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:52.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-17T05:37:52.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-17T05:37:55.662 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T05:37:55.663 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T05:37:55.663 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:55.746 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T05:37:55.746 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T05:37:55.746 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:55.830 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T05:37:55.830 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-17T05:37:55.830 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:37:57.710 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-17T05:37:57.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-17T05:38:01.932 INFO:tasks.ceph.osd.6:Stopped 2024-09-17T05:38:01.933 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T05:38:01.933 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:38:02.013 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T05:38:02.014 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T05:38:02.015 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T05:38:02.015 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:38:02.086 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T05:38:02.086 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T05:38:02.087 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:38:02.144 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T05:38:02.145 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T05:38:02.145 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T05:38:02.145 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:38:02.167 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T05:38:02.167 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T05:38:02.168 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:38:02.185 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T05:38:02.186 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T05:38:02.186 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:38:02.249 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T05:38:02.250 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T05:38:02.250 DEBUG:teuthology.orchestra.run.smithi031:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-09-17T05:38:02.293 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:38:02.293 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T05:38:02.575 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:38:02.575 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T05:38:02.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-17T05:38:02.730 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:38:02.730 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T05:38:02.855 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:38:02.855 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T05:38:03.017 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:38:03.017 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T05:38:03.195 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:38:03.195 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T05:38:03.366 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:38:03.366 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-17T05:38:03.539 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:38:03.540 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-17T05:38:03.682 INFO:tasks.ceph:Archiving mon data... 2024-09-17T05:38:03.684 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908692/data/mon.a.tgz 2024-09-17T05:38:03.684 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-09-17T05:38:03.693 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.IwaEduqEGc 2024-09-17T05:38:03.693 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.IwaEduqEGc 2024-09-17T05:38:03.933 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.IwaEduqEGc 2024-09-17T05:38:04.009 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.IwaEduqEGc is 1MB 2024-09-17T05:38:04.087 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.IwaEduqEGc 2024-09-17T05:38:04.097 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908692/data/mon.b.tgz 2024-09-17T05:38:04.098 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-09-17T05:38:04.107 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.5BaqldCBA9 2024-09-17T05:38:04.107 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.5BaqldCBA9 2024-09-17T05:38:04.340 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.5BaqldCBA9 2024-09-17T05:38:04.411 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.5BaqldCBA9 is 1MB 2024-09-17T05:38:04.487 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.5BaqldCBA9 2024-09-17T05:38:04.495 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908692/data/mon.c.tgz 2024-09-17T05:38:04.496 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-09-17T05:38:04.547 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.I1hnSNM7h7 2024-09-17T05:38:04.548 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.I1hnSNM7h7 2024-09-17T05:38:04.774 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.I1hnSNM7h7 2024-09-17T05:38:04.852 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.I1hnSNM7h7 is 1MB 2024-09-17T05:38:04.922 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.I1hnSNM7h7 2024-09-17T05:38:04.931 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T05:38:04.931 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T05:38:04.934 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T05:38:05.004 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T05:38:05.040 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T05:38:05.040 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T05:38:05.042 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/crash to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908692/remote/smithi031/crash 2024-09-17T05:38:05.043 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T05:38:05.069 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/crash to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908692/remote/smithi155/crash 2024-09-17T05:38:05.070 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T05:38:05.101 INFO:tasks.ceph:Shutting down logrotate 2024-09-17T05:38:05.101 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:38:05.120 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:38:05.207 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T05:38:05.228 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T05:38:05.247 INFO:tasks.ceph:Compressing logs... 2024-09-17T05:38:05.247 DEBUG:teuthology.orchestra.run.smithi031:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T05:38:05.275 DEBUG:teuthology.orchestra.run.smithi155:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T05:38:05.304 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52205.log 2024-09-17T05:38:05.304 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54595.log 2024-09-17T05:38:05.306 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49797.log 2024-09-17T05:38:05.306 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52205.log.gz 2024-09-17T05:38:05.306 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35600.log 2024-09-17T05:38:05.307 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54595.log.gz 2024-09-17T05:38:05.307 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52700.log 2024-09-17T05:38:05.307 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49797.log.gz 2024-09-17T05:38:05.308 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.35600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35600.log.gzgzip 2024-09-17T05:38:05.308 INFO:teuthology.orchestra.run.smithi031.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52450.log 2024-09-17T05:38:05.309 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54439.log 2024-09-17T05:38:05.309 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52700.log.gz 2024-09-17T05:38:05.310 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45643.log 2024-09-17T05:38:05.310 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52450.log.gz 2024-09-17T05:38:05.311 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48348.log 2024-09-17T05:38:05.311 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54439.log.gz 2024-09-17T05:38:05.312 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42175.log 2024-09-17T05:38:05.312 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45643.log.gz 2024-09-17T05:38:05.313 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40905.log 2024-09-17T05:38:05.313 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48348.log.gz 2024-09-17T05:38:05.314 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35395.log 2024-09-17T05:38:05.314 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42175.log.gz 2024-09-17T05:38:05.314 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49133.log 2024-09-17T05:38:05.315 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40905.log.gz 2024-09-17T05:38:05.315 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51935.log 2024-09-17T05:38:05.315 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35395.log.gz 2024-09-17T05:38:05.316 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37130.log 2024-09-17T05:38:05.316 INFO:teuthology.orchestra.run.smithi031.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.49133.log.gz 2024-09-17T05:38:05.317 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29116.log 2024-09-17T05:38:05.318 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44991.log 2024-09-17T05:38:05.318 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51935.log.gz 2024-09-17T05:38:05.318 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49058.log 2024-09-17T05:38:05.318 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37130.log.gz 2024-09-17T05:38:05.332 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34894.log 2024-09-17T05:38:05.332 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29092.log 2024-09-17T05:38:05.332 INFO:teuthology.orchestra.run.smithi155.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29116.log.gz 2024-09-17T05:38:05.332 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.34894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34894.log.gz 2024-09-17T05:38:05.333 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-17T05:38:05.333 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29037.log 2024-09-17T05:38:05.333 INFO:teuthology.orchestra.run.smithi155.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29092.log.gz 2024-09-17T05:38:05.333 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-17T05:38:05.333 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35314.log 2024-09-17T05:38:05.333 INFO:teuthology.orchestra.run.smithi155.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29037.log.gz 2024-09-17T05:38:05.333 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T05:38:05.333 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.35314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35314.log.gz 2024-09-17T05:38:05.333 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29061.log 2024-09-17T05:38:05.333 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35693.log 2024-09-17T05:38:05.333 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29061.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29061.log.gz 2024-09-17T05:38:05.333 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35021.log 2024-09-17T05:38:05.334 INFO:teuthology.orchestra.run.smithi155.stderr:gzip/var/log/ceph/ceph-client.1.35693.log: -5 --verbose -- /var/log/ceph/ceph-client.1.35568.log 2024-09-17T05:38:05.334 INFO:teuthology.orchestra.run.smithi155.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35693.log.gz 2024-09-17T05:38:05.334 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.35021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35021.log.gz 2024-09-17T05:38:05.334 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35930.log 2024-09-17T05:38:05.334 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35457.log 2024-09-17T05:38:05.334 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.35568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35568.log.gz 2024-09-17T05:38:05.334 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.35930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35930.log.gz 2024-09-17T05:38:05.334 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T05:38:05.334 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T05:38:05.334 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.35457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35457.log.gz 2024-09-17T05:38:05.334 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34496.log 2024-09-17T05:38:05.337 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54180.log 2024-09-17T05:38:05.337 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44991.log.gz 2024-09-17T05:38:05.337 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45988.log 2024-09-17T05:38:05.337 INFO:teuthology.orchestra.run.smithi031.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.49058.log.gz 2024-09-17T05:38:05.337 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37655.log 2024-09-17T05:38:05.337 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54180.log.gz 2024-09-17T05:38:05.337 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42972.log 2024-09-17T05:38:05.337 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45988.log.gz 2024-09-17T05:38:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53698.log 2024-09-17T05:38:05.338 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37655.log.gz 2024-09-17T05:38:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48714.log 2024-09-17T05:38:05.338 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42972.log.gz 2024-09-17T05:38:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34485.log 2024-09-17T05:38:05.338 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53698.log.gz 2024-09-17T05:38:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38970.log 2024-09-17T05:38:05.338 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48714.log.gz 2024-09-17T05:38:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53855.log 2024-09-17T05:38:05.338 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34485.log.gz 2024-09-17T05:38:05.338 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49509.log 2024-09-17T05:38:05.338 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38970.log.gz 2024-09-17T05:38:05.339 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45200.log 2024-09-17T05:38:05.339 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53855.log.gz 2024-09-17T05:38:05.339 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39550.log 2024-09-17T05:38:05.339 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49509.log.gz 2024-09-17T05:38:05.339 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52981.log 2024-09-17T05:38:05.339 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45200.log.gz 2024-09-17T05:38:05.339 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40756.log 2024-09-17T05:38:05.339 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39550.log.gz 2024-09-17T05:38:05.339 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47750.log 2024-09-17T05:38:05.339 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52981.log.gz 2024-09-17T05:38:05.339 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40756.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-17T05:38:05.339 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40756.log.gz 2024-09-17T05:38:05.339 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41298.log 2024-09-17T05:38:05.340 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47750.log.gz 2024-09-17T05:38:05.340 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54076.log 2024-09-17T05:38:05.340 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53646.log 2024-09-17T05:38:05.340 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41298.log.gz 2024-09-17T05:38:05.340 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47474.log 2024-09-17T05:38:05.340 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54076.log.gz 2024-09-17T05:38:05.340 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40557.log 2024-09-17T05:38:05.345 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28989.log 2024-09-17T05:38:05.345 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.1.34496.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.1.34496.log.gz /var/log/ceph/ceph-client.admin.29140.log 2024-09-17T05:38:05.345 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-09-17T05:38:05.345 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.28989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.34598.log 2024-09-17T05:38:05.345 INFO:teuthology.orchestra.run.smithi155.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.28989.log.gz 2024-09-17T05:38:05.345 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29140.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T05:38:05.345 INFO:teuthology.orchestra.run.smithi155.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29140.log.gz 2024-09-17T05:38:05.345 INFO:teuthology.orchestra.run.smithi155.stderr: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T05:38:05.345 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.3.34598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.34598.log.gz 2024-09-17T05:38:05.345 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T05:38:05.345 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34727.log 2024-09-17T05:38:05.346 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-17T05:38:05.346 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.34727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34727.log.gz 2024-09-17T05:38:05.346 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28965.log 2024-09-17T05:38:05.352 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35820.log 2024-09-17T05:38:05.352 INFO:teuthology.orchestra.run.smithi155.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T05:38:05.352 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-17T05:38:05.352 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.35820.log: /var/log/ceph/ceph-client.admin.28965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35820.log.gz 2024-09-17T05:38:05.352 INFO:teuthology.orchestra.run.smithi155.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.28965.log.gz 2024-09-17T05:38:05.352 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose 92.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-17T05:38:05.352 INFO:teuthology.orchestra.run.smithi155.stderr: -- /var/log/ceph/ceph-mon.b.log 2024-09-17T05:38:05.352 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-17T05:38:05.354 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53646.log.gz 2024-09-17T05:38:05.354 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51805.log 87.3% 2024-09-17T05:38:05.354 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47474.log.gz 2024-09-17T05:38:05.354 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34631.log 2024-09-17T05:38:05.354 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40557.log.gz 2024-09-17T05:38:05.354 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37681.log 2024-09-17T05:38:05.354 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51805.log.gz 2024-09-17T05:38:05.354 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46347.log 2024-09-17T05:38:05.354 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34631.log.gz 2024-09-17T05:38:05.354 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37681.log: gzip -5 --verbose 87.7% -- -- replaced with /var/log/ceph/ceph-client.admin.37681.log.gz /var/log/ceph/ceph-client.admin.35039.log 2024-09-17T05:38:05.355 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-09-17T05:38:05.355 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39182.log 2024-09-17T05:38:05.355 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46347.log.gz 2024-09-17T05:38:05.355 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51514.log 2024-09-17T05:38:05.355 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35039.log.gz 2024-09-17T05:38:05.355 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36296.log 2024-09-17T05:38:05.355 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39182.log.gz 2024-09-17T05:38:05.355 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54881.log 2024-09-17T05:38:05.355 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51514.log.gz 2024-09-17T05:38:05.355 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48376.log 2024-09-17T05:38:05.355 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36296.log.gz 2024-09-17T05:38:05.355 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41246.log 2024-09-17T05:38:05.356 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54881.log.gz 2024-09-17T05:38:05.356 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39349.log 2024-09-17T05:38:05.356 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48376.log.gz 2024-09-17T05:38:05.356 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49692.log 2024-09-17T05:38:05.356 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41246.log.gz 2024-09-17T05:38:05.356 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40245.log 2024-09-17T05:38:05.356 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39349.log.gz 2024-09-17T05:38:05.356 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40195.log 2024-09-17T05:38:05.356 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49692.log.gz 2024-09-17T05:38:05.356 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49183.log 2024-09-17T05:38:05.356 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40245.log.gz 2024-09-17T05:38:05.357 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37363.log 2024-09-17T05:38:05.357 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49183.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.40195.log.gz 2024-09-17T05:38:05.357 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53324.log 2024-09-17T05:38:05.357 INFO:teuthology.orchestra.run.smithi031.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.49183.log.gz 2024-09-17T05:38:05.357 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36516.log 2024-09-17T05:38:05.357 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37363.log.gz 2024-09-17T05:38:05.358 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29013.log 2024-09-17T05:38:05.361 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47524.log 2024-09-17T05:38:05.361 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53324.log.gz 2024-09-17T05:38:05.361 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37603.log 2024-09-17T05:38:05.361 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36516.log.gz 2024-09-17T05:38:05.361 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53350.log 2024-09-17T05:38:05.361 INFO:teuthology.orchestra.run.smithi031.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.47524.log.gz 2024-09-17T05:38:05.361 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44124.log 2024-09-17T05:38:05.361 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37603.log.gz 2024-09-17T05:38:05.361 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52400.log 2024-09-17T05:38:05.361 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53350.log.gz 2024-09-17T05:38:05.361 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48294.log 2024-09-17T05:38:05.362 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44124.log.gz 2024-09-17T05:38:05.362 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52400.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52400.log.gz 2024-09-17T05:38:05.362 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54309.log 2024-09-17T05:38:05.362 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42511.log 2024-09-17T05:38:05.364 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.29013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36049.log 2024-09-17T05:38:05.364 INFO:teuthology.orchestra.run.smithi155.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29013.log.gz 2024-09-17T05:38:05.365 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35164.log 2024-09-17T05:38:05.365 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48294.log.gz 2024-09-17T05:38:05.365 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47416.log 2024-09-17T05:38:05.366 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54309.log.gz 2024-09-17T05:38:05.366 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37525.log 2024-09-17T05:38:05.366 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42511.log.gz 2024-09-17T05:38:05.366 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41549.log 2024-09-17T05:38:05.366 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47416.log.gz 2024-09-17T05:38:05.366 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50229.log 2024-09-17T05:38:05.366 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37525.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37525.log.gz 2024-09-17T05:38:05.366 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42582.log 2024-09-17T05:38:05.366 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41549.log.gz 2024-09-17T05:38:05.367 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53246.log 2024-09-17T05:38:05.367 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50229.log.gz 2024-09-17T05:38:05.367 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42582.log: gzip -5 87.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.42582.log.gz 2024-09-17T05:38:05.367 INFO:teuthology.orchestra.run.smithi031.stderr: /var/log/ceph/ceph-client.admin.39981.log 2024-09-17T05:38:05.369 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53246.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T05:38:05.369 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53246.log.gz 2024-09-17T05:38:05.369 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38455.log 2024-09-17T05:38:05.369 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39981.log.gz 2024-09-17T05:38:05.370 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.36049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.36049.log.gz 2024-09-17T05:38:05.370 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.35164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35164.log.gz 2024-09-17T05:38:05.371 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37942.log 2024-09-17T05:38:05.371 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52330.log 2024-09-17T05:38:05.371 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38455.log.gz 2024-09-17T05:38:05.371 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50365.log 2024-09-17T05:38:05.371 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37942.log.gz 2024-09-17T05:38:05.372 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42233.log 2024-09-17T05:38:05.372 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52330.log.gz 2024-09-17T05:38:05.373 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36595.log 2024-09-17T05:38:05.373 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50365.log.gz 2024-09-17T05:38:05.374 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48933.log 2024-09-17T05:38:05.374 INFO:teuthology.orchestra.run.smithi031.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.42233.log.gz 2024-09-17T05:38:05.375 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51660.log 2024-09-17T05:38:05.375 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36595.log.gz 2024-09-17T05:38:05.376 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53454.log 2024-09-17T05:38:05.376 INFO:teuthology.orchestra.run.smithi031.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.48933.log.gz 2024-09-17T05:38:05.377 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35860.log 2024-09-17T05:38:05.377 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51660.log.gz 2024-09-17T05:38:05.378 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37421.log 2024-09-17T05:38:05.378 INFO:teuthology.orchestra.run.smithi031.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.53454.log.gz 2024-09-17T05:38:05.378 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41783.log 2024-09-17T05:38:05.379 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35860.log.gz 2024-09-17T05:38:05.379 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45438.log 2024-09-17T05:38:05.379 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37421.log.gz 2024-09-17T05:38:05.380 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49745.log 2024-09-17T05:38:05.381 INFO:teuthology.orchestra.run.smithi031.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41783.log.gz 2024-09-17T05:38:05.381 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45438.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45438.log.gz 2024-09-17T05:38:05.382 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39524.log 2024-09-17T05:38:05.382 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28806.log 2024-09-17T05:38:05.382 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49745.log.gz 2024-09-17T05:38:05.383 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54050.log 2024-09-17T05:38:05.383 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39524.log.gz 2024-09-17T05:38:05.384 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28806.log: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.28806.log.gz 2024-09-17T05:38:05.384 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53620.log 2024-09-17T05:38:05.385 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41627.log 2024-09-17T05:38:05.385 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54050.log.gz 2024-09-17T05:38:05.386 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54206.log 2024-09-17T05:38:05.386 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53620.log.gz 2024-09-17T05:38:05.387 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44027.log 2024-09-17T05:38:05.387 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41627.log.gz 2024-09-17T05:38:05.388 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54206.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.54206.log.gz 2024-09-17T05:38:05.388 INFO:teuthology.orchestra.run.smithi031.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46016.log 2024-09-17T05:38:05.389 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51482.log 2024-09-17T05:38:05.389 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44027.log.gz 2024-09-17T05:38:05.390 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49008.log 2024-09-17T05:38:05.390 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46016.log.gz 2024-09-17T05:38:05.391 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54465.log 2024-09-17T05:38:05.391 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51482.log.gz 2024-09-17T05:38:05.391 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49008.log: gzip -5 --verbose -- 84.3% /var/log/ceph/ceph-client.admin.39866.log -- replaced with /var/log/ceph/ceph-client.admin.49008.log.gz 2024-09-17T05:38:05.392 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-09-17T05:38:05.393 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51064.log 2024-09-17T05:38:05.393 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54465.log.gz 2024-09-17T05:38:05.394 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46701.log 2024-09-17T05:38:05.394 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39866.log.gz 2024-09-17T05:38:05.394 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34303.log 2024-09-17T05:38:05.395 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51064.log.gz 2024-09-17T05:38:05.395 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52065.log 2024-09-17T05:38:05.395 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46701.log.gz 2024-09-17T05:38:05.396 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38621.log 2024-09-17T05:38:05.396 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34303.log.gz 2024-09-17T05:38:05.397 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46068.log 2024-09-17T05:38:05.397 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52065.log.gz 2024-09-17T05:38:05.398 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43146.log 2024-09-17T05:38:05.398 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38621.log.gz 2024-09-17T05:38:05.399 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49295.log 2024-09-17T05:38:05.399 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46068.log.gz 2024-09-17T05:38:05.400 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34563.log 2024-09-17T05:38:05.400 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43146.log.gz 2024-09-17T05:38:05.401 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49295.log: gzip -5 --verbose 85.0% -- -- replaced with /var/log/ceph/ceph-client.admin.49295.log.gz /var/log/ceph/ceph-client.admin.46913.log 2024-09-17T05:38:05.401 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-09-17T05:38:05.402 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47698.log 2024-09-17T05:38:05.402 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34563.log.gz 2024-09-17T05:38:05.403 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34625.log 2024-09-17T05:38:05.403 INFO:teuthology.orchestra.run.smithi031.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46913.log.gz 2024-09-17T05:38:05.403 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51449.log 2024-09-17T05:38:05.404 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47698.log.gz 2024-09-17T05:38:05.404 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49849.log 2024-09-17T05:38:05.404 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34625.log.gz 2024-09-17T05:38:05.405 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41653.log 2024-09-17T05:38:05.405 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51449.log.gz 2024-09-17T05:38:05.406 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45408.log 2024-09-17T05:38:05.406 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49849.log.gz 2024-09-17T05:38:05.407 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48908.log 2024-09-17T05:38:05.407 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41653.log.gz 2024-09-17T05:38:05.408 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34132.log 2024-09-17T05:38:05.408 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45408.log.gz 2024-09-17T05:38:05.409 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50417.log 2024-09-17T05:38:05.409 INFO:teuthology.orchestra.run.smithi031.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.48908.log.gz 2024-09-17T05:38:05.410 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48111.log 2024-09-17T05:38:05.410 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34132.log.gz 2024-09-17T05:38:05.410 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45616.log 2024-09-17T05:38:05.411 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50417.log.gz 2024-09-17T05:38:05.411 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48111.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48111.log.gz -5 2024-09-17T05:38:05.411 INFO:teuthology.orchestra.run.smithi031.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39152.log 2024-09-17T05:38:05.413 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45616.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45616.log.gz 2024-09-17T05:38:05.413 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36341.log 2024-09-17T05:38:05.413 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53428.log 2024-09-17T05:38:05.414 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39152.log.gz 2024-09-17T05:38:05.414 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29291.log 2024-09-17T05:38:05.414 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36341.log.gz 2024-09-17T05:38:05.415 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48560.log 2024-09-17T05:38:05.415 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53428.log.gz 2024-09-17T05:38:05.416 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.29291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48761.log 2024-09-17T05:38:05.416 INFO:teuthology.orchestra.run.smithi031.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29291.log.gz 2024-09-17T05:38:05.417 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38193.log 2024-09-17T05:38:05.417 INFO:teuthology.orchestra.run.smithi031.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.48560.log.gz 2024-09-17T05:38:05.418 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.48761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48761.log.gz 2024-09-17T05:38:05.418 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45017.log 2024-09-17T05:38:05.419 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43406.log 2024-09-17T05:38:05.419 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38193.log.gz 2024-09-17T05:38:05.419 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42485.log 2024-09-17T05:38:05.420 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45017.log.gz 2024-09-17T05:38:05.420 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43406.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43406.log.gz 2024-09-17T05:38:05.421 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43328.log 2024-09-17T05:38:05.422 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50687.log 2024-09-17T05:38:05.422 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42485.log.gz 2024-09-17T05:38:05.423 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47828.log 2024-09-17T05:38:05.423 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43328.log.gz 2024-09-17T05:38:05.423 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39929.log 2024-09-17T05:38:05.424 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50687.log.gz 2024-09-17T05:38:05.424 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52039.log 2024-09-17T05:38:05.424 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47828.log.gz 2024-09-17T05:38:05.425 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41148.log 2024-09-17T05:38:05.425 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39929.log.gz 2024-09-17T05:38:05.426 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40678.log 2024-09-17T05:38:05.426 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52039.log.gz 2024-09-17T05:38:05.427 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48779.log 2024-09-17T05:38:05.427 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41148.log.gz 2024-09-17T05:38:05.428 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39688.log 2024-09-17T05:38:05.428 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40678.log.gz 2024-09-17T05:38:05.429 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49083.log 2024-09-17T05:38:05.429 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48779.log.gz 2024-09-17T05:38:05.430 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43064.log 2024-09-17T05:38:05.430 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39688.log.gz 2024-09-17T05:38:05.430 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38403.log 2024-09-17T05:38:05.431 INFO:teuthology.orchestra.run.smithi031.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.49083.log.gz 2024-09-17T05:38:05.431 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41115.log 2024-09-17T05:38:05.431 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43064.log.gz 2024-09-17T05:38:05.432 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38403.log: gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38403.log.gz -5 2024-09-17T05:38:05.433 INFO:teuthology.orchestra.run.smithi031.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49718.log 2024-09-17T05:38:05.433 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46665.log 2024-09-17T05:38:05.433 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41115.log.gz 2024-09-17T05:38:05.434 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38076.log 2024-09-17T05:38:05.434 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49718.log.gz 2024-09-17T05:38:05.435 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44176.log 2024-09-17T05:38:05.435 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46665.log.gz 2024-09-17T05:38:05.436 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45867.log 2024-09-17T05:38:05.436 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38076.log.gz 2024-09-17T05:38:05.437 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40860.log 2024-09-17T05:38:05.437 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44176.log.gz 2024-09-17T05:38:05.438 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40387.log 2024-09-17T05:38:05.438 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45867.log.gz 2024-09-17T05:38:05.439 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34589.log 2024-09-17T05:38:05.439 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40860.log.gz 2024-09-17T05:38:05.439 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47977.log 2024-09-17T05:38:05.439 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40387.log.gz 2024-09-17T05:38:05.440 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46609.log 2024-09-17T05:38:05.440 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34589.log.gz 2024-09-17T05:38:05.441 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47951.log 2024-09-17T05:38:05.441 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47977.log.gz 2024-09-17T05:38:05.442 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44001.log 2024-09-17T05:38:05.442 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46609.log.gz 2024-09-17T05:38:05.443 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36490.log 2024-09-17T05:38:05.443 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47951.log.gz 2024-09-17T05:38:05.444 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52622.log 2024-09-17T05:38:05.444 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44001.log.gz 2024-09-17T05:38:05.445 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36490.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36490.log.gz 2024-09-17T05:38:05.445 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43198.log 2024-09-17T05:38:05.446 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42790.log 2024-09-17T05:38:05.446 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52622.log.gz 2024-09-17T05:38:05.447 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43198.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T05:38:05.447 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43198.log.gz 2024-09-17T05:38:05.447 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34639.log 2024-09-17T05:38:05.447 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42790.log.gz 2024-09-17T05:38:05.448 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43029.log 2024-09-17T05:38:05.449 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46373.log 2024-09-17T05:38:05.449 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34639.log.gz 2024-09-17T05:38:05.450 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52877.log 2024-09-17T05:38:05.451 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43029.log.gz 2024-09-17T05:38:05.451 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49320.log 2024-09-17T05:38:05.452 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46373.log: /var/log/ceph/ceph-client.admin.52877.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46373.log.gz 2024-09-17T05:38:05.452 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37968.log 2024-09-17T05:38:05.453 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52877.log.gz 2024-09-17T05:38:05.453 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28743.log 2024-09-17T05:38:05.454 INFO:teuthology.orchestra.run.smithi031.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.49320.log.gz 2024-09-17T05:38:05.454 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41679.log 2024-09-17T05:38:05.455 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37968.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37968.log.gz 2024-09-17T05:38:05.455 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28743.log: gzip 79.1% -- replaced with /var/log/ceph/ceph-client.admin.28743.log.gz -5 2024-09-17T05:38:05.456 INFO:teuthology.orchestra.run.smithi031.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36166.log 2024-09-17T05:38:05.457 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41679.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.41679.log.gz 2024-09-17T05:38:05.457 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44496.log 2024-09-17T05:38:05.458 INFO:teuthology.orchestra.run.smithi031.stderr:gzip/var/log/ceph/ceph-client.admin.36166.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47045.log 2024-09-17T05:38:05.458 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36166.log.gz 2024-09-17T05:38:05.459 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41924.log 2024-09-17T05:38:05.459 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44496.log.gz 2024-09-17T05:38:05.460 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51631.log 2024-09-17T05:38:05.460 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47045.log.gz 2024-09-17T05:38:05.461 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.41924.log: -- /var/log/ceph/ceph-client.admin.54387.log 2024-09-17T05:38:05.461 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41924.log.gz 2024-09-17T05:38:05.462 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42091.log 2024-09-17T05:38:05.462 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51631.log.gz 2024-09-17T05:38:05.463 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54387.log: gzip -5 87.5% --verbose -- replaced with /var/log/ceph/ceph-client.admin.54387.log.gz -- 2024-09-17T05:38:05.463 INFO:teuthology.orchestra.run.smithi031.stderr: /var/log/ceph/ceph-client.admin.34636.log 2024-09-17T05:38:05.464 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34459.log 2024-09-17T05:38:05.464 INFO:teuthology.orchestra.run.smithi031.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42091.log.gz 2024-09-17T05:38:05.465 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45930.log 2024-09-17T05:38:05.465 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34636.log.gz 2024-09-17T05:38:05.466 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34459.log: gzip -5 87.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.34459.log.gz -- 2024-09-17T05:38:05.466 INFO:teuthology.orchestra.run.smithi031.stderr: /var/log/ceph/ceph-client.admin.34643.log 2024-09-17T05:38:05.467 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40039.log 2024-09-17T05:38:05.468 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45930.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45930.log.gz 2024-09-17T05:38:05.469 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35886.log 2024-09-17T05:38:05.469 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34643.log.gz 2024-09-17T05:38:05.470 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40039.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40039.log.gz 2024-09-17T05:38:05.470 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34355.log 2024-09-17T05:38:05.470 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36367.log 2024-09-17T05:38:05.471 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35886.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35886.log.gz 2024-09-17T05:38:05.471 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40309.log 2024-09-17T05:38:05.472 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34355.log.gz 2024-09-17T05:38:05.473 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36367.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36367.log.gz 2024-09-17T05:38:05.473 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50892.log 2024-09-17T05:38:05.473 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37577.log/var/log/ceph/ceph-client.admin.40309.log: 2024-09-17T05:38:05.474 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40309.log.gz 2024-09-17T05:38:05.475 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50255.log 2024-09-17T05:38:05.475 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50892.log.gz 2024-09-17T05:38:05.476 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37577.log: gzip -5 --verbose 86.8% -- -- replaced with /var/log/ceph/ceph-client.admin.37577.log.gz /var/log/ceph/ceph-client.admin.50194.log 2024-09-17T05:38:05.476 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-09-17T05:38:05.477 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34837.log 2024-09-17T05:38:05.477 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50255.log: /var/log/ceph/ceph-client.admin.50194.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50255.log.gz 2024-09-17T05:38:05.478 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50194.log.gz 2024-09-17T05:38:05.478 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43787.log 2024-09-17T05:38:05.479 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48202.log 2024-09-17T05:38:05.479 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34837.log.gz 2024-09-17T05:38:05.480 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35051.log 2024-09-17T05:38:05.480 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43787.log.gz 2024-09-17T05:38:05.481 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.48202.log: -- /var/log/ceph/ceph-client.admin.47880.log 2024-09-17T05:38:05.482 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48202.log.gz 2024-09-17T05:38:05.482 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46531.log 2024-09-17T05:38:05.483 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35051.log.gz 2024-09-17T05:38:05.483 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47880.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47880.log.gz 2024-09-17T05:38:05.484 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34247.log 2024-09-17T05:38:05.484 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41731.log 2024-09-17T05:38:05.486 INFO:teuthology.orchestra.run.smithi155.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T05:38:05.486 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46531.log.gz 2024-09-17T05:38:05.486 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34247.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T05:38:05.486 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34247.log.gz 2024-09-17T05:38:05.487 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41731.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41731.log.gz 2024-09-17T05:38:05.487 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29238.log 2024-09-17T05:38:05.488 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38163.log 2024-09-17T05:38:05.489 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.29238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44072.log 2024-09-17T05:38:05.489 INFO:teuthology.orchestra.run.smithi031.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29238.log.gz 2024-09-17T05:38:05.490 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38163.log: gzip 87.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.38163.log.gz -- 2024-09-17T05:38:05.490 INFO:teuthology.orchestra.run.smithi031.stderr: /var/log/ceph/ceph-client.admin.40651.log 2024-09-17T05:38:05.491 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42660.log 2024-09-17T05:38:05.491 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44072.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44072.log.gz 2024-09-17T05:38:05.492 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45226.log 2024-09-17T05:38:05.492 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40651.log.gz 2024-09-17T05:38:05.493 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37244.log 2024-09-17T05:38:05.493 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42660.log.gz 2024-09-17T05:38:05.494 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39323.log 2024-09-17T05:38:05.494 INFO:teuthology.orchestra.run.smithi031.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45226.log.gz 2024-09-17T05:38:05.495 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43276.log 2024-09-17T05:38:05.495 INFO:teuthology.orchestra.run.smithi031.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37244.log.gz 2024-09-17T05:38:05.496 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39323.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39323.log.gz 2024-09-17T05:38:05.496 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35317.log 2024-09-17T05:38:05.497 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40808.log 2024-09-17T05:38:05.498 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43276.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43276.log.gz 2024-09-17T05:38:05.499 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54491.log 2024-09-17T05:38:05.499 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35317.log.gz 2024-09-17T05:38:05.500 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48268.log 2024-09-17T05:38:05.500 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40808.log.gz 2024-09-17T05:38:05.501 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43754.log 2024-09-17T05:38:05.501 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54491.log.gz 2024-09-17T05:38:05.501 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36938.log 2024-09-17T05:38:05.502 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48268.log.gz 2024-09-17T05:38:05.503 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43529.log 2024-09-17T05:38:05.503 INFO:teuthology.orchestra.run.smithi031.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43754.log.gz 2024-09-17T05:38:05.503 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40450.log/var/log/ceph/ceph-client.admin.36938.log: 2024-09-17T05:38:05.504 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36938.log.gz 2024-09-17T05:38:05.505 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.43529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43529.log.gz 2024-09-17T05:38:05.505 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54803.log 2024-09-17T05:38:05.506 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41976.log 2024-09-17T05:38:05.506 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40450.log.gz 2024-09-17T05:38:05.507 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39297.log 2024-09-17T05:38:05.507 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54803.log.gz 2024-09-17T05:38:05.508 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40361.log 2024-09-17T05:38:05.509 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41976.log.gz 2024-09-17T05:38:05.509 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41950.log 2024-09-17T05:38:05.509 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39297.log.gz 2024-09-17T05:38:05.510 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47578.log 2024-09-17T05:38:05.511 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40361.log.gz 2024-09-17T05:38:05.511 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44771.log 2024-09-17T05:38:05.512 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41950.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.41950.log.gz 2024-09-17T05:38:05.513 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47578.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47578.log.gz 2024-09-17T05:38:05.513 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37330.log 2024-09-17T05:38:05.513 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42608.log 2024-09-17T05:38:05.514 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44771.log.gz 2024-09-17T05:38:05.515 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36569.log 2024-09-17T05:38:05.515 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37330.log.gz 2024-09-17T05:38:05.516 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42608.log: gzip 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42608.log.gz 2024-09-17T05:38:05.516 INFO:teuthology.orchestra.run.smithi031.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46835.log 2024-09-17T05:38:05.517 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39629.log 2024-09-17T05:38:05.517 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36569.log.gz 2024-09-17T05:38:05.518 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51605.log 2024-09-17T05:38:05.518 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46835.log.gz 2024-09-17T05:38:05.519 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48428.log 2024-09-17T05:38:05.519 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39629.log.gz 2024-09-17T05:38:05.520 INFO:teuthology.orchestra.run.smithi031.stderr:gzip/var/log/ceph/ceph-client.admin.51605.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50757.log 2024-09-17T05:38:05.520 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51605.log.gz 2024-09-17T05:38:05.521 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36543.log 2024-09-17T05:38:05.521 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48428.log.gz 2024-09-17T05:38:05.523 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41601.log 2024-09-17T05:38:05.523 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50757.log.gz 2024-09-17T05:38:05.523 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45056.log 2024-09-17T05:38:05.524 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36543.log.gz 2024-09-17T05:38:05.524 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28977.log 2024-09-17T05:38:05.525 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41601.log.gz 2024-09-17T05:38:05.531 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45681.log 2024-09-17T05:38:05.531 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45056.log.gz 2024-09-17T05:38:05.531 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54699.log 2024-09-17T05:38:05.531 INFO:teuthology.orchestra.run.smithi031.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.28977.log.gz 2024-09-17T05:38:05.531 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40959.log 2024-09-17T05:38:05.531 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45681.log.gz 2024-09-17T05:38:05.531 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46727.log 2024-09-17T05:38:05.531 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54699.log.gz 2024-09-17T05:38:05.531 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44098.log 2024-09-17T05:38:05.531 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40959.log.gz 2024-09-17T05:38:05.531 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44825.log 2024-09-17T05:38:05.532 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46727.log.gz 2024-09-17T05:38:05.532 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51987.log 2024-09-17T05:38:05.532 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44098.log.gz 2024-09-17T05:38:05.533 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37394.log 2024-09-17T05:38:05.534 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51987.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44825.log.gz 2024-09-17T05:38:05.534 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51987.log.gz 2024-09-17T05:38:05.534 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50609.log 2024-09-17T05:38:05.535 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34511.log 2024-09-17T05:38:05.536 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37394.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37394.log.gz 2024-09-17T05:38:05.536 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50609.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50609.log.gz 2024-09-17T05:38:05.536 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36399.log 2024-09-17T05:38:05.538 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43871.log 2024-09-17T05:38:05.538 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34511.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34511.log.gz 2024-09-17T05:38:05.538 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50545.log 2024-09-17T05:38:05.538 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36399.log.gz 2024-09-17T05:38:05.539 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34640.log 2024-09-17T05:38:05.540 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43871.log.gz 2024-09-17T05:38:05.541 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50545.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50545.log.gz 2024-09-17T05:38:05.541 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51423.log 2024-09-17T05:38:05.541 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36088.log 2024-09-17T05:38:05.543 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34640.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34640.log.gz 2024-09-17T05:38:05.543 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51423.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51423.log.gz 2024-09-17T05:38:05.543 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42823.log 2024-09-17T05:38:05.543 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47925.log 2024-09-17T05:38:05.544 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36088.log.gz 2024-09-17T05:38:05.544 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42823.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42823.log.gz 2024-09-17T05:38:05.545 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43250.log 2024-09-17T05:38:05.545 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52570.log 2024-09-17T05:38:05.546 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47925.log.gz 2024-09-17T05:38:05.546 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43250.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43250.log.gz 2024-09-17T05:38:05.547 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44436.log 2024-09-17T05:38:05.547 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.52570.log: -- /var/log/ceph/ceph-client.admin.53298.log 2024-09-17T05:38:05.548 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52570.log.gz 2024-09-17T05:38:05.548 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54673.log 2024-09-17T05:38:05.550 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44436.log.gz 2024-09-17T05:38:05.550 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51116.log 2024-09-17T05:38:05.551 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53298.log.gz 2024-09-17T05:38:05.552 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35481.log 2024-09-17T05:38:05.552 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54673.log.gz 2024-09-17T05:38:05.552 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53046.log 2024-09-17T05:38:05.552 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51116.log.gz 2024-09-17T05:38:05.553 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35481.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35481.log.gz 2024-09-17T05:38:05.553 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41180.log 2024-09-17T05:38:05.554 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46321.log 2024-09-17T05:38:05.554 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53046.log.gz 2024-09-17T05:38:05.555 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38936.log 2024-09-17T05:38:05.555 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41180.log.gz 2024-09-17T05:38:05.556 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36464.log 2024-09-17T05:38:05.556 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46321.log.gz 2024-09-17T05:38:05.557 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38936.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.38936.log.gz 2024-09-17T05:38:05.557 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48170.log 2024-09-17T05:38:05.558 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39000.log 2024-09-17T05:38:05.559 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36464.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36464.log.gz 2024-09-17T05:38:05.560 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36990.log 2024-09-17T05:38:05.560 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48170.log.gz 2024-09-17T05:38:05.561 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48883.log 2024-09-17T05:38:05.561 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39000.log.gz 2024-09-17T05:38:05.562 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49345.log 2024-09-17T05:38:05.562 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36990.log.gz 2024-09-17T05:38:05.563 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42004.log 2024-09-17T05:38:05.563 INFO:teuthology.orchestra.run.smithi031.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.48883.log.gz 2024-09-17T05:38:05.564 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49345.log: gzip 84.6% -- replaced with /var/log/ceph/ceph-client.admin.49345.log.gz -5 2024-09-17T05:38:05.564 INFO:teuthology.orchestra.run.smithi031.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43676.log 2024-09-17T05:38:05.565 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.42004.log: -- /var/log/ceph/ceph-client.admin.53480.log 2024-09-17T05:38:05.565 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42004.log.gz 2024-09-17T05:38:05.566 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41063.log 2024-09-17T05:38:05.566 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43676.log.gz 2024-09-17T05:38:05.567 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39030.log 2024-09-17T05:38:05.567 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53480.log.gz 2024-09-17T05:38:05.568 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28958.log 2024-09-17T05:38:05.569 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41063.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.41063.log.gz 2024-09-17T05:38:05.569 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49823.log 2024-09-17T05:38:05.569 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39030.log.gz 2024-09-17T05:38:05.570 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37182.log 2024-09-17T05:38:05.570 INFO:teuthology.orchestra.run.smithi031.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.28958.log.gz 2024-09-17T05:38:05.571 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47776.log 2024-09-17T05:38:05.572 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49823.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49823.log.gz 2024-09-17T05:38:05.572 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54777.log 2024-09-17T05:38:05.572 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37182.log.gz 2024-09-17T05:38:05.573 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45096.log 2024-09-17T05:38:05.573 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47776.log.gz 2024-09-17T05:38:05.574 INFO:teuthology.orchestra.run.smithi031.stderr:gzip/var/log/ceph/ceph-client.admin.54777.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48638.log 2024-09-17T05:38:05.575 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54777.log.gz 2024-09-17T05:38:05.576 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52141.log 2024-09-17T05:38:05.576 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45096.log.gz 2024-09-17T05:38:05.577 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52851.log 2024-09-17T05:38:05.577 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48638.log.gz 2024-09-17T05:38:05.578 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54283.log 2024-09-17T05:38:05.578 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52141.log.gz 2024-09-17T05:38:05.579 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53506.log 2024-09-17T05:38:05.579 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52851.log.gz 2024-09-17T05:38:05.580 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54283.log: 86.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.54283.log.gz 2024-09-17T05:38:05.580 INFO:teuthology.orchestra.run.smithi031.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.28964.log 2024-09-17T05:38:05.581 INFO:teuthology.orchestra.run.smithi031.stderr:gzip/var/log/ceph/ceph-client.admin.53506.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51831.log 2024-09-17T05:38:05.581 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28964.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53506.log.gz 2024-09-17T05:38:05.582 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35421.log 2024-09-17T05:38:05.582 INFO:teuthology.orchestra.run.smithi031.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.28964.log.gz 2024-09-17T05:38:05.583 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51831.log: 87.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.51831.log.gz 2024-09-17T05:38:05.583 INFO:teuthology.orchestra.run.smithi031.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53672.log 2024-09-17T05:38:05.584 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36833.log 2024-09-17T05:38:05.585 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53672.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.35421.log.gz 2024-09-17T05:38:05.585 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38701.log 2024-09-17T05:38:05.585 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53672.log.gz 2024-09-17T05:38:05.586 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45788.log 2024-09-17T05:38:05.587 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36833.log.gz 2024-09-17T05:38:05.588 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38701.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.49446.log 2024-09-17T05:38:05.588 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38701.log.gz 2024-09-17T05:38:05.589 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45122.log 2024-09-17T05:38:05.589 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45788.log.gz 2024-09-17T05:38:05.590 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51579.log 2024-09-17T05:38:05.590 INFO:teuthology.orchestra.run.smithi031.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.49446.log.gz 2024-09-17T05:38:05.591 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38732.log 2024-09-17T05:38:05.591 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45122.log.gz 2024-09-17T05:38:05.592 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51579.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51579.log.gz 2024-09-17T05:38:05.592 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45148.log 2024-09-17T05:38:05.593 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46861.log/var/log/ceph/ceph-client.admin.38732.log: 2024-09-17T05:38:05.593 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38732.log.gz 2024-09-17T05:38:05.594 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50018.log 2024-09-17T05:38:05.594 INFO:teuthology.orchestra.run.smithi031.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45148.log.gz 2024-09-17T05:38:05.595 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43224.log 2024-09-17T05:38:05.596 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46861.log.gz 2024-09-17T05:38:05.596 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50018.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50018.log.gz 2024-09-17T05:38:05.596 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44719.log 2024-09-17T05:38:05.597 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28984.log 2024-09-17T05:38:05.598 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43224.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43224.log.gz 2024-09-17T05:38:05.599 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41467.log 2024-09-17T05:38:05.599 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44719.log.gz 2024-09-17T05:38:05.600 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28923.log 2024-09-17T05:38:05.600 INFO:teuthology.orchestra.run.smithi031.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.28984.log.gz 2024-09-17T05:38:05.601 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54751.log 2024-09-17T05:38:05.601 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41467.log.gz 2024-09-17T05:38:05.602 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47168.log 2024-09-17T05:38:05.602 INFO:teuthology.orchestra.run.smithi031.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.28923.log.gz 2024-09-17T05:38:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43818.log 2024-09-17T05:38:05.603 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54751.log.gz 2024-09-17T05:38:05.604 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.47168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46583.log 2024-09-17T05:38:05.604 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47168.log.gz 2024-09-17T05:38:05.605 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43818.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43818.log.gz 2024-09-17T05:38:05.605 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-17T05:38:05.606 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44611.log 2024-09-17T05:38:05.607 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46583.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46583.log.gz 2024-09-17T05:38:05.607 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46120.log 2024-09-17T05:38:05.609 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34841.log 2024-09-17T05:38:05.609 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44611.log.gz 2024-09-17T05:38:05.609 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50813.log 2024-09-17T05:38:05.610 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46120.log.gz 2024-09-17T05:38:05.611 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43949.log 2024-09-17T05:38:05.611 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34841.log.gz 2024-09-17T05:38:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50813.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50813.log.gz 2024-09-17T05:38:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42855.log 2024-09-17T05:38:05.614 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43949.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43949.log.gz 2024-09-17T05:38:05.614 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36270.log 2024-09-17T05:38:05.615 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41089.log 2024-09-17T05:38:05.615 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42855.log.gz 2024-09-17T05:38:05.616 INFO:teuthology.orchestra.run.smithi155.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-17T05:38:05.616 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36270.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36270.log.gz 2024-09-17T05:38:05.617 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41089.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41089.log.gz 2024-09-17T05:38:05.618 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35058.log 2024-09-17T05:38:05.619 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45736.log 2024-09-17T05:38:05.621 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54361.log 2024-09-17T05:38:05.621 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35058.log.gz 2024-09-17T05:38:05.621 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45736.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45736.log.gz 2024-09-17T05:38:05.622 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54361.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54361.log.gz 2024-09-17T05:38:05.623 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38297.log 2024-09-17T05:38:05.624 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50108.log 2024-09-17T05:38:05.626 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49953.log 2024-09-17T05:38:05.626 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38297.log.gz 2024-09-17T05:38:05.627 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50108.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50108.log.gz 2024-09-17T05:38:05.628 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49953.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49953.log.gz 2024-09-17T05:38:05.628 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37499.log 2024-09-17T05:38:05.629 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50921.log 2024-09-17T05:38:05.631 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45710.log 2024-09-17T05:38:05.631 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37499.log.gz 2024-09-17T05:38:05.632 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50921.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50921.log.gz 2024-09-17T05:38:05.633 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45710.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45710.log.gz 2024-09-17T05:38:05.634 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41011.log 2024-09-17T05:38:05.635 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43652.log 2024-09-17T05:38:05.636 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54647.log 2024-09-17T05:38:05.636 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41011.log.gz 2024-09-17T05:38:05.637 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43652.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.43652.log.gz 2024-09-17T05:38:05.638 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54647.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54647.log.gz 2024-09-17T05:38:05.639 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49370.log 2024-09-17T05:38:05.640 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40505.log 2024-09-17T05:38:05.641 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54128.log 2024-09-17T05:38:05.641 INFO:teuthology.orchestra.run.smithi031.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.49370.log.gz 2024-09-17T05:38:05.643 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40730.log 2024-09-17T05:38:05.643 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.40505.log.gz 2024-09-17T05:38:05.644 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54128.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54128.log.gz 2024-09-17T05:38:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37208.log 2024-09-17T05:38:05.645 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40730.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40730.log.gz 2024-09-17T05:38:05.647 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37208.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37208.log.gz 2024-09-17T05:38:05.647 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34843.log 2024-09-17T05:38:05.648 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48402.log 2024-09-17T05:38:05.650 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34104.log 2024-09-17T05:38:05.650 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34843.log.gz 2024-09-17T05:38:05.651 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48402.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48402.log.gz 2024-09-17T05:38:05.652 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34104.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34104.log.gz 2024-09-17T05:38:05.653 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48534.log 2024-09-17T05:38:05.653 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42712.log 2024-09-17T05:38:05.655 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44559.log 2024-09-17T05:38:05.655 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48534.log.gz 2024-09-17T05:38:05.657 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42712.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42712.log.gz 2024-09-17T05:38:05.657 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44559.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44559.log.gz 2024-09-17T05:38:05.658 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43626.log 2024-09-17T05:38:05.659 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39811.log 2024-09-17T05:38:05.660 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34641.log 2024-09-17T05:38:05.660 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43626.log.gz 2024-09-17T05:38:05.662 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39811.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39811.log.gz 2024-09-17T05:38:05.662 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34641.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34641.log.gz 2024-09-17T05:38:05.663 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51723.log 2024-09-17T05:38:05.664 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39837.log 2024-09-17T05:38:05.665 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46783.log 2024-09-17T05:38:05.665 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51723.log.gz 2024-09-17T05:38:05.667 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49245.log 2024-09-17T05:38:05.667 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39837.log.gz 2024-09-17T05:38:05.668 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46783.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46783.log.gz 2024-09-17T05:38:05.669 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29381.log 2024-09-17T05:38:05.669 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49245.log: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.49245.log.gz 2024-09-17T05:38:05.669 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54543.log 2024-09-17T05:38:05.671 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.29381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48320.log 2024-09-17T05:38:05.671 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29381.log.gz 2024-09-17T05:38:05.672 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54543.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54543.log.gz 2024-09-17T05:38:05.673 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48320.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48320.log.gz 2024-09-17T05:38:05.674 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28830.log 2024-09-17T05:38:05.675 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38323.log 2024-09-17T05:38:05.676 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41757.log 2024-09-17T05:38:05.677 INFO:teuthology.orchestra.run.smithi031.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.28830.log.gz 2024-09-17T05:38:05.678 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38323.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38323.log.gz 2024-09-17T05:38:05.679 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41757.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41757.log.gz 2024-09-17T05:38:05.679 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39785.log 2024-09-17T05:38:05.680 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41272.log 2024-09-17T05:38:05.682 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37113.log 2024-09-17T05:38:05.682 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39785.log.gz 2024-09-17T05:38:05.683 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41272.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41272.log.gz 2024-09-17T05:38:05.684 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.37113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40782.log 2024-09-17T05:38:05.684 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37113.log.gz 2024-09-17T05:38:05.685 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35056.log 2024-09-17T05:38:05.687 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28818.log 2024-09-17T05:38:05.687 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40782.log.gz 2024-09-17T05:38:05.688 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35056.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35056.log.gz 2024-09-17T05:38:05.689 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28818.log: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.28818.log.gz 2024-09-17T05:38:05.690 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34850.log 2024-09-17T05:38:05.690 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41705.log 2024-09-17T05:38:05.692 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37447.log 2024-09-17T05:38:05.692 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34850.log.gz 2024-09-17T05:38:05.693 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41705.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41705.log.gz 2024-09-17T05:38:05.694 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37447.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37447.log.gz 2024-09-17T05:38:05.695 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T05:38:05.696 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41352.log 2024-09-17T05:38:05.697 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36673.log 2024-09-17T05:38:05.699 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41352.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41352.log.gz 2024-09-17T05:38:05.700 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36673.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36673.log.gz 2024-09-17T05:38:05.700 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46269.log 2024-09-17T05:38:05.701 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36140.log 2024-09-17T05:38:05.703 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46269.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46269.log.gz 2024-09-17T05:38:05.704 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36140.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36140.log.gz 2024-09-17T05:38:05.704 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37473.log 2024-09-17T05:38:05.705 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52648.log 2024-09-17T05:38:05.707 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37473.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37473.log.gz 2024-09-17T05:38:05.708 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52648.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52648.log.gz 2024-09-17T05:38:05.708 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40583.log 2024-09-17T05:38:05.709 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46939.log 2024-09-17T05:38:05.711 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40583.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40583.log.gz 2024-09-17T05:38:05.712 INFO:teuthology.orchestra.run.smithi155.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T05:38:05.713 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46939.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46939.log.gz 2024-09-17T05:38:05.713 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39219.log 2024-09-17T05:38:05.714 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35728.log 2024-09-17T05:38:05.715 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39219.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39219.log.gz 2024-09-17T05:38:05.716 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.2.35728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.35728.log.gz 2024-09-17T05:38:05.716 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49158.log 2024-09-17T05:38:05.717 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53192.log 2024-09-17T05:38:05.719 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49158.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.49158.log.gz 2024-09-17T05:38:05.719 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53192.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53192.log.gz 2024-09-17T05:38:05.720 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52188.log 2024-09-17T05:38:05.721 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43706.log 2024-09-17T05:38:05.722 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.52188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52188.log.gz 2024-09-17T05:38:05.723 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43706.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.43706.log.gz 2024-09-17T05:38:05.724 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38758.log 2024-09-17T05:38:05.725 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34835.log 2024-09-17T05:38:05.727 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38758.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38758.log.gz 2024-09-17T05:38:05.727 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34835.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34835.log.gz 2024-09-17T05:38:05.728 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36621.log 2024-09-17T05:38:05.734 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35998.log 2024-09-17T05:38:05.734 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36621.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36621.log.gz 2024-09-17T05:38:05.735 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35998.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35998.log.gz 2024-09-17T05:38:05.735 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36029.log 2024-09-17T05:38:05.735 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39060.log 2024-09-17T05:38:05.737 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36029.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36029.log.gz 2024-09-17T05:38:05.737 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39060.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39060.log.gz 2024-09-17T05:38:05.737 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39894.log 2024-09-17T05:38:05.738 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44202.log 2024-09-17T05:38:05.739 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39894.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39894.log.gz 2024-09-17T05:38:05.740 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44202.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44202.log.gz 2024-09-17T05:38:05.741 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40091.log 2024-09-17T05:38:05.742 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51909.log 2024-09-17T05:38:05.743 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40091.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40091.log.gz 2024-09-17T05:38:05.744 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43172.log 2024-09-17T05:38:05.745 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51909.log.gz 2024-09-17T05:38:05.748 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35938.log 2024-09-17T05:38:05.748 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43172.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43172.log.gz 2024-09-17T05:38:05.749 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35938.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35938.log.gz 2024-09-17T05:38:05.749 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46809.log 2024-09-17T05:38:05.749 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52486.log 2024-09-17T05:38:05.751 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46809.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46809.log.gz 2024-09-17T05:38:05.752 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52486.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52486.log.gz 2024-09-17T05:38:05.752 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37785.log 2024-09-17T05:38:05.753 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44965.log 2024-09-17T05:38:05.755 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37785.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37785.log.gz 2024-09-17T05:38:05.756 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44965.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44965.log.gz 2024-09-17T05:38:05.756 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52283.log 2024-09-17T05:38:05.757 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43090.log 2024-09-17T05:38:05.759 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52283.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52283.log.gz 2024-09-17T05:38:05.759 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43090.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43090.log.gz 2024-09-17T05:38:05.760 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34381.log 2024-09-17T05:38:05.761 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51194.log 2024-09-17T05:38:05.763 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34381.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34381.log.gz 2024-09-17T05:38:05.764 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51194.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51194.log.gz 2024-09-17T05:38:05.764 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46243.log 2024-09-17T05:38:05.765 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35912.log 2024-09-17T05:38:05.767 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46243.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46243.log.gz 2024-09-17T05:38:05.768 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35912.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35912.log.gz 2024-09-17T05:38:05.768 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43572.log 2024-09-17T05:38:05.769 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40476.log 2024-09-17T05:38:05.771 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43572.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43572.log.gz 2024-09-17T05:38:05.772 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40476.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40476.log.gz 2024-09-17T05:38:05.772 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34329.log 2024-09-17T05:38:05.773 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47640.log 2024-09-17T05:38:05.775 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34329.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34329.log.gz 2024-09-17T05:38:05.776 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53972.log 2024-09-17T05:38:05.777 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47640.log.gz 2024-09-17T05:38:05.777 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44745.log 2024-09-17T05:38:05.778 INFO:teuthology.orchestra.run.smithi155.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T05:38:05.779 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53972.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53972.log.gz 2024-09-17T05:38:05.780 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44745.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44745.log.gz 2024-09-17T05:38:05.780 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36886.log 2024-09-17T05:38:05.781 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46757.log 2024-09-17T05:38:05.783 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36886.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36886.log.gz 2024-09-17T05:38:05.784 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46757.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46757.log.gz 2024-09-17T05:38:05.784 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43730.log 2024-09-17T05:38:05.785 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48003.log 2024-09-17T05:38:05.787 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43730.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.43730.log.gz 2024-09-17T05:38:05.787 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48003.log: 93.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-17T05:38:05.788 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46637.log 2024-09-17T05:38:05.789 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48003.log.gz 2024-09-17T05:38:05.789 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34537.log 2024-09-17T05:38:05.790 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35031.log 2024-09-17T05:38:05.791 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46637.log.gz 2024-09-17T05:38:05.793 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34537.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34537.log.gz 2024-09-17T05:38:05.793 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35031.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35031.log.gz 2024-09-17T05:38:05.793 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43354.log 2024-09-17T05:38:05.794 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44939.log 2024-09-17T05:38:05.796 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38375.log 2024-09-17T05:38:05.796 INFO:teuthology.orchestra.run.smithi031.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43354.log.gz 2024-09-17T05:38:05.796 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44939.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44939.log.gz 2024-09-17T05:38:05.798 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38375.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38375.log.gz 2024-09-17T05:38:05.798 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47238.log 2024-09-17T05:38:05.799 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49901.log 2024-09-17T05:38:05.801 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47238.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47238.log.gz 2024-09-17T05:38:05.802 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49901.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49901.log.gz 2024-09-17T05:38:05.802 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37837.log 2024-09-17T05:38:05.803 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38531.log 2024-09-17T05:38:05.805 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52544.log 2024-09-17T05:38:05.805 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37837.log.gz 2024-09-17T05:38:05.806 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38531.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38531.log.gz 2024-09-17T05:38:05.808 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52544.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52544.log.gz 2024-09-17T05:38:05.808 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51317.log 2024-09-17T05:38:05.809 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39271.log 2024-09-17T05:38:05.810 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35291.log 2024-09-17T05:38:05.810 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51317.log.gz 2024-09-17T05:38:05.811 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39271.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39271.log.gz 2024-09-17T05:38:05.812 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49771.log 2024-09-17T05:38:05.813 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39446.log 2024-09-17T05:38:05.814 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35291.log.gz 2024-09-17T05:38:05.814 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51239.log 2024-09-17T05:38:05.815 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49771.log.gz 2024-09-17T05:38:05.815 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39446.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39446.log.gz 2024-09-17T05:38:05.817 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51239.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51239.log.gz 2024-09-17T05:38:05.817 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50661.log 2024-09-17T05:38:05.818 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44410.log 2024-09-17T05:38:05.819 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48664.log 2024-09-17T05:38:05.819 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50661.log.gz 2024-09-17T05:38:05.821 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44410.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44410.log.gz 2024-09-17T05:38:05.822 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48664.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48664.log.gz 2024-09-17T05:38:05.823 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34407.log 2024-09-17T05:38:05.824 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53919.log 2024-09-17T05:38:05.825 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47390.log 2024-09-17T05:38:05.825 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34407.log.gz 2024-09-17T05:38:05.826 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53919.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53919.log.gz 2024-09-17T05:38:05.828 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47390.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47390.log.gz 2024-09-17T05:38:05.828 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38219.log 2024-09-17T05:38:05.829 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42370.log 2024-09-17T05:38:05.831 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54024.log 2024-09-17T05:38:05.831 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38219.log.gz 2024-09-17T05:38:05.831 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42370.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42370.log.gz 2024-09-17T05:38:05.833 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54024.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54024.log.gz 2024-09-17T05:38:05.833 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52825.log 2024-09-17T05:38:05.834 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34078.log 2024-09-17T05:38:05.836 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42344.log 2024-09-17T05:38:05.836 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52825.log.gz 2024-09-17T05:38:05.837 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34078.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34078.log.gz 2024-09-17T05:38:05.838 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42344.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42344.log.gz 2024-09-17T05:38:05.839 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53376.log 2024-09-17T05:38:05.840 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47186.log 2024-09-17T05:38:05.841 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49640.log 2024-09-17T05:38:05.841 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53376.log.gz 2024-09-17T05:38:05.842 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47186.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47186.log.gz 2024-09-17T05:38:05.843 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49640.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49640.log.gz 2024-09-17T05:38:05.844 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50783.log 2024-09-17T05:38:05.845 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42061.log 2024-09-17T05:38:05.847 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35369.log 2024-09-17T05:38:05.847 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50783.log.gz 2024-09-17T05:38:05.848 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42061.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42061.log.gz 2024-09-17T05:38:05.849 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35369.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35369.log.gz 2024-09-17T05:38:05.849 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44875.log 2024-09-17T05:38:05.850 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52368.log 2024-09-17T05:38:05.852 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34629.log 2024-09-17T05:38:05.852 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44875.log.gz 2024-09-17T05:38:05.853 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52368.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52368.log.gz 2024-09-17T05:38:05.855 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34629.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34629.log.gz 2024-09-17T05:38:05.855 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35964.log 2024-09-17T05:38:05.855 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T05:38:05.857 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43482.log 2024-09-17T05:38:05.857 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35964.log.gz 2024-09-17T05:38:05.859 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.43482.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43482.log.gz 2024-09-17T05:38:05.859 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48586.log 2024-09-17T05:38:05.860 INFO:teuthology.orchestra.run.smithi031.stderr: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T05:38:05.861 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43432.log 2024-09-17T05:38:05.862 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48586.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48586.log.gz 2024-09-17T05:38:05.863 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43432.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43432.log.gz 2024-09-17T05:38:05.864 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50443.log 2024-09-17T05:38:05.865 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34160.log 2024-09-17T05:38:05.866 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45817.log 2024-09-17T05:38:05.867 INFO:teuthology.orchestra.run.smithi031.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.50443.log.gz 2024-09-17T05:38:05.867 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34160.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34160.log.gz 2024-09-17T05:38:05.868 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40620.log 2024-09-17T05:38:05.869 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53014.log 2024-09-17T05:38:05.869 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45817.log.gz 2024-09-17T05:38:05.870 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35054.log 2024-09-17T05:38:05.871 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40620.log.gz 2024-09-17T05:38:05.871 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53014.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53014.log.gz 2024-09-17T05:38:05.873 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35054.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35054.log.gz 2024-09-17T05:38:05.873 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49033.log 2024-09-17T05:38:05.874 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52596.log 2024-09-17T05:38:05.876 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42117.log 2024-09-17T05:38:05.876 INFO:teuthology.orchestra.run.smithi031.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.49033.log.gz 2024-09-17T05:38:05.877 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52596.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52596.log.gz 2024-09-17T05:38:05.878 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42117.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42117.log.gz 2024-09-17T05:38:05.878 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52517.log 2024-09-17T05:38:05.880 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38874.log 2024-09-17T05:38:05.881 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41441.log 2024-09-17T05:38:05.881 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52517.log.gz 2024-09-17T05:38:05.882 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38874.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38874.log.gz 2024-09-17T05:38:05.883 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41441.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41441.log.gz 2024-09-17T05:38:05.884 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40292.log 2024-09-17T05:38:05.885 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42946.log 2024-09-17T05:38:05.886 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.40292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38048.log 2024-09-17T05:38:05.886 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.40292.log.gz 2024-09-17T05:38:05.887 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48805.log 2024-09-17T05:38:05.887 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42946.log.gz 2024-09-17T05:38:05.888 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38048.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38048.log.gz 2024-09-17T05:38:05.890 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48805.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48805.log.gz 2024-09-17T05:38:05.890 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44641.log 2024-09-17T05:38:05.892 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35038.log 2024-09-17T05:38:05.893 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49108.log 2024-09-17T05:38:05.893 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44641.log.gz 2024-09-17T05:38:05.894 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35038.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35038.log.gz 2024-09-17T05:38:05.895 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49108.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.49108.log.gz 2024-09-17T05:38:05.895 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39090.log 2024-09-17T05:38:05.897 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43845.log 2024-09-17T05:38:05.898 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36244.log 2024-09-17T05:38:05.898 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39090.log.gz 2024-09-17T05:38:05.899 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43845.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43845.log.gz 2024-09-17T05:38:05.900 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36244.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36244.log.gz 2024-09-17T05:38:05.901 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52091.log 2024-09-17T05:38:05.902 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44922.log 2024-09-17T05:38:05.904 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48032.log 2024-09-17T05:38:05.904 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.44922.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52091.log.gz 2024-09-17T05:38:05.904 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44922.log.gz 2024-09-17T05:38:05.905 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48032.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48032.log.gz 2024-09-17T05:38:05.906 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38429.log 2024-09-17T05:38:05.907 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53998.log 2024-09-17T05:38:05.909 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53163.log 2024-09-17T05:38:05.909 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38429.log.gz 2024-09-17T05:38:05.909 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53998.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53998.log.gz 2024-09-17T05:38:05.911 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53163.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53163.log.gz 2024-09-17T05:38:05.911 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51168.log 2024-09-17T05:38:05.912 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51012.log 2024-09-17T05:38:05.913 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39245.log 2024-09-17T05:38:05.914 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51168.log.gz 2024-09-17T05:38:05.914 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51012.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51012.log.gz 2024-09-17T05:38:05.916 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39245.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39245.log.gz 2024-09-17T05:38:05.916 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36058.log 2024-09-17T05:38:05.917 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37811.log 2024-09-17T05:38:05.919 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28961.log 2024-09-17T05:38:05.919 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36058.log.gz 2024-09-17T05:38:05.920 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37811.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37811.log.gz 2024-09-17T05:38:05.921 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28961.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.28961.log.gz 2024-09-17T05:38:05.921 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35059.log 2024-09-17T05:38:05.923 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47071.log 2024-09-17T05:38:05.924 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45276.log 2024-09-17T05:38:05.924 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35059.log.gz 2024-09-17T05:38:05.925 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47071.log: /var/log/ceph/ceph-client.admin.45276.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47071.log.gz 2024-09-17T05:38:05.926 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45276.log.gz 2024-09-17T05:38:05.926 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40933.log 2024-09-17T05:38:05.928 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38020.log 2024-09-17T05:38:05.929 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34221.log 2024-09-17T05:38:05.929 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40933.log.gz 2024-09-17T05:38:05.930 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38020.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38020.log.gz 2024-09-17T05:38:05.931 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34221.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34221.log.gz 2024-09-17T05:38:05.932 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37629.log 2024-09-17T05:38:05.933 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41834.log 2024-09-17T05:38:05.937 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41575.log 2024-09-17T05:38:05.937 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37629.log.gz 2024-09-17T05:38:05.937 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41834.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41834.log.gz 2024-09-17T05:38:05.937 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41575.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41575.log.gz 2024-09-17T05:38:05.937 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40169.log 2024-09-17T05:38:05.938 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53556.log 2024-09-17T05:38:05.939 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38271.log 2024-09-17T05:38:05.939 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40169.log.gz 2024-09-17T05:38:05.940 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53556.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53556.log.gz 2024-09-17T05:38:05.942 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38271.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38271.log.gz 2024-09-17T05:38:05.942 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48508.log 2024-09-17T05:38:05.943 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54413.log 2024-09-17T05:38:05.945 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48508.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48508.log.gz 2024-09-17T05:38:05.946 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54413.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54413.log.gz 2024-09-17T05:38:05.946 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43380.log 2024-09-17T05:38:05.947 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37870.log 2024-09-17T05:38:05.949 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44280.log 2024-09-17T05:38:05.949 INFO:teuthology.orchestra.run.smithi031.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.43380.log.gz 2024-09-17T05:38:05.950 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37870.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37870.log.gz 2024-09-17T05:38:05.951 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44280.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44280.log.gz 2024-09-17T05:38:05.951 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36218.log 2024-09-17T05:38:05.953 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33951.log 2024-09-17T05:38:05.954 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51883.log 2024-09-17T05:38:05.954 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36218.log.gz 2024-09-17T05:38:05.955 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33951.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33951.log.gz 2024-09-17T05:38:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51883.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51883.log.gz 2024-09-17T05:38:05.956 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28970.log 2024-09-17T05:38:05.957 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39720.log 2024-09-17T05:38:05.959 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54855.log 2024-09-17T05:38:05.959 INFO:teuthology.orchestra.run.smithi031.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28970.log.gz 2024-09-17T05:38:05.961 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39720.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39720.log.gz 2024-09-17T05:38:05.961 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54855.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54855.log.gz 2024-09-17T05:38:05.962 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48084.log 2024-09-17T05:38:05.963 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36647.log 2024-09-17T05:38:05.964 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28963.log 2024-09-17T05:38:05.964 INFO:teuthology.orchestra.run.smithi031.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48084.log.gz 2024-09-17T05:38:05.966 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36647.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36647.log.gz 2024-09-17T05:38:05.966 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28963.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.28963.log.gz 2024-09-17T05:38:05.967 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52726.log 2024-09-17T05:38:05.968 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36860.log 2024-09-17T05:38:05.969 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52674.log 2024-09-17T05:38:05.970 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52726.log.gz 2024-09-17T05:38:05.972 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36860.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36860.log.gz 2024-09-17T05:38:05.972 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52674.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52674.log.gz 2024-09-17T05:38:05.972 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49614.log 2024-09-17T05:38:05.973 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42035.log 2024-09-17T05:38:05.976 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54154.log 2024-09-17T05:38:05.976 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49614.log.gz 2024-09-17T05:38:05.976 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42035.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42035.log.gz 2024-09-17T05:38:05.977 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54154.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54154.log.gz 2024-09-17T05:38:05.977 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.23918.log 2024-09-17T05:38:05.979 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39498.log 2024-09-17T05:38:05.980 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.tmp-client.admin.23918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38788.log 0.0% 2024-09-17T05:38:05.980 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.23918.log.gz 2024-09-17T05:38:05.981 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54102.log 2024-09-17T05:38:05.981 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39498.log.gz 2024-09-17T05:38:05.982 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38788.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38788.log.gz 2024-09-17T05:38:05.983 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54102.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54102.log.gz 2024-09-17T05:38:05.984 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53801.log 2024-09-17T05:38:05.985 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46399.log 2024-09-17T05:38:05.985 INFO:teuthology.orchestra.run.smithi155.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T05:38:05.986 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46217.log 2024-09-17T05:38:05.987 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53801.log.gz 2024-09-17T05:38:05.988 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46399.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46399.log.gz 2024-09-17T05:38:05.989 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46217.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46217.log.gz 2024-09-17T05:38:05.989 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50339.log 2024-09-17T05:38:05.990 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35239.log 2024-09-17T05:38:05.992 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44254.log 2024-09-17T05:38:05.992 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50339.log.gz 2024-09-17T05:38:05.993 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35239.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35239.log.gz 2024-09-17T05:38:05.994 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44254.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44254.log.gz 2024-09-17T05:38:05.994 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40531.log 2024-09-17T05:38:05.995 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35834.log 2024-09-17T05:38:05.997 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50469.log 2024-09-17T05:38:05.997 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40531.log.gz 2024-09-17T05:38:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35834.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35834.log.gz 2024-09-17T05:38:05.999 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50469.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50469.log.gz 2024-09-17T05:38:06.000 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36755.log 2024-09-17T05:38:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54569.log 2024-09-17T05:38:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54335.log 2024-09-17T05:38:06.002 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36755.log.gz 2024-09-17T05:38:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54569.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54569.log.gz 2024-09-17T05:38:06.004 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54335.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.54335.log.gz 2024-09-17T05:38:06.005 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36964.log 2024-09-17T05:38:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51857.log 2024-09-17T05:38:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36912.log 2024-09-17T05:38:06.007 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36964.log.gz 2024-09-17T05:38:06.009 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51857.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51857.log.gz 2024-09-17T05:38:06.010 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36912.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36912.log.gz 2024-09-17T05:38:06.010 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40421.log 2024-09-17T05:38:06.012 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37156.log 2024-09-17T05:38:06.013 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50985.log 2024-09-17T05:38:06.013 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40421.log.gz 2024-09-17T05:38:06.014 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37156.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37156.log.gz 2024-09-17T05:38:06.015 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50985.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50985.log.gz 2024-09-17T05:38:06.016 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53220.log 2024-09-17T05:38:06.017 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36114.log 2024-09-17T05:38:06.018 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41523.log 2024-09-17T05:38:06.018 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53220.log.gz 2024-09-17T05:38:06.019 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36114.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36114.log.gz 2024-09-17T05:38:06.020 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47442.log 2024-09-17T05:38:06.021 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41523.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41523.log.gz 2024-09-17T05:38:06.021 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50954.log 2024-09-17T05:38:06.023 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52797.log 2024-09-17T05:38:06.023 INFO:teuthology.orchestra.run.smithi031.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47442.log.gz 2024-09-17T05:38:06.023 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50954.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50954.log.gz 2024-09-17T05:38:06.025 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52797.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52797.log.gz 2024-09-17T05:38:06.025 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35780.log 2024-09-17T05:38:06.027 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28842.log 2024-09-17T05:38:06.028 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53888.log 2024-09-17T05:38:06.028 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35780.log.gz 2024-09-17T05:38:06.029 INFO:teuthology.orchestra.run.smithi155.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T05:38:06.029 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28842.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28842.log.gz 2024-09-17T05:38:06.030 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53888.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53888.log.gz 2024-09-17T05:38:06.031 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49270.log 2024-09-17T05:38:06.032 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50592.log 2024-09-17T05:38:06.033 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35265.log 2024-09-17T05:38:06.033 INFO:teuthology.orchestra.run.smithi031.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.49270.log.gz 2024-09-17T05:38:06.034 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.50592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50592.log.gz 2024-09-17T05:38:06.036 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35265.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35265.log.gz 2024-09-17T05:38:06.036 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T05:38:06.037 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43975.log 2024-09-17T05:38:06.038 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-17T05:38:06.040 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43975.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46425.log 2024-09-17T05:38:06.040 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43975.log.gz 2024-09-17T05:38:06.044 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.46425.log: 89.7% 87.6% -- replaced with /var/log/ceph/ceph.audit.log.gz -- replaced with /var/log/ceph/ceph-client.admin.46425.log.gz 2024-09-17T05:38:06.044 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-09-17T05:38:06.044 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35642.log 2024-09-17T05:38:06.045 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38905.log 2024-09-17T05:38:06.047 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35642.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35642.log.gz 2024-09-17T05:38:06.048 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47212.log 2024-09-17T05:38:06.048 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38905.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38905.log.gz 2024-09-17T05:38:06.050 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47212.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47212.log.gz 2024-09-17T05:38:06.051 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39602.log 2024-09-17T05:38:06.052 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-17T05:38:06.054 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39602.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.39602.log.gz 2024-09-17T05:38:06.056 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47802.log 2024-09-17T05:38:06.057 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39122.log 2024-09-17T05:38:06.058 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47802.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47802.log.gz 2024-09-17T05:38:06.060 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36807.log 2024-09-17T05:38:06.061 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39122.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.39122.log.gz 2024-09-17T05:38:06.062 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log 2024-09-17T05:38:06.063 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36807.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36807.log.gz 2024-09-17T05:38:06.067 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40985.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40985.log.gz 2024-09-17T05:38:06.068 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42396.log 2024-09-17T05:38:06.070 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42396.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42396.log.gz 2024-09-17T05:38:06.070 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47604.log 2024-09-17T05:38:06.073 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47604.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47604.log.gz 2024-09-17T05:38:06.073 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38349.log 2024-09-17T05:38:06.077 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38349.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38349.log.gz 2024-09-17T05:38:06.077 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47854.log 2024-09-17T05:38:06.080 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40834.log 2024-09-17T05:38:06.080 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47854.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47854.log.gz 2024-09-17T05:38:06.083 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40834.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40834.log.gz 2024-09-17T05:38:06.083 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37016.log 2024-09-17T05:38:06.086 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37016.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.37016.log.gz 2024-09-17T05:38:06.086 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43116.log 2024-09-17T05:38:06.089 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43116.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43116.log.gz 2024-09-17T05:38:06.089 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50082.log 2024-09-17T05:38:06.092 INFO:teuthology.orchestra.run.smithi155.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-17T05:38:06.092 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36192.log 2024-09-17T05:38:06.093 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50082.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50082.log.gz 2024-09-17T05:38:06.095 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36192.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36192.log.gz 2024-09-17T05:38:06.095 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42537.log 2024-09-17T05:38:06.097 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42537.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42537.log.gz 2024-09-17T05:38:06.098 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49986.log 2024-09-17T05:38:06.101 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49986.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49986.log.gz 2024-09-17T05:38:06.101 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42686.log 2024-09-17T05:38:06.103 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42686.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42686.log.gz 2024-09-17T05:38:06.104 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45353.log 2024-09-17T05:38:06.106 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45353.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45353.log.gz 2024-09-17T05:38:06.107 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47121.log 2024-09-17T05:38:06.109 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47121.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47121.log.gz 2024-09-17T05:38:06.109 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48857.log 2024-09-17T05:38:06.112 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50495.log 2024-09-17T05:38:06.112 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48857.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48857.log.gz 2024-09-17T05:38:06.114 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47724.log 2024-09-17T05:38:06.116 INFO:teuthology.orchestra.run.smithi031.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50495.log.gz 2024-09-17T05:38:06.118 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47724.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47724.log.gz 2024-09-17T05:38:06.119 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46295.log 2024-09-17T05:38:06.121 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46295.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46295.log.gz 2024-09-17T05:38:06.121 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37759.log 2024-09-17T05:38:06.124 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42634.log 2024-09-17T05:38:06.125 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37759.log.gz 2024-09-17T05:38:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46965.log 2024-09-17T05:38:06.128 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42634.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42634.log.gz 2024-09-17T05:38:06.131 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46965.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46965.log.gz 2024-09-17T05:38:06.131 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46094.log 2024-09-17T05:38:06.133 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46094.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46094.log.gz 2024-09-17T05:38:06.134 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43923.log 2024-09-17T05:38:06.134 INFO:teuthology.orchestra.run.smithi155.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-17T05:38:06.137 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-09-17T05:38:06.137 INFO:teuthology.orchestra.run.smithi155.stderr:real 0m0.843s 2024-09-17T05:38:06.137 INFO:teuthology.orchestra.run.smithi155.stderr:user 0m3.838s 2024-09-17T05:38:06.141 INFO:teuthology.orchestra.run.smithi155.stderr:sys 0m0.411s 2024-09-17T05:38:06.144 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43923.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43923.log.gz 2024-09-17T05:38:06.144 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40704.log 2024-09-17T05:38:06.144 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40704.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40704.log.gz 2024-09-17T05:38:06.145 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42920.log 2024-09-17T05:38:06.145 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42920.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42920.log.gz 2024-09-17T05:38:06.145 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37994.log 2024-09-17T05:38:06.146 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45174.log 2024-09-17T05:38:06.146 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37994.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37994.log.gz 2024-09-17T05:38:06.149 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45174.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45174.log.gz 2024-09-17T05:38:06.149 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44693.log 2024-09-17T05:38:06.152 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44693.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44693.log.gz 2024-09-17T05:38:06.152 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52013.log 2024-09-17T05:38:06.155 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35808.log 2024-09-17T05:38:06.155 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52013.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52013.log.gz 2024-09-17T05:38:06.157 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35808.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35808.log.gz 2024-09-17T05:38:06.158 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39472.log 2024-09-17T05:38:06.161 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39472.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.39472.log.gz 2024-09-17T05:38:06.161 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53111.log 2024-09-17T05:38:06.163 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53111.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53111.log.gz 2024-09-17T05:38:06.164 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41881.log 2024-09-17T05:38:06.167 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47264.log 2024-09-17T05:38:06.167 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.41881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41881.log.gz 2024-09-17T05:38:06.168 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5/var/log/ceph/ceph-client.admin.47264.log: --verbose -- /var/log/ceph/ceph-client.admin.28784.log 2024-09-17T05:38:06.168 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47264.log.gz 2024-09-17T05:38:06.170 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28784.log: 76.0% -- replaced with /var/log/ceph/ceph-client.admin.28784.log.gz 2024-09-17T05:38:06.170 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48482.log 2024-09-17T05:38:06.173 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48482.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48482.log.gz 2024-09-17T05:38:06.173 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53946.log 2024-09-17T05:38:06.176 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53946.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53946.log.gz 2024-09-17T05:38:06.176 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38647.log 2024-09-17T05:38:06.179 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38647.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38647.log.gz 2024-09-17T05:38:06.179 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36701.log 2024-09-17T05:38:06.184 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52771.log 2024-09-17T05:38:06.184 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36701.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36701.log.gz 2024-09-17T05:38:06.184 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52771.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38844.log 2024-09-17T05:38:06.184 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52771.log.gz 2024-09-17T05:38:06.185 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38814.log 2024-09-17T05:38:06.187 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50719.log 2024-09-17T05:38:06.189 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48612.log 2024-09-17T05:38:06.189 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38814.log.gz 2024-09-17T05:38:06.189 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50719.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38844.log.gz 2024-09-17T05:38:06.190 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50719.log.gz 2024-09-17T05:38:06.191 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34052.log 2024-09-17T05:38:06.195 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48612.log: /var/log/ceph/ceph-client.admin.34052.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34052.log.gz 2024-09-17T05:38:06.195 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48612.log.gz 2024-09-17T05:38:06.196 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39955.log 2024-09-17T05:38:06.198 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39955.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39955.log.gz 2024-09-17T05:38:06.199 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50391.log 2024-09-17T05:38:06.201 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50391.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50391.log.gz 2024-09-17T05:38:06.202 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51265.log 2024-09-17T05:38:06.204 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51265.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51265.log.gz 2024-09-17T05:38:06.204 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49208.log 2024-09-17T05:38:06.207 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49588.log 2024-09-17T05:38:06.207 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49208.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.49208.log.gz 2024-09-17T05:38:06.211 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49588.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49588.log.gz 2024-09-17T05:38:06.211 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53734.log 2024-09-17T05:38:06.213 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53734.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.53734.log.gz 2024-09-17T05:38:06.214 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33984.log 2024-09-17T05:38:06.217 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43600.log 2024-09-17T05:38:06.217 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33984.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33984.log.gz 2024-09-17T05:38:06.217 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54621.log 2024-09-17T05:38:06.220 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54621.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54621.log.gz 2024-09-17T05:38:06.221 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28902.log 2024-09-17T05:38:06.221 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43600.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43600.log.gz 2024-09-17T05:38:06.223 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28902.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.28902.log.gz 2024-09-17T05:38:06.224 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41037.log 2024-09-17T05:38:06.227 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41037.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41037.log.gz 2024-09-17T05:38:06.227 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43001.log 2024-09-17T05:38:06.228 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44228.log 2024-09-17T05:38:06.230 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43001.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43001.log.gz 2024-09-17T05:38:06.233 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44228.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44228.log.gz 2024-09-17T05:38:06.233 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46042.log 2024-09-17T05:38:06.236 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46042.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46042.log.gz 2024-09-17T05:38:06.236 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51775.log 2024-09-17T05:38:06.239 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51775.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51775.log.gz 2024-09-17T05:38:06.239 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39655.log 2024-09-17T05:38:06.245 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47326.log 2024-09-17T05:38:06.245 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39655.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39655.log.gz 2024-09-17T05:38:06.245 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47326.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47326.log.gz 2024-09-17T05:38:06.245 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35754.log 2024-09-17T05:38:06.247 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53402.log 2024-09-17T05:38:06.248 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35754.log.gz 2024-09-17T05:38:06.248 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34851.log 2024-09-17T05:38:06.251 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53402.log: gzip/var/log/ceph/ceph-client.admin.34851.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34827.log 2024-09-17T05:38:06.252 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34851.log.gz 2024-09-17T05:38:06.252 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54725.log 2024-09-17T05:38:06.254 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34827.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34827.log.gz 2024-09-17T05:38:06.255 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44313.log 2024-09-17T05:38:06.257 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53402.log.gz 2024-09-17T05:38:06.257 INFO:teuthology.orchestra.run.smithi031.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.54725.log.gz 2024-09-17T05:38:06.257 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50166.log 2024-09-17T05:38:06.260 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44313.log: /var/log/ceph/ceph-client.admin.50166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37066.log 2024-09-17T05:38:06.261 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50166.log.gz 2024-09-17T05:38:06.262 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44313.log.gz 2024-09-17T05:38:06.263 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49395.log 2024-09-17T05:38:06.265 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37066.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37066.log.gz 2024-09-17T05:38:06.268 INFO:teuthology.orchestra.run.smithi031.stderr:gzip/var/log/ceph/ceph-client.admin.49395.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52955.log 2024-09-17T05:38:06.269 INFO:teuthology.orchestra.run.smithi031.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.49395.log.gz 2024-09-17T05:38:06.271 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28990.log 2024-09-17T05:38:06.275 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28990.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.28990.log.gz 2024-09-17T05:38:06.275 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52955.log.gz 2024-09-17T05:38:06.275 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54232.log 2024-09-17T05:38:06.278 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54232.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54232.log.gz 2024-09-17T05:38:06.278 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42423.log 2024-09-17T05:38:06.281 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42423.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42423.log.gz 2024-09-17T05:38:06.281 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39375.log 2024-09-17T05:38:06.284 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53137.log 2024-09-17T05:38:06.284 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39375.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39375.log.gz 2024-09-17T05:38:06.287 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53137.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53137.log.gz 2024-09-17T05:38:06.287 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35343.log 2024-09-17T05:38:06.289 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35343.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35343.log.gz 2024-09-17T05:38:06.290 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53772.log 2024-09-17T05:38:06.293 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53772.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53772.log.gz 2024-09-17T05:38:06.293 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38111.log 2024-09-17T05:38:06.296 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38111.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38111.log.gz 2024-09-17T05:38:06.296 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40117.log 2024-09-17T05:38:06.299 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40117.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40117.log.gz 2024-09-17T05:38:06.299 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37707.log 2024-09-17T05:38:06.304 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38137.log 2024-09-17T05:38:06.304 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37707.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37707.log.gz 2024-09-17T05:38:06.304 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46172.log 2024-09-17T05:38:06.305 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38137.log.gz 2024-09-17T05:38:06.307 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46172.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46172.log.gz 2024-09-17T05:38:06.308 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43302.log 2024-09-17T05:38:06.310 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46458.log 2024-09-17T05:38:06.311 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43302.log.gz 2024-09-17T05:38:06.313 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52929.log 2024-09-17T05:38:06.315 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46458.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46458.log.gz 2024-09-17T05:38:06.317 INFO:teuthology.orchestra.run.smithi031.stderr:gzip/var/log/ceph/ceph-client.admin.52929.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51038.log 2024-09-17T05:38:06.318 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52929.log.gz 2024-09-17T05:38:06.321 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49927.log 2024-09-17T05:38:06.323 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49927.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49927.log.gz 2024-09-17T05:38:06.324 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log 2024-09-17T05:38:06.325 INFO:teuthology.orchestra.run.smithi031.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51038.log.gz 2024-09-17T05:38:06.328 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40143.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40143.log.gz 2024-09-17T05:38:06.328 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47364.log 2024-09-17T05:38:06.331 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47364.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47364.log.gz 2024-09-17T05:38:06.331 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51291.log 2024-09-17T05:38:06.333 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51291.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51291.log.gz 2024-09-17T05:38:06.334 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40335.log 2024-09-17T05:38:06.335 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51343.log 2024-09-17T05:38:06.340 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40335.log: /var/log/ceph/ceph-client.admin.51343.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51343.log.gz 2024-09-17T05:38:06.340 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40335.log.gz 2024-09-17T05:38:06.341 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49420.log 2024-09-17T05:38:06.345 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49420.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.49420.log.gz 2024-09-17T05:38:06.345 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51688.log 2024-09-17T05:38:06.345 INFO:teuthology.orchestra.run.smithi031.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T05:38:06.345 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46887.log 2024-09-17T05:38:06.346 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51688.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51688.log.gz 2024-09-17T05:38:06.346 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41324.log 2024-09-17T05:38:06.346 INFO:teuthology.orchestra.run.smithi031.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46887.log.gz 2024-09-17T05:38:06.348 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48454.log 2024-09-17T05:38:06.349 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38673.log 2024-09-17T05:38:06.350 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41324.log.gz 2024-09-17T05:38:06.351 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48454.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48454.log.gz 2024-09-17T05:38:06.352 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38673.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38673.log.gz 2024-09-17T05:38:06.353 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37270.log 2024-09-17T05:38:06.354 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51142.log 2024-09-17T05:38:06.356 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37270.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37270.log.gz 2024-09-17T05:38:06.357 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51142.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51142.log.gz 2024-09-17T05:38:06.357 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40065.log 2024-09-17T05:38:06.358 INFO:teuthology.orchestra.run.smithi031.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T05:38:06.358 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50313.log 2024-09-17T05:38:06.360 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50283.log 2024-09-17T05:38:06.360 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40065.log.gz 2024-09-17T05:38:06.361 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50313.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50313.log.gz 2024-09-17T05:38:06.362 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50283.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50283.log.gz 2024-09-17T05:38:06.363 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54517.log 2024-09-17T05:38:06.364 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34433.log 2024-09-17T05:38:06.366 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28786.log 2024-09-17T05:38:06.366 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54517.log.gz 2024-09-17T05:38:06.367 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51369.log 2024-09-17T05:38:06.367 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34433.log.gz 2024-09-17T05:38:06.368 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45382.log 2024-09-17T05:38:06.368 INFO:teuthology.orchestra.run.smithi031.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.28786.log.gz 2024-09-17T05:38:06.369 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51369.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51369.log.gz 2024-09-17T05:38:06.369 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51749.log 2024-09-17T05:38:06.370 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45382.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45382.log.gz 2024-09-17T05:38:06.370 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34195.log 2024-09-17T05:38:06.372 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47550.log 2024-09-17T05:38:06.372 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51749.log.gz 2024-09-17T05:38:06.373 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34195.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34195.log.gz 2024-09-17T05:38:06.373 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38578.log 2024-09-17T05:38:06.374 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47550.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.47550.log.gz 2024-09-17T05:38:06.374 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49536.log 2024-09-17T05:38:06.376 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.38578.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.0.38578.log.gz -5 2024-09-17T05:38:06.376 INFO:teuthology.orchestra.run.smithi031.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42147.log 2024-09-17T05:38:06.377 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48831.log 2024-09-17T05:38:06.377 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49536.log.gz 2024-09-17T05:38:06.378 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42147.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42147.log.gz 2024-09-17T05:38:06.379 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40013.log 2024-09-17T05:38:06.379 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48831.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48831.log.gz 2024-09-17T05:38:06.380 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50842.log 2024-09-17T05:38:06.381 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42764.log 2024-09-17T05:38:06.382 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40013.log.gz 2024-09-17T05:38:06.382 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50842.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50842.log.gz 2024-09-17T05:38:06.383 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51395.log 2024-09-17T05:38:06.384 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42764.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42764.log.gz 2024-09-17T05:38:06.384 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46146.log 2024-09-17T05:38:06.385 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53272.log 2024-09-17T05:38:06.385 INFO:teuthology.orchestra.run.smithi031.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51395.log.gz 2024-09-17T05:38:06.386 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38245.log 2024-09-17T05:38:06.386 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46146.log.gz 2024-09-17T05:38:06.387 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.53272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46993.log 2024-09-17T05:38:06.388 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53272.log.gz 2024-09-17T05:38:06.389 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45961.log 2024-09-17T05:38:06.389 INFO:teuthology.orchestra.run.smithi031.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38245.log.gz 2024-09-17T05:38:06.390 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46993.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46993.log.gz 2024-09-17T05:38:06.391 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52257.log 2024-09-17T05:38:06.391 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45961.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45961.log.gz 2024-09-17T05:38:06.391 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51090.log 2024-09-17T05:38:06.393 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45894.log 2024-09-17T05:38:06.393 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52257.log.gz 2024-09-17T05:38:06.395 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51090.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51090.log.gz 2024-09-17T05:38:06.395 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45894.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.45894.log.gz 2024-09-17T05:38:06.396 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37551.log 2024-09-17T05:38:06.397 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41898.log 2024-09-17T05:38:06.398 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51961.log 2024-09-17T05:38:06.398 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37551.log.gz 2024-09-17T05:38:06.399 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41898.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41898.log.gz 2024-09-17T05:38:06.400 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49875.log 2024-09-17T05:38:06.401 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.51961.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51961.log.gz 2024-09-17T05:38:06.401 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34277.log 2024-09-17T05:38:06.403 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49562.log 2024-09-17T05:38:06.403 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49875.log.gz 2024-09-17T05:38:06.403 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34838.log 2024-09-17T05:38:06.403 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34277.log.gz 2024-09-17T05:38:06.405 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49562.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49562.log.gz 2024-09-17T05:38:06.405 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45762.log 2024-09-17T05:38:06.406 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34838.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34838.log.gz 2024-09-17T05:38:06.406 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45302.log 2024-09-17T05:38:06.408 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52231.log 2024-09-17T05:38:06.408 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45762.log.gz 2024-09-17T05:38:06.409 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45302.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45302.log.gz 2024-09-17T05:38:06.410 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52231.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52231.log.gz 2024-09-17T05:38:06.410 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50134.log 2024-09-17T05:38:06.412 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28935.log 2024-09-17T05:38:06.413 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43546.log 2024-09-17T05:38:06.413 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50134.log.gz 2024-09-17T05:38:06.414 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37301.log 2024-09-17T05:38:06.414 INFO:teuthology.orchestra.run.smithi031.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28935.log.gz 2024-09-17T05:38:06.415 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43546.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43546.log.gz 2024-09-17T05:38:06.416 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36781.log 2024-09-17T05:38:06.416 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37301.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37301.log.gz 2024-09-17T05:38:06.417 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37733.log 2024-09-17T05:38:06.418 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49478.log 2024-09-17T05:38:06.418 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36781.log.gz 2024-09-17T05:38:06.420 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37733.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37733.log.gz 2024-09-17T05:38:06.420 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33582.log 2024-09-17T05:38:06.421 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49478.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49478.log.gz 2024-09-17T05:38:06.421 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48058.log 2024-09-17T05:38:06.423 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.33582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41380.log 2024-09-17T05:38:06.423 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33582.log.gz 2024-09-17T05:38:06.423 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48058.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48058.log.gz 2024-09-17T05:38:06.424 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49666.log 2024-09-17T05:38:06.425 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47671.log 2024-09-17T05:38:06.425 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41380.log.gz 2024-09-17T05:38:06.426 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.49666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44462.log 2024-09-17T05:38:06.427 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49666.log.gz 2024-09-17T05:38:06.428 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53603.log 2024-09-17T05:38:06.428 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47671.log.gz 2024-09-17T05:38:06.429 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46557.log 2024-09-17T05:38:06.429 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44462.log.gz 2024-09-17T05:38:06.430 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.53603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53603.log.gz 2024-09-17T05:38:06.431 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38481.log 2024-09-17T05:38:06.431 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46557.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46557.log.gz 2024-09-17T05:38:06.431 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38595.log 2024-09-17T05:38:06.433 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41497.log 2024-09-17T05:38:06.434 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38595.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.38481.log.gz 2024-09-17T05:38:06.434 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44585.log 2024-09-17T05:38:06.434 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38595.log.gz 2024-09-17T05:38:06.435 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36729.log 2024-09-17T05:38:06.436 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41497.log.gz 2024-09-17T05:38:06.437 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48958.log 2024-09-17T05:38:06.437 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44585.log.gz 2024-09-17T05:38:06.438 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36729.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36729.log.gz 2024-09-17T05:38:06.438 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54831.log 2024-09-17T05:38:06.439 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44667.log 2024-09-17T05:38:06.439 INFO:teuthology.orchestra.run.smithi031.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.48958.log.gz 2024-09-17T05:38:06.441 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.54831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48137.log 2024-09-17T05:38:06.441 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54831.log.gz 2024-09-17T05:38:06.441 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44667.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44667.log.gz 2024-09-17T05:38:06.443 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48137.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48137.log.gz 2024-09-17T05:38:06.444 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44345.log 2024-09-17T05:38:06.445 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44524.log 2024-09-17T05:38:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50635.log 2024-09-17T05:38:06.446 INFO:teuthology.orchestra.run.smithi031.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44345.log.gz 2024-09-17T05:38:06.447 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39401.log 2024-09-17T05:38:06.447 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44524.log.gz 2024-09-17T05:38:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.50635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48983.log 2024-09-17T05:38:06.449 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50635.log.gz 2024-09-17T05:38:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39401.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39401.log.gz 2024-09-17T05:38:06.450 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41415.log 2024-09-17T05:38:06.451 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.48983.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.48983.log.gz 2024-09-17T05:38:06.451 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42459.log 2024-09-17T05:38:06.453 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42738.log 2024-09-17T05:38:06.453 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41415.log.gz 2024-09-17T05:38:06.453 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42459.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42459.log.gz 2024-09-17T05:38:06.454 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43897.log 2024-09-17T05:38:06.454 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42738.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42738.log.gz 2024-09-17T05:38:06.455 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44797.log 2024-09-17T05:38:06.456 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52903.log 2024-09-17T05:38:06.457 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43897.log.gz 2024-09-17T05:38:06.458 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44797.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44797.log.gz 2024-09-17T05:38:06.459 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.52903.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52903.log.gz 2024-09-17T05:38:06.459 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47019.log 2024-09-17T05:38:06.460 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39576.log 2024-09-17T05:38:06.462 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.47019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44150.log 2024-09-17T05:38:06.462 INFO:teuthology.orchestra.run.smithi031.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47019.log.gz 2024-09-17T05:38:06.463 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39576.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39576.log.gz 2024-09-17T05:38:06.464 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44150.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44150.log.gz 2024-09-17T05:38:06.479 INFO:teuthology.orchestra.run.smithi031.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T05:38:06.509 INFO:teuthology.orchestra.run.smithi031.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T05:38:06.549 INFO:teuthology.orchestra.run.smithi031.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-17T05:38:06.575 INFO:teuthology.orchestra.run.smithi031.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T05:38:06.932 INFO:teuthology.orchestra.run.smithi031.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-17T05:38:06.934 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-09-17T05:38:06.934 INFO:teuthology.orchestra.run.smithi031.stderr:real 0m1.656s 2024-09-17T05:38:06.934 INFO:teuthology.orchestra.run.smithi031.stderr:user 0m6.800s 2024-09-17T05:38:06.934 INFO:teuthology.orchestra.run.smithi031.stderr:sys 0m1.718s 2024-09-17T05:38:06.935 INFO:tasks.ceph:Archiving logs... 2024-09-17T05:38:06.935 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908692/remote/smithi031/log 2024-09-17T05:38:06.937 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T05:38:08.230 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908692/remote/smithi155/log 2024-09-17T05:38:08.230 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T05:38:08.727 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T05:38:08.736 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T05:38:08.737 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T05:38:08.740 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T05:38:08.820 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T05:38:08.828 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T05:38:08.829 DEBUG:teuthology.orchestra.run.smithi031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:38:08.832 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:38:08.845 INFO:teuthology.orchestra.run.smithi031.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T05:38:08.845 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================== 2024-09-17T05:38:08.845 INFO:teuthology.orchestra.run.smithi031.stdout:+hv01.front.sepi 67.205.162.81 3 u 7 64 377 0.099 -1.863 1.340 2024-09-17T05:38:08.845 INFO:teuthology.orchestra.run.smithi031.stdout:*hv02.front.sepi 63.231.80.2 3 u 3 64 377 0.084 -0.384 1.761 2024-09-17T05:38:08.845 INFO:teuthology.orchestra.run.smithi031.stdout:+hv03.front.sepi 74.6.168.72 3 u 2 64 377 0.080 -0.519 1.572 2024-09-17T05:38:08.845 INFO:teuthology.orchestra.run.smithi031.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-09-17T05:38:08.847 INFO:teuthology.orchestra.run.smithi155.stdout: remote refid st t when poll reach delay offset jitter 2024-09-17T05:38:08.848 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================== 2024-09-17T05:38:08.848 INFO:teuthology.orchestra.run.smithi155.stdout:+hv01.front.sepi 67.205.162.81 3 u 4 64 377 0.072 -5.963 1.258 2024-09-17T05:38:08.848 INFO:teuthology.orchestra.run.smithi155.stdout:+hv02.front.sepi 63.231.80.2 3 u 4 64 377 0.094 -2.815 2.575 2024-09-17T05:38:08.848 INFO:teuthology.orchestra.run.smithi155.stdout:*hv03.front.sepi 74.6.168.72 3 u 14 64 377 0.108 -4.296 1.972 2024-09-17T05:38:08.848 INFO:teuthology.orchestra.run.smithi155.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-09-17T05:38:08.849 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T05:38:08.857 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T05:38:08.858 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T05:38:08.866 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T05:38:08.875 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T05:38:08.884 INFO:teuthology.task.internal:Duration was 1302.069308 seconds 2024-09-17T05:38:08.885 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T05:38:08.894 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T05:38:08.894 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T05:38:08.897 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T05:38:09.014 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T05:38:09.014 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi031.front.sepia.ceph.com 2024-09-17T05:38:09.014 DEBUG:teuthology.orchestra.run.smithi031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T05:38:09.036 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2024-09-17T05:38:09.036 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T05:38:09.056 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T05:38:09.057 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T05:38:09.087 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T05:38:09.143 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T05:38:09.143 DEBUG:teuthology.orchestra.run.smithi031:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T05:38:09.175 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T05:38:09.266 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T05:38:09.277 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T05:38:09.277 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T05:38:09.298 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T05:38:09.318 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T05:38:09.328 DEBUG:teuthology.orchestra.run.smithi031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:38:09.342 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:38:09.357 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = core 2024-09-17T05:38:09.376 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2024-09-17T05:38:09.394 DEBUG:teuthology.orchestra.run.smithi031:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:38:09.426 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:38:09.426 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:38:09.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:38:09.443 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T05:38:09.452 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T05:38:09.453 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908692/remote/smithi031 2024-09-17T05:38:09.453 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T05:38:09.496 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908692/remote/smithi155 2024-09-17T05:38:09.496 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T05:38:09.523 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T05:38:09.524 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T05:38:09.538 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T05:38:09.568 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T05:38:09.580 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T05:38:09.580 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T05:38:09.591 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T05:38:09.592 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T05:38:09.595 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T05:38:09.600 INFO:teuthology.orchestra.run.smithi031.stdout: 658142 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 05:38 /home/ubuntu/cephtest 2024-09-17T05:38:09.622 INFO:teuthology.orchestra.run.smithi155.stdout: 655441 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 05:38 /home/ubuntu/cephtest 2024-09-17T05:38:09.623 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T05:38:09.635 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T05:38:09.658 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}} duration: 1302.0693078041077 flavor: default owner: scheduled_avan@teuthology success: true 2024-09-17T05:38:09.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T05:38:09.742 INFO:teuthology.run:pass